-- Logs begin at Sun 2022-09-04 00:10:42 UTC, end at Sun 2022-09-04 02:41:15 UTC. -- Sep 04 00:44:09.246182 n-d-master-1 systemd[1]: Starting Devstack devstack@keystone.service... Sep 04 00:44:09.253410 n-d-master-1 devstack@keystone.service[81811]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 04 00:44:09.255440 n-d-master-1 devstack@keystone.service[81811]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Sep 4 00:44:09 2022] *** Sep 04 00:44:09.255440 n-d-master-1 devstack@keystone.service[81811]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 04 00:44:09.255440 n-d-master-1 devstack@keystone.service[81811]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 04 00:44:09.255440 n-d-master-1 devstack@keystone.service[81811]: nodename: n-d-master-1 Sep 04 00:44:09.255440 n-d-master-1 devstack@keystone.service[81811]: machine: x86_64 Sep 04 00:44:09.255440 n-d-master-1 devstack@keystone.service[81811]: clock source: unix Sep 04 00:44:09.255440 n-d-master-1 devstack@keystone.service[81811]: pcre jit disabled Sep 04 00:44:09.255883 n-d-master-1 devstack@keystone.service[81811]: detected number of CPU cores: 4 Sep 04 00:44:09.255883 n-d-master-1 devstack@keystone.service[81811]: current working directory: / Sep 04 00:44:09.255883 n-d-master-1 devstack@keystone.service[81811]: detected binary path: /usr/bin/uwsgi-core Sep 04 00:44:09.255883 n-d-master-1 devstack@keystone.service[81811]: your processes number limit is 47680 Sep 04 00:44:09.255883 n-d-master-1 devstack@keystone.service[81811]: your memory page size is 4096 bytes Sep 04 00:44:09.255883 n-d-master-1 devstack@keystone.service[81811]: detected max file descriptor number: 2048 Sep 04 00:44:09.255883 n-d-master-1 devstack@keystone.service[81811]: lock engine: pthread robust mutexes Sep 04 00:44:09.255883 n-d-master-1 devstack@keystone.service[81811]: thunder lock: enabled Sep 04 00:44:09.255883 n-d-master-1 devstack@keystone.service[81811]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 04 00:44:09.255883 n-d-master-1 devstack@keystone.service[81811]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 04 00:44:09.296437 n-d-master-1 devstack@keystone.service[81811]: Python main interpreter initialized at 0x55f8fbea89c0 Sep 04 00:44:09.296437 n-d-master-1 devstack@keystone.service[81811]: python threads support enabled Sep 04 00:44:09.296437 n-d-master-1 devstack@keystone.service[81811]: your server socket listen backlog is limited to 100 connections Sep 04 00:44:09.296437 n-d-master-1 devstack@keystone.service[81811]: your mercy for graceful operations on workers is 90 seconds Sep 04 00:44:09.296823 n-d-master-1 devstack@keystone.service[81811]: mapped 403077 bytes (393 KB) for 2 cores Sep 04 00:44:09.296902 n-d-master-1 devstack@keystone.service[81811]: *** Operational MODE: preforking *** Sep 04 00:44:09.297167 n-d-master-1 devstack@keystone.service[81811]: *** uWSGI is running in multiple interpreter mode *** Sep 04 00:44:09.297167 n-d-master-1 devstack@keystone.service[81811]: spawned uWSGI master process (pid: 81811) Sep 04 00:44:09.297369 n-d-master-1 systemd[1]: Started Devstack devstack@keystone.service. Sep 04 00:44:09.301478 n-d-master-1 devstack@keystone.service[81811]: spawned uWSGI worker 1 (pid: 81824, cores: 1) Sep 04 00:44:09.301478 n-d-master-1 devstack@keystone.service[81811]: spawned uWSGI worker 2 (pid: 81825, cores: 1) Sep 04 00:44:09.301478 n-d-master-1 devstack@keystone.service[81811]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 04 00:44:13.541257 n-d-master-1 devstack@keystone.service[81824]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 04 00:44:13.541257 n-d-master-1 devstack@keystone.service[81824]: from cryptography.utils import int_from_bytes Sep 04 00:44:13.542007 n-d-master-1 devstack@keystone.service[81825]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 04 00:44:13.542007 n-d-master-1 devstack@keystone.service[81825]: from cryptography.utils import int_from_bytes Sep 04 00:44:13.542441 n-d-master-1 devstack@keystone.service[81824]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 04 00:44:13.542441 n-d-master-1 devstack@keystone.service[81824]: from cryptography.utils import int_from_bytes Sep 04 00:44:13.542564 n-d-master-1 devstack@keystone.service[81825]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 04 00:44:13.542564 n-d-master-1 devstack@keystone.service[81825]: from cryptography.utils import int_from_bytes Sep 04 00:44:13.591487 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 04 00:44:13.591645 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 04 00:44:13.591722 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 04 00:44:13.591805 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 04 00:44:13.591877 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] command line args: [] {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 04 00:44:13.591957 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] command line args: [] {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 04 00:44:13.592113 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 04 00:44:13.592198 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 04 00:44:13.592295 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ================================================================================ {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 04 00:44:13.592378 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ================================================================================ {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 04 00:44:13.592546 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] admin_token = **** {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.592632 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] admin_token = **** {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.592792 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] config_dir = [] {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.592873 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] config_dir = [] {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.592972 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.593055 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.593156 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] config_source = [] {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.593244 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] config_source = [] {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.593316 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] debug = True {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.593389 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] debug = True {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.593531 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.593846 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.593974 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.594076 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.594175 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.594274 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.594274 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.594472 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.594573 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.594673 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.594772 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] list_limit = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.594879 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] list_limit = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.594972 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] log_config_append = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.595072 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] log_config_append = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.595172 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.595277 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.595372 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] log_dir = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.595470 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] log_dir = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.595569 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] log_file = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.595679 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] log_file = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.595775 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.595858 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.595974 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.596049 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.596168 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.596253 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.596324 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.596447 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.596523 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.596644 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.596729 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.596802 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.596919 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.596993 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.597113 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.597196 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.597276 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.597390 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.597550 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.597679 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.597759 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.597880 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.597964 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.598081 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.598172 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.598257 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.598380 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.598463 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.598650 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.598729 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.599134 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.599216 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.599343 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] publish_errors = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.599419 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] publish_errors = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.599533 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.599607 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.599731 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.599813 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.599884 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.600003 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.600123 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.600221 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.600353 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.600430 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.600586 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] standard_threads = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.600664 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] standard_threads = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.600817 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.600896 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.601052 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.601137 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.601214 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.601289 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.601425 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] use_journal = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.601522 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] use_journal = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.601593 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] use_json = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.601673 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] use_json = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.601744 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] use_stderr = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.601818 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] use_stderr = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.601896 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] use_syslog = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.601982 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] use_syslog = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.602181 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.602263 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:44:13.602339 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.602410 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.602567 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.602670 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.602849 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.602932 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.603089 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.603164 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.603332 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.603410 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.603567 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.603642 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.603810 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.603895 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.604044 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.604121 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.604284 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.604360 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.604527 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.604602 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.604770 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.604853 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.605002 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.605078 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.605243 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.605325 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.605494 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.605582 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.605742 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.605817 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.605989 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.606065 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.606225 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.606305 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.606472 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.606551 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.606722 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.606907 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.606989 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.607064 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.607181 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.607258 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.607685 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.607772 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.607940 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.608015 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.608188 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.608275 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.608435 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.608521 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.608661 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.608736 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.608887 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.608966 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.609113 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.609197 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.609343 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.609420 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.609613 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.609691 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.609858 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.609944 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.610083 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.610159 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.610310 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.610385 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.610551 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.610634 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.610793 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.610869 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.611024 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.611099 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.611267 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.611351 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.611493 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.611570 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.611727 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.611808 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.611957 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.612040 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.612185 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.612261 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.612408 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.612483 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.612635 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.612788 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.612867 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.612937 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.613084 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.613166 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.613326 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.613409 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.613560 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.613645 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.613795 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.613873 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.614023 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.614111 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.614253 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.614328 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.614486 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.614562 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.614729 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.614814 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.614957 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.615032 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.615187 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.615267 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.615419 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.615504 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.615650 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.615725 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.615885 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.615974 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.616116 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.616193 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.616340 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.616415 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.616583 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.616660 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.616816 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.616894 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.617045 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.617120 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.617271 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.617360 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.617548 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.617640 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.617780 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.617864 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.618009 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.618087 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.618752 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.618837 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.618990 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.619071 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.619254 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.619332 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.619488 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.619571 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.619730 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.619807 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.619970 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.620050 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.620203 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.620287 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.620435 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.620526 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.620665 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.620741 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.620910 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.620993 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.621141 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.621219 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.621375 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.621498 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.621637 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.621723 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.621871 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.621949 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.622111 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.622217 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.622343 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.622447 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.622575 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.622681 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.622807 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.622910 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.623033 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.623112 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.623266 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.623359 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.623521 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.623598 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.623756 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.623871 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.623998 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.624083 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.624234 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.624309 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.624464 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.624543 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.624733 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.624811 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.624926 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.625001 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.625121 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.625209 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.625355 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.625461 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.625605 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.625685 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.625833 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.625913 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.626057 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.626143 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.626290 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.626373 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.626514 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.626594 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.626749 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.626836 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.626981 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.627059 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.627222 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.627339 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.627455 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.627541 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.627705 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.627790 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.627960 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.628041 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.628196 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.628345 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.628433 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] auth.external = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.628513 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] auth.external = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.628639 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.628720 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.628926 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.629005 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.629155 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.629244 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.629380 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] auth.password = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.629476 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] auth.password = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.629632 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] auth.token = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.629711 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] auth.token = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.629866 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.629961 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.630098 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.630178 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.630339 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.630423 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.630563 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.630649 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.630806 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.630884 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.631043 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.631120 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.631271 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.631356 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.631501 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] credential.caching = True {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.631581 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] credential.caching = True {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.631746 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.631823 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.631990 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.632076 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.632233 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.632312 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.632473 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.632551 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.632712 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.632798 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.632946 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.633030 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.633186 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.633263 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.633452 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.633546 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.633689 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.633775 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.634506 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.634597 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.634794 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.634883 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.635040 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.635119 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.635300 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.635379 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.635541 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.635628 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.635794 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.635873 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.636027 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] federation.caching = True {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.636106 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] federation.caching = True {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.636263 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.636354 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.636508 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.636587 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.636761 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.636839 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.636987 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.637067 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.637232 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.637314 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.637483 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.637574 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.637736 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.637817 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.637968 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.638047 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.638220 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.638298 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.638448 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.638526 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.638685 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.638764 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.638921 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] identity.caching = True {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.638998 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] identity.caching = True {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.639164 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.639250 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.639408 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.639493 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.639643 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.639720 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.639876 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.639955 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.640120 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.640206 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.640346 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.640423 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.640579 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.640659 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.640824 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.640901 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.641069 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.641146 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.641298 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.641378 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.641554 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.641635 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.641783 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.641862 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.642026 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.642106 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.642268 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.642345 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.642511 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.642589 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.642762 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.642841 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.643002 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.643079 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.643268 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.643348 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.643505 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.643583 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.643736 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.643813 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.643964 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.644042 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.644196 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.644276 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.644422 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.644500 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.644657 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.644743 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.644891 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.644970 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.645127 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.645206 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.645372 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.645500 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.645631 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.645709 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.645872 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.645948 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.646115 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.646202 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.646350 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.646427 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.646591 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.646668 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.646835 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.646920 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.647059 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.647136 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.647292 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.647370 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.647520 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.647605 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.647751 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.647829 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.647986 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.648063 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.648223 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.648309 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.648458 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.648537 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.648691 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.648768 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.648933 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.649018 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.649280 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.649359 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.649568 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.649659 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.649804 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.649890 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.650050 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.650128 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.650298 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.650375 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.650530 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.650615 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.650766 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.650843 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.651000 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.651076 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.651230 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.user = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.651315 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.user = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.651464 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.651542 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.651719 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.651798 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.651950 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.652035 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.652193 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.652268 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.652437 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.652516 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.652682 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.652767 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.652912 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.652989 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.653140 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.653218 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.653374 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.653481 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.653631 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.653710 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.653864 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.653941 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.654089 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.654174 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.654332 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.654409 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.654574 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.654652 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.654817 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.654901 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.655056 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.655134 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.655298 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.655375 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.655525 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.655612 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.655768 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.655845 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.655998 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.656075 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.656231 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.656321 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.656469 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.656547 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.656698 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.656774 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.656939 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.657025 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.657183 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.657260 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.657415 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.657580 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.657689 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.657780 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.657918 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.657996 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.658159 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.658239 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.658392 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.658479 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.658623 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.658700 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.658855 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.658932 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.659099 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.659184 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.659336 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.659413 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.659564 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.659640 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.659797 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.659882 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.660035 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] resource.caching = True {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.660112 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] resource.caching = True {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.660277 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.660353 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.660521 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.660606 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.660752 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.660829 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.660997 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.661074 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.661240 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.661326 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.661492 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.661573 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.661736 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.661813 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.661962 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.662037 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.662194 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.662271 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.662425 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] role.caching = True {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.662502 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] role.caching = True {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.662664 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] role.driver = sql {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.662743 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] role.driver = sql {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.662891 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.662968 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.663133 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.663210 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.663376 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.663455 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.663615 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.663692 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.663857 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.663936 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.664100 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.664179 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.664338 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.664415 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.664579 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.664656 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.664821 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.664900 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.665048 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.665125 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.665314 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.665392 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.665580 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.665668 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.665824 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.665902 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.666069 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.666146 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.666459 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.666537 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.666695 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.666772 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.666939 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.667016 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.667187 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.667265 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.667429 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.667506 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.667676 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.667762 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.667907 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.667985 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.668158 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.668237 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.668408 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.668492 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.668641 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.668718 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.668872 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.668949 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.669098 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.669183 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.669326 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.669403 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.669596 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.669676 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.669852 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.669942 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.670092 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.670170 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.670328 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.670406 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.670560 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.670646 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.670789 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.670866 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.671020 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] token.caching = True {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.671097 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] token.caching = True {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.671256 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.671343 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.671500 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.671577 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.671734 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.671811 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.672076 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.672162 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.672471 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.672550 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.672714 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.672795 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.673032 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.673144 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.673277 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.673401 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.673547 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.673681 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.673784 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.674111 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.674226 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.674440 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.674519 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.674773 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.674849 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.675034 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.675112 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.675267 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.675353 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.675510 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.675590 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.675771 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.675858 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.676027 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] database.connection = **** {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.676114 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.676268 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.676346 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] database.connection = **** {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.676512 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.676591 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.676752 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.676839 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.676991 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.677070 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.677226 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.677303 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.677479 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.677572 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.677715 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.677793 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.677949 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.678026 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.678186 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.678273 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.678415 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.678492 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.678656 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.678735 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.678888 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.678975 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.679121 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.679199 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.679353 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.679431 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.679592 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.679680 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.679819 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.679898 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.680050 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.680128 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.680278 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.680364 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.680439 n-d-master-1 devstack@keystone.service[81824]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 04 00:44:13.680511 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:44:13.680667 n-d-master-1 devstack@keystone.service[81825]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 04 00:44:13.710566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:13.710712 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81824) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:13.710795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:13.710870 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81824) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:13.710943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:13.711018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81824) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:13.719217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81824) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:13.719311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:13.747472 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81824) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:13.747700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81824) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:13.747783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:13.747998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:13.800411 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81824) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:13.800707 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:13.848750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81824) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:13.848977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81824) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:13.849588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:13.849833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.006561 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.006765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81824) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.006840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.006904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81824) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.006982 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.007061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81824) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.007136 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.007271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81824) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.007375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.007463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81824) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.007539 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.007661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81824) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.030351 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.030541 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81824) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.030663 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.030756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81824) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.030834 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.030955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81824) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.031038 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.031173 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81824) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.031265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.031386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81824) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.031468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.031593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.031673 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81824) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.031798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81824) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.043163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.043324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81824) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.055687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.056452 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81824) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.056593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.056737 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81824) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.056881 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.057007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81824) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.057133 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.057259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81824) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.057392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.057538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81824) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.057667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.057796 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81824) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.057926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.058066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81824) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 04 00:44:14.074010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.074221 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 04 00:44:14.074352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.074484 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 04 00:44:14.074606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.074744 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 04 00:44:14.074870 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.074995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 04 00:44:14.075121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.075245 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.075376 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.075502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.075626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.075762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.075888 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.076012 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.085327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.085489 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.085618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.085741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.085895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.086036 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.086168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.086299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.093159 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81825) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 04 00:44:14.093295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81824) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 04 00:44:14.096046 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81824) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 04 00:44:14.096175 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81825) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 04 00:44:14.096329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.096454 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.096609 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.096733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.096873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.097002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.097142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.097271 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.097399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.097553 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.097680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.097804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.097928 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.098052 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.098185 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.098312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.098436 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.098569 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.098694 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.098818 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.122559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.122713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.124020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81824) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 04 00:44:14.124153 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81825) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 04 00:44:14.124317 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.124455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.129009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81824) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 04 00:44:14.129139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81825) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 04 00:44:14.129274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.129404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.129609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.129734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.135943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81824) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 04 00:44:14.136112 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81825) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 04 00:44:14.136239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.136400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.141762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81824) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 04 00:44:14.142022 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81825) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 04 00:44:14.142151 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.142324 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.142450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.142591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.142721 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.142850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.142990 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.143113 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.143251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.143400 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.143524 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.143663 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.143793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.143921 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.158896 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.159170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.159297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.159550 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.162978 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81824) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 04 00:44:14.163382 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81825) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 04 00:44:14.166667 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.166960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.167110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.167368 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.171086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81824) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 04 00:44:14.171508 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81825) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 04 00:44:14.174180 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81824) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 04 00:44:14.174606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81825) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 04 00:44:14.177409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.177741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.177911 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.178026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.178212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.178318 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.178499 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.178583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.178792 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.178874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.179072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.179362 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.195000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81824) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 04 00:44:14.195285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.195550 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.195690 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81825) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 04 00:44:14.195809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.195978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.196243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.196529 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.202677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.203422 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.204207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.204965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.205752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.206034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.206525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.206801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.208673 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81824) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 04 00:44:14.208955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.209236 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.209494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81825) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 04 00:44:14.209583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.209784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.209916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.210068 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.210353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.210736 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.221517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81824) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 04 00:44:14.221801 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.222079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.222355 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.222611 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81825) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 04 00:44:14.222757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.222900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.222983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.223188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.223270 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.223468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.223850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.224132 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.224417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.239388 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81824) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 04 00:44:14.240627 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81825) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 04 00:44:14.242312 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81824) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 04 00:44:14.243578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81825) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 04 00:44:14.245203 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.246505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.246656 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.247933 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.248109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81824) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 04 00:44:14.248390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.248789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.249477 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81825) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 04 00:44:14.249765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.250175 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.255111 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.256507 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.256629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81824) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 04 00:44:14.257992 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81825) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 04 00:44:14.259477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.259866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.260149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.260423 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.260906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.261303 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.261615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.261898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.268180 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81824) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 04 00:44:14.268489 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.268768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.269725 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81825) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 04 00:44:14.270042 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.270326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.276098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81824) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 04 00:44:14.276378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.276652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.276935 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.277213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.277505 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.277762 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81825) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 04 00:44:14.277857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.278028 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.278110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.278294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.278375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.278573 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.278666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.278850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.278933 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.279123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.279206 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.279383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.279464 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.279637 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81824) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.279760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.279902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.280181 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.280463 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.280752 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.281017 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.281277 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 04 00:44:14.313703 n-d-master-1 devstack@keystone.service[81824]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f8fbea89c0 pid: 81824 (default app) Sep 04 00:44:14.315680 n-d-master-1 devstack@keystone.service[81825]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f8fbea89c0 pid: 81825 (default app) Sep 04 00:44:14.316900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49901270-8b97-4bf7-9fe7-813352bd10d5 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:14.317185 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49901270-8b97-4bf7-9fe7-813352bd10d5 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:14.317481 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49901270-8b97-4bf7-9fe7-813352bd10d5 None None] PATH_INFO: `/v3` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:14.321584 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 791 bytes} [Sun Sep 4 00:44:14 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:20.838036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805015a4-1dcd-45ee-9766-8538088e609f None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:20.838537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805015a4-1dcd-45ee-9766-8538088e609f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:20.838537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805015a4-1dcd-45ee-9766-8538088e609f None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:20.842772 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1/2] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:44:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:44:20.847962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f6b60-b20e-49f8-8ffe-7f92c55ef608 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:20.848492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f6b60-b20e-49f8-8ffe-7f92c55ef608 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:20.848492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f6b60-b20e-49f8-8ffe-7f92c55ef608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:20.919238 n-d-master-1 devstack@keystone.service[81824]: INFO dbcounter [None req-fb6f6b60-b20e-49f8-8ffe-7f92c55ef608 None None] Registered counter for database keystone Sep 04 00:44:20.938548 n-d-master-1 devstack@keystone.service[81824]: DEBUG oslo_db.sqlalchemy.engines [None req-fb6f6b60-b20e-49f8-8ffe-7f92c55ef608 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81824) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 04 00:44:20.945054 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writer thread running {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 04 00:44:21.124170 n-d-master-1 devstack@keystone.service[81824]: DEBUG passlib.handlers.bcrypt [None req-fb6f6b60-b20e-49f8-8ffe-7f92c55ef608 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81824) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 04 00:44:21.124567 n-d-master-1 devstack@keystone.service[81824]: DEBUG passlib.handlers.bcrypt [None req-fb6f6b60-b20e-49f8-8ffe-7f92c55ef608 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81824) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 04 00:44:21.182038 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-fb6f6b60-b20e-49f8-8ffe-7f92c55ef608 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:44:21.183625 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fb6f6b60-b20e-49f8-8ffe-7f92c55ef608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:44:21.308795 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2/3] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:44:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 04 00:44:21.746175 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805015a4-1dcd-45ee-9766-8538088e609f None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:21.814356 n-d-master-1 devstack@keystone.service[81825]: INFO dbcounter [None req-805015a4-1dcd-45ee-9766-8538088e609f None None] Registered counter for database keystone Sep 04 00:44:21.835129 n-d-master-1 devstack@keystone.service[81825]: DEBUG oslo_db.sqlalchemy.engines [None req-805015a4-1dcd-45ee-9766-8538088e609f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81825) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 04 00:44:21.841949 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writer thread running {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 04 00:44:21.956903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805015a4-1dcd-45ee-9766-8538088e609f None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:21.961060 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0cde4c-49d5-44d0-9420-eac98ae3cae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:21.961695 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0cde4c-49d5-44d0-9420-eac98ae3cae0 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:21.961974 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0cde4c-49d5-44d0-9420-eac98ae3cae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:21.962751 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0cde4c-49d5-44d0-9420-eac98ae3cae0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:21.970774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0cde4c-49d5-44d0-9420-eac98ae3cae0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:22.021708 n-d-master-1 devstack@keystone.service[81825]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4b0cde4c-49d5-44d0-9420-eac98ae3cae0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 04 00:44:22.021984 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0cde4c-49d5-44d0-9420-eac98ae3cae0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:22.031758 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2/4] 10.222.0.30 () {58 vars in 1324 bytes} [Sun Sep 4 00:44:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 00:44:22.037746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f6b60-b20e-49f8-8ffe-7f92c55ef608 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:22.052501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f6b60-b20e-49f8-8ffe-7f92c55ef608 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:22.056796 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780b9a6-e288-4005-9056-ce12813f4e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:22.057933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780b9a6-e288-4005-9056-ce12813f4e7f admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:22.058216 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780b9a6-e288-4005-9056-ce12813f4e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:22.058486 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780b9a6-e288-4005-9056-ce12813f4e7f admin admin] PATH_INFO: `/v3/projects/6638e0942c764685b0292b0ca0b1b3e5` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:22.060040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780b9a6-e288-4005-9056-ce12813f4e7f admin admin] RBAC: Authorizing `identity:get_project(project_id=6638e0942c764685b0292b0ca0b1b3e5)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:22.112803 n-d-master-1 devstack@keystone.service[81824]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b780b9a6-e288-4005-9056-ce12813f4e7f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 04 00:44:22.113141 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780b9a6-e288-4005-9056-ce12813f4e7f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:22.118028 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3/5] 10.222.0.30 () {56 vars in 1207 bytes} [Sun Sep 4 00:44:22 2022] GET /identity/v3/projects/6638e0942c764685b0292b0ca0b1b3e5 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:23.973544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761872e-5428-4f3f-9270-d566a4ab6897 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:23.974049 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761872e-5428-4f3f-9270-d566a4ab6897 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:23.974129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761872e-5428-4f3f-9270-d566a4ab6897 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:23.978840 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3/6] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:44:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:44:23.984383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045376d4-6479-4171-b9da-b506344c372b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:23.984744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045376d4-6479-4171-b9da-b506344c372b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:23.984925 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045376d4-6479-4171-b9da-b506344c372b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:24.004347 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-045376d4-6479-4171-b9da-b506344c372b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:44:24.005863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-045376d4-6479-4171-b9da-b506344c372b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:44:24.013724 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4/7] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:44:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 04 00:44:24.280474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761872e-5428-4f3f-9270-d566a4ab6897 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:24.292983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761872e-5428-4f3f-9270-d566a4ab6897 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:24.297110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3c23d-e337-4ba5-9792-112e6c908da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:24.297743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3c23d-e337-4ba5-9792-112e6c908da0 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:24.298028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3c23d-e337-4ba5-9792-112e6c908da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:24.298303 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3c23d-e337-4ba5-9792-112e6c908da0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:24.305861 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d3c23d-e337-4ba5-9792-112e6c908da0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:24.307641 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d3c23d-e337-4ba5-9792-112e6c908da0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:24.316169 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4/8] 10.222.0.30 () {58 vars in 1324 bytes} [Sun Sep 4 00:44:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 00:44:24.321279 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045376d4-6479-4171-b9da-b506344c372b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:24.330697 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045376d4-6479-4171-b9da-b506344c372b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:24.334985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb45818-17a1-4ba6-82c8-dc6a522ec383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:24.335610 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb45818-17a1-4ba6-82c8-dc6a522ec383 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:24.335890 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb45818-17a1-4ba6-82c8-dc6a522ec383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:24.336165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb45818-17a1-4ba6-82c8-dc6a522ec383 admin admin] PATH_INFO: `/v3/users/b3da54db0785474cb38733cf09ad01a1` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:24.338082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb45818-17a1-4ba6-82c8-dc6a522ec383 admin admin] RBAC: Authorizing `identity:get_user(user_id=b3da54db0785474cb38733cf09ad01a1)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:24.339889 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb45818-17a1-4ba6-82c8-dc6a522ec383 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:24.341386 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 5/9] 10.222.0.30 () {56 vars in 1198 bytes} [Sun Sep 4 00:44:24 2022] GET /identity/v3/users/b3da54db0785474cb38733cf09ad01a1 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:26.272422 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d90c7d-de7f-4c7a-a081-c444b7d23a6b None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:26.272965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d90c7d-de7f-4c7a-a081-c444b7d23a6b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:26.273056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d90c7d-de7f-4c7a-a081-c444b7d23a6b None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:26.274329 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 5/10] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:44:26.279999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f2219-1e17-482e-8278-50eed6f90551 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:26.280422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f2219-1e17-482e-8278-50eed6f90551 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:26.280669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f2219-1e17-482e-8278-50eed6f90551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:26.298945 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-0f8f2219-1e17-482e-8278-50eed6f90551 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:44:26.300109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0f8f2219-1e17-482e-8278-50eed6f90551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:44:26.326069 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822373b4-1966-497d-9754-671755ff28ad None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:26.326358 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822373b4-1966-497d-9754-671755ff28ad None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:26.326634 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822373b4-1966-497d-9754-671755ff28ad None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:26.327942 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 6/11] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 04 00:44:26.332991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df262a78-67db-488c-a94f-f2662c8c2b22 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:26.333429 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df262a78-67db-488c-a94f-f2662c8c2b22 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:26.333727 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df262a78-67db-488c-a94f-f2662c8c2b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:26.375364 n-d-master-1 devstack@keystone.service[81825]: DEBUG passlib.handlers.bcrypt [None req-df262a78-67db-488c-a94f-f2662c8c2b22 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81825) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 04 00:44:26.375751 n-d-master-1 devstack@keystone.service[81825]: DEBUG passlib.handlers.bcrypt [None req-df262a78-67db-488c-a94f-f2662c8c2b22 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81825) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 04 00:44:26.378204 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 6/12] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:44:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:44:26.425093 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-df262a78-67db-488c-a94f-f2662c8c2b22 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:44:26.426689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-df262a78-67db-488c-a94f-f2662c8c2b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:44:26.527963 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 7/13] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:44:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 04 00:44:26.642944 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f2219-1e17-482e-8278-50eed6f90551 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:26.668279 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:26.744894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f2219-1e17-482e-8278-50eed6f90551 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:26.777714 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52742e7a-19f0-47ae-8f85-7952000268ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:26.778394 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52742e7a-19f0-47ae-8f85-7952000268ac None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:26.778625 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52742e7a-19f0-47ae-8f85-7952000268ac None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:26.778915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52742e7a-19f0-47ae-8f85-7952000268ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:26.789750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52742e7a-19f0-47ae-8f85-7952000268ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:44:26.792756 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df262a78-67db-488c-a94f-f2662c8c2b22 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:26.798635 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-52742e7a-19f0-47ae-8f85-7952000268ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:44:26.798635 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:44:26.798635 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:44:26.798635 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:44:26.798635 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:44:26.798635 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:44:26.798635 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:44:26.798635 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:44:26.798635 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:44:26.798635 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:44:26.798635 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:44:26.798635 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:44:26.798635 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:44:26.798635 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:44:26.798635 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:44:26.798635 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:44:26.799625 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:44:26.799625 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:44:26.799625 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:44:26.799625 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:44:26.799625 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:44:26.799625 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:44:26.799625 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:44:26.799625 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:44:26.799625 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:44:26.799625 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:44:26.799625 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:44:26.799625 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:44:26.799625 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:44:26.799625 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:44:26.799625 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:44:26.799625 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:44:26.800529 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:44:26.800529 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:44:26.800529 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:44:26.800529 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:44:26.800529 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:44:26.800529 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:44:26.800529 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:44:26.800529 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:44:26.800529 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:44:26.800529 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:44:26.800529 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:44:26.800529 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:44:26.800529 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 7/14] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Sep 4 00:44:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:44:26.805794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52742e7a-19f0-47ae-8f85-7952000268ac None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:26.886786 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:26.895535 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df262a78-67db-488c-a94f-f2662c8c2b22 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:26.897820 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:26.905838 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52742e7a-19f0-47ae-8f85-7952000268ac None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:26.932902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca38936-b144-4a5e-abe1-449c138ffdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:26.933807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca38936-b144-4a5e-abe1-449c138ffdf1 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:26.934091 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca38936-b144-4a5e-abe1-449c138ffdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:26.934366 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca38936-b144-4a5e-abe1-449c138ffdf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:26.939060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6ded7-5d4e-41c8-8dfb-71e0491f99a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:26.939652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6ded7-5d4e-41c8-8dfb-71e0491f99a6 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:26.939929 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6ded7-5d4e-41c8-8dfb-71e0491f99a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:26.940200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6ded7-5d4e-41c8-8dfb-71e0491f99a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:26.940855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6ded7-5d4e-41c8-8dfb-71e0491f99a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:44:26.941156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6ded7-5d4e-41c8-8dfb-71e0491f99a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:26.942576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6ded7-5d4e-41c8-8dfb-71e0491f99a6 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:26.954468 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 8/15] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:44:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:44:26.960136 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6ded7-5d4e-41c8-8dfb-71e0491f99a6 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:27.003765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca38936-b144-4a5e-abe1-449c138ffdf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:27.005289 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca38936-b144-4a5e-abe1-449c138ffdf1 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:27.057079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6ded7-5d4e-41c8-8dfb-71e0491f99a6 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:27.090354 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b8e96-1b9e-4059-b02a-a39df838f871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:27.091002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b8e96-1b9e-4059-b02a-a39df838f871 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:27.091287 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b8e96-1b9e-4059-b02a-a39df838f871 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:27.091627 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b8e96-1b9e-4059-b02a-a39df838f871 None admin] PATH_INFO: `/v3/users/b3da54db0785474cb38733cf09ad01a1` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:27.092809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86b8e96-1b9e-4059-b02a-a39df838f871 None admin] RBAC: Authorizing `identity:get_user(user_id=b3da54db0785474cb38733cf09ad01a1)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:27.094288 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86b8e96-1b9e-4059-b02a-a39df838f871 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:27.095830 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 9/16] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:44:26 2022] GET /identity/v3/users/b3da54db0785474cb38733cf09ad01a1 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:27.101248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b8e96-1b9e-4059-b02a-a39df838f871 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:27.105587 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 8/17] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:44:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 04 00:44:27.106630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca38936-b144-4a5e-abe1-449c138ffdf1 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:27.110268 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:27.117397 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:27.200625 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b8e96-1b9e-4059-b02a-a39df838f871 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:27.204859 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca38936-b144-4a5e-abe1-449c138ffdf1 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:27.232424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5e1eb-7399-4ad4-8e1e-bd25cc6b414f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:27.233301 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5e1eb-7399-4ad4-8e1e-bd25cc6b414f None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:27.233608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5e1eb-7399-4ad4-8e1e-bd25cc6b414f None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:27.233878 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5e1eb-7399-4ad4-8e1e-bd25cc6b414f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:27.234985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca5e1eb-7399-4ad4-8e1e-bd25cc6b414f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:27.236420 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca5e1eb-7399-4ad4-8e1e-bd25cc6b414f None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:27.238165 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 10/18] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:44:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:44:27.238328 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb1ba9-76aa-48c6-8b76-2eea56f01aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:27.239297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb1ba9-76aa-48c6-8b76-2eea56f01aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:27.239577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb1ba9-76aa-48c6-8b76-2eea56f01aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:27.239849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb1ba9-76aa-48c6-8b76-2eea56f01aa6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:27.244285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5e1eb-7399-4ad4-8e1e-bd25cc6b414f None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:27.259859 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb1ba9-76aa-48c6-8b76-2eea56f01aa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:27.261323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb1ba9-76aa-48c6-8b76-2eea56f01aa6 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:27.280432 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-8cbb1ba9-76aa-48c6-8b76-2eea56f01aa6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:44:27.280432 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:44:27.280432 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:44:27.280432 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:44:27.280432 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:44:27.280432 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:44:27.280432 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:44:27.280432 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:44:27.280432 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:44:27.280432 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:44:27.280432 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:44:27.280432 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:44:27.280432 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:44:27.280432 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:44:27.280432 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:44:27.280432 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:44:27.281747 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:44:27.281747 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:44:27.281747 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:44:27.281747 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:44:27.281747 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:44:27.281747 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:44:27.281747 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:44:27.281747 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:44:27.281747 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:44:27.281747 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:44:27.281747 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:44:27.281747 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:44:27.281747 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:44:27.281747 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:44:27.281747 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:44:27.281747 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:44:27.281747 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:44:27.282541 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:44:27.282541 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:44:27.282541 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:44:27.282541 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 9/19] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:44:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:44:27.287241 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb1ba9-76aa-48c6-8b76-2eea56f01aa6 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:27.324565 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:27.343593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5e1eb-7399-4ad4-8e1e-bd25cc6b414f None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:27.343739 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:27.376969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe57c2f-834f-43da-b262-5d9dd9d6a70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:27.377610 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe57c2f-834f-43da-b262-5d9dd9d6a70e None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:27.377885 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe57c2f-834f-43da-b262-5d9dd9d6a70e None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:27.378154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe57c2f-834f-43da-b262-5d9dd9d6a70e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:27.378865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe57c2f-834f-43da-b262-5d9dd9d6a70e None admin] RBAC: Adding query filter params (role.id=d255b03c37d64371a148ec4e11be01d9, scope.domain.id=default, user.id=b3da54db0785474cb38733cf09ad01a1) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:44:27.379169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe57c2f-834f-43da-b262-5d9dd9d6a70e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:27.380687 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe57c2f-834f-43da-b262-5d9dd9d6a70e None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:27.387086 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 11/20] 10.222.0.30 () {56 vars in 1322 bytes} [Sun Sep 4 00:44:27 2022] GET /identity/v3/role_assignments?user.id=b3da54db0785474cb38733cf09ad01a1&scope.domain.id=default&role.id=d255b03c37d64371a148ec4e11be01d9 => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:44:27.389076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb1ba9-76aa-48c6-8b76-2eea56f01aa6 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:27.425134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6c0ea-bc3c-46fb-8dc6-f7b0620dc0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:27.425789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6c0ea-bc3c-46fb-8dc6-f7b0620dc0f4 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:27.426073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6c0ea-bc3c-46fb-8dc6-f7b0620dc0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:27.426348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6c0ea-bc3c-46fb-8dc6-f7b0620dc0f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:27.427016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6c0ea-bc3c-46fb-8dc6-f7b0620dc0f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:44:27.427319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6c0ea-bc3c-46fb-8dc6-f7b0620dc0f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:27.428761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6c0ea-bc3c-46fb-8dc6-f7b0620dc0f4 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:27.449376 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 10/21] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:44:29.389179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446f332-4116-4e26-84ae-3af0125547ad None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:29.389749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446f332-4116-4e26-84ae-3af0125547ad None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:29.389834 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446f332-4116-4e26-84ae-3af0125547ad None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:29.391145 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 12/22] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:44:29.396518 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1d9f6-cd87-4f94-925d-c3d4aecf9e8c None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:29.396927 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1d9f6-cd87-4f94-925d-c3d4aecf9e8c None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:29.397119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1d9f6-cd87-4f94-925d-c3d4aecf9e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:29.434485 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-53a1d9f6-cd87-4f94-925d-c3d4aecf9e8c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:44:29.435711 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-53a1d9f6-cd87-4f94-925d-c3d4aecf9e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:44:29.526955 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 11/23] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:44:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 04 00:44:29.760744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ae216-e032-4db4-80ac-22cf91108f3b None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:29.761087 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ae216-e032-4db4-80ac-22cf91108f3b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:29.761266 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ae216-e032-4db4-80ac-22cf91108f3b None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:29.762592 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 13/24] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:44:29.775552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcde88a-e948-46dd-a276-e33ebecf77d6 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:29.775843 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcde88a-e948-46dd-a276-e33ebecf77d6 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:29.776124 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcde88a-e948-46dd-a276-e33ebecf77d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:29.802414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-1fcde88a-e948-46dd-a276-e33ebecf77d6 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:44:29.803639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1fcde88a-e948-46dd-a276-e33ebecf77d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:44:29.857823 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:29.887750 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 12/25] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:44:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:44:30.029859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ae216-e032-4db4-80ac-22cf91108f3b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:30.036878 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8d5f3-794e-4abc-9950-1df38cc1d7f7 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:30.037416 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8d5f3-794e-4abc-9950-1df38cc1d7f7 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:30.037929 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8d5f3-794e-4abc-9950-1df38cc1d7f7 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:30.039478 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 13/26] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:44:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 04 00:44:30.045842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dd427-8b99-4339-bba0-3a917da221e6 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:30.046415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dd427-8b99-4339-bba0-3a917da221e6 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:30.046886 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dd427-8b99-4339-bba0-3a917da221e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:30.069507 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-312dd427-8b99-4339-bba0-3a917da221e6 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:44:30.071018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-312dd427-8b99-4339-bba0-3a917da221e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:44:30.170245 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 14/27] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:44:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 04 00:44:30.196010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db7304-c8d1-48b5-a8e7-6508db6655e5 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:30.197224 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db7304-c8d1-48b5-a8e7-6508db6655e5 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:30.197725 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db7304-c8d1-48b5-a8e7-6508db6655e5 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:30.199254 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 15/28] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:44:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 04 00:44:30.204347 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43ffea-9770-431a-9023-9ad293f9e965 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:30.204773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ae216-e032-4db4-80ac-22cf91108f3b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:30.205126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43ffea-9770-431a-9023-9ad293f9e965 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:30.205655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43ffea-9770-431a-9023-9ad293f9e965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:30.246472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-2b43ffea-9770-431a-9023-9ad293f9e965 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:44:30.247824 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2b43ffea-9770-431a-9023-9ad293f9e965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:44:30.257520 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ccdbf-09b2-4a36-a004-478a3cfd9f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:30.258399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ccdbf-09b2-4a36-a004-478a3cfd9f88 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:30.258799 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ccdbf-09b2-4a36-a004-478a3cfd9f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:30.259748 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ccdbf-09b2-4a36-a004-478a3cfd9f88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:30.271480 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ccdbf-09b2-4a36-a004-478a3cfd9f88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:44:30.276674 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-fc4ccdbf-09b2-4a36-a004-478a3cfd9f88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:44:30.276674 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:44:30.276674 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:44:30.276674 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:44:30.276674 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:44:30.276674 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:44:30.276674 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:44:30.276674 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:44:30.276674 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:44:30.276674 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:44:30.276674 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:44:30.276674 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:44:30.276674 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:44:30.276674 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:44:30.276674 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:44:30.276674 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:44:30.277533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:44:30.277533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:44:30.277533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:44:30.277533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:44:30.277533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:44:30.277533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:44:30.277533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:44:30.277533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:44:30.277533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:44:30.277533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:44:30.277533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:44:30.277533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:44:30.277533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:44:30.277533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:44:30.277533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:44:30.277533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:44:30.278298 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:44:30.278298 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:44:30.278298 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:44:30.278298 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:44:30.278298 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:44:30.278298 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:44:30.278298 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:44:30.278298 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:44:30.278298 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:44:30.278298 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:44:30.278298 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:44:30.278298 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:44:30.280116 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 14/29] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Sep 4 00:44:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:44:30.285776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ccdbf-09b2-4a36-a004-478a3cfd9f88 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:30.291835 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:30.393077 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 16/30] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:44:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 04 00:44:30.393951 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43ffea-9770-431a-9023-9ad293f9e965 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:30.469822 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ccdbf-09b2-4a36-a004-478a3cfd9f88 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:30.490360 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:30.561178 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450f41c-61cc-454a-bc8f-e497a995f87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:30.561731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450f41c-61cc-454a-bc8f-e497a995f87e None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:30.562013 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450f41c-61cc-454a-bc8f-e497a995f87e None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:30.562288 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450f41c-61cc-454a-bc8f-e497a995f87e None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:30.562968 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450f41c-61cc-454a-bc8f-e497a995f87e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:44:30.563275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450f41c-61cc-454a-bc8f-e497a995f87e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:30.564680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450f41c-61cc-454a-bc8f-e497a995f87e None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:30.582319 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 15/31] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:44:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:44:30.583330 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450f41c-61cc-454a-bc8f-e497a995f87e None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:30.625995 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43ffea-9770-431a-9023-9ad293f9e965 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:30.679250 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629acf6f-c4b1-4541-90d6-731c8935fb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:30.682212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629acf6f-c4b1-4541-90d6-731c8935fb35 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:30.682641 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629acf6f-c4b1-4541-90d6-731c8935fb35 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:30.683118 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629acf6f-c4b1-4541-90d6-731c8935fb35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:30.703509 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629acf6f-c4b1-4541-90d6-731c8935fb35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:30.705361 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629acf6f-c4b1-4541-90d6-731c8935fb35 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:30.709645 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:30.736907 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-629acf6f-c4b1-4541-90d6-731c8935fb35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:44:30.736907 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:44:30.736907 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:44:30.736907 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:44:30.736907 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:44:30.736907 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:44:30.736907 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:44:30.736907 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:44:30.736907 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:44:30.736907 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:44:30.736907 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:44:30.736907 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:44:30.736907 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:44:30.736907 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:44:30.736907 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:44:30.736907 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:44:30.738013 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:44:30.738013 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:44:30.738013 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:44:30.738013 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:44:30.738013 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:44:30.738013 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:44:30.738013 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:44:30.738013 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:44:30.738013 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:44:30.738013 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:44:30.738013 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:44:30.738013 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:44:30.738013 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:44:30.738013 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:44:30.738013 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:44:30.738013 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:44:30.738013 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:44:30.739002 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:44:30.739002 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:44:30.739002 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:44:30.740430 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 17/32] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:44:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:44:30.741366 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629acf6f-c4b1-4541-90d6-731c8935fb35 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:30.759900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450f41c-61cc-454a-bc8f-e497a995f87e None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:30.795758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b5f85-6532-4a52-97aa-250b28e9c6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:30.796497 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b5f85-6532-4a52-97aa-250b28e9c6d0 None admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:30.796636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b5f85-6532-4a52-97aa-250b28e9c6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:30.796903 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b5f85-6532-4a52-97aa-250b28e9c6d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:30.797611 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b5f85-6532-4a52-97aa-250b28e9c6d0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:30.799010 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b5f85-6532-4a52-97aa-250b28e9c6d0 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:30.855871 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:30.870362 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629acf6f-c4b1-4541-90d6-731c8935fb35 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:30.917792 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091dc872-5577-4ad7-94f0-663aac16dd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:30.918734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091dc872-5577-4ad7-94f0-663aac16dd50 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:30.919203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091dc872-5577-4ad7-94f0-663aac16dd50 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:30.919655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091dc872-5577-4ad7-94f0-663aac16dd50 None admin] PATH_INFO: `/v3/users/b3da54db0785474cb38733cf09ad01a1` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:30.921321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091dc872-5577-4ad7-94f0-663aac16dd50 None admin] RBAC: Authorizing `identity:get_user(user_id=b3da54db0785474cb38733cf09ad01a1)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:30.922954 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091dc872-5577-4ad7-94f0-663aac16dd50 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:30.924807 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 18/33] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:44:30 2022] GET /identity/v3/users/b3da54db0785474cb38733cf09ad01a1 => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:30.925773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091dc872-5577-4ad7-94f0-663aac16dd50 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:30.931031 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 16/34] 10.222.0.30 () {60 vars in 1131 bytes} [Sun Sep 4 00:44:30 2022] POST /identity/v3/roles => generated 219 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:44:30.932064 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b5f85-6532-4a52-97aa-250b28e9c6d0 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:31.043755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091dc872-5577-4ad7-94f0-663aac16dd50 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:31.045602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b5f85-6532-4a52-97aa-250b28e9c6d0 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:31.073305 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:31.083291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41990315-f54b-4c32-8773-73219943c89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:31.084351 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41990315-f54b-4c32-8773-73219943c89f None admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:31.084477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f9dbe3-f918-421d-bb34-c235d1ef298b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:31.084898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41990315-f54b-4c32-8773-73219943c89f None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:31.085194 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9dbe3-f918-421d-bb34-c235d1ef298b None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:31.085505 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9dbe3-f918-421d-bb34-c235d1ef298b None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:31.085685 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41990315-f54b-4c32-8773-73219943c89f None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:31.085793 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9dbe3-f918-421d-bb34-c235d1ef298b None admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:31.086506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f9dbe3-f918-421d-bb34-c235d1ef298b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:44:31.086750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41990315-f54b-4c32-8773-73219943c89f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:31.086854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f9dbe3-f918-421d-bb34-c235d1ef298b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:31.089192 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f9dbe3-f918-421d-bb34-c235d1ef298b None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:31.090283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41990315-f54b-4c32-8773-73219943c89f None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:31.128838 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 17/35] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:31.130155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f9dbe3-f918-421d-bb34-c235d1ef298b None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:31.246683 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 19/36] 10.222.0.30 () {60 vars in 1131 bytes} [Sun Sep 4 00:44:30 2022] POST /identity/v3/roles => generated 225 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:44:31.247592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41990315-f54b-4c32-8773-73219943c89f None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:31.288208 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f9dbe3-f918-421d-bb34-c235d1ef298b None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:31.299398 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:31.330889 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c18656-c025-4643-a05d-a36b898ff08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:31.331551 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c18656-c025-4643-a05d-a36b898ff08a None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:31.331838 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c18656-c025-4643-a05d-a36b898ff08a None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:31.332117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c18656-c025-4643-a05d-a36b898ff08a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:31.333399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c18656-c025-4643-a05d-a36b898ff08a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:31.334938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c18656-c025-4643-a05d-a36b898ff08a None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:31.336965 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 18/37] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:44:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:31.343857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c18656-c025-4643-a05d-a36b898ff08a None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:31.444803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41990315-f54b-4c32-8773-73219943c89f None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:31.490560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801c519-1e53-4a3d-9036-34f366508ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:31.491181 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801c519-1e53-4a3d-9036-34f366508ffc None admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:31.491472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801c519-1e53-4a3d-9036-34f366508ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:31.491749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801c519-1e53-4a3d-9036-34f366508ffc None admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:31.492426 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801c519-1e53-4a3d-9036-34f366508ffc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:31.494137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801c519-1e53-4a3d-9036-34f366508ffc None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:31.523468 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:31.527476 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 20/38] 10.222.0.30 () {60 vars in 1141 bytes} [Sun Sep 4 00:44:31 2022] POST /identity/v3/projects => generated 301 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:44:31.528875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70273572-3422-4943-8bca-cd2477c994de None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:31.529174 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70273572-3422-4943-8bca-cd2477c994de None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:31.529485 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70273572-3422-4943-8bca-cd2477c994de None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:31.530765 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 21/39] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:44:31.531831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204f4b5-d38e-45da-873e-a5f4f8ed12f0 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:31.532117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204f4b5-d38e-45da-873e-a5f4f8ed12f0 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:31.532398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204f4b5-d38e-45da-873e-a5f4f8ed12f0 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:31.534591 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 22/40] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:44:31.540817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c808c0a-c571-47ae-a35b-76eff16422e0 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:31.541113 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c808c0a-c571-47ae-a35b-76eff16422e0 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:31.541394 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c808c0a-c571-47ae-a35b-76eff16422e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:31.561588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-9c808c0a-c571-47ae-a35b-76eff16422e0 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:44:31.563198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9c808c0a-c571-47ae-a35b-76eff16422e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:44:31.580459 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c18656-c025-4643-a05d-a36b898ff08a None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:31.618672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae21b79-ffa9-4e34-a61e-c6718438b14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:31.619350 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae21b79-ffa9-4e34-a61e-c6718438b14b None admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:31.619634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae21b79-ffa9-4e34-a61e-c6718438b14b None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:31.619918 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae21b79-ffa9-4e34-a61e-c6718438b14b None admin] PATH_INFO: `/v3/domains/default/users/b3da54db0785474cb38733cf09ad01a1/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:31.622013 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae21b79-ffa9-4e34-a61e-c6718438b14b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b3da54db0785474cb38733cf09ad01a1, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:31.623494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae21b79-ffa9-4e34-a61e-c6718438b14b None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:31.641283 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 19/41] 10.222.0.30 () {58 vars in 1361 bytes} [Sun Sep 4 00:44:31 2022] PUT /identity/v3/domains/default/users/b3da54db0785474cb38733cf09ad01a1/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:44:31.642842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065b86c-cd05-421a-a9f4-9b4f48167017 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:31.643189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065b86c-cd05-421a-a9f4-9b4f48167017 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:31.643462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065b86c-cd05-421a-a9f4-9b4f48167017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:31.655022 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:31.665916 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 23/42] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:44:31.670930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-2065b86c-cd05-421a-a9f4-9b4f48167017 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:44:31.672566 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2065b86c-cd05-421a-a9f4-9b4f48167017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:44:31.767661 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 20/43] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:44:31.932308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c808c0a-c571-47ae-a35b-76eff16422e0 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:32.034001 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c808c0a-c571-47ae-a35b-76eff16422e0 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:32.044866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065b86c-cd05-421a-a9f4-9b4f48167017 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:32.072465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9dedd-7e23-44ca-9fec-f7e1ce112fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:32.072935 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9dedd-7e23-44ca-9fec-f7e1ce112fe3 None admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:32.073222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9dedd-7e23-44ca-9fec-f7e1ce112fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:32.073552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9dedd-7e23-44ca-9fec-f7e1ce112fe3 None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:32.074215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e9dedd-7e23-44ca-9fec-f7e1ce112fe3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:32.075870 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e9dedd-7e23-44ca-9fec-f7e1ce112fe3 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:32.093847 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 24/44] 10.222.0.30 () {60 vars in 1131 bytes} [Sun Sep 4 00:44:31 2022] POST /identity/v3/roles => generated 223 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:44:32.099865 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:32.167404 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065b86c-cd05-421a-a9f4-9b4f48167017 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:32.207389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec402c0-d411-45bf-a4f6-18db7df170cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:32.208104 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec402c0-d411-45bf-a4f6-18db7df170cc None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:32.208620 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec402c0-d411-45bf-a4f6-18db7df170cc None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:32.209037 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec402c0-d411-45bf-a4f6-18db7df170cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:32.210290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec402c0-d411-45bf-a4f6-18db7df170cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:32.212805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec402c0-d411-45bf-a4f6-18db7df170cc None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:32.217481 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 21/45] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:44:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:44:32.221474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9dedd-7e23-44ca-9fec-f7e1ce112fe3 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:32.286845 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:32.331448 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9dedd-7e23-44ca-9fec-f7e1ce112fe3 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:32.364445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca3efd-e180-44b9-a983-98f5fa3cf7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:32.365060 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca3efd-e180-44b9-a983-98f5fa3cf7ca None admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:32.365344 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca3efd-e180-44b9-a983-98f5fa3cf7ca None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:32.365736 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca3efd-e180-44b9-a983-98f5fa3cf7ca None admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:32.366394 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca3efd-e180-44b9-a983-98f5fa3cf7ca None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:32.367844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca3efd-e180-44b9-a983-98f5fa3cf7ca None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:32.393793 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 25/46] 10.222.0.30 () {60 vars in 1141 bytes} [Sun Sep 4 00:44:32 2022] POST /identity/v3/projects => generated 312 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 00:44:33.551935 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38318202-8bf8-4455-95c1-fac74f5677eb None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:33.552465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38318202-8bf8-4455-95c1-fac74f5677eb None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:33.552465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38318202-8bf8-4455-95c1-fac74f5677eb None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:33.554004 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 22/47] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:44:33.558938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed23e9-3edd-49dc-83be-9c5779d69d32 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:33.559315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed23e9-3edd-49dc-83be-9c5779d69d32 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:33.559564 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed23e9-3edd-49dc-83be-9c5779d69d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:33.577702 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-aeed23e9-3edd-49dc-83be-9c5779d69d32 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:44:33.578873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-aeed23e9-3edd-49dc-83be-9c5779d69d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:44:33.643295 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 26/48] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:44:33.908559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38318202-8bf8-4455-95c1-fac74f5677eb None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:34.007822 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38318202-8bf8-4455-95c1-fac74f5677eb None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:34.021334 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:34.041892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595120af-c8b7-4758-8b43-3790571414c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:34.042517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595120af-c8b7-4758-8b43-3790571414c2 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:34.042801 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595120af-c8b7-4758-8b43-3790571414c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:34.043078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595120af-c8b7-4758-8b43-3790571414c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:34.052782 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595120af-c8b7-4758-8b43-3790571414c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:44:34.058246 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-595120af-c8b7-4758-8b43-3790571414c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:44:34.058246 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:44:34.058246 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:44:34.058246 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:44:34.058246 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:44:34.058246 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:44:34.058246 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:44:34.058246 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:44:34.058246 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:44:34.058246 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:44:34.058246 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:44:34.058246 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:44:34.058246 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:44:34.058246 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:44:34.058246 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:44:34.058246 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:44:34.059112 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:44:34.059112 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:44:34.059112 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:44:34.059112 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:44:34.059112 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:44:34.059112 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:44:34.059112 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:44:34.059112 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:44:34.059112 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:44:34.059112 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:44:34.059112 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:44:34.059112 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:44:34.059112 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:44:34.059112 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:44:34.059112 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:44:34.059112 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:44:34.059850 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:44:34.059850 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:44:34.059850 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:44:34.059850 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:44:34.059850 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:44:34.059850 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:44:34.059850 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:44:34.059850 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:44:34.059850 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:44:34.059850 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:44:34.059850 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:44:34.059850 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:44:34.059850 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 23/49] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Sep 4 00:44:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:44:34.065001 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed23e9-3edd-49dc-83be-9c5779d69d32 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:34.208279 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:34.266847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed23e9-3edd-49dc-83be-9c5779d69d32 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:34.299725 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be553fe5-fa47-404f-ad25-8068f20239ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:34.300341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be553fe5-fa47-404f-ad25-8068f20239ed None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:34.300624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be553fe5-fa47-404f-ad25-8068f20239ed None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:34.300898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be553fe5-fa47-404f-ad25-8068f20239ed None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:34.301596 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be553fe5-fa47-404f-ad25-8068f20239ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:44:34.301898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be553fe5-fa47-404f-ad25-8068f20239ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:34.303282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be553fe5-fa47-404f-ad25-8068f20239ed None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:34.315487 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 27/50] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:44:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:34.322326 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595120af-c8b7-4758-8b43-3790571414c2 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:34.327220 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c7d88-a8cd-4c59-abb3-3ecac509cd51 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:34.327544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c7d88-a8cd-4c59-abb3-3ecac509cd51 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:34.327823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c7d88-a8cd-4c59-abb3-3ecac509cd51 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:34.329121 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 28/51] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 04 00:44:34.333805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4402a-99d2-4913-81e7-d11febc66a7e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:34.334090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4402a-99d2-4913-81e7-d11febc66a7e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:34.334363 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4402a-99d2-4913-81e7-d11febc66a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:34.351659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-38f4402a-99d2-4913-81e7-d11febc66a7e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:44:34.353365 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-38f4402a-99d2-4913-81e7-d11febc66a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:44:34.419152 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 29/52] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:44:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 04 00:44:34.422361 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595120af-c8b7-4758-8b43-3790571414c2 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:34.456331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e019fe-e4ad-4e6e-9ab3-5a14b5a241b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:34.456959 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e019fe-e4ad-4e6e-9ab3-5a14b5a241b8 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:34.457243 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e019fe-e4ad-4e6e-9ab3-5a14b5a241b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:34.457566 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e019fe-e4ad-4e6e-9ab3-5a14b5a241b8 None admin] PATH_INFO: `/v3/users/b3da54db0785474cb38733cf09ad01a1` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:34.458744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e019fe-e4ad-4e6e-9ab3-5a14b5a241b8 None admin] RBAC: Authorizing `identity:get_user(user_id=b3da54db0785474cb38733cf09ad01a1)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:34.460161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e019fe-e4ad-4e6e-9ab3-5a14b5a241b8 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:34.461759 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 24/53] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:44:34 2022] GET /identity/v3/users/b3da54db0785474cb38733cf09ad01a1 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:34.467825 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f4402a-99d2-4913-81e7-d11febc66a7e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:34.501586 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:34.572557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f4402a-99d2-4913-81e7-d11febc66a7e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:34.605837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac19363-b069-4414-9c11-c14da57f830a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:34.606477 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac19363-b069-4414-9c11-c14da57f830a None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:34.606764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac19363-b069-4414-9c11-c14da57f830a None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:34.607045 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac19363-b069-4414-9c11-c14da57f830a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:34.608432 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac19363-b069-4414-9c11-c14da57f830a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:34.609914 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac19363-b069-4414-9c11-c14da57f830a None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:34.611632 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 30/54] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:44:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:34.617175 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e019fe-e4ad-4e6e-9ab3-5a14b5a241b8 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:34.657129 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:34.684278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac19363-b069-4414-9c11-c14da57f830a None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:34.714380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e019fe-e4ad-4e6e-9ab3-5a14b5a241b8 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:34.747553 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048425a5-3b84-43a2-a311-7f2210603a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:34.748155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048425a5-3b84-43a2-a311-7f2210603a78 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:34.748438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048425a5-3b84-43a2-a311-7f2210603a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:34.748714 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048425a5-3b84-43a2-a311-7f2210603a78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:34.749450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048425a5-3b84-43a2-a311-7f2210603a78 None admin] RBAC: Adding query filter params (role.id=d255b03c37d64371a148ec4e11be01d9, scope.domain.id=default, user.id=b3da54db0785474cb38733cf09ad01a1) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:44:34.749765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048425a5-3b84-43a2-a311-7f2210603a78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:34.751211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048425a5-3b84-43a2-a311-7f2210603a78 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:34.756795 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 25/55] 10.222.0.30 () {56 vars in 1322 bytes} [Sun Sep 4 00:44:34 2022] GET /identity/v3/role_assignments?user.id=b3da54db0785474cb38733cf09ad01a1&scope.domain.id=default&role.id=d255b03c37d64371a148ec4e11be01d9 => generated 530 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:34.783745 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:34.787424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac19363-b069-4414-9c11-c14da57f830a None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:34.824527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ce6ca-49bf-4a51-8b84-1483306a81dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:34.825180 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ce6ca-49bf-4a51-8b84-1483306a81dd None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:34.825480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ce6ca-49bf-4a51-8b84-1483306a81dd None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:34.825763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ce6ca-49bf-4a51-8b84-1483306a81dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:34.826963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ce6ca-49bf-4a51-8b84-1483306a81dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:34.828421 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ce6ca-49bf-4a51-8b84-1483306a81dd None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:34.830078 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 31/56] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:44:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:44:34.836270 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048425a5-3b84-43a2-a311-7f2210603a78 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:34.939291 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048425a5-3b84-43a2-a311-7f2210603a78 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:34.941568 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:34.973688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e740e33-8b79-4738-979a-0bd5468bfa63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:34.974243 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e740e33-8b79-4738-979a-0bd5468bfa63 None admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:34.974529 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e740e33-8b79-4738-979a-0bd5468bfa63 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:34.974806 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e740e33-8b79-4738-979a-0bd5468bfa63 None admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:34.975472 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e740e33-8b79-4738-979a-0bd5468bfa63 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:34.976916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e740e33-8b79-4738-979a-0bd5468bfa63 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:35.003265 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 26/57] 10.222.0.30 () {60 vars in 1140 bytes} [Sun Sep 4 00:44:34 2022] POST /identity/v3/projects => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:44:36.884450 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece280d7-8c6a-4966-9331-934f271adeef None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:36.884941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece280d7-8c6a-4966-9331-934f271adeef None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:36.885022 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece280d7-8c6a-4966-9331-934f271adeef None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:36.886356 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 32/58] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:44:36.891344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26398f22-ab77-417f-b37f-8d8d3cc9f968 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:36.891697 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26398f22-ab77-417f-b37f-8d8d3cc9f968 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:36.891912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26398f22-ab77-417f-b37f-8d8d3cc9f968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:36.910203 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-26398f22-ab77-417f-b37f-8d8d3cc9f968 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:44:36.911388 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-26398f22-ab77-417f-b37f-8d8d3cc9f968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:44:36.974678 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 27/59] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:44:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:44:37.238953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece280d7-8c6a-4966-9331-934f271adeef None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:37.336804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece280d7-8c6a-4966-9331-934f271adeef None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:37.369986 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b1617-af78-4497-b1b7-4457f275580f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:37.370608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b1617-af78-4497-b1b7-4457f275580f None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:37.370890 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b1617-af78-4497-b1b7-4457f275580f None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:37.371166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b1617-af78-4497-b1b7-4457f275580f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:37.372266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b1617-af78-4497-b1b7-4457f275580f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:37.373725 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b1617-af78-4497-b1b7-4457f275580f None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:37.375267 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 33/60] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:44:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:37.380685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26398f22-ab77-417f-b37f-8d8d3cc9f968 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:37.461898 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:37.478016 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26398f22-ab77-417f-b37f-8d8d3cc9f968 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:37.511757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba924c7-0d94-4cdc-92d8-e4720f336866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:37.512311 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba924c7-0d94-4cdc-92d8-e4720f336866 None admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:37.512594 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba924c7-0d94-4cdc-92d8-e4720f336866 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:37.512871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba924c7-0d94-4cdc-92d8-e4720f336866 None admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:37.513557 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba924c7-0d94-4cdc-92d8-e4720f336866 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:37.515026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba924c7-0d94-4cdc-92d8-e4720f336866 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:37.540477 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 28/61] 10.222.0.30 () {60 vars in 1132 bytes} [Sun Sep 4 00:44:37 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:44:40.456399 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b8c54-90ce-41e4-a542-23ac5c7ca005 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:40.457272 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b8c54-90ce-41e4-a542-23ac5c7ca005 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:40.457768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b8c54-90ce-41e4-a542-23ac5c7ca005 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:40.459325 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 34/62] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:44:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:44:40.465497 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b71ca-01fa-4019-815a-b7c909332d28 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:40.466338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b71ca-01fa-4019-815a-b7c909332d28 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:40.466812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b71ca-01fa-4019-815a-b7c909332d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:40.489965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-5a2b71ca-01fa-4019-815a-b7c909332d28 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:44:40.491504 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5a2b71ca-01fa-4019-815a-b7c909332d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:44:40.590344 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 29/63] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:44:40.646727 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a4840-caf7-4924-806c-c422869c3733 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:40.647335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a4840-caf7-4924-806c-c422869c3733 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:40.647829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a4840-caf7-4924-806c-c422869c3733 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:40.649369 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 35/64] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:44:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:44:40.668080 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76e409-78cf-48b1-9b6a-92fe745404b5 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:40.668660 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76e409-78cf-48b1-9b6a-92fe745404b5 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:40.669133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76e409-78cf-48b1-9b6a-92fe745404b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:40.693844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ba76e409-78cf-48b1-9b6a-92fe745404b5 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:44:40.695349 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ba76e409-78cf-48b1-9b6a-92fe745404b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:44:40.786041 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 30/65] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:44:40.900874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569d91b-8f68-42d0-a437-ff23145ca3be None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:40.901532 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569d91b-8f68-42d0-a437-ff23145ca3be None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:40.902018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569d91b-8f68-42d0-a437-ff23145ca3be None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:40.903780 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 36/66] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:44:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:44:40.915560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665de076-5640-47e6-949f-b9c2f06a9f3d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:40.916213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665de076-5640-47e6-949f-b9c2f06a9f3d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:40.916685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665de076-5640-47e6-949f-b9c2f06a9f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:40.923296 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:40.939451 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-665de076-5640-47e6-949f-b9c2f06a9f3d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:44:40.940909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-665de076-5640-47e6-949f-b9c2f06a9f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:44:41.030218 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 31/67] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:44:41.073257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7c2c4-5b66-4774-bea6-1a2cf32291a9 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:41.073866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7c2c4-5b66-4774-bea6-1a2cf32291a9 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:41.074341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7c2c4-5b66-4774-bea6-1a2cf32291a9 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:41.076139 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 37/68] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:44:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:44:41.079107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665de076-5640-47e6-949f-b9c2f06a9f3d None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:41.080481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a6c61-2fc6-4a70-a7bf-ca006b417d9c None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:41.080957 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a6c61-2fc6-4a70-a7bf-ca006b417d9c None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:41.081455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a6c61-2fc6-4a70-a7bf-ca006b417d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:41.104867 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-7b3a6c61-2fc6-4a70-a7bf-ca006b417d9c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:44:41.107037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7b3a6c61-2fc6-4a70-a7bf-ca006b417d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:44:41.142239 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:41.187154 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 38/69] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 04 00:44:41.188655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2070d10-f3b7-4813-89da-1b43e57f8ae2 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:41.188944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2070d10-f3b7-4813-89da-1b43e57f8ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:41.189221 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2070d10-f3b7-4813-89da-1b43e57f8ae2 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:41.190500 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 39/70] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:44:41.191390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2070d10-f3b7-4813-89da-1b43e57f8ae2 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:41.201180 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665de076-5640-47e6-949f-b9c2f06a9f3d None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:41.233661 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:41.243382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda91005-26e5-47a6-86fd-b3267f417efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:41.244017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda91005-26e5-47a6-86fd-b3267f417efe None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:41.244324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda91005-26e5-47a6-86fd-b3267f417efe None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:41.244573 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda91005-26e5-47a6-86fd-b3267f417efe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:41.263714 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda91005-26e5-47a6-86fd-b3267f417efe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:44:41.270734 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-fda91005-26e5-47a6-86fd-b3267f417efe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 04 00:44:41.270734 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:44:41.270734 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:44:41.270734 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:44:41.270734 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:44:41.270734 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:44:41.270734 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:44:41.270734 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:44:41.270734 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:44:41.270734 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:44:41.270734 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:44:41.270734 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:44:41.270734 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:44:41.270734 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:44:41.270734 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:44:41.270734 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:44:41.271567 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:44:41.271567 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:44:41.271567 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:44:41.271567 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:44:41.271567 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:44:41.271567 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:44:41.271567 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:44:41.271567 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:44:41.271567 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:44:41.271567 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:44:41.271567 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:44:41.271567 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:44:41.271567 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:44:41.271567 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:44:41.271567 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:44:41.271567 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:44:41.272312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:44:41.272312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:44:41.272312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:44:41.272312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:44:41.272312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:44:41.272312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:44:41.272312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:44:41.272312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:44:41.272312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:44:41.272312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:44:41.272312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 04 00:44:41.272312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:44:41.275645 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 32/71] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:44:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:44:41.278543 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a25927-bde5-48f1-83ae-7dba23ef300e None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:41.279016 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a25927-bde5-48f1-83ae-7dba23ef300e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:41.279431 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a25927-bde5-48f1-83ae-7dba23ef300e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:41.301773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-50a25927-bde5-48f1-83ae-7dba23ef300e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:44:41.303263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-50a25927-bde5-48f1-83ae-7dba23ef300e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:44:41.330344 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2070d10-f3b7-4813-89da-1b43e57f8ae2 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:41.370945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90cf0f6-6b48-4de2-bf7c-93f4cfa8df52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:41.371573 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cf0f6-6b48-4de2-bf7c-93f4cfa8df52 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:41.371854 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cf0f6-6b48-4de2-bf7c-93f4cfa8df52 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:41.372127 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cf0f6-6b48-4de2-bf7c-93f4cfa8df52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:41.375775 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 33/72] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:44:41.376772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a25927-bde5-48f1-83ae-7dba23ef300e None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:41.392341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90cf0f6-6b48-4de2-bf7c-93f4cfa8df52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:44:41.401482 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-e90cf0f6-6b48-4de2-bf7c-93f4cfa8df52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:44:41.401482 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:44:41.401482 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:44:41.401482 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:44:41.401482 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:44:41.401482 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:44:41.401482 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:44:41.401482 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:44:41.401482 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:44:41.401482 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:44:41.401482 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:44:41.401482 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:44:41.401482 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:44:41.401482 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:44:41.401482 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:44:41.401482 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:44:41.402516 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:44:41.402516 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:44:41.402516 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:44:41.402516 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:44:41.402516 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:44:41.402516 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:44:41.402516 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:44:41.402516 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:44:41.402516 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:44:41.402516 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:44:41.402516 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:44:41.402516 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:44:41.402516 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:44:41.402516 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:44:41.402516 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:44:41.402516 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:44:41.403440 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:44:41.403440 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:44:41.403440 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:44:41.403440 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:44:41.403440 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:44:41.403440 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:44:41.403440 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:44:41.403440 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:44:41.403440 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:44:41.403440 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:44:41.403440 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:44:41.403440 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:44:41.406087 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 40/73] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Sep 4 00:44:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:44:41.407276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90cf0f6-6b48-4de2-bf7c-93f4cfa8df52 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:41.449178 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:41.491221 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a25927-bde5-48f1-83ae-7dba23ef300e None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:41.512608 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:41.525122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90cf0f6-6b48-4de2-bf7c-93f4cfa8df52 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:41.526274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0234fd9-9e43-4444-8175-fcb45eebc902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:41.526884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0234fd9-9e43-4444-8175-fcb45eebc902 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:41.527169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0234fd9-9e43-4444-8175-fcb45eebc902 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:41.527448 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0234fd9-9e43-4444-8175-fcb45eebc902 None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:41.528153 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0234fd9-9e43-4444-8175-fcb45eebc902 None admin] RBAC: Adding query filter params (name=member) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:44:41.528456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0234fd9-9e43-4444-8175-fcb45eebc902 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:41.529888 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0234fd9-9e43-4444-8175-fcb45eebc902 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:41.538643 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 34/74] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Sep 4 00:44:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:41.539243 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0234fd9-9e43-4444-8175-fcb45eebc902 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:41.564788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8e118-85d5-44fb-9488-a71334a18fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:41.565470 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8e118-85d5-44fb-9488-a71334a18fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:41.565750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8e118-85d5-44fb-9488-a71334a18fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:41.566027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8e118-85d5-44fb-9488-a71334a18fc0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:41.576842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8e118-85d5-44fb-9488-a71334a18fc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:44:41.581822 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-fca8e118-85d5-44fb-9488-a71334a18fc0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 04 00:44:41.581822 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:44:41.581822 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:44:41.581822 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:44:41.581822 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:44:41.581822 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:44:41.581822 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:44:41.581822 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:44:41.581822 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:44:41.581822 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:44:41.581822 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:44:41.581822 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:44:41.581822 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:44:41.581822 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:44:41.581822 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:44:41.581822 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:44:41.582819 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:44:41.582819 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:44:41.582819 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:44:41.582819 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:44:41.582819 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:44:41.582819 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:44:41.582819 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:44:41.582819 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:44:41.582819 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:44:41.582819 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:44:41.582819 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:44:41.582819 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:44:41.582819 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:44:41.582819 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:44:41.582819 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:44:41.582819 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:44:41.583773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:44:41.583773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:44:41.583773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:44:41.583773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:44:41.583773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:44:41.583773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:44:41.583773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:44:41.583773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:44:41.583773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:44:41.583773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:44:41.583773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 04 00:44:41.583773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:44:41.588197 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 41/75] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Sep 4 00:44:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:44:41.590495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8e118-85d5-44fb-9488-a71334a18fc0 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:41.645845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0234fd9-9e43-4444-8175-fcb45eebc902 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:41.675442 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:41.683576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe7ce4-eb1d-4ffc-99dc-04469a8ec4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:41.684192 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe7ce4-eb1d-4ffc-99dc-04469a8ec4c7 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:41.684477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe7ce4-eb1d-4ffc-99dc-04469a8ec4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:41.684756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe7ce4-eb1d-4ffc-99dc-04469a8ec4c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:41.685423 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe7ce4-eb1d-4ffc-99dc-04469a8ec4c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:44:41.685763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe7ce4-eb1d-4ffc-99dc-04469a8ec4c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:41.687158 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe7ce4-eb1d-4ffc-99dc-04469a8ec4c7 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:41.690399 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8e118-85d5-44fb-9488-a71334a18fc0 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:41.695454 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 35/76] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:44:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:41.696236 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe7ce4-eb1d-4ffc-99dc-04469a8ec4c7 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:41.726425 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4193cad-f406-434b-a764-a89f526f20f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:41.727051 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4193cad-f406-434b-a764-a89f526f20f3 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:41.727332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4193cad-f406-434b-a764-a89f526f20f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:41.727642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4193cad-f406-434b-a764-a89f526f20f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:41.737662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4193cad-f406-434b-a764-a89f526f20f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:44:41.741673 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:41.742393 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-b4193cad-f406-434b-a764-a89f526f20f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 04 00:44:41.742393 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:44:41.742393 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:44:41.742393 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:44:41.742393 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:44:41.742393 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:44:41.742393 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:44:41.742393 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:44:41.742393 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:44:41.742393 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:44:41.742393 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:44:41.742393 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:44:41.742393 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:44:41.742393 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:44:41.742393 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:44:41.742393 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:44:41.743343 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:44:41.743343 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:44:41.743343 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:44:41.743343 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:44:41.743343 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:44:41.743343 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:44:41.743343 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:44:41.743343 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:44:41.743343 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:44:41.743343 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:44:41.743343 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:44:41.743343 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:44:41.743343 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:44:41.743343 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:44:41.743343 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:44:41.743343 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:44:41.744517 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:44:41.744517 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:44:41.744517 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:44:41.744517 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:44:41.744517 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:44:41.744517 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:44:41.744517 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:44:41.744517 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:44:41.744517 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:44:41.744517 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:44:41.744517 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 04 00:44:41.744517 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:44:41.744517 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 42/77] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:44:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:44:41.744517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4193cad-f406-434b-a764-a89f526f20f3 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:41.801586 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe7ce4-eb1d-4ffc-99dc-04469a8ec4c7 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:41.834124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6e459-a188-40c8-bdc3-580c5f5888bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:41.834691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6e459-a188-40c8-bdc3-580c5f5888bc None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:41.834973 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6e459-a188-40c8-bdc3-580c5f5888bc None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:41.835249 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6e459-a188-40c8-bdc3-580c5f5888bc None admin] PATH_INFO: `/v3/users/28a752c790934abebf720d75724b5b66` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:41.846365 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4193cad-f406-434b-a764-a89f526f20f3 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:41.848514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb6e459-a188-40c8-bdc3-580c5f5888bc None admin] RBAC: Authorizing `identity:get_user(user_id=28a752c790934abebf720d75724b5b66)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:41.850016 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb6e459-a188-40c8-bdc3-580c5f5888bc None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:41.851616 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 36/78] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:44:41 2022] GET /identity/v3/users/28a752c790934abebf720d75724b5b66 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:41.854026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6e459-a188-40c8-bdc3-580c5f5888bc None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:41.879190 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae901c-503e-4107-bf5b-b195a01b3a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:41.879795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae901c-503e-4107-bf5b-b195a01b3a0b None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:41.880077 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae901c-503e-4107-bf5b-b195a01b3a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:41.880357 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae901c-503e-4107-bf5b-b195a01b3a0b None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:41.881020 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae901c-503e-4107-bf5b-b195a01b3a0b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:44:41.881320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae901c-503e-4107-bf5b-b195a01b3a0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:41.882729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae901c-503e-4107-bf5b-b195a01b3a0b None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:41.890985 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 43/79] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:44:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:41.891680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae901c-503e-4107-bf5b-b195a01b3a0b None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:41.902628 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:41.955952 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6e459-a188-40c8-bdc3-580c5f5888bc None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:41.958289 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:41.990215 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d77528-9af2-444d-9a1d-9af8cc872c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:41.990840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d77528-9af2-444d-9a1d-9af8cc872c03 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:41.991122 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d77528-9af2-444d-9a1d-9af8cc872c03 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:41.991397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d77528-9af2-444d-9a1d-9af8cc872c03 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:41.991567 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae901c-503e-4107-bf5b-b195a01b3a0b None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:41.992501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d77528-9af2-444d-9a1d-9af8cc872c03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:41.994502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d77528-9af2-444d-9a1d-9af8cc872c03 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:41.996042 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 37/80] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:44:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:42.001352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d77528-9af2-444d-9a1d-9af8cc872c03 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:42.025465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57461736-a181-44fd-8772-843e8ffe52fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:42.026116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57461736-a181-44fd-8772-843e8ffe52fa None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:42.026398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57461736-a181-44fd-8772-843e8ffe52fa None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:42.026673 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57461736-a181-44fd-8772-843e8ffe52fa None admin] PATH_INFO: `/v3/users/b3da54db0785474cb38733cf09ad01a1` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:42.027806 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57461736-a181-44fd-8772-843e8ffe52fa None admin] RBAC: Authorizing `identity:get_user(user_id=b3da54db0785474cb38733cf09ad01a1)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:42.029229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57461736-a181-44fd-8772-843e8ffe52fa None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:42.030830 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 44/81] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:44:41 2022] GET /identity/v3/users/b3da54db0785474cb38733cf09ad01a1 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:42.031584 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57461736-a181-44fd-8772-843e8ffe52fa None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:42.097308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d77528-9af2-444d-9a1d-9af8cc872c03 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:42.106316 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:42.129479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57461736-a181-44fd-8772-843e8ffe52fa None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:42.133119 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07bb7ca-8f8c-4df6-83d8-a7cd231dc02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:42.133749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07bb7ca-8f8c-4df6-83d8-a7cd231dc02f None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:42.134557 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07bb7ca-8f8c-4df6-83d8-a7cd231dc02f None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:42.134829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07bb7ca-8f8c-4df6-83d8-a7cd231dc02f None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:42.135484 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07bb7ca-8f8c-4df6-83d8-a7cd231dc02f None admin] RBAC: Adding query filter params (name=member) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:44:42.135786 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07bb7ca-8f8c-4df6-83d8-a7cd231dc02f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:42.137158 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07bb7ca-8f8c-4df6-83d8-a7cd231dc02f None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:42.144910 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 38/82] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Sep 4 00:44:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:42.145711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07bb7ca-8f8c-4df6-83d8-a7cd231dc02f None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:42.163100 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d6844-2fd5-41f0-af72-3ac865263e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:42.163703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d6844-2fd5-41f0-af72-3ac865263e7d None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:42.163984 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d6844-2fd5-41f0-af72-3ac865263e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:42.164257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d6844-2fd5-41f0-af72-3ac865263e7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:42.179125 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:42.230335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d6844-2fd5-41f0-af72-3ac865263e7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:42.231822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d6844-2fd5-41f0-af72-3ac865263e7d None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:42.244363 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07bb7ca-8f8c-4df6-83d8-a7cd231dc02f None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:42.278723 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ba3e1-0f43-41ff-894e-f24449f9f882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:42.279348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ba3e1-0f43-41ff-894e-f24449f9f882 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:42.279629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ba3e1-0f43-41ff-894e-f24449f9f882 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:42.279901 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ba3e1-0f43-41ff-894e-f24449f9f882 None admin] PATH_INFO: `/v3/users/28a752c790934abebf720d75724b5b66` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:42.281009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ba3e1-0f43-41ff-894e-f24449f9f882 None admin] RBAC: Authorizing `identity:get_user(user_id=28a752c790934abebf720d75724b5b66)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:42.282475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ba3e1-0f43-41ff-894e-f24449f9f882 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:42.284033 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 39/83] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:44:42 2022] GET /identity/v3/users/28a752c790934abebf720d75724b5b66 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:42.284764 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ba3e1-0f43-41ff-894e-f24449f9f882 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:42.308203 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:42.331465 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 45/84] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:44:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 04 00:44:42.332473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d6844-2fd5-41f0-af72-3ac865263e7d None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:42.381976 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ba3e1-0f43-41ff-894e-f24449f9f882 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:42.383463 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:42.416454 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f92c9-8e36-43ab-abdf-e9d0a661e129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:42.417055 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f92c9-8e36-43ab-abdf-e9d0a661e129 None admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:42.417337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f92c9-8e36-43ab-abdf-e9d0a661e129 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:42.417647 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f92c9-8e36-43ab-abdf-e9d0a661e129 None admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:42.418296 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f92c9-8e36-43ab-abdf-e9d0a661e129 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:42.419732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f92c9-8e36-43ab-abdf-e9d0a661e129 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:42.429516 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d6844-2fd5-41f0-af72-3ac865263e7d None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:42.440535 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 40/85] 10.222.0.30 () {60 vars in 1132 bytes} [Sun Sep 4 00:44:42 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:44:42.446003 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f92c9-8e36-43ab-abdf-e9d0a661e129 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:42.475726 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a34e6d-0555-4bf0-bdb8-887c3c72077d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:42.477067 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a34e6d-0555-4bf0-bdb8-887c3c72077d None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:42.477482 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a34e6d-0555-4bf0-bdb8-887c3c72077d None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:42.478636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a34e6d-0555-4bf0-bdb8-887c3c72077d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:42.531574 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:42.561252 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a34e6d-0555-4bf0-bdb8-887c3c72077d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:42.562647 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f92c9-8e36-43ab-abdf-e9d0a661e129 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:42.563089 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a34e6d-0555-4bf0-bdb8-887c3c72077d None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:42.600338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a107a2-d8ca-46a4-9104-4f3d8d041419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:42.600985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a107a2-d8ca-46a4-9104-4f3d8d041419 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:42.601269 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a107a2-d8ca-46a4-9104-4f3d8d041419 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:42.601580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a107a2-d8ca-46a4-9104-4f3d8d041419 None admin] PATH_INFO: `/v3/users/28a752c790934abebf720d75724b5b66` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:42.603317 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a107a2-d8ca-46a4-9104-4f3d8d041419 None admin] RBAC: Authorizing `identity:get_user(user_id=28a752c790934abebf720d75724b5b66)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:42.604811 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a107a2-d8ca-46a4-9104-4f3d8d041419 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:42.606650 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 41/86] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:44:42 2022] GET /identity/v3/users/28a752c790934abebf720d75724b5b66 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:42.610758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a107a2-d8ca-46a4-9104-4f3d8d041419 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:42.640623 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:42.686877 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 46/87] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:44:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 04 00:44:42.687728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a34e6d-0555-4bf0-bdb8-887c3c72077d None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:42.743035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a107a2-d8ca-46a4-9104-4f3d8d041419 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:42.785662 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2d315-df05-47c1-9d9d-89b8544efcec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:42.786504 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2d315-df05-47c1-9d9d-89b8544efcec None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:42.786928 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2d315-df05-47c1-9d9d-89b8544efcec None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:42.787336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2d315-df05-47c1-9d9d-89b8544efcec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:42.788218 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:42.814868 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a34e6d-0555-4bf0-bdb8-887c3c72077d None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:42.857725 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4949d-1499-45af-a894-990aac42af52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:42.858816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4949d-1499-45af-a894-990aac42af52 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:42.859109 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4949d-1499-45af-a894-990aac42af52 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:42.860178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4949d-1499-45af-a894-990aac42af52 None admin] PATH_INFO: `/v3/projects/97a75aeee8d742edb0aa9858a8c2eede` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:42.861398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a4949d-1499-45af-a894-990aac42af52 None admin] RBAC: Authorizing `identity:get_project(project_id=97a75aeee8d742edb0aa9858a8c2eede)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:42.862468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2d315-df05-47c1-9d9d-89b8544efcec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:42.862916 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a4949d-1499-45af-a894-990aac42af52 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:42.864393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2d315-df05-47c1-9d9d-89b8544efcec None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:42.864584 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 47/88] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:44:42 2022] GET /identity/v3/projects/97a75aeee8d742edb0aa9858a8c2eede => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:42.865366 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4949d-1499-45af-a894-990aac42af52 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:42.893521 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:42.970452 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 42/89] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:44:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 04 00:44:42.971638 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2d315-df05-47c1-9d9d-89b8544efcec None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:42.977724 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4949d-1499-45af-a894-990aac42af52 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:43.016207 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf895c39-763c-4538-8eb4-74c2f3f509c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:43.016708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf895c39-763c-4538-8eb4-74c2f3f509c4 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:43.017014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf895c39-763c-4538-8eb4-74c2f3f509c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:43.017279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf895c39-763c-4538-8eb4-74c2f3f509c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:43.033047 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:43.085421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2d315-df05-47c1-9d9d-89b8544efcec None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:43.091874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf895c39-763c-4538-8eb4-74c2f3f509c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:43.093501 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf895c39-763c-4538-8eb4-74c2f3f509c4 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:43.117353 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:43.130020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad104dd-c373-4696-9c32-3e9d16177146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:43.130853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad104dd-c373-4696-9c32-3e9d16177146 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:43.131141 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad104dd-c373-4696-9c32-3e9d16177146 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:43.131418 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad104dd-c373-4696-9c32-3e9d16177146 None admin] PATH_INFO: `/v3/projects/97a75aeee8d742edb0aa9858a8c2eede` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:43.133349 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad104dd-c373-4696-9c32-3e9d16177146 None admin] RBAC: Authorizing `identity:get_project(project_id=97a75aeee8d742edb0aa9858a8c2eede)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:43.135554 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad104dd-c373-4696-9c32-3e9d16177146 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:43.136812 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 43/90] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:44:42 2022] GET /identity/v3/projects/97a75aeee8d742edb0aa9858a8c2eede => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:43.137360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad104dd-c373-4696-9c32-3e9d16177146 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:43.215715 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 48/91] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:44:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 04 00:44:43.217004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf895c39-763c-4538-8eb4-74c2f3f509c4 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:43.253847 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad104dd-c373-4696-9c32-3e9d16177146 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:43.277847 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:43.293340 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9364661-7449-4d30-9259-fd44f7e3720c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:43.294245 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9364661-7449-4d30-9259-fd44f7e3720c None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:43.294710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9364661-7449-4d30-9259-fd44f7e3720c None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:43.295169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9364661-7449-4d30-9259-fd44f7e3720c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:43.296027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9364661-7449-4d30-9259-fd44f7e3720c None admin] RBAC: Adding query filter params (role.id=7c1abe5c3a82479484ec5a104ec31f8f, scope.project.id=97a75aeee8d742edb0aa9858a8c2eede, user.id=28a752c790934abebf720d75724b5b66) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:44:43.296475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9364661-7449-4d30-9259-fd44f7e3720c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:43.298322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9364661-7449-4d30-9259-fd44f7e3720c None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:43.305162 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 44/92] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:44:43 2022] GET /identity/v3/role_assignments?user.id=28a752c790934abebf720d75724b5b66&scope.project.id=97a75aeee8d742edb0aa9858a8c2eede&role.id=7c1abe5c3a82479484ec5a104ec31f8f => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:43.307623 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9364661-7449-4d30-9259-fd44f7e3720c None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:43.377355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf895c39-763c-4538-8eb4-74c2f3f509c4 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:43.432428 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:43.447015 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9d554-d086-4ae2-9907-d209be0de68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:43.449081 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9d554-d086-4ae2-9907-d209be0de68c None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:43.450584 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9d554-d086-4ae2-9907-d209be0de68c None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:43.451013 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9d554-d086-4ae2-9907-d209be0de68c None admin] PATH_INFO: `/v3/projects/97a75aeee8d742edb0aa9858a8c2eede` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:43.452708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9d554-d086-4ae2-9907-d209be0de68c None admin] RBAC: Authorizing `identity:get_project(project_id=97a75aeee8d742edb0aa9858a8c2eede)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:43.461460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9d554-d086-4ae2-9907-d209be0de68c None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:43.461460 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 49/93] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:44:43 2022] GET /identity/v3/projects/97a75aeee8d742edb0aa9858a8c2eede => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:43.461460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9d554-d086-4ae2-9907-d209be0de68c None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:43.514703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9364661-7449-4d30-9259-fd44f7e3720c None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:43.584742 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300d4a2-79d6-4a36-ae96-8655d6e7c0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:43.585388 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300d4a2-79d6-4a36-ae96-8655d6e7c0b0 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:43.585670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300d4a2-79d6-4a36-ae96-8655d6e7c0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:43.585948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300d4a2-79d6-4a36-ae96-8655d6e7c0b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:43.586690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300d4a2-79d6-4a36-ae96-8655d6e7c0b0 None admin] RBAC: Adding query filter params (role.id=d255b03c37d64371a148ec4e11be01d9, scope.project.id=97a75aeee8d742edb0aa9858a8c2eede, user.id=b3da54db0785474cb38733cf09ad01a1) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:44:43.587532 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300d4a2-79d6-4a36-ae96-8655d6e7c0b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:43.589027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300d4a2-79d6-4a36-ae96-8655d6e7c0b0 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:43.604286 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 45/94] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:44:43 2022] GET /identity/v3/role_assignments?user.id=b3da54db0785474cb38733cf09ad01a1&scope.project.id=97a75aeee8d742edb0aa9858a8c2eede&role.id=d255b03c37d64371a148ec4e11be01d9 => generated 259 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:43.605158 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300d4a2-79d6-4a36-ae96-8655d6e7c0b0 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:43.707438 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9d554-d086-4ae2-9907-d209be0de68c None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:43.738394 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:43.782938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f403a45-4745-49f2-a2d4-62c1ec3916ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:43.783523 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f403a45-4745-49f2-a2d4-62c1ec3916ea None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:43.783809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f403a45-4745-49f2-a2d4-62c1ec3916ea None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:43.784085 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f403a45-4745-49f2-a2d4-62c1ec3916ea None admin] PATH_INFO: `/v3/projects/4330b901b5f6416197372ef9463c8c6a` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:43.787014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f403a45-4745-49f2-a2d4-62c1ec3916ea None admin] RBAC: Authorizing `identity:get_project(project_id=4330b901b5f6416197372ef9463c8c6a)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:43.789996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f403a45-4745-49f2-a2d4-62c1ec3916ea None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:43.793318 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 50/95] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:44:43 2022] GET /identity/v3/projects/4330b901b5f6416197372ef9463c8c6a => generated 312 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:43.799174 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f403a45-4745-49f2-a2d4-62c1ec3916ea None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:43.806527 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300d4a2-79d6-4a36-ae96-8655d6e7c0b0 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:43.852012 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:43.872472 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962cb6a-5969-4019-9c44-89a56215e636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:43.873095 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962cb6a-5969-4019-9c44-89a56215e636 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:43.873380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962cb6a-5969-4019-9c44-89a56215e636 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:43.873685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962cb6a-5969-4019-9c44-89a56215e636 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:43.875371 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962cb6a-5969-4019-9c44-89a56215e636 None admin] RBAC: Adding query filter params (role.id=c6d447182cac4a6ca92d2457e8936b91, scope.project.id=97a75aeee8d742edb0aa9858a8c2eede, user.id=28a752c790934abebf720d75724b5b66) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:44:43.875686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962cb6a-5969-4019-9c44-89a56215e636 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:43.885978 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962cb6a-5969-4019-9c44-89a56215e636 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:43.893536 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 46/96] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:44:43 2022] GET /identity/v3/role_assignments?user.id=28a752c790934abebf720d75724b5b66&scope.project.id=97a75aeee8d742edb0aa9858a8c2eede&role.id=c6d447182cac4a6ca92d2457e8936b91 => generated 259 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:43.987400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f403a45-4745-49f2-a2d4-62c1ec3916ea None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:44.032112 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91f858-7206-4fdb-8235-514fde5a7499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:44.032743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91f858-7206-4fdb-8235-514fde5a7499 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:44.033080 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91f858-7206-4fdb-8235-514fde5a7499 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:44.033300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91f858-7206-4fdb-8235-514fde5a7499 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:44.034072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91f858-7206-4fdb-8235-514fde5a7499 None admin] RBAC: Adding query filter params (role.id=7c1abe5c3a82479484ec5a104ec31f8f, scope.project.id=4330b901b5f6416197372ef9463c8c6a, user.id=28a752c790934abebf720d75724b5b66) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:44:44.034380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91f858-7206-4fdb-8235-514fde5a7499 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:44.035829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91f858-7206-4fdb-8235-514fde5a7499 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:44.049021 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 51/97] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:44:43 2022] GET /identity/v3/role_assignments?user.id=28a752c790934abebf720d75724b5b66&scope.project.id=4330b901b5f6416197372ef9463c8c6a&role.id=7c1abe5c3a82479484ec5a104ec31f8f => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:44.857168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405192f8-e0c1-4133-be92-91009da1de9b None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:44.857684 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405192f8-e0c1-4133-be92-91009da1de9b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:44.857684 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405192f8-e0c1-4133-be92-91009da1de9b None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:44.859532 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 47/98] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:44:44.864685 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3feee5a-c8c8-4bc8-90af-717418c58f70 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:44.865078 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3feee5a-c8c8-4bc8-90af-717418c58f70 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:44.865240 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3feee5a-c8c8-4bc8-90af-717418c58f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:44.894414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d3feee5a-c8c8-4bc8-90af-717418c58f70 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:44:44.895621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d3feee5a-c8c8-4bc8-90af-717418c58f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:44:44.943535 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:44.974035 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 52/99] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:44:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:44:44.979756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fc002-c71e-456d-844a-7e8a143b3e23 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:44.980049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fc002-c71e-456d-844a-7e8a143b3e23 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:44.980331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fc002-c71e-456d-844a-7e8a143b3e23 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:44.981707 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 48/100] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:44:44.986937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005255be-59ca-4fb8-91b2-f635dd12ccd7 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:44.987230 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005255be-59ca-4fb8-91b2-f635dd12ccd7 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:44.987510 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005255be-59ca-4fb8-91b2-f635dd12ccd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:45.014374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-005255be-59ca-4fb8-91b2-f635dd12ccd7 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:44:45.015560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-005255be-59ca-4fb8-91b2-f635dd12ccd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:44:45.095641 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 53/101] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:44:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 04 00:44:45.327783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710fc002-c71e-456d-844a-7e8a143b3e23 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:45.483930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710fc002-c71e-456d-844a-7e8a143b3e23 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:45.534644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6705eae-7e3a-4866-8d12-66e06e406a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:45.535649 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6705eae-7e3a-4866-8d12-66e06e406a7c None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:45.536149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6705eae-7e3a-4866-8d12-66e06e406a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:45.536622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6705eae-7e3a-4866-8d12-66e06e406a7c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:45.542099 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6705eae-7e3a-4866-8d12-66e06e406a7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:45.543797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6705eae-7e3a-4866-8d12-66e06e406a7c None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:45.546003 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 49/102] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:44:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:45.551719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005255be-59ca-4fb8-91b2-f635dd12ccd7 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:45.706206 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005255be-59ca-4fb8-91b2-f635dd12ccd7 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:45.708582 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:45.716350 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6705eae-7e3a-4866-8d12-66e06e406a7c None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:45.745279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564779bd-765b-4a90-8e3e-79356a49f0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:45.745933 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564779bd-765b-4a90-8e3e-79356a49f0e0 None admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:45.746219 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564779bd-765b-4a90-8e3e-79356a49f0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:45.746496 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564779bd-765b-4a90-8e3e-79356a49f0e0 None admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:45.747150 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564779bd-765b-4a90-8e3e-79356a49f0e0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:45.748609 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564779bd-765b-4a90-8e3e-79356a49f0e0 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:45.787098 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 54/103] 10.222.0.30 () {60 vars in 1141 bytes} [Sun Sep 4 00:44:45 2022] POST /identity/v3/projects => generated 302 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:44:45.827531 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:45.888197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6705eae-7e3a-4866-8d12-66e06e406a7c None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:45.896320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76bfc75-363b-4a49-8eb0-77f0e1dae30c None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:45.896841 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76bfc75-363b-4a49-8eb0-77f0e1dae30c None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:45.896914 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76bfc75-363b-4a49-8eb0-77f0e1dae30c None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:45.898257 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 55/104] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 04 00:44:45.903877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c522c-a921-4c0b-810c-8aca469da6dc None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:45.904167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c522c-a921-4c0b-810c-8aca469da6dc None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:45.904446 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c522c-a921-4c0b-810c-8aca469da6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:45.944367 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-fb7c522c-a921-4c0b-810c-8aca469da6dc None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:44:45.945791 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-fb7c522c-a921-4c0b-810c-8aca469da6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:44:45.951830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68958a-687d-4bb6-a479-711182ae7082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:45.952482 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68958a-687d-4bb6-a479-711182ae7082 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:45.952871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68958a-687d-4bb6-a479-711182ae7082 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:45.953124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68958a-687d-4bb6-a479-711182ae7082 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:45.975559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68958a-687d-4bb6-a479-711182ae7082 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:44:45.984685 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-8d68958a-687d-4bb6-a479-711182ae7082 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 04 00:44:45.984685 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:44:45.984685 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:44:45.984685 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:44:45.984685 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:44:45.984685 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:44:45.984685 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:44:45.984685 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:44:45.984685 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:44:45.984685 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:44:45.984685 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:44:45.984685 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:44:45.984685 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:44:45.984685 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:44:45.984685 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:44:45.984685 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:44:45.985534 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:44:45.985534 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:44:45.985534 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:44:45.985534 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:44:45.985534 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:44:45.985534 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:44:45.985534 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:44:45.985534 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:44:45.985534 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:44:45.985534 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:44:45.985534 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:44:45.985534 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:44:45.985534 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:44:45.985534 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:44:45.985534 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:44:45.985534 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:44:45.986279 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:44:45.986279 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:44:45.986279 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:44:45.986279 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:44:45.986279 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:44:45.986279 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:44:45.986279 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:44:45.986279 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:44:45.986279 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:44:45.986279 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:44:45.986279 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 04 00:44:45.986279 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:44:45.994386 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 50/105] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:44:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:44:46.002425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68958a-687d-4bb6-a479-711182ae7082 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:46.069109 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 56/106] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:44:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:44:46.134035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68958a-687d-4bb6-a479-711182ae7082 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:46.153994 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:46.176969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf30a1-e145-4159-beae-1a0d60e9cf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:46.177683 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf30a1-e145-4159-beae-1a0d60e9cf85 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:46.177968 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf30a1-e145-4159-beae-1a0d60e9cf85 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:46.178246 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf30a1-e145-4159-beae-1a0d60e9cf85 None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:46.178923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf30a1-e145-4159-beae-1a0d60e9cf85 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:44:46.179288 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf30a1-e145-4159-beae-1a0d60e9cf85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:46.182949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf30a1-e145-4159-beae-1a0d60e9cf85 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:46.190361 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 51/107] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Sep 4 00:44:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:46.196203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c522c-a921-4c0b-810c-8aca469da6dc None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:46.334708 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:46.354326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c522c-a921-4c0b-810c-8aca469da6dc None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:46.411921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf30a1-e145-4159-beae-1a0d60e9cf85 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:46.414348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27118931-fb9e-4598-bb49-151de05c488d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:46.414983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27118931-fb9e-4598-bb49-151de05c488d None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:46.415786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27118931-fb9e-4598-bb49-151de05c488d None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:46.416061 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27118931-fb9e-4598-bb49-151de05c488d None admin] PATH_INFO: `/v3/users/bb0fe5ece41d4827ba140b8aa4240807` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:46.440121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27118931-fb9e-4598-bb49-151de05c488d None admin] RBAC: Authorizing `identity:get_user(user_id=bb0fe5ece41d4827ba140b8aa4240807)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:46.441941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27118931-fb9e-4598-bb49-151de05c488d None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:46.443896 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 57/108] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:44:46 2022] GET /identity/v3/users/bb0fe5ece41d4827ba140b8aa4240807 => generated 289 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:46.450162 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27118931-fb9e-4598-bb49-151de05c488d None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:46.612697 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf30a1-e145-4159-beae-1a0d60e9cf85 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:46.658512 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27118931-fb9e-4598-bb49-151de05c488d None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:46.677380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8aa3c4-9bb5-4e58-89d0-26c2d5dd6f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:46.678045 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8aa3c4-9bb5-4e58-89d0-26c2d5dd6f69 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:46.678327 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8aa3c4-9bb5-4e58-89d0-26c2d5dd6f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:46.678601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8aa3c4-9bb5-4e58-89d0-26c2d5dd6f69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:46.699119 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8aa3c4-9bb5-4e58-89d0-26c2d5dd6f69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:44:46.705810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-ad8aa3c4-9bb5-4e58-89d0-26c2d5dd6f69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 04 00:44:46.705810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:44:46.705810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:44:46.705810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:44:46.705810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:44:46.705810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:44:46.705810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:44:46.705810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:44:46.705810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:44:46.705810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:44:46.705810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:44:46.705810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:44:46.705810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:44:46.705810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:44:46.705810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:44:46.705810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:44:46.706661 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:44:46.706661 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:44:46.706661 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:44:46.706661 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:44:46.706661 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:44:46.706661 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:44:46.706661 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:44:46.706661 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:44:46.706661 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:44:46.706661 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:44:46.706661 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:44:46.706661 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:44:46.706661 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:44:46.706661 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:44:46.706661 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:44:46.706661 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:44:46.707404 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:44:46.707404 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:44:46.707404 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:44:46.707404 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:44:46.707404 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:44:46.707404 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:44:46.707404 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:44:46.707404 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:44:46.707404 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:44:46.707404 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:44:46.707404 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 04 00:44:46.707404 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:44:46.707404 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 52/109] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:44:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:44:46.714942 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8aa3c4-9bb5-4e58-89d0-26c2d5dd6f69 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:46.740264 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1a0d9-989c-4967-951b-b21a8ffbf67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:46.741021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1a0d9-989c-4967-951b-b21a8ffbf67d None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:46.741309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1a0d9-989c-4967-951b-b21a8ffbf67d None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:46.741625 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1a0d9-989c-4967-951b-b21a8ffbf67d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:46.766072 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:46.785084 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:46.886414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8aa3c4-9bb5-4e58-89d0-26c2d5dd6f69 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:46.905074 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1a0d9-989c-4967-951b-b21a8ffbf67d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:46.906582 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1a0d9-989c-4967-951b-b21a8ffbf67d None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:46.941104 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c361fc-26c1-445f-bf03-64829cec2434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:46.942036 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c361fc-26c1-445f-bf03-64829cec2434 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:46.942391 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c361fc-26c1-445f-bf03-64829cec2434 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:46.942665 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c361fc-26c1-445f-bf03-64829cec2434 None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:46.943328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c361fc-26c1-445f-bf03-64829cec2434 None admin] RBAC: Adding query filter params (name=member) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:44:46.943628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c361fc-26c1-445f-bf03-64829cec2434 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:46.945199 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c361fc-26c1-445f-bf03-64829cec2434 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:46.961253 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 53/110] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Sep 4 00:44:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:44:46.963491 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fba38f-28d6-4f73-844d-0663ee83a348 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:46.963889 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fba38f-28d6-4f73-844d-0663ee83a348 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:46.964274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fba38f-28d6-4f73-844d-0663ee83a348 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:46.965760 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 54/111] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:44:46.966736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6d3d6-2954-4fc9-9941-f99d5c2bf315 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:46.967187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6d3d6-2954-4fc9-9941-f99d5c2bf315 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:46.967579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6d3d6-2954-4fc9-9941-f99d5c2bf315 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:46.969113 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 55/112] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:44:46.970280 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a65c63-a26b-46a8-86d6-feb34d3da15a None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:46.973779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a65c63-a26b-46a8-86d6-feb34d3da15a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:46.974596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a65c63-a26b-46a8-86d6-feb34d3da15a None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:46.976014 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 56/113] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:44:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:44:46.976955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cec054-ec2d-4ffb-8001-326a7cf9e9eb None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:46.977363 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cec054-ec2d-4ffb-8001-326a7cf9e9eb None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:46.977727 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cec054-ec2d-4ffb-8001-326a7cf9e9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:46.995931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-64cec054-ec2d-4ffb-8001-326a7cf9e9eb None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:44:46.997131 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-64cec054-ec2d-4ffb-8001-326a7cf9e9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:44:47.027851 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 58/114] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:44:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 04 00:44:47.028707 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1a0d9-989c-4967-951b-b21a8ffbf67d None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:47.073260 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 57/115] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:44:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:44:47.074798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4df51-8952-48e4-9189-94b5f1f8018b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:47.075146 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4df51-8952-48e4-9189-94b5f1f8018b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:47.075486 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4df51-8952-48e4-9189-94b5f1f8018b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:47.085877 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:47.095848 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-37e4df51-8952-48e4-9189-94b5f1f8018b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:44:47.097242 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-37e4df51-8952-48e4-9189-94b5f1f8018b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:44:47.123397 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:47.152744 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1a0d9-989c-4967-951b-b21a8ffbf67d None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:47.170554 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 58/116] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:44:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:44:47.172018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd3920-c729-453d-93fb-4def64032dc0 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:47.172525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd3920-c729-453d-93fb-4def64032dc0 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:47.172993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd3920-c729-453d-93fb-4def64032dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:47.192227 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032388c-3e9a-438b-b6b0-af5f2308b90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:47.192860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032388c-3e9a-438b-b6b0-af5f2308b90e None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:47.193139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032388c-3e9a-438b-b6b0-af5f2308b90e None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:47.193412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032388c-3e9a-438b-b6b0-af5f2308b90e None admin] PATH_INFO: `/v3/users/28a752c790934abebf720d75724b5b66` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:47.194077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-f1fd3920-c729-453d-93fb-4def64032dc0 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:44:47.194584 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032388c-3e9a-438b-b6b0-af5f2308b90e None admin] RBAC: Authorizing `identity:get_user(user_id=28a752c790934abebf720d75724b5b66)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:47.195771 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f1fd3920-c729-453d-93fb-4def64032dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:44:47.196037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032388c-3e9a-438b-b6b0-af5f2308b90e None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:47.198327 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 59/117] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:44:47 2022] GET /identity/v3/users/28a752c790934abebf720d75724b5b66 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:47.199111 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032388c-3e9a-438b-b6b0-af5f2308b90e None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:47.325669 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 59/118] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:44:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:44:47.327001 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd3920-c729-453d-93fb-4def64032dc0 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:47.381032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032388c-3e9a-438b-b6b0-af5f2308b90e None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:47.416819 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:47.466948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4c856-4a63-44b4-9395-896af14044ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:47.467605 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4c856-4a63-44b4-9395-896af14044ee None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:47.467884 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4c856-4a63-44b4-9395-896af14044ee None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:47.468159 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4c856-4a63-44b4-9395-896af14044ee None admin] PATH_INFO: `/v3/projects/97a75aeee8d742edb0aa9858a8c2eede` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:47.468868 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:47.469335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db4c856-4a63-44b4-9395-896af14044ee None admin] RBAC: Authorizing `identity:get_project(project_id=97a75aeee8d742edb0aa9858a8c2eede)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:47.470859 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db4c856-4a63-44b4-9395-896af14044ee None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:47.472824 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 60/119] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:44:47 2022] GET /identity/v3/projects/97a75aeee8d742edb0aa9858a8c2eede => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:47.473643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4c856-4a63-44b4-9395-896af14044ee None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:47.488442 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd3920-c729-453d-93fb-4def64032dc0 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:47.525084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17659c1-b674-4acf-b4bd-32879e1a2239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:47.525881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17659c1-b674-4acf-b4bd-32879e1a2239 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:47.526233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17659c1-b674-4acf-b4bd-32879e1a2239 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:47.526580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17659c1-b674-4acf-b4bd-32879e1a2239 None admin] PATH_INFO: `/v3/projects/97a75aeee8d742edb0aa9858a8c2eede` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:47.527800 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17659c1-b674-4acf-b4bd-32879e1a2239 None admin] RBAC: Authorizing `identity:get_project(project_id=97a75aeee8d742edb0aa9858a8c2eede)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:47.529332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17659c1-b674-4acf-b4bd-32879e1a2239 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:47.531429 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 60/120] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:44:47 2022] GET /identity/v3/projects/97a75aeee8d742edb0aa9858a8c2eede => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:47.532266 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17659c1-b674-4acf-b4bd-32879e1a2239 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:47.606537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4c856-4a63-44b4-9395-896af14044ee None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:47.641788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a262331-f570-4caa-be86-c48df3b1b190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:47.642424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a262331-f570-4caa-be86-c48df3b1b190 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:47.642703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a262331-f570-4caa-be86-c48df3b1b190 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:47.642976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a262331-f570-4caa-be86-c48df3b1b190 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:47.656677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a262331-f570-4caa-be86-c48df3b1b190 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:44:47.662318 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-4a262331-f570-4caa-be86-c48df3b1b190 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 04 00:44:47.662318 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:44:47.662318 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:44:47.662318 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:44:47.662318 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:44:47.662318 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:44:47.662318 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:44:47.662318 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:44:47.662318 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:44:47.662318 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:44:47.662318 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:44:47.662318 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:44:47.662318 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:44:47.662318 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:44:47.662318 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:44:47.662318 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:44:47.663384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:44:47.663384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:44:47.663384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:44:47.663384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:44:47.663384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:44:47.663384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:44:47.663384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:44:47.663384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:44:47.663384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:44:47.663384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:44:47.663384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:44:47.663384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:44:47.663384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:44:47.663384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:44:47.663384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:44:47.663384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:44:47.665548 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:44:47.665548 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:44:47.665548 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:44:47.665548 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:44:47.665548 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:44:47.665548 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:44:47.665548 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:44:47.665548 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:44:47.665548 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:44:47.665548 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:44:47.665548 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 04 00:44:47.665548 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:44:47.665548 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 61/121] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:44:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:44:47.665548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a262331-f570-4caa-be86-c48df3b1b190 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:47.682387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17659c1-b674-4acf-b4bd-32879e1a2239 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:47.712441 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:47.715984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431c8c9-bfb4-4886-96c8-51cf7e49d6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:47.716613 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431c8c9-bfb4-4886-96c8-51cf7e49d6d4 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:47.716892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431c8c9-bfb4-4886-96c8-51cf7e49d6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:47.717162 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431c8c9-bfb4-4886-96c8-51cf7e49d6d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:47.718179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d431c8c9-bfb4-4886-96c8-51cf7e49d6d4 None admin] RBAC: Adding query filter params (role.id=9cf4680c808546e286e3a5c3383d98e1, scope.project.id=97a75aeee8d742edb0aa9858a8c2eede, user.id=bb0fe5ece41d4827ba140b8aa4240807) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:44:47.718179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d431c8c9-bfb4-4886-96c8-51cf7e49d6d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:47.719743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d431c8c9-bfb4-4886-96c8-51cf7e49d6d4 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:47.725137 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 61/122] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:44:47 2022] GET /identity/v3/role_assignments?user.id=bb0fe5ece41d4827ba140b8aa4240807&scope.project.id=97a75aeee8d742edb0aa9858a8c2eede&role.id=9cf4680c808546e286e3a5c3383d98e1 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:47.725974 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431c8c9-bfb4-4886-96c8-51cf7e49d6d4 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:47.765353 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:47.794010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a262331-f570-4caa-be86-c48df3b1b190 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:47.839134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224e2f1-848f-4f7c-82a4-f2b3012332e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:47.839817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224e2f1-848f-4f7c-82a4-f2b3012332e8 None admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:47.840096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224e2f1-848f-4f7c-82a4-f2b3012332e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:47.840374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224e2f1-848f-4f7c-82a4-f2b3012332e8 None admin] PATH_INFO: `/v3/projects/97a75aeee8d742edb0aa9858a8c2eede/users/28a752c790934abebf720d75724b5b66/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:47.842665 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224e2f1-848f-4f7c-82a4-f2b3012332e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=97a75aeee8d742edb0aa9858a8c2eede, user_id=28a752c790934abebf720d75724b5b66, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:47.843927 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224e2f1-848f-4f7c-82a4-f2b3012332e8 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:47.867023 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 62/123] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Sep 4 00:44:47 2022] PUT /identity/v3/projects/97a75aeee8d742edb0aa9858a8c2eede/users/28a752c790934abebf720d75724b5b66/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:44:47.868888 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224e2f1-848f-4f7c-82a4-f2b3012332e8 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:47.879415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431c8c9-bfb4-4886-96c8-51cf7e49d6d4 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:47.931576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9005e0f-6ec1-4622-b8b4-d8b319d3f38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:47.932239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9005e0f-6ec1-4622-b8b4-d8b319d3f38b None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:47.932580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9005e0f-6ec1-4622-b8b4-d8b319d3f38b None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:47.932794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9005e0f-6ec1-4622-b8b4-d8b319d3f38b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:47.948434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9005e0f-6ec1-4622-b8b4-d8b319d3f38b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:44:47.955208 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-e9005e0f-6ec1-4622-b8b4-d8b319d3f38b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 04 00:44:47.955208 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:44:47.955208 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:44:47.955208 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:44:47.955208 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:44:47.955208 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:44:47.955208 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:44:47.955208 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:44:47.955208 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:44:47.955208 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:44:47.955208 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:44:47.955208 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:44:47.955208 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:44:47.955208 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:44:47.955208 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:44:47.955208 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:44:47.956118 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:44:47.956118 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:44:47.956118 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:44:47.956118 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:44:47.956118 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:44:47.956118 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:44:47.956118 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:44:47.956118 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:44:47.956118 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:44:47.956118 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:44:47.956118 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:44:47.956118 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:44:47.956118 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:44:47.956118 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:44:47.956118 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:44:47.956118 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:44:47.957312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:44:47.957312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:44:47.957312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:44:47.957312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:44:47.957312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:44:47.957312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:44:47.957312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:44:47.957312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:44:47.957312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:44:47.957312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:44:47.957312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 04 00:44:47.957312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:44:47.957312 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 62/124] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Sep 4 00:44:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:44:47.957312 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9005e0f-6ec1-4622-b8b4-d8b319d3f38b None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:48.009011 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:48.014890 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224e2f1-848f-4f7c-82a4-f2b3012332e8 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:48.067350 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:48.085739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c353f52-e582-4786-8f70-25491a5af79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:48.086418 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c353f52-e582-4786-8f70-25491a5af79e None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:48.086716 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c353f52-e582-4786-8f70-25491a5af79e None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:48.087528 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c353f52-e582-4786-8f70-25491a5af79e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:48.093226 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9005e0f-6ec1-4622-b8b4-d8b319d3f38b None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:48.099805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c353f52-e582-4786-8f70-25491a5af79e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:44:48.107599 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-9c353f52-e582-4786-8f70-25491a5af79e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:44:48.107599 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:44:48.107599 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:44:48.107599 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:44:48.107599 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:44:48.107599 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:44:48.107599 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:44:48.107599 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:44:48.107599 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:44:48.107599 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:44:48.107599 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:44:48.107599 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:44:48.107599 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:44:48.107599 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:44:48.107599 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:44:48.107599 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:44:48.108919 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:44:48.108919 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:44:48.108919 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:44:48.108919 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:44:48.108919 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:44:48.108919 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:44:48.108919 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:44:48.108919 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:44:48.108919 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:44:48.108919 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:44:48.108919 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:44:48.108919 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:44:48.108919 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:44:48.108919 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:44:48.108919 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:44:48.108919 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:44:48.109816 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:44:48.109816 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:44:48.109816 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:44:48.109816 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:44:48.109816 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:44:48.109816 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:44:48.109816 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:44:48.109816 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:44:48.109816 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:44:48.109816 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:44:48.109816 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:44:48.109816 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:44:48.110378 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 63/125] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Sep 4 00:44:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:44:48.112479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c353f52-e582-4786-8f70-25491a5af79e None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:48.179522 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b64eed-1db4-4f25-8dc4-b8ce87673e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:48.180150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b64eed-1db4-4f25-8dc4-b8ce87673e41 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:48.180428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b64eed-1db4-4f25-8dc4-b8ce87673e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:48.180755 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b64eed-1db4-4f25-8dc4-b8ce87673e41 None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:48.181406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b64eed-1db4-4f25-8dc4-b8ce87673e41 None admin] RBAC: Adding query filter params (name=member) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:44:48.181739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b64eed-1db4-4f25-8dc4-b8ce87673e41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:48.183196 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b64eed-1db4-4f25-8dc4-b8ce87673e41 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:48.205026 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 63/126] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Sep 4 00:44:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:48.205916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b64eed-1db4-4f25-8dc4-b8ce87673e41 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:48.224732 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c353f52-e582-4786-8f70-25491a5af79e None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:48.298463 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d0b50-6403-4b47-b451-1a342e23bcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:48.299091 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d0b50-6403-4b47-b451-1a342e23bcb8 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:48.299373 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d0b50-6403-4b47-b451-1a342e23bcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:48.299644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d0b50-6403-4b47-b451-1a342e23bcb8 None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:48.300328 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d0b50-6403-4b47-b451-1a342e23bcb8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:44:48.300627 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d0b50-6403-4b47-b451-1a342e23bcb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:48.302541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d0b50-6403-4b47-b451-1a342e23bcb8 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:48.318278 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 64/127] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:44:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:48.320708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d0b50-6403-4b47-b451-1a342e23bcb8 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:48.371977 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:48.382469 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b64eed-1db4-4f25-8dc4-b8ce87673e41 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:48.454530 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd430eda-9846-4ea8-9eac-056fca50d9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:48.455220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd430eda-9846-4ea8-9eac-056fca50d9a9 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:48.455503 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd430eda-9846-4ea8-9eac-056fca50d9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:48.455813 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd430eda-9846-4ea8-9eac-056fca50d9a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:48.456497 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd430eda-9846-4ea8-9eac-056fca50d9a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:44:48.456805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd430eda-9846-4ea8-9eac-056fca50d9a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:48.458318 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd430eda-9846-4ea8-9eac-056fca50d9a9 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:48.468613 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 64/128] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:44:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:48.473895 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd430eda-9846-4ea8-9eac-056fca50d9a9 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:48.477323 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:48.506516 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d0b50-6403-4b47-b451-1a342e23bcb8 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:48.544550 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da7e21-26da-4030-b51a-744709f0c0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:48.545189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da7e21-26da-4030-b51a-744709f0c0c5 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:48.545510 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da7e21-26da-4030-b51a-744709f0c0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:48.545794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da7e21-26da-4030-b51a-744709f0c0c5 None admin] PATH_INFO: `/v3/users/28a752c790934abebf720d75724b5b66` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:48.547150 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da7e21-26da-4030-b51a-744709f0c0c5 None admin] RBAC: Authorizing `identity:get_user(user_id=28a752c790934abebf720d75724b5b66)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:48.548665 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da7e21-26da-4030-b51a-744709f0c0c5 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:48.550864 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 65/129] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:44:48 2022] GET /identity/v3/users/28a752c790934abebf720d75724b5b66 => generated 275 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:48.552107 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc08ca-8106-4d05-8b4b-815f287e3146 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:48.552399 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc08ca-8106-4d05-8b4b-815f287e3146 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:48.552682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc08ca-8106-4d05-8b4b-815f287e3146 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:48.554185 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 66/130] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:44:48.554755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc08ca-8106-4d05-8b4b-815f287e3146 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:48.597227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd430eda-9846-4ea8-9eac-056fca50d9a9 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:48.631783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068bfb4-7624-4916-af99-a76089fcb20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:48.632413 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068bfb4-7624-4916-af99-a76089fcb20e None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:48.632691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068bfb4-7624-4916-af99-a76089fcb20e None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:48.632964 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068bfb4-7624-4916-af99-a76089fcb20e None admin] PATH_INFO: `/v3/users/28a752c790934abebf720d75724b5b66` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:48.634680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068bfb4-7624-4916-af99-a76089fcb20e None admin] RBAC: Authorizing `identity:get_user(user_id=28a752c790934abebf720d75724b5b66)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:48.636165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068bfb4-7624-4916-af99-a76089fcb20e None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:48.637767 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 65/131] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:44:48 2022] GET /identity/v3/users/28a752c790934abebf720d75724b5b66 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:48.638609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068bfb4-7624-4916-af99-a76089fcb20e None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:48.680109 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:48.693794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc08ca-8106-4d05-8b4b-815f287e3146 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:48.727288 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:48.730022 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff721c4c-71a3-41d2-aa38-505383773e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:48.730676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff721c4c-71a3-41d2-aa38-505383773e8d None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:48.730939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff721c4c-71a3-41d2-aa38-505383773e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:48.731214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff721c4c-71a3-41d2-aa38-505383773e8d None admin] PATH_INFO: `/v3/users/b3da54db0785474cb38733cf09ad01a1` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:48.732350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff721c4c-71a3-41d2-aa38-505383773e8d None admin] RBAC: Authorizing `identity:get_user(user_id=b3da54db0785474cb38733cf09ad01a1)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:48.734232 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff721c4c-71a3-41d2-aa38-505383773e8d None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:48.736103 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 67/132] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:44:48 2022] GET /identity/v3/users/b3da54db0785474cb38733cf09ad01a1 => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:48.737898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c3de8-06c2-49f0-8ca8-65c5e39ee375 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:48.738178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c3de8-06c2-49f0-8ca8-65c5e39ee375 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:48.738447 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c3de8-06c2-49f0-8ca8-65c5e39ee375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:48.757280 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a35c3de8-06c2-49f0-8ca8-65c5e39ee375 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:44:48.758619 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a35c3de8-06c2-49f0-8ca8-65c5e39ee375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:44:48.765897 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068bfb4-7624-4916-af99-a76089fcb20e None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:48.801913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825b624-7dfd-48bb-9a5a-fd68d6b6e999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:48.803088 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825b624-7dfd-48bb-9a5a-fd68d6b6e999 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:48.803602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825b624-7dfd-48bb-9a5a-fd68d6b6e999 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:48.804128 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825b624-7dfd-48bb-9a5a-fd68d6b6e999 None admin] PATH_INFO: `/v3/projects/4330b901b5f6416197372ef9463c8c6a` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:48.805552 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825b624-7dfd-48bb-9a5a-fd68d6b6e999 None admin] RBAC: Authorizing `identity:get_project(project_id=4330b901b5f6416197372ef9463c8c6a)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:48.807995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825b624-7dfd-48bb-9a5a-fd68d6b6e999 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:48.810092 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 66/133] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:44:48 2022] GET /identity/v3/projects/4330b901b5f6416197372ef9463c8c6a => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:48.811265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825b624-7dfd-48bb-9a5a-fd68d6b6e999 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:48.829493 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 68/134] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:44:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:44:48.834635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c3de8-06c2-49f0-8ca8-65c5e39ee375 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:48.933797 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:48.951495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c3de8-06c2-49f0-8ca8-65c5e39ee375 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:48.994900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825b624-7dfd-48bb-9a5a-fd68d6b6e999 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:49.034430 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0d58d-1bed-4600-83b5-18cb247287fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:49.035065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0d58d-1bed-4600-83b5-18cb247287fc None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:49.035346 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0d58d-1bed-4600-83b5-18cb247287fc None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:49.035622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0d58d-1bed-4600-83b5-18cb247287fc None admin] PATH_INFO: `/v3/projects/97a75aeee8d742edb0aa9858a8c2eede` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:49.036746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0d58d-1bed-4600-83b5-18cb247287fc None admin] RBAC: Authorizing `identity:get_project(project_id=97a75aeee8d742edb0aa9858a8c2eede)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:49.038236 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0d58d-1bed-4600-83b5-18cb247287fc None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:49.038631 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8801597-4d93-4ae8-80b1-0addbd0af993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:49.039278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8801597-4d93-4ae8-80b1-0addbd0af993 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:49.039562 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8801597-4d93-4ae8-80b1-0addbd0af993 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:49.039835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8801597-4d93-4ae8-80b1-0addbd0af993 None admin] PATH_INFO: `/v3/projects/97a75aeee8d742edb0aa9858a8c2eede` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:49.039928 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 67/135] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:44:48 2022] GET /identity/v3/projects/97a75aeee8d742edb0aa9858a8c2eede => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:49.040696 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0d58d-1bed-4600-83b5-18cb247287fc None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:49.046212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8801597-4d93-4ae8-80b1-0addbd0af993 None admin] RBAC: Authorizing `identity:get_project(project_id=97a75aeee8d742edb0aa9858a8c2eede)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:49.047692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8801597-4d93-4ae8-80b1-0addbd0af993 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:49.049379 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 69/136] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:44:48 2022] GET /identity/v3/projects/97a75aeee8d742edb0aa9858a8c2eede => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:49.050152 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8801597-4d93-4ae8-80b1-0addbd0af993 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:49.052191 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:49.152770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0d58d-1bed-4600-83b5-18cb247287fc None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:49.195014 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62616e-d0ac-4926-afc5-6a710ac9b43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:49.196064 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62616e-d0ac-4926-afc5-6a710ac9b43b None admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:49.196372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62616e-d0ac-4926-afc5-6a710ac9b43b None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:49.196647 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62616e-d0ac-4926-afc5-6a710ac9b43b None admin] PATH_INFO: `/v3/projects/4330b901b5f6416197372ef9463c8c6a/users/28a752c790934abebf720d75724b5b66/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:49.199276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62616e-d0ac-4926-afc5-6a710ac9b43b None admin] RBAC: Authorizing `identity:create_grant(project_id=4330b901b5f6416197372ef9463c8c6a, user_id=28a752c790934abebf720d75724b5b66, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:49.201046 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62616e-d0ac-4926-afc5-6a710ac9b43b None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:49.218681 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 68/137] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Sep 4 00:44:49 2022] PUT /identity/v3/projects/4330b901b5f6416197372ef9463c8c6a/users/28a752c790934abebf720d75724b5b66/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:44:49.219534 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62616e-d0ac-4926-afc5-6a710ac9b43b None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:49.252697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8801597-4d93-4ae8-80b1-0addbd0af993 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:49.290851 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a9b9b-6e93-4115-8588-afe54260bc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:49.292129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a9b9b-6e93-4115-8588-afe54260bc47 None admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:49.292613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a9b9b-6e93-4115-8588-afe54260bc47 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:49.293086 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a9b9b-6e93-4115-8588-afe54260bc47 None admin] PATH_INFO: `/v3/projects/97a75aeee8d742edb0aa9858a8c2eede/users/28a752c790934abebf720d75724b5b66/roles/c6d447182cac4a6ca92d2457e8936b91` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:49.295844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a9b9b-6e93-4115-8588-afe54260bc47 None admin] RBAC: Authorizing `identity:create_grant(project_id=97a75aeee8d742edb0aa9858a8c2eede, user_id=28a752c790934abebf720d75724b5b66, role_id=c6d447182cac4a6ca92d2457e8936b91)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:49.297756 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a9b9b-6e93-4115-8588-afe54260bc47 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:49.314216 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:49.318469 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 70/138] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Sep 4 00:44:49 2022] PUT /identity/v3/projects/97a75aeee8d742edb0aa9858a8c2eede/users/28a752c790934abebf720d75724b5b66/roles/c6d447182cac4a6ca92d2457e8936b91 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:44:49.320859 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a9b9b-6e93-4115-8588-afe54260bc47 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:49.345793 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:49.384255 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62616e-d0ac-4926-afc5-6a710ac9b43b None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:49.434654 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7940bb8-d12b-4557-9ccb-268edc77e3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:49.436078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7940bb8-d12b-4557-9ccb-268edc77e3f8 None admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:49.436845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7940bb8-d12b-4557-9ccb-268edc77e3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:49.437309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7940bb8-d12b-4557-9ccb-268edc77e3f8 None admin] PATH_INFO: `/v3/projects/97a75aeee8d742edb0aa9858a8c2eede/users/b3da54db0785474cb38733cf09ad01a1/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:49.440657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7940bb8-d12b-4557-9ccb-268edc77e3f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=97a75aeee8d742edb0aa9858a8c2eede, user_id=b3da54db0785474cb38733cf09ad01a1, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:49.442884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7940bb8-d12b-4557-9ccb-268edc77e3f8 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:49.458164 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a9b9b-6e93-4115-8588-afe54260bc47 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:49.463341 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 69/139] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Sep 4 00:44:49 2022] PUT /identity/v3/projects/97a75aeee8d742edb0aa9858a8c2eede/users/b3da54db0785474cb38733cf09ad01a1/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:44:49.507017 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290efd4-16f6-49bb-8102-20717e48f97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:49.508165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290efd4-16f6-49bb-8102-20717e48f97b None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:49.508643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290efd4-16f6-49bb-8102-20717e48f97b None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:49.509227 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290efd4-16f6-49bb-8102-20717e48f97b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:49.510775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290efd4-16f6-49bb-8102-20717e48f97b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:49.512556 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290efd4-16f6-49bb-8102-20717e48f97b None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:49.516207 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 71/140] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:44:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:49.521672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7940bb8-d12b-4557-9ccb-268edc77e3f8 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:49.641315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7940bb8-d12b-4557-9ccb-268edc77e3f8 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:49.671780 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:49.687184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4919b-b338-4cde-ba70-d95bde087fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:49.687819 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4919b-b338-4cde-ba70-d95bde087fdf None admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:49.688365 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4919b-b338-4cde-ba70-d95bde087fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:49.688646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4919b-b338-4cde-ba70-d95bde087fdf None admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:49.689325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a4919b-b338-4cde-ba70-d95bde087fdf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:49.690882 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a4919b-b338-4cde-ba70-d95bde087fdf None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:49.730945 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 70/141] 10.222.0.30 () {60 vars in 1132 bytes} [Sun Sep 4 00:44:49 2022] POST /identity/v3/users => generated 283 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:44:50.030656 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f932eff-7cce-4300-810e-6cc1f1c8c518 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:50.031025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f932eff-7cce-4300-810e-6cc1f1c8c518 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:50.031214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f932eff-7cce-4300-810e-6cc1f1c8c518 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:50.032684 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 72/142] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:44:50.037961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b457a-7724-43ec-84d1-43445584c577 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:50.038811 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b457a-7724-43ec-84d1-43445584c577 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:50.039306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b457a-7724-43ec-84d1-43445584c577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:50.058548 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-d74b457a-7724-43ec-84d1-43445584c577 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:44:50.060045 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d74b457a-7724-43ec-84d1-43445584c577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:44:50.135804 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 71/143] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:44:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:44:50.262522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754108c-83bd-4688-a5be-590f59c5290d None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:50.263481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754108c-83bd-4688-a5be-590f59c5290d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:50.263965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754108c-83bd-4688-a5be-590f59c5290d None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:50.265776 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 73/144] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:44:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:44:50.270839 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e064a-4ea2-466a-963c-ca557eb85e13 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:50.271390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e064a-4ea2-466a-963c-ca557eb85e13 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:50.271876 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e064a-4ea2-466a-963c-ca557eb85e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:50.302602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-4a6e064a-4ea2-466a-963c-ca557eb85e13 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:44:50.304107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4a6e064a-4ea2-466a-963c-ca557eb85e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:44:50.387192 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 72/145] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:44:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:44:50.514773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5754108c-83bd-4688-a5be-590f59c5290d None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:50.619028 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:50.636542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5754108c-83bd-4688-a5be-590f59c5290d None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:50.682269 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd829e-5322-4482-b685-a077b3e56d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:50.683575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd829e-5322-4482-b685-a077b3e56d7a None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:50.684083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd829e-5322-4482-b685-a077b3e56d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:50.684551 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd829e-5322-4482-b685-a077b3e56d7a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:50.702500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd829e-5322-4482-b685-a077b3e56d7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:44:50.707697 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-1bbd829e-5322-4482-b685-a077b3e56d7a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 04 00:44:50.707697 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:44:50.707697 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:44:50.707697 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:44:50.707697 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:44:50.707697 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:44:50.707697 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:44:50.707697 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:44:50.707697 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:44:50.707697 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:44:50.707697 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:44:50.707697 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:44:50.707697 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:44:50.707697 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:44:50.707697 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:44:50.707697 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:44:50.708615 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:44:50.708615 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:44:50.708615 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:44:50.708615 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:44:50.708615 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:44:50.708615 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:44:50.708615 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:44:50.708615 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:44:50.708615 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:44:50.708615 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:44:50.708615 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:44:50.708615 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:44:50.708615 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:44:50.708615 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:44:50.708615 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:44:50.708615 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:44:50.709363 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:44:50.709363 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:44:50.709363 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:44:50.709363 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:44:50.709363 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:44:50.709363 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:44:50.709363 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:44:50.709363 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:44:50.709363 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:44:50.709363 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:44:50.709363 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 04 00:44:50.709363 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:44:50.711947 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 74/146] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:44:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:44:50.722604 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e064a-4ea2-466a-963c-ca557eb85e13 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:50.782880 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:50.801833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd829e-5322-4482-b685-a077b3e56d7a None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:50.856163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e064a-4ea2-466a-963c-ca557eb85e13 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:50.899548 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fad7f-4b93-4e02-9811-ea4a29b067c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:50.900087 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fad7f-4b93-4e02-9811-ea4a29b067c5 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:50.900356 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fad7f-4b93-4e02-9811-ea4a29b067c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:50.900627 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fad7f-4b93-4e02-9811-ea4a29b067c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:50.902283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851fad7f-4b93-4e02-9811-ea4a29b067c5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:44:50.903718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851fad7f-4b93-4e02-9811-ea4a29b067c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:50.908028 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851fad7f-4b93-4e02-9811-ea4a29b067c5 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:50.920991 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 73/147] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Sep 4 00:44:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:50.929471 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fad7f-4b93-4e02-9811-ea4a29b067c5 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:50.935132 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd829e-5322-4482-b685-a077b3e56d7a None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:51.005663 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57a74e-5fe0-4a73-9438-772fe5ba46bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:51.006680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57a74e-5fe0-4a73-9438-772fe5ba46bf None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:51.007159 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57a74e-5fe0-4a73-9438-772fe5ba46bf None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:51.007630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57a74e-5fe0-4a73-9438-772fe5ba46bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:51.033847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c57a74e-5fe0-4a73-9438-772fe5ba46bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:44:51.041790 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-0c57a74e-5fe0-4a73-9438-772fe5ba46bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 04 00:44:51.041790 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:44:51.041790 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:44:51.041790 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:44:51.041790 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:44:51.041790 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:44:51.041790 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:44:51.041790 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:44:51.041790 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:44:51.041790 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:44:51.041790 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:44:51.041790 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:44:51.041790 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:44:51.041790 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:44:51.041790 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:44:51.041790 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:44:51.042638 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:44:51.042638 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:44:51.042638 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:44:51.042638 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:44:51.042638 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:44:51.042638 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:44:51.042638 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:44:51.042638 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:44:51.042638 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:44:51.042638 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:44:51.042638 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:44:51.042638 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:44:51.042638 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:44:51.042638 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:44:51.042638 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:44:51.042638 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:44:51.044214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:44:51.044214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:44:51.044214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:44:51.044214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:44:51.044214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:44:51.044214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:44:51.044214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:44:51.044214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:44:51.044214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:44:51.044214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:44:51.044214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 04 00:44:51.044214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:44:51.044784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fad7f-4b93-4e02-9811-ea4a29b067c5 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:51.051083 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 75/148] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:44:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:44:51.051230 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:51.057129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57a74e-5fe0-4a73-9438-772fe5ba46bf None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:51.062531 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:51.084281 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76760439-54f8-4135-9202-b61611cb21fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:51.084916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76760439-54f8-4135-9202-b61611cb21fe None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:51.085578 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76760439-54f8-4135-9202-b61611cb21fe None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:51.085875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76760439-54f8-4135-9202-b61611cb21fe None admin] PATH_INFO: `/v3/users/bb0fe5ece41d4827ba140b8aa4240807` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:51.087865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76760439-54f8-4135-9202-b61611cb21fe None admin] RBAC: Authorizing `identity:get_user(user_id=bb0fe5ece41d4827ba140b8aa4240807)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:51.089500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76760439-54f8-4135-9202-b61611cb21fe None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:51.091409 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 74/149] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:44:50 2022] GET /identity/v3/users/bb0fe5ece41d4827ba140b8aa4240807 => generated 289 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:44:51.097964 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76760439-54f8-4135-9202-b61611cb21fe None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:51.221957 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76760439-54f8-4135-9202-b61611cb21fe None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:51.247730 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57a74e-5fe0-4a73-9438-772fe5ba46bf None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:51.267141 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00425978-b9ab-49de-bd82-b367d9936b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:51.267779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00425978-b9ab-49de-bd82-b367d9936b6d None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:51.268056 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00425978-b9ab-49de-bd82-b367d9936b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:51.268322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00425978-b9ab-49de-bd82-b367d9936b6d None admin] PATH_INFO: `/v3/projects/97a75aeee8d742edb0aa9858a8c2eede` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:51.269897 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00425978-b9ab-49de-bd82-b367d9936b6d None admin] RBAC: Authorizing `identity:get_project(project_id=97a75aeee8d742edb0aa9858a8c2eede)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:51.271590 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00425978-b9ab-49de-bd82-b367d9936b6d None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:51.273200 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 75/150] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:44:51 2022] GET /identity/v3/projects/97a75aeee8d742edb0aa9858a8c2eede => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:51.280316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00425978-b9ab-49de-bd82-b367d9936b6d None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:51.322184 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86755f78-4e9f-40b2-9356-0b84ed27438a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:51.323480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86755f78-4e9f-40b2-9356-0b84ed27438a None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:51.323991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86755f78-4e9f-40b2-9356-0b84ed27438a None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:51.324742 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86755f78-4e9f-40b2-9356-0b84ed27438a None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:51.325746 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86755f78-4e9f-40b2-9356-0b84ed27438a None admin] RBAC: Adding query filter params (name=member) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:44:51.326246 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86755f78-4e9f-40b2-9356-0b84ed27438a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:51.327876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86755f78-4e9f-40b2-9356-0b84ed27438a None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:51.333190 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:51.345191 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 76/151] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Sep 4 00:44:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:44:51.351060 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86755f78-4e9f-40b2-9356-0b84ed27438a None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:51.398020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00425978-b9ab-49de-bd82-b367d9936b6d None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:51.439120 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64665d-ecdf-4447-801a-57b597b74df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:51.439789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64665d-ecdf-4447-801a-57b597b74df7 None admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:51.440067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64665d-ecdf-4447-801a-57b597b74df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:51.440342 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64665d-ecdf-4447-801a-57b597b74df7 None admin] PATH_INFO: `/v3/projects/97a75aeee8d742edb0aa9858a8c2eede/users/bb0fe5ece41d4827ba140b8aa4240807/roles/9cf4680c808546e286e3a5c3383d98e1` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:51.442366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db64665d-ecdf-4447-801a-57b597b74df7 None admin] RBAC: Authorizing `identity:create_grant(project_id=97a75aeee8d742edb0aa9858a8c2eede, user_id=bb0fe5ece41d4827ba140b8aa4240807, role_id=9cf4680c808546e286e3a5c3383d98e1)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:51.449475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db64665d-ecdf-4447-801a-57b597b74df7 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:51.469392 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:51.477064 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 76/152] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Sep 4 00:44:51 2022] PUT /identity/v3/projects/97a75aeee8d742edb0aa9858a8c2eede/users/bb0fe5ece41d4827ba140b8aa4240807/roles/9cf4680c808546e286e3a5c3383d98e1 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 00:44:51.516369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86755f78-4e9f-40b2-9356-0b84ed27438a None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:51.553423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66588950-09cf-45b6-989d-aa05a411f1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:51.554159 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66588950-09cf-45b6-989d-aa05a411f1a0 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:51.554441 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66588950-09cf-45b6-989d-aa05a411f1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:51.554717 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66588950-09cf-45b6-989d-aa05a411f1a0 None admin] PATH_INFO: `/v3/users/28a752c790934abebf720d75724b5b66` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:51.556049 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66588950-09cf-45b6-989d-aa05a411f1a0 None admin] RBAC: Authorizing `identity:get_user(user_id=28a752c790934abebf720d75724b5b66)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:51.557604 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66588950-09cf-45b6-989d-aa05a411f1a0 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:51.559298 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 77/153] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:44:51 2022] GET /identity/v3/users/28a752c790934abebf720d75724b5b66 => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:44:51.565611 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64665d-ecdf-4447-801a-57b597b74df7 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:51.678498 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64665d-ecdf-4447-801a-57b597b74df7 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:51.679989 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:51.718068 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045416d6-014e-4fa0-82e3-fcbd7faee54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:51.718685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045416d6-014e-4fa0-82e3-fcbd7faee54b None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:51.718973 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045416d6-014e-4fa0-82e3-fcbd7faee54b None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:51.719229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045416d6-014e-4fa0-82e3-fcbd7faee54b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:51.800688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045416d6-014e-4fa0-82e3-fcbd7faee54b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:51.802118 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045416d6-014e-4fa0-82e3-fcbd7faee54b None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:51.922500 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 77/154] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:44:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 04 00:44:51.928649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66588950-09cf-45b6-989d-aa05a411f1a0 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:52.066405 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66588950-09cf-45b6-989d-aa05a411f1a0 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:52.114279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f39a35-62e1-4c58-94c5-feb583f60750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:52.115292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f39a35-62e1-4c58-94c5-feb583f60750 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:52.115767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f39a35-62e1-4c58-94c5-feb583f60750 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:52.116254 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f39a35-62e1-4c58-94c5-feb583f60750 None admin] PATH_INFO: `/v3/projects/97a75aeee8d742edb0aa9858a8c2eede` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:52.122114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f39a35-62e1-4c58-94c5-feb583f60750 None admin] RBAC: Authorizing `identity:get_project(project_id=97a75aeee8d742edb0aa9858a8c2eede)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:52.123778 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f39a35-62e1-4c58-94c5-feb583f60750 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:52.125946 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 78/155] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:44:51 2022] GET /identity/v3/projects/97a75aeee8d742edb0aa9858a8c2eede => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:52.132021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045416d6-014e-4fa0-82e3-fcbd7faee54b None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:52.134506 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:52.274195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045416d6-014e-4fa0-82e3-fcbd7faee54b None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:52.325596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc027db-3a80-4d56-83a8-6a327b5cdc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:52.326133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc027db-3a80-4d56-83a8-6a327b5cdc88 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:52.326414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc027db-3a80-4d56-83a8-6a327b5cdc88 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:52.326688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc027db-3a80-4d56-83a8-6a327b5cdc88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:52.327424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc027db-3a80-4d56-83a8-6a327b5cdc88 None admin] RBAC: Adding query filter params (role.id=7c1abe5c3a82479484ec5a104ec31f8f, scope.project.id=97a75aeee8d742edb0aa9858a8c2eede, user.id=28a752c790934abebf720d75724b5b66) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:44:52.327729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc027db-3a80-4d56-83a8-6a327b5cdc88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:52.329277 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc027db-3a80-4d56-83a8-6a327b5cdc88 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:52.335543 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 78/156] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:44:52 2022] GET /identity/v3/role_assignments?user.id=28a752c790934abebf720d75724b5b66&scope.project.id=97a75aeee8d742edb0aa9858a8c2eede&role.id=7c1abe5c3a82479484ec5a104ec31f8f => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:52.726946 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723d150-c9c0-4e82-b3aa-92b31c050206 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:52.727579 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723d150-c9c0-4e82-b3aa-92b31c050206 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:52.728478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723d150-c9c0-4e82-b3aa-92b31c050206 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:52.729633 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 79/157] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:44:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:44:52.751036 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad3947-54c8-43a7-b1e4-e4de9f18be5b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:52.751666 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad3947-54c8-43a7-b1e4-e4de9f18be5b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:52.752136 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad3947-54c8-43a7-b1e4-e4de9f18be5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:52.778448 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-66ad3947-54c8-43a7-b1e4-e4de9f18be5b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:44:52.780033 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-66ad3947-54c8-43a7-b1e4-e4de9f18be5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:44:52.851646 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:52.860779 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 79/158] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:44:53.085250 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1561bd7-dd7b-4b2e-9a97-8706f4e01d7b None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:53.085549 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1561bd7-dd7b-4b2e-9a97-8706f4e01d7b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:53.085857 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1561bd7-dd7b-4b2e-9a97-8706f4e01d7b None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:53.087261 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 80/159] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:44:53.092615 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a56ca-b086-4703-b47d-d275106b765c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:53.092909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a56ca-b086-4703-b47d-d275106b765c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:53.093192 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a56ca-b086-4703-b47d-d275106b765c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:53.118929 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c14a56ca-b086-4703-b47d-d275106b765c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:44:53.120143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c14a56ca-b086-4703-b47d-d275106b765c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:44:53.210131 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 80/160] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:44:53.267926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2a4c0-55ac-4207-afe6-b958dc258a49 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:53.268242 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2a4c0-55ac-4207-afe6-b958dc258a49 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:53.268493 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2a4c0-55ac-4207-afe6-b958dc258a49 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:53.270146 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 81/161] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:44:53.275859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edee4b6-3a8e-48f4-834c-8756ba53da46 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:53.276148 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edee4b6-3a8e-48f4-834c-8756ba53da46 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:53.276428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edee4b6-3a8e-48f4-834c-8756ba53da46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:53.302930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-3edee4b6-3a8e-48f4-834c-8756ba53da46 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:44:53.304118 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3edee4b6-3a8e-48f4-834c-8756ba53da46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:44:53.390586 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 81/162] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:44:53.427093 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2a4c0-55ac-4207-afe6-b958dc258a49 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:53.430180 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:53.549568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2a4c0-55ac-4207-afe6-b958dc258a49 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:53.584633 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b665b-50a4-4955-a202-ff4b4794922e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:53.585259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b665b-50a4-4955-a202-ff4b4794922e None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:53.585563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b665b-50a4-4955-a202-ff4b4794922e None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:53.585832 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b665b-50a4-4955-a202-ff4b4794922e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:53.596465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b665b-50a4-4955-a202-ff4b4794922e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:44:53.601267 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-dc6b665b-50a4-4955-a202-ff4b4794922e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 04 00:44:53.601267 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:44:53.601267 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:44:53.601267 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:44:53.601267 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:44:53.601267 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:44:53.601267 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:44:53.601267 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:44:53.601267 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:44:53.601267 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:44:53.601267 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:44:53.601267 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:44:53.601267 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:44:53.601267 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:44:53.601267 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:44:53.601267 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:44:53.602125 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:44:53.602125 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:44:53.602125 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:44:53.602125 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:44:53.602125 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:44:53.602125 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:44:53.602125 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:44:53.602125 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:44:53.602125 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:44:53.602125 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:44:53.602125 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:44:53.602125 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:44:53.602125 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:44:53.602125 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:44:53.602125 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:44:53.602125 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:44:53.602943 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:44:53.602943 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:44:53.602943 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:44:53.602943 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:44:53.602943 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:44:53.602943 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:44:53.602943 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:44:53.602943 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:44:53.602943 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:44:53.602943 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:44:53.602943 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 04 00:44:53.602943 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:44:53.602943 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 82/163] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:44:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:44:53.609894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edee4b6-3a8e-48f4-834c-8756ba53da46 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:53.678202 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:53.705032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b665b-50a4-4955-a202-ff4b4794922e None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:53.743628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edee4b6-3a8e-48f4-834c-8756ba53da46 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:53.779789 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:53.809325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c656e8-3d06-4c8a-8662-4a617b886a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:53.809967 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c656e8-3d06-4c8a-8662-4a617b886a19 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:53.810246 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c656e8-3d06-4c8a-8662-4a617b886a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:53.810515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c656e8-3d06-4c8a-8662-4a617b886a19 None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:53.811183 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c656e8-3d06-4c8a-8662-4a617b886a19 None admin] RBAC: Adding query filter params (name=member) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:44:53.811480 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c656e8-3d06-4c8a-8662-4a617b886a19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:53.812855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c656e8-3d06-4c8a-8662-4a617b886a19 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:53.833837 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 82/164] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Sep 4 00:44:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:53.836716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd799c46-f50d-445d-b564-978dc342a33a None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:53.837602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd799c46-f50d-445d-b564-978dc342a33a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:53.837873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd799c46-f50d-445d-b564-978dc342a33a None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:53.839241 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 83/165] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:44:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:44:53.850189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b665b-50a4-4955-a202-ff4b4794922e None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:53.853103 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7c4db-1692-4e00-8970-0776e9bf5bd6 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:53.853384 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7c4db-1692-4e00-8970-0776e9bf5bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:53.853676 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7c4db-1692-4e00-8970-0776e9bf5bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:53.894442 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-fca7c4db-1692-4e00-8970-0776e9bf5bd6 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:44:53.895698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fca7c4db-1692-4e00-8970-0776e9bf5bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:44:53.914140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70babc21-76b6-4250-adb4-52989704ff57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:53.914788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70babc21-76b6-4250-adb4-52989704ff57 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:53.915112 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70babc21-76b6-4250-adb4-52989704ff57 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:53.915388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70babc21-76b6-4250-adb4-52989704ff57 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:53.934407 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70babc21-76b6-4250-adb4-52989704ff57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:44:53.939361 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-70babc21-76b6-4250-adb4-52989704ff57 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 04 00:44:53.939361 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:44:53.939361 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:44:53.939361 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:44:53.939361 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:44:53.939361 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:44:53.939361 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:44:53.939361 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:44:53.939361 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:44:53.939361 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:44:53.939361 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:44:53.939361 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:44:53.939361 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:44:53.939361 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:44:53.939361 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:44:53.939361 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:44:53.940186 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:44:53.940186 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:44:53.940186 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:44:53.940186 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:44:53.940186 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:44:53.940186 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:44:53.940186 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:44:53.940186 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:44:53.940186 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:44:53.940186 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:44:53.940186 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:44:53.940186 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:44:53.940186 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:44:53.940186 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:44:53.940186 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:44:53.940186 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:44:53.941184 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:44:53.941184 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:44:53.941184 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:44:53.941184 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:44:53.941184 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:44:53.941184 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:44:53.941184 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:44:53.941184 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:44:53.941184 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:44:53.941184 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:44:53.941184 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 04 00:44:53.941184 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:44:53.941184 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 83/166] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Sep 4 00:44:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:44:53.941834 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70babc21-76b6-4250-adb4-52989704ff57 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:54.046554 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70babc21-76b6-4250-adb4-52989704ff57 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:54.076079 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:54.083820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23e1ae-83e6-48a2-98e8-08093ca518c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:54.084314 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 84/167] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:44:54.084489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23e1ae-83e6-48a2-98e8-08093ca518c3 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:54.084994 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23e1ae-83e6-48a2-98e8-08093ca518c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:54.085092 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7c4db-1692-4e00-8970-0776e9bf5bd6 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:54.085315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23e1ae-83e6-48a2-98e8-08093ca518c3 None admin] PATH_INFO: `/v3/users/28a752c790934abebf720d75724b5b66` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:54.086491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23e1ae-83e6-48a2-98e8-08093ca518c3 None admin] RBAC: Authorizing `identity:get_user(user_id=28a752c790934abebf720d75724b5b66)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:54.088268 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23e1ae-83e6-48a2-98e8-08093ca518c3 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:54.090180 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 84/168] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:44:53 2022] GET /identity/v3/users/28a752c790934abebf720d75724b5b66 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:54.090964 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23e1ae-83e6-48a2-98e8-08093ca518c3 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:54.173840 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:54.264157 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7c4db-1692-4e00-8970-0776e9bf5bd6 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:54.267349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23e1ae-83e6-48a2-98e8-08093ca518c3 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:54.323403 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9dbeb-95bc-4d76-ac34-c705d05be125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:54.324152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9dbeb-95bc-4d76-ac34-c705d05be125 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:54.324433 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9dbeb-95bc-4d76-ac34-c705d05be125 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:54.324698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9dbeb-95bc-4d76-ac34-c705d05be125 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:54.340233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c9289-1875-41b7-84b0-e5703738e745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:54.340951 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c9289-1875-41b7-84b0-e5703738e745 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:54.341233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c9289-1875-41b7-84b0-e5703738e745 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:54.341535 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c9289-1875-41b7-84b0-e5703738e745 None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:54.342214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c9289-1875-41b7-84b0-e5703738e745 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:44:54.342514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c9289-1875-41b7-84b0-e5703738e745 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:54.343259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9dbeb-95bc-4d76-ac34-c705d05be125 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:44:54.343888 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c9289-1875-41b7-84b0-e5703738e745 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:54.348142 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-64b9dbeb-95bc-4d76-ac34-c705d05be125 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:44:54.348142 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:44:54.348142 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:44:54.348142 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:44:54.348142 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:44:54.348142 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:44:54.348142 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:44:54.348142 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:44:54.348142 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:44:54.348142 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:44:54.348142 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:44:54.348142 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:44:54.348142 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:44:54.348142 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:44:54.348142 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:44:54.348142 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:44:54.349055 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:44:54.349055 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:44:54.349055 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:44:54.349055 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:44:54.349055 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:44:54.349055 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:44:54.349055 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:44:54.349055 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:44:54.349055 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:44:54.349055 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:44:54.349055 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:44:54.349055 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:44:54.349055 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:44:54.349055 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:44:54.349055 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:44:54.349055 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:44:54.349851 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:44:54.349851 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:44:54.349851 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:44:54.349851 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:44:54.349851 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:44:54.349851 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:44:54.349851 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:44:54.349851 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:44:54.349851 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:44:54.349851 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:44:54.349851 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:44:54.349851 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:44:54.349851 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 85/169] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Sep 4 00:44:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:44:54.356405 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9dbeb-95bc-4d76-ac34-c705d05be125 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:54.359521 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 85/170] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:44:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:54.360452 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c9289-1875-41b7-84b0-e5703738e745 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:54.461835 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:54.475926 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9dbeb-95bc-4d76-ac34-c705d05be125 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:54.505517 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:54.552672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c9289-1875-41b7-84b0-e5703738e745 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:54.554362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487278e7-f5c3-4b20-a774-e3624689d6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:54.555269 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487278e7-f5c3-4b20-a774-e3624689d6f6 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:54.556305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487278e7-f5c3-4b20-a774-e3624689d6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:54.556957 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487278e7-f5c3-4b20-a774-e3624689d6f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:54.634005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473bd173-33cb-4af9-a724-1912c0c5dbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:54.634622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473bd173-33cb-4af9-a724-1912c0c5dbc8 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:54.634897 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473bd173-33cb-4af9-a724-1912c0c5dbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:54.635164 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473bd173-33cb-4af9-a724-1912c0c5dbc8 None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:54.635834 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473bd173-33cb-4af9-a724-1912c0c5dbc8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:44:54.636134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473bd173-33cb-4af9-a724-1912c0c5dbc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:54.637527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473bd173-33cb-4af9-a724-1912c0c5dbc8 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:54.649772 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 86/171] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:44:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:54.650678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473bd173-33cb-4af9-a724-1912c0c5dbc8 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:54.676230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487278e7-f5c3-4b20-a774-e3624689d6f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:54.677892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487278e7-f5c3-4b20-a774-e3624689d6f6 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:54.784483 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473bd173-33cb-4af9-a724-1912c0c5dbc8 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:54.789415 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 86/172] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:44:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 04 00:44:54.791083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487278e7-f5c3-4b20-a774-e3624689d6f6 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:54.802443 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:54.808884 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:54.830768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa2250-4f8a-43fa-9d28-6709dd2f2fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:54.831407 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa2250-4f8a-43fa-9d28-6709dd2f2fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:54.831684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa2250-4f8a-43fa-9d28-6709dd2f2fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:54.831954 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa2250-4f8a-43fa-9d28-6709dd2f2fd2 None admin] PATH_INFO: `/v3/users/28a752c790934abebf720d75724b5b66` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:54.834774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa2250-4f8a-43fa-9d28-6709dd2f2fd2 None admin] RBAC: Authorizing `identity:get_user(user_id=28a752c790934abebf720d75724b5b66)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:54.835228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa2250-4f8a-43fa-9d28-6709dd2f2fd2 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:54.839049 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 87/173] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:44:54 2022] GET /identity/v3/users/28a752c790934abebf720d75724b5b66 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:54.841572 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa2250-4f8a-43fa-9d28-6709dd2f2fd2 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:54.933550 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487278e7-f5c3-4b20-a774-e3624689d6f6 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:54.970013 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393eb6f-d1e7-4de8-84e5-6c479ef3b824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:54.971105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393eb6f-d1e7-4de8-84e5-6c479ef3b824 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:54.971591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393eb6f-d1e7-4de8-84e5-6c479ef3b824 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:54.972066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393eb6f-d1e7-4de8-84e5-6c479ef3b824 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:54.976802 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa2250-4f8a-43fa-9d28-6709dd2f2fd2 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:54.984271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0393eb6f-d1e7-4de8-84e5-6c479ef3b824 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:44:54.989411 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-0393eb6f-d1e7-4de8-84e5-6c479ef3b824 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:44:54.989411 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:44:54.989411 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:44:54.989411 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:44:54.989411 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:44:54.989411 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:44:54.989411 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:44:54.989411 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:44:54.989411 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:44:54.989411 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:44:54.989411 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:44:54.989411 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:44:54.989411 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:44:54.989411 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:44:54.989411 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:44:54.989411 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:44:54.990431 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:44:54.990431 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:44:54.990431 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:44:54.990431 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:44:54.990431 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:44:54.990431 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:44:54.990431 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:44:54.990431 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:44:54.990431 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:44:54.990431 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:44:54.990431 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:44:54.990431 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:44:54.990431 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:44:54.990431 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:44:54.990431 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:44:54.990431 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:44:54.991462 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:44:54.991462 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:44:54.991462 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:44:54.991462 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:44:54.991462 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:44:54.991462 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:44:54.991462 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:44:54.991462 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:44:54.991462 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:44:54.991462 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:44:54.991462 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:44:54.991462 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:44:54.993646 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 87/174] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Sep 4 00:44:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:44:54.999370 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19989c4f-9542-4f82-ad53-07a377662f51 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:54.999660 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19989c4f-9542-4f82-ad53-07a377662f51 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:54.999936 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19989c4f-9542-4f82-ad53-07a377662f51 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:55.001916 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 88/175] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:44:55.002722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19989c4f-9542-4f82-ad53-07a377662f51 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:55.013215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b8524-63e0-4150-b268-30c64eca6d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:55.013877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b8524-63e0-4150-b268-30c64eca6d6b None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:55.014153 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b8524-63e0-4150-b268-30c64eca6d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:55.014420 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b8524-63e0-4150-b268-30c64eca6d6b None admin] PATH_INFO: `/v3/users/b3da54db0785474cb38733cf09ad01a1` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:55.015554 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b8524-63e0-4150-b268-30c64eca6d6b None admin] RBAC: Authorizing `identity:get_user(user_id=b3da54db0785474cb38733cf09ad01a1)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:55.017004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b8524-63e0-4150-b268-30c64eca6d6b None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:55.018769 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 88/176] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:44:54 2022] GET /identity/v3/users/b3da54db0785474cb38733cf09ad01a1 => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:55.019431 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b8524-63e0-4150-b268-30c64eca6d6b None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:55.074004 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:55.083417 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:55.119774 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19989c4f-9542-4f82-ad53-07a377662f51 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:55.129648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b8524-63e0-4150-b268-30c64eca6d6b None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:55.155805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5312a-372c-45db-b90e-da2097c19e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:55.156429 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5312a-372c-45db-b90e-da2097c19e57 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:55.156702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5312a-372c-45db-b90e-da2097c19e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:55.156970 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5312a-372c-45db-b90e-da2097c19e57 None admin] PATH_INFO: `/v3/projects/4330b901b5f6416197372ef9463c8c6a` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:55.158197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5312a-372c-45db-b90e-da2097c19e57 None admin] RBAC: Authorizing `identity:get_project(project_id=4330b901b5f6416197372ef9463c8c6a)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:55.159669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5312a-372c-45db-b90e-da2097c19e57 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:55.165963 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 89/177] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:44:55 2022] GET /identity/v3/projects/4330b901b5f6416197372ef9463c8c6a => generated 312 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:55.165963 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2882f9-3ad6-450c-81f7-f3681bdefaed None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:55.165963 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2882f9-3ad6-450c-81f7-f3681bdefaed None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:55.165963 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2882f9-3ad6-450c-81f7-f3681bdefaed None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:55.165963 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 90/178] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:44:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:44:55.168676 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2882f9-3ad6-450c-81f7-f3681bdefaed None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:55.171812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b5ef6-b975-4229-b2f3-98623d79c081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:55.172433 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b5ef6-b975-4229-b2f3-98623d79c081 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:55.172780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b5ef6-b975-4229-b2f3-98623d79c081 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:55.173060 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b5ef6-b975-4229-b2f3-98623d79c081 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:55.240113 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b5ef6-b975-4229-b2f3-98623d79c081 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:55.241612 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b5ef6-b975-4229-b2f3-98623d79c081 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:55.270303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2882f9-3ad6-450c-81f7-f3681bdefaed None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:55.290009 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:55.305034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acef3fa-0b20-447d-8582-4ca9b3a0cadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:55.305712 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acef3fa-0b20-447d-8582-4ca9b3a0cadc None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:55.305990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acef3fa-0b20-447d-8582-4ca9b3a0cadc None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:55.306268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acef3fa-0b20-447d-8582-4ca9b3a0cadc None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:55.307010 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acef3fa-0b20-447d-8582-4ca9b3a0cadc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:44:55.307346 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acef3fa-0b20-447d-8582-4ca9b3a0cadc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:55.308720 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acef3fa-0b20-447d-8582-4ca9b3a0cadc None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:55.311020 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:55.318055 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 91/179] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:44:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:55.319223 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981b926-90d7-4d20-b896-809cd77c48ed None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:55.319508 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981b926-90d7-4d20-b896-809cd77c48ed None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:55.319787 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981b926-90d7-4d20-b896-809cd77c48ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:55.338422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-3981b926-90d7-4d20-b896-809cd77c48ed None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:44:55.339530 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3981b926-90d7-4d20-b896-809cd77c48ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:44:55.342420 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 89/180] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:44:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 04 00:44:55.343256 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b5ef6-b975-4229-b2f3-98623d79c081 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:55.405974 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 92/181] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:44:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:44:55.406885 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981b926-90d7-4d20-b896-809cd77c48ed None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:55.441782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b5ef6-b975-4229-b2f3-98623d79c081 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:55.481669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115106b-9b90-4497-ab8f-55aa5ff660c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:55.482399 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115106b-9b90-4497-ab8f-55aa5ff660c3 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:55.482681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115106b-9b90-4497-ab8f-55aa5ff660c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:55.483411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115106b-9b90-4497-ab8f-55aa5ff660c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:55.503951 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:55.517467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981b926-90d7-4d20-b896-809cd77c48ed None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:55.546157 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:55.554754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191bfb2-47f7-4d8d-9513-27278c4b8801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:55.555266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115106b-9b90-4497-ab8f-55aa5ff660c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:55.555382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191bfb2-47f7-4d8d-9513-27278c4b8801 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:55.556136 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191bfb2-47f7-4d8d-9513-27278c4b8801 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:55.556408 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191bfb2-47f7-4d8d-9513-27278c4b8801 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:55.557121 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f191bfb2-47f7-4d8d-9513-27278c4b8801 None admin] RBAC: Adding query filter params (role.id=7c1abe5c3a82479484ec5a104ec31f8f, scope.project.id=4330b901b5f6416197372ef9463c8c6a, user.id=28a752c790934abebf720d75724b5b66) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:44:55.557288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115106b-9b90-4497-ab8f-55aa5ff660c3 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:55.557404 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f191bfb2-47f7-4d8d-9513-27278c4b8801 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:55.558851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f191bfb2-47f7-4d8d-9513-27278c4b8801 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:55.573477 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 93/182] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:44:55 2022] GET /identity/v3/role_assignments?user.id=28a752c790934abebf720d75724b5b66&scope.project.id=4330b901b5f6416197372ef9463c8c6a&role.id=7c1abe5c3a82479484ec5a104ec31f8f => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:55.573477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386b109-d728-4570-8c35-77a493ba6aac None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:55.573477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386b109-d728-4570-8c35-77a493ba6aac None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:55.573477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386b109-d728-4570-8c35-77a493ba6aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:55.590671 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-5386b109-d728-4570-8c35-77a493ba6aac None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:44:55.591904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5386b109-d728-4570-8c35-77a493ba6aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:44:55.665269 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 94/183] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:44:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:44:55.666713 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab817aae-b5cd-40d4-a500-a686926e71ca None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:55.667001 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab817aae-b5cd-40d4-a500-a686926e71ca None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:55.667278 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab817aae-b5cd-40d4-a500-a686926e71ca None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:55.668905 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 95/184] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:44:55.669517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab817aae-b5cd-40d4-a500-a686926e71ca None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:55.691735 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 90/185] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:44:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 04 00:44:55.692713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115106b-9b90-4497-ab8f-55aa5ff660c3 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:55.750857 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:55.788081 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab817aae-b5cd-40d4-a500-a686926e71ca None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:55.810926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115106b-9b90-4497-ab8f-55aa5ff660c3 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:55.817529 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:55.836945 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0c2e0-30fc-46f3-938c-89857ee607be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:55.838477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0c2e0-30fc-46f3-938c-89857ee607be None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:55.838477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0c2e0-30fc-46f3-938c-89857ee607be None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:55.838477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0c2e0-30fc-46f3-938c-89857ee607be None admin] PATH_INFO: `/v3/users/e63318c21b1240ab84b218722de82a82` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:55.857592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0c2e0-30fc-46f3-938c-89857ee607be None admin] RBAC: Authorizing `identity:get_user(user_id=e63318c21b1240ab84b218722de82a82)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:55.859587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0c2e0-30fc-46f3-938c-89857ee607be None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:55.860675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6628294-5088-4fdc-ab79-2b5ad342c0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:55.861336 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6628294-5088-4fdc-ab79-2b5ad342c0ad None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:55.861872 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 96/186] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:44:55 2022] GET /identity/v3/users/e63318c21b1240ab84b218722de82a82 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:55.862652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea1dde-e64e-42d2-9688-b17e1c0b2879 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:55.862932 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea1dde-e64e-42d2-9688-b17e1c0b2879 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:55.863203 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea1dde-e64e-42d2-9688-b17e1c0b2879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:55.865519 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6628294-5088-4fdc-ab79-2b5ad342c0ad None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:55.866203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6628294-5088-4fdc-ab79-2b5ad342c0ad None admin] PATH_INFO: `/v3/projects/97a75aeee8d742edb0aa9858a8c2eede` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:55.867585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6628294-5088-4fdc-ab79-2b5ad342c0ad None admin] RBAC: Authorizing `identity:get_project(project_id=97a75aeee8d742edb0aa9858a8c2eede)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:55.869883 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6628294-5088-4fdc-ab79-2b5ad342c0ad None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:55.871695 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 91/187] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:44:55 2022] GET /identity/v3/projects/97a75aeee8d742edb0aa9858a8c2eede => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:55.872401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6628294-5088-4fdc-ab79-2b5ad342c0ad None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:55.890030 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-8cea1dde-e64e-42d2-9688-b17e1c0b2879 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:44:55.891996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8cea1dde-e64e-42d2-9688-b17e1c0b2879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:44:55.958954 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 97/188] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:44:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:44:55.962379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea1dde-e64e-42d2-9688-b17e1c0b2879 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:55.982811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6628294-5088-4fdc-ab79-2b5ad342c0ad None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:56.001539 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:56.019346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d3a46b-e16c-4c17-8197-7c369efc83fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:56.019983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3a46b-e16c-4c17-8197-7c369efc83fa None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:56.020258 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3a46b-e16c-4c17-8197-7c369efc83fa None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:56.020530 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3a46b-e16c-4c17-8197-7c369efc83fa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:56.030937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d3a46b-e16c-4c17-8197-7c369efc83fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:44:56.036181 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-69d3a46b-e16c-4c17-8197-7c369efc83fa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 04 00:44:56.036181 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:44:56.036181 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:44:56.036181 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:44:56.036181 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:44:56.036181 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:44:56.036181 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:44:56.036181 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:44:56.036181 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:44:56.036181 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:44:56.036181 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:44:56.036181 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:44:56.036181 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:44:56.036181 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:44:56.036181 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:44:56.036181 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:44:56.037060 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:44:56.037060 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:44:56.037060 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:44:56.037060 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:44:56.037060 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:44:56.037060 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:44:56.037060 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:44:56.037060 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:44:56.037060 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:44:56.037060 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:44:56.037060 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:44:56.037060 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:44:56.037060 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:44:56.037060 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:44:56.037060 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:44:56.037060 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:44:56.038314 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:44:56.038314 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:44:56.038314 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:44:56.038314 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:44:56.038314 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:44:56.038314 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:44:56.038314 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:44:56.038314 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:44:56.038314 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:44:56.038314 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:44:56.038314 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 04 00:44:56.038314 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:44:56.038314 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 92/189] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Sep 4 00:44:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:44:56.038314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d3a46b-e16c-4c17-8197-7c369efc83fa None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:56.074242 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea1dde-e64e-42d2-9688-b17e1c0b2879 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:56.085212 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:56.113308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1981d-0eab-480a-93fa-10c6603e6ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:56.113995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1981d-0eab-480a-93fa-10c6603e6ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:56.114275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1981d-0eab-480a-93fa-10c6603e6ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:56.114548 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1981d-0eab-480a-93fa-10c6603e6ce3 None admin] PATH_INFO: `/v3/projects/97a75aeee8d742edb0aa9858a8c2eede` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:56.115660 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b1981d-0eab-480a-93fa-10c6603e6ce3 None admin] RBAC: Authorizing `identity:get_project(project_id=97a75aeee8d742edb0aa9858a8c2eede)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:56.117119 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b1981d-0eab-480a-93fa-10c6603e6ce3 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:56.119532 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 98/190] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:44:55 2022] GET /identity/v3/projects/97a75aeee8d742edb0aa9858a8c2eede => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:56.120095 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1981d-0eab-480a-93fa-10c6603e6ce3 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:56.153884 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d3a46b-e16c-4c17-8197-7c369efc83fa None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:56.188758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491214f-7693-4ae5-b907-b7e5ea9b03ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:56.189360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491214f-7693-4ae5-b907-b7e5ea9b03ab None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:56.189669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491214f-7693-4ae5-b907-b7e5ea9b03ab None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:56.189939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491214f-7693-4ae5-b907-b7e5ea9b03ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:56.228840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1981d-0eab-480a-93fa-10c6603e6ce3 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:56.240676 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:56.262262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbaae00-7e6d-47d9-95ec-c4dc03aa7244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:56.262862 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbaae00-7e6d-47d9-95ec-c4dc03aa7244 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:56.263143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbaae00-7e6d-47d9-95ec-c4dc03aa7244 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:56.263395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9491214f-7693-4ae5-b907-b7e5ea9b03ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:56.263495 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbaae00-7e6d-47d9-95ec-c4dc03aa7244 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:56.264112 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbaae00-7e6d-47d9-95ec-c4dc03aa7244 None admin] RBAC: Adding query filter params (role.id=c6d447182cac4a6ca92d2457e8936b91, scope.project.id=97a75aeee8d742edb0aa9858a8c2eede, user.id=28a752c790934abebf720d75724b5b66) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:44:56.264415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbaae00-7e6d-47d9-95ec-c4dc03aa7244 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:56.264853 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9491214f-7693-4ae5-b907-b7e5ea9b03ab None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:56.265900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbaae00-7e6d-47d9-95ec-c4dc03aa7244 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:56.271460 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 99/191] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:44:56 2022] GET /identity/v3/role_assignments?user.id=28a752c790934abebf720d75724b5b66&scope.project.id=97a75aeee8d742edb0aa9858a8c2eede&role.id=c6d447182cac4a6ca92d2457e8936b91 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:56.272222 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbaae00-7e6d-47d9-95ec-c4dc03aa7244 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:56.331124 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:56.385536 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 93/192] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:44:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 04 00:44:56.385536 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491214f-7693-4ae5-b907-b7e5ea9b03ab None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:56.398771 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbaae00-7e6d-47d9-95ec-c4dc03aa7244 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:56.437580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f52122-8b6e-4cbf-a625-d6d279e10f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:56.437580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f52122-8b6e-4cbf-a625-d6d279e10f5f None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:56.437876 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f52122-8b6e-4cbf-a625-d6d279e10f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:56.438145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f52122-8b6e-4cbf-a625-d6d279e10f5f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:56.450599 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f52122-8b6e-4cbf-a625-d6d279e10f5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:44:56.458312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-75f52122-8b6e-4cbf-a625-d6d279e10f5f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 04 00:44:56.458312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:44:56.458312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:44:56.458312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:44:56.458312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:44:56.458312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:44:56.458312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:44:56.458312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:44:56.458312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:44:56.458312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:44:56.458312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:44:56.458312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:44:56.458312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:44:56.458312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:44:56.458312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:44:56.458312 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:44:56.459168 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:44:56.459168 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:44:56.459168 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:44:56.459168 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:44:56.459168 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:44:56.459168 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:44:56.459168 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:44:56.459168 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:44:56.459168 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:44:56.459168 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:44:56.459168 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:44:56.459168 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:44:56.459168 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:44:56.459168 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:44:56.459168 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:44:56.459168 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:44:56.459932 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:44:56.459932 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:44:56.459932 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:44:56.459932 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:44:56.459932 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:44:56.459932 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:44:56.459932 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:44:56.459932 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:44:56.459932 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:44:56.459932 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:44:56.459932 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 04 00:44:56.459932 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:44:56.459932 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 100/193] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:44:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:44:56.462634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f52122-8b6e-4cbf-a625-d6d279e10f5f None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:56.484092 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:56.508929 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491214f-7693-4ae5-b907-b7e5ea9b03ab None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:56.542803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9128b0-b840-4d6b-8ece-68bb782e1461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:56.543409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9128b0-b840-4d6b-8ece-68bb782e1461 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:56.543691 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9128b0-b840-4d6b-8ece-68bb782e1461 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:56.543968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9128b0-b840-4d6b-8ece-68bb782e1461 None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:56.544623 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9128b0-b840-4d6b-8ece-68bb782e1461 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:44:56.544923 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9128b0-b840-4d6b-8ece-68bb782e1461 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:56.546324 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9128b0-b840-4d6b-8ece-68bb782e1461 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:56.554031 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 94/194] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:44:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:56.554817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9128b0-b840-4d6b-8ece-68bb782e1461 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:56.575876 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f52122-8b6e-4cbf-a625-d6d279e10f5f None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:56.577894 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:56.611549 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9c760-2a59-4bf3-a201-c131f37855bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:56.612152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9c760-2a59-4bf3-a201-c131f37855bd None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:56.612431 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9c760-2a59-4bf3-a201-c131f37855bd None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:56.612705 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9c760-2a59-4bf3-a201-c131f37855bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:56.613428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9c760-2a59-4bf3-a201-c131f37855bd None admin] RBAC: Adding query filter params (role.id=d255b03c37d64371a148ec4e11be01d9, scope.project.id=97a75aeee8d742edb0aa9858a8c2eede, user.id=b3da54db0785474cb38733cf09ad01a1) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:44:56.613773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9c760-2a59-4bf3-a201-c131f37855bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:56.615228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9c760-2a59-4bf3-a201-c131f37855bd None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:56.620808 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 101/195] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:44:56 2022] GET /identity/v3/role_assignments?user.id=b3da54db0785474cb38733cf09ad01a1&scope.project.id=97a75aeee8d742edb0aa9858a8c2eede&role.id=d255b03c37d64371a148ec4e11be01d9 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:56.621606 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9c760-2a59-4bf3-a201-c131f37855bd None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:56.671971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9128b0-b840-4d6b-8ece-68bb782e1461 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:56.709920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e444c42-bf34-45be-be0f-dc509331b092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:56.710572 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e444c42-bf34-45be-be0f-dc509331b092 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:56.710855 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e444c42-bf34-45be-be0f-dc509331b092 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:56.711129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e444c42-bf34-45be-be0f-dc509331b092 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:56.712872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e444c42-bf34-45be-be0f-dc509331b092 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:56.714375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e444c42-bf34-45be-be0f-dc509331b092 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:56.720479 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 95/196] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:44:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:56.720479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e444c42-bf34-45be-be0f-dc509331b092 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:56.728981 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:56.744469 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9c760-2a59-4bf3-a201-c131f37855bd None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:56.786761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f248d1-24cc-4401-ba10-e84c7495156d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:56.787401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f248d1-24cc-4401-ba10-e84c7495156d None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:56.787680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f248d1-24cc-4401-ba10-e84c7495156d None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:56.788561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f248d1-24cc-4401-ba10-e84c7495156d None admin] PATH_INFO: `/v3/projects/904901a056914acebf292730fd309f87` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:56.789059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f248d1-24cc-4401-ba10-e84c7495156d None admin] RBAC: Authorizing `identity:get_project(project_id=904901a056914acebf292730fd309f87)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:56.790934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f248d1-24cc-4401-ba10-e84c7495156d None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:56.792803 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 102/197] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:44:56 2022] GET /identity/v3/projects/904901a056914acebf292730fd309f87 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:56.793535 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f248d1-24cc-4401-ba10-e84c7495156d None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:56.829694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e444c42-bf34-45be-be0f-dc509331b092 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:56.839779 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:56.866388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913ddc3-8acb-449e-bc85-1d133fbee330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:56.867002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913ddc3-8acb-449e-bc85-1d133fbee330 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:56.867282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913ddc3-8acb-449e-bc85-1d133fbee330 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:56.867560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913ddc3-8acb-449e-bc85-1d133fbee330 None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:56.868251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b913ddc3-8acb-449e-bc85-1d133fbee330 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:44:56.868558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b913ddc3-8acb-449e-bc85-1d133fbee330 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:56.869993 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b913ddc3-8acb-449e-bc85-1d133fbee330 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:56.877897 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 96/198] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Sep 4 00:44:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:56.878657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913ddc3-8acb-449e-bc85-1d133fbee330 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:56.906252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f248d1-24cc-4401-ba10-e84c7495156d None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:56.942243 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61c520-e440-42f2-9063-e30fff77b74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:56.942898 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61c520-e440-42f2-9063-e30fff77b74b None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:56.943184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61c520-e440-42f2-9063-e30fff77b74b None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:56.943450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61c520-e440-42f2-9063-e30fff77b74b None admin] PATH_INFO: `/v3/users/e63318c21b1240ab84b218722de82a82` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:56.944567 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61c520-e440-42f2-9063-e30fff77b74b None admin] RBAC: Authorizing `identity:get_user(user_id=e63318c21b1240ab84b218722de82a82)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:56.946056 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61c520-e440-42f2-9063-e30fff77b74b None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:56.948207 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 103/199] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:44:56 2022] GET /identity/v3/users/e63318c21b1240ab84b218722de82a82 => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:56.948959 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61c520-e440-42f2-9063-e30fff77b74b None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:56.954659 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:56.986490 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913ddc3-8acb-449e-bc85-1d133fbee330 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:57.019500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eeb1a2-ec1b-48c4-a8b3-0308bfdf8e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:57.020091 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eeb1a2-ec1b-48c4-a8b3-0308bfdf8e9a None admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:57.020365 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eeb1a2-ec1b-48c4-a8b3-0308bfdf8e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:57.020629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eeb1a2-ec1b-48c4-a8b3-0308bfdf8e9a None admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:57.021269 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eeb1a2-ec1b-48c4-a8b3-0308bfdf8e9a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:57.022779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eeb1a2-ec1b-48c4-a8b3-0308bfdf8e9a None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:57.045846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61c520-e440-42f2-9063-e30fff77b74b None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:57.047498 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:57.048312 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 97/200] 10.222.0.30 () {60 vars in 1132 bytes} [Sun Sep 4 00:44:56 2022] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:44:57.049114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eeb1a2-ec1b-48c4-a8b3-0308bfdf8e9a None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:57.088555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c107b1d-565d-41ed-8ea4-9523dd7c6de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:57.089593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c107b1d-565d-41ed-8ea4-9523dd7c6de2 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:57.090056 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c107b1d-565d-41ed-8ea4-9523dd7c6de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:57.090658 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c107b1d-565d-41ed-8ea4-9523dd7c6de2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:57.091764 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c107b1d-565d-41ed-8ea4-9523dd7c6de2 None admin] RBAC: Adding query filter params (role.id=d255b03c37d64371a148ec4e11be01d9, scope.project.id=904901a056914acebf292730fd309f87, user.id=e63318c21b1240ab84b218722de82a82) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:44:57.092282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c107b1d-565d-41ed-8ea4-9523dd7c6de2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:57.094127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c107b1d-565d-41ed-8ea4-9523dd7c6de2 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:57.101366 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 104/201] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:44:56 2022] GET /identity/v3/role_assignments?user.id=e63318c21b1240ab84b218722de82a82&scope.project.id=904901a056914acebf292730fd309f87&role.id=d255b03c37d64371a148ec4e11be01d9 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:57.102840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c107b1d-565d-41ed-8ea4-9523dd7c6de2 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:57.168095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eeb1a2-ec1b-48c4-a8b3-0308bfdf8e9a None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:57.203625 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:57.218550 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a8262-4419-4b30-9732-33c9a05efb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:57.219213 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a8262-4419-4b30-9732-33c9a05efb05 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:57.219490 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a8262-4419-4b30-9732-33c9a05efb05 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:57.219765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a8262-4419-4b30-9732-33c9a05efb05 None admin] PATH_INFO: `/v3/users/bb0fe5ece41d4827ba140b8aa4240807` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:57.221968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a8262-4419-4b30-9732-33c9a05efb05 None admin] RBAC: Authorizing `identity:get_user(user_id=bb0fe5ece41d4827ba140b8aa4240807)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:57.223435 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a8262-4419-4b30-9732-33c9a05efb05 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:57.225390 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 98/202] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:44:57 2022] GET /identity/v3/users/bb0fe5ece41d4827ba140b8aa4240807 => generated 289 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:57.231822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a8262-4419-4b30-9732-33c9a05efb05 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:57.262461 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c107b1d-565d-41ed-8ea4-9523dd7c6de2 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:57.313795 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd36f393-5d91-4c9f-a229-e659f7d84b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:57.314424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36f393-5d91-4c9f-a229-e659f7d84b0f None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:57.314675 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36f393-5d91-4c9f-a229-e659f7d84b0f None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:57.314938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36f393-5d91-4c9f-a229-e659f7d84b0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:57.358671 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:57.360953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a8262-4419-4b30-9732-33c9a05efb05 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:57.409752 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b192b3-5206-45d0-8d12-cbd3f44479cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:57.410703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b192b3-5206-45d0-8d12-cbd3f44479cb None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:57.411050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b192b3-5206-45d0-8d12-cbd3f44479cb None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:57.411390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b192b3-5206-45d0-8d12-cbd3f44479cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:57.411961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd36f393-5d91-4c9f-a229-e659f7d84b0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:57.413659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd36f393-5d91-4c9f-a229-e659f7d84b0f None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:57.497861 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:57.502179 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b192b3-5206-45d0-8d12-cbd3f44479cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:57.505793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b192b3-5206-45d0-8d12-cbd3f44479cb None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:57.539181 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 105/203] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:44:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 04 00:44:57.545514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd36f393-5d91-4c9f-a229-e659f7d84b0f None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:57.627660 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:57.637264 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 99/204] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:44:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 04 00:44:57.642793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b192b3-5206-45d0-8d12-cbd3f44479cb None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:57.668055 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd36f393-5d91-4c9f-a229-e659f7d84b0f None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:57.705901 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f45a8e-5fcb-4ef9-b9b5-01f01f9fb567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:57.706541 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f45a8e-5fcb-4ef9-b9b5-01f01f9fb567 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:57.706818 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f45a8e-5fcb-4ef9-b9b5-01f01f9fb567 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:57.707085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f45a8e-5fcb-4ef9-b9b5-01f01f9fb567 None admin] PATH_INFO: `/v3/projects/904901a056914acebf292730fd309f87` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:57.708197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f45a8e-5fcb-4ef9-b9b5-01f01f9fb567 None admin] RBAC: Authorizing `identity:get_project(project_id=904901a056914acebf292730fd309f87)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:57.709682 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f45a8e-5fcb-4ef9-b9b5-01f01f9fb567 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:57.716704 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 106/205] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:44:57 2022] GET /identity/v3/projects/904901a056914acebf292730fd309f87 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:57.717979 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f45a8e-5fcb-4ef9-b9b5-01f01f9fb567 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:57.765906 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:57.779173 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b192b3-5206-45d0-8d12-cbd3f44479cb None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:57.833060 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f28d3-c9d0-4a5e-a268-6f85d041cf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:57.833837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f28d3-c9d0-4a5e-a268-6f85d041cf12 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:57.834103 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f28d3-c9d0-4a5e-a268-6f85d041cf12 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:57.834389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f28d3-c9d0-4a5e-a268-6f85d041cf12 None admin] PATH_INFO: `/v3/projects/97a75aeee8d742edb0aa9858a8c2eede` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:57.835615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f28d3-c9d0-4a5e-a268-6f85d041cf12 None admin] RBAC: Authorizing `identity:get_project(project_id=97a75aeee8d742edb0aa9858a8c2eede)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:57.837638 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f28d3-c9d0-4a5e-a268-6f85d041cf12 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:57.839328 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 100/206] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:44:57 2022] GET /identity/v3/projects/97a75aeee8d742edb0aa9858a8c2eede => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:57.848228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f28d3-c9d0-4a5e-a268-6f85d041cf12 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:57.879828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f45a8e-5fcb-4ef9-b9b5-01f01f9fb567 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:57.966160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d9d29-9cdf-4567-8b00-cb92ff7d9a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:57.967157 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d9d29-9cdf-4567-8b00-cb92ff7d9a94 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:57.967719 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d9d29-9cdf-4567-8b00-cb92ff7d9a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:57.968227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d9d29-9cdf-4567-8b00-cb92ff7d9a94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:57.969238 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d9d29-9cdf-4567-8b00-cb92ff7d9a94 None admin] RBAC: Adding query filter params (role.id=c6d447182cac4a6ca92d2457e8936b91, scope.project.id=904901a056914acebf292730fd309f87, user.id=e63318c21b1240ab84b218722de82a82) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:44:57.969953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d9d29-9cdf-4567-8b00-cb92ff7d9a94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:57.971709 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d9d29-9cdf-4567-8b00-cb92ff7d9a94 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:57.977469 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:57.981900 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 107/207] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:44:57 2022] GET /identity/v3/role_assignments?user.id=e63318c21b1240ab84b218722de82a82&scope.project.id=904901a056914acebf292730fd309f87&role.id=c6d447182cac4a6ca92d2457e8936b91 => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:44:57.998515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f28d3-c9d0-4a5e-a268-6f85d041cf12 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:58.052572 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42023d0b-621f-4726-a133-42114218cce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:58.053116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42023d0b-621f-4726-a133-42114218cce3 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:58.053393 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42023d0b-621f-4726-a133-42114218cce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:58.053687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42023d0b-621f-4726-a133-42114218cce3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:58.054430 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42023d0b-621f-4726-a133-42114218cce3 None admin] RBAC: Adding query filter params (role.id=9cf4680c808546e286e3a5c3383d98e1, scope.project.id=97a75aeee8d742edb0aa9858a8c2eede, user.id=bb0fe5ece41d4827ba140b8aa4240807) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:44:58.054731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42023d0b-621f-4726-a133-42114218cce3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:58.056292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42023d0b-621f-4726-a133-42114218cce3 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:58.063168 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 101/208] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:44:57 2022] GET /identity/v3/role_assignments?user.id=bb0fe5ece41d4827ba140b8aa4240807&scope.project.id=97a75aeee8d742edb0aa9858a8c2eede&role.id=9cf4680c808546e286e3a5c3383d98e1 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:44:59.181917 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495e9b7-89fc-4c02-b058-e377025dfcc6 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:59.182929 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495e9b7-89fc-4c02-b058-e377025dfcc6 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:59.183411 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495e9b7-89fc-4c02-b058-e377025dfcc6 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:59.184976 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 108/209] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:44:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:44:59.190341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fbc33-fcf6-4e75-a670-bc6e499a0e93 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:59.190724 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fbc33-fcf6-4e75-a670-bc6e499a0e93 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:59.190881 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fbc33-fcf6-4e75-a670-bc6e499a0e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:59.209648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-9c4fbc33-fcf6-4e75-a670-bc6e499a0e93 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:44:59.210818 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9c4fbc33-fcf6-4e75-a670-bc6e499a0e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:44:59.231581 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:59.279941 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 102/210] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:44:59.482104 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36daeb65-4cd5-4be5-a296-2682331e11df None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:59.482726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36daeb65-4cd5-4be5-a296-2682331e11df None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:59.483209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36daeb65-4cd5-4be5-a296-2682331e11df None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:59.485281 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 109/211] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:44:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:44:59.490712 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1d057-1f8a-4f1f-a0cd-97df99c993a4 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:59.490997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1d057-1f8a-4f1f-a0cd-97df99c993a4 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:59.491266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1d057-1f8a-4f1f-a0cd-97df99c993a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:59.506804 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bee91f-1c37-477b-a5fb-291a3e2e5fa2 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:59.507096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bee91f-1c37-477b-a5fb-291a3e2e5fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:59.507362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bee91f-1c37-477b-a5fb-291a3e2e5fa2 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:59.509294 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 110/212] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:44:59.511185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-6ae1d057-1f8a-4f1f-a0cd-97df99c993a4 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:44:59.512360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6ae1d057-1f8a-4f1f-a0cd-97df99c993a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:44:59.514225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b70f9e-fb34-495c-9baa-da4bf47a34cb None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:59.514509 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b70f9e-fb34-495c-9baa-da4bf47a34cb None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:59.514785 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b70f9e-fb34-495c-9baa-da4bf47a34cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:59.533160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-43b70f9e-fb34-495c-9baa-da4bf47a34cb None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:44:59.534378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-43b70f9e-fb34-495c-9baa-da4bf47a34cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:44:59.586595 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 103/213] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:44:59.596722 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1d057-1f8a-4f1f-a0cd-97df99c993a4 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:59.615203 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 111/214] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 04 00:44:59.686567 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:59.702267 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1d057-1f8a-4f1f-a0cd-97df99c993a4 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:59.738585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877998b-2509-4172-85c3-8a041dc6a86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:59.739215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877998b-2509-4172-85c3-8a041dc6a86a None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:59.739493 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877998b-2509-4172-85c3-8a041dc6a86a None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:59.739760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877998b-2509-4172-85c3-8a041dc6a86a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:59.750904 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e877998b-2509-4172-85c3-8a041dc6a86a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:44:59.755714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-e877998b-2509-4172-85c3-8a041dc6a86a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:44:59.755714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:44:59.755714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:44:59.755714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:44:59.755714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:44:59.755714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:44:59.755714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:44:59.755714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:44:59.755714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:44:59.755714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:44:59.755714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:44:59.755714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:44:59.755714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:44:59.755714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:44:59.755714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:44:59.755714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:44:59.756580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:44:59.756580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:44:59.756580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:44:59.756580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:44:59.756580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:44:59.756580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:44:59.756580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:44:59.756580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:44:59.756580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:44:59.756580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:44:59.756580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:44:59.756580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:44:59.756580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:44:59.756580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:44:59.756580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:44:59.756580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:44:59.757348 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:44:59.757348 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:44:59.757348 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:44:59.757348 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:44:59.757348 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:44:59.757348 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:44:59.757348 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:44:59.757348 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:44:59.757348 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:44:59.757348 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:44:59.757348 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:44:59.757348 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:44:59.757348 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 104/215] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Sep 4 00:44:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:44:59.766797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b70f9e-fb34-495c-9baa-da4bf47a34cb None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:59.873137 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b70f9e-fb34-495c-9baa-da4bf47a34cb None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:44:59.881415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877998b-2509-4172-85c3-8a041dc6a86a None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:59.904693 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:44:59.913147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f464d-14f3-4da3-876c-ed1233389daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:44:59.913784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f464d-14f3-4da3-876c-ed1233389daf None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:44:59.914083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f464d-14f3-4da3-876c-ed1233389daf None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:44:59.914328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f464d-14f3-4da3-876c-ed1233389daf None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:44:59.915538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f464d-14f3-4da3-876c-ed1233389daf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:44:59.915929 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f464d-14f3-4da3-876c-ed1233389daf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:44:59.917229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f464d-14f3-4da3-876c-ed1233389daf None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:44:59.925721 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 112/216] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:44:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:44:59.926332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f464d-14f3-4da3-876c-ed1233389daf None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:44:59.994830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877998b-2509-4172-85c3-8a041dc6a86a None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:00.027253 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f464d-14f3-4da3-876c-ed1233389daf None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:00.027664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe755661-7455-4dfc-907c-619d9efd939f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:00.028356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe755661-7455-4dfc-907c-619d9efd939f None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:00.028637 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe755661-7455-4dfc-907c-619d9efd939f None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:00.028908 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe755661-7455-4dfc-907c-619d9efd939f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:00.038731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe755661-7455-4dfc-907c-619d9efd939f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:00.044106 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-fe755661-7455-4dfc-907c-619d9efd939f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 04 00:45:00.044106 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:00.044106 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:00.044106 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:00.044106 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:00.044106 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:00.044106 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:00.044106 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:00.044106 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:00.044106 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:00.044106 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:00.044106 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:00.044106 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:00.044106 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:00.044106 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:00.044106 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:00.045111 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:00.045111 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:00.045111 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:00.045111 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:00.045111 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:00.045111 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:00.045111 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:00.045111 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:00.045111 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:00.045111 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:00.045111 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:00.045111 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:00.045111 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:00.045111 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:00.045111 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:00.045111 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:00.050473 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:00.050473 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:00.050473 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:00.050473 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:00.050473 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:00.050473 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:00.050473 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:00.050473 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:00.050473 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:00.050473 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:00.050473 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 04 00:45:00.050473 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:00.050473 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 105/217] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:44:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:45:00.050473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe755661-7455-4dfc-907c-619d9efd939f None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:00.056701 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:00.061704 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f3ff4-0293-4892-bad2-4573174dda9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:00.062339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f3ff4-0293-4892-bad2-4573174dda9e None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:00.062618 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f3ff4-0293-4892-bad2-4573174dda9e None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:00.062890 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f3ff4-0293-4892-bad2-4573174dda9e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:00.064080 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f3ff4-0293-4892-bad2-4573174dda9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:00.065568 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f3ff4-0293-4892-bad2-4573174dda9e None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:00.067259 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 113/218] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:44:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:00.068203 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f57a04-b892-4d40-8653-f1b96edf078e None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:00.068483 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f57a04-b892-4d40-8653-f1b96edf078e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:00.068756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f57a04-b892-4d40-8653-f1b96edf078e None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:00.073486 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 114/219] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:00.073486 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f57a04-b892-4d40-8653-f1b96edf078e None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:00.129125 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:00.150298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe755661-7455-4dfc-907c-619d9efd939f None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:00.170892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f57a04-b892-4d40-8653-f1b96edf078e None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:00.183896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f38f8-249f-4b5c-b3be-e40c0a659ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:00.184518 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f38f8-249f-4b5c-b3be-e40c0a659ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:00.184793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f38f8-249f-4b5c-b3be-e40c0a659ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:00.185059 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f38f8-249f-4b5c-b3be-e40c0a659ee8 None admin] PATH_INFO: `/v3/users/e63318c21b1240ab84b218722de82a82` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:00.186194 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f38f8-249f-4b5c-b3be-e40c0a659ee8 None admin] RBAC: Authorizing `identity:get_user(user_id=e63318c21b1240ab84b218722de82a82)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:00.187647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f38f8-249f-4b5c-b3be-e40c0a659ee8 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:00.189200 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 106/220] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:45:00 2022] GET /identity/v3/users/e63318c21b1240ab84b218722de82a82 => generated 283 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:00.189954 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f38f8-249f-4b5c-b3be-e40c0a659ee8 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:00.203904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4dffcf-88f0-4e1d-aa94-1d22c19b20a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:00.204499 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dffcf-88f0-4e1d-aa94-1d22c19b20a1 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:00.204776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dffcf-88f0-4e1d-aa94-1d22c19b20a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:00.205046 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dffcf-88f0-4e1d-aa94-1d22c19b20a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:00.205805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4dffcf-88f0-4e1d-aa94-1d22c19b20a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:00.206112 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4dffcf-88f0-4e1d-aa94-1d22c19b20a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:00.207492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4dffcf-88f0-4e1d-aa94-1d22c19b20a1 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:00.216208 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 115/221] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Sep 4 00:45:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:00.218644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fae061-7894-4ea2-a0e1-76ded9a78321 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:00.218924 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fae061-7894-4ea2-a0e1-76ded9a78321 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:00.219188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fae061-7894-4ea2-a0e1-76ded9a78321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:00.237070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-d1fae061-7894-4ea2-a0e1-76ded9a78321 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:00.238279 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d1fae061-7894-4ea2-a0e1-76ded9a78321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:00.263252 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:00.287783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f38f8-249f-4b5c-b3be-e40c0a659ee8 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:00.302569 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 116/222] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:00.303383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fae061-7894-4ea2-a0e1-76ded9a78321 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:00.326555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36af1a-f636-44f5-aba3-bc1009115061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:00.327489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36af1a-f636-44f5-aba3-bc1009115061 None admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:00.327780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36af1a-f636-44f5-aba3-bc1009115061 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:00.328314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36af1a-f636-44f5-aba3-bc1009115061 None admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:00.329013 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f36af1a-f636-44f5-aba3-bc1009115061 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:00.331250 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f36af1a-f636-44f5-aba3-bc1009115061 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:00.354945 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:00.356356 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 107/223] 10.222.0.30 () {60 vars in 1132 bytes} [Sun Sep 4 00:45:00 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:45:00.357366 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36af1a-f636-44f5-aba3-bc1009115061 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:00.433158 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fae061-7894-4ea2-a0e1-76ded9a78321 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:00.485395 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00795cc2-205a-44cd-b925-48d9d68d8309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:00.486171 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00795cc2-205a-44cd-b925-48d9d68d8309 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:00.486456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00795cc2-205a-44cd-b925-48d9d68d8309 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:00.486729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00795cc2-205a-44cd-b925-48d9d68d8309 None admin] PATH_INFO: `/v3/projects/904901a056914acebf292730fd309f87` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:00.488215 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00795cc2-205a-44cd-b925-48d9d68d8309 None admin] RBAC: Authorizing `identity:get_project(project_id=904901a056914acebf292730fd309f87)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:00.490337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00795cc2-205a-44cd-b925-48d9d68d8309 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:00.496851 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 117/224] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:45:00 2022] GET /identity/v3/projects/904901a056914acebf292730fd309f87 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:00.497909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00795cc2-205a-44cd-b925-48d9d68d8309 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:00.518642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36af1a-f636-44f5-aba3-bc1009115061 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:00.556574 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:00.562521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe9ac5-230a-49e2-aed0-c9190663f5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:00.564437 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe9ac5-230a-49e2-aed0-c9190663f5cf None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:00.564898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe9ac5-230a-49e2-aed0-c9190663f5cf None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:00.565004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe9ac5-230a-49e2-aed0-c9190663f5cf None admin] PATH_INFO: `/v3/users/8da58b06ae8c4f5bafeb218ef399cc81` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:00.581311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe9ac5-230a-49e2-aed0-c9190663f5cf None admin] RBAC: Authorizing `identity:get_user(user_id=8da58b06ae8c4f5bafeb218ef399cc81)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:00.583231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe9ac5-230a-49e2-aed0-c9190663f5cf None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:00.586526 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 108/225] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:45:00 2022] GET /identity/v3/users/8da58b06ae8c4f5bafeb218ef399cc81 => generated 297 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:00.586526 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe9ac5-230a-49e2-aed0-c9190663f5cf None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:00.629299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00795cc2-205a-44cd-b925-48d9d68d8309 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:00.656524 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:00.684247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca925348-7ce3-41d9-8671-c594822c46a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:00.684924 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca925348-7ce3-41d9-8671-c594822c46a6 None admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:00.685208 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca925348-7ce3-41d9-8671-c594822c46a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:00.685528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca925348-7ce3-41d9-8671-c594822c46a6 None admin] PATH_INFO: `/v3/projects/904901a056914acebf292730fd309f87/users/e63318c21b1240ab84b218722de82a82/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:00.688267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca925348-7ce3-41d9-8671-c594822c46a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=904901a056914acebf292730fd309f87, user_id=e63318c21b1240ab84b218722de82a82, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:00.690039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca925348-7ce3-41d9-8671-c594822c46a6 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:00.706693 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 118/226] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Sep 4 00:45:00 2022] PUT /identity/v3/projects/904901a056914acebf292730fd309f87/users/e63318c21b1240ab84b218722de82a82/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:45:00.707599 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca925348-7ce3-41d9-8671-c594822c46a6 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:00.713696 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe9ac5-230a-49e2-aed0-c9190663f5cf None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:00.768391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd1906-f0ca-43a2-b69f-c0fe754fe272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:00.769169 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd1906-f0ca-43a2-b69f-c0fe754fe272 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:00.769400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd1906-f0ca-43a2-b69f-c0fe754fe272 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:00.769704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd1906-f0ca-43a2-b69f-c0fe754fe272 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:00.786632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd1906-f0ca-43a2-b69f-c0fe754fe272 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:00.792690 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-76fd1906-f0ca-43a2-b69f-c0fe754fe272 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 04 00:45:00.792690 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:00.792690 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:00.792690 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:00.792690 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:00.792690 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:00.792690 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:00.792690 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:00.792690 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:00.792690 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:00.792690 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:00.792690 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:00.792690 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:00.792690 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:00.792690 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:00.792690 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:00.793682 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:00.793682 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:00.793682 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:00.793682 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:00.793682 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:00.793682 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:00.793682 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:00.793682 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:00.793682 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:00.793682 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:00.793682 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:00.793682 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:00.793682 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:00.793682 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:00.793682 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:00.793682 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:00.794475 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:00.794475 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:00.794475 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:00.794475 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:00.794475 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:00.794475 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:00.794475 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:00.794475 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:00.794475 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:00.794475 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:00.794475 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 04 00:45:00.794475 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:00.794475 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 109/227] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Sep 4 00:45:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:00.802650 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd1906-f0ca-43a2-b69f-c0fe754fe272 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:00.856569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca925348-7ce3-41d9-8671-c594822c46a6 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:00.869712 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:00.920164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f1fbb-17ba-4dea-a8f4-94bc7cb006b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:00.920788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f1fbb-17ba-4dea-a8f4-94bc7cb006b8 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:00.921103 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f1fbb-17ba-4dea-a8f4-94bc7cb006b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:00.921729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f1fbb-17ba-4dea-a8f4-94bc7cb006b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:00.946079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd1906-f0ca-43a2-b69f-c0fe754fe272 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:00.982615 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:00.988465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534768e-36f9-4198-8d28-0a4e733b1af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:00.989099 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534768e-36f9-4198-8d28-0a4e733b1af6 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:00.989400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534768e-36f9-4198-8d28-0a4e733b1af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:00.989722 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534768e-36f9-4198-8d28-0a4e733b1af6 None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:00.990458 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534768e-36f9-4198-8d28-0a4e733b1af6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:00.991757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534768e-36f9-4198-8d28-0a4e733b1af6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:00.993743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534768e-36f9-4198-8d28-0a4e733b1af6 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:01.004030 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 110/228] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:45:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:01.010282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534768e-36f9-4198-8d28-0a4e733b1af6 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:01.010545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7f1fbb-17ba-4dea-a8f4-94bc7cb006b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:01.011997 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7f1fbb-17ba-4dea-a8f4-94bc7cb006b8 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:01.144581 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534768e-36f9-4198-8d28-0a4e733b1af6 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:01.148903 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 119/229] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:45:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 04 00:45:01.154349 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f1fbb-17ba-4dea-a8f4-94bc7cb006b8 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:01.158936 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:01.197492 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ad7f9-642c-4e3d-9b85-0a55835f8a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:01.198140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ad7f9-642c-4e3d-9b85-0a55835f8a4f None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:01.198424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ad7f9-642c-4e3d-9b85-0a55835f8a4f None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:01.198703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ad7f9-642c-4e3d-9b85-0a55835f8a4f None admin] PATH_INFO: `/v3/users/e63318c21b1240ab84b218722de82a82` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:01.199842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ad7f9-642c-4e3d-9b85-0a55835f8a4f None admin] RBAC: Authorizing `identity:get_user(user_id=e63318c21b1240ab84b218722de82a82)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:01.201357 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ad7f9-642c-4e3d-9b85-0a55835f8a4f None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:01.203224 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 111/230] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:45:01 2022] GET /identity/v3/users/e63318c21b1240ab84b218722de82a82 => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:45:01.208842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ad7f9-642c-4e3d-9b85-0a55835f8a4f None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:01.318806 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:01.361641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f1fbb-17ba-4dea-a8f4-94bc7cb006b8 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:01.384585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ad7f9-642c-4e3d-9b85-0a55835f8a4f None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:01.421563 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca464f-9555-4dbe-bd75-5593fb951bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:01.422110 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca464f-9555-4dbe-bd75-5593fb951bfe None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:01.422388 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca464f-9555-4dbe-bd75-5593fb951bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:01.422663 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca464f-9555-4dbe-bd75-5593fb951bfe None admin] PATH_INFO: `/v3/projects/904901a056914acebf292730fd309f87` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:01.426524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca464f-9555-4dbe-bd75-5593fb951bfe None admin] RBAC: Authorizing `identity:get_project(project_id=904901a056914acebf292730fd309f87)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:01.428000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca464f-9555-4dbe-bd75-5593fb951bfe None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:01.431351 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 120/231] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:45:01 2022] GET /identity/v3/projects/904901a056914acebf292730fd309f87 => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:45:01.436991 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca464f-9555-4dbe-bd75-5593fb951bfe None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:01.463536 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52e393-e933-43f7-b251-6912d0153ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:01.466027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52e393-e933-43f7-b251-6912d0153ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:01.466542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52e393-e933-43f7-b251-6912d0153ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:01.467096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52e393-e933-43f7-b251-6912d0153ea7 None admin] PATH_INFO: `/v3/projects/904901a056914acebf292730fd309f87` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:01.468472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52e393-e933-43f7-b251-6912d0153ea7 None admin] RBAC: Authorizing `identity:get_project(project_id=904901a056914acebf292730fd309f87)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:01.470181 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52e393-e933-43f7-b251-6912d0153ea7 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:01.472394 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 112/232] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:45:01 2022] GET /identity/v3/projects/904901a056914acebf292730fd309f87 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:01.478684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52e393-e933-43f7-b251-6912d0153ea7 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:01.557053 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:01.624708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca464f-9555-4dbe-bd75-5593fb951bfe None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:01.656632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52e393-e933-43f7-b251-6912d0153ea7 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:01.687981 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74edae7f-2f03-48c5-ad77-c9e86ba08106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:01.688678 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edae7f-2f03-48c5-ad77-c9e86ba08106 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:01.688973 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edae7f-2f03-48c5-ad77-c9e86ba08106 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:01.689363 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edae7f-2f03-48c5-ad77-c9e86ba08106 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:01.690160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74edae7f-2f03-48c5-ad77-c9e86ba08106 None admin] RBAC: Adding query filter params (role.id=7c1abe5c3a82479484ec5a104ec31f8f, scope.project.id=904901a056914acebf292730fd309f87, user.id=8da58b06ae8c4f5bafeb218ef399cc81) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:01.690472 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74edae7f-2f03-48c5-ad77-c9e86ba08106 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:01.691921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74edae7f-2f03-48c5-ad77-c9e86ba08106 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:01.698716 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 121/233] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:45:01 2022] GET /identity/v3/role_assignments?user.id=8da58b06ae8c4f5bafeb218ef399cc81&scope.project.id=904901a056914acebf292730fd309f87&role.id=7c1abe5c3a82479484ec5a104ec31f8f => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:01.725263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bacb23-2052-4309-b1da-8aa67d9a47a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:01.725993 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bacb23-2052-4309-b1da-8aa67d9a47a4 None admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:01.726319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bacb23-2052-4309-b1da-8aa67d9a47a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:01.726592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bacb23-2052-4309-b1da-8aa67d9a47a4 None admin] PATH_INFO: `/v3/projects/904901a056914acebf292730fd309f87/users/e63318c21b1240ab84b218722de82a82/roles/c6d447182cac4a6ca92d2457e8936b91` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:01.734090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bacb23-2052-4309-b1da-8aa67d9a47a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=904901a056914acebf292730fd309f87, user_id=e63318c21b1240ab84b218722de82a82, role_id=c6d447182cac4a6ca92d2457e8936b91)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:01.735627 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bacb23-2052-4309-b1da-8aa67d9a47a4 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:01.766083 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 113/234] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Sep 4 00:45:01 2022] PUT /identity/v3/projects/904901a056914acebf292730fd309f87/users/e63318c21b1240ab84b218722de82a82/roles/c6d447182cac4a6ca92d2457e8936b91 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 00:45:02.740445 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe97c61-59e2-4cc9-ab89-6dfd0350b4f1 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:02.740932 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe97c61-59e2-4cc9-ab89-6dfd0350b4f1 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:02.740932 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe97c61-59e2-4cc9-ab89-6dfd0350b4f1 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:02.742360 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 122/235] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:02.747923 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b8470-d933-4272-a7f3-830f97bee549 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:02.748340 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b8470-d933-4272-a7f3-830f97bee549 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:02.748509 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b8470-d933-4272-a7f3-830f97bee549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:02.768668 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a04b8470-d933-4272-a7f3-830f97bee549 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:02.769919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a04b8470-d933-4272-a7f3-830f97bee549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:02.773478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb8e4f-ddbf-43fa-a311-fc6fc6ca648f None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:02.773478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb8e4f-ddbf-43fa-a311-fc6fc6ca648f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:02.773478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb8e4f-ddbf-43fa-a311-fc6fc6ca648f None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:02.774907 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 123/236] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:02.779960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be0b24-d677-4ebd-9c20-e5e04482a0c9 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:02.780496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be0b24-d677-4ebd-9c20-e5e04482a0c9 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:02.780966 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be0b24-d677-4ebd-9c20-e5e04482a0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:02.800772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-51be0b24-d677-4ebd-9c20-e5e04482a0c9 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:02.802294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-51be0b24-d677-4ebd-9c20-e5e04482a0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:02.813458 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:02.886801 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 124/237] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 04 00:45:02.898700 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 114/238] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 04 00:45:03.141801 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d291c4-746d-4b6a-8167-558c2cf0fe3e None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:03.142471 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d291c4-746d-4b6a-8167-558c2cf0fe3e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:03.142951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d291c4-746d-4b6a-8167-558c2cf0fe3e None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:03.144813 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 125/239] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:03.149836 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0815c4-e3d4-4869-baa8-d5c334ff0162 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:03.150332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0815c4-e3d4-4869-baa8-d5c334ff0162 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:03.150800 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0815c4-e3d4-4869-baa8-d5c334ff0162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:03.173423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-0e0815c4-e3d4-4869-baa8-d5c334ff0162 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:03.174936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0e0815c4-e3d4-4869-baa8-d5c334ff0162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:03.214153 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:03.254862 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d291c4-746d-4b6a-8167-558c2cf0fe3e None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:03.292375 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 115/240] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:03.293099 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0815c4-e3d4-4869-baa8-d5c334ff0162 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:03.408354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0815c4-e3d4-4869-baa8-d5c334ff0162 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:03.470200 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad41a1-7aac-495c-9043-ea43ba83f24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:03.470848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad41a1-7aac-495c-9043-ea43ba83f24d None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:03.471130 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad41a1-7aac-495c-9043-ea43ba83f24d None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:03.471403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad41a1-7aac-495c-9043-ea43ba83f24d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:03.480468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d291c4-746d-4b6a-8167-558c2cf0fe3e None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:03.496708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad41a1-7aac-495c-9043-ea43ba83f24d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:03.508081 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-42ad41a1-7aac-495c-9043-ea43ba83f24d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 04 00:45:03.508081 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:03.508081 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:03.508081 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:03.508081 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:03.508081 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:03.508081 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:03.508081 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:03.508081 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:03.508081 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:03.508081 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:03.508081 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:03.508081 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:03.508081 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:03.508081 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:03.508081 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:03.509127 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:03.509127 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:03.509127 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:03.509127 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:03.509127 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:03.509127 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:03.509127 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:03.509127 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:03.509127 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:03.509127 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:03.509127 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:03.509127 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:03.509127 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:03.509127 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:03.509127 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:03.509127 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:03.509946 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:03.509946 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:03.509946 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:03.509946 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:03.509946 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:03.509946 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:03.509946 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:03.509946 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:03.509946 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:03.509946 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:03.509946 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 04 00:45:03.509946 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:03.509946 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 116/241] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:45:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:03.531496 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad41a1-7aac-495c-9043-ea43ba83f24d None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:03.547231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ac7bd-8907-49dd-aa87-c814af7c9bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:03.547879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ac7bd-8907-49dd-aa87-c814af7c9bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:03.548156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ac7bd-8907-49dd-aa87-c814af7c9bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:03.548429 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ac7bd-8907-49dd-aa87-c814af7c9bd3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:03.550165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ac7bd-8907-49dd-aa87-c814af7c9bd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:03.551854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ac7bd-8907-49dd-aa87-c814af7c9bd3 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:03.553685 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 126/242] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:45:03.559948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ac7bd-8907-49dd-aa87-c814af7c9bd3 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:03.568506 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:03.577354 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:03.672668 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad41a1-7aac-495c-9043-ea43ba83f24d None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:03.687014 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ac7bd-8907-49dd-aa87-c814af7c9bd3 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:03.718412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef586b4a-7190-4a06-b466-43f74e1acb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:03.719406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef586b4a-7190-4a06-b466-43f74e1acb40 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:03.719879 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef586b4a-7190-4a06-b466-43f74e1acb40 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:03.720374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef586b4a-7190-4a06-b466-43f74e1acb40 None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:03.721237 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef586b4a-7190-4a06-b466-43f74e1acb40 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:03.721786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef586b4a-7190-4a06-b466-43f74e1acb40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:03.723480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef586b4a-7190-4a06-b466-43f74e1acb40 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:03.726132 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd8920-f352-4860-8b94-fae13d5a0326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:03.727323 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd8920-f352-4860-8b94-fae13d5a0326 None admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:03.728229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd8920-f352-4860-8b94-fae13d5a0326 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:03.728738 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd8920-f352-4860-8b94-fae13d5a0326 None admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:03.729506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd8920-f352-4860-8b94-fae13d5a0326 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:03.731051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd8920-f352-4860-8b94-fae13d5a0326 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:03.736720 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 117/243] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Sep 4 00:45:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:45:03.737791 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef586b4a-7190-4a06-b466-43f74e1acb40 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:03.760658 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 127/244] 10.222.0.30 () {60 vars in 1132 bytes} [Sun Sep 4 00:45:03 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 00:45:03.762304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd8920-f352-4860-8b94-fae13d5a0326 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:03.839305 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:03.885271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd8920-f352-4860-8b94-fae13d5a0326 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:03.925686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ef75d-b1ba-4ef9-96a7-5d3895f9fba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:03.926618 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ef75d-b1ba-4ef9-96a7-5d3895f9fba6 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:03.927261 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ef75d-b1ba-4ef9-96a7-5d3895f9fba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:03.928199 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ef75d-b1ba-4ef9-96a7-5d3895f9fba6 None admin] PATH_INFO: `/v3/users/0a985fa4ab7a45f4ad9c93e3b571d768` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:03.944330 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92ef75d-b1ba-4ef9-96a7-5d3895f9fba6 None admin] RBAC: Authorizing `identity:get_user(user_id=0a985fa4ab7a45f4ad9c93e3b571d768)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:03.946183 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92ef75d-b1ba-4ef9-96a7-5d3895f9fba6 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:03.948269 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 128/245] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:45:03 2022] GET /identity/v3/users/0a985fa4ab7a45f4ad9c93e3b571d768 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:03.954379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ef75d-b1ba-4ef9-96a7-5d3895f9fba6 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:03.958411 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:03.976672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef586b4a-7190-4a06-b466-43f74e1acb40 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:04.019218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988efa3e-0218-40fe-be38-019b191a5ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:04.019856 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988efa3e-0218-40fe-be38-019b191a5ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:04.020137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988efa3e-0218-40fe-be38-019b191a5ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:04.020460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988efa3e-0218-40fe-be38-019b191a5ad6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:04.034178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988efa3e-0218-40fe-be38-019b191a5ad6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:04.040660 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-988efa3e-0218-40fe-be38-019b191a5ad6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:45:04.040660 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:04.040660 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:04.040660 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:04.040660 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:04.040660 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:04.040660 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:04.040660 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:04.040660 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:04.040660 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:04.040660 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:04.040660 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:04.040660 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:04.040660 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:04.040660 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:04.040660 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:04.041542 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:04.041542 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:04.041542 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:04.041542 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:04.041542 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:04.041542 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:04.041542 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:04.041542 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:04.041542 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:04.041542 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:04.041542 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:04.041542 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:04.041542 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:04.041542 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:04.041542 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:04.041542 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:04.042418 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:04.042418 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:04.042418 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:04.042418 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:04.042418 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:04.042418 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:04.042418 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:04.042418 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:04.042418 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:04.042418 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:04.042418 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:45:04.042418 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:04.042418 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 118/246] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Sep 4 00:45:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:04.047826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988efa3e-0218-40fe-be38-019b191a5ad6 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:04.090524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ef75d-b1ba-4ef9-96a7-5d3895f9fba6 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:04.124884 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:04.140896 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9f337-0860-4c3a-b100-7de61aea7def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:04.141967 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9f337-0860-4c3a-b100-7de61aea7def None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:04.142945 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9f337-0860-4c3a-b100-7de61aea7def None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:04.143420 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9f337-0860-4c3a-b100-7de61aea7def None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:04.174707 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988efa3e-0218-40fe-be38-019b191a5ad6 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:04.222745 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745a975-bb03-4bbf-a713-dbca4c946772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:04.223296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745a975-bb03-4bbf-a713-dbca4c946772 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:04.223579 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745a975-bb03-4bbf-a713-dbca4c946772 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:04.223854 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745a975-bb03-4bbf-a713-dbca4c946772 None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:04.224698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745a975-bb03-4bbf-a713-dbca4c946772 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:04.225009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745a975-bb03-4bbf-a713-dbca4c946772 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:04.226455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745a975-bb03-4bbf-a713-dbca4c946772 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:04.235683 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9f337-0860-4c3a-b100-7de61aea7def None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:04.236118 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 119/247] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:45:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:45:04.237369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e2342-0161-41af-8cb8-01a4ab0e8402 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:04.237692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e2342-0161-41af-8cb8-01a4ab0e8402 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:04.237943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9f337-0860-4c3a-b100-7de61aea7def None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:04.238052 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e2342-0161-41af-8cb8-01a4ab0e8402 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:04.239313 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 120/248] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:04.245451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac6675-99da-4046-b76b-d2b65aee4856 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:04.245451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac6675-99da-4046-b76b-d2b65aee4856 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:04.245451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac6675-99da-4046-b76b-d2b65aee4856 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:04.246734 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 121/249] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:04.247747 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61140f-bb0e-4ae8-8534-05c82cc4ff6c None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:04.248028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61140f-bb0e-4ae8-8534-05c82cc4ff6c None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:04.248301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61140f-bb0e-4ae8-8534-05c82cc4ff6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:04.267951 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-6f61140f-bb0e-4ae8-8534-05c82cc4ff6c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:04.269158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6f61140f-bb0e-4ae8-8534-05c82cc4ff6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:04.272167 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:04.355538 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 122/250] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:04.356665 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f61140f-bb0e-4ae8-8534-05c82cc4ff6c None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:04.371836 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 129/251] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:45:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 04 00:45:04.373415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50516ac2-6779-4ed3-8cda-e27c62517182 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:04.373899 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50516ac2-6779-4ed3-8cda-e27c62517182 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:04.374339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50516ac2-6779-4ed3-8cda-e27c62517182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:04.398730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-50516ac2-6779-4ed3-8cda-e27c62517182 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:04.401421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-50516ac2-6779-4ed3-8cda-e27c62517182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:04.423698 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:04.501185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f61140f-bb0e-4ae8-8534-05c82cc4ff6c None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:04.528541 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 130/252] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:04.529408 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50516ac2-6779-4ed3-8cda-e27c62517182 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:04.571834 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478f3a5-4ff7-4eb2-8c20-9ad6c238ea2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:04.573591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478f3a5-4ff7-4eb2-8c20-9ad6c238ea2c None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:04.573870 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478f3a5-4ff7-4eb2-8c20-9ad6c238ea2c None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:04.574141 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478f3a5-4ff7-4eb2-8c20-9ad6c238ea2c None admin] PATH_INFO: `/v3/users/e63318c21b1240ab84b218722de82a82` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:04.576575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1478f3a5-4ff7-4eb2-8c20-9ad6c238ea2c None admin] RBAC: Authorizing `identity:get_user(user_id=e63318c21b1240ab84b218722de82a82)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:04.580433 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1478f3a5-4ff7-4eb2-8c20-9ad6c238ea2c None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:04.582930 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 123/253] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:45:04 2022] GET /identity/v3/users/e63318c21b1240ab84b218722de82a82 => generated 283 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:04.607076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478f3a5-4ff7-4eb2-8c20-9ad6c238ea2c None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:04.623903 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:04.721849 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50516ac2-6779-4ed3-8cda-e27c62517182 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:04.771511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26655dde-69a7-4513-a7b4-a12a805ec916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:04.772110 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26655dde-69a7-4513-a7b4-a12a805ec916 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:04.772328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26655dde-69a7-4513-a7b4-a12a805ec916 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:04.772600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26655dde-69a7-4513-a7b4-a12a805ec916 None admin] PATH_INFO: `/v3/projects/904901a056914acebf292730fd309f87` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:04.773788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26655dde-69a7-4513-a7b4-a12a805ec916 None admin] RBAC: Authorizing `identity:get_project(project_id=904901a056914acebf292730fd309f87)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:04.775287 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26655dde-69a7-4513-a7b4-a12a805ec916 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:04.776913 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 131/254] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:45:04 2022] GET /identity/v3/projects/904901a056914acebf292730fd309f87 => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:04.780870 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26655dde-69a7-4513-a7b4-a12a805ec916 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:04.788268 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478f3a5-4ff7-4eb2-8c20-9ad6c238ea2c None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:04.825631 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:04.839307 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24bc6d-e343-4fd7-80d1-dc787a05a5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:04.840801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24bc6d-e343-4fd7-80d1-dc787a05a5c1 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:04.841229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24bc6d-e343-4fd7-80d1-dc787a05a5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:04.841946 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24bc6d-e343-4fd7-80d1-dc787a05a5c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:04.932289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26655dde-69a7-4513-a7b4-a12a805ec916 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:04.936160 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c24bc6d-e343-4fd7-80d1-dc787a05a5c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:04.937812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c24bc6d-e343-4fd7-80d1-dc787a05a5c1 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:04.951259 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:04.975203 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260e8e4-dcdf-4123-adab-49c6a231987a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:04.976352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260e8e4-dcdf-4123-adab-49c6a231987a None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:04.976804 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260e8e4-dcdf-4123-adab-49c6a231987a None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:04.977949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260e8e4-dcdf-4123-adab-49c6a231987a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:04.992834 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260e8e4-dcdf-4123-adab-49c6a231987a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:05.000995 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-5260e8e4-dcdf-4123-adab-49c6a231987a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 04 00:45:05.000995 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:05.000995 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:05.000995 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:05.000995 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:05.000995 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:05.000995 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:05.000995 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:05.000995 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:05.000995 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:05.000995 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:05.000995 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:05.000995 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:05.000995 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:05.000995 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:05.000995 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:05.002095 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:05.002095 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:05.002095 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:05.002095 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:05.002095 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:05.002095 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:05.002095 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:05.002095 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:05.002095 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:05.002095 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:05.002095 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:05.002095 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:05.002095 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:05.002095 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:05.002095 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:05.002095 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:05.003053 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:05.003053 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:05.003053 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:05.003053 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:05.003053 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:05.003053 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:05.003053 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:05.003053 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:05.003053 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:05.003053 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:05.003053 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 04 00:45:05.003053 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:05.010476 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 132/255] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:45:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:05.010476 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260e8e4-dcdf-4123-adab-49c6a231987a None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:05.061616 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 124/256] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:45:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 04 00:45:05.067035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24bc6d-e343-4fd7-80d1-dc787a05a5c1 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:05.123894 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:05.147644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260e8e4-dcdf-4123-adab-49c6a231987a None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:05.183553 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deab695-177e-4b88-bc72-ed8f2d641699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:05.184156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deab695-177e-4b88-bc72-ed8f2d641699 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:05.184432 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deab695-177e-4b88-bc72-ed8f2d641699 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:05.184700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deab695-177e-4b88-bc72-ed8f2d641699 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:05.185172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24bc6d-e343-4fd7-80d1-dc787a05a5c1 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:05.185419 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deab695-177e-4b88-bc72-ed8f2d641699 None admin] RBAC: Adding query filter params (role.id=9cf4680c808546e286e3a5c3383d98e1, scope.project.id=904901a056914acebf292730fd309f87, user.id=0a985fa4ab7a45f4ad9c93e3b571d768) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:05.185750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deab695-177e-4b88-bc72-ed8f2d641699 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:05.187220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deab695-177e-4b88-bc72-ed8f2d641699 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:05.197672 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 133/257] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:45:05 2022] GET /identity/v3/role_assignments?user.id=0a985fa4ab7a45f4ad9c93e3b571d768&scope.project.id=904901a056914acebf292730fd309f87&role.id=9cf4680c808546e286e3a5c3383d98e1 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:05.198938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deab695-177e-4b88-bc72-ed8f2d641699 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:05.204367 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:05.258425 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc4a8e-06b1-4be1-8580-94e914739bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:05.259174 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc4a8e-06b1-4be1-8580-94e914739bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:05.259457 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc4a8e-06b1-4be1-8580-94e914739bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:05.259732 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc4a8e-06b1-4be1-8580-94e914739bd1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:05.291728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc4a8e-06b1-4be1-8580-94e914739bd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:05.296725 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-6dcc4a8e-06b1-4be1-8580-94e914739bd1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 04 00:45:05.296725 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:05.296725 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:05.296725 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:05.296725 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:05.296725 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:05.296725 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:05.296725 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:05.296725 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:05.296725 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:05.296725 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:05.296725 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:05.296725 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:05.296725 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:05.296725 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:05.296725 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:05.297673 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:05.297673 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:05.297673 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:05.297673 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:05.297673 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:05.297673 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:05.297673 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:05.297673 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:05.297673 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:05.297673 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:05.297673 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:05.297673 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:05.297673 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:05.297673 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:05.297673 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:05.297673 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:05.298443 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:05.298443 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:05.298443 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:05.298443 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:05.298443 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:05.298443 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:05.298443 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:05.298443 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:05.298443 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:05.298443 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:05.298443 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 04 00:45:05.298443 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:05.298443 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 125/258] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Sep 4 00:45:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:05.299688 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc4a8e-06b1-4be1-8580-94e914739bd1 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:05.412976 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deab695-177e-4b88-bc72-ed8f2d641699 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:05.494040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc2114-411d-4646-9dd8-2683ed899629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:05.494705 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc2114-411d-4646-9dd8-2683ed899629 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:05.494987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc2114-411d-4646-9dd8-2683ed899629 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:05.495252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc2114-411d-4646-9dd8-2683ed899629 None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:05.495912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc2114-411d-4646-9dd8-2683ed899629 None admin] RBAC: Adding query filter params (name=member) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:05.496209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc2114-411d-4646-9dd8-2683ed899629 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:05.497610 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc2114-411d-4646-9dd8-2683ed899629 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:05.516606 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 134/259] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Sep 4 00:45:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:05.517421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc2114-411d-4646-9dd8-2683ed899629 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:05.522801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc4a8e-06b1-4be1-8580-94e914739bd1 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:05.534244 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:05.570531 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccb375-119d-40ae-8a4c-6ff79047fcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:05.571684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccb375-119d-40ae-8a4c-6ff79047fcb2 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:05.571961 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccb375-119d-40ae-8a4c-6ff79047fcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:05.572231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccb375-119d-40ae-8a4c-6ff79047fcb2 None admin] PATH_INFO: `/v3/projects/904901a056914acebf292730fd309f87` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:05.573464 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ccb375-119d-40ae-8a4c-6ff79047fcb2 None admin] RBAC: Authorizing `identity:get_project(project_id=904901a056914acebf292730fd309f87)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:05.574925 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ccb375-119d-40ae-8a4c-6ff79047fcb2 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:05.578353 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 126/260] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:45:05 2022] GET /identity/v3/projects/904901a056914acebf292730fd309f87 => generated 302 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:05.579114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccb375-119d-40ae-8a4c-6ff79047fcb2 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:05.651428 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:05.709148 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc2114-411d-4646-9dd8-2683ed899629 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:05.777777 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccb375-119d-40ae-8a4c-6ff79047fcb2 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:05.788361 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62bfcf-052d-4af2-a92b-b81bddf06d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:05.789638 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62bfcf-052d-4af2-a92b-b81bddf06d0f None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:05.790160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62bfcf-052d-4af2-a92b-b81bddf06d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:05.790645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62bfcf-052d-4af2-a92b-b81bddf06d0f None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:05.791510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62bfcf-052d-4af2-a92b-b81bddf06d0f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:05.792013 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62bfcf-052d-4af2-a92b-b81bddf06d0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:05.793851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62bfcf-052d-4af2-a92b-b81bddf06d0f None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:05.803105 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 135/261] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:45:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:05.804204 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62bfcf-052d-4af2-a92b-b81bddf06d0f None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:05.867059 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b3a1a-8e25-4a91-8756-5b23b5b10030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:05.867703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b3a1a-8e25-4a91-8756-5b23b5b10030 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:05.868030 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b3a1a-8e25-4a91-8756-5b23b5b10030 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:05.868338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b3a1a-8e25-4a91-8756-5b23b5b10030 None admin] PATH_INFO: `/v3/users/8da58b06ae8c4f5bafeb218ef399cc81` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:05.874122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b3a1a-8e25-4a91-8756-5b23b5b10030 None admin] RBAC: Authorizing `identity:get_user(user_id=8da58b06ae8c4f5bafeb218ef399cc81)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:05.875572 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b3a1a-8e25-4a91-8756-5b23b5b10030 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:05.876823 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:05.877320 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 127/262] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:45:05 2022] GET /identity/v3/users/8da58b06ae8c4f5bafeb218ef399cc81 => generated 297 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:05.881555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b3a1a-8e25-4a91-8756-5b23b5b10030 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:05.921243 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62bfcf-052d-4af2-a92b-b81bddf06d0f None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:05.960893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ce796-e573-4e33-8457-01d4c52c3dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:05.962080 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ce796-e573-4e33-8457-01d4c52c3dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:05.963316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ce796-e573-4e33-8457-01d4c52c3dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:05.964407 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ce796-e573-4e33-8457-01d4c52c3dd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:05.965520 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ce796-e573-4e33-8457-01d4c52c3dd5 None admin] RBAC: Adding query filter params (role.id=d255b03c37d64371a148ec4e11be01d9, scope.project.id=904901a056914acebf292730fd309f87, user.id=e63318c21b1240ab84b218722de82a82) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:05.967834 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ce796-e573-4e33-8457-01d4c52c3dd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:05.969521 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ce796-e573-4e33-8457-01d4c52c3dd5 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:05.982153 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 136/263] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:45:05 2022] GET /identity/v3/role_assignments?user.id=e63318c21b1240ab84b218722de82a82&scope.project.id=904901a056914acebf292730fd309f87&role.id=d255b03c37d64371a148ec4e11be01d9 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:05.985044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ce796-e573-4e33-8457-01d4c52c3dd5 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:06.118805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b3a1a-8e25-4a91-8756-5b23b5b10030 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:06.124222 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:06.164948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ce796-e573-4e33-8457-01d4c52c3dd5 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:06.176789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc63d647-3e1a-4eae-9551-5d36c8916824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:06.177231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63d647-3e1a-4eae-9551-5d36c8916824 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:06.177567 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63d647-3e1a-4eae-9551-5d36c8916824 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:06.177847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63d647-3e1a-4eae-9551-5d36c8916824 None admin] PATH_INFO: `/v3/users/e63318c21b1240ab84b218722de82a82` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:06.179043 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc63d647-3e1a-4eae-9551-5d36c8916824 None admin] RBAC: Authorizing `identity:get_user(user_id=e63318c21b1240ab84b218722de82a82)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:06.181255 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc63d647-3e1a-4eae-9551-5d36c8916824 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:06.183217 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 128/264] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:45:05 2022] GET /identity/v3/users/e63318c21b1240ab84b218722de82a82 => generated 283 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:06.188896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc63d647-3e1a-4eae-9551-5d36c8916824 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:06.200291 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:06.218297 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388e7f3-1a52-49ab-8f8f-370887b73b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:06.219282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388e7f3-1a52-49ab-8f8f-370887b73b00 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:06.219800 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388e7f3-1a52-49ab-8f8f-370887b73b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:06.220265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388e7f3-1a52-49ab-8f8f-370887b73b00 None admin] PATH_INFO: `/v3/projects/904901a056914acebf292730fd309f87` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:06.221702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388e7f3-1a52-49ab-8f8f-370887b73b00 None admin] RBAC: Authorizing `identity:get_project(project_id=904901a056914acebf292730fd309f87)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:06.223357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388e7f3-1a52-49ab-8f8f-370887b73b00 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:06.225205 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 137/265] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:45:05 2022] GET /identity/v3/projects/904901a056914acebf292730fd309f87 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:06.231127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388e7f3-1a52-49ab-8f8f-370887b73b00 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:06.304285 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc63d647-3e1a-4eae-9551-5d36c8916824 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:06.340760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d461eb5-bbff-4871-a0b9-ed0de425da12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:06.341375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d461eb5-bbff-4871-a0b9-ed0de425da12 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:06.341717 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d461eb5-bbff-4871-a0b9-ed0de425da12 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:06.341989 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d461eb5-bbff-4871-a0b9-ed0de425da12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:06.348353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388e7f3-1a52-49ab-8f8f-370887b73b00 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:06.391002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c5716b-8263-452e-a9f0-5ba48191269d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:06.391679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5716b-8263-452e-a9f0-5ba48191269d None admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:06.391957 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5716b-8263-452e-a9f0-5ba48191269d None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:06.392624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5716b-8263-452e-a9f0-5ba48191269d None admin] PATH_INFO: `/v3/projects/904901a056914acebf292730fd309f87/users/8da58b06ae8c4f5bafeb218ef399cc81/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:06.394553 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c5716b-8263-452e-a9f0-5ba48191269d None admin] RBAC: Authorizing `identity:create_grant(project_id=904901a056914acebf292730fd309f87, user_id=8da58b06ae8c4f5bafeb218ef399cc81, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:06.395399 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:06.396696 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c5716b-8263-452e-a9f0-5ba48191269d None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:06.420052 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 138/266] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Sep 4 00:45:06 2022] PUT /identity/v3/projects/904901a056914acebf292730fd309f87/users/8da58b06ae8c4f5bafeb218ef399cc81/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:45:06.422012 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60026b-f470-4174-9354-7b9fa0a0002d None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:06.422355 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60026b-f470-4174-9354-7b9fa0a0002d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:06.422669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60026b-f470-4174-9354-7b9fa0a0002d None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:06.431197 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 139/267] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:06 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:06.438455 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c1e8a-de21-4a71-8468-5735a40261dd None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:06.438781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c1e8a-de21-4a71-8468-5735a40261dd None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:06.439002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c1e8a-de21-4a71-8468-5735a40261dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:06.455787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d461eb5-bbff-4871-a0b9-ed0de425da12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:06.457359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d461eb5-bbff-4871-a0b9-ed0de425da12 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:06.482188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-2d7c1e8a-de21-4a71-8468-5735a40261dd None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:06.485011 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2d7c1e8a-de21-4a71-8468-5735a40261dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:06.573607 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:06.596015 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 140/268] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:06.597097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd2561-e93e-4a74-8aca-5d143b3cd2b5 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:06.597373 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd2561-e93e-4a74-8aca-5d143b3cd2b5 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:06.597705 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd2561-e93e-4a74-8aca-5d143b3cd2b5 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:06.602073 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 141/269] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:06.605091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93a490-7787-450f-b4d2-34289a160cb3 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:06.605367 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93a490-7787-450f-b4d2-34289a160cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:06.605913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93a490-7787-450f-b4d2-34289a160cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:06.621512 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 129/270] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:45:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 04 00:45:06.631919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d461eb5-bbff-4871-a0b9-ed0de425da12 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:06.633714 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-5f93a490-7787-450f-b4d2-34289a160cb3 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:06.634912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5f93a490-7787-450f-b4d2-34289a160cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:06.723134 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:06.731982 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 142/271] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:06.762229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d461eb5-bbff-4871-a0b9-ed0de425da12 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:06.811035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d70b3b-595e-40ba-84b0-dca4ebc9b8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:06.811666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d70b3b-595e-40ba-84b0-dca4ebc9b8a4 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:06.811946 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d70b3b-595e-40ba-84b0-dca4ebc9b8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:06.812223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d70b3b-595e-40ba-84b0-dca4ebc9b8a4 None admin] PATH_INFO: `/v3/projects/904901a056914acebf292730fd309f87` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:06.813341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d70b3b-595e-40ba-84b0-dca4ebc9b8a4 None admin] RBAC: Authorizing `identity:get_project(project_id=904901a056914acebf292730fd309f87)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:06.814820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d70b3b-595e-40ba-84b0-dca4ebc9b8a4 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:06.816806 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 130/272] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:45:06 2022] GET /identity/v3/projects/904901a056914acebf292730fd309f87 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:06.822339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93a490-7787-450f-b4d2-34289a160cb3 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:06.929476 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93a490-7787-450f-b4d2-34289a160cb3 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:06.951584 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:06.981304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78fa131-84a3-493f-b99d-27490c4e9b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:06.982008 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78fa131-84a3-493f-b99d-27490c4e9b27 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:06.982285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78fa131-84a3-493f-b99d-27490c4e9b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:06.982555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78fa131-84a3-493f-b99d-27490c4e9b27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:06.983291 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78fa131-84a3-493f-b99d-27490c4e9b27 None admin] RBAC: Adding query filter params (role.id=c6d447182cac4a6ca92d2457e8936b91, scope.project.id=904901a056914acebf292730fd309f87, user.id=e63318c21b1240ab84b218722de82a82) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:06.983643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78fa131-84a3-493f-b99d-27490c4e9b27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:06.985364 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78fa131-84a3-493f-b99d-27490c4e9b27 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:07.000409 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 143/273] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:45:06 2022] GET /identity/v3/role_assignments?user.id=e63318c21b1240ab84b218722de82a82&scope.project.id=904901a056914acebf292730fd309f87&role.id=c6d447182cac4a6ca92d2457e8936b91 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:07.021687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d70b3b-595e-40ba-84b0-dca4ebc9b8a4 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:07.038631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78fa131-84a3-493f-b99d-27490c4e9b27 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:07.204883 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d70b3b-595e-40ba-84b0-dca4ebc9b8a4 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:07.244588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94251b-8bdc-418c-b94e-d75e85165a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:07.246137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94251b-8bdc-418c-b94e-d75e85165a16 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:07.246426 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94251b-8bdc-418c-b94e-d75e85165a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:07.246754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94251b-8bdc-418c-b94e-d75e85165a16 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:07.261429 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94251b-8bdc-418c-b94e-d75e85165a16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:07.268896 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-cd94251b-8bdc-418c-b94e-d75e85165a16 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 04 00:45:07.268896 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:07.268896 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:07.268896 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:07.268896 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:07.268896 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:07.268896 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:07.268896 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:07.268896 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:07.268896 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:07.268896 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:07.268896 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:07.268896 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:07.268896 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:07.268896 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:07.268896 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:07.269853 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:07.269853 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:07.269853 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:07.269853 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:07.269853 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:07.269853 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:07.269853 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:07.269853 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:07.269853 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:07.269853 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:07.269853 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:07.269853 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:07.269853 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:07.269853 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:07.269853 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:07.269853 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:07.271000 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:07.271000 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:07.271000 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:07.271000 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:07.271000 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:07.271000 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:07.271000 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:07.271000 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:07.271000 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:07.271000 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:07.271000 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 04 00:45:07.271000 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:07.271000 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 131/274] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:45:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:07.271000 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:07.278041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94251b-8bdc-418c-b94e-d75e85165a16 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:07.320179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78fa131-84a3-493f-b99d-27490c4e9b27 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:07.406053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb1c82-0e09-44ce-848f-266c9c586092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:07.406693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb1c82-0e09-44ce-848f-266c9c586092 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:07.407644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb1c82-0e09-44ce-848f-266c9c586092 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:07.407923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb1c82-0e09-44ce-848f-266c9c586092 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:07.409156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb1c82-0e09-44ce-848f-266c9c586092 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:07.410642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb1c82-0e09-44ce-848f-266c9c586092 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:07.412204 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 144/275] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:07.418273 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94251b-8bdc-418c-b94e-d75e85165a16 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:07.420491 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb1c82-0e09-44ce-848f-266c9c586092 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:07.495137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ed7ea-0b7f-454d-9ac2-4629ac756866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:07.495884 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ed7ea-0b7f-454d-9ac2-4629ac756866 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:07.498208 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ed7ea-0b7f-454d-9ac2-4629ac756866 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:07.498513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ed7ea-0b7f-454d-9ac2-4629ac756866 None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:07.499354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ed7ea-0b7f-454d-9ac2-4629ac756866 None admin] RBAC: Adding query filter params (name=member) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:07.499660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ed7ea-0b7f-454d-9ac2-4629ac756866 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:07.501071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ed7ea-0b7f-454d-9ac2-4629ac756866 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:07.510801 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:07.531711 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 132/276] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Sep 4 00:45:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:45:07.535726 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016f579-a466-4ffa-887c-483c6a6f8636 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:07.536100 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016f579-a466-4ffa-887c-483c6a6f8636 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:07.536442 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016f579-a466-4ffa-887c-483c6a6f8636 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:07.538653 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 133/277] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 04 00:45:07.539350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016f579-a466-4ffa-887c-483c6a6f8636 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:07.573862 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb1c82-0e09-44ce-848f-266c9c586092 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:07.609967 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:07.613097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7751a8-4fed-4ce0-886e-0a6f2b3c428f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:07.613730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7751a8-4fed-4ce0-886e-0a6f2b3c428f None admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:07.614009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7751a8-4fed-4ce0-886e-0a6f2b3c428f None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:07.614285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7751a8-4fed-4ce0-886e-0a6f2b3c428f None admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:07.614955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7751a8-4fed-4ce0-886e-0a6f2b3c428f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:07.616392 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7751a8-4fed-4ce0-886e-0a6f2b3c428f None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:07.639810 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 145/278] 10.222.0.30 () {60 vars in 1132 bytes} [Sun Sep 4 00:45:07 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:45:07.640944 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1eef1-a358-42cd-a2ae-4e65517b4ac2 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:07.641234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1eef1-a358-42cd-a2ae-4e65517b4ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:07.641529 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1eef1-a358-42cd-a2ae-4e65517b4ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:07.661155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-3ab1eef1-a358-42cd-a2ae-4e65517b4ac2 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:07.662477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3ab1eef1-a358-42cd-a2ae-4e65517b4ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:07.670585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016f579-a466-4ffa-887c-483c6a6f8636 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:07.723760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1c320-8267-446c-8d11-3b693f0b4a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:07.724835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1c320-8267-446c-8d11-3b693f0b4a66 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:07.726216 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1c320-8267-446c-8d11-3b693f0b4a66 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:07.726501 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1c320-8267-446c-8d11-3b693f0b4a66 None admin] PATH_INFO: `/v3/users/39672c7d7ff44bcba113bd71464cacc8` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:07.749495 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 146/279] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:07.759629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1c320-8267-446c-8d11-3b693f0b4a66 None admin] RBAC: Authorizing `identity:get_user(user_id=39672c7d7ff44bcba113bd71464cacc8)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:07.761203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1c320-8267-446c-8d11-3b693f0b4a66 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:07.765503 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 134/280] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:45:07 2022] GET /identity/v3/users/39672c7d7ff44bcba113bd71464cacc8 => generated 293 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:07.772329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1eef1-a358-42cd-a2ae-4e65517b4ac2 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:07.816208 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:07.878601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1eef1-a358-42cd-a2ae-4e65517b4ac2 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:07.913057 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16ba90-6782-41cc-b462-d7e83fe48876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:07.913921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16ba90-6782-41cc-b462-d7e83fe48876 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:07.914336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16ba90-6782-41cc-b462-d7e83fe48876 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:07.915276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16ba90-6782-41cc-b462-d7e83fe48876 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:07.916150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16ba90-6782-41cc-b462-d7e83fe48876 None admin] RBAC: Adding query filter params (role.id=7c1abe5c3a82479484ec5a104ec31f8f, user.id=39672c7d7ff44bcba113bd71464cacc8, scope.system=all) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:07.916591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16ba90-6782-41cc-b462-d7e83fe48876 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:07.918292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16ba90-6782-41cc-b462-d7e83fe48876 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:07.923782 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 147/281] 10.222.0.30 () {56 vars in 1308 bytes} [Sun Sep 4 00:45:07 2022] GET /identity/v3/role_assignments?user.id=39672c7d7ff44bcba113bd71464cacc8&scope.system=all&role.id=7c1abe5c3a82479484ec5a104ec31f8f => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:08.030497 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1c320-8267-446c-8d11-3b693f0b4a66 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:08.136479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1c320-8267-446c-8d11-3b693f0b4a66 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:08.157086 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:08.171743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a656ddc-c685-4c4e-8009-41735d7ab884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:08.172385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a656ddc-c685-4c4e-8009-41735d7ab884 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:08.172665 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a656ddc-c685-4c4e-8009-41735d7ab884 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:08.172943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a656ddc-c685-4c4e-8009-41735d7ab884 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:08.184530 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a656ddc-c685-4c4e-8009-41735d7ab884 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:08.189378 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-9a656ddc-c685-4c4e-8009-41735d7ab884 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 04 00:45:08.189378 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:08.189378 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:08.189378 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:08.189378 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:08.189378 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:08.189378 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:08.189378 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:08.189378 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:08.189378 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:08.189378 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:08.189378 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:08.189378 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:08.189378 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:08.189378 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:08.189378 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:08.190274 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:08.190274 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:08.190274 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:08.190274 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:08.190274 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:08.190274 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:08.190274 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:08.190274 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:08.190274 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:08.190274 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:08.190274 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:08.190274 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:08.190274 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:08.190274 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:08.190274 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:08.190274 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:08.191034 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:08.191034 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:08.191034 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:08.191034 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:08.191034 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:08.191034 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:08.191034 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:08.191034 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:08.191034 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:08.191034 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:08.191034 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 04 00:45:08.191034 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:08.191034 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 135/282] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:45:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:08.196905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16ba90-6782-41cc-b462-d7e83fe48876 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:08.345185 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16ba90-6782-41cc-b462-d7e83fe48876 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:08.346797 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:08.383810 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85057b9f-1d71-430a-babc-04b3fc68d9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:08.384416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85057b9f-1d71-430a-babc-04b3fc68d9b2 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:08.384691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85057b9f-1d71-430a-babc-04b3fc68d9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:08.384958 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85057b9f-1d71-430a-babc-04b3fc68d9b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:08.385638 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85057b9f-1d71-430a-babc-04b3fc68d9b2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:08.385939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85057b9f-1d71-430a-babc-04b3fc68d9b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:08.387356 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85057b9f-1d71-430a-babc-04b3fc68d9b2 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:08.397248 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 148/283] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Sep 4 00:45:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:08.406546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a656ddc-c685-4c4e-8009-41735d7ab884 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:08.544371 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a656ddc-c685-4c4e-8009-41735d7ab884 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:08.584470 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce079fa-12fd-4c11-af22-5319dbda81e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:08.585374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce079fa-12fd-4c11-af22-5319dbda81e8 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:08.585824 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce079fa-12fd-4c11-af22-5319dbda81e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:08.586232 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce079fa-12fd-4c11-af22-5319dbda81e8 None admin] PATH_INFO: `/v3/users/0a985fa4ab7a45f4ad9c93e3b571d768` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:08.592205 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce079fa-12fd-4c11-af22-5319dbda81e8 None admin] RBAC: Authorizing `identity:get_user(user_id=0a985fa4ab7a45f4ad9c93e3b571d768)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:08.593847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce079fa-12fd-4c11-af22-5319dbda81e8 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:08.595903 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 136/284] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:45:08 2022] GET /identity/v3/users/0a985fa4ab7a45f4ad9c93e3b571d768 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:08.601044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85057b9f-1d71-430a-babc-04b3fc68d9b2 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:08.769046 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85057b9f-1d71-430a-babc-04b3fc68d9b2 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:08.819246 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec4822-3aed-4ceb-99bf-3dd51fc2dc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:08.819877 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec4822-3aed-4ceb-99bf-3dd51fc2dc65 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:08.820157 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec4822-3aed-4ceb-99bf-3dd51fc2dc65 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:08.820426 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec4822-3aed-4ceb-99bf-3dd51fc2dc65 None admin] PATH_INFO: `/v3/projects/904901a056914acebf292730fd309f87` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:08.826105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec4822-3aed-4ceb-99bf-3dd51fc2dc65 None admin] RBAC: Authorizing `identity:get_project(project_id=904901a056914acebf292730fd309f87)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:08.827606 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec4822-3aed-4ceb-99bf-3dd51fc2dc65 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:08.829545 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 149/285] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:45:08 2022] GET /identity/v3/projects/904901a056914acebf292730fd309f87 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:08.835696 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce079fa-12fd-4c11-af22-5319dbda81e8 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:08.911995 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:08.964837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce079fa-12fd-4c11-af22-5319dbda81e8 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:08.966946 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e233d-f4a9-4701-bcec-d4418243c4e6 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:08.967388 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e233d-f4a9-4701-bcec-d4418243c4e6 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:08.967547 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e233d-f4a9-4701-bcec-d4418243c4e6 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:08.968975 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 150/286] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:08.974341 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4fa97-cb00-4bed-a2a9-8b3741c1c22b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:08.974865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4fa97-cb00-4bed-a2a9-8b3741c1c22b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:08.975325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4fa97-cb00-4bed-a2a9-8b3741c1c22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:08.997070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-eab4fa97-cb00-4bed-a2a9-8b3741c1c22b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:08.998738 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-eab4fa97-cb00-4bed-a2a9-8b3741c1c22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:09.005767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d4cf6-adaf-450c-bfe1-59494bef61ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:09.006428 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d4cf6-adaf-450c-bfe1-59494bef61ad None admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:09.006704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d4cf6-adaf-450c-bfe1-59494bef61ad None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:09.007014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d4cf6-adaf-450c-bfe1-59494bef61ad None admin] PATH_INFO: `/v3/projects/904901a056914acebf292730fd309f87/users/0a985fa4ab7a45f4ad9c93e3b571d768/roles/9cf4680c808546e286e3a5c3383d98e1` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:09.009983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d4cf6-adaf-450c-bfe1-59494bef61ad None admin] RBAC: Authorizing `identity:create_grant(project_id=904901a056914acebf292730fd309f87, user_id=0a985fa4ab7a45f4ad9c93e3b571d768, role_id=9cf4680c808546e286e3a5c3383d98e1)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:09.011423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d4cf6-adaf-450c-bfe1-59494bef61ad None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:09.035720 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:09.038328 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 137/287] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Sep 4 00:45:08 2022] PUT /identity/v3/projects/904901a056914acebf292730fd309f87/users/0a985fa4ab7a45f4ad9c93e3b571d768/roles/9cf4680c808546e286e3a5c3383d98e1 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:45:09.127201 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 151/288] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 04 00:45:09.422539 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d4cf6-adaf-450c-bfe1-59494bef61ad None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:09.532769 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d4cf6-adaf-450c-bfe1-59494bef61ad None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:09.544883 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:09.574055 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976c7cd-344e-426a-90e9-1fb7669939df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:09.574737 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976c7cd-344e-426a-90e9-1fb7669939df None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:09.575014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976c7cd-344e-426a-90e9-1fb7669939df None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:09.575334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976c7cd-344e-426a-90e9-1fb7669939df None admin] PATH_INFO: `/v3/roles/member` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:09.585896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8976c7cd-344e-426a-90e9-1fb7669939df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:09.591183 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-8976c7cd-344e-426a-90e9-1fb7669939df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 04 00:45:09.591183 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:09.591183 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:09.591183 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:09.591183 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:09.591183 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:09.591183 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:09.591183 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:09.591183 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:09.591183 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:09.591183 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:09.591183 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:09.591183 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:09.591183 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:09.591183 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:09.591183 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:09.592050 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:09.592050 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:09.592050 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:09.592050 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:09.592050 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:09.592050 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:09.592050 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:09.592050 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:09.592050 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:09.592050 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:09.592050 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:09.592050 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:09.592050 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:09.592050 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:09.592050 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:09.592050 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:09.592827 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:09.592827 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:09.592827 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:09.592827 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:09.592827 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:09.592827 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:09.592827 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:09.592827 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:09.592827 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:09.592827 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:09.592827 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 04 00:45:09.592827 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:09.592827 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 138/289] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:45:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:09.598798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4fa97-cb00-4bed-a2a9-8b3741c1c22b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:09.725311 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4fa97-cb00-4bed-a2a9-8b3741c1c22b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:09.772440 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86165a7c-22cd-4aee-8ddb-c8c76a3dd691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:09.773051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86165a7c-22cd-4aee-8ddb-c8c76a3dd691 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:09.773333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86165a7c-22cd-4aee-8ddb-c8c76a3dd691 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:09.773632 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86165a7c-22cd-4aee-8ddb-c8c76a3dd691 None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:09.774819 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86165a7c-22cd-4aee-8ddb-c8c76a3dd691 None admin] RBAC: Adding query filter params (name=member) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:09.775122 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86165a7c-22cd-4aee-8ddb-c8c76a3dd691 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:09.776500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86165a7c-22cd-4aee-8ddb-c8c76a3dd691 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:09.789490 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 152/290] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Sep 4 00:45:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:09.795376 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976c7cd-344e-426a-90e9-1fb7669939df None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:09.975402 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976c7cd-344e-426a-90e9-1fb7669939df None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:10.024992 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24a2c6-caf1-4abc-9e2c-b5444a553cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:10.026009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24a2c6-caf1-4abc-9e2c-b5444a553cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:10.026504 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24a2c6-caf1-4abc-9e2c-b5444a553cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:10.026963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24a2c6-caf1-4abc-9e2c-b5444a553cf0 None admin] PATH_INFO: `/v3/users/8da58b06ae8c4f5bafeb218ef399cc81` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:10.034146 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24a2c6-caf1-4abc-9e2c-b5444a553cf0 None admin] RBAC: Authorizing `identity:get_user(user_id=8da58b06ae8c4f5bafeb218ef399cc81)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:10.035931 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24a2c6-caf1-4abc-9e2c-b5444a553cf0 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:10.038095 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 139/291] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:45:09 2022] GET /identity/v3/users/8da58b06ae8c4f5bafeb218ef399cc81 => generated 297 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:10.044187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86165a7c-22cd-4aee-8ddb-c8c76a3dd691 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:10.078742 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed750bd0-143f-4f0b-ac6a-3ddc4432d617 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:10.079376 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed750bd0-143f-4f0b-ac6a-3ddc4432d617 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:10.079842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed750bd0-143f-4f0b-ac6a-3ddc4432d617 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:10.081622 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 140/292] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:10.086021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7f7f1-3e31-44b0-af59-a6ec08f5de72 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:10.086504 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7f7f1-3e31-44b0-af59-a6ec08f5de72 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:10.087519 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7f7f1-3e31-44b0-af59-a6ec08f5de72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:10.093413 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:10.120308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-79b7f7f1-3e31-44b0-af59-a6ec08f5de72 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:10.123817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-79b7f7f1-3e31-44b0-af59-a6ec08f5de72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:10.189265 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:10.241947 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86165a7c-22cd-4aee-8ddb-c8c76a3dd691 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:10.259277 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 141/293] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:10.292863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeae343-b29e-4e23-ae98-220e02e530e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:10.293732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeae343-b29e-4e23-ae98-220e02e530e1 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:10.294175 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeae343-b29e-4e23-ae98-220e02e530e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:10.294584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeae343-b29e-4e23-ae98-220e02e530e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:10.306948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb6817-9014-443d-85ba-089f9af1d11e None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:10.308103 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb6817-9014-443d-85ba-089f9af1d11e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:10.308575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb6817-9014-443d-85ba-089f9af1d11e None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:10.310782 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 142/294] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 04 00:45:10.321983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa651c-05ca-4e4e-8798-fe54ac52f63c None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:10.322500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa651c-05ca-4e4e-8798-fe54ac52f63c None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:10.322971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa651c-05ca-4e4e-8798-fe54ac52f63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:10.356596 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-eafa651c-05ca-4e4e-8798-fe54ac52f63c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:10.357813 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-eafa651c-05ca-4e4e-8798-fe54ac52f63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:10.417852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeae343-b29e-4e23-ae98-220e02e530e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:10.419331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeae343-b29e-4e23-ae98-220e02e530e1 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:10.455977 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 143/295] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:10.456410 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:10.462847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9e31a-2c93-41be-a4e3-efa4019cdcf6 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:10.463169 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9e31a-2c93-41be-a4e3-efa4019cdcf6 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:10.463381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9e31a-2c93-41be-a4e3-efa4019cdcf6 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:10.464816 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 144/296] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:10.470716 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c1c67-215e-4ee3-8859-770ae47b57c7 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:10.470995 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c1c67-215e-4ee3-8859-770ae47b57c7 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:10.471267 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c1c67-215e-4ee3-8859-770ae47b57c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:10.514704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b48c1c67-215e-4ee3-8859-770ae47b57c7 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:10.515637 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b48c1c67-215e-4ee3-8859-770ae47b57c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:10.550606 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 153/297] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:45:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 04 00:45:10.551910 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeae343-b29e-4e23-ae98-220e02e530e1 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:10.606915 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 145/298] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:10.606915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c1c67-215e-4ee3-8859-770ae47b57c7 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:10.638966 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:10.678483 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeae343-b29e-4e23-ae98-220e02e530e1 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:10.705801 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:10.716667 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6022bf7-04f4-4bde-b648-80681d66682c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:10.717569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6022bf7-04f4-4bde-b648-80681d66682c None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:10.718041 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6022bf7-04f4-4bde-b648-80681d66682c None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:10.718616 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6022bf7-04f4-4bde-b648-80681d66682c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:10.729872 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6022bf7-04f4-4bde-b648-80681d66682c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:10.735692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-b6022bf7-04f4-4bde-b648-80681d66682c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 04 00:45:10.735692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:10.735692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:10.735692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:10.735692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:10.735692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:10.735692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:10.735692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:10.735692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:10.735692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:10.735692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:10.735692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:10.735692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:10.735692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:10.735692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:10.735692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:10.742068 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:10.742068 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:10.742068 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:10.742068 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:10.742068 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:10.742068 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:10.742068 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:10.742068 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:10.742068 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:10.742068 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:10.742068 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:10.742068 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:10.742068 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:10.742068 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:10.742068 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:10.742068 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:10.743359 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:10.743359 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:10.743359 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:10.743359 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:10.743359 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:10.743359 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:10.743359 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:10.743359 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:10.743359 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:10.743359 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:10.743359 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 04 00:45:10.743359 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:10.743359 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 154/299] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:45:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:10.746175 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6022bf7-04f4-4bde-b648-80681d66682c None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:10.778699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c1c67-215e-4ee3-8859-770ae47b57c7 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:10.831135 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0421c-412f-452c-a7c1-f13b17bc7ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:10.831765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0421c-412f-452c-a7c1-f13b17bc7ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:10.832043 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0421c-412f-452c-a7c1-f13b17bc7ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:10.832312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0421c-412f-452c-a7c1-f13b17bc7ae5 None admin] PATH_INFO: `/v3/projects/904901a056914acebf292730fd309f87` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:10.833965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0421c-412f-452c-a7c1-f13b17bc7ae5 None admin] RBAC: Authorizing `identity:get_project(project_id=904901a056914acebf292730fd309f87)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:10.835411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0421c-412f-452c-a7c1-f13b17bc7ae5 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:10.837217 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 146/300] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:45:10 2022] GET /identity/v3/projects/904901a056914acebf292730fd309f87 => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:10.837830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0421c-412f-452c-a7c1-f13b17bc7ae5 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:10.871680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6022bf7-04f4-4bde-b648-80681d66682c None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:10.915583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1dde6-e0d5-422b-9f65-2ab98bdd30b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:10.916941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1dde6-e0d5-422b-9f65-2ab98bdd30b4 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:10.917399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1dde6-e0d5-422b-9f65-2ab98bdd30b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:10.917917 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1dde6-e0d5-422b-9f65-2ab98bdd30b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:10.919106 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c1dde6-e0d5-422b-9f65-2ab98bdd30b4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:10.919579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c1dde6-e0d5-422b-9f65-2ab98bdd30b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:10.921751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c1dde6-e0d5-422b-9f65-2ab98bdd30b4 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:10.937680 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 155/301] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Sep 4 00:45:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:45:10.938721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1dde6-e0d5-422b-9f65-2ab98bdd30b4 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:10.940822 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:10.949900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0421c-412f-452c-a7c1-f13b17bc7ae5 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:10.990495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764f098-a80b-4907-96f4-11befe539054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:10.991291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764f098-a80b-4907-96f4-11befe539054 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:10.991568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764f098-a80b-4907-96f4-11befe539054 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:10.991836 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764f098-a80b-4907-96f4-11befe539054 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:10.992260 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:11.006176 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3764f098-a80b-4907-96f4-11befe539054 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:11.013121 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-3764f098-a80b-4907-96f4-11befe539054 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 04 00:45:11.013121 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:11.013121 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:11.013121 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:11.013121 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:11.013121 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:11.013121 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:11.013121 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:11.013121 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:11.013121 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:11.013121 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:11.013121 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:11.013121 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:11.013121 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:11.013121 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:11.013121 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:11.014019 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:11.014019 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:11.014019 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:11.014019 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:11.014019 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:11.014019 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:11.014019 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:11.014019 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:11.014019 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:11.014019 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:11.014019 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:11.014019 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:11.014019 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:11.014019 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:11.014019 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:11.014019 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:11.014799 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:11.014799 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:11.014799 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:11.014799 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:11.014799 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:11.014799 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:11.014799 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:11.014799 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:11.014799 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:11.014799 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:11.014799 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 04 00:45:11.014799 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:11.014799 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 147/302] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:45:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:11.015462 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764f098-a80b-4907-96f4-11befe539054 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:11.051710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1dde6-e0d5-422b-9f65-2ab98bdd30b4 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:11.084819 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b069dce-941f-437e-a010-adc6ffb7e429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:11.085463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b069dce-941f-437e-a010-adc6ffb7e429 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:11.085749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b069dce-941f-437e-a010-adc6ffb7e429 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:11.086022 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b069dce-941f-437e-a010-adc6ffb7e429 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:11.086734 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b069dce-941f-437e-a010-adc6ffb7e429 None admin] RBAC: Adding query filter params (role.id=7c1abe5c3a82479484ec5a104ec31f8f, scope.project.id=904901a056914acebf292730fd309f87, user.id=8da58b06ae8c4f5bafeb218ef399cc81) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:11.087040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b069dce-941f-437e-a010-adc6ffb7e429 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:11.088457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b069dce-941f-437e-a010-adc6ffb7e429 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:11.101470 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 156/303] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:45:10 2022] GET /identity/v3/role_assignments?user.id=8da58b06ae8c4f5bafeb218ef399cc81&scope.project.id=904901a056914acebf292730fd309f87&role.id=7c1abe5c3a82479484ec5a104ec31f8f => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:11.101470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b069dce-941f-437e-a010-adc6ffb7e429 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:11.136028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764f098-a80b-4907-96f4-11befe539054 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:11.186342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0d59f-3eb6-411f-af90-35f5d09ed7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:11.187213 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0d59f-3eb6-411f-af90-35f5d09ed7d7 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:11.187565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0d59f-3eb6-411f-af90-35f5d09ed7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:11.187912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0d59f-3eb6-411f-af90-35f5d09ed7d7 None admin] PATH_INFO: `/v3/users/071b9c00ea7e492fa4ea405adc06eaa0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:11.204767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0d59f-3eb6-411f-af90-35f5d09ed7d7 None admin] RBAC: Authorizing `identity:get_user(user_id=071b9c00ea7e492fa4ea405adc06eaa0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:11.206439 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0d59f-3eb6-411f-af90-35f5d09ed7d7 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:11.208369 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 148/304] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:45:11 2022] GET /identity/v3/users/071b9c00ea7e492fa4ea405adc06eaa0 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:11.209235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0d59f-3eb6-411f-af90-35f5d09ed7d7 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:11.219792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b069dce-941f-437e-a010-adc6ffb7e429 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:11.226503 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:11.232710 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:11.259163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f6211-dfce-4695-8668-13b6853599cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:11.259793 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f6211-dfce-4695-8668-13b6853599cb None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:11.260069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f6211-dfce-4695-8668-13b6853599cb None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:11.260339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f6211-dfce-4695-8668-13b6853599cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:11.261479 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f6211-dfce-4695-8668-13b6853599cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:11.262938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f6211-dfce-4695-8668-13b6853599cb None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:11.264655 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 157/305] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:11.265244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f6211-dfce-4695-8668-13b6853599cb None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:11.335176 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0d59f-3eb6-411f-af90-35f5d09ed7d7 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:11.376013 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75317baa-7da5-4172-b470-0763a453fb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:11.376684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75317baa-7da5-4172-b470-0763a453fb7a None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:11.376971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75317baa-7da5-4172-b470-0763a453fb7a None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:11.377243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75317baa-7da5-4172-b470-0763a453fb7a None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:11.377946 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75317baa-7da5-4172-b470-0763a453fb7a None admin] RBAC: Adding query filter params (name=member) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:11.378247 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75317baa-7da5-4172-b470-0763a453fb7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:11.379624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75317baa-7da5-4172-b470-0763a453fb7a None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:11.383907 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f6211-dfce-4695-8668-13b6853599cb None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:11.388156 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 149/306] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Sep 4 00:45:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:11.388749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75317baa-7da5-4172-b470-0763a453fb7a None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:11.423720 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13a7e9-0bdb-4aab-b6ab-a6911e0f32ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:11.424607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13a7e9-0bdb-4aab-b6ab-a6911e0f32ad None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:11.425061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13a7e9-0bdb-4aab-b6ab-a6911e0f32ad None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:11.425539 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13a7e9-0bdb-4aab-b6ab-a6911e0f32ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:11.426257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13a7e9-0bdb-4aab-b6ab-a6911e0f32ad None admin] RBAC: Adding query filter params (role.id=9cf4680c808546e286e3a5c3383d98e1, user.id=071b9c00ea7e492fa4ea405adc06eaa0, scope.system=all) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:11.426572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13a7e9-0bdb-4aab-b6ab-a6911e0f32ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:11.427991 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13a7e9-0bdb-4aab-b6ab-a6911e0f32ad None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:11.433316 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 158/307] 10.222.0.30 () {56 vars in 1308 bytes} [Sun Sep 4 00:45:11 2022] GET /identity/v3/role_assignments?user.id=071b9c00ea7e492fa4ea405adc06eaa0&scope.system=all&role.id=9cf4680c808546e286e3a5c3383d98e1 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:11.442878 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13a7e9-0bdb-4aab-b6ab-a6911e0f32ad None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:11.476841 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:11.501592 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:11.506844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75317baa-7da5-4172-b470-0763a453fb7a None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:11.551732 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5dabe-3fc0-4f7a-a6e0-0e2b671df73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:11.552433 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5dabe-3fc0-4f7a-a6e0-0e2b671df73a None admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:11.552724 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5dabe-3fc0-4f7a-a6e0-0e2b671df73a None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:11.552984 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5dabe-3fc0-4f7a-a6e0-0e2b671df73a None admin] PATH_INFO: `/v3/groups` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:11.554246 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5dabe-3fc0-4f7a-a6e0-0e2b671df73a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:11.556083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5dabe-3fc0-4f7a-a6e0-0e2b671df73a None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:11.565999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13a7e9-0bdb-4aab-b6ab-a6911e0f32ad None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:11.585751 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 150/308] 10.222.0.30 () {60 vars in 1134 bytes} [Sun Sep 4 00:45:11 2022] POST /identity/v3/groups => generated 229 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:45:11.587832 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405190a-38ca-4b74-a817-4a806e08ceeb None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:11.588119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405190a-38ca-4b74-a817-4a806e08ceeb None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:11.588385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405190a-38ca-4b74-a817-4a806e08ceeb None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:11.589795 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 151/309] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:11.596538 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e5c27-664e-43fe-9818-5591adf612c4 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:11.596821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e5c27-664e-43fe-9818-5591adf612c4 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:11.597096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e5c27-664e-43fe-9818-5591adf612c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:11.616316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c6f42-5b81-43cb-a350-67ab2ad18334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:11.617240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c6f42-5b81-43cb-a350-67ab2ad18334 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:11.619467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c6f42-5b81-43cb-a350-67ab2ad18334 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:11.619822 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c6f42-5b81-43cb-a350-67ab2ad18334 None admin] PATH_INFO: `/v3/users/39672c7d7ff44bcba113bd71464cacc8` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:11.621203 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c6f42-5b81-43cb-a350-67ab2ad18334 None admin] RBAC: Authorizing `identity:get_user(user_id=39672c7d7ff44bcba113bd71464cacc8)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:11.622549 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a52e5c27-664e-43fe-9818-5591adf612c4 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:11.622878 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c6f42-5b81-43cb-a350-67ab2ad18334 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:11.624246 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a52e5c27-664e-43fe-9818-5591adf612c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:11.624677 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 159/310] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:45:11 2022] GET /identity/v3/users/39672c7d7ff44bcba113bd71464cacc8 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:11.631392 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c6f42-5b81-43cb-a350-67ab2ad18334 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:11.724607 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 152/311] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:11.765377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c6f42-5b81-43cb-a350-67ab2ad18334 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:11.777345 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:11.802274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26733832-8eb1-4e00-b848-66301e86a445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:11.802931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26733832-8eb1-4e00-b848-66301e86a445 None admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:11.803209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26733832-8eb1-4e00-b848-66301e86a445 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:11.803478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26733832-8eb1-4e00-b848-66301e86a445 None admin] PATH_INFO: `/v3/system/users/39672c7d7ff44bcba113bd71464cacc8/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:11.804876 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26733832-8eb1-4e00-b848-66301e86a445 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=39672c7d7ff44bcba113bd71464cacc8, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:11.806370 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26733832-8eb1-4e00-b848-66301e86a445 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:11.817807 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 160/312] 10.222.0.30 () {58 vars in 1334 bytes} [Sun Sep 4 00:45:11 2022] PUT /identity/v3/system/users/39672c7d7ff44bcba113bd71464cacc8/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 00:45:12.015246 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e5c27-664e-43fe-9818-5591adf612c4 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:12.078940 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:12.121914 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e5c27-664e-43fe-9818-5591adf612c4 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:12.157480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e834a79-3cfc-4138-a3ed-ceab64910f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:12.158099 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e834a79-3cfc-4138-a3ed-ceab64910f59 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:12.158379 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e834a79-3cfc-4138-a3ed-ceab64910f59 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:12.158652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e834a79-3cfc-4138-a3ed-ceab64910f59 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:12.169187 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e834a79-3cfc-4138-a3ed-ceab64910f59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:12.174486 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-0e834a79-3cfc-4138-a3ed-ceab64910f59 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 04 00:45:12.174486 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:12.174486 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:12.174486 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:12.174486 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:12.174486 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:12.174486 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:12.174486 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:12.174486 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:12.174486 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:12.174486 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:12.174486 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:12.174486 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:12.174486 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:12.174486 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:12.174486 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:12.175369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:12.175369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:12.175369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:12.175369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:12.175369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:12.175369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:12.175369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:12.175369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:12.175369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:12.175369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:12.175369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:12.175369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:12.175369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:12.175369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:12.175369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:12.175369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:12.176152 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:12.176152 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:12.176152 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:12.176152 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:12.176152 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:12.176152 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:12.176152 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:12.176152 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:12.176152 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:12.176152 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:12.176152 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 04 00:45:12.176152 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:12.176152 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 153/313] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:45:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:12.182587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26733832-8eb1-4e00-b848-66301e86a445 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:12.282755 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26733832-8eb1-4e00-b848-66301e86a445 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:12.317123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a64ca7-1cf6-48bd-9d2d-408199769454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:12.317807 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a64ca7-1cf6-48bd-9d2d-408199769454 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:12.318082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a64ca7-1cf6-48bd-9d2d-408199769454 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:12.318353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a64ca7-1cf6-48bd-9d2d-408199769454 None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:12.319007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a64ca7-1cf6-48bd-9d2d-408199769454 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:12.319308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a64ca7-1cf6-48bd-9d2d-408199769454 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:12.320680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a64ca7-1cf6-48bd-9d2d-408199769454 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:12.329947 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 161/314] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Sep 4 00:45:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:12.338778 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e834a79-3cfc-4138-a3ed-ceab64910f59 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:12.449590 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e834a79-3cfc-4138-a3ed-ceab64910f59 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:12.473640 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:12.488715 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9ed90-ca08-4b6a-ae06-4a32585591e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:12.489408 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9ed90-ca08-4b6a-ae06-4a32585591e3 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:12.489652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9ed90-ca08-4b6a-ae06-4a32585591e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:12.489926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9ed90-ca08-4b6a-ae06-4a32585591e3 None admin] PATH_INFO: `/v3/users/0a985fa4ab7a45f4ad9c93e3b571d768` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:12.491060 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9ed90-ca08-4b6a-ae06-4a32585591e3 None admin] RBAC: Authorizing `identity:get_user(user_id=0a985fa4ab7a45f4ad9c93e3b571d768)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:12.492520 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9ed90-ca08-4b6a-ae06-4a32585591e3 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:12.494672 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 154/315] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:45:12 2022] GET /identity/v3/users/0a985fa4ab7a45f4ad9c93e3b571d768 => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:12.500460 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a64ca7-1cf6-48bd-9d2d-408199769454 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:12.536739 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:12.611594 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a64ca7-1cf6-48bd-9d2d-408199769454 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:12.646047 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65867c1b-2dbb-4b9a-921b-43147bf59680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:12.646907 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65867c1b-2dbb-4b9a-921b-43147bf59680 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:12.647411 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65867c1b-2dbb-4b9a-921b-43147bf59680 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:12.647871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65867c1b-2dbb-4b9a-921b-43147bf59680 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:12.715648 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65867c1b-2dbb-4b9a-921b-43147bf59680 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:12.717575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65867c1b-2dbb-4b9a-921b-43147bf59680 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:12.753293 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:12.821749 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 162/316] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:45:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 04 00:45:12.827759 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9ed90-ca08-4b6a-ae06-4a32585591e3 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:12.932406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9ed90-ca08-4b6a-ae06-4a32585591e3 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:12.967978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4510e9c-2e6d-46ec-9753-b4cb65464b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:12.969049 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4510e9c-2e6d-46ec-9753-b4cb65464b16 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:12.969566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4510e9c-2e6d-46ec-9753-b4cb65464b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:12.970043 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4510e9c-2e6d-46ec-9753-b4cb65464b16 None admin] PATH_INFO: `/v3/projects/904901a056914acebf292730fd309f87` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:12.971551 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4510e9c-2e6d-46ec-9753-b4cb65464b16 None admin] RBAC: Authorizing `identity:get_project(project_id=904901a056914acebf292730fd309f87)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:12.973313 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4510e9c-2e6d-46ec-9753-b4cb65464b16 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:12.980944 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 155/317] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:45:12 2022] GET /identity/v3/projects/904901a056914acebf292730fd309f87 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:12.982633 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65867c1b-2dbb-4b9a-921b-43147bf59680 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:13.096508 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65867c1b-2dbb-4b9a-921b-43147bf59680 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:13.140117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8852825-73e2-40bb-a3be-50dba3139523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:13.140726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8852825-73e2-40bb-a3be-50dba3139523 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:13.141002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8852825-73e2-40bb-a3be-50dba3139523 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:13.141274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8852825-73e2-40bb-a3be-50dba3139523 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:13.142027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8852825-73e2-40bb-a3be-50dba3139523 None admin] RBAC: Adding query filter params (role.id=9cf4680c808546e286e3a5c3383d98e1, scope.project.id=904901a056914acebf292730fd309f87, user.id=0a985fa4ab7a45f4ad9c93e3b571d768) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:13.142331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8852825-73e2-40bb-a3be-50dba3139523 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:13.143751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8852825-73e2-40bb-a3be-50dba3139523 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:13.146511 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:13.150669 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 163/318] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:45:12 2022] GET /identity/v3/role_assignments?user.id=0a985fa4ab7a45f4ad9c93e3b571d768&scope.project.id=904901a056914acebf292730fd309f87&role.id=9cf4680c808546e286e3a5c3383d98e1 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:13.383304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091bffa-e330-443d-9cf9-779798321416 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:13.384176 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091bffa-e330-443d-9cf9-779798321416 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:13.384382 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091bffa-e330-443d-9cf9-779798321416 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:13.385934 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 156/319] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 04 00:45:13.390939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b657057-bc4d-4c39-9214-3bce26a18d83 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:13.391404 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b657057-bc4d-4c39-9214-3bce26a18d83 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:13.391476 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b657057-bc4d-4c39-9214-3bce26a18d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:13.409958 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-4b657057-bc4d-4c39-9214-3bce26a18d83 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:13.411127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4b657057-bc4d-4c39-9214-3bce26a18d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:13.489472 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 164/320] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:13.639375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058911c-fa3e-4724-8b8f-f0ee2ef1450f None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:13.639854 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058911c-fa3e-4724-8b8f-f0ee2ef1450f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:13.639854 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058911c-fa3e-4724-8b8f-f0ee2ef1450f None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:13.641311 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 157/321] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:13.646121 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca35d1c-7e6d-4f01-b7ea-8c4878040f39 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:13.646402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca35d1c-7e6d-4f01-b7ea-8c4878040f39 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:13.646669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca35d1c-7e6d-4f01-b7ea-8c4878040f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:13.664240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-cca35d1c-7e6d-4f01-b7ea-8c4878040f39 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:13.665424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-cca35d1c-7e6d-4f01-b7ea-8c4878040f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:13.733362 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 165/322] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:13.755765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058911c-fa3e-4724-8b8f-f0ee2ef1450f None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:13.816296 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:13.848102 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc9cea-38ab-4bc7-9987-486919840cdb None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:13.848386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc9cea-38ab-4bc7-9987-486919840cdb None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:13.848668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc9cea-38ab-4bc7-9987-486919840cdb None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:13.850302 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 166/323] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 04 00:45:13.855931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e878359-ad0f-4e51-89cc-bdcfff563e8b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:13.856212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e878359-ad0f-4e51-89cc-bdcfff563e8b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:13.856642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e878359-ad0f-4e51-89cc-bdcfff563e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:13.861180 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058911c-fa3e-4724-8b8f-f0ee2ef1450f None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:13.877879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-6e878359-ad0f-4e51-89cc-bdcfff563e8b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:13.879692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6e878359-ad0f-4e51-89cc-bdcfff563e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:13.898547 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92657436-dfe5-48a9-97c0-985263e3bb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:13.899036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92657436-dfe5-48a9-97c0-985263e3bb29 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:13.899317 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92657436-dfe5-48a9-97c0-985263e3bb29 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:13.899593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92657436-dfe5-48a9-97c0-985263e3bb29 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:13.909687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92657436-dfe5-48a9-97c0-985263e3bb29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:13.914451 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-92657436-dfe5-48a9-97c0-985263e3bb29 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 04 00:45:13.914451 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:13.914451 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:13.914451 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:13.914451 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:13.914451 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:13.914451 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:13.914451 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:13.914451 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:13.914451 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:13.914451 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:13.914451 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:13.914451 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:13.914451 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:13.914451 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:13.914451 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:13.915849 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:13.915849 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:13.915849 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:13.915849 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:13.915849 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:13.915849 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:13.915849 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:13.915849 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:13.915849 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:13.915849 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:13.915849 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:13.915849 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:13.915849 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:13.915849 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:13.915849 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:13.915849 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:13.916626 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:13.916626 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:13.916626 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:13.916626 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:13.916626 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:13.916626 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:13.916626 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:13.916626 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:13.916626 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:13.916626 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:13.916626 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 04 00:45:13.916626 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:13.916626 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 158/324] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:45:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:13.921925 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92657436-dfe5-48a9-97c0-985263e3bb29 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:13.944004 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:13.955168 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 167/325] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:13.999396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e878359-ad0f-4e51-89cc-bdcfff563e8b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:14.026865 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92657436-dfe5-48a9-97c0-985263e3bb29 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:14.048518 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:14.065097 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49bfe6-ec78-48eb-9e0a-081aa50db2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:14.065990 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49bfe6-ec78-48eb-9e0a-081aa50db2d2 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:14.066463 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49bfe6-ec78-48eb-9e0a-081aa50db2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:14.066948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49bfe6-ec78-48eb-9e0a-081aa50db2d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:14.067799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b49bfe6-ec78-48eb-9e0a-081aa50db2d2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:14.068292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b49bfe6-ec78-48eb-9e0a-081aa50db2d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:14.069855 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b49bfe6-ec78-48eb-9e0a-081aa50db2d2 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:14.079107 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 159/326] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Sep 4 00:45:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:45:14.086323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49bfe6-ec78-48eb-9e0a-081aa50db2d2 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:14.107499 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e878359-ad0f-4e51-89cc-bdcfff563e8b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:14.143313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c7f24-f0c7-4c5f-bae7-268913d3aaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:14.144575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c7f24-f0c7-4c5f-bae7-268913d3aaed None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:14.145285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c7f24-f0c7-4c5f-bae7-268913d3aaed None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:14.145807 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c7f24-f0c7-4c5f-bae7-268913d3aaed None admin] PATH_INFO: `/v3/domains/default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:14.147539 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c7f24-f0c7-4c5f-bae7-268913d3aaed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:14.149648 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c7f24-f0c7-4c5f-bae7-268913d3aaed None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:14.156020 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 168/327] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:45:14.157204 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c7f24-f0c7-4c5f-bae7-268913d3aaed None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:14.197807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49bfe6-ec78-48eb-9e0a-081aa50db2d2 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:14.217809 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:14.233228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3ec4a-f9bd-42e8-9c44-c68f1b475808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:14.233885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3ec4a-f9bd-42e8-9c44-c68f1b475808 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:14.234429 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3ec4a-f9bd-42e8-9c44-c68f1b475808 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:14.234701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3ec4a-f9bd-42e8-9c44-c68f1b475808 None admin] PATH_INFO: `/v3/users/071b9c00ea7e492fa4ea405adc06eaa0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:14.235815 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc3ec4a-f9bd-42e8-9c44-c68f1b475808 None admin] RBAC: Authorizing `identity:get_user(user_id=071b9c00ea7e492fa4ea405adc06eaa0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:14.237251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc3ec4a-f9bd-42e8-9c44-c68f1b475808 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:14.238842 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 160/328] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:45:14 2022] GET /identity/v3/users/071b9c00ea7e492fa4ea405adc06eaa0 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:14.239581 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3ec4a-f9bd-42e8-9c44-c68f1b475808 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:14.263782 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c7f24-f0c7-4c5f-bae7-268913d3aaed None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:14.288407 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:14.297337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a7eb16-6a3d-4557-ab18-41adfd2209eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:14.297968 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7eb16-6a3d-4557-ab18-41adfd2209eb None admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:14.298251 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7eb16-6a3d-4557-ab18-41adfd2209eb None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:14.298524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7eb16-6a3d-4557-ab18-41adfd2209eb None admin] PATH_INFO: `/v3/groups` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:14.299152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a7eb16-6a3d-4557-ab18-41adfd2209eb None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:14.300593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a7eb16-6a3d-4557-ab18-41adfd2209eb None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:14.316071 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 169/329] 10.222.0.30 () {60 vars in 1134 bytes} [Sun Sep 4 00:45:14 2022] POST /identity/v3/groups => generated 226 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:45:14.317087 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a7eb16-6a3d-4557-ab18-41adfd2209eb None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:14.342699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3ec4a-f9bd-42e8-9c44-c68f1b475808 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:14.383126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe86f0-a442-4944-a4ea-d36b27bd0082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:14.383901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe86f0-a442-4944-a4ea-d36b27bd0082 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:14.384187 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe86f0-a442-4944-a4ea-d36b27bd0082 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:14.384461 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe86f0-a442-4944-a4ea-d36b27bd0082 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:14.396938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe86f0-a442-4944-a4ea-d36b27bd0082 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:14.406407 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-63fe86f0-a442-4944-a4ea-d36b27bd0082 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 04 00:45:14.406407 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:14.406407 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:14.406407 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:14.406407 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:14.406407 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:14.406407 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:14.406407 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:14.406407 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:14.406407 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:14.406407 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:14.406407 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:14.406407 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:14.406407 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:14.406407 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:14.406407 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:14.407335 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:14.407335 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:14.407335 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:14.407335 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:14.407335 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:14.407335 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:14.407335 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:14.407335 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:14.407335 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:14.407335 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:14.407335 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:14.407335 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:14.407335 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:14.407335 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:14.407335 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:14.407335 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:14.408153 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:14.408153 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:14.408153 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:14.408153 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:14.408153 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:14.408153 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:14.408153 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:14.408153 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:14.408153 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:14.408153 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:14.408153 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 04 00:45:14.408153 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:14.408153 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 161/330] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:45:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:14.416381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe86f0-a442-4944-a4ea-d36b27bd0082 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:14.467212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a7eb16-6a3d-4557-ab18-41adfd2209eb None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:14.486933 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:14.506494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f98f87-6434-47ed-badb-c373b9dc93fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:14.507156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f98f87-6434-47ed-badb-c373b9dc93fa None admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:14.507434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f98f87-6434-47ed-badb-c373b9dc93fa None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:14.507705 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f98f87-6434-47ed-badb-c373b9dc93fa None admin] PATH_INFO: `/v3/system/users/071b9c00ea7e492fa4ea405adc06eaa0/roles/9cf4680c808546e286e3a5c3383d98e1` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:14.509169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f98f87-6434-47ed-badb-c373b9dc93fa None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=071b9c00ea7e492fa4ea405adc06eaa0, role_id=9cf4680c808546e286e3a5c3383d98e1)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:14.510716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f98f87-6434-47ed-badb-c373b9dc93fa None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:14.520324 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 170/331] 10.222.0.30 () {58 vars in 1334 bytes} [Sun Sep 4 00:45:14 2022] PUT /identity/v3/system/users/071b9c00ea7e492fa4ea405adc06eaa0/roles/9cf4680c808546e286e3a5c3383d98e1 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:45:14.565521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe86f0-a442-4944-a4ea-d36b27bd0082 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:14.579757 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:14.609847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2834ba-1136-470b-89ca-241fd4b0a4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:14.610709 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2834ba-1136-470b-89ca-241fd4b0a4d2 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:14.610994 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2834ba-1136-470b-89ca-241fd4b0a4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:14.611265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2834ba-1136-470b-89ca-241fd4b0a4d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:14.611951 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2834ba-1136-470b-89ca-241fd4b0a4d2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:14.612254 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2834ba-1136-470b-89ca-241fd4b0a4d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:14.613690 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2834ba-1136-470b-89ca-241fd4b0a4d2 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:14.627970 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 162/332] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Sep 4 00:45:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:45:14.629426 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f98f87-6434-47ed-badb-c373b9dc93fa None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:14.744589 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f98f87-6434-47ed-badb-c373b9dc93fa None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:14.780342 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd439883-341c-4044-aac4-3b46b8c1362e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:14.780989 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd439883-341c-4044-aac4-3b46b8c1362e None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:14.781352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd439883-341c-4044-aac4-3b46b8c1362e None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:14.781586 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd439883-341c-4044-aac4-3b46b8c1362e None admin] PATH_INFO: `/v3/users/39672c7d7ff44bcba113bd71464cacc8` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:14.782744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd439883-341c-4044-aac4-3b46b8c1362e None admin] RBAC: Authorizing `identity:get_user(user_id=39672c7d7ff44bcba113bd71464cacc8)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:14.784445 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd439883-341c-4044-aac4-3b46b8c1362e None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:14.786124 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 171/333] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:45:14 2022] GET /identity/v3/users/39672c7d7ff44bcba113bd71464cacc8 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:14.792307 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2834ba-1136-470b-89ca-241fd4b0a4d2 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:14.901245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2834ba-1136-470b-89ca-241fd4b0a4d2 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:14.936276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7e8d7-19e0-477c-b5f2-be0c7b4dff70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:14.936877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7e8d7-19e0-477c-b5f2-be0c7b4dff70 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:14.937151 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7e8d7-19e0-477c-b5f2-be0c7b4dff70 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:14.937414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7e8d7-19e0-477c-b5f2-be0c7b4dff70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:14.938163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7e8d7-19e0-477c-b5f2-be0c7b4dff70 None admin] RBAC: Adding query filter params (role.id=7c1abe5c3a82479484ec5a104ec31f8f, user.id=39672c7d7ff44bcba113bd71464cacc8, scope.system=all) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:14.938464 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7e8d7-19e0-477c-b5f2-be0c7b4dff70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:14.939895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7e8d7-19e0-477c-b5f2-be0c7b4dff70 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:14.953743 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 163/334] 10.222.0.30 () {56 vars in 1308 bytes} [Sun Sep 4 00:45:14 2022] GET /identity/v3/role_assignments?user.id=39672c7d7ff44bcba113bd71464cacc8&scope.system=all&role.id=7c1abe5c3a82479484ec5a104ec31f8f => generated 510 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:16.573285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013c81e-6ac0-4a42-9e7c-2c2e9604d67f None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:16.574330 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013c81e-6ac0-4a42-9e7c-2c2e9604d67f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:16.574822 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013c81e-6ac0-4a42-9e7c-2c2e9604d67f None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:16.576595 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 172/335] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:16.581580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b4f7a-7829-4a74-8de9-676426f8432e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:16.582396 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b4f7a-7829-4a74-8de9-676426f8432e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:16.582862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b4f7a-7829-4a74-8de9-676426f8432e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:16.610429 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a14b4f7a-7829-4a74-8de9-676426f8432e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:16.611944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a14b4f7a-7829-4a74-8de9-676426f8432e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:16.638397 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:16.685073 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 164/336] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:16.860165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221af63-2258-4701-80c7-80b84b861c8d None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:16.860829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221af63-2258-4701-80c7-80b84b861c8d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:16.861296 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221af63-2258-4701-80c7-80b84b861c8d None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:16.862850 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 173/337] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:16.868930 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aeb560-9e02-4a7c-a9da-6f1598eb1638 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:16.869486 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aeb560-9e02-4a7c-a9da-6f1598eb1638 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:16.869954 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aeb560-9e02-4a7c-a9da-6f1598eb1638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:16.898505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a6aeb560-9e02-4a7c-a9da-6f1598eb1638 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:16.900071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a6aeb560-9e02-4a7c-a9da-6f1598eb1638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:16.971787 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 165/338] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:17.011749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e766bac-a384-4827-80fd-fe3f1738f31f None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:17.012386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e766bac-a384-4827-80fd-fe3f1738f31f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:17.012851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e766bac-a384-4827-80fd-fe3f1738f31f None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:17.014423 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 174/339] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:17.019876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79380bdb-6b99-42fa-9c6c-0bd8a6c2fab5 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:17.020409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79380bdb-6b99-42fa-9c6c-0bd8a6c2fab5 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:17.020897 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79380bdb-6b99-42fa-9c6c-0bd8a6c2fab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:17.039349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-79380bdb-6b99-42fa-9c6c-0bd8a6c2fab5 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:17.041329 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-79380bdb-6b99-42fa-9c6c-0bd8a6c2fab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:17.112722 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 166/340] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:17.145905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e766bac-a384-4827-80fd-fe3f1738f31f None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:17.209883 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:17.273685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e766bac-a384-4827-80fd-fe3f1738f31f None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:17.313184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d40be1-261f-4071-8bdb-408c1a73cedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:17.314236 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d40be1-261f-4071-8bdb-408c1a73cedb None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:17.314707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d40be1-261f-4071-8bdb-408c1a73cedb None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:17.315219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d40be1-261f-4071-8bdb-408c1a73cedb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:17.327024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d40be1-261f-4071-8bdb-408c1a73cedb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:17.332230 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-f5d40be1-261f-4071-8bdb-408c1a73cedb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 04 00:45:17.332230 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:17.332230 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:17.332230 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:17.332230 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:17.332230 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:17.332230 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:17.332230 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:17.332230 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:17.332230 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:17.332230 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:17.332230 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:17.332230 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:17.332230 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:17.332230 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:17.332230 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:17.333123 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:17.333123 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:17.333123 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:17.333123 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:17.333123 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:17.333123 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:17.333123 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:17.333123 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:17.333123 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:17.333123 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:17.333123 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:17.333123 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:17.333123 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:17.333123 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:17.333123 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:17.333123 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:17.333943 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:17.333943 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:17.333943 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:17.333943 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:17.333943 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:17.333943 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:17.333943 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:17.333943 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:17.333943 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:17.333943 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:17.333943 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 04 00:45:17.333943 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:17.336183 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 175/341] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:45:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:17.342438 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79380bdb-6b99-42fa-9c6c-0bd8a6c2fab5 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:17.347061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d40be1-261f-4071-8bdb-408c1a73cedb None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:17.375015 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:17.506842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79380bdb-6b99-42fa-9c6c-0bd8a6c2fab5 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:17.553903 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d40be1-261f-4071-8bdb-408c1a73cedb None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:17.569472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b578d68-e407-4aa7-99aa-b0bc2921161a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:17.569472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b578d68-e407-4aa7-99aa-b0bc2921161a None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:17.569472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b578d68-e407-4aa7-99aa-b0bc2921161a None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:17.569472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b578d68-e407-4aa7-99aa-b0bc2921161a None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:17.569826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b578d68-e407-4aa7-99aa-b0bc2921161a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:17.569826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b578d68-e407-4aa7-99aa-b0bc2921161a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:17.569826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b578d68-e407-4aa7-99aa-b0bc2921161a None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:17.571609 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:17.579943 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 167/342] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Sep 4 00:45:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:17.584512 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b578d68-e407-4aa7-99aa-b0bc2921161a None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:17.615537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e48ca-7e25-4895-a342-7304f4519463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:17.616856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e48ca-7e25-4895-a342-7304f4519463 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:17.617338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e48ca-7e25-4895-a342-7304f4519463 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:17.618138 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e48ca-7e25-4895-a342-7304f4519463 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:17.639988 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e48ca-7e25-4895-a342-7304f4519463 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:17.645296 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-5d5e48ca-7e25-4895-a342-7304f4519463 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 04 00:45:17.645296 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:17.645296 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:17.645296 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:17.645296 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:17.645296 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:17.645296 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:17.645296 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:17.645296 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:17.645296 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:17.645296 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:17.645296 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:17.645296 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:17.645296 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:17.645296 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:17.645296 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:17.650434 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:17.650434 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:17.650434 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:17.650434 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:17.650434 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:17.650434 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:17.650434 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:17.650434 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:17.650434 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:17.650434 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:17.650434 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:17.650434 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:17.650434 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:17.650434 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:17.650434 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:17.650434 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:17.651230 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:17.651230 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:17.651230 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:17.651230 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:17.651230 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:17.651230 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:17.651230 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:17.651230 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:17.651230 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:17.651230 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:17.651230 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 04 00:45:17.651230 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:17.653471 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 176/343] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:45:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:17.659194 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e48ca-7e25-4895-a342-7304f4519463 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:17.699503 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:17.722620 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b578d68-e407-4aa7-99aa-b0bc2921161a None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:17.760714 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48824e-989b-4b43-84e4-ad1dbf1d0ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:17.761421 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48824e-989b-4b43-84e4-ad1dbf1d0ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:17.761714 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48824e-989b-4b43-84e4-ad1dbf1d0ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:17.761983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48824e-989b-4b43-84e4-ad1dbf1d0ea6 None admin] PATH_INFO: `/v3/users/071b9c00ea7e492fa4ea405adc06eaa0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:17.763222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48824e-989b-4b43-84e4-ad1dbf1d0ea6 None admin] RBAC: Authorizing `identity:get_user(user_id=071b9c00ea7e492fa4ea405adc06eaa0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:17.764717 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48824e-989b-4b43-84e4-ad1dbf1d0ea6 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:17.766311 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 168/344] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:45:17 2022] GET /identity/v3/users/071b9c00ea7e492fa4ea405adc06eaa0 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:45:17.772276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48824e-989b-4b43-84e4-ad1dbf1d0ea6 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:17.803425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e48ca-7e25-4895-a342-7304f4519463 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:17.855661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40ab54-fea9-44bd-b2d0-d53a10f43447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:17.856883 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40ab54-fea9-44bd-b2d0-d53a10f43447 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:17.857308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40ab54-fea9-44bd-b2d0-d53a10f43447 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:17.858072 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40ab54-fea9-44bd-b2d0-d53a10f43447 None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:17.859438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40ab54-fea9-44bd-b2d0-d53a10f43447 None admin] RBAC: Adding query filter params (name=member) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:17.859908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40ab54-fea9-44bd-b2d0-d53a10f43447 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:17.861981 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40ab54-fea9-44bd-b2d0-d53a10f43447 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:17.872763 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 177/345] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Sep 4 00:45:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:45:17.874180 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40ab54-fea9-44bd-b2d0-d53a10f43447 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:17.881957 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48824e-989b-4b43-84e4-ad1dbf1d0ea6 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:17.917845 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:17.947809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f49336-663c-4288-833c-e80cf221ca82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:17.948436 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f49336-663c-4288-833c-e80cf221ca82 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:17.948716 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f49336-663c-4288-833c-e80cf221ca82 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:17.948985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f49336-663c-4288-833c-e80cf221ca82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:17.949792 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f49336-663c-4288-833c-e80cf221ca82 None admin] RBAC: Adding query filter params (role.id=9cf4680c808546e286e3a5c3383d98e1, user.id=071b9c00ea7e492fa4ea405adc06eaa0, scope.system=all) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:17.950102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f49336-663c-4288-833c-e80cf221ca82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:17.951552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f49336-663c-4288-833c-e80cf221ca82 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:17.966446 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 169/346] 10.222.0.30 () {56 vars in 1308 bytes} [Sun Sep 4 00:45:17 2022] GET /identity/v3/role_assignments?user.id=071b9c00ea7e492fa4ea405adc06eaa0&scope.system=all&role.id=9cf4680c808546e286e3a5c3383d98e1 => generated 510 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:17.967369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f49336-663c-4288-833c-e80cf221ca82 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:17.979110 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:18.006536 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40ab54-fea9-44bd-b2d0-d53a10f43447 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:18.045749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53176568-5c4c-47a2-879d-79fc0e51c164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:18.046818 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53176568-5c4c-47a2-879d-79fc0e51c164 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:18.047292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53176568-5c4c-47a2-879d-79fc0e51c164 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:18.047754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53176568-5c4c-47a2-879d-79fc0e51c164 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:18.060902 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53176568-5c4c-47a2-879d-79fc0e51c164 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:18.067337 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-53176568-5c4c-47a2-879d-79fc0e51c164 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 04 00:45:18.067337 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:18.067337 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:18.067337 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:18.067337 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:18.067337 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:18.067337 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:18.067337 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:18.067337 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:18.067337 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:18.067337 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:18.067337 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:18.067337 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:18.067337 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:18.067337 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:18.067337 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:18.068369 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:18.068369 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:18.068369 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:18.068369 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:18.068369 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:18.068369 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:18.068369 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:18.068369 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:18.068369 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:18.068369 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:18.068369 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:18.068369 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:18.068369 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:18.068369 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:18.068369 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:18.068369 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:18.069187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:18.069187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:18.069187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:18.069187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:18.069187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:18.069187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:18.069187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:18.069187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:18.069187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:18.069187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:18.069187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 04 00:45:18.069187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:18.072505 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 178/347] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Sep 4 00:45:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:18.074066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670fafd-0751-4cb9-97fa-2a68cb53b433 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:18.074620 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670fafd-0751-4cb9-97fa-2a68cb53b433 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:18.075203 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670fafd-0751-4cb9-97fa-2a68cb53b433 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:18.076843 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 179/348] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:18.078612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670fafd-0751-4cb9-97fa-2a68cb53b433 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:18.081973 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f49336-663c-4288-833c-e80cf221ca82 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:18.120765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820fd99-5d17-441a-91f2-f9d6a5b6e415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:18.122187 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820fd99-5d17-441a-91f2-f9d6a5b6e415 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:18.122187 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820fd99-5d17-441a-91f2-f9d6a5b6e415 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:18.122187 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820fd99-5d17-441a-91f2-f9d6a5b6e415 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:18.187492 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:18.197620 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820fd99-5d17-441a-91f2-f9d6a5b6e415 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:18.199802 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820fd99-5d17-441a-91f2-f9d6a5b6e415 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:18.200554 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670fafd-0751-4cb9-97fa-2a68cb53b433 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:18.210944 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:18.242627 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247e1cf-e13f-483f-8478-c9daf6618d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:18.244163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247e1cf-e13f-483f-8478-c9daf6618d9c None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:18.244630 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247e1cf-e13f-483f-8478-c9daf6618d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:18.245091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247e1cf-e13f-483f-8478-c9daf6618d9c None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:18.246097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247e1cf-e13f-483f-8478-c9daf6618d9c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:18.246606 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247e1cf-e13f-483f-8478-c9daf6618d9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:18.248386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247e1cf-e13f-483f-8478-c9daf6618d9c None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:18.259209 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 180/349] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:45:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:18.261094 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3aa11b-3f70-4deb-a885-428d064123e1 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:18.261595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3aa11b-3f70-4deb-a885-428d064123e1 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:18.262112 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3aa11b-3f70-4deb-a885-428d064123e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:18.284078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ab3aa11b-3f70-4deb-a885-428d064123e1 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:18.285728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ab3aa11b-3f70-4deb-a885-428d064123e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:18.314469 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 170/350] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:45:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 04 00:45:18.315506 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820fd99-5d17-441a-91f2-f9d6a5b6e415 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:18.360619 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 181/351] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:18.362054 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3aa11b-3f70-4deb-a885-428d064123e1 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:18.427190 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820fd99-5d17-441a-91f2-f9d6a5b6e415 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:18.438715 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:18.456022 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:18.469542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b52b87-77aa-412d-af9a-438cef14c793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:18.470167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b52b87-77aa-412d-af9a-438cef14c793 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:18.470431 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b52b87-77aa-412d-af9a-438cef14c793 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:18.470707 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b52b87-77aa-412d-af9a-438cef14c793 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:18.477820 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3aa11b-3f70-4deb-a885-428d064123e1 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:18.516066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf27c39-af9d-4036-94b1-2ac53929a7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:18.517037 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf27c39-af9d-4036-94b1-2ac53929a7c3 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:18.517529 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf27c39-af9d-4036-94b1-2ac53929a7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:18.517988 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf27c39-af9d-4036-94b1-2ac53929a7c3 None admin] PATH_INFO: `/v3/projects/97a75aeee8d742edb0aa9858a8c2eede` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:18.519398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf27c39-af9d-4036-94b1-2ac53929a7c3 None admin] RBAC: Authorizing `identity:get_project(project_id=97a75aeee8d742edb0aa9858a8c2eede)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:18.522393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf27c39-af9d-4036-94b1-2ac53929a7c3 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:18.524488 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 182/352] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:45:18 2022] GET /identity/v3/projects/97a75aeee8d742edb0aa9858a8c2eede => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:18.525905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16370b5a-106c-441d-bbb3-22121c6ec9ce None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:18.526385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16370b5a-106c-441d-bbb3-22121c6ec9ce None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:18.526911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16370b5a-106c-441d-bbb3-22121c6ec9ce None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:18.528461 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 183/353] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:18.537502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89fcc2-77d8-47a3-a5f9-fc197fb05827 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:18.538045 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89fcc2-77d8-47a3-a5f9-fc197fb05827 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:18.538508 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89fcc2-77d8-47a3-a5f9-fc197fb05827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:18.547466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b52b87-77aa-412d-af9a-438cef14c793 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:18.550066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b52b87-77aa-412d-af9a-438cef14c793 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:18.567870 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-0f89fcc2-77d8-47a3-a5f9-fc197fb05827 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:18.569175 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0f89fcc2-77d8-47a3-a5f9-fc197fb05827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:18.645892 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 184/354] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:18.646739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89fcc2-77d8-47a3-a5f9-fc197fb05827 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:18.662590 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 171/355] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:45:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 04 00:45:18.668231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b52b87-77aa-412d-af9a-438cef14c793 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:18.678436 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:18.770765 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:18.788543 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b52b87-77aa-412d-af9a-438cef14c793 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:18.792870 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89fcc2-77d8-47a3-a5f9-fc197fb05827 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:18.829262 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07429ae6-d326-406d-a6e4-14a2aae96ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:18.830393 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07429ae6-d326-406d-a6e4-14a2aae96ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:18.830996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07429ae6-d326-406d-a6e4-14a2aae96ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:18.831431 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07429ae6-d326-406d-a6e4-14a2aae96ed0 None admin] PATH_INFO: `/v3/projects/97a75aeee8d742edb0aa9858a8c2eede` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:18.832892 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07429ae6-d326-406d-a6e4-14a2aae96ed0 None admin] RBAC: Authorizing `identity:get_project(project_id=97a75aeee8d742edb0aa9858a8c2eede)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:18.834085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769635e-6c0d-49e6-96d7-9a979ee570bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:18.834476 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769635e-6c0d-49e6-96d7-9a979ee570bf None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:18.834826 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769635e-6c0d-49e6-96d7-9a979ee570bf None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:18.835194 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769635e-6c0d-49e6-96d7-9a979ee570bf None admin] PATH_INFO: `/v3/groups/0a43ca6c71234a1895f86d07348e8845` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:18.836174 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07429ae6-d326-406d-a6e4-14a2aae96ed0 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:18.838847 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 172/356] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:45:18 2022] GET /identity/v3/projects/97a75aeee8d742edb0aa9858a8c2eede => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:45:18.839851 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07429ae6-d326-406d-a6e4-14a2aae96ed0 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:18.842407 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769635e-6c0d-49e6-96d7-9a979ee570bf None admin] RBAC: Authorizing `identity:get_group(group_id=0a43ca6c71234a1895f86d07348e8845)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:18.844614 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769635e-6c0d-49e6-96d7-9a979ee570bf None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:18.847618 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 185/357] 10.222.0.30 () {56 vars in 1180 bytes} [Sun Sep 4 00:45:18 2022] GET /identity/v3/groups/0a43ca6c71234a1895f86d07348e8845 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:18.848467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769635e-6c0d-49e6-96d7-9a979ee570bf None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:18.931951 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:18.949610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07429ae6-d326-406d-a6e4-14a2aae96ed0 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:18.958744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769635e-6c0d-49e6-96d7-9a979ee570bf None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:18.986374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7d0bd-21c9-4580-9083-11247ebc735b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:18.987332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7d0bd-21c9-4580-9083-11247ebc735b None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:18.987761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7d0bd-21c9-4580-9083-11247ebc735b None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:18.988199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7d0bd-21c9-4580-9083-11247ebc735b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:18.996584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ccf776-b8b6-44fb-9e01-6a4525bbb4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:18.997299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccf776-b8b6-44fb-9e01-6a4525bbb4b1 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:18.997706 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccf776-b8b6-44fb-9e01-6a4525bbb4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:18.998149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccf776-b8b6-44fb-9e01-6a4525bbb4b1 None admin] PATH_INFO: `/v3/groups/0a43ca6c71234a1895f86d07348e8845` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:18.999231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ccf776-b8b6-44fb-9e01-6a4525bbb4b1 None admin] RBAC: Authorizing `identity:get_group(group_id=0a43ca6c71234a1895f86d07348e8845)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:19.000749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ccf776-b8b6-44fb-9e01-6a4525bbb4b1 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:19.001398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7d0bd-21c9-4580-9083-11247ebc735b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:19.002669 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 186/358] 10.222.0.30 () {56 vars in 1180 bytes} [Sun Sep 4 00:45:18 2022] GET /identity/v3/groups/0a43ca6c71234a1895f86d07348e8845 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:19.003557 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ccf776-b8b6-44fb-9e01-6a4525bbb4b1 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:19.007285 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-50e7d0bd-21c9-4580-9083-11247ebc735b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 04 00:45:19.007285 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:19.007285 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:19.007285 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:19.007285 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:19.007285 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:19.007285 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:19.007285 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:19.007285 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:19.007285 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:19.007285 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:19.007285 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:19.007285 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:19.007285 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:19.007285 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:19.007285 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:19.008154 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:19.008154 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:19.008154 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:19.008154 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:19.008154 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:19.008154 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:19.008154 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:19.008154 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:19.008154 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:19.008154 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:19.008154 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:19.008154 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:19.008154 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:19.008154 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:19.008154 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:19.008154 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:19.009952 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:19.009952 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:19.009952 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:19.009952 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:19.009952 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:19.009952 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:19.009952 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:19.009952 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:19.009952 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:19.009952 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:19.009952 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 04 00:45:19.009952 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:19.015080 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 173/359] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Sep 4 00:45:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:19.017401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7d0bd-21c9-4580-9083-11247ebc735b None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:19.027334 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:19.126881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ccf776-b8b6-44fb-9e01-6a4525bbb4b1 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:19.144939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7d0bd-21c9-4580-9083-11247ebc735b None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:19.174311 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619bb34b-de43-4615-93d9-44876d838eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:19.174936 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619bb34b-de43-4615-93d9-44876d838eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:19.175241 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619bb34b-de43-4615-93d9-44876d838eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:19.175649 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619bb34b-de43-4615-93d9-44876d838eb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:19.176743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619bb34b-de43-4615-93d9-44876d838eb6 None admin] RBAC: Adding query filter params (group.id=0a43ca6c71234a1895f86d07348e8845, role.id=7c1abe5c3a82479484ec5a104ec31f8f, scope.project.id=97a75aeee8d742edb0aa9858a8c2eede) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:19.177066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619bb34b-de43-4615-93d9-44876d838eb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:19.179095 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619bb34b-de43-4615-93d9-44876d838eb6 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:19.187552 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 187/360] 10.222.0.30 () {56 vars in 1376 bytes} [Sun Sep 4 00:45:19 2022] GET /identity/v3/role_assignments?group.id=0a43ca6c71234a1895f86d07348e8845&scope.project.id=97a75aeee8d742edb0aa9858a8c2eede&role.id=7c1abe5c3a82479484ec5a104ec31f8f => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:19.188360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619bb34b-de43-4615-93d9-44876d838eb6 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:19.194484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59562e4f-bd0d-4f67-8858-3a6f36e7a2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:19.195116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59562e4f-bd0d-4f67-8858-3a6f36e7a2a1 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:19.195391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59562e4f-bd0d-4f67-8858-3a6f36e7a2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:19.195656 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59562e4f-bd0d-4f67-8858-3a6f36e7a2a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:19.196460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59562e4f-bd0d-4f67-8858-3a6f36e7a2a1 None admin] RBAC: Adding query filter params (group.id=0a43ca6c71234a1895f86d07348e8845, role.id=c6d447182cac4a6ca92d2457e8936b91, scope.project.id=97a75aeee8d742edb0aa9858a8c2eede) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:19.196764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59562e4f-bd0d-4f67-8858-3a6f36e7a2a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:19.198257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59562e4f-bd0d-4f67-8858-3a6f36e7a2a1 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:19.202401 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:19.207415 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 174/361] 10.222.0.30 () {56 vars in 1376 bytes} [Sun Sep 4 00:45:19 2022] GET /identity/v3/role_assignments?group.id=0a43ca6c71234a1895f86d07348e8845&scope.project.id=97a75aeee8d742edb0aa9858a8c2eede&role.id=c6d447182cac4a6ca92d2457e8936b91 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:19.208598 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59562e4f-bd0d-4f67-8858-3a6f36e7a2a1 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:19.302177 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:19.334549 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619bb34b-de43-4615-93d9-44876d838eb6 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:19.374596 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59562e4f-bd0d-4f67-8858-3a6f36e7a2a1 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:19.390947 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb175603-6152-4df1-92e0-1ab7b670e8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:19.392216 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb175603-6152-4df1-92e0-1ab7b670e8d6 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:19.392711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb175603-6152-4df1-92e0-1ab7b670e8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:19.393171 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb175603-6152-4df1-92e0-1ab7b670e8d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:19.408644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb175603-6152-4df1-92e0-1ab7b670e8d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:19.416855 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-bb175603-6152-4df1-92e0-1ab7b670e8d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 04 00:45:19.416855 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:19.416855 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:19.416855 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:19.416855 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:19.416855 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:19.416855 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:19.416855 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:19.416855 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:19.416855 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:19.416855 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:19.416855 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:19.416855 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:19.416855 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:19.416855 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:19.416855 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:19.417766 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:19.417766 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:19.417766 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:19.417766 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:19.417766 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:19.417766 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:19.417766 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:19.417766 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:19.417766 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:19.417766 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:19.417766 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:19.417766 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:19.417766 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:19.417766 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:19.417766 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:19.417766 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:19.418542 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:19.418542 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:19.418542 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:19.418542 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:19.418542 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:19.418542 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:19.418542 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:19.418542 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:19.418542 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:19.418542 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:19.418542 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 04 00:45:19.418542 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:19.419134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ecf67-e2ec-411c-aa63-52175fda3376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:19.419134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ecf67-e2ec-411c-aa63-52175fda3376 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:19.419134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ecf67-e2ec-411c-aa63-52175fda3376 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:19.419134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ecf67-e2ec-411c-aa63-52175fda3376 None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:19.419888 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ecf67-e2ec-411c-aa63-52175fda3376 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:19.419888 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ecf67-e2ec-411c-aa63-52175fda3376 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:19.421131 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ecf67-e2ec-411c-aa63-52175fda3376 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:19.421556 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 188/362] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:45:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:19.422943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fff14-3b2a-4cda-9b3a-bb84723632bf None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:19.423417 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fff14-3b2a-4cda-9b3a-bb84723632bf None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:19.423875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fff14-3b2a-4cda-9b3a-bb84723632bf None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:19.425288 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 189/363] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:19.431525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4fff14-3b2a-4cda-9b3a-bb84723632bf None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:19.446375 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 175/364] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:45:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:19.447591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d794a6-eb76-4890-b1d1-cbc4bb5bfea9 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:19.447876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d794a6-eb76-4890-b1d1-cbc4bb5bfea9 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:19.448150 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d794a6-eb76-4890-b1d1-cbc4bb5bfea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:19.474713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b5d794a6-eb76-4890-b1d1-cbc4bb5bfea9 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:19.475988 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b5d794a6-eb76-4890-b1d1-cbc4bb5bfea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:19.546237 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:19.561546 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 176/365] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:19.561546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d794a6-eb76-4890-b1d1-cbc4bb5bfea9 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:19.582747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4fff14-3b2a-4cda-9b3a-bb84723632bf None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:19.646094 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48481f92-24ed-4fad-9620-8804497e7759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:19.646708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48481f92-24ed-4fad-9620-8804497e7759 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:19.646961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48481f92-24ed-4fad-9620-8804497e7759 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:19.647282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48481f92-24ed-4fad-9620-8804497e7759 None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:19.648007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48481f92-24ed-4fad-9620-8804497e7759 None admin] RBAC: Adding query filter params (name=member) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:19.648309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48481f92-24ed-4fad-9620-8804497e7759 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:19.650254 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48481f92-24ed-4fad-9620-8804497e7759 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:19.661990 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:19.666818 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 190/366] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Sep 4 00:45:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:19.673795 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48481f92-24ed-4fad-9620-8804497e7759 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:19.742774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d794a6-eb76-4890-b1d1-cbc4bb5bfea9 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:19.811706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660ed1a-6bd9-4962-9412-fe12cdc7dbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:19.812238 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660ed1a-6bd9-4962-9412-fe12cdc7dbf6 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:19.812514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660ed1a-6bd9-4962-9412-fe12cdc7dbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:19.812780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660ed1a-6bd9-4962-9412-fe12cdc7dbf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:19.815197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48481f92-24ed-4fad-9620-8804497e7759 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:19.871027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ecc49a-2400-4bd8-91fe-90769ea00e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:19.871826 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecc49a-2400-4bd8-91fe-90769ea00e81 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:19.872108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecc49a-2400-4bd8-91fe-90769ea00e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:19.872430 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecc49a-2400-4bd8-91fe-90769ea00e81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:19.931682 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:19.949525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4660ed1a-6bd9-4962-9412-fe12cdc7dbf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:19.951252 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4660ed1a-6bd9-4962-9412-fe12cdc7dbf6 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:19.964689 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:19.967642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ecc49a-2400-4bd8-91fe-90769ea00e81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:19.970059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ecc49a-2400-4bd8-91fe-90769ea00e81 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:20.091329 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 177/367] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:45:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 04 00:45:20.091751 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660ed1a-6bd9-4962-9412-fe12cdc7dbf6 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:20.114782 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 191/368] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:45:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 04 00:45:20.115619 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ecc49a-2400-4bd8-91fe-90769ea00e81 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:20.194283 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:20.204818 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660ed1a-6bd9-4962-9412-fe12cdc7dbf6 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:20.229064 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:20.232562 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ecc49a-2400-4bd8-91fe-90769ea00e81 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:20.241798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8b25c-d49c-4b70-b5b4-c4920bddcb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:20.243206 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8b25c-d49c-4b70-b5b4-c4920bddcb48 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:20.243707 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8b25c-d49c-4b70-b5b4-c4920bddcb48 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:20.244167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8b25c-d49c-4b70-b5b4-c4920bddcb48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:20.255713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8b25c-d49c-4b70-b5b4-c4920bddcb48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:20.261332 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-99b8b25c-d49c-4b70-b5b4-c4920bddcb48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:45:20.261332 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:20.261332 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:20.261332 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:20.261332 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:20.261332 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:20.261332 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:20.261332 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:20.261332 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:20.261332 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:20.261332 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:20.261332 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:20.261332 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:20.261332 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:20.261332 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:20.261332 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:20.262211 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:20.262211 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:20.262211 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:20.262211 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:20.262211 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:20.262211 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:20.262211 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:20.262211 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:20.262211 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:20.262211 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:20.262211 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:20.262211 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:20.262211 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:20.262211 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:20.262211 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:20.262211 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:20.262989 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:20.262989 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:20.262989 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:20.262989 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:20.262989 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:20.262989 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:20.262989 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:20.262989 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:20.262989 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:20.262989 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:20.262989 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:45:20.262989 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:20.265595 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 178/369] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Sep 4 00:45:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:20.266642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8b25c-d49c-4b70-b5b4-c4920bddcb48 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:20.277787 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96617b47-e4b3-4044-96af-bd78c651580a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:20.278741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96617b47-e4b3-4044-96af-bd78c651580a None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:20.279234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96617b47-e4b3-4044-96af-bd78c651580a None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:20.279708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96617b47-e4b3-4044-96af-bd78c651580a None admin] PATH_INFO: `/v3/projects/904901a056914acebf292730fd309f87` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:20.282165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96617b47-e4b3-4044-96af-bd78c651580a None admin] RBAC: Authorizing `identity:get_project(project_id=904901a056914acebf292730fd309f87)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:20.283727 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96617b47-e4b3-4044-96af-bd78c651580a None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:20.285856 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 192/370] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:45:20 2022] GET /identity/v3/projects/904901a056914acebf292730fd309f87 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:20.286696 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96617b47-e4b3-4044-96af-bd78c651580a None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:20.411095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8b25c-d49c-4b70-b5b4-c4920bddcb48 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:20.415131 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96617b47-e4b3-4044-96af-bd78c651580a None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:20.463212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0d3d2-c0b7-4c24-aae7-14e6042c0573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:20.464125 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0d3d2-c0b7-4c24-aae7-14e6042c0573 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:20.464631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0d3d2-c0b7-4c24-aae7-14e6042c0573 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:20.465114 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0d3d2-c0b7-4c24-aae7-14e6042c0573 None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:20.465830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9697f6d7-b172-4335-b9b3-18b016759f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:20.466276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0d3d2-c0b7-4c24-aae7-14e6042c0573 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:20.466458 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9697f6d7-b172-4335-b9b3-18b016759f23 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:20.466743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9697f6d7-b172-4335-b9b3-18b016759f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:20.467016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9697f6d7-b172-4335-b9b3-18b016759f23 None admin] PATH_INFO: `/v3/projects/904901a056914acebf292730fd309f87` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:20.467372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0d3d2-c0b7-4c24-aae7-14e6042c0573 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:20.468147 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9697f6d7-b172-4335-b9b3-18b016759f23 None admin] RBAC: Authorizing `identity:get_project(project_id=904901a056914acebf292730fd309f87)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:20.469161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0d3d2-c0b7-4c24-aae7-14e6042c0573 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:20.469611 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9697f6d7-b172-4335-b9b3-18b016759f23 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:20.471732 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 179/371] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:45:20 2022] GET /identity/v3/projects/904901a056914acebf292730fd309f87 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:20.472499 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9697f6d7-b172-4335-b9b3-18b016759f23 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:20.478977 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 193/372] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:45:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:20.481846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0d3d2-c0b7-4c24-aae7-14e6042c0573 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:20.502893 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:20.539769 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:20.589802 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9697f6d7-b172-4335-b9b3-18b016759f23 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:20.626448 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0d3d2-c0b7-4c24-aae7-14e6042c0573 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:20.629662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833133b-01d1-43ca-b0ae-1d75c08d3273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:20.630537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833133b-01d1-43ca-b0ae-1d75c08d3273 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:20.631011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833133b-01d1-43ca-b0ae-1d75c08d3273 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:20.631501 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833133b-01d1-43ca-b0ae-1d75c08d3273 None admin] PATH_INFO: `/v3/groups/0a43ca6c71234a1895f86d07348e8845` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:20.632811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833133b-01d1-43ca-b0ae-1d75c08d3273 None admin] RBAC: Authorizing `identity:get_group(group_id=0a43ca6c71234a1895f86d07348e8845)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:20.634528 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833133b-01d1-43ca-b0ae-1d75c08d3273 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:20.637607 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 180/373] 10.222.0.30 () {56 vars in 1180 bytes} [Sun Sep 4 00:45:20 2022] GET /identity/v3/groups/0a43ca6c71234a1895f86d07348e8845 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:20.638537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833133b-01d1-43ca-b0ae-1d75c08d3273 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:20.667470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b60463-f59b-4e16-a5f1-4992a2abe4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:20.669118 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b60463-f59b-4e16-a5f1-4992a2abe4b4 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:20.669611 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b60463-f59b-4e16-a5f1-4992a2abe4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:20.670316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b60463-f59b-4e16-a5f1-4992a2abe4b4 None admin] PATH_INFO: `/v3/groups/0a43ca6c71234a1895f86d07348e8845` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:20.671809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b60463-f59b-4e16-a5f1-4992a2abe4b4 None admin] RBAC: Authorizing `identity:get_group(group_id=0a43ca6c71234a1895f86d07348e8845)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:20.674136 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b60463-f59b-4e16-a5f1-4992a2abe4b4 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:20.676747 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 194/374] 10.222.0.30 () {56 vars in 1180 bytes} [Sun Sep 4 00:45:20 2022] GET /identity/v3/groups/0a43ca6c71234a1895f86d07348e8845 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:20.677708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b60463-f59b-4e16-a5f1-4992a2abe4b4 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:20.746012 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:20.756537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833133b-01d1-43ca-b0ae-1d75c08d3273 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:20.794826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79c697-96ca-4f82-87a8-dab3c9228b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:20.795594 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79c697-96ca-4f82-87a8-dab3c9228b37 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:20.795969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79c697-96ca-4f82-87a8-dab3c9228b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:20.796331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79c697-96ca-4f82-87a8-dab3c9228b37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:20.809748 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:20.815062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b60463-f59b-4e16-a5f1-4992a2abe4b4 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:20.858385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f157a2-39af-4585-b835-5fd726a49e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:20.859746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f157a2-39af-4585-b835-5fd726a49e24 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:20.860173 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f157a2-39af-4585-b835-5fd726a49e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:20.860586 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f157a2-39af-4585-b835-5fd726a49e24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:20.861538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f157a2-39af-4585-b835-5fd726a49e24 None admin] RBAC: Adding query filter params (group.id=0a43ca6c71234a1895f86d07348e8845, role.id=c6d447182cac4a6ca92d2457e8936b91, scope.project.id=904901a056914acebf292730fd309f87) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:20.861990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f157a2-39af-4585-b835-5fd726a49e24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:20.864327 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f157a2-39af-4585-b835-5fd726a49e24 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:20.872251 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 195/375] 10.222.0.30 () {56 vars in 1376 bytes} [Sun Sep 4 00:45:20 2022] GET /identity/v3/role_assignments?group.id=0a43ca6c71234a1895f86d07348e8845&scope.project.id=904901a056914acebf292730fd309f87&role.id=c6d447182cac4a6ca92d2457e8936b91 => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:20.873592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f157a2-39af-4585-b835-5fd726a49e24 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:20.886412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f79c697-96ca-4f82-87a8-dab3c9228b37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:20.888200 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f79c697-96ca-4f82-87a8-dab3c9228b37 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:20.993395 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f157a2-39af-4585-b835-5fd726a49e24 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:21.035292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a75c51-5836-4b8f-ad10-64e1fb757306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:21.036149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a75c51-5836-4b8f-ad10-64e1fb757306 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:21.036939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a75c51-5836-4b8f-ad10-64e1fb757306 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:21.037524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a75c51-5836-4b8f-ad10-64e1fb757306 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:21.038536 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a75c51-5836-4b8f-ad10-64e1fb757306 None admin] RBAC: Adding query filter params (group.id=0a43ca6c71234a1895f86d07348e8845, role.id=7c1abe5c3a82479484ec5a104ec31f8f, scope.project.id=904901a056914acebf292730fd309f87) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:21.038988 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a75c51-5836-4b8f-ad10-64e1fb757306 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:21.041727 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a75c51-5836-4b8f-ad10-64e1fb757306 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:21.048621 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 196/376] 10.222.0.30 () {56 vars in 1376 bytes} [Sun Sep 4 00:45:20 2022] GET /identity/v3/role_assignments?group.id=0a43ca6c71234a1895f86d07348e8845&scope.project.id=904901a056914acebf292730fd309f87&role.id=7c1abe5c3a82479484ec5a104ec31f8f => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:21.052268 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:21.080833 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 181/377] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:45:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 04 00:45:21.087292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a75c51-5836-4b8f-ad10-64e1fb757306 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:21.130871 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:21.221952 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a75c51-5836-4b8f-ad10-64e1fb757306 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:21.259132 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917ffbf-085f-4277-a087-b562e213b200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:21.259990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917ffbf-085f-4277-a087-b562e213b200 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:21.260414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917ffbf-085f-4277-a087-b562e213b200 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:21.260828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917ffbf-085f-4277-a087-b562e213b200 None admin] PATH_INFO: `/v3/projects/6638e0942c764685b0292b0ca0b1b3e5` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:21.262152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5917ffbf-085f-4277-a087-b562e213b200 None admin] RBAC: Authorizing `identity:get_project(project_id=6638e0942c764685b0292b0ca0b1b3e5)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:21.263789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5917ffbf-085f-4277-a087-b562e213b200 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:21.265961 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 197/378] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:45:21 2022] GET /identity/v3/projects/6638e0942c764685b0292b0ca0b1b3e5 => generated 344 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:21.271279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79c697-96ca-4f82-87a8-dab3c9228b37 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:21.418570 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79c697-96ca-4f82-87a8-dab3c9228b37 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:21.471239 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9870b5-e6a3-455b-a489-09f8ebbf906f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:21.472188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9870b5-e6a3-455b-a489-09f8ebbf906f None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:21.472643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9870b5-e6a3-455b-a489-09f8ebbf906f None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:21.473089 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9870b5-e6a3-455b-a489-09f8ebbf906f None admin] PATH_INFO: `/v3/groups/b66749657afd4a758deb8d136606ff0a` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:21.486107 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9870b5-e6a3-455b-a489-09f8ebbf906f None admin] RBAC: Authorizing `identity:get_group(group_id=b66749657afd4a758deb8d136606ff0a)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:21.487918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9870b5-e6a3-455b-a489-09f8ebbf906f None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:21.489895 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 182/379] 10.222.0.30 () {56 vars in 1180 bytes} [Sun Sep 4 00:45:21 2022] GET /identity/v3/groups/b66749657afd4a758deb8d136606ff0a => generated 229 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:21.499042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917ffbf-085f-4277-a087-b562e213b200 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:21.507120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c804d-b9a9-47a7-9d3d-a5a90e05118f None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:21.507409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c804d-b9a9-47a7-9d3d-a5a90e05118f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:21.507676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c804d-b9a9-47a7-9d3d-a5a90e05118f None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:21.509409 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 183/380] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:21.515777 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d13081-29c9-48c4-8ad2-6a7ff88fd3a1 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:21.516075 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d13081-29c9-48c4-8ad2-6a7ff88fd3a1 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:21.516329 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d13081-29c9-48c4-8ad2-6a7ff88fd3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:21.545692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-49d13081-29c9-48c4-8ad2-6a7ff88fd3a1 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:21.547479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-49d13081-29c9-48c4-8ad2-6a7ff88fd3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:21.611787 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:21.638968 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:21.642288 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 184/381] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 04 00:45:21.649459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb48074-34db-4de2-a814-a1ddd8adc38f None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:21.650116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb48074-34db-4de2-a814-a1ddd8adc38f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:21.650402 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb48074-34db-4de2-a814-a1ddd8adc38f None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:21.653830 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 185/382] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:21 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:21.656099 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917ffbf-085f-4277-a087-b562e213b200 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:21.659563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da641c-4926-447f-ab6e-02193cd13160 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:21.659969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da641c-4926-447f-ab6e-02193cd13160 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:21.660243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da641c-4926-447f-ab6e-02193cd13160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:21.683040 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d2da641c-4926-447f-ab6e-02193cd13160 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:21.684230 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d2da641c-4926-447f-ab6e-02193cd13160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:21.759332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd4171-0af2-4eb7-a89f-23c9fdca7c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:21.760015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd4171-0af2-4eb7-a89f-23c9fdca7c91 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:21.760227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd4171-0af2-4eb7-a89f-23c9fdca7c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:21.760527 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd4171-0af2-4eb7-a89f-23c9fdca7c91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:21.761231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd4171-0af2-4eb7-a89f-23c9fdca7c91 None admin] RBAC: Adding query filter params (group.id=b66749657afd4a758deb8d136606ff0a, role.id=d255b03c37d64371a148ec4e11be01d9, scope.project.id=6638e0942c764685b0292b0ca0b1b3e5) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:21.769732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd4171-0af2-4eb7-a89f-23c9fdca7c91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:21.771580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd4171-0af2-4eb7-a89f-23c9fdca7c91 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:21.773761 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 186/383] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:21.795434 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 198/384] 10.222.0.30 () {56 vars in 1376 bytes} [Sun Sep 4 00:45:21 2022] GET /identity/v3/role_assignments?group.id=b66749657afd4a758deb8d136606ff0a&scope.project.id=6638e0942c764685b0292b0ca0b1b3e5&role.id=d255b03c37d64371a148ec4e11be01d9 => generated 260 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:21.981345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da641c-4926-447f-ab6e-02193cd13160 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:22.072639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd4171-0af2-4eb7-a89f-23c9fdca7c91 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:22.096218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da641c-4926-447f-ab6e-02193cd13160 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:22.120287 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:22.155106 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aee469-387c-41d6-bc67-260b4728fbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:22.155760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aee469-387c-41d6-bc67-260b4728fbcc None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:22.156035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aee469-387c-41d6-bc67-260b4728fbcc None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:22.156303 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aee469-387c-41d6-bc67-260b4728fbcc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:22.186394 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aee469-387c-41d6-bc67-260b4728fbcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:22.191263 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-53aee469-387c-41d6-bc67-260b4728fbcc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 04 00:45:22.191263 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:22.191263 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:22.191263 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:22.191263 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:22.191263 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:22.191263 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:22.191263 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:22.191263 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:22.191263 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:22.191263 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:22.191263 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:22.191263 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:22.191263 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:22.191263 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:22.191263 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:22.192242 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:22.192242 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:22.192242 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:22.192242 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:22.192242 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:22.192242 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:22.192242 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:22.192242 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:22.192242 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:22.192242 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:22.192242 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:22.192242 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:22.192242 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:22.192242 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:22.192242 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:22.192242 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:22.193029 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:22.193029 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:22.193029 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:22.193029 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:22.193029 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:22.193029 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:22.193029 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:22.193029 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:22.193029 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:22.193029 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:22.193029 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 04 00:45:22.193029 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:22.193029 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 187/385] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Sep 4 00:45:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:22.203157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aee469-387c-41d6-bc67-260b4728fbcc None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:22.212637 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd4171-0af2-4eb7-a89f-23c9fdca7c91 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:22.252688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dad9cf-b114-4c80-b332-c5981549e5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:22.253789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dad9cf-b114-4c80-b332-c5981549e5fa None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:22.254269 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dad9cf-b114-4c80-b332-c5981549e5fa None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:22.254763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dad9cf-b114-4c80-b332-c5981549e5fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:22.267113 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dad9cf-b114-4c80-b332-c5981549e5fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:22.273048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-45dad9cf-b114-4c80-b332-c5981549e5fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 04 00:45:22.273048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:22.273048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:22.273048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:22.273048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:22.273048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:22.273048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:22.273048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:22.273048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:22.273048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:22.273048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:22.273048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:22.273048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:22.273048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:22.273048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:22.273048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:22.274519 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:22.274519 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:22.274519 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:22.274519 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:22.274519 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:22.274519 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:22.274519 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:22.274519 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:22.274519 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:22.274519 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:22.274519 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:22.274519 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:22.274519 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:22.274519 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:22.274519 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:22.274519 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:22.275324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:22.275324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:22.275324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:22.275324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:22.275324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:22.275324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:22.275324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:22.275324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:22.275324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:22.275324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:22.275324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 04 00:45:22.275324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:22.277945 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 199/386] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:45:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:45:22.284236 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dad9cf-b114-4c80-b332-c5981549e5fa None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:22.307191 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:22.412635 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dad9cf-b114-4c80-b332-c5981549e5fa None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:22.469691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b564b-3ec2-46cf-af80-f7414182973d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:22.470590 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b564b-3ec2-46cf-af80-f7414182973d None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:22.471038 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b564b-3ec2-46cf-af80-f7414182973d None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:22.471453 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b564b-3ec2-46cf-af80-f7414182973d None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:22.472308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b564b-3ec2-46cf-af80-f7414182973d None admin] RBAC: Adding query filter params (name=member) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:22.472751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b564b-3ec2-46cf-af80-f7414182973d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:22.474475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b564b-3ec2-46cf-af80-f7414182973d None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:22.485706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aee469-387c-41d6-bc67-260b4728fbcc None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:22.489169 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 200/387] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Sep 4 00:45:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:22.496221 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b564b-3ec2-46cf-af80-f7414182973d None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:22.584313 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf31cb-6364-46a1-9351-ef2f61b5061a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:22.585269 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf31cb-6364-46a1-9351-ef2f61b5061a None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:22.586440 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf31cb-6364-46a1-9351-ef2f61b5061a None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:22.586920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf31cb-6364-46a1-9351-ef2f61b5061a None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:22.587919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf31cb-6364-46a1-9351-ef2f61b5061a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:22.589428 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf31cb-6364-46a1-9351-ef2f61b5061a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:22.591798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf31cb-6364-46a1-9351-ef2f61b5061a None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:22.610787 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 188/388] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:45:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:22.619710 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf31cb-6364-46a1-9351-ef2f61b5061a None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:22.629637 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:22.673706 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b564b-3ec2-46cf-af80-f7414182973d None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:22.675694 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:22.741834 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc32e2-0021-4481-b443-b611317995d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:22.743405 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc32e2-0021-4481-b443-b611317995d6 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:22.745360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc32e2-0021-4481-b443-b611317995d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:22.745888 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc32e2-0021-4481-b443-b611317995d6 None admin] PATH_INFO: `/v3/groups/0a43ca6c71234a1895f86d07348e8845` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:22.748194 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc32e2-0021-4481-b443-b611317995d6 None admin] RBAC: Authorizing `identity:get_group(group_id=0a43ca6c71234a1895f86d07348e8845)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:22.750615 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc32e2-0021-4481-b443-b611317995d6 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:22.754769 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 201/389] 10.222.0.30 () {56 vars in 1180 bytes} [Sun Sep 4 00:45:22 2022] GET /identity/v3/groups/0a43ca6c71234a1895f86d07348e8845 => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:45:22.760918 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc32e2-0021-4481-b443-b611317995d6 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:22.763587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf31cb-6364-46a1-9351-ef2f61b5061a None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:22.818404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af2e42-8c2b-449d-9733-b3e7517ed832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:22.819015 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af2e42-8c2b-449d-9733-b3e7517ed832 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:22.819281 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af2e42-8c2b-449d-9733-b3e7517ed832 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:22.819541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af2e42-8c2b-449d-9733-b3e7517ed832 None admin] PATH_INFO: `/v3/groups/0a43ca6c71234a1895f86d07348e8845` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:22.821980 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af2e42-8c2b-449d-9733-b3e7517ed832 None admin] RBAC: Authorizing `identity:get_group(group_id=0a43ca6c71234a1895f86d07348e8845)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:22.827740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af2e42-8c2b-449d-9733-b3e7517ed832 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:22.833762 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 189/390] 10.222.0.30 () {56 vars in 1180 bytes} [Sun Sep 4 00:45:22 2022] GET /identity/v3/groups/0a43ca6c71234a1895f86d07348e8845 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:22.836653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af2e42-8c2b-449d-9733-b3e7517ed832 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:22.939140 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc32e2-0021-4481-b443-b611317995d6 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:22.999555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72130cd7-5ee0-4726-be1f-4248573a44bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:23.000190 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72130cd7-5ee0-4726-be1f-4248573a44bb None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:23.000468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72130cd7-5ee0-4726-be1f-4248573a44bb None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:23.000740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72130cd7-5ee0-4726-be1f-4248573a44bb None admin] PATH_INFO: `/v3/projects/97a75aeee8d742edb0aa9858a8c2eede` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:23.003863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72130cd7-5ee0-4726-be1f-4248573a44bb None admin] RBAC: Authorizing `identity:get_project(project_id=97a75aeee8d742edb0aa9858a8c2eede)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:23.005350 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72130cd7-5ee0-4726-be1f-4248573a44bb None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:23.008225 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 202/391] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:45:22 2022] GET /identity/v3/projects/97a75aeee8d742edb0aa9858a8c2eede => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:45:23.012178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af2e42-8c2b-449d-9733-b3e7517ed832 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:23.014117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72130cd7-5ee0-4726-be1f-4248573a44bb None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:23.017149 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:23.075307 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:23.100618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5ebb5-4e62-4d7c-bb4b-c9edee99d11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:23.101258 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5ebb5-4e62-4d7c-bb4b-c9edee99d11e None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:23.101568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5ebb5-4e62-4d7c-bb4b-c9edee99d11e None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:23.101844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5ebb5-4e62-4d7c-bb4b-c9edee99d11e None admin] PATH_INFO: `/v3/projects/97a75aeee8d742edb0aa9858a8c2eede` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:23.104706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5ebb5-4e62-4d7c-bb4b-c9edee99d11e None admin] RBAC: Authorizing `identity:get_project(project_id=97a75aeee8d742edb0aa9858a8c2eede)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:23.106188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5ebb5-4e62-4d7c-bb4b-c9edee99d11e None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:23.107849 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 190/392] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:45:22 2022] GET /identity/v3/projects/97a75aeee8d742edb0aa9858a8c2eede => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:23.115968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5ebb5-4e62-4d7c-bb4b-c9edee99d11e None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:23.190799 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72130cd7-5ee0-4726-be1f-4248573a44bb None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:23.246734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5ebb5-4e62-4d7c-bb4b-c9edee99d11e None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:23.255671 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d6be7-4b6b-4771-bedc-c8cbfc6d40d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:23.256338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d6be7-4b6b-4771-bedc-c8cbfc6d40d3 None admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:23.256616 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d6be7-4b6b-4771-bedc-c8cbfc6d40d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:23.256887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d6be7-4b6b-4771-bedc-c8cbfc6d40d3 None admin] PATH_INFO: `/v3/projects/97a75aeee8d742edb0aa9858a8c2eede/groups/0a43ca6c71234a1895f86d07348e8845/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:23.258864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d6be7-4b6b-4771-bedc-c8cbfc6d40d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=97a75aeee8d742edb0aa9858a8c2eede, group_id=0a43ca6c71234a1895f86d07348e8845, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:23.260297 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d6be7-4b6b-4771-bedc-c8cbfc6d40d3 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:23.284824 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 203/393] 10.222.0.30 () {58 vars in 1442 bytes} [Sun Sep 4 00:45:23 2022] PUT /identity/v3/projects/97a75aeee8d742edb0aa9858a8c2eede/groups/0a43ca6c71234a1895f86d07348e8845/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 00:45:23.293726 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13ece3-4d93-42b2-9a5f-70f36eaae8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:23.294410 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13ece3-4d93-42b2-9a5f-70f36eaae8ab None admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:23.294693 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13ece3-4d93-42b2-9a5f-70f36eaae8ab None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:23.294967 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13ece3-4d93-42b2-9a5f-70f36eaae8ab None admin] PATH_INFO: `/v3/projects/97a75aeee8d742edb0aa9858a8c2eede/groups/0a43ca6c71234a1895f86d07348e8845/roles/c6d447182cac4a6ca92d2457e8936b91` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:23.297270 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d13ece3-4d93-42b2-9a5f-70f36eaae8ab None admin] RBAC: Authorizing `identity:create_grant(project_id=97a75aeee8d742edb0aa9858a8c2eede, group_id=0a43ca6c71234a1895f86d07348e8845, role_id=c6d447182cac4a6ca92d2457e8936b91)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:23.298768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d13ece3-4d93-42b2-9a5f-70f36eaae8ab None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:23.330533 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 191/394] 10.222.0.30 () {58 vars in 1442 bytes} [Sun Sep 4 00:45:23 2022] PUT /identity/v3/projects/97a75aeee8d742edb0aa9858a8c2eede/groups/0a43ca6c71234a1895f86d07348e8845/roles/c6d447182cac4a6ca92d2457e8936b91 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:45:23.647846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac09304-260d-434a-978b-029d2f1b9425 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:23.648517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac09304-260d-434a-978b-029d2f1b9425 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:23.649629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac09304-260d-434a-978b-029d2f1b9425 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:23.651374 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 204/395] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:23.656999 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f225e1-d79e-48de-847e-05f8266063c8 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:23.657289 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f225e1-d79e-48de-847e-05f8266063c8 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:23.657595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f225e1-d79e-48de-847e-05f8266063c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:23.682377 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-f8f225e1-d79e-48de-847e-05f8266063c8 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:23.683599 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f8f225e1-d79e-48de-847e-05f8266063c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:23.713706 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:23.769497 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 192/396] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:23.800394 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a09151-fddd-42a1-ae8a-b4cf4a74ab01 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:23.800888 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a09151-fddd-42a1-ae8a-b4cf4a74ab01 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:23.800992 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a09151-fddd-42a1-ae8a-b4cf4a74ab01 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:23.802292 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 205/397] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:23.807775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e46d31-dc53-4d97-a18f-8a5bb73aee88 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:23.808063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e46d31-dc53-4d97-a18f-8a5bb73aee88 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:23.808340 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e46d31-dc53-4d97-a18f-8a5bb73aee88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:23.831866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b7e46d31-dc53-4d97-a18f-8a5bb73aee88 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:23.833055 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b7e46d31-dc53-4d97-a18f-8a5bb73aee88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:23.920429 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 193/398] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:24.207204 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a09151-fddd-42a1-ae8a-b4cf4a74ab01 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:24.237622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e46d31-dc53-4d97-a18f-8a5bb73aee88 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:24.345803 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:24.369942 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:24.381697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e46d31-dc53-4d97-a18f-8a5bb73aee88 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:24.388018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a09151-fddd-42a1-ae8a-b4cf4a74ab01 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:24.421515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3558078-338e-4ef4-a312-6686742511d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:24.422474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3558078-338e-4ef4-a312-6686742511d4 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:24.423002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3558078-338e-4ef4-a312-6686742511d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:24.423357 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3558078-338e-4ef4-a312-6686742511d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:24.435306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8789b1-69e2-4420-b38f-d6d9dd431a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:24.435947 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8789b1-69e2-4420-b38f-d6d9dd431a19 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:24.436227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8789b1-69e2-4420-b38f-d6d9dd431a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:24.436501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8789b1-69e2-4420-b38f-d6d9dd431a19 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:24.437970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3558078-338e-4ef4-a312-6686742511d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:24.443145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-e3558078-338e-4ef4-a312-6686742511d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 04 00:45:24.443145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:24.443145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:24.443145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:24.443145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:24.443145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:24.443145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:24.443145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:24.443145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:24.443145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:24.443145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:24.443145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:24.443145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:24.443145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:24.443145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:24.443145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:24.444261 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:24.444261 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:24.444261 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:24.444261 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:24.444261 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:24.444261 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:24.444261 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:24.444261 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:24.444261 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:24.444261 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:24.444261 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:24.444261 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:24.444261 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:24.444261 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:24.444261 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:24.444261 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:24.445243 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:24.445243 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:24.445243 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:24.445243 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:24.445243 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:24.445243 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:24.445243 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:24.445243 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:24.445243 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:24.445243 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:24.445243 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 04 00:45:24.445243 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:24.447144 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 194/399] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Sep 4 00:45:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:24.448272 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0196b-4a7c-45cd-932c-e7862be33cbf None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:24.449302 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0196b-4a7c-45cd-932c-e7862be33cbf None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:24.449853 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0196b-4a7c-45cd-932c-e7862be33cbf None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:24.451328 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 195/400] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:24.452741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0196b-4a7c-45cd-932c-e7862be33cbf None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:24.472514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8789b1-69e2-4420-b38f-d6d9dd431a19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:24.479556 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-ec8789b1-69e2-4420-b38f-d6d9dd431a19 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 04 00:45:24.479556 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:24.479556 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:24.479556 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:24.479556 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:24.479556 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:24.479556 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:24.479556 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:24.479556 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:24.479556 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:24.479556 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:24.479556 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:24.479556 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:24.479556 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:24.479556 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:24.479556 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:24.480416 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:24.480416 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:24.480416 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:24.480416 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:24.480416 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:24.480416 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:24.480416 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:24.480416 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:24.480416 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:24.480416 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:24.480416 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:24.480416 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:24.480416 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:24.480416 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:24.480416 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:24.480416 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:24.481186 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:24.481186 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:24.481186 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:24.481186 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:24.481186 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:24.481186 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:24.481186 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:24.481186 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:24.481186 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:24.481186 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:24.481186 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 04 00:45:24.481186 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:24.483816 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 206/401] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:45:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:24.485560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c848713-fe12-4f39-9634-f60f64afdacd None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:24.486006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c848713-fe12-4f39-9634-f60f64afdacd None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:24.486440 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c848713-fe12-4f39-9634-f60f64afdacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:24.506995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-5c848713-fe12-4f39-9634-f60f64afdacd None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:24.508621 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5c848713-fe12-4f39-9634-f60f64afdacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:24.585183 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0196b-4a7c-45cd-932c-e7862be33cbf None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:24.605379 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 207/402] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:24.607556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c848713-fe12-4f39-9634-f60f64afdacd None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:24.643066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85b64b-5dcb-440c-9aa4-0091111fba69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:24.643679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85b64b-5dcb-440c-9aa4-0091111fba69 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:24.643950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85b64b-5dcb-440c-9aa4-0091111fba69 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:24.644221 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85b64b-5dcb-440c-9aa4-0091111fba69 None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:24.645096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85b64b-5dcb-440c-9aa4-0091111fba69 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:24.645601 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85b64b-5dcb-440c-9aa4-0091111fba69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:24.647153 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85b64b-5dcb-440c-9aa4-0091111fba69 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:24.660386 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 196/403] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:45:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:24.686296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85b64b-5dcb-440c-9aa4-0091111fba69 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:24.692878 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:24.709285 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:24.730455 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c848713-fe12-4f39-9634-f60f64afdacd None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:24.767362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e22991-eff2-4add-9e36-26835d6a9cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:24.768280 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e22991-eff2-4add-9e36-26835d6a9cfd None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:24.768698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e22991-eff2-4add-9e36-26835d6a9cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:24.769105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e22991-eff2-4add-9e36-26835d6a9cfd None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:24.769969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e22991-eff2-4add-9e36-26835d6a9cfd None admin] RBAC: Adding query filter params (name=member) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:24.770418 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e22991-eff2-4add-9e36-26835d6a9cfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:24.771986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e22991-eff2-4add-9e36-26835d6a9cfd None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:24.782072 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 208/404] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Sep 4 00:45:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:24.791244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e22991-eff2-4add-9e36-26835d6a9cfd None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:24.891981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85b64b-5dcb-440c-9aa4-0091111fba69 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:24.951413 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e22991-eff2-4add-9e36-26835d6a9cfd None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:24.963384 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8f25a-320b-4589-9393-214e47388e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:24.964057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8f25a-320b-4589-9393-214e47388e65 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:24.964338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8f25a-320b-4589-9393-214e47388e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:24.964614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8f25a-320b-4589-9393-214e47388e65 None admin] PATH_INFO: `/v3/groups/0a43ca6c71234a1895f86d07348e8845` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:24.966091 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea8f25a-320b-4589-9393-214e47388e65 None admin] RBAC: Authorizing `identity:get_group(group_id=0a43ca6c71234a1895f86d07348e8845)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:24.967524 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea8f25a-320b-4589-9393-214e47388e65 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:24.969568 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 197/405] 10.222.0.30 () {56 vars in 1180 bytes} [Sun Sep 4 00:45:24 2022] GET /identity/v3/groups/0a43ca6c71234a1895f86d07348e8845 => generated 226 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:45:24.976040 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8f25a-320b-4589-9393-214e47388e65 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:24.985930 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:24.995818 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd4dc0-a726-4974-8745-7359a293b8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:24.996855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd4dc0-a726-4974-8745-7359a293b8e4 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:24.997329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd4dc0-a726-4974-8745-7359a293b8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:24.997833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd4dc0-a726-4974-8745-7359a293b8e4 None admin] PATH_INFO: `/v3/groups/0a43ca6c71234a1895f86d07348e8845` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:24.999177 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd4dc0-a726-4974-8745-7359a293b8e4 None admin] RBAC: Authorizing `identity:get_group(group_id=0a43ca6c71234a1895f86d07348e8845)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:25.000847 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd4dc0-a726-4974-8745-7359a293b8e4 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:25.003251 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 209/406] 10.222.0.30 () {56 vars in 1180 bytes} [Sun Sep 4 00:45:24 2022] GET /identity/v3/groups/0a43ca6c71234a1895f86d07348e8845 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:45:25.008741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd4dc0-a726-4974-8745-7359a293b8e4 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:25.095593 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:25.124002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8f25a-320b-4589-9393-214e47388e65 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:25.141290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd4dc0-a726-4974-8745-7359a293b8e4 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:25.169186 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1e65b-ba48-4126-8387-04604dae5bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:25.170503 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1e65b-ba48-4126-8387-04604dae5bf7 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:25.171192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1e65b-ba48-4126-8387-04604dae5bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:25.171764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1e65b-ba48-4126-8387-04604dae5bf7 None admin] PATH_INFO: `/v3/projects/904901a056914acebf292730fd309f87` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:25.173531 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b1e65b-ba48-4126-8387-04604dae5bf7 None admin] RBAC: Authorizing `identity:get_project(project_id=904901a056914acebf292730fd309f87)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:25.175479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b1e65b-ba48-4126-8387-04604dae5bf7 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:25.177522 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 198/407] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:45:24 2022] GET /identity/v3/projects/904901a056914acebf292730fd309f87 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:25.177988 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8d915-6e26-4074-a07d-bbc1203a46e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:25.178657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1e65b-ba48-4126-8387-04604dae5bf7 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:25.178807 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8d915-6e26-4074-a07d-bbc1203a46e4 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:25.179195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8d915-6e26-4074-a07d-bbc1203a46e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:25.179534 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8d915-6e26-4074-a07d-bbc1203a46e4 None admin] PATH_INFO: `/v3/projects/904901a056914acebf292730fd309f87` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:25.180775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8d915-6e26-4074-a07d-bbc1203a46e4 None admin] RBAC: Authorizing `identity:get_project(project_id=904901a056914acebf292730fd309f87)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:25.182461 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8d915-6e26-4074-a07d-bbc1203a46e4 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:25.184211 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 210/408] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:45:25 2022] GET /identity/v3/projects/904901a056914acebf292730fd309f87 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:45:25.185550 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8d915-6e26-4074-a07d-bbc1203a46e4 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:25.252309 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:25.294428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8d915-6e26-4074-a07d-bbc1203a46e4 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:25.311748 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1e65b-ba48-4126-8387-04604dae5bf7 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:25.330503 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3379b89-377d-4081-a8b8-5142bf1f65cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:25.331489 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3379b89-377d-4081-a8b8-5142bf1f65cb None admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:25.332027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3379b89-377d-4081-a8b8-5142bf1f65cb None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:25.332475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3379b89-377d-4081-a8b8-5142bf1f65cb None admin] PATH_INFO: `/v3/projects/904901a056914acebf292730fd309f87/groups/0a43ca6c71234a1895f86d07348e8845/roles/c6d447182cac4a6ca92d2457e8936b91` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:25.334986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3379b89-377d-4081-a8b8-5142bf1f65cb None admin] RBAC: Authorizing `identity:create_grant(project_id=904901a056914acebf292730fd309f87, group_id=0a43ca6c71234a1895f86d07348e8845, role_id=c6d447182cac4a6ca92d2457e8936b91)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:25.337418 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3379b89-377d-4081-a8b8-5142bf1f65cb None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:25.352418 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc2b88-f562-4db6-9234-47aafaec92a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:25.353192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc2b88-f562-4db6-9234-47aafaec92a3 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:25.353600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc2b88-f562-4db6-9234-47aafaec92a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:25.353982 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc2b88-f562-4db6-9234-47aafaec92a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:25.355645 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 211/409] 10.222.0.30 () {58 vars in 1442 bytes} [Sun Sep 4 00:45:25 2022] PUT /identity/v3/projects/904901a056914acebf292730fd309f87/groups/0a43ca6c71234a1895f86d07348e8845/roles/c6d447182cac4a6ca92d2457e8936b91 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:45:25.357682 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3379b89-377d-4081-a8b8-5142bf1f65cb None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:25.366980 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc2b88-f562-4db6-9234-47aafaec92a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:25.373759 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-90fc2b88-f562-4db6-9234-47aafaec92a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:45:25.373759 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:25.373759 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:25.373759 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:25.373759 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:25.373759 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:25.373759 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:25.373759 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:25.373759 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:25.373759 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:25.373759 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:25.373759 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:25.373759 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:25.373759 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:25.373759 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:25.373759 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:25.374882 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:25.374882 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:25.374882 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:25.374882 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:25.374882 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:25.374882 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:25.374882 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:25.374882 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:25.374882 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:25.374882 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:25.374882 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:25.374882 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:25.374882 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:25.374882 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:25.374882 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:25.374882 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:25.375896 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:25.375896 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:25.375896 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:25.375896 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:25.375896 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:25.375896 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:25.375896 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:25.375896 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:25.375896 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:25.375896 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:25.375896 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:45:25.375896 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:25.377480 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 199/410] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Sep 4 00:45:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:25.393815 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc2b88-f562-4db6-9234-47aafaec92a3 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:25.415680 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:25.505060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3379b89-377d-4081-a8b8-5142bf1f65cb None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:25.536334 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:25.556010 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a2e45-47cd-4ac0-b06f-f03bae716385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:25.556666 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a2e45-47cd-4ac0-b06f-f03bae716385 None admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:25.556940 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a2e45-47cd-4ac0-b06f-f03bae716385 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:25.557291 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a2e45-47cd-4ac0-b06f-f03bae716385 None admin] PATH_INFO: `/v3/projects/904901a056914acebf292730fd309f87/groups/0a43ca6c71234a1895f86d07348e8845/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:25.565322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3a2e45-47cd-4ac0-b06f-f03bae716385 None admin] RBAC: Authorizing `identity:create_grant(project_id=904901a056914acebf292730fd309f87, group_id=0a43ca6c71234a1895f86d07348e8845, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:25.567069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3a2e45-47cd-4ac0-b06f-f03bae716385 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:25.582958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc2b88-f562-4db6-9234-47aafaec92a3 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:25.590338 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 212/411] 10.222.0.30 () {58 vars in 1442 bytes} [Sun Sep 4 00:45:25 2022] PUT /identity/v3/projects/904901a056914acebf292730fd309f87/groups/0a43ca6c71234a1895f86d07348e8845/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:45:25.630243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2927a42-0da0-401e-87c8-db61caf87cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:25.631297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2927a42-0da0-401e-87c8-db61caf87cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:25.631809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2927a42-0da0-401e-87c8-db61caf87cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:25.632300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2927a42-0da0-401e-87c8-db61caf87cf5 None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:25.633279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2927a42-0da0-401e-87c8-db61caf87cf5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:25.634344 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2927a42-0da0-401e-87c8-db61caf87cf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:25.635997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2927a42-0da0-401e-87c8-db61caf87cf5 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:25.651226 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 200/412] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:45:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:25.653045 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a2e45-47cd-4ac0-b06f-f03bae716385 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:25.773139 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a2e45-47cd-4ac0-b06f-f03bae716385 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:25.773997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d03145-c589-4dba-8832-bab2d6186e07 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:25.774508 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d03145-c589-4dba-8832-bab2d6186e07 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:25.775155 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d03145-c589-4dba-8832-bab2d6186e07 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:25.777979 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 201/413] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 04 00:45:25.785554 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874c9a7-561a-4a9f-8acf-6a16cbad254a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:25.786674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874c9a7-561a-4a9f-8acf-6a16cbad254a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:25.787160 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874c9a7-561a-4a9f-8acf-6a16cbad254a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:25.810890 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-1874c9a7-561a-4a9f-8acf-6a16cbad254a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:25.812084 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1874c9a7-561a-4a9f-8acf-6a16cbad254a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:25.818144 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766afb5-5c6f-4a94-a0b6-734233bb51a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:25.818772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766afb5-5c6f-4a94-a0b6-734233bb51a0 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:25.819047 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766afb5-5c6f-4a94-a0b6-734233bb51a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:25.819314 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766afb5-5c6f-4a94-a0b6-734233bb51a0 None admin] PATH_INFO: `/v3/groups/b66749657afd4a758deb8d136606ff0a` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:25.821345 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766afb5-5c6f-4a94-a0b6-734233bb51a0 None admin] RBAC: Authorizing `identity:get_group(group_id=b66749657afd4a758deb8d136606ff0a)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:25.823230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766afb5-5c6f-4a94-a0b6-734233bb51a0 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:25.825760 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 213/414] 10.222.0.30 () {56 vars in 1180 bytes} [Sun Sep 4 00:45:25 2022] GET /identity/v3/groups/b66749657afd4a758deb8d136606ff0a => generated 229 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:45:25.827146 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f06fb-dd41-4261-8832-221856f03c2f None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:25.827815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f06fb-dd41-4261-8832-221856f03c2f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:25.828090 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f06fb-dd41-4261-8832-221856f03c2f None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:25.829577 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 214/415] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:25.832314 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f06fb-dd41-4261-8832-221856f03c2f None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:25.895156 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:25.902227 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:25.908687 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 202/416] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:25.909966 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf55b25-1647-46ab-a84a-4bd66457b407 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:25.910248 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf55b25-1647-46ab-a84a-4bd66457b407 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:25.910695 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf55b25-1647-46ab-a84a-4bd66457b407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:25.933374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-adf55b25-1647-46ab-a84a-4bd66457b407 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:25.934713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-adf55b25-1647-46ab-a84a-4bd66457b407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:26.012301 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 203/417] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:26.018728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f06fb-dd41-4261-8832-221856f03c2f None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:26.077810 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed5a14-be18-4b27-bc36-22ec624232d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:26.078684 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed5a14-be18-4b27-bc36-22ec624232d8 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:26.079124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed5a14-be18-4b27-bc36-22ec624232d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:26.079552 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed5a14-be18-4b27-bc36-22ec624232d8 None admin] PATH_INFO: `/v3/projects/6638e0942c764685b0292b0ca0b1b3e5` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:26.086113 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed5a14-be18-4b27-bc36-22ec624232d8 None admin] RBAC: Authorizing `identity:get_project(project_id=6638e0942c764685b0292b0ca0b1b3e5)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:26.087762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed5a14-be18-4b27-bc36-22ec624232d8 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:26.089560 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 215/418] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:45:25 2022] GET /identity/v3/projects/6638e0942c764685b0292b0ca0b1b3e5 => generated 344 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:45:26.095473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf55b25-1647-46ab-a84a-4bd66457b407 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:26.241675 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed5a14-be18-4b27-bc36-22ec624232d8 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:26.244362 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf55b25-1647-46ab-a84a-4bd66457b407 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:26.298527 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:26.309338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b6964-df89-4e06-a7e5-6e79fde475fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:26.310043 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b6964-df89-4e06-a7e5-6e79fde475fa None admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:26.310323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b6964-df89-4e06-a7e5-6e79fde475fa None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:26.310594 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b6964-df89-4e06-a7e5-6e79fde475fa None admin] PATH_INFO: `/v3/projects/6638e0942c764685b0292b0ca0b1b3e5/groups/b66749657afd4a758deb8d136606ff0a/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:26.314766 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b6964-df89-4e06-a7e5-6e79fde475fa None admin] RBAC: Authorizing `identity:create_grant(project_id=6638e0942c764685b0292b0ca0b1b3e5, group_id=b66749657afd4a758deb8d136606ff0a, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:26.316935 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b6964-df89-4e06-a7e5-6e79fde475fa None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:26.340169 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 204/419] 10.222.0.30 () {58 vars in 1442 bytes} [Sun Sep 4 00:45:26 2022] PUT /identity/v3/projects/6638e0942c764685b0292b0ca0b1b3e5/groups/b66749657afd4a758deb8d136606ff0a/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:45:26.341587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b6964-df89-4e06-a7e5-6e79fde475fa None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:26.384376 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed5a14-be18-4b27-bc36-22ec624232d8 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:26.413121 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:26.464404 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071411a-4a98-4e12-b985-4c8b53215a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:26.465058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071411a-4a98-4e12-b985-4c8b53215a47 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:26.465334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071411a-4a98-4e12-b985-4c8b53215a47 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:26.465630 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071411a-4a98-4e12-b985-4c8b53215a47 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:26.486962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f071411a-4a98-4e12-b985-4c8b53215a47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:26.492660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-f071411a-4a98-4e12-b985-4c8b53215a47 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 04 00:45:26.492660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:26.492660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:26.492660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:26.492660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:26.492660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:26.492660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:26.492660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:26.492660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:26.492660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:26.492660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:26.492660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:26.492660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:26.492660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:26.492660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:26.492660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:26.493680 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:26.493680 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:26.493680 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:26.493680 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:26.493680 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:26.493680 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:26.493680 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:26.493680 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:26.493680 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:26.493680 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:26.493680 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:26.493680 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:26.493680 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:26.493680 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:26.493680 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:26.493680 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:26.494515 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:26.494515 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:26.494515 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:26.494515 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:26.494515 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:26.494515 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:26.494515 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:26.494515 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:26.494515 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:26.494515 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:26.494515 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 04 00:45:26.494515 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:26.494515 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 216/420] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Sep 4 00:45:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:45:26.499914 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071411a-4a98-4e12-b985-4c8b53215a47 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:26.515028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b6964-df89-4e06-a7e5-6e79fde475fa None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:26.569989 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda29b1-b9f7-4968-8954-dcb5790b348d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:26.571135 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda29b1-b9f7-4968-8954-dcb5790b348d None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:26.571427 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda29b1-b9f7-4968-8954-dcb5790b348d None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:26.571699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda29b1-b9f7-4968-8954-dcb5790b348d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:26.583359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeda29b1-b9f7-4968-8954-dcb5790b348d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:26.589268 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-eeda29b1-b9f7-4968-8954-dcb5790b348d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 04 00:45:26.589268 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:26.589268 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:26.589268 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:26.589268 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:26.589268 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:26.589268 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:26.589268 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:26.589268 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:26.589268 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:26.589268 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:26.589268 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:26.589268 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:26.589268 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:26.589268 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:26.589268 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:26.590226 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:26.590226 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:26.590226 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:26.590226 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:26.590226 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:26.590226 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:26.590226 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:26.590226 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:26.590226 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:26.590226 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:26.590226 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:26.590226 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:26.590226 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:26.590226 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:26.590226 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:26.590226 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:26.591002 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:26.591002 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:26.591002 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:26.591002 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:26.591002 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:26.591002 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:26.591002 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:26.591002 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:26.591002 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:26.591002 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:26.591002 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 04 00:45:26.591002 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:26.591002 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 205/421] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:45:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:26.611387 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda29b1-b9f7-4968-8954-dcb5790b348d None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:26.626535 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071411a-4a98-4e12-b985-4c8b53215a47 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:26.664509 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd1b18-8252-40af-a2c8-f5b9b287e435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:26.665522 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd1b18-8252-40af-a2c8-f5b9b287e435 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:26.666561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd1b18-8252-40af-a2c8-f5b9b287e435 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:26.667049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd1b18-8252-40af-a2c8-f5b9b287e435 None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:26.667908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd1b18-8252-40af-a2c8-f5b9b287e435 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:26.668416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd1b18-8252-40af-a2c8-f5b9b287e435 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:26.670097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd1b18-8252-40af-a2c8-f5b9b287e435 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:26.680168 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 217/422] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:45:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:45:26.687269 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd1b18-8252-40af-a2c8-f5b9b287e435 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:26.727565 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:26.771103 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:26.823957 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda29b1-b9f7-4968-8954-dcb5790b348d None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:26.848784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd1b18-8252-40af-a2c8-f5b9b287e435 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:26.900290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f7a6c-72d0-4524-be99-2a4881db7afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:26.901893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f7a6c-72d0-4524-be99-2a4881db7afa None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:26.902453 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f7a6c-72d0-4524-be99-2a4881db7afa None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:26.902931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f7a6c-72d0-4524-be99-2a4881db7afa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:26.908983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58d6c7-ef2b-4f6a-b955-a79c94a21ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:26.908983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58d6c7-ef2b-4f6a-b955-a79c94a21ccc None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:26.908983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58d6c7-ef2b-4f6a-b955-a79c94a21ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:26.908983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58d6c7-ef2b-4f6a-b955-a79c94a21ccc None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:26.909719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58d6c7-ef2b-4f6a-b955-a79c94a21ccc None admin] RBAC: Adding query filter params (name=member) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:26.909719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58d6c7-ef2b-4f6a-b955-a79c94a21ccc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:26.909719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58d6c7-ef2b-4f6a-b955-a79c94a21ccc None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:26.916917 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 206/423] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Sep 4 00:45:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:45:26.922277 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58d6c7-ef2b-4f6a-b955-a79c94a21ccc None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:27.054474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f7a6c-72d0-4524-be99-2a4881db7afa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:27.055502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58d6c7-ef2b-4f6a-b955-a79c94a21ccc None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:27.056475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f7a6c-72d0-4524-be99-2a4881db7afa None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:27.070023 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:27.092840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e8c3c-7534-4049-93f7-b2f4a61539b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:27.093486 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e8c3c-7534-4049-93f7-b2f4a61539b3 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:27.093775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e8c3c-7534-4049-93f7-b2f4a61539b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:27.094053 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e8c3c-7534-4049-93f7-b2f4a61539b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:27.145017 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:27.232404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e8c3c-7534-4049-93f7-b2f4a61539b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:27.235755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e8c3c-7534-4049-93f7-b2f4a61539b3 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:27.253282 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 218/424] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:45:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 04 00:45:27.259412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f7a6c-72d0-4524-be99-2a4881db7afa None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:27.413050 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 207/425] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:45:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 04 00:45:27.421082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e8c3c-7534-4049-93f7-b2f4a61539b3 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:27.443874 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:27.451423 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f7a6c-72d0-4524-be99-2a4881db7afa None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:27.511535 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad568f-e970-485f-9d80-19e9b98da176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:27.512161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad568f-e970-485f-9d80-19e9b98da176 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:27.512434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad568f-e970-485f-9d80-19e9b98da176 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:27.512702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad568f-e970-485f-9d80-19e9b98da176 None admin] PATH_INFO: `/v3/projects/97a75aeee8d742edb0aa9858a8c2eede` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:27.514568 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecad568f-e970-485f-9d80-19e9b98da176 None admin] RBAC: Authorizing `identity:get_project(project_id=97a75aeee8d742edb0aa9858a8c2eede)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:27.516003 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecad568f-e970-485f-9d80-19e9b98da176 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:27.520388 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 219/426] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:45:27 2022] GET /identity/v3/projects/97a75aeee8d742edb0aa9858a8c2eede => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:27.522999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad568f-e970-485f-9d80-19e9b98da176 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:27.541788 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:27.605289 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e8c3c-7534-4049-93f7-b2f4a61539b3 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:27.669685 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f1257-8719-4ec8-a1d5-691a6a61d916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:27.670248 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f1257-8719-4ec8-a1d5-691a6a61d916 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:27.670524 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f1257-8719-4ec8-a1d5-691a6a61d916 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:27.670791 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f1257-8719-4ec8-a1d5-691a6a61d916 None admin] PATH_INFO: `/v3/projects/97a75aeee8d742edb0aa9858a8c2eede` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:27.672039 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f1257-8719-4ec8-a1d5-691a6a61d916 None admin] RBAC: Authorizing `identity:get_project(project_id=97a75aeee8d742edb0aa9858a8c2eede)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:27.673526 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f1257-8719-4ec8-a1d5-691a6a61d916 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:27.675483 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 208/427] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:45:27 2022] GET /identity/v3/projects/97a75aeee8d742edb0aa9858a8c2eede => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:45:27.681337 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f1257-8719-4ec8-a1d5-691a6a61d916 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:27.704074 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad568f-e970-485f-9d80-19e9b98da176 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:27.763443 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5973b-49a5-4d85-bc0c-c11b749323c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:27.764069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5973b-49a5-4d85-bc0c-c11b749323c0 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:27.764345 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5973b-49a5-4d85-bc0c-c11b749323c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:27.764613 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5973b-49a5-4d85-bc0c-c11b749323c0 None admin] PATH_INFO: `/v3/groups/0a43ca6c71234a1895f86d07348e8845` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:27.765735 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5973b-49a5-4d85-bc0c-c11b749323c0 None admin] RBAC: Authorizing `identity:get_group(group_id=0a43ca6c71234a1895f86d07348e8845)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:27.767166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5973b-49a5-4d85-bc0c-c11b749323c0 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:27.768975 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 220/428] 10.222.0.30 () {56 vars in 1180 bytes} [Sun Sep 4 00:45:27 2022] GET /identity/v3/groups/0a43ca6c71234a1895f86d07348e8845 => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:45:27.770112 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2b45d-2e6c-42e1-b38b-f0f2c565d745 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:27.770389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2b45d-2e6c-42e1-b38b-f0f2c565d745 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:27.770661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2b45d-2e6c-42e1-b38b-f0f2c565d745 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:27.771838 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 221/429] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:27.776862 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2b45d-2e6c-42e1-b38b-f0f2c565d745 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:27.804233 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:27.831616 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f1257-8719-4ec8-a1d5-691a6a61d916 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:27.860181 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:27.873731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375315c8-f72c-4a54-a2e8-27cb946a419b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:27.874361 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375315c8-f72c-4a54-a2e8-27cb946a419b None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:27.874639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375315c8-f72c-4a54-a2e8-27cb946a419b None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:27.874915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375315c8-f72c-4a54-a2e8-27cb946a419b None admin] PATH_INFO: `/v3/groups/0a43ca6c71234a1895f86d07348e8845` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:27.876044 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375315c8-f72c-4a54-a2e8-27cb946a419b None admin] RBAC: Authorizing `identity:get_group(group_id=0a43ca6c71234a1895f86d07348e8845)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:27.877511 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375315c8-f72c-4a54-a2e8-27cb946a419b None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:27.879075 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 209/430] 10.222.0.30 () {56 vars in 1180 bytes} [Sun Sep 4 00:45:27 2022] GET /identity/v3/groups/0a43ca6c71234a1895f86d07348e8845 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:45:27.880234 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578053e-40d7-49cd-bc8c-63c6478fb9cb None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:27.880519 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578053e-40d7-49cd-bc8c-63c6478fb9cb None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:27.880792 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578053e-40d7-49cd-bc8c-63c6478fb9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:27.886202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2b45d-2e6c-42e1-b38b-f0f2c565d745 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:27.899873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-2578053e-40d7-49cd-bc8c-63c6478fb9cb None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:27.901057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2578053e-40d7-49cd-bc8c-63c6478fb9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:27.922435 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0b852-6d38-475e-8505-6f87fffdf6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:27.923280 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0b852-6d38-475e-8505-6f87fffdf6dd None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:27.923726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0b852-6d38-475e-8505-6f87fffdf6dd None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:27.924259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0b852-6d38-475e-8505-6f87fffdf6dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:27.925273 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed0b852-6d38-475e-8505-6f87fffdf6dd None admin] RBAC: Adding query filter params (group.id=0a43ca6c71234a1895f86d07348e8845, role.id=c6d447182cac4a6ca92d2457e8936b91, scope.project.id=97a75aeee8d742edb0aa9858a8c2eede) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:27.925805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed0b852-6d38-475e-8505-6f87fffdf6dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:27.927418 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed0b852-6d38-475e-8505-6f87fffdf6dd None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:27.933460 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 222/431] 10.222.0.30 () {56 vars in 1376 bytes} [Sun Sep 4 00:45:27 2022] GET /identity/v3/role_assignments?group.id=0a43ca6c71234a1895f86d07348e8845&scope.project.id=97a75aeee8d742edb0aa9858a8c2eede&role.id=c6d447182cac4a6ca92d2457e8936b91 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:27.934550 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2364f2d-19d2-4e76-8f1d-e38aa483f981 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:27.934844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2364f2d-19d2-4e76-8f1d-e38aa483f981 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:27.935103 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2364f2d-19d2-4e76-8f1d-e38aa483f981 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:27.936552 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 223/432] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:27.937267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2364f2d-19d2-4e76-8f1d-e38aa483f981 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:27.980666 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 210/433] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:27.982179 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0a8a5-bf54-4577-a18b-d965c437d2a3 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:27.982466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0a8a5-bf54-4577-a18b-d965c437d2a3 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:27.982743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0a8a5-bf54-4577-a18b-d965c437d2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:28.002357 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a0d0a8a5-bf54-4577-a18b-d965c437d2a3 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:28.003550 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a0d0a8a5-bf54-4577-a18b-d965c437d2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:28.072453 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2364f2d-19d2-4e76-8f1d-e38aa483f981 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:28.078263 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 211/434] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:28.111951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5d222-defc-42d6-96d1-04ded7b056c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:28.112881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5d222-defc-42d6-96d1-04ded7b056c7 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:28.113370 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5d222-defc-42d6-96d1-04ded7b056c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:28.113891 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5d222-defc-42d6-96d1-04ded7b056c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:28.114808 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5d222-defc-42d6-96d1-04ded7b056c7 None admin] RBAC: Adding query filter params (group.id=0a43ca6c71234a1895f86d07348e8845, role.id=7c1abe5c3a82479484ec5a104ec31f8f, scope.project.id=97a75aeee8d742edb0aa9858a8c2eede) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:28.115357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5d222-defc-42d6-96d1-04ded7b056c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:28.117036 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5d222-defc-42d6-96d1-04ded7b056c7 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:28.123926 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 224/435] 10.222.0.30 () {56 vars in 1376 bytes} [Sun Sep 4 00:45:27 2022] GET /identity/v3/role_assignments?group.id=0a43ca6c71234a1895f86d07348e8845&scope.project.id=97a75aeee8d742edb0aa9858a8c2eede&role.id=7c1abe5c3a82479484ec5a104ec31f8f => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:28.319877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0a8a5-bf54-4577-a18b-d965c437d2a3 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:28.331442 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:28.372316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5d222-defc-42d6-96d1-04ded7b056c7 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:28.384362 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:28.435991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0a8a5-bf54-4577-a18b-d965c437d2a3 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:28.484883 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e494026-ed9a-403c-8881-f8ad83858503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:28.485566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e494026-ed9a-403c-8881-f8ad83858503 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:28.485842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e494026-ed9a-403c-8881-f8ad83858503 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:28.486107 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e494026-ed9a-403c-8881-f8ad83858503 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:28.499217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e494026-ed9a-403c-8881-f8ad83858503 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:28.503137 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-6e494026-ed9a-403c-8881-f8ad83858503 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 04 00:45:28.503137 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:28.503137 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:28.503137 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:28.503137 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:28.503137 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:28.503137 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:28.503137 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:28.503137 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:28.503137 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:28.503137 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:28.503137 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:28.503137 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:28.503137 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:28.503137 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:28.503137 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:28.504017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:28.504017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:28.504017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:28.504017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:28.504017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:28.504017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:28.504017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:28.504017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:28.504017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:28.504017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:28.504017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:28.504017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:28.504017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:28.504017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:28.504017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:28.504017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:28.510286 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:28.510286 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:28.510286 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:28.510286 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:28.510286 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:28.510286 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:28.510286 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:28.510286 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:28.510286 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:28.510286 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:28.510286 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 04 00:45:28.510286 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:28.510286 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 212/436] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Sep 4 00:45:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:28.512597 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e494026-ed9a-403c-8881-f8ad83858503 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:28.514494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5d222-defc-42d6-96d1-04ded7b056c7 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:28.561523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24450c8-791e-403c-92eb-be2b4cf0e190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:28.562163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24450c8-791e-403c-92eb-be2b4cf0e190 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:28.562441 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24450c8-791e-403c-92eb-be2b4cf0e190 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:28.562712 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24450c8-791e-403c-92eb-be2b4cf0e190 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:28.579514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24450c8-791e-403c-92eb-be2b4cf0e190 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:28.584802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-f24450c8-791e-403c-92eb-be2b4cf0e190 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 04 00:45:28.584802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:28.584802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:28.584802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:28.584802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:28.584802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:28.584802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:28.584802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:28.584802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:28.584802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:28.584802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:28.584802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:28.584802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:28.584802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:28.584802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:28.584802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:28.585692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:28.585692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:28.585692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:28.585692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:28.585692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:28.585692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:28.585692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:28.585692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:28.585692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:28.585692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:28.585692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:28.585692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:28.585692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:28.585692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:28.585692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:28.585692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:28.586524 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:28.586524 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:28.586524 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:28.586524 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:28.586524 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:28.586524 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:28.586524 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:28.586524 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:28.586524 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:28.586524 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:28.586524 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 04 00:45:28.586524 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:28.586524 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 225/437] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:45:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:28.592819 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24450c8-791e-403c-92eb-be2b4cf0e190 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:28.600070 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:28.645236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e494026-ed9a-403c-8881-f8ad83858503 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:28.668572 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:28.688258 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad58e04-26b9-451f-b5d2-418465d00940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:28.688867 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad58e04-26b9-451f-b5d2-418465d00940 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:28.689141 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad58e04-26b9-451f-b5d2-418465d00940 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:28.689407 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad58e04-26b9-451f-b5d2-418465d00940 None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:28.690098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad58e04-26b9-451f-b5d2-418465d00940 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:28.691065 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad58e04-26b9-451f-b5d2-418465d00940 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:28.692636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad58e04-26b9-451f-b5d2-418465d00940 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:28.702286 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 213/438] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:45:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:28.703571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7beb37b-248b-4c4f-ba0d-db16f7a78abc None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:28.703795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7beb37b-248b-4c4f-ba0d-db16f7a78abc None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:28.704062 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7beb37b-248b-4c4f-ba0d-db16f7a78abc None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:28.705355 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 214/439] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:28.708044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24450c8-791e-403c-92eb-be2b4cf0e190 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:28.710140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7beb37b-248b-4c4f-ba0d-db16f7a78abc None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:28.748638 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09b9c6-8d8b-4517-a724-a25954d3e29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:28.749245 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09b9c6-8d8b-4517-a724-a25954d3e29d None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:28.749560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09b9c6-8d8b-4517-a724-a25954d3e29d None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:28.749833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09b9c6-8d8b-4517-a724-a25954d3e29d None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:28.750494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09b9c6-8d8b-4517-a724-a25954d3e29d None admin] RBAC: Adding query filter params (name=member) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:28.750797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09b9c6-8d8b-4517-a724-a25954d3e29d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:28.752159 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09b9c6-8d8b-4517-a724-a25954d3e29d None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:28.761335 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 226/440] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Sep 4 00:45:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:45:28.763900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38229fe-c38b-4590-87b6-768a64dcd4f3 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:28.763900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38229fe-c38b-4590-87b6-768a64dcd4f3 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:28.764076 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38229fe-c38b-4590-87b6-768a64dcd4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:28.784932 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-b38229fe-c38b-4590-87b6-768a64dcd4f3 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:28.786412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b38229fe-c38b-4590-87b6-768a64dcd4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:28.822487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7beb37b-248b-4c4f-ba0d-db16f7a78abc None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:28.850873 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:28.853357 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 227/441] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:28.854224 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38229fe-c38b-4590-87b6-768a64dcd4f3 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:28.857920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3596447-49fb-4b10-9b1c-e66c8ce54f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:28.858525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3596447-49fb-4b10-9b1c-e66c8ce54f96 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:28.858799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3596447-49fb-4b10-9b1c-e66c8ce54f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:28.859067 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3596447-49fb-4b10-9b1c-e66c8ce54f96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:28.912116 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:28.936427 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3596447-49fb-4b10-9b1c-e66c8ce54f96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:28.938022 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3596447-49fb-4b10-9b1c-e66c8ce54f96 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:28.955692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38229fe-c38b-4590-87b6-768a64dcd4f3 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:28.991905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87617c30-540e-4818-bfb0-3a572be83f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:28.993102 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87617c30-540e-4818-bfb0-3a572be83f75 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:28.993385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87617c30-540e-4818-bfb0-3a572be83f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:28.993831 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87617c30-540e-4818-bfb0-3a572be83f75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:29.038383 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 215/442] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:45:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 04 00:45:29.044457 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3596447-49fb-4b10-9b1c-e66c8ce54f96 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:29.070216 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87617c30-540e-4818-bfb0-3a572be83f75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:29.071740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87617c30-540e-4818-bfb0-3a572be83f75 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:29.078328 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:29.131937 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:29.150392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3596447-49fb-4b10-9b1c-e66c8ce54f96 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:29.175316 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 228/443] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:45:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 04 00:45:29.176137 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87617c30-540e-4818-bfb0-3a572be83f75 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:29.185010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728416ec-a7be-43ed-ade3-63b7900a7ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:29.185667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728416ec-a7be-43ed-ade3-63b7900a7ccc None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:29.185952 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728416ec-a7be-43ed-ade3-63b7900a7ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:29.186227 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728416ec-a7be-43ed-ade3-63b7900a7ccc None admin] PATH_INFO: `/v3/projects/904901a056914acebf292730fd309f87` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:29.187348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728416ec-a7be-43ed-ade3-63b7900a7ccc None admin] RBAC: Authorizing `identity:get_project(project_id=904901a056914acebf292730fd309f87)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:29.188790 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728416ec-a7be-43ed-ade3-63b7900a7ccc None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:29.190442 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 216/444] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:45:29 2022] GET /identity/v3/projects/904901a056914acebf292730fd309f87 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:45:29.191258 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728416ec-a7be-43ed-ade3-63b7900a7ccc None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:29.275612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87617c30-540e-4818-bfb0-3a572be83f75 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:29.285113 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:29.289072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728416ec-a7be-43ed-ade3-63b7900a7ccc None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:29.308468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428aeb8-7910-4061-a02d-01f336912e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:29.309147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428aeb8-7910-4061-a02d-01f336912e84 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:29.309444 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428aeb8-7910-4061-a02d-01f336912e84 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:29.309727 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428aeb8-7910-4061-a02d-01f336912e84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:29.319471 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4428aeb8-7910-4061-a02d-01f336912e84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:29.322721 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c7f48-c688-4d27-8b29-d9f47720fcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:29.323340 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c7f48-c688-4d27-8b29-d9f47720fcd5 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:29.323619 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c7f48-c688-4d27-8b29-d9f47720fcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:29.323891 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c7f48-c688-4d27-8b29-d9f47720fcd5 None admin] PATH_INFO: `/v3/projects/904901a056914acebf292730fd309f87` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:29.324286 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-4428aeb8-7910-4061-a02d-01f336912e84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:45:29.324286 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:29.324286 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:29.324286 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:29.324286 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:29.324286 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:29.324286 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:29.324286 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:29.324286 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:29.324286 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:29.324286 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:29.324286 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:29.324286 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:29.324286 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:29.324286 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:29.324286 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:29.325283 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:29.325283 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:29.325283 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:29.325283 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:29.325283 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:29.325283 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:29.325283 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:29.325283 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:29.325283 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:29.325283 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:29.325283 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:29.325283 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:29.325283 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:29.325283 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:29.325283 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:29.325283 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:29.326626 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:29.326626 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:29.326626 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:29.326626 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:29.326626 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:29.326626 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:29.326626 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:29.326626 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:29.326626 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:29.326626 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:29.326626 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:45:29.326626 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:29.326626 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 229/445] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Sep 4 00:45:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:29.326626 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428aeb8-7910-4061-a02d-01f336912e84 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:29.330248 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c7f48-c688-4d27-8b29-d9f47720fcd5 None admin] RBAC: Authorizing `identity:get_project(project_id=904901a056914acebf292730fd309f87)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:29.331799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c7f48-c688-4d27-8b29-d9f47720fcd5 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:29.333457 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 217/446] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:45:29 2022] GET /identity/v3/projects/904901a056914acebf292730fd309f87 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:29.334198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c7f48-c688-4d27-8b29-d9f47720fcd5 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:29.344746 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:29.423861 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428aeb8-7910-4061-a02d-01f336912e84 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:29.432788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c7f48-c688-4d27-8b29-d9f47720fcd5 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:29.459210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2335e-4627-45ed-a86a-f28a37248c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:29.459836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2335e-4627-45ed-a86a-f28a37248c17 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:29.460114 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2335e-4627-45ed-a86a-f28a37248c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:29.460390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2335e-4627-45ed-a86a-f28a37248c17 None admin] PATH_INFO: `/v3/groups/0a43ca6c71234a1895f86d07348e8845` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:29.462035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2335e-4627-45ed-a86a-f28a37248c17 None admin] RBAC: Authorizing `identity:get_group(group_id=0a43ca6c71234a1895f86d07348e8845)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:29.463468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2335e-4627-45ed-a86a-f28a37248c17 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:29.469860 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 230/447] 10.222.0.30 () {56 vars in 1180 bytes} [Sun Sep 4 00:45:29 2022] GET /identity/v3/groups/0a43ca6c71234a1895f86d07348e8845 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:29.469860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2335e-4627-45ed-a86a-f28a37248c17 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:29.475645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ce5b6-0f32-4f0d-9d19-f6ac5e526229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:29.476254 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ce5b6-0f32-4f0d-9d19-f6ac5e526229 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:29.476534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ce5b6-0f32-4f0d-9d19-f6ac5e526229 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:29.476821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ce5b6-0f32-4f0d-9d19-f6ac5e526229 None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:29.478042 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ce5b6-0f32-4f0d-9d19-f6ac5e526229 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:29.478347 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ce5b6-0f32-4f0d-9d19-f6ac5e526229 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:29.479698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ce5b6-0f32-4f0d-9d19-f6ac5e526229 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:29.488023 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 218/448] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:45:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:29.488794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ce5b6-0f32-4f0d-9d19-f6ac5e526229 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:29.515630 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:29.548885 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:29.563427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2335e-4627-45ed-a86a-f28a37248c17 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:29.589007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ce5b6-0f32-4f0d-9d19-f6ac5e526229 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:29.596372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900bf75d-600d-4555-87bf-8db658ace466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:29.596995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bf75d-600d-4555-87bf-8db658ace466 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:29.597273 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bf75d-600d-4555-87bf-8db658ace466 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:29.597580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bf75d-600d-4555-87bf-8db658ace466 None admin] PATH_INFO: `/v3/groups/0a43ca6c71234a1895f86d07348e8845` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:29.598668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900bf75d-600d-4555-87bf-8db658ace466 None admin] RBAC: Authorizing `identity:get_group(group_id=0a43ca6c71234a1895f86d07348e8845)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:29.600094 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900bf75d-600d-4555-87bf-8db658ace466 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:29.601666 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 231/449] 10.222.0.30 () {56 vars in 1180 bytes} [Sun Sep 4 00:45:29 2022] GET /identity/v3/groups/0a43ca6c71234a1895f86d07348e8845 => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:29.602446 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900bf75d-600d-4555-87bf-8db658ace466 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:29.622958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2bf39-c345-447e-9118-3ce71220af4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:29.623555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2bf39-c345-447e-9118-3ce71220af4c None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:29.623833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2bf39-c345-447e-9118-3ce71220af4c None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:29.624104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2bf39-c345-447e-9118-3ce71220af4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:29.624862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b2bf39-c345-447e-9118-3ce71220af4c None admin] RBAC: Adding query filter params (group.id=0a43ca6c71234a1895f86d07348e8845, role.id=c6d447182cac4a6ca92d2457e8936b91, scope.project.id=904901a056914acebf292730fd309f87) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:29.625166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b2bf39-c345-447e-9118-3ce71220af4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:29.626638 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b2bf39-c345-447e-9118-3ce71220af4c None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:29.632248 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 219/450] 10.222.0.30 () {56 vars in 1376 bytes} [Sun Sep 4 00:45:29 2022] GET /identity/v3/role_assignments?group.id=0a43ca6c71234a1895f86d07348e8845&scope.project.id=904901a056914acebf292730fd309f87&role.id=c6d447182cac4a6ca92d2457e8936b91 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:29.633017 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2bf39-c345-447e-9118-3ce71220af4c None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:29.713856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900bf75d-600d-4555-87bf-8db658ace466 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:29.735702 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:29.744986 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2bf39-c345-447e-9118-3ce71220af4c None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:29.754958 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97c6e5-84d1-4ecf-a1bb-ee63012ef6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:29.755592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97c6e5-84d1-4ecf-a1bb-ee63012ef6bf None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:29.755909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97c6e5-84d1-4ecf-a1bb-ee63012ef6bf None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:29.756455 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97c6e5-84d1-4ecf-a1bb-ee63012ef6bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:29.784162 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dddc3bc-30d5-4515-a7f9-c2d2f3247e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:29.784795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddc3bc-30d5-4515-a7f9-c2d2f3247e60 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:29.785049 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddc3bc-30d5-4515-a7f9-c2d2f3247e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:29.785326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddc3bc-30d5-4515-a7f9-c2d2f3247e60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:29.786056 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:29.786165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dddc3bc-30d5-4515-a7f9-c2d2f3247e60 None admin] RBAC: Adding query filter params (group.id=0a43ca6c71234a1895f86d07348e8845, role.id=7c1abe5c3a82479484ec5a104ec31f8f, scope.project.id=904901a056914acebf292730fd309f87) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:29.786940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dddc3bc-30d5-4515-a7f9-c2d2f3247e60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:29.787913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dddc3bc-30d5-4515-a7f9-c2d2f3247e60 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:29.797848 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 220/451] 10.222.0.30 () {56 vars in 1376 bytes} [Sun Sep 4 00:45:29 2022] GET /identity/v3/role_assignments?group.id=0a43ca6c71234a1895f86d07348e8845&scope.project.id=904901a056914acebf292730fd309f87&role.id=7c1abe5c3a82479484ec5a104ec31f8f => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:29.841863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97c6e5-84d1-4ecf-a1bb-ee63012ef6bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:29.843375 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97c6e5-84d1-4ecf-a1bb-ee63012ef6bf None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:29.950103 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 232/452] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:45:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 04 00:45:29.955902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dddc3bc-30d5-4515-a7f9-c2d2f3247e60 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:30.059367 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dddc3bc-30d5-4515-a7f9-c2d2f3247e60 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:30.093073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa9e9f-7503-43b4-85da-2dcb3c0b1506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:30.093800 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa9e9f-7503-43b4-85da-2dcb3c0b1506 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:30.094080 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa9e9f-7503-43b4-85da-2dcb3c0b1506 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:30.094349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa9e9f-7503-43b4-85da-2dcb3c0b1506 None admin] PATH_INFO: `/v3/projects/6638e0942c764685b0292b0ca0b1b3e5` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:30.095464 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa9e9f-7503-43b4-85da-2dcb3c0b1506 None admin] RBAC: Authorizing `identity:get_project(project_id=6638e0942c764685b0292b0ca0b1b3e5)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:30.096919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa9e9f-7503-43b4-85da-2dcb3c0b1506 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:30.098567 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 221/453] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:45:29 2022] GET /identity/v3/projects/6638e0942c764685b0292b0ca0b1b3e5 => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:30.104206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97c6e5-84d1-4ecf-a1bb-ee63012ef6bf None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:30.159710 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:30.204957 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97c6e5-84d1-4ecf-a1bb-ee63012ef6bf None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:30.239698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eadf2d-281f-4887-9a6b-4b17ae416ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:30.240324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eadf2d-281f-4887-9a6b-4b17ae416ed6 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:30.240603 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eadf2d-281f-4887-9a6b-4b17ae416ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:30.240870 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eadf2d-281f-4887-9a6b-4b17ae416ed6 None admin] PATH_INFO: `/v3/groups/b66749657afd4a758deb8d136606ff0a` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:30.241985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eadf2d-281f-4887-9a6b-4b17ae416ed6 None admin] RBAC: Authorizing `identity:get_group(group_id=b66749657afd4a758deb8d136606ff0a)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:30.243947 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eadf2d-281f-4887-9a6b-4b17ae416ed6 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:30.245508 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 233/454] 10.222.0.30 () {56 vars in 1180 bytes} [Sun Sep 4 00:45:30 2022] GET /identity/v3/groups/b66749657afd4a758deb8d136606ff0a => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:45:30.251379 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa9e9f-7503-43b4-85da-2dcb3c0b1506 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:30.277396 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:30.348517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa9e9f-7503-43b4-85da-2dcb3c0b1506 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:30.381107 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c572be1-9e47-407e-8ff8-8c18da6dbace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:30.381730 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c572be1-9e47-407e-8ff8-8c18da6dbace None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:30.382007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c572be1-9e47-407e-8ff8-8c18da6dbace None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:30.382277 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c572be1-9e47-407e-8ff8-8c18da6dbace None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:30.382993 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c572be1-9e47-407e-8ff8-8c18da6dbace None admin] RBAC: Adding query filter params (group.id=b66749657afd4a758deb8d136606ff0a, role.id=d255b03c37d64371a148ec4e11be01d9, scope.project.id=6638e0942c764685b0292b0ca0b1b3e5) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:30.383321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c572be1-9e47-407e-8ff8-8c18da6dbace None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:30.384743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c572be1-9e47-407e-8ff8-8c18da6dbace None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:30.390307 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 222/455] 10.222.0.30 () {56 vars in 1376 bytes} [Sun Sep 4 00:45:30 2022] GET /identity/v3/role_assignments?group.id=b66749657afd4a758deb8d136606ff0a&scope.project.id=6638e0942c764685b0292b0ca0b1b3e5&role.id=d255b03c37d64371a148ec4e11be01d9 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:32.619740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452708f-c23a-4c01-84f3-0b10b3e75cbe None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:32.620275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452708f-c23a-4c01-84f3-0b10b3e75cbe None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:32.620275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452708f-c23a-4c01-84f3-0b10b3e75cbe None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:32.622014 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 234/456] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:32.627876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c37e70-2fb8-4813-892f-3eafadab4289 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:32.628695 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c37e70-2fb8-4813-892f-3eafadab4289 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:32.629155 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c37e70-2fb8-4813-892f-3eafadab4289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:32.658419 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a6c37e70-2fb8-4813-892f-3eafadab4289 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:32.659935 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a6c37e70-2fb8-4813-892f-3eafadab4289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:32.740549 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 223/457] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 04 00:45:32.787909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94f034-f71d-4845-841b-d5f47019baf8 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:32.788213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94f034-f71d-4845-841b-d5f47019baf8 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:32.788454 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94f034-f71d-4845-841b-d5f47019baf8 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:32.790097 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 235/458] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:32.798557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25a3b3-b9da-45eb-b216-aa514a8f6dd1 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:32.798845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25a3b3-b9da-45eb-b216-aa514a8f6dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:32.799119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25a3b3-b9da-45eb-b216-aa514a8f6dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:32.826398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-6f25a3b3-b9da-45eb-b216-aa514a8f6dd1 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:32.827585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6f25a3b3-b9da-45eb-b216-aa514a8f6dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:32.844033 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:32.909945 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 224/459] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:33.074692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94f034-f71d-4845-841b-d5f47019baf8 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:33.202798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94f034-f71d-4845-841b-d5f47019baf8 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:33.236301 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:33.251079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076bc86-f585-4aa8-9a5a-7ffcd02d2889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:33.251712 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076bc86-f585-4aa8-9a5a-7ffcd02d2889 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:33.251988 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076bc86-f585-4aa8-9a5a-7ffcd02d2889 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:33.252157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5bd04-7d68-4c55-867b-31e57fa6dc1f None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:33.252320 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076bc86-f585-4aa8-9a5a-7ffcd02d2889 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:33.252734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5bd04-7d68-4c55-867b-31e57fa6dc1f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:33.253157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5bd04-7d68-4c55-867b-31e57fa6dc1f None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:33.254907 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 225/460] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:33.264615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b41c46-679b-4489-99f1-9bcb2e7d5c48 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:33.265192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b41c46-679b-4489-99f1-9bcb2e7d5c48 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:33.265715 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b41c46-679b-4489-99f1-9bcb2e7d5c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:33.267213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076bc86-f585-4aa8-9a5a-7ffcd02d2889 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:33.268659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076bc86-f585-4aa8-9a5a-7ffcd02d2889 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:33.286918 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-d076bc86-f585-4aa8-9a5a-7ffcd02d2889 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:33.286918 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:33.286918 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:33.286918 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:33.286918 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:33.286918 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:33.286918 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:33.286918 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:33.286918 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:33.286918 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:33.286918 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:33.286918 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:33.286918 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:45:33.286918 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:45:33.286918 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:45:33.286918 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:45:33.287868 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:33.287868 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:33.287868 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:33.287868 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:33.287868 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:33.287868 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:33.287868 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:33.287868 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:33.287868 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:33.287868 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:33.287868 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:33.287868 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:33.287868 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:33.287868 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:33.287868 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:33.287868 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:33.287868 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:45:33.288702 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:45:33.288702 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:33.288702 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:33.288702 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 236/461] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:33.289368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076bc86-f585-4aa8-9a5a-7ffcd02d2889 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:33.297487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-f4b41c46-679b-4489-99f1-9bcb2e7d5c48 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:33.298659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f4b41c46-679b-4489-99f1-9bcb2e7d5c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:33.390027 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 226/462] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 04 00:45:33.394416 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b41c46-679b-4489-99f1-9bcb2e7d5c48 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:33.408878 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076bc86-f585-4aa8-9a5a-7ffcd02d2889 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:33.474230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7b7d4-ebb8-4276-a674-0422f94717a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:33.474873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7b7d4-ebb8-4276-a674-0422f94717a4 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:33.475411 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7b7d4-ebb8-4276-a674-0422f94717a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:33.475684 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7b7d4-ebb8-4276-a674-0422f94717a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:33.499114 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7b7d4-ebb8-4276-a674-0422f94717a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:33.500577 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7b7d4-ebb8-4276-a674-0422f94717a4 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:33.530277 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-84b7b7d4-ebb8-4276-a674-0422f94717a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:33.530277 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:33.530277 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:33.530277 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:33.530277 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:33.530277 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:33.530277 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:33.530277 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:33.530277 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:33.530277 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:33.530277 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:33.530277 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:33.530277 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:45:33.530277 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:45:33.530277 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:45:33.530277 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:45:33.531206 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:33.531206 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:33.531206 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:33.531206 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:33.531206 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:33.531206 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:33.531206 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:33.531206 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:33.531206 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:33.531206 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:33.531206 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:33.531206 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:33.531206 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:33.531206 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:33.531206 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:33.531206 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:33.531206 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:45:33.532054 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:45:33.532054 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:33.532054 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:33.532054 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 237/463] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:33.537030 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7b7d4-ebb8-4276-a674-0422f94717a4 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:33.543396 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:33.581633 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b41c46-679b-4489-99f1-9bcb2e7d5c48 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:33.587772 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:33.631027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42812c-253c-4487-9674-3b1f0c165e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:33.632877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42812c-253c-4487-9674-3b1f0c165e96 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:33.633881 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42812c-253c-4487-9674-3b1f0c165e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:33.634291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42812c-253c-4487-9674-3b1f0c165e96 None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:33.635062 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42812c-253c-4487-9674-3b1f0c165e96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:33.637608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42812c-253c-4487-9674-3b1f0c165e96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:33.639599 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42812c-253c-4487-9674-3b1f0c165e96 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:33.655637 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 227/464] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:33.657484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03857e62-b916-45cd-8086-7fc9ffb77221 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:33.657947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03857e62-b916-45cd-8086-7fc9ffb77221 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:33.658387 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03857e62-b916-45cd-8086-7fc9ffb77221 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:33.664410 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 228/465] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:33.664410 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03857e62-b916-45cd-8086-7fc9ffb77221 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:33.676384 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7b7d4-ebb8-4276-a674-0422f94717a4 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:33.714852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a67031-2c7e-428c-803c-1af46cc9db28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:33.715479 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a67031-2c7e-428c-803c-1af46cc9db28 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:33.715756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a67031-2c7e-428c-803c-1af46cc9db28 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:33.716023 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a67031-2c7e-428c-803c-1af46cc9db28 None admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:33.716659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a67031-2c7e-428c-803c-1af46cc9db28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:33.716958 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a67031-2c7e-428c-803c-1af46cc9db28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:33.718366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a67031-2c7e-428c-803c-1af46cc9db28 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:33.731518 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 238/466] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:33.733483 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d935cd-4c9c-48ad-9f4b-4e22604bcac5 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:33.733958 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d935cd-4c9c-48ad-9f4b-4e22604bcac5 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:33.735087 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d935cd-4c9c-48ad-9f4b-4e22604bcac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:33.757180 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-65d935cd-4c9c-48ad-9f4b-4e22604bcac5 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:33.758929 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-65d935cd-4c9c-48ad-9f4b-4e22604bcac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:33.781457 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03857e62-b916-45cd-8086-7fc9ffb77221 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:33.820313 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12e926-b24c-433a-93d5-b70223995ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:33.821490 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12e926-b24c-433a-93d5-b70223995ab4 None admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:33.821776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12e926-b24c-433a-93d5-b70223995ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:33.822042 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12e926-b24c-433a-93d5-b70223995ab4 None admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:33.822874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12e926-b24c-433a-93d5-b70223995ab4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:33.824089 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12e926-b24c-433a-93d5-b70223995ab4 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:33.827287 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 239/467] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:33.827953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d935cd-4c9c-48ad-9f4b-4e22604bcac5 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:33.842692 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:33.846352 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:33.865265 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 229/468] 10.222.0.30 () {60 vars in 1132 bytes} [Sun Sep 4 00:45:33 2022] POST /identity/v3/users => generated 246 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:45:33.866486 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12e926-b24c-433a-93d5-b70223995ab4 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:33.962613 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d935cd-4c9c-48ad-9f4b-4e22604bcac5 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:34.006677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70abadc-23bf-49f3-af1b-4dc819a95478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:34.008004 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70abadc-23bf-49f3-af1b-4dc819a95478 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:34.009099 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70abadc-23bf-49f3-af1b-4dc819a95478 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:34.009592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70abadc-23bf-49f3-af1b-4dc819a95478 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:34.022155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70abadc-23bf-49f3-af1b-4dc819a95478 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:34.024220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70abadc-23bf-49f3-af1b-4dc819a95478 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:34.042114 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-d70abadc-23bf-49f3-af1b-4dc819a95478 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:34.042114 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:34.042114 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:34.042114 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:34.042114 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:34.042114 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:34.042114 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:34.042114 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:34.042114 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:34.042114 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:34.042114 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:34.042114 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:34.042114 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:45:34.042114 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:45:34.042114 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:45:34.042114 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:45:34.043057 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:34.043057 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:34.043057 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:34.043057 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:34.043057 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:34.043057 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:34.043057 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:34.043057 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:34.043057 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:34.043057 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:34.043057 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:34.043057 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:34.043057 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:34.043057 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:34.043057 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:34.043057 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:34.043057 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:45:34.043903 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:45:34.043903 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:34.043903 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:34.044062 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12e926-b24c-433a-93d5-b70223995ab4 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:34.046466 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 240/469] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:34.057905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70abadc-23bf-49f3-af1b-4dc819a95478 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:34.103803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e5c81-ee9c-4177-adcc-c84b54ef4615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:34.104417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e5c81-ee9c-4177-adcc-c84b54ef4615 None admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:34.104691 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e5c81-ee9c-4177-adcc-c84b54ef4615 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:34.104956 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e5c81-ee9c-4177-adcc-c84b54ef4615 None admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:34.105632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e5c81-ee9c-4177-adcc-c84b54ef4615 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:34.107065 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e5c81-ee9c-4177-adcc-c84b54ef4615 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:34.131534 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 230/470] 10.222.0.30 () {60 vars in 1132 bytes} [Sun Sep 4 00:45:33 2022] POST /identity/v3/users => generated 248 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:45:34.138370 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e5c81-ee9c-4177-adcc-c84b54ef4615 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:34.159551 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:34.206805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70abadc-23bf-49f3-af1b-4dc819a95478 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:34.220146 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:34.259995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a993df-70b2-4532-b40e-c3f2a2b83aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:34.260997 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a993df-70b2-4532-b40e-c3f2a2b83aab None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:34.261899 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a993df-70b2-4532-b40e-c3f2a2b83aab None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:34.262401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a993df-70b2-4532-b40e-c3f2a2b83aab None admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:34.263791 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a993df-70b2-4532-b40e-c3f2a2b83aab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:34.264397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a993df-70b2-4532-b40e-c3f2a2b83aab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:34.266313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a993df-70b2-4532-b40e-c3f2a2b83aab None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:34.284640 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 241/471] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:45:34.291680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a993df-70b2-4532-b40e-c3f2a2b83aab None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:34.295802 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e5c81-ee9c-4177-adcc-c84b54ef4615 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:34.343225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f643fe-471a-44f5-826d-f6b4e822876d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:34.343869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f643fe-471a-44f5-826d-f6b4e822876d None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:34.344154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f643fe-471a-44f5-826d-f6b4e822876d None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:34.344428 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f643fe-471a-44f5-826d-f6b4e822876d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:34.358765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f643fe-471a-44f5-826d-f6b4e822876d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:34.360481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f643fe-471a-44f5-826d-f6b4e822876d None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:34.381425 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-a8f643fe-471a-44f5-826d-f6b4e822876d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:34.381425 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:34.381425 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:34.381425 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:34.381425 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:34.381425 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:34.381425 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:34.381425 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:34.381425 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:34.381425 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:34.381425 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:34.381425 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:34.381425 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:45:34.381425 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:45:34.381425 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:45:34.381425 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:45:34.382656 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:34.382656 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:34.382656 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:34.382656 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:34.382656 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:34.382656 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:34.382656 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:34.382656 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:34.382656 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:34.382656 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:34.382656 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:34.382656 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:34.382656 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:34.382656 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:34.382656 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:34.382656 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:34.382656 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:45:34.383762 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:45:34.383762 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:34.383762 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:34.383762 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 231/472] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:34.384075 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21361d70-d1e6-444b-95b5-dcc8b533fc22 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:34.384358 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21361d70-d1e6-444b-95b5-dcc8b533fc22 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:34.384631 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21361d70-d1e6-444b-95b5-dcc8b533fc22 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:34.386134 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 232/473] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:34.390751 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21361d70-d1e6-444b-95b5-dcc8b533fc22 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:34.415987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a993df-70b2-4532-b40e-c3f2a2b83aab None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:34.460270 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:34.471556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb010dd-d328-4520-b690-3e5947053128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:34.472099 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb010dd-d328-4520-b690-3e5947053128 None admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:34.472375 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb010dd-d328-4520-b690-3e5947053128 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:34.472643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb010dd-d328-4520-b690-3e5947053128 None admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:34.473290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb010dd-d328-4520-b690-3e5947053128 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:34.474769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb010dd-d328-4520-b690-3e5947053128 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:34.502339 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 242/474] 10.222.0.30 () {60 vars in 1132 bytes} [Sun Sep 4 00:45:34 2022] POST /identity/v3/users => generated 248 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:45:34.503665 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3c46d-6bbb-4685-a824-05528a73f0c0 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:34.503943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3c46d-6bbb-4685-a824-05528a73f0c0 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:34.504225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3c46d-6bbb-4685-a824-05528a73f0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:34.522270 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21361d70-d1e6-444b-95b5-dcc8b533fc22 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:34.523195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-21d3c46d-6bbb-4685-a824-05528a73f0c0 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:34.524968 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-21d3c46d-6bbb-4685-a824-05528a73f0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:34.525509 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:34.575436 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0353d-e5d6-472a-a795-7b80c7cc02dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:34.576058 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0353d-e5d6-472a-a795-7b80c7cc02dd None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:34.576335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0353d-e5d6-472a-a795-7b80c7cc02dd None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:34.576650 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0353d-e5d6-472a-a795-7b80c7cc02dd None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:34.577298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0353d-e5d6-472a-a795-7b80c7cc02dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:34.577632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0353d-e5d6-472a-a795-7b80c7cc02dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:34.579080 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0353d-e5d6-472a-a795-7b80c7cc02dd None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:34.597768 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 233/475] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:34.599308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0353d-e5d6-472a-a795-7b80c7cc02dd None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:34.616426 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 243/476] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:34.720371 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0353d-e5d6-472a-a795-7b80c7cc02dd None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:34.756974 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde68e8-c51b-490f-9157-4f1ab5dba8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:34.757529 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde68e8-c51b-490f-9157-4f1ab5dba8da None admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:34.757810 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde68e8-c51b-490f-9157-4f1ab5dba8da None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:34.758121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde68e8-c51b-490f-9157-4f1ab5dba8da None admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:34.758762 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde68e8-c51b-490f-9157-4f1ab5dba8da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:34.760202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde68e8-c51b-490f-9157-4f1ab5dba8da None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:34.790004 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 234/477] 10.222.0.30 () {60 vars in 1132 bytes} [Sun Sep 4 00:45:34 2022] POST /identity/v3/users => generated 249 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 00:45:34.940560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3c46d-6bbb-4685-a824-05528a73f0c0 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:35.051326 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3c46d-6bbb-4685-a824-05528a73f0c0 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:35.067899 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:35.094360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1f73c-72a3-4d0c-b15b-91af2ba8bbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:35.095352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1f73c-72a3-4d0c-b15b-91af2ba8bbcf None admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:35.095930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1f73c-72a3-4d0c-b15b-91af2ba8bbcf None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:35.096401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1f73c-72a3-4d0c-b15b-91af2ba8bbcf None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:35.097280 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1f73c-72a3-4d0c-b15b-91af2ba8bbcf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:35.098886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1f73c-72a3-4d0c-b15b-91af2ba8bbcf None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:35.117485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.sql.core [None req-f3c1f73c-72a3-4d0c-b15b-91af2ba8bbcf None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 04 00:45:35.117485 n-d-master-1 devstack@keystone.service[81824]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 04 00:45:35.117485 n-d-master-1 devstack@keystone.service[81824]: [parameters: {'id': 'f91f8da328934664a6c543a92090280c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 04 00:45:35.117485 n-d-master-1 devstack@keystone.service[81824]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81824) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 04 00:45:35.135184 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-f3c1f73c-72a3-4d0c-b15b-91af2ba8bbcf None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 04 00:45:35.135184 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:35.135184 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 04 00:45:35.135184 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 04 00:45:35.135184 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 04 00:45:35.135184 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 04 00:45:35.135184 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 04 00:45:35.135184 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application result = self._query(query) Sep 04 00:45:35.135184 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 04 00:45:35.135184 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application conn.query(q) Sep 04 00:45:35.135184 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 04 00:45:35.135184 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 04 00:45:35.135184 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 04 00:45:35.135184 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application result.read() Sep 04 00:45:35.135184 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 04 00:45:35.136080 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 04 00:45:35.136080 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 04 00:45:35.136080 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 04 00:45:35.136080 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 04 00:45:35.136080 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 04 00:45:35.136080 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 04 00:45:35.136080 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 04 00:45:35.136080 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 04 00:45:35.136080 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:35.136080 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 04 00:45:35.136080 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:35.136080 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:35.136080 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 04 00:45:35.136080 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 04 00:45:35.136080 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 04 00:45:35.136080 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return ref.to_dict() Sep 04 00:45:35.136080 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 04 00:45:35.136080 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application next(self.gen) Sep 04 00:45:35.137012 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 04 00:45:35.137012 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application yield resource Sep 04 00:45:35.137012 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 04 00:45:35.137012 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application next(self.gen) Sep 04 00:45:35.137012 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 04 00:45:35.137012 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self.session.rollback() Sep 04 00:45:35.137012 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 04 00:45:35.137012 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self.force_reraise() Sep 04 00:45:35.137012 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 04 00:45:35.137012 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise self.value Sep 04 00:45:35.137012 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 04 00:45:35.137012 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 04 00:45:35.137012 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 04 00:45:35.137012 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application session.commit() Sep 04 00:45:35.137012 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 04 00:45:35.137012 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 04 00:45:35.137012 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 04 00:45:35.137905 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._prepare_impl() Sep 04 00:45:35.137905 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 04 00:45:35.137905 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self.session.flush() Sep 04 00:45:35.137905 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 04 00:45:35.137905 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._flush(objects) Sep 04 00:45:35.137905 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 04 00:45:35.137905 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 04 00:45:35.137905 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 04 00:45:35.137905 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application compat.raise_( Sep 04 00:45:35.137905 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 04 00:45:35.137905 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception Sep 04 00:45:35.137905 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 04 00:45:35.137905 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application flush_context.execute() Sep 04 00:45:35.137905 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 04 00:45:35.137905 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rec.execute(self) Sep 04 00:45:35.137905 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 04 00:45:35.137905 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 04 00:45:35.138779 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 04 00:45:35.138779 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 04 00:45:35.138779 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 04 00:45:35.138779 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 04 00:45:35.138779 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 04 00:45:35.138779 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 04 00:45:35.138779 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 04 00:45:35.138779 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 04 00:45:35.138779 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 04 00:45:35.138779 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 04 00:45:35.138779 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 04 00:45:35.138779 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 04 00:45:35.138779 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 04 00:45:35.138779 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 04 00:45:35.138779 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 04 00:45:35.138779 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception Sep 04 00:45:35.139582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 04 00:45:35.139582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 04 00:45:35.139582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 04 00:45:35.139582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 04 00:45:35.139582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 04 00:45:35.139582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application result = self._query(query) Sep 04 00:45:35.139582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 04 00:45:35.139582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application conn.query(q) Sep 04 00:45:35.139582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 04 00:45:35.139582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 04 00:45:35.139582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 04 00:45:35.139582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application result.read() Sep 04 00:45:35.139582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 04 00:45:35.139582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 04 00:45:35.139582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 04 00:45:35.139582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 04 00:45:35.141697 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 04 00:45:35.141697 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 04 00:45:35.141697 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 04 00:45:35.141697 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 04 00:45:35.141697 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 04 00:45:35.141697 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 04 00:45:35.141697 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [parameters: {'id': 'f91f8da328934664a6c543a92090280c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 04 00:45:35.141697 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 04 00:45:35.141697 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:35.141697 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 00:45:35.141697 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:35.141697 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:35.141697 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:35.141697 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:35.141697 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:35.141697 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:35.143606 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:35.143606 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:35.143606 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:35.143606 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:35.143606 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:35.143606 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:35.143606 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 04 00:45:35.143606 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 04 00:45:35.143606 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:35.143606 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:35.143606 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 04 00:45:35.143606 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 04 00:45:35.143606 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 04 00:45:35.143606 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 04 00:45:35.143606 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 04 00:45:35.143606 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:35.147152 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 244/478] 10.222.0.30 () {60 vars in 1131 bytes} [Sun Sep 4 00:45:34 2022] POST /identity/v3/roles => generated 144 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:35.154525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde68e8-c51b-490f-9157-4f1ab5dba8da None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:35.190164 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:35.313977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde68e8-c51b-490f-9157-4f1ab5dba8da None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:35.358315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b103c7-e5c0-4326-bda9-8202eae76e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:35.358957 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b103c7-e5c0-4326-bda9-8202eae76e47 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:35.359235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b103c7-e5c0-4326-bda9-8202eae76e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:35.359762 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b103c7-e5c0-4326-bda9-8202eae76e47 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:35.379573 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b103c7-e5c0-4326-bda9-8202eae76e47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:35.385017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-81b103c7-e5c0-4326-bda9-8202eae76e47 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 04 00:45:35.385017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:35.385017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:35.385017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:35.385017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:35.385017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:35.385017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:35.385017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:35.385017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:35.385017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:35.385017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:35.385017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:35.385017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:35.385017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:35.385017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:35.385017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:35.387094 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:35.387094 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:35.387094 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:35.387094 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:35.387094 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:35.387094 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:35.387094 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:35.387094 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:35.387094 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:35.387094 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:35.387094 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:35.387094 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:35.387094 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:35.387094 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:35.387094 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:35.387094 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:35.388985 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:35.388985 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:35.388985 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:35.388985 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:35.388985 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:35.388985 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:35.388985 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:35.388985 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:35.388985 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:35.388985 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:35.388985 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 04 00:45:35.388985 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:35.388985 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 235/479] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Sep 4 00:45:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:35.392009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1f73c-72a3-4d0c-b15b-91af2ba8bbcf None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:35.557688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1f73c-72a3-4d0c-b15b-91af2ba8bbcf None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:35.592950 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75068790-1316-445b-b5fb-0996cbcfb0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:35.593517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75068790-1316-445b-b5fb-0996cbcfb0f7 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:35.593800 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75068790-1316-445b-b5fb-0996cbcfb0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:35.594074 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75068790-1316-445b-b5fb-0996cbcfb0f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:35.594739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75068790-1316-445b-b5fb-0996cbcfb0f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:35.595042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75068790-1316-445b-b5fb-0996cbcfb0f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:35.596433 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75068790-1316-445b-b5fb-0996cbcfb0f7 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:35.609671 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 245/480] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:45:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:36.511894 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466fb48-d7fd-42a9-b7da-1983e40c0ee9 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:36.512860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466fb48-d7fd-42a9-b7da-1983e40c0ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:36.513333 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466fb48-d7fd-42a9-b7da-1983e40c0ee9 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:36.515196 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 236/481] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:36.520083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc116f-d855-4bd7-8342-3aa0e1032e7d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:36.521683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c1d4c-9af9-4f64-b246-21bf75a92363 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:36.522165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c1d4c-9af9-4f64-b246-21bf75a92363 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:36.522632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c1d4c-9af9-4f64-b246-21bf75a92363 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:36.525177 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 237/482] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:36.525706 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc116f-d855-4bd7-8342-3aa0e1032e7d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:36.526201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc116f-d855-4bd7-8342-3aa0e1032e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:36.529967 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5da2b0-7d7b-41f5-8fc3-e764b1096603 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:36.530466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5da2b0-7d7b-41f5-8fc3-e764b1096603 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:36.530934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5da2b0-7d7b-41f5-8fc3-e764b1096603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:36.560505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-6b5da2b0-7d7b-41f5-8fc3-e764b1096603 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:36.562055 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6b5da2b0-7d7b-41f5-8fc3-e764b1096603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:36.563143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a5bc116f-d855-4bd7-8342-3aa0e1032e7d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:36.566539 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a5bc116f-d855-4bd7-8342-3aa0e1032e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:36.631455 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:36.690689 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 238/483] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 04 00:45:36.699597 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 246/484] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:36.967306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5da2b0-7d7b-41f5-8fc3-e764b1096603 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:36.977821 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:37.061640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc116f-d855-4bd7-8342-3aa0e1032e7d None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:37.092244 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5da2b0-7d7b-41f5-8fc3-e764b1096603 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:37.149106 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a7615-1b9b-4eb0-b70a-ccea3410be7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:37.149763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a7615-1b9b-4eb0-b70a-ccea3410be7c None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:37.150046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a7615-1b9b-4eb0-b70a-ccea3410be7c None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:37.150319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a7615-1b9b-4eb0-b70a-ccea3410be7c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:37.161142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a7615-1b9b-4eb0-b70a-ccea3410be7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:37.166650 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-833a7615-1b9b-4eb0-b70a-ccea3410be7c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:45:37.166650 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:37.166650 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:37.166650 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:37.166650 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:37.166650 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:37.166650 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:37.166650 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:37.166650 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:37.166650 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:37.166650 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:37.166650 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:37.166650 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:37.166650 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:37.166650 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:37.166650 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:37.167531 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:37.167531 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:37.167531 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:37.167531 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:37.167531 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:37.167531 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:37.167531 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:37.167531 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:37.167531 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:37.167531 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:37.167531 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:37.167531 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:37.167531 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:37.167531 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:37.167531 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:37.167531 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:37.168353 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:37.168353 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:37.168353 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:37.168353 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:37.168353 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:37.168353 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:37.168353 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:37.168353 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:37.168353 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:37.168353 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:37.168353 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:45:37.168353 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:37.168353 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 239/485] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Sep 4 00:45:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:37.173396 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a7615-1b9b-4eb0-b70a-ccea3410be7c None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:37.227538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc116f-d855-4bd7-8342-3aa0e1032e7d None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:37.253550 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:37.263816 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55d0af-63ef-4f85-8bef-a068426c4c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:37.264448 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55d0af-63ef-4f85-8bef-a068426c4c1a None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:37.264724 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55d0af-63ef-4f85-8bef-a068426c4c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:37.265210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55d0af-63ef-4f85-8bef-a068426c4c1a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:37.277179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55d0af-63ef-4f85-8bef-a068426c4c1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:37.281988 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-ae55d0af-63ef-4f85-8bef-a068426c4c1a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:45:37.281988 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:37.281988 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:37.281988 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:37.281988 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:37.281988 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:37.281988 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:37.281988 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:37.281988 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:37.281988 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:37.281988 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:37.281988 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:37.281988 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:37.281988 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:37.281988 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:37.281988 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:37.282870 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:37.282870 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:37.282870 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:37.282870 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:37.282870 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:37.282870 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:37.282870 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:37.282870 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:37.282870 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:37.282870 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:37.282870 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:37.282870 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:37.282870 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:37.282870 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:37.282870 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:37.282870 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:37.286283 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:37.286283 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:37.286283 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:37.286283 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:37.286283 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:37.286283 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:37.286283 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:37.286283 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:37.286283 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:37.286283 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:37.286283 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:45:37.286283 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:37.286283 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 247/486] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Sep 4 00:45:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:45:37.286283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3181e9-0dc0-4a83-9556-b2fe770482aa None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:37.286998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3181e9-0dc0-4a83-9556-b2fe770482aa None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:37.286998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3181e9-0dc0-4a83-9556-b2fe770482aa None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:37.288053 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 248/487] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:37.291573 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ce612-e152-44d3-a9b9-28ccc469854a None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:37.291940 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ce612-e152-44d3-a9b9-28ccc469854a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:37.292342 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ce612-e152-44d3-a9b9-28ccc469854a None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:37.293750 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 249/488] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:37.294439 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ce612-e152-44d3-a9b9-28ccc469854a None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:37.301676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a7615-1b9b-4eb0-b70a-ccea3410be7c None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:37.330800 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:37.347632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea3b93-a318-4ce7-ab13-6038fee95af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:37.348240 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea3b93-a318-4ce7-ab13-6038fee95af6 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:37.348643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea3b93-a318-4ce7-ab13-6038fee95af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:37.348958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea3b93-a318-4ce7-ab13-6038fee95af6 None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:37.349785 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea3b93-a318-4ce7-ab13-6038fee95af6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:37.350090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea3b93-a318-4ce7-ab13-6038fee95af6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:37.351466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea3b93-a318-4ce7-ab13-6038fee95af6 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:37.365392 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 240/489] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Sep 4 00:45:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:45:37.365392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da88202-65cd-4024-b91c-8cd40690f6fd None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:37.365392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da88202-65cd-4024-b91c-8cd40690f6fd None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:37.365392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da88202-65cd-4024-b91c-8cd40690f6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:37.382093 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-8da88202-65cd-4024-b91c-8cd40690f6fd None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:37.383299 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8da88202-65cd-4024-b91c-8cd40690f6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:37.410753 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ce612-e152-44d3-a9b9-28ccc469854a None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:37.448084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9adeb8-2035-47c3-b60f-31bc4b39c25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:37.449018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9adeb8-2035-47c3-b60f-31bc4b39c25f None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:37.449569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9adeb8-2035-47c3-b60f-31bc4b39c25f None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:37.450091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9adeb8-2035-47c3-b60f-31bc4b39c25f None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:37.451054 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9adeb8-2035-47c3-b60f-31bc4b39c25f None admin] RBAC: Adding query filter params (name=service) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:37.451907 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9adeb8-2035-47c3-b60f-31bc4b39c25f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:37.453052 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9adeb8-2035-47c3-b60f-31bc4b39c25f None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:37.455884 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 241/490] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:37.466134 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 250/491] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Sep 4 00:45:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:37.466134 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9adeb8-2035-47c3-b60f-31bc4b39c25f None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:37.467123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1388d9-97cf-41a2-ae3e-b3d6c68fd78e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:37.467414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1388d9-97cf-41a2-ae3e-b3d6c68fd78e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:37.467687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1388d9-97cf-41a2-ae3e-b3d6c68fd78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:37.487233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-7c1388d9-97cf-41a2-ae3e-b3d6c68fd78e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:37.488363 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7c1388d9-97cf-41a2-ae3e-b3d6c68fd78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:37.548206 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:37.561823 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 242/492] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:37.562704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1388d9-97cf-41a2-ae3e-b3d6c68fd78e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:37.586770 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:37.599160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9adeb8-2035-47c3-b60f-31bc4b39c25f None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:37.647536 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb1da8-39a2-447c-a66b-0018c77a0e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:37.650217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb1da8-39a2-447c-a66b-0018c77a0e97 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:37.651052 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb1da8-39a2-447c-a66b-0018c77a0e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:37.651986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb1da8-39a2-447c-a66b-0018c77a0e97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:37.670389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb1da8-39a2-447c-a66b-0018c77a0e97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:37.672911 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1388d9-97cf-41a2-ae3e-b3d6c68fd78e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:37.673775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb1da8-39a2-447c-a66b-0018c77a0e97 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:37.693287 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-effb1da8-39a2-447c-a66b-0018c77a0e97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:37.693287 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:37.693287 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:37.693287 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:37.693287 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:37.693287 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:37.693287 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:37.693287 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:37.693287 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:37.693287 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:37.693287 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:37.693287 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:37.693287 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:45:37.693287 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:45:37.693287 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:45:37.693287 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:45:37.694248 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:37.694248 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:37.694248 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:37.694248 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:37.694248 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:37.694248 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:37.694248 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:37.694248 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:37.694248 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:37.694248 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:37.694248 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:37.694248 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:37.694248 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:37.694248 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:37.694248 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:37.694248 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:37.694248 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:45:37.695097 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:45:37.695097 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:37.695097 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:37.697917 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 251/493] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:37.707142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb1da8-39a2-447c-a66b-0018c77a0e97 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:37.735255 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd4ffc-169f-4036-9451-49892ae06af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:37.736120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd4ffc-169f-4036-9451-49892ae06af1 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:37.736399 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd4ffc-169f-4036-9451-49892ae06af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:37.736667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd4ffc-169f-4036-9451-49892ae06af1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:37.756466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd4ffc-169f-4036-9451-49892ae06af1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:37.757913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd4ffc-169f-4036-9451-49892ae06af1 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:37.787505 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-48bd4ffc-169f-4036-9451-49892ae06af1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:37.787505 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:37.787505 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:37.787505 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:37.787505 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:37.787505 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:37.787505 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:37.787505 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:37.787505 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:37.787505 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:37.787505 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:37.787505 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:37.787505 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:45:37.787505 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:45:37.787505 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:45:37.787505 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:45:37.788436 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:37.788436 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:37.788436 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:37.788436 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:37.788436 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:37.788436 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:37.788436 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:37.788436 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:37.788436 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:37.788436 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:37.788436 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:37.788436 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:37.788436 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:37.788436 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:37.788436 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:37.788436 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:37.788436 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:45:37.789907 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:45:37.789907 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:37.789907 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:37.789907 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 243/494] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:37.798551 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd4ffc-169f-4036-9451-49892ae06af1 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:37.863541 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:37.876893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb1da8-39a2-447c-a66b-0018c77a0e97 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:37.913208 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5190e37-fd12-4c91-903a-2dc27ff51b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:37.914178 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5190e37-fd12-4c91-903a-2dc27ff51b3c None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:37.914641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5190e37-fd12-4c91-903a-2dc27ff51b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:37.915120 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5190e37-fd12-4c91-903a-2dc27ff51b3c None admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:37.915939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5190e37-fd12-4c91-903a-2dc27ff51b3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:37.916421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5190e37-fd12-4c91-903a-2dc27ff51b3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:37.918017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5190e37-fd12-4c91-903a-2dc27ff51b3c None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:37.928913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd4ffc-169f-4036-9451-49892ae06af1 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:37.931314 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 252/495] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:37.932291 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5190e37-fd12-4c91-903a-2dc27ff51b3c None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:37.939629 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:37.970119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b3d6c-b56f-4e8b-9fb8-ba70afecf23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:37.970728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b3d6c-b56f-4e8b-9fb8-ba70afecf23c None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:37.971006 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b3d6c-b56f-4e8b-9fb8-ba70afecf23c None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:37.971277 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b3d6c-b56f-4e8b-9fb8-ba70afecf23c None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:37.971924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b3d6c-b56f-4e8b-9fb8-ba70afecf23c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:37.972223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b3d6c-b56f-4e8b-9fb8-ba70afecf23c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:37.973742 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b3d6c-b56f-4e8b-9fb8-ba70afecf23c None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:37.992993 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 244/496] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:37.992993 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b3d6c-b56f-4e8b-9fb8-ba70afecf23c None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:38.054371 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5190e37-fd12-4c91-903a-2dc27ff51b3c None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:38.089702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae071b90-5efb-4bb5-b97f-6d3e83e8f789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:38.090323 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae071b90-5efb-4bb5-b97f-6d3e83e8f789 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:38.090605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae071b90-5efb-4bb5-b97f-6d3e83e8f789 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:38.090874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae071b90-5efb-4bb5-b97f-6d3e83e8f789 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:38.094294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b3d6c-b56f-4e8b-9fb8-ba70afecf23c None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:38.097310 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:38.101770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae071b90-5efb-4bb5-b97f-6d3e83e8f789 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:38.107220 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-ae071b90-5efb-4bb5-b97f-6d3e83e8f789 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:45:38.107220 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:38.107220 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:38.107220 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:38.107220 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:38.107220 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:38.107220 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:38.107220 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:38.107220 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:38.107220 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:38.107220 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:38.107220 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:38.107220 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:38.107220 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:38.107220 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:38.107220 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:38.108088 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:38.108088 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:38.108088 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:38.108088 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:38.108088 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:38.108088 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:38.108088 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:38.108088 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:38.108088 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:38.108088 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:38.108088 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:38.108088 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:38.108088 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:38.108088 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:38.108088 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:38.108088 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:38.110536 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:38.110536 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:38.110536 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:38.110536 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:38.110536 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:38.110536 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:38.110536 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:38.110536 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:38.110536 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:38.110536 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:38.110536 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:45:38.110536 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:38.110536 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 253/497] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Sep 4 00:45:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:38.110536 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae071b90-5efb-4bb5-b97f-6d3e83e8f789 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:38.136803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded82ca-a24d-4bfc-9141-fafa341090e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:38.137449 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded82ca-a24d-4bfc-9141-fafa341090e2 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:38.137747 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded82ca-a24d-4bfc-9141-fafa341090e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:38.138019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded82ca-a24d-4bfc-9141-fafa341090e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:38.149668 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded82ca-a24d-4bfc-9141-fafa341090e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:38.154552 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-bded82ca-a24d-4bfc-9141-fafa341090e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:45:38.154552 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:38.154552 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:38.154552 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:38.154552 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:38.154552 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:38.154552 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:38.154552 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:38.154552 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:38.154552 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:38.154552 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:38.154552 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:38.154552 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:38.154552 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:38.154552 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:38.154552 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:38.155445 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:38.155445 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:38.155445 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:38.155445 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:38.155445 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:38.155445 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:38.155445 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:38.155445 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:38.155445 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:38.155445 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:38.155445 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:38.155445 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:38.155445 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:38.155445 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:38.155445 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:38.155445 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:38.156255 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:38.156255 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:38.156255 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:38.156255 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:38.156255 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:38.156255 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:38.156255 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:38.156255 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:38.156255 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:38.156255 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:38.156255 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:45:38.156255 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:38.156255 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 245/498] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Sep 4 00:45:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:38.156896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded82ca-a24d-4bfc-9141-fafa341090e2 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:38.181612 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:38.218949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae071b90-5efb-4bb5-b97f-6d3e83e8f789 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:38.251655 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97446e40-b835-4efa-a715-bf40256d4e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:38.252268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97446e40-b835-4efa-a715-bf40256d4e20 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:38.252543 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97446e40-b835-4efa-a715-bf40256d4e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:38.252811 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97446e40-b835-4efa-a715-bf40256d4e20 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:38.257847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded82ca-a24d-4bfc-9141-fafa341090e2 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:38.260668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97446e40-b835-4efa-a715-bf40256d4e20 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:38.262181 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97446e40-b835-4efa-a715-bf40256d4e20 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:38.274235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-97446e40-b835-4efa-a715-bf40256d4e20 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 04 00:45:38.274235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:38.274235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:38.274235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:38.274235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:38.274235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:38.274235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:38.274235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:38.274235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:38.274235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:38.274235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:38.274235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:38.274235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 04 00:45:38.274235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 04 00:45:38.274235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 04 00:45:38.274235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 04 00:45:38.275324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:38.275324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:38.275324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 00:45:38.275324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:45:38.275324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 00:45:38.275324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:45:38.275324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:38.275324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:38.275324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:38.275324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:38.275324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:38.275324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:38.275324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:38.275324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:38.275324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:38.275324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:38.275324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:38.275324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:38.276423 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:38.276423 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:38.276423 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 00:45:38.276423 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 00:45:38.276423 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 00:45:38.276423 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 00:45:38.276423 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 00:45:38.276423 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 00:45:38.276423 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 04 00:45:38.276423 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:38.276423 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 254/499] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:45:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:38.276423 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97446e40-b835-4efa-a715-bf40256d4e20 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:38.294748 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051f630-83df-4695-b637-3c51db3a7315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:38.295369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051f630-83df-4695-b637-3c51db3a7315 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:38.295646 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051f630-83df-4695-b637-3c51db3a7315 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:38.295913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051f630-83df-4695-b637-3c51db3a7315 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:38.302668 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051f630-83df-4695-b637-3c51db3a7315 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:38.304118 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051f630-83df-4695-b637-3c51db3a7315 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:38.317369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-7051f630-83df-4695-b637-3c51db3a7315 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 04 00:45:38.317369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:38.317369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:38.317369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:38.317369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:38.317369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:38.317369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:38.317369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:38.317369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:38.317369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:38.317369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:38.317369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:38.317369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 04 00:45:38.317369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 04 00:45:38.317369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 04 00:45:38.317369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 04 00:45:38.318426 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:38.318426 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:38.318426 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 00:45:38.318426 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:45:38.318426 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 00:45:38.318426 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:45:38.318426 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:38.318426 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:38.318426 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:38.318426 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:38.318426 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:38.318426 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:38.318426 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:38.318426 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:38.318426 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:38.318426 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:38.318426 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:38.318426 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:38.319312 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:38.319312 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:38.319312 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 00:45:38.319312 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 00:45:38.319312 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 00:45:38.319312 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 00:45:38.319312 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 00:45:38.319312 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 00:45:38.319312 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 04 00:45:38.319312 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:38.323498 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 246/500] 10.222.0.30 () {56 vars in 1093 bytes} [Sun Sep 4 00:45:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:38.324272 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051f630-83df-4695-b637-3c51db3a7315 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:38.347715 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:38.375219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97446e40-b835-4efa-a715-bf40256d4e20 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:38.398557 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:38.409670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40065ca-3f50-4764-b88d-cc9faafcb330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:38.410275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40065ca-3f50-4764-b88d-cc9faafcb330 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:38.410560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40065ca-3f50-4764-b88d-cc9faafcb330 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:38.410833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40065ca-3f50-4764-b88d-cc9faafcb330 None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:38.411486 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40065ca-3f50-4764-b88d-cc9faafcb330 None admin] RBAC: Adding query filter params (name=service) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:38.411788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40065ca-3f50-4764-b88d-cc9faafcb330 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:38.413173 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40065ca-3f50-4764-b88d-cc9faafcb330 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:38.420901 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 255/501] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Sep 4 00:45:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:38.421934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051f630-83df-4695-b637-3c51db3a7315 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:38.422839 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e215578-d146-4e43-bfff-4df4feaf5ee1 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:38.423127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e215578-d146-4e43-bfff-4df4feaf5ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:38.423480 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e215578-d146-4e43-bfff-4df4feaf5ee1 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:38.424812 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 256/502] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:38.425397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e215578-d146-4e43-bfff-4df4feaf5ee1 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:38.460506 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1f6aa-9915-4946-9f78-043b1a8fa5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:38.461110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1f6aa-9915-4946-9f78-043b1a8fa5e1 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:38.461392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1f6aa-9915-4946-9f78-043b1a8fa5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:38.461695 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1f6aa-9915-4946-9f78-043b1a8fa5e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:38.462353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1f6aa-9915-4946-9f78-043b1a8fa5e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:38.462656 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1f6aa-9915-4946-9f78-043b1a8fa5e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:38.464028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1f6aa-9915-4946-9f78-043b1a8fa5e1 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:38.471805 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 247/503] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Sep 4 00:45:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:38.472525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1f6aa-9915-4946-9f78-043b1a8fa5e1 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:38.532680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e215578-d146-4e43-bfff-4df4feaf5ee1 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:38.555847 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:38.566171 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899205b-28c7-42bc-8dc0-d6f61a5d223f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:38.566765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899205b-28c7-42bc-8dc0-d6f61a5d223f None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:38.567038 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899205b-28c7-42bc-8dc0-d6f61a5d223f None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:38.567305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899205b-28c7-42bc-8dc0-d6f61a5d223f None admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:38.568061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d899205b-28c7-42bc-8dc0-d6f61a5d223f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:38.568313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d899205b-28c7-42bc-8dc0-d6f61a5d223f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:38.569778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d899205b-28c7-42bc-8dc0-d6f61a5d223f None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:38.572411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1f6aa-9915-4946-9f78-043b1a8fa5e1 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:38.604939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bb6a9-83a4-4ca6-8e59-dae5475112a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:38.605305 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 257/504] 10.222.0.30 () {56 vars in 1137 bytes} [Sun Sep 4 00:45:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:38.610499 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bb6a9-83a4-4ca6-8e59-dae5475112a3 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:38.610499 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bb6a9-83a4-4ca6-8e59-dae5475112a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:38.610499 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bb6a9-83a4-4ca6-8e59-dae5475112a3 None admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:38.610720 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899205b-28c7-42bc-8dc0-d6f61a5d223f None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:38.610797 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464bb6a9-83a4-4ca6-8e59-dae5475112a3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:38.610797 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464bb6a9-83a4-4ca6-8e59-dae5475112a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:38.610797 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464bb6a9-83a4-4ca6-8e59-dae5475112a3 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:38.644653 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 248/505] 10.222.0.30 () {56 vars in 1133 bytes} [Sun Sep 4 00:45:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:38.645893 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034391d9-a2f7-4fab-9617-0cf29be8cc1f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:38.646183 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034391d9-a2f7-4fab-9617-0cf29be8cc1f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:38.646455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034391d9-a2f7-4fab-9617-0cf29be8cc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:38.652633 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:38.665347 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-034391d9-a2f7-4fab-9617-0cf29be8cc1f None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:38.666568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-034391d9-a2f7-4fab-9617-0cf29be8cc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:38.706228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899205b-28c7-42bc-8dc0-d6f61a5d223f None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:38.731689 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 249/506] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:38.732501 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034391d9-a2f7-4fab-9617-0cf29be8cc1f None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:38.753670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6739a-f491-4c09-a121-303065e1d612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:38.754299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6739a-f491-4c09-a121-303065e1d612 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:38.754577 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6739a-f491-4c09-a121-303065e1d612 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:38.754849 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6739a-f491-4c09-a121-303065e1d612 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:38.765026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6739a-f491-4c09-a121-303065e1d612 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:38.766542 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6739a-f491-4c09-a121-303065e1d612 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:38.782267 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-e4a6739a-f491-4c09-a121-303065e1d612 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:38.782267 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:38.782267 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:38.782267 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:38.782267 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:38.782267 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:38.782267 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:38.782267 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:38.782267 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:38.782267 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:38.782267 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:38.782267 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:38.782267 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:45:38.782267 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:45:38.782267 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:45:38.782267 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:45:38.783166 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:38.783166 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:38.783166 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:38.783166 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:38.783166 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:38.783166 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:38.783166 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:38.783166 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:38.783166 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:38.783166 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:38.783166 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:38.783166 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:38.783166 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:38.783166 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:38.783166 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:38.783166 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:38.783166 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:45:38.784000 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:45:38.784000 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:38.784000 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:38.784000 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 258/507] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:38.784210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6739a-f491-4c09-a121-303065e1d612 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:38.809281 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:38.843127 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034391d9-a2f7-4fab-9617-0cf29be8cc1f None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:38.878121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5ee3e-bb58-4a84-aded-8fb091713b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:38.878743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5ee3e-bb58-4a84-aded-8fb091713b25 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:38.879020 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5ee3e-bb58-4a84-aded-8fb091713b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:38.879285 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5ee3e-bb58-4a84-aded-8fb091713b25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:38.880549 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:38.887689 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6739a-f491-4c09-a121-303065e1d612 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:38.890382 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5ee3e-bb58-4a84-aded-8fb091713b25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:38.891837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5ee3e-bb58-4a84-aded-8fb091713b25 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:38.906526 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-6af5ee3e-bb58-4a84-aded-8fb091713b25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:38.906526 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:38.906526 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:38.906526 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:38.906526 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:38.906526 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:38.906526 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:38.906526 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:38.906526 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:38.906526 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:38.906526 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:38.906526 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:38.906526 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:45:38.906526 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:45:38.906526 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:45:38.906526 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:45:38.907410 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:38.907410 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:38.907410 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:38.907410 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:38.907410 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:38.907410 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:38.907410 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:38.907410 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:38.907410 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:38.907410 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:38.907410 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:38.907410 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:38.907410 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:38.907410 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:38.907410 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:38.907410 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:38.907410 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:45:38.908242 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:45:38.908242 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:38.908242 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:38.912439 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 250/508] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:38.913079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5ee3e-bb58-4a84-aded-8fb091713b25 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:38.924503 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9504e21-fd74-473e-b04d-eeb8d68a466b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:38.925112 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9504e21-fd74-473e-b04d-eeb8d68a466b None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:38.925390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9504e21-fd74-473e-b04d-eeb8d68a466b None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:38.925735 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9504e21-fd74-473e-b04d-eeb8d68a466b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:38.995135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9504e21-fd74-473e-b04d-eeb8d68a466b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:38.996593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9504e21-fd74-473e-b04d-eeb8d68a466b None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:39.017102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5ee3e-bb58-4a84-aded-8fb091713b25 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:39.040515 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:39.051306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75472764-d7fe-4bca-98ac-7fa4637672bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:39.051912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75472764-d7fe-4bca-98ac-7fa4637672bc None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:39.052184 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75472764-d7fe-4bca-98ac-7fa4637672bc None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:39.052455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75472764-d7fe-4bca-98ac-7fa4637672bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:39.087203 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:39.093845 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 259/509] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:45:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 04 00:45:39.094577 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9504e21-fd74-473e-b04d-eeb8d68a466b None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:39.121225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75472764-d7fe-4bca-98ac-7fa4637672bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:39.122730 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75472764-d7fe-4bca-98ac-7fa4637672bc None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:39.191293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9504e21-fd74-473e-b04d-eeb8d68a466b None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:39.218457 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 251/510] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:45:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 04 00:45:39.219278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75472764-d7fe-4bca-98ac-7fa4637672bc None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:39.229061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d14dd-cf11-4625-a7a1-a27cf6bbf9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:39.229696 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d14dd-cf11-4625-a7a1-a27cf6bbf9b0 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:39.229975 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d14dd-cf11-4625-a7a1-a27cf6bbf9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:39.230246 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d14dd-cf11-4625-a7a1-a27cf6bbf9b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:39.230879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993d14dd-cf11-4625-a7a1-a27cf6bbf9b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:39.231186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993d14dd-cf11-4625-a7a1-a27cf6bbf9b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:39.232563 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993d14dd-cf11-4625-a7a1-a27cf6bbf9b0 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:39.243749 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 260/511] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:39.243897 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:39.244510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d14dd-cf11-4625-a7a1-a27cf6bbf9b0 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:39.298231 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:39.322044 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75472764-d7fe-4bca-98ac-7fa4637672bc None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:39.341528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d14dd-cf11-4625-a7a1-a27cf6bbf9b0 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:39.355520 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e4088-7d4d-487f-af3e-1fe9c0dd00cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:39.356052 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e4088-7d4d-487f-af3e-1fe9c0dd00cb None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:39.356325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e4088-7d4d-487f-af3e-1fe9c0dd00cb None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:39.356593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e4088-7d4d-487f-af3e-1fe9c0dd00cb None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:39.357223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e4088-7d4d-487f-af3e-1fe9c0dd00cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:39.357555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e4088-7d4d-487f-af3e-1fe9c0dd00cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:39.358924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e4088-7d4d-487f-af3e-1fe9c0dd00cb None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:39.369939 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 252/512] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:39.370697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e4088-7d4d-487f-af3e-1fe9c0dd00cb None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:39.379274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeeac6e-1b93-4bcb-ab30-ed78728f29c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:39.379890 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeeac6e-1b93-4bcb-ab30-ed78728f29c6 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:39.380164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeeac6e-1b93-4bcb-ab30-ed78728f29c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:39.380436 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeeac6e-1b93-4bcb-ab30-ed78728f29c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:39.392202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeeac6e-1b93-4bcb-ab30-ed78728f29c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:39.393690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeeac6e-1b93-4bcb-ab30-ed78728f29c6 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:39.407974 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-7eeeac6e-1b93-4bcb-ab30-ed78728f29c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:39.407974 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:39.407974 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:39.407974 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:39.407974 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:39.407974 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:39.407974 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:39.407974 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:39.407974 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:39.407974 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:39.407974 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:39.407974 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:39.407974 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:45:39.407974 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:45:39.407974 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:45:39.407974 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:45:39.408951 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:39.408951 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:39.408951 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:39.408951 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:39.408951 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:39.408951 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:39.408951 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:39.408951 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:39.408951 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:39.408951 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:39.408951 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:39.408951 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:39.408951 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:39.408951 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:39.408951 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:39.408951 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:39.408951 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:45:39.409869 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:45:39.409869 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:39.409869 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:39.409869 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 261/513] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:39.409869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeeac6e-1b93-4bcb-ab30-ed78728f29c6 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:39.457191 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:39.473965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e4088-7d4d-487f-af3e-1fe9c0dd00cb None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:39.506026 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c645a48-43f7-4b92-90f4-17608edf6ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:39.506642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c645a48-43f7-4b92-90f4-17608edf6ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:39.506918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c645a48-43f7-4b92-90f4-17608edf6ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:39.507186 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c645a48-43f7-4b92-90f4-17608edf6ec7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:39.511466 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeeac6e-1b93-4bcb-ab30-ed78728f29c6 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:39.518115 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c645a48-43f7-4b92-90f4-17608edf6ec7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:39.519558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c645a48-43f7-4b92-90f4-17608edf6ec7 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:39.520437 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:39.533740 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-1c645a48-43f7-4b92-90f4-17608edf6ec7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:39.533740 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:39.533740 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:39.533740 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:39.533740 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:39.533740 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:39.533740 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:39.533740 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:39.533740 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:39.533740 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:39.533740 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:39.533740 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:39.533740 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:45:39.533740 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:45:39.533740 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:45:39.533740 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:45:39.534627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:39.534627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:39.534627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:39.534627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:39.534627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:39.534627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:39.534627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:39.534627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:39.534627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:39.534627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:39.534627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:39.534627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:39.534627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:39.534627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:39.534627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:39.534627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:39.534627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:45:39.535476 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:45:39.535476 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:39.535476 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:39.535476 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 253/514] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:39.535952 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c645a48-43f7-4b92-90f4-17608edf6ec7 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:39.548434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514af58a-f82c-496c-8954-468decfa3e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:39.549050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514af58a-f82c-496c-8954-468decfa3e52 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:39.549321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514af58a-f82c-496c-8954-468decfa3e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:39.549618 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514af58a-f82c-496c-8954-468decfa3e52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:39.559345 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514af58a-f82c-496c-8954-468decfa3e52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:39.560783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514af58a-f82c-496c-8954-468decfa3e52 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:39.575292 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-514af58a-f82c-496c-8954-468decfa3e52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:39.575292 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:39.575292 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:39.575292 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:39.575292 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:39.575292 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:39.575292 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:39.575292 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:39.575292 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:39.575292 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:39.575292 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:39.575292 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:39.575292 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:45:39.575292 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:45:39.575292 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:45:39.575292 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:45:39.576164 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:39.576164 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:39.576164 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:39.576164 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:39.576164 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:39.576164 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:39.576164 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:39.576164 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:39.576164 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:39.576164 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:39.576164 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:39.576164 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:39.576164 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:39.576164 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:39.576164 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:39.576164 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:39.576164 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:45:39.576994 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:45:39.576994 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:39.576994 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:39.576994 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 262/515] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:39.577202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514af58a-f82c-496c-8954-468decfa3e52 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:39.635389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c645a48-43f7-4b92-90f4-17608edf6ec7 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:39.667541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202eacb-7c22-40e6-8a75-3189d48bfcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:39.668153 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202eacb-7c22-40e6-8a75-3189d48bfcb2 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:39.668427 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202eacb-7c22-40e6-8a75-3189d48bfcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:39.668696 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202eacb-7c22-40e6-8a75-3189d48bfcb2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:39.671312 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:39.677260 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9202eacb-7c22-40e6-8a75-3189d48bfcb2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:39.678797 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9202eacb-7c22-40e6-8a75-3189d48bfcb2 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:39.679641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514af58a-f82c-496c-8954-468decfa3e52 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:39.690308 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-9202eacb-7c22-40e6-8a75-3189d48bfcb2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 04 00:45:39.690308 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:39.690308 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:39.690308 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:39.690308 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:39.690308 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:39.690308 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:39.690308 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:39.690308 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:39.690308 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:39.690308 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:39.690308 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:39.690308 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 04 00:45:39.690308 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 04 00:45:39.690308 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 04 00:45:39.690308 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 04 00:45:39.691227 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:39.691227 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:39.691227 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 00:45:39.691227 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:45:39.691227 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 00:45:39.691227 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:45:39.691227 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:39.691227 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:39.691227 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:39.691227 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:39.691227 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:39.691227 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:39.691227 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:39.691227 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:39.691227 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:39.691227 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:39.691227 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:39.691227 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:39.692106 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:39.692106 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:39.692106 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 00:45:39.692106 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 00:45:39.692106 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 00:45:39.692106 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 00:45:39.692106 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 00:45:39.692106 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 00:45:39.692106 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 04 00:45:39.692106 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:39.692106 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 254/516] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Sep 4 00:45:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:39.692648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202eacb-7c22-40e6-8a75-3189d48bfcb2 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:39.716558 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f0259e-1f1c-460f-b75a-e5e16ab69fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:39.717183 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0259e-1f1c-460f-b75a-e5e16ab69fae None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:39.717492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0259e-1f1c-460f-b75a-e5e16ab69fae None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:39.717762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0259e-1f1c-460f-b75a-e5e16ab69fae None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:39.725224 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f0259e-1f1c-460f-b75a-e5e16ab69fae None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:39.726858 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f0259e-1f1c-460f-b75a-e5e16ab69fae None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:39.738089 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-89f0259e-1f1c-460f-b75a-e5e16ab69fae None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 04 00:45:39.738089 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:39.738089 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:39.738089 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:39.738089 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:39.738089 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:39.738089 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:39.738089 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:39.738089 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:39.738089 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:39.738089 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:39.738089 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:39.738089 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 04 00:45:39.738089 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 04 00:45:39.738089 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 04 00:45:39.738089 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 04 00:45:39.738991 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:39.738991 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:39.738991 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 00:45:39.738991 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:45:39.738991 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 00:45:39.738991 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:45:39.738991 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:39.738991 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:39.738991 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:39.738991 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:39.738991 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:39.738991 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:39.738991 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:39.738991 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:39.738991 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:39.738991 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:39.738991 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:39.738991 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:39.739850 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:39.739850 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:39.739850 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 00:45:39.739850 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 00:45:39.739850 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 00:45:39.739850 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 00:45:39.739850 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 00:45:39.739850 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 00:45:39.739850 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 04 00:45:39.739850 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:39.739850 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 263/517] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:45:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:39.740393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f0259e-1f1c-460f-b75a-e5e16ab69fae None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:39.761695 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:39.792142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202eacb-7c22-40e6-8a75-3189d48bfcb2 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:39.824192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8921b8f-867e-46fa-96c9-e2969f021afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:39.824787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8921b8f-867e-46fa-96c9-e2969f021afc None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:39.825069 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8921b8f-867e-46fa-96c9-e2969f021afc None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:39.825340 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8921b8f-867e-46fa-96c9-e2969f021afc None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:39.826020 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8921b8f-867e-46fa-96c9-e2969f021afc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:39.826328 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8921b8f-867e-46fa-96c9-e2969f021afc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:39.827689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8921b8f-867e-46fa-96c9-e2969f021afc None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:39.839199 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f0259e-1f1c-460f-b75a-e5e16ab69fae None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:39.839856 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 255/518] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:39.840635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8921b8f-867e-46fa-96c9-e2969f021afc None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:39.877096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77c775-f1b3-443f-9eb2-0fec214bb327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:39.877719 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77c775-f1b3-443f-9eb2-0fec214bb327 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:39.877998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77c775-f1b3-443f-9eb2-0fec214bb327 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:39.878265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77c775-f1b3-443f-9eb2-0fec214bb327 None admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:39.878894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77c775-f1b3-443f-9eb2-0fec214bb327 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:39.879191 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77c775-f1b3-443f-9eb2-0fec214bb327 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:39.880555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77c775-f1b3-443f-9eb2-0fec214bb327 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:39.891723 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 264/519] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:39.892425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77c775-f1b3-443f-9eb2-0fec214bb327 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:39.894188 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:39.939922 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8921b8f-867e-46fa-96c9-e2969f021afc None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:39.970714 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:39.974140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d0a74-03cd-4cba-9a0e-2f9e0df8569f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:39.974750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d0a74-03cd-4cba-9a0e-2f9e0df8569f None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:39.975030 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d0a74-03cd-4cba-9a0e-2f9e0df8569f None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:39.975306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d0a74-03cd-4cba-9a0e-2f9e0df8569f None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:39.975954 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d0a74-03cd-4cba-9a0e-2f9e0df8569f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:39.976256 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d0a74-03cd-4cba-9a0e-2f9e0df8569f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:39.978244 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d0a74-03cd-4cba-9a0e-2f9e0df8569f None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:39.989884 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 256/520] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:39.990306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77c775-f1b3-443f-9eb2-0fec214bb327 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:39.990585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d0a74-03cd-4cba-9a0e-2f9e0df8569f None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:40.025514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0ebe3-4a1f-4a61-98e0-142799131ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:40.026117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0ebe3-4a1f-4a61-98e0-142799131ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:40.026393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0ebe3-4a1f-4a61-98e0-142799131ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:40.026659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0ebe3-4a1f-4a61-98e0-142799131ef3 None admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:40.027381 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0ebe3-4a1f-4a61-98e0-142799131ef3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:40.027883 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0ebe3-4a1f-4a61-98e0-142799131ef3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:40.029335 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0ebe3-4a1f-4a61-98e0-142799131ef3 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:40.046779 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 265/521] 10.222.0.30 () {56 vars in 1139 bytes} [Sun Sep 4 00:45:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:40.047562 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0ebe3-4a1f-4a61-98e0-142799131ef3 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:40.098225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d0a74-03cd-4cba-9a0e-2f9e0df8569f None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:40.114010 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:40.131695 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e918b922-53fc-435b-a5e0-195e98686911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:40.132293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918b922-53fc-435b-a5e0-195e98686911 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:40.132570 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918b922-53fc-435b-a5e0-195e98686911 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:40.133349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918b922-53fc-435b-a5e0-195e98686911 None admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:40.134095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e918b922-53fc-435b-a5e0-195e98686911 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:40.134392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e918b922-53fc-435b-a5e0-195e98686911 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:40.135819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e918b922-53fc-435b-a5e0-195e98686911 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:40.149462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0ebe3-4a1f-4a61-98e0-142799131ef3 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:40.153907 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 257/522] 10.222.0.30 () {56 vars in 1137 bytes} [Sun Sep 4 00:45:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:40.154692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e918b922-53fc-435b-a5e0-195e98686911 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:40.183941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339919f-05e6-4508-8f52-af17e56c4e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:40.184632 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339919f-05e6-4508-8f52-af17e56c4e47 None admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:40.184906 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339919f-05e6-4508-8f52-af17e56c4e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:40.185174 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339919f-05e6-4508-8f52-af17e56c4e47 None admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:40.185840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339919f-05e6-4508-8f52-af17e56c4e47 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:40.187292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339919f-05e6-4508-8f52-af17e56c4e47 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:40.197461 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:40.209563 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 266/523] 10.222.0.30 () {60 vars in 1132 bytes} [Sun Sep 4 00:45:40 2022] POST /identity/v3/users => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:45:40.210359 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339919f-05e6-4508-8f52-af17e56c4e47 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:40.262292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e918b922-53fc-435b-a5e0-195e98686911 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:40.301088 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0b1a8-1012-4b8a-a276-43d5479a5bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:40.301840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0b1a8-1012-4b8a-a276-43d5479a5bac None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:40.302153 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0b1a8-1012-4b8a-a276-43d5479a5bac None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:40.302421 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0b1a8-1012-4b8a-a276-43d5479a5bac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:40.310442 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb0b1a8-1012-4b8a-a276-43d5479a5bac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:40.311935 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb0b1a8-1012-4b8a-a276-43d5479a5bac None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:40.326292 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-8fb0b1a8-1012-4b8a-a276-43d5479a5bac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:45:40.326292 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:40.326292 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:40.326292 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:40.326292 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:40.326292 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:40.326292 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:40.326292 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:40.326292 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:40.326292 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:40.326292 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:40.326292 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:40.326292 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 04 00:45:40.326292 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 04 00:45:40.326292 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 04 00:45:40.327381 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 04 00:45:40.327381 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:40.327381 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:40.327381 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:40.327381 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:40.327381 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:40.327381 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:40.327381 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:40.327381 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:40.327381 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:40.327381 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:40.327381 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:40.327381 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:40.327381 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:40.327381 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:40.327381 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:40.327381 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:40.328250 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 04 00:45:40.328250 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 04 00:45:40.328250 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 00:45:40.328250 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 00:45:40.328250 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 00:45:40.328250 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 00:45:40.328250 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:45:40.328250 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:40.328250 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 258/524] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:45:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:40.328250 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0b1a8-1012-4b8a-a276-43d5479a5bac None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:40.334662 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339919f-05e6-4508-8f52-af17e56c4e47 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:40.371017 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:40.378681 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5eb00a-dd4a-48a5-8de8-becb54e455d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:40.379351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eb00a-dd4a-48a5-8de8-becb54e455d7 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:40.379632 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eb00a-dd4a-48a5-8de8-becb54e455d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:40.380260 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eb00a-dd4a-48a5-8de8-becb54e455d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:40.388656 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5eb00a-dd4a-48a5-8de8-becb54e455d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:40.390202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5eb00a-dd4a-48a5-8de8-becb54e455d7 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:40.404554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-0e5eb00a-dd4a-48a5-8de8-becb54e455d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:45:40.404554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:40.404554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:40.404554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:40.404554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:40.404554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:40.404554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:40.404554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:40.404554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:40.404554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:40.404554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:40.404554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:40.404554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 04 00:45:40.404554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 04 00:45:40.404554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 04 00:45:40.405676 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 04 00:45:40.405676 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:40.405676 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:40.405676 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:40.405676 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:40.405676 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:40.405676 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:40.405676 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:40.405676 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:40.405676 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:40.405676 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:40.405676 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:40.405676 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:40.405676 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:40.405676 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:40.405676 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:40.405676 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:40.406744 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 04 00:45:40.406744 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 04 00:45:40.406744 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 00:45:40.406744 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 00:45:40.406744 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 00:45:40.406744 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 00:45:40.406744 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:45:40.406744 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:40.406744 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 267/525] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:45:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:40.406744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5eb00a-dd4a-48a5-8de8-becb54e455d7 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:40.454581 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0b1a8-1012-4b8a-a276-43d5479a5bac None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:40.468013 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:40.491617 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c700b-4c17-4fab-be74-fa4b0f2e475f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:40.492838 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c700b-4c17-4fab-be74-fa4b0f2e475f None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:40.493120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c700b-4c17-4fab-be74-fa4b0f2e475f None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:40.493390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c700b-4c17-4fab-be74-fa4b0f2e475f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:40.519820 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5eb00a-dd4a-48a5-8de8-becb54e455d7 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:40.558920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601ef7c-2db0-4b20-b03d-b247ac6891d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:40.559524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601ef7c-2db0-4b20-b03d-b247ac6891d3 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:40.559812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601ef7c-2db0-4b20-b03d-b247ac6891d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:40.560066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601ef7c-2db0-4b20-b03d-b247ac6891d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:40.567335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c700b-4c17-4fab-be74-fa4b0f2e475f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:40.568903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c700b-4c17-4fab-be74-fa4b0f2e475f None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:40.604419 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:40.634791 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601ef7c-2db0-4b20-b03d-b247ac6891d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:40.636248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601ef7c-2db0-4b20-b03d-b247ac6891d3 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:40.672212 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 259/526] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:45:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 04 00:45:40.672971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c700b-4c17-4fab-be74-fa4b0f2e475f None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:40.698860 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:40.753727 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 268/527] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:45:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 04 00:45:40.754400 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601ef7c-2db0-4b20-b03d-b247ac6891d3 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:40.777825 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c700b-4c17-4fab-be74-fa4b0f2e475f None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:40.812407 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e87caa-5c74-4d0a-b5bd-6b8a9e8283e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:40.813007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e87caa-5c74-4d0a-b5bd-6b8a9e8283e7 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:40.813286 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e87caa-5c74-4d0a-b5bd-6b8a9e8283e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:40.813626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e87caa-5c74-4d0a-b5bd-6b8a9e8283e7 None admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:40.814281 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e87caa-5c74-4d0a-b5bd-6b8a9e8283e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:40.814585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e87caa-5c74-4d0a-b5bd-6b8a9e8283e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:40.816034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e87caa-5c74-4d0a-b5bd-6b8a9e8283e7 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:40.817636 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:40.840508 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 260/528] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Sep 4 00:45:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:40.840508 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e87caa-5c74-4d0a-b5bd-6b8a9e8283e7 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:40.861447 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601ef7c-2db0-4b20-b03d-b247ac6891d3 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:40.895711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46cfa4-74c0-4298-890b-246fabad809f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:40.896312 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46cfa4-74c0-4298-890b-246fabad809f None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:40.896650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46cfa4-74c0-4298-890b-246fabad809f None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:40.896926 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46cfa4-74c0-4298-890b-246fabad809f None admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:40.897633 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46cfa4-74c0-4298-890b-246fabad809f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:40.898009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46cfa4-74c0-4298-890b-246fabad809f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:40.899518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46cfa4-74c0-4298-890b-246fabad809f None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:40.922602 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 269/529] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Sep 4 00:45:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:40.923327 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46cfa4-74c0-4298-890b-246fabad809f None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:40.938938 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:40.943973 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e87caa-5c74-4d0a-b5bd-6b8a9e8283e7 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:40.980358 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9f373-7478-43a1-a430-3b555244d107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:40.981012 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9f373-7478-43a1-a430-3b555244d107 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:40.981293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9f373-7478-43a1-a430-3b555244d107 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:40.981598 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9f373-7478-43a1-a430-3b555244d107 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:40.991677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f9f373-7478-43a1-a430-3b555244d107 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:40.993699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f9f373-7478-43a1-a430-3b555244d107 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:41.008420 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-00f9f373-7478-43a1-a430-3b555244d107 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:41.008420 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:41.008420 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:41.008420 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:41.008420 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:41.008420 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:41.008420 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:41.008420 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:41.008420 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:41.008420 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:41.008420 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:41.008420 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:41.008420 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:45:41.008420 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:45:41.008420 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:45:41.008420 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:45:41.009329 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:41.009329 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:41.009329 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:41.009329 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:41.009329 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:41.009329 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:41.009329 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:41.009329 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:41.009329 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:41.009329 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:41.009329 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:41.009329 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:41.009329 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:41.009329 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:41.009329 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:41.009329 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:41.009329 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:45:41.010474 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:45:41.010474 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:41.010474 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:41.010474 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 261/530] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:41.010474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9f373-7478-43a1-a430-3b555244d107 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:41.033632 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46cfa4-74c0-4298-890b-246fabad809f None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:41.059133 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:41.072182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9326301-ce42-4bda-8676-427a77a5e356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:41.072731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9326301-ce42-4bda-8676-427a77a5e356 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:41.073012 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9326301-ce42-4bda-8676-427a77a5e356 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:41.073485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9326301-ce42-4bda-8676-427a77a5e356 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:41.084250 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9326301-ce42-4bda-8676-427a77a5e356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:41.085741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9326301-ce42-4bda-8676-427a77a5e356 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:41.100581 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-c9326301-ce42-4bda-8676-427a77a5e356 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:41.100581 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:41.100581 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:41.100581 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:41.100581 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:41.100581 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:41.100581 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:41.100581 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:41.100581 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:41.100581 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:41.100581 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:41.100581 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:41.100581 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:45:41.100581 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:45:41.100581 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:45:41.100581 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:45:41.101508 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:41.101508 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:41.101508 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:41.101508 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:41.101508 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:41.101508 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:41.101508 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:41.101508 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:41.101508 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:41.101508 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:41.101508 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:41.101508 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:41.101508 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:41.101508 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:41.101508 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:41.101508 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:41.101508 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:45:41.107758 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:45:41.107758 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:41.107758 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:41.107758 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 270/531] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:41.107758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9326301-ce42-4bda-8676-427a77a5e356 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:41.124872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9f373-7478-43a1-a430-3b555244d107 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:41.161704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2617bc8-5a10-4cea-9119-0a35a906ce3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:41.162300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2617bc8-5a10-4cea-9119-0a35a906ce3c None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:41.162576 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2617bc8-5a10-4cea-9119-0a35a906ce3c None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:41.162842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2617bc8-5a10-4cea-9119-0a35a906ce3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:41.163558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2617bc8-5a10-4cea-9119-0a35a906ce3c None admin] RBAC: Adding query filter params (role.id=955481bca39c4b0fab953d506ea3c292, scope.project.id=40b24e92f8594ee08bd2a55f79e3b299, user.id=efcee9b21ea94b1b8e5c9c5acb35839f) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:41.163860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2617bc8-5a10-4cea-9119-0a35a906ce3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:41.165926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2617bc8-5a10-4cea-9119-0a35a906ce3c None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:41.181580 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 262/532] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:45:41 2022] GET /identity/v3/role_assignments?user.id=efcee9b21ea94b1b8e5c9c5acb35839f&scope.project.id=40b24e92f8594ee08bd2a55f79e3b299&role.id=955481bca39c4b0fab953d506ea3c292 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:41.181580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2617bc8-5a10-4cea-9119-0a35a906ce3c None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:41.187384 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:41.228450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9326301-ce42-4bda-8676-427a77a5e356 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:41.267934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5325de98-cba7-4ac1-b224-8029efde2d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:41.268691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325de98-cba7-4ac1-b224-8029efde2d41 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:41.269551 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325de98-cba7-4ac1-b224-8029efde2d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:41.269890 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325de98-cba7-4ac1-b224-8029efde2d41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:41.270924 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5325de98-cba7-4ac1-b224-8029efde2d41 None admin] RBAC: Adding query filter params (role.id=955481bca39c4b0fab953d506ea3c292, scope.project.id=40b24e92f8594ee08bd2a55f79e3b299, user.id=13f0f341bf2c475d82b4e7b34d503dd0) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:41.271231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5325de98-cba7-4ac1-b224-8029efde2d41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:41.274330 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5325de98-cba7-4ac1-b224-8029efde2d41 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:41.285531 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 271/533] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:45:41 2022] GET /identity/v3/role_assignments?user.id=13f0f341bf2c475d82b4e7b34d503dd0&scope.project.id=40b24e92f8594ee08bd2a55f79e3b299&role.id=955481bca39c4b0fab953d506ea3c292 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:41.286683 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5325de98-cba7-4ac1-b224-8029efde2d41 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:41.344939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2617bc8-5a10-4cea-9119-0a35a906ce3c None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:41.375424 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:41.427466 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5325de98-cba7-4ac1-b224-8029efde2d41 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:41.450237 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1f565-2daa-4f19-b7a4-d5615cb016fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:41.450789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1f565-2daa-4f19-b7a4-d5615cb016fe None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:41.451067 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1f565-2daa-4f19-b7a4-d5615cb016fe None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:41.451341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1f565-2daa-4f19-b7a4-d5615cb016fe None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:41.451998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1f565-2daa-4f19-b7a4-d5615cb016fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:41.452290 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1f565-2daa-4f19-b7a4-d5615cb016fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:41.453787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1f565-2daa-4f19-b7a4-d5615cb016fe None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:41.471871 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:41.474067 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 263/534] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:41.479618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1f565-2daa-4f19-b7a4-d5615cb016fe None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:41.481202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70021c35-0779-45fb-96e6-9c4006448efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:41.481867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70021c35-0779-45fb-96e6-9c4006448efc None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:41.482190 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70021c35-0779-45fb-96e6-9c4006448efc None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:41.482463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70021c35-0779-45fb-96e6-9c4006448efc None admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:41.483119 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70021c35-0779-45fb-96e6-9c4006448efc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:41.483708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70021c35-0779-45fb-96e6-9c4006448efc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:41.486211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70021c35-0779-45fb-96e6-9c4006448efc None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:41.501944 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 272/535] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:41.508096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70021c35-0779-45fb-96e6-9c4006448efc None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:41.625479 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70021c35-0779-45fb-96e6-9c4006448efc None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:41.666695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48a0fb-6d67-42e9-94a9-cd3fe0036d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:41.667617 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48a0fb-6d67-42e9-94a9-cd3fe0036d84 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:41.668078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48a0fb-6d67-42e9-94a9-cd3fe0036d84 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:41.668494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48a0fb-6d67-42e9-94a9-cd3fe0036d84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:41.677025 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48a0fb-6d67-42e9-94a9-cd3fe0036d84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:41.679319 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48a0fb-6d67-42e9-94a9-cd3fe0036d84 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:41.698127 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-cd48a0fb-6d67-42e9-94a9-cd3fe0036d84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:45:41.698127 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:41.698127 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:41.698127 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:41.698127 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:41.698127 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:41.698127 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:41.698127 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:41.698127 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:41.698127 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:41.698127 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:41.698127 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:41.698127 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 04 00:45:41.698127 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 04 00:45:41.698127 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 04 00:45:41.699502 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 04 00:45:41.699502 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:41.699502 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:41.699502 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:41.699502 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:41.699502 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:41.699502 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:41.699502 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:41.699502 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:41.699502 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:41.699502 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:41.699502 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:41.699502 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:41.699502 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:41.699502 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:41.699502 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:41.699502 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:41.700375 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 04 00:45:41.700375 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 04 00:45:41.700375 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 00:45:41.700375 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 00:45:41.700375 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 00:45:41.700375 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 00:45:41.700375 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:45:41.700375 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:41.703351 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 273/536] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:45:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:45:41.708958 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48a0fb-6d67-42e9-94a9-cd3fe0036d84 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:41.767607 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1f565-2daa-4f19-b7a4-d5615cb016fe None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:41.768327 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:41.826177 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48a0fb-6d67-42e9-94a9-cd3fe0036d84 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:41.866722 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a678e-bf3b-4022-ab8a-4f891c5f1ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:41.868133 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a678e-bf3b-4022-ab8a-4f891c5f1ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:41.869029 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a678e-bf3b-4022-ab8a-4f891c5f1ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:41.869896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a678e-bf3b-4022-ab8a-4f891c5f1ae1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:41.872112 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45471b-cb01-4339-b48d-19bd0ff7c15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:41.873540 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45471b-cb01-4339-b48d-19bd0ff7c15d None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:41.874445 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45471b-cb01-4339-b48d-19bd0ff7c15d None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:41.875841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45471b-cb01-4339-b48d-19bd0ff7c15d None admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:41.876702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45471b-cb01-4339-b48d-19bd0ff7c15d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:41.880904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45471b-cb01-4339-b48d-19bd0ff7c15d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:41.882592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45471b-cb01-4339-b48d-19bd0ff7c15d None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:41.886062 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a678e-bf3b-4022-ab8a-4f891c5f1ae1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:41.888934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a678e-bf3b-4022-ab8a-4f891c5f1ae1 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:41.916286 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-2c5a678e-bf3b-4022-ab8a-4f891c5f1ae1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:45:41.916286 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:41.916286 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:41.916286 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:41.916286 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:41.916286 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:41.916286 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:41.916286 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:41.916286 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:41.916286 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:41.916286 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:41.916286 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:41.916286 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 04 00:45:41.916286 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 04 00:45:41.916286 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 04 00:45:41.917427 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 04 00:45:41.917427 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:41.917427 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:41.917427 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:41.917427 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:41.917427 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:41.917427 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:41.917427 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:41.917427 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:41.917427 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:41.917427 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:41.917427 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:41.917427 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:41.917427 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:41.917427 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:41.917427 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:41.917427 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:41.918363 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 04 00:45:41.918363 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 04 00:45:41.918363 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 00:45:41.918363 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 00:45:41.918363 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 00:45:41.918363 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 00:45:41.918363 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:45:41.918363 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:41.918768 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 274/537] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Sep 4 00:45:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:41.920413 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 264/538] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:45:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 441 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:45:41.925982 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45471b-cb01-4339-b48d-19bd0ff7c15d None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:41.926955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a678e-bf3b-4022-ab8a-4f891c5f1ae1 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:41.985623 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:42.099912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a678e-bf3b-4022-ab8a-4f891c5f1ae1 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:42.110217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45471b-cb01-4339-b48d-19bd0ff7c15d None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:42.130154 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:42.165580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9e847-f94b-441c-86f7-1371314b2011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:42.166171 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9e847-f94b-441c-86f7-1371314b2011 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:42.166461 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9e847-f94b-441c-86f7-1371314b2011 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:42.166761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9e847-f94b-441c-86f7-1371314b2011 None admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:42.168046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9e847-f94b-441c-86f7-1371314b2011 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:42.168355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9e847-f94b-441c-86f7-1371314b2011 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:42.169821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9e847-f94b-441c-86f7-1371314b2011 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:42.175357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de272b7-1f40-42cf-8e35-aea4f16584e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:42.175966 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de272b7-1f40-42cf-8e35-aea4f16584e7 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:42.176249 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de272b7-1f40-42cf-8e35-aea4f16584e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:42.176523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de272b7-1f40-42cf-8e35-aea4f16584e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:42.177321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de272b7-1f40-42cf-8e35-aea4f16584e7 None admin] RBAC: Adding query filter params (role.id=955481bca39c4b0fab953d506ea3c292, scope.project.id=40b24e92f8594ee08bd2a55f79e3b299, user.id=9108334da66445c2a0ba438c19850357) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:42.177658 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de272b7-1f40-42cf-8e35-aea4f16584e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:42.179091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de272b7-1f40-42cf-8e35-aea4f16584e7 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:42.193704 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 275/539] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:45:41 2022] GET /identity/v3/role_assignments?user.id=9108334da66445c2a0ba438c19850357&scope.project.id=40b24e92f8594ee08bd2a55f79e3b299&role.id=955481bca39c4b0fab953d506ea3c292 => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:42.197076 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 265/540] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Sep 4 00:45:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:42.197699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21c476-be64-406a-a762-6aec43843199 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:42.197985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21c476-be64-406a-a762-6aec43843199 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:42.198381 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21c476-be64-406a-a762-6aec43843199 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:42.200039 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 276/541] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:42.205584 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9e847-f94b-441c-86f7-1371314b2011 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:42.226259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55821bbc-8397-4b13-9341-784761fffb8b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:42.226630 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55821bbc-8397-4b13-9341-784761fffb8b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:42.226855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55821bbc-8397-4b13-9341-784761fffb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:42.259329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-55821bbc-8397-4b13-9341-784761fffb8b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:42.260929 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-55821bbc-8397-4b13-9341-784761fffb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:42.337099 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:42.350091 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9e847-f94b-441c-86f7-1371314b2011 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:42.381056 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 277/542] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 04 00:45:42.395531 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed63d2-283f-460a-8562-8d8d0453bfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:42.396134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed63d2-283f-460a-8562-8d8d0453bfbe None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:42.396408 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed63d2-283f-460a-8562-8d8d0453bfbe None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:42.396677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed63d2-283f-460a-8562-8d8d0453bfbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:42.397491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed63d2-283f-460a-8562-8d8d0453bfbe None admin] RBAC: Adding query filter params (role.id=955481bca39c4b0fab953d506ea3c292, scope.project.id=40b24e92f8594ee08bd2a55f79e3b299, user.id=2cdde7a212954a01a2591ad5ac30d049) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:42.397803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed63d2-283f-460a-8562-8d8d0453bfbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:42.399430 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed63d2-283f-460a-8562-8d8d0453bfbe None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:42.406475 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 266/543] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:45:42 2022] GET /identity/v3/role_assignments?user.id=2cdde7a212954a01a2591ad5ac30d049&scope.project.id=40b24e92f8594ee08bd2a55f79e3b299&role.id=955481bca39c4b0fab953d506ea3c292 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:42.666912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55821bbc-8397-4b13-9341-784761fffb8b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:42.770315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55821bbc-8397-4b13-9341-784761fffb8b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:42.772630 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:42.816951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1707d-45c7-4cf9-89fa-3a29581c778c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:42.817611 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1707d-45c7-4cf9-89fa-3a29581c778c None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:42.817893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1707d-45c7-4cf9-89fa-3a29581c778c None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:42.818161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1707d-45c7-4cf9-89fa-3a29581c778c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:42.834699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa1707d-45c7-4cf9-89fa-3a29581c778c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:42.840033 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-bfa1707d-45c7-4cf9-89fa-3a29581c778c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:45:42.840033 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:42.840033 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:42.840033 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:42.840033 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:42.840033 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:42.840033 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:42.840033 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:42.840033 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:42.840033 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:42.840033 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:42.840033 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:42.840033 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:42.840033 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:42.840033 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:42.840033 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:42.840916 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:42.840916 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:42.840916 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:42.840916 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:42.840916 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:42.840916 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:42.840916 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:42.840916 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:42.840916 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:42.840916 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:42.840916 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:42.840916 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:42.840916 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:42.840916 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:42.840916 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:42.840916 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:42.841725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:42.841725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:42.841725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:42.841725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:42.841725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:42.841725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:42.841725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:42.841725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:42.841725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:42.841725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:42.841725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:45:42.841725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:42.841725 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 278/544] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Sep 4 00:45:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:42.847145 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed63d2-283f-460a-8562-8d8d0453bfbe None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:42.989451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed63d2-283f-460a-8562-8d8d0453bfbe None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:43.034279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c041a0-fcdc-415f-a957-3b3bcc067013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:43.035266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c041a0-fcdc-415f-a957-3b3bcc067013 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:43.035785 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c041a0-fcdc-415f-a957-3b3bcc067013 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:43.036274 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c041a0-fcdc-415f-a957-3b3bcc067013 None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:43.037128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c041a0-fcdc-415f-a957-3b3bcc067013 None admin] RBAC: Adding query filter params (name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:43.037659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c041a0-fcdc-415f-a957-3b3bcc067013 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:43.039760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c041a0-fcdc-415f-a957-3b3bcc067013 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:43.052778 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 267/545] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Sep 4 00:45:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:43.058397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1707d-45c7-4cf9-89fa-3a29581c778c None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:43.175490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1707d-45c7-4cf9-89fa-3a29581c778c None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:43.216915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf6abc-db74-41cb-bef4-654f9013b3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:43.217568 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf6abc-db74-41cb-bef4-654f9013b3be None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:43.217847 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf6abc-db74-41cb-bef4-654f9013b3be None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:43.218116 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf6abc-db74-41cb-bef4-654f9013b3be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:43.228727 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf6abc-db74-41cb-bef4-654f9013b3be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:43.230223 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf6abc-db74-41cb-bef4-654f9013b3be None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:43.248171 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-9bcf6abc-db74-41cb-bef4-654f9013b3be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:43.248171 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:43.248171 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:43.248171 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:43.248171 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:43.248171 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:43.248171 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:43.248171 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:43.248171 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:43.248171 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:43.248171 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:43.248171 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:43.248171 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:45:43.248171 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:45:43.248171 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:45:43.248171 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:45:43.249061 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:43.249061 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:43.249061 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:43.249061 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:43.249061 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:43.249061 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:43.249061 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:43.249061 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:43.249061 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:43.249061 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:43.249061 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:43.249061 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:43.249061 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:43.249061 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:43.249061 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:43.249061 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:43.249061 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:45:43.249921 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:45:43.249921 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:43.249921 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:43.253849 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 279/546] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:43.260021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c041a0-fcdc-415f-a957-3b3bcc067013 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:43.299271 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:43.409147 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c041a0-fcdc-415f-a957-3b3bcc067013 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:43.448894 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8de35-5cf7-4d30-ba36-0c5c5f9890b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:43.449536 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8de35-5cf7-4d30-ba36-0c5c5f9890b6 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:43.449823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8de35-5cf7-4d30-ba36-0c5c5f9890b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:43.450098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8de35-5cf7-4d30-ba36-0c5c5f9890b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:43.450749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8de35-5cf7-4d30-ba36-0c5c5f9890b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:43.451053 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8de35-5cf7-4d30-ba36-0c5c5f9890b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:43.452500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8de35-5cf7-4d30-ba36-0c5c5f9890b6 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:43.459349 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce9988-7edf-4f64-b6fd-85671e962ecf None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:43.459911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce9988-7edf-4f64-b6fd-85671e962ecf None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:43.460401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce9988-7edf-4f64-b6fd-85671e962ecf None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:43.462630 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 280/547] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:43.465370 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 268/548] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:43.468228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3007c4-3a2d-4cdb-b1a1-54e00cc23471 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:43.468738 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3007c4-3a2d-4cdb-b1a1-54e00cc23471 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:43.469204 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3007c4-3a2d-4cdb-b1a1-54e00cc23471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:43.470497 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8de35-5cf7-4d30-ba36-0c5c5f9890b6 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:43.508838 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-3c3007c4-3a2d-4cdb-b1a1-54e00cc23471 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:43.514447 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3c3007c4-3a2d-4cdb-b1a1-54e00cc23471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:43.538090 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:43.627742 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:43.649831 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 281/549] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 04 00:45:43.666253 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8de35-5cf7-4d30-ba36-0c5c5f9890b6 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:43.733217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7cf1d-f7d3-4f00-ba84-954b4f7727db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:43.733901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7cf1d-f7d3-4f00-ba84-954b4f7727db None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:43.734179 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7cf1d-f7d3-4f00-ba84-954b4f7727db None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:43.734451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7cf1d-f7d3-4f00-ba84-954b4f7727db None admin] PATH_INFO: `/v3/users/swift` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:43.745382 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d7cf1d-f7d3-4f00-ba84-954b4f7727db None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:43.746857 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d7cf1d-f7d3-4f00-ba84-954b4f7727db None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:43.765637 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-b3d7cf1d-f7d3-4f00-ba84-954b4f7727db None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 04 00:45:43.765637 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:43.765637 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:43.765637 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:43.765637 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:43.765637 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:43.765637 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:43.765637 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:43.765637 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:43.765637 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:43.765637 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:43.765637 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:43.765637 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 04 00:45:43.765637 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 04 00:45:43.765637 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 04 00:45:43.765637 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 04 00:45:43.767093 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:43.767093 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:43.767093 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 00:45:43.767093 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:45:43.767093 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 00:45:43.767093 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:45:43.767093 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:43.767093 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:43.767093 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:43.767093 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:43.767093 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:43.767093 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:43.767093 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:43.767093 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:43.767093 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:43.767093 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:43.767093 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:43.767093 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:43.768529 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:43.768529 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:43.768529 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 00:45:43.768529 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 00:45:43.768529 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 00:45:43.768529 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 00:45:43.768529 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 00:45:43.768529 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 00:45:43.768529 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 04 00:45:43.768529 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:43.768529 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 269/550] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Sep 4 00:45:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:45:43.772784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebab17-36d9-4bca-8bc4-fcd570840357 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:43.773301 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebab17-36d9-4bca-8bc4-fcd570840357 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:43.773301 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebab17-36d9-4bca-8bc4-fcd570840357 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:43.774942 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 282/551] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:43.775589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7cf1d-f7d3-4f00-ba84-954b4f7727db None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:43.779818 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ab652-cef7-415a-9bf3-26878762790a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:43.780099 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ab652-cef7-415a-9bf3-26878762790a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:43.780366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ab652-cef7-415a-9bf3-26878762790a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:43.798325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-018ab652-cef7-415a-9bf3-26878762790a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:43.799496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-018ab652-cef7-415a-9bf3-26878762790a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:43.889714 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 283/552] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 04 00:45:43.941967 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7cf1d-f7d3-4f00-ba84-954b4f7727db None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:44.007295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd1226-9260-4152-bb54-8b122f47a170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:44.007995 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd1226-9260-4152-bb54-8b122f47a170 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:44.008276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd1226-9260-4152-bb54-8b122f47a170 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:44.008545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd1226-9260-4152-bb54-8b122f47a170 None admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:44.009286 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd1226-9260-4152-bb54-8b122f47a170 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:44.009618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd1226-9260-4152-bb54-8b122f47a170 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:44.011117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd1226-9260-4152-bb54-8b122f47a170 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:44.015936 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:44.041353 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 270/553] 10.222.0.30 () {56 vars in 1135 bytes} [Sun Sep 4 00:45:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:44.045406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ab652-cef7-415a-9bf3-26878762790a None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:44.064252 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd1226-9260-4152-bb54-8b122f47a170 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:44.157801 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:44.193878 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ab652-cef7-415a-9bf3-26878762790a None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:44.224020 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd1226-9260-4152-bb54-8b122f47a170 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:44.264984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448021a-81dc-4700-9769-3e30f07e46ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:44.265660 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448021a-81dc-4700-9769-3e30f07e46ca None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:44.265999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448021a-81dc-4700-9769-3e30f07e46ca None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:44.266211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448021a-81dc-4700-9769-3e30f07e46ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:44.272862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdade27-b114-4036-8a5c-66105007dd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:44.274441 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdade27-b114-4036-8a5c-66105007dd22 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:44.274722 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdade27-b114-4036-8a5c-66105007dd22 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:44.274993 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdade27-b114-4036-8a5c-66105007dd22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:44.280035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448021a-81dc-4700-9769-3e30f07e46ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:44.284200 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-6448021a-81dc-4700-9769-3e30f07e46ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:45:44.284200 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:44.284200 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:44.284200 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:44.284200 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:44.284200 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:44.284200 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:44.284200 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:44.284200 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:44.284200 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:44.284200 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:44.284200 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:44.284200 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:44.284200 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:44.284200 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:44.284200 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:44.285179 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:44.285179 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:44.285179 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:44.285179 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:44.285179 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:44.285179 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:44.285179 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:44.285179 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:44.285179 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:44.285179 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:44.285179 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:44.285179 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:44.285179 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:44.285179 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:44.285179 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:44.285179 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:44.286018 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:44.286018 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:44.286018 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:44.286018 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:44.286018 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:44.286018 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:44.286018 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:44.286018 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:44.286018 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:44.286018 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:44.286018 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:45:44.286018 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:44.289891 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 284/554] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Sep 4 00:45:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:44.291019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448021a-81dc-4700-9769-3e30f07e46ca None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:44.351062 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:44.359008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdade27-b114-4036-8a5c-66105007dd22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:44.360710 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdade27-b114-4036-8a5c-66105007dd22 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:44.405244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448021a-81dc-4700-9769-3e30f07e46ca None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:44.454283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291db00-a6b4-49ed-8073-37b237b5032a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:44.454931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291db00-a6b4-49ed-8073-37b237b5032a None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:44.455212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291db00-a6b4-49ed-8073-37b237b5032a None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:44.455486 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291db00-a6b4-49ed-8073-37b237b5032a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:44.458681 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:44.462661 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 271/555] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:45:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 04 00:45:44.463357 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdade27-b114-4036-8a5c-66105007dd22 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:44.473098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291db00-a6b4-49ed-8073-37b237b5032a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:44.478792 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-b291db00-a6b4-49ed-8073-37b237b5032a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:45:44.478792 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:44.478792 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:44.478792 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:44.478792 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:44.478792 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:44.478792 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:44.478792 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:44.478792 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:44.478792 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:44.478792 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:44.478792 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:44.478792 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:44.478792 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:44.478792 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:44.478792 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:44.479769 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:44.479769 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:44.479769 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:44.479769 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:44.479769 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:44.479769 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:44.479769 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:44.479769 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:44.479769 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:44.479769 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:44.479769 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:44.479769 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:44.479769 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:44.479769 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:44.479769 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:44.479769 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:44.480574 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:44.480574 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:44.480574 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:44.480574 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:44.480574 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:44.480574 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:44.480574 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:44.480574 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:44.480574 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:44.480574 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:44.480574 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:45:44.480574 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:44.480574 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 285/556] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Sep 4 00:45:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:44.481745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436ce24-2f11-4f17-8a06-a8782f9908ca None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:44.481745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436ce24-2f11-4f17-8a06-a8782f9908ca None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:44.481991 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436ce24-2f11-4f17-8a06-a8782f9908ca None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:44.485476 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 286/557] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:44.485621 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436ce24-2f11-4f17-8a06-a8782f9908ca None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:44.567229 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:44.576766 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdade27-b114-4036-8a5c-66105007dd22 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:44.592942 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436ce24-2f11-4f17-8a06-a8782f9908ca None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:44.616535 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46a34a-ea91-4f48-8e0d-a08ece5b63a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:44.617170 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46a34a-ea91-4f48-8e0d-a08ece5b63a5 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:44.617458 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46a34a-ea91-4f48-8e0d-a08ece5b63a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:44.617749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46a34a-ea91-4f48-8e0d-a08ece5b63a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:44.618401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46a34a-ea91-4f48-8e0d-a08ece5b63a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:44.618702 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46a34a-ea91-4f48-8e0d-a08ece5b63a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:44.620062 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46a34a-ea91-4f48-8e0d-a08ece5b63a5 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:44.632613 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 272/558] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Sep 4 00:45:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:44.633754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0db9c1-4dbe-4960-a48e-7710c4982f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:44.633946 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46a34a-ea91-4f48-8e0d-a08ece5b63a5 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:44.634039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0db9c1-4dbe-4960-a48e-7710c4982f74 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:44.634039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0db9c1-4dbe-4960-a48e-7710c4982f74 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:44.634039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0db9c1-4dbe-4960-a48e-7710c4982f74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:44.644733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0db9c1-4dbe-4960-a48e-7710c4982f74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:44.646204 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0db9c1-4dbe-4960-a48e-7710c4982f74 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:44.661564 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-9e0db9c1-4dbe-4960-a48e-7710c4982f74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:44.661564 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:44.661564 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:44.661564 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:44.661564 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:44.661564 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:44.661564 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:44.661564 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:44.661564 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:44.661564 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:44.661564 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:44.661564 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:44.661564 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:45:44.661564 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:45:44.661564 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:45:44.661564 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:45:44.662495 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:44.662495 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:44.662495 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:44.662495 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:44.662495 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:44.662495 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:44.662495 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:44.662495 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:44.662495 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:44.662495 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:44.662495 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:44.662495 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:44.662495 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:44.662495 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:44.662495 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:44.662495 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:44.662495 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:45:44.663365 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:45:44.663365 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:44.663365 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:44.663365 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 287/559] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:44.664129 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f567a-c515-4e1f-8f91-e301044120da None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:44.664129 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f567a-c515-4e1f-8f91-e301044120da None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:44.664377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f567a-c515-4e1f-8f91-e301044120da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:44.681728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-306f567a-c515-4e1f-8f91-e301044120da None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:44.682938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-306f567a-c515-4e1f-8f91-e301044120da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:44.729399 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:44.748648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46a34a-ea91-4f48-8e0d-a08ece5b63a5 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:44.753404 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 288/560] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:44.754117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f567a-c515-4e1f-8f91-e301044120da None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:44.783830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a685f1-b325-4b06-abcf-b91c1476942a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:44.784434 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a685f1-b325-4b06-abcf-b91c1476942a None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:44.784707 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a685f1-b325-4b06-abcf-b91c1476942a None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:44.784975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a685f1-b325-4b06-abcf-b91c1476942a None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:44.785673 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a685f1-b325-4b06-abcf-b91c1476942a None admin] RBAC: Adding query filter params (name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:44.785970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a685f1-b325-4b06-abcf-b91c1476942a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:44.787403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a685f1-b325-4b06-abcf-b91c1476942a None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:44.795475 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 273/561] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Sep 4 00:45:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:44.796067 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a685f1-b325-4b06-abcf-b91c1476942a None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:44.814159 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:44.861770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f567a-c515-4e1f-8f91-e301044120da None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:44.893137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a685f1-b325-4b06-abcf-b91c1476942a None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:44.899019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda8e9b-2eac-4d5d-a669-2fd10000a358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:44.899874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda8e9b-2eac-4d5d-a669-2fd10000a358 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:44.900463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda8e9b-2eac-4d5d-a669-2fd10000a358 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:44.900737 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda8e9b-2eac-4d5d-a669-2fd10000a358 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:44.911764 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda8e9b-2eac-4d5d-a669-2fd10000a358 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:44.913971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda8e9b-2eac-4d5d-a669-2fd10000a358 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:44.926579 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0787b-3e4e-4346-a7c2-9c433901f446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:44.927176 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0787b-3e4e-4346-a7c2-9c433901f446 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:44.927451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0787b-3e4e-4346-a7c2-9c433901f446 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:44.927718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0787b-3e4e-4346-a7c2-9c433901f446 None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:44.928346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0787b-3e4e-4346-a7c2-9c433901f446 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:44.928642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0787b-3e4e-4346-a7c2-9c433901f446 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:44.930534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0787b-3e4e-4346-a7c2-9c433901f446 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:44.932070 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-3eda8e9b-2eac-4d5d-a669-2fd10000a358 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:44.932070 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:44.932070 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:44.932070 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:44.932070 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:44.932070 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:44.932070 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:44.932070 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:44.932070 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:44.932070 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:44.932070 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:44.932070 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:44.932070 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:45:44.932070 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:45:44.932070 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:45:44.932070 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:45:44.932973 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:44.932973 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:44.932973 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:44.932973 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:44.932973 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:44.932973 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:44.932973 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:44.932973 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:44.932973 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:44.932973 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:44.932973 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:44.932973 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:44.932973 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:44.932973 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:44.932973 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:44.932973 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:44.932973 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:45:44.934250 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:45:44.934250 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:44.934250 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:44.941490 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 289/562] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:44.941490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1f56a-0bb2-491f-9d38-dd2fceb8b58f None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:44.941490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1f56a-0bb2-491f-9d38-dd2fceb8b58f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:44.941490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1f56a-0bb2-491f-9d38-dd2fceb8b58f None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:44.941490 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 290/563] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:44.941490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1f56a-0bb2-491f-9d38-dd2fceb8b58f None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:44.947445 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 274/564] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:44.948409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0787b-3e4e-4346-a7c2-9c433901f446 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:44.973593 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:45.032486 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:45.047004 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1f56a-0bb2-491f-9d38-dd2fceb8b58f None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:45.053671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0787b-3e4e-4346-a7c2-9c433901f446 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:45.080627 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b207821-de6c-4a09-9a25-8861d2fe82b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:45.081250 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b207821-de6c-4a09-9a25-8861d2fe82b6 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:45.081564 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b207821-de6c-4a09-9a25-8861d2fe82b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:45.081839 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b207821-de6c-4a09-9a25-8861d2fe82b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:45.087754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca872a-743f-4fd6-a913-8237c5341e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:45.088357 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca872a-743f-4fd6-a913-8237c5341e8a None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:45.088634 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca872a-743f-4fd6-a913-8237c5341e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:45.088902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca872a-743f-4fd6-a913-8237c5341e8a None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:45.089570 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca872a-743f-4fd6-a913-8237c5341e8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:45.089872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca872a-743f-4fd6-a913-8237c5341e8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:45.091241 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca872a-743f-4fd6-a913-8237c5341e8a None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:45.092351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b207821-de6c-4a09-9a25-8861d2fe82b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:45.093826 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b207821-de6c-4a09-9a25-8861d2fe82b6 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:45.102462 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 275/565] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:45.103709 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bd635-0325-4125-a4e0-f1539b4f2de2 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:45.103999 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bd635-0325-4125-a4e0-f1539b4f2de2 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:45.104275 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bd635-0325-4125-a4e0-f1539b4f2de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:45.113695 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-1b207821-de6c-4a09-9a25-8861d2fe82b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:45.113695 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:45.113695 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:45.113695 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:45.113695 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:45.113695 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:45.113695 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:45.113695 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:45.113695 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:45.113695 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:45.113695 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:45.113695 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:45.113695 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:45:45.113695 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:45:45.113695 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:45:45.113695 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:45:45.114594 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:45.114594 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:45.114594 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:45.114594 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:45.114594 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:45.114594 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:45.114594 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:45.114594 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:45.114594 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:45.114594 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:45.114594 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:45.114594 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:45.114594 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:45.114594 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:45.114594 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:45.114594 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:45.114594 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:45:45.115464 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:45:45.115464 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:45.115464 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:45.115464 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 291/566] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:45.115688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b207821-de6c-4a09-9a25-8861d2fe82b6 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:45.125041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a18bd635-0325-4125-a4e0-f1539b4f2de2 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:45.126202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a18bd635-0325-4125-a4e0-f1539b4f2de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:45.191691 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 276/567] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:45.192502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18bd635-0325-4125-a4e0-f1539b4f2de2 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:45.213601 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:45.233649 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b207821-de6c-4a09-9a25-8861d2fe82b6 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:45.258925 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:45.271378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62babd54-9721-4013-95d5-6250a4cc7d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:45.272010 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62babd54-9721-4013-95d5-6250a4cc7d43 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:45.272291 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62babd54-9721-4013-95d5-6250a4cc7d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:45.272558 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62babd54-9721-4013-95d5-6250a4cc7d43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:45.279275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62babd54-9721-4013-95d5-6250a4cc7d43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:45.280821 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62babd54-9721-4013-95d5-6250a4cc7d43 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:45.291686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18bd635-0325-4125-a4e0-f1539b4f2de2 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:45.297553 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-62babd54-9721-4013-95d5-6250a4cc7d43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:45:45.297553 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:45.297553 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:45.297553 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:45.297553 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:45.297553 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:45.297553 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:45.297553 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:45.297553 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:45.297553 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:45.297553 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:45.297553 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:45.297553 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 04 00:45:45.297553 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 04 00:45:45.297553 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 04 00:45:45.298431 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 04 00:45:45.298431 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:45.298431 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:45.298431 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:45.298431 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:45.298431 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:45.298431 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:45.298431 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:45.298431 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:45.298431 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:45.298431 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:45.298431 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:45.298431 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:45.298431 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:45.298431 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:45.298431 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:45.298431 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:45.299306 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 04 00:45:45.299306 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 04 00:45:45.299306 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 00:45:45.299306 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 00:45:45.299306 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 00:45:45.299306 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 00:45:45.299306 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:45:45.299306 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:45.301760 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 292/568] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:45:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:45.302920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62babd54-9721-4013-95d5-6250a4cc7d43 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:45.331881 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64516e0-1ec0-4970-8288-1391ad747ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:45.332628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64516e0-1ec0-4970-8288-1391ad747ee4 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:45.333202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64516e0-1ec0-4970-8288-1391ad747ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:45.333336 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64516e0-1ec0-4970-8288-1391ad747ee4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:45.344517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64516e0-1ec0-4970-8288-1391ad747ee4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:45.349724 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-d64516e0-1ec0-4970-8288-1391ad747ee4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:45:45.349724 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:45.349724 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:45.349724 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:45.349724 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:45.349724 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:45.349724 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:45.349724 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:45.349724 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:45.349724 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:45.349724 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:45.349724 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:45.349724 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:45.349724 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:45.349724 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:45.349724 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:45.350632 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:45.350632 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:45.350632 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:45.350632 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:45.350632 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:45.350632 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:45.350632 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:45.350632 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:45.350632 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:45.350632 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:45.350632 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:45.350632 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:45.350632 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:45.350632 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:45.350632 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:45.350632 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:45.351961 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:45.351961 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:45.351961 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:45.351961 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:45.351961 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:45.351961 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:45.351961 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:45.351961 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:45.351961 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:45.351961 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:45.351961 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:45:45.351961 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:45.351961 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 277/569] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Sep 4 00:45:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:45.353151 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64516e0-1ec0-4970-8288-1391ad747ee4 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:45.409993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62babd54-9721-4013-95d5-6250a4cc7d43 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:45.459157 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49174802-adf5-440a-85af-882d412b3643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:45.459304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64516e0-1ec0-4970-8288-1391ad747ee4 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:45.459789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49174802-adf5-440a-85af-882d412b3643 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:45.460066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49174802-adf5-440a-85af-882d412b3643 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:45.460336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49174802-adf5-440a-85af-882d412b3643 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:45.468934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49174802-adf5-440a-85af-882d412b3643 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:45.470405 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49174802-adf5-440a-85af-882d412b3643 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:45.481934 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-49174802-adf5-440a-85af-882d412b3643 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 04 00:45:45.481934 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:45.481934 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:45.481934 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:45.481934 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:45.481934 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:45.481934 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:45.481934 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:45.481934 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:45.481934 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:45.481934 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:45.481934 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:45.481934 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 04 00:45:45.481934 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 04 00:45:45.481934 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 04 00:45:45.481934 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 04 00:45:45.483026 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:45.483026 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:45.483026 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 00:45:45.483026 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:45:45.483026 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 00:45:45.483026 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:45:45.483026 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:45.483026 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:45.483026 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:45.483026 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:45.483026 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:45.483026 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:45.483026 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:45.483026 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:45.483026 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:45.483026 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:45.483026 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:45.483026 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:45.484487 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:45.484487 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:45.484487 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 00:45:45.484487 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 00:45:45.484487 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 00:45:45.484487 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 00:45:45.484487 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 00:45:45.484487 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 00:45:45.484487 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 04 00:45:45.484487 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:45.484487 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 293/570] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:45:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:45.484487 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49174802-adf5-440a-85af-882d412b3643 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:45.487898 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:45.488215 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:45.496753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c709c-e556-427c-a644-9e44135b5830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:45.497353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c709c-e556-427c-a644-9e44135b5830 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:45.497656 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c709c-e556-427c-a644-9e44135b5830 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:45.497925 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c709c-e556-427c-a644-9e44135b5830 None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:45.498558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c709c-e556-427c-a644-9e44135b5830 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:45.498849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c709c-e556-427c-a644-9e44135b5830 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:45.500238 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c709c-e556-427c-a644-9e44135b5830 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:45.511342 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 278/571] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:45.512116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c709c-e556-427c-a644-9e44135b5830 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:45.588755 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49174802-adf5-440a-85af-882d412b3643 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:45.609170 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c709c-e556-427c-a644-9e44135b5830 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:45.621741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c59e87-732a-4e2d-bb83-0ecf755ebdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:45.622334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c59e87-732a-4e2d-bb83-0ecf755ebdb1 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:45.622610 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c59e87-732a-4e2d-bb83-0ecf755ebdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:45.622878 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c59e87-732a-4e2d-bb83-0ecf755ebdb1 None admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:45.623554 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c59e87-732a-4e2d-bb83-0ecf755ebdb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:45.623853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c59e87-732a-4e2d-bb83-0ecf755ebdb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:45.625272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c59e87-732a-4e2d-bb83-0ecf755ebdb1 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:45.636577 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 294/572] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Sep 4 00:45:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:45.637341 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c59e87-732a-4e2d-bb83-0ecf755ebdb1 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:45.644779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284c057-bc86-4ab1-b275-81f6c1543808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:45.645378 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284c057-bc86-4ab1-b275-81f6c1543808 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:45.645678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284c057-bc86-4ab1-b275-81f6c1543808 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:45.645947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284c057-bc86-4ab1-b275-81f6c1543808 None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:45.646603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0284c057-bc86-4ab1-b275-81f6c1543808 None admin] RBAC: Adding query filter params (name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:45.646901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0284c057-bc86-4ab1-b275-81f6c1543808 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:45.648244 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0284c057-bc86-4ab1-b275-81f6c1543808 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:45.656218 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 279/573] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Sep 4 00:45:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:45.657001 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284c057-bc86-4ab1-b275-81f6c1543808 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:45.699678 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:45.706838 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:45.738669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c59e87-732a-4e2d-bb83-0ecf755ebdb1 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:45.758318 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284c057-bc86-4ab1-b275-81f6c1543808 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:45.771599 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bdee38-c4c6-46c0-a7b1-c6db166e8af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:45.772215 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdee38-c4c6-46c0-a7b1-c6db166e8af4 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:45.772491 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdee38-c4c6-46c0-a7b1-c6db166e8af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:45.772760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdee38-c4c6-46c0-a7b1-c6db166e8af4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:45.783041 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bdee38-c4c6-46c0-a7b1-c6db166e8af4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:45.787725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-51bdee38-c4c6-46c0-a7b1-c6db166e8af4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:45:45.787725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:45.787725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:45.787725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:45.787725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:45.787725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:45.787725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:45.787725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:45.787725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:45.787725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:45.787725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:45.787725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:45.787725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:45.787725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:45.787725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:45.787725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:45.788651 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:45.788651 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:45.788651 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:45.788651 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:45.788651 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:45.788651 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:45.788651 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:45.788651 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:45.788651 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:45.788651 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:45.788651 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:45.788651 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:45.788651 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:45.788651 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:45.788651 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:45.788651 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:45.790077 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:45.790077 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:45.790077 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:45.790077 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:45.790077 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:45.790077 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:45.790077 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:45.790077 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:45.790077 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:45.790077 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:45.790077 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:45:45.790077 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:45.790077 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 295/574] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Sep 4 00:45:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:45.790771 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bdee38-c4c6-46c0-a7b1-c6db166e8af4 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:45.792593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdad646-affd-4c73-9145-98ff8a0fb117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:45.793200 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdad646-affd-4c73-9145-98ff8a0fb117 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:45.793584 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdad646-affd-4c73-9145-98ff8a0fb117 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:45.793805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdad646-affd-4c73-9145-98ff8a0fb117 None admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:45.794605 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdad646-affd-4c73-9145-98ff8a0fb117 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:45.794914 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdad646-affd-4c73-9145-98ff8a0fb117 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:45.796332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdad646-affd-4c73-9145-98ff8a0fb117 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:45.813778 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 280/575] 10.222.0.30 () {56 vars in 1137 bytes} [Sun Sep 4 00:45:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:45.814566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdad646-affd-4c73-9145-98ff8a0fb117 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:45.886124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bdee38-c4c6-46c0-a7b1-c6db166e8af4 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:45.907957 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:45.911682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdad646-affd-4c73-9145-98ff8a0fb117 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:45.920174 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd767a-e887-4947-82ba-8a214c1c00ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:45.920793 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd767a-e887-4947-82ba-8a214c1c00ff None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:45.921071 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd767a-e887-4947-82ba-8a214c1c00ff None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:45.921183 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:45.921341 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd767a-e887-4947-82ba-8a214c1c00ff None admin] PATH_INFO: `/v3/users/nova` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:45.928596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd767a-e887-4947-82ba-8a214c1c00ff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:45.930108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd767a-e887-4947-82ba-8a214c1c00ff None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:45.941422 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-4bcd767a-e887-4947-82ba-8a214c1c00ff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 04 00:45:45.941422 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:45.941422 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:45.941422 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:45.941422 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:45.941422 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:45.941422 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:45.941422 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:45.941422 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:45.941422 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:45.941422 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:45.941422 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:45.941422 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 04 00:45:45.941422 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 04 00:45:45.941422 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 04 00:45:45.941422 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 04 00:45:45.942444 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:45.942444 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:45.942444 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 00:45:45.942444 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:45:45.942444 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 00:45:45.942444 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:45:45.942444 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:45.942444 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:45.942444 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:45.942444 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:45.942444 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:45.942444 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:45.942444 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:45.942444 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:45.942444 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:45.942444 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:45.942444 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:45.942444 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:45.944035 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:45.944035 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:45.944035 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 00:45:45.944035 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 00:45:45.944035 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 00:45:45.944035 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 00:45:45.944035 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 00:45:45.944035 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 00:45:45.944035 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 04 00:45:45.944035 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:45.944035 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 296/576] 10.222.0.30 () {56 vars in 1093 bytes} [Sun Sep 4 00:45:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:45.944035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd767a-e887-4947-82ba-8a214c1c00ff None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:45.947335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18fa3ab-e5f2-419e-9387-62b74da80499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:45.947937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18fa3ab-e5f2-419e-9387-62b74da80499 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:45.948480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18fa3ab-e5f2-419e-9387-62b74da80499 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:45.948480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18fa3ab-e5f2-419e-9387-62b74da80499 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:45.949172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18fa3ab-e5f2-419e-9387-62b74da80499 None admin] RBAC: Adding query filter params (role.id=955481bca39c4b0fab953d506ea3c292, scope.project.id=40b24e92f8594ee08bd2a55f79e3b299, user.id=9bcc7a857fad4310896da5a87e71baed) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:45.949498 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18fa3ab-e5f2-419e-9387-62b74da80499 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:45.950967 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18fa3ab-e5f2-419e-9387-62b74da80499 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:45.956225 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 281/577] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:45:45 2022] GET /identity/v3/role_assignments?user.id=9bcc7a857fad4310896da5a87e71baed&scope.project.id=40b24e92f8594ee08bd2a55f79e3b299&role.id=955481bca39c4b0fab953d506ea3c292 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:45.956975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18fa3ab-e5f2-419e-9387-62b74da80499 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:46.057516 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd767a-e887-4947-82ba-8a214c1c00ff None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:46.077089 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18fa3ab-e5f2-419e-9387-62b74da80499 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:46.104622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95864d67-4163-495a-82ce-991038a84686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:46.105257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95864d67-4163-495a-82ce-991038a84686 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:46.105566 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95864d67-4163-495a-82ce-991038a84686 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:46.105838 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95864d67-4163-495a-82ce-991038a84686 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:46.117206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95864d67-4163-495a-82ce-991038a84686 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:46.118695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95864d67-4163-495a-82ce-991038a84686 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:46.124482 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434a2be-7b96-4a46-ab60-229f7a9c4ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:46.125087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434a2be-7b96-4a46-ab60-229f7a9c4ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:46.125365 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434a2be-7b96-4a46-ab60-229f7a9c4ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:46.125653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434a2be-7b96-4a46-ab60-229f7a9c4ad4 None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:46.126304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9434a2be-7b96-4a46-ab60-229f7a9c4ad4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:46.126603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9434a2be-7b96-4a46-ab60-229f7a9c4ad4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:46.127954 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9434a2be-7b96-4a46-ab60-229f7a9c4ad4 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:46.134092 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-95864d67-4163-495a-82ce-991038a84686 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:46.134092 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:46.134092 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:46.134092 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:46.134092 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:46.134092 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:46.134092 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:46.134092 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:46.134092 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:46.134092 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:46.134092 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:46.134092 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:46.134092 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:45:46.134092 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:45:46.134092 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:45:46.134092 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:45:46.135034 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:46.135034 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:46.135034 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:46.135034 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:46.135034 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:46.135034 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:46.135034 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:46.135034 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:46.135034 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:46.135034 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:46.135034 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:46.135034 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:46.135034 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:46.135034 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:46.135034 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:46.135034 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:46.135034 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:45:46.135912 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:45:46.135912 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:46.135912 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:46.135912 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 297/578] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:46.136747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95864d67-4163-495a-82ce-991038a84686 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:46.145804 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 282/579] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Sep 4 00:45:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:46.146675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434a2be-7b96-4a46-ab60-229f7a9c4ad4 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:46.172171 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:46.182473 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:46.244864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95864d67-4163-495a-82ce-991038a84686 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:46.251783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434a2be-7b96-4a46-ab60-229f7a9c4ad4 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:46.280972 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cbc3bd-f7d3-4f01-b39c-346b3ad87d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:46.281949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbc3bd-f7d3-4f01-b39c-346b3ad87d04 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:46.282415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbc3bd-f7d3-4f01-b39c-346b3ad87d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:46.282897 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbc3bd-f7d3-4f01-b39c-346b3ad87d04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:46.288959 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa435745-1b2f-4d5b-8dcf-4c3c70078b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:46.289621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa435745-1b2f-4d5b-8dcf-4c3c70078b93 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:46.289905 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa435745-1b2f-4d5b-8dcf-4c3c70078b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:46.290178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa435745-1b2f-4d5b-8dcf-4c3c70078b93 None admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:46.291326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa435745-1b2f-4d5b-8dcf-4c3c70078b93 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:46.291637 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa435745-1b2f-4d5b-8dcf-4c3c70078b93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:46.293502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa435745-1b2f-4d5b-8dcf-4c3c70078b93 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:46.294405 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cbc3bd-f7d3-4f01-b39c-346b3ad87d04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:46.295826 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cbc3bd-f7d3-4f01-b39c-346b3ad87d04 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:46.311393 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 283/580] 10.222.0.30 () {56 vars in 1133 bytes} [Sun Sep 4 00:45:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:46.312199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa435745-1b2f-4d5b-8dcf-4c3c70078b93 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:46.313578 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-34cbc3bd-f7d3-4f01-b39c-346b3ad87d04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:46.313578 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:46.313578 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:46.313578 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:46.313578 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:46.313578 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:46.313578 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:46.313578 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:46.313578 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:46.313578 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:46.313578 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:46.313578 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:46.313578 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:45:46.313578 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:45:46.313578 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:45:46.313578 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:45:46.314554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:46.314554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:46.314554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:46.314554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:46.314554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:46.314554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:46.314554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:46.314554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:46.314554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:46.314554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:46.314554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:46.314554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:46.314554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:46.314554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:46.314554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:46.314554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:46.314554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:45:46.315725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:45:46.315725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:46.315725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:46.323077 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 298/581] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:46.323077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cbc3bd-f7d3-4f01-b39c-346b3ad87d04 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:46.414648 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:46.415342 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:46.425519 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa435745-1b2f-4d5b-8dcf-4c3c70078b93 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:46.432022 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cbc3bd-f7d3-4f01-b39c-346b3ad87d04 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:46.464986 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8417282-6e62-4382-af14-ddb6536ff15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:46.465616 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8417282-6e62-4382-af14-ddb6536ff15a None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:46.465893 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8417282-6e62-4382-af14-ddb6536ff15a None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:46.466165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8417282-6e62-4382-af14-ddb6536ff15a None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:46.466796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8417282-6e62-4382-af14-ddb6536ff15a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:46.467096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8417282-6e62-4382-af14-ddb6536ff15a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:46.468448 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8417282-6e62-4382-af14-ddb6536ff15a None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:46.474597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb7cda-7517-49f6-aaa1-42fb93ed0dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:46.475698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb7cda-7517-49f6-aaa1-42fb93ed0dca None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:46.475982 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb7cda-7517-49f6-aaa1-42fb93ed0dca None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:46.476258 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb7cda-7517-49f6-aaa1-42fb93ed0dca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:46.479564 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 284/582] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:45:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:46.480353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8417282-6e62-4382-af14-ddb6536ff15a None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:46.493762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb7cda-7517-49f6-aaa1-42fb93ed0dca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:46.495619 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb7cda-7517-49f6-aaa1-42fb93ed0dca None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:46.510668 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-fdeb7cda-7517-49f6-aaa1-42fb93ed0dca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:46.510668 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:46.510668 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:46.510668 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:46.510668 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:46.510668 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:46.510668 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:46.510668 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:46.510668 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:46.510668 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:46.510668 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:46.510668 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:46.510668 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:45:46.510668 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:45:46.510668 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:45:46.510668 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:45:46.511619 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:46.511619 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:46.511619 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:46.511619 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:46.511619 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:46.511619 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:46.511619 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:46.511619 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:46.511619 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:46.511619 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:46.511619 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:46.511619 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:46.511619 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:46.511619 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:46.511619 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:46.511619 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:46.511619 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:45:46.512521 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:45:46.512521 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:46.512521 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:46.512521 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 299/583] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:46.512521 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb7cda-7517-49f6-aaa1-42fb93ed0dca None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:46.589617 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8417282-6e62-4382-af14-ddb6536ff15a None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:46.613603 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb7cda-7517-49f6-aaa1-42fb93ed0dca None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:46.624671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5eb56e-b97b-4f18-bebc-d8dcb8a6dd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:46.625293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5eb56e-b97b-4f18-bebc-d8dcb8a6dd50 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:46.625600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5eb56e-b97b-4f18-bebc-d8dcb8a6dd50 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:46.625868 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5eb56e-b97b-4f18-bebc-d8dcb8a6dd50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:46.637963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5eb56e-b97b-4f18-bebc-d8dcb8a6dd50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:46.639396 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5eb56e-b97b-4f18-bebc-d8dcb8a6dd50 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:46.647584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d75972-c140-4fd0-a98f-8337d4db5d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:46.648183 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d75972-c140-4fd0-a98f-8337d4db5d50 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:46.648489 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d75972-c140-4fd0-a98f-8337d4db5d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:46.648762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d75972-c140-4fd0-a98f-8337d4db5d50 None admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:46.649396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d75972-c140-4fd0-a98f-8337d4db5d50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:46.649725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d75972-c140-4fd0-a98f-8337d4db5d50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:46.651074 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d75972-c140-4fd0-a98f-8337d4db5d50 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:46.653247 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-9c5eb56e-b97b-4f18-bebc-d8dcb8a6dd50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:46.653247 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:46.653247 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:46.653247 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:46.653247 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:46.653247 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:46.653247 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:46.653247 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:46.653247 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:46.653247 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:46.653247 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:46.653247 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:46.653247 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:45:46.653247 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:45:46.653247 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:45:46.653247 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:45:46.654384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:46.654384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:46.654384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:46.654384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:46.654384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:46.654384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:46.654384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:46.654384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:46.654384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:46.654384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:46.654384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:46.654384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:46.654384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:46.654384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:46.654384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:46.654384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:46.654384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:45:46.655777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:45:46.655777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:46.655777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:46.655777 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 285/584] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:46.658280 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5eb56e-b97b-4f18-bebc-d8dcb8a6dd50 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:46.661106 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:46.663762 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:46.667349 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 300/585] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:45:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:46.668038 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d75972-c140-4fd0-a98f-8337d4db5d50 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:46.770945 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d75972-c140-4fd0-a98f-8337d4db5d50 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:46.771243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5eb56e-b97b-4f18-bebc-d8dcb8a6dd50 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:46.803927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f46c77-185a-4f8b-b32b-3b768af2c188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:46.804301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91578c06-8262-4933-9d05-6d3235cb752d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:46.805061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f46c77-185a-4f8b-b32b-3b768af2c188 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:46.805469 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91578c06-8262-4933-9d05-6d3235cb752d None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:46.805668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f46c77-185a-4f8b-b32b-3b768af2c188 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:46.805764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91578c06-8262-4933-9d05-6d3235cb752d None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:46.805944 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f46c77-185a-4f8b-b32b-3b768af2c188 None admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:46.806040 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91578c06-8262-4933-9d05-6d3235cb752d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:46.806582 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f46c77-185a-4f8b-b32b-3b768af2c188 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:46.806887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f46c77-185a-4f8b-b32b-3b768af2c188 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:46.808268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f46c77-185a-4f8b-b32b-3b768af2c188 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:46.813465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91578c06-8262-4933-9d05-6d3235cb752d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:46.814891 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91578c06-8262-4933-9d05-6d3235cb752d None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:46.824609 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 301/586] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:45:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:46.824609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f46c77-185a-4f8b-b32b-3b768af2c188 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:46.830411 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-91578c06-8262-4933-9d05-6d3235cb752d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 04 00:45:46.830411 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:46.830411 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:46.830411 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:46.830411 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:46.830411 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:46.830411 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:46.830411 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:46.830411 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:46.830411 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:46.830411 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:46.830411 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:46.830411 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 04 00:45:46.830411 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 04 00:45:46.830411 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 04 00:45:46.830411 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 04 00:45:46.831525 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:46.831525 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:46.831525 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 00:45:46.831525 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:45:46.831525 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 00:45:46.831525 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:45:46.831525 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:46.831525 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:46.831525 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:46.831525 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:46.831525 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:46.831525 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:46.831525 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:46.831525 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:46.831525 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:46.831525 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:46.831525 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:46.831525 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:46.832649 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:46.832649 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:46.832649 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 00:45:46.832649 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 00:45:46.832649 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 00:45:46.832649 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 00:45:46.832649 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 00:45:46.832649 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 00:45:46.832649 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 04 00:45:46.832649 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:46.833624 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 286/587] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:45:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:46.834457 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91578c06-8262-4933-9d05-6d3235cb752d None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:46.888068 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:46.900953 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:46.935326 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f46c77-185a-4f8b-b32b-3b768af2c188 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:46.943773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91578c06-8262-4933-9d05-6d3235cb752d None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:46.971030 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860263a6-9391-4754-8560-cea8902c917b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:46.971644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860263a6-9391-4754-8560-cea8902c917b None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:46.971925 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860263a6-9391-4754-8560-cea8902c917b None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:46.972312 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860263a6-9391-4754-8560-cea8902c917b None admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:46.973066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860263a6-9391-4754-8560-cea8902c917b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:46.973375 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860263a6-9391-4754-8560-cea8902c917b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:46.974773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860263a6-9391-4754-8560-cea8902c917b None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:46.978300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752ac93-949d-48b6-a0b5-e824558cdb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:46.978991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752ac93-949d-48b6-a0b5-e824558cdb37 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:46.979331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752ac93-949d-48b6-a0b5-e824558cdb37 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:46.979662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752ac93-949d-48b6-a0b5-e824558cdb37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:46.986792 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8752ac93-949d-48b6-a0b5-e824558cdb37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:46.991638 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 302/588] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:45:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:46.991779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8752ac93-949d-48b6-a0b5-e824558cdb37 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:46.991893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860263a6-9391-4754-8560-cea8902c917b None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:47.004026 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-8752ac93-949d-48b6-a0b5-e824558cdb37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:45:47.004026 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:47.004026 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:47.004026 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:47.004026 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:47.004026 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:47.004026 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:47.004026 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:47.004026 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:47.004026 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:47.004026 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:47.004026 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:47.004026 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 04 00:45:47.004026 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 04 00:45:47.004026 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 04 00:45:47.005209 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 04 00:45:47.005209 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:47.005209 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:47.005209 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:47.005209 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:47.005209 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:47.005209 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:47.005209 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:47.005209 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:47.005209 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:47.005209 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:47.005209 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:47.005209 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:47.005209 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:47.005209 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:47.005209 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:47.005209 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:47.006336 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 04 00:45:47.006336 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 04 00:45:47.006336 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 00:45:47.006336 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 00:45:47.006336 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 00:45:47.006336 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 00:45:47.006336 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:45:47.006336 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:47.006336 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 287/589] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:45:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:47.006336 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752ac93-949d-48b6-a0b5-e824558cdb37 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:47.100297 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860263a6-9391-4754-8560-cea8902c917b None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:47.113407 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752ac93-949d-48b6-a0b5-e824558cdb37 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:47.120044 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:47.140288 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e5c69-13e2-4398-8a90-0834a9100b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:47.140929 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e5c69-13e2-4398-8a90-0834a9100b7a None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:47.141368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e5c69-13e2-4398-8a90-0834a9100b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:47.141688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e5c69-13e2-4398-8a90-0834a9100b7a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:47.142216 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:47.151677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e5c69-13e2-4398-8a90-0834a9100b7a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:47.153058 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea7f77-2f97-494e-a824-85f545f61120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:47.153180 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e5c69-13e2-4398-8a90-0834a9100b7a None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:47.153700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea7f77-2f97-494e-a824-85f545f61120 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:47.153975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea7f77-2f97-494e-a824-85f545f61120 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:47.154243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea7f77-2f97-494e-a824-85f545f61120 None admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:47.154964 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea7f77-2f97-494e-a824-85f545f61120 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:47.155265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea7f77-2f97-494e-a824-85f545f61120 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:47.156653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea7f77-2f97-494e-a824-85f545f61120 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:47.167767 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-e79e5c69-13e2-4398-8a90-0834a9100b7a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 04 00:45:47.167767 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:47.167767 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:47.167767 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:47.167767 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:47.167767 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:47.167767 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:47.167767 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:47.167767 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:47.167767 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:47.167767 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:47.167767 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:47.167767 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 04 00:45:47.167767 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 04 00:45:47.167767 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 04 00:45:47.167767 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 04 00:45:47.168686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:47.168686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:47.168686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 00:45:47.168686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:45:47.168686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 00:45:47.168686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:45:47.168686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:47.168686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:47.168686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:47.168686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:47.168686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:47.168686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:47.168686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:47.168686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:47.168686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:47.168686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:47.168686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:47.168686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:47.170043 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:47.170043 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:47.170043 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 00:45:47.170043 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 00:45:47.170043 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 00:45:47.170043 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 00:45:47.170043 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 00:45:47.170043 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 00:45:47.170043 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 04 00:45:47.170043 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:47.170043 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 303/590] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Sep 4 00:45:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:47.170043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e5c69-13e2-4398-8a90-0834a9100b7a None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:47.184222 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 288/591] 10.222.0.30 () {56 vars in 1137 bytes} [Sun Sep 4 00:45:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:47.184222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea7f77-2f97-494e-a824-85f545f61120 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:47.284770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e5c69-13e2-4398-8a90-0834a9100b7a None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:47.285401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea7f77-2f97-494e-a824-85f545f61120 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:47.320617 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0765f43-bcce-42b8-bbd3-1e922d4cdae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:47.321384 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0765f43-bcce-42b8-bbd3-1e922d4cdae7 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:47.321794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0765f43-bcce-42b8-bbd3-1e922d4cdae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:47.322149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0765f43-bcce-42b8-bbd3-1e922d4cdae7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:47.323819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b532d-da51-42b0-99ec-083054ed03b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:47.324560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b532d-da51-42b0-99ec-083054ed03b0 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:47.324840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b532d-da51-42b0-99ec-083054ed03b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:47.325392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b532d-da51-42b0-99ec-083054ed03b0 None admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:47.326104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b532d-da51-42b0-99ec-083054ed03b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:47.326408 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b532d-da51-42b0-99ec-083054ed03b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:47.327817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b532d-da51-42b0-99ec-083054ed03b0 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:47.329361 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0765f43-bcce-42b8-bbd3-1e922d4cdae7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:47.330915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0765f43-bcce-42b8-bbd3-1e922d4cdae7 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:47.345942 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 289/592] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Sep 4 00:45:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:47.345942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b532d-da51-42b0-99ec-083054ed03b0 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:47.346193 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-b0765f43-bcce-42b8-bbd3-1e922d4cdae7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:45:47.346193 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:47.346193 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:47.346193 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:47.346193 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:47.346193 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:47.346193 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:47.346193 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:47.346193 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:47.346193 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:47.346193 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:47.346193 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:47.346193 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 04 00:45:47.346193 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 04 00:45:47.346193 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 04 00:45:47.347205 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 04 00:45:47.347205 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:47.347205 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:47.347205 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:47.347205 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:47.347205 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:47.347205 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:47.347205 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:47.347205 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:47.347205 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:47.347205 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:47.347205 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:47.347205 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:47.347205 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:47.347205 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:47.347205 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:47.347205 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:47.348704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 04 00:45:47.348704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 04 00:45:47.348704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 00:45:47.348704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 00:45:47.348704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 00:45:47.348704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 00:45:47.348704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:45:47.348704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:47.348704 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 304/593] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:45:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:47.348704 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0765f43-bcce-42b8-bbd3-1e922d4cdae7 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:47.389406 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:47.401131 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:47.453677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0765f43-bcce-42b8-bbd3-1e922d4cdae7 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:47.469862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b532d-da51-42b0-99ec-083054ed03b0 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:47.492771 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa76d2b-b5f9-4843-9900-c42dc11bf7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:47.493396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa76d2b-b5f9-4843-9900-c42dc11bf7d9 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:47.493826 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa76d2b-b5f9-4843-9900-c42dc11bf7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:47.493953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa76d2b-b5f9-4843-9900-c42dc11bf7d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:47.504338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa76d2b-b5f9-4843-9900-c42dc11bf7d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:47.505810 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa76d2b-b5f9-4843-9900-c42dc11bf7d9 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:47.507758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba95674-1503-4b2a-85c1-395b81cc6f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:47.508874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba95674-1503-4b2a-85c1-395b81cc6f85 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:47.509254 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba95674-1503-4b2a-85c1-395b81cc6f85 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:47.509661 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba95674-1503-4b2a-85c1-395b81cc6f85 None admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:47.510495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba95674-1503-4b2a-85c1-395b81cc6f85 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:47.510916 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba95674-1503-4b2a-85c1-395b81cc6f85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:47.512423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba95674-1503-4b2a-85c1-395b81cc6f85 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:47.520728 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-7aa76d2b-b5f9-4843-9900-c42dc11bf7d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:47.520728 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:47.520728 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:47.520728 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:47.520728 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:47.520728 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:47.520728 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:47.520728 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:47.520728 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:47.520728 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:47.520728 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:47.520728 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:47.520728 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:45:47.520728 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:45:47.520728 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:45:47.520728 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:45:47.526948 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:47.526948 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:47.526948 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:47.526948 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:47.526948 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:47.526948 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:47.526948 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:47.526948 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:47.526948 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:47.526948 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:47.526948 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:47.526948 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:47.526948 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:47.526948 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:47.526948 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:47.526948 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:47.526948 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:45:47.527878 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:45:47.527878 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:47.527878 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:47.527878 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 305/594] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:47.527878 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa76d2b-b5f9-4843-9900-c42dc11bf7d9 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:47.543092 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 290/595] 10.222.0.30 () {56 vars in 1139 bytes} [Sun Sep 4 00:45:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:47.547573 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba95674-1503-4b2a-85c1-395b81cc6f85 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:47.618537 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:47.630082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa76d2b-b5f9-4843-9900-c42dc11bf7d9 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:47.663318 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:47.666459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba95674-1503-4b2a-85c1-395b81cc6f85 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:47.667310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d306b-4848-47fd-94b4-99e2052d5190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:47.667988 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d306b-4848-47fd-94b4-99e2052d5190 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:47.668720 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d306b-4848-47fd-94b4-99e2052d5190 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:47.669075 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d306b-4848-47fd-94b4-99e2052d5190 None admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:47.669981 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d306b-4848-47fd-94b4-99e2052d5190 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:47.670292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d306b-4848-47fd-94b4-99e2052d5190 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:47.671739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d306b-4848-47fd-94b4-99e2052d5190 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:47.685091 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 306/596] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Sep 4 00:45:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:47.685929 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d306b-4848-47fd-94b4-99e2052d5190 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:47.707883 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd7730-033b-4e40-b049-fa69208301b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:47.708538 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd7730-033b-4e40-b049-fa69208301b3 None admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:47.708816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd7730-033b-4e40-b049-fa69208301b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:47.709087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd7730-033b-4e40-b049-fa69208301b3 None admin] PATH_INFO: `/v3/projects/40b24e92f8594ee08bd2a55f79e3b299/users/efcee9b21ea94b1b8e5c9c5acb35839f/roles/955481bca39c4b0fab953d506ea3c292` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:47.725100 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd7730-033b-4e40-b049-fa69208301b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=40b24e92f8594ee08bd2a55f79e3b299, user_id=efcee9b21ea94b1b8e5c9c5acb35839f, role_id=955481bca39c4b0fab953d506ea3c292)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:47.726821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd7730-033b-4e40-b049-fa69208301b3 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:47.741299 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 291/597] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Sep 4 00:45:47 2022] PUT /identity/v3/projects/40b24e92f8594ee08bd2a55f79e3b299/users/efcee9b21ea94b1b8e5c9c5acb35839f/roles/955481bca39c4b0fab953d506ea3c292 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:45:47.749760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd7730-033b-4e40-b049-fa69208301b3 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:47.810626 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d306b-4848-47fd-94b4-99e2052d5190 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:47.852967 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810599d-d024-477b-98c4-64f3016af6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:47.853784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810599d-d024-477b-98c4-64f3016af6a6 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:47.854135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810599d-d024-477b-98c4-64f3016af6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:47.854509 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810599d-d024-477b-98c4-64f3016af6a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:47.855265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810599d-d024-477b-98c4-64f3016af6a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:47.855726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810599d-d024-477b-98c4-64f3016af6a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:47.857341 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810599d-d024-477b-98c4-64f3016af6a6 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:47.862273 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd7730-033b-4e40-b049-fa69208301b3 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:47.874215 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 307/598] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:45:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:47.875694 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810599d-d024-477b-98c4-64f3016af6a6 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:47.891626 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:47.900494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9612c0-06a1-4f0d-920d-1d1ac0ded692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:47.901234 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9612c0-06a1-4f0d-920d-1d1ac0ded692 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:47.901541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9612c0-06a1-4f0d-920d-1d1ac0ded692 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:47.901839 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9612c0-06a1-4f0d-920d-1d1ac0ded692 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:47.913405 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9612c0-06a1-4f0d-920d-1d1ac0ded692 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:47.914953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9612c0-06a1-4f0d-920d-1d1ac0ded692 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:47.931829 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-4d9612c0-06a1-4f0d-920d-1d1ac0ded692 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:47.931829 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:47.931829 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:47.931829 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:47.931829 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:47.931829 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:47.931829 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:47.931829 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:47.931829 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:47.931829 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:47.931829 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:47.931829 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:47.931829 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:45:47.931829 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:45:47.931829 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:45:47.931829 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:45:47.932865 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:47.932865 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:47.932865 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:47.932865 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:47.932865 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:47.932865 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:47.932865 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:47.932865 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:47.932865 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:47.932865 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:47.932865 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:47.932865 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:47.932865 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:47.932865 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:47.932865 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:47.932865 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:47.932865 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:45:47.933801 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:45:47.933801 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:47.933801 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:47.933801 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 292/599] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:47.934610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900006f-e2c3-4512-b0f8-c4593f7d124d None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:47.934610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900006f-e2c3-4512-b0f8-c4593f7d124d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:47.934843 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900006f-e2c3-4512-b0f8-c4593f7d124d None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:47.936645 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 293/600] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:47.937573 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4900006f-e2c3-4512-b0f8-c4593f7d124d None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:47.941747 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:47.999673 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810599d-d024-477b-98c4-64f3016af6a6 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:48.035085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c310d-e250-43c4-91ca-159eeed2b9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:48.036035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c310d-e250-43c4-91ca-159eeed2b9b9 None admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:48.036496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c310d-e250-43c4-91ca-159eeed2b9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:48.036769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c310d-e250-43c4-91ca-159eeed2b9b9 None admin] PATH_INFO: `/v3/projects/40b24e92f8594ee08bd2a55f79e3b299/users/13f0f341bf2c475d82b4e7b34d503dd0/roles/955481bca39c4b0fab953d506ea3c292` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:48.051494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c310d-e250-43c4-91ca-159eeed2b9b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=40b24e92f8594ee08bd2a55f79e3b299, user_id=13f0f341bf2c475d82b4e7b34d503dd0, role_id=955481bca39c4b0fab953d506ea3c292)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:48.052938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c310d-e250-43c4-91ca-159eeed2b9b9 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:48.056004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4900006f-e2c3-4512-b0f8-c4593f7d124d None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:48.068437 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 308/601] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Sep 4 00:45:47 2022] PUT /identity/v3/projects/40b24e92f8594ee08bd2a55f79e3b299/users/13f0f341bf2c475d82b4e7b34d503dd0/roles/955481bca39c4b0fab953d506ea3c292 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:45:48.070826 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c310d-e250-43c4-91ca-159eeed2b9b9 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:48.109968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db58c84-6470-49c4-a909-b43b67dc23a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:48.110638 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db58c84-6470-49c4-a909-b43b67dc23a4 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:48.110919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db58c84-6470-49c4-a909-b43b67dc23a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:48.111192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db58c84-6470-49c4-a909-b43b67dc23a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:48.119932 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db58c84-6470-49c4-a909-b43b67dc23a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:48.121546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db58c84-6470-49c4-a909-b43b67dc23a4 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:48.135564 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-7db58c84-6470-49c4-a909-b43b67dc23a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:45:48.135564 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:48.135564 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:48.135564 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:48.135564 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:48.135564 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:48.135564 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:48.135564 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:48.135564 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:48.135564 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:48.135564 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:48.135564 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:48.135564 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 04 00:45:48.135564 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 04 00:45:48.135564 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 04 00:45:48.136544 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 04 00:45:48.136544 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:48.136544 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:48.136544 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:48.136544 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:48.136544 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:48.136544 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:48.136544 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:48.136544 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:48.136544 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:48.136544 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:48.136544 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:48.136544 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:48.136544 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:48.136544 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:48.136544 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:48.136544 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:48.137402 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 04 00:45:48.137402 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 04 00:45:48.137402 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 00:45:48.137402 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 00:45:48.137402 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 00:45:48.137402 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 00:45:48.137402 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:45:48.137402 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:48.142098 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 294/602] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:45:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:48.143235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb791fe-b391-4ab5-a0dd-ee0a9bb1495d None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:48.143584 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb791fe-b391-4ab5-a0dd-ee0a9bb1495d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:48.143793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb791fe-b391-4ab5-a0dd-ee0a9bb1495d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:48.159810 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:48.163385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-7fb791fe-b391-4ab5-a0dd-ee0a9bb1495d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:48.164927 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7fb791fe-b391-4ab5-a0dd-ee0a9bb1495d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:48.218607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c310d-e250-43c4-91ca-159eeed2b9b9 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:48.236558 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:48.247437 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 295/603] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:48.248327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb791fe-b391-4ab5-a0dd-ee0a9bb1495d None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:48.262613 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d00734-a118-448f-b8f4-8212d5180255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:48.263230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d00734-a118-448f-b8f4-8212d5180255 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:48.263513 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d00734-a118-448f-b8f4-8212d5180255 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:48.263789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d00734-a118-448f-b8f4-8212d5180255 None admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:48.264436 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d00734-a118-448f-b8f4-8212d5180255 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:48.264741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d00734-a118-448f-b8f4-8212d5180255 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:48.266157 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d00734-a118-448f-b8f4-8212d5180255 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:48.283650 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 309/604] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:45:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:48.290100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d00734-a118-448f-b8f4-8212d5180255 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:48.420243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb791fe-b391-4ab5-a0dd-ee0a9bb1495d None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:48.491579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d00734-a118-448f-b8f4-8212d5180255 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:48.494602 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ef31e-bd44-4af3-9c0a-1084617f3213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:48.495207 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ef31e-bd44-4af3-9c0a-1084617f3213 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:48.495481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ef31e-bd44-4af3-9c0a-1084617f3213 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:48.495745 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ef31e-bd44-4af3-9c0a-1084617f3213 None admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:48.496437 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ef31e-bd44-4af3-9c0a-1084617f3213 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:48.496735 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ef31e-bd44-4af3-9c0a-1084617f3213 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:48.498190 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ef31e-bd44-4af3-9c0a-1084617f3213 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:48.520441 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 296/605] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Sep 4 00:45:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:48.524820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ef31e-bd44-4af3-9c0a-1084617f3213 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:48.530378 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:48.557569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2e58f-e2d5-47b3-a52e-9703078cb5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:48.558212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2e58f-e2d5-47b3-a52e-9703078cb5f0 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:48.558497 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2e58f-e2d5-47b3-a52e-9703078cb5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:48.558774 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2e58f-e2d5-47b3-a52e-9703078cb5f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:48.574540 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae2e58f-e2d5-47b3-a52e-9703078cb5f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:48.575987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae2e58f-e2d5-47b3-a52e-9703078cb5f0 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:48.600569 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-0ae2e58f-e2d5-47b3-a52e-9703078cb5f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:45:48.600569 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:48.600569 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:48.600569 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:48.600569 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:48.600569 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:48.600569 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:48.600569 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:48.600569 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:48.600569 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:48.600569 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:48.600569 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:48.600569 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 04 00:45:48.600569 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 04 00:45:48.600569 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 04 00:45:48.602235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 04 00:45:48.602235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:48.602235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:48.602235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:48.602235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:48.602235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:48.602235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:48.602235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:48.602235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:48.602235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:48.602235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:48.602235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:48.602235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:48.602235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:48.602235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:48.602235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:48.602235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:48.603337 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 04 00:45:48.603337 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 04 00:45:48.603337 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 00:45:48.603337 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 00:45:48.603337 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 00:45:48.603337 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 00:45:48.603337 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:45:48.603337 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:48.612678 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 310/606] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:45:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:45:48.612838 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:48.613674 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2e58f-e2d5-47b3-a52e-9703078cb5f0 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:48.686827 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ef31e-bd44-4af3-9c0a-1084617f3213 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:48.736446 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f52e13-dadc-42cb-98dd-4f56599d7e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:48.737101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f52e13-dadc-42cb-98dd-4f56599d7e9e None admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:48.737374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f52e13-dadc-42cb-98dd-4f56599d7e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:48.737680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f52e13-dadc-42cb-98dd-4f56599d7e9e None admin] PATH_INFO: `/v3/projects/40b24e92f8594ee08bd2a55f79e3b299/users/9108334da66445c2a0ba438c19850357/roles/955481bca39c4b0fab953d506ea3c292` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:48.754586 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f52e13-dadc-42cb-98dd-4f56599d7e9e None admin] RBAC: Authorizing `identity:create_grant(project_id=40b24e92f8594ee08bd2a55f79e3b299, user_id=9108334da66445c2a0ba438c19850357, role_id=955481bca39c4b0fab953d506ea3c292)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:48.756019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f52e13-dadc-42cb-98dd-4f56599d7e9e None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:48.770809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2e58f-e2d5-47b3-a52e-9703078cb5f0 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:48.776235 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 297/607] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Sep 4 00:45:48 2022] PUT /identity/v3/projects/40b24e92f8594ee08bd2a55f79e3b299/users/9108334da66445c2a0ba438c19850357/roles/955481bca39c4b0fab953d506ea3c292 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:45:48.777072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f52e13-dadc-42cb-98dd-4f56599d7e9e None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:48.813137 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09f0a3-0868-44b2-b9bf-80dd0b576928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:48.814231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09f0a3-0868-44b2-b9bf-80dd0b576928 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:48.814691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09f0a3-0868-44b2-b9bf-80dd0b576928 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:48.815275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09f0a3-0868-44b2-b9bf-80dd0b576928 None admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:48.816346 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09f0a3-0868-44b2-b9bf-80dd0b576928 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:48.816847 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09f0a3-0868-44b2-b9bf-80dd0b576928 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:48.818749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09f0a3-0868-44b2-b9bf-80dd0b576928 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:48.833077 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 311/608] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Sep 4 00:45:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:45:48.841485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09f0a3-0868-44b2-b9bf-80dd0b576928 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:48.905113 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f52e13-dadc-42cb-98dd-4f56599d7e9e None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:48.907509 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:48.944309 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:48.950404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502d108-871f-4350-bb88-4b372711bd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:48.951887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502d108-871f-4350-bb88-4b372711bd03 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:48.952170 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502d108-871f-4350-bb88-4b372711bd03 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:48.952440 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502d108-871f-4350-bb88-4b372711bd03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:48.965279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502d108-871f-4350-bb88-4b372711bd03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:48.971651 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-7502d108-871f-4350-bb88-4b372711bd03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:45:48.971651 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:48.971651 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:48.971651 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:48.971651 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:48.971651 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:48.971651 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:48.971651 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:48.971651 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:48.971651 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:48.971651 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:48.971651 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:48.971651 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:48.971651 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:48.971651 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:48.971651 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:48.972759 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:48.972759 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:48.972759 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:48.972759 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:48.972759 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:48.972759 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:48.972759 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:48.972759 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:48.972759 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:48.972759 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:48.972759 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:48.972759 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:48.972759 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:48.972759 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:48.972759 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:48.972759 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:48.973876 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:48.973876 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:48.973876 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:48.973876 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:48.973876 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:48.973876 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:48.973876 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:48.973876 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:48.973876 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:48.973876 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:48.973876 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:45:48.973876 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:48.973876 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 298/609] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Sep 4 00:45:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:48.980351 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502d108-871f-4350-bb88-4b372711bd03 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:49.024116 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09f0a3-0868-44b2-b9bf-80dd0b576928 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:49.060217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fbac5-5b6d-4995-9947-e9ec6a16ac7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:49.060873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fbac5-5b6d-4995-9947-e9ec6a16ac7e None admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:49.061154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fbac5-5b6d-4995-9947-e9ec6a16ac7e None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:49.061422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fbac5-5b6d-4995-9947-e9ec6a16ac7e None admin] PATH_INFO: `/v3/projects/40b24e92f8594ee08bd2a55f79e3b299/users/2cdde7a212954a01a2591ad5ac30d049/roles/955481bca39c4b0fab953d506ea3c292` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:49.076701 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42fbac5-5b6d-4995-9947-e9ec6a16ac7e None admin] RBAC: Authorizing `identity:create_grant(project_id=40b24e92f8594ee08bd2a55f79e3b299, user_id=2cdde7a212954a01a2591ad5ac30d049, role_id=955481bca39c4b0fab953d506ea3c292)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:49.078866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42fbac5-5b6d-4995-9947-e9ec6a16ac7e None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:49.116072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502d108-871f-4350-bb88-4b372711bd03 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:49.122594 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 312/610] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Sep 4 00:45:48 2022] PUT /identity/v3/projects/40b24e92f8594ee08bd2a55f79e3b299/users/2cdde7a212954a01a2591ad5ac30d049/roles/955481bca39c4b0fab953d506ea3c292 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:45:49.160596 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3bc2e-3b52-4cd3-84b4-1aaf2fe836e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:49.161574 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3bc2e-3b52-4cd3-84b4-1aaf2fe836e9 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:49.162004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3bc2e-3b52-4cd3-84b4-1aaf2fe836e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:49.162471 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3bc2e-3b52-4cd3-84b4-1aaf2fe836e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:49.163298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e3bc2e-3b52-4cd3-84b4-1aaf2fe836e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:49.163750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e3bc2e-3b52-4cd3-84b4-1aaf2fe836e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:49.165388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e3bc2e-3b52-4cd3-84b4-1aaf2fe836e9 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:49.175144 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 299/611] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Sep 4 00:45:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:45:49.180880 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fbac5-5b6d-4995-9947-e9ec6a16ac7e None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:49.315741 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:49.329843 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fbac5-5b6d-4995-9947-e9ec6a16ac7e None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:49.371037 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294d6d8-fa27-4778-917f-5f9486a5d4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:49.371668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294d6d8-fa27-4778-917f-5f9486a5d4be None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:49.371941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294d6d8-fa27-4778-917f-5f9486a5d4be None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:49.372210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294d6d8-fa27-4778-917f-5f9486a5d4be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:49.383163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5294d6d8-fa27-4778-917f-5f9486a5d4be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:49.384664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5294d6d8-fa27-4778-917f-5f9486a5d4be None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:49.399807 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-5294d6d8-fa27-4778-917f-5f9486a5d4be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:49.399807 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:49.399807 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:49.399807 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:49.399807 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:49.399807 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:49.399807 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:49.399807 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:49.399807 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:49.399807 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:49.399807 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:49.399807 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:49.399807 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:45:49.399807 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:45:49.399807 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:45:49.399807 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:45:49.400761 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:49.400761 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:49.400761 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:49.400761 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:49.400761 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:49.400761 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:49.400761 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:49.400761 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:49.400761 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:49.400761 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:49.400761 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:49.400761 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:49.400761 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:49.400761 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:49.400761 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:49.400761 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:49.400761 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:45:49.401663 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:45:49.401663 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:49.401663 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:49.401663 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 313/612] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:49.407006 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3bc2e-3b52-4cd3-84b4-1aaf2fe836e9 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:49.436104 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:49.554015 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3bc2e-3b52-4cd3-84b4-1aaf2fe836e9 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:49.600965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727477b-e820-4910-bda2-3e46e0012448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:49.602188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727477b-e820-4910-bda2-3e46e0012448 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:49.602473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727477b-e820-4910-bda2-3e46e0012448 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:49.602742 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727477b-e820-4910-bda2-3e46e0012448 None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:49.603384 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727477b-e820-4910-bda2-3e46e0012448 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:49.603680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727477b-e820-4910-bda2-3e46e0012448 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:49.605104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727477b-e820-4910-bda2-3e46e0012448 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:49.619349 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 300/613] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:49.624783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294d6d8-fa27-4778-917f-5f9486a5d4be None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:49.750784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294d6d8-fa27-4778-917f-5f9486a5d4be None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:49.799815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6af32e-495d-4736-80ee-4cb578d4e666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:49.800448 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6af32e-495d-4736-80ee-4cb578d4e666 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:49.800727 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6af32e-495d-4736-80ee-4cb578d4e666 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:49.800995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6af32e-495d-4736-80ee-4cb578d4e666 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:49.809140 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6af32e-495d-4736-80ee-4cb578d4e666 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:49.810621 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6af32e-495d-4736-80ee-4cb578d4e666 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:49.822693 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-1b6af32e-495d-4736-80ee-4cb578d4e666 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 04 00:45:49.822693 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:49.822693 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:49.822693 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:49.822693 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:49.822693 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:49.822693 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:49.822693 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:49.822693 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:49.822693 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:49.822693 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:49.822693 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:49.822693 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 04 00:45:49.822693 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 04 00:45:49.822693 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 04 00:45:49.822693 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 04 00:45:49.823633 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:49.823633 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:49.823633 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 00:45:49.823633 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:45:49.823633 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 00:45:49.823633 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:45:49.823633 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:49.823633 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:49.823633 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:49.823633 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:49.823633 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:49.823633 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:49.823633 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:49.823633 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:49.823633 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:49.823633 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:49.823633 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:49.823633 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:49.825181 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:49.825181 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:49.825181 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 00:45:49.825181 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 00:45:49.825181 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 00:45:49.825181 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 00:45:49.825181 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 00:45:49.825181 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 00:45:49.825181 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 04 00:45:49.825181 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:49.825181 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 314/614] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Sep 4 00:45:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:49.829737 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727477b-e820-4910-bda2-3e46e0012448 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:49.949670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea67f3-c1e2-49c1-a76c-84993be95b28 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:49.950188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea67f3-c1e2-49c1-a76c-84993be95b28 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:49.950188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea67f3-c1e2-49c1-a76c-84993be95b28 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:49.951753 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 315/615] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:49.954298 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:49.970773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc8634-1e22-45c9-9104-6e18940e8ddb None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:49.971053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc8634-1e22-45c9-9104-6e18940e8ddb None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:49.971313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc8634-1e22-45c9-9104-6e18940e8ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:49.972091 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727477b-e820-4910-bda2-3e46e0012448 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:49.988247 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:50.007163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-95bc8634-1e22-45c9-9104-6e18940e8ddb None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:50.008877 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-95bc8634-1e22-45c9-9104-6e18940e8ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:50.030528 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c35d5-543b-4fc2-92a4-db15b76eca1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:50.031141 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c35d5-543b-4fc2-92a4-db15b76eca1a None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:50.031419 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c35d5-543b-4fc2-92a4-db15b76eca1a None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:50.031691 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c35d5-543b-4fc2-92a4-db15b76eca1a None admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:50.032425 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c35d5-543b-4fc2-92a4-db15b76eca1a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:50.032728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c35d5-543b-4fc2-92a4-db15b76eca1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:50.034182 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c35d5-543b-4fc2-92a4-db15b76eca1a None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:50.068321 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 301/616] 10.222.0.30 () {56 vars in 1135 bytes} [Sun Sep 4 00:45:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:50.072618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c35d5-543b-4fc2-92a4-db15b76eca1a None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:50.110976 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 316/617] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 04 00:45:50.252271 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c35d5-543b-4fc2-92a4-db15b76eca1a None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:50.298186 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31802625-08e7-45b0-a19f-72f45d6690b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:50.298819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31802625-08e7-45b0-a19f-72f45d6690b2 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:50.299099 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31802625-08e7-45b0-a19f-72f45d6690b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:50.299371 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31802625-08e7-45b0-a19f-72f45d6690b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:50.313966 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31802625-08e7-45b0-a19f-72f45d6690b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:50.315406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31802625-08e7-45b0-a19f-72f45d6690b2 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:50.318925 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:50.334853 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-31802625-08e7-45b0-a19f-72f45d6690b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:50.334853 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:50.334853 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:50.334853 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:50.334853 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:50.334853 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:50.334853 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:50.334853 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:50.334853 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:50.334853 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:50.334853 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:50.334853 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:50.334853 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:45:50.334853 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:45:50.334853 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:45:50.334853 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:45:50.336433 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:50.336433 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:50.336433 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:50.336433 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:50.336433 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:50.336433 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:50.336433 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:50.336433 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:50.336433 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:50.336433 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:50.336433 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:50.336433 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:50.336433 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:50.336433 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:50.336433 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:50.336433 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:50.336433 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:45:50.337945 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:45:50.337945 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:50.337945 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:50.337945 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 302/618] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:45:50.342634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc8634-1e22-45c9-9104-6e18940e8ddb None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:50.378025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854a01e-1dbd-4f32-b066-5b7d8786ea6e None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:50.378333 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854a01e-1dbd-4f32-b066-5b7d8786ea6e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:50.378565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854a01e-1dbd-4f32-b066-5b7d8786ea6e None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:50.380131 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 303/619] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 04 00:45:50.385597 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf73a8f-1242-4698-a37a-0304e384d765 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:50.385879 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf73a8f-1242-4698-a37a-0304e384d765 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:50.386158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf73a8f-1242-4698-a37a-0304e384d765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:50.420104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-bdf73a8f-1242-4698-a37a-0304e384d765 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:50.421283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bdf73a8f-1242-4698-a37a-0304e384d765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:50.532700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc8634-1e22-45c9-9104-6e18940e8ddb None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:50.541971 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 304/620] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:50.545753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf73a8f-1242-4698-a37a-0304e384d765 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:50.586777 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:50.595091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bdad5-5b4a-4542-a764-941dc8629616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:50.595768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bdad5-5b4a-4542-a764-941dc8629616 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:50.596050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bdad5-5b4a-4542-a764-941dc8629616 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:50.596328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bdad5-5b4a-4542-a764-941dc8629616 None admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:50.597028 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186bdad5-5b4a-4542-a764-941dc8629616 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:50.597342 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186bdad5-5b4a-4542-a764-941dc8629616 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:50.598753 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186bdad5-5b4a-4542-a764-941dc8629616 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:50.621715 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 317/621] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:50.626170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bdad5-5b4a-4542-a764-941dc8629616 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:50.725311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf73a8f-1242-4698-a37a-0304e384d765 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:50.769867 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:50.790436 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace1273-ff6e-4f1a-aaed-910618319229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:50.790988 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace1273-ff6e-4f1a-aaed-910618319229 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:50.791267 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace1273-ff6e-4f1a-aaed-910618319229 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:50.791540 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace1273-ff6e-4f1a-aaed-910618319229 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:50.804785 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bdad5-5b4a-4542-a764-941dc8629616 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:50.810341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace1273-ff6e-4f1a-aaed-910618319229 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:50.819644 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-0ace1273-ff6e-4f1a-aaed-910618319229 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:45:50.819644 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:50.819644 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:50.819644 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:50.819644 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:50.819644 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:50.819644 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:50.819644 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:50.819644 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:50.819644 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:50.819644 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:50.819644 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:50.819644 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:50.819644 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:50.819644 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:50.819644 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:50.821089 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:50.821089 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:50.821089 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:50.821089 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:50.821089 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:50.821089 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:50.821089 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:50.821089 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:50.821089 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:50.821089 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:50.821089 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:50.821089 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:50.821089 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:50.821089 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:50.821089 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:50.821089 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:50.821963 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:50.821963 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:50.821963 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:50.821963 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:50.821963 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:50.821963 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:50.821963 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:50.821963 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:50.821963 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:50.821963 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:50.821963 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:45:50.821963 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:50.824215 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 305/622] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Sep 4 00:45:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:50.830697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace1273-ff6e-4f1a-aaed-910618319229 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:50.874159 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a662e-e789-493a-b2e9-2b54b999fe9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:50.874794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a662e-e789-493a-b2e9-2b54b999fe9f None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:50.875072 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a662e-e789-493a-b2e9-2b54b999fe9f None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:50.875348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a662e-e789-493a-b2e9-2b54b999fe9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:50.885675 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a662e-e789-493a-b2e9-2b54b999fe9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:50.887118 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a662e-e789-493a-b2e9-2b54b999fe9f None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:50.909276 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-4f8a662e-e789-493a-b2e9-2b54b999fe9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:45:50.909276 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:50.909276 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:50.909276 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:50.909276 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:50.909276 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:50.909276 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:50.909276 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:50.909276 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:50.909276 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:50.909276 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:50.909276 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:50.909276 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 04 00:45:50.909276 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 04 00:45:50.909276 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 04 00:45:50.910279 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 04 00:45:50.910279 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:50.910279 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:50.910279 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:50.910279 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:50.910279 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:50.910279 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:50.910279 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:50.910279 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:50.910279 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:50.910279 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:50.910279 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:50.910279 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:50.910279 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:50.910279 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:50.910279 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:50.910279 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:50.911174 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 04 00:45:50.911174 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 04 00:45:50.911174 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 00:45:50.911174 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 00:45:50.911174 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 00:45:50.911174 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 00:45:50.911174 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:45:50.911174 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:50.914025 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 318/623] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:45:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:50.915083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a662e-e789-493a-b2e9-2b54b999fe9f None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:50.982783 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:50.995019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace1273-ff6e-4f1a-aaed-910618319229 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:51.035387 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce2877-6f16-422f-b5ce-bc6b096db396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:51.036376 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce2877-6f16-422f-b5ce-bc6b096db396 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:51.036874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce2877-6f16-422f-b5ce-bc6b096db396 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:51.037485 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce2877-6f16-422f-b5ce-bc6b096db396 None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:51.038453 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce2877-6f16-422f-b5ce-bc6b096db396 None admin] RBAC: Adding query filter params (name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:51.038988 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce2877-6f16-422f-b5ce-bc6b096db396 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:51.040628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce2877-6f16-422f-b5ce-bc6b096db396 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:51.040812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a662e-e789-493a-b2e9-2b54b999fe9f None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:51.050609 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 306/624] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Sep 4 00:45:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:51.051933 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce2877-6f16-422f-b5ce-bc6b096db396 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:51.082209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fc71d-28df-49ff-987b-d2a5452ee88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:51.082876 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fc71d-28df-49ff-987b-d2a5452ee88b None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:51.083179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fc71d-28df-49ff-987b-d2a5452ee88b None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:51.083409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fc71d-28df-49ff-987b-d2a5452ee88b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:51.096124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fc71d-28df-49ff-987b-d2a5452ee88b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:51.101732 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-d56fc71d-28df-49ff-987b-d2a5452ee88b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:45:51.101732 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:51.101732 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:51.101732 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:51.101732 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:51.101732 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:51.101732 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:51.101732 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:51.101732 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:51.101732 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:51.101732 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:51.101732 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:51.101732 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:51.101732 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:51.101732 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:51.101732 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:51.102715 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:51.102715 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:51.102715 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:51.102715 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:51.102715 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:51.102715 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:51.102715 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:51.102715 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:51.102715 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:51.102715 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:51.102715 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:51.102715 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:51.102715 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:51.102715 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:51.102715 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:51.102715 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:51.103533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:51.103533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:51.103533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:51.103533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:51.103533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:51.103533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:51.103533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:51.103533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:51.103533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:51.103533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:51.103533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:45:51.103533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:51.107862 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 319/625] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Sep 4 00:45:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:51.108550 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fc71d-28df-49ff-987b-d2a5452ee88b None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:51.112297 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:51.173886 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce2877-6f16-422f-b5ce-bc6b096db396 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:51.210956 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f983c-905b-4eb5-b22f-6f44e95cddbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:51.211664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f983c-905b-4eb5-b22f-6f44e95cddbc None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:51.211936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f983c-905b-4eb5-b22f-6f44e95cddbc None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:51.212313 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f983c-905b-4eb5-b22f-6f44e95cddbc None admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:51.212999 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f983c-905b-4eb5-b22f-6f44e95cddbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:51.213296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f983c-905b-4eb5-b22f-6f44e95cddbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:51.214765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f983c-905b-4eb5-b22f-6f44e95cddbc None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:51.218459 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fc71d-28df-49ff-987b-d2a5452ee88b None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:51.226536 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 307/626] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Sep 4 00:45:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:51.227323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f983c-905b-4eb5-b22f-6f44e95cddbc None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:51.236041 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:51.259550 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3be50-a66c-403f-9f32-c23207b5149f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:51.260124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3be50-a66c-403f-9f32-c23207b5149f None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:51.260404 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3be50-a66c-403f-9f32-c23207b5149f None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:51.260713 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3be50-a66c-403f-9f32-c23207b5149f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:51.271104 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa3be50-a66c-403f-9f32-c23207b5149f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:51.272549 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa3be50-a66c-403f-9f32-c23207b5149f None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:51.288674 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-daa3be50-a66c-403f-9f32-c23207b5149f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:51.288674 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:51.288674 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:51.288674 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:51.288674 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:51.288674 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:51.288674 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:51.288674 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:51.288674 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:51.288674 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:51.288674 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:51.288674 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:51.288674 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:45:51.288674 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:45:51.288674 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:45:51.288674 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:45:51.290023 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:51.290023 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:51.290023 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:51.290023 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:51.290023 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:51.290023 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:51.290023 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:51.290023 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:51.290023 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:51.290023 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:51.290023 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:51.290023 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:51.290023 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:51.290023 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:51.290023 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:51.290023 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:51.290023 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:45:51.290943 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:45:51.290943 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:51.290943 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:51.290943 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 320/627] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:51.291393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305a3fd-c7a7-47af-85f6-da424418718a None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:51.291679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305a3fd-c7a7-47af-85f6-da424418718a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:51.292002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305a3fd-c7a7-47af-85f6-da424418718a None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:51.297269 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 321/628] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:51.297920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305a3fd-c7a7-47af-85f6-da424418718a None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:51.340807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f983c-905b-4eb5-b22f-6f44e95cddbc None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:51.348160 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:51.376412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b99c64-9779-440b-b636-d26e0565e9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:51.377010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b99c64-9779-440b-b636-d26e0565e9af None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:51.377282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b99c64-9779-440b-b636-d26e0565e9af None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:51.377580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b99c64-9779-440b-b636-d26e0565e9af None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:51.378232 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b99c64-9779-440b-b636-d26e0565e9af None admin] RBAC: Adding query filter params (name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:51.378534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b99c64-9779-440b-b636-d26e0565e9af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:51.379901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b99c64-9779-440b-b636-d26e0565e9af None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:51.387863 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 308/629] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Sep 4 00:45:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:51.388674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b99c64-9779-440b-b636-d26e0565e9af None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:51.419925 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305a3fd-c7a7-47af-85f6-da424418718a None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:51.459718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d90c60-2ae5-4ebb-8741-034ec6e5e88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:51.460377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d90c60-2ae5-4ebb-8741-034ec6e5e88f None admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:51.460659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d90c60-2ae5-4ebb-8741-034ec6e5e88f None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:51.460932 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d90c60-2ae5-4ebb-8741-034ec6e5e88f None admin] PATH_INFO: `/v3/projects/40b24e92f8594ee08bd2a55f79e3b299/users/9bcc7a857fad4310896da5a87e71baed/roles/955481bca39c4b0fab953d506ea3c292` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:51.476083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d90c60-2ae5-4ebb-8741-034ec6e5e88f None admin] RBAC: Authorizing `identity:create_grant(project_id=40b24e92f8594ee08bd2a55f79e3b299, user_id=9bcc7a857fad4310896da5a87e71baed, role_id=955481bca39c4b0fab953d506ea3c292)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:51.478087 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d90c60-2ae5-4ebb-8741-034ec6e5e88f None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:51.493925 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 322/630] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Sep 4 00:45:51 2022] PUT /identity/v3/projects/40b24e92f8594ee08bd2a55f79e3b299/users/9bcc7a857fad4310896da5a87e71baed/roles/955481bca39c4b0fab953d506ea3c292 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:45:51.495111 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed18ce-63d6-4293-8ffd-4efedec4092c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:51.495393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed18ce-63d6-4293-8ffd-4efedec4092c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:51.495661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed18ce-63d6-4293-8ffd-4efedec4092c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:51.511309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b99c64-9779-440b-b636-d26e0565e9af None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:51.529169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-5bed18ce-63d6-4293-8ffd-4efedec4092c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:51.530453 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5bed18ce-63d6-4293-8ffd-4efedec4092c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:51.544148 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:51.552609 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5873bd-17dc-4873-8d88-d86b2b8d267e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:51.553240 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5873bd-17dc-4873-8d88-d86b2b8d267e None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:51.553580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5873bd-17dc-4873-8d88-d86b2b8d267e None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:51.553826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5873bd-17dc-4873-8d88-d86b2b8d267e None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:51.555102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5873bd-17dc-4873-8d88-d86b2b8d267e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:51.555407 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5873bd-17dc-4873-8d88-d86b2b8d267e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:51.556799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5873bd-17dc-4873-8d88-d86b2b8d267e None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:51.569870 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 309/631] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:51.570629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5873bd-17dc-4873-8d88-d86b2b8d267e None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:51.602260 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:51.618629 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 323/632] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:51.620083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0a1db-de60-430a-a192-0ce3071f04bb None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:51.620460 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0a1db-de60-430a-a192-0ce3071f04bb None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:51.620830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0a1db-de60-430a-a192-0ce3071f04bb None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:51.622371 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 324/633] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:51.623047 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0a1db-de60-430a-a192-0ce3071f04bb None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:51.710538 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5873bd-17dc-4873-8d88-d86b2b8d267e None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:51.744908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0a1db-de60-430a-a192-0ce3071f04bb None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:51.754514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549442dd-6e8e-4218-8a73-576315392740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:51.755268 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549442dd-6e8e-4218-8a73-576315392740 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:51.756018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549442dd-6e8e-4218-8a73-576315392740 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:51.756546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549442dd-6e8e-4218-8a73-576315392740 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:51.769819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549442dd-6e8e-4218-8a73-576315392740 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:51.771841 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549442dd-6e8e-4218-8a73-576315392740 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:51.779334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16db32-2839-47e4-87c9-28e25556ddf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:51.780135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16db32-2839-47e4-87c9-28e25556ddf2 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:51.780553 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16db32-2839-47e4-87c9-28e25556ddf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:51.780961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16db32-2839-47e4-87c9-28e25556ddf2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:51.788747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16db32-2839-47e4-87c9-28e25556ddf2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:51.791062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16db32-2839-47e4-87c9-28e25556ddf2 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:51.791480 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-549442dd-6e8e-4218-8a73-576315392740 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:51.791480 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:51.791480 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:51.791480 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:51.791480 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:51.791480 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:51.791480 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:51.791480 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:51.791480 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:51.791480 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:51.791480 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:51.791480 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:51.791480 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:45:51.791480 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:45:51.791480 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:45:51.791480 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:45:51.792532 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:51.792532 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:51.792532 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:51.792532 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:51.792532 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:51.792532 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:51.792532 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:51.792532 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:51.792532 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:51.792532 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:51.792532 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:51.792532 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:51.792532 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:51.792532 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:51.792532 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:51.792532 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:51.792532 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:45:51.793395 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:45:51.793395 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:51.793395 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:51.793924 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 310/634] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:51.795364 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446f3b6-c256-4d28-a796-f293e0413783 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:51.795593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446f3b6-c256-4d28-a796-f293e0413783 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:51.795864 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446f3b6-c256-4d28-a796-f293e0413783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:51.808073 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-0d16db32-2839-47e4-87c9-28e25556ddf2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 04 00:45:51.808073 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:51.808073 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:51.808073 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:51.808073 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:51.808073 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:51.808073 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:51.808073 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:51.808073 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:51.808073 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:51.808073 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:51.808073 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:51.808073 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 04 00:45:51.808073 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 04 00:45:51.808073 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 04 00:45:51.808073 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 04 00:45:51.809030 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:51.809030 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:51.809030 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 00:45:51.809030 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:45:51.809030 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 00:45:51.809030 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:45:51.809030 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:51.809030 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:51.809030 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:51.809030 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:51.809030 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:51.809030 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:51.809030 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:51.809030 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:51.809030 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:51.809030 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:51.809030 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:51.809030 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:51.810019 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:51.810019 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:51.810019 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 00:45:51.810019 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 00:45:51.810019 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 00:45:51.810019 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 00:45:51.810019 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 00:45:51.810019 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 00:45:51.810019 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 04 00:45:51.810019 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:51.812462 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 325/635] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:45:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:51.813596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16db32-2839-47e4-87c9-28e25556ddf2 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:51.820736 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:51.822487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-9446f3b6-c256-4d28-a796-f293e0413783 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:51.823680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9446f3b6-c256-4d28-a796-f293e0413783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:51.907613 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 311/636] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:51.908875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446f3b6-c256-4d28-a796-f293e0413783 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:51.927655 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:51.927813 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16db32-2839-47e4-87c9-28e25556ddf2 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:51.965279 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0fe01-54d6-42d9-9f6a-d60199e3ddd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:51.966031 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0fe01-54d6-42d9-9f6a-d60199e3ddd2 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:51.966315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0fe01-54d6-42d9-9f6a-d60199e3ddd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:51.966589 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0fe01-54d6-42d9-9f6a-d60199e3ddd2 None admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:51.967230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d0fe01-54d6-42d9-9f6a-d60199e3ddd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:51.967531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d0fe01-54d6-42d9-9f6a-d60199e3ddd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:51.968896 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d0fe01-54d6-42d9-9f6a-d60199e3ddd2 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:51.982646 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 326/637] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:51.983456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0fe01-54d6-42d9-9f6a-d60199e3ddd2 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:52.032746 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446f3b6-c256-4d28-a796-f293e0413783 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:52.069105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b90ea-bcb3-493d-8729-a5dfc16b0bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:52.069662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b90ea-bcb3-493d-8729-a5dfc16b0bb4 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:52.069944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b90ea-bcb3-493d-8729-a5dfc16b0bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:52.070753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b90ea-bcb3-493d-8729-a5dfc16b0bb4 None admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:52.070945 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:52.071705 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b90ea-bcb3-493d-8729-a5dfc16b0bb4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:52.071826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b90ea-bcb3-493d-8729-a5dfc16b0bb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:52.073188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b90ea-bcb3-493d-8729-a5dfc16b0bb4 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:52.091833 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 312/638] 10.222.0.30 () {56 vars in 1137 bytes} [Sun Sep 4 00:45:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:52.092719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b90ea-bcb3-493d-8729-a5dfc16b0bb4 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:52.110478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0fe01-54d6-42d9-9f6a-d60199e3ddd2 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:52.159858 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bad25-8eea-4757-988a-d31399e20888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:52.160488 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bad25-8eea-4757-988a-d31399e20888 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:52.160771 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bad25-8eea-4757-988a-d31399e20888 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:52.161091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bad25-8eea-4757-988a-d31399e20888 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:52.163964 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:52.176881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294bad25-8eea-4757-988a-d31399e20888 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:52.185038 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-294bad25-8eea-4757-988a-d31399e20888 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:45:52.185038 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:52.185038 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:52.185038 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:52.185038 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:52.185038 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:52.185038 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:52.185038 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:52.185038 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:52.185038 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:52.185038 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:52.185038 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:52.185038 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:52.185038 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:52.185038 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:52.185038 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:52.186297 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:52.186297 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:52.186297 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:52.186297 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:52.186297 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:52.186297 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:52.186297 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:52.186297 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:52.186297 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:52.186297 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:52.186297 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:52.186297 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:52.186297 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:52.186297 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:52.186297 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:52.186297 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:52.187348 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:52.187348 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:52.187348 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:52.187348 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:52.187348 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:52.187348 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:52.187348 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:52.187348 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:52.187348 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:52.187348 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:52.187348 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:45:52.187348 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:52.189886 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 327/639] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Sep 4 00:45:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:52.191099 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bad25-8eea-4757-988a-d31399e20888 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:52.203235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b90ea-bcb3-493d-8729-a5dfc16b0bb4 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:52.239325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6938c01-efa7-4339-9903-e78b244df7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:52.239951 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6938c01-efa7-4339-9903-e78b244df7ba None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:52.240233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6938c01-efa7-4339-9903-e78b244df7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:52.240508 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6938c01-efa7-4339-9903-e78b244df7ba None admin] PATH_INFO: `/v3/users/nova` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:52.248110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6938c01-efa7-4339-9903-e78b244df7ba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:52.249573 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6938c01-efa7-4339-9903-e78b244df7ba None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:52.261276 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-b6938c01-efa7-4339-9903-e78b244df7ba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 04 00:45:52.261276 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:52.261276 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:52.261276 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:52.261276 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:52.261276 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:52.261276 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:52.261276 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:52.261276 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:52.261276 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:52.261276 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:52.261276 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:52.261276 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 04 00:45:52.261276 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 04 00:45:52.261276 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 04 00:45:52.261276 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 04 00:45:52.262270 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:52.262270 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:52.262270 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 00:45:52.262270 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:45:52.262270 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 00:45:52.262270 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:45:52.262270 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:52.262270 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:52.262270 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:52.262270 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:52.262270 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:52.262270 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:52.262270 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:52.262270 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:52.262270 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:52.262270 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:52.262270 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:52.262270 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:52.263194 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:52.263194 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:52.263194 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 00:45:52.263194 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 00:45:52.263194 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 00:45:52.263194 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 00:45:52.263194 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 00:45:52.263194 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 00:45:52.263194 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 04 00:45:52.263194 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:52.267050 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 313/640] 10.222.0.30 () {56 vars in 1093 bytes} [Sun Sep 4 00:45:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:52.268375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6938c01-efa7-4339-9903-e78b244df7ba None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:52.298225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bad25-8eea-4757-988a-d31399e20888 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:52.320798 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:52.332849 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3457f5-7fae-42d9-b78c-3963985893f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:52.333548 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3457f5-7fae-42d9-b78c-3963985893f3 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:52.333886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3457f5-7fae-42d9-b78c-3963985893f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:52.334217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3457f5-7fae-42d9-b78c-3963985893f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:52.370962 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6938c01-efa7-4339-9903-e78b244df7ba None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:52.396834 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:52.405760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3457f5-7fae-42d9-b78c-3963985893f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:52.406238 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd6f12-1f3e-48b4-b2eb-7b1861856bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:52.406940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd6f12-1f3e-48b4-b2eb-7b1861856bbe None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:52.407293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd6f12-1f3e-48b4-b2eb-7b1861856bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:52.407488 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3457f5-7fae-42d9-b78c-3963985893f3 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:52.407707 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd6f12-1f3e-48b4-b2eb-7b1861856bbe None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:52.408441 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd6f12-1f3e-48b4-b2eb-7b1861856bbe None admin] RBAC: Adding query filter params (name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:52.408822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd6f12-1f3e-48b4-b2eb-7b1861856bbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:52.410266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd6f12-1f3e-48b4-b2eb-7b1861856bbe None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:52.423997 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 314/641] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Sep 4 00:45:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:52.423997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd6f12-1f3e-48b4-b2eb-7b1861856bbe None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:52.540868 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 328/642] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:45:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 04 00:45:52.540868 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3457f5-7fae-42d9-b78c-3963985893f3 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:52.544314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd6f12-1f3e-48b4-b2eb-7b1861856bbe None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:52.566142 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:52.581536 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a07f2ea-3783-463e-af86-8f1f56fc8c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:52.582097 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07f2ea-3783-463e-af86-8f1f56fc8c28 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:52.582376 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07f2ea-3783-463e-af86-8f1f56fc8c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:52.582654 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07f2ea-3783-463e-af86-8f1f56fc8c28 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:52.600995 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a07f2ea-3783-463e-af86-8f1f56fc8c28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:52.606905 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-9a07f2ea-3783-463e-af86-8f1f56fc8c28 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:45:52.606905 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:52.606905 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:52.606905 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:52.606905 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:52.606905 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:52.606905 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:52.606905 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:52.606905 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:52.606905 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:52.606905 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:52.606905 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:52.606905 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:52.606905 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:52.606905 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:52.606905 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:52.607915 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:52.607915 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:52.607915 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:52.607915 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:52.607915 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:52.607915 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:52.607915 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:52.607915 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:52.607915 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:52.607915 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:52.607915 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:52.607915 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:52.607915 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:52.607915 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:52.607915 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:52.607915 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:52.614313 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:52.614313 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:52.614313 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:52.614313 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:52.614313 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:52.614313 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:52.614313 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:52.614313 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:52.614313 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:52.614313 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:52.614313 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:45:52.614313 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:52.614313 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 315/643] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Sep 4 00:45:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:52.614313 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a07f2ea-3783-463e-af86-8f1f56fc8c28 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:52.649647 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3457f5-7fae-42d9-b78c-3963985893f3 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:52.664860 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:52.689031 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6571c2a-fcd2-4d5b-ae9e-a4339d2de7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:52.689673 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6571c2a-fcd2-4d5b-ae9e-a4339d2de7b2 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:52.689953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6571c2a-fcd2-4d5b-ae9e-a4339d2de7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:52.690222 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6571c2a-fcd2-4d5b-ae9e-a4339d2de7b2 None admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:52.690944 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6571c2a-fcd2-4d5b-ae9e-a4339d2de7b2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:52.691245 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6571c2a-fcd2-4d5b-ae9e-a4339d2de7b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:52.692688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6571c2a-fcd2-4d5b-ae9e-a4339d2de7b2 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:52.712203 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 329/644] 10.222.0.30 () {56 vars in 1133 bytes} [Sun Sep 4 00:45:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:52.712991 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6571c2a-fcd2-4d5b-ae9e-a4339d2de7b2 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:52.726718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a07f2ea-3783-463e-af86-8f1f56fc8c28 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:52.769999 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c8e0d-bc8b-4cbc-9466-3736e10fe8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:52.770625 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c8e0d-bc8b-4cbc-9466-3736e10fe8aa None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:52.770904 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c8e0d-bc8b-4cbc-9466-3736e10fe8aa None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:52.771180 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c8e0d-bc8b-4cbc-9466-3736e10fe8aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:52.781681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c8e0d-bc8b-4cbc-9466-3736e10fe8aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:52.783125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c8e0d-bc8b-4cbc-9466-3736e10fe8aa None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:52.797842 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-b98c8e0d-bc8b-4cbc-9466-3736e10fe8aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:52.797842 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:52.797842 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:52.797842 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:52.797842 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:52.797842 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:52.797842 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:52.797842 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:52.797842 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:52.797842 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:52.797842 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:52.797842 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:52.797842 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:45:52.797842 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:45:52.797842 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:45:52.797842 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:45:52.798761 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:52.798761 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:52.798761 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:52.798761 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:52.798761 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:52.798761 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:52.798761 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:52.798761 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:52.798761 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:52.798761 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:52.798761 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:52.798761 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:52.798761 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:52.798761 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:52.798761 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:52.798761 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:52.798761 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:45:52.799802 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:45:52.799802 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:52.799802 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:52.799802 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 316/645] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:52.799802 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c8e0d-bc8b-4cbc-9466-3736e10fe8aa None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:52.811805 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:52.832024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6571c2a-fcd2-4d5b-ae9e-a4339d2de7b2 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:52.871443 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb3642-f114-4426-8ce0-b9a8f4237056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:52.872073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb3642-f114-4426-8ce0-b9a8f4237056 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:52.872355 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb3642-f114-4426-8ce0-b9a8f4237056 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:52.872629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb3642-f114-4426-8ce0-b9a8f4237056 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:52.882758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb3642-f114-4426-8ce0-b9a8f4237056 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:52.884216 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb3642-f114-4426-8ce0-b9a8f4237056 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:52.899129 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-eabb3642-f114-4426-8ce0-b9a8f4237056 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:52.899129 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:52.899129 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:52.899129 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:52.899129 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:52.899129 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:52.899129 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:52.899129 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:52.899129 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:52.899129 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:52.899129 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:52.899129 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:52.899129 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:45:52.899129 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:45:52.899129 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:45:52.899129 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:45:52.900053 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:52.900053 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:52.900053 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:52.900053 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:52.900053 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:52.900053 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:52.900053 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:52.900053 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:52.900053 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:52.900053 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:52.900053 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:52.900053 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:52.900053 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:52.900053 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:52.900053 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:52.900053 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:52.900053 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:45:52.900934 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:45:52.900934 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:52.900934 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:52.900934 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 330/646] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:52.901154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb3642-f114-4426-8ce0-b9a8f4237056 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:52.907473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c8e0d-bc8b-4cbc-9466-3736e10fe8aa None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:52.909227 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:52.949930 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad395df-89ef-4021-87e8-bd3e1fdcb871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:52.950687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad395df-89ef-4021-87e8-bd3e1fdcb871 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:52.950965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad395df-89ef-4021-87e8-bd3e1fdcb871 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:52.951606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad395df-89ef-4021-87e8-bd3e1fdcb871 None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:52.952536 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad395df-89ef-4021-87e8-bd3e1fdcb871 None admin] RBAC: Adding query filter params (name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:52.952842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad395df-89ef-4021-87e8-bd3e1fdcb871 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:52.954650 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad395df-89ef-4021-87e8-bd3e1fdcb871 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:52.963237 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 317/647] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Sep 4 00:45:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:52.964112 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad395df-89ef-4021-87e8-bd3e1fdcb871 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:53.010995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb3642-f114-4426-8ce0-b9a8f4237056 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:53.046280 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13ada5-1b71-45b6-bf47-31677a7a6a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:53.047114 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13ada5-1b71-45b6-bf47-31677a7a6a65 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:53.047545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13ada5-1b71-45b6-bf47-31677a7a6a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:53.047820 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13ada5-1b71-45b6-bf47-31677a7a6a65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:53.050595 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:53.070501 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad395df-89ef-4021-87e8-bd3e1fdcb871 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:53.110993 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0494f2d-5d4f-445a-bdeb-b9a87a6d8d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:53.111499 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0494f2d-5d4f-445a-bdeb-b9a87a6d8d14 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:53.112278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0494f2d-5d4f-445a-bdeb-b9a87a6d8d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:53.112278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0494f2d-5d4f-445a-bdeb-b9a87a6d8d14 None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:53.112695 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0494f2d-5d4f-445a-bdeb-b9a87a6d8d14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:53.113001 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0494f2d-5d4f-445a-bdeb-b9a87a6d8d14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:53.114409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0494f2d-5d4f-445a-bdeb-b9a87a6d8d14 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:53.132210 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 318/648] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:53.132210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0494f2d-5d4f-445a-bdeb-b9a87a6d8d14 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:53.144240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db13ada5-1b71-45b6-bf47-31677a7a6a65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:53.145883 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db13ada5-1b71-45b6-bf47-31677a7a6a65 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:53.158476 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:53.237551 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0494f2d-5d4f-445a-bdeb-b9a87a6d8d14 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:53.253235 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 331/649] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:45:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 04 00:45:53.258311 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13ada5-1b71-45b6-bf47-31677a7a6a65 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:53.275918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bfae85-38c2-425b-8bae-5c922eedebaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:53.276815 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfae85-38c2-425b-8bae-5c922eedebaf None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:53.277098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfae85-38c2-425b-8bae-5c922eedebaf None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:53.277374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfae85-38c2-425b-8bae-5c922eedebaf None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:53.278060 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bfae85-38c2-425b-8bae-5c922eedebaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:53.278366 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bfae85-38c2-425b-8bae-5c922eedebaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:53.280329 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bfae85-38c2-425b-8bae-5c922eedebaf None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:53.293754 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:53.294133 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 319/650] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:53.295417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bfae85-38c2-425b-8bae-5c922eedebaf None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:53.366931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13ada5-1b71-45b6-bf47-31677a7a6a65 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:53.384252 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:53.401637 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bfae85-38c2-425b-8bae-5c922eedebaf None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:53.407616 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eea164-86e0-48c0-8c6c-d336de181617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:53.408251 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eea164-86e0-48c0-8c6c-d336de181617 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:53.408527 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eea164-86e0-48c0-8c6c-d336de181617 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:53.409220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eea164-86e0-48c0-8c6c-d336de181617 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:53.421690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eea164-86e0-48c0-8c6c-d336de181617 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:53.423145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eea164-86e0-48c0-8c6c-d336de181617 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:53.440733 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d10ef-bec5-4ecc-82a7-9a84cae7252c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:53.440933 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-c8eea164-86e0-48c0-8c6c-d336de181617 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:53.440933 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:53.440933 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:53.440933 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:53.440933 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:53.440933 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:53.440933 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:53.440933 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:53.440933 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:53.440933 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:53.440933 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:53.440933 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:53.440933 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:45:53.440933 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:45:53.440933 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:45:53.440933 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:45:53.441859 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:53.441859 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:53.441859 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:53.441859 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:53.441859 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:53.441859 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:53.441859 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:53.441859 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:53.441859 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:53.441859 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:53.441859 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:53.441859 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:53.441859 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:53.441859 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:53.441859 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:53.441859 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:53.441859 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:45:53.442728 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:45:53.442728 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:53.442728 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:53.442903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d10ef-bec5-4ecc-82a7-9a84cae7252c None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:53.442903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d10ef-bec5-4ecc-82a7-9a84cae7252c None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:53.442903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d10ef-bec5-4ecc-82a7-9a84cae7252c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:53.443079 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 332/651] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:53.443079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eea164-86e0-48c0-8c6c-d336de181617 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:53.455461 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d10ef-bec5-4ecc-82a7-9a84cae7252c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:53.457638 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d10ef-bec5-4ecc-82a7-9a84cae7252c None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:53.474185 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-310d10ef-bec5-4ecc-82a7-9a84cae7252c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 04 00:45:53.474185 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:53.474185 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:53.474185 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:53.474185 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:53.474185 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:53.474185 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:53.474185 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:53.474185 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:53.474185 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:53.474185 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:53.474185 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:53.474185 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 04 00:45:53.474185 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 04 00:45:53.474185 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 04 00:45:53.474185 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 04 00:45:53.475128 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:53.475128 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:53.475128 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 00:45:53.475128 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:45:53.475128 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 00:45:53.475128 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:45:53.475128 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:53.475128 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:53.475128 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:53.475128 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:53.475128 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:53.475128 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:53.475128 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:53.475128 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:53.475128 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:53.475128 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:53.475128 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:53.475128 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:53.476146 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:53.476146 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:53.476146 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 00:45:53.476146 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 00:45:53.476146 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 00:45:53.476146 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 00:45:53.476146 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 00:45:53.476146 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 00:45:53.476146 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 04 00:45:53.476146 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:53.477964 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 320/652] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:45:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:53.478784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d10ef-bec5-4ecc-82a7-9a84cae7252c None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:53.534911 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:53.550452 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eea164-86e0-48c0-8c6c-d336de181617 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:53.577282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d10ef-bec5-4ecc-82a7-9a84cae7252c None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:53.583635 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2c87d-862a-4474-9341-2bf124264636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:53.584649 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2c87d-862a-4474-9341-2bf124264636 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:53.584930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2c87d-862a-4474-9341-2bf124264636 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:53.585260 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2c87d-862a-4474-9341-2bf124264636 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:53.596759 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2c87d-862a-4474-9341-2bf124264636 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:53.598240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2c87d-862a-4474-9341-2bf124264636 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:53.609960 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d83ffb-22aa-47c5-9215-6fb3f994430d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:53.610575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d83ffb-22aa-47c5-9215-6fb3f994430d None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:53.610851 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d83ffb-22aa-47c5-9215-6fb3f994430d None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:53.611120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d83ffb-22aa-47c5-9215-6fb3f994430d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:53.612481 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-e6c2c87d-862a-4474-9341-2bf124264636 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:53.612481 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:53.612481 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:53.612481 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:53.612481 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:53.612481 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:53.612481 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:53.612481 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:53.612481 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:53.612481 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:53.612481 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:53.612481 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:53.612481 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:45:53.612481 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:45:53.612481 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:45:53.612481 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:45:53.613545 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:53.613545 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:53.613545 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:53.613545 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:53.613545 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:53.613545 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:53.613545 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:53.613545 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:53.613545 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:53.613545 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:53.613545 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:53.613545 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:53.613545 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:53.613545 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:53.613545 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:53.613545 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:53.613545 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:45:53.614538 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:45:53.614538 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:53.614538 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:53.614538 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 333/653] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:53.614538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2c87d-862a-4474-9341-2bf124264636 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:53.620101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d83ffb-22aa-47c5-9215-6fb3f994430d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:53.621501 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d83ffb-22aa-47c5-9215-6fb3f994430d None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:53.633079 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-d4d83ffb-22aa-47c5-9215-6fb3f994430d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:45:53.633079 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:53.633079 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:53.633079 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:53.633079 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:53.633079 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:53.633079 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:53.633079 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:53.633079 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:53.633079 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:53.633079 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:53.633079 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:53.633079 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 04 00:45:53.633079 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 04 00:45:53.633079 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 04 00:45:53.634057 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 04 00:45:53.634057 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:53.634057 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:53.634057 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:53.634057 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:53.634057 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:53.634057 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:53.634057 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:53.634057 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:53.634057 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:53.634057 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:53.634057 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:53.634057 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:53.634057 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:53.634057 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:53.634057 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:53.634057 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:53.635346 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 04 00:45:53.635346 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 04 00:45:53.635346 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 00:45:53.635346 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 00:45:53.635346 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 00:45:53.635346 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 00:45:53.635346 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:45:53.635346 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:53.635346 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 321/654] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:45:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:53.635346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d83ffb-22aa-47c5-9215-6fb3f994430d None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:53.639047 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:53.717069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2c87d-862a-4474-9341-2bf124264636 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:53.732973 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d83ffb-22aa-47c5-9215-6fb3f994430d None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:53.749330 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171a09c-047c-4090-b3fe-50d827cc965c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:53.749949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171a09c-047c-4090-b3fe-50d827cc965c None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:53.750221 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171a09c-047c-4090-b3fe-50d827cc965c None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:53.750485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171a09c-047c-4090-b3fe-50d827cc965c None admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:53.751132 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171a09c-047c-4090-b3fe-50d827cc965c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:53.751429 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171a09c-047c-4090-b3fe-50d827cc965c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:53.752795 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171a09c-047c-4090-b3fe-50d827cc965c None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:53.759484 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:53.769881 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 334/655] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:53.770034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e1a6d-e69b-43d0-bd62-e3931e3e27ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:53.770034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e1a6d-e69b-43d0-bd62-e3931e3e27ad None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:53.770034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e1a6d-e69b-43d0-bd62-e3931e3e27ad None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:53.770278 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95b3cd-f970-4c2f-9d20-27cf77bee2ca None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:53.770348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e1a6d-e69b-43d0-bd62-e3931e3e27ad None admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:53.770415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95b3cd-f970-4c2f-9d20-27cf77bee2ca None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:53.770415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95b3cd-f970-4c2f-9d20-27cf77bee2ca None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:53.770547 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e1a6d-e69b-43d0-bd62-e3931e3e27ad None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:53.770547 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e1a6d-e69b-43d0-bd62-e3931e3e27ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:53.770675 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 335/656] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:53.770675 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95b3cd-f970-4c2f-9d20-27cf77bee2ca None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:53.770809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e1a6d-e69b-43d0-bd62-e3931e3e27ad None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:53.787437 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 322/657] 10.222.0.30 () {56 vars in 1137 bytes} [Sun Sep 4 00:45:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:53.788233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e1a6d-e69b-43d0-bd62-e3931e3e27ad None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:53.847655 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:53.873761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95b3cd-f970-4c2f-9d20-27cf77bee2ca None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:53.885524 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e1a6d-e69b-43d0-bd62-e3931e3e27ad None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:53.907027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d41fb2-ec08-4968-acee-f6da8eea1f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:53.907645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d41fb2-ec08-4968-acee-f6da8eea1f3d None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:53.907921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d41fb2-ec08-4968-acee-f6da8eea1f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:53.908196 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d41fb2-ec08-4968-acee-f6da8eea1f3d None admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:53.908820 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d41fb2-ec08-4968-acee-f6da8eea1f3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:53.909118 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d41fb2-ec08-4968-acee-f6da8eea1f3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:53.910508 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d41fb2-ec08-4968-acee-f6da8eea1f3d None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:53.918404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f178a035-babb-47e9-9cdb-9ebb04de13aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:53.919003 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178a035-babb-47e9-9cdb-9ebb04de13aa None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:53.919282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178a035-babb-47e9-9cdb-9ebb04de13aa None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:53.919553 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178a035-babb-47e9-9cdb-9ebb04de13aa None admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:53.920231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f178a035-babb-47e9-9cdb-9ebb04de13aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:53.920610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f178a035-babb-47e9-9cdb-9ebb04de13aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:53.921519 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 336/658] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:53.922054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f178a035-babb-47e9-9cdb-9ebb04de13aa None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:53.922289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d41fb2-ec08-4968-acee-f6da8eea1f3d None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:53.934330 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 323/659] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Sep 4 00:45:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:53.935500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a849b5-ea00-49e8-ad90-88c379afe598 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:53.935821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a849b5-ea00-49e8-ad90-88c379afe598 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:53.936252 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a849b5-ea00-49e8-ad90-88c379afe598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:53.953478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-86a849b5-ea00-49e8-ad90-88c379afe598 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:53.954657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-86a849b5-ea00-49e8-ad90-88c379afe598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:53.980548 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:54.021332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d41fb2-ec08-4968-acee-f6da8eea1f3d None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:54.021938 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 324/660] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:54.022287 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a849b5-ea00-49e8-ad90-88c379afe598 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:54.061606 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e129ef1-1b85-453c-9d06-31fe4b8ff6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:54.062227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e129ef1-1b85-453c-9d06-31fe4b8ff6eb None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:54.062506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e129ef1-1b85-453c-9d06-31fe4b8ff6eb None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:54.062775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e129ef1-1b85-453c-9d06-31fe4b8ff6eb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:54.070888 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e129ef1-1b85-453c-9d06-31fe4b8ff6eb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:54.072307 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e129ef1-1b85-453c-9d06-31fe4b8ff6eb None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:54.076048 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:54.084743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-1e129ef1-1b85-453c-9d06-31fe4b8ff6eb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 04 00:45:54.084743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:54.084743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:54.084743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:54.084743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:54.084743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:54.084743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:54.084743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:54.084743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:54.084743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:54.084743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:54.084743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:54.084743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 04 00:45:54.084743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 04 00:45:54.084743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 04 00:45:54.084743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 04 00:45:54.085794 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:54.085794 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:54.085794 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 00:45:54.085794 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:45:54.085794 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 00:45:54.085794 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:45:54.085794 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:54.085794 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:54.085794 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:54.085794 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:54.085794 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:54.085794 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:54.085794 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:54.085794 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:54.085794 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:54.085794 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:54.085794 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:54.085794 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:54.086747 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:54.086747 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:54.086747 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 00:45:54.086747 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 00:45:54.086747 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 00:45:54.086747 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 00:45:54.086747 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 00:45:54.086747 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 00:45:54.086747 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 04 00:45:54.086747 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:54.089570 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 337/661] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Sep 4 00:45:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:54.090580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e129ef1-1b85-453c-9d06-31fe4b8ff6eb None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:54.130487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a849b5-ea00-49e8-ad90-88c379afe598 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:54.164798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1bc32-b03e-48b2-b8a5-f4d3a13c446a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:54.165404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1bc32-b03e-48b2-b8a5-f4d3a13c446a None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:54.165713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1bc32-b03e-48b2-b8a5-f4d3a13c446a None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:54.165986 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1bc32-b03e-48b2-b8a5-f4d3a13c446a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:54.197037 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e129ef1-1b85-453c-9d06-31fe4b8ff6eb None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:54.214809 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:54.232682 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6236c-3d71-4d97-896a-1c0a547975a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:54.233408 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6236c-3d71-4d97-896a-1c0a547975a1 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:54.233771 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6236c-3d71-4d97-896a-1c0a547975a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:54.234171 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6236c-3d71-4d97-896a-1c0a547975a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:54.240994 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab6236c-3d71-4d97-896a-1c0a547975a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:54.242499 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1bc32-b03e-48b2-b8a5-f4d3a13c446a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:54.243213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab6236c-3d71-4d97-896a-1c0a547975a1 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:54.244102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1bc32-b03e-48b2-b8a5-f4d3a13c446a None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:54.254696 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-dab6236c-3d71-4d97-896a-1c0a547975a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:45:54.254696 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:54.254696 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:54.254696 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:54.254696 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:54.254696 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:54.254696 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:54.254696 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:54.254696 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:54.254696 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:54.254696 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:54.254696 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:54.254696 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 04 00:45:54.254696 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 04 00:45:54.254696 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 04 00:45:54.255734 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 04 00:45:54.255734 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:54.255734 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:54.255734 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:54.255734 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:54.255734 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:54.255734 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:54.255734 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:54.255734 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:54.255734 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:54.255734 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:54.255734 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:54.255734 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:54.255734 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:54.255734 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:54.255734 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:54.255734 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:54.256635 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 04 00:45:54.256635 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 04 00:45:54.256635 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 00:45:54.256635 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 00:45:54.256635 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 00:45:54.256635 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 00:45:54.256635 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:45:54.256635 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:54.256635 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 338/662] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:45:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:54.256635 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6236c-3d71-4d97-896a-1c0a547975a1 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:54.301058 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:54.348680 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 325/663] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:45:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 04 00:45:54.349515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1bc32-b03e-48b2-b8a5-f4d3a13c446a None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:54.359314 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6236c-3d71-4d97-896a-1c0a547975a1 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:54.392023 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d71d29-5922-4273-8a93-2e5685c7f98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:54.392541 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d71d29-5922-4273-8a93-2e5685c7f98d None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:54.392822 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d71d29-5922-4273-8a93-2e5685c7f98d None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:54.393097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d71d29-5922-4273-8a93-2e5685c7f98d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:54.393858 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d71d29-5922-4273-8a93-2e5685c7f98d None admin] RBAC: Adding query filter params (role.id=955481bca39c4b0fab953d506ea3c292, scope.project.id=40b24e92f8594ee08bd2a55f79e3b299, user.id=efcee9b21ea94b1b8e5c9c5acb35839f) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:54.394168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d71d29-5922-4273-8a93-2e5685c7f98d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:54.395604 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d71d29-5922-4273-8a93-2e5685c7f98d None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:54.401164 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 339/664] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:45:54 2022] GET /identity/v3/role_assignments?user.id=efcee9b21ea94b1b8e5c9c5acb35839f&scope.project.id=40b24e92f8594ee08bd2a55f79e3b299&role.id=955481bca39c4b0fab953d506ea3c292 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:54.401961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d71d29-5922-4273-8a93-2e5685c7f98d None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:54.454412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1bc32-b03e-48b2-b8a5-f4d3a13c446a None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:54.457859 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:54.494008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c3060-664f-4bd0-90a7-4e5e16999b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:54.495022 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c3060-664f-4bd0-90a7-4e5e16999b95 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:54.495538 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c3060-664f-4bd0-90a7-4e5e16999b95 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:54.496081 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c3060-664f-4bd0-90a7-4e5e16999b95 None admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:54.496936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c3060-664f-4bd0-90a7-4e5e16999b95 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:54.497253 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c3060-664f-4bd0-90a7-4e5e16999b95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:54.498863 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c3060-664f-4bd0-90a7-4e5e16999b95 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:54.518504 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 326/665] 10.222.0.30 () {56 vars in 1139 bytes} [Sun Sep 4 00:45:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:54.519349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c3060-664f-4bd0-90a7-4e5e16999b95 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:54.529077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d71d29-5922-4273-8a93-2e5685c7f98d None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:54.534274 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:54.569421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03729d91-d9ae-42e1-bdfc-893402bc980f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:54.570095 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03729d91-d9ae-42e1-bdfc-893402bc980f None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:54.570372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03729d91-d9ae-42e1-bdfc-893402bc980f None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:54.570640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03729d91-d9ae-42e1-bdfc-893402bc980f None admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:54.571325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03729d91-d9ae-42e1-bdfc-893402bc980f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:54.571633 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03729d91-d9ae-42e1-bdfc-893402bc980f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:54.573055 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03729d91-d9ae-42e1-bdfc-893402bc980f None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:54.586449 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 340/666] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Sep 4 00:45:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:54.586640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03729d91-d9ae-42e1-bdfc-893402bc980f None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:54.639442 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c3060-664f-4bd0-90a7-4e5e16999b95 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:54.674312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9610a-41e3-4554-bd47-85b08f5a84bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:54.674866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9610a-41e3-4554-bd47-85b08f5a84bf None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:54.675140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9610a-41e3-4554-bd47-85b08f5a84bf None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:54.675409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9610a-41e3-4554-bd47-85b08f5a84bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:54.685844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc9610a-41e3-4554-bd47-85b08f5a84bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:54.690538 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-bbc9610a-41e3-4554-bd47-85b08f5a84bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:45:54.690538 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:54.690538 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:54.690538 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:54.690538 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:54.690538 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:54.690538 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:54.690538 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:54.690538 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:54.690538 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:54.690538 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:54.690538 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:54.690538 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:54.690538 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:54.690538 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:54.690538 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:54.691460 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:54.691460 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:54.691460 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:54.691460 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:54.691460 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:54.691460 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:54.691460 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:54.691460 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:54.691460 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:54.691460 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:54.691460 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:54.691460 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:54.691460 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:54.691460 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:54.691460 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:54.691460 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:54.692273 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:54.692273 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:54.692273 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:54.692273 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:54.692273 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:54.692273 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:54.692273 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:54.692273 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:54.692273 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:54.692273 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:54.692273 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:45:54.692273 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:54.692273 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 327/667] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Sep 4 00:45:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:54.693400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9610a-41e3-4554-bd47-85b08f5a84bf None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:54.702692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03729d91-d9ae-42e1-bdfc-893402bc980f None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:54.704442 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:54.742479 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481bcca-3033-4162-8e6c-8b57c9126aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:54.743106 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481bcca-3033-4162-8e6c-8b57c9126aad None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:54.743382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481bcca-3033-4162-8e6c-8b57c9126aad None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:54.743648 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481bcca-3033-4162-8e6c-8b57c9126aad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:54.753755 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481bcca-3033-4162-8e6c-8b57c9126aad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:54.755192 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481bcca-3033-4162-8e6c-8b57c9126aad None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:54.770440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-0481bcca-3033-4162-8e6c-8b57c9126aad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:54.770440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:54.770440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:54.770440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:54.770440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:54.770440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:54.770440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:54.770440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:54.770440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:54.770440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:54.770440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:54.770440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:54.770440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:45:54.770440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:45:54.770440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:45:54.770440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:45:54.771443 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:54.771443 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:54.771443 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:54.771443 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:54.771443 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:54.771443 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:54.771443 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:54.771443 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:54.771443 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:54.771443 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:54.771443 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:54.771443 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:54.771443 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:54.771443 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:54.771443 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:54.771443 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:54.771443 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:45:54.772329 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:45:54.772329 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:54.772329 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:54.772329 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 341/668] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:54.772329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481bcca-3033-4162-8e6c-8b57c9126aad None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:54.776688 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:54.811341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9610a-41e3-4554-bd47-85b08f5a84bf None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:54.850413 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b060dc3-7d8d-4354-bfe2-cbfd82094c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:54.851012 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b060dc3-7d8d-4354-bfe2-cbfd82094c79 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:54.851866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b060dc3-7d8d-4354-bfe2-cbfd82094c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:54.852098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b060dc3-7d8d-4354-bfe2-cbfd82094c79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:54.881251 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481bcca-3033-4162-8e6c-8b57c9126aad None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:54.921521 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33255a9-927b-466a-9792-b939e82f33cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:54.922135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33255a9-927b-466a-9792-b939e82f33cb None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:54.922417 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33255a9-927b-466a-9792-b939e82f33cb None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:54.922695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33255a9-927b-466a-9792-b939e82f33cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:54.923419 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33255a9-927b-466a-9792-b939e82f33cb None admin] RBAC: Adding query filter params (role.id=955481bca39c4b0fab953d506ea3c292, scope.project.id=40b24e92f8594ee08bd2a55f79e3b299, user.id=13f0f341bf2c475d82b4e7b34d503dd0) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:54.923692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b060dc3-7d8d-4354-bfe2-cbfd82094c79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:54.923801 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33255a9-927b-466a-9792-b939e82f33cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:54.925203 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33255a9-927b-466a-9792-b939e82f33cb None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:54.925318 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b060dc3-7d8d-4354-bfe2-cbfd82094c79 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:54.941814 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 342/669] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:45:54 2022] GET /identity/v3/role_assignments?user.id=13f0f341bf2c475d82b4e7b34d503dd0&scope.project.id=40b24e92f8594ee08bd2a55f79e3b299&role.id=955481bca39c4b0fab953d506ea3c292 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:54.941814 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33255a9-927b-466a-9792-b939e82f33cb None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:54.967295 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:55.019990 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:55.060821 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 328/670] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:45:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 04 00:45:55.061918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b060dc3-7d8d-4354-bfe2-cbfd82094c79 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:55.074622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33255a9-927b-466a-9792-b939e82f33cb None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:55.114390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59bd1b9-6d2b-4dbc-b3f9-a9ce29b48cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:55.115008 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59bd1b9-6d2b-4dbc-b3f9-a9ce29b48cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:55.115297 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59bd1b9-6d2b-4dbc-b3f9-a9ce29b48cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:55.115570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59bd1b9-6d2b-4dbc-b3f9-a9ce29b48cf7 None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:55.116522 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59bd1b9-6d2b-4dbc-b3f9-a9ce29b48cf7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:55.116880 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59bd1b9-6d2b-4dbc-b3f9-a9ce29b48cf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:55.118791 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59bd1b9-6d2b-4dbc-b3f9-a9ce29b48cf7 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:55.128657 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 343/671] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Sep 4 00:45:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:55.129525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59bd1b9-6d2b-4dbc-b3f9-a9ce29b48cf7 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:55.181035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b060dc3-7d8d-4354-bfe2-cbfd82094c79 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:55.220441 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a38ef9-7da5-4cd1-a192-9631a99cb64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:55.221048 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a38ef9-7da5-4cd1-a192-9631a99cb64f None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:55.221326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a38ef9-7da5-4cd1-a192-9631a99cb64f None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:55.221640 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a38ef9-7da5-4cd1-a192-9631a99cb64f None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:55.222282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a38ef9-7da5-4cd1-a192-9631a99cb64f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:55.222581 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a38ef9-7da5-4cd1-a192-9631a99cb64f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:55.223939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a38ef9-7da5-4cd1-a192-9631a99cb64f None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:55.227735 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:55.241177 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 329/672] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:55.244847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a38ef9-7da5-4cd1-a192-9631a99cb64f None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:55.249969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59bd1b9-6d2b-4dbc-b3f9-a9ce29b48cf7 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:55.283324 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:55.288187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c06e5d-b7dc-4387-9124-6f960760b5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:55.289911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c06e5d-b7dc-4387-9124-6f960760b5eb None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:55.290276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c06e5d-b7dc-4387-9124-6f960760b5eb None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:55.290618 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c06e5d-b7dc-4387-9124-6f960760b5eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:55.303251 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c06e5d-b7dc-4387-9124-6f960760b5eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:55.305698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c06e5d-b7dc-4387-9124-6f960760b5eb None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:55.320828 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-41c06e5d-b7dc-4387-9124-6f960760b5eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:55.320828 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:55.320828 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:55.320828 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:55.320828 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:55.320828 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:55.320828 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:55.320828 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:55.320828 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:55.320828 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:55.320828 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:55.320828 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:55.320828 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:45:55.320828 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:45:55.320828 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:45:55.320828 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:45:55.322036 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:55.322036 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:55.322036 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:55.322036 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:55.322036 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:55.322036 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:55.322036 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:55.322036 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:55.322036 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:55.322036 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:55.322036 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:55.322036 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:55.322036 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:55.322036 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:55.322036 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:55.322036 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:55.322036 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:45:55.323104 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:45:55.323104 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:55.323104 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:55.324060 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 344/673] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:55.329413 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c06e5d-b7dc-4387-9124-6f960760b5eb None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:55.372038 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a38ef9-7da5-4cd1-a192-9631a99cb64f None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:55.415039 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377ef39-3757-4c80-b2d4-a2973c952cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:55.415811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377ef39-3757-4c80-b2d4-a2973c952cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:55.416162 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377ef39-3757-4c80-b2d4-a2973c952cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:55.416508 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377ef39-3757-4c80-b2d4-a2973c952cb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:55.428467 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8377ef39-3757-4c80-b2d4-a2973c952cb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:55.430702 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8377ef39-3757-4c80-b2d4-a2973c952cb6 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:55.450098 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-8377ef39-3757-4c80-b2d4-a2973c952cb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:55.450098 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:55.450098 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:55.450098 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:55.450098 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:55.450098 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:55.450098 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:55.450098 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:55.450098 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:55.450098 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:55.450098 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:55.450098 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:55.450098 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:45:55.450098 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:45:55.450098 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:45:55.450098 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:45:55.451243 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:55.451243 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:55.451243 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:55.451243 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:55.451243 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:55.451243 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:55.451243 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:55.451243 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:55.451243 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:55.451243 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:55.451243 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:55.451243 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:55.451243 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:55.451243 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:55.451243 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:55.451243 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:55.451243 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:45:55.452257 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:45:55.452257 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:55.452257 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:55.456652 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 330/674] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:55.457674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377ef39-3757-4c80-b2d4-a2973c952cb6 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:55.459296 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c06e5d-b7dc-4387-9124-6f960760b5eb None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:55.499477 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:55.507685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc3d63-c799-4721-a53c-a1c090a46833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:55.508450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc3d63-c799-4721-a53c-a1c090a46833 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:55.508860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc3d63-c799-4721-a53c-a1c090a46833 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:55.509229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc3d63-c799-4721-a53c-a1c090a46833 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:55.517336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc3d63-c799-4721-a53c-a1c090a46833 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:55.519493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc3d63-c799-4721-a53c-a1c090a46833 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:55.532521 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-1fdc3d63-c799-4721-a53c-a1c090a46833 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:45:55.532521 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:55.532521 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:55.532521 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:55.532521 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:55.532521 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:55.532521 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:55.532521 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:55.532521 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:55.532521 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:55.532521 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:55.532521 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:55.532521 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 04 00:45:55.532521 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 04 00:45:55.532521 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 04 00:45:55.533618 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 04 00:45:55.533618 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:55.533618 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:55.533618 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:55.533618 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:55.533618 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:55.533618 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:55.533618 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:55.533618 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:55.533618 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:55.533618 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:55.533618 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:55.533618 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:55.533618 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:55.533618 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:55.533618 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:55.533618 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:55.534704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 04 00:45:55.534704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 04 00:45:55.534704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 00:45:55.534704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 00:45:55.534704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 00:45:55.534704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 00:45:55.534704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:45:55.534704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:55.534704 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 345/675] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:45:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:55.535267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc3d63-c799-4721-a53c-a1c090a46833 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:55.565370 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:55.590798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377ef39-3757-4c80-b2d4-a2973c952cb6 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:55.637028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7606d9-8349-401a-b56b-fa434a33ed66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:55.637901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7606d9-8349-401a-b56b-fa434a33ed66 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:55.638317 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7606d9-8349-401a-b56b-fa434a33ed66 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:55.638752 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7606d9-8349-401a-b56b-fa434a33ed66 None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:55.639953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7606d9-8349-401a-b56b-fa434a33ed66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:55.640671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7606d9-8349-401a-b56b-fa434a33ed66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:55.642374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7606d9-8349-401a-b56b-fa434a33ed66 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:55.652167 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc3d63-c799-4721-a53c-a1c090a46833 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:55.658997 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 331/676] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:55.659944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7606d9-8349-401a-b56b-fa434a33ed66 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:55.698230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c679c-e25b-4e09-ab04-01d3ec23ff42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:55.698847 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c679c-e25b-4e09-ab04-01d3ec23ff42 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:55.699131 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c679c-e25b-4e09-ab04-01d3ec23ff42 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:55.699397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c679c-e25b-4e09-ab04-01d3ec23ff42 None admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:55.700049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c679c-e25b-4e09-ab04-01d3ec23ff42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:55.700424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c679c-e25b-4e09-ab04-01d3ec23ff42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:55.703242 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c679c-e25b-4e09-ab04-01d3ec23ff42 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:55.719402 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 346/677] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:55.720551 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c679c-e25b-4e09-ab04-01d3ec23ff42 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:55.778727 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7606d9-8349-401a-b56b-fa434a33ed66 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:55.779835 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:55.815622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a04806-4677-4bd4-92ac-76b2efdd15bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:55.816526 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a04806-4677-4bd4-92ac-76b2efdd15bb None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:55.816958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a04806-4677-4bd4-92ac-76b2efdd15bb None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:55.817381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a04806-4677-4bd4-92ac-76b2efdd15bb None admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:55.818231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a04806-4677-4bd4-92ac-76b2efdd15bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:55.818672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a04806-4677-4bd4-92ac-76b2efdd15bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:55.820800 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a04806-4677-4bd4-92ac-76b2efdd15bb None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:55.833066 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 332/678] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Sep 4 00:45:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:55.834161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a04806-4677-4bd4-92ac-76b2efdd15bb None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:55.836888 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:55.839392 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c679c-e25b-4e09-ab04-01d3ec23ff42 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:55.878656 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe6958-e971-4547-871f-eb0e0804b6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:55.879427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe6958-e971-4547-871f-eb0e0804b6d3 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:55.879711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe6958-e971-4547-871f-eb0e0804b6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:55.879987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe6958-e971-4547-871f-eb0e0804b6d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:55.887376 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe6958-e971-4547-871f-eb0e0804b6d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:55.888934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe6958-e971-4547-871f-eb0e0804b6d3 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:55.901420 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-5ffe6958-e971-4547-871f-eb0e0804b6d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:45:55.901420 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:55.901420 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:55.901420 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:55.901420 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:55.901420 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:55.901420 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:55.901420 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:55.901420 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:55.901420 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:55.901420 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:55.901420 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:55.901420 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 04 00:45:55.901420 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 04 00:45:55.901420 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 04 00:45:55.902495 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 04 00:45:55.902495 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:55.902495 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:55.902495 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:55.902495 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:55.902495 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:55.902495 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:55.902495 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:55.902495 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:55.902495 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:55.902495 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:55.902495 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:55.902495 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:55.902495 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:55.902495 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:55.902495 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:55.902495 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:55.903579 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 04 00:45:55.903579 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 04 00:45:55.903579 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 00:45:55.903579 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 00:45:55.903579 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 00:45:55.903579 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 00:45:55.903579 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:45:55.903579 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:55.907785 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 347/679] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:45:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:55.908775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe6958-e971-4547-871f-eb0e0804b6d3 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:55.942411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a04806-4677-4bd4-92ac-76b2efdd15bb None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:55.977052 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97840a-c8a0-4171-8390-08244e8e0b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:55.977930 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97840a-c8a0-4171-8390-08244e8e0b85 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:55.978347 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97840a-c8a0-4171-8390-08244e8e0b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:55.978753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97840a-c8a0-4171-8390-08244e8e0b85 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:55.986718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e97840a-c8a0-4171-8390-08244e8e0b85 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:55.988404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e97840a-c8a0-4171-8390-08244e8e0b85 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:56.000316 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-6e97840a-c8a0-4171-8390-08244e8e0b85 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 04 00:45:56.000316 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:56.000316 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:56.000316 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:56.000316 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:56.000316 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:56.000316 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:56.000316 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:56.000316 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:56.000316 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:56.000316 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:56.000316 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:56.000316 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 04 00:45:56.000316 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 04 00:45:56.000316 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 04 00:45:56.000316 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 04 00:45:56.001527 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:56.001527 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:56.001527 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 00:45:56.001527 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:45:56.001527 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 00:45:56.001527 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:45:56.001527 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:56.001527 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:56.001527 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:56.001527 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:56.001527 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:56.001527 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:56.001527 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:56.001527 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:56.001527 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:56.001527 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:56.001527 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:56.001527 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:56.002580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:56.002580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:56.002580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 00:45:56.002580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 00:45:56.002580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 00:45:56.002580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 00:45:56.002580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 00:45:56.002580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 00:45:56.002580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 04 00:45:56.002580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:56.004955 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 333/680] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Sep 4 00:45:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:56.005947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97840a-c8a0-4171-8390-08244e8e0b85 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:56.027466 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe6958-e971-4547-871f-eb0e0804b6d3 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:56.041836 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:56.065728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e0465-0d04-4f84-ba97-d3e6a0f5cf1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:56.066332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e0465-0d04-4f84-ba97-d3e6a0f5cf1a None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:56.066610 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e0465-0d04-4f84-ba97-d3e6a0f5cf1a None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:56.067004 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e0465-0d04-4f84-ba97-d3e6a0f5cf1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:56.067695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e0465-0d04-4f84-ba97-d3e6a0f5cf1a None admin] RBAC: Adding query filter params (role.id=955481bca39c4b0fab953d506ea3c292, scope.project.id=40b24e92f8594ee08bd2a55f79e3b299, user.id=9108334da66445c2a0ba438c19850357) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:56.068234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e0465-0d04-4f84-ba97-d3e6a0f5cf1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:56.069562 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e0465-0d04-4f84-ba97-d3e6a0f5cf1a None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:56.073618 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:56.076851 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 348/681] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:45:55 2022] GET /identity/v3/role_assignments?user.id=9108334da66445c2a0ba438c19850357&scope.project.id=40b24e92f8594ee08bd2a55f79e3b299&role.id=955481bca39c4b0fab953d506ea3c292 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:56.077783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e0465-0d04-4f84-ba97-d3e6a0f5cf1a None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:56.121740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97840a-c8a0-4171-8390-08244e8e0b85 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:56.158733 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217a90d-4461-4b7e-bb0c-c8a24405a029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:56.159668 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217a90d-4461-4b7e-bb0c-c8a24405a029 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:56.160152 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217a90d-4461-4b7e-bb0c-c8a24405a029 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:56.160600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217a90d-4461-4b7e-bb0c-c8a24405a029 None admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:56.161509 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217a90d-4461-4b7e-bb0c-c8a24405a029 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:56.161990 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217a90d-4461-4b7e-bb0c-c8a24405a029 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:56.164140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217a90d-4461-4b7e-bb0c-c8a24405a029 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:56.178108 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 334/682] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Sep 4 00:45:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:56.184268 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217a90d-4461-4b7e-bb0c-c8a24405a029 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:56.275059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e0465-0d04-4f84-ba97-d3e6a0f5cf1a None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:56.319014 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca49d31-56ea-4430-b146-6a235912ca67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:56.319754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca49d31-56ea-4430-b146-6a235912ca67 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:56.320244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca49d31-56ea-4430-b146-6a235912ca67 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:56.320584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca49d31-56ea-4430-b146-6a235912ca67 None admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:56.321763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca49d31-56ea-4430-b146-6a235912ca67 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:56.322135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca49d31-56ea-4430-b146-6a235912ca67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:56.324053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca49d31-56ea-4430-b146-6a235912ca67 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:56.331223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217a90d-4461-4b7e-bb0c-c8a24405a029 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:56.349807 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 349/683] 10.222.0.30 () {56 vars in 1135 bytes} [Sun Sep 4 00:45:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:56.355380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca49d31-56ea-4430-b146-6a235912ca67 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:56.369318 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:56.379927 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069ceba-2f71-4a5d-938c-00978c6e42a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:56.380810 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069ceba-2f71-4a5d-938c-00978c6e42a7 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:56.381275 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069ceba-2f71-4a5d-938c-00978c6e42a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:56.382188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069ceba-2f71-4a5d-938c-00978c6e42a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:56.383394 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069ceba-2f71-4a5d-938c-00978c6e42a7 None admin] RBAC: Adding query filter params (role.id=955481bca39c4b0fab953d506ea3c292, scope.project.id=40b24e92f8594ee08bd2a55f79e3b299, user.id=2cdde7a212954a01a2591ad5ac30d049) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:56.383893 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069ceba-2f71-4a5d-938c-00978c6e42a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:56.386194 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069ceba-2f71-4a5d-938c-00978c6e42a7 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:56.394363 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 335/684] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:45:56 2022] GET /identity/v3/role_assignments?user.id=2cdde7a212954a01a2591ad5ac30d049&scope.project.id=40b24e92f8594ee08bd2a55f79e3b299&role.id=955481bca39c4b0fab953d506ea3c292 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:56.396381 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:56.480811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ff414-fd9c-4a72-8bf8-cbf4334c233b None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:56.481354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ff414-fd9c-4a72-8bf8-cbf4334c233b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:56.481354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ff414-fd9c-4a72-8bf8-cbf4334c233b None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:56.482995 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 336/685] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 04 00:45:56.488425 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6215d5-3786-4b70-8806-c02ef2493285 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:56.488701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6215d5-3786-4b70-8806-c02ef2493285 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:56.488983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6215d5-3786-4b70-8806-c02ef2493285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:56.508857 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-ee6215d5-3786-4b70-8806-c02ef2493285 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:56.510144 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ee6215d5-3786-4b70-8806-c02ef2493285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:56.512695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca49d31-56ea-4430-b146-6a235912ca67 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:56.552935 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f66f05-76e6-4592-bf35-b8c37ceb94c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:56.553494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f66f05-76e6-4592-bf35-b8c37ceb94c7 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:56.553947 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f66f05-76e6-4592-bf35-b8c37ceb94c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:56.554293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f66f05-76e6-4592-bf35-b8c37ceb94c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:56.655692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f66f05-76e6-4592-bf35-b8c37ceb94c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:56.657238 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f66f05-76e6-4592-bf35-b8c37ceb94c7 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:56.659809 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 337/686] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 04 00:45:56.702826 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:56.758867 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 350/687] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:45:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 04 00:45:56.764617 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6215d5-3786-4b70-8806-c02ef2493285 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:56.867116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6215d5-3786-4b70-8806-c02ef2493285 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:56.885314 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:56.902778 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baecff6c-6436-4202-8eac-fdb2c9857213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:56.903658 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecff6c-6436-4202-8eac-fdb2c9857213 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:56.903981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecff6c-6436-4202-8eac-fdb2c9857213 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:56.904258 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecff6c-6436-4202-8eac-fdb2c9857213 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:56.914674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baecff6c-6436-4202-8eac-fdb2c9857213 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:56.916129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baecff6c-6436-4202-8eac-fdb2c9857213 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:56.931401 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-baecff6c-6436-4202-8eac-fdb2c9857213 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:56.931401 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:56.931401 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:56.931401 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:56.931401 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:56.931401 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:56.931401 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:56.931401 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:56.931401 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:56.931401 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:56.931401 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:56.931401 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:56.931401 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:45:56.931401 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:45:56.931401 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:45:56.931401 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:45:56.932430 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:56.932430 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:56.932430 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:56.932430 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:56.932430 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:56.932430 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:56.932430 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:56.932430 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:56.932430 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:56.932430 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:56.932430 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:56.932430 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:56.932430 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:56.932430 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:56.932430 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:56.932430 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:56.932430 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:45:56.933568 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:45:56.933568 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:56.933568 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:56.933568 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 338/688] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:56.940076 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f66f05-76e6-4592-bf35-b8c37ceb94c7 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:56.955979 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baecff6c-6436-4202-8eac-fdb2c9857213 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:57.048203 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f66f05-76e6-4592-bf35-b8c37ceb94c7 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:57.109467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae49f5-940d-44f6-a1fb-10072344ae59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:57.110367 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae49f5-940d-44f6-a1fb-10072344ae59 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:57.110625 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae49f5-940d-44f6-a1fb-10072344ae59 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:57.110860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae49f5-940d-44f6-a1fb-10072344ae59 None admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:57.111497 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae49f5-940d-44f6-a1fb-10072344ae59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:57.111795 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae49f5-940d-44f6-a1fb-10072344ae59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:57.118608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae49f5-940d-44f6-a1fb-10072344ae59 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:57.121725 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:57.146536 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 351/689] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:57.148471 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae49f5-940d-44f6-a1fb-10072344ae59 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:57.177196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baecff6c-6436-4202-8eac-fdb2c9857213 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:57.211990 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d7fa8-c392-4086-a288-eb4605af92a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:57.212612 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d7fa8-c392-4086-a288-eb4605af92a0 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:57.212887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d7fa8-c392-4086-a288-eb4605af92a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:57.213291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d7fa8-c392-4086-a288-eb4605af92a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:57.224006 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d7fa8-c392-4086-a288-eb4605af92a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:57.225470 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d7fa8-c392-4086-a288-eb4605af92a0 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:57.243967 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-fa8d7fa8-c392-4086-a288-eb4605af92a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:57.243967 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:57.243967 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:57.243967 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:57.243967 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:57.243967 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:57.243967 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:57.243967 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:57.243967 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:57.243967 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:57.243967 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:57.243967 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:57.243967 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:45:57.243967 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:45:57.243967 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:45:57.243967 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:45:57.245168 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:57.245168 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:57.245168 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:57.245168 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:57.245168 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:57.245168 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:57.245168 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:57.245168 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:57.245168 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:57.245168 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:57.245168 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:57.245168 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:57.245168 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:57.245168 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:57.245168 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:57.245168 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:57.245168 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:45:57.246299 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:45:57.246299 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:57.246299 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:57.246299 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 339/690] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:45:57.251066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a18fb1-9846-4cf6-82c9-fae4f31e432e None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:57.251066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a18fb1-9846-4cf6-82c9-fae4f31e432e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:57.251066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a18fb1-9846-4cf6-82c9-fae4f31e432e None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:57.251066 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 340/691] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:57.254261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a18fb1-9846-4cf6-82c9-fae4f31e432e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:57.281017 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:57.289237 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae49f5-940d-44f6-a1fb-10072344ae59 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:57.337574 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc833e-1e2e-4fa9-9303-551962daece7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:57.338427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc833e-1e2e-4fa9-9303-551962daece7 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:57.338788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc833e-1e2e-4fa9-9303-551962daece7 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:57.339125 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc833e-1e2e-4fa9-9303-551962daece7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:57.348457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc833e-1e2e-4fa9-9303-551962daece7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:57.350240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc833e-1e2e-4fa9-9303-551962daece7 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:57.363789 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-a2dc833e-1e2e-4fa9-9303-551962daece7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:45:57.363789 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:57.363789 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:57.363789 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:57.363789 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:57.363789 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:57.363789 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:57.363789 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:57.363789 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:57.363789 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:57.363789 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:57.363789 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:57.363789 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 04 00:45:57.363789 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 04 00:45:57.363789 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 04 00:45:57.364721 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 04 00:45:57.364721 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:57.364721 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:57.364721 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:57.364721 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:57.364721 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:57.364721 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:57.364721 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:57.364721 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:57.364721 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:57.364721 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:57.364721 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:57.364721 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:57.364721 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:57.364721 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:57.364721 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:57.364721 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:57.365791 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 04 00:45:57.365791 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 04 00:45:57.365791 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 00:45:57.365791 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 00:45:57.365791 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 00:45:57.365791 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 00:45:57.365791 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:45:57.365791 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:45:57.368696 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 352/692] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:45:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:57.370266 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c42d0-5cdc-4503-8d2c-2d97ccb86dca None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:57.370759 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c42d0-5cdc-4503-8d2c-2d97ccb86dca None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:57.371252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c42d0-5cdc-4503-8d2c-2d97ccb86dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:57.380489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a18fb1-9846-4cf6-82c9-fae4f31e432e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:57.397492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-928c42d0-5cdc-4503-8d2c-2d97ccb86dca None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:57.397492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-928c42d0-5cdc-4503-8d2c-2d97ccb86dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:57.420070 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda13e0-bc01-4629-b9a5-3d6eb482fe2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:57.421086 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda13e0-bc01-4629-b9a5-3d6eb482fe2d None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:57.421365 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda13e0-bc01-4629-b9a5-3d6eb482fe2d None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:57.421803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda13e0-bc01-4629-b9a5-3d6eb482fe2d None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:57.422540 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda13e0-bc01-4629-b9a5-3d6eb482fe2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:57.422942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda13e0-bc01-4629-b9a5-3d6eb482fe2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:57.424443 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda13e0-bc01-4629-b9a5-3d6eb482fe2d None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:57.437675 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 341/693] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:57.438738 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda13e0-bc01-4629-b9a5-3d6eb482fe2d None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:57.472163 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:57.498804 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 353/694] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:57.499914 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c42d0-5cdc-4503-8d2c-2d97ccb86dca None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:57.539454 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:57.559427 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda13e0-bc01-4629-b9a5-3d6eb482fe2d None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:57.594933 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182597c-687e-4330-bb4b-69cd7a992d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:57.595542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182597c-687e-4330-bb4b-69cd7a992d3d None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:57.595821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182597c-687e-4330-bb4b-69cd7a992d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:57.596093 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182597c-687e-4330-bb4b-69cd7a992d3d None admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:57.596783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182597c-687e-4330-bb4b-69cd7a992d3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:57.597087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182597c-687e-4330-bb4b-69cd7a992d3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:57.598728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182597c-687e-4330-bb4b-69cd7a992d3d None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:57.611616 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 342/695] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Sep 4 00:45:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:57.617901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182597c-687e-4330-bb4b-69cd7a992d3d None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:57.708632 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c42d0-5cdc-4503-8d2c-2d97ccb86dca None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:57.718939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182597c-687e-4330-bb4b-69cd7a992d3d None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:57.755401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed73536-2b38-4260-b7dc-b03add7c34d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:57.756002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed73536-2b38-4260-b7dc-b03add7c34d6 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:57.756332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed73536-2b38-4260-b7dc-b03add7c34d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:57.756612 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed73536-2b38-4260-b7dc-b03add7c34d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:57.757416 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed73536-2b38-4260-b7dc-b03add7c34d6 None admin] RBAC: Adding query filter params (role.id=955481bca39c4b0fab953d506ea3c292, scope.project.id=40b24e92f8594ee08bd2a55f79e3b299, user.id=9bcc7a857fad4310896da5a87e71baed) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:57.757892 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed73536-2b38-4260-b7dc-b03add7c34d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:57.759649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed73536-2b38-4260-b7dc-b03add7c34d6 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:57.766365 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 343/696] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:45:57 2022] GET /identity/v3/role_assignments?user.id=9bcc7a857fad4310896da5a87e71baed&scope.project.id=40b24e92f8594ee08bd2a55f79e3b299&role.id=955481bca39c4b0fab953d506ea3c292 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:45:57.791855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5830f214-241d-4975-b8ed-a5d752eab2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:57.792492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830f214-241d-4975-b8ed-a5d752eab2a0 None admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:57.792772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830f214-241d-4975-b8ed-a5d752eab2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:57.793046 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830f214-241d-4975-b8ed-a5d752eab2a0 None admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:57.793759 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5830f214-241d-4975-b8ed-a5d752eab2a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:57.795262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5830f214-241d-4975-b8ed-a5d752eab2a0 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:57.797764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed73536-2b38-4260-b7dc-b03add7c34d6 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:57.802266 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:57.823006 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 354/697] 10.222.0.30 () {60 vars in 1132 bytes} [Sun Sep 4 00:45:57 2022] POST /identity/v3/users => generated 254 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:45:57.983674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed73536-2b38-4260-b7dc-b03add7c34d6 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:58.022592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4171d3-1e90-42e9-909f-b96735fe77c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:58.023792 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4171d3-1e90-42e9-909f-b96735fe77c1 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:58.024079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4171d3-1e90-42e9-909f-b96735fe77c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:58.024355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4171d3-1e90-42e9-909f-b96735fe77c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:58.034917 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4171d3-1e90-42e9-909f-b96735fe77c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:45:58.040798 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-eb4171d3-1e90-42e9-909f-b96735fe77c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:45:58.040798 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:58.040798 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:58.040798 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:58.040798 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:58.040798 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:58.040798 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:58.040798 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:58.040798 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:58.040798 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:58.040798 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:58.040798 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:58.040798 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:45:58.040798 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:45:58.040798 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:45:58.040798 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:45:58.041768 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:45:58.041768 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:45:58.041768 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:45:58.041768 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:45:58.041768 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:58.041768 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:58.041768 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:58.041768 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:58.041768 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:58.041768 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:58.041768 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:58.041768 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:58.041768 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:58.041768 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:58.041768 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:58.041768 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:58.042600 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:58.042600 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:58.042600 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:58.042600 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:58.042600 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:45:58.042600 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:45:58.042600 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:45:58.042600 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:45:58.042600 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:45:58.042600 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:45:58.042600 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:45:58.042600 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:58.042600 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 344/698] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Sep 4 00:45:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:45:58.048089 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5830f214-241d-4975-b8ed-a5d752eab2a0 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:58.092796 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:58.162190 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5830f214-241d-4975-b8ed-a5d752eab2a0 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:58.203723 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117bb54-e9e7-4d9c-aced-c00cf5db4874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:58.204337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117bb54-e9e7-4d9c-aced-c00cf5db4874 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:58.204617 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117bb54-e9e7-4d9c-aced-c00cf5db4874 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:58.204892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117bb54-e9e7-4d9c-aced-c00cf5db4874 None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:58.205580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117bb54-e9e7-4d9c-aced-c00cf5db4874 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:58.205884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117bb54-e9e7-4d9c-aced-c00cf5db4874 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:58.207271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117bb54-e9e7-4d9c-aced-c00cf5db4874 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:58.220252 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 355/699] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:45:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:58.222859 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4171d3-1e90-42e9-909f-b96735fe77c1 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:58.291085 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:58.332636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4171d3-1e90-42e9-909f-b96735fe77c1 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:58.369010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93938a2-ec9c-4e18-98fc-bfb53d187fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:58.369676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93938a2-ec9c-4e18-98fc-bfb53d187fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:58.369957 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93938a2-ec9c-4e18-98fc-bfb53d187fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:58.370229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93938a2-ec9c-4e18-98fc-bfb53d187fa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:58.381457 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93938a2-ec9c-4e18-98fc-bfb53d187fa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:58.383455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93938a2-ec9c-4e18-98fc-bfb53d187fa0 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:58.398677 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-c93938a2-ec9c-4e18-98fc-bfb53d187fa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:58.398677 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:58.398677 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:58.398677 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:58.398677 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:58.398677 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:58.398677 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:58.398677 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:58.398677 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:58.398677 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:58.398677 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:58.398677 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:58.398677 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:45:58.398677 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:45:58.398677 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:45:58.398677 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:45:58.399626 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:58.399626 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:58.399626 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:58.399626 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:58.399626 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:58.399626 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:58.399626 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:58.399626 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:58.399626 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:58.399626 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:58.399626 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:58.399626 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:58.399626 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:58.399626 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:58.399626 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:58.399626 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:58.399626 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:45:58.400503 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:45:58.400503 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:58.400503 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:58.404591 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 345/700] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:58.406070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117bb54-e9e7-4d9c-aced-c00cf5db4874 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:58.539143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117bb54-e9e7-4d9c-aced-c00cf5db4874 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:58.540683 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:58.582265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d07415-44cc-46b5-b4f9-dfcccda96844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:58.582786 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d07415-44cc-46b5-b4f9-dfcccda96844 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:58.583062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d07415-44cc-46b5-b4f9-dfcccda96844 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:58.583334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d07415-44cc-46b5-b4f9-dfcccda96844 None admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:58.584031 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d07415-44cc-46b5-b4f9-dfcccda96844 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:58.584337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d07415-44cc-46b5-b4f9-dfcccda96844 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:58.585771 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d07415-44cc-46b5-b4f9-dfcccda96844 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:58.602779 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 356/701] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:58.608462 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93938a2-ec9c-4e18-98fc-bfb53d187fa0 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:58.746134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93938a2-ec9c-4e18-98fc-bfb53d187fa0 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:58.762462 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:58.767859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4123476-5088-4c37-8d50-dfa15c68f071 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:58.769816 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4123476-5088-4c37-8d50-dfa15c68f071 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:58.769816 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4123476-5088-4c37-8d50-dfa15c68f071 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:58.769974 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 357/702] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 04 00:45:58.780943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc55b67-7d5a-4eea-bfa4-2322781ca57e None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:58.781355 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc55b67-7d5a-4eea-bfa4-2322781ca57e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:58.781673 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc55b67-7d5a-4eea-bfa4-2322781ca57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:58.791774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae009b-73aa-4562-8670-5f7a55fe5186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:58.792680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae009b-73aa-4562-8670-5f7a55fe5186 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:58.794166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae009b-73aa-4562-8670-5f7a55fe5186 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:58.794633 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae009b-73aa-4562-8670-5f7a55fe5186 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:58.803758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae009b-73aa-4562-8670-5f7a55fe5186 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:58.805896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae009b-73aa-4562-8670-5f7a55fe5186 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:58.821054 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-4bc55b67-7d5a-4eea-bfa4-2322781ca57e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:58.822724 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4bc55b67-7d5a-4eea-bfa4-2322781ca57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:58.832739 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-01ae009b-73aa-4562-8670-5f7a55fe5186 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 04 00:45:58.832739 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:58.832739 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:58.832739 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:58.832739 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:58.832739 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:58.832739 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:58.832739 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:58.832739 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:58.832739 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:58.832739 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:58.832739 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:58.832739 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 04 00:45:58.832739 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 04 00:45:58.832739 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 04 00:45:58.832739 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 04 00:45:58.833777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:58.833777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:58.833777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 00:45:58.833777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:45:58.833777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 00:45:58.833777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:45:58.833777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:58.833777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:58.833777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:58.833777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:58.833777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:58.833777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:58.833777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:58.833777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:58.833777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:58.833777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:58.833777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:58.833777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:58.835011 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:58.835011 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:58.835011 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 00:45:58.835011 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 00:45:58.835011 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 00:45:58.835011 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 00:45:58.835011 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 00:45:58.835011 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 00:45:58.835011 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 04 00:45:58.835011 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:58.837987 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 346/703] 10.222.0.30 () {56 vars in 1093 bytes} [Sun Sep 4 00:45:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:58.843190 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae009b-73aa-4562-8670-5f7a55fe5186 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:58.918427 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 358/704] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 04 00:45:58.925468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4429ce-bdc5-4fe0-a5be-7e979b2651b0 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:58.925468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4429ce-bdc5-4fe0-a5be-7e979b2651b0 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:58.925468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4429ce-bdc5-4fe0-a5be-7e979b2651b0 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:58.925785 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 359/705] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:45:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:45:58.926681 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ce30b-5220-4149-a8aa-2ec463d41e65 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:58.927034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ce30b-5220-4149-a8aa-2ec463d41e65 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:58.927316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ce30b-5220-4149-a8aa-2ec463d41e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:58.946494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-f95ce30b-5220-4149-a8aa-2ec463d41e65 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:45:58.947826 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f95ce30b-5220-4149-a8aa-2ec463d41e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:45:59.006894 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae009b-73aa-4562-8670-5f7a55fe5186 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:59.071941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e885697-bbe5-48b2-b739-8873f25d3609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:59.072502 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 360/706] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:45:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:45:59.073313 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e885697-bbe5-48b2-b739-8873f25d3609 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:59.073803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e885697-bbe5-48b2-b739-8873f25d3609 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:59.074251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e885697-bbe5-48b2-b739-8873f25d3609 None admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:59.075167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e885697-bbe5-48b2-b739-8873f25d3609 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:59.075675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e885697-bbe5-48b2-b739-8873f25d3609 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:59.077288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e885697-bbe5-48b2-b739-8873f25d3609 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:59.095357 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 347/707] 10.222.0.30 () {56 vars in 1133 bytes} [Sun Sep 4 00:45:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:59.102562 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ce30b-5220-4149-a8aa-2ec463d41e65 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:59.133832 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:59.214387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ce30b-5220-4149-a8aa-2ec463d41e65 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:59.249218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e885697-bbe5-48b2-b739-8873f25d3609 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:59.256831 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c96b5-b63f-44ac-aaa0-e8ef4cf97f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:59.258132 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c96b5-b63f-44ac-aaa0-e8ef4cf97f5a None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:59.258419 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c96b5-b63f-44ac-aaa0-e8ef4cf97f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:59.258719 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c96b5-b63f-44ac-aaa0-e8ef4cf97f5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:59.301947 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:59.330435 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c96b5-b63f-44ac-aaa0-e8ef4cf97f5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:59.331972 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c96b5-b63f-44ac-aaa0-e8ef4cf97f5a None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:59.356729 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:59.382627 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e885697-bbe5-48b2-b739-8873f25d3609 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:59.425510 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33996f2-5966-45b4-bbb9-47ba0ad961fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:59.426146 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33996f2-5966-45b4-bbb9-47ba0ad961fb None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:59.426421 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33996f2-5966-45b4-bbb9-47ba0ad961fb None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:59.426688 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33996f2-5966-45b4-bbb9-47ba0ad961fb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:59.427325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33996f2-5966-45b4-bbb9-47ba0ad961fb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:59.428700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33996f2-5966-45b4-bbb9-47ba0ad961fb None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:59.440716 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-e33996f2-5966-45b4-bbb9-47ba0ad961fb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 04 00:45:59.440716 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:59.440716 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 04 00:45:59.440716 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 04 00:45:59.440716 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 04 00:45:59.440716 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 04 00:45:59.440716 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 04 00:45:59.440716 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:45:59.440716 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 04 00:45:59.440716 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:59.440716 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 00:45:59.440716 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:59.440716 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:59.440716 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:59.440716 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:59.440716 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:59.440716 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:59.441812 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:59.441812 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:59.441812 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:59.441812 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:59.441812 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:59.441812 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:59.441812 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 04 00:45:59.441812 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 04 00:45:59.441812 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 04 00:45:59.441812 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 04 00:45:59.441812 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:59.441812 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:59.441812 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:59.441812 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:59.441812 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:59.441812 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:59.442667 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:59.442667 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:59.442667 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:59.442667 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:59.442667 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:59.442667 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:59.442667 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:59.442667 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:59.442667 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:59.442667 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:59.442667 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 04 00:45:59.442667 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:45:59.442667 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 04 00:45:59.442667 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:59.442667 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 348/708] 10.222.0.30 () {56 vars in 1129 bytes} [Sun Sep 4 00:45:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:45:59.443479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33996f2-5966-45b4-bbb9-47ba0ad961fb None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:59.446691 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 361/709] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:45:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 04 00:45:59.448718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c96b5-b63f-44ac-aaa0-e8ef4cf97f5a None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:59.563979 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:59.569689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33996f2-5966-45b4-bbb9-47ba0ad961fb None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:59.590431 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c96b5-b63f-44ac-aaa0-e8ef4cf97f5a None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:59.614829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4c6a8-b09f-474f-9181-70736283b224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:59.615456 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4c6a8-b09f-474f-9181-70736283b224 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:59.615795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4c6a8-b09f-474f-9181-70736283b224 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:59.616067 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4c6a8-b09f-474f-9181-70736283b224 None admin] PATH_INFO: `/v3/services/network` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:59.616669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae4c6a8-b09f-474f-9181-70736283b224 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:59.618853 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae4c6a8-b09f-474f-9181-70736283b224 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:59.619969 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:59.631031 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-cae4c6a8-b09f-474f-9181-70736283b224 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 04 00:45:59.631031 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:59.631031 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 04 00:45:59.631031 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 04 00:45:59.631031 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 04 00:45:59.631031 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 04 00:45:59.631031 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 04 00:45:59.631031 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:45:59.631031 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 04 00:45:59.631031 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:59.631031 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 00:45:59.631031 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:59.631031 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:59.631031 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:59.631031 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:59.631031 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:59.631031 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:59.632199 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:59.632199 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:59.632199 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:59.632199 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:59.632199 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:59.632199 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:59.632199 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 04 00:45:59.632199 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 04 00:45:59.632199 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 04 00:45:59.632199 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 04 00:45:59.632199 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:59.632199 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:59.632199 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:59.632199 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:59.632199 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:59.632199 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:59.633801 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:59.633801 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:59.633801 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:59.633801 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:59.633801 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:59.633801 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:59.633801 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:59.633801 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:59.633801 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:59.633801 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:59.633801 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 04 00:45:59.633801 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:45:59.633801 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 04 00:45:59.633801 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:59.633801 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 349/710] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:45:59 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:59.634746 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4c6a8-b09f-474f-9181-70736283b224 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:59.641063 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58819bd7-9c49-4dde-b998-72497a48d68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:59.642845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58819bd7-9c49-4dde-b998-72497a48d68c None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:59.643366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58819bd7-9c49-4dde-b998-72497a48d68c None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:59.643828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58819bd7-9c49-4dde-b998-72497a48d68c None admin] PATH_INFO: `/v3/services` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:59.644643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58819bd7-9c49-4dde-b998-72497a48d68c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:59.645121 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58819bd7-9c49-4dde-b998-72497a48d68c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:59.646694 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58819bd7-9c49-4dde-b998-72497a48d68c None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:59.654264 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 362/711] 10.222.0.30 () {56 vars in 1124 bytes} [Sun Sep 4 00:45:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:59.655860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58819bd7-9c49-4dde-b998-72497a48d68c None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:59.762570 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4c6a8-b09f-474f-9181-70736283b224 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:59.789423 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58819bd7-9c49-4dde-b998-72497a48d68c None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:59.804397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa734fa-1e6d-42f9-82e9-dbcdfd523ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:59.805111 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa734fa-1e6d-42f9-82e9-dbcdfd523ade None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:59.805487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa734fa-1e6d-42f9-82e9-dbcdfd523ade None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:59.805835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa734fa-1e6d-42f9-82e9-dbcdfd523ade None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:59.819515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa734fa-1e6d-42f9-82e9-dbcdfd523ade None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:59.821801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa734fa-1e6d-42f9-82e9-dbcdfd523ade None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:59.830481 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179e0f8-2f15-4d8b-ba57-226396b62995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:45:59.831361 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179e0f8-2f15-4d8b-ba57-226396b62995 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:45:59.832240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179e0f8-2f15-4d8b-ba57-226396b62995 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:45:59.832853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179e0f8-2f15-4d8b-ba57-226396b62995 None admin] PATH_INFO: `/v3/services` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:45:59.833798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179e0f8-2f15-4d8b-ba57-226396b62995 None admin] RBAC: Adding query filter params (name=network) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:45:59.834383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179e0f8-2f15-4d8b-ba57-226396b62995 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:45:59.836670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179e0f8-2f15-4d8b-ba57-226396b62995 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:45:59.839366 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-cfa734fa-1e6d-42f9-82e9-dbcdfd523ade None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:59.839366 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:45:59.839366 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:45:59.839366 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:45:59.839366 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:45:59.839366 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:45:59.839366 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:45:59.839366 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:45:59.839366 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:45:59.839366 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:45:59.839366 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:45:59.839366 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:45:59.839366 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:45:59.839366 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:45:59.839366 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:45:59.839366 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:45:59.840306 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:45:59.840306 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:45:59.840306 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:45:59.840306 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:45:59.840306 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:45:59.840306 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:45:59.840306 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:45:59.840306 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:45:59.840306 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:45:59.840306 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:45:59.840306 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:45:59.840306 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:45:59.840306 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:45:59.840306 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:45:59.840306 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:45:59.840306 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:45:59.840306 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:45:59.841207 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:45:59.841207 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:45:59.841207 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:45:59.845408 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 350/712] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:45:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:45:59.846543 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa734fa-1e6d-42f9-82e9-dbcdfd523ade None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:59.847884 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 363/713] 10.222.0.30 () {56 vars in 1112 bytes} [Sun Sep 4 00:45:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:45:59.849002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179e0f8-2f15-4d8b-ba57-226396b62995 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:45:59.873887 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:59.914654 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:45:59.980082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179e0f8-2f15-4d8b-ba57-226396b62995 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:45:59.993545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa734fa-1e6d-42f9-82e9-dbcdfd523ade None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:00.024151 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4db46-8285-4cef-9b8a-ec0d2e2f4d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:00.025231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4db46-8285-4cef-9b8a-ec0d2e2f4d6e None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:00.025783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4db46-8285-4cef-9b8a-ec0d2e2f4d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:00.026332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4db46-8285-4cef-9b8a-ec0d2e2f4d6e None admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:00.027076 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4db46-8285-4cef-9b8a-ec0d2e2f4d6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:00.027480 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4db46-8285-4cef-9b8a-ec0d2e2f4d6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:00.029672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4db46-8285-4cef-9b8a-ec0d2e2f4d6e None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:00.037001 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f2767-9e59-4771-8130-d811da705915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:00.038110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f2767-9e59-4771-8130-d811da705915 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:00.040545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f2767-9e59-4771-8130-d811da705915 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:00.040796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f2767-9e59-4771-8130-d811da705915 None admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:00.041571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f2767-9e59-4771-8130-d811da705915 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:00.041977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f2767-9e59-4771-8130-d811da705915 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:00.043733 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f2767-9e59-4771-8130-d811da705915 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:00.049620 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 364/714] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:00.050469 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 351/715] 10.222.0.30 () {56 vars in 1124 bytes} [Sun Sep 4 00:45:59 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:00.050933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4db46-8285-4cef-9b8a-ec0d2e2f4d6e None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:00.051532 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f2767-9e59-4771-8130-d811da705915 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:00.140544 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:00.166674 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4db46-8285-4cef-9b8a-ec0d2e2f4d6e None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:00.171813 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f2767-9e59-4771-8130-d811da705915 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:00.181063 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:00.210207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634d3cf-a2e9-4fc0-aa90-66a61d311094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:00.211314 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634d3cf-a2e9-4fc0-aa90-66a61d311094 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:00.211798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634d3cf-a2e9-4fc0-aa90-66a61d311094 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:00.212338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634d3cf-a2e9-4fc0-aa90-66a61d311094 None admin] PATH_INFO: `/v3/services` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:00.213344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0634d3cf-a2e9-4fc0-aa90-66a61d311094 None admin] RBAC: Adding query filter params (type=network) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:00.213881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0634d3cf-a2e9-4fc0-aa90-66a61d311094 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:00.215507 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0634d3cf-a2e9-4fc0-aa90-66a61d311094 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:00.223360 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 365/716] 10.222.0.30 () {56 vars in 1112 bytes} [Sun Sep 4 00:46:00 2022] GET /identity/v3/services?type=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:00.242970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76feafc0-5f8c-4e80-be34-2cb4feedde81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:00.243633 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76feafc0-5f8c-4e80-be34-2cb4feedde81 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:00.243913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76feafc0-5f8c-4e80-be34-2cb4feedde81 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:00.244185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76feafc0-5f8c-4e80-be34-2cb4feedde81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:00.257005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76feafc0-5f8c-4e80-be34-2cb4feedde81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:00.259197 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76feafc0-5f8c-4e80-be34-2cb4feedde81 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:00.272141 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-76feafc0-5f8c-4e80-be34-2cb4feedde81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:46:00.272141 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:00.272141 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:00.272141 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:00.272141 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:00.272141 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:00.272141 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:00.272141 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:00.272141 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:00.272141 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:00.272141 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:00.272141 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:00.272141 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 04 00:46:00.272141 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 04 00:46:00.272141 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 04 00:46:00.273156 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 04 00:46:00.273156 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:00.273156 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:00.273156 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:00.273156 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:00.273156 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:00.273156 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:00.273156 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:00.273156 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:00.273156 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:00.273156 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:00.273156 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:00.273156 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:00.273156 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:00.273156 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:00.273156 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:00.273156 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:00.274069 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 04 00:46:00.274069 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 04 00:46:00.274069 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 00:46:00.274069 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 00:46:00.274069 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 00:46:00.274069 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 00:46:00.274069 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:46:00.274069 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:00.274069 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 352/717] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:46:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:00.282900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634d3cf-a2e9-4fc0-aa90-66a61d311094 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:00.400309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634d3cf-a2e9-4fc0-aa90-66a61d311094 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:00.417820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6933567-6b1e-48f8-ab3f-7a431530d4bd None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:00.418128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6933567-6b1e-48f8-ab3f-7a431530d4bd None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:00.418377 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6933567-6b1e-48f8-ab3f-7a431530d4bd None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:00.419969 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 353/718] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:00.423738 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e00dba-c6e1-4da8-a3fb-7ad80c6ad2a8 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:00.424013 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e00dba-c6e1-4da8-a3fb-7ad80c6ad2a8 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:00.424289 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e00dba-c6e1-4da8-a3fb-7ad80c6ad2a8 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:00.425666 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 354/719] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:00.432893 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4d72b-0afc-4e82-896b-3f3d75c7b4e4 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:00.433180 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4d72b-0afc-4e82-896b-3f3d75c7b4e4 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:00.433466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4d72b-0afc-4e82-896b-3f3d75c7b4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:00.437606 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336884eb-f153-4a1b-b478-35f51a491860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:00.438221 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336884eb-f153-4a1b-b478-35f51a491860 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:00.438503 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336884eb-f153-4a1b-b478-35f51a491860 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:00.438780 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336884eb-f153-4a1b-b478-35f51a491860 None admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:00.439476 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336884eb-f153-4a1b-b478-35f51a491860 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:00.439784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336884eb-f153-4a1b-b478-35f51a491860 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:00.441223 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336884eb-f153-4a1b-b478-35f51a491860 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:00.455344 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 366/720] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Sep 4 00:46:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:00.459170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2b6f8-5196-457c-b007-faa1e416f0e1 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:00.459170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2b6f8-5196-457c-b007-faa1e416f0e1 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:00.459170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2b6f8-5196-457c-b007-faa1e416f0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:00.459409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c8d4d72b-0afc-4e82-896b-3f3d75c7b4e4 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:00.459409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c8d4d72b-0afc-4e82-896b-3f3d75c7b4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:00.474382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-4de2b6f8-5196-457c-b007-faa1e416f0e1 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:00.475565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4de2b6f8-5196-457c-b007-faa1e416f0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:00.505250 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:00.548170 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 355/721] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:46:00.548775 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 367/722] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:46:00.548992 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4d72b-0afc-4e82-896b-3f3d75c7b4e4 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:00.639497 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:00.686744 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4d72b-0afc-4e82-896b-3f3d75c7b4e4 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:00.735753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caacb60-dea2-4cfc-9956-42de7f3a54cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:00.736367 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caacb60-dea2-4cfc-9956-42de7f3a54cb None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:00.736645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caacb60-dea2-4cfc-9956-42de7f3a54cb None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:00.736919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caacb60-dea2-4cfc-9956-42de7f3a54cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:00.737678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caacb60-dea2-4cfc-9956-42de7f3a54cb None admin] RBAC: Adding query filter params (role.id=d255b03c37d64371a148ec4e11be01d9, scope.project.id=40b24e92f8594ee08bd2a55f79e3b299, user.id=13f0f341bf2c475d82b4e7b34d503dd0) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:00.737990 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caacb60-dea2-4cfc-9956-42de7f3a54cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:00.739531 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caacb60-dea2-4cfc-9956-42de7f3a54cb None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:00.749891 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 356/723] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:46:00 2022] GET /identity/v3/role_assignments?user.id=13f0f341bf2c475d82b4e7b34d503dd0&scope.project.id=40b24e92f8594ee08bd2a55f79e3b299&role.id=d255b03c37d64371a148ec4e11be01d9 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:00.850454 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2b6f8-5196-457c-b007-faa1e416f0e1 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:00.938092 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caacb60-dea2-4cfc-9956-42de7f3a54cb None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:00.962827 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2b6f8-5196-457c-b007-faa1e416f0e1 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:01.019796 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11babc32-e22d-4e7f-a75f-6d4e056a7ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:01.020583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11babc32-e22d-4e7f-a75f-6d4e056a7ce4 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:01.020953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11babc32-e22d-4e7f-a75f-6d4e056a7ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:01.021317 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11babc32-e22d-4e7f-a75f-6d4e056a7ce4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:01.032584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11babc32-e22d-4e7f-a75f-6d4e056a7ce4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:46:01.038621 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-11babc32-e22d-4e7f-a75f-6d4e056a7ce4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:46:01.038621 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:01.038621 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:01.038621 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:01.038621 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:01.038621 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:01.038621 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:01.038621 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:01.038621 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:01.038621 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:01.038621 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:01.038621 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:01.038621 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:46:01.038621 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:46:01.038621 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:46:01.038621 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:46:01.039731 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:46:01.039731 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:46:01.039731 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:46:01.039731 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:46:01.039731 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:01.039731 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:01.039731 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:01.039731 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:01.039731 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:01.039731 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:01.039731 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:01.039731 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:01.039731 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:01.039731 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:01.039731 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:01.039731 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:01.040551 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:01.040551 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:01.040551 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:01.040551 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:01.040551 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:46:01.040551 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:46:01.040551 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:46:01.040551 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:46:01.040551 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:46:01.040551 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:46:01.040551 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:46:01.040551 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:01.040551 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 368/724] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Sep 4 00:46:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:01.045652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11babc32-e22d-4e7f-a75f-6d4e056a7ce4 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:01.074702 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:01.087687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caacb60-dea2-4cfc-9956-42de7f3a54cb None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:01.153077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11babc32-e22d-4e7f-a75f-6d4e056a7ce4 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:01.170509 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:01.190188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdeb62-c021-4af6-8dc2-2c3951f26784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:01.190768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdeb62-c021-4af6-8dc2-2c3951f26784 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:01.191050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdeb62-c021-4af6-8dc2-2c3951f26784 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:01.191327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdeb62-c021-4af6-8dc2-2c3951f26784 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:01.192239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbfea9f-7391-40c5-8be7-7c997ba8f2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:01.192841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbfea9f-7391-40c5-8be7-7c997ba8f2f2 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:01.193220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbfea9f-7391-40c5-8be7-7c997ba8f2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:01.193524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbfea9f-7391-40c5-8be7-7c997ba8f2f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:01.194304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbfea9f-7391-40c5-8be7-7c997ba8f2f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:01.194611 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbfea9f-7391-40c5-8be7-7c997ba8f2f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:01.196035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbfea9f-7391-40c5-8be7-7c997ba8f2f2 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:01.204904 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 369/725] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:46:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:01.210145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbfea9f-7391-40c5-8be7-7c997ba8f2f2 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:01.211306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affdeb62-c021-4af6-8dc2-2c3951f26784 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:46:01.216878 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-affdeb62-c021-4af6-8dc2-2c3951f26784 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:46:01.216878 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:01.216878 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:01.216878 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:01.216878 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:01.216878 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:01.216878 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:01.216878 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:01.216878 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:01.216878 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:01.216878 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:01.216878 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:01.216878 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:46:01.216878 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:46:01.216878 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:46:01.216878 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:46:01.217841 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:46:01.217841 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:46:01.217841 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:46:01.217841 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:46:01.217841 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:01.217841 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:01.217841 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:01.217841 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:01.217841 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:01.217841 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:01.217841 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:01.217841 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:01.217841 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:01.217841 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:01.217841 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:01.217841 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:01.218826 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:01.218826 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:01.218826 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:01.218826 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:01.218826 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:46:01.218826 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:46:01.218826 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:46:01.218826 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:46:01.218826 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:46:01.218826 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:46:01.218826 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:46:01.218826 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:01.229502 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 357/726] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Sep 4 00:46:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:01.236925 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdeb62-c021-4af6-8dc2-2c3951f26784 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:01.313811 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:01.322977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbfea9f-7391-40c5-8be7-7c997ba8f2f2 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:01.359486 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a5550-61c3-4df6-b7d7-ca3af720a3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:01.360369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a5550-61c3-4df6-b7d7-ca3af720a3f9 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:01.360646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a5550-61c3-4df6-b7d7-ca3af720a3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:01.360916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a5550-61c3-4df6-b7d7-ca3af720a3f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:01.372296 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a5550-61c3-4df6-b7d7-ca3af720a3f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:01.373787 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a5550-61c3-4df6-b7d7-ca3af720a3f9 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:01.388940 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-492a5550-61c3-4df6-b7d7-ca3af720a3f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:01.388940 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:01.388940 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:01.388940 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:01.388940 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:01.388940 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:01.388940 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:01.388940 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:01.388940 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:01.388940 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:01.388940 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:01.388940 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:01.388940 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:46:01.388940 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:46:01.388940 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:46:01.388940 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:46:01.389977 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:01.389977 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:01.389977 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:01.389977 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:01.389977 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:01.389977 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:01.389977 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:01.389977 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:01.389977 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:01.389977 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:01.389977 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:01.389977 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:01.389977 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:01.389977 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:01.389977 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:01.389977 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:01.389977 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:46:01.390913 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:46:01.390913 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:01.390913 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:01.390913 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 370/727] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:46:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:01.396355 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a5550-61c3-4df6-b7d7-ca3af720a3f9 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:01.479375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdeb62-c021-4af6-8dc2-2c3951f26784 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:01.499028 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a5550-61c3-4df6-b7d7-ca3af720a3f9 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:01.533427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197d138-9dea-4141-ad4c-c2a3067dd4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:01.534053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197d138-9dea-4141-ad4c-c2a3067dd4b5 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:01.534333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197d138-9dea-4141-ad4c-c2a3067dd4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:01.534607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197d138-9dea-4141-ad4c-c2a3067dd4b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:01.535335 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7197d138-9dea-4141-ad4c-c2a3067dd4b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:01.535647 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7197d138-9dea-4141-ad4c-c2a3067dd4b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:01.537018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7197d138-9dea-4141-ad4c-c2a3067dd4b5 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:01.544979 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:01.546251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2238dc7-53c6-478f-82ff-868c5cb8851d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:01.546935 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2238dc7-53c6-478f-82ff-868c5cb8851d None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:01.547212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2238dc7-53c6-478f-82ff-868c5cb8851d None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:01.547473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2238dc7-53c6-478f-82ff-868c5cb8851d None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:01.548139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2238dc7-53c6-478f-82ff-868c5cb8851d None admin] RBAC: Adding query filter params (name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:01.548438 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2238dc7-53c6-478f-82ff-868c5cb8851d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:01.549830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2238dc7-53c6-478f-82ff-868c5cb8851d None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:01.550245 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 371/728] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:46:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:01.558592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197d138-9dea-4141-ad4c-c2a3067dd4b5 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:01.567229 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 358/729] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Sep 4 00:46:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:01.572643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2238dc7-53c6-478f-82ff-868c5cb8851d None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:01.673471 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:01.676145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197d138-9dea-4141-ad4c-c2a3067dd4b5 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:01.712741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0b8d9-f663-4ec7-8015-64ea56440ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:01.713348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0b8d9-f663-4ec7-8015-64ea56440ddb None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:01.713666 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0b8d9-f663-4ec7-8015-64ea56440ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:01.713938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0b8d9-f663-4ec7-8015-64ea56440ddb None admin] PATH_INFO: `/v3/users/swift` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:01.721381 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0b8d9-f663-4ec7-8015-64ea56440ddb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:01.722868 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0b8d9-f663-4ec7-8015-64ea56440ddb None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:01.735663 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-d4d0b8d9-f663-4ec7-8015-64ea56440ddb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 04 00:46:01.735663 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:01.735663 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:01.735663 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:01.735663 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:01.735663 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:01.735663 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:01.735663 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:01.735663 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:01.735663 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:01.735663 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:01.735663 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:01.735663 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 04 00:46:01.735663 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 04 00:46:01.735663 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 04 00:46:01.735663 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 04 00:46:01.741974 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:01.741974 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:01.741974 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 00:46:01.741974 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:46:01.741974 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 00:46:01.741974 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:46:01.741974 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:01.741974 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:01.741974 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:01.741974 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:01.741974 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:01.741974 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:01.741974 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:01.741974 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:01.741974 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:01.741974 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:01.741974 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:01.741974 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:01.744521 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:01.744521 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:01.744521 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 00:46:01.744521 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 00:46:01.744521 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 00:46:01.744521 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 00:46:01.744521 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 00:46:01.744521 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 00:46:01.744521 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 04 00:46:01.744521 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:01.744521 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 372/730] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Sep 4 00:46:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:01.744521 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0b8d9-f663-4ec7-8015-64ea56440ddb None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:01.762067 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2238dc7-53c6-478f-82ff-868c5cb8851d None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:01.806229 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:01.818465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb53c06-7036-4bff-9af1-ce5d2b66a900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:01.818465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb53c06-7036-4bff-9af1-ce5d2b66a900 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:01.819458 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb53c06-7036-4bff-9af1-ce5d2b66a900 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:01.824704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb53c06-7036-4bff-9af1-ce5d2b66a900 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:01.832279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb53c06-7036-4bff-9af1-ce5d2b66a900 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:01.834211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb53c06-7036-4bff-9af1-ce5d2b66a900 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:01.851479 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-9eb53c06-7036-4bff-9af1-ce5d2b66a900 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:01.851479 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:01.851479 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:01.851479 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:01.851479 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:01.851479 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:01.851479 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:01.851479 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:01.851479 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:01.851479 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:01.851479 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:01.851479 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:01.851479 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:46:01.851479 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:46:01.851479 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:46:01.851479 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:46:01.852428 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:01.852428 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:01.852428 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:01.852428 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:01.852428 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:01.852428 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:01.852428 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:01.852428 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:01.852428 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:01.852428 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:01.852428 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:01.852428 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:01.852428 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:01.852428 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:01.852428 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:01.852428 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:01.852428 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:46:01.853902 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:46:01.853902 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:01.853902 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:01.853902 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 359/731] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:46:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:46:01.858223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb53c06-7036-4bff-9af1-ce5d2b66a900 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:01.881808 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0b8d9-f663-4ec7-8015-64ea56440ddb None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:01.966239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d66baf-73e3-42ae-a770-850a613e2f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:01.967471 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d66baf-73e3-42ae-a770-850a613e2f95 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:01.968015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d66baf-73e3-42ae-a770-850a613e2f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:01.968486 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d66baf-73e3-42ae-a770-850a613e2f95 None admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:01.969425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d66baf-73e3-42ae-a770-850a613e2f95 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:01.969983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d66baf-73e3-42ae-a770-850a613e2f95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:01.971626 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d66baf-73e3-42ae-a770-850a613e2f95 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:01.993554 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 373/732] 10.222.0.30 () {56 vars in 1135 bytes} [Sun Sep 4 00:46:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:01.996205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d66baf-73e3-42ae-a770-850a613e2f95 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:01.999999 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb53c06-7036-4bff-9af1-ce5d2b66a900 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:02.017476 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:02.043357 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9717380-5a27-4660-9a74-11203c16a00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:02.043975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9717380-5a27-4660-9a74-11203c16a00b None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:02.044256 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9717380-5a27-4660-9a74-11203c16a00b None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:02.044734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9717380-5a27-4660-9a74-11203c16a00b None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:02.045385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9717380-5a27-4660-9a74-11203c16a00b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:02.045719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9717380-5a27-4660-9a74-11203c16a00b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:02.047085 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9717380-5a27-4660-9a74-11203c16a00b None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:02.072555 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 360/733] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:46:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:02.078599 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9717380-5a27-4660-9a74-11203c16a00b None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:02.194111 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9717380-5a27-4660-9a74-11203c16a00b None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:02.230272 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657e817-e425-4411-9316-778053e66aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:02.230825 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657e817-e425-4411-9316-778053e66aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:02.231106 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657e817-e425-4411-9316-778053e66aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:02.231379 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657e817-e425-4411-9316-778053e66aa2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:02.236589 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d66baf-73e3-42ae-a770-850a613e2f95 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:02.239095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0657e817-e425-4411-9316-778053e66aa2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:02.240560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0657e817-e425-4411-9316-778053e66aa2 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:02.253324 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-0657e817-e425-4411-9316-778053e66aa2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 04 00:46:02.253324 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:02.253324 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:02.253324 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:02.253324 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:02.253324 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:02.253324 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:02.253324 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:02.253324 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:02.253324 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:02.253324 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:02.253324 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:02.253324 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 04 00:46:02.253324 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 04 00:46:02.253324 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 04 00:46:02.253324 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 04 00:46:02.254310 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:02.254310 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:02.254310 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 00:46:02.254310 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:46:02.254310 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 00:46:02.254310 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:46:02.254310 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:02.254310 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:02.254310 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:02.254310 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:02.254310 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:02.254310 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:02.254310 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:02.254310 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:02.254310 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:02.254310 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:02.254310 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:02.254310 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:02.255848 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:02.255848 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:02.255848 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 00:46:02.255848 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 00:46:02.255848 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 00:46:02.255848 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 00:46:02.255848 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 00:46:02.255848 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 00:46:02.255848 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 04 00:46:02.255848 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:02.255848 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 361/734] 10.222.0.30 () {56 vars in 1117 bytes} [Sun Sep 4 00:46:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:02.260887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657e817-e425-4411-9316-778053e66aa2 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:02.272613 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:02.296266 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7faae-eea2-421c-848e-124f80311abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:02.297355 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7faae-eea2-421c-848e-124f80311abc None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:02.297707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7faae-eea2-421c-848e-124f80311abc None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:02.297984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7faae-eea2-421c-848e-124f80311abc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:02.324399 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:02.427753 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a7faae-eea2-421c-848e-124f80311abc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:02.431847 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a7faae-eea2-421c-848e-124f80311abc None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:02.462474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657e817-e425-4411-9316-778053e66aa2 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:02.515253 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6921125-088d-4d11-acfe-85cfad761755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:02.515894 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6921125-088d-4d11-acfe-85cfad761755 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:02.516177 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6921125-088d-4d11-acfe-85cfad761755 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:02.516448 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6921125-088d-4d11-acfe-85cfad761755 None admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:02.517177 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6921125-088d-4d11-acfe-85cfad761755 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:02.517503 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6921125-088d-4d11-acfe-85cfad761755 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:02.519057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6921125-088d-4d11-acfe-85cfad761755 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:02.539193 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 362/735] 10.222.0.30 () {56 vars in 1149 bytes} [Sun Sep 4 00:46:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:02.540575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa50121-7bfe-43d0-878e-3960143aee72 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:02.540859 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa50121-7bfe-43d0-878e-3960143aee72 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:02.541130 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa50121-7bfe-43d0-878e-3960143aee72 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:02.546437 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 363/736] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:02.546437 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa50121-7bfe-43d0-878e-3960143aee72 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:02.567547 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 374/737] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:46:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 04 00:46:02.569127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce880e7c-6b09-429f-a1f4-502517f3a828 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:02.570156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce880e7c-6b09-429f-a1f4-502517f3a828 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:02.570661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce880e7c-6b09-429f-a1f4-502517f3a828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:02.589312 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ce880e7c-6b09-429f-a1f4-502517f3a828 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:02.590860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ce880e7c-6b09-429f-a1f4-502517f3a828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:02.602561 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:02.639972 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:02.658283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa50121-7bfe-43d0-878e-3960143aee72 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:02.668954 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 375/738] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:46:02.670255 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce880e7c-6b09-429f-a1f4-502517f3a828 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:02.693057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15ccbd-b2b4-4019-b1cc-c3dc6aba17be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:02.693724 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15ccbd-b2b4-4019-b1cc-c3dc6aba17be None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:02.693964 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15ccbd-b2b4-4019-b1cc-c3dc6aba17be None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:02.694239 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15ccbd-b2b4-4019-b1cc-c3dc6aba17be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:02.765712 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15ccbd-b2b4-4019-b1cc-c3dc6aba17be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:02.767094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15ccbd-b2b4-4019-b1cc-c3dc6aba17be None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:02.782244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce880e7c-6b09-429f-a1f4-502517f3a828 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:02.817726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d4331-cb5a-4e93-ac76-3f5e39ed31ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:02.818354 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d4331-cb5a-4e93-ac76-3f5e39ed31ea None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:02.818637 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d4331-cb5a-4e93-ac76-3f5e39ed31ea None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:02.818911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d4331-cb5a-4e93-ac76-3f5e39ed31ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:02.830032 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d4331-cb5a-4e93-ac76-3f5e39ed31ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:02.831473 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d4331-cb5a-4e93-ac76-3f5e39ed31ea None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:02.841695 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:02.850621 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-a02d4331-cb5a-4e93-ac76-3f5e39ed31ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:02.850621 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:02.850621 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:02.850621 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:02.850621 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:02.850621 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:02.850621 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:02.850621 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:02.850621 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:02.850621 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:02.850621 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:02.850621 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:02.850621 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:46:02.850621 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:46:02.850621 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:46:02.850621 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:46:02.851598 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:02.851598 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:02.851598 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:02.851598 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:02.851598 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:02.851598 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:02.851598 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:02.851598 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:02.851598 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:02.851598 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:02.851598 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:02.851598 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:02.851598 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:02.851598 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:02.851598 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:02.851598 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:02.851598 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:46:02.852484 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:46:02.852484 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:02.852484 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:02.852651 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:02.857281 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 376/739] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:46:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:02.858577 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1489a-1a14-409b-8752-830f3af056b7 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:02.858860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1489a-1a14-409b-8752-830f3af056b7 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:02.859135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1489a-1a14-409b-8752-830f3af056b7 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:02.861019 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 377/740] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:02.865622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1489a-1a14-409b-8752-830f3af056b7 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:02.868942 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 364/741] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:46:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 04 00:46:02.870295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece117c9-5d0e-46da-ad81-0209c074adc9 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:02.870607 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece117c9-5d0e-46da-ad81-0209c074adc9 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:02.870949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece117c9-5d0e-46da-ad81-0209c074adc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:02.894830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-ece117c9-5d0e-46da-ad81-0209c074adc9 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:02.896003 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ece117c9-5d0e-46da-ad81-0209c074adc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:02.965721 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 365/742] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:46:02.966600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece117c9-5d0e-46da-ad81-0209c074adc9 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:02.984331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1489a-1a14-409b-8752-830f3af056b7 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:03.022567 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f525bb8-a7a8-484b-964f-e7a0d7e6d230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:03.023372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f525bb8-a7a8-484b-964f-e7a0d7e6d230 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:03.024134 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f525bb8-a7a8-484b-964f-e7a0d7e6d230 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:03.024419 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f525bb8-a7a8-484b-964f-e7a0d7e6d230 None admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:03.025064 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f525bb8-a7a8-484b-964f-e7a0d7e6d230 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:03.025366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f525bb8-a7a8-484b-964f-e7a0d7e6d230 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:03.026782 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f525bb8-a7a8-484b-964f-e7a0d7e6d230 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:03.038150 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 378/743] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:46:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:03.038950 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f525bb8-a7a8-484b-964f-e7a0d7e6d230 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:03.073172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece117c9-5d0e-46da-ad81-0209c074adc9 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:03.088114 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:03.098809 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:03.110307 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c3a08-0a24-45d9-99bf-b8363a7c4d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:03.110936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c3a08-0a24-45d9-99bf-b8363a7c4d29 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:03.111239 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c3a08-0a24-45d9-99bf-b8363a7c4d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:03.111489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c3a08-0a24-45d9-99bf-b8363a7c4d29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:03.122163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c3a08-0a24-45d9-99bf-b8363a7c4d29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:03.123618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c3a08-0a24-45d9-99bf-b8363a7c4d29 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:03.140214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-9a0c3a08-0a24-45d9-99bf-b8363a7c4d29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:03.140214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:03.140214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:03.140214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:03.140214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:03.140214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:03.140214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:03.140214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:03.140214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:03.140214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:03.140214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:03.140214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:03.140214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:46:03.140214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:46:03.140214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:46:03.140214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:46:03.141127 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:03.141127 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:03.141127 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:03.141127 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:03.141127 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:03.141127 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:03.141127 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:03.141127 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:03.141127 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:03.141127 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:03.141127 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:03.141127 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:03.141127 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:03.141127 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:03.141127 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:03.141127 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:03.141127 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:46:03.142050 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:46:03.142050 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:03.142050 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:03.142050 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 366/744] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:46:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:03.142671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c7ab6-7abe-44b7-96ce-04b64d1c18d6 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:03.142848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c7ab6-7abe-44b7-96ce-04b64d1c18d6 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:03.143046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c7ab6-7abe-44b7-96ce-04b64d1c18d6 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:03.148577 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 367/745] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:03.148577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c7ab6-7abe-44b7-96ce-04b64d1c18d6 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:03.154758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f525bb8-a7a8-484b-964f-e7a0d7e6d230 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:03.188780 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a0dc1-57b9-4369-b7bd-f897500c9d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:03.189387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a0dc1-57b9-4369-b7bd-f897500c9d8b None admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:03.189688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a0dc1-57b9-4369-b7bd-f897500c9d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:03.189959 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a0dc1-57b9-4369-b7bd-f897500c9d8b None admin] PATH_INFO: `/v3/services` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:03.190605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a0dc1-57b9-4369-b7bd-f897500c9d8b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:03.191964 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a0dc1-57b9-4369-b7bd-f897500c9d8b None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:03.209276 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 379/746] 10.222.0.30 () {60 vars in 1141 bytes} [Sun Sep 4 00:46:03 2022] POST /identity/v3/services => generated 251 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:46:03.209948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a0dc1-57b9-4369-b7bd-f897500c9d8b None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:03.289643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c7ab6-7abe-44b7-96ce-04b64d1c18d6 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:03.325781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a0dc1-57b9-4369-b7bd-f897500c9d8b None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:03.329132 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3feca18-1ff5-47ab-b66d-7c5b7dcb58d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:03.329813 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3feca18-1ff5-47ab-b66d-7c5b7dcb58d3 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:03.330145 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3feca18-1ff5-47ab-b66d-7c5b7dcb58d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:03.330418 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3feca18-1ff5-47ab-b66d-7c5b7dcb58d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:03.338441 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3feca18-1ff5-47ab-b66d-7c5b7dcb58d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:03.339936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3feca18-1ff5-47ab-b66d-7c5b7dcb58d3 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:03.344637 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:03.353687 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-b3feca18-1ff5-47ab-b66d-7c5b7dcb58d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:46:03.353687 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:03.353687 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:03.353687 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:03.353687 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:03.353687 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:03.353687 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:03.353687 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:03.353687 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:03.353687 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:03.353687 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:03.353687 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:03.353687 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 04 00:46:03.353687 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 04 00:46:03.353687 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 04 00:46:03.354613 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 04 00:46:03.354613 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:03.354613 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:03.354613 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:03.354613 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:03.354613 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:03.354613 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:03.354613 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:03.354613 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:03.354613 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:03.354613 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:03.354613 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:03.354613 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:03.354613 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:03.354613 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:03.354613 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:03.354613 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:03.355555 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 04 00:46:03.355555 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 04 00:46:03.355555 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 00:46:03.355555 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 00:46:03.355555 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 00:46:03.355555 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 00:46:03.355555 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:46:03.355555 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:03.360923 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 368/747] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:46:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:03.362539 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30c8d4-4325-4744-99db-37771cb67895 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:03.362539 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30c8d4-4325-4744-99db-37771cb67895 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:03.362793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30c8d4-4325-4744-99db-37771cb67895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:03.374589 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed8b47-c5bc-4fe3-b89f-806d5904ec00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:03.375256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed8b47-c5bc-4fe3-b89f-806d5904ec00 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:03.375536 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed8b47-c5bc-4fe3-b89f-806d5904ec00 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:03.376432 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed8b47-c5bc-4fe3-b89f-806d5904ec00 None admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:03.376541 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed8b47-c5bc-4fe3-b89f-806d5904ec00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:03.376752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed8b47-c5bc-4fe3-b89f-806d5904ec00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:03.378257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed8b47-c5bc-4fe3-b89f-806d5904ec00 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:03.386310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-ef30c8d4-4325-4744-99db-37771cb67895 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:03.387517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ef30c8d4-4325-4744-99db-37771cb67895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:03.391439 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 380/748] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:03.392410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed8b47-c5bc-4fe3-b89f-806d5904ec00 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:03.406224 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:03.466873 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 369/749] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:03 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 00:46:03.471458 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30c8d4-4325-4744-99db-37771cb67895 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:03.503572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed8b47-c5bc-4fe3-b89f-806d5904ec00 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:03.540809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b684a-ddc4-4237-bad0-37d039414a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:03.541461 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b684a-ddc4-4237-bad0-37d039414a65 None admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:03.541812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b684a-ddc4-4237-bad0-37d039414a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:03.542153 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b684a-ddc4-4237-bad0-37d039414a65 None admin] PATH_INFO: `/v3/services` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:03.542869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b684a-ddc4-4237-bad0-37d039414a65 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:03.544333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b684a-ddc4-4237-bad0-37d039414a65 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:03.570139 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 381/750] 10.222.0.30 () {60 vars in 1141 bytes} [Sun Sep 4 00:46:03 2022] POST /identity/v3/services => generated 240 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:46:03.572742 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b684a-ddc4-4237-bad0-37d039414a65 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:03.626374 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:03.655679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30c8d4-4325-4744-99db-37771cb67895 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:03.709840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b684a-ddc4-4237-bad0-37d039414a65 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:03.734437 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1c5d4-956f-4e83-9caa-3db60ce7b527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:03.735374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1c5d4-956f-4e83-9caa-3db60ce7b527 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:03.735660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1c5d4-956f-4e83-9caa-3db60ce7b527 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:03.735937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1c5d4-956f-4e83-9caa-3db60ce7b527 None admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:03.736716 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1c5d4-956f-4e83-9caa-3db60ce7b527 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:03.737022 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1c5d4-956f-4e83-9caa-3db60ce7b527 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:03.743142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1c5d4-956f-4e83-9caa-3db60ce7b527 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:03.758131 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 370/751] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Sep 4 00:46:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:03.759068 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1c5d4-956f-4e83-9caa-3db60ce7b527 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:03.778355 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:03.871758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d35b32-78f7-4092-ae9b-82fb7dc8ee24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:03.872433 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d35b32-78f7-4092-ae9b-82fb7dc8ee24 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:03.872711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d35b32-78f7-4092-ae9b-82fb7dc8ee24 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:03.872983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d35b32-78f7-4092-ae9b-82fb7dc8ee24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:03.879947 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d35b32-78f7-4092-ae9b-82fb7dc8ee24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:03.881008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1c5d4-956f-4e83-9caa-3db60ce7b527 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:03.881399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d35b32-78f7-4092-ae9b-82fb7dc8ee24 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:03.892929 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-b4d35b32-78f7-4092-ae9b-82fb7dc8ee24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:46:03.892929 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:03.892929 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:03.892929 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:03.892929 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:03.892929 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:03.892929 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:03.892929 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:03.892929 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:03.892929 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:03.892929 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:03.892929 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:03.892929 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 04 00:46:03.892929 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 04 00:46:03.892929 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 04 00:46:03.893905 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 04 00:46:03.893905 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:03.893905 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:03.893905 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:03.893905 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:03.893905 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:03.893905 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:03.893905 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:03.893905 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:03.893905 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:03.893905 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:03.893905 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:03.893905 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:03.893905 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:03.893905 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:03.893905 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:03.893905 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:03.894810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 04 00:46:03.894810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 04 00:46:03.894810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 00:46:03.894810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 00:46:03.894810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 00:46:03.894810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 00:46:03.894810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:46:03.894810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:03.894810 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 382/752] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:46:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:03.895288 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d35b32-78f7-4092-ae9b-82fb7dc8ee24 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:03.928381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a49cf-e5bb-4a5c-895f-3a2290d8dfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:03.930796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a49cf-e5bb-4a5c-895f-3a2290d8dfd0 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:03.931351 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a49cf-e5bb-4a5c-895f-3a2290d8dfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:03.932294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a49cf-e5bb-4a5c-895f-3a2290d8dfd0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:03.944911 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a49cf-e5bb-4a5c-895f-3a2290d8dfd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:46:03.950895 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-845a49cf-e5bb-4a5c-895f-3a2290d8dfd0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:46:03.950895 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:03.950895 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:03.950895 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:03.950895 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:03.950895 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:03.950895 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:03.950895 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:03.950895 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:03.950895 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:03.950895 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:03.950895 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:03.950895 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:46:03.950895 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:46:03.950895 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:46:03.950895 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:46:03.951815 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:46:03.951815 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:46:03.951815 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:46:03.951815 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:46:03.951815 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:03.951815 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:03.951815 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:03.951815 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:03.951815 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:03.951815 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:03.951815 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:03.951815 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:03.951815 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:03.951815 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:03.951815 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:03.951815 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:03.952656 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:03.952656 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:03.952656 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:03.952656 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:03.952656 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:46:03.952656 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:46:03.952656 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:46:03.952656 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:46:03.952656 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:46:03.952656 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:46:03.952656 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:46:03.952656 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:03.955423 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 371/753] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Sep 4 00:46:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:03.956461 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a49cf-e5bb-4a5c-895f-3a2290d8dfd0 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:03.993104 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:03.999791 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d35b32-78f7-4092-ae9b-82fb7dc8ee24 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:04.037069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44331391-3f78-46da-9232-a78ab0f27d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:04.037812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44331391-3f78-46da-9232-a78ab0f27d4e None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:04.038164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44331391-3f78-46da-9232-a78ab0f27d4e None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:04.039069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44331391-3f78-46da-9232-a78ab0f27d4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:04.039888 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44331391-3f78-46da-9232-a78ab0f27d4e None admin] RBAC: Adding query filter params (role.id=d255b03c37d64371a148ec4e11be01d9, scope.project.id=40b24e92f8594ee08bd2a55f79e3b299, user.id=9bcc7a857fad4310896da5a87e71baed) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:04.040266 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44331391-3f78-46da-9232-a78ab0f27d4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:04.041869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44331391-3f78-46da-9232-a78ab0f27d4e None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:04.048681 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 383/754] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:46:03 2022] GET /identity/v3/role_assignments?user.id=9bcc7a857fad4310896da5a87e71baed&scope.project.id=40b24e92f8594ee08bd2a55f79e3b299&role.id=d255b03c37d64371a148ec4e11be01d9 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:04.049748 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44331391-3f78-46da-9232-a78ab0f27d4e None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:04.162065 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:04.213660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a49cf-e5bb-4a5c-895f-3a2290d8dfd0 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:04.242143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44331391-3f78-46da-9232-a78ab0f27d4e None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:04.251232 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06c897-409c-4ff4-be3a-c3f9d044b1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:04.251842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06c897-409c-4ff4-be3a-c3f9d044b1a2 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:04.252240 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06c897-409c-4ff4-be3a-c3f9d044b1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:04.252515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06c897-409c-4ff4-be3a-c3f9d044b1a2 None admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:04.253260 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06c897-409c-4ff4-be3a-c3f9d044b1a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:04.253590 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06c897-409c-4ff4-be3a-c3f9d044b1a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:04.261457 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06c897-409c-4ff4-be3a-c3f9d044b1a2 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:04.268418 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 372/755] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Sep 4 00:46:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:04.278524 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06c897-409c-4ff4-be3a-c3f9d044b1a2 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:04.294619 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae82916-549f-403f-b23b-796290ae0c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:04.295584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae82916-549f-403f-b23b-796290ae0c55 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:04.296071 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae82916-549f-403f-b23b-796290ae0c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:04.296574 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae82916-549f-403f-b23b-796290ae0c55 None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:04.297462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae82916-549f-403f-b23b-796290ae0c55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:04.297982 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae82916-549f-403f-b23b-796290ae0c55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:04.299563 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae82916-549f-403f-b23b-796290ae0c55 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:04.310414 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 384/756] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:46:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:04.321884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae82916-549f-403f-b23b-796290ae0c55 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:04.339025 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:04.450440 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06c897-409c-4ff4-be3a-c3f9d044b1a2 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:04.485638 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:04.488796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d8f59-4ac0-480e-a411-1e448af801e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:04.492487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d8f59-4ac0-480e-a411-1e448af801e5 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:04.492487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d8f59-4ac0-480e-a411-1e448af801e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:04.492487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d8f59-4ac0-480e-a411-1e448af801e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:04.492487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d8f59-4ac0-480e-a411-1e448af801e5 None admin] RBAC: Adding query filter params (role.id=955481bca39c4b0fab953d506ea3c292, scope.project.id=40b24e92f8594ee08bd2a55f79e3b299, user.id=00543899e82647e8ba187b8d0b60d8c9) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:04.492487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d8f59-4ac0-480e-a411-1e448af801e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:04.493690 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d8f59-4ac0-480e-a411-1e448af801e5 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:04.500479 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 373/757] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:46:04 2022] GET /identity/v3/role_assignments?user.id=00543899e82647e8ba187b8d0b60d8c9&scope.project.id=40b24e92f8594ee08bd2a55f79e3b299&role.id=955481bca39c4b0fab953d506ea3c292 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:04.517779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae82916-549f-403f-b23b-796290ae0c55 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:04.592165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf7b0a-ce6a-469d-957e-f2e7f02a9b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:04.592817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf7b0a-ce6a-469d-957e-f2e7f02a9b77 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:04.593097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf7b0a-ce6a-469d-957e-f2e7f02a9b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:04.593368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf7b0a-ce6a-469d-957e-f2e7f02a9b77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:04.607595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf7b0a-ce6a-469d-957e-f2e7f02a9b77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:04.609380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf7b0a-ce6a-469d-957e-f2e7f02a9b77 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:04.631820 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-30cf7b0a-ce6a-469d-957e-f2e7f02a9b77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:04.631820 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:04.631820 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:04.631820 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:04.631820 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:04.631820 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:04.631820 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:04.631820 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:04.631820 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:04.631820 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:04.631820 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:04.631820 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:04.631820 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:46:04.631820 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:46:04.631820 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:46:04.631820 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:46:04.633406 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:04.633406 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:04.633406 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:04.633406 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:04.633406 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:04.633406 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:04.633406 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:04.633406 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:04.633406 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:04.633406 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:04.633406 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:04.633406 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:04.633406 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:04.633406 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:04.633406 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:04.633406 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:04.633406 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:46:04.634319 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:46:04.634319 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:04.634319 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:04.636482 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 385/758] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:46:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:04.642500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d8f59-4ac0-480e-a411-1e448af801e5 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:04.792178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d8f59-4ac0-480e-a411-1e448af801e5 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:04.834656 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32281c2c-429b-4a92-b8c3-9c7c105b1855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:04.835306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32281c2c-429b-4a92-b8c3-9c7c105b1855 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:04.835587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32281c2c-429b-4a92-b8c3-9c7c105b1855 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:04.835859 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32281c2c-429b-4a92-b8c3-9c7c105b1855 None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:04.836507 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32281c2c-429b-4a92-b8c3-9c7c105b1855 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:04.836809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32281c2c-429b-4a92-b8c3-9c7c105b1855 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:04.838197 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32281c2c-429b-4a92-b8c3-9c7c105b1855 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:04.854132 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 374/759] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:04.859913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf7b0a-ce6a-469d-957e-f2e7f02a9b77 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:04.974172 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:05.020183 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf7b0a-ce6a-469d-957e-f2e7f02a9b77 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:05.066169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22879a84-8982-4f1e-bee9-1d7c8b0657fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:05.066718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22879a84-8982-4f1e-bee9-1d7c8b0657fe None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:05.066990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22879a84-8982-4f1e-bee9-1d7c8b0657fe None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:05.067257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22879a84-8982-4f1e-bee9-1d7c8b0657fe None admin] PATH_INFO: `/v3/users/nova` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:05.075391 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22879a84-8982-4f1e-bee9-1d7c8b0657fe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:05.077052 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22879a84-8982-4f1e-bee9-1d7c8b0657fe None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:05.093620 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-22879a84-8982-4f1e-bee9-1d7c8b0657fe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 04 00:46:05.093620 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:05.093620 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:05.093620 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:05.093620 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:05.093620 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:05.093620 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:05.093620 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:05.093620 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:05.093620 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:05.093620 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:05.093620 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:05.093620 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 04 00:46:05.093620 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 04 00:46:05.093620 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 04 00:46:05.093620 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 04 00:46:05.094607 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:05.094607 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:05.094607 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 00:46:05.094607 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:46:05.094607 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 00:46:05.094607 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:46:05.094607 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:05.094607 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:05.094607 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:05.094607 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:05.094607 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:05.094607 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:05.094607 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:05.094607 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:05.094607 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:05.094607 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:05.094607 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:05.094607 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:05.095524 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:05.095524 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:05.095524 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 00:46:05.095524 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 00:46:05.095524 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 00:46:05.095524 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 00:46:05.095524 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 00:46:05.095524 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 00:46:05.095524 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 04 00:46:05.095524 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:05.097695 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 386/760] 10.222.0.30 () {56 vars in 1093 bytes} [Sun Sep 4 00:46:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:05.105294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32281c2c-429b-4a92-b8c3-9c7c105b1855 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:05.213366 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:05.273852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32281c2c-429b-4a92-b8c3-9c7c105b1855 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:05.317505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb483343-0635-4ccd-a132-3b12ed847eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:05.318033 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb483343-0635-4ccd-a132-3b12ed847eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:05.318311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb483343-0635-4ccd-a132-3b12ed847eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:05.318582 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb483343-0635-4ccd-a132-3b12ed847eb9 None admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:05.319315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb483343-0635-4ccd-a132-3b12ed847eb9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:05.319651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb483343-0635-4ccd-a132-3b12ed847eb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:05.321078 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb483343-0635-4ccd-a132-3b12ed847eb9 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:05.343521 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 375/761] 10.222.0.30 () {56 vars in 1133 bytes} [Sun Sep 4 00:46:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:05.348685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22879a84-8982-4f1e-bee9-1d7c8b0657fe None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:05.396382 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cebcc3-29d3-4742-ba1e-310a2b4fe91a None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:05.396693 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cebcc3-29d3-4742-ba1e-310a2b4fe91a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:05.396924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cebcc3-29d3-4742-ba1e-310a2b4fe91a None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:05.399990 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 376/762] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:05.407080 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40988367-6b9c-4ae5-9cd5-c38ad2544e2e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:05.407367 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40988367-6b9c-4ae5-9cd5-c38ad2544e2e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:05.407642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40988367-6b9c-4ae5-9cd5-c38ad2544e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:05.442633 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-40988367-6b9c-4ae5-9cd5-c38ad2544e2e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:05.443850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-40988367-6b9c-4ae5-9cd5-c38ad2544e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:05.539621 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22879a84-8982-4f1e-bee9-1d7c8b0657fe None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:05.584035 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 377/763] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 04 00:46:05.597831 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:05.602741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f949f36-88c1-4b3e-a0ef-42dc8ed7063b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:05.603380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f949f36-88c1-4b3e-a0ef-42dc8ed7063b None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:05.603670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f949f36-88c1-4b3e-a0ef-42dc8ed7063b None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:05.603950 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f949f36-88c1-4b3e-a0ef-42dc8ed7063b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:05.622114 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f949f36-88c1-4b3e-a0ef-42dc8ed7063b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:05.623570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f949f36-88c1-4b3e-a0ef-42dc8ed7063b None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:05.645146 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-6f949f36-88c1-4b3e-a0ef-42dc8ed7063b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:05.645146 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:05.645146 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:05.645146 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:05.645146 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:05.645146 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:05.645146 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:05.645146 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:05.645146 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:05.645146 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:05.645146 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:05.645146 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:05.645146 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:46:05.645146 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:46:05.645146 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:46:05.645146 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:46:05.646136 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:05.646136 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:05.646136 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:05.646136 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:05.646136 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:05.646136 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:05.646136 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:05.646136 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:05.646136 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:05.646136 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:05.646136 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:05.646136 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:05.646136 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:05.646136 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:05.646136 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:05.646136 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:05.646136 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:46:05.647028 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:46:05.647028 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:05.647028 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:05.647028 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 387/764] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:46:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:05.653787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40988367-6b9c-4ae5-9cd5-c38ad2544e2e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:05.716020 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:05.775035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40988367-6b9c-4ae5-9cd5-c38ad2544e2e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:05.809464 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b30ef68-f86d-4805-b8c7-25323c9f789c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:05.810078 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30ef68-f86d-4805-b8c7-25323c9f789c None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:05.810330 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30ef68-f86d-4805-b8c7-25323c9f789c None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:05.810607 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30ef68-f86d-4805-b8c7-25323c9f789c None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:05.811250 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b30ef68-f86d-4805-b8c7-25323c9f789c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:05.811550 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b30ef68-f86d-4805-b8c7-25323c9f789c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:05.812913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b30ef68-f86d-4805-b8c7-25323c9f789c None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:05.825514 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 378/765] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:05.834595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f949f36-88c1-4b3e-a0ef-42dc8ed7063b None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:05.892767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc0c0b-1473-4406-b21e-aa37e3cc0300 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:05.893097 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc0c0b-1473-4406-b21e-aa37e3cc0300 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:05.893317 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc0c0b-1473-4406-b21e-aa37e3cc0300 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:05.894922 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 379/766] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 04 00:46:05.900594 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178a547-58e1-43a5-978c-9d834aa956d0 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:05.900876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178a547-58e1-43a5-978c-9d834aa956d0 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:05.901148 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178a547-58e1-43a5-978c-9d834aa956d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:05.934430 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-f178a547-58e1-43a5-978c-9d834aa956d0 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:05.935615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f178a547-58e1-43a5-978c-9d834aa956d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:05.971044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f949f36-88c1-4b3e-a0ef-42dc8ed7063b None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:06.025508 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5786b-71bc-4ef5-93f0-eadfaac509d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:06.026140 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5786b-71bc-4ef5-93f0-eadfaac509d1 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:06.026415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5786b-71bc-4ef5-93f0-eadfaac509d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:06.026681 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5786b-71bc-4ef5-93f0-eadfaac509d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:06.038031 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5786b-71bc-4ef5-93f0-eadfaac509d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:06.039729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5786b-71bc-4ef5-93f0-eadfaac509d1 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:06.047826 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 380/767] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 04 00:46:06.048671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f178a547-58e1-43a5-978c-9d834aa956d0 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:06.053246 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-14a5786b-71bc-4ef5-93f0-eadfaac509d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:46:06.053246 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:06.053246 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:06.053246 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:06.053246 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:06.053246 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:06.053246 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:06.053246 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:06.053246 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:06.053246 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:06.053246 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:06.053246 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:06.053246 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 04 00:46:06.053246 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 04 00:46:06.053246 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 04 00:46:06.054672 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 04 00:46:06.054672 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:06.054672 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:06.054672 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:06.054672 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:06.054672 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:06.054672 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:06.054672 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:06.054672 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:06.054672 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:06.054672 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:06.054672 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:06.054672 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:06.054672 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:06.054672 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:06.054672 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:06.054672 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:06.055543 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 04 00:46:06.055543 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 04 00:46:06.055543 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 00:46:06.055543 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 00:46:06.055543 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 00:46:06.055543 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 00:46:06.055543 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:46:06.055543 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:06.055543 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 388/768] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:46:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:06.061300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5786b-71bc-4ef5-93f0-eadfaac509d1 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:06.125777 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:06.146496 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:06.205108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5786b-71bc-4ef5-93f0-eadfaac509d1 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:06.229371 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f178a547-58e1-43a5-978c-9d834aa956d0 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:06.241147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986a5e2-70ec-4172-8d91-f560eba17cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:06.242302 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986a5e2-70ec-4172-8d91-f560eba17cb5 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:06.242577 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986a5e2-70ec-4172-8d91-f560eba17cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:06.242844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986a5e2-70ec-4172-8d91-f560eba17cb5 None admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:06.243574 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986a5e2-70ec-4172-8d91-f560eba17cb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:06.243877 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986a5e2-70ec-4172-8d91-f560eba17cb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:06.245424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986a5e2-70ec-4172-8d91-f560eba17cb5 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:06.265199 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 389/769] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Sep 4 00:46:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:06.278434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986a5e2-70ec-4172-8d91-f560eba17cb5 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:06.280704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014f0f6-ee68-47d3-a61d-e1a07b1811d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:06.281347 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014f0f6-ee68-47d3-a61d-e1a07b1811d7 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:06.281926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014f0f6-ee68-47d3-a61d-e1a07b1811d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:06.282199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014f0f6-ee68-47d3-a61d-e1a07b1811d7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:06.282781 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a014f0f6-ee68-47d3-a61d-e1a07b1811d7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:06.284215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a014f0f6-ee68-47d3-a61d-e1a07b1811d7 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:06.294844 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-a014f0f6-ee68-47d3-a61d-e1a07b1811d7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 04 00:46:06.294844 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:06.294844 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 04 00:46:06.294844 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 04 00:46:06.294844 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 04 00:46:06.294844 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 04 00:46:06.294844 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 04 00:46:06.294844 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:06.294844 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 04 00:46:06.294844 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:06.294844 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 00:46:06.294844 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:06.294844 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:06.294844 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:06.294844 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:06.294844 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:06.294844 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:06.296830 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:06.296830 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:06.296830 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:06.296830 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:06.296830 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:06.296830 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:06.296830 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 04 00:46:06.296830 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 04 00:46:06.296830 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 04 00:46:06.296830 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 04 00:46:06.296830 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:06.296830 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:06.296830 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:06.296830 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:06.296830 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:06.296830 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:06.297903 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:06.297903 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:06.297903 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:06.297903 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:06.297903 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:06.297903 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:06.297903 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:06.297903 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:06.297903 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:06.297903 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:06.297903 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 04 00:46:06.297903 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:06.297903 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 04 00:46:06.297903 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:06.297903 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 381/770] 10.222.0.30 () {56 vars in 1129 bytes} [Sun Sep 4 00:46:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:06.301470 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014f0f6-ee68-47d3-a61d-e1a07b1811d7 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:06.407710 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:06.412235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014f0f6-ee68-47d3-a61d-e1a07b1811d7 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:06.456401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8423e-d5c3-4ffd-a615-8c9116e10842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:06.457018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8423e-d5c3-4ffd-a615-8c9116e10842 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:06.457296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8423e-d5c3-4ffd-a615-8c9116e10842 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:06.457595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8423e-d5c3-4ffd-a615-8c9116e10842 None admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:06.458228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8423e-d5c3-4ffd-a615-8c9116e10842 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:06.458525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8423e-d5c3-4ffd-a615-8c9116e10842 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:06.459884 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8423e-d5c3-4ffd-a615-8c9116e10842 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:06.470929 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 382/771] 10.222.0.30 () {56 vars in 1124 bytes} [Sun Sep 4 00:46:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:06.472718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe440fb6-6213-49f8-99ad-49fb825c0d90 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:06.473404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe440fb6-6213-49f8-99ad-49fb825c0d90 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:06.473981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe440fb6-6213-49f8-99ad-49fb825c0d90 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:06.476595 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 383/772] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:06.477510 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe440fb6-6213-49f8-99ad-49fb825c0d90 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:06.496402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986a5e2-70ec-4172-8d91-f560eba17cb5 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:06.498930 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:06.533644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949bfde-13b9-42f4-87be-85efe5a8792d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:06.534399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949bfde-13b9-42f4-87be-85efe5a8792d None admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:06.534672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949bfde-13b9-42f4-87be-85efe5a8792d None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:06.534938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949bfde-13b9-42f4-87be-85efe5a8792d None admin] PATH_INFO: `/v3/projects/40b24e92f8594ee08bd2a55f79e3b299/users/13f0f341bf2c475d82b4e7b34d503dd0/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:06.536880 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949bfde-13b9-42f4-87be-85efe5a8792d None admin] RBAC: Authorizing `identity:create_grant(project_id=40b24e92f8594ee08bd2a55f79e3b299, user_id=13f0f341bf2c475d82b4e7b34d503dd0, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:06.539367 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949bfde-13b9-42f4-87be-85efe5a8792d None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:06.557775 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 390/773] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Sep 4 00:46:06 2022] PUT /identity/v3/projects/40b24e92f8594ee08bd2a55f79e3b299/users/13f0f341bf2c475d82b4e7b34d503dd0/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:46:06.558690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949bfde-13b9-42f4-87be-85efe5a8792d None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:06.589466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe440fb6-6213-49f8-99ad-49fb825c0d90 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:06.640400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a39f2-0fdd-4061-8912-f04a1a75ef00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:06.641214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a39f2-0fdd-4061-8912-f04a1a75ef00 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:06.641649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a39f2-0fdd-4061-8912-f04a1a75ef00 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:06.642505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a39f2-0fdd-4061-8912-f04a1a75ef00 None admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:06.642878 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a39f2-0fdd-4061-8912-f04a1a75ef00 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:06.643280 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a39f2-0fdd-4061-8912-f04a1a75ef00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:06.644842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a39f2-0fdd-4061-8912-f04a1a75ef00 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:06.656088 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 384/774] 10.222.0.30 () {56 vars in 1124 bytes} [Sun Sep 4 00:46:06 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:06.657874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666796e-bf72-4295-9f6c-fbba252600b6 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:06.658165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666796e-bf72-4295-9f6c-fbba252600b6 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:06.658499 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666796e-bf72-4295-9f6c-fbba252600b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:06.680274 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-3666796e-bf72-4295-9f6c-fbba252600b6 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:06.681707 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3666796e-bf72-4295-9f6c-fbba252600b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:06.682376 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949bfde-13b9-42f4-87be-85efe5a8792d None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:06.705832 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:06.722859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250740e0-679a-4098-bf39-0c55e8d9229a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:06.723498 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250740e0-679a-4098-bf39-0c55e8d9229a None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:06.723776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250740e0-679a-4098-bf39-0c55e8d9229a None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:06.724048 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250740e0-679a-4098-bf39-0c55e8d9229a None admin] PATH_INFO: `/v3/services/network` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:06.724635 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250740e0-679a-4098-bf39-0c55e8d9229a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:06.726661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250740e0-679a-4098-bf39-0c55e8d9229a None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:06.739254 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-250740e0-679a-4098-bf39-0c55e8d9229a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 04 00:46:06.739254 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:06.739254 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 04 00:46:06.739254 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 04 00:46:06.739254 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 04 00:46:06.739254 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 04 00:46:06.739254 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 04 00:46:06.739254 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:06.739254 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 04 00:46:06.739254 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:06.739254 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 00:46:06.739254 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:06.739254 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:06.739254 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:06.739254 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:06.739254 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:06.739254 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:06.740253 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:06.740253 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:06.740253 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:06.740253 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:06.740253 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:06.740253 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:06.740253 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 04 00:46:06.740253 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 04 00:46:06.740253 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 04 00:46:06.740253 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 04 00:46:06.740253 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:06.740253 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:06.740253 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:06.740253 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:06.740253 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:06.740253 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:06.741568 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:06.741568 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:06.741568 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:06.741568 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:06.741568 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:06.741568 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:06.741568 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:06.741568 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:06.741568 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:06.741568 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:06.741568 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 04 00:46:06.741568 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:06.741568 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 04 00:46:06.741568 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:06.741568 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 391/775] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:46:06 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:06.742351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250740e0-679a-4098-bf39-0c55e8d9229a None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:06.780593 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 385/776] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:46:06.781867 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666796e-bf72-4295-9f6c-fbba252600b6 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:06.790741 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:06.897217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250740e0-679a-4098-bf39-0c55e8d9229a None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:06.925449 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666796e-bf72-4295-9f6c-fbba252600b6 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:06.936349 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb1641-17c9-4e3c-9f67-62739ab2785b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:06.936750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb1641-17c9-4e3c-9f67-62739ab2785b None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:06.937036 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb1641-17c9-4e3c-9f67-62739ab2785b None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:06.937308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb1641-17c9-4e3c-9f67-62739ab2785b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:06.938054 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb1641-17c9-4e3c-9f67-62739ab2785b None admin] RBAC: Adding query filter params (interface=public, service_id=d1db3f3a5bfc4450b06eefe25c85f756, region_id=RegionOne) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:06.938360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb1641-17c9-4e3c-9f67-62739ab2785b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:06.939809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb1641-17c9-4e3c-9f67-62739ab2785b None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:06.947918 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 392/777] 10.222.0.30 () {56 vars in 1251 bytes} [Sun Sep 4 00:46:06 2022] GET /identity/v3/endpoints?service_id=d1db3f3a5bfc4450b06eefe25c85f756&interface=public®ion_id=RegionOne => generated 194 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:06.949254 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6135b3-7416-4426-b78e-a6110f2bfe89 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:06.949565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6135b3-7416-4426-b78e-a6110f2bfe89 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:06.949837 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6135b3-7416-4426-b78e-a6110f2bfe89 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:06.951437 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 393/778] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:06.952719 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6135b3-7416-4426-b78e-a6110f2bfe89 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:06.972749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75a748-7274-4877-b2c8-faf84b0b77ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:06.973917 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75a748-7274-4877-b2c8-faf84b0b77ea None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:06.974348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75a748-7274-4877-b2c8-faf84b0b77ea None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:06.974791 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75a748-7274-4877-b2c8-faf84b0b77ea None admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:06.975578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75a748-7274-4877-b2c8-faf84b0b77ea None admin] RBAC: Adding query filter params (name=network) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:06.976575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75a748-7274-4877-b2c8-faf84b0b77ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:06.978559 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75a748-7274-4877-b2c8-faf84b0b77ea None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:06.985677 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 386/779] 10.222.0.30 () {56 vars in 1112 bytes} [Sun Sep 4 00:46:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:06.987248 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae8f40-e579-4842-af33-d37cdcd49395 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:06.987676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae8f40-e579-4842-af33-d37cdcd49395 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:06.988380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae8f40-e579-4842-af33-d37cdcd49395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:07.009977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-15ae8f40-e579-4842-af33-d37cdcd49395 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:07.011979 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-15ae8f40-e579-4842-af33-d37cdcd49395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:07.028542 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:07.068334 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:07.079365 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6135b3-7416-4426-b78e-a6110f2bfe89 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:07.097498 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 387/780] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:46:07.097498 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae8f40-e579-4842-af33-d37cdcd49395 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:07.129554 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb8275-d661-4192-bccf-844bd9d8bc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:07.130261 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb8275-d661-4192-bccf-844bd9d8bc1e None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:07.130591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb8275-d661-4192-bccf-844bd9d8bc1e None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:07.130928 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb8275-d661-4192-bccf-844bd9d8bc1e None admin] PATH_INFO: `/v3/services` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:07.131886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb8275-d661-4192-bccf-844bd9d8bc1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:07.133973 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb8275-d661-4192-bccf-844bd9d8bc1e None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:07.145909 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 394/781] 10.222.0.30 () {56 vars in 1087 bytes} [Sun Sep 4 00:46:06 2022] GET /identity/v3/services => generated 772 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:07.147059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb8275-d661-4192-bccf-844bd9d8bc1e None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:07.223046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae8f40-e579-4842-af33-d37cdcd49395 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:07.265671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10e750-dd6f-4062-b670-a54eab53be04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:07.266583 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10e750-dd6f-4062-b670-a54eab53be04 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:07.266936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10e750-dd6f-4062-b670-a54eab53be04 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:07.267323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10e750-dd6f-4062-b670-a54eab53be04 None admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:07.268317 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10e750-dd6f-4062-b670-a54eab53be04 None admin] RBAC: Adding query filter params (type=network) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:07.268696 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10e750-dd6f-4062-b670-a54eab53be04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:07.270774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10e750-dd6f-4062-b670-a54eab53be04 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:07.277838 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 388/782] 10.222.0.30 () {56 vars in 1112 bytes} [Sun Sep 4 00:46:07 2022] GET /identity/v3/services?type=network => generated 350 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:07.287624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10e750-dd6f-4062-b670-a54eab53be04 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:07.322769 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:07.371624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb8275-d661-4192-bccf-844bd9d8bc1e None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:07.416883 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9534418-bca9-473d-80e7-1c485adcb50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:07.417674 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9534418-bca9-473d-80e7-1c485adcb50b None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:07.417977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9534418-bca9-473d-80e7-1c485adcb50b None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:07.418254 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9534418-bca9-473d-80e7-1c485adcb50b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:07.427886 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10e750-dd6f-4062-b670-a54eab53be04 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:07.430846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9534418-bca9-473d-80e7-1c485adcb50b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:46:07.435703 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-d9534418-bca9-473d-80e7-1c485adcb50b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:46:07.435703 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:07.435703 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:07.435703 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:07.435703 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:07.435703 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:07.435703 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:07.435703 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:07.435703 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:07.435703 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:07.435703 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:07.435703 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:07.435703 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:46:07.435703 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:46:07.435703 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:46:07.435703 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:46:07.436617 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:46:07.436617 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:46:07.436617 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:46:07.436617 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:46:07.436617 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:07.436617 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:07.436617 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:07.436617 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:07.436617 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:07.436617 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:07.436617 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:07.436617 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:07.436617 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:07.436617 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:07.436617 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:07.436617 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:07.437480 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:07.437480 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:07.437480 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:07.437480 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:07.437480 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:46:07.437480 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:46:07.437480 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:46:07.437480 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:46:07.437480 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:46:07.437480 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:46:07.437480 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:46:07.437480 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:07.437480 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 395/783] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Sep 4 00:46:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:07.438593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9534418-bca9-473d-80e7-1c485adcb50b None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:07.466115 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:07.480224 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46419490-fdbf-4046-97b0-2a83524485fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:07.481386 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46419490-fdbf-4046-97b0-2a83524485fd None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:07.482128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46419490-fdbf-4046-97b0-2a83524485fd None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:07.482596 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46419490-fdbf-4046-97b0-2a83524485fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:07.484145 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46419490-fdbf-4046-97b0-2a83524485fd None admin] RBAC: Adding query filter params (interface=public, service_id=ca520afc8d254868bce49b6eb49e89a3, region_id=RegionOne) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:07.484668 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46419490-fdbf-4046-97b0-2a83524485fd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:07.486765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46419490-fdbf-4046-97b0-2a83524485fd None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:07.498038 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 389/784] 10.222.0.30 () {56 vars in 1251 bytes} [Sun Sep 4 00:46:07 2022] GET /identity/v3/endpoints?service_id=ca520afc8d254868bce49b6eb49e89a3&interface=public®ion_id=RegionOne => generated 194 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:07.499346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46419490-fdbf-4046-97b0-2a83524485fd None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:07.581588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9534418-bca9-473d-80e7-1c485adcb50b None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:07.601661 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:07.626256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079c7a4-6f07-449a-ad77-427676f44cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:07.627370 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079c7a4-6f07-449a-ad77-427676f44cbc None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:07.628087 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079c7a4-6f07-449a-ad77-427676f44cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:07.628556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079c7a4-6f07-449a-ad77-427676f44cbc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:07.641668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079c7a4-6f07-449a-ad77-427676f44cbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:46:07.647692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-4079c7a4-6f07-449a-ad77-427676f44cbc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:46:07.647692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:07.647692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:07.647692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:07.647692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:07.647692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:07.647692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:07.647692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:07.647692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:07.647692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:07.647692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:07.647692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:07.647692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:46:07.647692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:46:07.647692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:46:07.647692 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:46:07.648595 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:46:07.648595 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:46:07.648595 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:46:07.648595 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:46:07.648595 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:07.648595 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:07.648595 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:07.648595 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:07.648595 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:07.648595 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:07.648595 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:07.648595 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:07.648595 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:07.648595 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:07.648595 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:07.648595 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:07.649479 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:07.649479 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:07.649479 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:07.649479 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:07.649479 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:46:07.649479 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:46:07.649479 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:46:07.649479 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:46:07.649479 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:46:07.649479 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:46:07.649479 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:46:07.649479 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:07.652279 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 396/785] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Sep 4 00:46:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:07.652879 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46419490-fdbf-4046-97b0-2a83524485fd None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:07.653581 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079c7a4-6f07-449a-ad77-427676f44cbc None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:07.709706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a66a5-c963-45d6-827d-c6b72da847d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:07.710406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a66a5-c963-45d6-827d-c6b72da847d9 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:07.710686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a66a5-c963-45d6-827d-c6b72da847d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:07.710958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a66a5-c963-45d6-827d-c6b72da847d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:07.711750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a66a5-c963-45d6-827d-c6b72da847d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:07.711964 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a66a5-c963-45d6-827d-c6b72da847d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:07.713469 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a66a5-c963-45d6-827d-c6b72da847d9 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:07.724659 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 390/786] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:46:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:07.726015 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a66a5-c963-45d6-827d-c6b72da847d9 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:07.753002 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:07.781600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079c7a4-6f07-449a-ad77-427676f44cbc None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:07.817903 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d82c2-a9d4-4722-b057-9e8c0a2a18b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:07.818627 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d82c2-a9d4-4722-b057-9e8c0a2a18b8 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:07.818971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d82c2-a9d4-4722-b057-9e8c0a2a18b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:07.819307 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d82c2-a9d4-4722-b057-9e8c0a2a18b8 None admin] PATH_INFO: `/v3/services` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:07.820604 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d82c2-a9d4-4722-b057-9e8c0a2a18b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:07.823336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d82c2-a9d4-4722-b057-9e8c0a2a18b8 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:07.833916 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 397/787] 10.222.0.30 () {56 vars in 1087 bytes} [Sun Sep 4 00:46:07 2022] GET /identity/v3/services => generated 772 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:07.835009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d82c2-a9d4-4722-b057-9e8c0a2a18b8 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:07.926832 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a66a5-c963-45d6-827d-c6b72da847d9 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:08.024899 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19354a8c-fd64-42ab-836c-d1a2d08bda53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:08.027435 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19354a8c-fd64-42ab-836c-d1a2d08bda53 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:08.032209 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19354a8c-fd64-42ab-836c-d1a2d08bda53 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:08.032769 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19354a8c-fd64-42ab-836c-d1a2d08bda53 None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:08.033728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19354a8c-fd64-42ab-836c-d1a2d08bda53 None admin] RBAC: Adding query filter params (name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:08.035163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19354a8c-fd64-42ab-836c-d1a2d08bda53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:08.038053 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19354a8c-fd64-42ab-836c-d1a2d08bda53 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:08.048627 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 391/788] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Sep 4 00:46:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:08.055511 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19354a8c-fd64-42ab-836c-d1a2d08bda53 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:08.062290 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:08.090054 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d82c2-a9d4-4722-b057-9e8c0a2a18b8 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:08.171220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983856d-acab-43f9-bbb7-ffcf95eb5358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:08.171855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983856d-acab-43f9-bbb7-ffcf95eb5358 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:08.172140 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983856d-acab-43f9-bbb7-ffcf95eb5358 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:08.172415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983856d-acab-43f9-bbb7-ffcf95eb5358 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:08.191363 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:08.195938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983856d-acab-43f9-bbb7-ffcf95eb5358 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:08.197605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983856d-acab-43f9-bbb7-ffcf95eb5358 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:08.221532 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19354a8c-fd64-42ab-836c-d1a2d08bda53 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:08.227658 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-f983856d-acab-43f9-bbb7-ffcf95eb5358 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:08.227658 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:08.227658 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:08.227658 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:08.227658 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:08.227658 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:08.227658 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:08.227658 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:08.227658 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:08.227658 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:08.227658 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:08.227658 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:08.227658 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:46:08.227658 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:46:08.227658 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:46:08.227658 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:46:08.228582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:08.228582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:08.228582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:08.228582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:08.228582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:08.228582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:08.228582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:08.228582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:08.228582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:08.228582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:08.228582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:08.228582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:08.228582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:08.228582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:08.228582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:08.228582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:08.228582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:46:08.230137 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:46:08.230137 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:08.230137 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:08.230137 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 398/789] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:46:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:08.245920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983856d-acab-43f9-bbb7-ffcf95eb5358 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:08.266115 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748fa8e-4c61-498e-844d-0b043429042b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:08.267158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748fa8e-4c61-498e-844d-0b043429042b None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:08.267669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748fa8e-4c61-498e-844d-0b043429042b None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:08.268136 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748fa8e-4c61-498e-844d-0b043429042b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:08.280998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748fa8e-4c61-498e-844d-0b043429042b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:08.282795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748fa8e-4c61-498e-844d-0b043429042b None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:08.302444 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-a748fa8e-4c61-498e-844d-0b043429042b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:08.302444 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:08.302444 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:08.302444 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:08.302444 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:08.302444 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:08.302444 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:08.302444 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:08.302444 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:08.302444 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:08.302444 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:08.302444 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:08.302444 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:46:08.302444 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:46:08.302444 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:46:08.302444 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:46:08.303432 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:08.303432 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:08.303432 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:08.303432 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:08.303432 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:08.303432 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:08.303432 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:08.303432 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:08.303432 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:08.303432 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:08.303432 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:08.303432 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:08.303432 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:08.303432 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:08.303432 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:08.303432 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:08.303432 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:46:08.304383 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:46:08.304383 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:08.304383 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:08.306790 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 392/790] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:46:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:08.319112 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748fa8e-4c61-498e-844d-0b043429042b None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:08.377648 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:08.426878 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748fa8e-4c61-498e-844d-0b043429042b None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:08.464764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce23a3-d9f7-4398-8f81-09aea24d7b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:08.465505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce23a3-d9f7-4398-8f81-09aea24d7b14 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:08.465907 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce23a3-d9f7-4398-8f81-09aea24d7b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:08.466277 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce23a3-d9f7-4398-8f81-09aea24d7b14 None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:08.467228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce23a3-d9f7-4398-8f81-09aea24d7b14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:08.467334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983856d-acab-43f9-bbb7-ffcf95eb5358 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:08.467698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce23a3-d9f7-4398-8f81-09aea24d7b14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:08.469159 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce23a3-d9f7-4398-8f81-09aea24d7b14 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:08.482767 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 393/791] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:08.492296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce23a3-d9f7-4398-8f81-09aea24d7b14 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:08.512282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447264f2-9393-4f4c-be9c-405579a4ae93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:08.513245 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447264f2-9393-4f4c-be9c-405579a4ae93 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:08.513756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447264f2-9393-4f4c-be9c-405579a4ae93 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:08.514254 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447264f2-9393-4f4c-be9c-405579a4ae93 None admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:08.515103 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447264f2-9393-4f4c-be9c-405579a4ae93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:08.515615 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447264f2-9393-4f4c-be9c-405579a4ae93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:08.517180 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447264f2-9393-4f4c-be9c-405579a4ae93 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:08.530817 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 399/792] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:08.535771 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447264f2-9393-4f4c-be9c-405579a4ae93 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:08.607505 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:08.649007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce23a3-d9f7-4398-8f81-09aea24d7b14 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:08.665650 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:08.688507 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf09f7-bfcc-4cd3-a876-2b4bba02c332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:08.689521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf09f7-bfcc-4cd3-a876-2b4bba02c332 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:08.690076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf09f7-bfcc-4cd3-a876-2b4bba02c332 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:08.690545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf09f7-bfcc-4cd3-a876-2b4bba02c332 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:08.698864 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daf09f7-bfcc-4cd3-a876-2b4bba02c332 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:08.700626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daf09f7-bfcc-4cd3-a876-2b4bba02c332 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:08.712666 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447264f2-9393-4f4c-be9c-405579a4ae93 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:08.716894 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-5daf09f7-bfcc-4cd3-a876-2b4bba02c332 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 04 00:46:08.716894 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:08.716894 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:08.716894 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:08.716894 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:08.716894 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:08.716894 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:08.716894 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:08.716894 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:08.716894 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:08.716894 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:08.716894 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:08.716894 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 04 00:46:08.716894 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 04 00:46:08.716894 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 04 00:46:08.716894 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 04 00:46:08.717834 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:08.717834 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:08.717834 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 00:46:08.717834 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:46:08.717834 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 00:46:08.717834 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:46:08.717834 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:08.717834 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:08.717834 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:08.717834 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:08.717834 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:08.717834 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:08.717834 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:08.717834 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:08.717834 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:08.717834 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:08.717834 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:08.717834 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:08.718771 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:08.718771 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:08.718771 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 00:46:08.718771 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 00:46:08.718771 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 00:46:08.718771 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 00:46:08.718771 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 00:46:08.718771 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 00:46:08.718771 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 04 00:46:08.718771 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:08.726085 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 394/793] 10.222.0.30 () {56 vars in 1117 bytes} [Sun Sep 4 00:46:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:08.728294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959ca2f-022a-457e-8028-a3292b5bc9d7 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:08.729277 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959ca2f-022a-457e-8028-a3292b5bc9d7 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:08.729725 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959ca2f-022a-457e-8028-a3292b5bc9d7 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:08.732497 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 395/794] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:08.733350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959ca2f-022a-457e-8028-a3292b5bc9d7 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:08.768856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c17162-ae4c-41a0-bf0f-e106d3fb4994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:08.769851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c17162-ae4c-41a0-bf0f-e106d3fb4994 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:08.770383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c17162-ae4c-41a0-bf0f-e106d3fb4994 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:08.770871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c17162-ae4c-41a0-bf0f-e106d3fb4994 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:08.779161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c17162-ae4c-41a0-bf0f-e106d3fb4994 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:08.780902 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c17162-ae4c-41a0-bf0f-e106d3fb4994 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:08.793743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-64c17162-ae4c-41a0-bf0f-e106d3fb4994 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 04 00:46:08.793743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:08.793743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:08.793743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:08.793743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:08.793743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:08.793743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:08.793743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:08.793743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:08.793743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:08.793743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:08.793743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:08.793743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 04 00:46:08.793743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 04 00:46:08.793743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 04 00:46:08.793743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 04 00:46:08.794660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:08.794660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:08.794660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 00:46:08.794660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:46:08.794660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 00:46:08.794660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:46:08.794660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:08.794660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:08.794660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:08.794660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:08.794660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:08.794660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:08.794660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:08.794660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:08.794660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:08.794660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:08.794660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:08.794660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:08.795589 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:08.795589 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:08.795589 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 00:46:08.795589 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 00:46:08.795589 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 00:46:08.795589 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 00:46:08.795589 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 00:46:08.795589 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 00:46:08.795589 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 04 00:46:08.795589 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:08.798210 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 400/795] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Sep 4 00:46:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:08.799704 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3a28e-f5d6-484a-a340-21727c731878 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:08.800184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3a28e-f5d6-484a-a340-21727c731878 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:08.800667 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3a28e-f5d6-484a-a340-21727c731878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:08.820593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-5bc3a28e-f5d6-484a-a340-21727c731878 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:08.822120 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5bc3a28e-f5d6-484a-a340-21727c731878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:08.842972 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959ca2f-022a-457e-8028-a3292b5bc9d7 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:08.877688 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb33d08-9110-411d-9a16-213400bcb648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:08.878291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb33d08-9110-411d-9a16-213400bcb648 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:08.878575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb33d08-9110-411d-9a16-213400bcb648 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:08.878845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb33d08-9110-411d-9a16-213400bcb648 None admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:08.879630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb33d08-9110-411d-9a16-213400bcb648 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:08.879932 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb33d08-9110-411d-9a16-213400bcb648 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:08.881402 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb33d08-9110-411d-9a16-213400bcb648 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:08.898529 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 401/796] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:46:08.899686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3a28e-f5d6-484a-a340-21727c731878 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:08.912153 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 396/797] 10.222.0.30 () {56 vars in 1149 bytes} [Sun Sep 4 00:46:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:08.913295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb33d08-9110-411d-9a16-213400bcb648 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:08.951785 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:08.964645 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:09.018520 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3a28e-f5d6-484a-a340-21727c731878 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:09.059998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e978ff-31da-4c9f-bcca-85c1f72a21a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:09.062059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e978ff-31da-4c9f-bcca-85c1f72a21a3 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:09.062609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e978ff-31da-4c9f-bcca-85c1f72a21a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:09.063236 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e978ff-31da-4c9f-bcca-85c1f72a21a3 None admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:09.064844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e978ff-31da-4c9f-bcca-85c1f72a21a3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:09.065588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e978ff-31da-4c9f-bcca-85c1f72a21a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:09.070367 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e978ff-31da-4c9f-bcca-85c1f72a21a3 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:09.096208 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb33d08-9110-411d-9a16-213400bcb648 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:09.107854 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 402/798] 10.222.0.30 () {56 vars in 1135 bytes} [Sun Sep 4 00:46:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:09.115705 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e978ff-31da-4c9f-bcca-85c1f72a21a3 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:09.151546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fee106-a259-478b-851d-283363b893d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:09.152196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fee106-a259-478b-851d-283363b893d2 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:09.152477 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fee106-a259-478b-851d-283363b893d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:09.152753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fee106-a259-478b-851d-283363b893d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:09.174342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fee106-a259-478b-851d-283363b893d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:09.175821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fee106-a259-478b-851d-283363b893d2 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:09.204099 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-79fee106-a259-478b-851d-283363b893d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:09.204099 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:09.204099 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:09.204099 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:09.204099 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:09.204099 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:09.204099 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:09.204099 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:09.204099 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:09.204099 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:09.204099 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:09.204099 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:09.204099 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:46:09.204099 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:46:09.204099 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:46:09.204099 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:46:09.205182 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:09.205182 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:09.205182 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:09.205182 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:09.205182 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:09.205182 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:09.205182 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:09.205182 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:09.205182 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:09.205182 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:09.205182 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:09.205182 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:09.205182 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:09.205182 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:09.205182 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:09.205182 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:09.205182 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:46:09.211158 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:46:09.211158 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:09.211158 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:09.211158 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 397/799] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:46:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:09.213462 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fee106-a259-478b-851d-283363b893d2 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:09.263860 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:09.268121 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e978ff-31da-4c9f-bcca-85c1f72a21a3 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:09.315473 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877441a3-ba4d-4be0-b585-76c94aafdd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:09.316029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877441a3-ba4d-4be0-b585-76c94aafdd53 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:09.316309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877441a3-ba4d-4be0-b585-76c94aafdd53 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:09.316584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877441a3-ba4d-4be0-b585-76c94aafdd53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:09.328363 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:09.331799 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877441a3-ba4d-4be0-b585-76c94aafdd53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:09.333825 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877441a3-ba4d-4be0-b585-76c94aafdd53 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:09.346327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fee106-a259-478b-851d-283363b893d2 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:09.354269 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-877441a3-ba4d-4be0-b585-76c94aafdd53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:09.354269 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:09.354269 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:09.354269 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:09.354269 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:09.354269 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:09.354269 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:09.354269 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:09.354269 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:09.354269 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:09.354269 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:09.354269 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:09.354269 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:46:09.354269 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:46:09.354269 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:46:09.354269 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:46:09.355287 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:09.355287 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:09.355287 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:09.355287 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:09.355287 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:09.355287 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:09.355287 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:09.355287 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:09.355287 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:09.355287 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:09.355287 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:09.355287 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:09.355287 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:09.355287 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:09.355287 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:09.355287 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:09.355287 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:46:09.356159 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:46:09.356159 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:09.356159 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:09.356159 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 403/800] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:46:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:09.356676 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877441a3-ba4d-4be0-b585-76c94aafdd53 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:09.398095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c742c1-ee7c-4901-bffd-d0939577f781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:09.398708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c742c1-ee7c-4901-bffd-d0939577f781 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:09.401779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c742c1-ee7c-4901-bffd-d0939577f781 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:09.402390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c742c1-ee7c-4901-bffd-d0939577f781 None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:09.403240 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c742c1-ee7c-4901-bffd-d0939577f781 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:09.404167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c742c1-ee7c-4901-bffd-d0939577f781 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:09.405758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c742c1-ee7c-4901-bffd-d0939577f781 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:09.422342 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 398/801] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:09.423520 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c742c1-ee7c-4901-bffd-d0939577f781 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:09.474229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877441a3-ba4d-4be0-b585-76c94aafdd53 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:09.511814 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbdf87-3273-4e4e-bfad-cba2e12bc182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:09.512435 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbdf87-3273-4e4e-bfad-cba2e12bc182 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:09.512771 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbdf87-3273-4e4e-bfad-cba2e12bc182 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:09.512986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbdf87-3273-4e4e-bfad-cba2e12bc182 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:09.524194 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fbdf87-3273-4e4e-bfad-cba2e12bc182 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:46:09.529378 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-a8fbdf87-3273-4e4e-bfad-cba2e12bc182 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:46:09.529378 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:09.529378 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:09.529378 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:09.529378 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:09.529378 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:09.529378 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:09.529378 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:09.529378 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:09.529378 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:09.529378 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:09.529378 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:09.529378 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:46:09.529378 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:46:09.529378 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:46:09.529378 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:46:09.530324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:46:09.530324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:46:09.530324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:46:09.530324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:46:09.530324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:09.530324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:09.530324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:09.530324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:09.530324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:09.530324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:09.530324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:09.530324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:09.530324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:09.530324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:09.530324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:09.530324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:09.531157 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:09.531157 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:09.531157 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:09.531157 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:09.531157 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:46:09.531157 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:46:09.531157 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:46:09.531157 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:46:09.531157 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:46:09.531157 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:46:09.531157 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:46:09.531157 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:09.531157 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 404/802] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Sep 4 00:46:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:09.531877 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbdf87-3273-4e4e-bfad-cba2e12bc182 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:09.547793 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:09.556820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c742c1-ee7c-4901-bffd-d0939577f781 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:09.593215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a235f8-8086-4033-89cd-df3176a520c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:09.593911 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a235f8-8086-4033-89cd-df3176a520c6 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:09.594198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a235f8-8086-4033-89cd-df3176a520c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:09.594473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a235f8-8086-4033-89cd-df3176a520c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:09.595116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a235f8-8086-4033-89cd-df3176a520c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:09.595411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a235f8-8086-4033-89cd-df3176a520c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:09.596789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a235f8-8086-4033-89cd-df3176a520c6 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:09.608375 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 399/803] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:09.610166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96a8eb-bc8f-434e-9139-6e8c27be3b4c None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:09.610548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96a8eb-bc8f-434e-9139-6e8c27be3b4c None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:09.610896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96a8eb-bc8f-434e-9139-6e8c27be3b4c None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:09.612317 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 400/804] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:09.617081 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96a8eb-bc8f-434e-9139-6e8c27be3b4c None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:09.621579 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:09.648450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbdf87-3273-4e4e-bfad-cba2e12bc182 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:09.684123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cce42c-680e-4f67-9037-2fd25450c32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:09.684964 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cce42c-680e-4f67-9037-2fd25450c32e None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:09.685456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cce42c-680e-4f67-9037-2fd25450c32e None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:09.685878 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cce42c-680e-4f67-9037-2fd25450c32e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:09.693021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cce42c-680e-4f67-9037-2fd25450c32e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:09.695295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cce42c-680e-4f67-9037-2fd25450c32e None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:09.707158 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-31cce42c-680e-4f67-9037-2fd25450c32e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:46:09.707158 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:09.707158 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:09.707158 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:09.707158 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:09.707158 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:09.707158 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:09.707158 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:09.707158 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:09.707158 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:09.707158 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:09.707158 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:09.707158 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 04 00:46:09.707158 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 04 00:46:09.707158 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 04 00:46:09.708245 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 04 00:46:09.708245 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:09.708245 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:09.708245 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:09.708245 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:09.708245 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:09.708245 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:09.708245 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:09.708245 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:09.708245 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:09.708245 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:09.708245 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:09.708245 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:09.708245 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:09.708245 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:09.708245 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:09.708245 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:09.709348 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 04 00:46:09.709348 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 04 00:46:09.709348 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 00:46:09.709348 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 00:46:09.709348 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 00:46:09.709348 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 00:46:09.709348 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:46:09.709348 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:09.715414 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 405/805] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:46:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:09.715414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cce42c-680e-4f67-9037-2fd25450c32e None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:09.724631 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96a8eb-bc8f-434e-9139-6e8c27be3b4c None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:09.761762 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab9a46-2f00-4033-882d-1f6987565588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:09.762369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab9a46-2f00-4033-882d-1f6987565588 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:09.762649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab9a46-2f00-4033-882d-1f6987565588 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:09.762919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab9a46-2f00-4033-882d-1f6987565588 None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:09.763570 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab9a46-2f00-4033-882d-1f6987565588 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:09.763871 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab9a46-2f00-4033-882d-1f6987565588 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:09.765245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab9a46-2f00-4033-882d-1f6987565588 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:09.774560 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 401/806] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:46:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:09.775566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d3fb7-acd8-4d13-8e50-b61a354199de None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:09.775867 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d3fb7-acd8-4d13-8e50-b61a354199de None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:09.776125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d3fb7-acd8-4d13-8e50-b61a354199de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:09.793271 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:09.794466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-4a4d3fb7-acd8-4d13-8e50-b61a354199de None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:09.795734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4a4d3fb7-acd8-4d13-8e50-b61a354199de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:09.826783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cce42c-680e-4f67-9037-2fd25450c32e None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:09.861284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3818347-4d3a-4b9a-92da-e46d92b16af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:09.861876 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3818347-4d3a-4b9a-92da-e46d92b16af3 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:09.862155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3818347-4d3a-4b9a-92da-e46d92b16af3 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:09.862421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3818347-4d3a-4b9a-92da-e46d92b16af3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:09.863778 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:09.870075 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3818347-4d3a-4b9a-92da-e46d92b16af3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:09.871609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3818347-4d3a-4b9a-92da-e46d92b16af3 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:09.872725 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 402/807] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:46:09.881176 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d3fb7-acd8-4d13-8e50-b61a354199de None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:09.883761 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-e3818347-4d3a-4b9a-92da-e46d92b16af3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:46:09.883761 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:09.883761 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:09.883761 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:09.883761 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:09.883761 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:09.883761 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:09.883761 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:09.883761 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:09.883761 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:09.883761 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:09.883761 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:09.883761 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 04 00:46:09.883761 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 04 00:46:09.883761 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 04 00:46:09.884678 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 04 00:46:09.884678 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:09.884678 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:09.884678 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:09.884678 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:09.884678 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:09.884678 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:09.884678 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:09.884678 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:09.884678 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:09.884678 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:09.884678 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:09.884678 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:09.884678 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:09.884678 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:09.884678 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:09.884678 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:09.885610 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 04 00:46:09.885610 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 04 00:46:09.885610 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 00:46:09.885610 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 00:46:09.885610 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 00:46:09.885610 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 00:46:09.885610 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:46:09.885610 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:09.889629 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 406/808] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:46:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:09.890473 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3818347-4d3a-4b9a-92da-e46d92b16af3 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:10.006149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3818347-4d3a-4b9a-92da-e46d92b16af3 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:10.022236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d3fb7-acd8-4d13-8e50-b61a354199de None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:10.043576 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:10.050981 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f53a0d-e710-4687-872a-de6b0fc4e841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:10.051943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f53a0d-e710-4687-872a-de6b0fc4e841 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:10.052539 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f53a0d-e710-4687-872a-de6b0fc4e841 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:10.052911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f53a0d-e710-4687-872a-de6b0fc4e841 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:10.065154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f53a0d-e710-4687-872a-de6b0fc4e841 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:10.066786 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f53a0d-e710-4687-872a-de6b0fc4e841 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:10.068523 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504427c0-16d7-41ba-be36-c144b9add827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:10.070494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504427c0-16d7-41ba-be36-c144b9add827 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:10.070924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504427c0-16d7-41ba-be36-c144b9add827 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:10.071334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504427c0-16d7-41ba-be36-c144b9add827 None admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:10.072265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504427c0-16d7-41ba-be36-c144b9add827 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:10.072720 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504427c0-16d7-41ba-be36-c144b9add827 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:10.074314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504427c0-16d7-41ba-be36-c144b9add827 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:10.083516 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-31f53a0d-e710-4687-872a-de6b0fc4e841 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:10.083516 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:10.083516 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:10.083516 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:10.083516 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:10.083516 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:10.083516 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:10.083516 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:10.083516 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:10.083516 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:10.083516 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:10.083516 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:10.083516 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:46:10.083516 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:46:10.083516 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:46:10.083516 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:46:10.084636 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:10.084636 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:10.084636 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:10.084636 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:10.084636 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:10.084636 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:10.084636 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:10.084636 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:10.084636 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:10.084636 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:10.084636 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:10.084636 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:10.084636 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:10.084636 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:10.084636 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:10.084636 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:10.084636 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:46:10.085769 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:46:10.085769 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:10.085769 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:10.091828 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 407/809] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:46:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:10.091828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f53a0d-e710-4687-872a-de6b0fc4e841 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:10.096959 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 403/810] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Sep 4 00:46:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:10.098046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504427c0-16d7-41ba-be36-c144b9add827 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:10.169260 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:10.204096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f53a0d-e710-4687-872a-de6b0fc4e841 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:10.215297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504427c0-16d7-41ba-be36-c144b9add827 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:10.237793 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904677bc-0089-4488-acd2-c5a43d2fae7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:10.238397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904677bc-0089-4488-acd2-c5a43d2fae7a None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:10.238677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904677bc-0089-4488-acd2-c5a43d2fae7a None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:10.238949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904677bc-0089-4488-acd2-c5a43d2fae7a None admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:10.239634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904677bc-0089-4488-acd2-c5a43d2fae7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:10.239939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904677bc-0089-4488-acd2-c5a43d2fae7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:10.241955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904677bc-0089-4488-acd2-c5a43d2fae7a None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:10.248854 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc82284-0de5-47c3-b9ae-1dca2c12f992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:10.249457 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc82284-0de5-47c3-b9ae-1dca2c12f992 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:10.249747 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc82284-0de5-47c3-b9ae-1dca2c12f992 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:10.250017 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc82284-0de5-47c3-b9ae-1dca2c12f992 None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:10.250645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc82284-0de5-47c3-b9ae-1dca2c12f992 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:10.250943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc82284-0de5-47c3-b9ae-1dca2c12f992 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:10.252301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc82284-0de5-47c3-b9ae-1dca2c12f992 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:10.253932 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 408/811] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Sep 4 00:46:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:10.254742 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904677bc-0089-4488-acd2-c5a43d2fae7a None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:10.264221 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 404/812] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:10.264931 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc82284-0de5-47c3-b9ae-1dca2c12f992 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:10.300484 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:10.355653 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904677bc-0089-4488-acd2-c5a43d2fae7a None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:10.363812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc82284-0de5-47c3-b9ae-1dca2c12f992 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:10.380316 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:10.389798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a697599-5c95-44db-8ba7-2db008a5f592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:10.390448 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a697599-5c95-44db-8ba7-2db008a5f592 None admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:10.390726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a697599-5c95-44db-8ba7-2db008a5f592 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:10.390993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a697599-5c95-44db-8ba7-2db008a5f592 None admin] PATH_INFO: `/v3/projects/40b24e92f8594ee08bd2a55f79e3b299/users/00543899e82647e8ba187b8d0b60d8c9/roles/955481bca39c4b0fab953d506ea3c292` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:10.398651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857601e-9f1a-40b4-875e-95ca5ef317cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:10.399275 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857601e-9f1a-40b4-875e-95ca5ef317cd None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:10.399551 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857601e-9f1a-40b4-875e-95ca5ef317cd None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:10.399817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857601e-9f1a-40b4-875e-95ca5ef317cd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:10.400389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857601e-9f1a-40b4-875e-95ca5ef317cd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:10.401773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857601e-9f1a-40b4-875e-95ca5ef317cd None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:10.404831 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a697599-5c95-44db-8ba7-2db008a5f592 None admin] RBAC: Authorizing `identity:create_grant(project_id=40b24e92f8594ee08bd2a55f79e3b299, user_id=00543899e82647e8ba187b8d0b60d8c9, role_id=955481bca39c4b0fab953d506ea3c292)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:10.406359 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a697599-5c95-44db-8ba7-2db008a5f592 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:10.410448 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-d857601e-9f1a-40b4-875e-95ca5ef317cd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 04 00:46:10.410448 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:10.410448 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 04 00:46:10.410448 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 04 00:46:10.410448 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 04 00:46:10.410448 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 04 00:46:10.410448 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 04 00:46:10.410448 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:10.410448 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 04 00:46:10.410448 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:10.410448 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 00:46:10.410448 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:10.410448 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:10.410448 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:10.410448 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:10.410448 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:10.410448 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:10.411478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:10.411478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:10.411478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:10.411478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:10.411478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:10.411478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:10.411478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 04 00:46:10.411478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 04 00:46:10.411478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 04 00:46:10.411478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 04 00:46:10.411478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:10.411478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:10.411478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:10.411478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:10.411478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:10.411478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:10.412297 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:10.412297 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:10.412297 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:10.412297 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:10.412297 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:10.412297 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:10.412297 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:10.412297 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:10.412297 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:10.412297 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:10.412297 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 04 00:46:10.412297 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:10.412297 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 04 00:46:10.412297 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:10.412297 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 405/813] 10.222.0.30 () {56 vars in 1129 bytes} [Sun Sep 4 00:46:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:10.413094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351427d-b58c-4a20-bbff-ddec0c29c694 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:10.413873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351427d-b58c-4a20-bbff-ddec0c29c694 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:10.414122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351427d-b58c-4a20-bbff-ddec0c29c694 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:10.415327 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 406/814] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:10.415987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351427d-b58c-4a20-bbff-ddec0c29c694 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:10.424293 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 409/815] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Sep 4 00:46:10 2022] PUT /identity/v3/projects/40b24e92f8594ee08bd2a55f79e3b299/users/00543899e82647e8ba187b8d0b60d8c9/roles/955481bca39c4b0fab953d506ea3c292 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:46:10.425027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a697599-5c95-44db-8ba7-2db008a5f592 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:10.531716 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351427d-b58c-4a20-bbff-ddec0c29c694 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:10.545084 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:10.555306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a697599-5c95-44db-8ba7-2db008a5f592 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:10.571571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f824b84-9931-4abd-a688-e2dc93e93214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:10.572352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f824b84-9931-4abd-a688-e2dc93e93214 None admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:10.572635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f824b84-9931-4abd-a688-e2dc93e93214 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:10.573142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f824b84-9931-4abd-a688-e2dc93e93214 None admin] PATH_INFO: `/v3/projects/40b24e92f8594ee08bd2a55f79e3b299/users/9bcc7a857fad4310896da5a87e71baed/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:10.574926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f824b84-9931-4abd-a688-e2dc93e93214 None admin] RBAC: Authorizing `identity:create_grant(project_id=40b24e92f8594ee08bd2a55f79e3b299, user_id=9bcc7a857fad4310896da5a87e71baed, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:10.576359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f824b84-9931-4abd-a688-e2dc93e93214 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:10.591570 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 407/816] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Sep 4 00:46:10 2022] PUT /identity/v3/projects/40b24e92f8594ee08bd2a55f79e3b299/users/9bcc7a857fad4310896da5a87e71baed/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:46:10.592462 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f824b84-9931-4abd-a688-e2dc93e93214 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:10.597564 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9453f-4c69-4b72-907c-924d24166186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:10.598514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9453f-4c69-4b72-907c-924d24166186 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:10.598979 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9453f-4c69-4b72-907c-924d24166186 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:10.599421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9453f-4c69-4b72-907c-924d24166186 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:10.610391 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd9453f-4c69-4b72-907c-924d24166186 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:10.612304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd9453f-4c69-4b72-907c-924d24166186 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:10.626565 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-ccd9453f-4c69-4b72-907c-924d24166186 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 04 00:46:10.626565 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:10.626565 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:10.626565 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:10.626565 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:10.626565 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:10.626565 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:10.626565 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:10.626565 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:10.626565 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:10.626565 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:10.626565 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:10.626565 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 04 00:46:10.626565 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 04 00:46:10.626565 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 04 00:46:10.626565 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 04 00:46:10.627671 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:10.627671 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:10.627671 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 00:46:10.627671 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:46:10.627671 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 00:46:10.627671 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:46:10.627671 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:10.627671 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:10.627671 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:10.627671 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:10.627671 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:10.627671 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:10.627671 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:10.627671 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:10.627671 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:10.627671 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:10.627671 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:10.627671 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:10.628797 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:10.628797 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:10.628797 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 00:46:10.628797 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 00:46:10.628797 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 00:46:10.628797 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 00:46:10.628797 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 00:46:10.628797 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 00:46:10.628797 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 04 00:46:10.628797 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:10.628797 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 410/817] 10.222.0.30 () {56 vars in 1093 bytes} [Sun Sep 4 00:46:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:10.629709 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c7a69-703c-4133-b510-58d095dc3c1e None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:10.629974 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c7a69-703c-4133-b510-58d095dc3c1e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:10.630248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c7a69-703c-4133-b510-58d095dc3c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:10.647472 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:10.665324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-7a4c7a69-703c-4133-b510-58d095dc3c1e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:10.667953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7a4c7a69-703c-4133-b510-58d095dc3c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:10.726663 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f824b84-9931-4abd-a688-e2dc93e93214 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:10.765676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268e2dd-5995-4eb8-813a-e4bd0d2179fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:10.766537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268e2dd-5995-4eb8-813a-e4bd0d2179fc None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:10.766820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268e2dd-5995-4eb8-813a-e4bd0d2179fc None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:10.767092 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268e2dd-5995-4eb8-813a-e4bd0d2179fc None admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:10.767734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268e2dd-5995-4eb8-813a-e4bd0d2179fc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:10.768036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268e2dd-5995-4eb8-813a-e4bd0d2179fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:10.769408 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268e2dd-5995-4eb8-813a-e4bd0d2179fc None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:10.773413 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 411/818] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:46:10.774476 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c7a69-703c-4133-b510-58d095dc3c1e None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:10.779653 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 408/819] 10.222.0.30 () {56 vars in 1124 bytes} [Sun Sep 4 00:46:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:10.780800 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268e2dd-5995-4eb8-813a-e4bd0d2179fc None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:10.874516 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:10.893100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c7a69-703c-4133-b510-58d095dc3c1e None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:10.916187 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268e2dd-5995-4eb8-813a-e4bd0d2179fc None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:10.919629 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:10.931493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e06f76-b6a7-49db-a115-77c6baf9140b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:10.932788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e06f76-b6a7-49db-a115-77c6baf9140b None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:10.933263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e06f76-b6a7-49db-a115-77c6baf9140b None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:10.933909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e06f76-b6a7-49db-a115-77c6baf9140b None admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:10.935216 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e06f76-b6a7-49db-a115-77c6baf9140b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:10.935857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e06f76-b6a7-49db-a115-77c6baf9140b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:10.937756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e06f76-b6a7-49db-a115-77c6baf9140b None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:10.971694 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 412/820] 10.222.0.30 () {56 vars in 1133 bytes} [Sun Sep 4 00:46:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:10.977494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1cdb2-42d5-46ba-8b62-cd07e3cca42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:10.978087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1cdb2-42d5-46ba-8b62-cd07e3cca42f None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:10.978362 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1cdb2-42d5-46ba-8b62-cd07e3cca42f None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:10.978485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e06f76-b6a7-49db-a115-77c6baf9140b None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:10.978641 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1cdb2-42d5-46ba-8b62-cd07e3cca42f None admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:10.979259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1cdb2-42d5-46ba-8b62-cd07e3cca42f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:10.979559 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1cdb2-42d5-46ba-8b62-cd07e3cca42f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:10.980915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1cdb2-42d5-46ba-8b62-cd07e3cca42f None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:10.986748 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 409/821] 10.222.0.30 () {56 vars in 1124 bytes} [Sun Sep 4 00:46:10 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:11.000543 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1cdb2-42d5-46ba-8b62-cd07e3cca42f None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:11.093503 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e06f76-b6a7-49db-a115-77c6baf9140b None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:11.137774 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf942e4f-07a2-4f62-b4ce-801d4afa004f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:11.138810 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf942e4f-07a2-4f62-b4ce-801d4afa004f None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:11.139160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf942e4f-07a2-4f62-b4ce-801d4afa004f None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:11.139759 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf942e4f-07a2-4f62-b4ce-801d4afa004f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:11.155975 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:11.161731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1cdb2-42d5-46ba-8b62-cd07e3cca42f None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:11.203760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a0421-859c-4088-94c7-1691b368c471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:11.204278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a0421-859c-4088-94c7-1691b368c471 None admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:11.204558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a0421-859c-4088-94c7-1691b368c471 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:11.204833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a0421-859c-4088-94c7-1691b368c471 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:11.205715 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a0421-859c-4088-94c7-1691b368c471 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:11.206915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a0421-859c-4088-94c7-1691b368c471 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:11.229990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf942e4f-07a2-4f62-b4ce-801d4afa004f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:11.231880 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf942e4f-07a2-4f62-b4ce-801d4afa004f None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:11.237684 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 410/822] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 00:46:10 2022] POST /identity/v3/endpoints => generated 346 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 00:46:11.238840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a0421-859c-4088-94c7-1691b368c471 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:11.302489 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:11.438645 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 413/823] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:46:10 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 04 00:46:11.445103 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf942e4f-07a2-4f62-b4ce-801d4afa004f None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:11.456692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a0421-859c-4088-94c7-1691b368c471 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:11.506473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c3519-6a9a-4084-8e92-5f0e2ed2e311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:11.507600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c3519-6a9a-4084-8e92-5f0e2ed2e311 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:11.507879 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c3519-6a9a-4084-8e92-5f0e2ed2e311 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:11.508149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c3519-6a9a-4084-8e92-5f0e2ed2e311 None admin] PATH_INFO: `/v3/services/network` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:11.509334 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:11.509562 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c3519-6a9a-4084-8e92-5f0e2ed2e311 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:11.512095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c3519-6a9a-4084-8e92-5f0e2ed2e311 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:11.524484 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-9f7c3519-6a9a-4084-8e92-5f0e2ed2e311 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 04 00:46:11.524484 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:11.524484 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 04 00:46:11.524484 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 04 00:46:11.524484 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 04 00:46:11.524484 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 04 00:46:11.524484 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 04 00:46:11.524484 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:11.524484 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 04 00:46:11.524484 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:11.524484 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 00:46:11.524484 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:11.524484 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:11.524484 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:11.524484 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:11.524484 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:11.524484 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:11.525753 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:11.525753 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:11.525753 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:11.525753 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:11.525753 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:11.525753 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:11.525753 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 04 00:46:11.525753 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 04 00:46:11.525753 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 04 00:46:11.525753 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 04 00:46:11.525753 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:11.525753 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:11.525753 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:11.525753 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:11.525753 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:11.525753 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:11.526786 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:11.526786 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:11.526786 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:11.526786 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:11.526786 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:11.526786 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:11.526786 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:11.526786 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:11.526786 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:11.526786 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:11.526786 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 04 00:46:11.526786 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:11.526786 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 04 00:46:11.526786 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:11.529874 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 411/824] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:46:11 2022] GET /identity/v3/services/network => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:11.535192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c3519-6a9a-4084-8e92-5f0e2ed2e311 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:11.584416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf942e4f-07a2-4f62-b4ce-801d4afa004f None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:11.624169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a8e0e-3278-4972-ac2b-7e5898db1619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:11.625046 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a8e0e-3278-4972-ac2b-7e5898db1619 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:11.625500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a8e0e-3278-4972-ac2b-7e5898db1619 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:11.626715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a8e0e-3278-4972-ac2b-7e5898db1619 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:11.629912 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:11.638839 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a8e0e-3278-4972-ac2b-7e5898db1619 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:11.640299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a8e0e-3278-4972-ac2b-7e5898db1619 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:11.647201 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c3519-6a9a-4084-8e92-5f0e2ed2e311 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:11.656414 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-041a8e0e-3278-4972-ac2b-7e5898db1619 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:11.656414 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:11.656414 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:11.656414 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:11.656414 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:11.656414 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:11.656414 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:11.656414 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:11.656414 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:11.656414 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:11.656414 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:11.656414 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:11.656414 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:46:11.656414 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:46:11.656414 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:46:11.656414 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:46:11.657379 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:11.657379 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:11.657379 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:11.657379 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:11.657379 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:11.657379 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:11.657379 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:11.657379 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:11.657379 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:11.657379 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:11.657379 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:11.657379 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:11.657379 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:11.657379 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:11.657379 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:11.657379 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:11.657379 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:46:11.658324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:46:11.658324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:11.658324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:11.661621 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 414/825] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:46:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:46:11.664275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a8e0e-3278-4972-ac2b-7e5898db1619 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:11.686353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc32a1-0c85-4aa7-a89f-2dd6a07c8d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:11.687293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc32a1-0c85-4aa7-a89f-2dd6a07c8d2b None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:11.687771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc32a1-0c85-4aa7-a89f-2dd6a07c8d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:11.688239 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc32a1-0c85-4aa7-a89f-2dd6a07c8d2b None admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:11.689072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc32a1-0c85-4aa7-a89f-2dd6a07c8d2b None admin] RBAC: Adding query filter params (name=network) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:11.689635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc32a1-0c85-4aa7-a89f-2dd6a07c8d2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:11.691208 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc32a1-0c85-4aa7-a89f-2dd6a07c8d2b None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:11.696615 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 412/826] 10.222.0.30 () {56 vars in 1112 bytes} [Sun Sep 4 00:46:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:11.702218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc32a1-0c85-4aa7-a89f-2dd6a07c8d2b None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:11.767517 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:11.775830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a8e0e-3278-4972-ac2b-7e5898db1619 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:11.806817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc32a1-0c85-4aa7-a89f-2dd6a07c8d2b None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:11.812644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5806ffbf-2113-4db8-8367-ca2baaedeb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:11.813313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806ffbf-2113-4db8-8367-ca2baaedeb5f None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:11.813640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806ffbf-2113-4db8-8367-ca2baaedeb5f None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:11.813915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806ffbf-2113-4db8-8367-ca2baaedeb5f None admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:11.814558 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5806ffbf-2113-4db8-8367-ca2baaedeb5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:11.814857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5806ffbf-2113-4db8-8367-ca2baaedeb5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:11.816238 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5806ffbf-2113-4db8-8367-ca2baaedeb5f None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:11.833259 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 415/827] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:46:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:11.834452 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5806ffbf-2113-4db8-8367-ca2baaedeb5f None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:11.844476 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cff9e2-320e-4d03-b1e4-1664db0c5459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:11.845282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cff9e2-320e-4d03-b1e4-1664db0c5459 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:11.845847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cff9e2-320e-4d03-b1e4-1664db0c5459 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:11.846316 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cff9e2-320e-4d03-b1e4-1664db0c5459 None admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:11.847157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cff9e2-320e-4d03-b1e4-1664db0c5459 None admin] RBAC: Adding query filter params (type=network) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:11.847672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cff9e2-320e-4d03-b1e4-1664db0c5459 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:11.849233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cff9e2-320e-4d03-b1e4-1664db0c5459 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:11.855123 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 413/828] 10.222.0.30 () {56 vars in 1112 bytes} [Sun Sep 4 00:46:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:11.861008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cff9e2-320e-4d03-b1e4-1664db0c5459 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:11.877825 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:11.944468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5806ffbf-2113-4db8-8367-ca2baaedeb5f None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:11.965249 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cff9e2-320e-4d03-b1e4-1664db0c5459 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:12.001404 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a48324-a357-42d0-b98c-c56eb627111c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:12.002408 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a48324-a357-42d0-b98c-c56eb627111c None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:12.003839 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a48324-a357-42d0-b98c-c56eb627111c None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:12.005061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a48324-a357-42d0-b98c-c56eb627111c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:12.015568 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a48324-a357-42d0-b98c-c56eb627111c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:12.017312 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a48324-a357-42d0-b98c-c56eb627111c None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:12.018248 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043cf294-799c-45f8-aec1-e9b0d7c848d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:12.018821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cf294-799c-45f8-aec1-e9b0d7c848d3 None admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:12.019096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cf294-799c-45f8-aec1-e9b0d7c848d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:12.019364 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cf294-799c-45f8-aec1-e9b0d7c848d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:12.020046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043cf294-799c-45f8-aec1-e9b0d7c848d3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:12.021382 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043cf294-799c-45f8-aec1-e9b0d7c848d3 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:12.030952 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-10a48324-a357-42d0-b98c-c56eb627111c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:46:12.030952 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:12.030952 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:12.030952 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:12.030952 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:12.030952 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:12.030952 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:12.030952 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:12.030952 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:12.030952 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:12.030952 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:12.030952 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:12.030952 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 04 00:46:12.030952 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 04 00:46:12.030952 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 04 00:46:12.031861 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 04 00:46:12.031861 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:12.031861 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:12.031861 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:12.031861 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:12.031861 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:12.031861 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:12.031861 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:12.031861 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:12.031861 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:12.031861 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:12.031861 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:12.031861 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:12.031861 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:12.031861 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:12.031861 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:12.031861 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:12.032773 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 04 00:46:12.032773 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 04 00:46:12.032773 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 00:46:12.032773 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 00:46:12.032773 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 00:46:12.032773 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 00:46:12.032773 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:46:12.032773 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:12.035258 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 416/829] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:46:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:12.042008 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a48324-a357-42d0-b98c-c56eb627111c None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:12.063054 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 414/830] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 00:46:11 2022] POST /identity/v3/endpoints => generated 337 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 00:46:12.074136 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:12.202096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a48324-a357-42d0-b98c-c56eb627111c None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:12.266720 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca830e87-2f7b-4677-8e5b-a883a5eda3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:12.267337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca830e87-2f7b-4677-8e5b-a883a5eda3df None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:12.267614 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca830e87-2f7b-4677-8e5b-a883a5eda3df None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:12.267888 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca830e87-2f7b-4677-8e5b-a883a5eda3df None admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:12.268632 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca830e87-2f7b-4677-8e5b-a883a5eda3df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:12.268879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca830e87-2f7b-4677-8e5b-a883a5eda3df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:12.270401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca830e87-2f7b-4677-8e5b-a883a5eda3df None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:12.284627 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 417/831] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Sep 4 00:46:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:12.291450 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043cf294-799c-45f8-aec1-e9b0d7c848d3 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:12.373888 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:12.418388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043cf294-799c-45f8-aec1-e9b0d7c848d3 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:12.457460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0320ad-2ba2-4652-8c6d-50c58952ac05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:12.457460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0320ad-2ba2-4652-8c6d-50c58952ac05 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:12.457460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0320ad-2ba2-4652-8c6d-50c58952ac05 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:12.457460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0320ad-2ba2-4652-8c6d-50c58952ac05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:12.457778 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0320ad-2ba2-4652-8c6d-50c58952ac05 None admin] RBAC: Adding query filter params (role.id=d255b03c37d64371a148ec4e11be01d9, scope.project.id=40b24e92f8594ee08bd2a55f79e3b299, user.id=13f0f341bf2c475d82b4e7b34d503dd0) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:12.457778 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0320ad-2ba2-4652-8c6d-50c58952ac05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:12.459261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0320ad-2ba2-4652-8c6d-50c58952ac05 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:12.473648 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 415/832] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:46:12 2022] GET /identity/v3/role_assignments?user.id=13f0f341bf2c475d82b4e7b34d503dd0&scope.project.id=40b24e92f8594ee08bd2a55f79e3b299&role.id=d255b03c37d64371a148ec4e11be01d9 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:12.615485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94311022-5d27-4ad0-a7b2-b23a889cef5f None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:12.615770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94311022-5d27-4ad0-a7b2-b23a889cef5f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:12.616048 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94311022-5d27-4ad0-a7b2-b23a889cef5f None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:12.617604 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 418/833] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:12.622795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd79f66-4283-499d-beac-0fb75e32de32 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:12.623075 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd79f66-4283-499d-beac-0fb75e32de32 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:12.623343 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd79f66-4283-499d-beac-0fb75e32de32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:12.644325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-3fd79f66-4283-499d-beac-0fb75e32de32 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:12.645910 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3fd79f66-4283-499d-beac-0fb75e32de32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:12.731546 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 416/834] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:46:12.920650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887ed55-5536-4167-bedf-c5ae91c2adec None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:12.921145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887ed55-5536-4167-bedf-c5ae91c2adec None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:12.921145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887ed55-5536-4167-bedf-c5ae91c2adec None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:12.922702 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 419/835] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:12.927924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79816f14-2bfd-4971-87aa-50b126f50331 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:12.928211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79816f14-2bfd-4971-87aa-50b126f50331 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:12.928545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79816f14-2bfd-4971-87aa-50b126f50331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:12.947841 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-79816f14-2bfd-4971-87aa-50b126f50331 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:12.949041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-79816f14-2bfd-4971-87aa-50b126f50331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:13.008877 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:13.010433 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887ed55-5536-4167-bedf-c5ae91c2adec None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:13.023585 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 417/836] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:46:13.085889 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:13.119719 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887ed55-5536-4167-bedf-c5ae91c2adec None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:13.153761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9ac58-3050-435e-b19a-29b085c0f912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:13.154389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9ac58-3050-435e-b19a-29b085c0f912 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:13.154668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9ac58-3050-435e-b19a-29b085c0f912 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:13.154940 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9ac58-3050-435e-b19a-29b085c0f912 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:13.166075 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c9ac58-3050-435e-b19a-29b085c0f912 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:46:13.171335 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-74c9ac58-3050-435e-b19a-29b085c0f912 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:46:13.171335 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:13.171335 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:13.171335 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:13.171335 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:13.171335 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:13.171335 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:13.171335 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:13.171335 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:13.171335 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:13.171335 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:13.171335 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:13.171335 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:46:13.171335 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:46:13.171335 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:46:13.171335 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:46:13.172228 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:46:13.172228 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:46:13.172228 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:46:13.172228 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:46:13.172228 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:13.172228 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:13.172228 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:13.172228 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:13.172228 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:13.172228 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:13.172228 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:13.172228 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:13.172228 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:13.172228 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:13.172228 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:13.172228 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:13.173051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:13.173051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:13.173051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:13.173051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:13.173051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:46:13.173051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:46:13.173051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:46:13.173051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:46:13.173051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:46:13.173051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:46:13.173051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:46:13.173051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:13.173051 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 420/837] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Sep 4 00:46:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:46:13.178459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79816f14-2bfd-4971-87aa-50b126f50331 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:13.280712 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79816f14-2bfd-4971-87aa-50b126f50331 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:13.308877 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9ac58-3050-435e-b19a-29b085c0f912 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:13.318274 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a9759-14e8-48a0-ad2a-12ef70f7d17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:13.319497 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a9759-14e8-48a0-ad2a-12ef70f7d17f None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:13.319972 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a9759-14e8-48a0-ad2a-12ef70f7d17f None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:13.320460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a9759-14e8-48a0-ad2a-12ef70f7d17f None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:13.321331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a9759-14e8-48a0-ad2a-12ef70f7d17f None admin] RBAC: Adding query filter params (name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:13.321853 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a9759-14e8-48a0-ad2a-12ef70f7d17f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:13.323400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a9759-14e8-48a0-ad2a-12ef70f7d17f None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:13.332205 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 418/838] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Sep 4 00:46:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:13.340080 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a9759-14e8-48a0-ad2a-12ef70f7d17f None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:13.411497 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:13.423994 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9ac58-3050-435e-b19a-29b085c0f912 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:13.459411 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7a53f-662c-461c-98a4-fed298f4ce9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:13.460919 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7a53f-662c-461c-98a4-fed298f4ce9f None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:13.461540 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7a53f-662c-461c-98a4-fed298f4ce9f None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:13.462273 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7a53f-662c-461c-98a4-fed298f4ce9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:13.468407 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:13.468637 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a9759-14e8-48a0-ad2a-12ef70f7d17f None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:13.480722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7a53f-662c-461c-98a4-fed298f4ce9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:46:13.487908 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-1ad7a53f-662c-461c-98a4-fed298f4ce9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:46:13.487908 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:13.487908 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:13.487908 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:13.487908 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:13.487908 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:13.487908 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:13.487908 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:13.487908 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:13.487908 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:13.487908 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:13.487908 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:13.487908 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:46:13.487908 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:46:13.487908 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:46:13.487908 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:46:13.488807 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:46:13.488807 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:46:13.488807 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:46:13.488807 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:46:13.488807 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:13.488807 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:13.488807 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:13.488807 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:13.488807 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:13.488807 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:13.488807 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:13.488807 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:13.488807 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:13.488807 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:13.488807 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:13.488807 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:13.489675 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:13.489675 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:13.489675 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:13.489675 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:13.489675 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:46:13.489675 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:46:13.489675 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:46:13.489675 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:46:13.489675 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:46:13.489675 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:46:13.489675 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:46:13.489675 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:13.489675 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 421/839] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Sep 4 00:46:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:13.495137 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7a53f-662c-461c-98a4-fed298f4ce9f None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:13.514469 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b470b-8535-4d4d-b665-e9200aec2259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:13.515448 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b470b-8535-4d4d-b665-e9200aec2259 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:13.515920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b470b-8535-4d4d-b665-e9200aec2259 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:13.516383 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b470b-8535-4d4d-b665-e9200aec2259 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:13.528428 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b470b-8535-4d4d-b665-e9200aec2259 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:13.530226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b470b-8535-4d4d-b665-e9200aec2259 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:13.545817 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-911b470b-8535-4d4d-b665-e9200aec2259 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:13.545817 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:13.545817 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:13.545817 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:13.545817 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:13.545817 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:13.545817 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:13.545817 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:13.545817 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:13.545817 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:13.545817 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:13.545817 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:13.545817 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:46:13.545817 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:46:13.545817 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:46:13.545817 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:46:13.546820 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:13.546820 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:13.546820 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:13.546820 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:13.546820 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:13.546820 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:13.546820 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:13.546820 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:13.546820 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:13.546820 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:13.546820 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:13.546820 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:13.546820 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:13.546820 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:13.546820 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:13.546820 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:13.546820 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:46:13.547708 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:46:13.547708 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:13.547708 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:13.549790 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 419/840] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:46:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:13.555172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b470b-8535-4d4d-b665-e9200aec2259 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:13.605042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7a53f-662c-461c-98a4-fed298f4ce9f None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:13.640080 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a110f-ca8e-4567-9530-a82ba60c7076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:13.640685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a110f-ca8e-4567-9530-a82ba60c7076 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:13.640963 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a110f-ca8e-4567-9530-a82ba60c7076 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:13.641233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a110f-ca8e-4567-9530-a82ba60c7076 None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:13.641927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a110f-ca8e-4567-9530-a82ba60c7076 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:13.642231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a110f-ca8e-4567-9530-a82ba60c7076 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:13.643618 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a110f-ca8e-4567-9530-a82ba60c7076 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:13.652256 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 422/841] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:46:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:13.653428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f055f1-6223-47d8-9942-e91041bf78c7 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:13.653734 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f055f1-6223-47d8-9942-e91041bf78c7 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:13.654004 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f055f1-6223-47d8-9942-e91041bf78c7 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:13.659214 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 423/842] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:13.659982 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f055f1-6223-47d8-9942-e91041bf78c7 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:13.681632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b470b-8535-4d4d-b665-e9200aec2259 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:13.690163 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:13.720161 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:13.724301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da118c4-e83b-4f43-9227-b97b2db06ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:13.724921 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da118c4-e83b-4f43-9227-b97b2db06ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:13.725271 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da118c4-e83b-4f43-9227-b97b2db06ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:13.725563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da118c4-e83b-4f43-9227-b97b2db06ab3 None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:13.726670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da118c4-e83b-4f43-9227-b97b2db06ab3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:13.726964 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da118c4-e83b-4f43-9227-b97b2db06ab3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:13.728515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da118c4-e83b-4f43-9227-b97b2db06ab3 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:13.744395 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 420/843] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:13.744395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e3988-3c9d-48de-9312-757fcf206b38 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:13.744395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e3988-3c9d-48de-9312-757fcf206b38 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:13.744395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e3988-3c9d-48de-9312-757fcf206b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:13.763267 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-257e3988-3c9d-48de-9312-757fcf206b38 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:13.764698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-257e3988-3c9d-48de-9312-757fcf206b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:13.778970 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f055f1-6223-47d8-9942-e91041bf78c7 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:13.816554 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524d1c5-2753-44c1-a410-048d21e63f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:13.817292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524d1c5-2753-44c1-a410-048d21e63f83 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:13.817598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524d1c5-2753-44c1-a410-048d21e63f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:13.817985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524d1c5-2753-44c1-a410-048d21e63f83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:13.829597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524d1c5-2753-44c1-a410-048d21e63f83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:13.831150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524d1c5-2753-44c1-a410-048d21e63f83 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:13.841457 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 421/844] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:13 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:46:13.841457 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e3988-3c9d-48de-9312-757fcf206b38 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:13.854348 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-3524d1c5-2753-44c1-a410-048d21e63f83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:13.854348 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:13.854348 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:13.854348 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:13.854348 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:13.854348 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:13.854348 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:13.854348 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:13.854348 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:13.854348 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:13.854348 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:13.854348 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:13.854348 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:46:13.854348 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:46:13.854348 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:46:13.854348 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:46:13.855494 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:13.855494 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:13.855494 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:13.855494 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:13.855494 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:13.855494 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:13.855494 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:13.855494 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:13.855494 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:13.855494 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:13.855494 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:13.855494 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:13.855494 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:13.855494 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:13.855494 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:13.855494 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:13.855494 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:46:13.856586 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:46:13.856586 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:13.856586 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:13.856782 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 424/845] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:46:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:13.862753 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524d1c5-2753-44c1-a410-048d21e63f83 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:13.964690 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:13.968801 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524d1c5-2753-44c1-a410-048d21e63f83 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:13.972090 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:13.975231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e3988-3c9d-48de-9312-757fcf206b38 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:14.009336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87263b-9dc6-409a-a9a1-99f72d8a1de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:14.010019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87263b-9dc6-409a-a9a1-99f72d8a1de1 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:14.010296 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87263b-9dc6-409a-a9a1-99f72d8a1de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:14.010565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87263b-9dc6-409a-a9a1-99f72d8a1de1 None admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:14.011306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87263b-9dc6-409a-a9a1-99f72d8a1de1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:14.011611 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87263b-9dc6-409a-a9a1-99f72d8a1de1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:14.012975 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87263b-9dc6-409a-a9a1-99f72d8a1de1 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:14.020703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5de1a-9d5f-4cb1-acd2-d3de212ae88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:14.021618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5de1a-9d5f-4cb1-acd2-d3de212ae88b None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:14.023173 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5de1a-9d5f-4cb1-acd2-d3de212ae88b None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:14.023663 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5de1a-9d5f-4cb1-acd2-d3de212ae88b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:14.029869 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 425/846] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:14.031928 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f5de1a-9d5f-4cb1-acd2-d3de212ae88b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:14.032059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87263b-9dc6-409a-a9a1-99f72d8a1de1 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:14.033713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f5de1a-9d5f-4cb1-acd2-d3de212ae88b None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:14.048982 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-05f5de1a-9d5f-4cb1-acd2-d3de212ae88b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 04 00:46:14.048982 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:14.048982 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:14.048982 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:14.048982 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:14.048982 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:14.048982 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:14.048982 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:14.048982 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:14.048982 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:14.048982 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:14.048982 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:14.048982 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 04 00:46:14.048982 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 04 00:46:14.048982 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 04 00:46:14.048982 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 04 00:46:14.049993 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:14.049993 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:14.049993 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 00:46:14.049993 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:46:14.049993 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 00:46:14.049993 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:46:14.049993 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:14.049993 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:14.049993 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:14.049993 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:14.049993 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:14.049993 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:14.049993 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:14.049993 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:14.049993 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:14.049993 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:14.049993 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:14.049993 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:14.050925 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:14.050925 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:14.050925 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 00:46:14.050925 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 00:46:14.050925 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 00:46:14.050925 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 00:46:14.050925 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 00:46:14.050925 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 00:46:14.050925 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 04 00:46:14.050925 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:14.051457 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 422/847] 10.222.0.30 () {56 vars in 1117 bytes} [Sun Sep 4 00:46:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:14.058661 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5de1a-9d5f-4cb1-acd2-d3de212ae88b None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:14.150784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87263b-9dc6-409a-a9a1-99f72d8a1de1 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:14.173194 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5de1a-9d5f-4cb1-acd2-d3de212ae88b None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:14.187020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7845e4b-c962-4dcb-9769-7f6918543d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:14.187642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7845e4b-c962-4dcb-9769-7f6918543d11 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:14.187916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7845e4b-c962-4dcb-9769-7f6918543d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:14.188474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7845e4b-c962-4dcb-9769-7f6918543d11 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:14.196377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7845e4b-c962-4dcb-9769-7f6918543d11 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:14.197832 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7845e4b-c962-4dcb-9769-7f6918543d11 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:14.208953 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-c7845e4b-c962-4dcb-9769-7f6918543d11 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 04 00:46:14.208953 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:14.208953 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:14.208953 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:14.208953 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:14.208953 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:14.208953 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:14.208953 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:14.208953 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:14.208953 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:14.208953 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:14.208953 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:14.208953 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 04 00:46:14.208953 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 04 00:46:14.208953 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 04 00:46:14.208953 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 04 00:46:14.210160 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:14.210160 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:14.210160 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 00:46:14.210160 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:46:14.210160 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 00:46:14.210160 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:46:14.210160 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:14.210160 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:14.210160 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:14.210160 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:14.210160 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:14.210160 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:14.210160 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:14.210160 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:14.210160 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:14.210160 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:14.210160 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:14.210160 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:14.211126 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:14.211126 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:14.211126 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 00:46:14.211126 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 00:46:14.211126 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 00:46:14.211126 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 00:46:14.211126 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 00:46:14.211126 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 00:46:14.211126 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 04 00:46:14.211126 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:14.211661 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb86039-7ee9-4cdb-8e81-42aee14532a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:14.211760 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 426/848] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Sep 4 00:46:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:46:14.211760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7845e4b-c962-4dcb-9769-7f6918543d11 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:14.212894 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb86039-7ee9-4cdb-8e81-42aee14532a5 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:14.213245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb86039-7ee9-4cdb-8e81-42aee14532a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:14.213617 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb86039-7ee9-4cdb-8e81-42aee14532a5 None admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:14.214428 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb86039-7ee9-4cdb-8e81-42aee14532a5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:14.215149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb86039-7ee9-4cdb-8e81-42aee14532a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:14.216542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb86039-7ee9-4cdb-8e81-42aee14532a5 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:14.237190 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 423/849] 10.222.0.30 () {56 vars in 1149 bytes} [Sun Sep 4 00:46:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:14.237849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb86039-7ee9-4cdb-8e81-42aee14532a5 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:14.245094 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:14.254125 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:14.326129 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7845e4b-c962-4dcb-9769-7f6918543d11 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:14.349188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb86039-7ee9-4cdb-8e81-42aee14532a5 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:14.361136 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429fd99-cbe3-4906-be79-a9c1186f1d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:14.361799 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429fd99-cbe3-4906-be79-a9c1186f1d09 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:14.362077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429fd99-cbe3-4906-be79-a9c1186f1d09 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:14.362348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429fd99-cbe3-4906-be79-a9c1186f1d09 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:14.363234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429fd99-cbe3-4906-be79-a9c1186f1d09 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:14.364633 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429fd99-cbe3-4906-be79-a9c1186f1d09 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:14.374711 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-5429fd99-cbe3-4906-be79-a9c1186f1d09 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 04 00:46:14.374711 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:14.374711 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 04 00:46:14.374711 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 04 00:46:14.374711 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 04 00:46:14.374711 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 04 00:46:14.374711 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 04 00:46:14.374711 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:14.374711 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 04 00:46:14.374711 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:14.374711 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 00:46:14.374711 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:14.374711 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:14.374711 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:14.374711 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:14.374711 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:14.374711 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:14.375688 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:14.375688 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:14.375688 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:14.375688 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:14.375688 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:14.375688 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:14.375688 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 04 00:46:14.375688 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 04 00:46:14.375688 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 04 00:46:14.375688 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 04 00:46:14.375688 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:14.375688 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:14.375688 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:14.375688 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:14.375688 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:14.375688 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:14.376529 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:14.376529 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:14.376529 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:14.376529 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:14.376529 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:14.376529 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:14.376529 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:14.376529 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:14.376529 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:14.376529 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:14.376529 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 04 00:46:14.376529 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:14.376529 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 04 00:46:14.376529 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:14.376529 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 427/850] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Sep 4 00:46:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:14.377797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429fd99-cbe3-4906-be79-a9c1186f1d09 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:14.395144 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396d921-2f4d-47f2-a072-7a84c1c11226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:14.395865 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396d921-2f4d-47f2-a072-7a84c1c11226 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:14.396144 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396d921-2f4d-47f2-a072-7a84c1c11226 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:14.396527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396d921-2f4d-47f2-a072-7a84c1c11226 None admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:14.397361 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396d921-2f4d-47f2-a072-7a84c1c11226 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:14.397763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396d921-2f4d-47f2-a072-7a84c1c11226 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:14.399318 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396d921-2f4d-47f2-a072-7a84c1c11226 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:14.418014 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 424/851] 10.222.0.30 () {56 vars in 1135 bytes} [Sun Sep 4 00:46:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:14.423275 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396d921-2f4d-47f2-a072-7a84c1c11226 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:14.475865 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:14.490966 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429fd99-cbe3-4906-be79-a9c1186f1d09 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:14.503503 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:14.532544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ed9cb-404e-4152-8c58-dbfbfa9475cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:14.533149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ed9cb-404e-4152-8c58-dbfbfa9475cb None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:14.533425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ed9cb-404e-4152-8c58-dbfbfa9475cb None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:14.533727 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ed9cb-404e-4152-8c58-dbfbfa9475cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:14.536118 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396d921-2f4d-47f2-a072-7a84c1c11226 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:14.572417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618cbb7-7a53-4cd9-bb7b-8db7a1e2039c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:14.573016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618cbb7-7a53-4cd9-bb7b-8db7a1e2039c None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:14.573292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618cbb7-7a53-4cd9-bb7b-8db7a1e2039c None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:14.573594 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618cbb7-7a53-4cd9-bb7b-8db7a1e2039c None admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:14.574215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1618cbb7-7a53-4cd9-bb7b-8db7a1e2039c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:14.574509 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1618cbb7-7a53-4cd9-bb7b-8db7a1e2039c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:14.575877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1618cbb7-7a53-4cd9-bb7b-8db7a1e2039c None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:14.580210 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 425/852] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Sep 4 00:46:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:14.580961 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618cbb7-7a53-4cd9-bb7b-8db7a1e2039c None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:14.602170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ed9cb-404e-4152-8c58-dbfbfa9475cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:14.603628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ed9cb-404e-4152-8c58-dbfbfa9475cb None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:14.681195 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618cbb7-7a53-4cd9-bb7b-8db7a1e2039c None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:14.689630 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:14.705834 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 428/853] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:46:14 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 04 00:46:14.707070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aef969-999d-4ebe-830c-6f69256e7936 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:14.707351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aef969-999d-4ebe-830c-6f69256e7936 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:14.707622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aef969-999d-4ebe-830c-6f69256e7936 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:14.708862 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 429/854] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:14.709631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aef969-999d-4ebe-830c-6f69256e7936 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:14.719624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec0439-2e89-4a65-9357-172ba67bafaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:14.720235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec0439-2e89-4a65-9357-172ba67bafaa None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:14.720510 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec0439-2e89-4a65-9357-172ba67bafaa None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:14.720777 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec0439-2e89-4a65-9357-172ba67bafaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:14.724284 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:14.791126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec0439-2e89-4a65-9357-172ba67bafaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:14.792478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec0439-2e89-4a65-9357-172ba67bafaa None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:14.814388 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aef969-999d-4ebe-830c-6f69256e7936 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:14.846478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292ed51-ea7f-412d-b12e-ee69c9008a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:14.847067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292ed51-ea7f-412d-b12e-ee69c9008a4f None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:14.847345 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292ed51-ea7f-412d-b12e-ee69c9008a4f None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:14.847612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292ed51-ea7f-412d-b12e-ee69c9008a4f None admin] PATH_INFO: `/v3/services` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:14.848228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292ed51-ea7f-412d-b12e-ee69c9008a4f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:14.848525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292ed51-ea7f-412d-b12e-ee69c9008a4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:14.849894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292ed51-ea7f-412d-b12e-ee69c9008a4f None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:14.854912 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 430/855] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Sep 4 00:46:14 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:14.855657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292ed51-ea7f-412d-b12e-ee69c9008a4f None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:14.899614 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 426/856] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:46:14 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 04 00:46:14.899614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a8c2a-d9f7-4984-b3c7-bd56346902e2 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:14.899614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a8c2a-d9f7-4984-b3c7-bd56346902e2 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:14.899614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a8c2a-d9f7-4984-b3c7-bd56346902e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:14.916537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-126a8c2a-d9f7-4984-b3c7-bd56346902e2 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:14.917787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-126a8c2a-d9f7-4984-b3c7-bd56346902e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:14.930925 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:14.951832 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:14.986624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292ed51-ea7f-412d-b12e-ee69c9008a4f None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:14.995506 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 427/857] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:46:14.996675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a8c2a-d9f7-4984-b3c7-bd56346902e2 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:15.033124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bfc1b-c2f1-495a-8db8-7a6a5589eb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:15.033789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bfc1b-c2f1-495a-8db8-7a6a5589eb90 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:15.034066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bfc1b-c2f1-495a-8db8-7a6a5589eb90 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:15.034337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bfc1b-c2f1-495a-8db8-7a6a5589eb90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:15.048170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1bfc1b-c2f1-495a-8db8-7a6a5589eb90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:15.049379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1bfc1b-c2f1-495a-8db8-7a6a5589eb90 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:15.065413 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-1a1bfc1b-c2f1-495a-8db8-7a6a5589eb90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:15.065413 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:15.065413 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:15.065413 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:15.065413 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:15.065413 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:15.065413 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:15.065413 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:15.065413 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:15.065413 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:15.065413 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:15.065413 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:15.065413 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:46:15.065413 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:46:15.065413 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:46:15.065413 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:46:15.066584 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:15.066584 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:15.066584 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:15.066584 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:15.066584 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:15.066584 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:15.066584 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:15.066584 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:15.066584 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:15.066584 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:15.066584 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:15.066584 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:15.066584 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:15.066584 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:15.066584 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:15.066584 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:15.066584 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:46:15.067603 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:46:15.067603 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:15.067603 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:15.067603 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 431/858] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:46:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:15.072372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bfc1b-c2f1-495a-8db8-7a6a5589eb90 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:15.115480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a8c2a-d9f7-4984-b3c7-bd56346902e2 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:15.153776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0acd94-1f6c-4fc1-a76a-81c596eb36e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:15.154546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0acd94-1f6c-4fc1-a76a-81c596eb36e2 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:15.154946 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0acd94-1f6c-4fc1-a76a-81c596eb36e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:15.155288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0acd94-1f6c-4fc1-a76a-81c596eb36e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:15.169039 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0acd94-1f6c-4fc1-a76a-81c596eb36e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:15.171065 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0acd94-1f6c-4fc1-a76a-81c596eb36e2 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:15.190381 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-fe0acd94-1f6c-4fc1-a76a-81c596eb36e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:15.190381 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:15.190381 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:15.190381 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:15.190381 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:15.190381 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:15.190381 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:15.190381 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:15.190381 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:15.190381 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:15.190381 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:15.190381 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:15.190381 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:46:15.190381 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:46:15.190381 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:46:15.190381 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:46:15.191369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:15.191369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:15.191369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:15.191369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:15.191369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:15.191369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:15.191369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:15.191369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:15.191369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:15.191369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:15.191369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:15.191369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:15.191369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:15.191369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:15.191369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:15.191369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:15.191369 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:46:15.192249 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:46:15.192249 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:15.192249 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:15.192249 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 428/859] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:46:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:15.197168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bfc1b-c2f1-495a-8db8-7a6a5589eb90 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:15.197944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0acd94-1f6c-4fc1-a76a-81c596eb36e2 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:15.205779 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:15.220246 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:15.246875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32758d-77c7-42dd-82b2-c4fc860a47fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:15.247609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32758d-77c7-42dd-82b2-c4fc860a47fb None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:15.247982 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32758d-77c7-42dd-82b2-c4fc860a47fb None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:15.248321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32758d-77c7-42dd-82b2-c4fc860a47fb None admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:15.249520 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32758d-77c7-42dd-82b2-c4fc860a47fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:15.249896 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32758d-77c7-42dd-82b2-c4fc860a47fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:15.251341 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32758d-77c7-42dd-82b2-c4fc860a47fb None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:15.266452 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 432/860] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:15.271699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32758d-77c7-42dd-82b2-c4fc860a47fb None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:15.322039 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0acd94-1f6c-4fc1-a76a-81c596eb36e2 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:15.359051 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe4461-2031-4c44-88a6-e33902f9718f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:15.359672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe4461-2031-4c44-88a6-e33902f9718f None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:15.360183 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe4461-2031-4c44-88a6-e33902f9718f None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:15.360452 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe4461-2031-4c44-88a6-e33902f9718f None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:15.361093 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe4461-2031-4c44-88a6-e33902f9718f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:15.361392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe4461-2031-4c44-88a6-e33902f9718f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:15.362780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe4461-2031-4c44-88a6-e33902f9718f None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:15.379174 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 429/861] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:15.379174 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe4461-2031-4c44-88a6-e33902f9718f None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:15.390804 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32758d-77c7-42dd-82b2-c4fc860a47fb None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:15.426390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ad92f-372a-4b04-84df-d373f49181a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:15.427019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ad92f-372a-4b04-84df-d373f49181a0 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:15.427297 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ad92f-372a-4b04-84df-d373f49181a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:15.427565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ad92f-372a-4b04-84df-d373f49181a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:15.434736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09ad92f-372a-4b04-84df-d373f49181a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:15.436170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09ad92f-372a-4b04-84df-d373f49181a0 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:15.448539 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-e09ad92f-372a-4b04-84df-d373f49181a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:46:15.448539 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:15.448539 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:15.448539 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:15.448539 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:15.448539 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:15.448539 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:15.448539 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:15.448539 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:15.448539 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:15.448539 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:15.448539 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:15.448539 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 04 00:46:15.448539 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 04 00:46:15.448539 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 04 00:46:15.449491 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 04 00:46:15.449491 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:15.449491 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:15.449491 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:15.449491 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:15.449491 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:15.449491 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:15.449491 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:15.449491 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:15.449491 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:15.449491 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:15.449491 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:15.449491 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:15.449491 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:15.449491 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:15.449491 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:15.449491 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:15.450387 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 04 00:46:15.450387 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 04 00:46:15.450387 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 00:46:15.450387 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 00:46:15.450387 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 00:46:15.450387 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 00:46:15.450387 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:46:15.450387 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:15.454523 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 433/862] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:46:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:15.455331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ad92f-372a-4b04-84df-d373f49181a0 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:15.466377 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:15.484458 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:15.494617 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe4461-2031-4c44-88a6-e33902f9718f None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:15.530037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe39f1-681e-4704-81d4-5160fc2fcf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:15.530665 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe39f1-681e-4704-81d4-5160fc2fcf69 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:15.530938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe39f1-681e-4704-81d4-5160fc2fcf69 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:15.531202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe39f1-681e-4704-81d4-5160fc2fcf69 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:15.531775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe39f1-681e-4704-81d4-5160fc2fcf69 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:15.533123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe39f1-681e-4704-81d4-5160fc2fcf69 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:15.542658 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-9abe39f1-681e-4704-81d4-5160fc2fcf69 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 04 00:46:15.542658 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:15.542658 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 04 00:46:15.542658 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 04 00:46:15.542658 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 04 00:46:15.542658 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 04 00:46:15.542658 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 04 00:46:15.542658 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:15.542658 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 04 00:46:15.542658 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:15.542658 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 00:46:15.542658 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:15.542658 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:15.542658 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:15.542658 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:15.542658 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:15.543588 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:15.543588 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:15.543588 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:15.543588 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:15.543588 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:15.543588 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:15.543588 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:15.543588 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 04 00:46:15.543588 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 04 00:46:15.543588 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 04 00:46:15.543588 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 04 00:46:15.543588 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:15.543588 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:15.543588 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:15.543588 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:15.543588 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:15.543588 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:15.544515 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:15.544515 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:15.544515 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:15.544515 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:15.544515 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:15.544515 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:15.544515 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:15.544515 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:15.544515 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:15.544515 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:15.544515 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 04 00:46:15.544515 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:15.544515 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 04 00:46:15.544515 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:15.544515 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 430/863] 10.222.0.30 () {56 vars in 1132 bytes} [Sun Sep 4 00:46:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:15.545808 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe39f1-681e-4704-81d4-5160fc2fcf69 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:15.572552 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ad92f-372a-4b04-84df-d373f49181a0 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:15.607460 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8f4b5-e3cb-4d85-a25f-a9c1da14e99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:15.608324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8f4b5-e3cb-4d85-a25f-a9c1da14e99a None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:15.608798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8f4b5-e3cb-4d85-a25f-a9c1da14e99a None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:15.609077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8f4b5-e3cb-4d85-a25f-a9c1da14e99a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:15.617689 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8f4b5-e3cb-4d85-a25f-a9c1da14e99a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:15.619130 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8f4b5-e3cb-4d85-a25f-a9c1da14e99a None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:15.631201 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-b0b8f4b5-e3cb-4d85-a25f-a9c1da14e99a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:46:15.631201 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:15.631201 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:15.631201 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:15.631201 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:15.631201 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:15.631201 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:15.631201 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:15.631201 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:15.631201 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:15.631201 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:15.631201 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:15.631201 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 04 00:46:15.631201 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 04 00:46:15.631201 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 04 00:46:15.632660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 04 00:46:15.632660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:15.632660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:15.632660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:15.632660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:15.632660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:15.632660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:15.632660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:15.632660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:15.632660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:15.632660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:15.632660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:15.632660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:15.632660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:15.632660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:15.632660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:15.632660 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:15.633565 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 04 00:46:15.633565 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 04 00:46:15.633565 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 00:46:15.633565 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 00:46:15.633565 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 00:46:15.633565 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 00:46:15.633565 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:46:15.633565 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:15.633565 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 434/864] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:46:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:15.633565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8f4b5-e3cb-4d85-a25f-a9c1da14e99a None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:15.653570 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe39f1-681e-4704-81d4-5160fc2fcf69 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:15.692023 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccba3c-f1df-44a0-89a0-c56fb3c632d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:15.692736 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccba3c-f1df-44a0-89a0-c56fb3c632d2 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:15.693018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccba3c-f1df-44a0-89a0-c56fb3c632d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:15.693291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccba3c-f1df-44a0-89a0-c56fb3c632d2 None admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:15.694005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ccba3c-f1df-44a0-89a0-c56fb3c632d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:15.694885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ccba3c-f1df-44a0-89a0-c56fb3c632d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:15.696619 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ccba3c-f1df-44a0-89a0-c56fb3c632d2 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:15.713563 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 431/865] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Sep 4 00:46:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:15.713563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccba3c-f1df-44a0-89a0-c56fb3c632d2 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:15.713563 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:15.723639 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:15.743761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8f4b5-e3cb-4d85-a25f-a9c1da14e99a None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:15.782630 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b86e5-6f8f-4914-831e-df60281736d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:15.783236 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b86e5-6f8f-4914-831e-df60281736d5 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:15.783518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b86e5-6f8f-4914-831e-df60281736d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:15.783792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b86e5-6f8f-4914-831e-df60281736d5 None admin] PATH_INFO: `/v3/services` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:15.784416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b86e5-6f8f-4914-831e-df60281736d5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:15.784719 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b86e5-6f8f-4914-831e-df60281736d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:15.786799 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b86e5-6f8f-4914-831e-df60281736d5 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:15.795371 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 435/866] 10.222.0.30 () {56 vars in 1126 bytes} [Sun Sep 4 00:46:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:15.795371 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b86e5-6f8f-4914-831e-df60281736d5 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:15.823671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccba3c-f1df-44a0-89a0-c56fb3c632d2 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:15.856071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cac218-a5e3-4037-8d5b-152fc3d4c6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:15.856683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cac218-a5e3-4037-8d5b-152fc3d4c6ab None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:15.856964 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cac218-a5e3-4037-8d5b-152fc3d4c6ab None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:15.857237 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cac218-a5e3-4037-8d5b-152fc3d4c6ab None admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:15.857956 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cac218-a5e3-4037-8d5b-152fc3d4c6ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:15.858348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cac218-a5e3-4037-8d5b-152fc3d4c6ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:15.859683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cac218-a5e3-4037-8d5b-152fc3d4c6ab None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:15.872254 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 432/867] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Sep 4 00:46:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:15.873053 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cac218-a5e3-4037-8d5b-152fc3d4c6ab None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:15.908605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b86e5-6f8f-4914-831e-df60281736d5 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:15.933867 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:15.945851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cfa35-e667-4dfa-b007-ea4f5315db22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:15.946449 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cfa35-e667-4dfa-b007-ea4f5315db22 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:15.946730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cfa35-e667-4dfa-b007-ea4f5315db22 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:15.947000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cfa35-e667-4dfa-b007-ea4f5315db22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:15.947711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580cfa35-e667-4dfa-b007-ea4f5315db22 None admin] RBAC: Adding query filter params (role.id=955481bca39c4b0fab953d506ea3c292, scope.project.id=40b24e92f8594ee08bd2a55f79e3b299, user.id=00543899e82647e8ba187b8d0b60d8c9) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:15.948015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580cfa35-e667-4dfa-b007-ea4f5315db22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:15.949608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580cfa35-e667-4dfa-b007-ea4f5315db22 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:15.965469 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 436/868] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:46:15 2022] GET /identity/v3/role_assignments?user.id=00543899e82647e8ba187b8d0b60d8c9&scope.project.id=40b24e92f8594ee08bd2a55f79e3b299&role.id=955481bca39c4b0fab953d506ea3c292 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:15.965469 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cfa35-e667-4dfa-b007-ea4f5315db22 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:15.983806 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:15.988066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cac218-a5e3-4037-8d5b-152fc3d4c6ab None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:16.035968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16577426-7d58-498a-b416-25319a5c27a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:16.036588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16577426-7d58-498a-b416-25319a5c27a0 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:16.036987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16577426-7d58-498a-b416-25319a5c27a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:16.037256 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16577426-7d58-498a-b416-25319a5c27a0 None admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:16.037913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16577426-7d58-498a-b416-25319a5c27a0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:16.038252 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16577426-7d58-498a-b416-25319a5c27a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:16.039625 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16577426-7d58-498a-b416-25319a5c27a0 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:16.045667 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 433/869] 10.222.0.30 () {56 vars in 1126 bytes} [Sun Sep 4 00:46:15 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:16.097310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cfa35-e667-4dfa-b007-ea4f5315db22 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:16.139017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439a49c-193b-499b-a3da-8d6bfdac4502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:16.139635 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439a49c-193b-499b-a3da-8d6bfdac4502 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:16.139913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439a49c-193b-499b-a3da-8d6bfdac4502 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:16.140188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439a49c-193b-499b-a3da-8d6bfdac4502 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:16.140918 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439a49c-193b-499b-a3da-8d6bfdac4502 None admin] RBAC: Adding query filter params (role.id=d255b03c37d64371a148ec4e11be01d9, scope.project.id=40b24e92f8594ee08bd2a55f79e3b299, user.id=9bcc7a857fad4310896da5a87e71baed) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:16.141231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439a49c-193b-499b-a3da-8d6bfdac4502 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:16.142736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439a49c-193b-499b-a3da-8d6bfdac4502 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:16.150013 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 437/870] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:46:15 2022] GET /identity/v3/role_assignments?user.id=9bcc7a857fad4310896da5a87e71baed&scope.project.id=40b24e92f8594ee08bd2a55f79e3b299&role.id=d255b03c37d64371a148ec4e11be01d9 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:16.811789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7d6a5-f15a-49ef-bc99-05b331e137e2 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:16.812318 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7d6a5-f15a-49ef-bc99-05b331e137e2 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:16.812397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7d6a5-f15a-49ef-bc99-05b331e137e2 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:16.814048 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 434/871] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:16.819926 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6adc9-70a9-4e37-8e54-d3b54fea4ff4 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:16.820211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6adc9-70a9-4e37-8e54-d3b54fea4ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:16.820484 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6adc9-70a9-4e37-8e54-d3b54fea4ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:16.839463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-7aa6adc9-70a9-4e37-8e54-d3b54fea4ff4 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:16.840630 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7aa6adc9-70a9-4e37-8e54-d3b54fea4ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:16.912426 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 438/872] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 04 00:46:17.172650 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7d6a5-f15a-49ef-bc99-05b331e137e2 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:17.287459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7d6a5-f15a-49ef-bc99-05b331e137e2 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:17.315128 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:17.324724 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc350f2-29a3-4550-ba77-22d534e56bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:17.325326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc350f2-29a3-4550-ba77-22d534e56bdd None admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:17.325701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc350f2-29a3-4550-ba77-22d534e56bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:17.325971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc350f2-29a3-4550-ba77-22d534e56bdd None admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:17.326626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc350f2-29a3-4550-ba77-22d534e56bdd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:17.327986 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc350f2-29a3-4550-ba77-22d534e56bdd None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:17.345011 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 435/873] 10.222.0.30 () {60 vars in 1141 bytes} [Sun Sep 4 00:46:17 2022] POST /identity/v3/services => generated 251 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:46:17.999337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad50b2-6209-495c-b733-372e517cb700 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:18.000364 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad50b2-6209-495c-b733-372e517cb700 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:18.000849 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad50b2-6209-495c-b733-372e517cb700 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:18.002679 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 439/874] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:18.007853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841dc370-11ed-4863-a923-ab1429aed673 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:18.008130 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841dc370-11ed-4863-a923-ab1429aed673 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:18.008401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841dc370-11ed-4863-a923-ab1429aed673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:18.010928 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c770f-bbb5-4c30-b4e8-9e6f3937cfcc None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:18.011747 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c770f-bbb5-4c30-b4e8-9e6f3937cfcc None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:18.012235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c770f-bbb5-4c30-b4e8-9e6f3937cfcc None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:18.014001 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 436/875] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:18.020367 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac40c6e-ee75-40ca-89c3-1b5a25be36d7 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:18.020645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac40c6e-ee75-40ca-89c3-1b5a25be36d7 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:18.020911 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac40c6e-ee75-40ca-89c3-1b5a25be36d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:18.029412 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:18.043205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-841dc370-11ed-4863-a923-ab1429aed673 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:18.044389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-841dc370-11ed-4863-a923-ab1429aed673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:18.056752 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-9ac40c6e-ee75-40ca-89c3-1b5a25be36d7 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:18.057938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9ac40c6e-ee75-40ca-89c3-1b5a25be36d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:18.150255 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 437/876] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:18 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 04 00:46:18.151583 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef99b6-4b6b-48d5-bd42-fade1093d8f6 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:18.151867 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef99b6-4b6b-48d5-bd42-fade1093d8f6 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:18.152140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef99b6-4b6b-48d5-bd42-fade1093d8f6 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:18.153595 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 438/877] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:18.154496 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 440/878] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:18 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 04 00:46:18.162632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e5df8-0439-42e6-8956-9785a1ce4d44 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:18.166715 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e5df8-0439-42e6-8956-9785a1ce4d44 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:18.166715 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e5df8-0439-42e6-8956-9785a1ce4d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:18.181920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-f41e5df8-0439-42e6-8956-9785a1ce4d44 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:18.183210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f41e5df8-0439-42e6-8956-9785a1ce4d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:18.253468 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 439/879] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:18 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:46:18.421848 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841dc370-11ed-4863-a923-ab1429aed673 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:18.450273 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e5df8-0439-42e6-8956-9785a1ce4d44 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:18.498445 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:18.552267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841dc370-11ed-4863-a923-ab1429aed673 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:18.560502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e5df8-0439-42e6-8956-9785a1ce4d44 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:18.583741 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:18.589876 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a090748-d140-4766-8ffb-0a9d8f9dd148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:18.590481 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a090748-d140-4766-8ffb-0a9d8f9dd148 None admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:18.590760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a090748-d140-4766-8ffb-0a9d8f9dd148 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:18.591030 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a090748-d140-4766-8ffb-0a9d8f9dd148 None admin] PATH_INFO: `/v3/services` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:18.591679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a090748-d140-4766-8ffb-0a9d8f9dd148 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:18.593056 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a090748-d140-4766-8ffb-0a9d8f9dd148 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:18.597507 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3e8e0-c66a-46f0-9c30-7b196c636d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:18.598453 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3e8e0-c66a-46f0-9c30-7b196c636d0e None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:18.598780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3e8e0-c66a-46f0-9c30-7b196c636d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:18.599169 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3e8e0-c66a-46f0-9c30-7b196c636d0e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:18.610741 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 441/880] 10.222.0.30 () {60 vars in 1141 bytes} [Sun Sep 4 00:46:18 2022] POST /identity/v3/services => generated 269 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:46:18.613175 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3e8e0-c66a-46f0-9c30-7b196c636d0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:46:18.618265 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-9df3e8e0-c66a-46f0-9c30-7b196c636d0e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 04 00:46:18.618265 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:18.618265 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:18.618265 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:18.618265 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:18.618265 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:18.618265 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:18.618265 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:18.618265 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:18.618265 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:18.618265 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:18.618265 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:18.618265 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:46:18.618265 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:46:18.618265 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:46:18.618265 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:46:18.619298 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:46:18.619298 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:46:18.619298 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:46:18.619298 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:46:18.619298 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:18.619298 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:18.619298 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:18.619298 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:18.619298 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:18.619298 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:18.619298 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:18.619298 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:18.619298 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:18.619298 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:18.619298 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:18.619298 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:18.620150 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:18.620150 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:18.620150 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:18.620150 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:18.620150 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:46:18.620150 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:46:18.620150 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:46:18.620150 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:46:18.620150 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:46:18.620150 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:46:18.620150 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 04 00:46:18.620150 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:18.621743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a090748-d140-4766-8ffb-0a9d8f9dd148 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:18.624675 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 440/881] 10.222.0.30 () {56 vars in 1120 bytes} [Sun Sep 4 00:46:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:46:18.626036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3e8e0-c66a-46f0-9c30-7b196c636d0e None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:18.749466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3e8e0-c66a-46f0-9c30-7b196c636d0e None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:18.751406 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:18.765894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a090748-d140-4766-8ffb-0a9d8f9dd148 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:18.790307 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b239de-efb4-4a4b-9f4a-7182cefc79bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:18.790917 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b239de-efb4-4a4b-9f4a-7182cefc79bc None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:18.791198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b239de-efb4-4a4b-9f4a-7182cefc79bc None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:18.791465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b239de-efb4-4a4b-9f4a-7182cefc79bc None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:18.792123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b239de-efb4-4a4b-9f4a-7182cefc79bc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:18.792422 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b239de-efb4-4a4b-9f4a-7182cefc79bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:18.794280 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b239de-efb4-4a4b-9f4a-7182cefc79bc None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:18.805606 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 441/882] 10.222.0.30 () {56 vars in 1115 bytes} [Sun Sep 4 00:46:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:18.807741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120b376-824b-4e0a-b362-cb930b6268de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:18.808361 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b239de-efb4-4a4b-9f4a-7182cefc79bc None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:18.808815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120b376-824b-4e0a-b362-cb930b6268de None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:18.809280 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120b376-824b-4e0a-b362-cb930b6268de None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:18.809785 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120b376-824b-4e0a-b362-cb930b6268de None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:18.810570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120b376-824b-4e0a-b362-cb930b6268de None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:18.813325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120b376-824b-4e0a-b362-cb930b6268de None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:18.825604 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-a120b376-824b-4e0a-b362-cb930b6268de None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 04 00:46:18.825604 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:18.825604 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 04 00:46:18.825604 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 04 00:46:18.825604 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 04 00:46:18.825604 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 04 00:46:18.825604 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 04 00:46:18.825604 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:18.825604 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 04 00:46:18.825604 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:18.825604 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 00:46:18.825604 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:18.825604 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:18.825604 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:18.825604 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:18.825604 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:18.825604 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:18.826789 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:18.826789 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:18.826789 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:18.826789 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:18.826789 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:18.826789 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:18.826789 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 04 00:46:18.826789 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 04 00:46:18.826789 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 04 00:46:18.826789 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 04 00:46:18.826789 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:18.826789 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:18.826789 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:18.826789 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:18.826789 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:18.826789 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:18.827783 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:18.827783 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:18.827783 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:18.827783 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:18.827783 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:18.827783 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:18.827783 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:18.827783 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:18.827783 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:18.827783 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:18.827783 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 04 00:46:18.827783 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:18.827783 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 04 00:46:18.827783 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:18.830186 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 442/883] 10.222.0.30 () {56 vars in 1126 bytes} [Sun Sep 4 00:46:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:18.836464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120b376-824b-4e0a-b362-cb930b6268de None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:18.899110 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:18.936914 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b239de-efb4-4a4b-9f4a-7182cefc79bc None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:18.949657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120b376-824b-4e0a-b362-cb930b6268de None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:18.974508 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300294f-a887-4a02-ac7d-400aa360e064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:18.975644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300294f-a887-4a02-ac7d-400aa360e064 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:18.976231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300294f-a887-4a02-ac7d-400aa360e064 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:18.976697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300294f-a887-4a02-ac7d-400aa360e064 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:18.984492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117e732-7c88-477c-831d-42ec4c27892f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:18.985878 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117e732-7c88-477c-831d-42ec4c27892f None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:18.986385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117e732-7c88-477c-831d-42ec4c27892f None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:18.986887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117e732-7c88-477c-831d-42ec4c27892f None admin] PATH_INFO: `/v3/services` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:18.988028 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7117e732-7c88-477c-831d-42ec4c27892f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:18.988826 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7117e732-7c88-477c-831d-42ec4c27892f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:18.990549 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7117e732-7c88-477c-831d-42ec4c27892f None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:18.991697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300294f-a887-4a02-ac7d-400aa360e064 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:18.993589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300294f-a887-4a02-ac7d-400aa360e064 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:18.996549 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 443/884] 10.222.0.30 () {56 vars in 1122 bytes} [Sun Sep 4 00:46:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:19.002720 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117e732-7c88-477c-831d-42ec4c27892f None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:19.014203 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-a300294f-a887-4a02-ac7d-400aa360e064 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:19.014203 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:19.014203 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:19.014203 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:19.014203 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:19.014203 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:19.014203 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:19.014203 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:19.014203 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:19.014203 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:19.014203 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:19.014203 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:19.014203 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:46:19.014203 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:46:19.014203 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:46:19.014203 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:46:19.015659 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:19.015659 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:19.015659 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:19.015659 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:19.015659 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:19.015659 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:19.015659 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:19.015659 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:19.015659 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:19.015659 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:19.015659 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:19.015659 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:19.015659 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:19.015659 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:19.015659 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:19.015659 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:19.015659 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:46:19.016565 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:46:19.016565 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:19.016565 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:19.022961 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 442/885] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:46:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:46:19.024514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300294f-a887-4a02-ac7d-400aa360e064 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:19.044834 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:19.120978 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117e732-7c88-477c-831d-42ec4c27892f None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:19.135640 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300294f-a887-4a02-ac7d-400aa360e064 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:19.138919 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:19.161943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec2c45-570a-4ee2-8cd7-e3dcb6cd6d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:19.163511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec2c45-570a-4ee2-8cd7-e3dcb6cd6d15 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:19.164130 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec2c45-570a-4ee2-8cd7-e3dcb6cd6d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:19.164607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec2c45-570a-4ee2-8cd7-e3dcb6cd6d15 None admin] PATH_INFO: `/v3/services` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:19.165455 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec2c45-570a-4ee2-8cd7-e3dcb6cd6d15 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:19.165983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec2c45-570a-4ee2-8cd7-e3dcb6cd6d15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:19.167700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec2c45-570a-4ee2-8cd7-e3dcb6cd6d15 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:19.171791 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c4063-637d-42d4-a7fb-648da662e11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:19.172402 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c4063-637d-42d4-a7fb-648da662e11e None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:19.172675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c4063-637d-42d4-a7fb-648da662e11e None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:19.172943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c4063-637d-42d4-a7fb-648da662e11e None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:19.173610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c4063-637d-42d4-a7fb-648da662e11e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:19.173972 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c4063-637d-42d4-a7fb-648da662e11e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:19.174407 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 444/886] 10.222.0.30 () {56 vars in 1122 bytes} [Sun Sep 4 00:46:19 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:19.179517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c4063-637d-42d4-a7fb-648da662e11e None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:19.194023 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 443/887] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:19.202681 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec2c45-570a-4ee2-8cd7-e3dcb6cd6d15 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:19.274362 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab90964-d415-4ec2-a052-b69afb540645 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:19.274692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab90964-d415-4ec2-a052-b69afb540645 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:19.274906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab90964-d415-4ec2-a052-b69afb540645 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:19.276526 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 444/888] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 04 00:46:19.282010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c42959-fb68-42ea-8227-633424cc19b2 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:19.282291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c42959-fb68-42ea-8227-633424cc19b2 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:19.282562 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c42959-fb68-42ea-8227-633424cc19b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:19.301502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b3c42959-fb68-42ea-8227-633424cc19b2 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:19.302704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b3c42959-fb68-42ea-8227-633424cc19b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:19.324608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec2c45-570a-4ee2-8cd7-e3dcb6cd6d15 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:19.365546 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d013e5-1c90-4964-9934-71b8a1a6c496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:19.366737 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d013e5-1c90-4964-9934-71b8a1a6c496 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:19.367018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d013e5-1c90-4964-9934-71b8a1a6c496 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:19.367289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d013e5-1c90-4964-9934-71b8a1a6c496 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:19.379171 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d013e5-1c90-4964-9934-71b8a1a6c496 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:19.380841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d013e5-1c90-4964-9934-71b8a1a6c496 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:19.393187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-27d013e5-1c90-4964-9934-71b8a1a6c496 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 04 00:46:19.393187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:19.393187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:19.393187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:19.393187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:19.393187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:19.393187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:19.393187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:19.393187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:19.393187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:19.393187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:19.393187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:19.393187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 04 00:46:19.393187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 04 00:46:19.393187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 04 00:46:19.393187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 04 00:46:19.394152 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:19.394152 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:19.394152 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 00:46:19.394152 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:46:19.394152 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 00:46:19.394152 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:46:19.394152 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:19.394152 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:19.394152 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:19.394152 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:19.394152 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:19.394152 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:19.394152 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:19.394152 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:19.394152 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:19.394152 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:19.394152 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:19.394152 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:19.395069 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:19.395069 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:19.395069 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 00:46:19.395069 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 00:46:19.395069 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 00:46:19.395069 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 00:46:19.395069 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 00:46:19.395069 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 00:46:19.395069 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 04 00:46:19.395069 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:19.399086 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 445/889] 10.222.0.30 () {56 vars in 1117 bytes} [Sun Sep 4 00:46:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:19.400257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d013e5-1c90-4964-9934-71b8a1a6c496 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:19.400837 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 445/890] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:19 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 04 00:46:19.445945 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:19.505660 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d013e5-1c90-4964-9934-71b8a1a6c496 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:19.541274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7682a9e7-2fc1-479e-9ffb-500058a9d215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:19.541909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682a9e7-2fc1-479e-9ffb-500058a9d215 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:19.542188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682a9e7-2fc1-479e-9ffb-500058a9d215 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:19.542512 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682a9e7-2fc1-479e-9ffb-500058a9d215 None admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:19.543226 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7682a9e7-2fc1-479e-9ffb-500058a9d215 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:19.543579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7682a9e7-2fc1-479e-9ffb-500058a9d215 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:19.545000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7682a9e7-2fc1-479e-9ffb-500058a9d215 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:19.565621 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 446/891] 10.222.0.30 () {56 vars in 1149 bytes} [Sun Sep 4 00:46:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:19.568676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c42959-fb68-42ea-8227-633424cc19b2 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:19.577745 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:19.675451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c42959-fb68-42ea-8227-633424cc19b2 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:19.697848 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7682a9e7-2fc1-479e-9ffb-500058a9d215 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:19.713195 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07172953-8e76-495f-9731-a48f59aab285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:19.714195 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07172953-8e76-495f-9731-a48f59aab285 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:19.714680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07172953-8e76-495f-9731-a48f59aab285 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:19.715168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07172953-8e76-495f-9731-a48f59aab285 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:19.790753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07172953-8e76-495f-9731-a48f59aab285 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:19.792810 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07172953-8e76-495f-9731-a48f59aab285 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:19.802395 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:19.807787 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:19.813752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7682a9e7-2fc1-479e-9ffb-500058a9d215 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:19.851869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f166a53-9c8a-4b43-9409-4644ee8dc906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:19.852850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f166a53-9c8a-4b43-9409-4644ee8dc906 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:19.853228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f166a53-9c8a-4b43-9409-4644ee8dc906 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:19.853623 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f166a53-9c8a-4b43-9409-4644ee8dc906 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:19.854347 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f166a53-9c8a-4b43-9409-4644ee8dc906 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:19.855911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f166a53-9c8a-4b43-9409-4644ee8dc906 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:19.865787 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-5f166a53-9c8a-4b43-9409-4644ee8dc906 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 04 00:46:19.865787 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:19.865787 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 04 00:46:19.865787 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 04 00:46:19.865787 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 04 00:46:19.865787 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 04 00:46:19.865787 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 04 00:46:19.865787 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:19.865787 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 04 00:46:19.865787 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:19.865787 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 00:46:19.865787 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:19.865787 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:19.865787 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:19.865787 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:19.865787 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:19.865787 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:19.866981 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:19.866981 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:19.866981 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:19.866981 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:19.866981 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:19.866981 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:19.866981 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 04 00:46:19.866981 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 04 00:46:19.866981 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 04 00:46:19.866981 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 04 00:46:19.866981 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:19.866981 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:19.866981 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:19.866981 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:19.866981 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:19.866981 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:19.867980 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:19.867980 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:19.867980 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:19.867980 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:19.867980 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:19.867980 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:19.867980 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:19.867980 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:19.867980 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:19.867980 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:19.867980 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 04 00:46:19.867980 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:19.867980 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 04 00:46:19.867980 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:19.873469 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 447/892] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Sep 4 00:46:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:46:19.875931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f166a53-9c8a-4b43-9409-4644ee8dc906 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:19.926549 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 446/893] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:46:19 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 04 00:46:19.927874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07172953-8e76-495f-9731-a48f59aab285 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:20.005902 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f166a53-9c8a-4b43-9409-4644ee8dc906 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:20.029768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07172953-8e76-495f-9731-a48f59aab285 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:20.037767 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:20.054460 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c52ccf-e0f1-4694-8b8a-199b8712a6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:20.055660 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c52ccf-e0f1-4694-8b8a-199b8712a6bc None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:20.056152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c52ccf-e0f1-4694-8b8a-199b8712a6bc None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:20.056779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c52ccf-e0f1-4694-8b8a-199b8712a6bc None admin] PATH_INFO: `/v3/services` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:20.058009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c52ccf-e0f1-4694-8b8a-199b8712a6bc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:20.058718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c52ccf-e0f1-4694-8b8a-199b8712a6bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:20.060909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c52ccf-e0f1-4694-8b8a-199b8712a6bc None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:20.072472 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 448/894] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Sep 4 00:46:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:20.073837 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c52ccf-e0f1-4694-8b8a-199b8712a6bc None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:20.073948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb010798-5b19-4410-ad31-73e7018256f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:20.074897 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb010798-5b19-4410-ad31-73e7018256f3 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:20.075390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb010798-5b19-4410-ad31-73e7018256f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:20.075849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb010798-5b19-4410-ad31-73e7018256f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:20.090820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb010798-5b19-4410-ad31-73e7018256f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:20.093081 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb010798-5b19-4410-ad31-73e7018256f3 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:20.104056 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:20.114883 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-bb010798-5b19-4410-ad31-73e7018256f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:20.114883 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:20.114883 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:20.114883 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:20.114883 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:20.114883 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:20.114883 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:20.114883 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:20.114883 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:20.114883 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:20.114883 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:20.114883 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:20.114883 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:46:20.114883 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:46:20.114883 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:46:20.114883 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:46:20.115799 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:20.115799 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:20.115799 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:20.115799 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:20.115799 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:20.115799 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:20.115799 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:20.115799 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:20.115799 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:20.115799 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:20.115799 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:20.115799 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:20.115799 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:20.115799 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:20.115799 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:20.115799 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:20.115799 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:46:20.116796 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:46:20.116796 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:20.116796 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:20.120863 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 447/895] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:46:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:20.122220 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb010798-5b19-4410-ad31-73e7018256f3 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:20.201300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c52ccf-e0f1-4694-8b8a-199b8712a6bc None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:20.229491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb010798-5b19-4410-ad31-73e7018256f3 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:20.251652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb075bd7-4e79-460b-b11b-b0b5b0b40d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:20.252323 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb075bd7-4e79-460b-b11b-b0b5b0b40d11 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:20.252607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb075bd7-4e79-460b-b11b-b0b5b0b40d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:20.253392 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb075bd7-4e79-460b-b11b-b0b5b0b40d11 None admin] PATH_INFO: `/v3/services` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:20.254058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb075bd7-4e79-460b-b11b-b0b5b0b40d11 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:20.254365 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb075bd7-4e79-460b-b11b-b0b5b0b40d11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:20.256333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb075bd7-4e79-460b-b11b-b0b5b0b40d11 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:20.265600 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 449/896] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Sep 4 00:46:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:20.269956 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb075bd7-4e79-460b-b11b-b0b5b0b40d11 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:20.275284 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65014e3e-2d1f-41d9-8441-72fe55b387fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:20.275284 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65014e3e-2d1f-41d9-8441-72fe55b387fa None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:20.275498 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65014e3e-2d1f-41d9-8441-72fe55b387fa None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:20.275679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65014e3e-2d1f-41d9-8441-72fe55b387fa None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:20.276296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65014e3e-2d1f-41d9-8441-72fe55b387fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:20.276602 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65014e3e-2d1f-41d9-8441-72fe55b387fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:20.278058 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65014e3e-2d1f-41d9-8441-72fe55b387fa None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:20.295090 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 448/897] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:20.296386 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65014e3e-2d1f-41d9-8441-72fe55b387fa None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:20.317723 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:20.400249 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:20.413915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb075bd7-4e79-460b-b11b-b0b5b0b40d11 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:20.414137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65014e3e-2d1f-41d9-8441-72fe55b387fa None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:20.455098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5885c-781a-48ff-b3a5-e646f23f8c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:20.455804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5885c-781a-48ff-b3a5-e646f23f8c2f None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:20.456178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5885c-781a-48ff-b3a5-e646f23f8c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:20.456544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5885c-781a-48ff-b3a5-e646f23f8c2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:20.458050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81fcf73-9a50-4e40-90dc-dff3408f7759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:20.460023 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fcf73-9a50-4e40-90dc-dff3408f7759 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:20.460648 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fcf73-9a50-4e40-90dc-dff3408f7759 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:20.461105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fcf73-9a50-4e40-90dc-dff3408f7759 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:20.462085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81fcf73-9a50-4e40-90dc-dff3408f7759 None admin] RBAC: Adding query filter params (interface=public, service_id=c5737234317b47778cf5655bd74d0185, region_id=RegionOne) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:20.462559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81fcf73-9a50-4e40-90dc-dff3408f7759 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:20.464220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81fcf73-9a50-4e40-90dc-dff3408f7759 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:20.465082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5885c-781a-48ff-b3a5-e646f23f8c2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:20.466820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5885c-781a-48ff-b3a5-e646f23f8c2f None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:20.475371 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 450/898] 10.222.0.30 () {56 vars in 1251 bytes} [Sun Sep 4 00:46:20 2022] GET /identity/v3/endpoints?service_id=c5737234317b47778cf5655bd74d0185&interface=public®ion_id=RegionOne => generated 194 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:20.476757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81fcf73-9a50-4e40-90dc-dff3408f7759 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:20.482533 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-81c5885c-781a-48ff-b3a5-e646f23f8c2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:46:20.482533 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:20.482533 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:20.482533 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:20.482533 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:20.482533 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:20.482533 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:20.482533 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:20.482533 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:20.482533 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:20.482533 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:20.482533 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:20.482533 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 04 00:46:20.482533 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 04 00:46:20.482533 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 04 00:46:20.483397 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 04 00:46:20.483397 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:20.483397 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:20.483397 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:20.483397 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:20.483397 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:20.483397 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:20.483397 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:20.483397 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:20.483397 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:20.483397 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:20.483397 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:20.483397 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:20.483397 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:20.483397 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:20.483397 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:20.483397 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:20.484299 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 04 00:46:20.484299 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 04 00:46:20.484299 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 00:46:20.484299 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 00:46:20.484299 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 00:46:20.484299 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 00:46:20.484299 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:46:20.484299 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:20.489059 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 449/899] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:46:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:20.490544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5885c-781a-48ff-b3a5-e646f23f8c2f None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:20.576064 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:20.597005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81fcf73-9a50-4e40-90dc-dff3408f7759 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:20.600869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5885c-781a-48ff-b3a5-e646f23f8c2f None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:20.634790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07bf27c-2d4a-43dc-9d09-9c9146768f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:20.635886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bf27c-2d4a-43dc-9d09-9c9146768f37 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:20.636432 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bf27c-2d4a-43dc-9d09-9c9146768f37 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:20.636961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bf27c-2d4a-43dc-9d09-9c9146768f37 None admin] PATH_INFO: `/v3/services` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:20.637909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07bf27c-2d4a-43dc-9d09-9c9146768f37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:20.638474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccda6e4-35bf-40b2-9495-137a2f48e4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:20.639310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccda6e4-35bf-40b2-9495-137a2f48e4e8 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:20.639589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccda6e4-35bf-40b2-9495-137a2f48e4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:20.639861 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccda6e4-35bf-40b2-9495-137a2f48e4e8 None admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:20.639962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07bf27c-2d4a-43dc-9d09-9c9146768f37 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:20.640557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccda6e4-35bf-40b2-9495-137a2f48e4e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:20.640862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccda6e4-35bf-40b2-9495-137a2f48e4e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:20.642368 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccda6e4-35bf-40b2-9495-137a2f48e4e8 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:20.646164 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 451/900] 10.222.0.30 () {56 vars in 1087 bytes} [Sun Sep 4 00:46:20 2022] GET /identity/v3/services => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 00:46:20.651009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7deec1-3d22-43b3-8862-d9954b60e448 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:20.651592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7deec1-3d22-43b3-8862-d9954b60e448 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:20.652068 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7deec1-3d22-43b3-8862-d9954b60e448 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:20.654159 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 452/901] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:20.660167 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f1889-622b-4d24-82ca-f106fde15ac7 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:20.660809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f1889-622b-4d24-82ca-f106fde15ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:20.661286 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f1889-622b-4d24-82ca-f106fde15ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:20.662628 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 450/902] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Sep 4 00:46:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:20.664646 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccda6e4-35bf-40b2-9495-137a2f48e4e8 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:20.683006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-eb4f1889-622b-4d24-82ca-f106fde15ac7 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:20.684574 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-eb4f1889-622b-4d24-82ca-f106fde15ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:20.703401 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:20.774017 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 453/903] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:20 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:46:20.780766 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccda6e4-35bf-40b2-9495-137a2f48e4e8 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:20.817781 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18f54e-e2b5-4ba4-8c29-0206fcb520e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:20.818390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18f54e-e2b5-4ba4-8c29-0206fcb520e0 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:20.818671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18f54e-e2b5-4ba4-8c29-0206fcb520e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:20.818943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18f54e-e2b5-4ba4-8c29-0206fcb520e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:20.819706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f18f54e-e2b5-4ba4-8c29-0206fcb520e0 None admin] RBAC: Adding query filter params (role.id=fd671e98e0424c60995238aaa9dcdd5d, scope.project.id=40b24e92f8594ee08bd2a55f79e3b299, user.id=00543899e82647e8ba187b8d0b60d8c9) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:20.820013 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f18f54e-e2b5-4ba4-8c29-0206fcb520e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:20.821546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f18f54e-e2b5-4ba4-8c29-0206fcb520e0 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:20.828127 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 451/904] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:46:20 2022] GET /identity/v3/role_assignments?user.id=00543899e82647e8ba187b8d0b60d8c9&scope.project.id=40b24e92f8594ee08bd2a55f79e3b299&role.id=fd671e98e0424c60995238aaa9dcdd5d => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:21.045635 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f1889-622b-4d24-82ca-f106fde15ac7 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:21.150535 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f1889-622b-4d24-82ca-f106fde15ac7 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:21.177954 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a827ed-77f4-4971-bf58-81491dc60697 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:21.178500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a827ed-77f4-4971-bf58-81491dc60697 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:21.178584 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a827ed-77f4-4971-bf58-81491dc60697 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:21.180173 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 452/905] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:21.185038 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac912a-10f7-4aae-b57e-2a0fbd13689f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:21.185323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac912a-10f7-4aae-b57e-2a0fbd13689f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:21.185629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac912a-10f7-4aae-b57e-2a0fbd13689f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:21.186997 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329b276-0151-4462-9dd7-b308e3465708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:21.187631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329b276-0151-4462-9dd7-b308e3465708 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:21.187912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329b276-0151-4462-9dd7-b308e3465708 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:21.188187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329b276-0151-4462-9dd7-b308e3465708 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:21.188776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f329b276-0151-4462-9dd7-b308e3465708 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:21.190181 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f329b276-0151-4462-9dd7-b308e3465708 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:21.193736 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:21.199461 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-f329b276-0151-4462-9dd7-b308e3465708 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 04 00:46:21.199461 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:21.199461 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 04 00:46:21.199461 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 04 00:46:21.199461 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 04 00:46:21.199461 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 04 00:46:21.199461 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 04 00:46:21.199461 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:21.199461 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 04 00:46:21.199461 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:21.199461 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 00:46:21.199461 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:21.199461 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:21.199461 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:21.199461 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:21.199461 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:21.200880 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:21.200880 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:21.200880 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:21.200880 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:21.200880 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:21.200880 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:21.200880 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:21.200880 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 04 00:46:21.200880 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 04 00:46:21.200880 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 04 00:46:21.200880 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 04 00:46:21.200880 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:21.200880 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:21.200880 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:21.200880 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:21.200880 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:21.200880 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:21.201840 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:21.201840 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:21.201840 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:21.201840 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:21.201840 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:21.201840 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:21.201840 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:21.201840 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:21.201840 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:21.201840 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:21.201840 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 04 00:46:21.201840 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:21.201840 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 04 00:46:21.201840 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:21.201840 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 454/906] 10.222.0.30 () {56 vars in 1132 bytes} [Sun Sep 4 00:46:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:21.206647 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329b276-0151-4462-9dd7-b308e3465708 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:21.209347 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-45ac912a-10f7-4aae-b57e-2a0fbd13689f None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:21.211311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-45ac912a-10f7-4aae-b57e-2a0fbd13689f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:21.222815 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:21.287487 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 453/907] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:21 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 04 00:46:21.314912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329b276-0151-4462-9dd7-b308e3465708 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:21.350951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b89c5-3d40-458e-91b5-faafc5046eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:21.351561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b89c5-3d40-458e-91b5-faafc5046eb8 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:21.351842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b89c5-3d40-458e-91b5-faafc5046eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:21.352117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b89c5-3d40-458e-91b5-faafc5046eb8 None admin] PATH_INFO: `/v3/services` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:21.352746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b89c5-3d40-458e-91b5-faafc5046eb8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:21.353050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b89c5-3d40-458e-91b5-faafc5046eb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:21.354458 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b89c5-3d40-458e-91b5-faafc5046eb8 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:21.359519 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 455/908] 10.222.0.30 () {56 vars in 1126 bytes} [Sun Sep 4 00:46:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:21.365362 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac912a-10f7-4aae-b57e-2a0fbd13689f None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:21.476877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac912a-10f7-4aae-b57e-2a0fbd13689f None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:21.507296 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:21.517546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb1279-a24d-4c3e-8c72-f2eacfab467f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:21.518441 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb1279-a24d-4c3e-8c72-f2eacfab467f None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:21.518938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb1279-a24d-4c3e-8c72-f2eacfab467f None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:21.519409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb1279-a24d-4c3e-8c72-f2eacfab467f None admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:21.520251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb1279-a24d-4c3e-8c72-f2eacfab467f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:21.521016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb1279-a24d-4c3e-8c72-f2eacfab467f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:21.523163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb1279-a24d-4c3e-8c72-f2eacfab467f None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:21.528914 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 454/909] 10.222.0.30 () {56 vars in 1126 bytes} [Sun Sep 4 00:46:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:21.534458 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b89c5-3d40-458e-91b5-faafc5046eb8 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:21.568742 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb1279-a24d-4c3e-8c72-f2eacfab467f None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:21.622733 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:21.648790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b89c5-3d40-458e-91b5-faafc5046eb8 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:21.687297 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77652b90-a156-4d3f-a388-271251098614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:21.688297 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77652b90-a156-4d3f-a388-271251098614 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:21.688795 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77652b90-a156-4d3f-a388-271251098614 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:21.689280 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77652b90-a156-4d3f-a388-271251098614 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:21.690213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77652b90-a156-4d3f-a388-271251098614 None admin] RBAC: Adding query filter params (interface=public, service_id=b78afb6c555246d3a826bf6a8cd5c89e, region_id=RegionOne) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:21.690723 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77652b90-a156-4d3f-a388-271251098614 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:21.692299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77652b90-a156-4d3f-a388-271251098614 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:21.699243 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 456/910] 10.222.0.30 () {56 vars in 1251 bytes} [Sun Sep 4 00:46:21 2022] GET /identity/v3/endpoints?service_id=b78afb6c555246d3a826bf6a8cd5c89e&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:21.705422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77652b90-a156-4d3f-a388-271251098614 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:21.708906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb1279-a24d-4c3e-8c72-f2eacfab467f None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:21.746096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9cf29-3a28-4c07-a9e5-fb2223986cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:21.746457 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9cf29-3a28-4c07-a9e5-fb2223986cd9 None admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:21.746650 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9cf29-3a28-4c07-a9e5-fb2223986cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:21.746912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9cf29-3a28-4c07-a9e5-fb2223986cd9 None admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:21.747580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9cf29-3a28-4c07-a9e5-fb2223986cd9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:21.748942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9cf29-3a28-4c07-a9e5-fb2223986cd9 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:21.767071 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 455/911] 10.222.0.30 () {60 vars in 1141 bytes} [Sun Sep 4 00:46:21 2022] POST /identity/v3/services => generated 241 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 00:46:21.827993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77652b90-a156-4d3f-a388-271251098614 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:21.875773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702b06f-22cf-4e43-b44f-5429edcd5a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:21.876707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702b06f-22cf-4e43-b44f-5429edcd5a90 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:21.877172 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702b06f-22cf-4e43-b44f-5429edcd5a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:21.877652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702b06f-22cf-4e43-b44f-5429edcd5a90 None admin] PATH_INFO: `/v3/services` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:21.878478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f702b06f-22cf-4e43-b44f-5429edcd5a90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:21.880199 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f702b06f-22cf-4e43-b44f-5429edcd5a90 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:21.889489 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:21.893761 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 457/912] 10.222.0.30 () {56 vars in 1087 bytes} [Sun Sep 4 00:46:21 2022] GET /identity/v3/services => generated 1497 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 00:46:22.602443 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859dc27-8c7f-46dc-a057-6277d6151e3f None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:22.602991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859dc27-8c7f-46dc-a057-6277d6151e3f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:22.602991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859dc27-8c7f-46dc-a057-6277d6151e3f None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:22.604563 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 456/913] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:22.609688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff43125-fdd2-4e0a-b96e-97391938a996 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:22.610325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff43125-fdd2-4e0a-b96e-97391938a996 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:22.610490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff43125-fdd2-4e0a-b96e-97391938a996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:22.628488 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-4ff43125-fdd2-4e0a-b96e-97391938a996 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:22.629686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4ff43125-fdd2-4e0a-b96e-97391938a996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:22.698239 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 458/914] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:46:22.815048 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f09f81-080e-41d9-a976-05c9def3339f None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:22.815392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f09f81-080e-41d9-a976-05c9def3339f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:22.815518 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f09f81-080e-41d9-a976-05c9def3339f None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:22.817100 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 457/915] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:22.822728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42004f6-41b7-43ad-8fce-44a5a34560f6 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:22.823019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42004f6-41b7-43ad-8fce-44a5a34560f6 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:22.823298 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42004f6-41b7-43ad-8fce-44a5a34560f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:22.842117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c42004f6-41b7-43ad-8fce-44a5a34560f6 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:22.843295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c42004f6-41b7-43ad-8fce-44a5a34560f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:22.914721 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 459/916] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:46:22.965270 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f09f81-080e-41d9-a976-05c9def3339f None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:23.027630 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:23.074099 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f09f81-080e-41d9-a976-05c9def3339f None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:23.108918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01db8b-a6cc-4d0e-a940-17d46150cebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:23.110021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01db8b-a6cc-4d0e-a940-17d46150cebb None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:23.110445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01db8b-a6cc-4d0e-a940-17d46150cebb None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:23.110857 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01db8b-a6cc-4d0e-a940-17d46150cebb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:23.111607 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01db8b-a6cc-4d0e-a940-17d46150cebb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:23.113102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01db8b-a6cc-4d0e-a940-17d46150cebb None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:23.122129 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-fb01db8b-a6cc-4d0e-a940-17d46150cebb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 04 00:46:23.122129 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:23.122129 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 04 00:46:23.122129 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 04 00:46:23.122129 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 04 00:46:23.122129 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 04 00:46:23.122129 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 04 00:46:23.122129 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:23.122129 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 04 00:46:23.122129 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:23.122129 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 00:46:23.122129 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:23.122129 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:23.122129 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:23.122129 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:23.122129 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:23.122129 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:23.123260 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:23.123260 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:23.123260 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:23.123260 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:23.123260 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:23.123260 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:23.123260 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 04 00:46:23.123260 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 04 00:46:23.123260 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 04 00:46:23.123260 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 04 00:46:23.123260 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:23.123260 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:23.123260 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:23.123260 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:23.123260 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:23.123260 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:23.124249 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:23.124249 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:23.124249 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:23.124249 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:23.124249 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:23.124249 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:23.124249 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:23.124249 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:23.124249 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:23.124249 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:23.124249 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 04 00:46:23.124249 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:23.124249 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 04 00:46:23.124249 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:23.126586 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 458/917] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Sep 4 00:46:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:23.135049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42004f6-41b7-43ad-8fce-44a5a34560f6 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:23.191096 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:23.210809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01db8b-a6cc-4d0e-a940-17d46150cebb None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:23.233328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42004f6-41b7-43ad-8fce-44a5a34560f6 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:23.275776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a210e3-565c-4ecb-8b9e-dc0c72637e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:23.276511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a210e3-565c-4ecb-8b9e-dc0c72637e49 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:23.276801 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a210e3-565c-4ecb-8b9e-dc0c72637e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:23.277090 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a210e3-565c-4ecb-8b9e-dc0c72637e49 None admin] PATH_INFO: `/v3/services` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:23.277880 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a210e3-565c-4ecb-8b9e-dc0c72637e49 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:23.278239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a210e3-565c-4ecb-8b9e-dc0c72637e49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:23.279750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a210e3-565c-4ecb-8b9e-dc0c72637e49 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:23.285257 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 460/918] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Sep 4 00:46:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:23.290547 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a210e3-565c-4ecb-8b9e-dc0c72637e49 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:23.320819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01db8b-a6cc-4d0e-a940-17d46150cebb None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:23.342373 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:23.358885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7925a2-672d-4478-8b08-e5661084988c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:23.359688 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7925a2-672d-4478-8b08-e5661084988c None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:23.360307 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7925a2-672d-4478-8b08-e5661084988c None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:23.360719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7925a2-672d-4478-8b08-e5661084988c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:23.372084 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7925a2-672d-4478-8b08-e5661084988c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:46:23.377457 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-ec7925a2-672d-4478-8b08-e5661084988c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 04 00:46:23.377457 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:23.377457 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:23.377457 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:23.377457 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:23.377457 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:23.377457 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:23.377457 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:23.377457 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:23.377457 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:23.377457 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:23.377457 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:23.377457 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:46:23.377457 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:46:23.377457 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:46:23.377457 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:46:23.378402 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:46:23.378402 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:46:23.378402 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:46:23.378402 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:46:23.378402 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:23.378402 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:23.378402 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:23.378402 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:23.378402 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:23.378402 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:23.378402 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:23.378402 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:23.378402 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:23.378402 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:23.378402 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:23.378402 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:23.379235 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:23.379235 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:23.379235 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:23.379235 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:23.379235 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:46:23.379235 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:46:23.379235 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:46:23.379235 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:46:23.379235 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:46:23.379235 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:46:23.379235 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 04 00:46:23.379235 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:23.384734 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 459/919] 10.222.0.30 () {56 vars in 1120 bytes} [Sun Sep 4 00:46:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:46:23.386471 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7925a2-672d-4478-8b08-e5661084988c None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:23.409858 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a210e3-565c-4ecb-8b9e-dc0c72637e49 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:23.452021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf47b57-3332-474e-87d3-abe181fcbacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:23.452794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf47b57-3332-474e-87d3-abe181fcbacb None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:23.453006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf47b57-3332-474e-87d3-abe181fcbacb None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:23.453196 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf47b57-3332-474e-87d3-abe181fcbacb None admin] PATH_INFO: `/v3/services` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:23.453871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf47b57-3332-474e-87d3-abe181fcbacb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:23.454198 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf47b57-3332-474e-87d3-abe181fcbacb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:23.454828 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:23.462443 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf47b57-3332-474e-87d3-abe181fcbacb None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:23.472311 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 461/920] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Sep 4 00:46:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:23.477526 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf47b57-3332-474e-87d3-abe181fcbacb None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:23.519229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7925a2-672d-4478-8b08-e5661084988c None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:23.559511 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336d9f1-604d-4122-8912-cdf9537d4309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:23.560112 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336d9f1-604d-4122-8912-cdf9537d4309 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:23.560385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336d9f1-604d-4122-8912-cdf9537d4309 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:23.560652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336d9f1-604d-4122-8912-cdf9537d4309 None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:23.561309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d336d9f1-604d-4122-8912-cdf9537d4309 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:23.561627 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d336d9f1-604d-4122-8912-cdf9537d4309 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:23.562990 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d336d9f1-604d-4122-8912-cdf9537d4309 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:23.572596 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 460/921] 10.222.0.30 () {56 vars in 1115 bytes} [Sun Sep 4 00:46:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:23.578210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336d9f1-604d-4122-8912-cdf9537d4309 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:23.618892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf47b57-3332-474e-87d3-abe181fcbacb None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:23.631482 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:23.670153 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca75e0-f1af-40ad-a8b2-abce4234ec18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:23.671188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca75e0-f1af-40ad-a8b2-abce4234ec18 None admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:23.671690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca75e0-f1af-40ad-a8b2-abce4234ec18 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:23.672176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca75e0-f1af-40ad-a8b2-abce4234ec18 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:23.673073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca75e0-f1af-40ad-a8b2-abce4234ec18 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:23.674682 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca75e0-f1af-40ad-a8b2-abce4234ec18 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:23.701779 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 462/922] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 00:46:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:46:23.703468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336d9f1-604d-4122-8912-cdf9537d4309 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:23.749289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e5d4e-c73b-4d0e-9a80-3499bdd5807c None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:23.749648 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e5d4e-c73b-4d0e-9a80-3499bdd5807c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:23.749877 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e5d4e-c73b-4d0e-9a80-3499bdd5807c None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:23.758692 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 463/923] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:23 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 04 00:46:23.760725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e9938-b77c-4327-a09b-c99747ac8cfc None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:23.761013 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e9938-b77c-4327-a09b-c99747ac8cfc None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:23.761333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e9938-b77c-4327-a09b-c99747ac8cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:23.780536 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31bc2db-9f86-40f6-9a26-4b1966885f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:23.781334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bc2db-9f86-40f6-9a26-4b1966885f05 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:23.781701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bc2db-9f86-40f6-9a26-4b1966885f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:23.781984 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bc2db-9f86-40f6-9a26-4b1966885f05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:23.783914 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-f93e9938-b77c-4327-a09b-c99747ac8cfc None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:23.785208 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f93e9938-b77c-4327-a09b-c99747ac8cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:23.798536 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31bc2db-9f86-40f6-9a26-4b1966885f05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:23.800213 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31bc2db-9f86-40f6-9a26-4b1966885f05 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:23.819607 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-e31bc2db-9f86-40f6-9a26-4b1966885f05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:23.819607 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:23.819607 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:23.819607 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:23.819607 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:23.819607 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:23.819607 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:23.819607 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:23.819607 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:23.819607 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:23.819607 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:23.819607 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:23.819607 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:46:23.819607 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:46:23.819607 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:46:23.819607 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:46:23.820612 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:23.820612 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:23.820612 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:23.820612 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:23.820612 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:23.820612 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:23.820612 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:23.820612 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:23.820612 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:23.820612 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:23.820612 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:23.820612 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:23.820612 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:23.820612 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:23.820612 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:23.820612 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:23.820612 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:46:23.821565 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:46:23.821565 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:23.821565 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:23.827192 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 461/924] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:46:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:23.829312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31bc2db-9f86-40f6-9a26-4b1966885f05 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:23.845181 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:23.877164 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 464/925] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:46:23.962889 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:23.973735 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31bc2db-9f86-40f6-9a26-4b1966885f05 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:23.986098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59489e62-a8e2-471e-ad1d-b7a7ab4fa88f None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:23.986405 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59489e62-a8e2-471e-ad1d-b7a7ab4fa88f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:23.986646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59489e62-a8e2-471e-ad1d-b7a7ab4fa88f None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:23.988133 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 465/926] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 04 00:46:23.993329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae8293-fe6f-4e5d-8ad3-183621746ef6 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:23.993712 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae8293-fe6f-4e5d-8ad3-183621746ef6 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:23.994060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae8293-fe6f-4e5d-8ad3-183621746ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:24.013149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511d004-3912-4ef0-8931-5dc66e2ddd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:24.013875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511d004-3912-4ef0-8931-5dc66e2ddd3f None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:24.014158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511d004-3912-4ef0-8931-5dc66e2ddd3f None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:24.014424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511d004-3912-4ef0-8931-5dc66e2ddd3f None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:24.015062 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d511d004-3912-4ef0-8931-5dc66e2ddd3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:24.015242 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-1aae8293-fe6f-4e5d-8ad3-183621746ef6 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:24.015349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d511d004-3912-4ef0-8931-5dc66e2ddd3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:24.016601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1aae8293-fe6f-4e5d-8ad3-183621746ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:24.016775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d511d004-3912-4ef0-8931-5dc66e2ddd3f None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:24.032334 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 462/927] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:24.038678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511d004-3912-4ef0-8931-5dc66e2ddd3f None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:24.113507 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 466/928] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 04 00:46:24.165695 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511d004-3912-4ef0-8931-5dc66e2ddd3f None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:24.176751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae8293-fe6f-4e5d-8ad3-183621746ef6 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:24.210460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29602e7-d6a4-4b5f-87ba-7a95f8c965ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:24.210832 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29602e7-d6a4-4b5f-87ba-7a95f8c965ab None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:24.212389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29602e7-d6a4-4b5f-87ba-7a95f8c965ab None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:24.212389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29602e7-d6a4-4b5f-87ba-7a95f8c965ab None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:24.226398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29602e7-d6a4-4b5f-87ba-7a95f8c965ab None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:24.228924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29602e7-d6a4-4b5f-87ba-7a95f8c965ab None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:24.245938 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-e29602e7-d6a4-4b5f-87ba-7a95f8c965ab None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 04 00:46:24.245938 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:24.245938 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:24.245938 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:24.245938 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:24.245938 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:24.245938 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:24.245938 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:24.245938 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:24.245938 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:24.245938 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:24.245938 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:24.245938 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 04 00:46:24.245938 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 04 00:46:24.245938 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 04 00:46:24.245938 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 04 00:46:24.246917 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:24.246917 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:24.246917 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 00:46:24.246917 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:46:24.246917 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 00:46:24.246917 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:46:24.246917 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:24.246917 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:24.246917 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:24.246917 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:24.246917 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:24.246917 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:24.246917 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:24.246917 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:24.246917 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:24.246917 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:24.246917 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:24.246917 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:24.247848 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:24.247848 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:24.247848 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 00:46:24.247848 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 00:46:24.247848 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 00:46:24.247848 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 00:46:24.247848 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 00:46:24.247848 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 00:46:24.247848 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 04 00:46:24.247848 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:24.251134 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 463/929] 10.222.0.30 () {56 vars in 1117 bytes} [Sun Sep 4 00:46:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:46:24.256903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29602e7-d6a4-4b5f-87ba-7a95f8c965ab None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:24.273008 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:24.305833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae8293-fe6f-4e5d-8ad3-183621746ef6 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:24.309490 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:24.352564 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3391558-5b08-4555-a0cf-5d9a3c2e4488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:24.353865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3391558-5b08-4555-a0cf-5d9a3c2e4488 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:24.354349 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3391558-5b08-4555-a0cf-5d9a3c2e4488 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:24.354817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3391558-5b08-4555-a0cf-5d9a3c2e4488 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:24.355619 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3391558-5b08-4555-a0cf-5d9a3c2e4488 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:24.358015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3391558-5b08-4555-a0cf-5d9a3c2e4488 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:24.368752 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29602e7-d6a4-4b5f-87ba-7a95f8c965ab None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:24.370111 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-d3391558-5b08-4555-a0cf-5d9a3c2e4488 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 04 00:46:24.370111 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:24.370111 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 04 00:46:24.370111 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 04 00:46:24.370111 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 04 00:46:24.370111 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 04 00:46:24.370111 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 04 00:46:24.370111 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:24.370111 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 04 00:46:24.370111 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:24.370111 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 00:46:24.370111 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:24.370111 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:24.370111 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:24.370111 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:24.370111 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:24.370111 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:24.371083 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:24.371083 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:24.371083 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:24.371083 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:24.371083 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:24.371083 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:24.371083 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 04 00:46:24.371083 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 04 00:46:24.371083 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 04 00:46:24.371083 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 04 00:46:24.371083 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:24.371083 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:24.371083 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:24.371083 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:24.371083 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:24.371083 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:24.371917 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:24.371917 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:24.371917 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:24.371917 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:24.371917 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:24.371917 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:24.371917 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:24.371917 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:24.371917 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:24.371917 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:24.371917 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 04 00:46:24.371917 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:24.371917 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 04 00:46:24.371917 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:24.375499 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 467/930] 10.222.0.30 () {56 vars in 1126 bytes} [Sun Sep 4 00:46:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:46:24.381236 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3391558-5b08-4555-a0cf-5d9a3c2e4488 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:24.413136 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce09bba6-16c6-422e-aa62-356e701d8076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:24.414153 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09bba6-16c6-422e-aa62-356e701d8076 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:24.414437 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09bba6-16c6-422e-aa62-356e701d8076 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:24.414706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09bba6-16c6-422e-aa62-356e701d8076 None admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:24.415434 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce09bba6-16c6-422e-aa62-356e701d8076 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:24.415809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce09bba6-16c6-422e-aa62-356e701d8076 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:24.417284 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce09bba6-16c6-422e-aa62-356e701d8076 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:24.441246 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 464/931] 10.222.0.30 () {56 vars in 1149 bytes} [Sun Sep 4 00:46:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:24.442053 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce09bba6-16c6-422e-aa62-356e701d8076 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:24.498321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3391558-5b08-4555-a0cf-5d9a3c2e4488 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:24.514172 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:24.533472 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757d06b9-766a-4acd-a5e2-625ee576214a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:24.533960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d06b9-766a-4acd-a5e2-625ee576214a None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:24.534237 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d06b9-766a-4acd-a5e2-625ee576214a None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:24.534504 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d06b9-766a-4acd-a5e2-625ee576214a None admin] PATH_INFO: `/v3/services` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:24.535121 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757d06b9-766a-4acd-a5e2-625ee576214a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:24.535420 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757d06b9-766a-4acd-a5e2-625ee576214a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:24.536770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757d06b9-766a-4acd-a5e2-625ee576214a None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:24.541952 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 468/932] 10.222.0.30 () {56 vars in 1122 bytes} [Sun Sep 4 00:46:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:24.542551 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757d06b9-766a-4acd-a5e2-625ee576214a None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:24.553548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce09bba6-16c6-422e-aa62-356e701d8076 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:24.574217 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:24.589924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b74546-96e3-45c3-82e8-7f5a782b1359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:24.590550 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b74546-96e3-45c3-82e8-7f5a782b1359 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:24.590830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b74546-96e3-45c3-82e8-7f5a782b1359 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:24.591103 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b74546-96e3-45c3-82e8-7f5a782b1359 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:24.591679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b74546-96e3-45c3-82e8-7f5a782b1359 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:24.593034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b74546-96e3-45c3-82e8-7f5a782b1359 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:24.602383 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-a3b74546-96e3-45c3-82e8-7f5a782b1359 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 04 00:46:24.602383 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:24.602383 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 04 00:46:24.602383 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 04 00:46:24.602383 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 04 00:46:24.602383 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 04 00:46:24.602383 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 04 00:46:24.602383 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:24.602383 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 04 00:46:24.602383 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:24.602383 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 00:46:24.602383 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:24.602383 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:24.602383 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:24.602383 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:24.602383 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:24.603325 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:24.603325 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:24.603325 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:24.603325 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:24.603325 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:24.603325 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:24.603325 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:24.603325 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 04 00:46:24.603325 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 04 00:46:24.603325 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 04 00:46:24.603325 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 04 00:46:24.603325 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:24.603325 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:24.603325 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:24.603325 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:24.603325 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:24.603325 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:24.604252 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:24.604252 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:24.604252 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:24.604252 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:24.604252 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:24.604252 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:24.604252 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:24.604252 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:24.604252 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:24.604252 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:24.604252 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 04 00:46:24.604252 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:24.604252 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 04 00:46:24.604252 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:24.604252 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 465/933] 10.222.0.30 () {56 vars in 1132 bytes} [Sun Sep 4 00:46:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:24.605066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b74546-96e3-45c3-82e8-7f5a782b1359 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:24.649118 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757d06b9-766a-4acd-a5e2-625ee576214a None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:24.687091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946e7c3-0fd9-43f7-8b83-c32dec95bf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:24.688094 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946e7c3-0fd9-43f7-8b83-c32dec95bf31 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:24.688514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946e7c3-0fd9-43f7-8b83-c32dec95bf31 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:24.689053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946e7c3-0fd9-43f7-8b83-c32dec95bf31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:24.700656 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946e7c3-0fd9-43f7-8b83-c32dec95bf31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:24.702572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946e7c3-0fd9-43f7-8b83-c32dec95bf31 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:24.707280 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b74546-96e3-45c3-82e8-7f5a782b1359 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:24.717904 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-f946e7c3-0fd9-43f7-8b83-c32dec95bf31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:24.717904 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:24.717904 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:24.717904 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:24.717904 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:24.717904 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:24.717904 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:24.717904 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:24.717904 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:24.717904 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:24.717904 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:24.717904 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:24.717904 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:46:24.717904 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:46:24.717904 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:46:24.717904 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:46:24.719032 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:24.719032 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:24.719032 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:24.719032 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:24.719032 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:24.719032 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:24.719032 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:24.719032 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:24.719032 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:24.719032 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:24.719032 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:24.719032 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:24.719032 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:24.719032 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:24.719032 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:24.719032 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:24.719032 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:46:24.719916 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:46:24.719916 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:24.719916 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:24.719916 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 469/934] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:46:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:24.719916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946e7c3-0fd9-43f7-8b83-c32dec95bf31 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:24.744422 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:24.750557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db15810-006d-47bf-9be1-23a9e95290a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:24.751248 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db15810-006d-47bf-9be1-23a9e95290a4 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:24.751595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db15810-006d-47bf-9be1-23a9e95290a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:24.751936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db15810-006d-47bf-9be1-23a9e95290a4 None admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:24.752745 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db15810-006d-47bf-9be1-23a9e95290a4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:24.753229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db15810-006d-47bf-9be1-23a9e95290a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:24.754714 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db15810-006d-47bf-9be1-23a9e95290a4 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:24.765213 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 466/935] 10.222.0.30 () {56 vars in 1122 bytes} [Sun Sep 4 00:46:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:24.765213 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db15810-006d-47bf-9be1-23a9e95290a4 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:24.811063 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:24.828043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946e7c3-0fd9-43f7-8b83-c32dec95bf31 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:24.862166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631b8b1-fbef-4918-bc0d-975c941dd279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:24.863063 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631b8b1-fbef-4918-bc0d-975c941dd279 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:24.863339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631b8b1-fbef-4918-bc0d-975c941dd279 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:24.863612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631b8b1-fbef-4918-bc0d-975c941dd279 None admin] PATH_INFO: `/v3/services` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:24.864232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631b8b1-fbef-4918-bc0d-975c941dd279 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:24.864533 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631b8b1-fbef-4918-bc0d-975c941dd279 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:24.865966 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631b8b1-fbef-4918-bc0d-975c941dd279 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:24.873494 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 470/936] 10.222.0.30 () {56 vars in 1126 bytes} [Sun Sep 4 00:46:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:24.873494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631b8b1-fbef-4918-bc0d-975c941dd279 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:24.879288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db15810-006d-47bf-9be1-23a9e95290a4 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:24.918850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f635f9c-8a39-4181-8a69-973f5a4d6c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:24.919558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f635f9c-8a39-4181-8a69-973f5a4d6c20 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:24.919905 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f635f9c-8a39-4181-8a69-973f5a4d6c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:24.920242 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f635f9c-8a39-4181-8a69-973f5a4d6c20 None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:24.920957 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f635f9c-8a39-4181-8a69-973f5a4d6c20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:24.921326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f635f9c-8a39-4181-8a69-973f5a4d6c20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:24.922763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f635f9c-8a39-4181-8a69-973f5a4d6c20 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:24.935044 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 467/937] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:24.935938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f635f9c-8a39-4181-8a69-973f5a4d6c20 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:24.980907 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631b8b1-fbef-4918-bc0d-975c941dd279 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:24.992679 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:25.015765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192c4f4-0363-46ad-83db-591158d580b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:25.016374 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192c4f4-0363-46ad-83db-591158d580b4 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:25.016662 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192c4f4-0363-46ad-83db-591158d580b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:25.016931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192c4f4-0363-46ad-83db-591158d580b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:25.017661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6192c4f4-0363-46ad-83db-591158d580b4 None admin] RBAC: Adding query filter params (interface=public, service_id=b138a5476ce34aa59ad307c20e8e9b1c, region_id=RegionOne) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:25.017971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6192c4f4-0363-46ad-83db-591158d580b4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:25.019339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6192c4f4-0363-46ad-83db-591158d580b4 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:25.025464 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 471/938] 10.222.0.30 () {56 vars in 1251 bytes} [Sun Sep 4 00:46:24 2022] GET /identity/v3/endpoints?service_id=b138a5476ce34aa59ad307c20e8e9b1c&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:25.025905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192c4f4-0363-46ad-83db-591158d580b4 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:25.043242 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:25.047434 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f635f9c-8a39-4181-8a69-973f5a4d6c20 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:25.083863 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc04af-dc31-4ba2-bbe5-abd8a882cec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:25.084470 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc04af-dc31-4ba2-bbe5-abd8a882cec4 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:25.085354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc04af-dc31-4ba2-bbe5-abd8a882cec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:25.085657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc04af-dc31-4ba2-bbe5-abd8a882cec4 None admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:25.086285 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc04af-dc31-4ba2-bbe5-abd8a882cec4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:25.086587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc04af-dc31-4ba2-bbe5-abd8a882cec4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:25.087948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc04af-dc31-4ba2-bbe5-abd8a882cec4 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:25.097988 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 468/939] 10.222.0.30 () {56 vars in 1126 bytes} [Sun Sep 4 00:46:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:25.097988 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc04af-dc31-4ba2-bbe5-abd8a882cec4 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:25.139414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192c4f4-0363-46ad-83db-591158d580b4 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:25.174403 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547677b-1685-4da7-84bf-8c13734d8a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:25.175028 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547677b-1685-4da7-84bf-8c13734d8a7b None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:25.175301 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547677b-1685-4da7-84bf-8c13734d8a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:25.175566 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547677b-1685-4da7-84bf-8c13734d8a7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:25.182641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547677b-1685-4da7-84bf-8c13734d8a7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:25.184190 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547677b-1685-4da7-84bf-8c13734d8a7b None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:25.195615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc04af-dc31-4ba2-bbe5-abd8a882cec4 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:25.196349 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-a547677b-1685-4da7-84bf-8c13734d8a7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:46:25.196349 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:25.196349 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:25.196349 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:25.196349 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:25.196349 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:25.196349 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:25.196349 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:25.196349 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:25.196349 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:25.196349 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:25.196349 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:25.196349 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 04 00:46:25.196349 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 04 00:46:25.196349 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 04 00:46:25.197362 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 04 00:46:25.197362 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:25.197362 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:25.197362 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:25.197362 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:25.197362 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:25.197362 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:25.197362 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:25.197362 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:25.197362 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:25.197362 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:25.197362 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:25.197362 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:25.197362 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:25.197362 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:25.197362 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:25.197362 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:25.198667 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 04 00:46:25.198667 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 04 00:46:25.198667 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 00:46:25.198667 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 00:46:25.198667 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 00:46:25.198667 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 00:46:25.198667 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:46:25.198667 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:25.202475 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 472/940] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:46:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:25.203273 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547677b-1685-4da7-84bf-8c13734d8a7b None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:25.218933 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:25.237668 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0145af-2260-4376-9ece-77c24bd04187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:25.238206 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0145af-2260-4376-9ece-77c24bd04187 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:25.238505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0145af-2260-4376-9ece-77c24bd04187 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:25.238992 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0145af-2260-4376-9ece-77c24bd04187 None admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:25.240456 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0145af-2260-4376-9ece-77c24bd04187 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:25.241919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0145af-2260-4376-9ece-77c24bd04187 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:25.257820 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 469/941] 10.222.0.30 () {56 vars in 1087 bytes} [Sun Sep 4 00:46:25 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 00:46:25.257820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0145af-2260-4376-9ece-77c24bd04187 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:25.284683 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:25.320307 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547677b-1685-4da7-84bf-8c13734d8a7b None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:25.358289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c000a-4d60-4a65-bdef-2bd2fc868f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:25.358907 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c000a-4d60-4a65-bdef-2bd2fc868f0a None admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:25.359247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c000a-4d60-4a65-bdef-2bd2fc868f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:25.359529 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c000a-4d60-4a65-bdef-2bd2fc868f0a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:25.360520 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c000a-4d60-4a65-bdef-2bd2fc868f0a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:25.361972 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c000a-4d60-4a65-bdef-2bd2fc868f0a None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:25.386006 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0145af-2260-4376-9ece-77c24bd04187 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:25.388443 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 473/942] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 00:46:25 2022] POST /identity/v3/endpoints => generated 347 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:46:25.442429 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5b678-3bf3-49fc-ae73-5ca9cde1ae97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:25.443321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5b678-3bf3-49fc-ae73-5ca9cde1ae97 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:25.443803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5b678-3bf3-49fc-ae73-5ca9cde1ae97 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:25.445019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5b678-3bf3-49fc-ae73-5ca9cde1ae97 None admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:25.446717 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5b678-3bf3-49fc-ae73-5ca9cde1ae97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:25.447500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5b678-3bf3-49fc-ae73-5ca9cde1ae97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:25.450336 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5b678-3bf3-49fc-ae73-5ca9cde1ae97 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:25.467322 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 470/943] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Sep 4 00:46:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:25.478995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c000a-4d60-4a65-bdef-2bd2fc868f0a None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:25.594504 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c000a-4d60-4a65-bdef-2bd2fc868f0a None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:25.624636 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:25.635884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238b789-a325-4175-bfb1-2e2a3db778ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:25.636852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238b789-a325-4175-bfb1-2e2a3db778ca None admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:25.637306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238b789-a325-4175-bfb1-2e2a3db778ca None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:25.637789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238b789-a325-4175-bfb1-2e2a3db778ca None admin] PATH_INFO: `/v3/projects/40b24e92f8594ee08bd2a55f79e3b299/users/00543899e82647e8ba187b8d0b60d8c9/roles/fd671e98e0424c60995238aaa9dcdd5d` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:25.640142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0238b789-a325-4175-bfb1-2e2a3db778ca None admin] RBAC: Authorizing `identity:create_grant(project_id=40b24e92f8594ee08bd2a55f79e3b299, user_id=00543899e82647e8ba187b8d0b60d8c9, role_id=fd671e98e0424c60995238aaa9dcdd5d)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:25.641795 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0238b789-a325-4175-bfb1-2e2a3db778ca None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:25.656996 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 474/944] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Sep 4 00:46:25 2022] PUT /identity/v3/projects/40b24e92f8594ee08bd2a55f79e3b299/users/00543899e82647e8ba187b8d0b60d8c9/roles/fd671e98e0424c60995238aaa9dcdd5d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:46:25.767833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53020c3c-8034-4df2-baa0-35b34258014f None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:25.768354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53020c3c-8034-4df2-baa0-35b34258014f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:25.768431 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53020c3c-8034-4df2-baa0-35b34258014f None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:25.770216 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 471/945] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:25.776218 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bb796-9c48-4e7b-b08c-c0ccd76d257d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:25.776586 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bb796-9c48-4e7b-b08c-c0ccd76d257d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:25.776936 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bb796-9c48-4e7b-b08c-c0ccd76d257d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:25.797663 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-df7bb796-9c48-4e7b-b08c-c0ccd76d257d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:25.798869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-df7bb796-9c48-4e7b-b08c-c0ccd76d257d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:25.874640 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 475/946] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:46:26.148780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53020c3c-8034-4df2-baa0-35b34258014f None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:26.194173 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:26.262243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53020c3c-8034-4df2-baa0-35b34258014f None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:26.302445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cff369-4d34-458a-a11c-c348eea2b7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:26.303061 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cff369-4d34-458a-a11c-c348eea2b7cd None admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:26.303377 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cff369-4d34-458a-a11c-c348eea2b7cd None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:26.303649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cff369-4d34-458a-a11c-c348eea2b7cd None admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:26.304309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cff369-4d34-458a-a11c-c348eea2b7cd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:26.305757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cff369-4d34-458a-a11c-c348eea2b7cd None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:26.308368 n-d-master-1 devstack@keystone.service[81825]: WARNING keystone.server.flask.common [None req-91cff369-4d34-458a-a11c-c348eea2b7cd None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 04 00:46:26.328359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.sql.core [None req-91cff369-4d34-458a-a11c-c348eea2b7cd None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 04 00:46:26.328359 n-d-master-1 devstack@keystone.service[81825]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 04 00:46:26.328359 n-d-master-1 devstack@keystone.service[81825]: [parameters: {'id': 'e3e96ecae11e4a599c2bf34e184aa6d2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 04 00:46:26.328359 n-d-master-1 devstack@keystone.service[81825]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81825) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 04 00:46:26.346252 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-91cff369-4d34-458a-a11c-c348eea2b7cd None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e3e96ecae11e4a599c2bf34e184aa6d2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e3e96ecae11e4a599c2bf34e184aa6d2. Sep 04 00:46:26.346252 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:26.346252 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 04 00:46:26.346252 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 04 00:46:26.346252 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 04 00:46:26.346252 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 04 00:46:26.346252 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 04 00:46:26.346252 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application result = self._query(query) Sep 04 00:46:26.346252 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 04 00:46:26.346252 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application conn.query(q) Sep 04 00:46:26.346252 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 04 00:46:26.346252 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 04 00:46:26.346252 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 04 00:46:26.347096 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application result.read() Sep 04 00:46:26.347096 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 04 00:46:26.347096 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 04 00:46:26.347096 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 04 00:46:26.347096 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 04 00:46:26.347096 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 04 00:46:26.347096 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 04 00:46:26.347096 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 04 00:46:26.347096 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 04 00:46:26.347096 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 04 00:46:26.347096 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:26.347096 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 04 00:46:26.347096 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:26.347096 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:26.347096 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 04 00:46:26.347096 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 04 00:46:26.347096 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 04 00:46:26.347096 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 04 00:46:26.348214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 04 00:46:26.348214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application next(self.gen) Sep 04 00:46:26.348214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 04 00:46:26.348214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application yield resource Sep 04 00:46:26.348214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 04 00:46:26.348214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application next(self.gen) Sep 04 00:46:26.348214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 04 00:46:26.348214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self.session.rollback() Sep 04 00:46:26.348214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 04 00:46:26.348214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self.force_reraise() Sep 04 00:46:26.348214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 04 00:46:26.348214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise self.value Sep 04 00:46:26.348214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 04 00:46:26.348214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 04 00:46:26.348214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 04 00:46:26.348214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application session.commit() Sep 04 00:46:26.348214 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 04 00:46:26.349233 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 04 00:46:26.349233 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 04 00:46:26.349233 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._prepare_impl() Sep 04 00:46:26.349233 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 04 00:46:26.349233 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self.session.flush() Sep 04 00:46:26.349233 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 04 00:46:26.349233 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._flush(objects) Sep 04 00:46:26.349233 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 04 00:46:26.349233 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 04 00:46:26.349233 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 04 00:46:26.349233 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application compat.raise_( Sep 04 00:46:26.349233 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 04 00:46:26.349233 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception Sep 04 00:46:26.349233 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 04 00:46:26.349233 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application flush_context.execute() Sep 04 00:46:26.349233 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 04 00:46:26.349233 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rec.execute(self) Sep 04 00:46:26.352007 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 04 00:46:26.352007 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 04 00:46:26.352007 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 04 00:46:26.352007 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 04 00:46:26.352007 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 04 00:46:26.352007 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 04 00:46:26.352007 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 04 00:46:26.352007 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 04 00:46:26.352007 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 04 00:46:26.352007 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 04 00:46:26.352007 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 04 00:46:26.352007 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 04 00:46:26.352007 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 04 00:46:26.352007 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 04 00:46:26.352007 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 04 00:46:26.357297 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 04 00:46:26.357297 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 04 00:46:26.357297 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception Sep 04 00:46:26.357297 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 04 00:46:26.357297 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 04 00:46:26.357297 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 04 00:46:26.357297 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 04 00:46:26.357297 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 04 00:46:26.357297 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application result = self._query(query) Sep 04 00:46:26.357297 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 04 00:46:26.357297 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application conn.query(q) Sep 04 00:46:26.357297 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 04 00:46:26.357297 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 04 00:46:26.357297 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 04 00:46:26.357297 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application result.read() Sep 04 00:46:26.357297 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 04 00:46:26.357297 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 04 00:46:26.359367 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 04 00:46:26.359367 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 04 00:46:26.359367 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 04 00:46:26.359367 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 04 00:46:26.359367 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 04 00:46:26.359367 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 04 00:46:26.359367 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 04 00:46:26.359367 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 04 00:46:26.359367 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [parameters: {'id': 'e3e96ecae11e4a599c2bf34e184aa6d2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 04 00:46:26.359367 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 04 00:46:26.359367 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:26.359367 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 00:46:26.359367 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:26.359367 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:26.359367 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 04 00:46:26.361750 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 04 00:46:26.361750 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 04 00:46:26.361750 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 04 00:46:26.361750 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 04 00:46:26.361750 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:26.361750 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 00:46:26.361750 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:26.361750 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:26.361750 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:26.361750 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:26.361750 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:26.361750 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:26.361750 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:26.361750 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:26.361750 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:26.361750 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:26.361750 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:26.364625 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:26.364625 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 04 00:46:26.364625 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 04 00:46:26.364625 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:26.364625 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:26.364625 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 04 00:46:26.364625 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 04 00:46:26.364625 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e3e96ecae11e4a599c2bf34e184aa6d2. Sep 04 00:46:26.364625 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:26.364625 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 472/947] 10.222.0.30 () {60 vars in 1140 bytes} [Sun Sep 4 00:46:26 2022] POST /identity/v3/projects => generated 262 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:26.365565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7bb796-9c48-4e7b-b08c-c0ccd76d257d None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:26.479195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7bb796-9c48-4e7b-b08c-c0ccd76d257d None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:26.501781 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:26.514880 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b09b4-90b7-4814-b6fd-63906df88380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:26.515525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b09b4-90b7-4814-b6fd-63906df88380 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:26.515867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b09b4-90b7-4814-b6fd-63906df88380 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:26.516153 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b09b4-90b7-4814-b6fd-63906df88380 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:26.523722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b09b4-90b7-4814-b6fd-63906df88380 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:26.525345 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b09b4-90b7-4814-b6fd-63906df88380 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:26.537531 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-2d9b09b4-90b7-4814-b6fd-63906df88380 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:46:26.537531 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:26.537531 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:26.537531 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:26.537531 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:26.537531 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:26.537531 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:26.537531 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:26.537531 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:26.537531 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:26.537531 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:26.537531 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:26.537531 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 04 00:46:26.537531 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 04 00:46:26.537531 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 04 00:46:26.538988 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 04 00:46:26.538988 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:26.538988 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:26.538988 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:26.538988 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:26.538988 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:26.538988 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:26.538988 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:26.538988 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:26.538988 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:26.538988 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:26.538988 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:26.538988 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:26.538988 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:26.538988 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:26.538988 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:26.538988 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:26.539897 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 04 00:46:26.539897 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 04 00:46:26.539897 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 00:46:26.539897 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 00:46:26.539897 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 00:46:26.539897 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 00:46:26.539897 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:46:26.539897 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:26.539897 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 476/948] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:46:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:26.546707 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cff369-4d34-458a-a11c-c348eea2b7cd None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:26.654181 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:26.660340 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cff369-4d34-458a-a11c-c348eea2b7cd None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:26.698254 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488888d3-1a33-407e-a3a0-b3c9acb8bc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:26.698868 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488888d3-1a33-407e-a3a0-b3c9acb8bc97 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:26.699147 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488888d3-1a33-407e-a3a0-b3c9acb8bc97 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:26.699421 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488888d3-1a33-407e-a3a0-b3c9acb8bc97 None admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:26.700082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488888d3-1a33-407e-a3a0-b3c9acb8bc97 None admin] RBAC: Adding query filter params (name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:26.700385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488888d3-1a33-407e-a3a0-b3c9acb8bc97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:26.702136 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488888d3-1a33-407e-a3a0-b3c9acb8bc97 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:26.722988 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 473/949] 10.222.0.30 () {56 vars in 1112 bytes} [Sun Sep 4 00:46:26 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:27.273316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b15649-c755-4a67-bcc3-c1e536bab855 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:27.274431 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b15649-c755-4a67-bcc3-c1e536bab855 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:27.274929 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b15649-c755-4a67-bcc3-c1e536bab855 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:27.276706 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 477/950] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:27.282426 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eaf467-da78-4b71-9305-976bd6b5485e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:27.283259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eaf467-da78-4b71-9305-976bd6b5485e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:27.283742 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eaf467-da78-4b71-9305-976bd6b5485e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:27.305765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d9eaf467-da78-4b71-9305-976bd6b5485e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:27.307267 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d9eaf467-da78-4b71-9305-976bd6b5485e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:27.376941 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 474/951] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 04 00:46:27.471184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1fed19-5d7f-4841-bb48-474f7eb20b36 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:27.471470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1fed19-5d7f-4841-bb48-474f7eb20b36 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:27.471742 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1fed19-5d7f-4841-bb48-474f7eb20b36 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:27.473332 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 478/952] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:27.478894 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e810e-0113-4a31-8013-31095f59bc20 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:27.479177 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e810e-0113-4a31-8013-31095f59bc20 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:27.479445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e810e-0113-4a31-8013-31095f59bc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:27.498555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-0e6e810e-0113-4a31-8013-31095f59bc20 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:27.499879 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0e6e810e-0113-4a31-8013-31095f59bc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:27.573742 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 475/953] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:46:27.647931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1fed19-5d7f-4841-bb48-474f7eb20b36 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:27.659821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e12ffb-90e1-40bb-8587-ed6b39956894 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:27.660098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e12ffb-90e1-40bb-8587-ed6b39956894 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:27.660365 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e12ffb-90e1-40bb-8587-ed6b39956894 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:27.661732 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 476/954] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:27.668895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a45992-0105-4079-b5b9-d08968bad8b7 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:27.669732 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a45992-0105-4079-b5b9-d08968bad8b7 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:27.670008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a45992-0105-4079-b5b9-d08968bad8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:27.688527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-f3a45992-0105-4079-b5b9-d08968bad8b7 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:27.689730 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f3a45992-0105-4079-b5b9-d08968bad8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:27.700558 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:27.768177 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 477/955] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 04 00:46:27.778326 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1fed19-5d7f-4841-bb48-474f7eb20b36 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:27.812926 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105945e-b3cf-43f4-b60e-3a413b0ba60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:27.813578 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105945e-b3cf-43f4-b60e-3a413b0ba60a None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:27.813857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105945e-b3cf-43f4-b60e-3a413b0ba60a None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:27.814127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105945e-b3cf-43f4-b60e-3a413b0ba60a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:27.814701 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105945e-b3cf-43f4-b60e-3a413b0ba60a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:27.816117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105945e-b3cf-43f4-b60e-3a413b0ba60a None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:27.825242 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-e105945e-b3cf-43f4-b60e-3a413b0ba60a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 04 00:46:27.825242 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:27.825242 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 04 00:46:27.825242 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 04 00:46:27.825242 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 04 00:46:27.825242 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 04 00:46:27.825242 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 04 00:46:27.825242 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:27.825242 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 04 00:46:27.825242 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:27.825242 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 00:46:27.825242 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:27.825242 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:27.825242 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:27.825242 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:27.825242 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:27.825242 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:27.827581 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:27.827581 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:27.827581 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:27.827581 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:27.827581 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:27.827581 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:27.827581 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 04 00:46:27.827581 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 04 00:46:27.827581 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 04 00:46:27.827581 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 04 00:46:27.827581 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:27.827581 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:27.827581 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:27.827581 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:27.827581 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:27.827581 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:27.828883 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:27.828883 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:27.828883 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:27.828883 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:27.828883 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:27.828883 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:27.828883 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:27.828883 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:27.828883 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:27.828883 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:27.828883 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 04 00:46:27.828883 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:27.828883 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 04 00:46:27.828883 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:27.828883 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 479/956] 10.222.0.30 () {56 vars in 1126 bytes} [Sun Sep 4 00:46:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:27.836848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a45992-0105-4079-b5b9-d08968bad8b7 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:27.854155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105945e-b3cf-43f4-b60e-3a413b0ba60a None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:27.906478 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:27.954964 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a45992-0105-4079-b5b9-d08968bad8b7 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:27.978753 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105945e-b3cf-43f4-b60e-3a413b0ba60a None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:27.993398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06068e32-a1dc-43d5-bf54-4af4afa1446a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:27.994041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06068e32-a1dc-43d5-bf54-4af4afa1446a None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:27.994320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06068e32-a1dc-43d5-bf54-4af4afa1446a None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:27.994593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06068e32-a1dc-43d5-bf54-4af4afa1446a None admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:27.995225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06068e32-a1dc-43d5-bf54-4af4afa1446a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:27.995624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06068e32-a1dc-43d5-bf54-4af4afa1446a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:27.997105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06068e32-a1dc-43d5-bf54-4af4afa1446a None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:28.002918 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 478/957] 10.222.0.30 () {56 vars in 1122 bytes} [Sun Sep 4 00:46:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:28.008941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06068e32-a1dc-43d5-bf54-4af4afa1446a None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:28.020911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7173d1-5fe2-4a85-839b-fcc21eacf8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:28.021573 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7173d1-5fe2-4a85-839b-fcc21eacf8a7 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:28.021857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7173d1-5fe2-4a85-839b-fcc21eacf8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:28.022651 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7173d1-5fe2-4a85-839b-fcc21eacf8a7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:28.023236 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7173d1-5fe2-4a85-839b-fcc21eacf8a7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:28.025647 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:28.025778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7173d1-5fe2-4a85-839b-fcc21eacf8a7 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:28.037554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-7c7173d1-5fe2-4a85-839b-fcc21eacf8a7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 04 00:46:28.037554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:28.037554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 04 00:46:28.037554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 04 00:46:28.037554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 04 00:46:28.037554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 04 00:46:28.037554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 04 00:46:28.037554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:28.037554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 04 00:46:28.037554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:28.037554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 00:46:28.037554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:28.037554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:28.037554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:28.037554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:28.037554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:28.037554 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:28.039098 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:28.039098 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:28.039098 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:28.039098 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:28.039098 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:28.039098 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:28.039098 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 04 00:46:28.039098 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 04 00:46:28.039098 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 04 00:46:28.039098 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 04 00:46:28.039098 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:28.039098 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:28.039098 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:28.039098 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:28.039098 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:28.039098 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:28.039939 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:28.039939 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:28.039939 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:28.039939 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:28.039939 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:28.039939 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:28.039939 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:28.039939 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:28.039939 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:28.039939 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:28.039939 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 04 00:46:28.039939 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:28.039939 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 04 00:46:28.039939 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:28.043234 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 480/958] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:46:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:46:28.045514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7173d1-5fe2-4a85-839b-fcc21eacf8a7 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:28.123959 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06068e32-a1dc-43d5-bf54-4af4afa1446a None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:28.152868 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7173d1-5fe2-4a85-839b-fcc21eacf8a7 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:28.158124 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbfe35-4d50-478e-a6e8-711ae63471c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:28.158738 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbfe35-4d50-478e-a6e8-711ae63471c2 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:28.159019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbfe35-4d50-478e-a6e8-711ae63471c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:28.159294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbfe35-4d50-478e-a6e8-711ae63471c2 None admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:28.159921 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbfe35-4d50-478e-a6e8-711ae63471c2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:28.160226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbfe35-4d50-478e-a6e8-711ae63471c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:28.161041 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:28.161629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbfe35-4d50-478e-a6e8-711ae63471c2 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:28.171712 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 479/959] 10.222.0.30 () {56 vars in 1122 bytes} [Sun Sep 4 00:46:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:28.171712 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbfe35-4d50-478e-a6e8-711ae63471c2 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:28.195152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c525d1-6513-4278-ab82-77affe397b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:28.195778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c525d1-6513-4278-ab82-77affe397b29 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:28.196061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c525d1-6513-4278-ab82-77affe397b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:28.196343 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c525d1-6513-4278-ab82-77affe397b29 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:28.206506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c525d1-6513-4278-ab82-77affe397b29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:46:28.211872 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-b3c525d1-6513-4278-ab82-77affe397b29 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 04 00:46:28.211872 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:28.211872 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:28.211872 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:28.211872 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:28.211872 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:28.211872 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:28.211872 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:28.211872 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:28.211872 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:28.211872 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:28.211872 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:28.211872 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:46:28.211872 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:46:28.211872 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:46:28.211872 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:46:28.212802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:46:28.212802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:46:28.212802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:46:28.212802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:46:28.212802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:28.212802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:28.212802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:28.212802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:28.212802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:28.212802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:28.212802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:28.212802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:28.212802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:28.212802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:28.212802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:28.212802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:28.214207 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:28.214207 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:28.214207 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:28.214207 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:28.214207 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:46:28.214207 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:46:28.214207 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:46:28.214207 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:46:28.214207 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:46:28.214207 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:46:28.214207 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 04 00:46:28.214207 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:28.214207 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 481/960] 10.222.0.30 () {56 vars in 1120 bytes} [Sun Sep 4 00:46:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:46:28.214207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c525d1-6513-4278-ab82-77affe397b29 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:28.252646 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:28.280744 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbfe35-4d50-478e-a6e8-711ae63471c2 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:28.315962 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a53f3b-4023-461d-8a4a-2c55e32f7e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:28.316630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a53f3b-4023-461d-8a4a-2c55e32f7e07 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:28.316861 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a53f3b-4023-461d-8a4a-2c55e32f7e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:28.317132 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a53f3b-4023-461d-8a4a-2c55e32f7e07 None admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:28.317786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a53f3b-4023-461d-8a4a-2c55e32f7e07 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:28.318086 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a53f3b-4023-461d-8a4a-2c55e32f7e07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:28.320005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a53f3b-4023-461d-8a4a-2c55e32f7e07 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:28.324195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c525d1-6513-4278-ab82-77affe397b29 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:28.324980 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 480/961] 10.222.0.30 () {56 vars in 1112 bytes} [Sun Sep 4 00:46:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:28.325694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a53f3b-4023-461d-8a4a-2c55e32f7e07 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:28.367752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ded78-cb9e-4eba-9620-8070a2b2448d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:28.368362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ded78-cb9e-4eba-9620-8070a2b2448d None admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:28.368643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ded78-cb9e-4eba-9620-8070a2b2448d None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:28.368915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ded78-cb9e-4eba-9620-8070a2b2448d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:28.369842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ded78-cb9e-4eba-9620-8070a2b2448d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:28.370979 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ded78-cb9e-4eba-9620-8070a2b2448d None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:28.397879 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 482/962] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 00:46:28 2022] POST /identity/v3/endpoints => generated 349 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:46:28.397879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ded78-cb9e-4eba-9620-8070a2b2448d None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:28.425512 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:28.446842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a53f3b-4023-461d-8a4a-2c55e32f7e07 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:28.503990 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46056500-fa73-4325-8726-516014104aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:28.505365 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46056500-fa73-4325-8726-516014104aff None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:28.505692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46056500-fa73-4325-8726-516014104aff None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:28.505970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46056500-fa73-4325-8726-516014104aff None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:28.507377 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46056500-fa73-4325-8726-516014104aff None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:28.507686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46056500-fa73-4325-8726-516014104aff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:28.509709 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46056500-fa73-4325-8726-516014104aff None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:28.511996 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:28.525612 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 481/963] 10.222.0.30 () {56 vars in 1115 bytes} [Sun Sep 4 00:46:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:28.529094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46056500-fa73-4325-8726-516014104aff None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:28.545984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ded78-cb9e-4eba-9620-8070a2b2448d None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:28.587791 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdc45e-69b4-4ebe-b5bc-0718f480d8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:28.589363 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdc45e-69b4-4ebe-b5bc-0718f480d8c1 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:28.589839 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdc45e-69b4-4ebe-b5bc-0718f480d8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:28.590268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdc45e-69b4-4ebe-b5bc-0718f480d8c1 None admin] PATH_INFO: `/v3/services` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:28.591111 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fdc45e-69b4-4ebe-b5bc-0718f480d8c1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:28.591629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fdc45e-69b4-4ebe-b5bc-0718f480d8c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:28.593575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fdc45e-69b4-4ebe-b5bc-0718f480d8c1 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:28.600186 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 483/964] 10.222.0.30 () {56 vars in 1112 bytes} [Sun Sep 4 00:46:28 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:28.658065 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46056500-fa73-4325-8726-516014104aff None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:28.698221 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe73df-4f56-40be-b6a4-ee4cefc54c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:28.698865 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe73df-4f56-40be-b6a4-ee4cefc54c57 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:28.699142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe73df-4f56-40be-b6a4-ee4cefc54c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:28.699413 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe73df-4f56-40be-b6a4-ee4cefc54c57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:28.711179 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe73df-4f56-40be-b6a4-ee4cefc54c57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:28.712656 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe73df-4f56-40be-b6a4-ee4cefc54c57 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:28.730048 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-1bfe73df-4f56-40be-b6a4-ee4cefc54c57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:28.730048 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:28.730048 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:28.730048 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:28.730048 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:28.730048 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:28.730048 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:28.730048 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:28.730048 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:28.730048 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:28.730048 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:28.730048 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:28.730048 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:46:28.730048 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:46:28.730048 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:46:28.730048 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:46:28.731068 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:28.731068 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:28.731068 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:28.731068 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:28.731068 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:28.731068 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:28.731068 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:28.731068 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:28.731068 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:28.731068 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:28.731068 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:28.731068 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:28.731068 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:28.731068 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:28.731068 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:28.731068 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:28.731068 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:46:28.732009 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:46:28.732009 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:28.732009 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:28.732009 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 482/965] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:46:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:28.737389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdc45e-69b4-4ebe-b5bc-0718f480d8c1 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:28.760793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0bd18-2d57-4edf-bc13-61a885b81bc0 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:28.761075 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0bd18-2d57-4edf-bc13-61a885b81bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:28.761345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0bd18-2d57-4edf-bc13-61a885b81bc0 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:28.762713 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 483/966] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 04 00:46:28.768051 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ea64b-4df2-46bf-a716-584c571d3b15 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:28.768578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ea64b-4df2-46bf-a716-584c571d3b15 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:28.769132 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ea64b-4df2-46bf-a716-584c571d3b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:28.789287 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-bb6ea64b-4df2-46bf-a716-584c571d3b15 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:28.790533 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bb6ea64b-4df2-46bf-a716-584c571d3b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:28.838853 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:28.853663 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:28.869516 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 484/967] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:46:28.872476 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdc45e-69b4-4ebe-b5bc-0718f480d8c1 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:28.907855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366851ca-3ed7-4ebc-a127-bfab179f4d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:28.908518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366851ca-3ed7-4ebc-a127-bfab179f4d22 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:28.908735 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366851ca-3ed7-4ebc-a127-bfab179f4d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:28.909004 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366851ca-3ed7-4ebc-a127-bfab179f4d22 None admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:28.909664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366851ca-3ed7-4ebc-a127-bfab179f4d22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:28.909961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366851ca-3ed7-4ebc-a127-bfab179f4d22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:28.911315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366851ca-3ed7-4ebc-a127-bfab179f4d22 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:28.923991 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 484/968] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:28.929914 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ea64b-4df2-46bf-a716-584c571d3b15 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:29.033807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ea64b-4df2-46bf-a716-584c571d3b15 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:29.072697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842ead9-59be-426e-aecd-97c6d15447b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:29.073329 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842ead9-59be-426e-aecd-97c6d15447b6 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:29.073638 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842ead9-59be-426e-aecd-97c6d15447b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:29.073905 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842ead9-59be-426e-aecd-97c6d15447b6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:29.081348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842ead9-59be-426e-aecd-97c6d15447b6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:29.082886 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842ead9-59be-426e-aecd-97c6d15447b6 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:29.095627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-1842ead9-59be-426e-aecd-97c6d15447b6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 04 00:46:29.095627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:29.095627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:29.095627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:29.095627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:29.095627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:29.095627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:29.095627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:29.095627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:29.095627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:29.095627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:29.095627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:29.095627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 04 00:46:29.095627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 04 00:46:29.095627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 04 00:46:29.095627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 04 00:46:29.096592 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:29.096592 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:29.096592 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 00:46:29.096592 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:46:29.096592 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 00:46:29.096592 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:46:29.096592 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:29.096592 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:29.096592 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:29.096592 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:29.096592 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:29.096592 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:29.096592 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:29.096592 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:29.096592 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:29.096592 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:29.096592 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:29.096592 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:29.097569 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:29.097569 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:29.097569 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 00:46:29.097569 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 00:46:29.097569 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 00:46:29.097569 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 00:46:29.097569 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 00:46:29.097569 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 00:46:29.097569 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 04 00:46:29.097569 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:29.097569 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 485/969] 10.222.0.30 () {56 vars in 1117 bytes} [Sun Sep 4 00:46:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:29.102894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366851ca-3ed7-4ebc-a127-bfab179f4d22 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:29.143427 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842ead9-59be-426e-aecd-97c6d15447b6 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:29.195560 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:29.230920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366851ca-3ed7-4ebc-a127-bfab179f4d22 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:29.267008 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d64ec9-8464-4b71-ba44-816de7e05652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:29.267924 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d64ec9-8464-4b71-ba44-816de7e05652 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:29.268398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d64ec9-8464-4b71-ba44-816de7e05652 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:29.268863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d64ec9-8464-4b71-ba44-816de7e05652 None admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:29.269816 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d64ec9-8464-4b71-ba44-816de7e05652 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:29.270334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d64ec9-8464-4b71-ba44-816de7e05652 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:29.271283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842ead9-59be-426e-aecd-97c6d15447b6 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:29.272851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d64ec9-8464-4b71-ba44-816de7e05652 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:29.291691 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 485/970] 10.222.0.30 () {56 vars in 1149 bytes} [Sun Sep 4 00:46:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:29.299997 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d64ec9-8464-4b71-ba44-816de7e05652 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:29.304594 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:29.320233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7dd62-0eac-421d-9923-769684c4d3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:29.321528 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7dd62-0eac-421d-9923-769684c4d3e8 None admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:29.322002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7dd62-0eac-421d-9923-769684c4d3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:29.322464 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7dd62-0eac-421d-9923-769684c4d3e8 None admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:29.323306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df7dd62-0eac-421d-9923-769684c4d3e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:29.325074 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df7dd62-0eac-421d-9923-769684c4d3e8 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:29.341072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.sql.core [None req-6df7dd62-0eac-421d-9923-769684c4d3e8 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 04 00:46:29.341072 n-d-master-1 devstack@keystone.service[81825]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 04 00:46:29.341072 n-d-master-1 devstack@keystone.service[81825]: [parameters: {'user_id': '6934fa1828844c99a78378b6871ba083', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 04 00:46:29.341072 n-d-master-1 devstack@keystone.service[81825]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81825) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 04 00:46:29.350833 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-6df7dd62-0eac-421d-9923-769684c4d3e8 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 04 00:46:29.350833 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:29.350833 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 04 00:46:29.350833 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 04 00:46:29.350833 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 04 00:46:29.350833 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 04 00:46:29.350833 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 04 00:46:29.350833 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application result = self._query(query) Sep 04 00:46:29.350833 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 04 00:46:29.350833 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application conn.query(q) Sep 04 00:46:29.350833 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 04 00:46:29.350833 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 04 00:46:29.350833 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 04 00:46:29.350833 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application result.read() Sep 04 00:46:29.350833 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 04 00:46:29.351753 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 04 00:46:29.351753 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 04 00:46:29.351753 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 04 00:46:29.351753 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 04 00:46:29.351753 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 04 00:46:29.351753 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 04 00:46:29.351753 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 04 00:46:29.351753 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 04 00:46:29.351753 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:29.351753 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 04 00:46:29.351753 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:29.351753 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:29.351753 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 04 00:46:29.351753 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 04 00:46:29.351753 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 04 00:46:29.351753 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 04 00:46:29.351753 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 04 00:46:29.351753 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application next(self.gen) Sep 04 00:46:29.352714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 04 00:46:29.352714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application yield resource Sep 04 00:46:29.352714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 04 00:46:29.352714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application next(self.gen) Sep 04 00:46:29.352714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 04 00:46:29.352714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self.session.rollback() Sep 04 00:46:29.352714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 04 00:46:29.352714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self.force_reraise() Sep 04 00:46:29.352714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 04 00:46:29.352714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise self.value Sep 04 00:46:29.352714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 04 00:46:29.352714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 04 00:46:29.352714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 04 00:46:29.352714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application session.commit() Sep 04 00:46:29.352714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 04 00:46:29.352714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 04 00:46:29.352714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 04 00:46:29.353659 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._prepare_impl() Sep 04 00:46:29.353659 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 04 00:46:29.353659 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self.session.flush() Sep 04 00:46:29.353659 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 04 00:46:29.353659 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._flush(objects) Sep 04 00:46:29.353659 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 04 00:46:29.353659 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 04 00:46:29.353659 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 04 00:46:29.353659 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application compat.raise_( Sep 04 00:46:29.353659 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 04 00:46:29.353659 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception Sep 04 00:46:29.353659 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 04 00:46:29.353659 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application flush_context.execute() Sep 04 00:46:29.353659 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 04 00:46:29.353659 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rec.execute(self) Sep 04 00:46:29.353659 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 04 00:46:29.353659 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 04 00:46:29.358242 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 04 00:46:29.358242 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 04 00:46:29.358242 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 04 00:46:29.358242 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 04 00:46:29.358242 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 04 00:46:29.358242 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 04 00:46:29.358242 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 04 00:46:29.358242 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 04 00:46:29.358242 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 04 00:46:29.358242 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 04 00:46:29.358242 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 04 00:46:29.358242 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 04 00:46:29.358242 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 04 00:46:29.358242 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 04 00:46:29.358242 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 04 00:46:29.358242 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception Sep 04 00:46:29.359138 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 04 00:46:29.359138 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 04 00:46:29.359138 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 04 00:46:29.359138 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 04 00:46:29.359138 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 04 00:46:29.359138 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application result = self._query(query) Sep 04 00:46:29.359138 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 04 00:46:29.359138 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application conn.query(q) Sep 04 00:46:29.359138 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 04 00:46:29.359138 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 04 00:46:29.359138 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 04 00:46:29.359138 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application result.read() Sep 04 00:46:29.359138 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 04 00:46:29.359138 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 04 00:46:29.359138 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 04 00:46:29.359138 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 04 00:46:29.360309 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 04 00:46:29.360309 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 04 00:46:29.360309 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 04 00:46:29.360309 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 04 00:46:29.360309 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 04 00:46:29.360309 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 04 00:46:29.360309 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [parameters: {'user_id': '6934fa1828844c99a78378b6871ba083', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 04 00:46:29.360309 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 04 00:46:29.360309 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:29.360309 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 00:46:29.360309 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:29.360309 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:29.360309 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:29.360309 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:29.360309 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:29.361145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:29.361145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:29.361145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:29.361145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:29.361145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:29.361145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:29.361145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:29.361145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 04 00:46:29.361145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 04 00:46:29.361145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:29.361145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:29.361145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 00:46:29.361145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:46:29.361145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 00:46:29.361145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:46:29.361145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 04 00:46:29.361145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 04 00:46:29.362350 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 04 00:46:29.362350 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 04 00:46:29.362350 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 04 00:46:29.362350 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 04 00:46:29.362350 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 04 00:46:29.362350 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:29.362350 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 486/971] 10.222.0.30 () {60 vars in 1131 bytes} [Sun Sep 4 00:46:29 2022] POST /identity/v3/users => generated 160 bytes in 212 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:46:29.364770 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7dd62-0eac-421d-9923-769684c4d3e8 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:29.428073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d64ec9-8464-4b71-ba44-816de7e05652 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:29.470351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660a665-bebc-4021-9772-006e93bdc11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:29.471470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660a665-bebc-4021-9772-006e93bdc11f None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:29.471853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660a665-bebc-4021-9772-006e93bdc11f None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:29.472227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660a665-bebc-4021-9772-006e93bdc11f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:29.486159 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:29.490958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7dd62-0eac-421d-9923-769684c4d3e8 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:29.537073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9331816-3eeb-429e-8146-659f3918d4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:29.538540 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9331816-3eeb-429e-8146-659f3918d4bb None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:29.539207 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9331816-3eeb-429e-8146-659f3918d4bb None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:29.539432 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9331816-3eeb-429e-8146-659f3918d4bb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:29.547787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9331816-3eeb-429e-8146-659f3918d4bb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:29.549695 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9331816-3eeb-429e-8146-659f3918d4bb None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:29.558303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660a665-bebc-4021-9772-006e93bdc11f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:29.559932 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660a665-bebc-4021-9772-006e93bdc11f None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:29.562764 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:29.563651 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-f9331816-3eeb-429e-8146-659f3918d4bb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 04 00:46:29.563651 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:29.563651 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:29.563651 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:29.563651 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:29.563651 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:29.563651 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:29.563651 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:29.563651 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:29.563651 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:29.563651 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:29.563651 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:29.563651 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 04 00:46:29.563651 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 04 00:46:29.563651 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 04 00:46:29.563651 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 04 00:46:29.564574 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:29.564574 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:29.564574 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 00:46:29.564574 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:46:29.564574 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 00:46:29.564574 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:46:29.564574 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:29.564574 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:29.564574 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:29.564574 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:29.564574 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:29.564574 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:29.564574 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:29.564574 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:29.564574 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:29.564574 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:29.564574 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:29.564574 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:29.565996 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:29.565996 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:29.565996 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 00:46:29.565996 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 00:46:29.565996 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 00:46:29.565996 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 00:46:29.565996 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 00:46:29.565996 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 00:46:29.565996 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 04 00:46:29.565996 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:29.568272 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 487/972] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:46:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:29.574432 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9331816-3eeb-429e-8146-659f3918d4bb None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:29.684964 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 486/973] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:46:29 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 04 00:46:29.686080 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660a665-bebc-4021-9772-006e93bdc11f None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:29.708434 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9331816-3eeb-429e-8146-659f3918d4bb None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:29.746494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc2e28-7e4e-45c0-9641-d26c31dec6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:29.747267 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc2e28-7e4e-45c0-9641-d26c31dec6db None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:29.747684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc2e28-7e4e-45c0-9641-d26c31dec6db None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:29.748060 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc2e28-7e4e-45c0-9641-d26c31dec6db None admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:29.748857 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc2e28-7e4e-45c0-9641-d26c31dec6db None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:29.749260 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc2e28-7e4e-45c0-9641-d26c31dec6db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:29.750961 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc2e28-7e4e-45c0-9641-d26c31dec6db None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:29.802159 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 488/974] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Sep 4 00:46:29 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:29.804872 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660a665-bebc-4021-9772-006e93bdc11f None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:29.807946 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:29.844739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7306c28-beca-4672-899a-cb15eab8c83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:29.845385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7306c28-beca-4672-899a-cb15eab8c83a None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:29.845694 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7306c28-beca-4672-899a-cb15eab8c83a None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:29.845961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7306c28-beca-4672-899a-cb15eab8c83a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:29.857544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7306c28-beca-4672-899a-cb15eab8c83a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:29.859123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7306c28-beca-4672-899a-cb15eab8c83a None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:29.875516 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-e7306c28-beca-4672-899a-cb15eab8c83a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:29.875516 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:29.875516 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:29.875516 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:29.875516 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:29.875516 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:29.875516 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:29.875516 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:29.875516 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:29.875516 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:29.875516 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:29.875516 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:29.875516 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:46:29.875516 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:46:29.875516 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:46:29.875516 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:46:29.876553 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:29.876553 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:29.876553 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:29.876553 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:29.876553 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:29.876553 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:29.876553 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:29.876553 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:29.876553 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:29.876553 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:29.876553 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:29.876553 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:29.876553 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:29.876553 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:29.876553 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:29.876553 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:29.876553 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:46:29.877493 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:46:29.877493 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:29.877493 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:29.877493 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 487/975] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:46:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:29.884537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc2e28-7e4e-45c0-9641-d26c31dec6db None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:29.910036 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:29.997834 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc2e28-7e4e-45c0-9641-d26c31dec6db None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:30.033794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd2390-37a5-44dd-9bd4-d3c8381e59ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:30.034412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd2390-37a5-44dd-9bd4-d3c8381e59ba None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:30.034682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd2390-37a5-44dd-9bd4-d3c8381e59ba None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:30.034949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd2390-37a5-44dd-9bd4-d3c8381e59ba None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:30.035581 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd2390-37a5-44dd-9bd4-d3c8381e59ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:30.035876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd2390-37a5-44dd-9bd4-d3c8381e59ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:30.037229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd2390-37a5-44dd-9bd4-d3c8381e59ba None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:30.049553 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 489/976] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:30.055648 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7306c28-beca-4672-899a-cb15eab8c83a None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:30.162794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7306c28-beca-4672-899a-cb15eab8c83a None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:30.202400 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddbb01-5636-4ab3-a4b7-a1f1d6368713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:30.203109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddbb01-5636-4ab3-a4b7-a1f1d6368713 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:30.203390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddbb01-5636-4ab3-a4b7-a1f1d6368713 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:30.204283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddbb01-5636-4ab3-a4b7-a1f1d6368713 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:30.212637 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eddbb01-5636-4ab3-a4b7-a1f1d6368713 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:30.214123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eddbb01-5636-4ab3-a4b7-a1f1d6368713 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:30.225352 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-9eddbb01-5636-4ab3-a4b7-a1f1d6368713 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:46:30.225352 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:30.225352 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:30.225352 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:30.225352 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:30.225352 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:30.225352 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:30.225352 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:30.225352 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:30.225352 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:30.225352 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:30.225352 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:30.225352 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 04 00:46:30.225352 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 04 00:46:30.225352 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 04 00:46:30.226539 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 04 00:46:30.226539 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:30.226539 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:30.226539 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:30.226539 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:30.226539 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:30.226539 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:30.226539 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:30.226539 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:30.226539 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:30.226539 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:30.226539 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:30.226539 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:30.226539 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:30.226539 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:30.226539 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:30.226539 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:30.227439 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 04 00:46:30.227439 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 04 00:46:30.227439 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 00:46:30.227439 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 00:46:30.227439 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 00:46:30.227439 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 00:46:30.227439 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:46:30.227439 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:30.227439 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 488/977] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:46:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:30.232407 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd2390-37a5-44dd-9bd4-d3c8381e59ba None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:30.312248 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:30.335279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd2390-37a5-44dd-9bd4-d3c8381e59ba None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:30.369762 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185389f-430d-4c4e-b1e7-71469db819a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:30.370447 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185389f-430d-4c4e-b1e7-71469db819a8 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:30.370798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185389f-430d-4c4e-b1e7-71469db819a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:30.371142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185389f-430d-4c4e-b1e7-71469db819a8 None admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:30.371903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185389f-430d-4c4e-b1e7-71469db819a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:30.372279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185389f-430d-4c4e-b1e7-71469db819a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:30.373805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185389f-430d-4c4e-b1e7-71469db819a8 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:30.386388 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 490/978] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Sep 4 00:46:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:30.392074 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddbb01-5636-4ab3-a4b7-a1f1d6368713 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:30.410562 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:30.513694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489e0b4-57b7-4061-9839-b18a93170a82 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:30.514137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489e0b4-57b7-4061-9839-b18a93170a82 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:30.514519 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489e0b4-57b7-4061-9839-b18a93170a82 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:30.515948 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 491/979] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 04 00:46:30.516703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddbb01-5636-4ab3-a4b7-a1f1d6368713 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:30.522546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3abd8-e845-4d7a-bda1-481c393d0e31 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:30.522945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3abd8-e845-4d7a-bda1-481c393d0e31 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:30.523326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3abd8-e845-4d7a-bda1-481c393d0e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:30.542009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-22d3abd8-e845-4d7a-bda1-481c393d0e31 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:30.543740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-22d3abd8-e845-4d7a-bda1-481c393d0e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:30.555275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954e919-55ee-41a4-bfbc-64cbc5198c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:30.555955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954e919-55ee-41a4-bfbc-64cbc5198c24 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:30.556309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954e919-55ee-41a4-bfbc-64cbc5198c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:30.556582 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954e919-55ee-41a4-bfbc-64cbc5198c24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:30.557299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954e919-55ee-41a4-bfbc-64cbc5198c24 None admin] RBAC: Adding query filter params (role.id=fd671e98e0424c60995238aaa9dcdd5d, scope.project.id=40b24e92f8594ee08bd2a55f79e3b299, user.id=00543899e82647e8ba187b8d0b60d8c9) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:30.557633 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954e919-55ee-41a4-bfbc-64cbc5198c24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:30.559068 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954e919-55ee-41a4-bfbc-64cbc5198c24 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:30.569661 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 489/980] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:46:30 2022] GET /identity/v3/role_assignments?user.id=00543899e82647e8ba187b8d0b60d8c9&scope.project.id=40b24e92f8594ee08bd2a55f79e3b299&role.id=fd671e98e0424c60995238aaa9dcdd5d => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:30.616390 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 492/981] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 04 00:46:30.625662 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eeaf85-df6f-4c57-840c-9faa93e06e44 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:30.625943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eeaf85-df6f-4c57-840c-9faa93e06e44 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:30.626214 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eeaf85-df6f-4c57-840c-9faa93e06e44 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:30.627695 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 490/982] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:30.633333 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356e6a6-b15f-4215-a030-b9011fff418c None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:30.633659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356e6a6-b15f-4215-a030-b9011fff418c None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:30.633931 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356e6a6-b15f-4215-a030-b9011fff418c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:30.652831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-0356e6a6-b15f-4215-a030-b9011fff418c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:30.654063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0356e6a6-b15f-4215-a030-b9011fff418c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:30.722200 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:30.728921 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 493/983] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:46:30.892226 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eeaf85-df6f-4c57-840c-9faa93e06e44 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:30.973637 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:30.995018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eeaf85-df6f-4c57-840c-9faa93e06e44 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:31.008549 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356e6a6-b15f-4215-a030-b9011fff418c None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:31.031076 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d4e40-e7ef-456f-8fcc-f23abc62d7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:31.031699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d4e40-e7ef-456f-8fcc-f23abc62d7bc None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:31.031974 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d4e40-e7ef-456f-8fcc-f23abc62d7bc None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:31.032242 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d4e40-e7ef-456f-8fcc-f23abc62d7bc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:31.032815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d4e40-e7ef-456f-8fcc-f23abc62d7bc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:31.034208 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d4e40-e7ef-456f-8fcc-f23abc62d7bc None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:31.044802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-6a1d4e40-e7ef-456f-8fcc-f23abc62d7bc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 04 00:46:31.044802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:31.044802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 04 00:46:31.044802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 04 00:46:31.044802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 04 00:46:31.044802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 04 00:46:31.044802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 04 00:46:31.044802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:31.044802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 04 00:46:31.044802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:31.044802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 00:46:31.044802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:31.044802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:31.044802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:31.044802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:31.044802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:31.044802 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:31.045859 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:31.045859 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:31.045859 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:31.045859 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:31.045859 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:31.045859 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:31.045859 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 04 00:46:31.045859 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 04 00:46:31.045859 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 04 00:46:31.045859 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 04 00:46:31.045859 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:31.045859 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:31.045859 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:31.045859 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:31.045859 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:31.045859 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:31.050821 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:31.050821 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:31.050821 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:31.050821 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:31.050821 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:31.050821 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:31.050821 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:31.050821 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:31.050821 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:31.050821 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:31.050821 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 04 00:46:31.050821 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:31.050821 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 04 00:46:31.050821 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:31.050821 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 491/984] 10.222.0.30 () {56 vars in 1126 bytes} [Sun Sep 4 00:46:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:31.052697 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d4e40-e7ef-456f-8fcc-f23abc62d7bc None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:31.113768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356e6a6-b15f-4215-a030-b9011fff418c None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:31.153109 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aeaa05-1f6d-4398-837d-addb855faa52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:31.153660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aeaa05-1f6d-4398-837d-addb855faa52 None admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:31.153935 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aeaa05-1f6d-4398-837d-addb855faa52 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:31.154203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aeaa05-1f6d-4398-837d-addb855faa52 None admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:31.154838 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aeaa05-1f6d-4398-837d-addb855faa52 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:31.156189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aeaa05-1f6d-4398-837d-addb855faa52 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:31.160144 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d4e40-e7ef-456f-8fcc-f23abc62d7bc None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:31.173693 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 494/985] 10.222.0.30 () {60 vars in 1141 bytes} [Sun Sep 4 00:46:31 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 00:46:31.210679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948fdfe1-a752-42bb-b86a-c25989437266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:31.211642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948fdfe1-a752-42bb-b86a-c25989437266 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:31.212160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948fdfe1-a752-42bb-b86a-c25989437266 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:31.212615 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948fdfe1-a752-42bb-b86a-c25989437266 None admin] PATH_INFO: `/v3/services` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:31.213422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948fdfe1-a752-42bb-b86a-c25989437266 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:31.213932 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948fdfe1-a752-42bb-b86a-c25989437266 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:31.215541 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948fdfe1-a752-42bb-b86a-c25989437266 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:31.221709 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 492/986] 10.222.0.30 () {56 vars in 1122 bytes} [Sun Sep 4 00:46:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:31.227633 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aeaa05-1f6d-4398-837d-addb855faa52 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:31.295179 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:31.343179 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aeaa05-1f6d-4398-837d-addb855faa52 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:31.378176 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ac739-687b-4794-b99b-a424c53a1b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:31.378780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ac739-687b-4794-b99b-a424c53a1b57 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:31.379048 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ac739-687b-4794-b99b-a424c53a1b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:31.379310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ac739-687b-4794-b99b-a424c53a1b57 None admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:31.379958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ac739-687b-4794-b99b-a424c53a1b57 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:31.380258 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ac739-687b-4794-b99b-a424c53a1b57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:31.382128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ac739-687b-4794-b99b-a424c53a1b57 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:31.387266 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 495/987] 10.222.0.30 () {56 vars in 1122 bytes} [Sun Sep 4 00:46:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:31.393171 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948fdfe1-a752-42bb-b86a-c25989437266 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:31.397572 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:31.501995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948fdfe1-a752-42bb-b86a-c25989437266 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:31.536235 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e53c508-d4c6-45fa-ab91-b65d9de7dda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:31.536864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53c508-d4c6-45fa-ab91-b65d9de7dda1 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:31.537102 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53c508-d4c6-45fa-ab91-b65d9de7dda1 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:31.537367 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53c508-d4c6-45fa-ab91-b65d9de7dda1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:31.538097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e53c508-d4c6-45fa-ab91-b65d9de7dda1 None admin] RBAC: Adding query filter params (interface=admin, service_id=b138a5476ce34aa59ad307c20e8e9b1c, region_id=RegionOne) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:31.538402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e53c508-d4c6-45fa-ab91-b65d9de7dda1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:31.539756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e53c508-d4c6-45fa-ab91-b65d9de7dda1 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:31.549471 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 493/988] 10.222.0.30 () {56 vars in 1249 bytes} [Sun Sep 4 00:46:31 2022] GET /identity/v3/endpoints?service_id=b138a5476ce34aa59ad307c20e8e9b1c&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:31.550992 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ac739-687b-4794-b99b-a424c53a1b57 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:31.653828 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ac739-687b-4794-b99b-a424c53a1b57 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:31.678822 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:31.691375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f49a8-6487-412e-90c4-e3147b80543b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:31.691993 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f49a8-6487-412e-90c4-e3147b80543b None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:31.692277 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f49a8-6487-412e-90c4-e3147b80543b None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:31.692558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f49a8-6487-412e-90c4-e3147b80543b None admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:31.693165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f49a8-6487-412e-90c4-e3147b80543b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:31.695201 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f49a8-6487-412e-90c4-e3147b80543b None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:31.709623 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 496/989] 10.222.0.30 () {56 vars in 1087 bytes} [Sun Sep 4 00:46:31 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 00:46:32.503186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d557b-1344-4b50-a34a-d2ceb63190c3 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:32.503492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d557b-1344-4b50-a34a-d2ceb63190c3 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:32.503742 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d557b-1344-4b50-a34a-d2ceb63190c3 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:32.505255 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 494/990] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:32.510326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417933cb-d6fb-4ac0-a953-3dc0243a991b None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:32.510772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417933cb-d6fb-4ac0-a953-3dc0243a991b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:32.510954 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417933cb-d6fb-4ac0-a953-3dc0243a991b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:32.529324 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-417933cb-d6fb-4ac0-a953-3dc0243a991b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:32.530491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-417933cb-d6fb-4ac0-a953-3dc0243a991b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:32.595695 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 497/991] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:32 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:46:32.862565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d557b-1344-4b50-a34a-d2ceb63190c3 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:32.929866 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:32.966161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d557b-1344-4b50-a34a-d2ceb63190c3 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:32.999816 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4ed4f-8f2b-4ccb-bc09-7048ad95a824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:33.000438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4ed4f-8f2b-4ccb-bc09-7048ad95a824 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:33.000718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4ed4f-8f2b-4ccb-bc09-7048ad95a824 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:33.000991 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4ed4f-8f2b-4ccb-bc09-7048ad95a824 None admin] PATH_INFO: `/v3/services/image` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:33.001598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db4ed4f-8f2b-4ccb-bc09-7048ad95a824 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:33.002960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db4ed4f-8f2b-4ccb-bc09-7048ad95a824 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:33.012306 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-8db4ed4f-8f2b-4ccb-bc09-7048ad95a824 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 04 00:46:33.012306 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:33.012306 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 04 00:46:33.012306 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 04 00:46:33.012306 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 04 00:46:33.012306 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 04 00:46:33.012306 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 04 00:46:33.012306 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:33.012306 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 04 00:46:33.012306 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:33.012306 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 00:46:33.012306 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:33.012306 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:33.012306 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:33.012306 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:33.012306 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:33.012306 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:33.013289 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:33.013289 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:33.013289 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:33.013289 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:33.013289 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:33.013289 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:33.013289 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 04 00:46:33.013289 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 04 00:46:33.013289 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 04 00:46:33.013289 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 04 00:46:33.013289 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:33.013289 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:33.013289 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:33.013289 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:33.013289 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:33.013289 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:33.014150 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:33.014150 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:33.014150 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:33.014150 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:33.014150 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:33.014150 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:33.014150 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:33.014150 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:33.014150 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:33.014150 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:33.014150 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 04 00:46:33.014150 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:33.014150 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 04 00:46:33.014150 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:33.017781 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 495/992] 10.222.0.30 () {56 vars in 1105 bytes} [Sun Sep 4 00:46:32 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:33.019324 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417933cb-d6fb-4ac0-a953-3dc0243a991b None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:33.088249 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b99b8-bea1-4881-ba77-1fe067346b3a None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:33.088532 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b99b8-bea1-4881-ba77-1fe067346b3a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:33.088795 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b99b8-bea1-4881-ba77-1fe067346b3a None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:33.090293 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 496/993] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:33.094819 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8912c8-9195-4b28-82fb-fe32d26a9d28 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:33.095100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8912c8-9195-4b28-82fb-fe32d26a9d28 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:33.095374 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8912c8-9195-4b28-82fb-fe32d26a9d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:33.114161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-bc8912c8-9195-4b28-82fb-fe32d26a9d28 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:33.115234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-bc8912c8-9195-4b28-82fb-fe32d26a9d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:33.119695 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417933cb-d6fb-4ac0-a953-3dc0243a991b None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:33.136818 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:33.156070 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6a542-61f7-491f-96be-e6bb4ec901bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:33.156680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6a542-61f7-491f-96be-e6bb4ec901bc None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:33.156959 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6a542-61f7-491f-96be-e6bb4ec901bc None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:33.157232 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6a542-61f7-491f-96be-e6bb4ec901bc None admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:33.157904 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6a542-61f7-491f-96be-e6bb4ec901bc None admin] RBAC: Adding query filter params (name=image) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:33.158185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6a542-61f7-491f-96be-e6bb4ec901bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:33.159586 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6a542-61f7-491f-96be-e6bb4ec901bc None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:33.164839 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 498/994] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:46:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:33.170861 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6a542-61f7-491f-96be-e6bb4ec901bc None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:33.188586 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 497/995] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:33 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 04 00:46:33.270854 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6a542-61f7-491f-96be-e6bb4ec901bc None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:33.304628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314997e-92f0-4163-a746-6913d23b56a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:33.305244 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314997e-92f0-4163-a746-6913d23b56a7 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:33.305559 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314997e-92f0-4163-a746-6913d23b56a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:33.305833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314997e-92f0-4163-a746-6913d23b56a7 None admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:33.306456 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e314997e-92f0-4163-a746-6913d23b56a7 None admin] RBAC: Adding query filter params (type=image) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:33.306756 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e314997e-92f0-4163-a746-6913d23b56a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:33.308108 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e314997e-92f0-4163-a746-6913d23b56a7 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:33.312840 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 499/996] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:46:33 2022] GET /identity/v3/services?type=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:33.458507 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8912c8-9195-4b28-82fb-fe32d26a9d28 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:33.522246 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:33.564308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8912c8-9195-4b28-82fb-fe32d26a9d28 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:33.598115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319ec80-12ad-484d-a667-859496398bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:33.598756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319ec80-12ad-484d-a667-859496398bff None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:33.599039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319ec80-12ad-484d-a667-859496398bff None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:33.599314 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319ec80-12ad-484d-a667-859496398bff None admin] PATH_INFO: `/v3/services/compute` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:33.600413 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319ec80-12ad-484d-a667-859496398bff None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:33.601819 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319ec80-12ad-484d-a667-859496398bff None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:33.610874 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-c319ec80-12ad-484d-a667-859496398bff None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 04 00:46:33.610874 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:33.610874 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 04 00:46:33.610874 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 04 00:46:33.610874 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 04 00:46:33.610874 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 04 00:46:33.610874 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 04 00:46:33.610874 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:33.610874 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 04 00:46:33.610874 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:33.610874 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 00:46:33.610874 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:33.610874 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:33.610874 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:33.610874 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:33.610874 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:33.610874 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:33.611850 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:33.611850 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:33.611850 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:33.611850 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:33.611850 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:33.611850 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:33.611850 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 04 00:46:33.611850 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 04 00:46:33.611850 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 04 00:46:33.611850 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 04 00:46:33.611850 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:33.611850 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:33.611850 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:33.611850 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:33.611850 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:33.611850 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:33.612695 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:33.612695 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:33.612695 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:33.612695 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:33.612695 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:33.612695 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:33.612695 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:33.612695 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:33.612695 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:33.612695 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:33.612695 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 04 00:46:33.612695 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:33.612695 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 04 00:46:33.612695 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:33.612695 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 498/997] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:46:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:33.620026 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314997e-92f0-4163-a746-6913d23b56a7 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:33.624260 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf87105-c71d-494b-9f06-bdb7cd0f34ef None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:33.624539 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf87105-c71d-494b-9f06-bdb7cd0f34ef None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:33.624809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf87105-c71d-494b-9f06-bdb7cd0f34ef None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:33.626155 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 499/998] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:33.631198 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1375336-3fa3-4120-9c8c-69f7bf2ccbe5 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:33.631476 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1375336-3fa3-4120-9c8c-69f7bf2ccbe5 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:33.631745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1375336-3fa3-4120-9c8c-69f7bf2ccbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:33.649488 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-f1375336-3fa3-4120-9c8c-69f7bf2ccbe5 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:33.650915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f1375336-3fa3-4120-9c8c-69f7bf2ccbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:33.670553 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:33.727665 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314997e-92f0-4163-a746-6913d23b56a7 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:33.728198 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 500/999] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:33 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 04 00:46:33.763661 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883dd672-e418-4478-9a63-79b2e17abfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:33.764269 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883dd672-e418-4478-9a63-79b2e17abfc9 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:33.764541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883dd672-e418-4478-9a63-79b2e17abfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:33.764805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883dd672-e418-4478-9a63-79b2e17abfc9 None admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:33.765559 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883dd672-e418-4478-9a63-79b2e17abfc9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:33.765859 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883dd672-e418-4478-9a63-79b2e17abfc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:33.767235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883dd672-e418-4478-9a63-79b2e17abfc9 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:33.777143 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 500/1000] 10.222.0.30 () {56 vars in 1112 bytes} [Sun Sep 4 00:46:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:33.778677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1375336-3fa3-4120-9c8c-69f7bf2ccbe5 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:33.836456 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:33.880767 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1375336-3fa3-4120-9c8c-69f7bf2ccbe5 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:33.914587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d2304-edc7-4669-975b-5aaa0dfcd3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:33.915197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d2304-edc7-4669-975b-5aaa0dfcd3aa None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:33.915480 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d2304-edc7-4669-975b-5aaa0dfcd3aa None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:33.915753 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d2304-edc7-4669-975b-5aaa0dfcd3aa None admin] PATH_INFO: `/v3/services` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:33.916376 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d2304-edc7-4669-975b-5aaa0dfcd3aa None admin] RBAC: Adding query filter params (type=compute) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:33.916678 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d2304-edc7-4669-975b-5aaa0dfcd3aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:33.918085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d2304-edc7-4669-975b-5aaa0dfcd3aa None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:33.927539 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 501/1001] 10.222.0.30 () {56 vars in 1112 bytes} [Sun Sep 4 00:46:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:33.928628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883dd672-e418-4478-9a63-79b2e17abfc9 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:33.995962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d2304-edc7-4669-975b-5aaa0dfcd3aa None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:34.031924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883dd672-e418-4478-9a63-79b2e17abfc9 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:34.041135 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:34.067533 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7efa1f-80a8-4efd-ac12-b7316c875449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:34.068137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7efa1f-80a8-4efd-ac12-b7316c875449 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:34.068412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7efa1f-80a8-4efd-ac12-b7316c875449 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:34.069203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7efa1f-80a8-4efd-ac12-b7316c875449 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:34.069935 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7efa1f-80a8-4efd-ac12-b7316c875449 None admin] RBAC: Adding query filter params (interface=public, service_id=a70919409e2c4e7b9f5c7adf935d661f, region_id=RegionOne) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:34.070239 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7efa1f-80a8-4efd-ac12-b7316c875449 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:34.071602 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7efa1f-80a8-4efd-ac12-b7316c875449 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:34.081008 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 501/1002] 10.222.0.30 () {56 vars in 1251 bytes} [Sun Sep 4 00:46:33 2022] GET /identity/v3/endpoints?service_id=a70919409e2c4e7b9f5c7adf935d661f&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:34.081976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7efa1f-80a8-4efd-ac12-b7316c875449 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:34.101265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d2304-edc7-4669-975b-5aaa0dfcd3aa None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:34.121453 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:34.136765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed6417-e4d0-4885-8367-f798bb3a2cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:34.137385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed6417-e4d0-4885-8367-f798bb3a2cd6 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:34.137707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed6417-e4d0-4885-8367-f798bb3a2cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:34.137982 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed6417-e4d0-4885-8367-f798bb3a2cd6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:34.138559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed6417-e4d0-4885-8367-f798bb3a2cd6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:34.140188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed6417-e4d0-4885-8367-f798bb3a2cd6 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:34.150354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-0fed6417-e4d0-4885-8367-f798bb3a2cd6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 04 00:46:34.150354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:34.150354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 04 00:46:34.150354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 04 00:46:34.150354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 04 00:46:34.150354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 04 00:46:34.150354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 04 00:46:34.150354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:34.150354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 04 00:46:34.150354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:34.150354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 00:46:34.150354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:34.150354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:34.150354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:34.150354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:34.150354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:34.150354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:34.151509 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:34.151509 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:34.151509 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:34.151509 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:34.151509 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:34.151509 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:34.151509 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 04 00:46:34.151509 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 04 00:46:34.151509 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 04 00:46:34.151509 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 04 00:46:34.151509 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:34.151509 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:34.151509 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:34.151509 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:34.151509 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:34.151509 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:34.152920 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:34.152920 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:34.152920 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:34.152920 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:34.152920 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:34.152920 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:34.152920 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:34.152920 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:34.152920 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:34.152920 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:34.152920 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 04 00:46:34.152920 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:34.152920 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 04 00:46:34.152920 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:34.152920 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 502/1003] 10.222.0.30 () {56 vars in 1126 bytes} [Sun Sep 4 00:46:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:46:34.157390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed6417-e4d0-4885-8367-f798bb3a2cd6 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:34.189065 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7efa1f-80a8-4efd-ac12-b7316c875449 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:34.228470 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6d56a-b88d-4861-8d63-e9b75c21adbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:34.229887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6d56a-b88d-4861-8d63-e9b75c21adbe None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:34.230165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6d56a-b88d-4861-8d63-e9b75c21adbe None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:34.230433 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6d56a-b88d-4861-8d63-e9b75c21adbe None admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:34.231029 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c6d56a-b88d-4861-8d63-e9b75c21adbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:34.232373 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c6d56a-b88d-4861-8d63-e9b75c21adbe None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:34.239008 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 502/1004] 10.222.0.30 () {56 vars in 1087 bytes} [Sun Sep 4 00:46:34 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 00:46:34.273548 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed6417-e4d0-4885-8367-f798bb3a2cd6 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:34.310887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092080d9-9a90-4545-96a2-70f24410b0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:34.311506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092080d9-9a90-4545-96a2-70f24410b0c2 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:34.311785 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092080d9-9a90-4545-96a2-70f24410b0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:34.312059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092080d9-9a90-4545-96a2-70f24410b0c2 None admin] PATH_INFO: `/v3/services` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:34.312708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092080d9-9a90-4545-96a2-70f24410b0c2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:34.313014 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092080d9-9a90-4545-96a2-70f24410b0c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:34.314485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092080d9-9a90-4545-96a2-70f24410b0c2 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:34.320517 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 503/1005] 10.222.0.30 () {56 vars in 1122 bytes} [Sun Sep 4 00:46:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:34.326791 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6d56a-b88d-4861-8d63-e9b75c21adbe None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:34.366739 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:34.439117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6d56a-b88d-4861-8d63-e9b75c21adbe None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:34.498335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8794b98-9a88-4004-80ab-44af0a7338ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:34.498960 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8794b98-9a88-4004-80ab-44af0a7338ff None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:34.499239 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8794b98-9a88-4004-80ab-44af0a7338ff None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:34.499508 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8794b98-9a88-4004-80ab-44af0a7338ff None admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:34.500139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8794b98-9a88-4004-80ab-44af0a7338ff None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:34.500439 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8794b98-9a88-4004-80ab-44af0a7338ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:34.501835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8794b98-9a88-4004-80ab-44af0a7338ff None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:34.507901 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 503/1006] 10.222.0.30 () {56 vars in 1122 bytes} [Sun Sep 4 00:46:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:34.513342 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092080d9-9a90-4545-96a2-70f24410b0c2 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:34.562863 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:34.614436 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092080d9-9a90-4545-96a2-70f24410b0c2 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:34.649316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aace999-cc9a-4b9c-a9b3-6fad385d1b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:34.649948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aace999-cc9a-4b9c-a9b3-6fad385d1b8e None admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:34.650221 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aace999-cc9a-4b9c-a9b3-6fad385d1b8e None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:34.650488 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aace999-cc9a-4b9c-a9b3-6fad385d1b8e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:34.651155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aace999-cc9a-4b9c-a9b3-6fad385d1b8e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:34.652513 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aace999-cc9a-4b9c-a9b3-6fad385d1b8e None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:34.673527 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 504/1007] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 00:46:34 2022] POST /identity/v3/endpoints => generated 325 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:46:35.224156 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94963a3-42f8-4969-995b-f74756a9984d None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:35.224701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94963a3-42f8-4969-995b-f74756a9984d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:35.224701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94963a3-42f8-4969-995b-f74756a9984d None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:35.226679 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 504/1008] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:35.231733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395997b-5c7d-4dcf-a5bf-d983d8ed7d45 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:35.232131 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395997b-5c7d-4dcf-a5bf-d983d8ed7d45 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:35.232302 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395997b-5c7d-4dcf-a5bf-d983d8ed7d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:35.250988 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-d395997b-5c7d-4dcf-a5bf-d983d8ed7d45 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:35.252165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d395997b-5c7d-4dcf-a5bf-d983d8ed7d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:35.326933 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 505/1009] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:35 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:46:35.593948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94963a3-42f8-4969-995b-f74756a9984d None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:35.697090 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:35.702326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94963a3-42f8-4969-995b-f74756a9984d None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:35.737457 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b91908-c8ed-4dff-8862-0f5e9c3fb35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:35.738217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b91908-c8ed-4dff-8862-0f5e9c3fb35c None admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:35.738565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b91908-c8ed-4dff-8862-0f5e9c3fb35c None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:35.738904 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b91908-c8ed-4dff-8862-0f5e9c3fb35c None admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:35.739608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b91908-c8ed-4dff-8862-0f5e9c3fb35c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:35.741071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b91908-c8ed-4dff-8862-0f5e9c3fb35c None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:35.761480 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 505/1010] 10.222.0.30 () {60 vars in 1141 bytes} [Sun Sep 4 00:46:35 2022] POST /identity/v3/services => generated 242 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:46:36.195197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de9bd7-6cfe-4196-9602-e0d23da8f24c None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:36.195590 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de9bd7-6cfe-4196-9602-e0d23da8f24c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:36.195781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de9bd7-6cfe-4196-9602-e0d23da8f24c None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:36.197229 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 506/1011] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:36.202309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ab2f0-bd70-4cd5-8a56-9c8db0f5fbb9 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:36.202604 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ab2f0-bd70-4cd5-8a56-9c8db0f5fbb9 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:36.202882 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ab2f0-bd70-4cd5-8a56-9c8db0f5fbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:36.220995 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5f9ab2f0-bd70-4cd5-8a56-9c8db0f5fbb9 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:36.222223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5f9ab2f0-bd70-4cd5-8a56-9c8db0f5fbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:36.296541 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 506/1012] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:36 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:46:36.563024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de9bd7-6cfe-4196-9602-e0d23da8f24c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:36.575222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499c47e-5fff-4a8f-b5d5-df041d7b40b5 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:36.575510 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499c47e-5fff-4a8f-b5d5-df041d7b40b5 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:36.575783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499c47e-5fff-4a8f-b5d5-df041d7b40b5 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:36.577245 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 507/1013] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:36.581892 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee6a34-2062-43d1-bd4e-7d1e8ec3a7a5 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:36.582172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee6a34-2062-43d1-bd4e-7d1e8ec3a7a5 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:36.582445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee6a34-2062-43d1-bd4e-7d1e8ec3a7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:36.600718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-deee6a34-2062-43d1-bd4e-7d1e8ec3a7a5 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:36.601110 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:36.602567 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-deee6a34-2062-43d1-bd4e-7d1e8ec3a7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:36.672830 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 508/1014] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:36 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 04 00:46:36.679306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de9bd7-6cfe-4196-9602-e0d23da8f24c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:36.714258 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb6ecb-dc22-4f6f-a326-97ba43e7dcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:36.715098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb6ecb-dc22-4f6f-a326-97ba43e7dcd3 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:36.715529 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb6ecb-dc22-4f6f-a326-97ba43e7dcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:36.715940 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb6ecb-dc22-4f6f-a326-97ba43e7dcd3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:36.716655 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb6ecb-dc22-4f6f-a326-97ba43e7dcd3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:36.718189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb6ecb-dc22-4f6f-a326-97ba43e7dcd3 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:36.728241 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-87eb6ecb-dc22-4f6f-a326-97ba43e7dcd3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 04 00:46:36.728241 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:36.728241 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 04 00:46:36.728241 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 04 00:46:36.728241 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 04 00:46:36.728241 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 04 00:46:36.728241 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 04 00:46:36.728241 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:36.728241 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 04 00:46:36.728241 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:36.728241 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 00:46:36.728241 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:36.728241 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:36.728241 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:36.728241 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:36.728241 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:36.728241 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:36.729373 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:36.729373 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:36.729373 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:36.729373 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:36.729373 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:36.729373 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:36.729373 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 04 00:46:36.729373 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 04 00:46:36.729373 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 04 00:46:36.729373 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 04 00:46:36.729373 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:36.729373 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:36.729373 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:36.729373 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:36.729373 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:36.729373 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:36.730397 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:36.730397 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:36.730397 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:36.730397 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:36.730397 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:36.730397 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:36.730397 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:36.730397 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:36.730397 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:36.730397 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:36.730397 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 04 00:46:36.730397 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:36.730397 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 04 00:46:36.730397 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:36.732687 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 507/1015] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:46:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:36.739043 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee6a34-2062-43d1-bd4e-7d1e8ec3a7a5 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:36.757628 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:36.845529 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee6a34-2062-43d1-bd4e-7d1e8ec3a7a5 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:36.879980 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b053ebe3-a198-41a6-ac52-8ea5b6084714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:36.880588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053ebe3-a198-41a6-ac52-8ea5b6084714 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:36.880866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053ebe3-a198-41a6-ac52-8ea5b6084714 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:36.881164 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053ebe3-a198-41a6-ac52-8ea5b6084714 None admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:36.881875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b053ebe3-a198-41a6-ac52-8ea5b6084714 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:36.882181 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b053ebe3-a198-41a6-ac52-8ea5b6084714 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:36.883549 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b053ebe3-a198-41a6-ac52-8ea5b6084714 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:36.888561 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 509/1016] 10.222.0.30 () {56 vars in 1112 bytes} [Sun Sep 4 00:46:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:36.894105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb6ecb-dc22-4f6f-a326-97ba43e7dcd3 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:36.943940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b053ebe3-a198-41a6-ac52-8ea5b6084714 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:36.993297 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:37.000080 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb6ecb-dc22-4f6f-a326-97ba43e7dcd3 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:37.026997 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:37.043996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ed9c2-8b5f-4559-bf77-9b64a55a3d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:37.044857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ed9c2-8b5f-4559-bf77-9b64a55a3d9d None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:37.045142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ed9c2-8b5f-4559-bf77-9b64a55a3d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:37.045835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ed9c2-8b5f-4559-bf77-9b64a55a3d9d None admin] PATH_INFO: `/v3/services` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:37.046745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ed9c2-8b5f-4559-bf77-9b64a55a3d9d None admin] RBAC: Adding query filter params (type=compute) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:37.047053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ed9c2-8b5f-4559-bf77-9b64a55a3d9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:37.048076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b053ebe3-a198-41a6-ac52-8ea5b6084714 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:37.048422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ed9c2-8b5f-4559-bf77-9b64a55a3d9d None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:37.055521 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 508/1017] 10.222.0.30 () {56 vars in 1112 bytes} [Sun Sep 4 00:46:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:37.059946 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ed9c2-8b5f-4559-bf77-9b64a55a3d9d None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:37.087472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fefd65-01db-4acf-8a71-194c7c0572e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:37.088097 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fefd65-01db-4acf-8a71-194c7c0572e7 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:37.088374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fefd65-01db-4acf-8a71-194c7c0572e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:37.088636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fefd65-01db-4acf-8a71-194c7c0572e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:37.089759 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fefd65-01db-4acf-8a71-194c7c0572e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:37.091177 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fefd65-01db-4acf-8a71-194c7c0572e7 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:37.092875 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 510/1018] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:46:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:37.098391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fefd65-01db-4acf-8a71-194c7c0572e7 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:37.168398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ed9c2-8b5f-4559-bf77-9b64a55a3d9d None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:37.204951 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fefd65-01db-4acf-8a71-194c7c0572e7 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:37.205400 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0461b0b-7888-43cd-a9a8-7d56b8e81b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:37.206029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0461b0b-7888-43cd-a9a8-7d56b8e81b3a None admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:37.206304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0461b0b-7888-43cd-a9a8-7d56b8e81b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:37.206576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0461b0b-7888-43cd-a9a8-7d56b8e81b3a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:37.207231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0461b0b-7888-43cd-a9a8-7d56b8e81b3a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:37.208592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0461b0b-7888-43cd-a9a8-7d56b8e81b3a None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:37.230253 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 509/1019] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 00:46:37 2022] POST /identity/v3/endpoints => generated 334 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 00:46:37.257287 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affef4ab-ec33-4597-8d31-b3f44d2d2dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:37.257853 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affef4ab-ec33-4597-8d31-b3f44d2d2dbb None admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:37.258129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affef4ab-ec33-4597-8d31-b3f44d2d2dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:37.258419 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affef4ab-ec33-4597-8d31-b3f44d2d2dbb None admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:37.259070 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affef4ab-ec33-4597-8d31-b3f44d2d2dbb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:37.260602 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affef4ab-ec33-4597-8d31-b3f44d2d2dbb None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:37.280116 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:37.294035 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 511/1020] 10.222.0.30 () {60 vars in 1141 bytes} [Sun Sep 4 00:46:37 2022] POST /identity/v3/projects => generated 311 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 00:46:37.696094 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa6c5f-cc7a-4acc-ae80-ba3bfe587e89 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:37.696658 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa6c5f-cc7a-4acc-ae80-ba3bfe587e89 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:37.696658 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa6c5f-cc7a-4acc-ae80-ba3bfe587e89 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:37.698160 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 510/1021] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:37.703085 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4548678-fa1a-4f3c-9c5d-1a258fbd28ad None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:37.703380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4548678-fa1a-4f3c-9c5d-1a258fbd28ad None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:37.703657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4548678-fa1a-4f3c-9c5d-1a258fbd28ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:37.721624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-f4548678-fa1a-4f3c-9c5d-1a258fbd28ad None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:37.722805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f4548678-fa1a-4f3c-9c5d-1a258fbd28ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:37.793503 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 512/1022] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:37 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:46:38.061087 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa6c5f-cc7a-4acc-ae80-ba3bfe587e89 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:38.080673 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:38.162020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa6c5f-cc7a-4acc-ae80-ba3bfe587e89 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:38.195591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398f4cc-d94a-480d-a5e9-70adc50b37ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:38.196216 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398f4cc-d94a-480d-a5e9-70adc50b37ae None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:38.196497 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398f4cc-d94a-480d-a5e9-70adc50b37ae None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:38.196770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398f4cc-d94a-480d-a5e9-70adc50b37ae None admin] PATH_INFO: `/v3/services/image` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:38.197351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398f4cc-d94a-480d-a5e9-70adc50b37ae None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:38.198745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398f4cc-d94a-480d-a5e9-70adc50b37ae None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:38.207655 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-2398f4cc-d94a-480d-a5e9-70adc50b37ae None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 04 00:46:38.207655 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:38.207655 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 04 00:46:38.207655 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 04 00:46:38.207655 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 04 00:46:38.207655 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 04 00:46:38.207655 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 04 00:46:38.207655 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:38.207655 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 04 00:46:38.207655 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:38.207655 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 00:46:38.207655 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:38.207655 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:38.207655 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:38.207655 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:38.207655 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:38.207655 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:38.208616 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:38.208616 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:38.208616 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:38.208616 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:38.208616 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:38.208616 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:38.208616 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 04 00:46:38.208616 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 04 00:46:38.208616 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 04 00:46:38.208616 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 04 00:46:38.208616 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:38.208616 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:38.208616 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:38.208616 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:38.208616 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:38.208616 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:38.209946 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:38.209946 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:38.209946 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:38.209946 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:38.209946 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:38.209946 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:38.209946 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:38.209946 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:38.209946 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:38.209946 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:38.209946 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 04 00:46:38.209946 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:38.209946 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 04 00:46:38.209946 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:38.213830 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 511/1023] 10.222.0.30 () {56 vars in 1105 bytes} [Sun Sep 4 00:46:38 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:38.215096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4548678-fa1a-4f3c-9c5d-1a258fbd28ad None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:38.314691 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4548678-fa1a-4f3c-9c5d-1a258fbd28ad None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:38.341588 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:38.352121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd6913-d030-4135-b9ce-9b9a0ceccaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:38.352732 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd6913-d030-4135-b9ce-9b9a0ceccaca None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:38.353011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd6913-d030-4135-b9ce-9b9a0ceccaca None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:38.353281 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd6913-d030-4135-b9ce-9b9a0ceccaca None admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:38.353943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd6913-d030-4135-b9ce-9b9a0ceccaca None admin] RBAC: Adding query filter params (name=image) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:38.354246 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd6913-d030-4135-b9ce-9b9a0ceccaca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:38.355613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd6913-d030-4135-b9ce-9b9a0ceccaca None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:38.360888 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 513/1024] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:46:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:38.366380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398f4cc-d94a-480d-a5e9-70adc50b37ae None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:38.453238 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:38.473555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398f4cc-d94a-480d-a5e9-70adc50b37ae None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:38.507968 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913a273-39ab-4d90-a7d4-bccc0904105b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:38.508565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913a273-39ab-4d90-a7d4-bccc0904105b None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:38.508842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913a273-39ab-4d90-a7d4-bccc0904105b None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:38.509110 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913a273-39ab-4d90-a7d4-bccc0904105b None admin] PATH_INFO: `/v3/services` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:38.509760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4913a273-39ab-4d90-a7d4-bccc0904105b None admin] RBAC: Adding query filter params (type=image) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:38.510060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4913a273-39ab-4d90-a7d4-bccc0904105b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:38.511409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4913a273-39ab-4d90-a7d4-bccc0904105b None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:38.520784 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 512/1025] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:46:38 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:38.522559 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd6913-d030-4135-b9ce-9b9a0ceccaca None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:38.623427 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd6913-d030-4135-b9ce-9b9a0ceccaca None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:38.656852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16496d2-62b9-4d03-8ca1-9be7095afe11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:38.657479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16496d2-62b9-4d03-8ca1-9be7095afe11 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:38.657761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16496d2-62b9-4d03-8ca1-9be7095afe11 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:38.658035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16496d2-62b9-4d03-8ca1-9be7095afe11 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:38.658730 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16496d2-62b9-4d03-8ca1-9be7095afe11 None admin] RBAC: Adding query filter params (interface=public, service_id=d4f5e8b7169a4d459f7bd1bd71586143, region_id=RegionOne) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:38.659037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16496d2-62b9-4d03-8ca1-9be7095afe11 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:38.660423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16496d2-62b9-4d03-8ca1-9be7095afe11 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:38.670017 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 514/1026] 10.222.0.30 () {56 vars in 1251 bytes} [Sun Sep 4 00:46:38 2022] GET /identity/v3/endpoints?service_id=d4f5e8b7169a4d459f7bd1bd71586143&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:38.671565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913a273-39ab-4d90-a7d4-bccc0904105b None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:38.774228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913a273-39ab-4d90-a7d4-bccc0904105b None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:38.807042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc6921-7eda-4343-b562-7ff6934f63f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:38.807650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc6921-7eda-4343-b562-7ff6934f63f1 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:38.807930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc6921-7eda-4343-b562-7ff6934f63f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:38.808202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc6921-7eda-4343-b562-7ff6934f63f1 None admin] PATH_INFO: `/v3/services` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:38.808804 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc6921-7eda-4343-b562-7ff6934f63f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:38.810208 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc6921-7eda-4343-b562-7ff6934f63f1 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:38.821777 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 513/1027] 10.222.0.30 () {56 vars in 1087 bytes} [Sun Sep 4 00:46:38 2022] GET /identity/v3/services => generated 1957 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 00:46:39.261138 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ac751-c13e-4325-aa34-587e2764b3ad None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:39.261494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ac751-c13e-4325-aa34-587e2764b3ad None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:39.261716 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ac751-c13e-4325-aa34-587e2764b3ad None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:39.263216 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 515/1028] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:39.268195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f299bf3-0904-411c-af9d-998f61a2cea3 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:39.268484 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f299bf3-0904-411c-af9d-998f61a2cea3 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:39.268758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f299bf3-0904-411c-af9d-998f61a2cea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:39.280357 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb153f-7d34-4e0c-9b3a-741b0d855bc1 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:39.280641 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb153f-7d34-4e0c-9b3a-741b0d855bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:39.280917 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb153f-7d34-4e0c-9b3a-741b0d855bc1 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:39.282366 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 516/1029] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:39.286846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-1f299bf3-0904-411c-af9d-998f61a2cea3 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:39.286978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48efe2-7ee2-468f-821f-f6cd8d58c4b3 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:39.287209 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48efe2-7ee2-468f-821f-f6cd8d58c4b3 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:39.287505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48efe2-7ee2-468f-821f-f6cd8d58c4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:39.288058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1f299bf3-0904-411c-af9d-998f61a2cea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:39.292215 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:39.305910 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-6c48efe2-7ee2-468f-821f-f6cd8d58c4b3 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:39.307086 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6c48efe2-7ee2-468f-821f-f6cd8d58c4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:39.362803 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:39.368419 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 514/1030] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:39 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:46:39.383569 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 517/1031] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:39 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 04 00:46:39.637043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f299bf3-0904-411c-af9d-998f61a2cea3 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:39.652521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48efe2-7ee2-468f-821f-f6cd8d58c4b3 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:39.742548 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f299bf3-0904-411c-af9d-998f61a2cea3 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:39.761865 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48efe2-7ee2-468f-821f-f6cd8d58c4b3 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:39.777407 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79278c7a-7518-46eb-adb0-9039ea7feee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:39.778719 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79278c7a-7518-46eb-adb0-9039ea7feee8 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:39.779213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79278c7a-7518-46eb-adb0-9039ea7feee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:39.779682 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79278c7a-7518-46eb-adb0-9039ea7feee8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:39.787912 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:39.791117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79278c7a-7518-46eb-adb0-9039ea7feee8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:46:39.796479 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-79278c7a-7518-46eb-adb0-9039ea7feee8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 04 00:46:39.796479 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:39.796479 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:39.796479 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:39.796479 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:39.796479 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:39.796479 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:39.796479 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:39.796479 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:39.796479 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:39.796479 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:39.796479 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:39.796479 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:46:39.796479 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:46:39.796479 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:46:39.796479 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:46:39.797792 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:46:39.797792 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:46:39.797792 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:46:39.797792 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:46:39.797792 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:39.797792 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:39.797792 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:39.797792 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:39.797792 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:39.797792 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:39.797792 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:39.797792 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:39.797792 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:39.797792 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:39.797792 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:39.797792 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:39.798847 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:39.798847 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:39.798847 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:39.798847 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:39.798847 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:46:39.798847 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:46:39.798847 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:46:39.798847 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:46:39.798847 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:46:39.798847 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:46:39.798847 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 04 00:46:39.798847 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:39.799622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3367c34-4b83-4b2f-992b-47c9db562431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:39.799622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3367c34-4b83-4b2f-992b-47c9db562431 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:39.799622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3367c34-4b83-4b2f-992b-47c9db562431 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:39.799622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3367c34-4b83-4b2f-992b-47c9db562431 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:39.800081 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 515/1032] 10.222.0.30 () {56 vars in 1120 bytes} [Sun Sep 4 00:46:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:39.801687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3367c34-4b83-4b2f-992b-47c9db562431 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:39.803753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3367c34-4b83-4b2f-992b-47c9db562431 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:39.805479 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79278c7a-7518-46eb-adb0-9039ea7feee8 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:39.810015 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 518/1033] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:46:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:39.811290 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3367c34-4b83-4b2f-992b-47c9db562431 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:39.868845 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:39.912814 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79278c7a-7518-46eb-adb0-9039ea7feee8 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:39.920854 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3367c34-4b83-4b2f-992b-47c9db562431 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:39.952369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6032e9-063e-4e40-95df-cbe793b2cf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:39.952979 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6032e9-063e-4e40-95df-cbe793b2cf44 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:39.953267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6032e9-063e-4e40-95df-cbe793b2cf44 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:39.953568 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6032e9-063e-4e40-95df-cbe793b2cf44 None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:39.954362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6032e9-063e-4e40-95df-cbe793b2cf44 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:39.954563 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6032e9-063e-4e40-95df-cbe793b2cf44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:39.955880 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6032e9-063e-4e40-95df-cbe793b2cf44 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:39.959378 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a071bd-7b2b-4bd5-8ecc-04f0d470ac98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:39.959981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a071bd-7b2b-4bd5-8ecc-04f0d470ac98 None admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:39.960259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a071bd-7b2b-4bd5-8ecc-04f0d470ac98 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:39.960528 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a071bd-7b2b-4bd5-8ecc-04f0d470ac98 None admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:39.961174 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a071bd-7b2b-4bd5-8ecc-04f0d470ac98 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:39.962617 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a071bd-7b2b-4bd5-8ecc-04f0d470ac98 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:39.964261 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 516/1034] 10.222.0.30 () {56 vars in 1115 bytes} [Sun Sep 4 00:46:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:39.969596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6032e9-063e-4e40-95df-cbe793b2cf44 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:39.997492 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 519/1035] 10.222.0.30 () {60 vars in 1132 bytes} [Sun Sep 4 00:46:39 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 00:46:40.038970 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:40.081225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6032e9-063e-4e40-95df-cbe793b2cf44 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:40.117387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0820698-fd8d-4c35-8db2-077d782de982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:40.118048 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0820698-fd8d-4c35-8db2-077d782de982 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:40.118328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0820698-fd8d-4c35-8db2-077d782de982 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:40.118602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0820698-fd8d-4c35-8db2-077d782de982 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:40.129442 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0820698-fd8d-4c35-8db2-077d782de982 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:40.130942 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0820698-fd8d-4c35-8db2-077d782de982 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:40.145011 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-e0820698-fd8d-4c35-8db2-077d782de982 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:40.145011 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:40.145011 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:40.145011 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:40.145011 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:40.145011 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:40.145011 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:40.145011 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:40.145011 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:40.145011 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:40.145011 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:40.145011 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:40.145011 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:46:40.145011 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:46:40.145011 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:46:40.145011 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:46:40.146146 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:40.146146 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:40.146146 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:40.146146 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:40.146146 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:40.146146 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:40.146146 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:40.146146 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:40.146146 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:40.146146 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:40.146146 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:40.146146 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:40.146146 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:40.146146 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:40.146146 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:40.146146 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:40.146146 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:46:40.147099 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:46:40.147099 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:40.147099 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:40.147099 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 517/1036] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:46:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:46:40.153300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a071bd-7b2b-4bd5-8ecc-04f0d470ac98 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:40.257707 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a071bd-7b2b-4bd5-8ecc-04f0d470ac98 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:40.266732 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:40.293181 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b747ba-e3e3-4bb8-a8b0-61bf62cbbd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:40.293815 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b747ba-e3e3-4bb8-a8b0-61bf62cbbd35 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:40.294092 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b747ba-e3e3-4bb8-a8b0-61bf62cbbd35 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:40.294360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b747ba-e3e3-4bb8-a8b0-61bf62cbbd35 None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:40.294997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b747ba-e3e3-4bb8-a8b0-61bf62cbbd35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:40.295298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b747ba-e3e3-4bb8-a8b0-61bf62cbbd35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:40.296731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b747ba-e3e3-4bb8-a8b0-61bf62cbbd35 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:40.313536 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 520/1037] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:40.315283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0820698-fd8d-4c35-8db2-077d782de982 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:40.423149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0820698-fd8d-4c35-8db2-077d782de982 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:40.442234 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:40.466947 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2beabe0-7229-4536-8a81-e3ce9e942106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:40.467815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2beabe0-7229-4536-8a81-e3ce9e942106 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:40.468274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2beabe0-7229-4536-8a81-e3ce9e942106 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:40.468724 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2beabe0-7229-4536-8a81-e3ce9e942106 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:40.477081 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2beabe0-7229-4536-8a81-e3ce9e942106 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:40.478790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2beabe0-7229-4536-8a81-e3ce9e942106 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:40.490240 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-a2beabe0-7229-4536-8a81-e3ce9e942106 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 04 00:46:40.490240 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:40.490240 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:40.490240 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:40.490240 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:40.490240 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:40.490240 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:40.490240 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:40.490240 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:40.490240 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:40.490240 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:40.490240 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:40.490240 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 04 00:46:40.490240 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 04 00:46:40.490240 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 04 00:46:40.490240 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 04 00:46:40.491440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:40.491440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:40.491440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 00:46:40.491440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:46:40.491440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 00:46:40.491440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:46:40.491440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:40.491440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:40.491440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:40.491440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:40.491440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:40.491440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:40.491440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:40.491440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:40.491440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:40.491440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:40.491440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:40.491440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:40.492617 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:40.492617 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:40.492617 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 00:46:40.492617 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 00:46:40.492617 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 00:46:40.492617 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 00:46:40.492617 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 00:46:40.492617 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 00:46:40.492617 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 04 00:46:40.492617 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:40.494746 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 518/1038] 10.222.0.30 () {56 vars in 1093 bytes} [Sun Sep 4 00:46:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:40.500175 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b747ba-e3e3-4bb8-a8b0-61bf62cbbd35 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:40.599069 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b747ba-e3e3-4bb8-a8b0-61bf62cbbd35 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:40.633606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f7ffa-345d-4bdd-9d5a-b4e19b6fc732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:40.634221 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f7ffa-345d-4bdd-9d5a-b4e19b6fc732 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:40.634498 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f7ffa-345d-4bdd-9d5a-b4e19b6fc732 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:40.634766 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f7ffa-345d-4bdd-9d5a-b4e19b6fc732 None admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:40.635486 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f7ffa-345d-4bdd-9d5a-b4e19b6fc732 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:40.635789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f7ffa-345d-4bdd-9d5a-b4e19b6fc732 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:40.637206 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f7ffa-345d-4bdd-9d5a-b4e19b6fc732 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:40.659161 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 521/1039] 10.222.0.30 () {56 vars in 1133 bytes} [Sun Sep 4 00:46:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:40.660380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2beabe0-7229-4536-8a81-e3ce9e942106 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:40.760945 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2beabe0-7229-4536-8a81-e3ce9e942106 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:40.775528 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585d438-143f-4042-afc3-79d7e08c05ab None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:40.775808 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585d438-143f-4042-afc3-79d7e08c05ab None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:40.776102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585d438-143f-4042-afc3-79d7e08c05ab None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:40.777649 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 522/1040] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 04 00:46:40.782197 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731aa08d-a60f-4d92-aa7d-30ed7ba8d24e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:40.782478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731aa08d-a60f-4d92-aa7d-30ed7ba8d24e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:40.782772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731aa08d-a60f-4d92-aa7d-30ed7ba8d24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:40.798422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0375a-e3f4-4fd8-b8c3-ba61a0ebb94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:40.799028 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0375a-e3f4-4fd8-b8c3-ba61a0ebb94c None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:40.799305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0375a-e3f4-4fd8-b8c3-ba61a0ebb94c None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:40.799576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0375a-e3f4-4fd8-b8c3-ba61a0ebb94c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:40.801747 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-731aa08d-a60f-4d92-aa7d-30ed7ba8d24e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:40.803316 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-731aa08d-a60f-4d92-aa7d-30ed7ba8d24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:40.824484 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:40.844489 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:40.872471 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0375a-e3f4-4fd8-b8c3-ba61a0ebb94c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:40.873232 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 523/1041] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 04 00:46:40.873969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0375a-e3f4-4fd8-b8c3-ba61a0ebb94c None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:40.977462 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 519/1042] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:46:40 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 04 00:46:40.980066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731aa08d-a60f-4d92-aa7d-30ed7ba8d24e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:41.080328 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731aa08d-a60f-4d92-aa7d-30ed7ba8d24e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:41.114729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad08bd-1676-4f9a-9026-4ac5b1d5fe85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:41.115423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad08bd-1676-4f9a-9026-4ac5b1d5fe85 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:41.115699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad08bd-1676-4f9a-9026-4ac5b1d5fe85 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:41.115969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad08bd-1676-4f9a-9026-4ac5b1d5fe85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:41.127605 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad08bd-1676-4f9a-9026-4ac5b1d5fe85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:41.128970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad08bd-1676-4f9a-9026-4ac5b1d5fe85 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:41.141731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0375a-e3f4-4fd8-b8c3-ba61a0ebb94c None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:41.144205 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-c1ad08bd-1676-4f9a-9026-4ac5b1d5fe85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:41.144205 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:41.144205 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:41.144205 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:41.144205 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:41.144205 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:41.144205 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:41.144205 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:41.144205 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:41.144205 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:41.144205 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:41.144205 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:41.144205 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:46:41.144205 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:46:41.144205 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:46:41.144205 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:46:41.145120 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:41.145120 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:41.145120 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:41.145120 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:41.145120 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:41.145120 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:41.145120 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:41.145120 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:41.145120 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:41.145120 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:41.145120 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:41.145120 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:41.145120 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:41.145120 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:41.145120 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:41.145120 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:41.145120 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:46:41.146052 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:46:41.146052 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:41.146052 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:41.146052 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 524/1043] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:46:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:41.151321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad08bd-1676-4f9a-9026-4ac5b1d5fe85 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:41.161908 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:41.223855 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:41.252233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0375a-e3f4-4fd8-b8c3-ba61a0ebb94c None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:41.266375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad08bd-1676-4f9a-9026-4ac5b1d5fe85 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:41.289908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87b3c4-4866-43c3-a1b2-c2c2ef82552d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:41.290751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87b3c4-4866-43c3-a1b2-c2c2ef82552d None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:41.291263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87b3c4-4866-43c3-a1b2-c2c2ef82552d None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:41.291694 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87b3c4-4866-43c3-a1b2-c2c2ef82552d None admin] PATH_INFO: `/v3/services/image` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:41.292444 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea87b3c4-4866-43c3-a1b2-c2c2ef82552d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:41.293860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea87b3c4-4866-43c3-a1b2-c2c2ef82552d None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:41.300256 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c899ad-e745-43e0-a1df-0de117d9704b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:41.300860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c899ad-e745-43e0-a1df-0de117d9704b None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:41.301140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c899ad-e745-43e0-a1df-0de117d9704b None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:41.301413 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c899ad-e745-43e0-a1df-0de117d9704b None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:41.302073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c899ad-e745-43e0-a1df-0de117d9704b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:41.302375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c899ad-e745-43e0-a1df-0de117d9704b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:41.303788 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-ea87b3c4-4866-43c3-a1b2-c2c2ef82552d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 04 00:46:41.303788 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:41.303788 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 04 00:46:41.303788 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 04 00:46:41.303788 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 04 00:46:41.303788 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 04 00:46:41.303788 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 04 00:46:41.303788 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:41.303788 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 04 00:46:41.303788 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:41.303788 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 00:46:41.303788 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:41.303788 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:41.303788 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:41.303788 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:41.303788 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:41.303788 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:41.304719 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:41.304719 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:41.304719 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:41.304719 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:41.304719 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:41.304719 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:41.304719 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 04 00:46:41.304719 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 04 00:46:41.304719 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 04 00:46:41.304719 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 04 00:46:41.304719 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:41.304719 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:41.304719 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:41.304719 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:41.304719 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:41.304719 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:41.310185 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:41.310185 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:41.310185 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:41.310185 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:41.310185 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:41.310185 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:41.310185 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:41.310185 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:41.310185 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:41.310185 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:41.310185 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 04 00:46:41.310185 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:46:41.310185 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 04 00:46:41.310185 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:41.310925 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c899ad-e745-43e0-a1df-0de117d9704b None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:41.310997 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 520/1044] 10.222.0.30 () {56 vars in 1105 bytes} [Sun Sep 4 00:46:41 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:46:41.312177 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87b3c4-4866-43c3-a1b2-c2c2ef82552d None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:41.321835 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 525/1045] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:41.327353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c899ad-e745-43e0-a1df-0de117d9704b None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:41.397694 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:41.427017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87b3c4-4866-43c3-a1b2-c2c2ef82552d None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:41.433675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c899ad-e745-43e0-a1df-0de117d9704b None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:41.472341 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4f829-9719-42ea-9d56-891b4e53b0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:41.472980 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4f829-9719-42ea-9d56-891b4e53b0f3 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:41.473262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4f829-9719-42ea-9d56-891b4e53b0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:41.473360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab29948-c18e-45f2-b012-cb19a6630249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:41.473577 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4f829-9719-42ea-9d56-891b4e53b0f3 None admin] PATH_INFO: `/v3/services` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:41.474093 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab29948-c18e-45f2-b012-cb19a6630249 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:41.474187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4f829-9719-42ea-9d56-891b4e53b0f3 None admin] RBAC: Adding query filter params (name=image) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:41.474438 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab29948-c18e-45f2-b012-cb19a6630249 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:41.474558 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4f829-9719-42ea-9d56-891b4e53b0f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:41.474803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab29948-c18e-45f2-b012-cb19a6630249 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:41.475999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4f829-9719-42ea-9d56-891b4e53b0f3 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:41.481041 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 521/1046] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:46:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:41.486600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab29948-c18e-45f2-b012-cb19a6630249 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:41.486719 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4f829-9719-42ea-9d56-891b4e53b0f3 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:41.488169 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab29948-c18e-45f2-b012-cb19a6630249 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:41.489288 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:41.501163 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-6ab29948-c18e-45f2-b012-cb19a6630249 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:46:41.501163 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:41.501163 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:41.501163 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:41.501163 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:41.501163 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:41.501163 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:41.501163 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:41.501163 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:41.501163 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:41.501163 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:41.501163 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:41.501163 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 04 00:46:41.501163 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 04 00:46:41.501163 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 04 00:46:41.502675 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 04 00:46:41.502675 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:41.502675 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:41.502675 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:41.502675 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:41.502675 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:41.502675 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:41.502675 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:41.502675 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:41.502675 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:41.502675 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:41.502675 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:41.502675 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:41.502675 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:41.502675 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:41.502675 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:41.502675 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:41.503872 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 04 00:46:41.503872 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 04 00:46:41.503872 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 00:46:41.503872 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 00:46:41.503872 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 00:46:41.503872 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 00:46:41.503872 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:46:41.503872 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:41.507811 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 526/1047] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:46:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:46:41.508842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab29948-c18e-45f2-b012-cb19a6630249 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:41.601657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4f829-9719-42ea-9d56-891b4e53b0f3 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:41.613983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab29948-c18e-45f2-b012-cb19a6630249 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:41.638219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893f88c-5ef9-429e-a6fa-fe6e39abd758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:41.638824 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893f88c-5ef9-429e-a6fa-fe6e39abd758 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:41.639102 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893f88c-5ef9-429e-a6fa-fe6e39abd758 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:41.639369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893f88c-5ef9-429e-a6fa-fe6e39abd758 None admin] PATH_INFO: `/v3/services` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:41.639994 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893f88c-5ef9-429e-a6fa-fe6e39abd758 None admin] RBAC: Adding query filter params (type=image) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:41.640298 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893f88c-5ef9-429e-a6fa-fe6e39abd758 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:41.641690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893f88c-5ef9-429e-a6fa-fe6e39abd758 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:41.643936 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:41.647081 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 522/1048] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:46:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:41.652569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893f88c-5ef9-429e-a6fa-fe6e39abd758 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:41.654862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67f6ec-aa7c-4dc3-9986-ff1e5620390b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:41.655469 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67f6ec-aa7c-4dc3-9986-ff1e5620390b None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:41.655743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67f6ec-aa7c-4dc3-9986-ff1e5620390b None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:41.656012 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67f6ec-aa7c-4dc3-9986-ff1e5620390b None admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:41.656698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67f6ec-aa7c-4dc3-9986-ff1e5620390b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:41.656996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67f6ec-aa7c-4dc3-9986-ff1e5620390b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:41.658513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67f6ec-aa7c-4dc3-9986-ff1e5620390b None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:41.671279 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 527/1049] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Sep 4 00:46:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:41.677024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67f6ec-aa7c-4dc3-9986-ff1e5620390b None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:41.721966 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:41.757882 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893f88c-5ef9-429e-a6fa-fe6e39abd758 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:41.787760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67f6ec-aa7c-4dc3-9986-ff1e5620390b None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:41.793053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd545a3-7a3f-4a5a-b743-dcde5e1ab647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:41.793691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd545a3-7a3f-4a5a-b743-dcde5e1ab647 None admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:41.793968 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd545a3-7a3f-4a5a-b743-dcde5e1ab647 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:41.794239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd545a3-7a3f-4a5a-b743-dcde5e1ab647 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:41.794900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd545a3-7a3f-4a5a-b743-dcde5e1ab647 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:41.796717 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd545a3-7a3f-4a5a-b743-dcde5e1ab647 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:41.825477 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 523/1050] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 00:46:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:46:41.839466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9170e-4173-48ee-9888-3bfdeadca47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:41.840094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9170e-4173-48ee-9888-3bfdeadca47a None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:41.840368 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9170e-4173-48ee-9888-3bfdeadca47a None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:41.840646 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9170e-4173-48ee-9888-3bfdeadca47a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:41.841422 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9170e-4173-48ee-9888-3bfdeadca47a None admin] RBAC: Adding query filter params (role.id=fd671e98e0424c60995238aaa9dcdd5d, scope.project.id=40b24e92f8594ee08bd2a55f79e3b299, user.id=13f0f341bf2c475d82b4e7b34d503dd0) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:41.841767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9170e-4173-48ee-9888-3bfdeadca47a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:41.843244 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9170e-4173-48ee-9888-3bfdeadca47a None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:41.850497 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 528/1051] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:46:41 2022] GET /identity/v3/role_assignments?user.id=13f0f341bf2c475d82b4e7b34d503dd0&scope.project.id=40b24e92f8594ee08bd2a55f79e3b299&role.id=fd671e98e0424c60995238aaa9dcdd5d => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:41.954373 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72e70c-06bf-4693-8899-3e6efe94b44b None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:41.954556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72e70c-06bf-4693-8899-3e6efe94b44b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:41.954835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72e70c-06bf-4693-8899-3e6efe94b44b None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:41.956432 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 524/1052] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:41.963488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a674c19-e67e-4516-90de-07aac34036fa None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:41.963836 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a674c19-e67e-4516-90de-07aac34036fa None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:41.964040 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a674c19-e67e-4516-90de-07aac34036fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:41.985032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-2a674c19-e67e-4516-90de-07aac34036fa None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:41.986310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2a674c19-e67e-4516-90de-07aac34036fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:42.036629 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:42.061056 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 529/1053] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:46:42.328382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72e70c-06bf-4693-8899-3e6efe94b44b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:42.430598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72e70c-06bf-4693-8899-3e6efe94b44b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:42.458908 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:42.472997 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f44121-ad2c-4372-b8fa-1074679a720d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:42.473650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f44121-ad2c-4372-b8fa-1074679a720d None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:42.473933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f44121-ad2c-4372-b8fa-1074679a720d None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:42.474204 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f44121-ad2c-4372-b8fa-1074679a720d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:42.484661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f44121-ad2c-4372-b8fa-1074679a720d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:46:42.489714 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-33f44121-ad2c-4372-b8fa-1074679a720d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:46:42.489714 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:42.489714 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:42.489714 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:42.489714 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:42.489714 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:42.489714 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:42.489714 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:42.489714 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:42.489714 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:42.489714 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:42.489714 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:42.489714 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:46:42.489714 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:46:42.489714 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:46:42.489714 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:46:42.490639 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:46:42.490639 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:46:42.490639 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:46:42.490639 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:46:42.490639 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:42.490639 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:42.490639 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:42.490639 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:42.490639 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:42.490639 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:42.490639 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:42.490639 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:42.490639 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:42.490639 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:42.490639 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:42.490639 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:42.494354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:42.494354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:42.494354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:42.494354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:42.494354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:46:42.494354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:46:42.494354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:46:42.494354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:46:42.494354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:46:42.494354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:46:42.494354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:46:42.494354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:42.494354 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 525/1054] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Sep 4 00:46:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:46:42.496850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a674c19-e67e-4516-90de-07aac34036fa None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:42.596858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a674c19-e67e-4516-90de-07aac34036fa None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:42.629639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51469a41-4bc6-48fb-9a24-9992f7fb777f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:42.630242 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51469a41-4bc6-48fb-9a24-9992f7fb777f None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:42.630521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51469a41-4bc6-48fb-9a24-9992f7fb777f None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:42.631339 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51469a41-4bc6-48fb-9a24-9992f7fb777f None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:42.631996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51469a41-4bc6-48fb-9a24-9992f7fb777f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:42.632296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51469a41-4bc6-48fb-9a24-9992f7fb777f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:42.633675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51469a41-4bc6-48fb-9a24-9992f7fb777f None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:42.646344 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 530/1055] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:46:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:42.647921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f44121-ad2c-4372-b8fa-1074679a720d None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:42.748387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f44121-ad2c-4372-b8fa-1074679a720d None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:42.782324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad5756-9745-4bfa-83cd-82206c86abe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:42.783063 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad5756-9745-4bfa-83cd-82206c86abe3 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:42.783437 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad5756-9745-4bfa-83cd-82206c86abe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:42.783800 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad5756-9745-4bfa-83cd-82206c86abe3 None admin] PATH_INFO: `/v3/users/fc4b721f260e461989c429b9cde404da` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:42.796859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad5756-9745-4bfa-83cd-82206c86abe3 None admin] RBAC: Authorizing `identity:get_user(user_id=fc4b721f260e461989c429b9cde404da)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:42.798334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad5756-9745-4bfa-83cd-82206c86abe3 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:42.805475 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 526/1056] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:46:42 2022] GET /identity/v3/users/fc4b721f260e461989c429b9cde404da => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:42.806955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51469a41-4bc6-48fb-9a24-9992f7fb777f None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:42.849673 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:42.909091 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51469a41-4bc6-48fb-9a24-9992f7fb777f None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:42.945066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7283fb-d101-4288-9698-89ba5b7fb593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:42.945730 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7283fb-d101-4288-9698-89ba5b7fb593 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:42.946009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7283fb-d101-4288-9698-89ba5b7fb593 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:42.946279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7283fb-d101-4288-9698-89ba5b7fb593 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:43.015417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7283fb-d101-4288-9698-89ba5b7fb593 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:43.016856 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7283fb-d101-4288-9698-89ba5b7fb593 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:43.055732 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:43.121878 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 531/1057] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:46:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 04 00:46:43.123152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad5756-9745-4bfa-83cd-82206c86abe3 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:43.167646 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:43.226655 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad5756-9745-4bfa-83cd-82206c86abe3 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:43.265334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075e6cd-6636-4f9f-98c3-9791455cadf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:43.266001 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075e6cd-6636-4f9f-98c3-9791455cadf9 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:43.266285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075e6cd-6636-4f9f-98c3-9791455cadf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:43.266561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075e6cd-6636-4f9f-98c3-9791455cadf9 None admin] PATH_INFO: `/v3/projects/61f3df6515c54c4e8705489f1e03205b` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:43.267688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075e6cd-6636-4f9f-98c3-9791455cadf9 None admin] RBAC: Authorizing `identity:get_project(project_id=61f3df6515c54c4e8705489f1e03205b)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:43.269125 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075e6cd-6636-4f9f-98c3-9791455cadf9 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:43.276092 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 527/1058] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:46:43 2022] GET /identity/v3/projects/61f3df6515c54c4e8705489f1e03205b => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:43.277059 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7283fb-d101-4288-9698-89ba5b7fb593 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:43.381255 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7283fb-d101-4288-9698-89ba5b7fb593 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:43.415422 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54dd99-0174-4c13-9247-849aa5dbc5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:43.416028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54dd99-0174-4c13-9247-849aa5dbc5fc None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:43.416306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54dd99-0174-4c13-9247-849aa5dbc5fc None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:43.416577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54dd99-0174-4c13-9247-849aa5dbc5fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:43.417298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54dd99-0174-4c13-9247-849aa5dbc5fc None admin] RBAC: Adding query filter params (role.id=d255b03c37d64371a148ec4e11be01d9, scope.project.id=61f3df6515c54c4e8705489f1e03205b, user.id=fc4b721f260e461989c429b9cde404da) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:43.417634 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54dd99-0174-4c13-9247-849aa5dbc5fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:43.419061 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54dd99-0174-4c13-9247-849aa5dbc5fc None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:43.433578 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 532/1059] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:46:43 2022] GET /identity/v3/role_assignments?user.id=fc4b721f260e461989c429b9cde404da&scope.project.id=61f3df6515c54c4e8705489f1e03205b&role.id=d255b03c37d64371a148ec4e11be01d9 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:43.760946 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d3a87-17c0-49b4-a180-aa0b8f98b2a9 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:43.761140 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d3a87-17c0-49b4-a180-aa0b8f98b2a9 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:43.761408 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d3a87-17c0-49b4-a180-aa0b8f98b2a9 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:43.762904 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 528/1060] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:43.767699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5ea53-dd04-4695-b3e4-fbf7a2656ffb None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:43.768131 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5ea53-dd04-4695-b3e4-fbf7a2656ffb None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:43.768299 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5ea53-dd04-4695-b3e4-fbf7a2656ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:43.775953 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:43.785740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f81e98-1f47-4240-9299-df0039fdf2ad None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:43.786026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f81e98-1f47-4240-9299-df0039fdf2ad None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:43.786300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f81e98-1f47-4240-9299-df0039fdf2ad None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:43.788347 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 529/1061] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 04 00:46:43.788704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-31a5ea53-dd04-4695-b3e4-fbf7a2656ffb None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:43.790013 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-31a5ea53-dd04-4695-b3e4-fbf7a2656ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:43.793226 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327d612-aa05-4cfc-be33-d59cf5e46f00 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:43.793542 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327d612-aa05-4cfc-be33-d59cf5e46f00 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:43.793824 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327d612-aa05-4cfc-be33-d59cf5e46f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:43.812578 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a327d612-aa05-4cfc-be33-d59cf5e46f00 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:43.813795 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a327d612-aa05-4cfc-be33-d59cf5e46f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:43.864620 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 533/1062] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:46:43.889165 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 530/1063] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 04 00:46:44.134218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5ea53-dd04-4695-b3e4-fbf7a2656ffb None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:44.159430 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327d612-aa05-4cfc-be33-d59cf5e46f00 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:44.201245 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:44.235081 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5ea53-dd04-4695-b3e4-fbf7a2656ffb None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:44.264394 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327d612-aa05-4cfc-be33-d59cf5e46f00 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:44.269587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbb57d-f9f3-4e06-8aa6-973a5c145861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:44.270218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbb57d-f9f3-4e06-8aa6-973a5c145861 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:44.270501 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbb57d-f9f3-4e06-8aa6-973a5c145861 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:44.270754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbb57d-f9f3-4e06-8aa6-973a5c145861 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:44.272594 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:44.282339 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdbb57d-f9f3-4e06-8aa6-973a5c145861 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:46:44.287095 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-1cdbb57d-f9f3-4e06-8aa6-973a5c145861 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 04 00:46:44.287095 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:44.287095 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:44.287095 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:44.287095 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:44.287095 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:44.287095 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:44.287095 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:44.287095 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:44.287095 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:44.287095 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:44.287095 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:44.287095 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:46:44.287095 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:46:44.287095 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:46:44.287095 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:46:44.288024 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:46:44.288024 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:46:44.288024 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:46:44.288024 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:46:44.288024 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:44.288024 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:44.288024 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:44.288024 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:44.288024 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:44.288024 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:44.288024 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:44.288024 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:44.288024 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:44.288024 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:44.288024 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:44.288024 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:44.288871 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:44.288871 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:44.288871 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:44.288871 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:44.288871 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:46:44.288871 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:46:44.288871 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:46:44.288871 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:46:44.288871 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:46:44.288871 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:46:44.288871 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 04 00:46:44.288871 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:44.288871 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 534/1064] 10.222.0.30 () {56 vars in 1120 bytes} [Sun Sep 4 00:46:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:44.294556 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbb57d-f9f3-4e06-8aa6-973a5c145861 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:44.305737 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03911b8c-196d-4a4f-9e09-38df729e9fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:44.306354 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03911b8c-196d-4a4f-9e09-38df729e9fd8 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:44.306637 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03911b8c-196d-4a4f-9e09-38df729e9fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:44.306911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03911b8c-196d-4a4f-9e09-38df729e9fd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:44.379572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03911b8c-196d-4a4f-9e09-38df729e9fd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:44.381614 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03911b8c-196d-4a4f-9e09-38df729e9fd8 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:44.397391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbb57d-f9f3-4e06-8aa6-973a5c145861 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:44.418854 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:44.433421 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b2747-5f4e-4af0-9215-55543618eee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:44.434063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b2747-5f4e-4af0-9215-55543618eee3 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:44.434348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b2747-5f4e-4af0-9215-55543618eee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:44.434622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b2747-5f4e-4af0-9215-55543618eee3 None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:44.435282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b2747-5f4e-4af0-9215-55543618eee3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:44.435588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b2747-5f4e-4af0-9215-55543618eee3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:44.436948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b2747-5f4e-4af0-9215-55543618eee3 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:44.446480 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 535/1065] 10.222.0.30 () {56 vars in 1115 bytes} [Sun Sep 4 00:46:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:44.452218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b2747-5f4e-4af0-9215-55543618eee3 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:44.497785 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 531/1066] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:46:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 04 00:46:44.503406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03911b8c-196d-4a4f-9e09-38df729e9fd8 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:44.524149 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:44.570973 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b2747-5f4e-4af0-9215-55543618eee3 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:44.604701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ffdfc-aa11-486d-80f4-7e2b11976575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:44.605423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ffdfc-aa11-486d-80f4-7e2b11976575 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:44.605977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ffdfc-aa11-486d-80f4-7e2b11976575 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:44.606311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ffdfc-aa11-486d-80f4-7e2b11976575 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:44.611026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03911b8c-196d-4a4f-9e09-38df729e9fd8 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:44.618226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ffdfc-aa11-486d-80f4-7e2b11976575 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:44.619773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ffdfc-aa11-486d-80f4-7e2b11976575 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:44.633512 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-366ffdfc-aa11-486d-80f4-7e2b11976575 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:44.633512 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:44.633512 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:44.633512 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:44.633512 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:44.633512 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:44.633512 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:44.633512 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:44.633512 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:44.633512 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:44.633512 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:44.633512 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:44.633512 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:46:44.633512 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:46:44.633512 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:46:44.633512 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:46:44.634450 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:44.634450 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:44.634450 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:44.634450 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:44.634450 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:44.634450 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:44.634450 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:44.634450 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:44.634450 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:44.634450 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:44.634450 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:44.634450 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:44.634450 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:44.634450 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:44.634450 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:44.634450 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:44.634450 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:46:44.635403 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:46:44.635403 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:44.635403 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:44.635403 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 536/1067] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:46:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:46:44.640118 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ffdfc-aa11-486d-80f4-7e2b11976575 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:44.649747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f9b85-01b6-4d6d-ab96-55b4268e9440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:44.650492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f9b85-01b6-4d6d-ab96-55b4268e9440 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:44.650824 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f9b85-01b6-4d6d-ab96-55b4268e9440 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:44.651102 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f9b85-01b6-4d6d-ab96-55b4268e9440 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:44.658781 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:44.663672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f9b85-01b6-4d6d-ab96-55b4268e9440 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:44.666350 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f9b85-01b6-4d6d-ab96-55b4268e9440 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:44.681675 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-761f9b85-01b6-4d6d-ab96-55b4268e9440 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:44.681675 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:44.681675 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:44.681675 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:44.681675 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:44.681675 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:44.681675 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:44.681675 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:44.681675 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:44.681675 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:44.681675 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:44.681675 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:44.681675 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:46:44.681675 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:46:44.681675 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:46:44.681675 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:46:44.682630 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:44.682630 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:44.682630 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:44.682630 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:44.682630 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:44.682630 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:44.682630 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:44.682630 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:44.682630 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:44.682630 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:44.682630 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:44.682630 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:44.682630 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:44.682630 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:44.682630 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:44.682630 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:44.682630 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:46:44.683530 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:46:44.683530 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:44.683530 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:44.683530 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 532/1068] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:46:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:46:44.688753 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f9b85-01b6-4d6d-ab96-55b4268e9440 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:44.743543 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ffdfc-aa11-486d-80f4-7e2b11976575 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:44.752473 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:44.778180 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270c79a-26a2-4ea0-a83e-0eb3d8681491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:44.778792 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270c79a-26a2-4ea0-a83e-0eb3d8681491 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:44.779044 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270c79a-26a2-4ea0-a83e-0eb3d8681491 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:44.779312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270c79a-26a2-4ea0-a83e-0eb3d8681491 None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:44.779948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270c79a-26a2-4ea0-a83e-0eb3d8681491 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:44.780250 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270c79a-26a2-4ea0-a83e-0eb3d8681491 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:44.781633 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270c79a-26a2-4ea0-a83e-0eb3d8681491 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:44.793405 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 537/1069] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:44.798870 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270c79a-26a2-4ea0-a83e-0eb3d8681491 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:44.803789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f9b85-01b6-4d6d-ab96-55b4268e9440 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:44.837252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa92f33-dc53-4392-8cdc-35941da94565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:44.837877 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa92f33-dc53-4392-8cdc-35941da94565 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:44.838192 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa92f33-dc53-4392-8cdc-35941da94565 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:44.838420 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa92f33-dc53-4392-8cdc-35941da94565 None admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:44.839048 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa92f33-dc53-4392-8cdc-35941da94565 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:44.839348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa92f33-dc53-4392-8cdc-35941da94565 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:44.840716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa92f33-dc53-4392-8cdc-35941da94565 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:44.853467 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 533/1070] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:44.905296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270c79a-26a2-4ea0-a83e-0eb3d8681491 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:44.943406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76f5dd-d941-443c-8c54-54b91ea669cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:44.944057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76f5dd-d941-443c-8c54-54b91ea669cc None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:44.944338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76f5dd-d941-443c-8c54-54b91ea669cc None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:44.944612 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76f5dd-d941-443c-8c54-54b91ea669cc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:44.952683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76f5dd-d941-443c-8c54-54b91ea669cc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:44.954183 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76f5dd-d941-443c-8c54-54b91ea669cc None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:44.967665 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-fa76f5dd-d941-443c-8c54-54b91ea669cc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 04 00:46:44.967665 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:44.967665 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:44.967665 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:44.967665 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:44.967665 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:44.967665 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:44.967665 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:44.967665 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:44.967665 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:44.967665 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:44.967665 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:44.967665 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 04 00:46:44.967665 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 04 00:46:44.967665 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 04 00:46:44.967665 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 04 00:46:44.968692 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:44.968692 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:44.968692 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 00:46:44.968692 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:46:44.968692 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 00:46:44.968692 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:46:44.968692 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:44.968692 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:44.968692 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:44.968692 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:44.968692 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:44.968692 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:44.968692 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:44.968692 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:44.968692 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:44.968692 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:44.968692 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:44.968692 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:44.975451 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:44.975451 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:44.975451 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 00:46:44.975451 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 00:46:44.975451 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 00:46:44.975451 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 00:46:44.975451 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 00:46:44.975451 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 00:46:44.975451 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 04 00:46:44.975451 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:44.975451 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 538/1071] 10.222.0.30 () {56 vars in 1093 bytes} [Sun Sep 4 00:46:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:44.976102 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa92f33-dc53-4392-8cdc-35941da94565 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:45.029271 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:45.087449 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa92f33-dc53-4392-8cdc-35941da94565 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:45.122302 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a5479-408e-4ab4-83fe-b0d4c006c56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:45.122912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a5479-408e-4ab4-83fe-b0d4c006c56e None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:45.123191 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a5479-408e-4ab4-83fe-b0d4c006c56e None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:45.123463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a5479-408e-4ab4-83fe-b0d4c006c56e None admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:45.124188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a5479-408e-4ab4-83fe-b0d4c006c56e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:45.124487 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a5479-408e-4ab4-83fe-b0d4c006c56e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:45.125964 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a5479-408e-4ab4-83fe-b0d4c006c56e None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:45.143221 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 534/1072] 10.222.0.30 () {56 vars in 1133 bytes} [Sun Sep 4 00:46:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:45.149498 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76f5dd-d941-443c-8c54-54b91ea669cc None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:45.180913 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:45.250738 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76f5dd-d941-443c-8c54-54b91ea669cc None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:45.283044 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f4672-06b9-4ea0-b058-9e329e3fd345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:45.283668 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f4672-06b9-4ea0-b058-9e329e3fd345 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:45.283946 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f4672-06b9-4ea0-b058-9e329e3fd345 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:45.284215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f4672-06b9-4ea0-b058-9e329e3fd345 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:45.295074 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f4672-06b9-4ea0-b058-9e329e3fd345 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:45.296520 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f4672-06b9-4ea0-b058-9e329e3fd345 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:45.306565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc5e7a-dbe7-4a38-b0c9-3ca1dacab8ce None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:45.307025 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc5e7a-dbe7-4a38-b0c9-3ca1dacab8ce None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:45.307114 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc5e7a-dbe7-4a38-b0c9-3ca1dacab8ce None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:45.308449 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 535/1073] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 04 00:46:45.310401 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-2b4f4672-06b9-4ea0-b058-9e329e3fd345 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:45.310401 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:45.310401 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:45.310401 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:45.310401 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:45.310401 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:45.310401 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:45.310401 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:45.310401 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:45.310401 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:45.310401 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:45.310401 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:45.310401 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:46:45.310401 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:46:45.310401 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:46:45.310401 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:46:45.311483 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:45.311483 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:45.311483 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:45.311483 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:45.311483 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:45.311483 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:45.311483 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:45.311483 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:45.311483 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:45.311483 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:45.311483 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:45.311483 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:45.311483 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:45.311483 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:45.311483 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:45.311483 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:45.311483 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:46:45.312406 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:46:45.312406 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:45.312406 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:45.312406 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 539/1074] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:46:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:45.313593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f74ef54-588a-4315-ae4d-acba874bc898 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:45.313872 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f74ef54-588a-4315-ae4d-acba874bc898 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:45.314142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f74ef54-588a-4315-ae4d-acba874bc898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:45.317210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f4672-06b9-4ea0-b058-9e329e3fd345 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:45.332155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-6f74ef54-588a-4315-ae4d-acba874bc898 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:45.333354 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6f74ef54-588a-4315-ae4d-acba874bc898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:45.399424 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:45.404634 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 536/1075] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 04 00:46:45.417847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f4672-06b9-4ea0-b058-9e329e3fd345 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:45.452633 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144c499-f9db-4bf9-b23e-309b361ffc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:45.453236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144c499-f9db-4bf9-b23e-309b361ffc7a None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:45.453535 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144c499-f9db-4bf9-b23e-309b361ffc7a None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:45.453803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144c499-f9db-4bf9-b23e-309b361ffc7a None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:45.454429 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7144c499-f9db-4bf9-b23e-309b361ffc7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:45.454724 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7144c499-f9db-4bf9-b23e-309b361ffc7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:45.456066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7144c499-f9db-4bf9-b23e-309b361ffc7a None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:45.468276 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 540/1076] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:45.474105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f74ef54-588a-4315-ae4d-acba874bc898 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:45.513726 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:45.570100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f74ef54-588a-4315-ae4d-acba874bc898 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:45.603227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad7ffc-df85-4b70-a90a-b5a249b7fbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:45.603842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad7ffc-df85-4b70-a90a-b5a249b7fbba None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:45.604117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad7ffc-df85-4b70-a90a-b5a249b7fbba None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:45.604385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad7ffc-df85-4b70-a90a-b5a249b7fbba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:45.610980 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad7ffc-df85-4b70-a90a-b5a249b7fbba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:45.612402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad7ffc-df85-4b70-a90a-b5a249b7fbba None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:45.623227 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-d0ad7ffc-df85-4b70-a90a-b5a249b7fbba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:46:45.623227 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:45.623227 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:45.623227 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:45.623227 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:45.623227 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:45.623227 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:45.623227 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:45.623227 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:45.623227 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:45.623227 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:45.623227 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:45.623227 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 04 00:46:45.623227 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 04 00:46:45.623227 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 04 00:46:45.624318 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 04 00:46:45.624318 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:45.624318 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:45.624318 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:45.624318 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:45.624318 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:45.624318 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:45.624318 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:45.624318 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:45.624318 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:45.624318 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:45.624318 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:45.624318 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:45.624318 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:45.624318 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:45.624318 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:45.624318 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:45.625221 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 04 00:46:45.625221 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 04 00:46:45.625221 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 00:46:45.625221 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 00:46:45.625221 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 00:46:45.625221 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 00:46:45.625221 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:46:45.625221 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:45.625221 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 537/1077] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:46:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:45.632532 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144c499-f9db-4bf9-b23e-309b361ffc7a None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:45.670382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad7ffc-df85-4b70-a90a-b5a249b7fbba None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:45.729767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144c499-f9db-4bf9-b23e-309b361ffc7a None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:45.764007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5eec8-711d-43b7-9efd-2f9a8bb08f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:45.764599 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5eec8-711d-43b7-9efd-2f9a8bb08f0a None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:45.764871 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5eec8-711d-43b7-9efd-2f9a8bb08f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:45.765141 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5eec8-711d-43b7-9efd-2f9a8bb08f0a None admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:45.765851 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5eec8-711d-43b7-9efd-2f9a8bb08f0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:45.766150 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5eec8-711d-43b7-9efd-2f9a8bb08f0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:45.766685 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:45.767604 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5eec8-711d-43b7-9efd-2f9a8bb08f0a None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:45.770969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad7ffc-df85-4b70-a90a-b5a249b7fbba None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:45.776304 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:45.780110 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 541/1078] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Sep 4 00:46:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:45.785638 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5eec8-711d-43b7-9efd-2f9a8bb08f0a None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:45.809814 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabfb70-ba98-4f2e-8cf3-309f62960f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:45.810436 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabfb70-ba98-4f2e-8cf3-309f62960f24 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:45.810712 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabfb70-ba98-4f2e-8cf3-309f62960f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:45.810982 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabfb70-ba98-4f2e-8cf3-309f62960f24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:45.821671 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eabfb70-ba98-4f2e-8cf3-309f62960f24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:46:45.826334 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-0eabfb70-ba98-4f2e-8cf3-309f62960f24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:46:45.826334 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:45.826334 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:45.826334 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:45.826334 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:45.826334 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:45.826334 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:45.826334 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:45.826334 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:45.826334 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:45.826334 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:45.826334 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:45.826334 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:46:45.826334 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:46:45.826334 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:46:45.826334 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:46:45.827475 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:46:45.827475 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:46:45.827475 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:46:45.827475 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:46:45.827475 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:45.827475 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:45.827475 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:45.827475 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:45.827475 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:45.827475 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:45.827475 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:45.827475 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:45.827475 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:45.827475 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:45.827475 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:45.827475 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:45.828489 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:45.828489 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:45.828489 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:45.828489 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:45.828489 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:46:45.828489 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:46:45.828489 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:46:45.828489 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:46:45.828489 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:46:45.828489 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:46:45.828489 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:46:45.828489 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:45.828489 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 538/1079] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Sep 4 00:46:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:46:45.833209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabfb70-ba98-4f2e-8cf3-309f62960f24 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:45.884789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5eec8-711d-43b7-9efd-2f9a8bb08f0a None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:45.918016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4afeba5-2a93-4ff6-9f07-66467f6b4472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:45.919940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afeba5-2a93-4ff6-9f07-66467f6b4472 None admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:45.919940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afeba5-2a93-4ff6-9f07-66467f6b4472 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:45.919940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afeba5-2a93-4ff6-9f07-66467f6b4472 None admin] PATH_INFO: `/v3/projects/40b24e92f8594ee08bd2a55f79e3b299/users/13f0f341bf2c475d82b4e7b34d503dd0/roles/fd671e98e0424c60995238aaa9dcdd5d` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:45.921414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4afeba5-2a93-4ff6-9f07-66467f6b4472 None admin] RBAC: Authorizing `identity:create_grant(project_id=40b24e92f8594ee08bd2a55f79e3b299, user_id=13f0f341bf2c475d82b4e7b34d503dd0, role_id=fd671e98e0424c60995238aaa9dcdd5d)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:45.922867 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4afeba5-2a93-4ff6-9f07-66467f6b4472 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:45.931095 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabfb70-ba98-4f2e-8cf3-309f62960f24 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:45.937155 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 542/1080] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Sep 4 00:46:45 2022] PUT /identity/v3/projects/40b24e92f8594ee08bd2a55f79e3b299/users/13f0f341bf2c475d82b4e7b34d503dd0/roles/fd671e98e0424c60995238aaa9dcdd5d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 00:46:45.971364 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f7799-ef27-47cd-9fec-e18fe2239fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:45.971978 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f7799-ef27-47cd-9fec-e18fe2239fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:45.972252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f7799-ef27-47cd-9fec-e18fe2239fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:45.972519 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f7799-ef27-47cd-9fec-e18fe2239fa2 None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:45.973178 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f7799-ef27-47cd-9fec-e18fe2239fa2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:45.973505 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f7799-ef27-47cd-9fec-e18fe2239fa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:45.974941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f7799-ef27-47cd-9fec-e18fe2239fa2 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:45.985201 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 539/1081] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:46:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:45.991841 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4afeba5-2a93-4ff6-9f07-66467f6b4472 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:46.053715 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:46.097205 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4afeba5-2a93-4ff6-9f07-66467f6b4472 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:46.130576 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3d2cb-bc60-4f28-ae51-d7745b1beacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:46.131219 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3d2cb-bc60-4f28-ae51-d7745b1beacf None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:46.131495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3d2cb-bc60-4f28-ae51-d7745b1beacf None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:46.131762 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3d2cb-bc60-4f28-ae51-d7745b1beacf None admin] PATH_INFO: `/v3/users/fc4b721f260e461989c429b9cde404da` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:46.132877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff3d2cb-bc60-4f28-ae51-d7745b1beacf None admin] RBAC: Authorizing `identity:get_user(user_id=fc4b721f260e461989c429b9cde404da)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:46.134326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff3d2cb-bc60-4f28-ae51-d7745b1beacf None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:46.135888 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 543/1082] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:46:45 2022] GET /identity/v3/users/fc4b721f260e461989c429b9cde404da => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:46.141892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f7799-ef27-47cd-9fec-e18fe2239fa2 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:46.163714 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:46.239542 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f7799-ef27-47cd-9fec-e18fe2239fa2 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:46.272286 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2911f581-3de5-40b8-91d3-40712222e5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:46.272912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911f581-3de5-40b8-91d3-40712222e5c6 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:46.273189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911f581-3de5-40b8-91d3-40712222e5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:46.273500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911f581-3de5-40b8-91d3-40712222e5c6 None admin] PATH_INFO: `/v3/projects/61f3df6515c54c4e8705489f1e03205b` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:46.274606 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2911f581-3de5-40b8-91d3-40712222e5c6 None admin] RBAC: Authorizing `identity:get_project(project_id=61f3df6515c54c4e8705489f1e03205b)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:46.276037 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2911f581-3de5-40b8-91d3-40712222e5c6 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:46.277664 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 540/1083] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:46:46 2022] GET /identity/v3/projects/61f3df6515c54c4e8705489f1e03205b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:46.283507 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3d2cb-bc60-4f28-ae51-d7745b1beacf None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:46.381397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3d2cb-bc60-4f28-ae51-d7745b1beacf None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:46.406440 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:46.415182 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef7200-5815-4b07-a34e-2f77b79983e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:46.415831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef7200-5815-4b07-a34e-2f77b79983e8 None admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:46.416106 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef7200-5815-4b07-a34e-2f77b79983e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:46.416374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef7200-5815-4b07-a34e-2f77b79983e8 None admin] PATH_INFO: `/v3/projects/61f3df6515c54c4e8705489f1e03205b/users/fc4b721f260e461989c429b9cde404da/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:46.418256 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef7200-5815-4b07-a34e-2f77b79983e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=61f3df6515c54c4e8705489f1e03205b, user_id=fc4b721f260e461989c429b9cde404da, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:46.419678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef7200-5815-4b07-a34e-2f77b79983e8 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:46.432661 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 544/1084] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Sep 4 00:46:46 2022] PUT /identity/v3/projects/61f3df6515c54c4e8705489f1e03205b/users/fc4b721f260e461989c429b9cde404da/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 00:46:47.817985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf180e8e-4836-4da7-8bc5-77d1c64f8732 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:47.818483 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf180e8e-4836-4da7-8bc5-77d1c64f8732 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:47.818483 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf180e8e-4836-4da7-8bc5-77d1c64f8732 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:47.819802 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 541/1085] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:47.824835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c6354-013c-4db4-bcf8-c9127e079916 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:47.825210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c6354-013c-4db4-bcf8-c9127e079916 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:47.825518 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c6354-013c-4db4-bcf8-c9127e079916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:47.843309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-dc7c6354-013c-4db4-bcf8-c9127e079916 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:47.844481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-dc7c6354-013c-4db4-bcf8-c9127e079916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:47.910314 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 545/1086] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:46:48.181100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf180e8e-4836-4da7-8bc5-77d1c64f8732 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:48.266397 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:48.279737 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf180e8e-4836-4da7-8bc5-77d1c64f8732 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:48.282541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaeffe1-2d38-48f4-8b6a-eac403b1fbb2 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:48.282823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaeffe1-2d38-48f4-8b6a-eac403b1fbb2 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:48.283098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaeffe1-2d38-48f4-8b6a-eac403b1fbb2 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:48.284435 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 546/1087] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 04 00:46:48.289930 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc199c-dd8d-4d72-892a-d0e6fd4331ca None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:48.290217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc199c-dd8d-4d72-892a-d0e6fd4331ca None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:48.290489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc199c-dd8d-4d72-892a-d0e6fd4331ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:48.307695 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-8dcc199c-dd8d-4d72-892a-d0e6fd4331ca None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:48.308864 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8dcc199c-dd8d-4d72-892a-d0e6fd4331ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:48.315179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea7868-14bd-4321-a8fc-bcfaf7b3d6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:48.315801 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea7868-14bd-4321-a8fc-bcfaf7b3d6e8 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:48.316086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea7868-14bd-4321-a8fc-bcfaf7b3d6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:48.316365 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea7868-14bd-4321-a8fc-bcfaf7b3d6e8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:48.326761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea7868-14bd-4321-a8fc-bcfaf7b3d6e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:46:48.331509 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-67ea7868-14bd-4321-a8fc-bcfaf7b3d6e8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 04 00:46:48.331509 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:48.331509 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:48.331509 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:48.331509 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:48.331509 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:48.331509 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:48.331509 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:48.331509 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:48.331509 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:48.331509 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:48.331509 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:48.331509 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:46:48.331509 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:46:48.331509 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:46:48.331509 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:46:48.332533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:46:48.332533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:46:48.332533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:46:48.332533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:46:48.332533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:48.332533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:48.332533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:48.332533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:48.332533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:48.332533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:48.332533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:48.332533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:48.332533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:48.332533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:48.332533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:48.332533 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:48.334451 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:48.334451 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:48.334451 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:48.334451 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:48.334451 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:46:48.334451 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:46:48.334451 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:46:48.334451 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:46:48.334451 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:46:48.334451 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:46:48.334451 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 04 00:46:48.334451 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:48.334451 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 542/1088] 10.222.0.30 () {56 vars in 1120 bytes} [Sun Sep 4 00:46:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:48.339070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea7868-14bd-4321-a8fc-bcfaf7b3d6e8 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:48.375566 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 547/1089] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 04 00:46:48.434959 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea7868-14bd-4321-a8fc-bcfaf7b3d6e8 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:48.470528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c051cc8-50dc-46f0-b03f-91d862786af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:48.471125 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c051cc8-50dc-46f0-b03f-91d862786af6 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:48.471402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c051cc8-50dc-46f0-b03f-91d862786af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:48.471666 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c051cc8-50dc-46f0-b03f-91d862786af6 None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:48.472308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c051cc8-50dc-46f0-b03f-91d862786af6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:48.472605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c051cc8-50dc-46f0-b03f-91d862786af6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:48.474006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c051cc8-50dc-46f0-b03f-91d862786af6 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:48.481492 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 543/1090] 10.222.0.30 () {56 vars in 1115 bytes} [Sun Sep 4 00:46:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:48.487319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc199c-dd8d-4d72-892a-d0e6fd4331ca None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:48.535497 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:48.587559 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc199c-dd8d-4d72-892a-d0e6fd4331ca None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:48.621970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b99a8-0798-47e4-8f89-1ceee2829b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:48.622622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b99a8-0798-47e4-8f89-1ceee2829b40 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:48.622896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b99a8-0798-47e4-8f89-1ceee2829b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:48.623160 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b99a8-0798-47e4-8f89-1ceee2829b40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:48.633321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b99a8-0798-47e4-8f89-1ceee2829b40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:48.634775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b99a8-0798-47e4-8f89-1ceee2829b40 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:48.646044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c051cc8-50dc-46f0-b03f-91d862786af6 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:48.649291 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-709b99a8-0798-47e4-8f89-1ceee2829b40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:48.649291 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:48.649291 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:48.649291 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:48.649291 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:48.649291 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:48.649291 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:48.649291 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:48.649291 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:48.649291 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:48.649291 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:48.649291 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:48.649291 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:46:48.649291 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:46:48.649291 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:46:48.649291 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:46:48.650294 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:48.650294 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:48.650294 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:48.650294 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:48.650294 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:48.650294 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:48.650294 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:48.650294 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:48.650294 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:48.650294 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:48.650294 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:48.650294 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:48.650294 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:48.650294 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:48.650294 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:48.650294 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:48.650294 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:46:48.651220 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:46:48.651220 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:48.651220 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:48.651220 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 548/1091] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:46:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:48.656071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b99a8-0798-47e4-8f89-1ceee2829b40 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:48.659389 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:48.748644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c051cc8-50dc-46f0-b03f-91d862786af6 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:48.752768 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:48.756312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b99a8-0798-47e4-8f89-1ceee2829b40 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:48.781110 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e46f84-68d1-4b71-9bb5-33851b40599f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:48.781753 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e46f84-68d1-4b71-9bb5-33851b40599f None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:48.782031 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e46f84-68d1-4b71-9bb5-33851b40599f None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:48.782339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e46f84-68d1-4b71-9bb5-33851b40599f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:48.789852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663b515-1d99-4c40-932b-8339a44ecf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:48.790460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663b515-1d99-4c40-932b-8339a44ecf84 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:48.790741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663b515-1d99-4c40-932b-8339a44ecf84 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:48.791017 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663b515-1d99-4c40-932b-8339a44ecf84 None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:48.791653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c663b515-1d99-4c40-932b-8339a44ecf84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:48.791953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c663b515-1d99-4c40-932b-8339a44ecf84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:48.793002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e46f84-68d1-4b71-9bb5-33851b40599f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:46:48.793314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c663b515-1d99-4c40-932b-8339a44ecf84 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:48.797763 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-38e46f84-68d1-4b71-9bb5-33851b40599f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:46:48.797763 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:48.797763 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:48.797763 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:48.797763 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:48.797763 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:48.797763 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:48.797763 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:48.797763 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:48.797763 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:48.797763 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:48.797763 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:48.797763 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:46:48.797763 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:46:48.797763 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:46:48.797763 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:46:48.798890 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:46:48.798890 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:46:48.798890 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:46:48.798890 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:46:48.798890 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:48.798890 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:48.798890 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:48.798890 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:48.798890 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:48.798890 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:48.798890 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:48.798890 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:48.798890 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:48.798890 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:48.798890 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:48.798890 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:48.799729 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:48.799729 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:48.799729 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:48.799729 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:48.799729 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:46:48.799729 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:46:48.799729 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:46:48.799729 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:46:48.799729 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:46:48.799729 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:46:48.799729 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:46:48.799729 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:48.799729 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 544/1092] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Sep 4 00:46:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:46:48.805335 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e46f84-68d1-4b71-9bb5-33851b40599f None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:48.810920 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 549/1093] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:48.811871 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663b515-1d99-4c40-932b-8339a44ecf84 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:48.874528 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:48.904998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e46f84-68d1-4b71-9bb5-33851b40599f None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:48.911065 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663b515-1d99-4c40-932b-8339a44ecf84 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:48.937555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b5da8-144b-4e06-9442-a3f112b722fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:48.938151 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b5da8-144b-4e06-9442-a3f112b722fc None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:48.938426 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b5da8-144b-4e06-9442-a3f112b722fc None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:48.938702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b5da8-144b-4e06-9442-a3f112b722fc None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:48.939339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b5da8-144b-4e06-9442-a3f112b722fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:48.939639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b5da8-144b-4e06-9442-a3f112b722fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:48.941001 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b5da8-144b-4e06-9442-a3f112b722fc None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:48.944934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68098e73-6350-4d6a-936c-ed7b2c5220b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:48.945591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68098e73-6350-4d6a-936c-ed7b2c5220b5 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:48.945875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68098e73-6350-4d6a-936c-ed7b2c5220b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:48.946148 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68098e73-6350-4d6a-936c-ed7b2c5220b5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:48.950003 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 545/1094] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:46:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:48.953223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68098e73-6350-4d6a-936c-ed7b2c5220b5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:48.954992 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68098e73-6350-4d6a-936c-ed7b2c5220b5 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:48.956228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b5da8-144b-4e06-9442-a3f112b722fc None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:48.967226 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-68098e73-6350-4d6a-936c-ed7b2c5220b5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 04 00:46:48.967226 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:48.967226 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:48.967226 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:48.967226 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:48.967226 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:48.967226 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:48.967226 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:48.967226 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:48.967226 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:48.967226 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:48.967226 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:48.967226 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 04 00:46:48.967226 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 04 00:46:48.967226 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 04 00:46:48.967226 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 04 00:46:48.968282 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:48.968282 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:48.968282 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 00:46:48.968282 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:46:48.968282 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 00:46:48.968282 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:46:48.968282 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:48.968282 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:48.968282 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:48.968282 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:48.968282 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:48.968282 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:48.968282 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:48.968282 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:48.968282 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:48.968282 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:48.968282 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:48.968282 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:48.969674 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:48.969674 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:48.969674 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 00:46:48.969674 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 00:46:48.969674 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 00:46:48.969674 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 00:46:48.969674 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 00:46:48.969674 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 00:46:48.969674 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 04 00:46:48.969674 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:48.969674 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 550/1095] 10.222.0.30 () {56 vars in 1093 bytes} [Sun Sep 4 00:46:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:48.973901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68098e73-6350-4d6a-936c-ed7b2c5220b5 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:48.996331 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:49.054320 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b5da8-144b-4e06-9442-a3f112b722fc None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:49.072690 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68098e73-6350-4d6a-936c-ed7b2c5220b5 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:49.083598 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:49.089131 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e3883-0e7c-45f5-bfe7-1e7db4113651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:49.089805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e3883-0e7c-45f5-bfe7-1e7db4113651 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:49.090085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e3883-0e7c-45f5-bfe7-1e7db4113651 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:49.090360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e3883-0e7c-45f5-bfe7-1e7db4113651 None admin] PATH_INFO: `/v3/users/fc4b721f260e461989c429b9cde404da` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:49.091490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e3883-0e7c-45f5-bfe7-1e7db4113651 None admin] RBAC: Authorizing `identity:get_user(user_id=fc4b721f260e461989c429b9cde404da)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:49.092934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e3883-0e7c-45f5-bfe7-1e7db4113651 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:49.094524 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 546/1096] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:46:48 2022] GET /identity/v3/users/fc4b721f260e461989c429b9cde404da => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:49.100863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e3883-0e7c-45f5-bfe7-1e7db4113651 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:49.109342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c3c7d-c370-4ce8-9f76-abde81c30c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:49.110245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c3c7d-c370-4ce8-9f76-abde81c30c23 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:49.110525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c3c7d-c370-4ce8-9f76-abde81c30c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:49.110798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c3c7d-c370-4ce8-9f76-abde81c30c23 None admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:49.111523 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c3c7d-c370-4ce8-9f76-abde81c30c23 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:49.111824 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c3c7d-c370-4ce8-9f76-abde81c30c23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:49.113264 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c3c7d-c370-4ce8-9f76-abde81c30c23 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:49.130448 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 551/1097] 10.222.0.30 () {56 vars in 1133 bytes} [Sun Sep 4 00:46:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:49.135948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c3c7d-c370-4ce8-9f76-abde81c30c23 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:49.200544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e3883-0e7c-45f5-bfe7-1e7db4113651 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:49.210476 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:49.232553 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c3c7d-c370-4ce8-9f76-abde81c30c23 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:49.233386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3f90c-40c6-450b-ad2e-a6542c269b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:49.234029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3f90c-40c6-450b-ad2e-a6542c269b39 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:49.234313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3f90c-40c6-450b-ad2e-a6542c269b39 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:49.234585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3f90c-40c6-450b-ad2e-a6542c269b39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:49.266249 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756eb9a-edaa-4718-b190-91e358fde6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:49.266845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756eb9a-edaa-4718-b190-91e358fde6f3 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:49.267121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756eb9a-edaa-4718-b190-91e358fde6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:49.267390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756eb9a-edaa-4718-b190-91e358fde6f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:49.298348 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:49.300629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3f90c-40c6-450b-ad2e-a6542c269b39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:49.302175 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3f90c-40c6-450b-ad2e-a6542c269b39 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:49.332719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756eb9a-edaa-4718-b190-91e358fde6f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:49.334140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756eb9a-edaa-4718-b190-91e358fde6f3 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:49.398309 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 547/1098] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:46:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 04 00:46:49.404619 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3f90c-40c6-450b-ad2e-a6542c269b39 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:49.410495 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:49.433854 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 552/1099] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:46:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 04 00:46:49.439742 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756eb9a-edaa-4718-b190-91e358fde6f3 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:49.503785 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:49.507581 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3f90c-40c6-450b-ad2e-a6542c269b39 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:49.535854 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756eb9a-edaa-4718-b190-91e358fde6f3 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:49.543448 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ae3df-ee62-4562-8149-e0aa79333d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:49.544060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ae3df-ee62-4562-8149-e0aa79333d8b None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:49.544334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ae3df-ee62-4562-8149-e0aa79333d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:49.544602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ae3df-ee62-4562-8149-e0aa79333d8b None admin] PATH_INFO: `/v3/projects/61f3df6515c54c4e8705489f1e03205b` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:49.545729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ae3df-ee62-4562-8149-e0aa79333d8b None admin] RBAC: Authorizing `identity:get_project(project_id=61f3df6515c54c4e8705489f1e03205b)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:49.547152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ae3df-ee62-4562-8149-e0aa79333d8b None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:49.548725 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 548/1100] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:46:49 2022] GET /identity/v3/projects/61f3df6515c54c4e8705489f1e03205b => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:49.554679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ae3df-ee62-4562-8149-e0aa79333d8b None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:49.569588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f2d0e-fc1b-4eae-8996-f6c77247094b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:49.570218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f2d0e-fc1b-4eae-8996-f6c77247094b None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:49.570493 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f2d0e-fc1b-4eae-8996-f6c77247094b None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:49.570763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f2d0e-fc1b-4eae-8996-f6c77247094b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:49.580505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f2d0e-fc1b-4eae-8996-f6c77247094b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:49.581979 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f2d0e-fc1b-4eae-8996-f6c77247094b None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:49.596611 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-1e0f2d0e-fc1b-4eae-8996-f6c77247094b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:49.596611 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:49.596611 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:49.596611 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:49.596611 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:49.596611 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:49.596611 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:49.596611 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:49.596611 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:49.596611 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:49.596611 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:49.596611 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:49.596611 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:46:49.596611 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:46:49.596611 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:46:49.596611 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:46:49.597760 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:49.597760 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:49.597760 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:49.597760 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:49.597760 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:49.597760 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:49.597760 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:49.597760 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:49.597760 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:49.597760 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:49.597760 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:49.597760 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:49.597760 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:49.597760 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:49.597760 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:49.597760 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:49.597760 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:46:49.598838 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:46:49.598838 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:46:49.598838 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:46:49.598838 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 553/1101] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:46:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:46:49.603903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f2d0e-fc1b-4eae-8996-f6c77247094b None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:49.632960 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:49.653737 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ae3df-ee62-4562-8149-e0aa79333d8b None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:49.686932 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760a995-8caa-4a24-95bd-3cd66a4e5bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:49.687524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760a995-8caa-4a24-95bd-3cd66a4e5bce None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:49.687809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760a995-8caa-4a24-95bd-3cd66a4e5bce None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:49.688067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760a995-8caa-4a24-95bd-3cd66a4e5bce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:49.688784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760a995-8caa-4a24-95bd-3cd66a4e5bce None admin] RBAC: Adding query filter params (role.id=d255b03c37d64371a148ec4e11be01d9, scope.project.id=61f3df6515c54c4e8705489f1e03205b, user.id=fc4b721f260e461989c429b9cde404da) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:49.689090 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760a995-8caa-4a24-95bd-3cd66a4e5bce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:49.690543 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760a995-8caa-4a24-95bd-3cd66a4e5bce None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:49.696038 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 549/1102] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:46:49 2022] GET /identity/v3/role_assignments?user.id=fc4b721f260e461989c429b9cde404da&scope.project.id=61f3df6515c54c4e8705489f1e03205b&role.id=d255b03c37d64371a148ec4e11be01d9 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:49.702887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f2d0e-fc1b-4eae-8996-f6c77247094b None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:49.741195 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c905aef-84e5-495c-a66b-523798078d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:49.741865 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c905aef-84e5-495c-a66b-523798078d9e None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:49.742140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c905aef-84e5-495c-a66b-523798078d9e None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:49.742408 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c905aef-84e5-495c-a66b-523798078d9e None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:49.743061 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c905aef-84e5-495c-a66b-523798078d9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:49.743360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c905aef-84e5-495c-a66b-523798078d9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:49.744778 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c905aef-84e5-495c-a66b-523798078d9e None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:49.757255 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 554/1103] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:49.763325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760a995-8caa-4a24-95bd-3cd66a4e5bce None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:49.796472 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:49.868206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760a995-8caa-4a24-95bd-3cd66a4e5bce None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:49.903745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f45b0-e075-4ca6-b5ee-b61280efe574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:49.904411 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f45b0-e075-4ca6-b5ee-b61280efe574 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:49.904630 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f45b0-e075-4ca6-b5ee-b61280efe574 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:49.904898 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f45b0-e075-4ca6-b5ee-b61280efe574 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:49.911514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f45b0-e075-4ca6-b5ee-b61280efe574 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:49.912976 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f45b0-e075-4ca6-b5ee-b61280efe574 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:49.923810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-547f45b0-e075-4ca6-b5ee-b61280efe574 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:46:49.923810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:46:49.923810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:46:49.923810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:46:49.923810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:46:49.923810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:46:49.923810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:46:49.923810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:46:49.923810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:46:49.923810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:46:49.923810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:46:49.923810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:46:49.923810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 04 00:46:49.923810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 04 00:46:49.923810 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 04 00:46:49.924677 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 04 00:46:49.924677 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:46:49.924677 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:46:49.924677 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:46:49.924677 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:46:49.924677 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:46:49.924677 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:46:49.924677 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:46:49.924677 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:46:49.924677 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:46:49.924677 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:46:49.924677 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:46:49.924677 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:46:49.924677 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:46:49.924677 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:46:49.924677 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:46:49.924677 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:46:49.925611 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 04 00:46:49.925611 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 04 00:46:49.925611 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 00:46:49.925611 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 00:46:49.925611 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 00:46:49.925611 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 00:46:49.925611 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:46:49.925611 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:46:49.925611 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 550/1104] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:46:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:46:49.930757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c905aef-84e5-495c-a66b-523798078d9e None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:50.018069 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:50.028314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c905aef-84e5-495c-a66b-523798078d9e None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:50.060047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928966a-e728-4566-8cfe-1f4068b52ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:50.060646 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928966a-e728-4566-8cfe-1f4068b52ea8 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:50.060920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928966a-e728-4566-8cfe-1f4068b52ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:50.061188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928966a-e728-4566-8cfe-1f4068b52ea8 None admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:50.061892 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928966a-e728-4566-8cfe-1f4068b52ea8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:50.062193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928966a-e728-4566-8cfe-1f4068b52ea8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:50.063607 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928966a-e728-4566-8cfe-1f4068b52ea8 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:50.075754 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 555/1105] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Sep 4 00:46:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:50.081724 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f45b0-e075-4ca6-b5ee-b61280efe574 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:50.172951 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:50.182596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f45b0-e075-4ca6-b5ee-b61280efe574 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:50.215302 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162fe2b2-85cd-4ed7-88eb-dbf8c4e9da93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:50.215908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fe2b2-85cd-4ed7-88eb-dbf8c4e9da93 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:50.216189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fe2b2-85cd-4ed7-88eb-dbf8c4e9da93 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:50.216462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fe2b2-85cd-4ed7-88eb-dbf8c4e9da93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:50.217176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162fe2b2-85cd-4ed7-88eb-dbf8c4e9da93 None admin] RBAC: Adding query filter params (role.id=fd671e98e0424c60995238aaa9dcdd5d, scope.project.id=40b24e92f8594ee08bd2a55f79e3b299, user.id=13f0f341bf2c475d82b4e7b34d503dd0) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:50.217512 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162fe2b2-85cd-4ed7-88eb-dbf8c4e9da93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:50.218939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162fe2b2-85cd-4ed7-88eb-dbf8c4e9da93 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:50.224682 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 551/1106] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:46:50 2022] GET /identity/v3/role_assignments?user.id=13f0f341bf2c475d82b4e7b34d503dd0&scope.project.id=40b24e92f8594ee08bd2a55f79e3b299&role.id=fd671e98e0424c60995238aaa9dcdd5d => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:51.631278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7728c2-c3f3-44f8-a07e-ab109899eba7 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:51.631793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7728c2-c3f3-44f8-a07e-ab109899eba7 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:51.631905 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7728c2-c3f3-44f8-a07e-ab109899eba7 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:51.633155 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 556/1107] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:51.638280 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891d8bd-63bd-4646-995e-92d60eabd335 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:51.638649 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891d8bd-63bd-4646-995e-92d60eabd335 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:51.638832 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891d8bd-63bd-4646-995e-92d60eabd335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:51.657111 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e891d8bd-63bd-4646-995e-92d60eabd335 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:51.658306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e891d8bd-63bd-4646-995e-92d60eabd335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:51.721891 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 552/1108] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:46:51.997779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7728c2-c3f3-44f8-a07e-ab109899eba7 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:52.095098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7728c2-c3f3-44f8-a07e-ab109899eba7 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:52.130289 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e961e90-1691-436f-868f-e31eb203eb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:52.131426 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e961e90-1691-436f-868f-e31eb203eb34 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:52.131706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e961e90-1691-436f-868f-e31eb203eb34 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:52.131976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e961e90-1691-436f-868f-e31eb203eb34 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:52.133069 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e961e90-1691-436f-868f-e31eb203eb34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:52.134519 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e961e90-1691-436f-868f-e31eb203eb34 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:52.136067 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 557/1109] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:46:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:52.141773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891d8bd-63bd-4646-995e-92d60eabd335 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:52.222642 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:52.237894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891d8bd-63bd-4646-995e-92d60eabd335 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:52.270283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad6036-b94d-4564-9920-9d061fff6581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:52.270822 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad6036-b94d-4564-9920-9d061fff6581 None admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:52.271694 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad6036-b94d-4564-9920-9d061fff6581 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:52.271969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad6036-b94d-4564-9920-9d061fff6581 None admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:52.272608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad6036-b94d-4564-9920-9d061fff6581 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:52.274079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad6036-b94d-4564-9920-9d061fff6581 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:52.294292 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 553/1110] 10.222.0.30 () {60 vars in 1132 bytes} [Sun Sep 4 00:46:52 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:46:54.210414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177308ce-2f31-46a3-9636-873852e91781 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:54.210969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177308ce-2f31-46a3-9636-873852e91781 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:54.210969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177308ce-2f31-46a3-9636-873852e91781 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:54.212273 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 558/1111] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:54.217406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f349ce3-d302-4b94-8116-d9e80efb658c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:54.217831 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f349ce3-d302-4b94-8116-d9e80efb658c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:54.217969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f349ce3-d302-4b94-8116-d9e80efb658c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:54.236382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-3f349ce3-d302-4b94-8116-d9e80efb658c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:54.237580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3f349ce3-d302-4b94-8116-d9e80efb658c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:54.302690 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 554/1112] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:46:54.578562 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177308ce-2f31-46a3-9636-873852e91781 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:54.597072 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:54.677871 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177308ce-2f31-46a3-9636-873852e91781 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:54.710122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4608f-c7ff-4c00-94d7-670069ffe35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:54.710747 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4608f-c7ff-4c00-94d7-670069ffe35e None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:54.711024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4608f-c7ff-4c00-94d7-670069ffe35e None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:54.711293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4608f-c7ff-4c00-94d7-670069ffe35e None admin] PATH_INFO: `/v3/roles/c6d447182cac4a6ca92d2457e8936b91` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:54.712667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be4608f-c7ff-4c00-94d7-670069ffe35e None admin] RBAC: Authorizing `identity:get_role(role_id=c6d447182cac4a6ca92d2457e8936b91)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:54.714056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be4608f-c7ff-4c00-94d7-670069ffe35e None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:54.715375 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 559/1113] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:46:54 2022] GET /identity/v3/roles/c6d447182cac4a6ca92d2457e8936b91 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:54.721105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f349ce3-d302-4b94-8116-d9e80efb658c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:54.789381 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:54.817893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f349ce3-d302-4b94-8116-d9e80efb658c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:54.850496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b01a2-27aa-4ed6-8d7e-c7cf39db1435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:54.851051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b01a2-27aa-4ed6-8d7e-c7cf39db1435 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:54.851327 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b01a2-27aa-4ed6-8d7e-c7cf39db1435 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:54.851594 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b01a2-27aa-4ed6-8d7e-c7cf39db1435 None admin] PATH_INFO: `/v3/users/9f17ad980f2f4a8883ece46cc518c578` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:54.864208 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b01a2-27aa-4ed6-8d7e-c7cf39db1435 None admin] RBAC: Authorizing `identity:get_user(user_id=9f17ad980f2f4a8883ece46cc518c578)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:54.865695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b01a2-27aa-4ed6-8d7e-c7cf39db1435 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:54.867237 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 555/1114] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:46:54 2022] GET /identity/v3/users/9f17ad980f2f4a8883ece46cc518c578 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:54.872946 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4608f-c7ff-4c00-94d7-670069ffe35e None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:54.957363 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:54.972435 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4608f-c7ff-4c00-94d7-670069ffe35e None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:55.004425 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d1e8a-01fc-4d9c-a4bd-0127cd7179e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:55.005016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d1e8a-01fc-4d9c-a4bd-0127cd7179e7 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:55.005314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d1e8a-01fc-4d9c-a4bd-0127cd7179e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:55.005613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d1e8a-01fc-4d9c-a4bd-0127cd7179e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:55.069262 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4d1e8a-01fc-4d9c-a4bd-0127cd7179e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:55.070709 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4d1e8a-01fc-4d9c-a4bd-0127cd7179e7 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:55.150749 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:55.167297 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 560/1115] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:46:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 04 00:46:55.173151 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b01a2-27aa-4ed6-8d7e-c7cf39db1435 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:55.268485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b01a2-27aa-4ed6-8d7e-c7cf39db1435 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:55.295614 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:55.301564 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9cba58-244f-4964-b874-9a121fef56aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:55.302201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cba58-244f-4964-b874-9a121fef56aa None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:55.302479 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cba58-244f-4964-b874-9a121fef56aa None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:55.302748 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cba58-244f-4964-b874-9a121fef56aa None admin] PATH_INFO: `/v3/projects/61f3df6515c54c4e8705489f1e03205b` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:55.303840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9cba58-244f-4964-b874-9a121fef56aa None admin] RBAC: Authorizing `identity:get_project(project_id=61f3df6515c54c4e8705489f1e03205b)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:55.305263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9cba58-244f-4964-b874-9a121fef56aa None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:55.306871 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 556/1116] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:46:55 2022] GET /identity/v3/projects/61f3df6515c54c4e8705489f1e03205b => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:55.312979 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d1e8a-01fc-4d9c-a4bd-0127cd7179e7 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:55.408522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d1e8a-01fc-4d9c-a4bd-0127cd7179e7 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:55.445607 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242fde4-81d4-458a-b522-55ffed47d157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:55.446199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242fde4-81d4-458a-b522-55ffed47d157 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:55.446472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242fde4-81d4-458a-b522-55ffed47d157 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:55.446758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242fde4-81d4-458a-b522-55ffed47d157 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:55.447476 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5242fde4-81d4-458a-b522-55ffed47d157 None admin] RBAC: Adding query filter params (role.id=c6d447182cac4a6ca92d2457e8936b91, scope.project.id=61f3df6515c54c4e8705489f1e03205b, user.id=9f17ad980f2f4a8883ece46cc518c578) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:46:55.447774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5242fde4-81d4-458a-b522-55ffed47d157 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:55.449179 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5242fde4-81d4-458a-b522-55ffed47d157 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:55.454549 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 561/1117] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:46:55 2022] GET /identity/v3/role_assignments?user.id=9f17ad980f2f4a8883ece46cc518c578&scope.project.id=61f3df6515c54c4e8705489f1e03205b&role.id=c6d447182cac4a6ca92d2457e8936b91 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:46:57.293115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e5551-8823-4bca-872d-e0799bcbf68d None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:57.293678 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e5551-8823-4bca-872d-e0799bcbf68d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:57.293768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e5551-8823-4bca-872d-e0799bcbf68d None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:57.295065 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 557/1118] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:46:57.300071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581e810-e120-4eed-baa1-f563b02e5a3a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:57.300509 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581e810-e120-4eed-baa1-f563b02e5a3a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:57.300603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581e810-e120-4eed-baa1-f563b02e5a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:57.319255 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5581e810-e120-4eed-baa1-f563b02e5a3a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:46:57.320403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5581e810-e120-4eed-baa1-f563b02e5a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:46:57.364223 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:57.384977 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 562/1119] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:46:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 04 00:46:57.655232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e5551-8823-4bca-872d-e0799bcbf68d None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:57.755469 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e5551-8823-4bca-872d-e0799bcbf68d None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:57.787883 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f62ff0-ff76-4e1d-81b3-0c234c95ee32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:57.788491 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f62ff0-ff76-4e1d-81b3-0c234c95ee32 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:57.788767 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f62ff0-ff76-4e1d-81b3-0c234c95ee32 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:57.789037 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f62ff0-ff76-4e1d-81b3-0c234c95ee32 None admin] PATH_INFO: `/v3/roles/c6d447182cac4a6ca92d2457e8936b91` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:57.790411 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f62ff0-ff76-4e1d-81b3-0c234c95ee32 None admin] RBAC: Authorizing `identity:get_role(role_id=c6d447182cac4a6ca92d2457e8936b91)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:57.791759 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f62ff0-ff76-4e1d-81b3-0c234c95ee32 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:57.793043 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 558/1120] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:46:57 2022] GET /identity/v3/roles/c6d447182cac4a6ca92d2457e8936b91 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:57.798822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581e810-e120-4eed-baa1-f563b02e5a3a None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:57.891391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581e810-e120-4eed-baa1-f563b02e5a3a None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:57.923922 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b2a1a-26df-4d3b-adf6-0f4884033d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:57.924470 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b2a1a-26df-4d3b-adf6-0f4884033d66 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:57.924747 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b2a1a-26df-4d3b-adf6-0f4884033d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:57.925018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b2a1a-26df-4d3b-adf6-0f4884033d66 None admin] PATH_INFO: `/v3/users/9f17ad980f2f4a8883ece46cc518c578` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:57.926120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b2a1a-26df-4d3b-adf6-0f4884033d66 None admin] RBAC: Authorizing `identity:get_user(user_id=9f17ad980f2f4a8883ece46cc518c578)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:57.927551 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b2a1a-26df-4d3b-adf6-0f4884033d66 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:57.929057 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 563/1121] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:46:57 2022] GET /identity/v3/users/9f17ad980f2f4a8883ece46cc518c578 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:57.934523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f62ff0-ff76-4e1d-81b3-0c234c95ee32 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:57.998009 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:58.031691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f62ff0-ff76-4e1d-81b3-0c234c95ee32 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:58.063733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb899c-adc3-4612-8da0-8112ac5a5a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:58.064340 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb899c-adc3-4612-8da0-8112ac5a5a3a None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:58.064622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb899c-adc3-4612-8da0-8112ac5a5a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:58.064897 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb899c-adc3-4612-8da0-8112ac5a5a3a None admin] PATH_INFO: `/v3/projects/61f3df6515c54c4e8705489f1e03205b` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:58.066017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb899c-adc3-4612-8da0-8112ac5a5a3a None admin] RBAC: Authorizing `identity:get_project(project_id=61f3df6515c54c4e8705489f1e03205b)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:58.067438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb899c-adc3-4612-8da0-8112ac5a5a3a None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:58.069564 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 559/1122] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:46:57 2022] GET /identity/v3/projects/61f3df6515c54c4e8705489f1e03205b => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:46:58.075233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b2a1a-26df-4d3b-adf6-0f4884033d66 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:46:58.122348 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:46:58.172648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b2a1a-26df-4d3b-adf6-0f4884033d66 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:46:58.205699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae2ac3-e2cd-4326-abba-97106f069dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:46:58.206289 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae2ac3-e2cd-4326-abba-97106f069dac None admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:46:58.206570 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae2ac3-e2cd-4326-abba-97106f069dac None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:46:58.206845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae2ac3-e2cd-4326-abba-97106f069dac None admin] PATH_INFO: `/v3/projects/61f3df6515c54c4e8705489f1e03205b/users/9f17ad980f2f4a8883ece46cc518c578/roles/c6d447182cac4a6ca92d2457e8936b91` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:46:58.209576 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ae2ac3-e2cd-4326-abba-97106f069dac None admin] RBAC: Authorizing `identity:create_grant(project_id=61f3df6515c54c4e8705489f1e03205b, user_id=9f17ad980f2f4a8883ece46cc518c578, role_id=c6d447182cac4a6ca92d2457e8936b91)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:46:58.211013 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ae2ac3-e2cd-4326-abba-97106f069dac None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:46:58.223440 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 564/1123] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Sep 4 00:46:58 2022] PUT /identity/v3/projects/61f3df6515c54c4e8705489f1e03205b/users/9f17ad980f2f4a8883ece46cc518c578/roles/c6d447182cac4a6ca92d2457e8936b91 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:47:00.111691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d9165c-bb46-43a8-9624-81b4de5374b3 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:00.112252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d9165c-bb46-43a8-9624-81b4de5374b3 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:00.112252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d9165c-bb46-43a8-9624-81b4de5374b3 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:00.113583 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 560/1124] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:47:00.119195 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97585dd6-9857-4385-9ee3-a0046252ec8a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:00.119659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97585dd6-9857-4385-9ee3-a0046252ec8a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:00.119756 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97585dd6-9857-4385-9ee3-a0046252ec8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:00.137901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-97585dd6-9857-4385-9ee3-a0046252ec8a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:47:00.139059 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-97585dd6-9857-4385-9ee3-a0046252ec8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:47:00.202098 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 565/1125] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:47:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:47:00.468845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d9165c-bb46-43a8-9624-81b4de5374b3 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:00.567241 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d9165c-bb46-43a8-9624-81b4de5374b3 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:00.598718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34279ec-c9d1-449c-9a6a-c69da46222e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:00.599831 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34279ec-c9d1-449c-9a6a-c69da46222e2 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:00.600111 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34279ec-c9d1-449c-9a6a-c69da46222e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:00.600382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34279ec-c9d1-449c-9a6a-c69da46222e2 None admin] PATH_INFO: `/v3/roles/c6d447182cac4a6ca92d2457e8936b91` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:00.601779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34279ec-c9d1-449c-9a6a-c69da46222e2 None admin] RBAC: Authorizing `identity:get_role(role_id=c6d447182cac4a6ca92d2457e8936b91)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:00.603142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34279ec-c9d1-449c-9a6a-c69da46222e2 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:00.604414 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 561/1126] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:47:00 2022] GET /identity/v3/roles/c6d447182cac4a6ca92d2457e8936b91 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:47:00.610451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97585dd6-9857-4385-9ee3-a0046252ec8a None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:00.648497 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:00.706434 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97585dd6-9857-4385-9ee3-a0046252ec8a None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:00.740748 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc076707-223a-4b88-be68-80f959f17bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:00.741465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc076707-223a-4b88-be68-80f959f17bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:00.741816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc076707-223a-4b88-be68-80f959f17bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:00.742110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc076707-223a-4b88-be68-80f959f17bc3 None admin] PATH_INFO: `/v3/users/9f17ad980f2f4a8883ece46cc518c578` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:00.743317 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc076707-223a-4b88-be68-80f959f17bc3 None admin] RBAC: Authorizing `identity:get_user(user_id=9f17ad980f2f4a8883ece46cc518c578)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:00.744738 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc076707-223a-4b88-be68-80f959f17bc3 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:00.746309 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 566/1127] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:47:00 2022] GET /identity/v3/users/9f17ad980f2f4a8883ece46cc518c578 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:47:00.752129 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34279ec-c9d1-449c-9a6a-c69da46222e2 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:00.754942 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:00.848764 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34279ec-c9d1-449c-9a6a-c69da46222e2 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:00.880964 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c85095-c870-4cb5-97a7-ab3859642129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:00.881582 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c85095-c870-4cb5-97a7-ab3859642129 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:00.881861 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c85095-c870-4cb5-97a7-ab3859642129 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:00.882131 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c85095-c870-4cb5-97a7-ab3859642129 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:00.945141 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c85095-c870-4cb5-97a7-ab3859642129 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:00.946607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c85095-c870-4cb5-97a7-ab3859642129 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:00.948300 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:01.041947 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 562/1128] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:47:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 04 00:47:01.048022 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc076707-223a-4b88-be68-80f959f17bc3 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:01.144745 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc076707-223a-4b88-be68-80f959f17bc3 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:01.152086 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:01.178399 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33940a6e-71ca-42a5-9133-9a4403165ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:01.179013 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33940a6e-71ca-42a5-9133-9a4403165ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:01.179295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33940a6e-71ca-42a5-9133-9a4403165ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:01.179567 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33940a6e-71ca-42a5-9133-9a4403165ea3 None admin] PATH_INFO: `/v3/projects/61f3df6515c54c4e8705489f1e03205b` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:01.180670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33940a6e-71ca-42a5-9133-9a4403165ea3 None admin] RBAC: Authorizing `identity:get_project(project_id=61f3df6515c54c4e8705489f1e03205b)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:01.182125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33940a6e-71ca-42a5-9133-9a4403165ea3 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:01.183715 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 567/1129] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:47:01 2022] GET /identity/v3/projects/61f3df6515c54c4e8705489f1e03205b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:47:01.189774 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c85095-c870-4cb5-97a7-ab3859642129 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:01.286117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c85095-c870-4cb5-97a7-ab3859642129 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:01.287663 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:01.320238 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff3581-3030-4e5c-9bcd-757eae637e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:01.320774 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff3581-3030-4e5c-9bcd-757eae637e91 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:01.321053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff3581-3030-4e5c-9bcd-757eae637e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:01.321324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff3581-3030-4e5c-9bcd-757eae637e91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:01.322068 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff3581-3030-4e5c-9bcd-757eae637e91 None admin] RBAC: Adding query filter params (role.id=c6d447182cac4a6ca92d2457e8936b91, scope.project.id=61f3df6515c54c4e8705489f1e03205b, user.id=9f17ad980f2f4a8883ece46cc518c578) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:47:01.322381 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff3581-3030-4e5c-9bcd-757eae637e91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:01.323803 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff3581-3030-4e5c-9bcd-757eae637e91 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:01.329292 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 563/1130] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:47:01 2022] GET /identity/v3/role_assignments?user.id=9f17ad980f2f4a8883ece46cc518c578&scope.project.id=61f3df6515c54c4e8705489f1e03205b&role.id=c6d447182cac4a6ca92d2457e8936b91 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:47:03.220024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0475356-b629-45e8-ac57-88c8a8397058 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:03.221852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0475356-b629-45e8-ac57-88c8a8397058 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:03.221852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0475356-b629-45e8-ac57-88c8a8397058 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:03.222051 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 568/1131] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:47:03.227104 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953a821-7bf7-4261-8780-7e3993175561 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:03.227545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953a821-7bf7-4261-8780-7e3993175561 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:03.227683 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953a821-7bf7-4261-8780-7e3993175561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:03.246157 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-b953a821-7bf7-4261-8780-7e3993175561 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:47:03.247333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b953a821-7bf7-4261-8780-7e3993175561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:47:03.312898 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 564/1132] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:47:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:47:03.580546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0475356-b629-45e8-ac57-88c8a8397058 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:03.678563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0475356-b629-45e8-ac57-88c8a8397058 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:03.710812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4d02b-fee1-4f1e-81f9-89736011fba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:03.711417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4d02b-fee1-4f1e-81f9-89736011fba8 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:03.711701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4d02b-fee1-4f1e-81f9-89736011fba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:03.711968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4d02b-fee1-4f1e-81f9-89736011fba8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:03.713058 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e4d02b-fee1-4f1e-81f9-89736011fba8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:03.714498 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e4d02b-fee1-4f1e-81f9-89736011fba8 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:03.716023 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 569/1133] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:47:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:47:03.721643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953a821-7bf7-4261-8780-7e3993175561 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:03.811685 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:03.817589 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953a821-7bf7-4261-8780-7e3993175561 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:03.850821 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e36b21-3068-4fa1-983c-2b24d02f4780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:03.851358 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e36b21-3068-4fa1-983c-2b24d02f4780 None admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:03.851638 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e36b21-3068-4fa1-983c-2b24d02f4780 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:03.851910 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e36b21-3068-4fa1-983c-2b24d02f4780 None admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:03.852546 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e36b21-3068-4fa1-983c-2b24d02f4780 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:03.854013 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e36b21-3068-4fa1-983c-2b24d02f4780 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:03.879578 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 565/1134] 10.222.0.30 () {60 vars in 1141 bytes} [Sun Sep 4 00:47:03 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:47:05.797143 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cdab7-4def-4036-be23-4b04850e8d9d None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:05.797672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cdab7-4def-4036-be23-4b04850e8d9d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:05.797672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cdab7-4def-4036-be23-4b04850e8d9d None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:05.798974 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 570/1135] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:47:05.804063 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e344a70-eb27-4413-bada-268e4d656593 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:05.804478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e344a70-eb27-4413-bada-268e4d656593 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:05.804604 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e344a70-eb27-4413-bada-268e4d656593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:05.822903 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-2e344a70-eb27-4413-bada-268e4d656593 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:47:05.824058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2e344a70-eb27-4413-bada-268e4d656593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:47:05.887188 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 566/1136] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:47:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:47:06.152142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9cdab7-4def-4036-be23-4b04850e8d9d None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:06.195857 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:06.253182 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9cdab7-4def-4036-be23-4b04850e8d9d None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:06.285635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73189fd9-2ecc-48e9-aadf-3a887db1b853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:06.286242 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73189fd9-2ecc-48e9-aadf-3a887db1b853 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:06.286517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73189fd9-2ecc-48e9-aadf-3a887db1b853 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:06.286783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73189fd9-2ecc-48e9-aadf-3a887db1b853 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:06.287860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73189fd9-2ecc-48e9-aadf-3a887db1b853 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:06.289273 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73189fd9-2ecc-48e9-aadf-3a887db1b853 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:06.290831 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 571/1137] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:47:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:47:06.296436 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e344a70-eb27-4413-bada-268e4d656593 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:06.371879 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:06.392984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e344a70-eb27-4413-bada-268e4d656593 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:06.424851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1972764-1ace-4781-8f35-81afd6f262f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:06.425379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1972764-1ace-4781-8f35-81afd6f262f8 None admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:06.425682 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1972764-1ace-4781-8f35-81afd6f262f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:06.425951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1972764-1ace-4781-8f35-81afd6f262f8 None admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:06.426594 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1972764-1ace-4781-8f35-81afd6f262f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:06.428552 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1972764-1ace-4781-8f35-81afd6f262f8 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:06.448685 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 567/1138] 10.222.0.30 () {60 vars in 1132 bytes} [Sun Sep 4 00:47:06 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:47:08.368878 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ff21f-d0ae-4e26-94eb-28585843b21e None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:08.369456 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ff21f-d0ae-4e26-94eb-28585843b21e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:08.369606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ff21f-d0ae-4e26-94eb-28585843b21e None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:08.371028 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 572/1139] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:47:08.376436 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613ad5c-ae2e-4135-a1f7-ecf8def5e804 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:08.376874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613ad5c-ae2e-4135-a1f7-ecf8def5e804 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:08.377047 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613ad5c-ae2e-4135-a1f7-ecf8def5e804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:08.395385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-0613ad5c-ae2e-4135-a1f7-ecf8def5e804 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:47:08.396560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0613ad5c-ae2e-4135-a1f7-ecf8def5e804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:47:08.462950 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 568/1140] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:47:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:47:08.736582 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ff21f-d0ae-4e26-94eb-28585843b21e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:08.833824 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ff21f-d0ae-4e26-94eb-28585843b21e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:08.843884 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:08.867898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660eba1-011f-42b0-8184-b952e080e445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:08.868507 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660eba1-011f-42b0-8184-b952e080e445 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:08.868784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660eba1-011f-42b0-8184-b952e080e445 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:08.869052 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660eba1-011f-42b0-8184-b952e080e445 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:08.878701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660eba1-011f-42b0-8184-b952e080e445 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:47:08.883386 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-e660eba1-011f-42b0-8184-b952e080e445 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:47:08.883386 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:47:08.883386 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:47:08.883386 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:47:08.883386 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:47:08.883386 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:47:08.883386 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:47:08.883386 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:47:08.883386 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:47:08.883386 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:47:08.883386 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:47:08.883386 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:47:08.883386 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:47:08.883386 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:47:08.883386 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:47:08.883386 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:47:08.884529 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:47:08.884529 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:47:08.884529 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:47:08.884529 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:47:08.884529 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:47:08.884529 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:47:08.884529 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:47:08.884529 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:47:08.884529 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:47:08.884529 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:47:08.884529 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:47:08.884529 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:47:08.884529 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:47:08.884529 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:47:08.884529 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:47:08.884529 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:47:08.885616 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:47:08.885616 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:47:08.885616 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:47:08.885616 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:47:08.885616 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:47:08.885616 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:47:08.885616 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:47:08.885616 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:47:08.885616 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:47:08.885616 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:47:08.885616 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:47:08.885616 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:47:08.885616 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 573/1141] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Sep 4 00:47:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:47:08.890433 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613ad5c-ae2e-4135-a1f7-ecf8def5e804 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:08.948090 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:08.984665 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613ad5c-ae2e-4135-a1f7-ecf8def5e804 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:09.016216 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f90cc7-0465-4cb9-a19c-53932d781529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:09.016746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f90cc7-0465-4cb9-a19c-53932d781529 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:09.017021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f90cc7-0465-4cb9-a19c-53932d781529 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:09.017287 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f90cc7-0465-4cb9-a19c-53932d781529 None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:09.017963 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f90cc7-0465-4cb9-a19c-53932d781529 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:47:09.018260 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f90cc7-0465-4cb9-a19c-53932d781529 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:09.019609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f90cc7-0465-4cb9-a19c-53932d781529 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:09.027650 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 569/1142] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:47:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:47:09.033212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660eba1-011f-42b0-8184-b952e080e445 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:09.129619 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660eba1-011f-42b0-8184-b952e080e445 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:09.162517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d3834-2dd3-483c-9cce-6cfec1eb5244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:09.163116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d3834-2dd3-483c-9cce-6cfec1eb5244 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:09.163389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d3834-2dd3-483c-9cce-6cfec1eb5244 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:09.163656 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d3834-2dd3-483c-9cce-6cfec1eb5244 None admin] PATH_INFO: `/v3/users/7bb2fdba16cf4878be0cc08fe0305dcc` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:09.176154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d3834-2dd3-483c-9cce-6cfec1eb5244 None admin] RBAC: Authorizing `identity:get_user(user_id=7bb2fdba16cf4878be0cc08fe0305dcc)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:09.177652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d3834-2dd3-483c-9cce-6cfec1eb5244 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:09.179194 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 574/1143] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:47:09 2022] GET /identity/v3/users/7bb2fdba16cf4878be0cc08fe0305dcc => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:47:09.184888 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f90cc7-0465-4cb9-a19c-53932d781529 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:09.280176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f90cc7-0465-4cb9-a19c-53932d781529 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:09.304313 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:09.312715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a2cce-7fdc-4bc9-bd3e-25561a0e53c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:09.313300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a2cce-7fdc-4bc9-bd3e-25561a0e53c2 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:09.313609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a2cce-7fdc-4bc9-bd3e-25561a0e53c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:09.313881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a2cce-7fdc-4bc9-bd3e-25561a0e53c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:09.378223 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a2cce-7fdc-4bc9-bd3e-25561a0e53c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:09.379653 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a2cce-7fdc-4bc9-bd3e-25561a0e53c2 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:09.474969 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 570/1144] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:47:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 04 00:47:09.480790 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d3834-2dd3-483c-9cce-6cfec1eb5244 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:09.508514 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:09.575727 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d3834-2dd3-483c-9cce-6cfec1eb5244 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:09.607759 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc41b7d-0598-496a-9c0c-bdc4e06c6232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:09.608369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc41b7d-0598-496a-9c0c-bdc4e06c6232 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:09.608646 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc41b7d-0598-496a-9c0c-bdc4e06c6232 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:09.608915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc41b7d-0598-496a-9c0c-bdc4e06c6232 None admin] PATH_INFO: `/v3/projects/2c016dff925c47738dde7529c522330e` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:09.610270 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc41b7d-0598-496a-9c0c-bdc4e06c6232 None admin] RBAC: Authorizing `identity:get_project(project_id=2c016dff925c47738dde7529c522330e)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:09.611685 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc41b7d-0598-496a-9c0c-bdc4e06c6232 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:09.613261 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 575/1145] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:47:09 2022] GET /identity/v3/projects/2c016dff925c47738dde7529c522330e => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:47:09.619501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a2cce-7fdc-4bc9-bd3e-25561a0e53c2 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:09.652262 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:09.721959 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a2cce-7fdc-4bc9-bd3e-25561a0e53c2 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:09.754202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5162e-1073-4cee-b868-dfc65e28eb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:09.755423 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5162e-1073-4cee-b868-dfc65e28eb9e None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:09.755699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5162e-1073-4cee-b868-dfc65e28eb9e None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:09.755965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5162e-1073-4cee-b868-dfc65e28eb9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:09.756669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5162e-1073-4cee-b868-dfc65e28eb9e None admin] RBAC: Adding query filter params (role.id=d255b03c37d64371a148ec4e11be01d9, scope.project.id=2c016dff925c47738dde7529c522330e, user.id=7bb2fdba16cf4878be0cc08fe0305dcc) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:47:09.756973 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5162e-1073-4cee-b868-dfc65e28eb9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:09.758412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5162e-1073-4cee-b868-dfc65e28eb9e None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:09.763470 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 571/1146] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:47:09 2022] GET /identity/v3/role_assignments?user.id=7bb2fdba16cf4878be0cc08fe0305dcc&scope.project.id=2c016dff925c47738dde7529c522330e&role.id=d255b03c37d64371a148ec4e11be01d9 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:47:11.619184 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8c15a-b95d-4705-814d-ac1ec8b0da62 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:11.619729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8c15a-b95d-4705-814d-ac1ec8b0da62 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:11.619729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8c15a-b95d-4705-814d-ac1ec8b0da62 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:11.621059 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 576/1147] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:47:11.626095 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a29aff-fa55-4845-8d89-005d10d297d6 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:11.626525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a29aff-fa55-4845-8d89-005d10d297d6 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:11.626624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a29aff-fa55-4845-8d89-005d10d297d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:11.645078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e0a29aff-fa55-4845-8d89-005d10d297d6 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:47:11.646475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e0a29aff-fa55-4845-8d89-005d10d297d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:47:11.710157 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 572/1148] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:47:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:47:11.979901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8c15a-b95d-4705-814d-ac1ec8b0da62 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:12.072086 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:12.079732 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8c15a-b95d-4705-814d-ac1ec8b0da62 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:12.113619 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11bd29-57a1-4b72-8c50-eb5349e7bf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:12.114241 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11bd29-57a1-4b72-8c50-eb5349e7bf8a None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:12.114520 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11bd29-57a1-4b72-8c50-eb5349e7bf8a None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:12.114791 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11bd29-57a1-4b72-8c50-eb5349e7bf8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:12.124641 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b11bd29-57a1-4b72-8c50-eb5349e7bf8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:47:12.129342 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-5b11bd29-57a1-4b72-8c50-eb5349e7bf8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:47:12.129342 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:47:12.129342 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:47:12.129342 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:47:12.129342 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:47:12.129342 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:47:12.129342 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:47:12.129342 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:47:12.129342 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:47:12.129342 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:47:12.129342 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:47:12.129342 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:47:12.129342 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:47:12.129342 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:47:12.129342 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:47:12.129342 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:47:12.130441 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:47:12.130441 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:47:12.130441 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:47:12.130441 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:47:12.130441 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:47:12.130441 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:47:12.130441 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:47:12.130441 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:47:12.130441 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:47:12.130441 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:47:12.130441 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:47:12.130441 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:47:12.130441 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:47:12.130441 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:47:12.130441 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:47:12.130441 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:47:12.131458 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:47:12.131458 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:47:12.131458 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:47:12.131458 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:47:12.131458 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:47:12.131458 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:47:12.131458 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:47:12.131458 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:47:12.131458 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:47:12.131458 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:47:12.131458 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:47:12.131458 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:47:12.131458 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 577/1149] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Sep 4 00:47:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:47:12.136611 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a29aff-fa55-4845-8d89-005d10d297d6 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:12.157056 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:12.231676 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a29aff-fa55-4845-8d89-005d10d297d6 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:12.263596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe6061-b0d9-4918-9bd8-6e079574a0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:12.264209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe6061-b0d9-4918-9bd8-6e079574a0ee None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:12.264485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe6061-b0d9-4918-9bd8-6e079574a0ee None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:12.264749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe6061-b0d9-4918-9bd8-6e079574a0ee None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:12.265389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe6061-b0d9-4918-9bd8-6e079574a0ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:47:12.265712 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe6061-b0d9-4918-9bd8-6e079574a0ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:12.267107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe6061-b0d9-4918-9bd8-6e079574a0ee None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:12.276265 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 573/1150] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:47:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:47:12.282057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11bd29-57a1-4b72-8c50-eb5349e7bf8a None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:12.378285 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11bd29-57a1-4b72-8c50-eb5349e7bf8a None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:12.411748 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989b234-d0f2-4a16-8636-e55a706151df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:12.412354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989b234-d0f2-4a16-8636-e55a706151df None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:12.412635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989b234-d0f2-4a16-8636-e55a706151df None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:12.412909 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989b234-d0f2-4a16-8636-e55a706151df None admin] PATH_INFO: `/v3/users/7bb2fdba16cf4878be0cc08fe0305dcc` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:12.414025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2989b234-d0f2-4a16-8636-e55a706151df None admin] RBAC: Authorizing `identity:get_user(user_id=7bb2fdba16cf4878be0cc08fe0305dcc)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:12.415441 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2989b234-d0f2-4a16-8636-e55a706151df None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:12.416966 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 578/1151] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:47:12 2022] GET /identity/v3/users/7bb2fdba16cf4878be0cc08fe0305dcc => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:47:12.422460 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe6061-b0d9-4918-9bd8-6e079574a0ee None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:12.501564 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:12.519623 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe6061-b0d9-4918-9bd8-6e079574a0ee None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:12.551819 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1787d-2198-4368-b207-34829a05a8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:12.552435 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1787d-2198-4368-b207-34829a05a8da None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:12.552715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1787d-2198-4368-b207-34829a05a8da None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:12.552988 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1787d-2198-4368-b207-34829a05a8da None admin] PATH_INFO: `/v3/projects/2c016dff925c47738dde7529c522330e` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:12.554065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1787d-2198-4368-b207-34829a05a8da None admin] RBAC: Authorizing `identity:get_project(project_id=2c016dff925c47738dde7529c522330e)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:12.555494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1787d-2198-4368-b207-34829a05a8da None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:12.557093 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 574/1152] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:47:12 2022] GET /identity/v3/projects/2c016dff925c47738dde7529c522330e => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:47:12.563004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989b234-d0f2-4a16-8636-e55a706151df None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:12.588793 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:12.661267 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989b234-d0f2-4a16-8636-e55a706151df None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:12.694376 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c051a-1775-4347-9c28-e52504781bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:12.695019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c051a-1775-4347-9c28-e52504781bf3 None admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:12.695301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c051a-1775-4347-9c28-e52504781bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:12.695574 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c051a-1775-4347-9c28-e52504781bf3 None admin] PATH_INFO: `/v3/projects/2c016dff925c47738dde7529c522330e/users/7bb2fdba16cf4878be0cc08fe0305dcc/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:12.697466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c051a-1775-4347-9c28-e52504781bf3 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c016dff925c47738dde7529c522330e, user_id=7bb2fdba16cf4878be0cc08fe0305dcc, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:12.698889 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c051a-1775-4347-9c28-e52504781bf3 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:12.711687 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 579/1153] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Sep 4 00:47:12 2022] PUT /identity/v3/projects/2c016dff925c47738dde7529c522330e/users/7bb2fdba16cf4878be0cc08fe0305dcc/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:47:14.578525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b4821-e0fb-4f12-9511-725a00e9ab71 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:14.579071 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b4821-e0fb-4f12-9511-725a00e9ab71 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:14.579071 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b4821-e0fb-4f12-9511-725a00e9ab71 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:14.580422 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 575/1154] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:47:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:47:14.585588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b9a9a-7a48-41a8-a5a4-c63a8059f332 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:14.585983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b9a9a-7a48-41a8-a5a4-c63a8059f332 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:14.586126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b9a9a-7a48-41a8-a5a4-c63a8059f332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:14.604794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d38b9a9a-7a48-41a8-a5a4-c63a8059f332 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:47:14.605987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d38b9a9a-7a48-41a8-a5a4-c63a8059f332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:47:14.668768 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 580/1155] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:47:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:47:14.935924 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b4821-e0fb-4f12-9511-725a00e9ab71 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:15.034082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b4821-e0fb-4f12-9511-725a00e9ab71 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:15.065976 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d7672-dab6-443f-b2e1-2cc4aabcf3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:15.066577 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d7672-dab6-443f-b2e1-2cc4aabcf3bf None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:15.066855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d7672-dab6-443f-b2e1-2cc4aabcf3bf None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:15.067148 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d7672-dab6-443f-b2e1-2cc4aabcf3bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:15.076699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d7672-dab6-443f-b2e1-2cc4aabcf3bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:47:15.081404 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-697d7672-dab6-443f-b2e1-2cc4aabcf3bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:47:15.081404 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:47:15.081404 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:47:15.081404 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:47:15.081404 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:47:15.081404 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:47:15.081404 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:47:15.081404 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:47:15.081404 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:47:15.081404 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:47:15.081404 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:47:15.081404 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:47:15.081404 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:47:15.081404 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:47:15.081404 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:47:15.081404 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:47:15.082386 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:47:15.082386 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:47:15.082386 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:47:15.082386 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:47:15.082386 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:47:15.082386 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:47:15.082386 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:47:15.082386 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:47:15.082386 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:47:15.082386 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:47:15.082386 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:47:15.082386 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:47:15.082386 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:47:15.082386 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:47:15.082386 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:47:15.082386 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:47:15.084187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:47:15.084187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:47:15.084187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:47:15.084187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:47:15.084187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:47:15.084187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:47:15.084187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:47:15.084187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:47:15.084187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:47:15.084187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:47:15.084187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:47:15.084187 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:47:15.084187 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 576/1156] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Sep 4 00:47:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:47:15.088665 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b9a9a-7a48-41a8-a5a4-c63a8059f332 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:15.103609 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:15.185073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b9a9a-7a48-41a8-a5a4-c63a8059f332 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:15.217720 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ff7d7-62ad-4eea-bc02-24762f5b4a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:15.218263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ff7d7-62ad-4eea-bc02-24762f5b4a73 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:15.218571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ff7d7-62ad-4eea-bc02-24762f5b4a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:15.218844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ff7d7-62ad-4eea-bc02-24762f5b4a73 None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:15.219505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ff7d7-62ad-4eea-bc02-24762f5b4a73 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:47:15.219803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ff7d7-62ad-4eea-bc02-24762f5b4a73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:15.221152 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ff7d7-62ad-4eea-bc02-24762f5b4a73 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:15.229495 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 581/1157] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:47:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:47:15.235346 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d7672-dab6-443f-b2e1-2cc4aabcf3bf None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:15.247710 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:15.332000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d7672-dab6-443f-b2e1-2cc4aabcf3bf None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:15.364376 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ce27e-f873-43a4-8f9c-dc27a2059643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:15.364976 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ce27e-f873-43a4-8f9c-dc27a2059643 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:15.365250 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ce27e-f873-43a4-8f9c-dc27a2059643 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:15.365544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ce27e-f873-43a4-8f9c-dc27a2059643 None admin] PATH_INFO: `/v3/users/7bb2fdba16cf4878be0cc08fe0305dcc` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:15.366636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ce27e-f873-43a4-8f9c-dc27a2059643 None admin] RBAC: Authorizing `identity:get_user(user_id=7bb2fdba16cf4878be0cc08fe0305dcc)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:15.368046 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ce27e-f873-43a4-8f9c-dc27a2059643 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:15.369581 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 577/1158] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:47:15 2022] GET /identity/v3/users/7bb2fdba16cf4878be0cc08fe0305dcc => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:47:15.375356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ff7d7-62ad-4eea-bc02-24762f5b4a73 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:15.449293 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:15.472047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ff7d7-62ad-4eea-bc02-24762f5b4a73 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:15.505292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636cecf-1f74-417a-a56a-1b2cc2f1ef40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:15.505938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636cecf-1f74-417a-a56a-1b2cc2f1ef40 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:15.506209 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636cecf-1f74-417a-a56a-1b2cc2f1ef40 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:15.506472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636cecf-1f74-417a-a56a-1b2cc2f1ef40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:15.572181 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636cecf-1f74-417a-a56a-1b2cc2f1ef40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:15.573645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636cecf-1f74-417a-a56a-1b2cc2f1ef40 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:15.644942 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:15.668411 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 582/1159] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:47:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 04 00:47:15.674385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ce27e-f873-43a4-8f9c-dc27a2059643 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:15.749573 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:15.770908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ce27e-f873-43a4-8f9c-dc27a2059643 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:15.802852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3682cf-bc39-45d8-9527-b8bb6b6bf18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:15.803465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3682cf-bc39-45d8-9527-b8bb6b6bf18a None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:15.803743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3682cf-bc39-45d8-9527-b8bb6b6bf18a None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:15.804013 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3682cf-bc39-45d8-9527-b8bb6b6bf18a None admin] PATH_INFO: `/v3/projects/2c016dff925c47738dde7529c522330e` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:15.805103 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3682cf-bc39-45d8-9527-b8bb6b6bf18a None admin] RBAC: Authorizing `identity:get_project(project_id=2c016dff925c47738dde7529c522330e)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:15.806561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3682cf-bc39-45d8-9527-b8bb6b6bf18a None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:15.808160 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 578/1160] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:47:15 2022] GET /identity/v3/projects/2c016dff925c47738dde7529c522330e => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:47:15.814096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636cecf-1f74-417a-a56a-1b2cc2f1ef40 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:15.908775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636cecf-1f74-417a-a56a-1b2cc2f1ef40 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:15.941035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63342cd9-76af-4279-b251-259d6eb3a3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:15.941645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63342cd9-76af-4279-b251-259d6eb3a3b6 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:15.942513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63342cd9-76af-4279-b251-259d6eb3a3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:15.942797 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63342cd9-76af-4279-b251-259d6eb3a3b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:15.943510 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63342cd9-76af-4279-b251-259d6eb3a3b6 None admin] RBAC: Adding query filter params (role.id=d255b03c37d64371a148ec4e11be01d9, scope.project.id=2c016dff925c47738dde7529c522330e, user.id=7bb2fdba16cf4878be0cc08fe0305dcc) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:47:15.943813 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63342cd9-76af-4279-b251-259d6eb3a3b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:15.945213 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63342cd9-76af-4279-b251-259d6eb3a3b6 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:15.950748 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 583/1161] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:47:15 2022] GET /identity/v3/role_assignments?user.id=7bb2fdba16cf4878be0cc08fe0305dcc&scope.project.id=2c016dff925c47738dde7529c522330e&role.id=d255b03c37d64371a148ec4e11be01d9 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:47:17.835772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14255cf0-4ecd-4a82-b02b-b66ab791f292 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:17.836300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14255cf0-4ecd-4a82-b02b-b66ab791f292 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:17.836300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14255cf0-4ecd-4a82-b02b-b66ab791f292 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:17.837577 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 579/1162] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:47:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:47:17.842839 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd75894-2552-42cc-912d-e7e173cc7536 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:17.843263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd75894-2552-42cc-912d-e7e173cc7536 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:17.843382 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd75894-2552-42cc-912d-e7e173cc7536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:17.861089 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-8cd75894-2552-42cc-912d-e7e173cc7536 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:47:17.862268 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8cd75894-2552-42cc-912d-e7e173cc7536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:47:17.894733 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:17.927899 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 584/1163] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:47:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:47:18.200252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14255cf0-4ecd-4a82-b02b-b66ab791f292 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:18.296416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14255cf0-4ecd-4a82-b02b-b66ab791f292 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:18.331246 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d2ada-26c8-4429-8d61-6c7c808e71d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:18.331836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d2ada-26c8-4429-8d61-6c7c808e71d0 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:18.332111 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d2ada-26c8-4429-8d61-6c7c808e71d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:18.332379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d2ada-26c8-4429-8d61-6c7c808e71d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:18.346657 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:18.396675 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d2ada-26c8-4429-8d61-6c7c808e71d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:18.398135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d2ada-26c8-4429-8d61-6c7c808e71d0 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:18.492011 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 580/1164] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:47:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 04 00:47:18.497903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd75894-2552-42cc-912d-e7e173cc7536 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:18.591228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd75894-2552-42cc-912d-e7e173cc7536 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:18.624319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3410d-36a7-44cf-97c9-7e87a0565934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:18.624934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3410d-36a7-44cf-97c9-7e87a0565934 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:18.625209 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3410d-36a7-44cf-97c9-7e87a0565934 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:18.625498 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3410d-36a7-44cf-97c9-7e87a0565934 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:18.631860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac3410d-36a7-44cf-97c9-7e87a0565934 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:18.633279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac3410d-36a7-44cf-97c9-7e87a0565934 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:18.644158 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-fac3410d-36a7-44cf-97c9-7e87a0565934 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 04 00:47:18.644158 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:47:18.644158 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 04 00:47:18.644158 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 04 00:47:18.644158 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 00:47:18.644158 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 00:47:18.644158 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 00:47:18.644158 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 00:47:18.644158 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 04 00:47:18.644158 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:47:18.644158 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 00:47:18.644158 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:47:18.644158 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:47:18.644158 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:47:18.644158 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:47:18.644158 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:47:18.644158 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:47:18.645384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:47:18.645384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:47:18.645384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:47:18.645384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:47:18.645384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:47:18.645384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:47:18.645384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:47:18.645384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:47:18.645384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:47:18.645384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:47:18.645384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:47:18.645384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:47:18.645384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:47:18.645384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:47:18.645384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:47:18.645384 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:47:18.646479 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:47:18.646479 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:47:18.646479 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:47:18.646479 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:47:18.646479 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:47:18.646479 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:47:18.646479 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:47:18.646479 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:47:18.646479 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:47:18.646479 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:47:18.646479 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 04 00:47:18.646479 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:47:18.646479 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 04 00:47:18.646479 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:47:18.646479 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 585/1165] 10.222.0.30 () {56 vars in 1117 bytes} [Sun Sep 4 00:47:18 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:47:18.651283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d2ada-26c8-4429-8d61-6c7c808e71d0 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:18.695414 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:18.746182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d2ada-26c8-4429-8d61-6c7c808e71d0 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:18.778007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489744c2-8382-462d-91b0-0057a09310cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:18.778587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489744c2-8382-462d-91b0-0057a09310cf None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:18.778860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489744c2-8382-462d-91b0-0057a09310cf None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:18.779128 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489744c2-8382-462d-91b0-0057a09310cf None admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:18.779745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489744c2-8382-462d-91b0-0057a09310cf None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:47:18.780042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489744c2-8382-462d-91b0-0057a09310cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:18.781383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489744c2-8382-462d-91b0-0057a09310cf None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:18.788691 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 581/1166] 10.222.0.30 () {56 vars in 1115 bytes} [Sun Sep 4 00:47:18 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:47:20.654406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b9072-89a2-49e8-afe8-21da630951a5 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:20.654942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b9072-89a2-49e8-afe8-21da630951a5 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:20.654942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b9072-89a2-49e8-afe8-21da630951a5 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:20.656302 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 586/1167] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:47:20.661703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fd5ce-7ae4-455e-9bf2-3e797e10ae9e None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:20.662100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fd5ce-7ae4-455e-9bf2-3e797e10ae9e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:20.662243 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fd5ce-7ae4-455e-9bf2-3e797e10ae9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:20.680014 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-df7fd5ce-7ae4-455e-9bf2-3e797e10ae9e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:47:20.681174 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-df7fd5ce-7ae4-455e-9bf2-3e797e10ae9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:47:20.744227 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 582/1168] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:47:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:47:21.012837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b9072-89a2-49e8-afe8-21da630951a5 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:21.042313 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:21.110781 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b9072-89a2-49e8-afe8-21da630951a5 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:21.144529 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429aecf6-5624-483a-9815-1784e2a6233e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:21.145139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429aecf6-5624-483a-9815-1784e2a6233e None admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:21.145415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429aecf6-5624-483a-9815-1784e2a6233e None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:21.145716 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429aecf6-5624-483a-9815-1784e2a6233e None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:21.146371 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429aecf6-5624-483a-9815-1784e2a6233e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:21.147710 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429aecf6-5624-483a-9815-1784e2a6233e None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:21.162804 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 587/1169] 10.222.0.30 () {60 vars in 1138 bytes} [Sun Sep 4 00:47:21 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:47:23.057936 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce12b31-fa02-4840-8356-1ee8ef741392 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:23.058462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce12b31-fa02-4840-8356-1ee8ef741392 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:23.058462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce12b31-fa02-4840-8356-1ee8ef741392 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:23.059805 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 583/1170] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:47:23.064789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb1011-0548-49ff-9366-9bd206e13f73 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:23.065193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb1011-0548-49ff-9366-9bd206e13f73 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:23.065341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb1011-0548-49ff-9366-9bd206e13f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:23.084116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c3bb1011-0548-49ff-9366-9bd206e13f73 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:47:23.085293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c3bb1011-0548-49ff-9366-9bd206e13f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:47:23.149558 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 588/1171] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:47:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:47:23.431754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce12b31-fa02-4840-8356-1ee8ef741392 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:23.478491 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:23.536039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce12b31-fa02-4840-8356-1ee8ef741392 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:23.571306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779aa9b-c433-49b5-81ff-18f0a0fd74db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:23.571926 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779aa9b-c433-49b5-81ff-18f0a0fd74db None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:23.572204 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779aa9b-c433-49b5-81ff-18f0a0fd74db None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:23.572478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779aa9b-c433-49b5-81ff-18f0a0fd74db None admin] PATH_INFO: `/v3/domains/7b6de03dfdda45978333bea16e0d3a26` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:23.582923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779aa9b-c433-49b5-81ff-18f0a0fd74db None admin] RBAC: Authorizing `identity:get_domain(domain_id=7b6de03dfdda45978333bea16e0d3a26)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:23.584353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779aa9b-c433-49b5-81ff-18f0a0fd74db None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:23.585947 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 584/1172] 10.222.0.30 () {56 vars in 1183 bytes} [Sun Sep 4 00:47:23 2022] GET /identity/v3/domains/7b6de03dfdda45978333bea16e0d3a26 => generated 267 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:47:23.591766 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb1011-0548-49ff-9366-9bd206e13f73 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:23.614239 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:23.698020 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb1011-0548-49ff-9366-9bd206e13f73 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:23.731426 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff318600-01ab-4900-8dce-5f1f7d013127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:23.732036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff318600-01ab-4900-8dce-5f1f7d013127 None admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:23.732315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff318600-01ab-4900-8dce-5f1f7d013127 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:23.732586 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff318600-01ab-4900-8dce-5f1f7d013127 None admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:23.733238 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff318600-01ab-4900-8dce-5f1f7d013127 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:23.734975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff318600-01ab-4900-8dce-5f1f7d013127 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:23.761961 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 589/1173] 10.222.0.30 () {60 vars in 1141 bytes} [Sun Sep 4 00:47:23 2022] POST /identity/v3/projects => generated 361 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:47:25.672884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9c24e-bca8-4ad3-8026-723dc3181cb8 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:25.673407 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9c24e-bca8-4ad3-8026-723dc3181cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:25.673407 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9c24e-bca8-4ad3-8026-723dc3181cb8 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:25.674778 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 585/1174] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:47:25.679935 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d647f9-51db-4695-bf1e-81f422fe1fc8 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:25.680332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d647f9-51db-4695-bf1e-81f422fe1fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:25.680481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d647f9-51db-4695-bf1e-81f422fe1fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:25.698213 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e8d647f9-51db-4695-bf1e-81f422fe1fc8 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:47:25.699383 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e8d647f9-51db-4695-bf1e-81f422fe1fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:47:25.764697 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 590/1175] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:47:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 04 00:47:26.029322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9c24e-bca8-4ad3-8026-723dc3181cb8 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:26.122845 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:26.126886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9c24e-bca8-4ad3-8026-723dc3181cb8 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:26.159673 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa50a5d-98b7-41e5-8799-b6b53d5579ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:26.160311 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa50a5d-98b7-41e5-8799-b6b53d5579ae None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:26.160593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa50a5d-98b7-41e5-8799-b6b53d5579ae None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:26.160863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa50a5d-98b7-41e5-8799-b6b53d5579ae None admin] PATH_INFO: `/v3/domains/7b6de03dfdda45978333bea16e0d3a26` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:26.161992 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa50a5d-98b7-41e5-8799-b6b53d5579ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=7b6de03dfdda45978333bea16e0d3a26)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:26.163419 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa50a5d-98b7-41e5-8799-b6b53d5579ae None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:26.164925 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 586/1176] 10.222.0.30 () {56 vars in 1183 bytes} [Sun Sep 4 00:47:26 2022] GET /identity/v3/domains/7b6de03dfdda45978333bea16e0d3a26 => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:47:26.170463 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d647f9-51db-4695-bf1e-81f422fe1fc8 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:26.172606 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:26.266053 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d647f9-51db-4695-bf1e-81f422fe1fc8 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:26.297592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ff18e-0655-459f-9149-915338878294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:26.298122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ff18e-0655-459f-9149-915338878294 None admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:26.298395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ff18e-0655-459f-9149-915338878294 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:26.298658 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ff18e-0655-459f-9149-915338878294 None admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:26.299286 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547ff18e-0655-459f-9149-915338878294 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:26.300687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547ff18e-0655-459f-9149-915338878294 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:26.322467 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 591/1177] 10.222.0.30 () {60 vars in 1132 bytes} [Sun Sep 4 00:47:26 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:47:28.248135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76596856-e415-4415-884e-6cdd9632b2eb None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:28.248693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76596856-e415-4415-884e-6cdd9632b2eb None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:28.248693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76596856-e415-4415-884e-6cdd9632b2eb None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:28.250176 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 587/1178] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:47:28.255233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89a3fd-cdc2-4353-9f76-716eb165480b None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:28.255642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89a3fd-cdc2-4353-9f76-716eb165480b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:28.255787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89a3fd-cdc2-4353-9f76-716eb165480b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:28.273455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-6a89a3fd-cdc2-4353-9f76-716eb165480b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:47:28.274624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6a89a3fd-cdc2-4353-9f76-716eb165480b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:47:28.325412 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:28.339421 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 592/1179] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:47:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:47:28.615980 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76596856-e415-4415-884e-6cdd9632b2eb None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:28.715249 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76596856-e415-4415-884e-6cdd9632b2eb None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:28.748940 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a9425-36b2-4fd2-95cc-173981c1e2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:28.749580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a9425-36b2-4fd2-95cc-173981c1e2be None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:28.749859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a9425-36b2-4fd2-95cc-173981c1e2be None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:28.750129 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a9425-36b2-4fd2-95cc-173981c1e2be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:28.760470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a9425-36b2-4fd2-95cc-173981c1e2be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:47:28.765179 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-3d0a9425-36b2-4fd2-95cc-173981c1e2be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:47:28.765179 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:47:28.765179 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:47:28.765179 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:47:28.765179 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:47:28.765179 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:47:28.765179 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:47:28.765179 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:47:28.765179 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:47:28.765179 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:47:28.765179 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:47:28.765179 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:47:28.765179 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:47:28.765179 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:47:28.765179 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:47:28.765179 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:47:28.766361 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:47:28.766361 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:47:28.766361 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:47:28.766361 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:47:28.766361 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:47:28.766361 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:47:28.766361 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:47:28.766361 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:47:28.766361 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:47:28.766361 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:47:28.766361 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:47:28.766361 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:47:28.766361 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:47:28.766361 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:47:28.766361 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:47:28.766361 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:47:28.767432 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:47:28.767432 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:47:28.767432 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:47:28.767432 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:47:28.767432 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:47:28.767432 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:47:28.767432 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:47:28.767432 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:47:28.767432 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:47:28.767432 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:47:28.767432 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:47:28.767432 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:47:28.767432 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 588/1180] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Sep 4 00:47:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:47:28.772274 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89a3fd-cdc2-4353-9f76-716eb165480b None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:28.867012 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89a3fd-cdc2-4353-9f76-716eb165480b None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:28.898611 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb10a9-b64f-47cf-bedc-6c07d84e4315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:28.899203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb10a9-b64f-47cf-bedc-6c07d84e4315 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:28.899482 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb10a9-b64f-47cf-bedc-6c07d84e4315 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:28.899751 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb10a9-b64f-47cf-bedc-6c07d84e4315 None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:28.900396 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb10a9-b64f-47cf-bedc-6c07d84e4315 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:47:28.900694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb10a9-b64f-47cf-bedc-6c07d84e4315 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:28.902076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb10a9-b64f-47cf-bedc-6c07d84e4315 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:28.909764 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 593/1181] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:47:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:47:28.915927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a9425-36b2-4fd2-95cc-173981c1e2be None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:28.944552 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:29.012434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a9425-36b2-4fd2-95cc-173981c1e2be None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:29.044749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4e4a3-b76b-4d66-bc8c-1183c0f407f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:29.045361 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4e4a3-b76b-4d66-bc8c-1183c0f407f4 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:29.045670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4e4a3-b76b-4d66-bc8c-1183c0f407f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:29.045944 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4e4a3-b76b-4d66-bc8c-1183c0f407f4 None admin] PATH_INFO: `/v3/users/3e3564a3575d49438505078d3c4e7c39` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:29.059043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4e4a3-b76b-4d66-bc8c-1183c0f407f4 None admin] RBAC: Authorizing `identity:get_user(user_id=3e3564a3575d49438505078d3c4e7c39)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:29.060474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4e4a3-b76b-4d66-bc8c-1183c0f407f4 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:29.062054 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 589/1182] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:47:28 2022] GET /identity/v3/users/3e3564a3575d49438505078d3c4e7c39 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:47:29.067857 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb10a9-b64f-47cf-bedc-6c07d84e4315 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:29.116485 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:29.164626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb10a9-b64f-47cf-bedc-6c07d84e4315 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:29.196877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c29e7-4e2d-426e-81c6-7bfdb5c63066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:29.197496 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c29e7-4e2d-426e-81c6-7bfdb5c63066 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:29.197779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c29e7-4e2d-426e-81c6-7bfdb5c63066 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:29.198050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c29e7-4e2d-426e-81c6-7bfdb5c63066 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:29.261697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c29e7-4e2d-426e-81c6-7bfdb5c63066 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:29.263116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c29e7-4e2d-426e-81c6-7bfdb5c63066 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:29.308840 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:29.357508 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 594/1183] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:47:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 04 00:47:29.363615 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4e4a3-b76b-4d66-bc8c-1183c0f407f4 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:29.447293 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:29.462784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4e4a3-b76b-4d66-bc8c-1183c0f407f4 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:29.495667 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0872d-b831-4895-bdc1-84c81f1facc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:29.496278 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0872d-b831-4895-bdc1-84c81f1facc6 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:29.496552 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0872d-b831-4895-bdc1-84c81f1facc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:29.496820 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0872d-b831-4895-bdc1-84c81f1facc6 None admin] PATH_INFO: `/v3/projects/75b2466f20a94152a99ffd1dab8e87bc` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:29.497926 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0872d-b831-4895-bdc1-84c81f1facc6 None admin] RBAC: Authorizing `identity:get_project(project_id=75b2466f20a94152a99ffd1dab8e87bc)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:29.499345 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0872d-b831-4895-bdc1-84c81f1facc6 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:29.500920 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 590/1184] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:47:29 2022] GET /identity/v3/projects/75b2466f20a94152a99ffd1dab8e87bc => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:47:29.507032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c29e7-4e2d-426e-81c6-7bfdb5c63066 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:29.604957 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c29e7-4e2d-426e-81c6-7bfdb5c63066 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:29.637366 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ebbf4-5f01-41f6-bb89-1fb04c74448d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:29.637973 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ebbf4-5f01-41f6-bb89-1fb04c74448d None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:29.638246 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ebbf4-5f01-41f6-bb89-1fb04c74448d None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:29.638513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ebbf4-5f01-41f6-bb89-1fb04c74448d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:29.639217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ebbf4-5f01-41f6-bb89-1fb04c74448d None admin] RBAC: Adding query filter params (role.id=d255b03c37d64371a148ec4e11be01d9, scope.project.id=75b2466f20a94152a99ffd1dab8e87bc, user.id=3e3564a3575d49438505078d3c4e7c39) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:47:29.639519 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ebbf4-5f01-41f6-bb89-1fb04c74448d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:29.640915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ebbf4-5f01-41f6-bb89-1fb04c74448d None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:29.646694 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 595/1185] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:47:29 2022] GET /identity/v3/role_assignments?user.id=3e3564a3575d49438505078d3c4e7c39&scope.project.id=75b2466f20a94152a99ffd1dab8e87bc&role.id=d255b03c37d64371a148ec4e11be01d9 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:47:31.506976 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3f957-7d08-48e2-a50d-f4d9b74e8b76 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:31.507477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3f957-7d08-48e2-a50d-f4d9b74e8b76 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:31.507586 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3f957-7d08-48e2-a50d-f4d9b74e8b76 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:31.508836 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 591/1186] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:47:31.513919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d0268-5431-4db3-bd60-50e1c90815ed None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:31.514283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d0268-5431-4db3-bd60-50e1c90815ed None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:31.514464 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d0268-5431-4db3-bd60-50e1c90815ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:31.532026 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-342d0268-5431-4db3-bd60-50e1c90815ed None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:47:31.533192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-342d0268-5431-4db3-bd60-50e1c90815ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:47:31.542525 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:31.598215 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 596/1187] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:47:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:47:31.864957 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3f957-7d08-48e2-a50d-f4d9b74e8b76 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:31.961522 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3f957-7d08-48e2-a50d-f4d9b74e8b76 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:32.000812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740fe6c-155b-4c47-833b-cbe507ab0d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:32.001465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740fe6c-155b-4c47-833b-cbe507ab0d5e None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:32.001740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740fe6c-155b-4c47-833b-cbe507ab0d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:32.002013 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740fe6c-155b-4c47-833b-cbe507ab0d5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:32.011801 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740fe6c-155b-4c47-833b-cbe507ab0d5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:47:32.016524 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-e740fe6c-155b-4c47-833b-cbe507ab0d5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:47:32.016524 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:47:32.016524 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:47:32.016524 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:47:32.016524 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:47:32.016524 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:47:32.016524 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:47:32.016524 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:47:32.016524 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:47:32.016524 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:47:32.016524 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:47:32.016524 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:47:32.016524 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:47:32.016524 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:47:32.016524 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:47:32.016524 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:47:32.017600 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:47:32.017600 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:47:32.017600 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:47:32.017600 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:47:32.017600 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:47:32.017600 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:47:32.017600 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:47:32.017600 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:47:32.017600 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:47:32.017600 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:47:32.017600 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:47:32.017600 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:47:32.017600 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:47:32.017600 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:47:32.017600 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:47:32.017600 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:47:32.018608 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:47:32.018608 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:47:32.018608 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:47:32.018608 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:47:32.018608 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:47:32.018608 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:47:32.018608 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:47:32.018608 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:47:32.018608 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:47:32.018608 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:47:32.018608 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:47:32.018608 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:47:32.018608 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 592/1188] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Sep 4 00:47:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:47:32.023559 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d0268-5431-4db3-bd60-50e1c90815ed None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:32.117783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d0268-5431-4db3-bd60-50e1c90815ed None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:32.149276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563db30-6d75-488b-88f0-c39322cd2d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:32.149900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563db30-6d75-488b-88f0-c39322cd2d7d None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:32.150178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563db30-6d75-488b-88f0-c39322cd2d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:32.150446 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563db30-6d75-488b-88f0-c39322cd2d7d None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:32.151097 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563db30-6d75-488b-88f0-c39322cd2d7d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:47:32.151395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563db30-6d75-488b-88f0-c39322cd2d7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:32.152740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563db30-6d75-488b-88f0-c39322cd2d7d None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:32.160913 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 597/1189] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:47:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:47:32.166356 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740fe6c-155b-4c47-833b-cbe507ab0d5e None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:32.182313 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:32.262039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740fe6c-155b-4c47-833b-cbe507ab0d5e None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:32.295131 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe27b9e-64f9-434f-9f51-5c1dda8d163b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:32.295739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe27b9e-64f9-434f-9f51-5c1dda8d163b None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:32.296016 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe27b9e-64f9-434f-9f51-5c1dda8d163b None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:32.296285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe27b9e-64f9-434f-9f51-5c1dda8d163b None admin] PATH_INFO: `/v3/users/3e3564a3575d49438505078d3c4e7c39` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:32.297385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe27b9e-64f9-434f-9f51-5c1dda8d163b None admin] RBAC: Authorizing `identity:get_user(user_id=3e3564a3575d49438505078d3c4e7c39)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:32.298830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe27b9e-64f9-434f-9f51-5c1dda8d163b None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:32.300361 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 593/1190] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:47:32 2022] GET /identity/v3/users/3e3564a3575d49438505078d3c4e7c39 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:47:32.306209 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563db30-6d75-488b-88f0-c39322cd2d7d None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:32.315372 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:32.403513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563db30-6d75-488b-88f0-c39322cd2d7d None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:32.436494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b876e-18d1-4c54-a797-10db65d18ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:32.437102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b876e-18d1-4c54-a797-10db65d18ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:32.437379 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b876e-18d1-4c54-a797-10db65d18ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:32.437675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b876e-18d1-4c54-a797-10db65d18ef4 None admin] PATH_INFO: `/v3/projects/75b2466f20a94152a99ffd1dab8e87bc` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:32.438780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b876e-18d1-4c54-a797-10db65d18ef4 None admin] RBAC: Authorizing `identity:get_project(project_id=75b2466f20a94152a99ffd1dab8e87bc)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:32.440204 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b876e-18d1-4c54-a797-10db65d18ef4 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:32.441900 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 598/1191] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:47:32 2022] GET /identity/v3/projects/75b2466f20a94152a99ffd1dab8e87bc => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:47:32.447668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe27b9e-64f9-434f-9f51-5c1dda8d163b None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:32.527722 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:32.545751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe27b9e-64f9-434f-9f51-5c1dda8d163b None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:32.577542 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db679dea-ba17-40b4-972a-640c73ba0ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:32.578181 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db679dea-ba17-40b4-972a-640c73ba0ce7 None admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:32.578460 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db679dea-ba17-40b4-972a-640c73ba0ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:32.578732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db679dea-ba17-40b4-972a-640c73ba0ce7 None admin] PATH_INFO: `/v3/projects/75b2466f20a94152a99ffd1dab8e87bc/users/3e3564a3575d49438505078d3c4e7c39/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:32.580583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db679dea-ba17-40b4-972a-640c73ba0ce7 None admin] RBAC: Authorizing `identity:create_grant(project_id=75b2466f20a94152a99ffd1dab8e87bc, user_id=3e3564a3575d49438505078d3c4e7c39, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:32.582631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db679dea-ba17-40b4-972a-640c73ba0ce7 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:32.594435 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 594/1192] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Sep 4 00:47:32 2022] PUT /identity/v3/projects/75b2466f20a94152a99ffd1dab8e87bc/users/3e3564a3575d49438505078d3c4e7c39/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:47:34.468967 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34fd3b-a1f4-405a-987c-8038af68bab0 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:34.469371 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34fd3b-a1f4-405a-987c-8038af68bab0 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:34.469526 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34fd3b-a1f4-405a-987c-8038af68bab0 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:34.470868 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 599/1193] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:47:34.476722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a94c8-b1d8-40d3-9294-356f0c2b9ef1 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:34.477149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a94c8-b1d8-40d3-9294-356f0c2b9ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:34.477249 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a94c8-b1d8-40d3-9294-356f0c2b9ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:34.495133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-396a94c8-b1d8-40d3-9294-356f0c2b9ef1 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:47:34.496296 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-396a94c8-b1d8-40d3-9294-356f0c2b9ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:47:34.558830 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 595/1194] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:47:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:47:34.833307 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd34fd3b-a1f4-405a-987c-8038af68bab0 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:34.907584 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:34.932822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd34fd3b-a1f4-405a-987c-8038af68bab0 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:34.967183 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb62849-1d9b-4ba5-a265-7e97e5850ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:34.967804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb62849-1d9b-4ba5-a265-7e97e5850ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:34.968084 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb62849-1d9b-4ba5-a265-7e97e5850ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:34.968355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb62849-1d9b-4ba5-a265-7e97e5850ae7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:34.978284 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb62849-1d9b-4ba5-a265-7e97e5850ae7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:47:34.983066 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-3cb62849-1d9b-4ba5-a265-7e97e5850ae7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:47:34.983066 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:47:34.983066 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:47:34.983066 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:47:34.983066 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:47:34.983066 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:47:34.983066 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:47:34.983066 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:47:34.983066 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:47:34.983066 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:47:34.983066 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:47:34.983066 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:47:34.983066 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:47:34.983066 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:47:34.983066 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:47:34.983066 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:47:34.984140 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:47:34.984140 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:47:34.984140 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:47:34.984140 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:47:34.984140 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:47:34.984140 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:47:34.984140 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:47:34.984140 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:47:34.984140 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:47:34.984140 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:47:34.984140 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:47:34.984140 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:47:34.984140 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:47:34.984140 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:47:34.984140 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:47:34.984140 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:47:34.985289 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:47:34.985289 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:47:34.985289 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:47:34.985289 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:47:34.985289 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:47:34.985289 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:47:34.985289 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:47:34.985289 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:47:34.985289 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:47:34.985289 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:47:34.985289 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:47:34.985289 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:47:34.985289 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 600/1195] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Sep 4 00:47:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:47:34.990533 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a94c8-b1d8-40d3-9294-356f0c2b9ef1 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:35.056241 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:35.086015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a94c8-b1d8-40d3-9294-356f0c2b9ef1 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:35.117669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa3dd6-d91d-4d2b-b501-4decf4791e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:35.118252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa3dd6-d91d-4d2b-b501-4decf4791e69 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:35.118526 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa3dd6-d91d-4d2b-b501-4decf4791e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:35.118793 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa3dd6-d91d-4d2b-b501-4decf4791e69 None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:35.119431 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa3dd6-d91d-4d2b-b501-4decf4791e69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:47:35.119728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa3dd6-d91d-4d2b-b501-4decf4791e69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:35.121085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa3dd6-d91d-4d2b-b501-4decf4791e69 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:35.129158 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 596/1196] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:47:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:47:35.134760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb62849-1d9b-4ba5-a265-7e97e5850ae7 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:35.231302 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb62849-1d9b-4ba5-a265-7e97e5850ae7 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:35.264451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad2781-acc6-4502-8b3c-800467c010e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:35.265057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad2781-acc6-4502-8b3c-800467c010e3 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:35.265332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad2781-acc6-4502-8b3c-800467c010e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:35.265626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad2781-acc6-4502-8b3c-800467c010e3 None admin] PATH_INFO: `/v3/users/3e3564a3575d49438505078d3c4e7c39` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:35.266721 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad2781-acc6-4502-8b3c-800467c010e3 None admin] RBAC: Authorizing `identity:get_user(user_id=3e3564a3575d49438505078d3c4e7c39)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:35.268126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad2781-acc6-4502-8b3c-800467c010e3 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:35.269751 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 601/1197] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Sep 4 00:47:35 2022] GET /identity/v3/users/3e3564a3575d49438505078d3c4e7c39 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:47:35.275452 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa3dd6-d91d-4d2b-b501-4decf4791e69 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:35.370214 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa3dd6-d91d-4d2b-b501-4decf4791e69 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:35.401982 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1a2b0-f4b5-4517-a4b9-62f884e9db08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:35.402581 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1a2b0-f4b5-4517-a4b9-62f884e9db08 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:35.402856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1a2b0-f4b5-4517-a4b9-62f884e9db08 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:35.403125 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1a2b0-f4b5-4517-a4b9-62f884e9db08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:35.405556 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:35.468844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1a2b0-f4b5-4517-a4b9-62f884e9db08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:35.470319 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1a2b0-f4b5-4517-a4b9-62f884e9db08 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:35.564548 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 597/1198] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:47:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 04 00:47:35.570968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad2781-acc6-4502-8b3c-800467c010e3 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:35.573854 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:35.670562 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad2781-acc6-4502-8b3c-800467c010e3 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:35.702706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c7115-c117-4c4d-97aa-73000ab87453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:35.703323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c7115-c117-4c4d-97aa-73000ab87453 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:35.703602 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c7115-c117-4c4d-97aa-73000ab87453 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:35.703871 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c7115-c117-4c4d-97aa-73000ab87453 None admin] PATH_INFO: `/v3/projects/75b2466f20a94152a99ffd1dab8e87bc` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:35.704965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c7115-c117-4c4d-97aa-73000ab87453 None admin] RBAC: Authorizing `identity:get_project(project_id=75b2466f20a94152a99ffd1dab8e87bc)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:35.706412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c7115-c117-4c4d-97aa-73000ab87453 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:35.708047 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 602/1199] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Sep 4 00:47:35 2022] GET /identity/v3/projects/75b2466f20a94152a99ffd1dab8e87bc => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:47:35.714173 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1a2b0-f4b5-4517-a4b9-62f884e9db08 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:47:35.747330 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:35.811286 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1a2b0-f4b5-4517-a4b9-62f884e9db08 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:47:35.843516 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1355a92-5903-4981-82b4-b174017ab26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:47:35.844104 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1355a92-5903-4981-82b4-b174017ab26e None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:47:35.844380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1355a92-5903-4981-82b4-b174017ab26e None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:47:35.844648 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1355a92-5903-4981-82b4-b174017ab26e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:47:35.845353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1355a92-5903-4981-82b4-b174017ab26e None admin] RBAC: Adding query filter params (role.id=d255b03c37d64371a148ec4e11be01d9, scope.project.id=75b2466f20a94152a99ffd1dab8e87bc, user.id=3e3564a3575d49438505078d3c4e7c39) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:47:35.845688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1355a92-5903-4981-82b4-b174017ab26e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:47:35.847105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1355a92-5903-4981-82b4-b174017ab26e None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:47:35.853146 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 598/1200] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:47:35 2022] GET /identity/v3/role_assignments?user.id=3e3564a3575d49438505078d3c4e7c39&scope.project.id=75b2466f20a94152a99ffd1dab8e87bc&role.id=d255b03c37d64371a148ec4e11be01d9 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:47:45.698633 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=65 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:47:45.850751 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=51 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:30.280659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcef80-9174-480b-a714-d21f0f94e480 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:30.280659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcef80-9174-480b-a714-d21f0f94e480 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:30.280659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcef80-9174-480b-a714-d21f0f94e480 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:30.280659 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 603/1201] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:48:30.286194 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1e1f5-fcba-48ee-961f-5cb8c8213499 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:30.286653 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1e1f5-fcba-48ee-961f-5cb8c8213499 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:30.286832 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1e1f5-fcba-48ee-961f-5cb8c8213499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:30.307793 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-82f1e1f5-fcba-48ee-961f-5cb8c8213499 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:48:30.308985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-82f1e1f5-fcba-48ee-961f-5cb8c8213499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:48:30.393478 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 599/1202] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:48:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 04 00:48:30.669029 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfcef80-9174-480b-a714-d21f0f94e480 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:30.808314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfcef80-9174-480b-a714-d21f0f94e480 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:30.856315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021e63c-e97b-4738-b186-c8daafca2131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:30.857154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021e63c-e97b-4738-b186-c8daafca2131 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:30.857465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021e63c-e97b-4738-b186-c8daafca2131 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:30.858097 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021e63c-e97b-4738-b186-c8daafca2131 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:30.871842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021e63c-e97b-4738-b186-c8daafca2131 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:30.873616 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021e63c-e97b-4738-b186-c8daafca2131 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:30.893610 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-3021e63c-e97b-4738-b186-c8daafca2131 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:48:30.893610 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:48:30.893610 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:48:30.893610 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:48:30.893610 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:48:30.893610 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:48:30.893610 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:48:30.893610 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:48:30.893610 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:48:30.893610 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:48:30.893610 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:48:30.893610 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:48:30.893610 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:48:30.893610 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:48:30.893610 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:48:30.893610 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:48:30.895747 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:48:30.895747 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:48:30.895747 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:48:30.895747 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:48:30.895747 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:48:30.895747 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:48:30.895747 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:48:30.895747 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:48:30.895747 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:48:30.895747 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:48:30.895747 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:48:30.895747 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:48:30.895747 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:48:30.895747 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:48:30.895747 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:48:30.895747 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:48:30.895747 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:48:30.896759 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:48:30.896759 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:48:30.896759 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:48:30.896759 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 604/1203] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:48:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:48:30.904370 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1e1f5-fcba-48ee-961f-5cb8c8213499 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:31.026307 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1e1f5-fcba-48ee-961f-5cb8c8213499 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:31.067602 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:31.077851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248f685-c8db-44f6-baa5-3956b80db305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:31.078897 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248f685-c8db-44f6-baa5-3956b80db305 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:31.079834 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248f685-c8db-44f6-baa5-3956b80db305 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:31.080242 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248f685-c8db-44f6-baa5-3956b80db305 None admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:31.081108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248f685-c8db-44f6-baa5-3956b80db305 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:48:31.081502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248f685-c8db-44f6-baa5-3956b80db305 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:31.082982 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248f685-c8db-44f6-baa5-3956b80db305 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:31.106634 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021e63c-e97b-4738-b186-c8daafca2131 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:31.108075 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 600/1204] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:48:31.182411 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:31.243594 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021e63c-e97b-4738-b186-c8daafca2131 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:31.288880 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5ec0c-e645-4dd5-a450-1882bd01713d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:31.289689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5ec0c-e645-4dd5-a450-1882bd01713d None admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:31.289808 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5ec0c-e645-4dd5-a450-1882bd01713d None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:31.290072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5ec0c-e645-4dd5-a450-1882bd01713d None admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:31.290720 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce5ec0c-e645-4dd5-a450-1882bd01713d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:31.292214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce5ec0c-e645-4dd5-a450-1882bd01713d None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:31.326060 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 605/1205] 10.222.0.30 () {60 vars in 1132 bytes} [Sun Sep 4 00:48:31 2022] POST /identity/v3/users => generated 251 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:48:33.433110 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31dcd2-6fcb-4c9c-be56-4acd92cce668 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:33.433724 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31dcd2-6fcb-4c9c-be56-4acd92cce668 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:33.433724 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31dcd2-6fcb-4c9c-be56-4acd92cce668 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:33.437497 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 601/1206] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:48:33.445042 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80756791-7b70-4054-a831-fa9d5a889a25 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:33.445599 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80756791-7b70-4054-a831-fa9d5a889a25 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:33.445696 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80756791-7b70-4054-a831-fa9d5a889a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:33.468278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-80756791-7b70-4054-a831-fa9d5a889a25 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:48:33.470803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-80756791-7b70-4054-a831-fa9d5a889a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:48:33.555016 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 606/1207] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:48:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:48:33.892265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31dcd2-6fcb-4c9c-be56-4acd92cce668 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:34.030677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31dcd2-6fcb-4c9c-be56-4acd92cce668 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:34.093060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce148777-a14e-4b95-ab7e-149974f900c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:34.093753 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce148777-a14e-4b95-ab7e-149974f900c4 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:34.094201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce148777-a14e-4b95-ab7e-149974f900c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:34.094305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce148777-a14e-4b95-ab7e-149974f900c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:34.107921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce148777-a14e-4b95-ab7e-149974f900c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:48:34.113750 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-ce148777-a14e-4b95-ab7e-149974f900c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:48:34.113750 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:48:34.113750 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:48:34.113750 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:48:34.113750 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:48:34.113750 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:48:34.113750 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:48:34.113750 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:48:34.113750 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:48:34.113750 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:48:34.113750 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:48:34.113750 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:48:34.113750 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:48:34.113750 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:48:34.113750 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:48:34.113750 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:48:34.114885 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:48:34.114885 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:48:34.114885 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:48:34.114885 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:48:34.114885 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:48:34.114885 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:48:34.114885 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:48:34.114885 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:48:34.114885 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:48:34.114885 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:48:34.114885 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:48:34.114885 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:48:34.114885 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:48:34.114885 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:48:34.114885 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:48:34.114885 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:48:34.116273 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:48:34.116273 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:48:34.116273 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:48:34.116273 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:48:34.116273 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:48:34.116273 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:48:34.116273 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:48:34.116273 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:48:34.116273 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:48:34.116273 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:48:34.116273 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:48:34.116273 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:48:34.117940 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 602/1208] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Sep 4 00:48:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:48:34.123830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80756791-7b70-4054-a831-fa9d5a889a25 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:34.171013 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:34.241548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80756791-7b70-4054-a831-fa9d5a889a25 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:34.279583 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d013a-d3ed-44f0-b857-d4632bdfbb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:34.281880 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d013a-d3ed-44f0-b857-d4632bdfbb1f None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:34.281880 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d013a-d3ed-44f0-b857-d4632bdfbb1f None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:34.281880 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d013a-d3ed-44f0-b857-d4632bdfbb1f None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:34.281880 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d013a-d3ed-44f0-b857-d4632bdfbb1f None admin] RBAC: Adding query filter params (name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:48:34.281880 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d013a-d3ed-44f0-b857-d4632bdfbb1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:34.283772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d013a-d3ed-44f0-b857-d4632bdfbb1f None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:34.294109 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 607/1209] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Sep 4 00:48:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:48:34.300840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce148777-a14e-4b95-ab7e-149974f900c4 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:34.362704 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:34.418359 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce148777-a14e-4b95-ab7e-149974f900c4 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:34.459387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb05073-3510-4505-be0b-86966dc0c2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:34.460089 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb05073-3510-4505-be0b-86966dc0c2ca None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:34.460294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb05073-3510-4505-be0b-86966dc0c2ca None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:34.460597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb05073-3510-4505-be0b-86966dc0c2ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:34.471781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb05073-3510-4505-be0b-86966dc0c2ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:34.473256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb05073-3510-4505-be0b-86966dc0c2ca None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:34.494853 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-5eb05073-3510-4505-be0b-86966dc0c2ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:48:34.494853 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:48:34.494853 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:48:34.494853 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:48:34.494853 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:48:34.494853 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:48:34.494853 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:48:34.494853 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:48:34.494853 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:48:34.494853 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:48:34.494853 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:48:34.494853 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:48:34.494853 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:48:34.494853 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:48:34.494853 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:48:34.494853 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:48:34.495815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:48:34.495815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:48:34.495815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:48:34.495815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:48:34.495815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:48:34.495815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:48:34.495815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:48:34.495815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:48:34.495815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:48:34.495815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:48:34.495815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:48:34.495815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:48:34.495815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:48:34.495815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:48:34.495815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:48:34.495815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:48:34.495815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:48:34.496687 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:48:34.496687 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:48:34.496687 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:48:34.498478 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 603/1210] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:48:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:48:34.506883 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d013a-d3ed-44f0-b857-d4632bdfbb1f None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:34.663010 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:34.663010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d013a-d3ed-44f0-b857-d4632bdfbb1f None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:34.706086 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50353656-0cd0-4c80-80d9-26dffa6f1048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:34.706623 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50353656-0cd0-4c80-80d9-26dffa6f1048 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:34.706905 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50353656-0cd0-4c80-80d9-26dffa6f1048 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:34.707178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50353656-0cd0-4c80-80d9-26dffa6f1048 None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:34.707823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50353656-0cd0-4c80-80d9-26dffa6f1048 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:48:34.708125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50353656-0cd0-4c80-80d9-26dffa6f1048 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:34.709510 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50353656-0cd0-4c80-80d9-26dffa6f1048 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:34.725540 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 608/1211] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:48:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:48:34.727880 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb05073-3510-4505-be0b-86966dc0c2ca None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:34.855034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb05073-3510-4505-be0b-86966dc0c2ca None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:34.856673 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:34.900410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c260f4c-69ae-445d-8eb8-733a3983ce81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:34.901170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c260f4c-69ae-445d-8eb8-733a3983ce81 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:34.901550 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c260f4c-69ae-445d-8eb8-733a3983ce81 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:34.901827 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c260f4c-69ae-445d-8eb8-733a3983ce81 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:34.909824 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c260f4c-69ae-445d-8eb8-733a3983ce81 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:34.911561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c260f4c-69ae-445d-8eb8-733a3983ce81 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:34.925967 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-4c260f4c-69ae-445d-8eb8-733a3983ce81 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 04 00:48:34.925967 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:48:34.925967 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:48:34.925967 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:48:34.925967 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:48:34.925967 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:48:34.925967 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:48:34.925967 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:48:34.925967 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:48:34.925967 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:48:34.925967 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:48:34.925967 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:48:34.925967 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 04 00:48:34.925967 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 04 00:48:34.925967 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 04 00:48:34.925967 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 04 00:48:34.932978 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:48:34.932978 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:48:34.932978 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 00:48:34.932978 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:48:34.932978 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 00:48:34.932978 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:48:34.932978 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:48:34.932978 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:48:34.932978 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:48:34.932978 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:48:34.932978 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:48:34.932978 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:48:34.932978 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:48:34.932978 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:48:34.932978 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:48:34.932978 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:48:34.932978 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:48:34.932978 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:48:34.934020 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:48:34.934020 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:48:34.934020 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 00:48:34.934020 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 00:48:34.934020 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 00:48:34.934020 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 00:48:34.934020 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 00:48:34.934020 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 00:48:34.934020 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 04 00:48:34.934020 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:48:34.934020 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 604/1212] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:48:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:48:34.934644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50353656-0cd0-4c80-80d9-26dffa6f1048 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:35.077956 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50353656-0cd0-4c80-80d9-26dffa6f1048 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:35.114598 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbeae7-4081-4750-bf42-cbf5f5c7dd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:35.115209 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbeae7-4081-4750-bf42-cbf5f5c7dd75 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:35.115491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbeae7-4081-4750-bf42-cbf5f5c7dd75 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:35.115768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbeae7-4081-4750-bf42-cbf5f5c7dd75 None admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:35.116659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bbeae7-4081-4750-bf42-cbf5f5c7dd75 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:48:35.116989 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bbeae7-4081-4750-bf42-cbf5f5c7dd75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:35.118742 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bbeae7-4081-4750-bf42-cbf5f5c7dd75 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:35.143806 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 609/1213] 10.222.0.30 () {56 vars in 1143 bytes} [Sun Sep 4 00:48:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:48:35.145724 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c260f4c-69ae-445d-8eb8-733a3983ce81 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:35.266870 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c260f4c-69ae-445d-8eb8-733a3983ce81 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:35.301091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f2413-eb4c-4e43-af25-fce268c579a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:35.301745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f2413-eb4c-4e43-af25-fce268c579a5 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:35.302082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f2413-eb4c-4e43-af25-fce268c579a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:35.302306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f2413-eb4c-4e43-af25-fce268c579a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:35.338040 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:35.382865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f2413-eb4c-4e43-af25-fce268c579a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:35.384322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f2413-eb4c-4e43-af25-fce268c579a5 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:35.506770 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 605/1214] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:48:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 04 00:48:35.507926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbeae7-4081-4750-bf42-cbf5f5c7dd75 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:35.527961 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:35.617749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbeae7-4081-4750-bf42-cbf5f5c7dd75 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:35.658879 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0cc4e0-fe5e-4373-b9bb-16f9c1dc06d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:35.659694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0cc4e0-fe5e-4373-b9bb-16f9c1dc06d8 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:35.659943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0cc4e0-fe5e-4373-b9bb-16f9c1dc06d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:35.660287 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0cc4e0-fe5e-4373-b9bb-16f9c1dc06d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:35.673499 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0cc4e0-fe5e-4373-b9bb-16f9c1dc06d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:35.674942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0cc4e0-fe5e-4373-b9bb-16f9c1dc06d8 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:35.691789 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-dd0cc4e0-fe5e-4373-b9bb-16f9c1dc06d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:48:35.691789 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:48:35.691789 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:48:35.691789 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:48:35.691789 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:48:35.691789 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:48:35.691789 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:48:35.691789 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:48:35.691789 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:48:35.691789 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:48:35.691789 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:48:35.691789 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:48:35.691789 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:48:35.691789 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:48:35.691789 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:48:35.691789 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:48:35.693000 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:48:35.693000 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:48:35.693000 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:48:35.693000 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:48:35.693000 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:48:35.693000 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:48:35.693000 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:48:35.693000 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:48:35.693000 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:48:35.693000 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:48:35.693000 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:48:35.693000 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:48:35.693000 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:48:35.693000 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:48:35.693000 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:48:35.693000 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:48:35.693000 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:48:35.693916 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:48:35.693916 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:48:35.693916 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:48:35.693916 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 610/1215] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:48:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:48:35.698642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f2413-eb4c-4e43-af25-fce268c579a5 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:35.765207 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:35.808105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f2413-eb4c-4e43-af25-fce268c579a5 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:35.851742 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac380a-543e-469d-bb4b-24dbb710021c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:35.852433 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac380a-543e-469d-bb4b-24dbb710021c None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:35.852715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac380a-543e-469d-bb4b-24dbb710021c None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:35.852988 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac380a-543e-469d-bb4b-24dbb710021c None admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:35.853734 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac380a-543e-469d-bb4b-24dbb710021c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:48:35.854080 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac380a-543e-469d-bb4b-24dbb710021c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:35.855423 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac380a-543e-469d-bb4b-24dbb710021c None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:35.874931 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 606/1216] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:48:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:48:35.875115 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0cc4e0-fe5e-4373-b9bb-16f9c1dc06d8 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:35.971642 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:36.012196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0cc4e0-fe5e-4373-b9bb-16f9c1dc06d8 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:36.055191 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566f8f5-09dd-447d-aba0-1631377d8537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:36.056142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566f8f5-09dd-447d-aba0-1631377d8537 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:36.056601 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566f8f5-09dd-447d-aba0-1631377d8537 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:36.056868 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566f8f5-09dd-447d-aba0-1631377d8537 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:36.064013 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566f8f5-09dd-447d-aba0-1631377d8537 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:36.065482 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566f8f5-09dd-447d-aba0-1631377d8537 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:36.076911 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-9566f8f5-09dd-447d-aba0-1631377d8537 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:48:36.076911 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:48:36.076911 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:48:36.076911 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:48:36.076911 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:48:36.076911 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:48:36.076911 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:48:36.076911 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:48:36.076911 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:48:36.076911 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:48:36.076911 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:48:36.076911 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:48:36.076911 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 04 00:48:36.076911 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 04 00:48:36.076911 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 04 00:48:36.078176 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 04 00:48:36.078176 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:48:36.078176 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:48:36.078176 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:48:36.078176 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:48:36.078176 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:48:36.078176 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:48:36.078176 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:48:36.078176 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:48:36.078176 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:48:36.078176 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:48:36.078176 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:48:36.078176 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:48:36.078176 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:48:36.078176 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:48:36.078176 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:48:36.078176 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:48:36.079792 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 04 00:48:36.079792 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 04 00:48:36.079792 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 00:48:36.079792 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 00:48:36.079792 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 00:48:36.079792 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 00:48:36.079792 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:48:36.079792 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:48:36.083467 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 611/1217] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:48:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:48:36.084411 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac380a-543e-469d-bb4b-24dbb710021c None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:36.205623 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac380a-543e-469d-bb4b-24dbb710021c None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:36.231436 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:36.246778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df08f5-ecde-40ab-9629-996e00fe4fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:36.247786 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df08f5-ecde-40ab-9629-996e00fe4fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:36.247786 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df08f5-ecde-40ab-9629-996e00fe4fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:36.248043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df08f5-ecde-40ab-9629-996e00fe4fb1 None admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:36.248663 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df08f5-ecde-40ab-9629-996e00fe4fb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:48:36.249016 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df08f5-ecde-40ab-9629-996e00fe4fb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:36.250515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df08f5-ecde-40ab-9629-996e00fe4fb1 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:36.269079 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 607/1218] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Sep 4 00:48:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:48:36.276261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566f8f5-09dd-447d-aba0-1631377d8537 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:36.390652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566f8f5-09dd-447d-aba0-1631377d8537 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:36.425268 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:36.434575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665e64c-55a9-4a83-a0ca-a5edd023f5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:36.435450 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665e64c-55a9-4a83-a0ca-a5edd023f5f1 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:36.435773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665e64c-55a9-4a83-a0ca-a5edd023f5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:36.436068 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665e64c-55a9-4a83-a0ca-a5edd023f5f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:36.436983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665e64c-55a9-4a83-a0ca-a5edd023f5f1 None admin] RBAC: Adding query filter params (role.id=955481bca39c4b0fab953d506ea3c292, scope.project.id=40b24e92f8594ee08bd2a55f79e3b299, user.id=f908fda75ef8440cb6a0ef9440127d6d) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:48:36.437354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665e64c-55a9-4a83-a0ca-a5edd023f5f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:36.439942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665e64c-55a9-4a83-a0ca-a5edd023f5f1 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:36.446931 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 612/1219] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:48:36 2022] GET /identity/v3/role_assignments?user.id=f908fda75ef8440cb6a0ef9440127d6d&scope.project.id=40b24e92f8594ee08bd2a55f79e3b299&role.id=955481bca39c4b0fab953d506ea3c292 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:48:38.571892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb98ea3-70c7-4368-ba46-0bf94a57660f None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:38.572447 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb98ea3-70c7-4368-ba46-0bf94a57660f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:38.572447 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb98ea3-70c7-4368-ba46-0bf94a57660f None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:38.573869 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 608/1220] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:48:38.579075 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e5b35-4867-4882-8ff7-7baf74e23f72 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:38.579492 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e5b35-4867-4882-8ff7-7baf74e23f72 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:38.579628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e5b35-4867-4882-8ff7-7baf74e23f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:38.599188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c13e5b35-4867-4882-8ff7-7baf74e23f72 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:48:38.600495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c13e5b35-4867-4882-8ff7-7baf74e23f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:48:38.682148 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 613/1221] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:48:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:48:38.996573 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb98ea3-70c7-4368-ba46-0bf94a57660f None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:39.107600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb98ea3-70c7-4368-ba46-0bf94a57660f None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:39.150146 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b48a9-0902-4d49-a930-c4ec204e734e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:39.150845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b48a9-0902-4d49-a930-c4ec204e734e None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:39.151121 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b48a9-0902-4d49-a930-c4ec204e734e None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:39.151416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b48a9-0902-4d49-a930-c4ec204e734e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:39.163263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b48a9-0902-4d49-a930-c4ec204e734e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:48:39.167998 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-4c7b48a9-0902-4d49-a930-c4ec204e734e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:48:39.167998 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:48:39.167998 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:48:39.167998 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:48:39.167998 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:48:39.167998 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:48:39.167998 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:48:39.167998 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:48:39.167998 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:48:39.167998 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:48:39.167998 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:48:39.167998 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:48:39.167998 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:48:39.167998 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:48:39.167998 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:48:39.167998 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:48:39.169007 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:48:39.169007 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:48:39.169007 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:48:39.169007 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:48:39.169007 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:48:39.169007 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:48:39.169007 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:48:39.169007 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:48:39.169007 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:48:39.169007 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:48:39.169007 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:48:39.169007 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:48:39.169007 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:48:39.169007 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:48:39.169007 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:48:39.169007 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:48:39.169945 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:48:39.169945 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:48:39.169945 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:48:39.169945 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:48:39.169945 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:48:39.169945 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:48:39.169945 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:48:39.169945 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:48:39.169945 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:48:39.169945 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:48:39.169945 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:48:39.169945 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:48:39.169945 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 609/1222] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Sep 4 00:48:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:48:39.175388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e5b35-4867-4882-8ff7-7baf74e23f72 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:39.280313 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e5b35-4867-4882-8ff7-7baf74e23f72 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:39.312445 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:39.323934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152de46c-214b-49b9-848b-f5c7fd458512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:39.324538 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152de46c-214b-49b9-848b-f5c7fd458512 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:39.324814 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152de46c-214b-49b9-848b-f5c7fd458512 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:39.325083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152de46c-214b-49b9-848b-f5c7fd458512 None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:39.325767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152de46c-214b-49b9-848b-f5c7fd458512 None admin] RBAC: Adding query filter params (name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:48:39.326064 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152de46c-214b-49b9-848b-f5c7fd458512 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:39.327418 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152de46c-214b-49b9-848b-f5c7fd458512 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:39.341310 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 614/1223] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Sep 4 00:48:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:48:39.342614 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b48a9-0902-4d49-a930-c4ec204e734e None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:39.385975 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:39.442177 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b48a9-0902-4d49-a930-c4ec204e734e None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:39.479761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ae9aa-bf20-4399-a2e1-a452bdc9d9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:39.480384 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ae9aa-bf20-4399-a2e1-a452bdc9d9f1 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:39.480659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ae9aa-bf20-4399-a2e1-a452bdc9d9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:39.480949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ae9aa-bf20-4399-a2e1-a452bdc9d9f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:39.491239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ae9aa-bf20-4399-a2e1-a452bdc9d9f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:39.492693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ae9aa-bf20-4399-a2e1-a452bdc9d9f1 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:39.507567 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-ee5ae9aa-bf20-4399-a2e1-a452bdc9d9f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:48:39.507567 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:48:39.507567 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:48:39.507567 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:48:39.507567 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:48:39.507567 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:48:39.507567 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:48:39.507567 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:48:39.507567 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:48:39.507567 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:48:39.507567 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:48:39.507567 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:48:39.507567 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:48:39.507567 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:48:39.507567 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:48:39.507567 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:48:39.508686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:48:39.508686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:48:39.508686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:48:39.508686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:48:39.508686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:48:39.508686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:48:39.508686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:48:39.508686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:48:39.508686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:48:39.508686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:48:39.508686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:48:39.508686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:48:39.508686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:48:39.508686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:48:39.508686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:48:39.508686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:48:39.508686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:48:39.509650 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:48:39.509650 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:48:39.509650 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:48:39.509650 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 610/1224] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:48:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:48:39.514680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152de46c-214b-49b9-848b-f5c7fd458512 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:39.637663 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152de46c-214b-49b9-848b-f5c7fd458512 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:39.671491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2349c2-f351-450c-b05e-8a65b86bb653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:39.672095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2349c2-f351-450c-b05e-8a65b86bb653 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:39.672900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2349c2-f351-450c-b05e-8a65b86bb653 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:39.673174 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2349c2-f351-450c-b05e-8a65b86bb653 None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:39.673844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2349c2-f351-450c-b05e-8a65b86bb653 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:48:39.674146 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2349c2-f351-450c-b05e-8a65b86bb653 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:39.675506 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2349c2-f351-450c-b05e-8a65b86bb653 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:39.687003 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 615/1225] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:48:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:48:39.693527 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ae9aa-bf20-4399-a2e1-a452bdc9d9f1 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:39.804722 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:39.812026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ae9aa-bf20-4399-a2e1-a452bdc9d9f1 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:39.847703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7db2dd-5852-4705-ad24-a02f0dff03d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:39.848321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7db2dd-5852-4705-ad24-a02f0dff03d3 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:39.848602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7db2dd-5852-4705-ad24-a02f0dff03d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:39.848914 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7db2dd-5852-4705-ad24-a02f0dff03d3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:39.856738 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7db2dd-5852-4705-ad24-a02f0dff03d3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:39.858256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7db2dd-5852-4705-ad24-a02f0dff03d3 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:39.870665 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-7d7db2dd-5852-4705-ad24-a02f0dff03d3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 04 00:48:39.870665 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:48:39.870665 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:48:39.870665 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:48:39.870665 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:48:39.870665 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:48:39.870665 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:48:39.870665 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:48:39.870665 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:48:39.870665 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:48:39.870665 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:48:39.870665 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:48:39.870665 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 04 00:48:39.870665 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 04 00:48:39.870665 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 04 00:48:39.870665 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 04 00:48:39.871835 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:48:39.871835 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:48:39.871835 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 00:48:39.871835 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:48:39.871835 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 00:48:39.871835 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:48:39.871835 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:48:39.871835 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:48:39.871835 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:48:39.871835 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:48:39.871835 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:48:39.871835 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:48:39.871835 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:48:39.871835 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:48:39.871835 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:48:39.871835 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:48:39.871835 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:48:39.871835 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:48:39.872958 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:48:39.872958 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:48:39.872958 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 00:48:39.872958 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 00:48:39.872958 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 00:48:39.872958 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 00:48:39.872958 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 00:48:39.872958 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 00:48:39.872958 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 04 00:48:39.872958 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:48:39.872958 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 611/1226] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:48:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:48:39.878270 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2349c2-f351-450c-b05e-8a65b86bb653 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:39.934037 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:39.991325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2349c2-f351-450c-b05e-8a65b86bb653 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:40.027743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb6aed-d4fd-4f7b-90e0-0b1283f20e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:40.028350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb6aed-d4fd-4f7b-90e0-0b1283f20e81 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:40.028633 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb6aed-d4fd-4f7b-90e0-0b1283f20e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:40.028905 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb6aed-d4fd-4f7b-90e0-0b1283f20e81 None admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:40.029662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb6aed-d4fd-4f7b-90e0-0b1283f20e81 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:48:40.029965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb6aed-d4fd-4f7b-90e0-0b1283f20e81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:40.031393 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb6aed-d4fd-4f7b-90e0-0b1283f20e81 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:40.049752 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 616/1227] 10.222.0.30 () {56 vars in 1143 bytes} [Sun Sep 4 00:48:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:48:40.055518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7db2dd-5852-4705-ad24-a02f0dff03d3 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:40.156425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7db2dd-5852-4705-ad24-a02f0dff03d3 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:40.194040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5759a-1754-42af-a392-2ced87cc7c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:40.194628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5759a-1754-42af-a392-2ced87cc7c4c None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:40.194969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5759a-1754-42af-a392-2ced87cc7c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:40.195295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5759a-1754-42af-a392-2ced87cc7c4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:40.207944 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5759a-1754-42af-a392-2ced87cc7c4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:40.209622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5759a-1754-42af-a392-2ced87cc7c4c None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:40.224538 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-4fc5759a-1754-42af-a392-2ced87cc7c4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:48:40.224538 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:48:40.224538 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:48:40.224538 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:48:40.224538 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:48:40.224538 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:48:40.224538 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:48:40.224538 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:48:40.224538 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:48:40.224538 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:48:40.224538 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:48:40.224538 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:48:40.224538 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:48:40.224538 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:48:40.224538 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:48:40.224538 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:48:40.225939 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:48:40.225939 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:48:40.225939 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:48:40.225939 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:48:40.225939 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:48:40.225939 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:48:40.225939 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:48:40.225939 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:48:40.225939 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:48:40.225939 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:48:40.225939 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:48:40.225939 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:48:40.225939 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:48:40.225939 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:48:40.225939 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:48:40.225939 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:48:40.225939 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:48:40.227023 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:48:40.227023 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:48:40.227023 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:48:40.227023 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 612/1228] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:48:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:48:40.232337 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb6aed-d4fd-4f7b-90e0-0b1283f20e81 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:40.337118 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb6aed-d4fd-4f7b-90e0-0b1283f20e81 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:40.339765 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:40.374761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72411a95-bf23-4942-ad01-49566e7c6b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:40.375506 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72411a95-bf23-4942-ad01-49566e7c6b67 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:40.375870 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72411a95-bf23-4942-ad01-49566e7c6b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:40.376114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72411a95-bf23-4942-ad01-49566e7c6b67 None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:40.376762 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72411a95-bf23-4942-ad01-49566e7c6b67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:48:40.377063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72411a95-bf23-4942-ad01-49566e7c6b67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:40.378468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72411a95-bf23-4942-ad01-49566e7c6b67 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:40.392192 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 617/1229] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:48:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:48:40.397910 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5759a-1754-42af-a392-2ced87cc7c4c None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:40.407991 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:40.511669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5759a-1754-42af-a392-2ced87cc7c4c None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:40.547524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258762c6-c49e-4c99-905d-77b1942f75ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:40.548146 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258762c6-c49e-4c99-905d-77b1942f75ac None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:40.548421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258762c6-c49e-4c99-905d-77b1942f75ac None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:40.548692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258762c6-c49e-4c99-905d-77b1942f75ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:40.555441 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258762c6-c49e-4c99-905d-77b1942f75ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:40.556874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258762c6-c49e-4c99-905d-77b1942f75ac None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:40.567833 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-258762c6-c49e-4c99-905d-77b1942f75ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:48:40.567833 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:48:40.567833 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:48:40.567833 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:48:40.567833 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:48:40.567833 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:48:40.567833 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:48:40.567833 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:48:40.567833 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:48:40.567833 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:48:40.567833 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:48:40.567833 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:48:40.567833 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 04 00:48:40.567833 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 04 00:48:40.567833 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 04 00:48:40.568877 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 04 00:48:40.568877 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:48:40.568877 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:48:40.568877 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:48:40.568877 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:48:40.568877 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:48:40.568877 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:48:40.568877 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:48:40.568877 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:48:40.568877 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:48:40.568877 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:48:40.568877 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:48:40.568877 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:48:40.568877 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:48:40.568877 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:48:40.568877 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:48:40.568877 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:48:40.569879 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 04 00:48:40.569879 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 04 00:48:40.569879 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 00:48:40.569879 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 00:48:40.569879 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 00:48:40.569879 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 00:48:40.569879 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:48:40.569879 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:48:40.569879 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 613/1230] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:48:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:48:40.574784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72411a95-bf23-4942-ad01-49566e7c6b67 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:40.683036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72411a95-bf23-4942-ad01-49566e7c6b67 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:40.721082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7417d14-2dc7-48a2-ada0-c66f8a94cf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:40.721649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7417d14-2dc7-48a2-ada0-c66f8a94cf98 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:40.721919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7417d14-2dc7-48a2-ada0-c66f8a94cf98 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:40.722187 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7417d14-2dc7-48a2-ada0-c66f8a94cf98 None admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:40.722872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7417d14-2dc7-48a2-ada0-c66f8a94cf98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:48:40.723226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7417d14-2dc7-48a2-ada0-c66f8a94cf98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:40.724587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7417d14-2dc7-48a2-ada0-c66f8a94cf98 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:40.743744 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 618/1231] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Sep 4 00:48:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:48:40.748732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258762c6-c49e-4c99-905d-77b1942f75ac None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:40.833967 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:40.874109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258762c6-c49e-4c99-905d-77b1942f75ac None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:40.915364 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e4c03-e8bd-47cc-aa8b-b4ba9efd8056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:40.916593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e4c03-e8bd-47cc-aa8b-b4ba9efd8056 None admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:40.917067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e4c03-e8bd-47cc-aa8b-b4ba9efd8056 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:40.917385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e4c03-e8bd-47cc-aa8b-b4ba9efd8056 None admin] PATH_INFO: `/v3/projects/40b24e92f8594ee08bd2a55f79e3b299/users/f908fda75ef8440cb6a0ef9440127d6d/roles/955481bca39c4b0fab953d506ea3c292` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:40.937064 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e4c03-e8bd-47cc-aa8b-b4ba9efd8056 None admin] RBAC: Authorizing `identity:create_grant(project_id=40b24e92f8594ee08bd2a55f79e3b299, user_id=f908fda75ef8440cb6a0ef9440127d6d, role_id=955481bca39c4b0fab953d506ea3c292)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:40.939279 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e4c03-e8bd-47cc-aa8b-b4ba9efd8056 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:40.952512 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 614/1232] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Sep 4 00:48:40 2022] PUT /identity/v3/projects/40b24e92f8594ee08bd2a55f79e3b299/users/f908fda75ef8440cb6a0ef9440127d6d/roles/955481bca39c4b0fab953d506ea3c292 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:48:42.880335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45e1dc-bfec-4e58-8df0-84b2f3c20541 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:42.880857 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45e1dc-bfec-4e58-8df0-84b2f3c20541 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:42.880857 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45e1dc-bfec-4e58-8df0-84b2f3c20541 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:42.886285 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 619/1233] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:48:42.888072 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86244d2-f457-4a9c-bb06-7eeb123489f5 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:42.888768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86244d2-f457-4a9c-bb06-7eeb123489f5 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:42.888768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86244d2-f457-4a9c-bb06-7eeb123489f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:42.909000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-d86244d2-f457-4a9c-bb06-7eeb123489f5 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:48:42.910272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d86244d2-f457-4a9c-bb06-7eeb123489f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:48:42.992589 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 615/1234] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:48:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:48:43.261826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45e1dc-bfec-4e58-8df0-84b2f3c20541 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:43.289276 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:43.371813 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45e1dc-bfec-4e58-8df0-84b2f3c20541 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:43.409402 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5edac4-fb3c-422e-a19d-c1c5180275ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:43.410057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5edac4-fb3c-422e-a19d-c1c5180275ba None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:43.410340 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5edac4-fb3c-422e-a19d-c1c5180275ba None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:43.410618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5edac4-fb3c-422e-a19d-c1c5180275ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:43.421381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5edac4-fb3c-422e-a19d-c1c5180275ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:48:43.426809 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-ec5edac4-fb3c-422e-a19d-c1c5180275ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:48:43.426809 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:48:43.426809 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:48:43.426809 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:48:43.426809 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:48:43.426809 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:48:43.426809 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:48:43.426809 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:48:43.426809 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:48:43.426809 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:48:43.426809 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:48:43.426809 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:48:43.426809 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:48:43.426809 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:48:43.426809 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:48:43.426809 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:48:43.427965 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:48:43.427965 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:48:43.427965 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:48:43.427965 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:48:43.427965 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:48:43.427965 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:48:43.427965 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:48:43.427965 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:48:43.427965 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:48:43.427965 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:48:43.427965 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:48:43.427965 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:48:43.427965 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:48:43.427965 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:48:43.427965 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:48:43.427965 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:48:43.428796 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:48:43.428796 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:48:43.428796 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:48:43.428796 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:48:43.428796 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:48:43.428796 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:48:43.428796 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:48:43.428796 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:48:43.428796 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:48:43.428796 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:48:43.428796 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 04 00:48:43.428796 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:48:43.428796 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 620/1235] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Sep 4 00:48:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:48:43.433930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86244d2-f457-4a9c-bb06-7eeb123489f5 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:43.484595 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:43.539413 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86244d2-f457-4a9c-bb06-7eeb123489f5 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:43.576713 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fcb56c-c09f-48ae-a2ae-056d8091e546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:43.577319 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcb56c-c09f-48ae-a2ae-056d8091e546 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:43.577647 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcb56c-c09f-48ae-a2ae-056d8091e546 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:43.577917 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcb56c-c09f-48ae-a2ae-056d8091e546 None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:43.579095 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fcb56c-c09f-48ae-a2ae-056d8091e546 None admin] RBAC: Adding query filter params (name=service) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:48:43.579401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fcb56c-c09f-48ae-a2ae-056d8091e546 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:43.580780 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fcb56c-c09f-48ae-a2ae-056d8091e546 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:43.589090 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 616/1236] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Sep 4 00:48:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:48:43.595287 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5edac4-fb3c-422e-a19d-c1c5180275ba None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:43.687160 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:43.706553 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5edac4-fb3c-422e-a19d-c1c5180275ba None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:43.750191 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f53ce-447e-449a-b62c-da9d38bb81e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:43.751458 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f53ce-447e-449a-b62c-da9d38bb81e8 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:43.751743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f53ce-447e-449a-b62c-da9d38bb81e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:43.752202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f53ce-447e-449a-b62c-da9d38bb81e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:43.765794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f53ce-447e-449a-b62c-da9d38bb81e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:43.768263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f53ce-447e-449a-b62c-da9d38bb81e8 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:43.789818 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-185f53ce-447e-449a-b62c-da9d38bb81e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:48:43.789818 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:48:43.789818 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:48:43.789818 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:48:43.789818 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:48:43.789818 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:48:43.789818 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:48:43.789818 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:48:43.789818 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:48:43.789818 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:48:43.789818 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:48:43.789818 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:48:43.789818 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:48:43.789818 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:48:43.789818 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:48:43.789818 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:48:43.790856 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:48:43.790856 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:48:43.790856 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:48:43.790856 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:48:43.790856 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:48:43.790856 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:48:43.790856 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:48:43.790856 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:48:43.790856 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:48:43.790856 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:48:43.790856 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:48:43.790856 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:48:43.790856 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:48:43.790856 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:48:43.790856 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:48:43.790856 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:48:43.790856 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:48:43.791880 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:48:43.791880 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:48:43.791880 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:48:43.791880 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 621/1237] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:48:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:48:43.797864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fcb56c-c09f-48ae-a2ae-056d8091e546 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:43.915629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fcb56c-c09f-48ae-a2ae-056d8091e546 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:43.927351 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:43.957339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ba911-5f11-45bf-8108-6cc8067531fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:43.958076 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ba911-5f11-45bf-8108-6cc8067531fa None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:43.958388 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ba911-5f11-45bf-8108-6cc8067531fa None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:43.958633 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ba911-5f11-45bf-8108-6cc8067531fa None admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:43.959310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ba911-5f11-45bf-8108-6cc8067531fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:48:43.959655 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ba911-5f11-45bf-8108-6cc8067531fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:43.961022 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ba911-5f11-45bf-8108-6cc8067531fa None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:43.973363 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 617/1238] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:48:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:48:43.979259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f53ce-447e-449a-b62c-da9d38bb81e8 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:44.088192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f53ce-447e-449a-b62c-da9d38bb81e8 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:44.123507 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87488e-185b-4d19-a06d-1fff166eca39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:44.124130 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87488e-185b-4d19-a06d-1fff166eca39 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:44.124411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87488e-185b-4d19-a06d-1fff166eca39 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:44.124679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87488e-185b-4d19-a06d-1fff166eca39 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:44.127954 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:44.133608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb87488e-185b-4d19-a06d-1fff166eca39 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:44.135342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb87488e-185b-4d19-a06d-1fff166eca39 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:44.147321 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-eb87488e-185b-4d19-a06d-1fff166eca39 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 04 00:48:44.147321 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:48:44.147321 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:48:44.147321 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:48:44.147321 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:48:44.147321 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:48:44.147321 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:48:44.147321 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:48:44.147321 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:48:44.147321 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:48:44.147321 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:48:44.147321 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:48:44.147321 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 04 00:48:44.147321 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 04 00:48:44.147321 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 04 00:48:44.147321 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 04 00:48:44.148338 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:48:44.148338 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:48:44.148338 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 00:48:44.148338 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:48:44.148338 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 00:48:44.148338 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:48:44.148338 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:48:44.148338 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:48:44.148338 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:48:44.148338 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:48:44.148338 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:48:44.148338 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:48:44.148338 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:48:44.148338 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:48:44.148338 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:48:44.148338 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:48:44.148338 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:48:44.148338 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:48:44.149310 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:48:44.149310 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:48:44.149310 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 00:48:44.149310 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 00:48:44.149310 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 00:48:44.149310 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 00:48:44.149310 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 00:48:44.149310 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 00:48:44.149310 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 04 00:48:44.149310 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:48:44.149310 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 622/1239] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:48:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 04 00:48:44.154474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ba911-5f11-45bf-8108-6cc8067531fa None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:44.257758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ba911-5f11-45bf-8108-6cc8067531fa None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:44.295073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6676027b-b0e5-4ff8-bab8-f4ca0ad1fbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:44.295751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676027b-b0e5-4ff8-bab8-f4ca0ad1fbbb None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:44.296100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676027b-b0e5-4ff8-bab8-f4ca0ad1fbbb None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:44.296413 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676027b-b0e5-4ff8-bab8-f4ca0ad1fbbb None admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:44.297725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6676027b-b0e5-4ff8-bab8-f4ca0ad1fbbb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:48:44.298067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6676027b-b0e5-4ff8-bab8-f4ca0ad1fbbb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:44.299710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6676027b-b0e5-4ff8-bab8-f4ca0ad1fbbb None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:44.318060 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 618/1240] 10.222.0.30 () {56 vars in 1143 bytes} [Sun Sep 4 00:48:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:48:44.324195 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87488e-185b-4d19-a06d-1fff166eca39 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:44.429230 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87488e-185b-4d19-a06d-1fff166eca39 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:44.469837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff506f-a930-491f-8ab5-60be4007a3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:44.470628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff506f-a930-491f-8ab5-60be4007a3a4 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:44.470954 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff506f-a930-491f-8ab5-60be4007a3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:44.471288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff506f-a930-491f-8ab5-60be4007a3a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:44.540375 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:44.548988 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff506f-a930-491f-8ab5-60be4007a3a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:44.550474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff506f-a930-491f-8ab5-60be4007a3a4 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:44.654625 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 623/1241] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:48:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 04 00:48:44.661013 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6676027b-b0e5-4ff8-bab8-f4ca0ad1fbbb None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:44.690093 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:44.775819 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6676027b-b0e5-4ff8-bab8-f4ca0ad1fbbb None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:44.815272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6cd8dc-afaf-4001-b183-5177d39e7a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:44.816111 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cd8dc-afaf-4001-b183-5177d39e7a66 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:44.816423 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cd8dc-afaf-4001-b183-5177d39e7a66 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:44.816698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cd8dc-afaf-4001-b183-5177d39e7a66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:44.829374 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6cd8dc-afaf-4001-b183-5177d39e7a66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:44.830857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6cd8dc-afaf-4001-b183-5177d39e7a66 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:44.851085 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-aa6cd8dc-afaf-4001-b183-5177d39e7a66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:48:44.851085 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:48:44.851085 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:48:44.851085 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:48:44.851085 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:48:44.851085 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:48:44.851085 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:48:44.851085 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:48:44.851085 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:48:44.851085 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:48:44.851085 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:48:44.851085 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:48:44.851085 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:48:44.851085 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:48:44.851085 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:48:44.851085 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:48:44.852160 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:48:44.852160 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:48:44.852160 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:48:44.852160 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:48:44.852160 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:48:44.852160 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:48:44.852160 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:48:44.852160 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:48:44.852160 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:48:44.852160 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:48:44.852160 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:48:44.852160 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:48:44.852160 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:48:44.852160 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:48:44.852160 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:48:44.852160 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:48:44.852160 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:48:44.853085 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:48:44.853085 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:48:44.853085 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:48:44.853085 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 619/1242] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:48:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:48:44.858282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff506f-a930-491f-8ab5-60be4007a3a4 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:44.960916 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:44.968441 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff506f-a930-491f-8ab5-60be4007a3a4 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:45.005035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919eea40-7161-46f0-99a8-91bfa20d969c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:45.007622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919eea40-7161-46f0-99a8-91bfa20d969c None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:45.007969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919eea40-7161-46f0-99a8-91bfa20d969c None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:45.008481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919eea40-7161-46f0-99a8-91bfa20d969c None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:45.009865 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919eea40-7161-46f0-99a8-91bfa20d969c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:48:45.010427 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919eea40-7161-46f0-99a8-91bfa20d969c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:45.012902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919eea40-7161-46f0-99a8-91bfa20d969c None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:45.029424 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 624/1243] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:48:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:48:45.037117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6cd8dc-afaf-4001-b183-5177d39e7a66 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:45.121964 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:45.146038 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6cd8dc-afaf-4001-b183-5177d39e7a66 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:45.182671 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553e750-5809-4f7a-887c-7948a2d6f1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:45.183339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553e750-5809-4f7a-887c-7948a2d6f1ef None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:45.183618 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553e750-5809-4f7a-887c-7948a2d6f1ef None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:45.183886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553e750-5809-4f7a-887c-7948a2d6f1ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:45.191250 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8553e750-5809-4f7a-887c-7948a2d6f1ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:45.192690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8553e750-5809-4f7a-887c-7948a2d6f1ef None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:45.204723 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-8553e750-5809-4f7a-887c-7948a2d6f1ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:48:45.204723 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:48:45.204723 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:48:45.204723 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:48:45.204723 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:48:45.204723 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:48:45.204723 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:48:45.204723 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:48:45.204723 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:48:45.204723 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:48:45.204723 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:48:45.204723 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:48:45.204723 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 04 00:48:45.204723 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 04 00:48:45.204723 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 04 00:48:45.205806 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 04 00:48:45.205806 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:48:45.205806 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:48:45.205806 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:48:45.205806 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:48:45.205806 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:48:45.205806 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:48:45.205806 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:48:45.205806 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:48:45.205806 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:48:45.205806 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:48:45.205806 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:48:45.205806 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:48:45.205806 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:48:45.205806 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:48:45.205806 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:48:45.205806 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:48:45.211461 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 04 00:48:45.211461 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 04 00:48:45.211461 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 00:48:45.211461 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 00:48:45.211461 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 00:48:45.211461 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 00:48:45.211461 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:48:45.211461 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:48:45.211461 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 620/1244] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:48:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:48:45.211986 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919eea40-7161-46f0-99a8-91bfa20d969c None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:45.323733 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919eea40-7161-46f0-99a8-91bfa20d969c None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:45.360472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e246ad-ac04-46f7-9aa7-26ebe0c3066b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:45.361125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e246ad-ac04-46f7-9aa7-26ebe0c3066b None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:45.361427 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e246ad-ac04-46f7-9aa7-26ebe0c3066b None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:45.361710 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e246ad-ac04-46f7-9aa7-26ebe0c3066b None admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:45.362491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e246ad-ac04-46f7-9aa7-26ebe0c3066b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:48:45.362844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e246ad-ac04-46f7-9aa7-26ebe0c3066b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:45.364394 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e246ad-ac04-46f7-9aa7-26ebe0c3066b None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:45.378273 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 625/1245] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Sep 4 00:48:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:48:45.384294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553e750-5809-4f7a-887c-7948a2d6f1ef None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:45.501383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553e750-5809-4f7a-887c-7948a2d6f1ef None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:45.535759 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18166e11-41ab-44f3-965a-8dd6987f73df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:45.536346 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18166e11-41ab-44f3-965a-8dd6987f73df None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:45.536626 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18166e11-41ab-44f3-965a-8dd6987f73df None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:45.536893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18166e11-41ab-44f3-965a-8dd6987f73df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:45.537633 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18166e11-41ab-44f3-965a-8dd6987f73df None admin] RBAC: Adding query filter params (role.id=955481bca39c4b0fab953d506ea3c292, scope.project.id=40b24e92f8594ee08bd2a55f79e3b299, user.id=f908fda75ef8440cb6a0ef9440127d6d) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:48:45.537937 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18166e11-41ab-44f3-965a-8dd6987f73df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:45.539356 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18166e11-41ab-44f3-965a-8dd6987f73df None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:45.545002 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 621/1246] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:48:45 2022] GET /identity/v3/role_assignments?user.id=f908fda75ef8440cb6a0ef9440127d6d&scope.project.id=40b24e92f8594ee08bd2a55f79e3b299&role.id=955481bca39c4b0fab953d506ea3c292 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:48:47.602899 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a3fbd-9e0e-4399-84af-25117470c5a2 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:47.603505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a3fbd-9e0e-4399-84af-25117470c5a2 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:47.603505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a3fbd-9e0e-4399-84af-25117470c5a2 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:47.604777 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 626/1247] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:48:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:48:47.611909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4fd443-889d-4c1a-ae73-126a14e5d772 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:47.612391 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4fd443-889d-4c1a-ae73-126a14e5d772 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:47.612391 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4fd443-889d-4c1a-ae73-126a14e5d772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:47.618644 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:47.630693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ef4fd443-889d-4c1a-ae73-126a14e5d772 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:48:47.631854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ef4fd443-889d-4c1a-ae73-126a14e5d772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:48:47.699959 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 622/1248] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:48:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:48:47.970557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a3fbd-9e0e-4399-84af-25117470c5a2 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:47.992229 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:48.095883 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a3fbd-9e0e-4399-84af-25117470c5a2 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:48.135919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f8998-e0e3-4a72-aaca-634d118dde37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:48.136651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f8998-e0e3-4a72-aaca-634d118dde37 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:48.136933 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f8998-e0e3-4a72-aaca-634d118dde37 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:48.137388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f8998-e0e3-4a72-aaca-634d118dde37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:48.150155 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f8998-e0e3-4a72-aaca-634d118dde37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:48:48.156389 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-615f8998-e0e3-4a72-aaca-634d118dde37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:48:48.156389 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:48:48.156389 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:48:48.156389 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:48:48.156389 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:48:48.156389 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:48:48.156389 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:48:48.156389 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:48:48.156389 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:48:48.156389 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:48:48.156389 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:48:48.156389 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:48:48.156389 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:48:48.156389 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:48:48.156389 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:48:48.156389 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:48:48.158282 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:48:48.158282 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:48:48.158282 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:48:48.158282 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:48:48.158282 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:48:48.158282 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:48:48.158282 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:48:48.158282 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:48:48.158282 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:48:48.158282 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:48:48.158282 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:48:48.158282 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:48:48.158282 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:48:48.158282 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:48:48.158282 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:48:48.158282 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:48:48.159410 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:48:48.159410 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:48:48.159410 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:48:48.159410 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:48:48.159410 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:48:48.159410 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:48:48.159410 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:48:48.159410 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:48:48.159410 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:48:48.159410 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:48:48.159410 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:48:48.159410 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:48:48.159410 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 627/1249] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Sep 4 00:48:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:48:48.163763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4fd443-889d-4c1a-ae73-126a14e5d772 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:48.280555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4fd443-889d-4c1a-ae73-126a14e5d772 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:48.311024 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:48.317069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac6128-eb9a-42a9-9026-96e917be02fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:48.317717 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac6128-eb9a-42a9-9026-96e917be02fd None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:48.317987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac6128-eb9a-42a9-9026-96e917be02fd None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:48.318280 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac6128-eb9a-42a9-9026-96e917be02fd None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:48.318980 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac6128-eb9a-42a9-9026-96e917be02fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:48:48.319210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac6128-eb9a-42a9-9026-96e917be02fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:48.320575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac6128-eb9a-42a9-9026-96e917be02fd None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:48.329957 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 623/1250] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:48:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:48:48.335635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f8998-e0e3-4a72-aaca-634d118dde37 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:48.420197 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:48.449127 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f8998-e0e3-4a72-aaca-634d118dde37 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:48.485512 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3597e-8c74-46dd-84ef-fba625699612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:48.486143 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3597e-8c74-46dd-84ef-fba625699612 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:48.486422 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3597e-8c74-46dd-84ef-fba625699612 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:48.486696 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3597e-8c74-46dd-84ef-fba625699612 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:48.500631 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3597e-8c74-46dd-84ef-fba625699612 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:48.502384 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3597e-8c74-46dd-84ef-fba625699612 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:48.519773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-b1f3597e-8c74-46dd-84ef-fba625699612 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:48:48.519773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:48:48.519773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:48:48.519773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:48:48.519773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:48:48.519773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:48:48.519773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:48:48.519773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:48:48.519773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:48:48.519773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:48:48.519773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:48:48.519773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:48:48.519773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:48:48.519773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:48:48.519773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:48:48.519773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:48:48.520981 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:48:48.520981 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:48:48.520981 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:48:48.520981 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:48:48.520981 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:48:48.520981 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:48:48.520981 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:48:48.520981 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:48:48.520981 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:48:48.520981 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:48:48.520981 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:48:48.520981 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:48:48.520981 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:48:48.520981 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:48:48.520981 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:48:48.520981 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:48:48.520981 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:48:48.521916 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:48:48.521916 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:48:48.521916 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:48:48.521916 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 628/1251] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:48:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:48:48.528316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac6128-eb9a-42a9-9026-96e917be02fd None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:48.641252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac6128-eb9a-42a9-9026-96e917be02fd None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:48.679735 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a9d3f-a8ca-4ab9-823d-7ce48e1bd820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:48.680470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a9d3f-a8ca-4ab9-823d-7ce48e1bd820 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:48.680817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a9d3f-a8ca-4ab9-823d-7ce48e1bd820 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:48.681157 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a9d3f-a8ca-4ab9-823d-7ce48e1bd820 None admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:48.681910 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a9d3f-a8ca-4ab9-823d-7ce48e1bd820 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:48:48.682195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a9d3f-a8ca-4ab9-823d-7ce48e1bd820 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:48.683801 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a9d3f-a8ca-4ab9-823d-7ce48e1bd820 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:48.696663 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 624/1252] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:48:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:48:48.703008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3597e-8c74-46dd-84ef-fba625699612 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:48.816710 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3597e-8c74-46dd-84ef-fba625699612 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:48.846235 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:48.854622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7f71e-a5de-4221-92b7-a74e38030fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:48.856613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7f71e-a5de-4221-92b7-a74e38030fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:48.856892 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7f71e-a5de-4221-92b7-a74e38030fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:48.857165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7f71e-a5de-4221-92b7-a74e38030fe3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:48.866871 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7f71e-a5de-4221-92b7-a74e38030fe3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:48.868449 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7f71e-a5de-4221-92b7-a74e38030fe3 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:48.881159 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-e4d7f71e-a5de-4221-92b7-a74e38030fe3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 04 00:48:48.881159 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:48:48.881159 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:48:48.881159 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:48:48.881159 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:48:48.881159 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:48:48.881159 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:48:48.881159 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:48:48.881159 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:48:48.881159 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:48:48.881159 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:48:48.881159 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:48:48.881159 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 04 00:48:48.881159 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 04 00:48:48.881159 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 04 00:48:48.881159 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 04 00:48:48.882309 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:48:48.882309 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:48:48.882309 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 00:48:48.882309 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:48:48.882309 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 00:48:48.882309 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:48:48.882309 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:48:48.882309 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:48:48.882309 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:48:48.882309 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:48:48.882309 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:48:48.882309 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:48:48.882309 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:48:48.882309 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:48:48.882309 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:48:48.882309 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:48:48.882309 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:48:48.882309 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:48:48.883313 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:48:48.883313 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:48:48.883313 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 00:48:48.883313 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 00:48:48.883313 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 00:48:48.883313 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 00:48:48.883313 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 00:48:48.883313 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 00:48:48.883313 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 04 00:48:48.883313 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:48:48.883313 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 629/1253] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:48:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:48:48.888279 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a9d3f-a8ca-4ab9-823d-7ce48e1bd820 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:48.953034 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:49.013868 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a9d3f-a8ca-4ab9-823d-7ce48e1bd820 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:49.052427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a4d9b-2763-4345-b8a9-97b456b3ad44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:49.053000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a4d9b-2763-4345-b8a9-97b456b3ad44 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:49.053315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a4d9b-2763-4345-b8a9-97b456b3ad44 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:49.053654 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a4d9b-2763-4345-b8a9-97b456b3ad44 None admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:49.054504 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a4d9b-2763-4345-b8a9-97b456b3ad44 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:48:49.054835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a4d9b-2763-4345-b8a9-97b456b3ad44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:49.056421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a4d9b-2763-4345-b8a9-97b456b3ad44 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:49.076517 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 625/1254] 10.222.0.30 () {56 vars in 1143 bytes} [Sun Sep 4 00:48:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:48:49.082702 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7f71e-a5de-4221-92b7-a74e38030fe3 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:49.211301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7f71e-a5de-4221-92b7-a74e38030fe3 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:49.248496 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889242c6-8f6e-47c0-8ca6-0fa01e4a04e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:49.249145 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889242c6-8f6e-47c0-8ca6-0fa01e4a04e6 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:49.249497 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889242c6-8f6e-47c0-8ca6-0fa01e4a04e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:49.249807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889242c6-8f6e-47c0-8ca6-0fa01e4a04e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:49.311328 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:49.327540 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889242c6-8f6e-47c0-8ca6-0fa01e4a04e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:49.329075 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889242c6-8f6e-47c0-8ca6-0fa01e4a04e6 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:49.446349 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 630/1255] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:48:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 04 00:48:49.452185 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a4d9b-2763-4345-b8a9-97b456b3ad44 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:49.572506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a4d9b-2763-4345-b8a9-97b456b3ad44 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:49.587523 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:49.611826 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b7898-1079-49b3-bb18-633db765081c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:49.612486 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b7898-1079-49b3-bb18-633db765081c None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:49.612743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b7898-1079-49b3-bb18-633db765081c None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:49.613017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b7898-1079-49b3-bb18-633db765081c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:49.623359 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b7898-1079-49b3-bb18-633db765081c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:49.624830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b7898-1079-49b3-bb18-633db765081c None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:49.639568 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-b50b7898-1079-49b3-bb18-633db765081c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:48:49.639568 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:48:49.639568 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:48:49.639568 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:48:49.639568 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:48:49.639568 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:48:49.639568 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:48:49.639568 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:48:49.639568 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:48:49.639568 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:48:49.639568 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:48:49.639568 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:48:49.639568 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:48:49.639568 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:48:49.639568 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:48:49.639568 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:48:49.641280 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:48:49.641280 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:48:49.641280 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:48:49.641280 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:48:49.641280 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:48:49.641280 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:48:49.641280 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:48:49.641280 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:48:49.641280 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:48:49.641280 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:48:49.641280 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:48:49.641280 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:48:49.641280 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:48:49.641280 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:48:49.641280 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:48:49.641280 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:48:49.641280 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:48:49.643230 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:48:49.643230 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:48:49.643230 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:48:49.643230 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 626/1256] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:48:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:48:49.647076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889242c6-8f6e-47c0-8ca6-0fa01e4a04e6 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:49.748332 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:49.761967 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889242c6-8f6e-47c0-8ca6-0fa01e4a04e6 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:49.800766 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f3264-7ec8-4fdb-b853-eccf5fb8709d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:49.801492 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f3264-7ec8-4fdb-b853-eccf5fb8709d None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:49.801865 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f3264-7ec8-4fdb-b853-eccf5fb8709d None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:49.802351 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f3264-7ec8-4fdb-b853-eccf5fb8709d None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:49.802850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f3264-7ec8-4fdb-b853-eccf5fb8709d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:48:49.803259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f3264-7ec8-4fdb-b853-eccf5fb8709d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:49.804530 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f3264-7ec8-4fdb-b853-eccf5fb8709d None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:49.818693 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 631/1257] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:48:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:48:49.824686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b7898-1079-49b3-bb18-633db765081c None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:49.933716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b7898-1079-49b3-bb18-633db765081c None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:49.974115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1f4ed-46ae-4600-981d-da0515b48acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:49.974731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1f4ed-46ae-4600-981d-da0515b48acc None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:49.975007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1f4ed-46ae-4600-981d-da0515b48acc None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:49.975273 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1f4ed-46ae-4600-981d-da0515b48acc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:49.981843 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1f4ed-46ae-4600-981d-da0515b48acc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:49.983274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1f4ed-46ae-4600-981d-da0515b48acc None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:49.995129 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-43d1f4ed-46ae-4600-981d-da0515b48acc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:48:49.995129 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:48:49.995129 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:48:49.995129 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:48:49.995129 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:48:49.995129 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:48:49.995129 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:48:49.995129 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:48:49.995129 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:48:49.995129 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:48:49.995129 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:48:49.995129 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:48:49.995129 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 04 00:48:49.995129 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 04 00:48:49.995129 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 04 00:48:49.996182 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 04 00:48:49.996182 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:48:49.996182 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:48:49.996182 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:48:49.996182 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:48:49.996182 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:48:49.996182 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:48:49.996182 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:48:49.996182 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:48:49.996182 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:48:49.996182 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:48:49.996182 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:48:49.996182 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:48:49.996182 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:48:49.996182 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:48:49.996182 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:48:49.996182 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:48:49.997148 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 04 00:48:49.997148 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 04 00:48:49.997148 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 00:48:49.997148 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 00:48:49.997148 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 00:48:49.997148 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 00:48:49.997148 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:48:49.997148 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:48:49.997148 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 627/1258] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:48:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:48:50.003259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f3264-7ec8-4fdb-b853-eccf5fb8709d None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:50.115366 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f3264-7ec8-4fdb-b853-eccf5fb8709d None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:50.157769 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49944615-bfea-4db3-8616-1de942e855dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:50.158377 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49944615-bfea-4db3-8616-1de942e855dc None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:50.158657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49944615-bfea-4db3-8616-1de942e855dc None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:50.158932 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49944615-bfea-4db3-8616-1de942e855dc None admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:50.159620 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49944615-bfea-4db3-8616-1de942e855dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:48:50.159927 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49944615-bfea-4db3-8616-1de942e855dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:50.161355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49944615-bfea-4db3-8616-1de942e855dc None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:50.173821 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 632/1259] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Sep 4 00:48:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:48:50.179864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1f4ed-46ae-4600-981d-da0515b48acc None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:50.207209 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:50.288594 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1f4ed-46ae-4600-981d-da0515b48acc None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:50.328892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c578f9a-4910-430f-ac15-d55a5ac3a928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:50.329604 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c578f9a-4910-430f-ac15-d55a5ac3a928 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:50.329905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c578f9a-4910-430f-ac15-d55a5ac3a928 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:50.330230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c578f9a-4910-430f-ac15-d55a5ac3a928 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:50.331160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c578f9a-4910-430f-ac15-d55a5ac3a928 None admin] RBAC: Adding query filter params (role.id=d255b03c37d64371a148ec4e11be01d9, scope.project.id=40b24e92f8594ee08bd2a55f79e3b299, user.id=f908fda75ef8440cb6a0ef9440127d6d) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:48:50.331585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c578f9a-4910-430f-ac15-d55a5ac3a928 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:50.333166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c578f9a-4910-430f-ac15-d55a5ac3a928 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:50.338634 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 628/1260] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:48:50 2022] GET /identity/v3/role_assignments?user.id=f908fda75ef8440cb6a0ef9440127d6d&scope.project.id=40b24e92f8594ee08bd2a55f79e3b299&role.id=d255b03c37d64371a148ec4e11be01d9 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:48:52.230190 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d672a-2828-48a2-9388-297a9ac3df73 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:52.230748 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d672a-2828-48a2-9388-297a9ac3df73 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:52.230748 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d672a-2828-48a2-9388-297a9ac3df73 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:52.232078 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 633/1261] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:48:52.237913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835b97e-30d4-4814-a8f3-94918bc0569f None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:52.238326 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835b97e-30d4-4814-a8f3-94918bc0569f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:52.238442 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835b97e-30d4-4814-a8f3-94918bc0569f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:52.256129 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-7835b97e-30d4-4814-a8f3-94918bc0569f None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:48:52.257284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7835b97e-30d4-4814-a8f3-94918bc0569f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:48:52.319745 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 629/1262] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:48:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:48:52.589794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d672a-2828-48a2-9388-297a9ac3df73 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:52.601075 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:52.689418 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d672a-2828-48a2-9388-297a9ac3df73 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:52.722505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf29f6-cea3-403a-8229-edf75f42b55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:52.723117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf29f6-cea3-403a-8229-edf75f42b55b None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:52.723400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf29f6-cea3-403a-8229-edf75f42b55b None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:52.723676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf29f6-cea3-403a-8229-edf75f42b55b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:52.733515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf29f6-cea3-403a-8229-edf75f42b55b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:48:52.738709 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-6ebf29f6-cea3-403a-8229-edf75f42b55b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:48:52.738709 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:48:52.738709 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:48:52.738709 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:48:52.738709 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:48:52.738709 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:48:52.738709 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:48:52.738709 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:48:52.738709 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:48:52.738709 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:48:52.738709 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:48:52.738709 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:48:52.738709 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:48:52.738709 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:48:52.738709 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:48:52.738709 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:48:52.739777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:48:52.739777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:48:52.739777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:48:52.739777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:48:52.739777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:48:52.739777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:48:52.739777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:48:52.739777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:48:52.739777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:48:52.739777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:48:52.739777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:48:52.739777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:48:52.739777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:48:52.739777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:48:52.739777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:48:52.739777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:48:52.740944 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:48:52.740944 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:48:52.740944 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:48:52.740944 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:48:52.740944 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:48:52.740944 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:48:52.740944 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:48:52.740944 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:48:52.740944 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:48:52.740944 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:48:52.740944 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:48:52.740944 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:48:52.740944 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 634/1263] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Sep 4 00:48:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:48:52.746841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835b97e-30d4-4814-a8f3-94918bc0569f None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:52.766095 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:52.847108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835b97e-30d4-4814-a8f3-94918bc0569f None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:52.879612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae546530-3046-451a-9890-fb4224528a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:52.880201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae546530-3046-451a-9890-fb4224528a6a None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:52.880474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae546530-3046-451a-9890-fb4224528a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:52.880740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae546530-3046-451a-9890-fb4224528a6a None admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:52.881383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae546530-3046-451a-9890-fb4224528a6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:48:52.881707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae546530-3046-451a-9890-fb4224528a6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:52.883067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae546530-3046-451a-9890-fb4224528a6a None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:52.891329 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 630/1264] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:48:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:48:52.897050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf29f6-cea3-403a-8229-edf75f42b55b None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:52.962352 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:52.994582 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf29f6-cea3-403a-8229-edf75f42b55b None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:53.027929 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c807be-ea57-4c8d-8c56-320253eb88bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:53.028544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c807be-ea57-4c8d-8c56-320253eb88bb None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:53.028822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c807be-ea57-4c8d-8c56-320253eb88bb None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:53.029109 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c807be-ea57-4c8d-8c56-320253eb88bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:53.038826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c807be-ea57-4c8d-8c56-320253eb88bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:53.040251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c807be-ea57-4c8d-8c56-320253eb88bb None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:53.054313 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-77c807be-ea57-4c8d-8c56-320253eb88bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:48:53.054313 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:48:53.054313 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:48:53.054313 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:48:53.054313 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:48:53.054313 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:48:53.054313 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:48:53.054313 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:48:53.054313 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:48:53.054313 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:48:53.054313 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:48:53.054313 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:48:53.054313 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:48:53.054313 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:48:53.054313 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:48:53.054313 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:48:53.055399 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:48:53.055399 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:48:53.055399 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:48:53.055399 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:48:53.055399 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:48:53.055399 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:48:53.055399 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:48:53.055399 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:48:53.055399 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:48:53.055399 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:48:53.055399 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:48:53.055399 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:48:53.055399 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:48:53.055399 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:48:53.055399 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:48:53.055399 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:48:53.055399 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:48:53.056683 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:48:53.056683 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:48:53.056683 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:48:53.056683 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 635/1265] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:48:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:48:53.061029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae546530-3046-451a-9890-fb4224528a6a None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:53.138969 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:53.157927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae546530-3046-451a-9890-fb4224528a6a None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:53.190468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f037f5-0a35-4179-8781-e3f8f191c572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:53.191035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f037f5-0a35-4179-8781-e3f8f191c572 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:53.191310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f037f5-0a35-4179-8781-e3f8f191c572 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:53.191578 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f037f5-0a35-4179-8781-e3f8f191c572 None admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:53.192200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f037f5-0a35-4179-8781-e3f8f191c572 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:48:53.192502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f037f5-0a35-4179-8781-e3f8f191c572 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:53.193893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f037f5-0a35-4179-8781-e3f8f191c572 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:53.205021 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 631/1266] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:48:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:48:53.210573 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c807be-ea57-4c8d-8c56-320253eb88bb None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:53.311682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c807be-ea57-4c8d-8c56-320253eb88bb None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:53.330963 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:53.344662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d2ffe-5131-49b8-8468-ec9b1acf5daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:53.345278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d2ffe-5131-49b8-8468-ec9b1acf5daa None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:53.345582 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d2ffe-5131-49b8-8468-ec9b1acf5daa None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:53.345852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d2ffe-5131-49b8-8468-ec9b1acf5daa None admin] PATH_INFO: `/v3/users/placement` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:53.352929 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d2ffe-5131-49b8-8468-ec9b1acf5daa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:53.354375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d2ffe-5131-49b8-8468-ec9b1acf5daa None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:53.365773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-768d2ffe-5131-49b8-8468-ec9b1acf5daa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 04 00:48:53.365773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:48:53.365773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:48:53.365773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:48:53.365773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:48:53.365773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:48:53.365773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:48:53.365773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:48:53.365773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:48:53.365773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:48:53.365773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:48:53.365773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:48:53.365773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 04 00:48:53.365773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 04 00:48:53.365773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 04 00:48:53.365773 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 04 00:48:53.366875 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:48:53.366875 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:48:53.366875 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 00:48:53.366875 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:48:53.366875 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 00:48:53.366875 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:48:53.366875 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:48:53.366875 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:48:53.366875 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:48:53.366875 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:48:53.366875 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:48:53.366875 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:48:53.366875 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:48:53.366875 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:48:53.366875 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:48:53.366875 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:48:53.366875 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:48:53.366875 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:48:53.367858 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:48:53.367858 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:48:53.367858 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 00:48:53.367858 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 00:48:53.367858 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 00:48:53.367858 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 00:48:53.367858 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 00:48:53.367858 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 00:48:53.367858 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 04 00:48:53.367858 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:48:53.367858 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 636/1267] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:48:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:48:53.372801 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f037f5-0a35-4179-8781-e3f8f191c572 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:53.468841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f037f5-0a35-4179-8781-e3f8f191c572 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:53.501721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93042492-663d-4d16-8463-9f6d9aee6a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:53.502311 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93042492-663d-4d16-8463-9f6d9aee6a95 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:53.502585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93042492-663d-4d16-8463-9f6d9aee6a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:53.502848 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93042492-663d-4d16-8463-9f6d9aee6a95 None admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:53.503553 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93042492-663d-4d16-8463-9f6d9aee6a95 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:48:53.503851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93042492-663d-4d16-8463-9f6d9aee6a95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:53.505263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93042492-663d-4d16-8463-9f6d9aee6a95 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:53.513456 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:53.521650 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 632/1268] 10.222.0.30 () {56 vars in 1143 bytes} [Sun Sep 4 00:48:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:48:53.527232 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d2ffe-5131-49b8-8468-ec9b1acf5daa None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:53.623652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d2ffe-5131-49b8-8468-ec9b1acf5daa None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:53.659660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9dfdff-9c93-4cc1-a17c-d09c4f6300e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:53.660285 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9dfdff-9c93-4cc1-a17c-d09c4f6300e4 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:53.660563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9dfdff-9c93-4cc1-a17c-d09c4f6300e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:53.660834 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9dfdff-9c93-4cc1-a17c-d09c4f6300e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:53.670981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9dfdff-9c93-4cc1-a17c-d09c4f6300e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:53.673049 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9dfdff-9c93-4cc1-a17c-d09c4f6300e4 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:53.686580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-ca9dfdff-9c93-4cc1-a17c-d09c4f6300e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:48:53.686580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:48:53.686580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:48:53.686580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:48:53.686580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:48:53.686580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:48:53.686580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:48:53.686580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:48:53.686580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:48:53.686580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:48:53.686580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:48:53.686580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:48:53.686580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:48:53.686580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:48:53.686580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:48:53.686580 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:48:53.687675 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:48:53.687675 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:48:53.687675 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:48:53.687675 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:48:53.687675 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:48:53.687675 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:48:53.687675 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:48:53.687675 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:48:53.687675 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:48:53.687675 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:48:53.687675 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:48:53.687675 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:48:53.687675 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:48:53.687675 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:48:53.687675 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:48:53.687675 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:48:53.687675 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:48:53.688928 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:48:53.688928 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:48:53.688928 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:48:53.688928 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 637/1269] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:48:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:48:53.693708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93042492-663d-4d16-8463-9f6d9aee6a95 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:53.790992 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93042492-663d-4d16-8463-9f6d9aee6a95 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:53.823068 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732c502-bbb6-4c18-ac8c-375027e03366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:53.823658 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732c502-bbb6-4c18-ac8c-375027e03366 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:53.823934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732c502-bbb6-4c18-ac8c-375027e03366 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:53.824204 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732c502-bbb6-4c18-ac8c-375027e03366 None admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:53.824829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732c502-bbb6-4c18-ac8c-375027e03366 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:48:53.825127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732c502-bbb6-4c18-ac8c-375027e03366 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:53.826514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732c502-bbb6-4c18-ac8c-375027e03366 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:53.837025 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 633/1270] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:48:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:48:53.842612 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9dfdff-9c93-4cc1-a17c-d09c4f6300e4 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:53.874311 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:53.940166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9dfdff-9c93-4cc1-a17c-d09c4f6300e4 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:53.974020 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6017d-429b-4fcd-9e31-491dfb463353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:53.974639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6017d-429b-4fcd-9e31-491dfb463353 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:53.974944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6017d-429b-4fcd-9e31-491dfb463353 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:53.975215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6017d-429b-4fcd-9e31-491dfb463353 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:53.981618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6017d-429b-4fcd-9e31-491dfb463353 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:53.983064 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6017d-429b-4fcd-9e31-491dfb463353 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:53.994852 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-64c6017d-429b-4fcd-9e31-491dfb463353 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:48:53.994852 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:48:53.994852 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:48:53.994852 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:48:53.994852 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:48:53.994852 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:48:53.994852 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:48:53.994852 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:48:53.994852 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:48:53.994852 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:48:53.994852 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:48:53.994852 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:48:53.994852 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 04 00:48:53.994852 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 04 00:48:53.994852 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 04 00:48:53.995883 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 04 00:48:53.995883 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:48:53.995883 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:48:53.995883 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:48:53.995883 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:48:53.995883 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:48:53.995883 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:48:53.995883 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:48:53.995883 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:48:53.995883 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:48:53.995883 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:48:53.995883 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:48:53.995883 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:48:53.995883 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:48:53.995883 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:48:53.995883 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:48:53.995883 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:48:53.996811 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 04 00:48:53.996811 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 04 00:48:53.996811 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 00:48:53.996811 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 00:48:53.996811 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 00:48:53.996811 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 00:48:53.996811 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:48:53.996811 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:48:53.996811 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 638/1271] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:48:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:48:54.001800 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732c502-bbb6-4c18-ac8c-375027e03366 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:54.057574 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:54.098424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732c502-bbb6-4c18-ac8c-375027e03366 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:54.129924 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70bbdb3-6ca0-45cc-bae7-f8b9c07f8c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:54.130516 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bbdb3-6ca0-45cc-bae7-f8b9c07f8c53 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:54.130796 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bbdb3-6ca0-45cc-bae7-f8b9c07f8c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:54.131067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bbdb3-6ca0-45cc-bae7-f8b9c07f8c53 None admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:54.131746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70bbdb3-6ca0-45cc-bae7-f8b9c07f8c53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:48:54.132049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70bbdb3-6ca0-45cc-bae7-f8b9c07f8c53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:54.133504 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70bbdb3-6ca0-45cc-bae7-f8b9c07f8c53 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:54.145234 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 634/1272] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Sep 4 00:48:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:48:54.151242 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6017d-429b-4fcd-9e31-491dfb463353 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:54.239585 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:54.248481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6017d-429b-4fcd-9e31-491dfb463353 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:54.280840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec48080-77ad-4516-8dc3-b02ab36388b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:54.282046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec48080-77ad-4516-8dc3-b02ab36388b7 None admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:54.282323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec48080-77ad-4516-8dc3-b02ab36388b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:54.282595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec48080-77ad-4516-8dc3-b02ab36388b7 None admin] PATH_INFO: `/v3/projects/40b24e92f8594ee08bd2a55f79e3b299/users/f908fda75ef8440cb6a0ef9440127d6d/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:54.284505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec48080-77ad-4516-8dc3-b02ab36388b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=40b24e92f8594ee08bd2a55f79e3b299, user_id=f908fda75ef8440cb6a0ef9440127d6d, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:54.285948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec48080-77ad-4516-8dc3-b02ab36388b7 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:54.297719 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 639/1273] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Sep 4 00:48:54 2022] PUT /identity/v3/projects/40b24e92f8594ee08bd2a55f79e3b299/users/f908fda75ef8440cb6a0ef9440127d6d/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:48:56.164774 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de145eda-f201-467e-b689-f73d949c286a None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:56.165297 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de145eda-f201-467e-b689-f73d949c286a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:56.165297 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de145eda-f201-467e-b689-f73d949c286a None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:56.166674 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 635/1274] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:48:56.172442 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45081b4-b2cb-4049-95f8-b4b1ac37eb74 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:56.172878 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45081b4-b2cb-4049-95f8-b4b1ac37eb74 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:56.172980 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45081b4-b2cb-4049-95f8-b4b1ac37eb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:56.191295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d45081b4-b2cb-4049-95f8-b4b1ac37eb74 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:48:56.192471 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d45081b4-b2cb-4049-95f8-b4b1ac37eb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:48:56.256998 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 640/1275] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:48:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:48:56.533702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de145eda-f201-467e-b689-f73d949c286a None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:56.630976 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de145eda-f201-467e-b689-f73d949c286a None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:56.649543 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:56.666969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de3854-00c7-4d6c-8e18-d0d46d567d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:56.667589 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de3854-00c7-4d6c-8e18-d0d46d567d70 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:56.667861 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de3854-00c7-4d6c-8e18-d0d46d567d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:56.668133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de3854-00c7-4d6c-8e18-d0d46d567d70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:56.678346 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de3854-00c7-4d6c-8e18-d0d46d567d70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 00:48:56.683029 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-18de3854-00c7-4d6c-8e18-d0d46d567d70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:48:56.683029 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:48:56.683029 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:48:56.683029 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:48:56.683029 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:48:56.683029 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:48:56.683029 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:48:56.683029 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:48:56.683029 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:48:56.683029 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:48:56.683029 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:48:56.683029 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:48:56.683029 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 04 00:48:56.683029 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 04 00:48:56.683029 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 04 00:48:56.683029 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 04 00:48:56.684094 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 00:48:56.684094 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 00:48:56.684094 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 00:48:56.684094 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 00:48:56.684094 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:48:56.684094 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:48:56.684094 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:48:56.684094 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:48:56.684094 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:48:56.684094 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:48:56.684094 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:48:56.684094 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:48:56.684094 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:48:56.684094 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:48:56.684094 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:48:56.684094 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:48:56.685376 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:48:56.685376 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:48:56.685376 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:48:56.685376 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:48:56.685376 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 00:48:56.685376 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 00:48:56.685376 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 00:48:56.685376 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 00:48:56.685376 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 00:48:56.685376 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 00:48:56.685376 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 04 00:48:56.685376 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:48:56.685376 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 636/1276] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Sep 4 00:48:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:48:56.690012 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45081b4-b2cb-4049-95f8-b4b1ac37eb74 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:56.765991 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:56.783848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45081b4-b2cb-4049-95f8-b4b1ac37eb74 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:56.815898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d6dae-6711-4caa-971d-7853547ae287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:56.816490 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d6dae-6711-4caa-971d-7853547ae287 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:56.816767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d6dae-6711-4caa-971d-7853547ae287 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:56.817035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d6dae-6711-4caa-971d-7853547ae287 None admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:56.817711 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d6dae-6711-4caa-971d-7853547ae287 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:48:56.818008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d6dae-6711-4caa-971d-7853547ae287 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:56.819355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d6dae-6711-4caa-971d-7853547ae287 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:56.826942 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 641/1277] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Sep 4 00:48:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:48:56.832450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de3854-00c7-4d6c-8e18-d0d46d567d70 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:56.929058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de3854-00c7-4d6c-8e18-d0d46d567d70 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:56.961117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9a6e1-09f7-4759-8106-feac58ef262f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:56.961745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9a6e1-09f7-4759-8106-feac58ef262f None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:56.962022 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9a6e1-09f7-4759-8106-feac58ef262f None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:56.962285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9a6e1-09f7-4759-8106-feac58ef262f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:56.972277 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9a6e1-09f7-4759-8106-feac58ef262f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:56.973728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9a6e1-09f7-4759-8106-feac58ef262f None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:56.987710 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-bcb9a6e1-09f7-4759-8106-feac58ef262f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:48:56.987710 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:48:56.987710 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:48:56.987710 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:48:56.987710 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:48:56.987710 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:48:56.987710 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:48:56.987710 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:48:56.987710 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:48:56.987710 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:48:56.987710 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:48:56.987710 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:48:56.987710 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:48:56.987710 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:48:56.987710 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:48:56.987710 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:48:56.988777 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:48:56.988777 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:48:56.988777 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:48:56.988777 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:48:56.988777 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:48:56.988777 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:48:56.988777 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:48:56.988777 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:48:56.988777 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:48:56.988777 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:48:56.988777 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:48:56.988777 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:48:56.988777 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:48:56.988777 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:48:56.988777 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:48:56.988777 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:48:56.988777 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:48:56.989705 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:48:56.989705 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:48:56.989705 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:48:56.989705 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 637/1278] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:48:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:48:56.994616 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d6dae-6711-4caa-971d-7853547ae287 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:57.089766 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d6dae-6711-4caa-971d-7853547ae287 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:57.122547 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdab02-ce8e-472b-847d-e162b49decc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:57.123136 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdab02-ce8e-472b-847d-e162b49decc0 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:57.123412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdab02-ce8e-472b-847d-e162b49decc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:57.123678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdab02-ce8e-472b-847d-e162b49decc0 None admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:57.124299 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdab02-ce8e-472b-847d-e162b49decc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:48:57.124619 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdab02-ce8e-472b-847d-e162b49decc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:57.126001 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdab02-ce8e-472b-847d-e162b49decc0 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:57.137017 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 642/1279] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:48:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:48:57.143304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9a6e1-09f7-4759-8106-feac58ef262f None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:57.173428 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:57.239977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9a6e1-09f7-4759-8106-feac58ef262f None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:57.271794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76a7e0-c692-405c-b6cb-758dde70883f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:57.272398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76a7e0-c692-405c-b6cb-758dde70883f None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:57.272674 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76a7e0-c692-405c-b6cb-758dde70883f None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:57.272944 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76a7e0-c692-405c-b6cb-758dde70883f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:57.280044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f76a7e0-c692-405c-b6cb-758dde70883f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:57.282039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f76a7e0-c692-405c-b6cb-758dde70883f None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:57.292738 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-5f76a7e0-c692-405c-b6cb-758dde70883f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 04 00:48:57.292738 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:48:57.292738 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:48:57.292738 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:48:57.292738 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:48:57.292738 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:48:57.292738 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:48:57.292738 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:48:57.292738 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:48:57.292738 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:48:57.292738 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:48:57.292738 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:48:57.292738 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 04 00:48:57.292738 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 04 00:48:57.292738 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 04 00:48:57.292738 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 04 00:48:57.293898 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:48:57.293898 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:48:57.293898 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 00:48:57.293898 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:48:57.293898 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 00:48:57.293898 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 00:48:57.293898 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:48:57.293898 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:48:57.293898 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:48:57.293898 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:48:57.293898 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:48:57.293898 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:48:57.293898 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:48:57.293898 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:48:57.293898 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:48:57.293898 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:48:57.293898 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:48:57.293898 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:48:57.295247 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:48:57.295247 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:48:57.295247 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 00:48:57.295247 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 00:48:57.295247 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 00:48:57.295247 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 00:48:57.295247 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 00:48:57.295247 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 00:48:57.295247 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 04 00:48:57.295247 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:48:57.295247 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 638/1280] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:48:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:48:57.299537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdab02-ce8e-472b-847d-e162b49decc0 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:57.303250 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:57.394653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdab02-ce8e-472b-847d-e162b49decc0 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:57.426569 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ffde1-76de-4dd2-8bb2-c0865460700d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:57.427148 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ffde1-76de-4dd2-8bb2-c0865460700d None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:57.427425 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ffde1-76de-4dd2-8bb2-c0865460700d None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:57.427694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ffde1-76de-4dd2-8bb2-c0865460700d None admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:57.428401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ffde1-76de-4dd2-8bb2-c0865460700d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:48:57.428700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ffde1-76de-4dd2-8bb2-c0865460700d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:57.430129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ffde1-76de-4dd2-8bb2-c0865460700d None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:57.447811 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 643/1281] 10.222.0.30 () {56 vars in 1143 bytes} [Sun Sep 4 00:48:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:48:57.453941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76a7e0-c692-405c-b6cb-758dde70883f None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:57.539475 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:57.549084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76a7e0-c692-405c-b6cb-758dde70883f None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:57.581802 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edcc80d-6ae0-446a-b567-db7e51116c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:57.582383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcc80d-6ae0-446a-b567-db7e51116c2a None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:57.582663 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcc80d-6ae0-446a-b567-db7e51116c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:57.582936 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcc80d-6ae0-446a-b567-db7e51116c2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:57.646545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edcc80d-6ae0-446a-b567-db7e51116c2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:57.647928 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edcc80d-6ae0-446a-b567-db7e51116c2a None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:57.733478 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:57.743896 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 639/1282] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Sep 4 00:48:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 04 00:48:57.750482 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ffde1-76de-4dd2-8bb2-c0865460700d None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:57.808889 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:57.846278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ffde1-76de-4dd2-8bb2-c0865460700d None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:57.879433 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601c630-aff7-4fd1-bf4d-ba563322983f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:57.880041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601c630-aff7-4fd1-bf4d-ba563322983f None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:57.880318 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601c630-aff7-4fd1-bf4d-ba563322983f None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:57.880589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601c630-aff7-4fd1-bf4d-ba563322983f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:57.890186 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601c630-aff7-4fd1-bf4d-ba563322983f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:57.891619 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601c630-aff7-4fd1-bf4d-ba563322983f None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:57.906038 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-0601c630-aff7-4fd1-bf4d-ba563322983f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:48:57.906038 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:48:57.906038 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:48:57.906038 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:48:57.906038 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:48:57.906038 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:48:57.906038 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:48:57.906038 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:48:57.906038 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:48:57.906038 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:48:57.906038 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:48:57.906038 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:48:57.906038 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 00:48:57.906038 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 00:48:57.906038 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 00:48:57.906038 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 00:48:57.907121 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:48:57.907121 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:48:57.907121 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:48:57.907121 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:48:57.907121 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:48:57.907121 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:48:57.907121 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:48:57.907121 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:48:57.907121 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:48:57.907121 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:48:57.907121 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:48:57.907121 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:48:57.907121 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:48:57.907121 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:48:57.907121 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:48:57.907121 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:48:57.907121 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 04 00:48:57.908229 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 00:48:57.908229 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 04 00:48:57.908229 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:48:57.908229 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 644/1283] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:48:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:48:57.912680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edcc80d-6ae0-446a-b567-db7e51116c2a None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:58.014672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edcc80d-6ae0-446a-b567-db7e51116c2a None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:58.047491 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b9080-aee0-401f-aba5-bb819f6f83cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:58.048130 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b9080-aee0-401f-aba5-bb819f6f83cc None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:58.048410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b9080-aee0-401f-aba5-bb819f6f83cc None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:58.048680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b9080-aee0-401f-aba5-bb819f6f83cc None admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:58.049312 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b9080-aee0-401f-aba5-bb819f6f83cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:48:58.049641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b9080-aee0-401f-aba5-bb819f6f83cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:58.051005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b9080-aee0-401f-aba5-bb819f6f83cc None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:58.061845 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 640/1284] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Sep 4 00:48:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:48:58.068117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601c630-aff7-4fd1-bf4d-ba563322983f None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:58.163583 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601c630-aff7-4fd1-bf4d-ba563322983f None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:58.177113 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:58.196545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0300e-57b6-4dc4-8a14-4c37de363c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:58.197156 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0300e-57b6-4dc4-8a14-4c37de363c2d None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:58.197459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0300e-57b6-4dc4-8a14-4c37de363c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:58.197728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0300e-57b6-4dc4-8a14-4c37de363c2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:58.204051 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0300e-57b6-4dc4-8a14-4c37de363c2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:58.205508 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0300e-57b6-4dc4-8a14-4c37de363c2d None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:58.216260 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-84f0300e-57b6-4dc4-8a14-4c37de363c2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:48:58.216260 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:48:58.216260 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:48:58.216260 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:48:58.216260 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:48:58.216260 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:48:58.216260 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:48:58.216260 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:48:58.216260 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:48:58.216260 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:48:58.216260 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:48:58.216260 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:48:58.216260 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 04 00:48:58.216260 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 04 00:48:58.216260 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 04 00:48:58.217356 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 04 00:48:58.217356 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:48:58.217356 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:48:58.217356 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:48:58.217356 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:48:58.217356 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:48:58.217356 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:48:58.217356 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:48:58.217356 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 00:48:58.217356 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:48:58.217356 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:48:58.217356 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:48:58.217356 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:48:58.217356 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:48:58.217356 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:48:58.217356 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:48:58.217356 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:48:58.219055 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 04 00:48:58.219055 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 04 00:48:58.219055 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 00:48:58.219055 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 00:48:58.219055 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 00:48:58.219055 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 00:48:58.219055 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 04 00:48:58.219055 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 00:48:58.219055 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 645/1285] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Sep 4 00:48:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:48:58.223649 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b9080-aee0-401f-aba5-bb819f6f83cc None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:58.271801 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:48:58.320684 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b9080-aee0-401f-aba5-bb819f6f83cc None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:58.354294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158fbd0-7060-4dd9-841e-a860740cccd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:58.354923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158fbd0-7060-4dd9-841e-a860740cccd5 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:58.355202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158fbd0-7060-4dd9-841e-a860740cccd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:58.355474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158fbd0-7060-4dd9-841e-a860740cccd5 None admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:58.356154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158fbd0-7060-4dd9-841e-a860740cccd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:48:58.356456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158fbd0-7060-4dd9-841e-a860740cccd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:58.357913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158fbd0-7060-4dd9-841e-a860740cccd5 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:58.370330 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 641/1286] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Sep 4 00:48:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:48:58.376574 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0300e-57b6-4dc4-8a14-4c37de363c2d None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:48:58.474233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0300e-57b6-4dc4-8a14-4c37de363c2d None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:48:58.506030 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb2172-c405-4562-907b-8e111d2c78db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:48:58.506624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb2172-c405-4562-907b-8e111d2c78db None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:48:58.506902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb2172-c405-4562-907b-8e111d2c78db None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:48:58.507174 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb2172-c405-4562-907b-8e111d2c78db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:48:58.507892 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb2172-c405-4562-907b-8e111d2c78db None admin] RBAC: Adding query filter params (role.id=d255b03c37d64371a148ec4e11be01d9, scope.project.id=40b24e92f8594ee08bd2a55f79e3b299, user.id=f908fda75ef8440cb6a0ef9440127d6d) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:48:58.508197 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb2172-c405-4562-907b-8e111d2c78db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:48:58.509649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb2172-c405-4562-907b-8e111d2c78db None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:48:58.515685 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 646/1287] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Sep 4 00:48:58 2022] GET /identity/v3/role_assignments?user.id=f908fda75ef8440cb6a0ef9440127d6d&scope.project.id=40b24e92f8594ee08bd2a55f79e3b299&role.id=d255b03c37d64371a148ec4e11be01d9 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:49:00.391340 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6e08d-f086-43c3-b653-6c9c3e02f9f7 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:49:00.391866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6e08d-f086-43c3-b653-6c9c3e02f9f7 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:49:00.391866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6e08d-f086-43c3-b653-6c9c3e02f9f7 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:49:00.393187 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 642/1288] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:49:00.398336 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2ed06-d003-4888-bf1b-1e85c4768862 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:49:00.398726 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2ed06-d003-4888-bf1b-1e85c4768862 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:49:00.398881 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2ed06-d003-4888-bf1b-1e85c4768862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:49:00.416668 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-73b2ed06-d003-4888-bf1b-1e85c4768862 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:49:00.417871 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-73b2ed06-d003-4888-bf1b-1e85c4768862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:49:00.446389 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:49:00.482530 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 647/1289] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:49:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:49:00.747645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6e08d-f086-43c3-b653-6c9c3e02f9f7 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:49:00.853644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6e08d-f086-43c3-b653-6c9c3e02f9f7 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:49:00.864656 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:49:00.888189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569729b-54fd-40a0-ad9f-e219d1174e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:49:00.888805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569729b-54fd-40a0-ad9f-e219d1174e66 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:49:00.889086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569729b-54fd-40a0-ad9f-e219d1174e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:49:00.889358 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569729b-54fd-40a0-ad9f-e219d1174e66 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:49:00.889970 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9569729b-54fd-40a0-ad9f-e219d1174e66 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:49:00.891335 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9569729b-54fd-40a0-ad9f-e219d1174e66 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:49:00.899833 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-9569729b-54fd-40a0-ad9f-e219d1174e66 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 04 00:49:00.899833 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:49:00.899833 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 04 00:49:00.899833 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 04 00:49:00.899833 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 04 00:49:00.899833 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 04 00:49:00.899833 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 04 00:49:00.899833 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:49:00.899833 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 04 00:49:00.899833 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:49:00.899833 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 00:49:00.899833 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:49:00.899833 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:49:00.899833 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:49:00.899833 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:49:00.899833 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:49:00.899833 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:49:00.901086 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:49:00.901086 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:49:00.901086 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:49:00.901086 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:49:00.901086 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:49:00.901086 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:49:00.901086 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 04 00:49:00.901086 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 04 00:49:00.901086 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 04 00:49:00.901086 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 04 00:49:00.901086 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:49:00.901086 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:49:00.901086 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:49:00.901086 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:49:00.901086 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:49:00.901086 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:49:00.902219 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:49:00.902219 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:49:00.902219 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:49:00.902219 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:49:00.902219 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:49:00.902219 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:49:00.902219 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:49:00.902219 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:49:00.902219 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:49:00.902219 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:49:00.902219 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 04 00:49:00.902219 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:49:00.902219 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 04 00:49:00.902219 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:49:00.902219 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 643/1290] 10.222.0.30 () {56 vars in 1117 bytes} [Sun Sep 4 00:49:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:49:00.909353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2ed06-d003-4888-bf1b-1e85c4768862 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:49:01.004977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2ed06-d003-4888-bf1b-1e85c4768862 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:49:01.038298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab517aee-7020-4416-811f-a29afacf56ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:49:01.038895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab517aee-7020-4416-811f-a29afacf56ee None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:49:01.039170 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab517aee-7020-4416-811f-a29afacf56ee None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:49:01.039441 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab517aee-7020-4416-811f-a29afacf56ee None admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:49:01.040060 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab517aee-7020-4416-811f-a29afacf56ee None admin] RBAC: Adding query filter params (name=placement) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:49:01.040360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab517aee-7020-4416-811f-a29afacf56ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:49:01.041739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab517aee-7020-4416-811f-a29afacf56ee None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:49:01.046852 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 648/1291] 10.222.0.30 () {56 vars in 1116 bytes} [Sun Sep 4 00:49:00 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:49:01.052598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569729b-54fd-40a0-ad9f-e219d1174e66 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:49:01.151101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569729b-54fd-40a0-ad9f-e219d1174e66 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:49:01.183493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc1c333-f42b-4b91-b84c-45874da66923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:49:01.184077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1c333-f42b-4b91-b84c-45874da66923 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:49:01.184353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1c333-f42b-4b91-b84c-45874da66923 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:49:01.184621 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1c333-f42b-4b91-b84c-45874da66923 None admin] PATH_INFO: `/v3/services` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:49:01.185230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc1c333-f42b-4b91-b84c-45874da66923 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:49:01.185559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc1c333-f42b-4b91-b84c-45874da66923 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:49:01.186933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc1c333-f42b-4b91-b84c-45874da66923 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:49:01.191110 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 644/1292] 10.222.0.30 () {56 vars in 1116 bytes} [Sun Sep 4 00:49:01 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:49:03.039900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e71c8-8aca-4539-8129-8946743e5c90 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:49:03.040446 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e71c8-8aca-4539-8129-8946743e5c90 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:49:03.040446 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e71c8-8aca-4539-8129-8946743e5c90 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:49:03.041820 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 649/1293] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:49:03.046945 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed00f6-70ef-476a-955f-a69a22bbc3df None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:49:03.047330 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed00f6-70ef-476a-955f-a69a22bbc3df None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:49:03.047500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed00f6-70ef-476a-955f-a69a22bbc3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:49:03.065148 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c9ed00f6-70ef-476a-955f-a69a22bbc3df None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:49:03.066366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c9ed00f6-70ef-476a-955f-a69a22bbc3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:49:03.095137 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:49:03.130807 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 645/1294] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:49:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:49:03.401718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e71c8-8aca-4539-8129-8946743e5c90 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:49:03.431428 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:49:03.500261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e71c8-8aca-4539-8129-8946743e5c90 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:49:03.532494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48051aa2-3dcc-4693-8ba5-7d44a758f0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:49:03.533084 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48051aa2-3dcc-4693-8ba5-7d44a758f0a5 None admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:49:03.533473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48051aa2-3dcc-4693-8ba5-7d44a758f0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:49:03.533752 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48051aa2-3dcc-4693-8ba5-7d44a758f0a5 None admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:49:03.534395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48051aa2-3dcc-4693-8ba5-7d44a758f0a5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:49:03.535734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48051aa2-3dcc-4693-8ba5-7d44a758f0a5 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:49:03.549482 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 650/1295] 10.222.0.30 () {60 vars in 1141 bytes} [Sun Sep 4 00:49:03 2022] POST /identity/v3/services => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:49:05.439742 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c99ce5-ae65-4982-8781-e8952e5419e3 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:49:05.440320 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c99ce5-ae65-4982-8781-e8952e5419e3 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:49:05.440320 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c99ce5-ae65-4982-8781-e8952e5419e3 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:49:05.441627 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 646/1296] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:49:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:49:05.446836 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080ceba-2d0d-4cc8-afe4-2244000c998d None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:49:05.447223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080ceba-2d0d-4cc8-afe4-2244000c998d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:49:05.447382 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080ceba-2d0d-4cc8-afe4-2244000c998d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:49:05.465275 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e080ceba-2d0d-4cc8-afe4-2244000c998d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:49:05.466488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e080ceba-2d0d-4cc8-afe4-2244000c998d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:49:05.536316 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 651/1297] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:49:05 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:49:05.800984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c99ce5-ae65-4982-8781-e8952e5419e3 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:49:05.899781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c99ce5-ae65-4982-8781-e8952e5419e3 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:49:05.932854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f80e9-6d7f-45fc-9bc8-b74b45da0f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:49:05.933519 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f80e9-6d7f-45fc-9bc8-b74b45da0f9a None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:49:05.933802 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f80e9-6d7f-45fc-9bc8-b74b45da0f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:49:05.934076 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f80e9-6d7f-45fc-9bc8-b74b45da0f9a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:49:05.934652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f80e9-6d7f-45fc-9bc8-b74b45da0f9a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:49:05.936016 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f80e9-6d7f-45fc-9bc8-b74b45da0f9a None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:49:05.944490 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-981f80e9-6d7f-45fc-9bc8-b74b45da0f9a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 04 00:49:05.944490 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:49:05.944490 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 04 00:49:05.944490 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 04 00:49:05.944490 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 04 00:49:05.944490 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 04 00:49:05.944490 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 04 00:49:05.944490 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:49:05.944490 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 04 00:49:05.944490 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:49:05.944490 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 00:49:05.944490 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:49:05.944490 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:49:05.944490 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:49:05.944490 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:49:05.944490 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:49:05.944490 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:49:05.945662 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:49:05.945662 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:49:05.945662 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:49:05.945662 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:49:05.945662 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:49:05.945662 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:49:05.945662 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 04 00:49:05.945662 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 04 00:49:05.945662 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 04 00:49:05.945662 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 04 00:49:05.945662 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:49:05.945662 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:49:05.945662 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:49:05.945662 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:49:05.945662 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:49:05.945662 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:49:05.946948 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:49:05.946948 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:49:05.946948 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:49:05.946948 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:49:05.946948 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:49:05.946948 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:49:05.946948 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:49:05.946948 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:49:05.946948 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:49:05.946948 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:49:05.946948 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 04 00:49:05.946948 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:49:05.946948 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 04 00:49:05.946948 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:49:05.946948 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 647/1298] 10.222.0.30 () {56 vars in 1117 bytes} [Sun Sep 4 00:49:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:49:05.951577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080ceba-2d0d-4cc8-afe4-2244000c998d None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:49:05.970572 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:49:06.049211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080ceba-2d0d-4cc8-afe4-2244000c998d None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:49:06.081456 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae5df6-1b42-41db-a693-9af18b459e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:49:06.082005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae5df6-1b42-41db-a693-9af18b459e31 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:49:06.082282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae5df6-1b42-41db-a693-9af18b459e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:49:06.082552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae5df6-1b42-41db-a693-9af18b459e31 None admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:49:06.083168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae5df6-1b42-41db-a693-9af18b459e31 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:49:06.083467 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae5df6-1b42-41db-a693-9af18b459e31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:49:06.084809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae5df6-1b42-41db-a693-9af18b459e31 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:49:06.089740 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 652/1299] 10.222.0.30 () {56 vars in 1116 bytes} [Sun Sep 4 00:49:05 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:49:06.096333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f80e9-6d7f-45fc-9bc8-b74b45da0f9a None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:49:06.126536 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:49:06.193608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f80e9-6d7f-45fc-9bc8-b74b45da0f9a None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:49:06.225091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b86901-1f3b-414f-ba6d-e5fef67a5c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:49:06.225708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b86901-1f3b-414f-ba6d-e5fef67a5c4a None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:49:06.225987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b86901-1f3b-414f-ba6d-e5fef67a5c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:49:06.226256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b86901-1f3b-414f-ba6d-e5fef67a5c4a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:49:06.226938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b86901-1f3b-414f-ba6d-e5fef67a5c4a None admin] RBAC: Adding query filter params (interface=public, service_id=9ccb815aeb824b4bb7314ebf24af239a, region_id=RegionOne) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:49:06.227241 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b86901-1f3b-414f-ba6d-e5fef67a5c4a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:49:06.228598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b86901-1f3b-414f-ba6d-e5fef67a5c4a None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:49:06.233328 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 648/1300] 10.222.0.30 () {56 vars in 1251 bytes} [Sun Sep 4 00:49:06 2022] GET /identity/v3/endpoints?service_id=9ccb815aeb824b4bb7314ebf24af239a&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:49:06.239548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae5df6-1b42-41db-a693-9af18b459e31 None admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:49:06.319340 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:49:06.336705 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae5df6-1b42-41db-a693-9af18b459e31 None admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:49:06.369371 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c814d-e3fe-4f44-900d-92abda382924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:49:06.369995 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c814d-e3fe-4f44-900d-92abda382924 None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:49:06.370272 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c814d-e3fe-4f44-900d-92abda382924 None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:49:06.370539 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c814d-e3fe-4f44-900d-92abda382924 None admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:49:06.371126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c814d-e3fe-4f44-900d-92abda382924 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:49:06.372472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c814d-e3fe-4f44-900d-92abda382924 None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:49:06.379082 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 653/1301] 10.222.0.30 () {56 vars in 1087 bytes} [Sun Sep 4 00:49:06 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 00:49:08.269422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecaff0-b1b8-421d-a9f8-af4185d1c10a None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:49:08.269993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecaff0-b1b8-421d-a9f8-af4185d1c10a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:49:08.269993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecaff0-b1b8-421d-a9f8-af4185d1c10a None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:49:08.271323 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 649/1302] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:49:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:49:08.276437 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7e73f-22d4-4a5b-9640-9a4c591b11a4 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:49:08.276859 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7e73f-22d4-4a5b-9640-9a4c591b11a4 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:49:08.276981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7e73f-22d4-4a5b-9640-9a4c591b11a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:49:08.295405 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e0a7e73f-22d4-4a5b-9640-9a4c591b11a4 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:49:08.296602 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e0a7e73f-22d4-4a5b-9640-9a4c591b11a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:49:08.360406 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 654/1303] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:49:08 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 04 00:49:08.625281 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ecaff0-b1b8-421d-a9f8-af4185d1c10a None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:49:08.717754 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:49:08.725215 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ecaff0-b1b8-421d-a9f8-af4185d1c10a None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:49:08.767121 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7b045-5a3e-490f-a6a1-accb60f6b7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:49:08.768073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7b045-5a3e-490f-a6a1-accb60f6b7a2 None admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:49:08.768538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7b045-5a3e-490f-a6a1-accb60f6b7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:49:08.768665 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7b045-5a3e-490f-a6a1-accb60f6b7a2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:49:08.769860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7b045-5a3e-490f-a6a1-accb60f6b7a2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:49:08.772198 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7b045-5a3e-490f-a6a1-accb60f6b7a2 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:49:08.786866 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-88c7b045-5a3e-490f-a6a1-accb60f6b7a2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 04 00:49:08.786866 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:49:08.786866 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 04 00:49:08.786866 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 04 00:49:08.786866 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 04 00:49:08.786866 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 04 00:49:08.786866 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 04 00:49:08.786866 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:49:08.786866 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 04 00:49:08.786866 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:49:08.786866 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 00:49:08.786866 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:49:08.786866 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 00:49:08.786866 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 00:49:08.786866 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 00:49:08.786866 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 00:49:08.786866 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 00:49:08.788400 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 00:49:08.788400 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 00:49:08.788400 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 00:49:08.788400 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 00:49:08.788400 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 00:49:08.788400 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 00:49:08.788400 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 04 00:49:08.788400 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 04 00:49:08.788400 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 04 00:49:08.788400 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 04 00:49:08.788400 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 00:49:08.788400 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 00:49:08.788400 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 00:49:08.788400 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 00:49:08.788400 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 00:49:08.788400 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 00:49:08.789808 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 00:49:08.789808 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 00:49:08.789808 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 00:49:08.789808 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 00:49:08.789808 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 00:49:08.789808 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 00:49:08.789808 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 00:49:08.789808 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 00:49:08.789808 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 00:49:08.789808 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 00:49:08.789808 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 04 00:49:08.789808 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 00:49:08.789808 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 04 00:49:08.789808 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 00:49:08.789808 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 650/1304] 10.222.0.30 () {56 vars in 1117 bytes} [Sun Sep 4 00:49:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 00:49:08.794720 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7e73f-22d4-4a5b-9640-9a4c591b11a4 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:49:08.879364 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:49:08.902121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7e73f-22d4-4a5b-9640-9a4c591b11a4 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:49:08.935784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220389a-04b1-418a-ad50-93ed6bf504bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:49:08.936385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220389a-04b1-418a-ad50-93ed6bf504bc None admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:49:08.937292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220389a-04b1-418a-ad50-93ed6bf504bc None admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:49:08.937594 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220389a-04b1-418a-ad50-93ed6bf504bc None admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:49:08.938218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f220389a-04b1-418a-ad50-93ed6bf504bc None admin] RBAC: Adding query filter params (name=placement) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:49:08.938515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f220389a-04b1-418a-ad50-93ed6bf504bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:49:08.939857 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f220389a-04b1-418a-ad50-93ed6bf504bc None admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:49:08.944822 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 655/1305] 10.222.0.30 () {56 vars in 1116 bytes} [Sun Sep 4 00:49:08 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:49:08.950607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7b045-5a3e-490f-a6a1-accb60f6b7a2 None admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:49:09.053935 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7b045-5a3e-490f-a6a1-accb60f6b7a2 None admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:49:09.086102 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81730499-05ef-437c-8770-ddaca52844b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:49:09.086696 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81730499-05ef-437c-8770-ddaca52844b1 None admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:49:09.086977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81730499-05ef-437c-8770-ddaca52844b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:49:09.087251 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81730499-05ef-437c-8770-ddaca52844b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:49:09.087951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81730499-05ef-437c-8770-ddaca52844b1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:49:09.089310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81730499-05ef-437c-8770-ddaca52844b1 None admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:49:09.107724 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 651/1306] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 00:49:08 2022] POST /identity/v3/endpoints => generated 331 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:49:18.941876 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=30 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:49:19.103511 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:50:12.535462 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a0d94-47d6-4d45-a9ae-5dd886749a6d None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:12.538593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a0d94-47d6-4d45-a9ae-5dd886749a6d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:12.540089 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a0d94-47d6-4d45-a9ae-5dd886749a6d None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:12.552655 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029459bb-aef8-4195-aa0e-30047572ba69 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:12.553234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029459bb-aef8-4195-aa0e-30047572ba69 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:12.553919 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029459bb-aef8-4195-aa0e-30047572ba69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:12.555596 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 656/1307] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:50:12 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:50:12.652370 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-029459bb-aef8-4195-aa0e-30047572ba69 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:50:12.654161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-029459bb-aef8-4195-aa0e-30047572ba69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:12.889701 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 652/1308] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:50:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:50:13.198728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b12b1b-dec1-4059-ba13-fd36dcef7e0a None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:13.199073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b12b1b-dec1-4059-ba13-fd36dcef7e0a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:13.199282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b12b1b-dec1-4059-ba13-fd36dcef7e0a None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:13.203962 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 657/1309] 10.222.0.30 () {54 vars in 965 bytes} [Sun Sep 4 00:50:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:50:13.212069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900f8f2-cd30-4e39-a939-a094ac1b321d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:13.212367 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900f8f2-cd30-4e39-a939-a094ac1b321d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:13.212563 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900f8f2-cd30-4e39-a939-a094ac1b321d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:13.309170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a900f8f2-cd30-4e39-a939-a094ac1b321d None None] MFA Rules not processed for user `2cdde7a212954a01a2591ad5ac30d049`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:50:13.310446 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a900f8f2-cd30-4e39-a939-a094ac1b321d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:13.333726 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:50:13.396604 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 653/1310] 10.222.0.30 () {58 vars in 1062 bytes} [Sun Sep 4 00:50:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:50:13.406147 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b12b1b-dec1-4059-ba13-fd36dcef7e0a None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:50:13.407987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-02b12b1b-dec1-4059-ba13-fd36dcef7e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:13.542598 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b12b1b-dec1-4059-ba13-fd36dcef7e0a None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:50:13.626289 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ddd31-a272-4719-8b5a-3fa938e26429 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:50:13.627311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ddd31-a272-4719-8b5a-3fa938e26429 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:13.627805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ddd31-a272-4719-8b5a-3fa938e26429 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:13.628283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ddd31-a272-4719-8b5a-3fa938e26429 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:13.630921 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f31ddd31-a272-4719-8b5a-3fa938e26429 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:13.693083 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:50:13.757798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ddd31-a272-4719-8b5a-3fa938e26429 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:50:13.759586 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ddd31-a272-4719-8b5a-3fa938e26429 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:50:13.782626 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 658/1311] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:50:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:50:16.011279 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb12f15-1ce1-4153-95ad-d29afaccab9e None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:16.011840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb12f15-1ce1-4153-95ad-d29afaccab9e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:16.011961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb12f15-1ce1-4153-95ad-d29afaccab9e None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:16.013266 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 654/1312] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:50:16.019066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063336c5-a698-45c4-8d95-411d30a697b5 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:16.019066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063336c5-a698-45c4-8d95-411d30a697b5 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:16.019066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063336c5-a698-45c4-8d95-411d30a697b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:16.099953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-063336c5-a698-45c4-8d95-411d30a697b5 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:50:16.101140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-063336c5-a698-45c4-8d95-411d30a697b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:16.197007 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 659/1313] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:50:16.480472 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb12f15-1ce1-4153-95ad-d29afaccab9e None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:50:16.482045 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ccb12f15-1ce1-4153-95ad-d29afaccab9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:16.582062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb12f15-1ce1-4153-95ad-d29afaccab9e None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:50:16.650497 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:50:16.653699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c083510-688d-4ff8-8226-a64ab46f2996 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:50:16.654496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c083510-688d-4ff8-8226-a64ab46f2996 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:16.654931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c083510-688d-4ff8-8226-a64ab46f2996 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:16.655380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c083510-688d-4ff8-8226-a64ab46f2996 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:16.656970 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7c083510-688d-4ff8-8226-a64ab46f2996 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:16.760468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c083510-688d-4ff8-8226-a64ab46f2996 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:50:16.762464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c083510-688d-4ff8-8226-a64ab46f2996 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:50:16.781678 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 655/1314] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:50:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:50:18.954859 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6172fa-dfe1-47e0-8a02-7b71b438fdce None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:18.955437 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6172fa-dfe1-47e0-8a02-7b71b438fdce None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:18.955437 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6172fa-dfe1-47e0-8a02-7b71b438fdce None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:18.956764 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 660/1315] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:50:18.961783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2902a-c4c9-4306-83cd-9dfe50d1593f None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:18.962157 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2902a-c4c9-4306-83cd-9dfe50d1593f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:18.962328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2902a-c4c9-4306-83cd-9dfe50d1593f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:19.026091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-95e2902a-c4c9-4306-83cd-9dfe50d1593f None None] MFA Rules not processed for user `28a752c790934abebf720d75724b5b66`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:50:19.027272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-95e2902a-c4c9-4306-83cd-9dfe50d1593f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:19.077763 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:50:19.126063 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 656/1316] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:50:18 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:50:19.412071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6172fa-dfe1-47e0-8a02-7b71b438fdce None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:50:19.413635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-af6172fa-dfe1-47e0-8a02-7b71b438fdce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:19.423780 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:50:19.517009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6172fa-dfe1-47e0-8a02-7b71b438fdce None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:50:19.588189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd79ee-98d1-4d6b-b9a8-cfbc3fc46263 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:50:19.588786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd79ee-98d1-4d6b-b9a8-cfbc3fc46263 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:19.589063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd79ee-98d1-4d6b-b9a8-cfbc3fc46263 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:19.589334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd79ee-98d1-4d6b-b9a8-cfbc3fc46263 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:19.591569 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3ebd79ee-98d1-4d6b-b9a8-cfbc3fc46263 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:19.651231 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:50:19.696665 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd79ee-98d1-4d6b-b9a8-cfbc3fc46263 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:50:19.698065 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd79ee-98d1-4d6b-b9a8-cfbc3fc46263 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:50:19.716970 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 661/1317] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:50:19 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:50:22.135364 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bcd3b-2288-4c0a-9b19-9785ce6622cb None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:22.135896 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bcd3b-2288-4c0a-9b19-9785ce6622cb None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:22.135896 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bcd3b-2288-4c0a-9b19-9785ce6622cb None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:22.137237 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 657/1318] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:50:22.143098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bd55a-fb3f-4aaa-9f88-0db0d48b96b6 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:22.143479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bd55a-fb3f-4aaa-9f88-0db0d48b96b6 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:22.143649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bd55a-fb3f-4aaa-9f88-0db0d48b96b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:22.208616 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a50bd55a-fb3f-4aaa-9f88-0db0d48b96b6 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:50:22.209853 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a50bd55a-fb3f-4aaa-9f88-0db0d48b96b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:22.305268 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 662/1319] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:50:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:50:22.608153 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d9eba-61a2-454e-9fd7-451dd8856b42 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:22.608430 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d9eba-61a2-454e-9fd7-451dd8856b42 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:22.608700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d9eba-61a2-454e-9fd7-451dd8856b42 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:22.610058 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 658/1320] 10.222.0.30 () {54 vars in 965 bytes} [Sun Sep 4 00:50:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:50:22.615964 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f14146-83f5-4192-9841-17b4d4a98bbb None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:22.616245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f14146-83f5-4192-9841-17b4d4a98bbb None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:22.616514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f14146-83f5-4192-9841-17b4d4a98bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:22.638695 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:50:22.691787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-73f14146-83f5-4192-9841-17b4d4a98bbb None None] MFA Rules not processed for user `2cdde7a212954a01a2591ad5ac30d049`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:50:22.692982 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-73f14146-83f5-4192-9841-17b4d4a98bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:22.768625 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 663/1321] 10.222.0.30 () {58 vars in 1062 bytes} [Sun Sep 4 00:50:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:50:22.777662 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d9eba-61a2-454e-9fd7-451dd8856b42 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:50:22.779723 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-381d9eba-61a2-454e-9fd7-451dd8856b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:22.879421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d9eba-61a2-454e-9fd7-451dd8856b42 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:50:22.948985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7092f03d-32ab-4237-956b-4374c511ddfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:50:22.949606 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092f03d-32ab-4237-956b-4374c511ddfd service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:22.949903 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092f03d-32ab-4237-956b-4374c511ddfd service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:22.950175 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092f03d-32ab-4237-956b-4374c511ddfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:22.951721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7092f03d-32ab-4237-956b-4374c511ddfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:22.958822 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:50:23.060546 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7092f03d-32ab-4237-956b-4374c511ddfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:50:23.061939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7092f03d-32ab-4237-956b-4374c511ddfd service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:50:23.079681 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 659/1322] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:50:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:50:26.108900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f1513-53cc-4963-8697-ba9a9967dfe4 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:26.109632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f1513-53cc-4963-8697-ba9a9967dfe4 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:26.109632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f1513-53cc-4963-8697-ba9a9967dfe4 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:26.110834 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 664/1323] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:50:26.115989 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793d514-abdc-47ca-ada9-35e993c3fa78 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:26.116399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793d514-abdc-47ca-ada9-35e993c3fa78 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:26.116559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793d514-abdc-47ca-ada9-35e993c3fa78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:26.187713 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-8793d514-abdc-47ca-ada9-35e993c3fa78 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:50:26.188931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8793d514-abdc-47ca-ada9-35e993c3fa78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:26.246757 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:50:26.290847 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 660/1324] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:50:26.581381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f1513-53cc-4963-8697-ba9a9967dfe4 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:50:26.583025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f89f1513-53cc-4963-8697-ba9a9967dfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:26.685521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f1513-53cc-4963-8697-ba9a9967dfe4 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:50:26.697546 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:50:26.766708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbbb07d-cac2-4a15-ae02-9331d33cf537 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:50:26.767319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbb07d-cac2-4a15-ae02-9331d33cf537 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:26.767599 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbb07d-cac2-4a15-ae02-9331d33cf537 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:26.767867 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbb07d-cac2-4a15-ae02-9331d33cf537 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:26.769465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1bbbb07d-cac2-4a15-ae02-9331d33cf537 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:26.877805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbbb07d-cac2-4a15-ae02-9331d33cf537 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:50:26.879241 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbbb07d-cac2-4a15-ae02-9331d33cf537 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:50:26.898908 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 665/1325] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:50:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:50:28.851345 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c28240-d8a7-4016-9e99-0e91912ff33e None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:28.851851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c28240-d8a7-4016-9e99-0e91912ff33e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:28.851851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c28240-d8a7-4016-9e99-0e91912ff33e None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:28.853298 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 661/1326] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:50:28.859062 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0be94-5fae-42bd-be45-cdc4a301c296 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:28.859450 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0be94-5fae-42bd-be45-cdc4a301c296 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:28.859600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0be94-5fae-42bd-be45-cdc4a301c296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:28.906606 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:50:28.924988 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-7bd0be94-5fae-42bd-be45-cdc4a301c296 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:50:28.926216 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7bd0be94-5fae-42bd-be45-cdc4a301c296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:29.020629 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 666/1327] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:50:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:50:29.304062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c28240-d8a7-4016-9e99-0e91912ff33e None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:50:29.305692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e0c28240-d8a7-4016-9e99-0e91912ff33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:29.419793 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c28240-d8a7-4016-9e99-0e91912ff33e None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:50:29.506457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02fa4a-b72a-4901-9687-4020bc6e4564 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:50:29.507065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02fa4a-b72a-4901-9687-4020bc6e4564 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:29.507345 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02fa4a-b72a-4901-9687-4020bc6e4564 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:29.507615 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02fa4a-b72a-4901-9687-4020bc6e4564 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:29.509221 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fa02fa4a-b72a-4901-9687-4020bc6e4564 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:29.526424 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:50:29.616691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa02fa4a-b72a-4901-9687-4020bc6e4564 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:50:29.618172 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa02fa4a-b72a-4901-9687-4020bc6e4564 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:50:29.636815 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 662/1328] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:50:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:50:31.628380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad453ce-279a-4968-bd9c-8f8ab7a9d318 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:31.628933 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad453ce-279a-4968-bd9c-8f8ab7a9d318 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:31.628933 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad453ce-279a-4968-bd9c-8f8ab7a9d318 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:31.630327 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 667/1329] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:50:31.635470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571847df-ba56-4c17-a256-be735bf1f540 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:31.635895 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571847df-ba56-4c17-a256-be735bf1f540 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:31.636140 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571847df-ba56-4c17-a256-be735bf1f540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:31.703113 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-571847df-ba56-4c17-a256-be735bf1f540 None None] MFA Rules not processed for user `28a752c790934abebf720d75724b5b66`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:50:31.704233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-571847df-ba56-4c17-a256-be735bf1f540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:31.771066 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:50:31.802290 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 663/1330] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:50:31 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:50:32.085787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad453ce-279a-4968-bd9c-8f8ab7a9d318 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:50:32.087337 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4ad453ce-279a-4968-bd9c-8f8ab7a9d318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:32.191711 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad453ce-279a-4968-bd9c-8f8ab7a9d318 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:50:32.211001 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:50:32.266027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2d6d4-892a-4935-8bf6-8001e77096d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:50:32.266667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2d6d4-892a-4935-8bf6-8001e77096d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:32.266932 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2d6d4-892a-4935-8bf6-8001e77096d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:32.267200 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2d6d4-892a-4935-8bf6-8001e77096d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:32.268849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9ad2d6d4-892a-4935-8bf6-8001e77096d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:32.392076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad2d6d4-892a-4935-8bf6-8001e77096d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:50:32.393617 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad2d6d4-892a-4935-8bf6-8001e77096d9 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:50:32.412185 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 668/1331] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:50:32 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:50:34.569260 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a245b-c65c-4ea4-8637-7b9f5b6c0e3d None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:34.569882 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a245b-c65c-4ea4-8637-7b9f5b6c0e3d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:34.569882 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a245b-c65c-4ea4-8637-7b9f5b6c0e3d None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:34.571180 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 664/1332] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:50:34.577004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a484ec-65b6-41f8-8b45-a1ccb8d2caa0 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:34.577451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a484ec-65b6-41f8-8b45-a1ccb8d2caa0 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:34.577596 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a484ec-65b6-41f8-8b45-a1ccb8d2caa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:34.640482 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:50:34.643549 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-95a484ec-65b6-41f8-8b45-a1ccb8d2caa0 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:50:34.645365 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-95a484ec-65b6-41f8-8b45-a1ccb8d2caa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:34.739134 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 669/1333] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:50:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:50:35.017627 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a245b-c65c-4ea4-8637-7b9f5b6c0e3d None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:50:35.019144 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e69a245b-c65c-4ea4-8637-7b9f5b6c0e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:35.119104 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a245b-c65c-4ea4-8637-7b9f5b6c0e3d None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:50:35.191231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b4ca1-1253-4e38-b2cd-7fd1d4749f9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:50:35.191827 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b4ca1-1253-4e38-b2cd-7fd1d4749f9e service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:35.192105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b4ca1-1253-4e38-b2cd-7fd1d4749f9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:35.192377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b4ca1-1253-4e38-b2cd-7fd1d4749f9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:35.193967 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1f3b4ca1-1253-4e38-b2cd-7fd1d4749f9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:35.219937 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:50:35.299727 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b4ca1-1253-4e38-b2cd-7fd1d4749f9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:50:35.301082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b4ca1-1253-4e38-b2cd-7fd1d4749f9e service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:50:35.319471 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 665/1334] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:50:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:50:37.236113 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c0da9-43a8-4e03-bdd5-684ffd1da9ca None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:37.236678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c0da9-43a8-4e03-bdd5-684ffd1da9ca None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:37.236678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c0da9-43a8-4e03-bdd5-684ffd1da9ca None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:37.238041 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 670/1335] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:50:37.243002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb671e2-aff3-4787-aff3-e603a1f7cddb None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:37.243420 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb671e2-aff3-4787-aff3-e603a1f7cddb None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:37.243559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb671e2-aff3-4787-aff3-e603a1f7cddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:37.309549 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-bfb671e2-aff3-4787-aff3-e603a1f7cddb None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:50:37.310745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-bfb671e2-aff3-4787-aff3-e603a1f7cddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:37.384009 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:50:37.406521 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 666/1336] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:50:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 00:50:37.688673 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c0da9-43a8-4e03-bdd5-684ffd1da9ca None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:50:37.690231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-588c0da9-43a8-4e03-bdd5-684ffd1da9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:37.792018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c0da9-43a8-4e03-bdd5-684ffd1da9ca None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:50:37.819600 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:50:37.864034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff215d-502d-4da5-a267-26a607000eda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:50:37.864632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff215d-502d-4da5-a267-26a607000eda service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:37.864908 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff215d-502d-4da5-a267-26a607000eda service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:37.865176 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff215d-502d-4da5-a267-26a607000eda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:37.866784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-06ff215d-502d-4da5-a267-26a607000eda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:37.974546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff215d-502d-4da5-a267-26a607000eda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:50:37.975906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff215d-502d-4da5-a267-26a607000eda service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:50:37.994044 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 671/1337] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:50:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:50:40.220080 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52946d7b-c55e-4f5d-b3c6-7e925cca8282 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:40.220614 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52946d7b-c55e-4f5d-b3c6-7e925cca8282 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:40.220614 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52946d7b-c55e-4f5d-b3c6-7e925cca8282 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:40.222054 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 667/1338] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:50:40.227047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1cc37-20c6-4a12-8401-a1a57cf7f2ea None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:40.227475 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1cc37-20c6-4a12-8401-a1a57cf7f2ea None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:40.227576 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1cc37-20c6-4a12-8401-a1a57cf7f2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:40.293937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e8c1cc37-20c6-4a12-8401-a1a57cf7f2ea None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:50:40.295123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e8c1cc37-20c6-4a12-8401-a1a57cf7f2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:40.303198 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:50:40.394225 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 672/1339] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:50:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:50:40.686334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52946d7b-c55e-4f5d-b3c6-7e925cca8282 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:50:40.687863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-52946d7b-c55e-4f5d-b3c6-7e925cca8282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:40.789312 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52946d7b-c55e-4f5d-b3c6-7e925cca8282 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:50:40.860817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3dfa6-5d87-4ac2-bf2d-6355f9ea73ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:50:40.861416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3dfa6-5d87-4ac2-bf2d-6355f9ea73ec service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:40.861721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3dfa6-5d87-4ac2-bf2d-6355f9ea73ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:40.861993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3dfa6-5d87-4ac2-bf2d-6355f9ea73ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:40.863585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1db3dfa6-5d87-4ac2-bf2d-6355f9ea73ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:40.898292 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:50:40.969733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db3dfa6-5d87-4ac2-bf2d-6355f9ea73ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:50:40.971094 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db3dfa6-5d87-4ac2-bf2d-6355f9ea73ec service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:50:40.988997 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 668/1340] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:50:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:50:44.880073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec90f39-ef64-4bc0-b7fa-cd6cc73d76d5 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:44.880647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec90f39-ef64-4bc0-b7fa-cd6cc73d76d5 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:44.880647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec90f39-ef64-4bc0-b7fa-cd6cc73d76d5 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:44.882013 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 673/1341] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:50:44.888154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f003e5-00a0-4054-b71c-c711eac8db05 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:44.888573 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f003e5-00a0-4054-b71c-c711eac8db05 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:44.888682 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f003e5-00a0-4054-b71c-c711eac8db05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:44.954982 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-12f003e5-00a0-4054-b71c-c711eac8db05 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:50:44.956185 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-12f003e5-00a0-4054-b71c-c711eac8db05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:45.043630 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:50:45.055351 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 669/1342] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:50:45.336840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec90f39-ef64-4bc0-b7fa-cd6cc73d76d5 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:50:45.338512 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3ec90f39-ef64-4bc0-b7fa-cd6cc73d76d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:45.442472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec90f39-ef64-4bc0-b7fa-cd6cc73d76d5 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:50:45.481221 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:50:45.524809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24449846-6b66-4628-9a6f-df5125e22df7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:50:45.525418 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24449846-6b66-4628-9a6f-df5125e22df7 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:45.525721 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24449846-6b66-4628-9a6f-df5125e22df7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:45.525987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24449846-6b66-4628-9a6f-df5125e22df7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:45.527593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-24449846-6b66-4628-9a6f-df5125e22df7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:45.636985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24449846-6b66-4628-9a6f-df5125e22df7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:50:45.638459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24449846-6b66-4628-9a6f-df5125e22df7 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:50:45.656508 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 674/1343] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:50:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:50:48.207188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018d803-3884-4623-9ee3-381c9b0e6035 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:48.207761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018d803-3884-4623-9ee3-381c9b0e6035 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:48.207761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018d803-3884-4623-9ee3-381c9b0e6035 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:48.209141 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 670/1344] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:50:48.214524 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad0dd0-9aa0-4c69-bab7-5f913fa9737a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:48.214978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad0dd0-9aa0-4c69-bab7-5f913fa9737a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:48.215076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad0dd0-9aa0-4c69-bab7-5f913fa9737a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:48.282746 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-21ad0dd0-9aa0-4c69-bab7-5f913fa9737a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:50:48.283948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-21ad0dd0-9aa0-4c69-bab7-5f913fa9737a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:48.302052 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:50:48.380923 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 675/1345] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:50:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:50:48.668816 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018d803-3884-4623-9ee3-381c9b0e6035 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:50:48.670360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3018d803-3884-4623-9ee3-381c9b0e6035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:48.777024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018d803-3884-4623-9ee3-381c9b0e6035 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:50:48.855456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af94d6f-4aba-488f-9470-6f9d2942e248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:50:48.856060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af94d6f-4aba-488f-9470-6f9d2942e248 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:48.856334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af94d6f-4aba-488f-9470-6f9d2942e248 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:48.856604 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af94d6f-4aba-488f-9470-6f9d2942e248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:48.858456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2af94d6f-4aba-488f-9470-6f9d2942e248 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:48.900996 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:50:48.967011 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af94d6f-4aba-488f-9470-6f9d2942e248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:50:48.968476 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af94d6f-4aba-488f-9470-6f9d2942e248 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:50:48.987773 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 671/1346] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:50:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:50:52.974706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850f012-9cad-4750-a7c5-4049f9b372f8 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:52.975161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850f012-9cad-4750-a7c5-4049f9b372f8 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:52.975252 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850f012-9cad-4750-a7c5-4049f9b372f8 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:52.976598 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 676/1347] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:50:52.982930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a8b4a-b989-4f93-9755-9521fca81d51 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:52.983441 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a8b4a-b989-4f93-9755-9521fca81d51 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:52.983546 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a8b4a-b989-4f93-9755-9521fca81d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:53.052307 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-d70a8b4a-b989-4f93-9755-9521fca81d51 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:50:53.053558 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d70a8b4a-b989-4f93-9755-9521fca81d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:53.151099 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:50:53.154508 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 672/1348] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:50:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:50:53.435795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850f012-9cad-4750-a7c5-4049f9b372f8 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:50:53.437329 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6850f012-9cad-4750-a7c5-4049f9b372f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:53.542480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850f012-9cad-4750-a7c5-4049f9b372f8 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:50:53.589046 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:50:53.614513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d5cfc-60ff-4e28-a9e7-7609ca8720bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:50:53.615131 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d5cfc-60ff-4e28-a9e7-7609ca8720bb service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:53.615408 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d5cfc-60ff-4e28-a9e7-7609ca8720bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:53.615677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d5cfc-60ff-4e28-a9e7-7609ca8720bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:53.617251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c95d5cfc-60ff-4e28-a9e7-7609ca8720bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:53.723379 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d5cfc-60ff-4e28-a9e7-7609ca8720bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:50:53.724853 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d5cfc-60ff-4e28-a9e7-7609ca8720bb service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:50:53.742829 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 677/1349] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:50:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:50:58.628220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bdd80-dde7-4561-965d-4a8a6f5c2d80 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:58.628654 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bdd80-dde7-4561-965d-4a8a6f5c2d80 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:58.628924 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bdd80-dde7-4561-965d-4a8a6f5c2d80 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:58.630660 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 673/1350] 10.222.0.30 () {54 vars in 921 bytes} [Sun Sep 4 00:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:50:58.636364 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1ea52-9741-435d-8759-264026b86256 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:50:58.636781 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1ea52-9741-435d-8759-264026b86256 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:50:58.637162 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1ea52-9741-435d-8759-264026b86256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:50:58.737125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-46e1ea52-9741-435d-8759-264026b86256 None None] MFA Rules not processed for user `f908fda75ef8440cb6a0ef9440127d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:50:58.738470 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-46e1ea52-9741-435d-8759-264026b86256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:50:58.764430 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:50:58.881500 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 678/1351] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Sep 4 00:50:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 00:51:03.261631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e92e1-592b-4051-b6cd-26898c0380d6 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:03.262147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e92e1-592b-4051-b6cd-26898c0380d6 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:03.262147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e92e1-592b-4051-b6cd-26898c0380d6 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:03.263691 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 674/1352] 10.222.0.30 () {54 vars in 921 bytes} [Sun Sep 4 00:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:51:03.268600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cacbb-8730-4dd0-9796-775d21eeb6f8 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:03.269024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cacbb-8730-4dd0-9796-775d21eeb6f8 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:03.269192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cacbb-8730-4dd0-9796-775d21eeb6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:03.355800 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-fe2cacbb-8730-4dd0-9796-775d21eeb6f8 None None] MFA Rules not processed for user `f908fda75ef8440cb6a0ef9440127d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:51:03.357540 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-fe2cacbb-8730-4dd0-9796-775d21eeb6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:03.444838 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:51:03.501546 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 679/1353] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Sep 4 00:51:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:51:04.590201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccaab0-bfa9-44b0-992c-ea20cbb69550 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:04.590725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccaab0-bfa9-44b0-992c-ea20cbb69550 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:04.590725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccaab0-bfa9-44b0-992c-ea20cbb69550 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:04.592066 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 675/1354] 10.222.0.30 () {54 vars in 921 bytes} [Sun Sep 4 00:51:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:51:04.596940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bf99d-f034-434e-bcac-d7d34ded7e7d None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:04.597360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bf99d-f034-434e-bcac-d7d34ded7e7d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:04.597501 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bf99d-f034-434e-bcac-d7d34ded7e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:04.677933 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-6d6bf99d-f034-434e-bcac-d7d34ded7e7d None None] MFA Rules not processed for user `f908fda75ef8440cb6a0ef9440127d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:51:04.679137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6d6bf99d-f034-434e-bcac-d7d34ded7e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:04.786811 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 680/1355] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Sep 4 00:51:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:51:08.123310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ce381-df81-4a57-b9a6-419922e37f1b None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:08.123968 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ce381-df81-4a57-b9a6-419922e37f1b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:08.123968 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ce381-df81-4a57-b9a6-419922e37f1b None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:08.125300 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 676/1356] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:51:08.130485 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83033dd1-69a9-4269-a6ad-6e5ddafeede7 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:08.130916 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83033dd1-69a9-4269-a6ad-6e5ddafeede7 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:08.131029 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83033dd1-69a9-4269-a6ad-6e5ddafeede7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:08.174036 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:51:08.222765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-83033dd1-69a9-4269-a6ad-6e5ddafeede7 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:51:08.223959 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-83033dd1-69a9-4269-a6ad-6e5ddafeede7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:08.338562 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 681/1357] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:51:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:51:08.650710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d776ea8-5ef2-4190-bca7-286c3c9fca8c None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:08.651454 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d776ea8-5ef2-4190-bca7-286c3c9fca8c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:08.651984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d776ea8-5ef2-4190-bca7-286c3c9fca8c None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:08.653799 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 677/1358] 10.222.0.30 () {54 vars in 962 bytes} [Sun Sep 4 00:51:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:51:08.663127 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b883e-aa2a-4a57-8b64-3c10c9ff301b None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:08.663422 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b883e-aa2a-4a57-8b64-3c10c9ff301b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:08.663687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b883e-aa2a-4a57-8b64-3c10c9ff301b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:08.745554 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-cf4b883e-aa2a-4a57-8b64-3c10c9ff301b None None] MFA Rules not processed for user `13f0f341bf2c475d82b4e7b34d503dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:51:08.746705 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-cf4b883e-aa2a-4a57-8b64-3c10c9ff301b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:08.798160 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:51:08.872421 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 682/1359] 10.222.0.30 () {58 vars in 1059 bytes} [Sun Sep 4 00:51:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:51:08.880270 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d776ea8-5ef2-4190-bca7-286c3c9fca8c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:51:08.881898 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7d776ea8-5ef2-4190-bca7-286c3c9fca8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:09.035488 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d776ea8-5ef2-4190-bca7-286c3c9fca8c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:51:09.116731 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:51:09.160187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c48a2-2c79-479d-8e75-d0b93a4fbbde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:51:09.160872 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c48a2-2c79-479d-8e75-d0b93a4fbbde service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:09.161060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c48a2-2c79-479d-8e75-d0b93a4fbbde service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:09.161545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c48a2-2c79-479d-8e75-d0b93a4fbbde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:09.163139 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f46c48a2-2c79-479d-8e75-d0b93a4fbbde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:09.267073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c48a2-2c79-479d-8e75-d0b93a4fbbde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:51:09.268833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c48a2-2c79-479d-8e75-d0b93a4fbbde service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:51:09.287586 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 678/1360] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:51:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:51:11.436760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37953c-ce1c-42b4-9404-b5ae40c16706 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:11.437315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37953c-ce1c-42b4-9404-b5ae40c16706 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:11.437315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37953c-ce1c-42b4-9404-b5ae40c16706 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:11.441832 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 683/1361] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:51:11.447118 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ca7f4-bad8-46e1-abb0-01102e48f4ac None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:11.448475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ca7f4-bad8-46e1-abb0-01102e48f4ac None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:11.448893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ca7f4-bad8-46e1-abb0-01102e48f4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:11.518179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-cb6ca7f4-bad8-46e1-abb0-01102e48f4ac None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:51:11.519382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-cb6ca7f4-bad8-46e1-abb0-01102e48f4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:11.559599 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:51:11.633659 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 679/1362] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:51:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:51:11.928028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37953c-ce1c-42b4-9404-b5ae40c16706 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:51:11.929612 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ba37953c-ce1c-42b4-9404-b5ae40c16706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:12.096488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37953c-ce1c-42b4-9404-b5ae40c16706 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:51:12.107101 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:51:12.217214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334dd1b0-3e62-4984-b32a-bc35d0942bae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:51:12.217767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334dd1b0-3e62-4984-b32a-bc35d0942bae service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:12.218046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334dd1b0-3e62-4984-b32a-bc35d0942bae service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:12.218371 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334dd1b0-3e62-4984-b32a-bc35d0942bae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:12.219957 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-334dd1b0-3e62-4984-b32a-bc35d0942bae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:12.326437 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334dd1b0-3e62-4984-b32a-bc35d0942bae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:51:12.328242 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334dd1b0-3e62-4984-b32a-bc35d0942bae service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:51:12.348635 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 684/1363] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:51:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:51:15.064350 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cb7ce-070f-459c-b116-a89474bb4aac None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:15.066277 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cb7ce-070f-459c-b116-a89474bb4aac None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:15.067023 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cb7ce-070f-459c-b116-a89474bb4aac None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:15.069159 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 680/1364] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:51:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 04 00:51:15.075773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780604ab-cef4-41c1-810e-d3f1df90fc0b None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:15.076213 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780604ab-cef4-41c1-810e-d3f1df90fc0b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:15.076213 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780604ab-cef4-41c1-810e-d3f1df90fc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:15.093328 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:51:15.168250 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-780604ab-cef4-41c1-810e-d3f1df90fc0b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:51:15.169577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-780604ab-cef4-41c1-810e-d3f1df90fc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:15.316331 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 685/1365] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:51:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:51:15.605624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcc81e-800c-4078-8023-817f699a65ee None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:15.605909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcc81e-800c-4078-8023-817f699a65ee None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:15.606598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcc81e-800c-4078-8023-817f699a65ee None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:15.608074 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 681/1366] 10.222.0.30 () {54 vars in 962 bytes} [Sun Sep 4 00:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:51:15.614955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a534ab-f3b9-4f0c-9c42-cb1ae6c20bae None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:15.615363 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a534ab-f3b9-4f0c-9c42-cb1ae6c20bae None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:15.615727 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a534ab-f3b9-4f0c-9c42-cb1ae6c20bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:15.751501 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-61a534ab-f3b9-4f0c-9c42-cb1ae6c20bae None None] MFA Rules not processed for user `13f0f341bf2c475d82b4e7b34d503dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:51:15.752794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-61a534ab-f3b9-4f0c-9c42-cb1ae6c20bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:15.802302 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:51:15.893051 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 686/1367] 10.222.0.30 () {58 vars in 1059 bytes} [Sun Sep 4 00:51:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:51:15.901691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafcc81e-800c-4078-8023-817f699a65ee None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:51:15.903308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-bafcc81e-800c-4078-8023-817f699a65ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:16.076578 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafcc81e-800c-4078-8023-817f699a65ee None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:51:16.105739 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:51:16.221770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db289d4-2984-4d50-a38e-9d30bedd3833 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:51:16.222726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db289d4-2984-4d50-a38e-9d30bedd3833 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:16.223160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db289d4-2984-4d50-a38e-9d30bedd3833 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:16.223592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db289d4-2984-4d50-a38e-9d30bedd3833 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:16.226046 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4db289d4-2984-4d50-a38e-9d30bedd3833 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:16.366403 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db289d4-2984-4d50-a38e-9d30bedd3833 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:51:16.368368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db289d4-2984-4d50-a38e-9d30bedd3833 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:51:16.396164 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 682/1368] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:51:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:51:18.524855 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cc0e5-3b73-4fdb-ab33-1139f67f7ec8 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:18.525419 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cc0e5-3b73-4fdb-ab33-1139f67f7ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:18.525541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cc0e5-3b73-4fdb-ab33-1139f67f7ec8 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:18.527123 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 687/1369] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:51:18.532385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b7f40-f1e4-4eb2-892e-eca8bf2de806 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:18.533464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b7f40-f1e4-4eb2-892e-eca8bf2de806 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:18.533972 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b7f40-f1e4-4eb2-892e-eca8bf2de806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:18.569504 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:51:18.614543 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-0d1b7f40-f1e4-4eb2-892e-eca8bf2de806 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:51:18.616285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0d1b7f40-f1e4-4eb2-892e-eca8bf2de806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:18.733920 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 683/1370] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:51:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:51:19.042219 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cc0e5-3b73-4fdb-ab33-1139f67f7ec8 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:51:19.044020 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f10cc0e5-3b73-4fdb-ab33-1139f67f7ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:19.211956 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:51:19.221627 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cc0e5-3b73-4fdb-ab33-1139f67f7ec8 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:51:19.355195 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f52a4a-6e25-475b-a66f-94f964c65fc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:51:19.356672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f52a4a-6e25-475b-a66f-94f964c65fc3 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:19.357208 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f52a4a-6e25-475b-a66f-94f964c65fc3 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:19.357739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f52a4a-6e25-475b-a66f-94f964c65fc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:19.359702 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-74f52a4a-6e25-475b-a66f-94f964c65fc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:19.478330 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f52a4a-6e25-475b-a66f-94f964c65fc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:51:19.479958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f52a4a-6e25-475b-a66f-94f964c65fc3 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:51:19.497936 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:51:19.513868 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 688/1371] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:51:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:51:20.260319 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5534d-4e3c-4fc2-8bd1-22a82006b9ec None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:20.261263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5534d-4e3c-4fc2-8bd1-22a82006b9ec None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:20.261649 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5534d-4e3c-4fc2-8bd1-22a82006b9ec None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:20.263082 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 684/1372] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:51:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:51:20.268588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa054e7-7e42-498d-a2ab-19c3d55a18f2 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:20.269033 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa054e7-7e42-498d-a2ab-19c3d55a18f2 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:20.269607 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa054e7-7e42-498d-a2ab-19c3d55a18f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:20.338874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-baa054e7-7e42-498d-a2ab-19c3d55a18f2 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:51:20.339998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-baa054e7-7e42-498d-a2ab-19c3d55a18f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:20.445038 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 689/1373] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:51:21.054380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c77d56-8415-4b84-9110-de37780ed24a None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:21.054380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c77d56-8415-4b84-9110-de37780ed24a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:21.054380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c77d56-8415-4b84-9110-de37780ed24a None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:21.057679 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 685/1374] 10.222.0.30 () {54 vars in 964 bytes} [Sun Sep 4 00:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:51:21.061972 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcfe3b-4f14-46d6-8608-012ffbeb6155 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:21.062264 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcfe3b-4f14-46d6-8608-012ffbeb6155 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:21.062541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcfe3b-4f14-46d6-8608-012ffbeb6155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:21.143868 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-bbbcfe3b-4f14-46d6-8608-012ffbeb6155 None None] MFA Rules not processed for user `9108334da66445c2a0ba438c19850357`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:51:21.145002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bbbcfe3b-4f14-46d6-8608-012ffbeb6155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:21.167173 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:51:21.227400 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 690/1375] 10.222.0.30 () {58 vars in 1061 bytes} [Sun Sep 4 00:51:21 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:51:21.235225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c77d56-8415-4b84-9110-de37780ed24a None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:51:21.236728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a1c77d56-8415-4b84-9110-de37780ed24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:21.346105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c77d56-8415-4b84-9110-de37780ed24a None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:51:21.350238 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:51:21.426409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d3494-30d5-43fc-935f-e5f88fe2e070 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:51:21.426934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d3494-30d5-43fc-935f-e5f88fe2e070 service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:21.427211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d3494-30d5-43fc-935f-e5f88fe2e070 service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:21.427482 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d3494-30d5-43fc-935f-e5f88fe2e070 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:21.429055 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a10d3494-30d5-43fc-935f-e5f88fe2e070 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:21.552807 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d3494-30d5-43fc-935f-e5f88fe2e070 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:51:21.554373 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d3494-30d5-43fc-935f-e5f88fe2e070 service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:51:21.575963 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 686/1376] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:51:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:51:21.625866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39f827-a58e-42a0-a252-eaf60af0f104 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:21.626400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39f827-a58e-42a0-a252-eaf60af0f104 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:21.626496 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39f827-a58e-42a0-a252-eaf60af0f104 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:21.627773 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 691/1377] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:51:21.633121 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68b9ab-0db4-460d-bbf1-b8c04b9c1a63 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:21.633495 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68b9ab-0db4-460d-bbf1-b8c04b9c1a63 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:21.633833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68b9ab-0db4-460d-bbf1-b8c04b9c1a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:21.689711 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:51:21.717276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-aa68b9ab-0db4-460d-bbf1-b8c04b9c1a63 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:51:21.718531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-aa68b9ab-0db4-460d-bbf1-b8c04b9c1a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:21.821491 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 687/1378] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:51:22.114800 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39f827-a58e-42a0-a252-eaf60af0f104 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:51:22.116333 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-fb39f827-a58e-42a0-a252-eaf60af0f104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:22.319744 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39f827-a58e-42a0-a252-eaf60af0f104 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:51:22.348114 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:51:22.444164 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a22bd5-bf37-41b7-a75e-5feb482582c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:51:22.445149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a22bd5-bf37-41b7-a75e-5feb482582c0 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:22.445614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a22bd5-bf37-41b7-a75e-5feb482582c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:22.445891 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a22bd5-bf37-41b7-a75e-5feb482582c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:22.447742 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a0a22bd5-bf37-41b7-a75e-5feb482582c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:22.546562 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a22bd5-bf37-41b7-a75e-5feb482582c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:51:22.548163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a22bd5-bf37-41b7-a75e-5feb482582c0 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:51:22.567688 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 692/1379] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:51:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:51:24.523486 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01571d25-3392-4359-92e6-11fce0009f33 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:24.524015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01571d25-3392-4359-92e6-11fce0009f33 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:24.524015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01571d25-3392-4359-92e6-11fce0009f33 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:24.525378 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 688/1380] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:51:24.530688 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8677f83-3136-43dc-b392-08402148a51a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:24.531370 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8677f83-3136-43dc-b392-08402148a51a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:24.531370 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8677f83-3136-43dc-b392-08402148a51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:24.694313 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:51:24.739341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d8677f83-3136-43dc-b392-08402148a51a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:51:24.740566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d8677f83-3136-43dc-b392-08402148a51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:24.897466 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 693/1381] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:51:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 00:51:25.190835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01571d25-3392-4359-92e6-11fce0009f33 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:51:25.192635 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-01571d25-3392-4359-92e6-11fce0009f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:25.345057 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:51:25.425729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01571d25-3392-4359-92e6-11fce0009f33 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:51:25.570382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e374e0-5cd4-4aac-91bd-a3b9bbd662da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:51:25.571182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e374e0-5cd4-4aac-91bd-a3b9bbd662da service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:25.571628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e374e0-5cd4-4aac-91bd-a3b9bbd662da service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:25.571997 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e374e0-5cd4-4aac-91bd-a3b9bbd662da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:25.573818 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e7e374e0-5cd4-4aac-91bd-a3b9bbd662da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:25.667975 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:51:25.687999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e374e0-5cd4-4aac-91bd-a3b9bbd662da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:51:25.690734 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e374e0-5cd4-4aac-91bd-a3b9bbd662da service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:51:25.714619 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 689/1382] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:51:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:51:27.727907 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b042013-afe3-4aba-8b9f-c60be192b719 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:27.728357 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b042013-afe3-4aba-8b9f-c60be192b719 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:27.728479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b042013-afe3-4aba-8b9f-c60be192b719 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:27.730178 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 694/1383] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:51:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:51:27.735879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d839e-e963-4916-8d19-a92408781371 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:27.736348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d839e-e963-4916-8d19-a92408781371 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:27.736457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d839e-e963-4916-8d19-a92408781371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:27.815571 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e71d839e-e963-4916-8d19-a92408781371 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:51:27.816789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e71d839e-e963-4916-8d19-a92408781371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:27.922278 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 690/1384] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:51:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:51:28.224380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b042013-afe3-4aba-8b9f-c60be192b719 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:51:28.226238 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9b042013-afe3-4aba-8b9f-c60be192b719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:28.359082 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:51:28.412813 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b042013-afe3-4aba-8b9f-c60be192b719 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:51:28.576322 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6abaf5-c17a-463e-a61e-1b7a59486321 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:51:28.577070 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6abaf5-c17a-463e-a61e-1b7a59486321 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:28.578484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6abaf5-c17a-463e-a61e-1b7a59486321 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:28.578885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6abaf5-c17a-463e-a61e-1b7a59486321 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:28.580361 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5c6abaf5-c17a-463e-a61e-1b7a59486321 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:28.660003 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:51:28.679858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6abaf5-c17a-463e-a61e-1b7a59486321 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:51:28.682278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6abaf5-c17a-463e-a61e-1b7a59486321 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:51:28.701490 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 695/1385] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:51:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:51:30.686234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765a8e5-43fa-4760-b686-04621871e770 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:30.686764 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765a8e5-43fa-4760-b686-04621871e770 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:30.686861 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765a8e5-43fa-4760-b686-04621871e770 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:30.688184 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 691/1386] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:51:30.693361 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c86f8a-618a-45b2-a100-480c03e0095f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:30.693783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c86f8a-618a-45b2-a100-480c03e0095f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:30.693926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c86f8a-618a-45b2-a100-480c03e0095f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:30.759461 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-79c86f8a-618a-45b2-a100-480c03e0095f None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:51:30.760795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-79c86f8a-618a-45b2-a100-480c03e0095f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:30.873375 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 696/1387] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:51:31.242150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765a8e5-43fa-4760-b686-04621871e770 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:51:31.243799 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b765a8e5-43fa-4760-b686-04621871e770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:31.305259 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:51:31.395664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765a8e5-43fa-4760-b686-04621871e770 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:51:31.517492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6835ce0-6536-4fff-9c02-c6466ff2a174 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:51:31.518029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6835ce0-6536-4fff-9c02-c6466ff2a174 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:31.518292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6835ce0-6536-4fff-9c02-c6466ff2a174 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:31.518292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6835ce0-6536-4fff-9c02-c6466ff2a174 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:31.520115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e6835ce0-6536-4fff-9c02-c6466ff2a174 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:31.533019 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:51:31.617556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6835ce0-6536-4fff-9c02-c6466ff2a174 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:51:31.619191 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6835ce0-6536-4fff-9c02-c6466ff2a174 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:51:31.637818 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 692/1388] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:51:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 00:51:33.614837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8595d7-d129-4f09-9c92-ea7d56f73f1b None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:33.615374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8595d7-d129-4f09-9c92-ea7d56f73f1b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:33.615567 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8595d7-d129-4f09-9c92-ea7d56f73f1b None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:33.617388 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 697/1389] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:51:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:51:33.622792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24a899-c03f-4749-a2da-fbee047c48bd None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:33.623354 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24a899-c03f-4749-a2da-fbee047c48bd None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:33.623354 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24a899-c03f-4749-a2da-fbee047c48bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:33.689690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-3b24a899-c03f-4749-a2da-fbee047c48bd None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:51:33.690906 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3b24a899-c03f-4749-a2da-fbee047c48bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:33.793855 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:51:33.808336 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 693/1390] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:51:34.179519 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8595d7-d129-4f09-9c92-ea7d56f73f1b None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:51:34.181625 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4e8595d7-d129-4f09-9c92-ea7d56f73f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:34.257514 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:51:34.357679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8595d7-d129-4f09-9c92-ea7d56f73f1b None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:51:34.495882 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef60525-1f51-4b01-96e8-be9e2eeb0b9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:51:34.496729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef60525-1f51-4b01-96e8-be9e2eeb0b9a service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:34.497087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef60525-1f51-4b01-96e8-be9e2eeb0b9a service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:34.497466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef60525-1f51-4b01-96e8-be9e2eeb0b9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:34.499527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3ef60525-1f51-4b01-96e8-be9e2eeb0b9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:34.515334 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:51:34.609784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef60525-1f51-4b01-96e8-be9e2eeb0b9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:51:34.612006 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef60525-1f51-4b01-96e8-be9e2eeb0b9a service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:51:34.630510 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 698/1391] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:51:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:51:36.576353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddf384-2134-4715-ba87-d56ad65e4de6 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:36.576946 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddf384-2134-4715-ba87-d56ad65e4de6 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:36.576946 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddf384-2134-4715-ba87-d56ad65e4de6 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:36.578333 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 694/1392] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:51:36.583311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24997c02-72f3-4235-b501-b97a68cd7f03 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:36.583734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24997c02-72f3-4235-b501-b97a68cd7f03 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:36.583854 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24997c02-72f3-4235-b501-b97a68cd7f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:36.655627 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-24997c02-72f3-4235-b501-b97a68cd7f03 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:51:36.656924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-24997c02-72f3-4235-b501-b97a68cd7f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:36.740823 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:51:36.754070 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 699/1393] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:51:36.904751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1ab04-8e61-4f1b-a47a-363a50b9fc4d None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:36.905079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1ab04-8e61-4f1b-a47a-363a50b9fc4d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:36.905317 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1ab04-8e61-4f1b-a47a-363a50b9fc4d None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:36.906700 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 695/1394] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:51:36.912035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d87851-5488-47c7-b92b-1fd3af03e7a8 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:36.912318 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d87851-5488-47c7-b92b-1fd3af03e7a8 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:36.912589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d87851-5488-47c7-b92b-1fd3af03e7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:36.981736 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-39d87851-5488-47c7-b92b-1fd3af03e7a8 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:51:36.982921 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-39d87851-5488-47c7-b92b-1fd3af03e7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:37.057723 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1ab04-8e61-4f1b-a47a-363a50b9fc4d None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:51:37.059203 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e2b1ab04-8e61-4f1b-a47a-363a50b9fc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:37.078432 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 700/1395] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:51:37.203720 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1ab04-8e61-4f1b-a47a-363a50b9fc4d None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:51:37.266265 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:51:37.316612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd177e-d0a4-45c9-92d1-8f21445053f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:51:37.317208 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd177e-d0a4-45c9-92d1-8f21445053f1 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:37.317507 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd177e-d0a4-45c9-92d1-8f21445053f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:37.317779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd177e-d0a4-45c9-92d1-8f21445053f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:37.319813 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c2fd177e-d0a4-45c9-92d1-8f21445053f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:37.378266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f197a87-c877-47fe-8ead-dbf9eb6f0658 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:37.378553 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f197a87-c877-47fe-8ead-dbf9eb6f0658 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:37.378827 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f197a87-c877-47fe-8ead-dbf9eb6f0658 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:37.380167 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 701/1396] 10.222.0.30 () {54 vars in 961 bytes} [Sun Sep 4 00:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 04 00:51:37.385482 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cde26-5c04-4cb4-944b-341af16d2376 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:37.385766 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cde26-5c04-4cb4-944b-341af16d2376 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:37.386039 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cde26-5c04-4cb4-944b-341af16d2376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:37.415541 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd177e-d0a4-45c9-92d1-8f21445053f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:51:37.417139 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd177e-d0a4-45c9-92d1-8f21445053f1 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:51:37.436102 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 696/1397] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:51:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 00:51:37.463262 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-313cde26-5c04-4cb4-944b-341af16d2376 None None] MFA Rules not processed for user `efcee9b21ea94b1b8e5c9c5acb35839f`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:51:37.464391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-313cde26-5c04-4cb4-944b-341af16d2376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:37.473037 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:51:37.547908 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 702/1398] 10.222.0.30 () {58 vars in 1058 bytes} [Sun Sep 4 00:51:37 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 00:51:37.555418 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd177e-d0a4-45c9-92d1-8f21445053f1 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:51:37.556799 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c2fd177e-d0a4-45c9-92d1-8f21445053f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:37.642751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd177e-d0a4-45c9-92d1-8f21445053f1 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:51:37.651073 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:51:37.717497 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34417a03-18d2-4fef-b938-30c3ee5a901c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efcee9b21ea94b1b8e5c9c5acb35839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:51:37.718026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34417a03-18d2-4fef-b938-30c3ee5a901c service glance] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:37.718308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34417a03-18d2-4fef-b938-30c3ee5a901c service glance] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:37.718578 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34417a03-18d2-4fef-b938-30c3ee5a901c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:37.720205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-34417a03-18d2-4fef-b938-30c3ee5a901c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:37.829773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34417a03-18d2-4fef-b938-30c3ee5a901c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:51:37.831220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34417a03-18d2-4fef-b938-30c3ee5a901c service glance] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:51:37.850225 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 697/1399] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:51:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:51:38.596948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c2647-24a2-4a36-9635-ff70c98723fd None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:38.597728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c2647-24a2-4a36-9635-ff70c98723fd None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:38.598099 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c2647-24a2-4a36-9635-ff70c98723fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:38.668710 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d14c2647-24a2-4a36-9635-ff70c98723fd None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:51:38.669920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d14c2647-24a2-4a36-9635-ff70c98723fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:38.755683 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 703/1400] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 00:51:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:51:38.802331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5eb540-a0a1-4212-8173-57218da174fc None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:38.802822 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5eb540-a0a1-4212-8173-57218da174fc None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:38.802932 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5eb540-a0a1-4212-8173-57218da174fc None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:38.804238 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 698/1401] 10.222.0.30 () {54 vars in 943 bytes} [Sun Sep 4 00:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:51:38.811109 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514c441-663d-483c-8391-f9368ea418c4 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:38.811535 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514c441-663d-483c-8391-f9368ea418c4 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:38.811943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514c441-663d-483c-8391-f9368ea418c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:38.843090 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:51:38.890700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a514c441-663d-483c-8391-f9368ea418c4 None None] MFA Rules not processed for user `9bcc7a857fad4310896da5a87e71baed`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:51:38.891908 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a514c441-663d-483c-8391-f9368ea418c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:38.998185 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 704/1402] 10.222.0.30 () {58 vars in 1040 bytes} [Sun Sep 4 00:51:38 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:51:39.007450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5eb540-a0a1-4212-8173-57218da174fc None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:51:39.009517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fb5eb540-a0a1-4212-8173-57218da174fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:39.054171 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:51:39.153034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5eb540-a0a1-4212-8173-57218da174fc None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:51:39.254970 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3769b3-3585-469d-a67a-c17eca2bdd50 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:51:39.255575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3769b3-3585-469d-a67a-c17eca2bdd50 service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:39.255848 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3769b3-3585-469d-a67a-c17eca2bdd50 service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:39.256116 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3769b3-3585-469d-a67a-c17eca2bdd50 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:39.257729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ec3769b3-3585-469d-a67a-c17eca2bdd50 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:39.279792 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:51:39.342688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3769b3-3585-469d-a67a-c17eca2bdd50 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:51:39.344389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3769b3-3585-469d-a67a-c17eca2bdd50 service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:51:39.352856 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 699/1403] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 00:51:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 04 00:51:39.400771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35487a65-4033-4efd-90b1-ffab3eb1e902 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:39.401138 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35487a65-4033-4efd-90b1-ffab3eb1e902 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:39.401459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35487a65-4033-4efd-90b1-ffab3eb1e902 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:39.405662 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 705/1404] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:51:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:51:39.408396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d8bfb-6d5e-49c2-a27c-660a8edb9808 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:39.409033 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d8bfb-6d5e-49c2-a27c-660a8edb9808 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:39.409613 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d8bfb-6d5e-49c2-a27c-660a8edb9808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:39.493771 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-210d8bfb-6d5e-49c2-a27c-660a8edb9808 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:51:39.495012 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-210d8bfb-6d5e-49c2-a27c-660a8edb9808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:39.603613 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 700/1405] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:51:39.890129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35487a65-4033-4efd-90b1-ffab3eb1e902 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:51:39.891638 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-35487a65-4033-4efd-90b1-ffab3eb1e902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:39.990458 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:51:40.071920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35487a65-4033-4efd-90b1-ffab3eb1e902 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:51:40.202465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061a1d5-6418-41c6-ae97-6872d2428210 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:51:40.203116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061a1d5-6418-41c6-ae97-6872d2428210 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:40.203392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061a1d5-6418-41c6-ae97-6872d2428210 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:40.203659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061a1d5-6418-41c6-ae97-6872d2428210 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:40.205263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5061a1d5-6418-41c6-ae97-6872d2428210 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:40.267161 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:51:40.314058 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061a1d5-6418-41c6-ae97-6872d2428210 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:51:40.315654 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061a1d5-6418-41c6-ae97-6872d2428210 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:51:40.334446 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 706/1406] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:51:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:51:42.397949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a165ad-4481-4bd0-bdb3-0532f8eea972 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:42.398522 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a165ad-4481-4bd0-bdb3-0532f8eea972 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:42.398522 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a165ad-4481-4bd0-bdb3-0532f8eea972 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:42.404535 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 701/1407] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:51:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:51:42.406260 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8b235-8b00-4b4b-92a8-3ce76e916c87 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:42.406743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8b235-8b00-4b4b-92a8-3ce76e916c87 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:42.406889 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8b235-8b00-4b4b-92a8-3ce76e916c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:42.483965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-1ce8b235-8b00-4b4b-92a8-3ce76e916c87 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:51:42.485192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1ce8b235-8b00-4b4b-92a8-3ce76e916c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:42.597325 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 707/1408] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 00:51:42.892857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a165ad-4481-4bd0-bdb3-0532f8eea972 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:51:42.894409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-76a165ad-4481-4bd0-bdb3-0532f8eea972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:42.909124 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:51:43.056985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a165ad-4481-4bd0-bdb3-0532f8eea972 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:51:43.156725 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:51:43.186330 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003f8e3-15df-45c3-9e13-2f441facbae0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:51:43.186943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003f8e3-15df-45c3-9e13-2f441facbae0 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:51:43.187222 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003f8e3-15df-45c3-9e13-2f441facbae0 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:51:43.187498 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003f8e3-15df-45c3-9e13-2f441facbae0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:51:43.189096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5003f8e3-15df-45c3-9e13-2f441facbae0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:51:43.290376 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003f8e3-15df-45c3-9e13-2f441facbae0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:51:43.292283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003f8e3-15df-45c3-9e13-2f441facbae0 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:51:43.311429 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 702/1409] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:51:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:51:52.595180 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:51:53.309079 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=56 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:01.703732 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12800947-b186-4a38-acfb-459789d4ee1e None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:01.704275 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12800947-b186-4a38-acfb-459789d4ee1e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:01.704275 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12800947-b186-4a38-acfb-459789d4ee1e None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:01.705547 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 708/1410] 10.222.0.30 () {54 vars in 918 bytes} [Sun Sep 4 00:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:52:01.711346 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a0058-af7d-47da-90a2-3176b67a5bd5 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:01.711772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a0058-af7d-47da-90a2-3176b67a5bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:01.711922 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a0058-af7d-47da-90a2-3176b67a5bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:01.786834 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-570a0058-af7d-47da-90a2-3176b67a5bd5 None None] MFA Rules not processed for user `f908fda75ef8440cb6a0ef9440127d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:52:01.788032 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-570a0058-af7d-47da-90a2-3176b67a5bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:01.900673 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 703/1411] 10.222.0.30 () {58 vars in 1015 bytes} [Sun Sep 4 00:52:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:52:01.914673 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21315b57-c5b3-4ff5-9835-75aab6a60188 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:01.914960 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21315b57-c5b3-4ff5-9835-75aab6a60188 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:01.915232 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21315b57-c5b3-4ff5-9835-75aab6a60188 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:01.916577 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 709/1412] 10.222.0.30 () {54 vars in 918 bytes} [Sun Sep 4 00:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:52:01.921852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238618a-79cc-464d-813c-196c368c2115 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:01.922141 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238618a-79cc-464d-813c-196c368c2115 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:01.922417 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238618a-79cc-464d-813c-196c368c2115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:01.994105 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:01.996670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-4238618a-79cc-464d-813c-196c368c2115 None None] MFA Rules not processed for user `13f0f341bf2c475d82b4e7b34d503dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:52:01.998401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4238618a-79cc-464d-813c-196c368c2115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:02.111173 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 704/1413] 10.222.0.30 () {58 vars in 1015 bytes} [Sun Sep 4 00:52:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 00:52:04.492024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600970a2-45d6-48ee-bb8b-6173361058f1 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:04.492558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600970a2-45d6-48ee-bb8b-6173361058f1 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:04.492558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600970a2-45d6-48ee-bb8b-6173361058f1 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:04.494003 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 4 00:52:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:52:04.499359 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c6e96-52b0-4a42-8cc6-69368fffa184 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:04.499812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c6e96-52b0-4a42-8cc6-69368fffa184 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:04.499919 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c6e96-52b0-4a42-8cc6-69368fffa184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:04.564278 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-6b9c6e96-52b0-4a42-8cc6-69368fffa184 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:52:04.565507 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6b9c6e96-52b0-4a42-8cc6-69368fffa184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:04.619711 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:04.660164 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 4 00:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:52:04.946443 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600970a2-45d6-48ee-bb8b-6173361058f1 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:52:04.948137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-600970a2-45d6-48ee-bb8b-6173361058f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:05.094150 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600970a2-45d6-48ee-bb8b-6173361058f1 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:52:05.167108 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:05.207335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7f2ea-cbce-4d3c-a41b-40c6fca9da22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:52:05.207885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7f2ea-cbce-4d3c-a41b-40c6fca9da22 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:05.208165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7f2ea-cbce-4d3c-a41b-40c6fca9da22 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:05.208443 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7f2ea-cbce-4d3c-a41b-40c6fca9da22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:05.210598 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-88d7f2ea-cbce-4d3c-a41b-40c6fca9da22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:05.297420 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d7f2ea-cbce-4d3c-a41b-40c6fca9da22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:52:05.299019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d7f2ea-cbce-4d3c-a41b-40c6fca9da22 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:52:05.316557 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 711/1416] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:52:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:52:06.196300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee14ba-a82a-42cd-a466-34ce6f1ddafe None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:06.196868 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee14ba-a82a-42cd-a466-34ce6f1ddafe None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:06.196868 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee14ba-a82a-42cd-a466-34ce6f1ddafe None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:06.198220 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 4 00:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:52:06.203284 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca1235-df8d-45a7-8611-19afc6a7ef7a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:06.203692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca1235-df8d-45a7-8611-19afc6a7ef7a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:06.203826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca1235-df8d-45a7-8611-19afc6a7ef7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:06.278304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-77ca1235-df8d-45a7-8611-19afc6a7ef7a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:52:06.279485 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-77ca1235-df8d-45a7-8611-19afc6a7ef7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:06.305712 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:06.376086 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 4 00:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:52:06.542257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee14ba-a82a-42cd-a466-34ce6f1ddafe None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:52:06.543773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-91ee14ba-a82a-42cd-a466-34ce6f1ddafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:06.687661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee14ba-a82a-42cd-a466-34ce6f1ddafe None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:52:06.726395 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:06.801218 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f731c3-4679-4775-ab3b-285effcf143e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:52:06.801856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f731c3-4679-4775-ab3b-285effcf143e service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:06.802162 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f731c3-4679-4775-ab3b-285effcf143e service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:06.802440 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f731c3-4679-4775-ab3b-285effcf143e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:06.804662 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c6f731c3-4679-4775-ab3b-285effcf143e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:06.897642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f731c3-4679-4775-ab3b-285effcf143e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:52:06.899239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f731c3-4679-4775-ab3b-285effcf143e service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:52:06.917201 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 707/1419] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:52:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:52:07.829407 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972e3b4-bb3e-4704-b39e-344ce56b26d3 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:07.830002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972e3b4-bb3e-4704-b39e-344ce56b26d3 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:07.830002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972e3b4-bb3e-4704-b39e-344ce56b26d3 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:07.831340 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 4 00:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:52:07.836346 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1ae87-477c-4fb4-8838-8a614f155838 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:07.836753 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1ae87-477c-4fb4-8838-8a614f155838 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:07.836891 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1ae87-477c-4fb4-8838-8a614f155838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:07.891362 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:07.913089 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-b2b1ae87-477c-4fb4-8838-8a614f155838 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:52:07.914322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b2b1ae87-477c-4fb4-8838-8a614f155838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:08.008946 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 4 00:52:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:52:08.158833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972e3b4-bb3e-4704-b39e-344ce56b26d3 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:52:08.160329 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a972e3b4-bb3e-4704-b39e-344ce56b26d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:08.303611 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972e3b4-bb3e-4704-b39e-344ce56b26d3 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:52:08.315502 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:08.417281 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea37b74-961b-4bd1-a6f9-e62b78cfecab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:52:08.417840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea37b74-961b-4bd1-a6f9-e62b78cfecab service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:08.418113 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea37b74-961b-4bd1-a6f9-e62b78cfecab service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:08.418378 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea37b74-961b-4bd1-a6f9-e62b78cfecab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:08.419936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2ea37b74-961b-4bd1-a6f9-e62b78cfecab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:08.508177 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea37b74-961b-4bd1-a6f9-e62b78cfecab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:52:08.509800 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea37b74-961b-4bd1-a6f9-e62b78cfecab service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:52:08.527418 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 714/1422] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:52:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:52:09.392136 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60d608-9579-4482-af45-50d581d50d1d None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:09.392588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60d608-9579-4482-af45-50d581d50d1d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:09.392691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60d608-9579-4482-af45-50d581d50d1d None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:09.394045 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 4 00:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:52:09.399444 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70611efa-0225-403e-a27f-aba913679267 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:09.399864 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70611efa-0225-403e-a27f-aba913679267 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:09.399972 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70611efa-0225-403e-a27f-aba913679267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:09.419943 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:09.476811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-70611efa-0225-403e-a27f-aba913679267 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:52:09.478035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-70611efa-0225-403e-a27f-aba913679267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:09.572582 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 4 00:52:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:52:09.724242 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60d608-9579-4482-af45-50d581d50d1d None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:52:09.725718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4d60d608-9579-4482-af45-50d581d50d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:09.836114 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:09.871044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60d608-9579-4482-af45-50d581d50d1d None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:52:09.981161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039d4e3-7f14-45b1-9bd8-fa8898d0ee6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:52:09.981716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039d4e3-7f14-45b1-9bd8-fa8898d0ee6e service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:09.981997 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039d4e3-7f14-45b1-9bd8-fa8898d0ee6e service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:09.982266 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039d4e3-7f14-45b1-9bd8-fa8898d0ee6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:09.983840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d039d4e3-7f14-45b1-9bd8-fa8898d0ee6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:10.059254 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:10.073670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d039d4e3-7f14-45b1-9bd8-fa8898d0ee6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:52:10.075552 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d039d4e3-7f14-45b1-9bd8-fa8898d0ee6e service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:52:10.096161 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 710/1425] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:52:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:52:10.958712 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91763ea-9ff0-4812-a653-34c7de7417e1 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:10.959259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91763ea-9ff0-4812-a653-34c7de7417e1 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:10.959259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91763ea-9ff0-4812-a653-34c7de7417e1 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:10.961103 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 4 00:52:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:52:10.965937 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f593a3-14c3-4442-9ef6-536293e2366b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:10.966338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f593a3-14c3-4442-9ef6-536293e2366b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:10.966482 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f593a3-14c3-4442-9ef6-536293e2366b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:11.042018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-52f593a3-14c3-4442-9ef6-536293e2366b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:52:11.043206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-52f593a3-14c3-4442-9ef6-536293e2366b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:11.136302 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 4 00:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:52:11.283993 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91763ea-9ff0-4812-a653-34c7de7417e1 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:52:11.285571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d91763ea-9ff0-4812-a653-34c7de7417e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:11.370679 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:11.432741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91763ea-9ff0-4812-a653-34c7de7417e1 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:52:11.544604 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7e2ee-0606-4f02-9bc6-95dcc9e960cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:52:11.545144 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7e2ee-0606-4f02-9bc6-95dcc9e960cb service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:11.545417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7e2ee-0606-4f02-9bc6-95dcc9e960cb service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:11.545714 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7e2ee-0606-4f02-9bc6-95dcc9e960cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:11.547280 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-efb7e2ee-0606-4f02-9bc6-95dcc9e960cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:11.597675 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:11.641161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7e2ee-0606-4f02-9bc6-95dcc9e960cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:52:11.642781 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7e2ee-0606-4f02-9bc6-95dcc9e960cb service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:52:11.661267 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 717/1428] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:52:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:52:12.453402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda56f15-809d-4a24-ba2f-885ca4db72c2 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:12.453850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda56f15-809d-4a24-ba2f-885ca4db72c2 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:12.453987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda56f15-809d-4a24-ba2f-885ca4db72c2 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:12.455343 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 4 00:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:52:12.460755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e91ea-b1de-4726-ad38-8ce2996ee0b4 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:12.461175 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e91ea-b1de-4726-ad38-8ce2996ee0b4 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:12.461304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e91ea-b1de-4726-ad38-8ce2996ee0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:12.539101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-469e91ea-b1de-4726-ad38-8ce2996ee0b4 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:52:12.540298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-469e91ea-b1de-4726-ad38-8ce2996ee0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:12.636694 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 4 00:52:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:52:12.786532 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda56f15-809d-4a24-ba2f-885ca4db72c2 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:52:12.788545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-dda56f15-809d-4a24-ba2f-885ca4db72c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:12.835761 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:12.930848 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda56f15-809d-4a24-ba2f-885ca4db72c2 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:52:13.045074 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76996851-8063-4db5-9917-acb818bfd5ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:52:13.045720 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76996851-8063-4db5-9917-acb818bfd5ba service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:13.046001 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76996851-8063-4db5-9917-acb818bfd5ba service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:13.046270 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76996851-8063-4db5-9917-acb818bfd5ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:13.047862 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-76996851-8063-4db5-9917-acb818bfd5ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:13.054854 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:13.136284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76996851-8063-4db5-9917-acb818bfd5ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:52:13.137910 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76996851-8063-4db5-9917-acb818bfd5ba service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:52:13.155855 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 713/1431] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:52:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:52:13.954260 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13341161-db49-4f85-859e-639846c18f3d None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:13.954822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13341161-db49-4f85-859e-639846c18f3d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:13.954822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13341161-db49-4f85-859e-639846c18f3d None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:13.956184 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 4 00:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:52:13.961621 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623d9be-fe9d-4d6f-a61f-f581f943492a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:13.962005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623d9be-fe9d-4d6f-a61f-f581f943492a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:13.962164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623d9be-fe9d-4d6f-a61f-f581f943492a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:14.035961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e623d9be-fe9d-4d6f-a61f-f581f943492a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:52:14.037189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e623d9be-fe9d-4d6f-a61f-f581f943492a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:14.103476 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:14.132945 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 4 00:52:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:52:14.282712 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13341161-db49-4f85-859e-639846c18f3d None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:52:14.284142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-13341161-db49-4f85-859e-639846c18f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:14.301530 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:14.433455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13341161-db49-4f85-859e-639846c18f3d None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:52:14.527265 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:14.553257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575837f-e522-4f6c-94b0-41bb83f79c2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:52:14.554352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575837f-e522-4f6c-94b0-41bb83f79c2d service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:14.554634 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575837f-e522-4f6c-94b0-41bb83f79c2d service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:14.554902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575837f-e522-4f6c-94b0-41bb83f79c2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:14.556493 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5575837f-e522-4f6c-94b0-41bb83f79c2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:14.647242 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575837f-e522-4f6c-94b0-41bb83f79c2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:52:14.648839 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575837f-e522-4f6c-94b0-41bb83f79c2d service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:52:14.666697 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 720/1434] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:52:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:52:15.473840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02b318-d143-4fd0-90ea-2ec48cb039da None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:15.474311 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02b318-d143-4fd0-90ea-2ec48cb039da None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:15.474415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02b318-d143-4fd0-90ea-2ec48cb039da None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:15.476412 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 4 00:52:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:52:15.481471 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc47949-0d0c-4b5b-b643-df2f5f827555 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:15.481884 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc47949-0d0c-4b5b-b643-df2f5f827555 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:15.482020 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc47949-0d0c-4b5b-b643-df2f5f827555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:15.555982 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-bdc47949-0d0c-4b5b-b643-df2f5f827555 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:52:15.557168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bdc47949-0d0c-4b5b-b643-df2f5f827555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:15.597677 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:15.652663 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 4 00:52:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:52:15.804075 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02b318-d143-4fd0-90ea-2ec48cb039da None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:52:15.805598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-af02b318-d143-4fd0-90ea-2ec48cb039da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:15.946873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02b318-d143-4fd0-90ea-2ec48cb039da None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:52:16.000135 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:16.058050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea2863-3a99-4bdc-96cb-ba40cd027237 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:52:16.058655 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea2863-3a99-4bdc-96cb-ba40cd027237 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:16.058937 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea2863-3a99-4bdc-96cb-ba40cd027237 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:16.059213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea2863-3a99-4bdc-96cb-ba40cd027237 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:16.060807 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-46ea2863-3a99-4bdc-96cb-ba40cd027237 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:16.149413 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea2863-3a99-4bdc-96cb-ba40cd027237 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:52:16.151073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea2863-3a99-4bdc-96cb-ba40cd027237 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:52:16.169163 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 716/1437] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:52:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:52:16.976670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49288bc8-1524-48e8-9940-069112696166 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:16.977230 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49288bc8-1524-48e8-9940-069112696166 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:16.977230 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49288bc8-1524-48e8-9940-069112696166 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:16.978604 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 4 00:52:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:52:16.983815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ddb30-5cf1-4360-9241-7d04ac8e0355 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:16.984232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ddb30-5cf1-4360-9241-7d04ac8e0355 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:16.984367 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ddb30-5cf1-4360-9241-7d04ac8e0355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:17.059237 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-0b0ddb30-5cf1-4360-9241-7d04ac8e0355 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:52:17.060431 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0b0ddb30-5cf1-4360-9241-7d04ac8e0355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:17.062427 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:17.158905 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 4 00:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:52:17.312892 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49288bc8-1524-48e8-9940-069112696166 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:52:17.314463 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-49288bc8-1524-48e8-9940-069112696166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:17.460450 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49288bc8-1524-48e8-9940-069112696166 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:52:17.487655 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:17.573353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f77b7-df27-43ae-a893-06d683c16c9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:52:17.574003 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f77b7-df27-43ae-a893-06d683c16c9f service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:17.574282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f77b7-df27-43ae-a893-06d683c16c9f service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:17.574553 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f77b7-df27-43ae-a893-06d683c16c9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:17.576168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-979f77b7-df27-43ae-a893-06d683c16c9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:17.664915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f77b7-df27-43ae-a893-06d683c16c9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:52:17.666533 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f77b7-df27-43ae-a893-06d683c16c9f service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:52:17.684536 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 723/1440] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:52:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:52:19.511715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbde983-b977-4f3f-9f74-df84d4861d41 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:19.512258 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbde983-b977-4f3f-9f74-df84d4861d41 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:19.512258 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbde983-b977-4f3f-9f74-df84d4861d41 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:19.513748 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 4 00:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:52:19.518859 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05128d40-b4b0-4d9e-8d26-4aa73740095c None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:19.519287 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05128d40-b4b0-4d9e-8d26-4aa73740095c None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:19.519397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05128d40-b4b0-4d9e-8d26-4aa73740095c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:19.559921 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:19.585802 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-05128d40-b4b0-4d9e-8d26-4aa73740095c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:52:19.587218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-05128d40-b4b0-4d9e-8d26-4aa73740095c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:19.683375 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 4 00:52:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:52:19.966155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbde983-b977-4f3f-9f74-df84d4861d41 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:52:19.967722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-abbde983-b977-4f3f-9f74-df84d4861d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:20.069677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbde983-b977-4f3f-9f74-df84d4861d41 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:52:20.102141 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:20.143659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da092de6-5d55-4bfc-b471-002d2f252347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:52:20.144400 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da092de6-5d55-4bfc-b471-002d2f252347 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:20.144558 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da092de6-5d55-4bfc-b471-002d2f252347 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:20.144828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da092de6-5d55-4bfc-b471-002d2f252347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:20.146676 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-da092de6-5d55-4bfc-b471-002d2f252347 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:20.261538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da092de6-5d55-4bfc-b471-002d2f252347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:52:20.262935 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da092de6-5d55-4bfc-b471-002d2f252347 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:52:20.395941 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 719/1443] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:52:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:52:22.434718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaefe5c-cb7c-4d61-8e44-8259d7f74ba7 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:22.435294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaefe5c-cb7c-4d61-8e44-8259d7f74ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:22.435294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaefe5c-cb7c-4d61-8e44-8259d7f74ba7 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:22.436620 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 4 00:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:52:22.441819 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d26d2-c3d9-4f3a-9b6a-cc153264516b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:22.442256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d26d2-c3d9-4f3a-9b6a-cc153264516b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:22.442355 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d26d2-c3d9-4f3a-9b6a-cc153264516b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:22.507756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-434d26d2-c3d9-4f3a-9b6a-cc153264516b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:52:22.508933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-434d26d2-c3d9-4f3a-9b6a-cc153264516b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:22.522958 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:22.609958 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 4 00:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:52:22.898918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaefe5c-cb7c-4d61-8e44-8259d7f74ba7 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:52:22.900480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bcaefe5c-cb7c-4d61-8e44-8259d7f74ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:23.002822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaefe5c-cb7c-4d61-8e44-8259d7f74ba7 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:52:23.014838 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:23.075928 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e5e7c-6eb8-4dfe-9b71-4032ba50133b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:52:23.076532 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e5e7c-6eb8-4dfe-9b71-4032ba50133b service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:23.076814 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e5e7c-6eb8-4dfe-9b71-4032ba50133b service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:23.077094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e5e7c-6eb8-4dfe-9b71-4032ba50133b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:23.078700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-497e5e7c-6eb8-4dfe-9b71-4032ba50133b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:23.187492 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e5e7c-6eb8-4dfe-9b71-4032ba50133b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:52:23.188840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e5e7c-6eb8-4dfe-9b71-4032ba50133b service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:52:23.208972 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 726/1446] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:52:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:52:25.396291 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebb0d8-538d-4514-84a7-6e8abd9b7ade None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:25.396885 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebb0d8-538d-4514-84a7-6e8abd9b7ade None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:25.396885 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebb0d8-538d-4514-84a7-6e8abd9b7ade None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:25.398763 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 4 00:52:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:52:25.403819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29a85d-a430-4473-bef0-d95ac775aff0 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:25.404241 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29a85d-a430-4473-bef0-d95ac775aff0 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:25.404360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29a85d-a430-4473-bef0-d95ac775aff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:25.452995 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:25.470970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-fe29a85d-a430-4473-bef0-d95ac775aff0 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:52:25.472171 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-fe29a85d-a430-4473-bef0-d95ac775aff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:25.570341 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 4 00:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:52:25.858595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebb0d8-538d-4514-84a7-6e8abd9b7ade None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:52:25.860117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a2ebb0d8-538d-4514-84a7-6e8abd9b7ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:25.960524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebb0d8-538d-4514-84a7-6e8abd9b7ade None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:52:25.999470 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:26.032412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a538b-53e0-41a8-9188-24dd601ef31a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:52:26.033008 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a538b-53e0-41a8-9188-24dd601ef31a service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:26.033285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a538b-53e0-41a8-9188-24dd601ef31a service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:26.033584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a538b-53e0-41a8-9188-24dd601ef31a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:26.035156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-717a538b-53e0-41a8-9188-24dd601ef31a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:26.141709 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a538b-53e0-41a8-9188-24dd601ef31a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:52:26.143147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a538b-53e0-41a8-9188-24dd601ef31a service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:52:26.161176 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 722/1449] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:52:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:52:28.201859 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a36da8-470a-40c2-bbf4-7f3ae5bbd52e None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:28.202426 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a36da8-470a-40c2-bbf4-7f3ae5bbd52e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:28.202426 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a36da8-470a-40c2-bbf4-7f3ae5bbd52e None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:28.203744 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 4 00:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:52:28.209031 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc349eef-caf4-4816-807f-a15d7a1ecb40 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:28.209484 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc349eef-caf4-4816-807f-a15d7a1ecb40 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:28.210158 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc349eef-caf4-4816-807f-a15d7a1ecb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:28.275128 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-fc349eef-caf4-4816-807f-a15d7a1ecb40 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:52:28.276326 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fc349eef-caf4-4816-807f-a15d7a1ecb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:28.301109 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:28.376617 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 4 00:52:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:52:28.661490 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a36da8-470a-40c2-bbf4-7f3ae5bbd52e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:52:28.663592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d6a36da8-470a-40c2-bbf4-7f3ae5bbd52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:28.766146 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a36da8-470a-40c2-bbf4-7f3ae5bbd52e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:52:28.787421 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:28.840898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54beb8f1-6448-44d3-98ad-af539bc69309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:52:28.841534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54beb8f1-6448-44d3-98ad-af539bc69309 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:28.841815 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54beb8f1-6448-44d3-98ad-af539bc69309 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:28.842086 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54beb8f1-6448-44d3-98ad-af539bc69309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:28.843679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-54beb8f1-6448-44d3-98ad-af539bc69309 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:28.965909 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54beb8f1-6448-44d3-98ad-af539bc69309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:52:28.967412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54beb8f1-6448-44d3-98ad-af539bc69309 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:52:28.989366 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 729/1452] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:52:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:52:30.939302 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ce2fd-c766-43fe-a701-84fe13cc4c29 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:30.939863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ce2fd-c766-43fe-a701-84fe13cc4c29 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:30.939863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ce2fd-c766-43fe-a701-84fe13cc4c29 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:30.941148 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 4 00:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:52:30.946820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c66cfe-c7ad-4db6-b385-9cb3b1c58273 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:30.947228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c66cfe-c7ad-4db6-b385-9cb3b1c58273 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:30.947371 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c66cfe-c7ad-4db6-b385-9cb3b1c58273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:31.011027 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:31.014519 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-24c66cfe-c7ad-4db6-b385-9cb3b1c58273 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:52:31.016111 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-24c66cfe-c7ad-4db6-b385-9cb3b1c58273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:31.110807 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 4 00:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 00:52:31.390229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ce2fd-c766-43fe-a701-84fe13cc4c29 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:52:31.391787 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c04ce2fd-c766-43fe-a701-84fe13cc4c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:31.493013 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ce2fd-c766-43fe-a701-84fe13cc4c29 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:52:31.540340 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:31.564585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894a88f-c8d7-4887-81ad-575e600a5124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:52:31.565214 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894a88f-c8d7-4887-81ad-575e600a5124 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:31.565526 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894a88f-c8d7-4887-81ad-575e600a5124 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:31.565797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894a88f-c8d7-4887-81ad-575e600a5124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:31.567376 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a894a88f-c8d7-4887-81ad-575e600a5124 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:31.673073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a894a88f-c8d7-4887-81ad-575e600a5124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:52:31.674459 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a894a88f-c8d7-4887-81ad-575e600a5124 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:52:31.692797 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 725/1455] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:52:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:52:33.648227 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5be51-ee74-4dec-b7ed-ccb5e13c7d55 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:33.648799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5be51-ee74-4dec-b7ed-ccb5e13c7d55 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:33.648799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5be51-ee74-4dec-b7ed-ccb5e13c7d55 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:33.650191 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 4 00:52:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:52:33.655631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5975a-a54f-4dc2-8a06-027d404bbaab None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:33.656044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5975a-a54f-4dc2-8a06-027d404bbaab None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:33.656180 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5975a-a54f-4dc2-8a06-027d404bbaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:33.721575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-b7e5975a-a54f-4dc2-8a06-027d404bbaab None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:52:33.722699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b7e5975a-a54f-4dc2-8a06-027d404bbaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:33.750522 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:33.816427 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 4 00:52:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:52:34.102311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5be51-ee74-4dec-b7ed-ccb5e13c7d55 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:52:34.103823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b8d5be51-ee74-4dec-b7ed-ccb5e13c7d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:34.204407 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5be51-ee74-4dec-b7ed-ccb5e13c7d55 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:52:34.233127 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:34.278818 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8cba0b-6c75-4e58-94b4-04a824eeb8f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:52:34.279335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8cba0b-6c75-4e58-94b4-04a824eeb8f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:34.279613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8cba0b-6c75-4e58-94b4-04a824eeb8f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:34.279911 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8cba0b-6c75-4e58-94b4-04a824eeb8f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:34.281538 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6b8cba0b-6c75-4e58-94b4-04a824eeb8f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:34.389683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8cba0b-6c75-4e58-94b4-04a824eeb8f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:52:34.391122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8cba0b-6c75-4e58-94b4-04a824eeb8f0 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:52:34.411085 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 732/1458] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:52:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:52:36.356164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba71cc-7d73-4021-9e06-d295a88014ca None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:36.356981 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba71cc-7d73-4021-9e06-d295a88014ca None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:36.356981 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba71cc-7d73-4021-9e06-d295a88014ca None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:36.358367 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 4 00:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:52:36.363691 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945c90d-cb8b-4a6a-a156-9f288a49d8e3 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:36.364083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945c90d-cb8b-4a6a-a156-9f288a49d8e3 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:36.364232 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945c90d-cb8b-4a6a-a156-9f288a49d8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:36.429295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-1945c90d-cb8b-4a6a-a156-9f288a49d8e3 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:52:36.430507 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1945c90d-cb8b-4a6a-a156-9f288a49d8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:36.438549 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:36.527836 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 4 00:52:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:52:36.808090 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba71cc-7d73-4021-9e06-d295a88014ca None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:52:36.809658 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-51ba71cc-7d73-4021-9e06-d295a88014ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:36.911429 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba71cc-7d73-4021-9e06-d295a88014ca None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:52:36.964958 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:36.982811 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59b453-eb97-4885-b594-f00553a06469 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:52:36.983411 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59b453-eb97-4885-b594-f00553a06469 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:36.983690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59b453-eb97-4885-b594-f00553a06469 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:36.983962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59b453-eb97-4885-b594-f00553a06469 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:36.985570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2b59b453-eb97-4885-b594-f00553a06469 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:37.091296 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59b453-eb97-4885-b594-f00553a06469 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:52:37.092649 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59b453-eb97-4885-b594-f00553a06469 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:52:37.111492 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 728/1461] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:52:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:52:39.071762 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532e3d8-22d2-4d0a-b986-bc1bec8ee5cb None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:39.072303 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532e3d8-22d2-4d0a-b986-bc1bec8ee5cb None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:39.072303 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532e3d8-22d2-4d0a-b986-bc1bec8ee5cb None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:39.073709 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 4 00:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:52:39.079070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d5acf-a769-49e8-b30c-0fa8be03a3e9 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:39.079514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d5acf-a769-49e8-b30c-0fa8be03a3e9 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:39.079613 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d5acf-a769-49e8-b30c-0fa8be03a3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:39.145149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e86d5acf-a769-49e8-b30c-0fa8be03a3e9 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:52:39.146371 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e86d5acf-a769-49e8-b30c-0fa8be03a3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:39.184195 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:39.240585 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 4 00:52:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:52:39.528488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532e3d8-22d2-4d0a-b986-bc1bec8ee5cb None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:52:39.530043 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a532e3d8-22d2-4d0a-b986-bc1bec8ee5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:39.631134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532e3d8-22d2-4d0a-b986-bc1bec8ee5cb None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:52:39.668133 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:39.703314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ecad33-4515-45b8-b71a-192840ac3dbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:52:39.703921 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecad33-4515-45b8-b71a-192840ac3dbf service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:39.704197 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecad33-4515-45b8-b71a-192840ac3dbf service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:39.704468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecad33-4515-45b8-b71a-192840ac3dbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:39.706078 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-30ecad33-4515-45b8-b71a-192840ac3dbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:39.812638 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ecad33-4515-45b8-b71a-192840ac3dbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:52:39.814102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ecad33-4515-45b8-b71a-192840ac3dbf service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:52:39.832517 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 735/1464] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:52:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:52:41.830149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c287c-b378-41cc-9106-8db1951d9d36 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:41.830675 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c287c-b378-41cc-9106-8db1951d9d36 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:41.830675 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c287c-b378-41cc-9106-8db1951d9d36 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:41.831931 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 4 00:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:52:41.837592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1514c8a-41b6-484d-a282-b4b9896c91f1 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:41.838015 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1514c8a-41b6-484d-a282-b4b9896c91f1 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:41.838165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1514c8a-41b6-484d-a282-b4b9896c91f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:41.905064 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-f1514c8a-41b6-484d-a282-b4b9896c91f1 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:52:41.906297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f1514c8a-41b6-484d-a282-b4b9896c91f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:41.923810 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:42.002237 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 4 00:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:52:42.282309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c287c-b378-41cc-9106-8db1951d9d36 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:52:42.283898 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-858c287c-b378-41cc-9106-8db1951d9d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:42.384284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c287c-b378-41cc-9106-8db1951d9d36 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:52:42.448624 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:42.455859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c415453-7c3e-49db-a676-59a1e1b2075a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:52:42.456462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c415453-7c3e-49db-a676-59a1e1b2075a service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:42.456735 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c415453-7c3e-49db-a676-59a1e1b2075a service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:42.457004 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c415453-7c3e-49db-a676-59a1e1b2075a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:42.458614 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7c415453-7c3e-49db-a676-59a1e1b2075a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:42.568212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c415453-7c3e-49db-a676-59a1e1b2075a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:52:42.570239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c415453-7c3e-49db-a676-59a1e1b2075a service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:52:42.588836 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 731/1467] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:52:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:52:44.498176 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b09d0-3b86-4d8f-9ee1-99b55645b3af None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:44.498708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b09d0-3b86-4d8f-9ee1-99b55645b3af None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:44.498708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b09d0-3b86-4d8f-9ee1-99b55645b3af None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:44.500099 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 4 00:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:52:44.505558 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0caedfc-3497-4ae0-ac1c-b61568183550 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:44.505979 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0caedfc-3497-4ae0-ac1c-b61568183550 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:44.506148 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0caedfc-3497-4ae0-ac1c-b61568183550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:44.570584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e0caedfc-3497-4ae0-ac1c-b61568183550 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:52:44.571774 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e0caedfc-3497-4ae0-ac1c-b61568183550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:44.627461 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:44.675242 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 4 00:52:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:52:44.961686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b09d0-3b86-4d8f-9ee1-99b55645b3af None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:52:44.963219 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-186b09d0-3b86-4d8f-9ee1-99b55645b3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:45.064217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b09d0-3b86-4d8f-9ee1-99b55645b3af None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:52:45.111554 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:45.137425 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64dd8b-1ed6-42fb-9a1d-d19879f50ce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:52:45.138047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64dd8b-1ed6-42fb-9a1d-d19879f50ce3 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:52:45.138327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64dd8b-1ed6-42fb-9a1d-d19879f50ce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:52:45.138599 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64dd8b-1ed6-42fb-9a1d-d19879f50ce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:52:45.140182 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-cd64dd8b-1ed6-42fb-9a1d-d19879f50ce3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:52:45.247045 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd64dd8b-1ed6-42fb-9a1d-d19879f50ce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:52:45.248380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd64dd8b-1ed6-42fb-9a1d-d19879f50ce3 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:52:45.266553 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 738/1470] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:52:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:52:54.673447 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=22 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:52:55.264356 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=66 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:53:04.825145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b277ba4-679a-41fe-baf6-682f93e7e920 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:53:04.825702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b277ba4-679a-41fe-baf6-682f93e7e920 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:53:04.825702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b277ba4-679a-41fe-baf6-682f93e7e920 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:53:04.827024 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 733/1471] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:53:04.832490 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b41fd8-5494-4507-9c58-96c45553bc3a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:53:04.832942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b41fd8-5494-4507-9c58-96c45553bc3a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:53:04.833055 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b41fd8-5494-4507-9c58-96c45553bc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:53:04.899276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c5b41fd8-5494-4507-9c58-96c45553bc3a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:53:04.900460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c5b41fd8-5494-4507-9c58-96c45553bc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:53:04.996105 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 739/1472] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:53:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:53:05.292078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e40d5-b8e1-454f-88f5-b702833e1a57 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:53:05.292361 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e40d5-b8e1-454f-88f5-b702833e1a57 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:53:05.292636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e40d5-b8e1-454f-88f5-b702833e1a57 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:53:05.294061 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 734/1473] 10.222.0.30 () {54 vars in 961 bytes} [Sun Sep 4 00:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:53:05.299050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548acfe-aa2b-4559-8f53-c515f701e478 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:53:05.299336 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548acfe-aa2b-4559-8f53-c515f701e478 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:53:05.299608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548acfe-aa2b-4559-8f53-c515f701e478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:53:05.374883 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5548acfe-aa2b-4559-8f53-c515f701e478 None None] MFA Rules not processed for user `efcee9b21ea94b1b8e5c9c5acb35839f`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:53:05.376067 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5548acfe-aa2b-4559-8f53-c515f701e478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:53:05.395686 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:53:05.450715 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 740/1474] 10.222.0.30 () {58 vars in 1058 bytes} [Sun Sep 4 00:53:05 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:53:05.458294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e40d5-b8e1-454f-88f5-b702833e1a57 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:53:05.459793 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b08e40d5-b8e1-454f-88f5-b702833e1a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:53:05.560758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e40d5-b8e1-454f-88f5-b702833e1a57 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:53:05.631464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b576e96-08d3-4a0f-842f-6ade974f8f95 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efcee9b21ea94b1b8e5c9c5acb35839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:53:05.632085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b576e96-08d3-4a0f-842f-6ade974f8f95 service glance] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:53:05.632361 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b576e96-08d3-4a0f-842f-6ade974f8f95 service glance] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:53:05.632630 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b576e96-08d3-4a0f-842f-6ade974f8f95 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:53:05.634226 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3b576e96-08d3-4a0f-842f-6ade974f8f95 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:53:05.686984 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:53:05.742389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b576e96-08d3-4a0f-842f-6ade974f8f95 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:53:05.743829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b576e96-08d3-4a0f-842f-6ade974f8f95 service glance] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:53:05.761664 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 735/1475] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:53:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:53:07.728228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950dc01-3eaf-45a1-a7db-a2ad3a4d32eb None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:53:07.728748 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950dc01-3eaf-45a1-a7db-a2ad3a4d32eb None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:53:07.728748 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950dc01-3eaf-45a1-a7db-a2ad3a4d32eb None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:53:07.730079 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 741/1476] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:53:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:53:07.735616 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48bc8c-5764-420a-92b9-2964786848ea None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:53:07.736051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48bc8c-5764-420a-92b9-2964786848ea None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:53:07.736148 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48bc8c-5764-420a-92b9-2964786848ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:53:07.799551 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-cd48bc8c-5764-420a-92b9-2964786848ea None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:53:07.800735 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-cd48bc8c-5764-420a-92b9-2964786848ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:53:07.896004 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 736/1477] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:53:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:53:08.171994 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950dc01-3eaf-45a1-a7db-a2ad3a4d32eb None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:53:08.173563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0950dc01-3eaf-45a1-a7db-a2ad3a4d32eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:53:08.297021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950dc01-3eaf-45a1-a7db-a2ad3a4d32eb None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:53:08.346142 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:53:08.393166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a2109-838c-4cb6-af80-93712cbb3cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:53:08.393814 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a2109-838c-4cb6-af80-93712cbb3cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:53:08.394094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a2109-838c-4cb6-af80-93712cbb3cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:53:08.394362 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a2109-838c-4cb6-af80-93712cbb3cb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:53:08.394995 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a2109-838c-4cb6-af80-93712cbb3cb9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:53:08.396760 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-eb9a2109-838c-4cb6-af80-93712cbb3cb9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 00:53:08.396760 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 00:53:08.396760 n-d-master-1 devstack@keystone.service[81825]: Sep 04 00:53:08.398045 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a2109-838c-4cb6-af80-93712cbb3cb9 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:53:08.418285 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 742/1478] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Sep 4 00:53:08 2022] GET /identity/v3/projects => generated 2553 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 00:53:10.349027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd652c-d166-43e2-9125-760fc6e75a05 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:53:10.349585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd652c-d166-43e2-9125-760fc6e75a05 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:53:10.349585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd652c-d166-43e2-9125-760fc6e75a05 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:53:10.350930 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 737/1479] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:53:10.357058 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96593cb-b686-4879-95c8-f0eb7a2c0356 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:53:10.357867 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96593cb-b686-4879-95c8-f0eb7a2c0356 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:53:10.357867 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96593cb-b686-4879-95c8-f0eb7a2c0356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:53:10.438425 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d96593cb-b686-4879-95c8-f0eb7a2c0356 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:53:10.439575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d96593cb-b686-4879-95c8-f0eb7a2c0356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:53:10.545643 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 743/1480] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:53:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:53:10.843570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd652c-d166-43e2-9125-760fc6e75a05 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:53:10.846024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-76bd652c-d166-43e2-9125-760fc6e75a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:53:10.856603 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:53:10.991782 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd652c-d166-43e2-9125-760fc6e75a05 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:53:11.071854 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:53:11.103965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c08c90-6255-40d7-9aeb-5388c0dbae0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:53:11.104477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c08c90-6255-40d7-9aeb-5388c0dbae0f service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:53:11.104751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c08c90-6255-40d7-9aeb-5388c0dbae0f service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:53:11.105020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c08c90-6255-40d7-9aeb-5388c0dbae0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:53:11.106615 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e1c08c90-6255-40d7-9aeb-5388c0dbae0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:53:11.193743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c08c90-6255-40d7-9aeb-5388c0dbae0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:53:11.195314 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c08c90-6255-40d7-9aeb-5388c0dbae0f service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:53:11.213621 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 738/1481] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:53:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:53:13.291644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835c389-9ec4-4eef-8584-4161667a3eed None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:53:13.292172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835c389-9ec4-4eef-8584-4161667a3eed None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:53:13.292172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835c389-9ec4-4eef-8584-4161667a3eed None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:53:13.293479 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 744/1482] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 04 00:53:13.298815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98f6de-0374-4ef5-a290-587d4e55cce0 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:53:13.299240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98f6de-0374-4ef5-a290-587d4e55cce0 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:53:13.299338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98f6de-0374-4ef5-a290-587d4e55cce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:53:13.363753 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-3b98f6de-0374-4ef5-a290-587d4e55cce0 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:53:13.364943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3b98f6de-0374-4ef5-a290-587d4e55cce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:53:13.410214 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:53:13.458859 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 739/1483] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:53:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 00:53:13.740993 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835c389-9ec4-4eef-8584-4161667a3eed None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:53:13.743165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c835c389-9ec4-4eef-8584-4161667a3eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:53:13.768345 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:53:13.851356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835c389-9ec4-4eef-8584-4161667a3eed None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:53:13.924116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ff966-95c4-49ea-a702-2e55a054b6d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:53:13.924721 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ff966-95c4-49ea-a702-2e55a054b6d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:53:13.925000 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ff966-95c4-49ea-a702-2e55a054b6d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:53:13.925266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ff966-95c4-49ea-a702-2e55a054b6d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:53:13.926865 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c69ff966-95c4-49ea-a702-2e55a054b6d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:53:13.998703 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:53:14.036792 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ff966-95c4-49ea-a702-2e55a054b6d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:53:14.038246 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ff966-95c4-49ea-a702-2e55a054b6d0 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:53:14.056635 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 745/1484] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:53:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:53:16.019709 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17839d5d-097b-46b5-ab61-d96abd51ef87 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:53:16.020290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17839d5d-097b-46b5-ab61-d96abd51ef87 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:53:16.020290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17839d5d-097b-46b5-ab61-d96abd51ef87 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:53:16.021609 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 740/1485] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:53:16.026772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b496f5-9826-40e1-ae2b-f209d000b20d None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:53:16.027158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b496f5-9826-40e1-ae2b-f209d000b20d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:53:16.027325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b496f5-9826-40e1-ae2b-f209d000b20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:53:16.094089 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-12b496f5-9826-40e1-ae2b-f209d000b20d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:53:16.095217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-12b496f5-9826-40e1-ae2b-f209d000b20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:53:16.190247 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 746/1486] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:53:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:53:16.476070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17839d5d-097b-46b5-ab61-d96abd51ef87 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:53:16.477663 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-17839d5d-097b-46b5-ab61-d96abd51ef87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:53:16.578911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17839d5d-097b-46b5-ab61-d96abd51ef87 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:53:16.648404 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:53:16.651070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f3bbd-d164-4391-9a11-aba804913ad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:53:16.651855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f3bbd-d164-4391-9a11-aba804913ad1 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:53:16.652295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f3bbd-d164-4391-9a11-aba804913ad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:53:16.652576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f3bbd-d164-4391-9a11-aba804913ad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:53:16.654372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-609f3bbd-d164-4391-9a11-aba804913ad1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:53:16.760123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f3bbd-d164-4391-9a11-aba804913ad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:53:16.761587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f3bbd-d164-4391-9a11-aba804913ad1 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:53:16.779955 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 741/1487] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:53:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:53:18.792445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519b9ea-0d2b-42bf-af19-d267c35bbb72 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:53:18.792973 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519b9ea-0d2b-42bf-af19-d267c35bbb72 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:53:18.792973 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519b9ea-0d2b-42bf-af19-d267c35bbb72 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:53:18.794324 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 747/1488] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:53:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:53:18.799551 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf9058-7da8-4e38-8f84-79465a90b122 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:53:18.799952 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf9058-7da8-4e38-8f84-79465a90b122 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:53:18.800092 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf9058-7da8-4e38-8f84-79465a90b122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:53:18.864559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-dbbf9058-7da8-4e38-8f84-79465a90b122 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:53:18.865787 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-dbbf9058-7da8-4e38-8f84-79465a90b122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:53:18.916558 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:53:18.959303 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 742/1489] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:53:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:53:19.261748 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519b9ea-0d2b-42bf-af19-d267c35bbb72 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:53:19.263310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e519b9ea-0d2b-42bf-af19-d267c35bbb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:53:19.298415 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:53:19.365778 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519b9ea-0d2b-42bf-af19-d267c35bbb72 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:53:19.441816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d37d2-7b1a-446c-96a6-e00910ef085f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:53:19.442435 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d37d2-7b1a-446c-96a6-e00910ef085f service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:53:19.442713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d37d2-7b1a-446c-96a6-e00910ef085f service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:53:19.443011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d37d2-7b1a-446c-96a6-e00910ef085f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:53:19.444650 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-640d37d2-7b1a-446c-96a6-e00910ef085f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:53:19.524822 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:53:19.553263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d37d2-7b1a-446c-96a6-e00910ef085f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:53:19.554715 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d37d2-7b1a-446c-96a6-e00910ef085f service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:53:19.573484 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 748/1490] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:53:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:53:21.673870 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764edc62-2c71-4e03-897f-8d3b23ecb99b None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:53:21.674422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764edc62-2c71-4e03-897f-8d3b23ecb99b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:53:21.674422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764edc62-2c71-4e03-897f-8d3b23ecb99b None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:53:21.675730 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 743/1491] 10.222.0.30 () {54 vars in 927 bytes} [Sun Sep 4 00:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:53:21.680794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfff838-4417-4d19-8324-cfbba95439b5 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:53:21.681238 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfff838-4417-4d19-8324-cfbba95439b5 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:53:21.681335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfff838-4417-4d19-8324-cfbba95439b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:53:21.747639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-0cfff838-4417-4d19-8324-cfbba95439b5 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:53:21.748755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0cfff838-4417-4d19-8324-cfbba95439b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:53:21.845224 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 749/1492] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Sep 4 00:53:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:53:22.131309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764edc62-2c71-4e03-897f-8d3b23ecb99b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:53:22.133465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-764edc62-2c71-4e03-897f-8d3b23ecb99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:53:22.235424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764edc62-2c71-4e03-897f-8d3b23ecb99b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:53:22.305585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a85b7b-25aa-4751-8b36-5c5f93325ffc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:53:22.306178 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a85b7b-25aa-4751-8b36-5c5f93325ffc service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:53:22.306451 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a85b7b-25aa-4751-8b36-5c5f93325ffc service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:53:22.306716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a85b7b-25aa-4751-8b36-5c5f93325ffc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:53:22.308262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d7a85b7b-25aa-4751-8b36-5c5f93325ffc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:53:22.316954 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:53:22.413570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a85b7b-25aa-4751-8b36-5c5f93325ffc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:53:22.415499 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a85b7b-25aa-4751-8b36-5c5f93325ffc service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:53:22.433351 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 744/1493] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:53:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:53:31.843427 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=82 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:53:32.431193 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=50 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:54:33.650680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6546ebf-b830-413f-ae39-d6be0a9f0ae9 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:54:33.651289 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6546ebf-b830-413f-ae39-d6be0a9f0ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:54:33.651289 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6546ebf-b830-413f-ae39-d6be0a9f0ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:54:33.725128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-f6546ebf-b830-413f-ae39-d6be0a9f0ae9 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:54:33.726780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f6546ebf-b830-413f-ae39-d6be0a9f0ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:54:33.822655 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 750/1494] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 00:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:54:33.830475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588328a3-80a7-4181-a29b-c1cf2ed4aff8 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:54:33.830981 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588328a3-80a7-4181-a29b-c1cf2ed4aff8 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:54:33.831091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588328a3-80a7-4181-a29b-c1cf2ed4aff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:54:33.905351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-588328a3-80a7-4181-a29b-c1cf2ed4aff8 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:54:33.906575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-588328a3-80a7-4181-a29b-c1cf2ed4aff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:54:34.000365 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 745/1495] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 00:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:54:34.004845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6546ebf-b830-413f-ae39-d6be0a9f0ae9 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:54:34.006061 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f6546ebf-b830-413f-ae39-d6be0a9f0ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:54:34.017117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6546ebf-b830-413f-ae39-d6be0a9f0ae9 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:54:34.076209 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:54:34.109975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651dd87-88fe-4234-bbd0-19b4854ffd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:54:34.110569 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651dd87-88fe-4234-bbd0-19b4854ffd5c admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:54:34.110840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651dd87-88fe-4234-bbd0-19b4854ffd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:54:34.111105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651dd87-88fe-4234-bbd0-19b4854ffd5c admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:54:34.111729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651dd87-88fe-4234-bbd0-19b4854ffd5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:54:34.112023 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651dd87-88fe-4234-bbd0-19b4854ffd5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:54:34.113010 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-3651dd87-88fe-4234-bbd0-19b4854ffd5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 00:54:34.113010 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 00:54:34.113010 n-d-master-1 devstack@keystone.service[81825]: Sep 04 00:54:34.113911 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651dd87-88fe-4234-bbd0-19b4854ffd5c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:54:34.124603 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 751/1496] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 00:54:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:54:34.132953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588328a3-80a7-4181-a29b-c1cf2ed4aff8 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:54:34.141956 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588328a3-80a7-4181-a29b-c1cf2ed4aff8 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:54:34.201940 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:54:34.236227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b506c-7960-4c5f-a8c7-9e0549240ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:54:34.236835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b506c-7960-4c5f-a8c7-9e0549240ca8 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:54:34.237110 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b506c-7960-4c5f-a8c7-9e0549240ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:54:34.237379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b506c-7960-4c5f-a8c7-9e0549240ca8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:54:34.238049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b506c-7960-4c5f-a8c7-9e0549240ca8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:54:34.239754 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-671b506c-7960-4c5f-a8c7-9e0549240ca8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 00:54:34.239754 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 00:54:34.239754 n-d-master-1 devstack@keystone.service[81824]: Sep 04 00:54:34.240940 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b506c-7960-4c5f-a8c7-9e0549240ca8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:54:34.296322 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 746/1497] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 00:54:34 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:54:34.300483 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651dd87-88fe-4234-bbd0-19b4854ffd5c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:54:34.302026 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3651dd87-88fe-4234-bbd0-19b4854ffd5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:54:34.335523 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651dd87-88fe-4234-bbd0-19b4854ffd5c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:54:34.428949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246ee58-3732-4aab-955b-0dca1cbb2f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:54:34.429588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246ee58-3732-4aab-955b-0dca1cbb2f94 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:54:34.429869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246ee58-3732-4aab-955b-0dca1cbb2f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:54:34.430141 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246ee58-3732-4aab-955b-0dca1cbb2f94 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:54:34.430759 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246ee58-3732-4aab-955b-0dca1cbb2f94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:54:34.431827 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-7246ee58-3732-4aab-955b-0dca1cbb2f94 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 00:54:34.431827 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 00:54:34.431827 n-d-master-1 devstack@keystone.service[81825]: Sep 04 00:54:34.433031 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246ee58-3732-4aab-955b-0dca1cbb2f94 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:54:34.480329 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 752/1498] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 00:54:34 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:54:34.485032 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b506c-7960-4c5f-a8c7-9e0549240ca8 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:54:34.486583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-671b506c-7960-4c5f-a8c7-9e0549240ca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:54:34.547069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b506c-7960-4c5f-a8c7-9e0549240ca8 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:54:34.628312 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:54:34.639313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40431a-dd32-4ff4-8932-f8386405b7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:54:34.639908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40431a-dd32-4ff4-8932-f8386405b7e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:54:34.640242 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40431a-dd32-4ff4-8932-f8386405b7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:54:34.640522 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40431a-dd32-4ff4-8932-f8386405b7e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:54:34.641161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40431a-dd32-4ff4-8932-f8386405b7e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:54:34.642241 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-7d40431a-dd32-4ff4-8932-f8386405b7e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 00:54:34.642241 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 00:54:34.642241 n-d-master-1 devstack@keystone.service[81824]: Sep 04 00:54:34.643135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40431a-dd32-4ff4-8932-f8386405b7e1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:54:34.655652 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 747/1499] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 00:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 00:54:34.659839 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246ee58-3732-4aab-955b-0dca1cbb2f94 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:54:34.661346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7246ee58-3732-4aab-955b-0dca1cbb2f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:54:34.673233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246ee58-3732-4aab-955b-0dca1cbb2f94 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:54:34.698516 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:54:34.768189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bf353-f9af-4eba-82ee-e287d56e1c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:54:34.768792 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bf353-f9af-4eba-82ee-e287d56e1c0c admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:54:34.769070 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bf353-f9af-4eba-82ee-e287d56e1c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:54:34.769340 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bf353-f9af-4eba-82ee-e287d56e1c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:54:34.769997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6bf353-f9af-4eba-82ee-e287d56e1c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:54:34.770998 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-1c6bf353-f9af-4eba-82ee-e287d56e1c0c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 00:54:34.770998 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 00:54:34.770998 n-d-master-1 devstack@keystone.service[81825]: Sep 04 00:54:34.771963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6bf353-f9af-4eba-82ee-e287d56e1c0c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:54:34.784889 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 753/1500] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 00:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 00:54:34.789791 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40431a-dd32-4ff4-8932-f8386405b7e1 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:54:34.791303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7d40431a-dd32-4ff4-8932-f8386405b7e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:54:34.823712 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40431a-dd32-4ff4-8932-f8386405b7e1 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:54:34.915866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e2976-5325-4da9-b402-8f5a57ff0e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:54:34.916528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e2976-5325-4da9-b402-8f5a57ff0e98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:54:34.916776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e2976-5325-4da9-b402-8f5a57ff0e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:54:34.917045 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e2976-5325-4da9-b402-8f5a57ff0e98 admin admin] PATH_INFO: `/v3/projects/0482ffb1011a4773a6c787c417b9cede/users/cdec7cbc8fa84c98bb9d5e2e1066b882/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:54:34.938170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e2976-5325-4da9-b402-8f5a57ff0e98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0482ffb1011a4773a6c787c417b9cede, user_id=cdec7cbc8fa84c98bb9d5e2e1066b882, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:54:34.939191 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-575e2976-5325-4da9-b402-8f5a57ff0e98 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 00:54:34.939191 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 00:54:34.939191 n-d-master-1 devstack@keystone.service[81824]: Sep 04 00:54:34.941127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e2976-5325-4da9-b402-8f5a57ff0e98 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:54:34.965150 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 748/1501] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 00:54:34 2022] PUT /identity/v3/projects/0482ffb1011a4773a6c787c417b9cede/users/cdec7cbc8fa84c98bb9d5e2e1066b882/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:54:34.978149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156d359-f456-4655-8d3e-b4a0388b1bba None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:54:34.978446 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156d359-f456-4655-8d3e-b4a0388b1bba None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:54:34.978703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156d359-f456-4655-8d3e-b4a0388b1bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:54:35.035481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b156d359-f456-4655-8d3e-b4a0388b1bba None None] MFA Rules not processed for user `cdec7cbc8fa84c98bb9d5e2e1066b882`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:54:35.036670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b156d359-f456-4655-8d3e-b4a0388b1bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:54:35.111378 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 754/1502] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 00:54:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:54:35.124396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e4d7e-5f9b-4ca3-aaab-d40d018b0bda None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:54:35.124679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e4d7e-5f9b-4ca3-aaab-d40d018b0bda None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:54:35.124950 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e4d7e-5f9b-4ca3-aaab-d40d018b0bda None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:54:35.126327 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 749/1503] 10.222.0.30 () {54 vars in 964 bytes} [Sun Sep 4 00:54:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:54:35.131090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a29bb1-c1a7-4093-89d7-b7ec12eaf93d None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:54:35.131380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a29bb1-c1a7-4093-89d7-b7ec12eaf93d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:54:35.132145 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a29bb1-c1a7-4093-89d7-b7ec12eaf93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:54:35.163722 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:54:35.207229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d3a29bb1-c1a7-4093-89d7-b7ec12eaf93d None None] MFA Rules not processed for user `9108334da66445c2a0ba438c19850357`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:54:35.208422 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d3a29bb1-c1a7-4093-89d7-b7ec12eaf93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:54:35.285399 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 755/1504] 10.222.0.30 () {58 vars in 1061 bytes} [Sun Sep 4 00:54:35 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:54:35.293044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e4d7e-5f9b-4ca3-aaab-d40d018b0bda None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:54:35.294575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-183e4d7e-5f9b-4ca3-aaab-d40d018b0bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:54:35.345858 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:54:35.398941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e4d7e-5f9b-4ca3-aaab-d40d018b0bda None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:54:35.472180 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc887f04-a5a7-4d04-8775-5d6334ec9f0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:54:35.472783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc887f04-a5a7-4d04-8775-5d6334ec9f0a service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:54:35.473060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc887f04-a5a7-4d04-8775-5d6334ec9f0a service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:54:35.473329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc887f04-a5a7-4d04-8775-5d6334ec9f0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:54:35.474930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fc887f04-a5a7-4d04-8775-5d6334ec9f0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:54:35.571428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc887f04-a5a7-4d04-8775-5d6334ec9f0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:54:35.572860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc887f04-a5a7-4d04-8775-5d6334ec9f0a service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:54:35.576216 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:54:35.590528 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 750/1505] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:54:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:54:35.635763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a148d21-2054-4102-a18a-99b838d89b66 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:54:35.636046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a148d21-2054-4102-a18a-99b838d89b66 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:54:35.636323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a148d21-2054-4102-a18a-99b838d89b66 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:54:35.637627 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 756/1506] 10.222.0.30 () {52 vars in 830 bytes} [Sun Sep 4 00:54:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:54:35.641123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc887f04-a5a7-4d04-8775-5d6334ec9f0a service cinder] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:54:35.642353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fc887f04-a5a7-4d04-8775-5d6334ec9f0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:54:35.738592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc887f04-a5a7-4d04-8775-5d6334ec9f0a service cinder] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:54:35.830512 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a5b9b-1e94-410e-95a8-c063b2c7c9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:54:35.831136 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a5b9b-1e94-410e-95a8-c063b2c7c9df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:54:35.831409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a5b9b-1e94-410e-95a8-c063b2c7c9df admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:54:35.831674 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a5b9b-1e94-410e-95a8-c063b2c7c9df admin admin] PATH_INFO: `/v3/users/cdec7cbc8fa84c98bb9d5e2e1066b882` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:54:35.844565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6a5b9b-1e94-410e-95a8-c063b2c7c9df admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdec7cbc8fa84c98bb9d5e2e1066b882)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:54:35.845622 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-fe6a5b9b-1e94-410e-95a8-c063b2c7c9df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 00:54:35.845622 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 00:54:35.845622 n-d-master-1 devstack@keystone.service[81824]: Sep 04 00:54:35.846824 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6a5b9b-1e94-410e-95a8-c063b2c7c9df admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:54:35.857106 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:54:35.910156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fe6a5b9b-1e94-410e-95a8-c063b2c7c9df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdec7cbc8fa84c98bb9d5e2e1066b882'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 00:54:35.910591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fe6a5b9b-1e94-410e-95a8-c063b2c7c9df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdec7cbc8fa84c98bb9d5e2e1066b882'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 00:54:35.924786 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fe6a5b9b-1e94-410e-95a8-c063b2c7c9df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdec7cbc8fa84c98bb9d5e2e1066b882'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 00:54:35.934296 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fe6a5b9b-1e94-410e-95a8-c063b2c7c9df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdec7cbc8fa84c98bb9d5e2e1066b882'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 00:54:35.934853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fe6a5b9b-1e94-410e-95a8-c063b2c7c9df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdec7cbc8fa84c98bb9d5e2e1066b882'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 00:54:35.962995 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 751/1507] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 00:54:35 2022] DELETE /identity/v3/users/cdec7cbc8fa84c98bb9d5e2e1066b882 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:54:35.967491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30099e-43a6-4093-b3e7-773edd75adc7 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:54:35.967998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30099e-43a6-4093-b3e7-773edd75adc7 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:54:35.968105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30099e-43a6-4093-b3e7-773edd75adc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:54:36.033563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-3d30099e-43a6-4093-b3e7-773edd75adc7 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:54:36.034697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3d30099e-43a6-4093-b3e7-773edd75adc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:54:36.122778 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:54:36.136226 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 757/1508] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 00:54:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:54:36.145824 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a5b9b-1e94-410e-95a8-c063b2c7c9df admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:54:36.147068 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fe6a5b9b-1e94-410e-95a8-c063b2c7c9df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:54:36.247544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a5b9b-1e94-410e-95a8-c063b2c7c9df admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:54:36.301479 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:54:36.322186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb1ec5-1135-486f-8925-2cd4b6312161 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:54:36.322796 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb1ec5-1135-486f-8925-2cd4b6312161 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:54:36.323073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb1ec5-1135-486f-8925-2cd4b6312161 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:54:36.323342 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb1ec5-1135-486f-8925-2cd4b6312161 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:54:36.324915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5efb1ec5-1135-486f-8925-2cd4b6312161 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:54:36.431731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb1ec5-1135-486f-8925-2cd4b6312161 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:54:36.433179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb1ec5-1135-486f-8925-2cd4b6312161 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:54:36.452836 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 752/1509] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:54:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:54:36.807495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30099e-43a6-4093-b3e7-773edd75adc7 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:54:36.808746 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3d30099e-43a6-4093-b3e7-773edd75adc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:54:36.820124 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30099e-43a6-4093-b3e7-773edd75adc7 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:54:36.918311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1347b-9270-4f13-a65c-a06e9659203c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:54:36.918938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1347b-9270-4f13-a65c-a06e9659203c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:54:36.919211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1347b-9270-4f13-a65c-a06e9659203c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:54:36.919478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1347b-9270-4f13-a65c-a06e9659203c admin admin] PATH_INFO: `/v3/projects/0482ffb1011a4773a6c787c417b9cede` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:54:36.929683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1347b-9270-4f13-a65c-a06e9659203c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0482ffb1011a4773a6c787c417b9cede)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:54:36.930691 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-71f1347b-9270-4f13-a65c-a06e9659203c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 00:54:36.930691 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 00:54:36.930691 n-d-master-1 devstack@keystone.service[81825]: Sep 04 00:54:36.931886 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1347b-9270-4f13-a65c-a06e9659203c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:54:36.989827 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-71f1347b-9270-4f13-a65c-a06e9659203c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0482ffb1011a4773a6c787c417b9cede', 'request_id': 'req-71f1347b-9270-4f13-a65c-a06e9659203c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 00:54:36.998268 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-71f1347b-9270-4f13-a65c-a06e9659203c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0482ffb1011a4773a6c787c417b9cede', 'request_id': 'req-71f1347b-9270-4f13-a65c-a06e9659203c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 00:54:37.004243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-71f1347b-9270-4f13-a65c-a06e9659203c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0482ffb1011a4773a6c787c417b9cede', 'request_id': 'req-71f1347b-9270-4f13-a65c-a06e9659203c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 00:54:37.034075 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-71f1347b-9270-4f13-a65c-a06e9659203c admin admin] The token cache is being invalidate because project 0482ffb1011a4773a6c787c417b9cede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 00:54:37.034364 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-71f1347b-9270-4f13-a65c-a06e9659203c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 00:54:37.034791 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-71f1347b-9270-4f13-a65c-a06e9659203c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 00:54:37.036176 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 758/1510] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 00:54:36 2022] DELETE /identity/v3/projects/0482ffb1011a4773a6c787c417b9cede => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:54:46.450491 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=62 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:54:47.032038 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:57:56.462177 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00569dfc-5f21-4f89-bc97-5d1a99c2a295 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:57:56.462696 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00569dfc-5f21-4f89-bc97-5d1a99c2a295 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:57:56.462812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00569dfc-5f21-4f89-bc97-5d1a99c2a295 None None] PATH_INFO: `/v3` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:57:56.463994 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 753/1511] 10.222.0.39 () {54 vars in 925 bytes} [Sun Sep 4 00:57:56 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 00:57:56.472149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88942ba5-5ebe-4697-b399-f1429e34d673 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:57:56.472581 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88942ba5-5ebe-4697-b399-f1429e34d673 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:57:56.472693 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88942ba5-5ebe-4697-b399-f1429e34d673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:57:56.555309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-88942ba5-5ebe-4697-b399-f1429e34d673 None None] MFA Rules not processed for user `f908fda75ef8440cb6a0ef9440127d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:57:56.556503 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-88942ba5-5ebe-4697-b399-f1429e34d673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:57:56.671281 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 759/1512] 10.222.0.39 () {58 vars in 1015 bytes} [Sun Sep 4 00:57:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:57:58.057138 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb9952-231a-4580-bfb7-89bcbbaaf58d None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:57:58.057733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb9952-231a-4580-bfb7-89bcbbaaf58d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:57:58.057733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb9952-231a-4580-bfb7-89bcbbaaf58d None None] PATH_INFO: `/v3` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:57:58.058997 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 754/1513] 10.222.0.49 () {54 vars in 925 bytes} [Sun Sep 4 00:57:58 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:57:58.064809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b2d13-1f26-4c97-95d6-755cfa5c9c8d None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:57:58.065262 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b2d13-1f26-4c97-95d6-755cfa5c9c8d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:57:58.065373 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b2d13-1f26-4c97-95d6-755cfa5c9c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:57:58.085299 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-494b2d13-1f26-4c97-95d6-755cfa5c9c8d None None] MFA Rules not processed for user `f908fda75ef8440cb6a0ef9440127d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:57:58.086513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-494b2d13-1f26-4c97-95d6-755cfa5c9c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:57:58.094868 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 760/1514] 10.222.0.49 () {58 vars in 1015 bytes} [Sun Sep 4 00:57:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:58:05.537471 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2bf474-6153-4b75-8f35-17a34674df83 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:58:05.538597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2bf474-6153-4b75-8f35-17a34674df83 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:58:05.538709 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2bf474-6153-4b75-8f35-17a34674df83 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:58:05.539941 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 755/1515] 10.222.0.30 () {54 vars in 961 bytes} [Sun Sep 4 00:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:58:05.544987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a9642-6661-4f73-9ff8-cbe49dff1074 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:58:05.545455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a9642-6661-4f73-9ff8-cbe49dff1074 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:58:05.545597 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a9642-6661-4f73-9ff8-cbe49dff1074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:58:05.564786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-dc2a9642-6661-4f73-9ff8-cbe49dff1074 None None] MFA Rules not processed for user `f908fda75ef8440cb6a0ef9440127d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:58:05.566136 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-dc2a9642-6661-4f73-9ff8-cbe49dff1074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:58:05.575588 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 761/1516] 10.222.0.30 () {58 vars in 1058 bytes} [Sun Sep 4 00:58:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:58:05.583039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2bf474-6153-4b75-8f35-17a34674df83 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:58:05.597836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2bf474-6153-4b75-8f35-17a34674df83 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:58:05.603216 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8eb009-be8f-45f5-9a87-016bc0c88581 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:58:05.603803 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8eb009-be8f-45f5-9a87-016bc0c88581 service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:58:05.604080 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8eb009-be8f-45f5-9a87-016bc0c88581 service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:58:05.604352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8eb009-be8f-45f5-9a87-016bc0c88581 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:58:05.612582 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8eb009-be8f-45f5-9a87-016bc0c88581 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:58:05.614200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8eb009-be8f-45f5-9a87-016bc0c88581 service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:58:05.623501 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 756/1517] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:58:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:58:06.557730 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a9642-6661-4f73-9ff8-cbe49dff1074 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:58:06.567637 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a9642-6661-4f73-9ff8-cbe49dff1074 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:58:06.572648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eab16c-e889-43ad-b388-4d6ab205b6e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:58:06.573244 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eab16c-e889-43ad-b388-4d6ab205b6e2 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:58:06.573564 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eab16c-e889-43ad-b388-4d6ab205b6e2 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:58:06.573833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eab16c-e889-43ad-b388-4d6ab205b6e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:58:06.581903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eab16c-e889-43ad-b388-4d6ab205b6e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:58:06.583474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eab16c-e889-43ad-b388-4d6ab205b6e2 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:58:06.593412 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 762/1518] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:58:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:58:15.619626 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=6 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:58:16.589583 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=86 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:58:24.135441 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766aea3b-ae43-48c8-8c0c-ad7e022c1e3f None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:58:24.135987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766aea3b-ae43-48c8-8c0c-ad7e022c1e3f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:58:24.135987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766aea3b-ae43-48c8-8c0c-ad7e022c1e3f None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:58:24.137319 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 757/1519] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 4 00:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:58:24.142285 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b440b9-e2aa-40ba-925d-8c0df341ece7 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:58:24.142728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b440b9-e2aa-40ba-925d-8c0df341ece7 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:58:24.142828 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b440b9-e2aa-40ba-925d-8c0df341ece7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:58:24.202419 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-53b440b9-e2aa-40ba-925d-8c0df341ece7 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:58:24.203573 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-53b440b9-e2aa-40ba-925d-8c0df341ece7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:58:24.278023 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 763/1520] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 4 00:58:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:58:24.434054 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766aea3b-ae43-48c8-8c0c-ad7e022c1e3f None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:58:24.435840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-766aea3b-ae43-48c8-8c0c-ad7e022c1e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:58:24.538742 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766aea3b-ae43-48c8-8c0c-ad7e022c1e3f None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:58:24.544700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221846e2-f6f4-444f-a4d0-8914b908fd06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:58:24.545292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221846e2-f6f4-444f-a4d0-8914b908fd06 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:58:24.545598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221846e2-f6f4-444f-a4d0-8914b908fd06 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:58:24.545871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221846e2-f6f4-444f-a4d0-8914b908fd06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:58:24.553692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221846e2-f6f4-444f-a4d0-8914b908fd06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:58:24.555269 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221846e2-f6f4-444f-a4d0-8914b908fd06 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:58:24.564266 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 758/1521] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:58:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:58:25.397716 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03479213-ec18-49ec-a3a4-ed4b8a20b427 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:58:25.398294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03479213-ec18-49ec-a3a4-ed4b8a20b427 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:58:25.398294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03479213-ec18-49ec-a3a4-ed4b8a20b427 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:58:25.399648 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 4 00:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:58:25.404567 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede34c7-c394-4c9d-93b3-96de9ad76300 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:58:25.405011 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede34c7-c394-4c9d-93b3-96de9ad76300 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:58:25.405108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede34c7-c394-4c9d-93b3-96de9ad76300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:58:25.424260 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-eede34c7-c394-4c9d-93b3-96de9ad76300 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:58:25.425482 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-eede34c7-c394-4c9d-93b3-96de9ad76300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:58:25.433753 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 4 00:58:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:58:25.583952 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03479213-ec18-49ec-a3a4-ed4b8a20b427 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:58:25.598288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03479213-ec18-49ec-a3a4-ed4b8a20b427 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:58:25.604249 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9145648-7ded-4fe5-aa2a-86ba0b5d3c6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:58:25.604844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9145648-7ded-4fe5-aa2a-86ba0b5d3c6b service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:58:25.605122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9145648-7ded-4fe5-aa2a-86ba0b5d3c6b service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:58:25.605395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9145648-7ded-4fe5-aa2a-86ba0b5d3c6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:58:25.613615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9145648-7ded-4fe5-aa2a-86ba0b5d3c6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:58:25.615199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9145648-7ded-4fe5-aa2a-86ba0b5d3c6b service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:58:25.628239 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 765/1524] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:58:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:58:29.427403 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cddaa6-845e-4604-a041-b2dc82ec6505 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:58:29.427986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cddaa6-845e-4604-a041-b2dc82ec6505 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:58:29.427986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cddaa6-845e-4604-a041-b2dc82ec6505 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:58:29.429294 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 4 00:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:58:29.434363 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa758dff-2cbe-4e6d-b32d-33fd6f9c132b None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:58:29.434765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa758dff-2cbe-4e6d-b32d-33fd6f9c132b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:58:29.434940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa758dff-2cbe-4e6d-b32d-33fd6f9c132b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:58:29.455023 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-fa758dff-2cbe-4e6d-b32d-33fd6f9c132b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:58:29.456224 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-fa758dff-2cbe-4e6d-b32d-33fd6f9c132b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:58:29.464725 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 4 00:58:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:58:29.750110 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cddaa6-845e-4604-a041-b2dc82ec6505 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:58:29.751854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-06cddaa6-845e-4604-a041-b2dc82ec6505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:58:29.832567 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cddaa6-845e-4604-a041-b2dc82ec6505 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:58:29.838282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce129d3-f383-4f8b-b905-cf040ae2a1d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:58:29.838282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce129d3-f383-4f8b-b905-cf040ae2a1d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:58:29.838282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce129d3-f383-4f8b-b905-cf040ae2a1d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:58:29.838282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce129d3-f383-4f8b-b905-cf040ae2a1d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:58:29.846993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce129d3-f383-4f8b-b905-cf040ae2a1d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:58:29.848424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce129d3-f383-4f8b-b905-cf040ae2a1d0 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:58:29.858204 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 761/1527] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:58:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:58:31.764324 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162a641-941c-4b91-aba6-5a63c9e4a349 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:58:31.764894 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162a641-941c-4b91-aba6-5a63c9e4a349 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:58:31.764894 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162a641-941c-4b91-aba6-5a63c9e4a349 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:58:31.766217 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 4 00:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:58:31.771353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b0812-2e37-4e98-b92c-e35fe947b68a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:58:31.771814 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b0812-2e37-4e98-b92c-e35fe947b68a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:58:31.771930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b0812-2e37-4e98-b92c-e35fe947b68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:58:31.791523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-7a7b0812-2e37-4e98-b92c-e35fe947b68a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:58:31.792699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7a7b0812-2e37-4e98-b92c-e35fe947b68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:58:31.800304 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 4 00:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:58:32.106074 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162a641-941c-4b91-aba6-5a63c9e4a349 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:58:32.117054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162a641-941c-4b91-aba6-5a63c9e4a349 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:58:32.121020 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163998f8-df5b-4946-8ba1-6ff0a71c593f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:58:32.121645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163998f8-df5b-4946-8ba1-6ff0a71c593f service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:58:32.121947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163998f8-df5b-4946-8ba1-6ff0a71c593f service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:58:32.122197 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163998f8-df5b-4946-8ba1-6ff0a71c593f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:58:32.130837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163998f8-df5b-4946-8ba1-6ff0a71c593f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:58:32.132257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163998f8-df5b-4946-8ba1-6ff0a71c593f service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:58:32.142130 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 768/1530] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:58:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:58:41.786390 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=87 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:58:42.138059 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=65 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:59:24.556198 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a828e-9e82-4135-a3dd-307bcaae8fcd None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:24.556731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a828e-9e82-4135-a3dd-307bcaae8fcd None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:24.556731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a828e-9e82-4135-a3dd-307bcaae8fcd None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:24.558094 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 763/1531] 10.222.0.30 () {54 vars in 921 bytes} [Sun Sep 4 00:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:59:24.563226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04891af-13f3-4296-801f-91510acb4339 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:24.563647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04891af-13f3-4296-801f-91510acb4339 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:24.563780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04891af-13f3-4296-801f-91510acb4339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:24.583046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e04891af-13f3-4296-801f-91510acb4339 None None] MFA Rules not processed for user `f908fda75ef8440cb6a0ef9440127d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:59:24.584218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e04891af-13f3-4296-801f-91510acb4339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:59:24.593518 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 769/1532] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Sep 4 00:59:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 00:59:34.578249 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:59:56.062735 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42542442-2f82-4e79-b089-cd92030ac0b4 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:56.063919 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42542442-2f82-4e79-b089-cd92030ac0b4 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:56.064418 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42542442-2f82-4e79-b089-cd92030ac0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:56.093656 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-42542442-2f82-4e79-b089-cd92030ac0b4 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:59:56.095247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-42542442-2f82-4e79-b089-cd92030ac0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:59:56.107567 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 764/1533] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 00:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:59:56.123901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7287e-58dd-472b-92ec-7b7e7b0a2ccc None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:56.124882 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7287e-58dd-472b-92ec-7b7e7b0a2ccc None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:56.125369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7287e-58dd-472b-92ec-7b7e7b0a2ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:56.150302 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-40f7287e-58dd-472b-92ec-7b7e7b0a2ccc None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:59:56.152381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-40f7287e-58dd-472b-92ec-7b7e7b0a2ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:59:56.164548 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 770/1534] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 00:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:59:56.169519 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42542442-2f82-4e79-b089-cd92030ac0b4 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:56.182260 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42542442-2f82-4e79-b089-cd92030ac0b4 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:56.191844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cebeb8-4eea-4d5b-a490-4b2129413d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:56.193099 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cebeb8-4eea-4d5b-a490-4b2129413d4c admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:56.193798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cebeb8-4eea-4d5b-a490-4b2129413d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:56.194772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cebeb8-4eea-4d5b-a490-4b2129413d4c admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:56.195627 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cebeb8-4eea-4d5b-a490-4b2129413d4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:59:56.196134 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cebeb8-4eea-4d5b-a490-4b2129413d4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:56.197375 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-66cebeb8-4eea-4d5b-a490-4b2129413d4c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 00:59:56.197375 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 00:59:56.197375 n-d-master-1 devstack@keystone.service[81824]: Sep 04 00:59:56.198832 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cebeb8-4eea-4d5b-a490-4b2129413d4c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:56.216265 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 765/1535] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 00:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:59:56.225548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f7287e-58dd-472b-92ec-7b7e7b0a2ccc None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:56.239776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f7287e-58dd-472b-92ec-7b7e7b0a2ccc None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:56.250938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754a4af-9f95-4db6-badc-a9ca35092d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:56.251996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754a4af-9f95-4db6-badc-a9ca35092d54 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:56.252510 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754a4af-9f95-4db6-badc-a9ca35092d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:56.253458 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754a4af-9f95-4db6-badc-a9ca35092d54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:56.254755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d754a4af-9f95-4db6-badc-a9ca35092d54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:56.256123 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-d754a4af-9f95-4db6-badc-a9ca35092d54 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 00:59:56.256123 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 00:59:56.256123 n-d-master-1 devstack@keystone.service[81825]: Sep 04 00:59:56.257923 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d754a4af-9f95-4db6-badc-a9ca35092d54 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:56.329842 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 771/1536] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 00:59:56 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:59:56.333702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cebeb8-4eea-4d5b-a490-4b2129413d4c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:56.346401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cebeb8-4eea-4d5b-a490-4b2129413d4c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:56.421571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023e555-0fea-4b69-a66b-794526e5b394 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:56.422222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023e555-0fea-4b69-a66b-794526e5b394 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:56.422830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023e555-0fea-4b69-a66b-794526e5b394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:56.442420 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97514293-67f2-48c2-a616-26accd02d47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:56.445249 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97514293-67f2-48c2-a616-26accd02d47c admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:56.445774 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97514293-67f2-48c2-a616-26accd02d47c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:56.446263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97514293-67f2-48c2-a616-26accd02d47c admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:56.448678 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97514293-67f2-48c2-a616-26accd02d47c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:56.450720 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-97514293-67f2-48c2-a616-26accd02d47c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 00:59:56.450720 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 00:59:56.450720 n-d-master-1 devstack@keystone.service[81824]: Sep 04 00:59:56.461569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97514293-67f2-48c2-a616-26accd02d47c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:56.480043 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-9023e555-0fea-4b69-a66b-794526e5b394 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:59:56.482197 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9023e555-0fea-4b69-a66b-794526e5b394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:59:56.517562 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 772/1537] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 00:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 00:59:56.525966 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470599b7-14f7-4faf-98f3-a70d9431e64f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:56.526263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470599b7-14f7-4faf-98f3-a70d9431e64f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:56.526517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470599b7-14f7-4faf-98f3-a70d9431e64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:56.526617 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 766/1538] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 00:59:56 2022] POST /identity/v3/users => generated 291 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:59:56.529464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97514293-67f2-48c2-a616-26accd02d47c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:56.549276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97514293-67f2-48c2-a616-26accd02d47c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:56.556985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b667f9-1e1f-41d5-88be-7c1caec0d4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:56.561695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b667f9-1e1f-41d5-88be-7c1caec0d4d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:56.561998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b667f9-1e1f-41d5-88be-7c1caec0d4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:56.562382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b667f9-1e1f-41d5-88be-7c1caec0d4d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:56.563181 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b667f9-1e1f-41d5-88be-7c1caec0d4d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:56.564806 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b667f9-1e1f-41d5-88be-7c1caec0d4d3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:56.566106 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-470599b7-14f7-4faf-98f3-a70d9431e64f None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:59:56.567717 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-470599b7-14f7-4faf-98f3-a70d9431e64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:59:56.588789 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 767/1539] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 00:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 00:59:56.591072 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 773/1540] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 00:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 00:59:56.592321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d07063-60ba-4cd5-a610-9d89dea2e252 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:56.592607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d07063-60ba-4cd5-a610-9d89dea2e252 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:56.592887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d07063-60ba-4cd5-a610-9d89dea2e252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:56.601054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75700174-9fb1-4696-a819-6fc5f2ef5c55 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:56.601389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75700174-9fb1-4696-a819-6fc5f2ef5c55 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:56.601730 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75700174-9fb1-4696-a819-6fc5f2ef5c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:56.634628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-66d07063-60ba-4cd5-a610-9d89dea2e252 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:59:56.635857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-66d07063-60ba-4cd5-a610-9d89dea2e252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:59:56.643443 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-75700174-9fb1-4696-a819-6fc5f2ef5c55 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:59:56.644613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-75700174-9fb1-4696-a819-6fc5f2ef5c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:59:56.652144 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 768/1541] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 00:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:59:56.653323 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d07063-60ba-4cd5-a610-9d89dea2e252 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:56.660001 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 774/1542] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 00:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:59:56.661303 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a42e5a-2a49-414a-a73b-6b390b497299 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:56.661614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a42e5a-2a49-414a-a73b-6b390b497299 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:56.661892 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a42e5a-2a49-414a-a73b-6b390b497299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:56.670182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d07063-60ba-4cd5-a610-9d89dea2e252 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:56.686203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-95a42e5a-2a49-414a-a73b-6b390b497299 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:59:56.688723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-95a42e5a-2a49-414a-a73b-6b390b497299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:59:56.690353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaabe95-ecb3-4c6a-9765-ef6778530b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:56.690994 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaabe95-ecb3-4c6a-9765-ef6778530b60 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:56.691272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaabe95-ecb3-4c6a-9765-ef6778530b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:56.691541 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaabe95-ecb3-4c6a-9765-ef6778530b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:56.692228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaabe95-ecb3-4c6a-9765-ef6778530b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:56.695583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaabe95-ecb3-4c6a-9765-ef6778530b60 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:56.711236 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 775/1543] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 00:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:59:56.712348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677f392-b0a2-4994-b00e-67ffd8929fac None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:56.712636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677f392-b0a2-4994-b00e-67ffd8929fac None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:56.712910 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677f392-b0a2-4994-b00e-67ffd8929fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:56.714340 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 769/1544] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 00:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 00:59:56.715179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaabe95-ecb3-4c6a-9765-ef6778530b60 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:56.737931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaabe95-ecb3-4c6a-9765-ef6778530b60 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:56.749402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f64bea-dfd7-4eec-b550-aeef2422dc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:56.750046 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f64bea-dfd7-4eec-b550-aeef2422dc36 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:56.750323 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f64bea-dfd7-4eec-b550-aeef2422dc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:56.750594 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f64bea-dfd7-4eec-b550-aeef2422dc36 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:56.751243 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f64bea-dfd7-4eec-b550-aeef2422dc36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:59:56.751543 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f64bea-dfd7-4eec-b550-aeef2422dc36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:56.753149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f64bea-dfd7-4eec-b550-aeef2422dc36 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:56.758412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5677f392-b0a2-4994-b00e-67ffd8929fac None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:59:56.759622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5677f392-b0a2-4994-b00e-67ffd8929fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:59:56.766360 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 770/1545] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 00:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:59:56.766968 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f64bea-dfd7-4eec-b550-aeef2422dc36 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:56.779150 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 776/1546] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 00:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:59:56.781331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379da3b-1709-4d3d-b225-ff47f62ebd38 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:56.781658 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379da3b-1709-4d3d-b225-ff47f62ebd38 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:56.782214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379da3b-1709-4d3d-b225-ff47f62ebd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:56.784313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f64bea-dfd7-4eec-b550-aeef2422dc36 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:56.789320 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f3582-1ca9-4dd5-842c-b9f44c80345a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:56.790002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f3582-1ca9-4dd5-842c-b9f44c80345a admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:56.790238 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f3582-1ca9-4dd5-842c-b9f44c80345a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:56.790513 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f3582-1ca9-4dd5-842c-b9f44c80345a admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:56.791519 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f3582-1ca9-4dd5-842c-b9f44c80345a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:59:56.791823 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f3582-1ca9-4dd5-842c-b9f44c80345a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:56.793415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f3582-1ca9-4dd5-842c-b9f44c80345a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:56.808058 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 771/1547] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 00:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:59:56.808980 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f3582-1ca9-4dd5-842c-b9f44c80345a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:56.820418 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f3582-1ca9-4dd5-842c-b9f44c80345a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:56.824314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b379da3b-1709-4d3d-b225-ff47f62ebd38 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:59:56.826158 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca3760-f042-4068-a6ee-b3124ace4ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:56.826785 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b379da3b-1709-4d3d-b225-ff47f62ebd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:59:56.826905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca3760-f042-4068-a6ee-b3124ace4ca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:56.827088 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca3760-f042-4068-a6ee-b3124ace4ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:56.827363 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca3760-f042-4068-a6ee-b3124ace4ca3 admin admin] PATH_INFO: `/v3/projects/3ba3107862654eb483e9693ed761c4ac/users/5705a5c5ea2b46e0a98841ea0d82dc2b/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:56.837356 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 777/1548] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 00:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:59:56.839009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a3c4e-9cdf-43c5-aa7f-984df26b95c7 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:56.839396 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a3c4e-9cdf-43c5-aa7f-984df26b95c7 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:56.839777 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a3c4e-9cdf-43c5-aa7f-984df26b95c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:56.846073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ca3760-f042-4068-a6ee-b3124ace4ca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ba3107862654eb483e9693ed761c4ac, user_id=5705a5c5ea2b46e0a98841ea0d82dc2b, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:56.849479 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ca3760-f042-4068-a6ee-b3124ace4ca3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:56.862175 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-426a3c4e-9cdf-43c5-aa7f-984df26b95c7 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:59:56.863776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-426a3c4e-9cdf-43c5-aa7f-984df26b95c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:59:56.864517 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 772/1549] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 00:59:56 2022] PUT /identity/v3/projects/3ba3107862654eb483e9693ed761c4ac/users/5705a5c5ea2b46e0a98841ea0d82dc2b/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:59:56.869638 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca3760-f042-4068-a6ee-b3124ace4ca3 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:56.924830 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:59:56.941322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca3760-f042-4068-a6ee-b3124ace4ca3 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:56.945578 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 778/1550] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 00:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:59:56.947111 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f34099-f29f-4b0b-8b57-856d93b7911a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:56.947341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f34099-f29f-4b0b-8b57-856d93b7911a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:56.947618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f34099-f29f-4b0b-8b57-856d93b7911a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:56.952927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38034470-c283-446c-b372-44541630e686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:56.953601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38034470-c283-446c-b372-44541630e686 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:56.953906 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38034470-c283-446c-b372-44541630e686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:56.954173 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38034470-c283-446c-b372-44541630e686 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:56.954809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38034470-c283-446c-b372-44541630e686 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:56.956764 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38034470-c283-446c-b372-44541630e686 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:56.967398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b0f34099-f29f-4b0b-8b57-856d93b7911a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:59:56.968601 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b0f34099-f29f-4b0b-8b57-856d93b7911a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:59:56.978244 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 779/1551] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 00:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:59:56.985934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13983925-c184-46d0-b027-afbdef82b313 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:56.985934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13983925-c184-46d0-b027-afbdef82b313 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:56.985934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13983925-c184-46d0-b027-afbdef82b313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:56.994020 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 773/1552] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 00:59:56 2022] POST /identity/v3/projects => generated 369 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:59:56.995039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38034470-c283-446c-b372-44541630e686 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:57.002981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-13983925-c184-46d0-b027-afbdef82b313 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:59:57.004171 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-13983925-c184-46d0-b027-afbdef82b313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:59:57.056174 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38034470-c283-446c-b372-44541630e686 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:57.060835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89e664-96a6-40b5-8068-fb1279e4cd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:57.061462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89e664-96a6-40b5-8068-fb1279e4cd9a admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:57.061754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89e664-96a6-40b5-8068-fb1279e4cd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:57.062028 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89e664-96a6-40b5-8068-fb1279e4cd9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:57.062659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89e664-96a6-40b5-8068-fb1279e4cd9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:57.062747 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 780/1553] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 00:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:59:57.063510 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13983925-c184-46d0-b027-afbdef82b313 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:57.064659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89e664-96a6-40b5-8068-fb1279e4cd9a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:57.075156 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13983925-c184-46d0-b027-afbdef82b313 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:57.079735 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c2ed6-35b8-4170-9440-f2b35548612f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:57.080326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c2ed6-35b8-4170-9440-f2b35548612f admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:57.080598 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c2ed6-35b8-4170-9440-f2b35548612f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:57.080866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c2ed6-35b8-4170-9440-f2b35548612f admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:57.081535 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c2ed6-35b8-4170-9440-f2b35548612f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:59:57.081898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c2ed6-35b8-4170-9440-f2b35548612f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:57.083795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c2ed6-35b8-4170-9440-f2b35548612f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:57.092151 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 774/1554] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 00:59:56 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:59:57.093350 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1ec64-474e-426e-8098-102bb9531f22 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:57.093684 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1ec64-474e-426e-8098-102bb9531f22 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:57.093963 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1ec64-474e-426e-8098-102bb9531f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:57.095973 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 781/1555] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 00:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:59:57.097415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55464441-7708-4fbf-96b2-75d2d2ce39fc None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:57.097726 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55464441-7708-4fbf-96b2-75d2d2ce39fc None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:57.097995 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55464441-7708-4fbf-96b2-75d2d2ce39fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:57.107852 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:59:57.121911 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-55464441-7708-4fbf-96b2-75d2d2ce39fc None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:59:57.123363 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-55464441-7708-4fbf-96b2-75d2d2ce39fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:59:57.130026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-63c1ec64-474e-426e-8098-102bb9531f22 None None] MFA Rules not processed for user `5705a5c5ea2b46e0a98841ea0d82dc2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:59:57.131229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-63c1ec64-474e-426e-8098-102bb9531f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:59:57.190266 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 782/1556] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 00:59:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:59:57.191572 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ce1a2-ac32-41f1-ba79-75757565f79c None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:57.191858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ce1a2-ac32-41f1-ba79-75757565f79c None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:57.192125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ce1a2-ac32-41f1-ba79-75757565f79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:57.211597 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 775/1557] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 00:59:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:59:57.211597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cd015-e0e1-4e48-a9c3-e58b37f394e2 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:57.211597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cd015-e0e1-4e48-a9c3-e58b37f394e2 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:57.211597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cd015-e0e1-4e48-a9c3-e58b37f394e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:57.217519 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-ab1ce1a2-ac32-41f1-ba79-75757565f79c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:59:57.218757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ab1ce1a2-ac32-41f1-ba79-75757565f79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:59:57.227035 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 783/1558] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 00:59:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:59:57.227775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ce1a2-ac32-41f1-ba79-75757565f79c None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:57.229121 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-fd4cd015-e0e1-4e48-a9c3-e58b37f394e2 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:59:57.230419 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fd4cd015-e0e1-4e48-a9c3-e58b37f394e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:59:57.237139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ce1a2-ac32-41f1-ba79-75757565f79c None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:57.238706 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 776/1559] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 00:59:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:59:57.242271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cd015-e0e1-4e48-a9c3-e58b37f394e2 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:57.242438 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbac227-0b2e-45a7-a321-c7df68807c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:57.243083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbac227-0b2e-45a7-a321-c7df68807c08 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:57.243364 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbac227-0b2e-45a7-a321-c7df68807c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:57.243630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbac227-0b2e-45a7-a321-c7df68807c08 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:57.244246 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbac227-0b2e-45a7-a321-c7df68807c08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:57.246182 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbac227-0b2e-45a7-a321-c7df68807c08 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:57.251793 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cd015-e0e1-4e48-a9c3-e58b37f394e2 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:57.256424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03018ed8-8326-49a8-a6ef-41a7f3e620c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:57.256968 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03018ed8-8326-49a8-a6ef-41a7f3e620c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:57.257230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03018ed8-8326-49a8-a6ef-41a7f3e620c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:57.257538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03018ed8-8326-49a8-a6ef-41a7f3e620c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:57.258337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03018ed8-8326-49a8-a6ef-41a7f3e620c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:59:57.258647 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03018ed8-8326-49a8-a6ef-41a7f3e620c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:57.260024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03018ed8-8326-49a8-a6ef-41a7f3e620c7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:57.269262 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 784/1560] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 00:59:57 2022] POST /identity/v3/users => generated 285 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:59:57.270087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbac227-0b2e-45a7-a321-c7df68807c08 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:57.275432 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 777/1561] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 00:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:59:57.282379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03018ed8-8326-49a8-a6ef-41a7f3e620c7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:57.285756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03018ed8-8326-49a8-a6ef-41a7f3e620c7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:57.286300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbac227-0b2e-45a7-a321-c7df68807c08 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:57.290872 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea978a0-4b8a-4de1-82c1-10eb97ef187e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:57.291314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7bd39-aa52-44ad-a7cb-873635d7f038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:57.291435 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea978a0-4b8a-4de1-82c1-10eb97ef187e admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:57.291715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea978a0-4b8a-4de1-82c1-10eb97ef187e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:57.291909 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7bd39-aa52-44ad-a7cb-873635d7f038 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:57.292015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea978a0-4b8a-4de1-82c1-10eb97ef187e admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:57.292186 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7bd39-aa52-44ad-a7cb-873635d7f038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:57.292449 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7bd39-aa52-44ad-a7cb-873635d7f038 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:57.292599 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea978a0-4b8a-4de1-82c1-10eb97ef187e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:57.293180 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d7bd39-aa52-44ad-a7cb-873635d7f038 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:57.294527 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea978a0-4b8a-4de1-82c1-10eb97ef187e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:57.295101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d7bd39-aa52-44ad-a7cb-873635d7f038 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:57.317952 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 785/1562] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 00:59:57 2022] POST /identity/v3/users => generated 292 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:59:57.319454 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11420a-7dd8-49f7-b783-fe64e4d61950 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:57.319757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11420a-7dd8-49f7-b783-fe64e4d61950 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:57.320024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11420a-7dd8-49f7-b783-fe64e4d61950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:57.325751 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 778/1563] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 00:59:57 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:59:57.325751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea978a0-4b8a-4de1-82c1-10eb97ef187e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:57.335339 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:59:57.339711 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-3e11420a-7dd8-49f7-b783-fe64e4d61950 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:59:57.340895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3e11420a-7dd8-49f7-b783-fe64e4d61950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:59:57.392979 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea978a0-4b8a-4de1-82c1-10eb97ef187e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:57.399483 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff222a-8b77-4a94-adfe-1dafc2cf5f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:57.400101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff222a-8b77-4a94-adfe-1dafc2cf5f95 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:57.400371 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff222a-8b77-4a94-adfe-1dafc2cf5f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:57.400646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff222a-8b77-4a94-adfe-1dafc2cf5f95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:57.401340 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff222a-8b77-4a94-adfe-1dafc2cf5f95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:57.403423 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff222a-8b77-4a94-adfe-1dafc2cf5f95 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:57.407348 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 786/1564] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 00:59:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:59:57.413297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11420a-7dd8-49f7-b783-fe64e4d61950 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:57.424440 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11420a-7dd8-49f7-b783-fe64e4d61950 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:57.429656 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464676c5-453e-4358-a069-4977e31800c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:57.430274 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464676c5-453e-4358-a069-4977e31800c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:57.430557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464676c5-453e-4358-a069-4977e31800c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:57.430832 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464676c5-453e-4358-a069-4977e31800c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:57.431483 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464676c5-453e-4358-a069-4977e31800c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:59:57.431788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464676c5-453e-4358-a069-4977e31800c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:57.431948 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 779/1565] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 00:59:57 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:59:57.432729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff222a-8b77-4a94-adfe-1dafc2cf5f95 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:57.436507 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464676c5-453e-4358-a069-4977e31800c0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:57.452410 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 787/1566] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 00:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:59:57.453380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464676c5-453e-4358-a069-4977e31800c0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:57.468045 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464676c5-453e-4358-a069-4977e31800c0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:57.505120 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff222a-8b77-4a94-adfe-1dafc2cf5f95 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:57.510603 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1accdfb0-b223-4fd5-b9db-b1052316f77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:57.511705 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accdfb0-b223-4fd5-b9db-b1052316f77e admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:57.512084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accdfb0-b223-4fd5-b9db-b1052316f77e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:57.512789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accdfb0-b223-4fd5-b9db-b1052316f77e admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:57.513756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1accdfb0-b223-4fd5-b9db-b1052316f77e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:59:57.514168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1accdfb0-b223-4fd5-b9db-b1052316f77e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:57.515904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1accdfb0-b223-4fd5-b9db-b1052316f77e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:57.517585 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:59:57.528170 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 780/1567] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 00:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:59:57.530186 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9896cc6-9d30-4471-a2ae-1b81e09a68a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:57.530495 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1accdfb0-b223-4fd5-b9db-b1052316f77e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:57.530796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9896cc6-9d30-4471-a2ae-1b81e09a68a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:57.531071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9896cc6-9d30-4471-a2ae-1b81e09a68a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:57.531339 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9896cc6-9d30-4471-a2ae-1b81e09a68a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:57.531977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9896cc6-9d30-4471-a2ae-1b81e09a68a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:57.533659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9896cc6-9d30-4471-a2ae-1b81e09a68a5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:57.541078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1accdfb0-b223-4fd5-b9db-b1052316f77e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:57.547515 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 788/1568] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 00:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 00:59:57.547515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9896cc6-9d30-4471-a2ae-1b81e09a68a5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:57.547731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d6d5b-d79b-44cb-a668-7a37d8103d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:57.547731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d6d5b-d79b-44cb-a668-7a37d8103d71 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:57.547731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d6d5b-d79b-44cb-a668-7a37d8103d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:57.547731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d6d5b-d79b-44cb-a668-7a37d8103d71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:57.548020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d6d5b-d79b-44cb-a668-7a37d8103d71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:57.549663 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d6d5b-d79b-44cb-a668-7a37d8103d71 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:57.554524 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9896cc6-9d30-4471-a2ae-1b81e09a68a5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:57.559020 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007b4cc-25b0-4352-b4e9-0bae6f6eb0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:57.559591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007b4cc-25b0-4352-b4e9-0bae6f6eb0b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:57.559866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007b4cc-25b0-4352-b4e9-0bae6f6eb0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:57.560133 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007b4cc-25b0-4352-b4e9-0bae6f6eb0b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:57.560750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007b4cc-25b0-4352-b4e9-0bae6f6eb0b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:57.562337 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007b4cc-25b0-4352-b4e9-0bae6f6eb0b0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:57.574397 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 789/1569] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 00:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 00:59:57.575374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007b4cc-25b0-4352-b4e9-0bae6f6eb0b0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:57.577207 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 781/1570] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 00:59:57 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:59:57.578303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d6d5b-d79b-44cb-a668-7a37d8103d71 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:57.586300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007b4cc-25b0-4352-b4e9-0bae6f6eb0b0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:57.640842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d6d5b-d79b-44cb-a668-7a37d8103d71 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:57.642771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3681a6-2d6a-40fc-bd1f-8d2e853b2f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:57.643386 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3681a6-2d6a-40fc-bd1f-8d2e853b2f46 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:57.643684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3681a6-2d6a-40fc-bd1f-8d2e853b2f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:57.643942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3681a6-2d6a-40fc-bd1f-8d2e853b2f46 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:57.644567 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3681a6-2d6a-40fc-bd1f-8d2e853b2f46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:57.646057 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e155d-340f-456d-b509-d1234ba03c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:57.646523 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3681a6-2d6a-40fc-bd1f-8d2e853b2f46 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:57.646657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e155d-340f-456d-b509-d1234ba03c29 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:57.647429 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e155d-340f-456d-b509-d1234ba03c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:57.647699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e155d-340f-456d-b509-d1234ba03c29 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:57.648338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e155d-340f-456d-b509-d1234ba03c29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 00:59:57.648642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e155d-340f-456d-b509-d1234ba03c29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:57.650295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e155d-340f-456d-b509-d1234ba03c29 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:57.659111 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:59:57.663410 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 782/1571] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 00:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 00:59:57.664156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e155d-340f-456d-b509-d1234ba03c29 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:57.672985 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 790/1572] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 00:59:57 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:59:57.674015 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3681a6-2d6a-40fc-bd1f-8d2e853b2f46 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:57.674786 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e155d-340f-456d-b509-d1234ba03c29 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:57.681230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41fef4-8e1e-43b0-8dfc-1e94f2aa8389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:57.682040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41fef4-8e1e-43b0-8dfc-1e94f2aa8389 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:57.682419 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41fef4-8e1e-43b0-8dfc-1e94f2aa8389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:57.682788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41fef4-8e1e-43b0-8dfc-1e94f2aa8389 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:57.683425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f41fef4-8e1e-43b0-8dfc-1e94f2aa8389 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:57.683633 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3681a6-2d6a-40fc-bd1f-8d2e853b2f46 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:57.685378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f41fef4-8e1e-43b0-8dfc-1e94f2aa8389 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:57.688406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dacbfb-120c-41a9-bf9f-d183bf925881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:57.688994 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dacbfb-120c-41a9-bf9f-d183bf925881 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:57.689270 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dacbfb-120c-41a9-bf9f-d183bf925881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:57.689572 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dacbfb-120c-41a9-bf9f-d183bf925881 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:57.690196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dacbfb-120c-41a9-bf9f-d183bf925881 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:57.692078 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dacbfb-120c-41a9-bf9f-d183bf925881 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:57.708516 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 783/1573] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 00:59:57 2022] POST /identity/v3/users => generated 298 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:59:57.712334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41fef4-8e1e-43b0-8dfc-1e94f2aa8389 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:57.722972 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41fef4-8e1e-43b0-8dfc-1e94f2aa8389 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:57.727134 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 791/1574] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 00:59:57 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:59:57.728089 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dacbfb-120c-41a9-bf9f-d183bf925881 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:57.730607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3317cab-0b19-4112-8b31-0be07a1c42b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:57.731221 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3317cab-0b19-4112-8b31-0be07a1c42b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:57.731501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3317cab-0b19-4112-8b31-0be07a1c42b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:57.731774 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3317cab-0b19-4112-8b31-0be07a1c42b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:57.732466 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3317cab-0b19-4112-8b31-0be07a1c42b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:57.734586 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3317cab-0b19-4112-8b31-0be07a1c42b5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:57.767044 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 784/1575] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 00:59:57 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:59:57.767948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3317cab-0b19-4112-8b31-0be07a1c42b5 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:57.797086 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dacbfb-120c-41a9-bf9f-d183bf925881 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:57.846736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3317cab-0b19-4112-8b31-0be07a1c42b5 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:57.849167 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:59:57.852953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc412fd-b6f1-4422-9262-ed388186b2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:57.853603 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc412fd-b6f1-4422-9262-ed388186b2bb admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:57.853886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc412fd-b6f1-4422-9262-ed388186b2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:57.854158 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc412fd-b6f1-4422-9262-ed388186b2bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:57.854909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc412fd-b6f1-4422-9262-ed388186b2bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:57.856467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc412fd-b6f1-4422-9262-ed388186b2bb admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:57.863208 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f840bf-37bd-490f-adce-4bd431ad4655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:57.863936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f840bf-37bd-490f-adce-4bd431ad4655 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:57.864254 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f840bf-37bd-490f-adce-4bd431ad4655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:57.864608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f840bf-37bd-490f-adce-4bd431ad4655 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:57.865833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f840bf-37bd-490f-adce-4bd431ad4655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:57.870917 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 785/1576] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 00:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 00:59:57.871075 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f840bf-37bd-490f-adce-4bd431ad4655 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:57.871191 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc412fd-b6f1-4422-9262-ed388186b2bb admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:57.879313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc412fd-b6f1-4422-9262-ed388186b2bb admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:57.879873 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 792/1577] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 00:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 00:59:57.885213 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f840bf-37bd-490f-adce-4bd431ad4655 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:57.885700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff95740-c49f-4342-8607-ff01618fd556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:57.886395 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff95740-c49f-4342-8607-ff01618fd556 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:57.886747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff95740-c49f-4342-8607-ff01618fd556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:57.887088 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff95740-c49f-4342-8607-ff01618fd556 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:57.887789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff95740-c49f-4342-8607-ff01618fd556 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:57.889828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff95740-c49f-4342-8607-ff01618fd556 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:57.896082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f840bf-37bd-490f-adce-4bd431ad4655 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:57.901315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd5b6d-2be7-4e71-8f0b-601e52db91aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:57.901955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd5b6d-2be7-4e71-8f0b-601e52db91aa admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:57.902237 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd5b6d-2be7-4e71-8f0b-601e52db91aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:57.902511 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd5b6d-2be7-4e71-8f0b-601e52db91aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:57.903142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd5b6d-2be7-4e71-8f0b-601e52db91aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:57.905042 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd5b6d-2be7-4e71-8f0b-601e52db91aa admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:57.913776 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 786/1578] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 00:59:57 2022] POST /identity/v3/users => generated 287 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:59:57.914587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff95740-c49f-4342-8607-ff01618fd556 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:57.924882 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff95740-c49f-4342-8607-ff01618fd556 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:57.930272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d54810-92b4-4a02-8b9b-c18b73a31d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:57.930868 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d54810-92b4-4a02-8b9b-c18b73a31d69 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:57.931155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d54810-92b4-4a02-8b9b-c18b73a31d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:57.931426 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d54810-92b4-4a02-8b9b-c18b73a31d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:57.932065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d54810-92b4-4a02-8b9b-c18b73a31d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:57.933727 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d54810-92b4-4a02-8b9b-c18b73a31d69 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:57.937965 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 793/1579] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 00:59:57 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:59:57.937965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd5b6d-2be7-4e71-8f0b-601e52db91aa admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:57.945940 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 787/1580] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 00:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 00:59:57.946730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d54810-92b4-4a02-8b9b-c18b73a31d69 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:57.956113 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d54810-92b4-4a02-8b9b-c18b73a31d69 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:58.002969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd5b6d-2be7-4e71-8f0b-601e52db91aa admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:58.008000 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b7ab5-0377-48ac-b5b5-620177036ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:58.008665 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b7ab5-0377-48ac-b5b5-620177036ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:58.008881 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b7ab5-0377-48ac-b5b5-620177036ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:58.009150 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b7ab5-0377-48ac-b5b5-620177036ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:58.009825 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b7ab5-0377-48ac-b5b5-620177036ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:58.011442 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b7ab5-0377-48ac-b5b5-620177036ab2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:58.015049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81778cd-271c-4495-b722-6c3465223682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:58.015643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81778cd-271c-4495-b722-6c3465223682 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:58.015924 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81778cd-271c-4495-b722-6c3465223682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:58.016197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81778cd-271c-4495-b722-6c3465223682 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:58.016823 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81778cd-271c-4495-b722-6c3465223682 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:58.018764 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81778cd-271c-4495-b722-6c3465223682 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:58.021539 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 794/1581] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 00:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 00:59:58.022968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b7ab5-0377-48ac-b5b5-620177036ab2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:58.033284 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b7ab5-0377-48ac-b5b5-620177036ab2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:58.038691 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f73ef-a8c8-4ce5-a075-726f8b79f052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:58.039326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f73ef-a8c8-4ce5-a075-726f8b79f052 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:58.039617 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f73ef-a8c8-4ce5-a075-726f8b79f052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:58.039878 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f73ef-a8c8-4ce5-a075-726f8b79f052 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:58.040502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f73ef-a8c8-4ce5-a075-726f8b79f052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:58.041973 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 788/1582] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 00:59:57 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:59:58.042459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f73ef-a8c8-4ce5-a075-726f8b79f052 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:58.042771 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81778cd-271c-4495-b722-6c3465223682 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:58.056997 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81778cd-271c-4495-b722-6c3465223682 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:58.062504 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7acea26-9e47-43d8-a127-48b9686aacf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:58.063189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acea26-9e47-43d8-a127-48b9686aacf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:58.063573 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acea26-9e47-43d8-a127-48b9686aacf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:58.063849 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acea26-9e47-43d8-a127-48b9686aacf1 admin admin] PATH_INFO: `/v3/projects/51c30badc7dc4c31aaeb459d8174ae9f/users/5df38b0724ba485fa93c6b043d9b262c/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:58.066101 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 795/1583] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 00:59:58 2022] POST /identity/v3/users => generated 287 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:59:58.070428 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f73ef-a8c8-4ce5-a075-726f8b79f052 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:58.079109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7acea26-9e47-43d8-a127-48b9686aacf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51c30badc7dc4c31aaeb459d8174ae9f, user_id=5df38b0724ba485fa93c6b043d9b262c, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:58.079953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f73ef-a8c8-4ce5-a075-726f8b79f052 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:58.082179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7acea26-9e47-43d8-a127-48b9686aacf1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:58.084356 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:59:58.085782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f4437-d470-40d7-9338-8c99b0ba963c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:58.086431 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f4437-d470-40d7-9338-8c99b0ba963c admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:58.086688 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f4437-d470-40d7-9338-8c99b0ba963c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:58.087001 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f4437-d470-40d7-9338-8c99b0ba963c admin admin] PATH_INFO: `/v3/projects/023bb579cb164bcf99e11ad4e0d9178f/users/caae49db19114c20b3bb86c81cda1ff9/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:58.096353 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 789/1584] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 00:59:58 2022] PUT /identity/v3/projects/51c30badc7dc4c31aaeb459d8174ae9f/users/5df38b0724ba485fa93c6b043d9b262c/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:59:58.096920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7acea26-9e47-43d8-a127-48b9686aacf1 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:58.102386 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f4437-d470-40d7-9338-8c99b0ba963c admin admin] RBAC: Authorizing `identity:create_grant(project_id=023bb579cb164bcf99e11ad4e0d9178f, user_id=caae49db19114c20b3bb86c81cda1ff9, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:58.103431 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-929f4437-d470-40d7-9338-8c99b0ba963c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 00:59:58.103431 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 00:59:58.103431 n-d-master-1 devstack@keystone.service[81825]: Sep 04 00:59:58.105711 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f4437-d470-40d7-9338-8c99b0ba963c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:58.121092 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 796/1585] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 00:59:58 2022] PUT /identity/v3/projects/023bb579cb164bcf99e11ad4e0d9178f/users/caae49db19114c20b3bb86c81cda1ff9/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:59:58.122057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f4437-d470-40d7-9338-8c99b0ba963c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:58.171447 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7acea26-9e47-43d8-a127-48b9686aacf1 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:58.192333 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f4437-d470-40d7-9338-8c99b0ba963c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:58.199846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b253ced-1adf-4687-9429-016a71dd8e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:58.200530 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b253ced-1adf-4687-9429-016a71dd8e50 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:58.200809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b253ced-1adf-4687-9429-016a71dd8e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:58.201073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b253ced-1adf-4687-9429-016a71dd8e50 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:58.201748 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b253ced-1adf-4687-9429-016a71dd8e50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:58.203686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b253ced-1adf-4687-9429-016a71dd8e50 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:58.224520 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 797/1586] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 00:59:58 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:59:58.225323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b253ced-1adf-4687-9429-016a71dd8e50 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:58.233643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f2a10-15aa-499f-aa90-3fc3b257eda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:58.234257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f2a10-15aa-499f-aa90-3fc3b257eda8 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:58.234537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f2a10-15aa-499f-aa90-3fc3b257eda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:58.234716 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b253ced-1adf-4687-9429-016a71dd8e50 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:58.234819 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f2a10-15aa-499f-aa90-3fc3b257eda8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:58.235744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f2a10-15aa-499f-aa90-3fc3b257eda8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:58.237352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f2a10-15aa-499f-aa90-3fc3b257eda8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:58.239505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7117c-c427-4b76-90fb-fb2954bc9986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:58.240079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7117c-c427-4b76-90fb-fb2954bc9986 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:58.240355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7117c-c427-4b76-90fb-fb2954bc9986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:58.241122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7117c-c427-4b76-90fb-fb2954bc9986 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:58.241779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7117c-c427-4b76-90fb-fb2954bc9986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:58.243345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7117c-c427-4b76-90fb-fb2954bc9986 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:58.245404 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:59:58.250796 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 790/1587] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 00:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 00:59:58.250796 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f2a10-15aa-499f-aa90-3fc3b257eda8 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:58.255384 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 798/1588] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 00:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 00:59:58.256153 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7117c-c427-4b76-90fb-fb2954bc9986 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:58.261296 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f2a10-15aa-499f-aa90-3fc3b257eda8 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:58.266016 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113644e-48df-4a71-a998-431b92fa9a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:58.266211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7117c-c427-4b76-90fb-fb2954bc9986 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:58.266653 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113644e-48df-4a71-a998-431b92fa9a9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:58.266933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113644e-48df-4a71-a998-431b92fa9a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:58.267206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113644e-48df-4a71-a998-431b92fa9a9a admin admin] PATH_INFO: `/v3/projects/b1145855880e4f6db8ccf257ccd35d2b/users/91025e1413374083ba70f600f70cc7fe/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:58.270675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49bf68b-087a-44ec-8261-86603b95af85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:58.271241 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bf68b-087a-44ec-8261-86603b95af85 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:58.271514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bf68b-087a-44ec-8261-86603b95af85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:58.271807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bf68b-087a-44ec-8261-86603b95af85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:58.272422 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49bf68b-087a-44ec-8261-86603b95af85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:58.274045 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49bf68b-087a-44ec-8261-86603b95af85 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:58.282510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113644e-48df-4a71-a998-431b92fa9a9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1145855880e4f6db8ccf257ccd35d2b, user_id=91025e1413374083ba70f600f70cc7fe, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:58.285087 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 799/1589] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 00:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 00:59:58.285197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113644e-48df-4a71-a998-431b92fa9a9a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:58.286727 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49bf68b-087a-44ec-8261-86603b95af85 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:58.298257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49bf68b-087a-44ec-8261-86603b95af85 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:58.300243 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 791/1590] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 00:59:58 2022] PUT /identity/v3/projects/b1145855880e4f6db8ccf257ccd35d2b/users/91025e1413374083ba70f600f70cc7fe/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:59:58.301457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e93c50-af99-44ec-936c-90117b457d47 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:58.301760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e93c50-af99-44ec-936c-90117b457d47 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:58.302040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e93c50-af99-44ec-936c-90117b457d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:58.329120 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a6e93c50-af99-44ec-936c-90117b457d47 None None] MFA Rules not processed for user `5df38b0724ba485fa93c6b043d9b262c`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:59:58.330365 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a6e93c50-af99-44ec-936c-90117b457d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:59:58.355306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf966f28-f12b-4928-b58d-b31f6c8348bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:58.355913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf966f28-f12b-4928-b58d-b31f6c8348bc admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:58.356194 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf966f28-f12b-4928-b58d-b31f6c8348bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:58.356464 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf966f28-f12b-4928-b58d-b31f6c8348bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:58.357098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf966f28-f12b-4928-b58d-b31f6c8348bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:58.358726 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf966f28-f12b-4928-b58d-b31f6c8348bc admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:58.369314 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 800/1591] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 00:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 00:59:58.370949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182abcb9-86fe-43f4-8d36-0152d003fa70 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:58.371232 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182abcb9-86fe-43f4-8d36-0152d003fa70 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:58.371503 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182abcb9-86fe-43f4-8d36-0152d003fa70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:58.395767 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 792/1592] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 00:59:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:59:58.396866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e93c50-af99-44ec-936c-90117b457d47 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:58.399666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-182abcb9-86fe-43f4-8d36-0152d003fa70 None None] MFA Rules not processed for user `caae49db19114c20b3bb86c81cda1ff9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:59:58.400990 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-182abcb9-86fe-43f4-8d36-0152d003fa70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:59:58.404096 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:59:58.411453 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e93c50-af99-44ec-936c-90117b457d47 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:58.416751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9346902-bc46-4943-bff2-4c20796e68df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:58.417352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9346902-bc46-4943-bff2-4c20796e68df admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:58.417657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9346902-bc46-4943-bff2-4c20796e68df admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:58.417925 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9346902-bc46-4943-bff2-4c20796e68df admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:58.418590 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9346902-bc46-4943-bff2-4c20796e68df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:58.420196 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9346902-bc46-4943-bff2-4c20796e68df admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:58.430455 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 793/1593] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 00:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 00:59:58.431298 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9346902-bc46-4943-bff2-4c20796e68df admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:58.441261 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9346902-bc46-4943-bff2-4c20796e68df admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:58.446480 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20001b84-ba4e-4556-9e9d-14e33d61b7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:58.447078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20001b84-ba4e-4556-9e9d-14e33d61b7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:58.447356 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20001b84-ba4e-4556-9e9d-14e33d61b7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:58.447629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20001b84-ba4e-4556-9e9d-14e33d61b7e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:58.448259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20001b84-ba4e-4556-9e9d-14e33d61b7e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:58.449938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20001b84-ba4e-4556-9e9d-14e33d61b7e0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:58.460272 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 794/1594] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 00:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 00:59:58.461080 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20001b84-ba4e-4556-9e9d-14e33d61b7e0 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:58.470712 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20001b84-ba4e-4556-9e9d-14e33d61b7e0 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:58.475889 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 801/1595] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 00:59:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:59:58.476004 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05129337-8a2c-4bd9-94cf-34c7546ecf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:58.476570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05129337-8a2c-4bd9-94cf-34c7546ecf19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:58.476849 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05129337-8a2c-4bd9-94cf-34c7546ecf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:58.477047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182abcb9-86fe-43f4-8d36-0152d003fa70 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:58.477161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05129337-8a2c-4bd9-94cf-34c7546ecf19 admin admin] PATH_INFO: `/v3/projects/aecb01baaaad48708791439cea5d8a3f/users/51557c0b966a49e4816c534ceda6b8a9/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:58.488969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182abcb9-86fe-43f4-8d36-0152d003fa70 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:58.492698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05129337-8a2c-4bd9-94cf-34c7546ecf19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aecb01baaaad48708791439cea5d8a3f, user_id=51557c0b966a49e4816c534ceda6b8a9, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:58.494068 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712d030-df03-497e-99b5-a1295075e37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:58.494688 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712d030-df03-497e-99b5-a1295075e37b admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:58.494991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712d030-df03-497e-99b5-a1295075e37b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:58.495259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712d030-df03-497e-99b5-a1295075e37b admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:58.495372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05129337-8a2c-4bd9-94cf-34c7546ecf19 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:58.495887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712d030-df03-497e-99b5-a1295075e37b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:58.497465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712d030-df03-497e-99b5-a1295075e37b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:58.508321 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 795/1596] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 00:59:58 2022] PUT /identity/v3/projects/aecb01baaaad48708791439cea5d8a3f/users/51557c0b966a49e4816c534ceda6b8a9/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:59:58.509820 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 802/1597] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 00:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 00:59:58.510664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712d030-df03-497e-99b5-a1295075e37b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:58.510896 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05129337-8a2c-4bd9-94cf-34c7546ecf19 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:58.521596 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712d030-df03-497e-99b5-a1295075e37b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:58.577927 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fac7d7-62bf-456f-83e0-bb53d4e10e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:58.578542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fac7d7-62bf-456f-83e0-bb53d4e10e97 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:58.578821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fac7d7-62bf-456f-83e0-bb53d4e10e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:58.579203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fac7d7-62bf-456f-83e0-bb53d4e10e97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:58.579958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fac7d7-62bf-456f-83e0-bb53d4e10e97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:58.581587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fac7d7-62bf-456f-83e0-bb53d4e10e97 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:58.582298 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05129337-8a2c-4bd9-94cf-34c7546ecf19 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:58.583635 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:59:58.587197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f662b-5f29-4222-9e61-789bbd3dfedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:58.587804 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f662b-5f29-4222-9e61-789bbd3dfedf admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:58.588088 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f662b-5f29-4222-9e61-789bbd3dfedf admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:58.588358 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f662b-5f29-4222-9e61-789bbd3dfedf admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:58.588983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f662b-5f29-4222-9e61-789bbd3dfedf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:58.590635 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f662b-5f29-4222-9e61-789bbd3dfedf admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:58.592579 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 803/1598] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 00:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 00:59:58.593461 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fac7d7-62bf-456f-83e0-bb53d4e10e97 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:58.595095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c9fac7d7-62bf-456f-83e0-bb53d4e10e97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:59:58.604642 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 796/1599] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 00:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 00:59:58.605531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f662b-5f29-4222-9e61-789bbd3dfedf admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:58.615028 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f662b-5f29-4222-9e61-789bbd3dfedf admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:58.620266 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a030955-1e06-45a3-8de2-0a0786ed8011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:58.620846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a030955-1e06-45a3-8de2-0a0786ed8011 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:58.621129 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a030955-1e06-45a3-8de2-0a0786ed8011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:58.621404 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a030955-1e06-45a3-8de2-0a0786ed8011 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:58.622357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a030955-1e06-45a3-8de2-0a0786ed8011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:58.623664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a030955-1e06-45a3-8de2-0a0786ed8011 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:58.633702 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 797/1600] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 00:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 00:59:58.634306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a030955-1e06-45a3-8de2-0a0786ed8011 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:58.645683 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a030955-1e06-45a3-8de2-0a0786ed8011 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:58.650384 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37089c6a-f4e3-454d-98e5-08a4bf8d789e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:58.651047 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37089c6a-f4e3-454d-98e5-08a4bf8d789e admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:58.651325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37089c6a-f4e3-454d-98e5-08a4bf8d789e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:58.651593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37089c6a-f4e3-454d-98e5-08a4bf8d789e admin admin] PATH_INFO: `/v3/projects/eb9892d9ceda458f84d3880b3193d33d/users/6153466275a841079473eb61068f8ec7/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:58.656075 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fac7d7-62bf-456f-83e0-bb53d4e10e97 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:58.659778 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f97b86-985e-43bd-930a-cb4f0a28133f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:58.660390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f97b86-985e-43bd-930a-cb4f0a28133f service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:58.660670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f97b86-985e-43bd-930a-cb4f0a28133f service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:58.660966 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f97b86-985e-43bd-930a-cb4f0a28133f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:58.666344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37089c6a-f4e3-454d-98e5-08a4bf8d789e admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb9892d9ceda458f84d3880b3193d33d, user_id=6153466275a841079473eb61068f8ec7, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:58.668971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37089c6a-f4e3-454d-98e5-08a4bf8d789e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:58.682868 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 798/1601] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 00:59:58 2022] PUT /identity/v3/projects/eb9892d9ceda458f84d3880b3193d33d/users/6153466275a841079473eb61068f8ec7/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:59:58.686689 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37089c6a-f4e3-454d-98e5-08a4bf8d789e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:58.720671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f97b86-985e-43bd-930a-cb4f0a28133f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:58.722715 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f97b86-985e-43bd-930a-cb4f0a28133f service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:58.733308 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 804/1602] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 00:59:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 00:59:58.734135 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f97b86-985e-43bd-930a-cb4f0a28133f service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:58.745203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f97b86-985e-43bd-930a-cb4f0a28133f service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:58.749835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8feb4-cc44-446d-8309-2da5cfe7db1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:58.750483 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8feb4-cc44-446d-8309-2da5cfe7db1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:58.750766 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8feb4-cc44-446d-8309-2da5cfe7db1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:58.751036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8feb4-cc44-446d-8309-2da5cfe7db1c admin admin] PATH_INFO: `/v3/projects/73d93fd9c4444ffdb1caf71d6911f1ef/users/b896c96e48e74034aadf845869ac7f4a/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:58.755689 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37089c6a-f4e3-454d-98e5-08a4bf8d789e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:58.760735 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bed6b3-7b89-4fbe-a0c1-ee04bcd9cc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:58.761400 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bed6b3-7b89-4fbe-a0c1-ee04bcd9cc89 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:58.761725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bed6b3-7b89-4fbe-a0c1-ee04bcd9cc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:58.761889 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bed6b3-7b89-4fbe-a0c1-ee04bcd9cc89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:58.762486 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bed6b3-7b89-4fbe-a0c1-ee04bcd9cc89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:58.764682 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bed6b3-7b89-4fbe-a0c1-ee04bcd9cc89 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:58.768081 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8feb4-cc44-446d-8309-2da5cfe7db1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=73d93fd9c4444ffdb1caf71d6911f1ef, user_id=b896c96e48e74034aadf845869ac7f4a, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:58.769006 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8feb4-cc44-446d-8309-2da5cfe7db1c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:58.806484 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 805/1603] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 00:59:58 2022] PUT /identity/v3/projects/73d93fd9c4444ffdb1caf71d6911f1ef/users/b896c96e48e74034aadf845869ac7f4a/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:59:58.806484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557524c-75c8-4840-90ba-ea8e9dc95dbe None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:58.806484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557524c-75c8-4840-90ba-ea8e9dc95dbe None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:58.806484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557524c-75c8-4840-90ba-ea8e9dc95dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:58.811767 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 799/1604] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 00:59:58 2022] POST /identity/v3/projects => generated 369 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:59:58.813055 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bed6b3-7b89-4fbe-a0c1-ee04bcd9cc89 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:58.819683 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:59:58.837499 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-3557524c-75c8-4840-90ba-ea8e9dc95dbe None None] MFA Rules not processed for user `51557c0b966a49e4816c534ceda6b8a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:59:58.839919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3557524c-75c8-4840-90ba-ea8e9dc95dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:59:58.886466 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bed6b3-7b89-4fbe-a0c1-ee04bcd9cc89 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:58.891995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57eb7db-4b2d-4ba2-9d5b-44e88e1b1752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:58.892656 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57eb7db-4b2d-4ba2-9d5b-44e88e1b1752 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:58.892936 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57eb7db-4b2d-4ba2-9d5b-44e88e1b1752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:58.893209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57eb7db-4b2d-4ba2-9d5b-44e88e1b1752 admin admin] PATH_INFO: `/v3/projects/a6a9406fa37e48de8853999c0aa67a21/users/5bd1c3dbb0ba4bf9a6a47c3d739e2afc/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:58.909791 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57eb7db-4b2d-4ba2-9d5b-44e88e1b1752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6a9406fa37e48de8853999c0aa67a21, user_id=5bd1c3dbb0ba4bf9a6a47c3d739e2afc, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:58.913092 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57eb7db-4b2d-4ba2-9d5b-44e88e1b1752 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:58.914222 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 806/1605] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 00:59:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:59:58.918366 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557524c-75c8-4840-90ba-ea8e9dc95dbe None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:58.929965 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 800/1606] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 00:59:58 2022] PUT /identity/v3/projects/a6a9406fa37e48de8853999c0aa67a21/users/5bd1c3dbb0ba4bf9a6a47c3d739e2afc/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:59:58.930166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557524c-75c8-4840-90ba-ea8e9dc95dbe None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:58.931579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57eb7db-4b2d-4ba2-9d5b-44e88e1b1752 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:58.956410 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:59:59.010294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57eb7db-4b2d-4ba2-9d5b-44e88e1b1752 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:59.015733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63038a9-188a-4b8f-9f4c-6324743acf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:59.016315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63038a9-188a-4b8f-9f4c-6324743acf9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:59.016585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63038a9-188a-4b8f-9f4c-6324743acf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:59.016856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63038a9-188a-4b8f-9f4c-6324743acf9a admin admin] PATH_INFO: `/v3/projects/318b4f17029a4240bffcd94d5103cf56/users/05f54677df04452fb4d1c76cdf9febaf/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:59.017845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf25aaa-eeba-4a0c-b556-e39dd7d1020c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:59.018620 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf25aaa-eeba-4a0c-b556-e39dd7d1020c admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:59.018971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf25aaa-eeba-4a0c-b556-e39dd7d1020c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:59.019313 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf25aaa-eeba-4a0c-b556-e39dd7d1020c admin admin] PATH_INFO: `/v3/projects/b1145855880e4f6db8ccf257ccd35d2b/users/91025e1413374083ba70f600f70cc7fe/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:59.021305 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf25aaa-eeba-4a0c-b556-e39dd7d1020c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1145855880e4f6db8ccf257ccd35d2b, user_id=91025e1413374083ba70f600f70cc7fe, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:59.024755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf25aaa-eeba-4a0c-b556-e39dd7d1020c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:59.036246 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 807/1607] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 00:59:58 2022] PUT /identity/v3/projects/b1145855880e4f6db8ccf257ccd35d2b/users/91025e1413374083ba70f600f70cc7fe/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:59:59.037492 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35456fe4-b611-4e10-815d-9cbec97a4c89 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:59.038306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35456fe4-b611-4e10-815d-9cbec97a4c89 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:59.038652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35456fe4-b611-4e10-815d-9cbec97a4c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:59.043600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63038a9-188a-4b8f-9f4c-6324743acf9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=318b4f17029a4240bffcd94d5103cf56, user_id=05f54677df04452fb4d1c76cdf9febaf, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:59.046861 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63038a9-188a-4b8f-9f4c-6324743acf9a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:59.075473 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 801/1608] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 00:59:58 2022] PUT /identity/v3/projects/318b4f17029a4240bffcd94d5103cf56/users/05f54677df04452fb4d1c76cdf9febaf/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:59:59.076544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b815f-a932-489c-ad15-d474c9243ee2 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:59.076832 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b815f-a932-489c-ad15-d474c9243ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:59.077109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b815f-a932-489c-ad15-d474c9243ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:59.078478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-35456fe4-b611-4e10-815d-9cbec97a4c89 None None] MFA Rules not processed for user `6153466275a841079473eb61068f8ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:59:59.079806 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-35456fe4-b611-4e10-815d-9cbec97a4c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:59:59.111442 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-431b815f-a932-489c-ad15-d474c9243ee2 None None] MFA Rules not processed for user `b896c96e48e74034aadf845869ac7f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:59:59.112680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-431b815f-a932-489c-ad15-d474c9243ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:59:59.156497 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 808/1609] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 00:59:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:59:59.158456 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35456fe4-b611-4e10-815d-9cbec97a4c89 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:59.174221 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:59:59.181856 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 802/1610] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 00:59:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:59:59.182680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b815f-a932-489c-ad15-d474c9243ee2 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:59.221948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35456fe4-b611-4e10-815d-9cbec97a4c89 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:59.227150 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3a81d-b51d-43c4-8a06-f756e7370bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:59.227753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3a81d-b51d-43c4-8a06-f756e7370bbd admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:59.228029 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3a81d-b51d-43c4-8a06-f756e7370bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:59.228296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3a81d-b51d-43c4-8a06-f756e7370bbd admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:59.228923 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3a81d-b51d-43c4-8a06-f756e7370bbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:59.230858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3a81d-b51d-43c4-8a06-f756e7370bbd admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:59.247021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b815f-a932-489c-ad15-d474c9243ee2 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:59.251632 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b9a83-0eed-44d2-b44a-d4e0be544fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:59.252238 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b9a83-0eed-44d2-b44a-d4e0be544fc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:59.252513 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b9a83-0eed-44d2-b44a-d4e0be544fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:59.252779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b9a83-0eed-44d2-b44a-d4e0be544fc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:59.253344 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 809/1611] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 00:59:59 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:59:59.253538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b9a83-0eed-44d2-b44a-d4e0be544fc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:59.255465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b9a83-0eed-44d2-b44a-d4e0be544fc0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:59.258580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb0ac1-df41-4619-b3b5-06f73b6af69f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:59.258870 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb0ac1-df41-4619-b3b5-06f73b6af69f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:59.259145 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb0ac1-df41-4619-b3b5-06f73b6af69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:59.284697 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 803/1612] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 00:59:59 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:59:59.286373 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b5faf-afc4-44e5-a7ea-571a92005b1b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:59.286929 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b5faf-afc4-44e5-a7ea-571a92005b1b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:59.287209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b5faf-afc4-44e5-a7ea-571a92005b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:59.288245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-4cdb0ac1-df41-4619-b3b5-06f73b6af69f None None] MFA Rules not processed for user `5bd1c3dbb0ba4bf9a6a47c3d739e2afc`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:59:59.289618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4cdb0ac1-df41-4619-b3b5-06f73b6af69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:59:59.308299 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:59:59.314814 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e79b5faf-afc4-44e5-a7ea-571a92005b1b None None] MFA Rules not processed for user `91025e1413374083ba70f600f70cc7fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:59:59.315998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e79b5faf-afc4-44e5-a7ea-571a92005b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:59:59.356714 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 810/1613] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 00:59:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:59:59.357994 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ea112-e635-4b71-b05c-4a2a0c056e28 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:59.358279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ea112-e635-4b71-b05c-4a2a0c056e28 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:59.358575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ea112-e635-4b71-b05c-4a2a0c056e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:59.383611 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 804/1614] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 00:59:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:59:59.384435 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b5faf-afc4-44e5-a7ea-571a92005b1b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:59.385964 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d56ea112-e635-4b71-b05c-4a2a0c056e28 None None] MFA Rules not processed for user `05f54677df04452fb4d1c76cdf9febaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:59:59.387226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d56ea112-e635-4b71-b05c-4a2a0c056e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:59:59.460135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b5faf-afc4-44e5-a7ea-571a92005b1b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:59.467134 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967518e-87a7-4e90-87f1-6c4085445585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:59.467775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967518e-87a7-4e90-87f1-6c4085445585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:59.468054 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967518e-87a7-4e90-87f1-6c4085445585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:59.468327 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967518e-87a7-4e90-87f1-6c4085445585 admin admin] PATH_INFO: `/v3/users/5df38b0724ba485fa93c6b043d9b262c` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:59.469483 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8967518e-87a7-4e90-87f1-6c4085445585 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5df38b0724ba485fa93c6b043d9b262c)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:59.471424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8967518e-87a7-4e90-87f1-6c4085445585 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:59.474309 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 811/1615] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 00:59:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:59:59.475162 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ea112-e635-4b71-b05c-4a2a0c056e28 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:59.483335 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:59:59.486069 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ea112-e635-4b71-b05c-4a2a0c056e28 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:59.492495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c5fc9-85c5-4d40-9615-88d855e6bb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:59.493110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c5fc9-85c5-4d40-9615-88d855e6bb77 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:59.493384 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c5fc9-85c5-4d40-9615-88d855e6bb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:59.493689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c5fc9-85c5-4d40-9615-88d855e6bb77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:59.494322 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c5fc9-85c5-4d40-9615-88d855e6bb77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:59.496228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c5fc9-85c5-4d40-9615-88d855e6bb77 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:59.523277 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8967518e-87a7-4e90-87f1-6c4085445585 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5df38b0724ba485fa93c6b043d9b262c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 00:59:59.523925 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8967518e-87a7-4e90-87f1-6c4085445585 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5df38b0724ba485fa93c6b043d9b262c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 00:59:59.525221 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 812/1616] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 00:59:59 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:59:59.528487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c5fc9-85c5-4d40-9615-88d855e6bb77 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:59.528487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-937c5fc9-85c5-4d40-9615-88d855e6bb77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:59:59.534182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8967518e-87a7-4e90-87f1-6c4085445585 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5df38b0724ba485fa93c6b043d9b262c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 00:59:59.542553 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8967518e-87a7-4e90-87f1-6c4085445585 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5df38b0724ba485fa93c6b043d9b262c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 00:59:59.543178 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8967518e-87a7-4e90-87f1-6c4085445585 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5df38b0724ba485fa93c6b043d9b262c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 00:59:59.560466 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 805/1617] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 00:59:59 2022] DELETE /identity/v3/users/5df38b0724ba485fa93c6b043d9b262c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:59:59.561472 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967518e-87a7-4e90-87f1-6c4085445585 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:59.562715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8967518e-87a7-4e90-87f1-6c4085445585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:59:59.591969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c5fc9-85c5-4d40-9615-88d855e6bb77 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:59.625955 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:59:59.628632 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967518e-87a7-4e90-87f1-6c4085445585 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:59.634847 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700900a-c945-4bc6-8d1b-a5d41e996476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:59.635460 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700900a-c945-4bc6-8d1b-a5d41e996476 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:59.635744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700900a-c945-4bc6-8d1b-a5d41e996476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:59.636016 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700900a-c945-4bc6-8d1b-a5d41e996476 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:59.636769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700900a-c945-4bc6-8d1b-a5d41e996476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:59.638423 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700900a-c945-4bc6-8d1b-a5d41e996476 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:59.648516 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 806/1618] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 00:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 00:59:59.649294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700900a-c945-4bc6-8d1b-a5d41e996476 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:59.653249 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4700900a-c945-4bc6-8d1b-a5d41e996476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:59:59.654716 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f2858-cb7d-4b10-a9d9-144ca600d755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:59.655329 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f2858-cb7d-4b10-a9d9-144ca600d755 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:59.655609 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f2858-cb7d-4b10-a9d9-144ca600d755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:59.655879 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f2858-cb7d-4b10-a9d9-144ca600d755 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:59.656506 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528f2858-cb7d-4b10-a9d9-144ca600d755 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:59.658474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528f2858-cb7d-4b10-a9d9-144ca600d755 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:59.665501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700900a-c945-4bc6-8d1b-a5d41e996476 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:59.670416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d4dd7-3b9d-47d2-87de-8c2667a0897e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:59.671126 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d4dd7-3b9d-47d2-87de-8c2667a0897e admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:59.671521 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d4dd7-3b9d-47d2-87de-8c2667a0897e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:59.671797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d4dd7-3b9d-47d2-87de-8c2667a0897e admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:59.672414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d4dd7-3b9d-47d2-87de-8c2667a0897e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:59.674515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d4dd7-3b9d-47d2-87de-8c2667a0897e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:59.688473 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 813/1619] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 00:59:59 2022] POST /identity/v3/projects => generated 379 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:59:59.688473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f2858-cb7d-4b10-a9d9-144ca600d755 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:59.689571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-528f2858-cb7d-4b10-a9d9-144ca600d755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:59:59.700250 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 807/1620] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 00:59:59 2022] POST /identity/v3/users => generated 297 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:59:59.700250 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb9688-782b-42b7-9589-d8fed889cfcb None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:59.700250 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb9688-782b-42b7-9589-d8fed889cfcb None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:59.700250 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb9688-782b-42b7-9589-d8fed889cfcb None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:59.700934 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 808/1621] 10.222.0.30 () {54 vars in 962 bytes} [Sun Sep 4 00:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 00:59:59.701636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb9688-782b-42b7-9589-d8fed889cfcb None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:59.703302 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4bcb9688-782b-42b7-9589-d8fed889cfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:59:59.755247 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f2858-cb7d-4b10-a9d9-144ca600d755 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:59.760663 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42075f08-a973-4254-b03e-852cdce73a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:59.761271 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42075f08-a973-4254-b03e-852cdce73a05 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:59.761655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42075f08-a973-4254-b03e-852cdce73a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:59.761927 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42075f08-a973-4254-b03e-852cdce73a05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:59.762555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42075f08-a973-4254-b03e-852cdce73a05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:59.764474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42075f08-a973-4254-b03e-852cdce73a05 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:59.774393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb9688-782b-42b7-9589-d8fed889cfcb None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:59.779937 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db6146-21f8-4297-99a1-26a48adb9e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:59.780560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db6146-21f8-4297-99a1-26a48adb9e7e admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:59.780849 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db6146-21f8-4297-99a1-26a48adb9e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:59.781127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db6146-21f8-4297-99a1-26a48adb9e7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:59.781860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db6146-21f8-4297-99a1-26a48adb9e7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:59.784773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db6146-21f8-4297-99a1-26a48adb9e7e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:59.797901 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 814/1622] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 00:59:59 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:59:59.797901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42075f08-a973-4254-b03e-852cdce73a05 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:59.798526 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:59:59.799951 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-42075f08-a973-4254-b03e-852cdce73a05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:59:59.817163 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 809/1623] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 00:59:59 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:59:59.818530 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac778e-704c-493c-a3e4-c30670359b7a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:59.819386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac778e-704c-493c-a3e4-c30670359b7a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:59.819663 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac778e-704c-493c-a3e4-c30670359b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:59.839081 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-90ac778e-704c-493c-a3e4-c30670359b7a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 00:59:59.840296 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-90ac778e-704c-493c-a3e4-c30670359b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 00:59:59.866621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42075f08-a973-4254-b03e-852cdce73a05 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:59.898712 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 810/1624] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 00:59:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 00:59:59.899839 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac778e-704c-493c-a3e4-c30670359b7a None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:59.909117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac778e-704c-493c-a3e4-c30670359b7a None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 00:59:59.913788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7f833-d4de-49e7-9a82-55ce10f85f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:59.914438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7f833-d4de-49e7-9a82-55ce10f85f23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:59.914719 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7f833-d4de-49e7-9a82-55ce10f85f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:59.914989 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7f833-d4de-49e7-9a82-55ce10f85f23 admin admin] PATH_INFO: `/v3/projects/52bfe932448d4af98b7d52c3da37f8bb/users/d5cad13455ee4c88bdc96260ed9c7a9c/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:59.915565 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:59:59.926271 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7cea58-bc62-4531-ac71-fbbf262004d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 00:59:59.927154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7cea58-bc62-4531-ac71-fbbf262004d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 00:59:59.927442 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7cea58-bc62-4531-ac71-fbbf262004d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 00:59:59.927719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7cea58-bc62-4531-ac71-fbbf262004d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 00:59:59.928889 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7cea58-bc62-4531-ac71-fbbf262004d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:59.930861 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7cea58-bc62-4531-ac71-fbbf262004d2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:59.930966 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7f833-d4de-49e7-9a82-55ce10f85f23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52bfe932448d4af98b7d52c3da37f8bb, user_id=d5cad13455ee4c88bdc96260ed9c7a9c, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 00:59:59.933640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7f833-d4de-49e7-9a82-55ce10f85f23 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 00:59:59.948163 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 811/1625] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 00:59:59 2022] PUT /identity/v3/projects/52bfe932448d4af98b7d52c3da37f8bb/users/d5cad13455ee4c88bdc96260ed9c7a9c/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 00:59:59.948927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7f833-d4de-49e7-9a82-55ce10f85f23 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:59.958304 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 815/1626] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 00:59:59 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 00:59:59.959131 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7cea58-bc62-4531-ac71-fbbf262004d2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 00:59:59.969706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7cea58-bc62-4531-ac71-fbbf262004d2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:00.014408 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7f833-d4de-49e7-9a82-55ce10f85f23 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:00.019304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fec11-803b-46c3-937c-8ba5aa4c0b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:00.019906 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fec11-803b-46c3-937c-8ba5aa4c0b10 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:00.020180 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fec11-803b-46c3-937c-8ba5aa4c0b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:00.020449 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fec11-803b-46c3-937c-8ba5aa4c0b10 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:00.021076 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3fec11-803b-46c3-937c-8ba5aa4c0b10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:00.023083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3fec11-803b-46c3-937c-8ba5aa4c0b10 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:00.027658 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccc631-f902-4c78-8241-06bb5d5d6809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:00.028302 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccc631-f902-4c78-8241-06bb5d5d6809 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:00.028556 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccc631-f902-4c78-8241-06bb5d5d6809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:00.028835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccc631-f902-4c78-8241-06bb5d5d6809 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:00.029508 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eccc631-f902-4c78-8241-06bb5d5d6809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:00.031097 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eccc631-f902-4c78-8241-06bb5d5d6809 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:00.043202 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 816/1627] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 00:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:00.043202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2d8ca-c9e0-4bc9-ae2c-443a5aeef088 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:00.043202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2d8ca-c9e0-4bc9-ae2c-443a5aeef088 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:00.043202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2d8ca-c9e0-4bc9-ae2c-443a5aeef088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:00.053717 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 812/1628] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 00:59:59 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:00.053717 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fec11-803b-46c3-937c-8ba5aa4c0b10 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:00.061934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fec11-803b-46c3-937c-8ba5aa4c0b10 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:00.066579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88916d7d-a5d8-4c3b-99b8-280a31dfd0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:00.067172 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88916d7d-a5d8-4c3b-99b8-280a31dfd0a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:00.067452 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88916d7d-a5d8-4c3b-99b8-280a31dfd0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:00.067726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88916d7d-a5d8-4c3b-99b8-280a31dfd0a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:00.068356 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88916d7d-a5d8-4c3b-99b8-280a31dfd0a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:00.070346 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88916d7d-a5d8-4c3b-99b8-280a31dfd0a7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:00.089271 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5ce2d8ca-c9e0-4bc9-ae2c-443a5aeef088 None None] MFA Rules not processed for user `13f0f341bf2c475d82b4e7b34d503dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:00.090503 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5ce2d8ca-c9e0-4bc9-ae2c-443a5aeef088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:00.094669 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 813/1629] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:00 2022] POST /identity/v3/users => generated 294 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:00.094669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88916d7d-a5d8-4c3b-99b8-280a31dfd0a7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:00.107781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88916d7d-a5d8-4c3b-99b8-280a31dfd0a7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:00.114741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787bd9e-7354-4ceb-8abd-ce8730fdb530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:00.115361 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787bd9e-7354-4ceb-8abd-ce8730fdb530 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:00.116359 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787bd9e-7354-4ceb-8abd-ce8730fdb530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:00.116772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787bd9e-7354-4ceb-8abd-ce8730fdb530 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:00.117418 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787bd9e-7354-4ceb-8abd-ce8730fdb530 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:00.120136 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787bd9e-7354-4ceb-8abd-ce8730fdb530 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:00.143358 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 814/1630] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:00 2022] POST /identity/v3/users => generated 300 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:00.144187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787bd9e-7354-4ceb-8abd-ce8730fdb530 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:00.145956 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0787bd9e-7354-4ceb-8abd-ce8730fdb530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:00.167319 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 817/1631] 10.222.0.30 () {58 vars in 1059 bytes} [Sun Sep 4 01:00:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:00.168064 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2d8ca-c9e0-4bc9-ae2c-443a5aeef088 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:00.177779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2d8ca-c9e0-4bc9-ae2c-443a5aeef088 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:00.179519 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:00.183584 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf15a5dc-f1bf-4416-9260-59500a583e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:00.184224 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15a5dc-f1bf-4416-9260-59500a583e0d admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:00.184492 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15a5dc-f1bf-4416-9260-59500a583e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:00.184842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15a5dc-f1bf-4416-9260-59500a583e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:00.185398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf15a5dc-f1bf-4416-9260-59500a583e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:00.187018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf15a5dc-f1bf-4416-9260-59500a583e0d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:00.197079 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 818/1632] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:00.197902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf15a5dc-f1bf-4416-9260-59500a583e0d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:00.209397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf15a5dc-f1bf-4416-9260-59500a583e0d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:00.212579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787bd9e-7354-4ceb-8abd-ce8730fdb530 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:00.214347 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2d1e1-b195-4ae5-84ed-41b2fad313e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:00.214930 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2d1e1-b195-4ae5-84ed-41b2fad313e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:00.215214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2d1e1-b195-4ae5-84ed-41b2fad313e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:00.215487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2d1e1-b195-4ae5-84ed-41b2fad313e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:00.216114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2d1e1-b195-4ae5-84ed-41b2fad313e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:00.216224 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941d13f-82fe-40e3-9b87-770ebcda5292 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:00.216771 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941d13f-82fe-40e3-9b87-770ebcda5292 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:00.217048 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941d13f-82fe-40e3-9b87-770ebcda5292 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:00.217316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941d13f-82fe-40e3-9b87-770ebcda5292 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:00.217742 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2d1e1-b195-4ae5-84ed-41b2fad313e3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:00.231478 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 819/1633] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:00.232058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941d13f-82fe-40e3-9b87-770ebcda5292 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:00.232134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2d1e1-b195-4ae5-84ed-41b2fad313e3 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:00.232221 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941d13f-82fe-40e3-9b87-770ebcda5292 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:00.239353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2d1e1-b195-4ae5-84ed-41b2fad313e3 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:00.240317 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 815/1634] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:00.241739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941d13f-82fe-40e3-9b87-770ebcda5292 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:00.245291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84c45c-ab8b-45d0-a7ca-a5be82e7ecc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:00.245979 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84c45c-ab8b-45d0-a7ca-a5be82e7ecc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:00.246258 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84c45c-ab8b-45d0-a7ca-a5be82e7ecc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:00.246535 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84c45c-ab8b-45d0-a7ca-a5be82e7ecc5 admin admin] PATH_INFO: `/v3/projects/bd7bf004460f4852a3177fa9d6c4c7a7/users/7e84e2afdd1d4837b6f1ede8c90ef263/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:00.252282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941d13f-82fe-40e3-9b87-770ebcda5292 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:00.257721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2435c2-c40a-4c24-a2f6-25663fdddd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:00.258323 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2435c2-c40a-4c24-a2f6-25663fdddd71 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:00.258601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2435c2-c40a-4c24-a2f6-25663fdddd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:00.258869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2435c2-c40a-4c24-a2f6-25663fdddd71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:00.259634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2435c2-c40a-4c24-a2f6-25663fdddd71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:00.261489 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2435c2-c40a-4c24-a2f6-25663fdddd71 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:00.265213 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84c45c-ab8b-45d0-a7ca-a5be82e7ecc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd7bf004460f4852a3177fa9d6c4c7a7, user_id=7e84e2afdd1d4837b6f1ede8c90ef263, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:00.268578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84c45c-ab8b-45d0-a7ca-a5be82e7ecc5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:00.275695 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 816/1635] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:00.276619 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2435c2-c40a-4c24-a2f6-25663fdddd71 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:00.290763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2435c2-c40a-4c24-a2f6-25663fdddd71 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:00.295217 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 820/1636] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:00 2022] PUT /identity/v3/projects/bd7bf004460f4852a3177fa9d6c4c7a7/users/7e84e2afdd1d4837b6f1ede8c90ef263/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:00.295217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84c45c-ab8b-45d0-a7ca-a5be82e7ecc5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:00.317847 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:00.362118 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20f424-cc17-4330-b011-f507dd051763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:00.362837 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20f424-cc17-4330-b011-f507dd051763 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:00.363500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20f424-cc17-4330-b011-f507dd051763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:00.363500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20f424-cc17-4330-b011-f507dd051763 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:00.364150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d20f424-cc17-4330-b011-f507dd051763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:00.366171 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d20f424-cc17-4330-b011-f507dd051763 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:00.380061 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 817/1637] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:00.381053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20f424-cc17-4330-b011-f507dd051763 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:00.393689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84c45c-ab8b-45d0-a7ca-a5be82e7ecc5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:00.399816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788985cc-728e-4269-99af-540eef58a4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:00.400663 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788985cc-728e-4269-99af-540eef58a4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:00.401116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788985cc-728e-4269-99af-540eef58a4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:00.401735 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788985cc-728e-4269-99af-540eef58a4a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:00.402763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788985cc-728e-4269-99af-540eef58a4a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:00.405126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788985cc-728e-4269-99af-540eef58a4a2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:00.421579 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 821/1638] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:00.422602 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788985cc-728e-4269-99af-540eef58a4a2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:00.453091 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788985cc-728e-4269-99af-540eef58a4a2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:00.460693 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9385d2e-cfb3-4e30-a5f9-2dac88ccd6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:00.461665 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9385d2e-cfb3-4e30-a5f9-2dac88ccd6a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:00.462101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9385d2e-cfb3-4e30-a5f9-2dac88ccd6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:00.462450 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9385d2e-cfb3-4e30-a5f9-2dac88ccd6a5 admin admin] PATH_INFO: `/v3/projects/52bfe932448d4af98b7d52c3da37f8bb/users/d5cad13455ee4c88bdc96260ed9c7a9c/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:00.464973 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9385d2e-cfb3-4e30-a5f9-2dac88ccd6a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52bfe932448d4af98b7d52c3da37f8bb, user_id=d5cad13455ee4c88bdc96260ed9c7a9c, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:00.469416 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9385d2e-cfb3-4e30-a5f9-2dac88ccd6a5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:00.486603 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 822/1639] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:00 2022] PUT /identity/v3/projects/52bfe932448d4af98b7d52c3da37f8bb/users/d5cad13455ee4c88bdc96260ed9c7a9c/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:00.487640 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9385d2e-cfb3-4e30-a5f9-2dac88ccd6a5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:00.491128 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20f424-cc17-4330-b011-f507dd051763 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:00.549528 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:00.569938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9385d2e-cfb3-4e30-a5f9-2dac88ccd6a5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:00.572877 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099922cd-9066-4bcf-a0dd-25a128a65211 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:00.573612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099922cd-9066-4bcf-a0dd-25a128a65211 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:00.573899 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099922cd-9066-4bcf-a0dd-25a128a65211 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:00.574190 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099922cd-9066-4bcf-a0dd-25a128a65211 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:00.575947 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-099922cd-9066-4bcf-a0dd-25a128a65211 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:00.579259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6c77a-af88-4a5d-b579-a893c40ce246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:00.579727 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6c77a-af88-4a5d-b579-a893c40ce246 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:00.580101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6c77a-af88-4a5d-b579-a893c40ce246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:00.580771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6c77a-af88-4a5d-b579-a893c40ce246 admin admin] PATH_INFO: `/v3/projects/7d8124f215d94e4f95b53ace98d5b234/users/a609137f14a6492dabd80d8aa93a875f/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:00.598217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6c77a-af88-4a5d-b579-a893c40ce246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d8124f215d94e4f95b53ace98d5b234, user_id=a609137f14a6492dabd80d8aa93a875f, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:00.601848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6c77a-af88-4a5d-b579-a893c40ce246 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:00.617288 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 823/1640] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:00 2022] PUT /identity/v3/projects/7d8124f215d94e4f95b53ace98d5b234/users/a609137f14a6492dabd80d8aa93a875f/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:00.617288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6c77a-af88-4a5d-b579-a893c40ce246 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:00.672893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099922cd-9066-4bcf-a0dd-25a128a65211 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:00.674542 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099922cd-9066-4bcf-a0dd-25a128a65211 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:00.684425 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 818/1641] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:00 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:00.685233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099922cd-9066-4bcf-a0dd-25a128a65211 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:00.691795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6c77a-af88-4a5d-b579-a893c40ce246 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:00.695202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099922cd-9066-4bcf-a0dd-25a128a65211 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:00.696734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c939d7f-46dd-47e1-9991-8d2a6abf48e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:00.697404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c939d7f-46dd-47e1-9991-8d2a6abf48e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:00.697712 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c939d7f-46dd-47e1-9991-8d2a6abf48e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:00.697988 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c939d7f-46dd-47e1-9991-8d2a6abf48e5 admin admin] PATH_INFO: `/v3/projects/12e547a50be8494083c2a3693813e47b/users/434c194ab7f64624acc657c2b595847a/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:00.699714 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f8f0a-b8e6-4edd-b21e-5af2d9bdba98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:00.700299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f8f0a-b8e6-4edd-b21e-5af2d9bdba98 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:00.700582 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f8f0a-b8e6-4edd-b21e-5af2d9bdba98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:00.700855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f8f0a-b8e6-4edd-b21e-5af2d9bdba98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:00.701647 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f8f0a-b8e6-4edd-b21e-5af2d9bdba98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:00.703222 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f8f0a-b8e6-4edd-b21e-5af2d9bdba98 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:00.714085 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 819/1642] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:00.714611 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c939d7f-46dd-47e1-9991-8d2a6abf48e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12e547a50be8494083c2a3693813e47b, user_id=434c194ab7f64624acc657c2b595847a, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:00.714924 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f8f0a-b8e6-4edd-b21e-5af2d9bdba98 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:00.717563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c939d7f-46dd-47e1-9991-8d2a6abf48e5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:00.727943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f8f0a-b8e6-4edd-b21e-5af2d9bdba98 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:00.729878 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:00.738207 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 824/1643] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:00 2022] PUT /identity/v3/projects/12e547a50be8494083c2a3693813e47b/users/434c194ab7f64624acc657c2b595847a/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:00.738207 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c939d7f-46dd-47e1-9991-8d2a6abf48e5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:00.794118 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db5b57-663f-4de7-8c8c-56130d4c314d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:00.794803 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db5b57-663f-4de7-8c8c-56130d4c314d admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:00.795084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db5b57-663f-4de7-8c8c-56130d4c314d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:00.795355 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db5b57-663f-4de7-8c8c-56130d4c314d admin admin] PATH_INFO: `/v3/projects/ea1c703086924239a076021d1150ec28/users/09d07bcd49854335836e7329743890de/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:00.810737 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db5b57-663f-4de7-8c8c-56130d4c314d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea1c703086924239a076021d1150ec28, user_id=09d07bcd49854335836e7329743890de, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:00.811384 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c939d7f-46dd-47e1-9991-8d2a6abf48e5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:00.813425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db5b57-663f-4de7-8c8c-56130d4c314d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:00.816636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b0038-15b7-47d7-acf2-2236fcab391b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:00.817629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b0038-15b7-47d7-acf2-2236fcab391b admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:00.817941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b0038-15b7-47d7-acf2-2236fcab391b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:00.818241 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b0038-15b7-47d7-acf2-2236fcab391b admin admin] PATH_INFO: `/v3/projects/88b355d418ba425d84496d4ef1d5b328/users/fdf930a72819412a86da9fb0078dc343/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:00.828623 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 820/1644] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:00 2022] PUT /identity/v3/projects/ea1c703086924239a076021d1150ec28/users/09d07bcd49854335836e7329743890de/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:00.829907 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61117a-9471-4590-ba2f-caf5237ab899 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:00.830162 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61117a-9471-4590-ba2f-caf5237ab899 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:00.830433 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61117a-9471-4590-ba2f-caf5237ab899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:00.840601 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b0038-15b7-47d7-acf2-2236fcab391b admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b355d418ba425d84496d4ef1d5b328, user_id=fdf930a72819412a86da9fb0078dc343, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:00.844983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b0038-15b7-47d7-acf2-2236fcab391b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:00.859098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ab61117a-9471-4590-ba2f-caf5237ab899 None None] MFA Rules not processed for user `d5cad13455ee4c88bdc96260ed9c7a9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:00.859814 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 825/1645] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:00 2022] PUT /identity/v3/projects/88b355d418ba425d84496d4ef1d5b328/users/fdf930a72819412a86da9fb0078dc343/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:00.860747 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b0038-15b7-47d7-acf2-2236fcab391b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:00.862355 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ab61117a-9471-4590-ba2f-caf5237ab899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:00.863481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5f3b0038-15b7-47d7-acf2-2236fcab391b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:00.919150 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:00.933528 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b0038-15b7-47d7-acf2-2236fcab391b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:00.939397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65805d4d-a753-4ffa-85b5-0e05f98c242c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:00.940129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65805d4d-a753-4ffa-85b5-0e05f98c242c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:00.940482 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65805d4d-a753-4ffa-85b5-0e05f98c242c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:00.940834 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65805d4d-a753-4ffa-85b5-0e05f98c242c admin admin] PATH_INFO: `/v3/projects/51c30badc7dc4c31aaeb459d8174ae9f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:00.942076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65805d4d-a753-4ffa-85b5-0e05f98c242c admin admin] RBAC: Authorizing `identity:delete_project(project_id=51c30badc7dc4c31aaeb459d8174ae9f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:00.944690 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65805d4d-a753-4ffa-85b5-0e05f98c242c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:00.951042 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 821/1646] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:00.951700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61117a-9471-4590-ba2f-caf5237ab899 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:00.964871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61117a-9471-4590-ba2f-caf5237ab899 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:00.969565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d962026-3128-49b1-ba99-05b7823be1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:00.970256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d962026-3128-49b1-ba99-05b7823be1cd admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:00.970884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d962026-3128-49b1-ba99-05b7823be1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:00.971167 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d962026-3128-49b1-ba99-05b7823be1cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:00.972121 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d962026-3128-49b1-ba99-05b7823be1cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:00.975038 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d962026-3128-49b1-ba99-05b7823be1cd admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:00.994321 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 822/1647] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:00.995191 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d962026-3128-49b1-ba99-05b7823be1cd admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:01.005295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d962026-3128-49b1-ba99-05b7823be1cd admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:01.020165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-65805d4d-a753-4ffa-85b5-0e05f98c242c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51c30badc7dc4c31aaeb459d8174ae9f', 'request_id': 'req-65805d4d-a753-4ffa-85b5-0e05f98c242c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:01.028592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-65805d4d-a753-4ffa-85b5-0e05f98c242c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51c30badc7dc4c31aaeb459d8174ae9f', 'request_id': 'req-65805d4d-a753-4ffa-85b5-0e05f98c242c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:01.036528 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-65805d4d-a753-4ffa-85b5-0e05f98c242c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51c30badc7dc4c31aaeb459d8174ae9f', 'request_id': 'req-65805d4d-a753-4ffa-85b5-0e05f98c242c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:01.049621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-65805d4d-a753-4ffa-85b5-0e05f98c242c admin admin] The token cache is being invalidate because project 51c30badc7dc4c31aaeb459d8174ae9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:01.049918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-65805d4d-a753-4ffa-85b5-0e05f98c242c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:01.050601 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-65805d4d-a753-4ffa-85b5-0e05f98c242c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:01.057858 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 826/1648] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:00 2022] DELETE /identity/v3/projects/51c30badc7dc4c31aaeb459d8174ae9f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:01.058413 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65805d4d-a753-4ffa-85b5-0e05f98c242c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:01.060059 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-65805d4d-a753-4ffa-85b5-0e05f98c242c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:01.075604 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:01.080342 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b47f83-31e4-439d-b521-4418c9b9bc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:01.081250 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b47f83-31e4-439d-b521-4418c9b9bc0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:01.081571 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b47f83-31e4-439d-b521-4418c9b9bc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:01.081846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b47f83-31e4-439d-b521-4418c9b9bc0e admin admin] PATH_INFO: `/v3/projects/bd7bf004460f4852a3177fa9d6c4c7a7/users/7e84e2afdd1d4837b6f1ede8c90ef263/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:01.084041 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b47f83-31e4-439d-b521-4418c9b9bc0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd7bf004460f4852a3177fa9d6c4c7a7, user_id=7e84e2afdd1d4837b6f1ede8c90ef263, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:01.087692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b47f83-31e4-439d-b521-4418c9b9bc0e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:01.106270 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 823/1649] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:00 2022] PUT /identity/v3/projects/bd7bf004460f4852a3177fa9d6c4c7a7/users/7e84e2afdd1d4837b6f1ede8c90ef263/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:01.107259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b47f83-31e4-439d-b521-4418c9b9bc0e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:01.108970 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f7b47f83-31e4-439d-b521-4418c9b9bc0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:01.144660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65805d4d-a753-4ffa-85b5-0e05f98c242c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:01.182480 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b47f83-31e4-439d-b521-4418c9b9bc0e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:01.187453 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a4fd0-0b0c-4aea-aa15-a5bf1ca366a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:01.188063 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a4fd0-0b0c-4aea-aa15-a5bf1ca366a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:01.188345 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a4fd0-0b0c-4aea-aa15-a5bf1ca366a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:01.188618 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a4fd0-0b0c-4aea-aa15-a5bf1ca366a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:01.189265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a4fd0-0b0c-4aea-aa15-a5bf1ca366a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:01.191177 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a4fd0-0b0c-4aea-aa15-a5bf1ca366a5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:01.207492 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 824/1650] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:01.211456 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e8c8d-d786-4f9f-839d-0e9b1be649bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:01.211893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a4fd0-0b0c-4aea-aa15-a5bf1ca366a5 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:01.212139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e8c8d-d786-4f9f-839d-0e9b1be649bb admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:01.212426 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e8c8d-d786-4f9f-839d-0e9b1be649bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:01.212809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e8c8d-d786-4f9f-839d-0e9b1be649bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:01.213591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e8c8d-d786-4f9f-839d-0e9b1be649bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:01.213683 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a99a4fd0-0b0c-4aea-aa15-a5bf1ca366a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:01.215233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e8c8d-d786-4f9f-839d-0e9b1be649bb admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:01.226842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a4fd0-0b0c-4aea-aa15-a5bf1ca366a5 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:01.228266 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 827/1651] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:01.229666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2e60d-902d-4957-9ebb-eda2ffce357e None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:01.230035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2e60d-902d-4957-9ebb-eda2ffce357e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:01.230229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2e60d-902d-4957-9ebb-eda2ffce357e None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:01.231700 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 828/1652] 10.222.0.30 () {54 vars in 962 bytes} [Sun Sep 4 01:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:00:01.232251 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7e20b-4f6b-414e-af87-055918ad64f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:01.232251 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7e20b-4f6b-414e-af87-055918ad64f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:01.232431 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2e60d-902d-4957-9ebb-eda2ffce357e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:01.232518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7e20b-4f6b-414e-af87-055918ad64f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:01.232766 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7e20b-4f6b-414e-af87-055918ad64f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:01.233398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7e20b-4f6b-414e-af87-055918ad64f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:01.234059 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5bf2e60d-902d-4957-9ebb-eda2ffce357e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:01.235100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7e20b-4f6b-414e-af87-055918ad64f5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:01.245920 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 825/1653] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:01.247143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add516d0-7ee8-4e8e-aa77-5092b8b57ac4 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:01.247429 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add516d0-7ee8-4e8e-aa77-5092b8b57ac4 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:01.247707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add516d0-7ee8-4e8e-aa77-5092b8b57ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:01.252160 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2e60d-902d-4957-9ebb-eda2ffce357e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:01.256577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb6fde-8ce6-4b42-adb7-ae82748ddfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:01.257257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb6fde-8ce6-4b42-adb7-ae82748ddfc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:01.257565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb6fde-8ce6-4b42-adb7-ae82748ddfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:01.257838 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb6fde-8ce6-4b42-adb7-ae82748ddfc8 admin admin] PATH_INFO: `/v3/projects/7d8124f215d94e4f95b53ace98d5b234/users/a609137f14a6492dabd80d8aa93a875f/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:01.259779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb6fde-8ce6-4b42-adb7-ae82748ddfc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d8124f215d94e4f95b53ace98d5b234, user_id=a609137f14a6492dabd80d8aa93a875f, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:01.262456 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb6fde-8ce6-4b42-adb7-ae82748ddfc8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:01.266626 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-add516d0-7ee8-4e8e-aa77-5092b8b57ac4 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:01.268042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-add516d0-7ee8-4e8e-aa77-5092b8b57ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:01.273143 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 829/1654] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:01 2022] PUT /identity/v3/projects/7d8124f215d94e4f95b53ace98d5b234/users/a609137f14a6492dabd80d8aa93a875f/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:01.274401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d497217-f7e2-480a-8dc6-07f32afd795b None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:01.274666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d497217-f7e2-480a-8dc6-07f32afd795b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:01.274933 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d497217-f7e2-480a-8dc6-07f32afd795b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:01.302310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-7d497217-f7e2-480a-8dc6-07f32afd795b None None] MFA Rules not processed for user `7e84e2afdd1d4837b6f1ede8c90ef263`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:01.303531 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7d497217-f7e2-480a-8dc6-07f32afd795b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:01.318293 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:01.336832 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 826/1655] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:01.337588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add516d0-7ee8-4e8e-aa77-5092b8b57ac4 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:01.347511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add516d0-7ee8-4e8e-aa77-5092b8b57ac4 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:01.352635 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57e5aa-368a-482f-9f22-8d7fea58a1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:01.353273 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57e5aa-368a-482f-9f22-8d7fea58a1b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:01.353577 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57e5aa-368a-482f-9f22-8d7fea58a1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:01.353850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57e5aa-368a-482f-9f22-8d7fea58a1b4 admin admin] PATH_INFO: `/v3/projects/ea1c703086924239a076021d1150ec28/users/09d07bcd49854335836e7329743890de/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:01.355715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb57e5aa-368a-482f-9f22-8d7fea58a1b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea1c703086924239a076021d1150ec28, user_id=09d07bcd49854335836e7329743890de, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:01.358378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb57e5aa-368a-482f-9f22-8d7fea58a1b4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:01.368890 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 827/1656] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:01 2022] PUT /identity/v3/projects/ea1c703086924239a076021d1150ec28/users/09d07bcd49854335836e7329743890de/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:01.370017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d36ff-d26b-473d-a4a2-bf2d5d62d988 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:01.370344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d36ff-d26b-473d-a4a2-bf2d5d62d988 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:01.370618 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d36ff-d26b-473d-a4a2-bf2d5d62d988 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:01.372151 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 828/1657] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:00:01.372835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d36ff-d26b-473d-a4a2-bf2d5d62d988 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:01.373615 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 830/1658] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:01 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:01.374938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4db92-c06b-4ab1-a81a-f6f60e74b022 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:01.375225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4db92-c06b-4ab1-a81a-f6f60e74b022 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:01.375496 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4db92-c06b-4ab1-a81a-f6f60e74b022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:01.395896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-67c4db92-c06b-4ab1-a81a-f6f60e74b022 None None] MFA Rules not processed for user `13f0f341bf2c475d82b4e7b34d503dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:01.397611 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-67c4db92-c06b-4ab1-a81a-f6f60e74b022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:01.422066 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:01.446924 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d36ff-d26b-473d-a4a2-bf2d5d62d988 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:01.455815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72954132-ad40-46ed-a634-709b0c102149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:01.456475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72954132-ad40-46ed-a634-709b0c102149 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:01.456752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72954132-ad40-46ed-a634-709b0c102149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:01.457028 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72954132-ad40-46ed-a634-709b0c102149 admin admin] PATH_INFO: `/v3/projects/12e547a50be8494083c2a3693813e47b/users/434c194ab7f64624acc657c2b595847a/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:01.459066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72954132-ad40-46ed-a634-709b0c102149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12e547a50be8494083c2a3693813e47b, user_id=434c194ab7f64624acc657c2b595847a, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:01.462920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72954132-ad40-46ed-a634-709b0c102149 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:01.468540 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 831/1659] 10.222.0.30 () {58 vars in 1059 bytes} [Sun Sep 4 01:00:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:01.469348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4db92-c06b-4ab1-a81a-f6f60e74b022 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:01.473927 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 829/1660] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:01 2022] PUT /identity/v3/projects/12e547a50be8494083c2a3693813e47b/users/434c194ab7f64624acc657c2b595847a/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:01.483366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2c0b6-9cce-41f5-97c2-be19dee699f4 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:01.483366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2c0b6-9cce-41f5-97c2-be19dee699f4 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:01.483366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2c0b6-9cce-41f5-97c2-be19dee699f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:01.483605 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4db92-c06b-4ab1-a81a-f6f60e74b022 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:01.509190 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a6d2c0b6-9cce-41f5-97c2-be19dee699f4 None None] MFA Rules not processed for user `a609137f14a6492dabd80d8aa93a875f`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:01.511460 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a6d2c0b6-9cce-41f5-97c2-be19dee699f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:01.542940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23d98f-8068-48ad-abdb-d60be4ddf264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:01.543602 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23d98f-8068-48ad-abdb-d60be4ddf264 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:01.543899 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23d98f-8068-48ad-abdb-d60be4ddf264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:01.544156 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23d98f-8068-48ad-abdb-d60be4ddf264 admin admin] PATH_INFO: `/v3/projects/88b355d418ba425d84496d4ef1d5b328/users/fdf930a72819412a86da9fb0078dc343/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:01.546082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23d98f-8068-48ad-abdb-d60be4ddf264 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b355d418ba425d84496d4ef1d5b328, user_id=fdf930a72819412a86da9fb0078dc343, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:01.548739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23d98f-8068-48ad-abdb-d60be4ddf264 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:01.559022 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 832/1661] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:01 2022] PUT /identity/v3/projects/88b355d418ba425d84496d4ef1d5b328/users/fdf930a72819412a86da9fb0078dc343/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:01.560253 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64697882-a421-453f-8599-31172aaf0d34 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:01.560530 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64697882-a421-453f-8599-31172aaf0d34 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:01.560798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64697882-a421-453f-8599-31172aaf0d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:01.579823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-64697882-a421-453f-8599-31172aaf0d34 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:01.581001 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-64697882-a421-453f-8599-31172aaf0d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:01.586108 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 830/1662] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:01.590827 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651fe9e-c62a-4e77-b9da-a74535619cd7 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:01.591134 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651fe9e-c62a-4e77-b9da-a74535619cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:01.591416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651fe9e-c62a-4e77-b9da-a74535619cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:01.622377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-b651fe9e-c62a-4e77-b9da-a74535619cd7 None None] MFA Rules not processed for user `09d07bcd49854335836e7329743890de`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:01.623707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b651fe9e-c62a-4e77-b9da-a74535619cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:01.645370 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 833/1663] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:01.646697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bc3bd-ed7e-4213-943c-3cfd39830465 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:01.647500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bc3bd-ed7e-4213-943c-3cfd39830465 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:01.647773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bc3bd-ed7e-4213-943c-3cfd39830465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:01.666556 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-782bc3bd-ed7e-4213-943c-3cfd39830465 None None] MFA Rules not processed for user `f908fda75ef8440cb6a0ef9440127d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:01.667749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-782bc3bd-ed7e-4213-943c-3cfd39830465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:01.668082 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:01.696715 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 831/1664] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:01.697576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651fe9e-c62a-4e77-b9da-a74535619cd7 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:01.720288 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:01.735990 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 834/1665] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:00:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:01.738764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34fd8c-0d24-4e33-a258-60973f84ec27 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:01.739051 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34fd8c-0d24-4e33-a258-60973f84ec27 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:01.739326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34fd8c-0d24-4e33-a258-60973f84ec27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:01.768911 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-bc34fd8c-0d24-4e33-a258-60973f84ec27 None None] MFA Rules not processed for user `434c194ab7f64624acc657c2b595847a`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:01.770179 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bc34fd8c-0d24-4e33-a258-60973f84ec27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:01.771141 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651fe9e-c62a-4e77-b9da-a74535619cd7 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:01.777113 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e4c69b-86ac-467c-9b1f-199efc73db02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:01.777867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4c69b-86ac-467c-9b1f-199efc73db02 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:01.778144 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4c69b-86ac-467c-9b1f-199efc73db02 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:01.778409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4c69b-86ac-467c-9b1f-199efc73db02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:01.780118 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c0e4c69b-86ac-467c-9b1f-199efc73db02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:01.843300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e4c69b-86ac-467c-9b1f-199efc73db02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:01.844605 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 835/1666] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:01 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:01.844812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e4c69b-86ac-467c-9b1f-199efc73db02 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:01.845840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a7285-a7ce-4815-8295-a0abd7e7e4c7 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:01.846123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a7285-a7ce-4815-8295-a0abd7e7e4c7 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:01.846389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a7285-a7ce-4815-8295-a0abd7e7e4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:01.854870 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 832/1667] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:01 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:01.855569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e4c69b-86ac-467c-9b1f-199efc73db02 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:01.865218 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e4c69b-86ac-467c-9b1f-199efc73db02 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:01.870407 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce9e71-bf05-4d91-bdd3-3c2d4bbf1a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:01.870993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce9e71-bf05-4d91-bdd3-3c2d4bbf1a6d admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:01.871271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce9e71-bf05-4d91-bdd3-3c2d4bbf1a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:01.871545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce9e71-bf05-4d91-bdd3-3c2d4bbf1a6d admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:01.872174 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce9e71-bf05-4d91-bdd3-3c2d4bbf1a6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:00:01.872478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce9e71-bf05-4d91-bdd3-3c2d4bbf1a6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:01.874090 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce9e71-bf05-4d91-bdd3-3c2d4bbf1a6d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:01.875225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-108a7285-a7ce-4815-8295-a0abd7e7e4c7 None None] MFA Rules not processed for user `fdf930a72819412a86da9fb0078dc343`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:01.876415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-108a7285-a7ce-4815-8295-a0abd7e7e4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:01.886017 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 833/1668] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:00:01.886966 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce9e71-bf05-4d91-bdd3-3c2d4bbf1a6d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:01.890920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2cce9e71-bf05-4d91-bdd3-3c2d4bbf1a6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:01.905659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce9e71-bf05-4d91-bdd3-3c2d4bbf1a6d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:01.910575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c32929-96d7-4a22-9dba-835bbe86fb33 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:01.911223 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c32929-96d7-4a22-9dba-835bbe86fb33 service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:01.911436 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c32929-96d7-4a22-9dba-835bbe86fb33 service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:01.911707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c32929-96d7-4a22-9dba-835bbe86fb33 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:01.920165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c32929-96d7-4a22-9dba-835bbe86fb33 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:01.921816 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c32929-96d7-4a22-9dba-835bbe86fb33 service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:01.932294 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 834/1669] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:01.932863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c32929-96d7-4a22-9dba-835bbe86fb33 service placement] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:01.942878 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c32929-96d7-4a22-9dba-835bbe86fb33 service placement] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:01.948525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b08df-3ff3-47cd-a647-b5cac2ae47f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:01.949223 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b08df-3ff3-47cd-a647-b5cac2ae47f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:01.949532 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b08df-3ff3-47cd-a647-b5cac2ae47f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:01.957515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b08df-3ff3-47cd-a647-b5cac2ae47f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:01.957675 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 836/1670] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:01 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:01.957765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b08df-3ff3-47cd-a647-b5cac2ae47f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:01.957765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b08df-3ff3-47cd-a647-b5cac2ae47f1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:01.962724 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5938f5-2139-482d-8640-fa9969e9585a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:01.963080 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5938f5-2139-482d-8640-fa9969e9585a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:01.963418 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5938f5-2139-482d-8640-fa9969e9585a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:01.987317 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-3a5938f5-2139-482d-8640-fa9969e9585a None None] MFA Rules not processed for user `05f54677df04452fb4d1c76cdf9febaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:01.988908 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3a5938f5-2139-482d-8640-fa9969e9585a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:01.996549 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 835/1671] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:00:01 2022] POST /identity/v3/projects => generated 391 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:02.001866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b08df-3ff3-47cd-a647-b5cac2ae47f1 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:02.031498 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:02.064721 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 837/1672] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:00:02.076852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b08df-3ff3-47cd-a647-b5cac2ae47f1 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:02.082040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ff9fe-78ba-443c-95de-925abcc95a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:02.082703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ff9fe-78ba-443c-95de-925abcc95a5e admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:02.082984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ff9fe-78ba-443c-95de-925abcc95a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:02.083257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ff9fe-78ba-443c-95de-925abcc95a5e admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:02.083888 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ff9fe-78ba-443c-95de-925abcc95a5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:02.085889 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ff9fe-78ba-443c-95de-925abcc95a5e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:02.090613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5938f5-2139-482d-8640-fa9969e9585a None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:02.092876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3a5938f5-2139-482d-8640-fa9969e9585a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:02.110772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5938f5-2139-482d-8640-fa9969e9585a None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:02.111733 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 836/1673] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:02 2022] POST /identity/v3/users => generated 296 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:02.112981 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94534375-2a9f-4b0f-a321-0e4e15e99010 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:02.113263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94534375-2a9f-4b0f-a321-0e4e15e99010 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:02.113569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94534375-2a9f-4b0f-a321-0e4e15e99010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:02.118683 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:02.145795 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-94534375-2a9f-4b0f-a321-0e4e15e99010 None None] MFA Rules not processed for user `5705a5c5ea2b46e0a98841ea0d82dc2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:02.147352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-94534375-2a9f-4b0f-a321-0e4e15e99010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:02.188164 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e175b-7122-4a45-95e9-5e6d3c799129 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:02.188807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e175b-7122-4a45-95e9-5e6d3c799129 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:02.189089 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e175b-7122-4a45-95e9-5e6d3c799129 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:02.189360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e175b-7122-4a45-95e9-5e6d3c799129 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:02.191282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-149e175b-7122-4a45-95e9-5e6d3c799129 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:02.205681 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 837/1674] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:02.205681 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94534375-2a9f-4b0f-a321-0e4e15e99010 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:02.212324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94534375-2a9f-4b0f-a321-0e4e15e99010 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:02.216763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d70b3e-d2eb-48f8-9aa2-5e3a3d2e54f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:02.217348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d70b3e-d2eb-48f8-9aa2-5e3a3d2e54f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:02.217687 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d70b3e-d2eb-48f8-9aa2-5e3a3d2e54f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:02.217963 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d70b3e-d2eb-48f8-9aa2-5e3a3d2e54f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:02.218598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d70b3e-d2eb-48f8-9aa2-5e3a3d2e54f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:02.220192 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d70b3e-d2eb-48f8-9aa2-5e3a3d2e54f2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:02.230278 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 838/1675] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:02.231107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d70b3e-d2eb-48f8-9aa2-5e3a3d2e54f2 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:02.243735 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d70b3e-d2eb-48f8-9aa2-5e3a3d2e54f2 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:02.249084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e5094-28a0-4154-b83a-70a9a3c206d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:02.249693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e5094-28a0-4154-b83a-70a9a3c206d7 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:02.249974 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e5094-28a0-4154-b83a-70a9a3c206d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:02.250248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e5094-28a0-4154-b83a-70a9a3c206d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:02.258823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e175b-7122-4a45-95e9-5e6d3c799129 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:02.260570 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e175b-7122-4a45-95e9-5e6d3c799129 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:02.269721 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 838/1676] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:02 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:02.270506 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e175b-7122-4a45-95e9-5e6d3c799129 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:02.280111 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e175b-7122-4a45-95e9-5e6d3c799129 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:02.288975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7899d8-9e0e-4736-9939-e61ba0b1bd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:02.289664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7899d8-9e0e-4736-9939-e61ba0b1bd42 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:02.289942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7899d8-9e0e-4736-9939-e61ba0b1bd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:02.290218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7899d8-9e0e-4736-9939-e61ba0b1bd42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:02.290860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7899d8-9e0e-4736-9939-e61ba0b1bd42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:02.292483 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7899d8-9e0e-4736-9939-e61ba0b1bd42 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:02.303617 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 839/1677] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:02.304412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7899d8-9e0e-4736-9939-e61ba0b1bd42 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:02.306194 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9a7899d8-9e0e-4736-9939-e61ba0b1bd42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:02.318421 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7899d8-9e0e-4736-9939-e61ba0b1bd42 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:02.319025 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e5094-28a0-4154-b83a-70a9a3c206d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:02.320726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e5094-28a0-4154-b83a-70a9a3c206d7 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:02.324180 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613aaccf-2063-4845-94cb-ae9db75e5806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:02.324793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613aaccf-2063-4845-94cb-ae9db75e5806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:02.325071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613aaccf-2063-4845-94cb-ae9db75e5806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:02.325344 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613aaccf-2063-4845-94cb-ae9db75e5806 admin admin] PATH_INFO: `/v3/users/51557c0b966a49e4816c534ceda6b8a9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:02.326495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613aaccf-2063-4845-94cb-ae9db75e5806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51557c0b966a49e4816c534ceda6b8a9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:02.327489 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-613aaccf-2063-4845-94cb-ae9db75e5806 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:00:02.327489 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:00:02.327489 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:00:02.328684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613aaccf-2063-4845-94cb-ae9db75e5806 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:02.331209 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 839/1678] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:02.332311 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e5094-28a0-4154-b83a-70a9a3c206d7 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:02.344207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e5094-28a0-4154-b83a-70a9a3c206d7 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:02.350957 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7d609-569e-4556-be4e-f82626de3ed0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:02.351551 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7d609-569e-4556-be4e-f82626de3ed0 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:02.351840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7d609-569e-4556-be4e-f82626de3ed0 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:02.352114 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7d609-569e-4556-be4e-f82626de3ed0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:02.399417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-613aaccf-2063-4845-94cb-ae9db75e5806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51557c0b966a49e4816c534ceda6b8a9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:02.400085 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-613aaccf-2063-4845-94cb-ae9db75e5806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51557c0b966a49e4816c534ceda6b8a9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:02.401482 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:02.410657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-613aaccf-2063-4845-94cb-ae9db75e5806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51557c0b966a49e4816c534ceda6b8a9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:02.419221 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-613aaccf-2063-4845-94cb-ae9db75e5806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51557c0b966a49e4816c534ceda6b8a9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:02.419855 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-613aaccf-2063-4845-94cb-ae9db75e5806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51557c0b966a49e4816c534ceda6b8a9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:02.425413 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad7d609-569e-4556-be4e-f82626de3ed0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:02.427095 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad7d609-569e-4556-be4e-f82626de3ed0 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:02.437129 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 840/1679] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:02.438691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7d609-569e-4556-be4e-f82626de3ed0 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:02.448034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7d609-569e-4556-be4e-f82626de3ed0 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:02.452769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803258a-6f4d-49c1-8330-645af379eae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:02.453743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803258a-6f4d-49c1-8330-645af379eae0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:02.453743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803258a-6f4d-49c1-8330-645af379eae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:02.453990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803258a-6f4d-49c1-8330-645af379eae0 admin admin] PATH_INFO: `/v3/projects/4667a4ef6459477eb33bd39178aa9b35/users/96bee00bced644e595806e03fb6e83b2/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:02.455321 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 840/1680] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:00:02 2022] DELETE /identity/v3/users/51557c0b966a49e4816c534ceda6b8a9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:02.455991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613aaccf-2063-4845-94cb-ae9db75e5806 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:02.458655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-613aaccf-2063-4845-94cb-ae9db75e5806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:02.465839 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:02.475985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7803258a-6f4d-49c1-8330-645af379eae0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4667a4ef6459477eb33bd39178aa9b35, user_id=96bee00bced644e595806e03fb6e83b2, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:02.479306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7803258a-6f4d-49c1-8330-645af379eae0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:02.503529 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 841/1681] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:02 2022] PUT /identity/v3/projects/4667a4ef6459477eb33bd39178aa9b35/users/96bee00bced644e595806e03fb6e83b2/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:02.504876 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee6b16-bfef-47bb-9a58-e50a82557e21 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:02.505161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee6b16-bfef-47bb-9a58-e50a82557e21 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:02.505465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee6b16-bfef-47bb-9a58-e50a82557e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:02.533659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-64ee6b16-bfef-47bb-9a58-e50a82557e21 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:02.534977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-64ee6b16-bfef-47bb-9a58-e50a82557e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:02.540375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613aaccf-2063-4845-94cb-ae9db75e5806 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:02.599389 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 842/1682] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:02.600784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee6b16-bfef-47bb-9a58-e50a82557e21 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:02.602169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-64ee6b16-bfef-47bb-9a58-e50a82557e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:02.609480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66b1ee-091d-4942-9025-f1ba9c247834 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:02.610112 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66b1ee-091d-4942-9025-f1ba9c247834 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:02.610648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66b1ee-091d-4942-9025-f1ba9c247834 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:02.610922 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66b1ee-091d-4942-9025-f1ba9c247834 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:02.612835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4c66b1ee-091d-4942-9025-f1ba9c247834 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:02.675327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c66b1ee-091d-4942-9025-f1ba9c247834 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:02.675988 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee6b16-bfef-47bb-9a58-e50a82557e21 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:02.676938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c66b1ee-091d-4942-9025-f1ba9c247834 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:02.681609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959dd44-b02a-49e0-8e04-787995b38c21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:02.682317 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959dd44-b02a-49e0-8e04-787995b38c21 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:02.682623 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959dd44-b02a-49e0-8e04-787995b38c21 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:02.682898 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959dd44-b02a-49e0-8e04-787995b38c21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:02.684656 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1959dd44-b02a-49e0-8e04-787995b38c21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:02.687071 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 841/1683] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:02 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:02.688429 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf4239-bba4-4bbc-a97d-2a63632cb798 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:02.688769 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf4239-bba4-4bbc-a97d-2a63632cb798 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:02.688977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf4239-bba4-4bbc-a97d-2a63632cb798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:02.717691 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-72bf4239-bba4-4bbc-a97d-2a63632cb798 None None] MFA Rules not processed for user `96bee00bced644e595806e03fb6e83b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:02.718918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-72bf4239-bba4-4bbc-a97d-2a63632cb798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:02.734226 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:02.748752 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:02.749851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959dd44-b02a-49e0-8e04-787995b38c21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:02.751714 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959dd44-b02a-49e0-8e04-787995b38c21 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:02.769228 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 843/1684] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:02 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:02.769228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959dd44-b02a-49e0-8e04-787995b38c21 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:02.769228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1959dd44-b02a-49e0-8e04-787995b38c21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:02.824875 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 842/1685] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:02.824875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf4239-bba4-4bbc-a97d-2a63632cb798 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:02.834028 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959dd44-b02a-49e0-8e04-787995b38c21 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:02.838167 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6aa68-d5b3-4134-94cd-1330b2576bf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:02.838640 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf4239-bba4-4bbc-a97d-2a63632cb798 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:02.838773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6aa68-d5b3-4134-94cd-1330b2576bf8 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:02.839052 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6aa68-d5b3-4134-94cd-1330b2576bf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:02.839324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6aa68-d5b3-4134-94cd-1330b2576bf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:02.844045 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5ce10-f22b-4764-87cb-8e12937de984 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:02.844644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5ce10-f22b-4764-87cb-8e12937de984 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:02.844985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5ce10-f22b-4764-87cb-8e12937de984 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:02.845423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5ce10-f22b-4764-87cb-8e12937de984 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:02.847804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-35e5ce10-f22b-4764-87cb-8e12937de984 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:02.848587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6aa68-d5b3-4134-94cd-1330b2576bf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:02.850713 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6aa68-d5b3-4134-94cd-1330b2576bf8 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:02.860772 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 844/1686] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:02.861730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6aa68-d5b3-4134-94cd-1330b2576bf8 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:02.863098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a5e6aa68-d5b3-4134-94cd-1330b2576bf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:02.875722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6aa68-d5b3-4134-94cd-1330b2576bf8 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:02.880540 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3950ff5-a85f-48b3-bc4d-f1490726be88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:02.881227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3950ff5-a85f-48b3-bc4d-f1490726be88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:02.881545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3950ff5-a85f-48b3-bc4d-f1490726be88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:02.881818 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3950ff5-a85f-48b3-bc4d-f1490726be88 admin admin] PATH_INFO: `/v3/users/caae49db19114c20b3bb86c81cda1ff9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:02.883043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3950ff5-a85f-48b3-bc4d-f1490726be88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caae49db19114c20b3bb86c81cda1ff9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:02.885117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3950ff5-a85f-48b3-bc4d-f1490726be88 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:02.914202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5ce10-f22b-4764-87cb-8e12937de984 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:02.916198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5ce10-f22b-4764-87cb-8e12937de984 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:02.928350 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 843/1687] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:02.929303 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5ce10-f22b-4764-87cb-8e12937de984 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:02.931236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-35e5ce10-f22b-4764-87cb-8e12937de984 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:02.940865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d3950ff5-a85f-48b3-bc4d-f1490726be88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caae49db19114c20b3bb86c81cda1ff9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:02.941680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d3950ff5-a85f-48b3-bc4d-f1490726be88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caae49db19114c20b3bb86c81cda1ff9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:02.945647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5ce10-f22b-4764-87cb-8e12937de984 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:02.949569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d3950ff5-a85f-48b3-bc4d-f1490726be88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caae49db19114c20b3bb86c81cda1ff9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:02.950922 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7f255-c3f0-41d8-994e-3dfeb0d39046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:02.951947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7f255-c3f0-41d8-994e-3dfeb0d39046 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:02.952475 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7f255-c3f0-41d8-994e-3dfeb0d39046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:02.953027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7f255-c3f0-41d8-994e-3dfeb0d39046 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:02.954060 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7f255-c3f0-41d8-994e-3dfeb0d39046 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:02.956492 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7f255-c3f0-41d8-994e-3dfeb0d39046 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:02.960312 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d3950ff5-a85f-48b3-bc4d-f1490726be88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caae49db19114c20b3bb86c81cda1ff9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:02.961342 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d3950ff5-a85f-48b3-bc4d-f1490726be88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caae49db19114c20b3bb86c81cda1ff9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:02.989803 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 845/1688] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:00:02 2022] DELETE /identity/v3/users/caae49db19114c20b3bb86c81cda1ff9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:02.991729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940e0a5-a123-49ea-97b3-6a8eff027fd0 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:02.992195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940e0a5-a123-49ea-97b3-6a8eff027fd0 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:02.992786 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940e0a5-a123-49ea-97b3-6a8eff027fd0 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:02.993353 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 844/1689] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:00:02 2022] POST /identity/v3/projects => generated 389 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:02.994854 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db8d3b-6586-4fe2-a994-e271e0eaf855 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:02.995144 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db8d3b-6586-4fe2-a994-e271e0eaf855 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:02.995422 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db8d3b-6586-4fe2-a994-e271e0eaf855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:02.999660 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 846/1690] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:00:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:00:03.000972 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940e0a5-a123-49ea-97b3-6a8eff027fd0 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:03.002798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0940e0a5-a123-49ea-97b3-6a8eff027fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:03.023926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b1db8d3b-6586-4fe2-a994-e271e0eaf855 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:03.025380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b1db8d3b-6586-4fe2-a994-e271e0eaf855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:03.087874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940e0a5-a123-49ea-97b3-6a8eff027fd0 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:03.093398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16e078-25db-4a6a-964c-355acaf7f0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:03.094221 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16e078-25db-4a6a-964c-355acaf7f0c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:03.094552 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16e078-25db-4a6a-964c-355acaf7f0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:03.094910 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16e078-25db-4a6a-964c-355acaf7f0c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:03.095616 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16e078-25db-4a6a-964c-355acaf7f0c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:03.097954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16e078-25db-4a6a-964c-355acaf7f0c1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:03.105576 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 845/1691] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:03.107119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db694a7-9df7-4584-bd6d-acc8fc4c2d4c None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:03.107475 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db694a7-9df7-4584-bd6d-acc8fc4c2d4c None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:03.107821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db694a7-9df7-4584-bd6d-acc8fc4c2d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:03.111379 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:03.128140 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 847/1692] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:02 2022] POST /identity/v3/users => generated 301 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:03.129579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652aa221-ed5d-43d2-a116-cc9e4f64381d None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:03.132108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652aa221-ed5d-43d2-a116-cc9e4f64381d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:03.132108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652aa221-ed5d-43d2-a116-cc9e4f64381d None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:03.136413 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-9db694a7-9df7-4584-bd6d-acc8fc4c2d4c None None] MFA Rules not processed for user `13f0f341bf2c475d82b4e7b34d503dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:03.136847 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 848/1693] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:00:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:00:03.138052 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9db694a7-9df7-4584-bd6d-acc8fc4c2d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:03.138783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652aa221-ed5d-43d2-a116-cc9e4f64381d None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:03.140687 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-652aa221-ed5d-43d2-a116-cc9e4f64381d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:03.183911 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:03.216896 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652aa221-ed5d-43d2-a116-cc9e4f64381d None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:03.220548 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84052d4-b74c-4bc5-b96a-266a8906516e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:03.221159 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84052d4-b74c-4bc5-b96a-266a8906516e service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:03.221464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84052d4-b74c-4bc5-b96a-266a8906516e service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:03.221799 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84052d4-b74c-4bc5-b96a-266a8906516e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:03.224028 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 846/1694] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:00:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:03.224931 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db694a7-9df7-4584-bd6d-acc8fc4c2d4c None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:03.233177 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84052d4-b74c-4bc5-b96a-266a8906516e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:03.235118 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84052d4-b74c-4bc5-b96a-266a8906516e service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:03.236726 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db694a7-9df7-4584-bd6d-acc8fc4c2d4c None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:03.241595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0cba88-7251-4462-afc0-d757362fe27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:03.242208 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cba88-7251-4462-afc0-d757362fe27c admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:03.242489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cba88-7251-4462-afc0-d757362fe27c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:03.242761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cba88-7251-4462-afc0-d757362fe27c admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:03.243414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0cba88-7251-4462-afc0-d757362fe27c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:03.245070 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0cba88-7251-4462-afc0-d757362fe27c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:03.245583 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 849/1695] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:03.246792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfec5d0-3bfe-4aa2-a365-71d162fc50b4 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:03.247082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfec5d0-3bfe-4aa2-a365-71d162fc50b4 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:03.247356 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfec5d0-3bfe-4aa2-a365-71d162fc50b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:03.257253 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 847/1696] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:03.258339 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0cba88-7251-4462-afc0-d757362fe27c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:03.260398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0d0cba88-7251-4462-afc0-d757362fe27c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:03.270231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-8cfec5d0-3bfe-4aa2-a365-71d162fc50b4 None None] MFA Rules not processed for user `13f0f341bf2c475d82b4e7b34d503dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:03.271448 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8cfec5d0-3bfe-4aa2-a365-71d162fc50b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:03.274529 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0cba88-7251-4462-afc0-d757362fe27c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:03.279764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c21e7-726a-4eb0-8f20-01fa5d1f05f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:03.280416 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c21e7-726a-4eb0-8f20-01fa5d1f05f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:03.280698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c21e7-726a-4eb0-8f20-01fa5d1f05f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:03.280968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c21e7-726a-4eb0-8f20-01fa5d1f05f8 admin admin] PATH_INFO: `/v3/projects/aecb01baaaad48708791439cea5d8a3f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:03.282087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c21e7-726a-4eb0-8f20-01fa5d1f05f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aecb01baaaad48708791439cea5d8a3f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:03.282822 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 850/1697] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:00:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:03.283565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfec5d0-3bfe-4aa2-a365-71d162fc50b4 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:03.285078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8cfec5d0-3bfe-4aa2-a365-71d162fc50b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:03.288324 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c21e7-726a-4eb0-8f20-01fa5d1f05f8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:03.347321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-df9c21e7-726a-4eb0-8f20-01fa5d1f05f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aecb01baaaad48708791439cea5d8a3f', 'request_id': 'req-df9c21e7-726a-4eb0-8f20-01fa5d1f05f8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:03.357198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-df9c21e7-726a-4eb0-8f20-01fa5d1f05f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aecb01baaaad48708791439cea5d8a3f', 'request_id': 'req-df9c21e7-726a-4eb0-8f20-01fa5d1f05f8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:03.364684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-df9c21e7-726a-4eb0-8f20-01fa5d1f05f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aecb01baaaad48708791439cea5d8a3f', 'request_id': 'req-df9c21e7-726a-4eb0-8f20-01fa5d1f05f8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:03.378254 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-df9c21e7-726a-4eb0-8f20-01fa5d1f05f8 admin admin] The token cache is being invalidate because project aecb01baaaad48708791439cea5d8a3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:03.378460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-df9c21e7-726a-4eb0-8f20-01fa5d1f05f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:03.379116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-df9c21e7-726a-4eb0-8f20-01fa5d1f05f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:03.381050 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 848/1698] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:03 2022] DELETE /identity/v3/projects/aecb01baaaad48708791439cea5d8a3f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:03.382082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfec5d0-3bfe-4aa2-a365-71d162fc50b4 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:03.384949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c21e7-726a-4eb0-8f20-01fa5d1f05f8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:03.386331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-df9c21e7-726a-4eb0-8f20-01fa5d1f05f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:03.441506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d988a-620c-4ef7-804b-24033cff54fb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efcee9b21ea94b1b8e5c9c5acb35839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:03.442511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d988a-620c-4ef7-804b-24033cff54fb service glance] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:03.444148 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d988a-620c-4ef7-804b-24033cff54fb service glance] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:03.445447 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d988a-620c-4ef7-804b-24033cff54fb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:03.448129 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-825d988a-620c-4ef7-804b-24033cff54fb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:03.477179 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c21e7-726a-4eb0-8f20-01fa5d1f05f8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:03.482039 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3289728-fdd8-4af2-b522-98af7c5434c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:03.482784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3289728-fdd8-4af2-b522-98af7c5434c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:03.483134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3289728-fdd8-4af2-b522-98af7c5434c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:03.483912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3289728-fdd8-4af2-b522-98af7c5434c4 admin admin] PATH_INFO: `/v3/projects/4d6367d70746477095ba0a873b9dee0a/users/00622a08fde64c64950e7a458d01acb1/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:03.494492 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:03.502005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3289728-fdd8-4af2-b522-98af7c5434c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d6367d70746477095ba0a873b9dee0a, user_id=00622a08fde64c64950e7a458d01acb1, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:03.505108 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3289728-fdd8-4af2-b522-98af7c5434c4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:03.523592 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 849/1699] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:03 2022] PUT /identity/v3/projects/4d6367d70746477095ba0a873b9dee0a/users/00622a08fde64c64950e7a458d01acb1/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:03.524785 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3289728-fdd8-4af2-b522-98af7c5434c4 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:03.529768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f3289728-fdd8-4af2-b522-98af7c5434c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:03.537605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d988a-620c-4ef7-804b-24033cff54fb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:03.538012 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d988a-620c-4ef7-804b-24033cff54fb service glance] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:03.549503 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 851/1700] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:03.550346 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d988a-620c-4ef7-804b-24033cff54fb service glance] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:03.551704 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-825d988a-620c-4ef7-804b-24033cff54fb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:03.569854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d988a-620c-4ef7-804b-24033cff54fb service glance] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:03.573618 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:03.606212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3289728-fdd8-4af2-b522-98af7c5434c4 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:03.611245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2bf60-7f56-4337-bff3-9f48f70ca3a3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efcee9b21ea94b1b8e5c9c5acb35839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:03.611974 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2bf60-7f56-4337-bff3-9f48f70ca3a3 service glance] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:03.612255 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2bf60-7f56-4337-bff3-9f48f70ca3a3 service glance] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:03.612521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2bf60-7f56-4337-bff3-9f48f70ca3a3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:03.614478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a5d2bf60-7f56-4337-bff3-9f48f70ca3a3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:03.642187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80948ff-5c16-4a09-8e11-5196998c030e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:03.643042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80948ff-5c16-4a09-8e11-5196998c030e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:03.643463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80948ff-5c16-4a09-8e11-5196998c030e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:03.643939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80948ff-5c16-4a09-8e11-5196998c030e admin admin] PATH_INFO: `/v3/users/7e84e2afdd1d4837b6f1ede8c90ef263` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:03.645540 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80948ff-5c16-4a09-8e11-5196998c030e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e84e2afdd1d4837b6f1ede8c90ef263)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:03.647722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80948ff-5c16-4a09-8e11-5196998c030e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:03.698809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2bf60-7f56-4337-bff3-9f48f70ca3a3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:03.700936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2bf60-7f56-4337-bff3-9f48f70ca3a3 service glance] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:03.708381 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f80948ff-5c16-4a09-8e11-5196998c030e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e84e2afdd1d4837b6f1ede8c90ef263'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:03.709207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f80948ff-5c16-4a09-8e11-5196998c030e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e84e2afdd1d4837b6f1ede8c90ef263'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:03.711942 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 850/1701] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:03.713385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2bf60-7f56-4337-bff3-9f48f70ca3a3 service glance] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:03.719483 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f80948ff-5c16-4a09-8e11-5196998c030e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e84e2afdd1d4837b6f1ede8c90ef263'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:03.726281 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2bf60-7f56-4337-bff3-9f48f70ca3a3 service glance] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:03.731127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f80948ff-5c16-4a09-8e11-5196998c030e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e84e2afdd1d4837b6f1ede8c90ef263'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:03.731305 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be081c-eb74-4f36-be0f-8c3b13481804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:03.731909 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be081c-eb74-4f36-be0f-8c3b13481804 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:03.732203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be081c-eb74-4f36-be0f-8c3b13481804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:03.732461 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be081c-eb74-4f36-be0f-8c3b13481804 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:03.732849 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f80948ff-5c16-4a09-8e11-5196998c030e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e84e2afdd1d4837b6f1ede8c90ef263'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:03.733153 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be081c-eb74-4f36-be0f-8c3b13481804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:03.735042 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be081c-eb74-4f36-be0f-8c3b13481804 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:03.751864 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 851/1702] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:03.751864 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be081c-eb74-4f36-be0f-8c3b13481804 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:03.753382 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-72be081c-eb74-4f36-be0f-8c3b13481804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:03.768159 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be081c-eb74-4f36-be0f-8c3b13481804 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:03.768527 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 852/1703] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:00:03 2022] DELETE /identity/v3/users/7e84e2afdd1d4837b6f1ede8c90ef263 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:03.772665 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80948ff-5c16-4a09-8e11-5196998c030e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:03.774899 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f80948ff-5c16-4a09-8e11-5196998c030e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:03.824603 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:03.847385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80948ff-5c16-4a09-8e11-5196998c030e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:03.853877 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d779b-ae11-4e8f-a749-22b2beeb8c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:03.854771 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d779b-ae11-4e8f-a749-22b2beeb8c2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:03.855113 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d779b-ae11-4e8f-a749-22b2beeb8c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:03.855390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d779b-ae11-4e8f-a749-22b2beeb8c2d admin admin] PATH_INFO: `/v3/projects/4d6367d70746477095ba0a873b9dee0a/users/00622a08fde64c64950e7a458d01acb1/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:03.856926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8f1cf-5a4c-4aaa-99a8-421cdb5384dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:03.857307 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d779b-ae11-4e8f-a749-22b2beeb8c2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d6367d70746477095ba0a873b9dee0a, user_id=00622a08fde64c64950e7a458d01acb1, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:03.857803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8f1cf-5a4c-4aaa-99a8-421cdb5384dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:03.858140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8f1cf-5a4c-4aaa-99a8-421cdb5384dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:03.858480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8f1cf-5a4c-4aaa-99a8-421cdb5384dc admin admin] PATH_INFO: `/v3/projects/023bb579cb164bcf99e11ad4e0d9178f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:03.859703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8f1cf-5a4c-4aaa-99a8-421cdb5384dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=023bb579cb164bcf99e11ad4e0d9178f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:03.860012 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d779b-ae11-4e8f-a749-22b2beeb8c2d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:03.862843 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8f1cf-5a4c-4aaa-99a8-421cdb5384dc admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:03.881104 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 853/1704] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:03 2022] PUT /identity/v3/projects/4d6367d70746477095ba0a873b9dee0a/users/00622a08fde64c64950e7a458d01acb1/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:03.882838 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f657d-7be2-498f-88a5-30aeb4047a9d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:03.883128 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f657d-7be2-498f-88a5-30aeb4047a9d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:03.884179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f657d-7be2-498f-88a5-30aeb4047a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:03.917776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-480f657d-7be2-498f-88a5-30aeb4047a9d None None] MFA Rules not processed for user `00622a08fde64c64950e7a458d01acb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:03.918934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-480f657d-7be2-498f-88a5-30aeb4047a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:03.938701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3dd8f1cf-5a4c-4aaa-99a8-421cdb5384dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '023bb579cb164bcf99e11ad4e0d9178f', 'request_id': 'req-3dd8f1cf-5a4c-4aaa-99a8-421cdb5384dc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:03.949763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3dd8f1cf-5a4c-4aaa-99a8-421cdb5384dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '023bb579cb164bcf99e11ad4e0d9178f', 'request_id': 'req-3dd8f1cf-5a4c-4aaa-99a8-421cdb5384dc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:03.956136 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:03.958707 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3dd8f1cf-5a4c-4aaa-99a8-421cdb5384dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '023bb579cb164bcf99e11ad4e0d9178f', 'request_id': 'req-3dd8f1cf-5a4c-4aaa-99a8-421cdb5384dc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:03.977895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3dd8f1cf-5a4c-4aaa-99a8-421cdb5384dc admin admin] The token cache is being invalidate because project 023bb579cb164bcf99e11ad4e0d9178f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:03.978848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3dd8f1cf-5a4c-4aaa-99a8-421cdb5384dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:03.979642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3dd8f1cf-5a4c-4aaa-99a8-421cdb5384dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:03.986075 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 852/1705] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:03 2022] DELETE /identity/v3/projects/023bb579cb164bcf99e11ad4e0d9178f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:03.987266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8f1cf-5a4c-4aaa-99a8-421cdb5384dc admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:03.989159 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3dd8f1cf-5a4c-4aaa-99a8-421cdb5384dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:04.027771 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 854/1706] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:03 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:00:04.077764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8f1cf-5a4c-4aaa-99a8-421cdb5384dc admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:04.084593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b99557-e079-4eb0-9764-483f9f2ec8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:04.085593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b99557-e079-4eb0-9764-483f9f2ec8a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:04.085974 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b99557-e079-4eb0-9764-483f9f2ec8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:04.086424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b99557-e079-4eb0-9764-483f9f2ec8a2 admin admin] PATH_INFO: `/v3/users/d5cad13455ee4c88bdc96260ed9c7a9c` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:04.088090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b99557-e079-4eb0-9764-483f9f2ec8a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5cad13455ee4c88bdc96260ed9c7a9c)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:04.090543 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b99557-e079-4eb0-9764-483f9f2ec8a2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:04.173936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d7b99557-e079-4eb0-9764-483f9f2ec8a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5cad13455ee4c88bdc96260ed9c7a9c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:04.175209 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d7b99557-e079-4eb0-9764-483f9f2ec8a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5cad13455ee4c88bdc96260ed9c7a9c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:04.183688 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d7b99557-e079-4eb0-9764-483f9f2ec8a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5cad13455ee4c88bdc96260ed9c7a9c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:04.194124 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d7b99557-e079-4eb0-9764-483f9f2ec8a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5cad13455ee4c88bdc96260ed9c7a9c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:04.194917 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d7b99557-e079-4eb0-9764-483f9f2ec8a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5cad13455ee4c88bdc96260ed9c7a9c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:04.217470 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 853/1707] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:00:03 2022] DELETE /identity/v3/users/d5cad13455ee4c88bdc96260ed9c7a9c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:04.257483 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12360489-232d-4807-a676-666098b621a5 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:04.257973 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12360489-232d-4807-a676-666098b621a5 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:04.258464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12360489-232d-4807-a676-666098b621a5 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:04.259737 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 855/1708] 10.222.0.30 () {54 vars in 961 bytes} [Sun Sep 4 01:00:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:00:04.267190 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dae708-6f4e-465f-8cf3-0e23c8440c53 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:04.267714 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dae708-6f4e-465f-8cf3-0e23c8440c53 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:04.267804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dae708-6f4e-465f-8cf3-0e23c8440c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:04.283732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12360489-232d-4807-a676-666098b621a5 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:04.286751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-12360489-232d-4807-a676-666098b621a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:04.323629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-f9dae708-6f4e-465f-8cf3-0e23c8440c53 None None] MFA Rules not processed for user `f908fda75ef8440cb6a0ef9440127d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:04.328177 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f9dae708-6f4e-465f-8cf3-0e23c8440c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:04.488654 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 854/1709] 10.222.0.30 () {58 vars in 1058 bytes} [Sun Sep 4 01:00:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:04.498708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dae708-6f4e-465f-8cf3-0e23c8440c53 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:04.499868 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f9dae708-6f4e-465f-8cf3-0e23c8440c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:04.529339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12360489-232d-4807-a676-666098b621a5 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:04.532969 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:04.560293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe307cf-f13d-4962-8e8b-d1c907ea850f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:04.560927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe307cf-f13d-4962-8e8b-d1c907ea850f service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:04.561204 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe307cf-f13d-4962-8e8b-d1c907ea850f service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:04.561492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe307cf-f13d-4962-8e8b-d1c907ea850f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:04.564808 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-abe307cf-f13d-4962-8e8b-d1c907ea850f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:04.608981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dae708-6f4e-465f-8cf3-0e23c8440c53 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:04.615775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb6392-5e1f-4a0c-a4b9-938858fdcbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:04.616902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb6392-5e1f-4a0c-a4b9-938858fdcbe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:04.617363 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb6392-5e1f-4a0c-a4b9-938858fdcbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:04.618004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb6392-5e1f-4a0c-a4b9-938858fdcbe6 admin admin] PATH_INFO: `/v3/users/96bee00bced644e595806e03fb6e83b2` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:04.619288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb6392-5e1f-4a0c-a4b9-938858fdcbe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96bee00bced644e595806e03fb6e83b2)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:04.625080 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb6392-5e1f-4a0c-a4b9-938858fdcbe6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:04.662868 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe307cf-f13d-4962-8e8b-d1c907ea850f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:04.664494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe307cf-f13d-4962-8e8b-d1c907ea850f service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:04.671453 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:04.690512 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 856/1710] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:00:04.690743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1afb6392-5e1f-4a0c-a4b9-938858fdcbe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96bee00bced644e595806e03fb6e83b2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:04.690817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe307cf-f13d-4962-8e8b-d1c907ea850f service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:04.690885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1afb6392-5e1f-4a0c-a4b9-938858fdcbe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96bee00bced644e595806e03fb6e83b2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:04.698850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-abe307cf-f13d-4962-8e8b-d1c907ea850f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:04.699893 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1afb6392-5e1f-4a0c-a4b9-938858fdcbe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96bee00bced644e595806e03fb6e83b2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:04.713865 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1afb6392-5e1f-4a0c-a4b9-938858fdcbe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96bee00bced644e595806e03fb6e83b2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:04.714541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1afb6392-5e1f-4a0c-a4b9-938858fdcbe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96bee00bced644e595806e03fb6e83b2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:04.724951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe307cf-f13d-4962-8e8b-d1c907ea850f service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:04.731939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772c224-3788-4c33-8202-81b28cfcc6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:04.732760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772c224-3788-4c33-8202-81b28cfcc6f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:04.733034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772c224-3788-4c33-8202-81b28cfcc6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:04.733373 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772c224-3788-4c33-8202-81b28cfcc6f6 admin admin] PATH_INFO: `/v3/projects/bd7bf004460f4852a3177fa9d6c4c7a7` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:04.734767 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9772c224-3788-4c33-8202-81b28cfcc6f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd7bf004460f4852a3177fa9d6c4c7a7)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:04.736152 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-9772c224-3788-4c33-8202-81b28cfcc6f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:00:04.736152 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:00:04.736152 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:00:04.737427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9772c224-3788-4c33-8202-81b28cfcc6f6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:04.745469 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 855/1711] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:00:04 2022] DELETE /identity/v3/users/96bee00bced644e595806e03fb6e83b2 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:04.746537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb6392-5e1f-4a0c-a4b9-938858fdcbe6 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:04.748516 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1afb6392-5e1f-4a0c-a4b9-938858fdcbe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:04.816478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9772c224-3788-4c33-8202-81b28cfcc6f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd7bf004460f4852a3177fa9d6c4c7a7', 'request_id': 'req-9772c224-3788-4c33-8202-81b28cfcc6f6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:04.826187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9772c224-3788-4c33-8202-81b28cfcc6f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd7bf004460f4852a3177fa9d6c4c7a7', 'request_id': 'req-9772c224-3788-4c33-8202-81b28cfcc6f6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:04.833758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9772c224-3788-4c33-8202-81b28cfcc6f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd7bf004460f4852a3177fa9d6c4c7a7', 'request_id': 'req-9772c224-3788-4c33-8202-81b28cfcc6f6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:04.838741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb6392-5e1f-4a0c-a4b9-938858fdcbe6 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:04.857776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9772c224-3788-4c33-8202-81b28cfcc6f6 admin admin] The token cache is being invalidate because project bd7bf004460f4852a3177fa9d6c4c7a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:04.857776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9772c224-3788-4c33-8202-81b28cfcc6f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:04.858590 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9772c224-3788-4c33-8202-81b28cfcc6f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:04.860727 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 857/1712] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:04 2022] DELETE /identity/v3/projects/bd7bf004460f4852a3177fa9d6c4c7a7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:04.861384 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772c224-3788-4c33-8202-81b28cfcc6f6 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:04.862693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9772c224-3788-4c33-8202-81b28cfcc6f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:04.863480 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:04.913736 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427243f-d16b-4fc5-aba9-9bae6df3a401 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:04.914359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427243f-d16b-4fc5-aba9-9bae6df3a401 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:04.915027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427243f-d16b-4fc5-aba9-9bae6df3a401 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:04.915358 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427243f-d16b-4fc5-aba9-9bae6df3a401 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:04.918125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6427243f-d16b-4fc5-aba9-9bae6df3a401 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:04.931217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427243f-d16b-4fc5-aba9-9bae6df3a401 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:04.933078 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427243f-d16b-4fc5-aba9-9bae6df3a401 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:04.944983 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 856/1713] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:04.945664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427243f-d16b-4fc5-aba9-9bae6df3a401 service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:04.946174 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772c224-3788-4c33-8202-81b28cfcc6f6 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:04.947118 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6427243f-d16b-4fc5-aba9-9bae6df3a401 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:04.951232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99a3e6-77ba-4637-8dca-522cce9bf0fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:04.951845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99a3e6-77ba-4637-8dca-522cce9bf0fb service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:04.952157 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99a3e6-77ba-4637-8dca-522cce9bf0fb service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:04.952382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99a3e6-77ba-4637-8dca-522cce9bf0fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:04.960900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99a3e6-77ba-4637-8dca-522cce9bf0fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:04.962499 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99a3e6-77ba-4637-8dca-522cce9bf0fb service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:04.972157 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 858/1714] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:04.973179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba4eb3-0c21-45e9-b0d9-60c859a3418b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:04.973569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba4eb3-0c21-45e9-b0d9-60c859a3418b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:04.973851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba4eb3-0c21-45e9-b0d9-60c859a3418b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:04.997508 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-aaba4eb3-0c21-45e9-b0d9-60c859a3418b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:04.999587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-aaba4eb3-0c21-45e9-b0d9-60c859a3418b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:05.036977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427243f-d16b-4fc5-aba9-9bae6df3a401 service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:05.044853 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c08e1f-2ee5-400a-b2c5-bf5a771c358b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:05.045529 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c08e1f-2ee5-400a-b2c5-bf5a771c358b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:05.045808 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c08e1f-2ee5-400a-b2c5-bf5a771c358b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:05.046081 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c08e1f-2ee5-400a-b2c5-bf5a771c358b admin admin] PATH_INFO: `/v3/projects/52bfe932448d4af98b7d52c3da37f8bb` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:05.047346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c08e1f-2ee5-400a-b2c5-bf5a771c358b admin admin] RBAC: Authorizing `identity:delete_project(project_id=52bfe932448d4af98b7d52c3da37f8bb)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:05.049265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c08e1f-2ee5-400a-b2c5-bf5a771c358b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:05.077282 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 859/1715] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:05.078956 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb916072-5462-4c6f-96e5-3ca3ea5fb144 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:05.079564 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb916072-5462-4c6f-96e5-3ca3ea5fb144 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:05.080022 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb916072-5462-4c6f-96e5-3ca3ea5fb144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:05.112991 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-fb916072-5462-4c6f-96e5-3ca3ea5fb144 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:05.114291 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fb916072-5462-4c6f-96e5-3ca3ea5fb144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:05.124632 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:05.128415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-93c08e1f-2ee5-400a-b2c5-bf5a771c358b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52bfe932448d4af98b7d52c3da37f8bb', 'request_id': 'req-93c08e1f-2ee5-400a-b2c5-bf5a771c358b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:05.142112 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-93c08e1f-2ee5-400a-b2c5-bf5a771c358b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52bfe932448d4af98b7d52c3da37f8bb', 'request_id': 'req-93c08e1f-2ee5-400a-b2c5-bf5a771c358b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:05.156359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-93c08e1f-2ee5-400a-b2c5-bf5a771c358b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52bfe932448d4af98b7d52c3da37f8bb', 'request_id': 'req-93c08e1f-2ee5-400a-b2c5-bf5a771c358b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:05.171404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-93c08e1f-2ee5-400a-b2c5-bf5a771c358b admin admin] The token cache is being invalidate because project 52bfe932448d4af98b7d52c3da37f8bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:05.171696 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-93c08e1f-2ee5-400a-b2c5-bf5a771c358b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:05.172426 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-93c08e1f-2ee5-400a-b2c5-bf5a771c358b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:05.174268 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 857/1716] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:04 2022] DELETE /identity/v3/projects/52bfe932448d4af98b7d52c3da37f8bb => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:05.175105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c08e1f-2ee5-400a-b2c5-bf5a771c358b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:05.176491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-93c08e1f-2ee5-400a-b2c5-bf5a771c358b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:05.213612 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 860/1717] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:05.213612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb916072-5462-4c6f-96e5-3ca3ea5fb144 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:05.216654 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fb916072-5462-4c6f-96e5-3ca3ea5fb144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:05.239798 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:05.264033 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c08e1f-2ee5-400a-b2c5-bf5a771c358b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:05.269412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df7ff3-ed6f-4dbe-a789-e5a0e998d9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:05.270266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df7ff3-ed6f-4dbe-a789-e5a0e998d9b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:05.270626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df7ff3-ed6f-4dbe-a789-e5a0e998d9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:05.271010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df7ff3-ed6f-4dbe-a789-e5a0e998d9b8 admin admin] PATH_INFO: `/v3/users/5bd1c3dbb0ba4bf9a6a47c3d739e2afc` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:05.272263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df7ff3-ed6f-4dbe-a789-e5a0e998d9b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bd1c3dbb0ba4bf9a6a47c3d739e2afc)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:05.274464 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df7ff3-ed6f-4dbe-a789-e5a0e998d9b8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:05.298112 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb916072-5462-4c6f-96e5-3ca3ea5fb144 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:05.302729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4cd2b-4b4d-4650-b8f4-4739353c86fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:05.304025 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4cd2b-4b4d-4650-b8f4-4739353c86fc service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:05.304588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4cd2b-4b4d-4650-b8f4-4739353c86fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:05.304941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4cd2b-4b4d-4650-b8f4-4739353c86fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:05.307432 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-82c4cd2b-4b4d-4650-b8f4-4739353c86fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:05.320813 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4cd2b-4b4d-4650-b8f4-4739353c86fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:05.322391 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4cd2b-4b4d-4650-b8f4-4739353c86fc service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:05.336030 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 861/1718] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:05.337620 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d75b8e-6b36-4e3b-aa94-743976ceff96 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:05.337990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d75b8e-6b36-4e3b-aa94-743976ceff96 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:05.338336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d75b8e-6b36-4e3b-aa94-743976ceff96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:05.345146 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f1df7ff3-ed6f-4dbe-a789-e5a0e998d9b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bd1c3dbb0ba4bf9a6a47c3d739e2afc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:05.346508 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f1df7ff3-ed6f-4dbe-a789-e5a0e998d9b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bd1c3dbb0ba4bf9a6a47c3d739e2afc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:05.358435 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f1df7ff3-ed6f-4dbe-a789-e5a0e998d9b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bd1c3dbb0ba4bf9a6a47c3d739e2afc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:05.362730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-80d75b8e-6b36-4e3b-aa94-743976ceff96 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:05.364023 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-80d75b8e-6b36-4e3b-aa94-743976ceff96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:05.375651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f1df7ff3-ed6f-4dbe-a789-e5a0e998d9b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bd1c3dbb0ba4bf9a6a47c3d739e2afc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:05.376326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f1df7ff3-ed6f-4dbe-a789-e5a0e998d9b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bd1c3dbb0ba4bf9a6a47c3d739e2afc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:05.401763 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 858/1719] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:00:05 2022] DELETE /identity/v3/users/5bd1c3dbb0ba4bf9a6a47c3d739e2afc => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:05.401763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f426a99-a676-47fa-b7b4-e5c1291fd5b6 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:05.401763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f426a99-a676-47fa-b7b4-e5c1291fd5b6 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:05.401763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f426a99-a676-47fa-b7b4-e5c1291fd5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:05.409254 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 862/1720] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:05.416444 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124ada1-b92d-41fe-95fa-3788f8b55a1b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:05.416794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124ada1-b92d-41fe-95fa-3788f8b55a1b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:05.417071 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124ada1-b92d-41fe-95fa-3788f8b55a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:05.428542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-2f426a99-a676-47fa-b7b4-e5c1291fd5b6 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:05.430057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2f426a99-a676-47fa-b7b4-e5c1291fd5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:05.454258 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-5124ada1-b92d-41fe-95fa-3788f8b55a1b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:05.455646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5124ada1-b92d-41fe-95fa-3788f8b55a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:05.581051 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 859/1721] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:05.582928 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde5c74-6626-4978-b4ba-8289371c61c7 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:05.583222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde5c74-6626-4978-b4ba-8289371c61c7 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:05.583517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde5c74-6626-4978-b4ba-8289371c61c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:05.616807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5cde5c74-6626-4978-b4ba-8289371c61c7 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:05.618316 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5cde5c74-6626-4978-b4ba-8289371c61c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:05.629141 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 860/1722] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:05.630053 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde5c74-6626-4978-b4ba-8289371c61c7 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:05.634303 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 863/1723] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:05.635331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124ada1-b92d-41fe-95fa-3788f8b55a1b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:05.649371 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde5c74-6626-4978-b4ba-8289371c61c7 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:05.662558 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124ada1-b92d-41fe-95fa-3788f8b55a1b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:05.664913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a406f17-3760-470c-8acc-3efb8396341e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:05.665588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a406f17-3760-470c-8acc-3efb8396341e admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:05.665872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a406f17-3760-470c-8acc-3efb8396341e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:05.666144 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a406f17-3760-470c-8acc-3efb8396341e admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:05.666817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a406f17-3760-470c-8acc-3efb8396341e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:00:05.667128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a406f17-3760-470c-8acc-3efb8396341e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:05.669592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a406f17-3760-470c-8acc-3efb8396341e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:05.675275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271f2d5-1401-42ea-b9a7-77db5305d205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:05.675911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271f2d5-1401-42ea-b9a7-77db5305d205 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:05.680144 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271f2d5-1401-42ea-b9a7-77db5305d205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:05.680392 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271f2d5-1401-42ea-b9a7-77db5305d205 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:05.681089 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3271f2d5-1401-42ea-b9a7-77db5305d205 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:00:05.681403 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3271f2d5-1401-42ea-b9a7-77db5305d205 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:05.688939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3271f2d5-1401-42ea-b9a7-77db5305d205 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:05.705064 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 861/1724] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:00:05.707145 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a406f17-3760-470c-8acc-3efb8396341e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:05.708095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5a406f17-3760-470c-8acc-3efb8396341e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:05.730198 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 864/1725] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:00:05.731032 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271f2d5-1401-42ea-b9a7-77db5305d205 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:05.769699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271f2d5-1401-42ea-b9a7-77db5305d205 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:05.775800 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0be80-714f-4f80-927c-cda9454187fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:05.776520 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0be80-714f-4f80-927c-cda9454187fa admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:05.776799 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0be80-714f-4f80-927c-cda9454187fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:05.777076 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0be80-714f-4f80-927c-cda9454187fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:05.777839 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c0be80-714f-4f80-927c-cda9454187fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:05.778774 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:05.781065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c0be80-714f-4f80-927c-cda9454187fa admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:05.786285 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a406f17-3760-470c-8acc-3efb8396341e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:05.792384 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f77f7-855e-425e-b871-8fe1bae29d19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:05.793402 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f77f7-855e-425e-b871-8fe1bae29d19 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:05.794125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f77f7-855e-425e-b871-8fe1bae29d19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:05.794983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f77f7-855e-425e-b871-8fe1bae29d19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:05.811630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0f77f7-855e-425e-b871-8fe1bae29d19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:05.813131 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0f77f7-855e-425e-b871-8fe1bae29d19 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:05.825899 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 862/1726] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:05.829096 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 865/1727] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:00:05 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:05.833587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0be80-714f-4f80-927c-cda9454187fa admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:05.834350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f77f7-855e-425e-b871-8fe1bae29d19 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:05.858447 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:05.861069 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f77f7-855e-425e-b871-8fe1bae29d19 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:05.969394 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0be80-714f-4f80-927c-cda9454187fa admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:05.984261 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b8e5c-150e-4f0f-9100-22c5f5406a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:05.985086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b8e5c-150e-4f0f-9100-22c5f5406a1f admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:05.985655 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b8e5c-150e-4f0f-9100-22c5f5406a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:05.986153 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b8e5c-150e-4f0f-9100-22c5f5406a1f admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:05.986930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b8e5c-150e-4f0f-9100-22c5f5406a1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:05.993449 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b8e5c-150e-4f0f-9100-22c5f5406a1f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:06.038423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162a3f0-89d5-4f30-8b00-5413538b6527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:06.039062 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162a3f0-89d5-4f30-8b00-5413538b6527 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:06.039345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162a3f0-89d5-4f30-8b00-5413538b6527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:06.039649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162a3f0-89d5-4f30-8b00-5413538b6527 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:06.043813 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162a3f0-89d5-4f30-8b00-5413538b6527 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:06.046094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162a3f0-89d5-4f30-8b00-5413538b6527 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:06.048873 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 866/1728] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:05 2022] POST /identity/v3/users => generated 289 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:06.048873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b8e5c-150e-4f0f-9100-22c5f5406a1f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:06.054556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b02b8e5c-150e-4f0f-9100-22c5f5406a1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:06.081010 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b8e5c-150e-4f0f-9100-22c5f5406a1f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:06.089518 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 863/1729] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:00:05 2022] POST /identity/v3/projects => generated 383 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:06.090374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162a3f0-89d5-4f30-8b00-5413538b6527 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:06.094962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a2298-fdee-4f57-b00b-de370fbe2705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:06.097383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a2298-fdee-4f57-b00b-de370fbe2705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:06.099241 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a2298-fdee-4f57-b00b-de370fbe2705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:06.100564 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a2298-fdee-4f57-b00b-de370fbe2705 admin admin] PATH_INFO: `/v3/projects/4667a4ef6459477eb33bd39178aa9b35` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:06.103470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a2298-fdee-4f57-b00b-de370fbe2705 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4667a4ef6459477eb33bd39178aa9b35)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:06.106873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a2298-fdee-4f57-b00b-de370fbe2705 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:06.185019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-df5a2298-fdee-4f57-b00b-de370fbe2705 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4667a4ef6459477eb33bd39178aa9b35', 'request_id': 'req-df5a2298-fdee-4f57-b00b-de370fbe2705'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:06.195837 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-df5a2298-fdee-4f57-b00b-de370fbe2705 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4667a4ef6459477eb33bd39178aa9b35', 'request_id': 'req-df5a2298-fdee-4f57-b00b-de370fbe2705'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:06.200579 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162a3f0-89d5-4f30-8b00-5413538b6527 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:06.205634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-df5a2298-fdee-4f57-b00b-de370fbe2705 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4667a4ef6459477eb33bd39178aa9b35', 'request_id': 'req-df5a2298-fdee-4f57-b00b-de370fbe2705'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:06.222211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-df5a2298-fdee-4f57-b00b-de370fbe2705 admin admin] The token cache is being invalidate because project 4667a4ef6459477eb33bd39178aa9b35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:06.222502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-df5a2298-fdee-4f57-b00b-de370fbe2705 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:06.223237 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-df5a2298-fdee-4f57-b00b-de370fbe2705 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:06.228316 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 867/1730] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:06 2022] DELETE /identity/v3/projects/4667a4ef6459477eb33bd39178aa9b35 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:06.228316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a2298-fdee-4f57-b00b-de370fbe2705 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:06.228506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-df5a2298-fdee-4f57-b00b-de370fbe2705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:06.270774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc02bd-da9d-4ed3-b9f7-bd94b32c9089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:06.271568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc02bd-da9d-4ed3-b9f7-bd94b32c9089 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:06.272435 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc02bd-da9d-4ed3-b9f7-bd94b32c9089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:06.272722 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc02bd-da9d-4ed3-b9f7-bd94b32c9089 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:06.273880 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc02bd-da9d-4ed3-b9f7-bd94b32c9089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:06.277064 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc02bd-da9d-4ed3-b9f7-bd94b32c9089 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:06.305428 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 864/1731] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:06.305428 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc02bd-da9d-4ed3-b9f7-bd94b32c9089 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:06.308107 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-18cc02bd-da9d-4ed3-b9f7-bd94b32c9089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:06.329643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc02bd-da9d-4ed3-b9f7-bd94b32c9089 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:06.336012 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113feaf7-f05a-4bbc-a01b-04ca5ea0a30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:06.336662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113feaf7-f05a-4bbc-a01b-04ca5ea0a30c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:06.337050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113feaf7-f05a-4bbc-a01b-04ca5ea0a30c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:06.337207 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113feaf7-f05a-4bbc-a01b-04ca5ea0a30c admin admin] PATH_INFO: `/v3/users/00622a08fde64c64950e7a458d01acb1` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:06.338699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113feaf7-f05a-4bbc-a01b-04ca5ea0a30c admin admin] RBAC: Authorizing `identity:delete_user(user_id=00622a08fde64c64950e7a458d01acb1)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:06.340342 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a2298-fdee-4f57-b00b-de370fbe2705 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:06.340800 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113feaf7-f05a-4bbc-a01b-04ca5ea0a30c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:06.345532 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5558c-cba3-485b-ba8c-ec863808e210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:06.346440 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5558c-cba3-485b-ba8c-ec863808e210 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:06.346884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5558c-cba3-485b-ba8c-ec863808e210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:06.347374 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5558c-cba3-485b-ba8c-ec863808e210 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:06.348026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5558c-cba3-485b-ba8c-ec863808e210 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:06.351977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5558c-cba3-485b-ba8c-ec863808e210 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:06.358000 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:06.381349 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 868/1732] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:06 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:06.382531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5558c-cba3-485b-ba8c-ec863808e210 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:06.384416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-06b5558c-cba3-485b-ba8c-ec863808e210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:06.399241 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5558c-cba3-485b-ba8c-ec863808e210 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:06.404887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcad93d-dd6b-4cc7-9d73-1d356d48899c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:06.405534 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcad93d-dd6b-4cc7-9d73-1d356d48899c admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:06.405817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcad93d-dd6b-4cc7-9d73-1d356d48899c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:06.406055 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-113feaf7-f05a-4bbc-a01b-04ca5ea0a30c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00622a08fde64c64950e7a458d01acb1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:06.406152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcad93d-dd6b-4cc7-9d73-1d356d48899c admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:06.406731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-113feaf7-f05a-4bbc-a01b-04ca5ea0a30c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00622a08fde64c64950e7a458d01acb1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:06.406827 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcad93d-dd6b-4cc7-9d73-1d356d48899c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:06.408376 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcad93d-dd6b-4cc7-9d73-1d356d48899c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:06.415778 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-113feaf7-f05a-4bbc-a01b-04ca5ea0a30c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00622a08fde64c64950e7a458d01acb1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:06.419832 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 869/1733] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:06.421261 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcad93d-dd6b-4cc7-9d73-1d356d48899c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:06.423368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7fcad93d-dd6b-4cc7-9d73-1d356d48899c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:06.424188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-113feaf7-f05a-4bbc-a01b-04ca5ea0a30c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00622a08fde64c64950e7a458d01acb1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:06.424930 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-113feaf7-f05a-4bbc-a01b-04ca5ea0a30c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00622a08fde64c64950e7a458d01acb1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:06.440617 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcad93d-dd6b-4cc7-9d73-1d356d48899c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:06.449414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a869a0a-34b6-4a5e-9a10-7ff0653cb358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:06.450363 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a869a0a-34b6-4a5e-9a10-7ff0653cb358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:06.450821 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a869a0a-34b6-4a5e-9a10-7ff0653cb358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:06.451306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a869a0a-34b6-4a5e-9a10-7ff0653cb358 admin admin] PATH_INFO: `/v3/projects/a6a9406fa37e48de8853999c0aa67a21` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:06.452732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a869a0a-34b6-4a5e-9a10-7ff0653cb358 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6a9406fa37e48de8853999c0aa67a21)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:06.456267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a869a0a-34b6-4a5e-9a10-7ff0653cb358 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:06.456922 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 865/1734] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:00:06 2022] DELETE /identity/v3/users/00622a08fde64c64950e7a458d01acb1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:06.461737 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:06.462786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113feaf7-f05a-4bbc-a01b-04ca5ea0a30c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:06.464736 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-113feaf7-f05a-4bbc-a01b-04ca5ea0a30c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:06.530381 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4a869a0a-34b6-4a5e-9a10-7ff0653cb358 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6a9406fa37e48de8853999c0aa67a21', 'request_id': 'req-4a869a0a-34b6-4a5e-9a10-7ff0653cb358'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:06.549053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4a869a0a-34b6-4a5e-9a10-7ff0653cb358 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6a9406fa37e48de8853999c0aa67a21', 'request_id': 'req-4a869a0a-34b6-4a5e-9a10-7ff0653cb358'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:06.557401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4a869a0a-34b6-4a5e-9a10-7ff0653cb358 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6a9406fa37e48de8853999c0aa67a21', 'request_id': 'req-4a869a0a-34b6-4a5e-9a10-7ff0653cb358'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:06.560139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113feaf7-f05a-4bbc-a01b-04ca5ea0a30c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:06.573962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4a869a0a-34b6-4a5e-9a10-7ff0653cb358 admin admin] The token cache is being invalidate because project a6a9406fa37e48de8853999c0aa67a21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:06.575098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4a869a0a-34b6-4a5e-9a10-7ff0653cb358 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:06.576476 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4a869a0a-34b6-4a5e-9a10-7ff0653cb358 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:06.582426 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 870/1735] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:06 2022] DELETE /identity/v3/projects/a6a9406fa37e48de8853999c0aa67a21 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:06.584436 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a869a0a-34b6-4a5e-9a10-7ff0653cb358 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:06.587094 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4a869a0a-34b6-4a5e-9a10-7ff0653cb358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:06.683714 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec64ffb-0925-4523-a215-82e6e36c13db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:06.684334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec64ffb-0925-4523-a215-82e6e36c13db admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:06.684656 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec64ffb-0925-4523-a215-82e6e36c13db admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:06.685120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec64ffb-0925-4523-a215-82e6e36c13db admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:06.685811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec64ffb-0925-4523-a215-82e6e36c13db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:06.687412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec64ffb-0925-4523-a215-82e6e36c13db admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:06.703630 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a869a0a-34b6-4a5e-9a10-7ff0653cb358 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:06.704145 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 866/1736] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:06.705063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec64ffb-0925-4523-a215-82e6e36c13db admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:06.707315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4ec64ffb-0925-4523-a215-82e6e36c13db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:06.711199 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e742611-ba6d-4e2f-b41d-f38e1e7ed720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:06.711874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e742611-ba6d-4e2f-b41d-f38e1e7ed720 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:06.712158 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e742611-ba6d-4e2f-b41d-f38e1e7ed720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:06.712433 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e742611-ba6d-4e2f-b41d-f38e1e7ed720 admin admin] PATH_INFO: `/v3/projects/f4b042cc50124c9a87dd2b2afaeb8fba/users/734a6025b8c84c3d9f7eec77e8fad5f6/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:06.731664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e742611-ba6d-4e2f-b41d-f38e1e7ed720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4b042cc50124c9a87dd2b2afaeb8fba, user_id=734a6025b8c84c3d9f7eec77e8fad5f6, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:06.734917 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e742611-ba6d-4e2f-b41d-f38e1e7ed720 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:06.738398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec64ffb-0925-4523-a215-82e6e36c13db admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:06.744719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a372d4-92dd-4c00-94fe-a3487b301111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:06.745955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a372d4-92dd-4c00-94fe-a3487b301111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:06.746454 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a372d4-92dd-4c00-94fe-a3487b301111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:06.746867 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a372d4-92dd-4c00-94fe-a3487b301111 admin admin] PATH_INFO: `/v3/users/09d07bcd49854335836e7329743890de` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:06.748626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a372d4-92dd-4c00-94fe-a3487b301111 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09d07bcd49854335836e7329743890de)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:06.750592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a372d4-92dd-4c00-94fe-a3487b301111 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:06.758525 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 871/1737] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:06 2022] PUT /identity/v3/projects/f4b042cc50124c9a87dd2b2afaeb8fba/users/734a6025b8c84c3d9f7eec77e8fad5f6/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:06.758525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e742611-ba6d-4e2f-b41d-f38e1e7ed720 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:06.769265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5e742611-ba6d-4e2f-b41d-f38e1e7ed720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:06.798835 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:06.828873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-15a372d4-92dd-4c00-94fe-a3487b301111 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09d07bcd49854335836e7329743890de'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:06.829681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-15a372d4-92dd-4c00-94fe-a3487b301111 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09d07bcd49854335836e7329743890de'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:06.839245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-15a372d4-92dd-4c00-94fe-a3487b301111 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09d07bcd49854335836e7329743890de'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:06.851761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-15a372d4-92dd-4c00-94fe-a3487b301111 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09d07bcd49854335836e7329743890de'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:06.852446 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-15a372d4-92dd-4c00-94fe-a3487b301111 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09d07bcd49854335836e7329743890de'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:06.871942 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 867/1738] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:00:06 2022] DELETE /identity/v3/users/09d07bcd49854335836e7329743890de => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:06.875943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368501a2-8b93-4b03-a56e-6612b418dc98 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:06.876246 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368501a2-8b93-4b03-a56e-6612b418dc98 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:06.876652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368501a2-8b93-4b03-a56e-6612b418dc98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:06.887879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e742611-ba6d-4e2f-b41d-f38e1e7ed720 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:06.911821 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:06.934203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-368501a2-8b93-4b03-a56e-6612b418dc98 None None] MFA Rules not processed for user `734a6025b8c84c3d9f7eec77e8fad5f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:06.935904 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-368501a2-8b93-4b03-a56e-6612b418dc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:06.973615 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5f533-572b-42df-b72e-7425d91c2003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:06.974589 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5f533-572b-42df-b72e-7425d91c2003 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:06.975079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5f533-572b-42df-b72e-7425d91c2003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:06.975555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5f533-572b-42df-b72e-7425d91c2003 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:06.976406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff5f533-572b-42df-b72e-7425d91c2003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:06.978366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff5f533-572b-42df-b72e-7425d91c2003 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:06.993585 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 872/1739] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:06.994953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5f533-572b-42df-b72e-7425d91c2003 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:06.997013 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0ff5f533-572b-42df-b72e-7425d91c2003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:07.013871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5f533-572b-42df-b72e-7425d91c2003 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:07.020868 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77434ea8-2ead-4d34-8313-f68fa8705218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:07.021414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77434ea8-2ead-4d34-8313-f68fa8705218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:07.022297 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77434ea8-2ead-4d34-8313-f68fa8705218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:07.022694 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77434ea8-2ead-4d34-8313-f68fa8705218 admin admin] PATH_INFO: `/v3/projects/4d6367d70746477095ba0a873b9dee0a` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:07.024490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77434ea8-2ead-4d34-8313-f68fa8705218 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d6367d70746477095ba0a873b9dee0a)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:07.028358 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77434ea8-2ead-4d34-8313-f68fa8705218 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:07.048307 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 868/1740] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:07.050037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368501a2-8b93-4b03-a56e-6612b418dc98 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:07.052500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-368501a2-8b93-4b03-a56e-6612b418dc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:07.071106 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368501a2-8b93-4b03-a56e-6612b418dc98 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:07.075929 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0495aa-fb5b-4019-b0a8-ea83adea2d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:07.076775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0495aa-fb5b-4019-b0a8-ea83adea2d70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:07.077097 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0495aa-fb5b-4019-b0a8-ea83adea2d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:07.077375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0495aa-fb5b-4019-b0a8-ea83adea2d70 admin admin] PATH_INFO: `/v3/projects/7c0d4a8d7c90471081b5a4c948ac2391/users/e92e26cb9ad74e3a9a0ea27ea1aeeb2f/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:07.094511 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0495aa-fb5b-4019-b0a8-ea83adea2d70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c0d4a8d7c90471081b5a4c948ac2391, user_id=e92e26cb9ad74e3a9a0ea27ea1aeeb2f, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:07.097366 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0495aa-fb5b-4019-b0a8-ea83adea2d70 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:07.120837 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-77434ea8-2ead-4d34-8313-f68fa8705218 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d6367d70746477095ba0a873b9dee0a', 'request_id': 'req-77434ea8-2ead-4d34-8313-f68fa8705218'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:07.129050 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 869/1741] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:07 2022] PUT /identity/v3/projects/7c0d4a8d7c90471081b5a4c948ac2391/users/e92e26cb9ad74e3a9a0ea27ea1aeeb2f/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:07.130079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0495aa-fb5b-4019-b0a8-ea83adea2d70 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:07.133121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1c0495aa-fb5b-4019-b0a8-ea83adea2d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:07.135836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-77434ea8-2ead-4d34-8313-f68fa8705218 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d6367d70746477095ba0a873b9dee0a', 'request_id': 'req-77434ea8-2ead-4d34-8313-f68fa8705218'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:07.144275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-77434ea8-2ead-4d34-8313-f68fa8705218 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d6367d70746477095ba0a873b9dee0a', 'request_id': 'req-77434ea8-2ead-4d34-8313-f68fa8705218'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:07.158105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-77434ea8-2ead-4d34-8313-f68fa8705218 admin admin] The token cache is being invalidate because project 4d6367d70746477095ba0a873b9dee0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:07.158436 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-77434ea8-2ead-4d34-8313-f68fa8705218 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:07.159121 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-77434ea8-2ead-4d34-8313-f68fa8705218 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:07.160881 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 873/1742] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:06 2022] DELETE /identity/v3/projects/4d6367d70746477095ba0a873b9dee0a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:07.161930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae442d-2d89-4947-bd86-896632d0589c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:07.162302 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae442d-2d89-4947-bd86-896632d0589c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:07.162583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae442d-2d89-4947-bd86-896632d0589c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:07.195399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-dcae442d-2d89-4947-bd86-896632d0589c None None] MFA Rules not processed for user `e92e26cb9ad74e3a9a0ea27ea1aeeb2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:07.196823 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-dcae442d-2d89-4947-bd86-896632d0589c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:07.234660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0495aa-fb5b-4019-b0a8-ea83adea2d70 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:07.250167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac73c46-bd19-4d4d-a50f-d62997f874d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:07.250849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac73c46-bd19-4d4d-a50f-d62997f874d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:07.251127 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac73c46-bd19-4d4d-a50f-d62997f874d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:07.251401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac73c46-bd19-4d4d-a50f-d62997f874d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:07.252163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac73c46-bd19-4d4d-a50f-d62997f874d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:07.254234 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac73c46-bd19-4d4d-a50f-d62997f874d7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:07.270956 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:07.289517 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 870/1743] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:00:07 2022] POST /identity/v3/projects => generated 379 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:07.291331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc628f9-cc6d-43a1-9dfb-5e5739c7863e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:07.291682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc628f9-cc6d-43a1-9dfb-5e5739c7863e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:07.292239 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc628f9-cc6d-43a1-9dfb-5e5739c7863e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:07.306758 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 874/1744] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:07.315967 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae442d-2d89-4947-bd86-896632d0589c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:07.319120 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-dcae442d-2d89-4947-bd86-896632d0589c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:07.326802 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-3fc628f9-cc6d-43a1-9dfb-5e5739c7863e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:07.328323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3fc628f9-cc6d-43a1-9dfb-5e5739c7863e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:07.337098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae442d-2d89-4947-bd86-896632d0589c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:07.367432 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:07.414321 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 871/1745] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:07.414321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc628f9-cc6d-43a1-9dfb-5e5739c7863e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:07.416292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3fc628f9-cc6d-43a1-9dfb-5e5739c7863e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:07.423360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9dc83-e0dc-4524-9d3d-b1d34963036c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:07.424402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9dc83-e0dc-4524-9d3d-b1d34963036c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:07.424678 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9dc83-e0dc-4524-9d3d-b1d34963036c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:07.425680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9dc83-e0dc-4524-9d3d-b1d34963036c admin admin] PATH_INFO: `/v3/projects/ea1c703086924239a076021d1150ec28` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:07.428798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9dc83-e0dc-4524-9d3d-b1d34963036c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea1c703086924239a076021d1150ec28)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:07.432754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9dc83-e0dc-4524-9d3d-b1d34963036c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:07.435297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc628f9-cc6d-43a1-9dfb-5e5739c7863e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:07.451563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a37afd-c6ba-49df-8756-43dc5a5827ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:07.451563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a37afd-c6ba-49df-8756-43dc5a5827ff admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:07.451805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a37afd-c6ba-49df-8756-43dc5a5827ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:07.452436 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a37afd-c6ba-49df-8756-43dc5a5827ff admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:07.453090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a37afd-c6ba-49df-8756-43dc5a5827ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:07.470926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a37afd-c6ba-49df-8756-43dc5a5827ff admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:07.518036 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 872/1746] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:07 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:07.518036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a37afd-c6ba-49df-8756-43dc5a5827ff admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:07.518486 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-17a37afd-c6ba-49df-8756-43dc5a5827ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:07.535307 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-28a9dc83-e0dc-4524-9d3d-b1d34963036c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea1c703086924239a076021d1150ec28', 'request_id': 'req-28a9dc83-e0dc-4524-9d3d-b1d34963036c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:07.543098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a37afd-c6ba-49df-8756-43dc5a5827ff admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:07.552541 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-28a9dc83-e0dc-4524-9d3d-b1d34963036c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea1c703086924239a076021d1150ec28', 'request_id': 'req-28a9dc83-e0dc-4524-9d3d-b1d34963036c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:07.561803 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-28a9dc83-e0dc-4524-9d3d-b1d34963036c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea1c703086924239a076021d1150ec28', 'request_id': 'req-28a9dc83-e0dc-4524-9d3d-b1d34963036c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:07.584321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-28a9dc83-e0dc-4524-9d3d-b1d34963036c admin admin] The token cache is being invalidate because project ea1c703086924239a076021d1150ec28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:07.584620 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-28a9dc83-e0dc-4524-9d3d-b1d34963036c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:07.587113 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-28a9dc83-e0dc-4524-9d3d-b1d34963036c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:07.589103 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 875/1747] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:07 2022] DELETE /identity/v3/projects/ea1c703086924239a076021d1150ec28 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:07.590337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c21760-3dd8-4faf-9389-1474518ae02d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:07.590617 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c21760-3dd8-4faf-9389-1474518ae02d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:07.596320 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c21760-3dd8-4faf-9389-1474518ae02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:07.623701 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-f6c21760-3dd8-4faf-9389-1474518ae02d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:07.624978 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f6c21760-3dd8-4faf-9389-1474518ae02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:07.638117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf94de-9bb3-4f47-8a95-11224577badb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:07.638740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf94de-9bb3-4f47-8a95-11224577badb admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:07.639022 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf94de-9bb3-4f47-8a95-11224577badb admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:07.639296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf94de-9bb3-4f47-8a95-11224577badb admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:07.639961 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf94de-9bb3-4f47-8a95-11224577badb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:07.641912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf94de-9bb3-4f47-8a95-11224577badb admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:07.673209 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 873/1748] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:00:07 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:07.673209 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf94de-9bb3-4f47-8a95-11224577badb admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:07.674503 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ffaf94de-9bb3-4f47-8a95-11224577badb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:07.687597 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 876/1749] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:07.688926 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694efdc6-0c23-4e9e-b400-19b99c627e3e None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:07.689210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694efdc6-0c23-4e9e-b400-19b99c627e3e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:07.689507 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694efdc6-0c23-4e9e-b400-19b99c627e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:07.709730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-694efdc6-0c23-4e9e-b400-19b99c627e3e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:07.710915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-694efdc6-0c23-4e9e-b400-19b99c627e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:07.742072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf94de-9bb3-4f47-8a95-11224577badb admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:07.746669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6d52a-396b-498a-9cf5-e6774ddd5dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:07.747276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6d52a-396b-498a-9cf5-e6774ddd5dfc admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:07.747574 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6d52a-396b-498a-9cf5-e6774ddd5dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:07.747830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6d52a-396b-498a-9cf5-e6774ddd5dfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:07.748472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6d52a-396b-498a-9cf5-e6774ddd5dfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:07.750091 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6d52a-396b-498a-9cf5-e6774ddd5dfc admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:07.755195 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:07.760905 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 874/1750] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:07.761820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6d52a-396b-498a-9cf5-e6774ddd5dfc admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:07.763735 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0cc6d52a-396b-498a-9cf5-e6774ddd5dfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:07.764323 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:07.783390 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 877/1751] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:07.783390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694efdc6-0c23-4e9e-b400-19b99c627e3e None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:07.783621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6d52a-396b-498a-9cf5-e6774ddd5dfc admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:07.783621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cddc65c-6e1b-4ddb-b09f-c8cfee53ddc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:07.783963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddc65c-6e1b-4ddb-b09f-c8cfee53ddc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:07.784203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddc65c-6e1b-4ddb-b09f-c8cfee53ddc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:07.784474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddc65c-6e1b-4ddb-b09f-c8cfee53ddc8 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:07.785223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cddc65c-6e1b-4ddb-b09f-c8cfee53ddc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:07.787694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cddc65c-6e1b-4ddb-b09f-c8cfee53ddc8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:07.793546 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694efdc6-0c23-4e9e-b400-19b99c627e3e None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:07.799447 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b300f3-dc3e-4b36-9d93-aa52fd915e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:07.800086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b300f3-dc3e-4b36-9d93-aa52fd915e03 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:07.800450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b300f3-dc3e-4b36-9d93-aa52fd915e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:07.800782 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b300f3-dc3e-4b36-9d93-aa52fd915e03 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:07.801489 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b300f3-dc3e-4b36-9d93-aa52fd915e03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:00:07.801886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b300f3-dc3e-4b36-9d93-aa52fd915e03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:07.804139 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b300f3-dc3e-4b36-9d93-aa52fd915e03 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:07.810337 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 875/1752] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:07 2022] POST /identity/v3/users => generated 299 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:07.811199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cddc65c-6e1b-4ddb-b09f-c8cfee53ddc8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:07.821257 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 878/1753] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:00:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:00:07.822631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696a6e6-8307-428c-9aa9-5f62638ee4b9 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:07.822919 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696a6e6-8307-428c-9aa9-5f62638ee4b9 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:07.823193 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696a6e6-8307-428c-9aa9-5f62638ee4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:07.844761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-3696a6e6-8307-428c-9aa9-5f62638ee4b9 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:07.845941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3696a6e6-8307-428c-9aa9-5f62638ee4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:07.848068 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cddc65c-6e1b-4ddb-b09f-c8cfee53ddc8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:07.853503 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878bf12-2374-481c-a469-550611504f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:07.854189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878bf12-2374-481c-a469-550611504f11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:07.854465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878bf12-2374-481c-a469-550611504f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:07.854739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878bf12-2374-481c-a469-550611504f11 admin admin] PATH_INFO: `/v3/projects/306c60d17cc54dc58d96340290905a95/users/e812b0ac9d324dbca0a33779143ad9ab/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:07.860714 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 879/1754] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:07.864743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696a6e6-8307-428c-9aa9-5f62638ee4b9 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:07.883276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696a6e6-8307-428c-9aa9-5f62638ee4b9 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:07.886438 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6878bf12-2374-481c-a469-550611504f11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=306c60d17cc54dc58d96340290905a95, user_id=e812b0ac9d324dbca0a33779143ad9ab, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:07.889121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6878bf12-2374-481c-a469-550611504f11 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:07.893295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f3bd9-397e-4813-adcb-653e8d3ab1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:07.894261 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f3bd9-397e-4813-adcb-653e8d3ab1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:07.894640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f3bd9-397e-4813-adcb-653e8d3ab1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:07.894888 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f3bd9-397e-4813-adcb-653e8d3ab1f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:07.895848 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f3bd9-397e-4813-adcb-653e8d3ab1f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:07.898759 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f3bd9-397e-4813-adcb-653e8d3ab1f9 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:07.906965 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 876/1755] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:07 2022] PUT /identity/v3/projects/306c60d17cc54dc58d96340290905a95/users/e812b0ac9d324dbca0a33779143ad9ab/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:07.908108 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878bf12-2374-481c-a469-550611504f11 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:07.911750 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 880/1756] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:07.913522 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f3bd9-397e-4813-adcb-653e8d3ab1f9 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:07.926753 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f3bd9-397e-4813-adcb-653e8d3ab1f9 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:08.004618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878bf12-2374-481c-a469-550611504f11 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:08.018185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad76b66-1b6a-42db-95d0-053a8fd1c9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:08.019331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad76b66-1b6a-42db-95d0-053a8fd1c9c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:08.019709 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad76b66-1b6a-42db-95d0-053a8fd1c9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:08.019816 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32395dcc-c889-4e79-8db1-4bd7a5cacf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:08.020168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad76b66-1b6a-42db-95d0-053a8fd1c9c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:08.020372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32395dcc-c889-4e79-8db1-4bd7a5cacf7e admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:08.020660 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32395dcc-c889-4e79-8db1-4bd7a5cacf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:08.020938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32395dcc-c889-4e79-8db1-4bd7a5cacf7e admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:08.021729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32395dcc-c889-4e79-8db1-4bd7a5cacf7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:00:08.021978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad76b66-1b6a-42db-95d0-053a8fd1c9c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:08.022079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32395dcc-c889-4e79-8db1-4bd7a5cacf7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:08.023650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32395dcc-c889-4e79-8db1-4bd7a5cacf7e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:08.024382 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad76b66-1b6a-42db-95d0-053a8fd1c9c0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:08.049132 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 881/1757] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:00:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:00:08.050783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32395dcc-c889-4e79-8db1-4bd7a5cacf7e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:08.065409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32395dcc-c889-4e79-8db1-4bd7a5cacf7e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:08.070728 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 877/1758] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:00:07 2022] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:08.072802 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad76b66-1b6a-42db-95d0-053a8fd1c9c0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:08.144986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b95fba-4f1f-44af-ad24-a69a372ac4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:08.145863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b95fba-4f1f-44af-ad24-a69a372ac4ab admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:08.146185 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b95fba-4f1f-44af-ad24-a69a372ac4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:08.146639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b95fba-4f1f-44af-ad24-a69a372ac4ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:08.147640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b95fba-4f1f-44af-ad24-a69a372ac4ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:08.149518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b95fba-4f1f-44af-ad24-a69a372ac4ab admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:08.166324 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 882/1759] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:08.167915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886e4ee-8d7d-443d-93cc-176689abbd33 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:08.168610 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886e4ee-8d7d-443d-93cc-176689abbd33 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:08.168911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886e4ee-8d7d-443d-93cc-176689abbd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:08.192079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad76b66-1b6a-42db-95d0-053a8fd1c9c0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:08.199312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1e92f-8670-4eb2-9453-03fbe142260a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:08.200560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1e92f-8670-4eb2-9453-03fbe142260a admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:08.201045 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1e92f-8670-4eb2-9453-03fbe142260a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:08.201592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1e92f-8670-4eb2-9453-03fbe142260a admin admin] PATH_INFO: `/v3/projects/36deaeec637143369701a3dfc7db966f/users/7e4e5cefe5e4492e9e785dc893e64d9f/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:08.220756 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1e92f-8670-4eb2-9453-03fbe142260a admin admin] RBAC: Authorizing `identity:create_grant(project_id=36deaeec637143369701a3dfc7db966f, user_id=7e4e5cefe5e4492e9e785dc893e64d9f, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:08.223932 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1e92f-8670-4eb2-9453-03fbe142260a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:08.244046 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-3886e4ee-8d7d-443d-93cc-176689abbd33 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:08.245227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3886e4ee-8d7d-443d-93cc-176689abbd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:08.246535 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 878/1760] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:08 2022] PUT /identity/v3/projects/36deaeec637143369701a3dfc7db966f/users/7e4e5cefe5e4492e9e785dc893e64d9f/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:08.248059 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1e92f-8670-4eb2-9453-03fbe142260a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:08.289779 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:08.290441 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:08.333706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1e92f-8670-4eb2-9453-03fbe142260a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:08.353739 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 883/1761] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:00:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:08.354664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886e4ee-8d7d-443d-93cc-176689abbd33 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:08.354823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7208ec7-96d3-4563-b173-c1b332e4b5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:08.356454 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7208ec7-96d3-4563-b173-c1b332e4b5c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:08.356848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7208ec7-96d3-4563-b173-c1b332e4b5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:08.357608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7208ec7-96d3-4563-b173-c1b332e4b5c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:08.359363 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7208ec7-96d3-4563-b173-c1b332e4b5c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:08.362195 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7208ec7-96d3-4563-b173-c1b332e4b5c1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:08.392847 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886e4ee-8d7d-443d-93cc-176689abbd33 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:08.399302 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137b07f-724a-437e-9e20-ecfed833b18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:08.399937 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137b07f-724a-437e-9e20-ecfed833b18f admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:08.400217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137b07f-724a-437e-9e20-ecfed833b18f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:08.401144 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137b07f-724a-437e-9e20-ecfed833b18f admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:08.401144 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a137b07f-724a-437e-9e20-ecfed833b18f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:08.403297 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a137b07f-724a-437e-9e20-ecfed833b18f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:08.429405 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 879/1762] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:00:08 2022] POST /identity/v3/projects => generated 389 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:08.430765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7208ec7-96d3-4563-b173-c1b332e4b5c1 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:08.442800 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 884/1763] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:08 2022] POST /identity/v3/users => generated 294 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:08.442800 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137b07f-724a-437e-9e20-ecfed833b18f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:08.455674 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137b07f-724a-437e-9e20-ecfed833b18f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:08.525397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7208ec7-96d3-4563-b173-c1b332e4b5c1 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:08.530695 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02c2f2-3756-4dd9-8f67-7b01db894247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:08.531242 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02c2f2-3756-4dd9-8f67-7b01db894247 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:08.531528 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02c2f2-3756-4dd9-8f67-7b01db894247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:08.531802 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02c2f2-3756-4dd9-8f67-7b01db894247 admin admin] PATH_INFO: `/v3/projects/306c60d17cc54dc58d96340290905a95/users/e812b0ac9d324dbca0a33779143ad9ab/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:08.533996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02c2f2-3756-4dd9-8f67-7b01db894247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=306c60d17cc54dc58d96340290905a95, user_id=e812b0ac9d324dbca0a33779143ad9ab, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:08.536921 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02c2f2-3756-4dd9-8f67-7b01db894247 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:08.542674 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fd43d-7aa5-4502-9644-5276a72c3618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:08.543487 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fd43d-7aa5-4502-9644-5276a72c3618 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:08.543770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fd43d-7aa5-4502-9644-5276a72c3618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:08.544176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fd43d-7aa5-4502-9644-5276a72c3618 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:08.544826 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6fd43d-7aa5-4502-9644-5276a72c3618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:08.546642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6fd43d-7aa5-4502-9644-5276a72c3618 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:08.552062 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 880/1764] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:08 2022] PUT /identity/v3/projects/306c60d17cc54dc58d96340290905a95/users/e812b0ac9d324dbca0a33779143ad9ab/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:08.553111 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02c2f2-3756-4dd9-8f67-7b01db894247 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:08.564519 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 885/1765] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:08.565172 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fd43d-7aa5-4502-9644-5276a72c3618 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:08.577353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fd43d-7aa5-4502-9644-5276a72c3618 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:08.632663 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02c2f2-3756-4dd9-8f67-7b01db894247 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:08.638162 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102eafef-0937-4841-a779-adafa62e9506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:08.638988 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102eafef-0937-4841-a779-adafa62e9506 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:08.639411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102eafef-0937-4841-a779-adafa62e9506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:08.639698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102eafef-0937-4841-a779-adafa62e9506 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:08.640317 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102eafef-0937-4841-a779-adafa62e9506 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:08.642303 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102eafef-0937-4841-a779-adafa62e9506 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:08.645846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c775c6-c855-4393-b37d-323aad1a8440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:08.646503 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c775c6-c855-4393-b37d-323aad1a8440 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:08.646793 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c775c6-c855-4393-b37d-323aad1a8440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:08.647093 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c775c6-c855-4393-b37d-323aad1a8440 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:08.648140 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c775c6-c855-4393-b37d-323aad1a8440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:08.649864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c775c6-c855-4393-b37d-323aad1a8440 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:08.665960 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 886/1766] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:08.665960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c775c6-c855-4393-b37d-323aad1a8440 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:08.665960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d1c775c6-c855-4393-b37d-323aad1a8440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:08.673646 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 881/1767] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:08 2022] POST /identity/v3/users => generated 295 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:08.673646 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5eb2d-6c21-4702-960a-c8bae77a9fc9 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:08.673646 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5eb2d-6c21-4702-960a-c8bae77a9fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:08.673646 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5eb2d-6c21-4702-960a-c8bae77a9fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:08.702893 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-62b5eb2d-6c21-4702-960a-c8bae77a9fc9 None None] MFA Rules not processed for user `e812b0ac9d324dbca0a33779143ad9ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:08.703930 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-62b5eb2d-6c21-4702-960a-c8bae77a9fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:08.724760 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:08.743086 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:08.780857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c775c6-c855-4393-b37d-323aad1a8440 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:08.787387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68675f5c-5e48-44b3-8788-c51aacc83a2b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:08.788301 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68675f5c-5e48-44b3-8788-c51aacc83a2b service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:08.788582 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68675f5c-5e48-44b3-8788-c51aacc83a2b service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:08.788858 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68675f5c-5e48-44b3-8788-c51aacc83a2b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:08.794753 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 882/1768] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:08 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:08.795805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b5eb2d-6c21-4702-960a-c8bae77a9fc9 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:08.827227 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b5eb2d-6c21-4702-960a-c8bae77a9fc9 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:08.834646 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda2a85-10aa-4c78-88c3-117fdddcceb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:08.835331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda2a85-10aa-4c78-88c3-117fdddcceb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:08.835611 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda2a85-10aa-4c78-88c3-117fdddcceb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:08.835887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda2a85-10aa-4c78-88c3-117fdddcceb7 admin admin] PATH_INFO: `/v3/projects/36deaeec637143369701a3dfc7db966f/users/7e4e5cefe5e4492e9e785dc893e64d9f/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:08.838179 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda2a85-10aa-4c78-88c3-117fdddcceb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36deaeec637143369701a3dfc7db966f, user_id=7e4e5cefe5e4492e9e785dc893e64d9f, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:08.844926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda2a85-10aa-4c78-88c3-117fdddcceb7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:08.861331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68675f5c-5e48-44b3-8788-c51aacc83a2b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:08.864217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68675f5c-5e48-44b3-8788-c51aacc83a2b service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:08.870039 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 883/1769] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:08 2022] PUT /identity/v3/projects/36deaeec637143369701a3dfc7db966f/users/7e4e5cefe5e4492e9e785dc893e64d9f/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:08.870667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda2a85-10aa-4c78-88c3-117fdddcceb7 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:08.882683 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 887/1770] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:00:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:00:08.883653 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68675f5c-5e48-44b3-8788-c51aacc83a2b service swift] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:08.929185 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68675f5c-5e48-44b3-8788-c51aacc83a2b service swift] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:09.065178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda2a85-10aa-4c78-88c3-117fdddcceb7 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:09.072875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736ddf9-366d-4017-af65-589f180caa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:09.073567 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736ddf9-366d-4017-af65-589f180caa15 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:09.073849 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736ddf9-366d-4017-af65-589f180caa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:09.074160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736ddf9-366d-4017-af65-589f180caa15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:09.074684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f4266-6105-4fc0-8576-7605d7e85735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:09.074840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b736ddf9-366d-4017-af65-589f180caa15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:09.075519 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f4266-6105-4fc0-8576-7605d7e85735 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:09.075913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f4266-6105-4fc0-8576-7605d7e85735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:09.076425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b736ddf9-366d-4017-af65-589f180caa15 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:09.076688 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f4266-6105-4fc0-8576-7605d7e85735 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:09.077801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f4266-6105-4fc0-8576-7605d7e85735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:09.081478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f4266-6105-4fc0-8576-7605d7e85735 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:09.107881 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 884/1771] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:09.108958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f4266-6105-4fc0-8576-7605d7e85735 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:09.112564 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-812f4266-6105-4fc0-8576-7605d7e85735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:09.133670 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 888/1772] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:09.136044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823963a-68f7-4b77-b9a7-437b594c6285 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:09.136329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823963a-68f7-4b77-b9a7-437b594c6285 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:09.136605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823963a-68f7-4b77-b9a7-437b594c6285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:09.226009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a823963a-68f7-4b77-b9a7-437b594c6285 None None] MFA Rules not processed for user `7e4e5cefe5e4492e9e785dc893e64d9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:09.227327 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a823963a-68f7-4b77-b9a7-437b594c6285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:09.272714 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f4266-6105-4fc0-8576-7605d7e85735 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:09.297749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221eab3-3a89-4aeb-b93e-a652585bd1cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:09.299584 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221eab3-3a89-4aeb-b93e-a652585bd1cb service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:09.299877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221eab3-3a89-4aeb-b93e-a652585bd1cb service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:09.300157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221eab3-3a89-4aeb-b93e-a652585bd1cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:09.339332 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:09.391577 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 889/1773] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:09 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:09.393273 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19417022-a874-412b-aecc-290e6e2c032e None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:09.393921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19417022-a874-412b-aecc-290e6e2c032e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:09.394252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19417022-a874-412b-aecc-290e6e2c032e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:09.466977 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:09.499043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-19417022-a874-412b-aecc-290e6e2c032e None None] MFA Rules not processed for user `2cdde7a212954a01a2591ad5ac30d049`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:09.500637 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-19417022-a874-412b-aecc-290e6e2c032e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:09.517787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221eab3-3a89-4aeb-b93e-a652585bd1cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:09.519594 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221eab3-3a89-4aeb-b93e-a652585bd1cb service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:09.545896 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 885/1774] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:09 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:09.546814 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221eab3-3a89-4aeb-b93e-a652585bd1cb service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:09.578562 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221eab3-3a89-4aeb-b93e-a652585bd1cb service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:09.609298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f862d92-6255-45f5-a4aa-755780837e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:09.610071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f862d92-6255-45f5-a4aa-755780837e1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:09.610624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f862d92-6255-45f5-a4aa-755780837e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:09.610763 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 890/1775] 10.222.0.39 () {58 vars in 1015 bytes} [Sun Sep 4 01:00:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:09.610950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f862d92-6255-45f5-a4aa-755780837e1a admin admin] PATH_INFO: `/v3/projects/511d2111500e4050a488a8bb6d688109/users/c0dfe5b82e7045d19b82685fab4290cd/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:09.612323 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19417022-a874-412b-aecc-290e6e2c032e None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:09.626948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19417022-a874-412b-aecc-290e6e2c032e None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:09.634246 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc61af0-495d-418b-8f9b-02bf7abe04f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:09.635017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc61af0-495d-418b-8f9b-02bf7abe04f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:09.635353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc61af0-495d-418b-8f9b-02bf7abe04f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:09.635627 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc61af0-495d-418b-8f9b-02bf7abe04f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:09.636283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc61af0-495d-418b-8f9b-02bf7abe04f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:09.638198 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc61af0-495d-418b-8f9b-02bf7abe04f5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:09.643489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f862d92-6255-45f5-a4aa-755780837e1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=511d2111500e4050a488a8bb6d688109, user_id=c0dfe5b82e7045d19b82685fab4290cd, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:09.646323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f862d92-6255-45f5-a4aa-755780837e1a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:09.655875 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 891/1776] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:09.655875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc61af0-495d-418b-8f9b-02bf7abe04f5 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:09.676443 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc61af0-495d-418b-8f9b-02bf7abe04f5 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:09.683200 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 886/1777] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:09 2022] PUT /identity/v3/projects/511d2111500e4050a488a8bb6d688109/users/c0dfe5b82e7045d19b82685fab4290cd/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:09.684198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f862d92-6255-45f5-a4aa-755780837e1a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:09.816495 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d47f15-28d7-47a3-8061-55dfe74cf750 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:09.819507 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d47f15-28d7-47a3-8061-55dfe74cf750 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:09.820834 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d47f15-28d7-47a3-8061-55dfe74cf750 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:09.822098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d47f15-28d7-47a3-8061-55dfe74cf750 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:09.859005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f862d92-6255-45f5-a4aa-755780837e1a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:09.892560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4463f-8646-40e9-afd6-a4d88d55e3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:09.893664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4463f-8646-40e9-afd6-a4d88d55e3e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:09.894127 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4463f-8646-40e9-afd6-a4d88d55e3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:09.895636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4463f-8646-40e9-afd6-a4d88d55e3e6 admin admin] PATH_INFO: `/v3/projects/c7f217d13bce4e479bd6470f5579a6a0/users/b30f2499eadd460f86a81a4a167f77bf/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:09.931077 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4463f-8646-40e9-afd6-a4d88d55e3e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7f217d13bce4e479bd6470f5579a6a0, user_id=b30f2499eadd460f86a81a4a167f77bf, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:09.935020 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4463f-8646-40e9-afd6-a4d88d55e3e6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:09.967064 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 887/1778] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:09 2022] PUT /identity/v3/projects/c7f217d13bce4e479bd6470f5579a6a0/users/b30f2499eadd460f86a81a4a167f77bf/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:09.968181 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4463f-8646-40e9-afd6-a4d88d55e3e6 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:09.978285 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d5f4463f-8646-40e9-afd6-a4d88d55e3e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:09.986810 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d47f15-28d7-47a3-8061-55dfe74cf750 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:09.988543 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d47f15-28d7-47a3-8061-55dfe74cf750 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:10.008863 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 892/1779] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:10.011809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a786c-c099-4ae7-8689-ec76da2eb969 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:10.012309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a786c-c099-4ae7-8689-ec76da2eb969 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:10.013950 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a786c-c099-4ae7-8689-ec76da2eb969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:10.059577 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:10.096197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-926a786c-c099-4ae7-8689-ec76da2eb969 None None] MFA Rules not processed for user `c0dfe5b82e7045d19b82685fab4290cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:10.097866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-926a786c-c099-4ae7-8689-ec76da2eb969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:10.133781 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4463f-8646-40e9-afd6-a4d88d55e3e6 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:10.137927 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc729dc-486d-4a01-977c-220c4f050e7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:10.138553 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc729dc-486d-4a01-977c-220c4f050e7f service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:10.138841 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc729dc-486d-4a01-977c-220c4f050e7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:10.139114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc729dc-486d-4a01-977c-220c4f050e7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:10.147814 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc729dc-486d-4a01-977c-220c4f050e7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:10.149258 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc729dc-486d-4a01-977c-220c4f050e7f service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:10.182754 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 888/1780] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:10.183669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc729dc-486d-4a01-977c-220c4f050e7f service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:10.189023 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0bc729dc-486d-4a01-977c-220c4f050e7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:10.223729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc729dc-486d-4a01-977c-220c4f050e7f service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:10.230926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c6a03-84f1-45ae-a6de-b7aececbdd2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:10.231184 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 893/1781] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:10.231786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c6a03-84f1-45ae-a6de-b7aececbdd2a service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:10.232165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c6a03-84f1-45ae-a6de-b7aececbdd2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:10.232522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c6a03-84f1-45ae-a6de-b7aececbdd2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:10.233617 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434cc0f2-6527-41e9-b06a-0b5973177d00 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:10.235908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434cc0f2-6527-41e9-b06a-0b5973177d00 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:10.236323 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434cc0f2-6527-41e9-b06a-0b5973177d00 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:10.241548 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 894/1782] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:00:10 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:00:10.243127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c776aee-6246-42ac-9050-6a04e1d1345d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:10.243531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c776aee-6246-42ac-9050-6a04e1d1345d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:10.243913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c776aee-6246-42ac-9050-6a04e1d1345d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:10.249409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c6a03-84f1-45ae-a6de-b7aececbdd2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:10.251017 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c6a03-84f1-45ae-a6de-b7aececbdd2a service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:10.276964 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 889/1783] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:10.278203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c6a03-84f1-45ae-a6de-b7aececbdd2a service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:10.343821 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:10.362697 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-4c776aee-6246-42ac-9050-6a04e1d1345d None None] MFA Rules not processed for user `b30f2499eadd460f86a81a4a167f77bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:10.374139 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4c776aee-6246-42ac-9050-6a04e1d1345d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:10.415925 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c6a03-84f1-45ae-a6de-b7aececbdd2a service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:10.426455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c38f1-32e6-487d-8479-a4aa0f2092db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:10.427090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c38f1-32e6-487d-8479-a4aa0f2092db admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:10.427440 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c38f1-32e6-487d-8479-a4aa0f2092db admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:10.428334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c38f1-32e6-487d-8479-a4aa0f2092db admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:10.429274 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c38f1-32e6-487d-8479-a4aa0f2092db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:10.435548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c38f1-32e6-487d-8479-a4aa0f2092db admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:10.504890 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 890/1784] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:00:10 2022] POST /identity/v3/projects => generated 385 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:10.507297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c38f1-32e6-487d-8479-a4aa0f2092db admin admin] Authenticating service token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:00:10.513262 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a44c38f1-32e6-487d-8479-a4aa0f2092db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:10.589248 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 895/1785] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:10.591146 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c776aee-6246-42ac-9050-6a04e1d1345d None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:10.608311 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c776aee-6246-42ac-9050-6a04e1d1345d None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:10.718942 n-d-master-1 devstack@keystone.service[81825]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-a44c38f1-32e6-487d-8479-a4aa0f2092db admin admin] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Sep 04 01:00:10.719521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c38f1-32e6-487d-8479-a4aa0f2092db admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:10.804198 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3dfc5c-9a79-4585-85b8-307d42b7894a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:10.805084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3dfc5c-9a79-4585-85b8-307d42b7894a admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:10.805390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3dfc5c-9a79-4585-85b8-307d42b7894a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:10.805773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3dfc5c-9a79-4585-85b8-307d42b7894a admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:10.812718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3dfc5c-9a79-4585-85b8-307d42b7894a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:10.814979 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3dfc5c-9a79-4585-85b8-307d42b7894a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:10.859601 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 896/1786] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:10 2022] POST /identity/v3/users => generated 299 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:10.859601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3dfc5c-9a79-4585-85b8-307d42b7894a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:10.881483 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3dfc5c-9a79-4585-85b8-307d42b7894a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:10.889296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c38f1-32e6-487d-8479-a4aa0f2092db admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:10.899750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751676ca-bd4a-492e-b54a-3f78c5118b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:10.900855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751676ca-bd4a-492e-b54a-3f78c5118b84 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:10.901457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751676ca-bd4a-492e-b54a-3f78c5118b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:10.902103 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751676ca-bd4a-492e-b54a-3f78c5118b84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:10.907356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be40a0a-d32e-48db-a8a1-41db1ce3d2cf tempest-FlavorsAccessTestJSON-1195186805 tempest-FlavorsAccessTestJSON-1195186805-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e812b0ac9d324dbca0a33779143ad9ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306c60d17cc54dc58d96340290905a95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:10.907579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751676ca-bd4a-492e-b54a-3f78c5118b84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:10.908114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be40a0a-d32e-48db-a8a1-41db1ce3d2cf tempest-FlavorsAccessTestJSON-1195186805 tempest-FlavorsAccessTestJSON-1195186805-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:10.908635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be40a0a-d32e-48db-a8a1-41db1ce3d2cf tempest-FlavorsAccessTestJSON-1195186805 tempest-FlavorsAccessTestJSON-1195186805-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:10.909636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751676ca-bd4a-492e-b54a-3f78c5118b84 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:10.912858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be40a0a-d32e-48db-a8a1-41db1ce3d2cf tempest-FlavorsAccessTestJSON-1195186805 tempest-FlavorsAccessTestJSON-1195186805-project-admin] PATH_INFO: `/v3/projects/f4b042cc50124c9a87dd2b2afaeb8fba` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:10.916621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be40a0a-d32e-48db-a8a1-41db1ce3d2cf tempest-FlavorsAccessTestJSON-1195186805 tempest-FlavorsAccessTestJSON-1195186805-project-admin] RBAC: Authorizing `identity:get_project(project_id=f4b042cc50124c9a87dd2b2afaeb8fba)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:10.920391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be40a0a-d32e-48db-a8a1-41db1ce3d2cf tempest-FlavorsAccessTestJSON-1195186805 tempest-FlavorsAccessTestJSON-1195186805-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:10.922528 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 891/1787] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:00:10 2022] GET /identity/v3/projects/f4b042cc50124c9a87dd2b2afaeb8fba => generated 377 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:00:10.923471 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be40a0a-d32e-48db-a8a1-41db1ce3d2cf tempest-FlavorsAccessTestJSON-1195186805 tempest-FlavorsAccessTestJSON-1195186805-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:10.939354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be40a0a-d32e-48db-a8a1-41db1ce3d2cf tempest-FlavorsAccessTestJSON-1195186805 tempest-FlavorsAccessTestJSON-1195186805-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:10.946637 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e052dd-a4d5-4b96-b63b-2acf707d425d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:10.956259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e052dd-a4d5-4b96-b63b-2acf707d425d admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:10.956612 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e052dd-a4d5-4b96-b63b-2acf707d425d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:10.956988 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e052dd-a4d5-4b96-b63b-2acf707d425d admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:10.957723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e052dd-a4d5-4b96-b63b-2acf707d425d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:10.960479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e052dd-a4d5-4b96-b63b-2acf707d425d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:10.973051 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:10.982395 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 892/1788] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:10.987922 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e052dd-a4d5-4b96-b63b-2acf707d425d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:11.004593 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 897/1789] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:00:10 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:11.008806 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751676ca-bd4a-492e-b54a-3f78c5118b84 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:11.022354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e052dd-a4d5-4b96-b63b-2acf707d425d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:11.129178 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:11.153293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751676ca-bd4a-492e-b54a-3f78c5118b84 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:11.162835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e3cbc-49ce-44ef-9f9e-22a753ecfacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:11.163677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e3cbc-49ce-44ef-9f9e-22a753ecfacf admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:11.164062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e3cbc-49ce-44ef-9f9e-22a753ecfacf admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:11.164435 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e3cbc-49ce-44ef-9f9e-22a753ecfacf admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:11.165205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21e3cbc-49ce-44ef-9f9e-22a753ecfacf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:11.167354 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21e3cbc-49ce-44ef-9f9e-22a753ecfacf admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:11.209990 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc3241-d52c-4f44-a565-57d45b1262fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:11.210610 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 898/1790] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:11 2022] POST /identity/v3/users => generated 299 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:11.210794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc3241-d52c-4f44-a565-57d45b1262fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:11.211032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc3241-d52c-4f44-a565-57d45b1262fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:11.211312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc3241-d52c-4f44-a565-57d45b1262fd admin admin] PATH_INFO: `/v3/projects/83d634f78d3147cfb1c72d41dd3eecef/users/90ded921a9374e01b10a67cb23898f52/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:11.214817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e3cbc-49ce-44ef-9f9e-22a753ecfacf admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:11.239503 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e3cbc-49ce-44ef-9f9e-22a753ecfacf admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:11.242106 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc3241-d52c-4f44-a565-57d45b1262fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=83d634f78d3147cfb1c72d41dd3eecef, user_id=90ded921a9374e01b10a67cb23898f52, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:11.253336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1eb2e-6c8a-4b89-a07a-5cb0fed824ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:11.254093 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1eb2e-6c8a-4b89-a07a-5cb0fed824ea admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:11.254535 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1eb2e-6c8a-4b89-a07a-5cb0fed824ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:11.254856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1eb2e-6c8a-4b89-a07a-5cb0fed824ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:11.256314 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e1eb2e-6c8a-4b89-a07a-5cb0fed824ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:11.258097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e1eb2e-6c8a-4b89-a07a-5cb0fed824ea admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:11.263298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc3241-d52c-4f44-a565-57d45b1262fd admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:11.273290 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 899/1791] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:11.274654 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1eb2e-6c8a-4b89-a07a-5cb0fed824ea admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:11.288519 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1eb2e-6c8a-4b89-a07a-5cb0fed824ea admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:11.294570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958d48f-2f76-458d-b6ea-f7b641bafabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:11.295485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958d48f-2f76-458d-b6ea-f7b641bafabf admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:11.295850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958d48f-2f76-458d-b6ea-f7b641bafabf admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:11.296311 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958d48f-2f76-458d-b6ea-f7b641bafabf admin admin] PATH_INFO: `/v3/projects/55ba94522c1c4c8f967e1e4b88d3c012/users/21f11571add14b3696ee32a215ca63db/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:11.311695 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 893/1792] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:10 2022] PUT /identity/v3/projects/83d634f78d3147cfb1c72d41dd3eecef/users/90ded921a9374e01b10a67cb23898f52/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:11.319241 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc3241-d52c-4f44-a565-57d45b1262fd admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:11.325390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3958d48f-2f76-458d-b6ea-f7b641bafabf admin admin] RBAC: Authorizing `identity:create_grant(project_id=55ba94522c1c4c8f967e1e4b88d3c012, user_id=21f11571add14b3696ee32a215ca63db, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:11.339042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3958d48f-2f76-458d-b6ea-f7b641bafabf admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:11.373602 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 900/1793] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:11 2022] PUT /identity/v3/projects/55ba94522c1c4c8f967e1e4b88d3c012/users/21f11571add14b3696ee32a215ca63db/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:11.373602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958d48f-2f76-458d-b6ea-f7b641bafabf admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:11.540012 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc3241-d52c-4f44-a565-57d45b1262fd admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:11.556258 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958d48f-2f76-458d-b6ea-f7b641bafabf admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:11.570084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1cc362-24fa-47ba-9634-40e3a57101d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:11.570896 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cc362-24fa-47ba-9634-40e3a57101d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:11.571262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cc362-24fa-47ba-9634-40e3a57101d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:11.571523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cc362-24fa-47ba-9634-40e3a57101d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:11.572290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1cc362-24fa-47ba-9634-40e3a57101d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:11.581154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1cc362-24fa-47ba-9634-40e3a57101d3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:11.605993 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 901/1794] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:11.607618 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1cc362-24fa-47ba-9634-40e3a57101d3 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:11.634805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1cc362-24fa-47ba-9634-40e3a57101d3 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:11.647371 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a3928-67f7-4be7-b83d-5314c911fee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:11.648351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a3928-67f7-4be7-b83d-5314c911fee8 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:11.648888 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a3928-67f7-4be7-b83d-5314c911fee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:11.649615 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a3928-67f7-4be7-b83d-5314c911fee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:11.650629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a3928-67f7-4be7-b83d-5314c911fee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:11.653904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a3928-67f7-4be7-b83d-5314c911fee8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:11.691740 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 902/1795] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:11.697085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a3928-67f7-4be7-b83d-5314c911fee8 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:11.719082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a3928-67f7-4be7-b83d-5314c911fee8 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:11.733617 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e5291-8628-4db9-a85d-6086a59f8ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:11.734680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e5291-8628-4db9-a85d-6086a59f8ef9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:11.735505 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e5291-8628-4db9-a85d-6086a59f8ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:11.736742 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e5291-8628-4db9-a85d-6086a59f8ef9 admin admin] PATH_INFO: `/v3/projects/83d634f78d3147cfb1c72d41dd3eecef/users/90ded921a9374e01b10a67cb23898f52/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:11.740478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e5291-8628-4db9-a85d-6086a59f8ef9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83d634f78d3147cfb1c72d41dd3eecef, user_id=90ded921a9374e01b10a67cb23898f52, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:11.750441 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e5291-8628-4db9-a85d-6086a59f8ef9 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:11.781734 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 903/1796] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:11 2022] PUT /identity/v3/projects/83d634f78d3147cfb1c72d41dd3eecef/users/90ded921a9374e01b10a67cb23898f52/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:11.783057 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e5291-8628-4db9-a85d-6086a59f8ef9 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:11.792676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5299f-c574-4502-a9fa-44f93b4f8f7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:11.793409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5299f-c574-4502-a9fa-44f93b4f8f7c service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:11.793724 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5299f-c574-4502-a9fa-44f93b4f8f7c service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:11.794003 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5299f-c574-4502-a9fa-44f93b4f8f7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:11.805646 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2bc5299f-c574-4502-a9fa-44f93b4f8f7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:11.832153 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:11.951587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e5291-8628-4db9-a85d-6086a59f8ef9 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:11.959483 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d09074-a5dc-4eb6-b7d7-2b4cbeed13c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:11.960177 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d09074-a5dc-4eb6-b7d7-2b4cbeed13c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:11.960462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d09074-a5dc-4eb6-b7d7-2b4cbeed13c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:11.973110 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d09074-a5dc-4eb6-b7d7-2b4cbeed13c2 admin admin] PATH_INFO: `/v3/projects/55ba94522c1c4c8f967e1e4b88d3c012/users/21f11571add14b3696ee32a215ca63db/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:11.976604 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d09074-a5dc-4eb6-b7d7-2b4cbeed13c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55ba94522c1c4c8f967e1e4b88d3c012, user_id=21f11571add14b3696ee32a215ca63db, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:11.979373 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d09074-a5dc-4eb6-b7d7-2b4cbeed13c2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:11.981979 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:11.989863 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5299f-c574-4502-a9fa-44f93b4f8f7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:12.001781 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 904/1797] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:11 2022] PUT /identity/v3/projects/55ba94522c1c4c8f967e1e4b88d3c012/users/21f11571add14b3696ee32a215ca63db/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:12.005235 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c365fe-2f29-410e-bf9a-448673e1fb7b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:12.006750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c365fe-2f29-410e-bf9a-448673e1fb7b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:12.007615 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c365fe-2f29-410e-bf9a-448673e1fb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:12.012305 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5299f-c574-4502-a9fa-44f93b4f8f7c service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:12.029630 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 894/1798] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 717 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:12.030945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81004752-2577-481f-863e-581d3fceb118 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:12.031250 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81004752-2577-481f-863e-581d3fceb118 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:12.031512 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81004752-2577-481f-863e-581d3fceb118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:12.078306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-f0c365fe-2f29-410e-bf9a-448673e1fb7b None None] MFA Rules not processed for user `90ded921a9374e01b10a67cb23898f52`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:12.080862 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f0c365fe-2f29-410e-bf9a-448673e1fb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:12.110984 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-81004752-2577-481f-863e-581d3fceb118 None None] MFA Rules not processed for user `21f11571add14b3696ee32a215ca63db`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:12.110984 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-81004752-2577-481f-863e-581d3fceb118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:12.286226 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 905/1799] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:12.286226 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c365fe-2f29-410e-bf9a-448673e1fb7b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:12.476661 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 895/1800] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:12.476873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c365fe-2f29-410e-bf9a-448673e1fb7b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:12.477037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651feef-c3ce-4b1b-a9a9-e7d65b128721 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:12.477037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651feef-c3ce-4b1b-a9a9-e7d65b128721 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:12.477037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651feef-c3ce-4b1b-a9a9-e7d65b128721 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:12.477037 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 896/1801] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:00:12.477866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33a871-4ecd-403c-9ff5-1fc18e34e5c3 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:12.486906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33a871-4ecd-403c-9ff5-1fc18e34e5c3 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:12.487295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33a871-4ecd-403c-9ff5-1fc18e34e5c3 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:12.494704 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1006c-21ee-4e7f-96f8-75bc7cadccc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:12.495459 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1006c-21ee-4e7f-96f8-75bc7cadccc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:12.495775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1006c-21ee-4e7f-96f8-75bc7cadccc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:12.496042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1006c-21ee-4e7f-96f8-75bc7cadccc4 admin admin] PATH_INFO: `/v3/users/e92e26cb9ad74e3a9a0ea27ea1aeeb2f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:12.497666 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1006c-21ee-4e7f-96f8-75bc7cadccc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e92e26cb9ad74e3a9a0ea27ea1aeeb2f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:12.497903 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 897/1802] 10.222.0.30 () {54 vars in 921 bytes} [Sun Sep 4 01:00:12 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:00:12.499135 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7090d91-65d9-49b4-8cb3-8ae278bd24e2 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:12.499423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7090d91-65d9-49b4-8cb3-8ae278bd24e2 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:12.499698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7090d91-65d9-49b4-8cb3-8ae278bd24e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:12.500319 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1006c-21ee-4e7f-96f8-75bc7cadccc4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:12.572081 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b7090d91-65d9-49b4-8cb3-8ae278bd24e2 None None] MFA Rules not processed for user `c0dfe5b82e7045d19b82685fab4290cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:12.573326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b7090d91-65d9-49b4-8cb3-8ae278bd24e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:12.679614 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:12.703887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c6f1006c-21ee-4e7f-96f8-75bc7cadccc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e92e26cb9ad74e3a9a0ea27ea1aeeb2f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:12.706211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c6f1006c-21ee-4e7f-96f8-75bc7cadccc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e92e26cb9ad74e3a9a0ea27ea1aeeb2f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:12.744588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c6f1006c-21ee-4e7f-96f8-75bc7cadccc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e92e26cb9ad74e3a9a0ea27ea1aeeb2f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:12.757825 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c6f1006c-21ee-4e7f-96f8-75bc7cadccc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e92e26cb9ad74e3a9a0ea27ea1aeeb2f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:12.758794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c6f1006c-21ee-4e7f-96f8-75bc7cadccc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e92e26cb9ad74e3a9a0ea27ea1aeeb2f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:12.766141 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 898/1803] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:12.767944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7090d91-65d9-49b4-8cb3-8ae278bd24e2 None None] Authenticating service token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:00:12.772129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b7090d91-65d9-49b4-8cb3-8ae278bd24e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:12.807214 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 906/1804] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:00:12 2022] DELETE /identity/v3/users/e92e26cb9ad74e3a9a0ea27ea1aeeb2f => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:12.807214 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af91e4-33f1-4e86-b902-45e5da4ea890 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:12.808591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af91e4-33f1-4e86-b902-45e5da4ea890 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:12.809383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af91e4-33f1-4e86-b902-45e5da4ea890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:12.859796 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-34af91e4-33f1-4e86-b902-45e5da4ea890 None None] MFA Rules not processed for user `13f0f341bf2c475d82b4e7b34d503dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:12.861553 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-34af91e4-33f1-4e86-b902-45e5da4ea890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:12.933896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7090d91-65d9-49b4-8cb3-8ae278bd24e2 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:12.936294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b7090d91-65d9-49b4-8cb3-8ae278bd24e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:12.980122 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:12.998839 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 907/1805] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Sep 4 01:00:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:13.000192 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349e535-4560-4f01-8330-337da60ba34f None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:13.000480 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349e535-4560-4f01-8330-337da60ba34f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:13.000819 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349e535-4560-4f01-8330-337da60ba34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:13.030463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-1349e535-4560-4f01-8330-337da60ba34f None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:13.032545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1349e535-4560-4f01-8330-337da60ba34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:13.100023 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7090d91-65d9-49b4-8cb3-8ae278bd24e2 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:13.173015 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 908/1806] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:13.174065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349e535-4560-4f01-8330-337da60ba34f None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:13.183673 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1349e535-4560-4f01-8330-337da60ba34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:13.188149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff3feb-1744-4745-9dbe-8068fcbef584 tempest-FlavorsAccessTestJSON-1195186805 tempest-FlavorsAccessTestJSON-1195186805-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e812b0ac9d324dbca0a33779143ad9ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306c60d17cc54dc58d96340290905a95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:13.189623 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff3feb-1744-4745-9dbe-8068fcbef584 tempest-FlavorsAccessTestJSON-1195186805 tempest-FlavorsAccessTestJSON-1195186805-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:13.190207 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff3feb-1744-4745-9dbe-8068fcbef584 tempest-FlavorsAccessTestJSON-1195186805 tempest-FlavorsAccessTestJSON-1195186805-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:13.190664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff3feb-1744-4745-9dbe-8068fcbef584 tempest-FlavorsAccessTestJSON-1195186805 tempest-FlavorsAccessTestJSON-1195186805-project-admin] PATH_INFO: `/v3/projects/f4b042cc50124c9a87dd2b2afaeb8fba` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:13.192000 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff3feb-1744-4745-9dbe-8068fcbef584 tempest-FlavorsAccessTestJSON-1195186805 tempest-FlavorsAccessTestJSON-1195186805-project-admin] RBAC: Authorizing `identity:get_project(project_id=f4b042cc50124c9a87dd2b2afaeb8fba)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:13.214163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349e535-4560-4f01-8330-337da60ba34f None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:13.219041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff3feb-1744-4745-9dbe-8068fcbef584 tempest-FlavorsAccessTestJSON-1195186805 tempest-FlavorsAccessTestJSON-1195186805-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:13.222311 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 899/1807] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:00:12 2022] GET /identity/v3/projects/f4b042cc50124c9a87dd2b2afaeb8fba => generated 377 bytes in 455 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:00:13.226118 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02561875-5624-4d1d-ae3d-dddb2af5919c None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:13.226591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02561875-5624-4d1d-ae3d-dddb2af5919c None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:13.227012 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02561875-5624-4d1d-ae3d-dddb2af5919c None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:13.229417 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 900/1808] 10.222.0.30 () {54 vars in 921 bytes} [Sun Sep 4 01:00:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:00:13.230505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02561875-5624-4d1d-ae3d-dddb2af5919c None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:13.231682 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c5ef9-967a-4ae8-b7e3-aa4723473b74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:13.232749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c5ef9-967a-4ae8-b7e3-aa4723473b74 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:13.232749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c5ef9-967a-4ae8-b7e3-aa4723473b74 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:13.232954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c5ef9-967a-4ae8-b7e3-aa4723473b74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:13.234471 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-02561875-5624-4d1d-ae3d-dddb2af5919c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:13.239548 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4d7c5ef9-967a-4ae8-b7e3-aa4723473b74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:13.345089 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:13.349127 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02561875-5624-4d1d-ae3d-dddb2af5919c None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:13.356508 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164bdcc-5d3a-4f91-9202-8e06da1334ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:13.357087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164bdcc-5d3a-4f91-9202-8e06da1334ad service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:13.357369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164bdcc-5d3a-4f91-9202-8e06da1334ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:13.357673 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164bdcc-5d3a-4f91-9202-8e06da1334ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:13.379912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8164bdcc-5d3a-4f91-9202-8e06da1334ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:13.381478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8164bdcc-5d3a-4f91-9202-8e06da1334ad service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:13.382405 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c5ef9-967a-4ae8-b7e3-aa4723473b74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:13.389286 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c5ef9-967a-4ae8-b7e3-aa4723473b74 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:13.397238 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 901/1809] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:13.398571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dd9f3-49ad-4998-b1da-eed3a5465172 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:13.398863 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dd9f3-49ad-4998-b1da-eed3a5465172 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:13.399123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dd9f3-49ad-4998-b1da-eed3a5465172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:13.418070 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 909/1810] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:13 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:13.419294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c5ef9-967a-4ae8-b7e3-aa4723473b74 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:13.434280 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c5ef9-967a-4ae8-b7e3-aa4723473b74 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:13.446994 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8ef65-790e-49d7-9113-168673a5e156 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:13.453261 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8ef65-790e-49d7-9113-168673a5e156 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:13.453623 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-803dd9f3-49ad-4998-b1da-eed3a5465172 None None] MFA Rules not processed for user `13f0f341bf2c475d82b4e7b34d503dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:13.454155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8ef65-790e-49d7-9113-168673a5e156 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:13.454542 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8ef65-790e-49d7-9113-168673a5e156 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:13.455274 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-803dd9f3-49ad-4998-b1da-eed3a5465172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:13.456875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ebd8ef65-790e-49d7-9113-168673a5e156 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:13.482159 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 902/1811] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Sep 4 01:00:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:13.571800 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8ef65-790e-49d7-9113-168673a5e156 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:13.573753 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8ef65-790e-49d7-9113-168673a5e156 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:13.600912 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 910/1812] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:13 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:13.955240 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803dd9f3-49ad-4998-b1da-eed3a5465172 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:13.998746 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803dd9f3-49ad-4998-b1da-eed3a5465172 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:14.028990 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03007b-3eb0-46d3-8289-b6e7d85e6d7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:14.030420 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03007b-3eb0-46d3-8289-b6e7d85e6d7a service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:14.030800 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03007b-3eb0-46d3-8289-b6e7d85e6d7a service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:14.031213 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03007b-3eb0-46d3-8289-b6e7d85e6d7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:14.072532 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03007b-3eb0-46d3-8289-b6e7d85e6d7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:14.074276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03007b-3eb0-46d3-8289-b6e7d85e6d7a service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:14.103080 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 903/1813] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:14.168561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8ef65-790e-49d7-9113-168673a5e156 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:14.170205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ebd8ef65-790e-49d7-9113-168673a5e156 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:14.220814 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03007b-3eb0-46d3-8289-b6e7d85e6d7a service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:14.223324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8ef65-790e-49d7-9113-168673a5e156 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:14.231527 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21dae65-4a1d-417e-bbd7-a445720956c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:14.232232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dae65-4a1d-417e-bbd7-a445720956c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:14.232487 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dae65-4a1d-417e-bbd7-a445720956c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:14.232739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dae65-4a1d-417e-bbd7-a445720956c6 admin admin] PATH_INFO: `/v3/projects/7c0d4a8d7c90471081b5a4c948ac2391` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:14.233919 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21dae65-4a1d-417e-bbd7-a445720956c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c0d4a8d7c90471081b5a4c948ac2391)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:14.235001 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03007b-3eb0-46d3-8289-b6e7d85e6d7a service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:14.237003 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21dae65-4a1d-417e-bbd7-a445720956c6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:14.241990 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c8434-eea3-45fa-9350-94ae27973718 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:14.242615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c8434-eea3-45fa-9350-94ae27973718 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:14.242941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c8434-eea3-45fa-9350-94ae27973718 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:14.243159 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c8434-eea3-45fa-9350-94ae27973718 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:14.272092 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c8434-eea3-45fa-9350-94ae27973718 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:14.273958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c8434-eea3-45fa-9350-94ae27973718 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:14.316634 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 904/1814] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:14.321161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c8434-eea3-45fa-9350-94ae27973718 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:14.338315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c21dae65-4a1d-417e-bbd7-a445720956c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c0d4a8d7c90471081b5a4c948ac2391', 'request_id': 'req-c21dae65-4a1d-417e-bbd7-a445720956c6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:14.342690 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c8434-eea3-45fa-9350-94ae27973718 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:14.348818 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c21dae65-4a1d-417e-bbd7-a445720956c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c0d4a8d7c90471081b5a4c948ac2391', 'request_id': 'req-c21dae65-4a1d-417e-bbd7-a445720956c6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:14.358195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c21dae65-4a1d-417e-bbd7-a445720956c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c0d4a8d7c90471081b5a4c948ac2391', 'request_id': 'req-c21dae65-4a1d-417e-bbd7-a445720956c6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:14.377184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c21dae65-4a1d-417e-bbd7-a445720956c6 admin admin] The token cache is being invalidate because project 7c0d4a8d7c90471081b5a4c948ac2391 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:14.377578 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c21dae65-4a1d-417e-bbd7-a445720956c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:14.378384 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c21dae65-4a1d-417e-bbd7-a445720956c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:14.384622 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 911/1815] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:14 2022] DELETE /identity/v3/projects/7c0d4a8d7c90471081b5a4c948ac2391 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:14.385641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21dae65-4a1d-417e-bbd7-a445720956c6 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:14.387354 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c21dae65-4a1d-417e-bbd7-a445720956c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:14.421171 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:14.492217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21dae65-4a1d-417e-bbd7-a445720956c6 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:14.497887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65d994-4fba-481c-b104-f6a830163ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:14.498540 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65d994-4fba-481c-b104-f6a830163ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:14.498761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655f0bc-d638-4861-9859-64529573f5d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:14.498885 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65d994-4fba-481c-b104-f6a830163ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:14.499331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65d994-4fba-481c-b104-f6a830163ff6 admin admin] PATH_INFO: `/v3/users/7e4e5cefe5e4492e9e785dc893e64d9f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:14.499442 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655f0bc-d638-4861-9859-64529573f5d8 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:14.499681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655f0bc-d638-4861-9859-64529573f5d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:14.500056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655f0bc-d638-4861-9859-64529573f5d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:14.500438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65d994-4fba-481c-b104-f6a830163ff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e4e5cefe5e4492e9e785dc893e64d9f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:14.502702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65d994-4fba-481c-b104-f6a830163ff6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:14.507189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7655f0bc-d638-4861-9859-64529573f5d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:14.509993 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:14.621503 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8f65d994-4fba-481c-b104-f6a830163ff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e4e5cefe5e4492e9e785dc893e64d9f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:14.625665 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8f65d994-4fba-481c-b104-f6a830163ff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e4e5cefe5e4492e9e785dc893e64d9f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:14.646024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8f65d994-4fba-481c-b104-f6a830163ff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e4e5cefe5e4492e9e785dc893e64d9f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:14.682290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8f65d994-4fba-481c-b104-f6a830163ff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e4e5cefe5e4492e9e785dc893e64d9f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:14.683035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8f65d994-4fba-481c-b104-f6a830163ff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e4e5cefe5e4492e9e785dc893e64d9f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:14.729300 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 912/1816] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:00:14 2022] DELETE /identity/v3/users/7e4e5cefe5e4492e9e785dc893e64d9f => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:14.755897 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655f0bc-d638-4861-9859-64529573f5d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:14.768762 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655f0bc-d638-4861-9859-64529573f5d8 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:14.807617 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 905/1817] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:14 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:15.414972 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65d994-4fba-481c-b104-f6a830163ff6 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:15.417089 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8f65d994-4fba-481c-b104-f6a830163ff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:15.575249 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65d994-4fba-481c-b104-f6a830163ff6 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:15.586927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a0aa3-a59b-4280-b6ad-549ee7f7bd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:15.587680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a0aa3-a59b-4280-b6ad-549ee7f7bd8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:15.588033 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a0aa3-a59b-4280-b6ad-549ee7f7bd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:15.588391 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a0aa3-a59b-4280-b6ad-549ee7f7bd8a admin admin] PATH_INFO: `/v3/users/734a6025b8c84c3d9f7eec77e8fad5f6` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:15.590405 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a0aa3-a59b-4280-b6ad-549ee7f7bd8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=734a6025b8c84c3d9f7eec77e8fad5f6)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:15.594145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a0aa3-a59b-4280-b6ad-549ee7f7bd8a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:15.737067 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655f0bc-d638-4861-9859-64529573f5d8 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:15.738895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7655f0bc-d638-4861-9859-64529573f5d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:15.797104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655f0bc-d638-4861-9859-64529573f5d8 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:15.800200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-993a0aa3-a59b-4280-b6ad-549ee7f7bd8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '734a6025b8c84c3d9f7eec77e8fad5f6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:15.801149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-993a0aa3-a59b-4280-b6ad-549ee7f7bd8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '734a6025b8c84c3d9f7eec77e8fad5f6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:15.826737 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-993a0aa3-a59b-4280-b6ad-549ee7f7bd8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '734a6025b8c84c3d9f7eec77e8fad5f6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:15.827221 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b69253-8185-4e99-ba0a-b418a5d5e349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:15.827221 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b69253-8185-4e99-ba0a-b418a5d5e349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:15.827221 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b69253-8185-4e99-ba0a-b418a5d5e349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:15.827221 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b69253-8185-4e99-ba0a-b418a5d5e349 admin admin] PATH_INFO: `/v3/users/b30f2499eadd460f86a81a4a167f77bf` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:15.827947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b69253-8185-4e99-ba0a-b418a5d5e349 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b30f2499eadd460f86a81a4a167f77bf)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:15.833754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b69253-8185-4e99-ba0a-b418a5d5e349 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:15.838715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-993a0aa3-a59b-4280-b6ad-549ee7f7bd8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '734a6025b8c84c3d9f7eec77e8fad5f6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:15.840557 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-993a0aa3-a59b-4280-b6ad-549ee7f7bd8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '734a6025b8c84c3d9f7eec77e8fad5f6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:15.883710 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 913/1818] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:00:15 2022] DELETE /identity/v3/users/734a6025b8c84c3d9f7eec77e8fad5f6 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:15.884925 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a0aa3-a59b-4280-b6ad-549ee7f7bd8a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:15.891166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-993a0aa3-a59b-4280-b6ad-549ee7f7bd8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:15.904460 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:15.947563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-89b69253-8185-4e99-ba0a-b418a5d5e349 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b30f2499eadd460f86a81a4a167f77bf'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:15.950878 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-89b69253-8185-4e99-ba0a-b418a5d5e349 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b30f2499eadd460f86a81a4a167f77bf'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:15.965121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-89b69253-8185-4e99-ba0a-b418a5d5e349 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b30f2499eadd460f86a81a4a167f77bf'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:15.982301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-89b69253-8185-4e99-ba0a-b418a5d5e349 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b30f2499eadd460f86a81a4a167f77bf'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:15.983081 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-89b69253-8185-4e99-ba0a-b418a5d5e349 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b30f2499eadd460f86a81a4a167f77bf'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:16.016815 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 906/1819] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:00:15 2022] DELETE /identity/v3/users/b30f2499eadd460f86a81a4a167f77bf => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:16.019379 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a142bca-23fa-4766-a7b2-3b7480b1dc90 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:16.019710 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a142bca-23fa-4766-a7b2-3b7480b1dc90 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:16.019932 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a142bca-23fa-4766-a7b2-3b7480b1dc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:16.048709 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a0aa3-a59b-4280-b6ad-549ee7f7bd8a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:16.079212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-3a142bca-23fa-4766-a7b2-3b7480b1dc90 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:16.080514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3a142bca-23fa-4766-a7b2-3b7480b1dc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:16.145883 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:16.175968 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 907/1820] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:16.180288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2692025-a6af-4510-b6f8-0d96352f746d None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:16.182643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2692025-a6af-4510-b6f8-0d96352f746d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:16.183666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2692025-a6af-4510-b6f8-0d96352f746d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:16.198815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2069be-d741-4c0e-852f-a62f43f03ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:16.201603 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2069be-d741-4c0e-852f-a62f43f03ed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:16.201896 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2069be-d741-4c0e-852f-a62f43f03ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:16.202274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2069be-d741-4c0e-852f-a62f43f03ed5 admin admin] PATH_INFO: `/v3/projects/36deaeec637143369701a3dfc7db966f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:16.204256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2069be-d741-4c0e-852f-a62f43f03ed5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36deaeec637143369701a3dfc7db966f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:16.206424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2069be-d741-4c0e-852f-a62f43f03ed5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:16.214754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b2692025-a6af-4510-b6f8-0d96352f746d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:16.216587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b2692025-a6af-4510-b6f8-0d96352f746d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:16.244738 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 908/1821] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:16.247888 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2692025-a6af-4510-b6f8-0d96352f746d None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:16.255209 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b2692025-a6af-4510-b6f8-0d96352f746d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:16.292997 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fb2069be-d741-4c0e-852f-a62f43f03ed5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36deaeec637143369701a3dfc7db966f', 'request_id': 'req-fb2069be-d741-4c0e-852f-a62f43f03ed5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:16.305452 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fb2069be-d741-4c0e-852f-a62f43f03ed5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36deaeec637143369701a3dfc7db966f', 'request_id': 'req-fb2069be-d741-4c0e-852f-a62f43f03ed5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:16.312993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fb2069be-d741-4c0e-852f-a62f43f03ed5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36deaeec637143369701a3dfc7db966f', 'request_id': 'req-fb2069be-d741-4c0e-852f-a62f43f03ed5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:16.335966 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fb2069be-d741-4c0e-852f-a62f43f03ed5 admin admin] The token cache is being invalidate because project 36deaeec637143369701a3dfc7db966f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:16.336834 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fb2069be-d741-4c0e-852f-a62f43f03ed5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:16.340454 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fb2069be-d741-4c0e-852f-a62f43f03ed5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:16.373645 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 914/1822] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:15 2022] DELETE /identity/v3/projects/36deaeec637143369701a3dfc7db966f => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:16.376893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2069be-d741-4c0e-852f-a62f43f03ed5 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:16.386133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fb2069be-d741-4c0e-852f-a62f43f03ed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:16.402189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2692025-a6af-4510-b6f8-0d96352f746d None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:16.497698 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:16.503900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b875e-de1b-4571-9a77-84628e968021 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:16.510926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b875e-de1b-4571-9a77-84628e968021 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:16.511282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b875e-de1b-4571-9a77-84628e968021 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:16.511789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b875e-de1b-4571-9a77-84628e968021 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:16.516994 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a02b875e-de1b-4571-9a77-84628e968021 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:16.532466 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2069be-d741-4c0e-852f-a62f43f03ed5 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:16.541508 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df010d9-8e42-4876-8936-c875edbd26c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:16.542943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df010d9-8e42-4876-8936-c875edbd26c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:16.544320 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df010d9-8e42-4876-8936-c875edbd26c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:16.544668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df010d9-8e42-4876-8936-c875edbd26c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:16.549255 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5df010d9-8e42-4876-8936-c875edbd26c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:16.704354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b875e-de1b-4571-9a77-84628e968021 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:16.706582 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b875e-de1b-4571-9a77-84628e968021 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:16.730018 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 909/1823] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:16.733054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f49e4-871d-41f1-a40f-81deda005d3a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:16.733054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f49e4-871d-41f1-a40f-81deda005d3a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:16.734041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f49e4-871d-41f1-a40f-81deda005d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:16.762585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df010d9-8e42-4876-8936-c875edbd26c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:16.762585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df010d9-8e42-4876-8936-c875edbd26c9 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:16.783743 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 915/1824] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:16.811969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-cc9f49e4-871d-41f1-a40f-81deda005d3a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:16.815186 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-cc9f49e4-871d-41f1-a40f-81deda005d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:16.840354 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 910/1825] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:16.848878 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a14e8-13fe-4afb-9dbc-87dcbd1fc942 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:16.849733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a14e8-13fe-4afb-9dbc-87dcbd1fc942 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:16.850027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a14e8-13fe-4afb-9dbc-87dcbd1fc942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:16.886983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-848a14e8-13fe-4afb-9dbc-87dcbd1fc942 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:16.888219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-848a14e8-13fe-4afb-9dbc-87dcbd1fc942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:16.928589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f49e4-871d-41f1-a40f-81deda005d3a None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:16.931630 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 916/1826] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:16.933214 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73219a79-f856-4e15-b7af-3acf590b7a6c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:16.933767 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73219a79-f856-4e15-b7af-3acf590b7a6c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:16.934488 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73219a79-f856-4e15-b7af-3acf590b7a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:16.941671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f49e4-871d-41f1-a40f-81deda005d3a None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:16.953099 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97fabc-b90c-4cdb-aa9e-842a1d7944ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:16.953901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97fabc-b90c-4cdb-aa9e-842a1d7944ca admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:16.954278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97fabc-b90c-4cdb-aa9e-842a1d7944ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:16.955418 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97fabc-b90c-4cdb-aa9e-842a1d7944ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:16.956857 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a97fabc-b90c-4cdb-aa9e-842a1d7944ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:00:16.957962 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a97fabc-b90c-4cdb-aa9e-842a1d7944ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:16.972584 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a97fabc-b90c-4cdb-aa9e-842a1d7944ca admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:16.976009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-73219a79-f856-4e15-b7af-3acf590b7a6c None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:16.977484 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-73219a79-f856-4e15-b7af-3acf590b7a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:17.000747 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 911/1827] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:00:17.005449 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97fabc-b90c-4cdb-aa9e-842a1d7944ca admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:17.022315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97fabc-b90c-4cdb-aa9e-842a1d7944ca admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:17.028643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e31fc-5566-4c45-933d-b70be72abc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:17.030135 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e31fc-5566-4c45-933d-b70be72abc3d admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:17.030658 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e31fc-5566-4c45-933d-b70be72abc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:17.031057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e31fc-5566-4c45-933d-b70be72abc3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:17.032708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e31fc-5566-4c45-933d-b70be72abc3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:17.035708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e31fc-5566-4c45-933d-b70be72abc3d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:17.086553 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 912/1828] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:00:17 2022] POST /identity/v3/projects => generated 379 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:17.092589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e31fc-5566-4c45-933d-b70be72abc3d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:17.106322 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:17.170163 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 917/1829] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:00:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:17.179982 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73219a79-f856-4e15-b7af-3acf590b7a6c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:17.181752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-73219a79-f856-4e15-b7af-3acf590b7a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:17.291775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e31fc-5566-4c45-933d-b70be72abc3d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:17.295590 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73219a79-f856-4e15-b7af-3acf590b7a6c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:17.300642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144cc10-9e76-4009-8575-44e3ee6b518c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:17.301904 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144cc10-9e76-4009-8575-44e3ee6b518c admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:17.303555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144cc10-9e76-4009-8575-44e3ee6b518c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:17.304134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144cc10-9e76-4009-8575-44e3ee6b518c admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:17.322925 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a144cc10-9e76-4009-8575-44e3ee6b518c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:17.329357 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a144cc10-9e76-4009-8575-44e3ee6b518c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:17.333278 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:17.382325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e26000-0ef7-4472-a0c8-22634bb11f1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:17.383134 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e26000-0ef7-4472-a0c8-22634bb11f1b service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:17.383487 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e26000-0ef7-4472-a0c8-22634bb11f1b service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:17.383926 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e26000-0ef7-4472-a0c8-22634bb11f1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:17.408704 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 913/1830] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:17 2022] POST /identity/v3/users => generated 290 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:17.413270 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144cc10-9e76-4009-8575-44e3ee6b518c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:17.441230 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144cc10-9e76-4009-8575-44e3ee6b518c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:17.458469 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9280c-6e00-4d95-830b-767e87338504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:17.459050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9280c-6e00-4d95-830b-767e87338504 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:17.459328 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9280c-6e00-4d95-830b-767e87338504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:17.460640 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9280c-6e00-4d95-830b-767e87338504 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:17.460640 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe9280c-6e00-4d95-830b-767e87338504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:17.466754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e26000-0ef7-4472-a0c8-22634bb11f1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:17.468385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e26000-0ef7-4472-a0c8-22634bb11f1b service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:17.472186 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe9280c-6e00-4d95-830b-767e87338504 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:17.494532 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 914/1831] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:17.495578 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 918/1832] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:00:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:00:17.498444 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9280c-6e00-4d95-830b-767e87338504 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:17.514004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9280c-6e00-4d95-830b-767e87338504 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:17.520832 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd13b85-f129-4cd7-8c0a-93788789585f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:17.521685 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd13b85-f129-4cd7-8c0a-93788789585f admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:17.522188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd13b85-f129-4cd7-8c0a-93788789585f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:17.522569 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd13b85-f129-4cd7-8c0a-93788789585f admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:17.523313 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd13b85-f129-4cd7-8c0a-93788789585f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:17.525034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd13b85-f129-4cd7-8c0a-93788789585f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:17.540013 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 915/1833] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:17.544210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e26000-0ef7-4472-a0c8-22634bb11f1b service swift] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:17.559012 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e26000-0ef7-4472-a0c8-22634bb11f1b service swift] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:17.569596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ceaf3e-a879-4def-ac12-c0f847a896ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:17.570481 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ceaf3e-a879-4def-ac12-c0f847a896ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:17.570871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ceaf3e-a879-4def-ac12-c0f847a896ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:17.571239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ceaf3e-a879-4def-ac12-c0f847a896ff admin admin] PATH_INFO: `/v3/projects/035addf456164d10994a7c3c701e794c/users/64e8f52361be4ddebbe8baad4f54bdf5/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:17.592920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ceaf3e-a879-4def-ac12-c0f847a896ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=035addf456164d10994a7c3c701e794c, user_id=64e8f52361be4ddebbe8baad4f54bdf5, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:17.596331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ceaf3e-a879-4def-ac12-c0f847a896ff admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:17.616471 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 919/1834] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:17 2022] PUT /identity/v3/projects/035addf456164d10994a7c3c701e794c/users/64e8f52361be4ddebbe8baad4f54bdf5/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:17.633863 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1160818-d066-4f62-96e6-78ab1bd95474 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:17.634414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1160818-d066-4f62-96e6-78ab1bd95474 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:17.634822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1160818-d066-4f62-96e6-78ab1bd95474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:17.701658 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d1160818-d066-4f62-96e6-78ab1bd95474 None None] MFA Rules not processed for user `64e8f52361be4ddebbe8baad4f54bdf5`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:17.705696 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d1160818-d066-4f62-96e6-78ab1bd95474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:17.929185 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ceaf3e-a879-4def-ac12-c0f847a896ff admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:17.931644 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 916/1835] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:18.119770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ceaf3e-a879-4def-ac12-c0f847a896ff admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:18.132456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76327d7-e6ef-4268-b4d7-ff67d9cbae41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:18.133502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76327d7-e6ef-4268-b4d7-ff67d9cbae41 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:18.134409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76327d7-e6ef-4268-b4d7-ff67d9cbae41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:18.134843 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76327d7-e6ef-4268-b4d7-ff67d9cbae41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:18.136267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76327d7-e6ef-4268-b4d7-ff67d9cbae41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:18.139255 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1160818-d066-4f62-96e6-78ab1bd95474 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:18.139584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76327d7-e6ef-4268-b4d7-ff67d9cbae41 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:18.141278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d1160818-d066-4f62-96e6-78ab1bd95474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:18.168962 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1160818-d066-4f62-96e6-78ab1bd95474 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:18.182656 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2cb60-12f3-4209-b323-eba1690c7747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:18.183470 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2cb60-12f3-4209-b323-eba1690c7747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:18.183920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2cb60-12f3-4209-b323-eba1690c7747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:18.184354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2cb60-12f3-4209-b323-eba1690c7747 admin admin] PATH_INFO: `/v3/projects/c7f217d13bce4e479bd6470f5579a6a0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:18.187216 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2cb60-12f3-4209-b323-eba1690c7747 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7f217d13bce4e479bd6470f5579a6a0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:18.189306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2cb60-12f3-4209-b323-eba1690c7747 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:18.205364 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 920/1836] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:00:17 2022] POST /identity/v3/projects => generated 381 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:18.211532 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76327d7-e6ef-4268-b4d7-ff67d9cbae41 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:18.287120 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:18.298637 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8bb2cb60-12f3-4209-b323-eba1690c7747 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7f217d13bce4e479bd6470f5579a6a0', 'request_id': 'req-8bb2cb60-12f3-4209-b323-eba1690c7747'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:18.316178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8bb2cb60-12f3-4209-b323-eba1690c7747 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7f217d13bce4e479bd6470f5579a6a0', 'request_id': 'req-8bb2cb60-12f3-4209-b323-eba1690c7747'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:18.323690 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:18.336466 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76327d7-e6ef-4268-b4d7-ff67d9cbae41 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:18.339219 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8bb2cb60-12f3-4209-b323-eba1690c7747 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7f217d13bce4e479bd6470f5579a6a0', 'request_id': 'req-8bb2cb60-12f3-4209-b323-eba1690c7747'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:18.360953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8bb2cb60-12f3-4209-b323-eba1690c7747 admin admin] The token cache is being invalidate because project c7f217d13bce4e479bd6470f5579a6a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:18.361518 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8bb2cb60-12f3-4209-b323-eba1690c7747 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:18.362744 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8bb2cb60-12f3-4209-b323-eba1690c7747 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:18.366381 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 917/1837] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:18 2022] DELETE /identity/v3/projects/c7f217d13bce4e479bd6470f5579a6a0 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:00:18.371834 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2cb60-12f3-4209-b323-eba1690c7747 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:18.400240 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8bb2cb60-12f3-4209-b323-eba1690c7747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:18.433819 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd356a-bb43-43f8-9c48-89758894ff76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:18.434778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd356a-bb43-43f8-9c48-89758894ff76 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:18.435306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd356a-bb43-43f8-9c48-89758894ff76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:18.435710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd356a-bb43-43f8-9c48-89758894ff76 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:18.436523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd356a-bb43-43f8-9c48-89758894ff76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:18.455808 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd356a-bb43-43f8-9c48-89758894ff76 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:18.494057 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 921/1838] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:18 2022] POST /identity/v3/users => generated 297 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:18.504514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd356a-bb43-43f8-9c48-89758894ff76 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:18.525582 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8abd356a-bb43-43f8-9c48-89758894ff76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:18.543592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd356a-bb43-43f8-9c48-89758894ff76 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:18.563542 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4072c-df40-47fb-bd5e-14e186a4417a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:18.566058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4072c-df40-47fb-bd5e-14e186a4417a admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:18.566367 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4072c-df40-47fb-bd5e-14e186a4417a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:18.566645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4072c-df40-47fb-bd5e-14e186a4417a admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:18.567319 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4072c-df40-47fb-bd5e-14e186a4417a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:18.577084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4072c-df40-47fb-bd5e-14e186a4417a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:18.620860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2cb60-12f3-4209-b323-eba1690c7747 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:18.634420 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf1125-aba0-4926-acc6-3f760d97c87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:18.635149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf1125-aba0-4926-acc6-3f760d97c87a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:18.636474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf1125-aba0-4926-acc6-3f760d97c87a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:18.636766 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf1125-aba0-4926-acc6-3f760d97c87a admin admin] PATH_INFO: `/v3/users/21f11571add14b3696ee32a215ca63db` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:18.645118 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf1125-aba0-4926-acc6-3f760d97c87a admin admin] RBAC: Authorizing `identity:delete_user(user_id=21f11571add14b3696ee32a215ca63db)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:18.645118 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf1125-aba0-4926-acc6-3f760d97c87a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:18.672636 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 922/1839] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:18.672636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4072c-df40-47fb-bd5e-14e186a4417a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:18.678332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ded4072c-df40-47fb-bd5e-14e186a4417a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:18.736735 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4072c-df40-47fb-bd5e-14e186a4417a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:18.756634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da97b2-26cb-498d-9095-cf9f84c2dc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:18.760944 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da97b2-26cb-498d-9095-cf9f84c2dc66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:18.765104 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da97b2-26cb-498d-9095-cf9f84c2dc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:18.770421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da97b2-26cb-498d-9095-cf9f84c2dc66 admin admin] PATH_INFO: `/v3/projects/f4b042cc50124c9a87dd2b2afaeb8fba` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:18.775649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-43bf1125-aba0-4926-acc6-3f760d97c87a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21f11571add14b3696ee32a215ca63db'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:18.775902 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da97b2-26cb-498d-9095-cf9f84c2dc66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4b042cc50124c9a87dd2b2afaeb8fba)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:18.776639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-43bf1125-aba0-4926-acc6-3f760d97c87a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21f11571add14b3696ee32a215ca63db'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:18.783757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da97b2-26cb-498d-9095-cf9f84c2dc66 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:18.789189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-43bf1125-aba0-4926-acc6-3f760d97c87a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21f11571add14b3696ee32a215ca63db'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:18.798887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-43bf1125-aba0-4926-acc6-3f760d97c87a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21f11571add14b3696ee32a215ca63db'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:18.800811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-43bf1125-aba0-4926-acc6-3f760d97c87a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21f11571add14b3696ee32a215ca63db'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:18.874403 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 918/1840] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:00:18 2022] DELETE /identity/v3/users/21f11571add14b3696ee32a215ca63db => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:18.874403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf1125-aba0-4926-acc6-3f760d97c87a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:18.874403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-43bf1125-aba0-4926-acc6-3f760d97c87a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:18.913073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-35da97b2-26cb-498d-9095-cf9f84c2dc66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4b042cc50124c9a87dd2b2afaeb8fba', 'request_id': 'req-35da97b2-26cb-498d-9095-cf9f84c2dc66'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:18.932849 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-35da97b2-26cb-498d-9095-cf9f84c2dc66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4b042cc50124c9a87dd2b2afaeb8fba', 'request_id': 'req-35da97b2-26cb-498d-9095-cf9f84c2dc66'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:18.950428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-35da97b2-26cb-498d-9095-cf9f84c2dc66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4b042cc50124c9a87dd2b2afaeb8fba', 'request_id': 'req-35da97b2-26cb-498d-9095-cf9f84c2dc66'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:18.973350 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-35da97b2-26cb-498d-9095-cf9f84c2dc66 admin admin] The token cache is being invalidate because project f4b042cc50124c9a87dd2b2afaeb8fba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:18.973951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-35da97b2-26cb-498d-9095-cf9f84c2dc66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:18.975389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-35da97b2-26cb-498d-9095-cf9f84c2dc66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:18.982455 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 923/1841] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:18 2022] DELETE /identity/v3/projects/f4b042cc50124c9a87dd2b2afaeb8fba => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:18.985902 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da97b2-26cb-498d-9095-cf9f84c2dc66 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:18.988544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-35da97b2-26cb-498d-9095-cf9f84c2dc66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:19.032168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf1125-aba0-4926-acc6-3f760d97c87a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:19.049703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ea554-0fe8-40bd-a1b3-79504d33948d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:19.050226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ea554-0fe8-40bd-a1b3-79504d33948d admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:19.050614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ea554-0fe8-40bd-a1b3-79504d33948d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:19.050992 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ea554-0fe8-40bd-a1b3-79504d33948d admin admin] PATH_INFO: `/v3/projects/bff41c3c3ab641359a95669035859c27/users/a0b47bb20c2f4257a2a96dfa6fff704e/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:19.071736 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:19.103946 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ea554-0fe8-40bd-a1b3-79504d33948d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bff41c3c3ab641359a95669035859c27, user_id=a0b47bb20c2f4257a2a96dfa6fff704e, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:19.106874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ea554-0fe8-40bd-a1b3-79504d33948d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:19.147841 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:19.148295 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 919/1842] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:18 2022] PUT /identity/v3/projects/bff41c3c3ab641359a95669035859c27/users/a0b47bb20c2f4257a2a96dfa6fff704e/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:19.156767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ea554-0fe8-40bd-a1b3-79504d33948d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:19.159647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7f5ea554-0fe8-40bd-a1b3-79504d33948d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:19.223268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da97b2-26cb-498d-9095-cf9f84c2dc66 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:19.355480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ea554-0fe8-40bd-a1b3-79504d33948d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:19.363660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd8e92-bc27-4165-8b20-c6ed3003197a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:19.365290 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd8e92-bc27-4165-8b20-c6ed3003197a admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:19.365624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd8e92-bc27-4165-8b20-c6ed3003197a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:19.366997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd8e92-bc27-4165-8b20-c6ed3003197a admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:19.367884 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd8e92-bc27-4165-8b20-c6ed3003197a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:19.370448 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd8e92-bc27-4165-8b20-c6ed3003197a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:19.380593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf15c6-8f04-4fbb-b9a6-54d8ddf464dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:19.382520 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf15c6-8f04-4fbb-b9a6-54d8ddf464dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:19.383066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf15c6-8f04-4fbb-b9a6-54d8ddf464dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:19.384406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf15c6-8f04-4fbb-b9a6-54d8ddf464dc admin admin] PATH_INFO: `/v3/users/e812b0ac9d324dbca0a33779143ad9ab` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:19.385953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf15c6-8f04-4fbb-b9a6-54d8ddf464dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e812b0ac9d324dbca0a33779143ad9ab)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:19.389090 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf15c6-8f04-4fbb-b9a6-54d8ddf464dc admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:19.410990 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 920/1843] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:19.412661 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd8e92-bc27-4165-8b20-c6ed3003197a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:19.432484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd8e92-bc27-4165-8b20-c6ed3003197a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:19.442876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de01b26a-8b8a-4fa1-8820-be526e76d9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:19.447125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01b26a-8b8a-4fa1-8820-be526e76d9d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:19.447816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01b26a-8b8a-4fa1-8820-be526e76d9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:19.448159 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01b26a-8b8a-4fa1-8820-be526e76d9d9 admin admin] PATH_INFO: `/v3/projects/bff41c3c3ab641359a95669035859c27/users/a0b47bb20c2f4257a2a96dfa6fff704e/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:19.452026 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01b26a-8b8a-4fa1-8820-be526e76d9d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bff41c3c3ab641359a95669035859c27, user_id=a0b47bb20c2f4257a2a96dfa6fff704e, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:19.463272 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01b26a-8b8a-4fa1-8820-be526e76d9d9 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:19.489319 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 921/1844] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:19 2022] PUT /identity/v3/projects/bff41c3c3ab641359a95669035859c27/users/a0b47bb20c2f4257a2a96dfa6fff704e/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:19.492498 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce09b95-5eee-4e39-a12b-a26d1a58b4d2 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:19.492900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce09b95-5eee-4e39-a12b-a26d1a58b4d2 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:19.493197 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce09b95-5eee-4e39-a12b-a26d1a58b4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:19.518652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0acf15c6-8f04-4fbb-b9a6-54d8ddf464dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e812b0ac9d324dbca0a33779143ad9ab'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:19.520737 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0acf15c6-8f04-4fbb-b9a6-54d8ddf464dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e812b0ac9d324dbca0a33779143ad9ab'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:19.538514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0acf15c6-8f04-4fbb-b9a6-54d8ddf464dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e812b0ac9d324dbca0a33779143ad9ab'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:19.550816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-7ce09b95-5eee-4e39-a12b-a26d1a58b4d2 None None] MFA Rules not processed for user `a0b47bb20c2f4257a2a96dfa6fff704e`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:19.552268 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7ce09b95-5eee-4e39-a12b-a26d1a58b4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:19.553970 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0acf15c6-8f04-4fbb-b9a6-54d8ddf464dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e812b0ac9d324dbca0a33779143ad9ab'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:19.557842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0acf15c6-8f04-4fbb-b9a6-54d8ddf464dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e812b0ac9d324dbca0a33779143ad9ab'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:19.627997 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 924/1845] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:00:18 2022] DELETE /identity/v3/users/e812b0ac9d324dbca0a33779143ad9ab => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:19.628782 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf15c6-8f04-4fbb-b9a6-54d8ddf464dc admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:19.637109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0acf15c6-8f04-4fbb-b9a6-54d8ddf464dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:19.676171 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 922/1846] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:19 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:19.720230 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce09b95-5eee-4e39-a12b-a26d1a58b4d2 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:19.721797 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7ce09b95-5eee-4e39-a12b-a26d1a58b4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:19.812679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf15c6-8f04-4fbb-b9a6-54d8ddf464dc admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:19.829300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e158808-cb99-44c8-aeca-dc898dce2e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:19.830656 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e158808-cb99-44c8-aeca-dc898dce2e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:19.831098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e158808-cb99-44c8-aeca-dc898dce2e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:19.831630 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e158808-cb99-44c8-aeca-dc898dce2e2f admin admin] PATH_INFO: `/v3/projects/55ba94522c1c4c8f967e1e4b88d3c012` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:19.835067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e158808-cb99-44c8-aeca-dc898dce2e2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=55ba94522c1c4c8f967e1e4b88d3c012)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:19.837336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e158808-cb99-44c8-aeca-dc898dce2e2f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:19.844213 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:19.857861 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:19.871602 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce09b95-5eee-4e39-a12b-a26d1a58b4d2 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:19.955456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7e158808-cb99-44c8-aeca-dc898dce2e2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55ba94522c1c4c8f967e1e4b88d3c012', 'request_id': 'req-7e158808-cb99-44c8-aeca-dc898dce2e2f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:19.970120 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7e158808-cb99-44c8-aeca-dc898dce2e2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55ba94522c1c4c8f967e1e4b88d3c012', 'request_id': 'req-7e158808-cb99-44c8-aeca-dc898dce2e2f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:19.983831 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7e158808-cb99-44c8-aeca-dc898dce2e2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55ba94522c1c4c8f967e1e4b88d3c012', 'request_id': 'req-7e158808-cb99-44c8-aeca-dc898dce2e2f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:19.993806 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da33ed10-11e1-4685-abfb-ee1b6f479bc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:19.994717 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33ed10-11e1-4685-abfb-ee1b6f479bc6 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:19.994717 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33ed10-11e1-4685-abfb-ee1b6f479bc6 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:19.994965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33ed10-11e1-4685-abfb-ee1b6f479bc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:20.017114 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7e158808-cb99-44c8-aeca-dc898dce2e2f admin admin] The token cache is being invalidate because project 55ba94522c1c4c8f967e1e4b88d3c012 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:20.017487 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7e158808-cb99-44c8-aeca-dc898dce2e2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:20.018377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7e158808-cb99-44c8-aeca-dc898dce2e2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:20.024606 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 925/1847] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:19 2022] DELETE /identity/v3/projects/55ba94522c1c4c8f967e1e4b88d3c012 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:20.026242 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7eec3-726c-4bfd-9704-67270a19b815 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:20.026516 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7eec3-726c-4bfd-9704-67270a19b815 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:20.026788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7eec3-726c-4bfd-9704-67270a19b815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:20.055807 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-34b7eec3-726c-4bfd-9704-67270a19b815 None None] MFA Rules not processed for user `2cdde7a212954a01a2591ad5ac30d049`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:20.057088 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-34b7eec3-726c-4bfd-9704-67270a19b815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:20.119801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da33ed10-11e1-4685-abfb-ee1b6f479bc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:20.122095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da33ed10-11e1-4685-abfb-ee1b6f479bc6 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:20.136412 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 923/1848] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:19 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:20.138135 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13903291-8e8c-46c8-90c2-7e631a35dece None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:20.138135 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13903291-8e8c-46c8-90c2-7e631a35dece None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:20.138525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13903291-8e8c-46c8-90c2-7e631a35dece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:20.184045 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-13903291-8e8c-46c8-90c2-7e631a35dece None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:20.186388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-13903291-8e8c-46c8-90c2-7e631a35dece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:20.231087 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 926/1849] 10.222.0.49 () {58 vars in 1015 bytes} [Sun Sep 4 01:00:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:20.293763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b7eec3-726c-4bfd-9704-67270a19b815 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:20.295436 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-34b7eec3-726c-4bfd-9704-67270a19b815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:20.309202 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 924/1850] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:20.312831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6b4bd-cd7a-4d6e-8249-8f4d6f308a26 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:20.314404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6b4bd-cd7a-4d6e-8249-8f4d6f308a26 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:20.315090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6b4bd-cd7a-4d6e-8249-8f4d6f308a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:20.324847 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b7eec3-726c-4bfd-9704-67270a19b815 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:20.335076 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6c771-d21c-4f48-8fbe-50cce4e4c6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:20.336380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6c771-d21c-4f48-8fbe-50cce4e4c6ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:20.336945 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6c771-d21c-4f48-8fbe-50cce4e4c6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:20.337207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6c771-d21c-4f48-8fbe-50cce4e4c6ac admin admin] PATH_INFO: `/v3/users/64e8f52361be4ddebbe8baad4f54bdf5` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:20.340424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a6c771-d21c-4f48-8fbe-50cce4e4c6ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=64e8f52361be4ddebbe8baad4f54bdf5)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:20.343126 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a6c771-d21c-4f48-8fbe-50cce4e4c6ac admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:20.346226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c6b6b4bd-cd7a-4d6e-8249-8f4d6f308a26 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:20.347768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c6b6b4bd-cd7a-4d6e-8249-8f4d6f308a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:20.358211 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 925/1851] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:20.362629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6b4bd-cd7a-4d6e-8249-8f4d6f308a26 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:20.374393 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6b4bd-cd7a-4d6e-8249-8f4d6f308a26 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:20.381791 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d35864-3e6b-4aed-ab81-5cb7982e6551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:20.382950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d35864-3e6b-4aed-ab81-5cb7982e6551 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:20.382950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d35864-3e6b-4aed-ab81-5cb7982e6551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:20.383415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d35864-3e6b-4aed-ab81-5cb7982e6551 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:20.384210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d35864-3e6b-4aed-ab81-5cb7982e6551 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:00:20.384998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d35864-3e6b-4aed-ab81-5cb7982e6551 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:20.387743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d35864-3e6b-4aed-ab81-5cb7982e6551 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:20.407145 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 926/1852] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:00:20.411729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d35864-3e6b-4aed-ab81-5cb7982e6551 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:20.427429 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d35864-3e6b-4aed-ab81-5cb7982e6551 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:20.433399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d7a6c771-d21c-4f48-8fbe-50cce4e4c6ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64e8f52361be4ddebbe8baad4f54bdf5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:20.434557 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d7a6c771-d21c-4f48-8fbe-50cce4e4c6ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64e8f52361be4ddebbe8baad4f54bdf5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:20.436093 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a141c9-5794-4f32-aec3-6ff96912057c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:20.436960 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a141c9-5794-4f32-aec3-6ff96912057c admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:20.437458 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a141c9-5794-4f32-aec3-6ff96912057c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:20.437899 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a141c9-5794-4f32-aec3-6ff96912057c admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:20.439140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a141c9-5794-4f32-aec3-6ff96912057c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:20.441621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a141c9-5794-4f32-aec3-6ff96912057c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:20.447387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d7a6c771-d21c-4f48-8fbe-50cce4e4c6ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64e8f52361be4ddebbe8baad4f54bdf5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:20.449904 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:20.468356 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d7a6c771-d21c-4f48-8fbe-50cce4e4c6ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64e8f52361be4ddebbe8baad4f54bdf5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:20.469155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d7a6c771-d21c-4f48-8fbe-50cce4e4c6ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64e8f52361be4ddebbe8baad4f54bdf5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:20.498879 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 927/1853] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:00:20 2022] DELETE /identity/v3/users/64e8f52361be4ddebbe8baad4f54bdf5 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:20.502646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742dd0c-ad81-4baf-bf89-c38303ee45fe None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:20.503033 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742dd0c-ad81-4baf-bf89-c38303ee45fe None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:20.503369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742dd0c-ad81-4baf-bf89-c38303ee45fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:20.506350 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 927/1854] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:00:20 2022] POST /identity/v3/projects => generated 389 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:00:20.510959 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a141c9-5794-4f32-aec3-6ff96912057c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:20.513164 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c6a141c9-5794-4f32-aec3-6ff96912057c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:20.568784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-9742dd0c-ad81-4baf-bf89-c38303ee45fe None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:20.570793 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9742dd0c-ad81-4baf-bf89-c38303ee45fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:20.592974 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:20.671116 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 928/1855] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:20.672148 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9742dd0c-ad81-4baf-bf89-c38303ee45fe None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:20.673688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9742dd0c-ad81-4baf-bf89-c38303ee45fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:20.686608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a141c9-5794-4f32-aec3-6ff96912057c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:20.696475 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62ade8-d6b6-4880-ad63-2682e7d2d937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:20.697620 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62ade8-d6b6-4880-ad63-2682e7d2d937 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:20.698287 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62ade8-d6b6-4880-ad63-2682e7d2d937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:20.698899 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62ade8-d6b6-4880-ad63-2682e7d2d937 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:20.700003 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d62ade8-d6b6-4880-ad63-2682e7d2d937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:20.703216 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d62ade8-d6b6-4880-ad63-2682e7d2d937 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:20.777342 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 928/1856] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:20 2022] POST /identity/v3/users => generated 295 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:00:20.779713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62ade8-d6b6-4880-ad63-2682e7d2d937 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:20.779826 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9742dd0c-ad81-4baf-bf89-c38303ee45fe None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:20.785737 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5d62ade8-d6b6-4880-ad63-2682e7d2d937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:20.790333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221dc97-67e3-4837-8595-cd6a66a2f0a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:20.790981 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221dc97-67e3-4837-8595-cd6a66a2f0a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:20.791265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221dc97-67e3-4837-8595-cd6a66a2f0a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:20.791544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221dc97-67e3-4837-8595-cd6a66a2f0a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:20.797923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9221dc97-67e3-4837-8595-cd6a66a2f0a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:20.809408 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62ade8-d6b6-4880-ad63-2682e7d2d937 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:20.819316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221dc97-67e3-4837-8595-cd6a66a2f0a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:20.820779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221dc97-67e3-4837-8595-cd6a66a2f0a4 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:20.821846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea1878-7d8b-42b2-87ab-3c07d43f3cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:20.822855 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea1878-7d8b-42b2-87ab-3c07d43f3cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:20.823444 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea1878-7d8b-42b2-87ab-3c07d43f3cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:20.824080 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea1878-7d8b-42b2-87ab-3c07d43f3cbb admin admin] PATH_INFO: `/v3/projects/306c60d17cc54dc58d96340290905a95` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:20.825793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea1878-7d8b-42b2-87ab-3c07d43f3cbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=306c60d17cc54dc58d96340290905a95)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:20.833497 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 929/1857] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:20.833920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea1878-7d8b-42b2-87ab-3c07d43f3cbb admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:20.834357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221dc97-67e3-4837-8595-cd6a66a2f0a4 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:20.844315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221dc97-67e3-4837-8595-cd6a66a2f0a4 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:20.852395 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762e90a-1c85-4bff-a6c5-2ad88a013c32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:20.853103 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762e90a-1c85-4bff-a6c5-2ad88a013c32 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:20.853482 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762e90a-1c85-4bff-a6c5-2ad88a013c32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:20.853768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762e90a-1c85-4bff-a6c5-2ad88a013c32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:20.868740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762e90a-1c85-4bff-a6c5-2ad88a013c32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:20.873087 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762e90a-1c85-4bff-a6c5-2ad88a013c32 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:20.888037 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 930/1858] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:20.889184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762e90a-1c85-4bff-a6c5-2ad88a013c32 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:20.903034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762e90a-1c85-4bff-a6c5-2ad88a013c32 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:20.940473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-42ea1878-7d8b-42b2-87ab-3c07d43f3cbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '306c60d17cc54dc58d96340290905a95', 'request_id': 'req-42ea1878-7d8b-42b2-87ab-3c07d43f3cbb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:20.951947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-42ea1878-7d8b-42b2-87ab-3c07d43f3cbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '306c60d17cc54dc58d96340290905a95', 'request_id': 'req-42ea1878-7d8b-42b2-87ab-3c07d43f3cbb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:20.962251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-42ea1878-7d8b-42b2-87ab-3c07d43f3cbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '306c60d17cc54dc58d96340290905a95', 'request_id': 'req-42ea1878-7d8b-42b2-87ab-3c07d43f3cbb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:20.979412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-42ea1878-7d8b-42b2-87ab-3c07d43f3cbb admin admin] The token cache is being invalidate because project 306c60d17cc54dc58d96340290905a95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:20.980198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-42ea1878-7d8b-42b2-87ab-3c07d43f3cbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:20.981232 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-42ea1878-7d8b-42b2-87ab-3c07d43f3cbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:20.983528 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 929/1859] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:20 2022] DELETE /identity/v3/projects/306c60d17cc54dc58d96340290905a95 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:20.991742 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ecbd4-8504-4925-82dd-30f247e451b6 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:20.992578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ecbd4-8504-4925-82dd-30f247e451b6 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:20.993153 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ecbd4-8504-4925-82dd-30f247e451b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:21.024512 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977a4db-e698-46f4-a187-6dcc78c38a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:21.025133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977a4db-e698-46f4-a187-6dcc78c38a63 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:21.025414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977a4db-e698-46f4-a187-6dcc78c38a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:21.025784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977a4db-e698-46f4-a187-6dcc78c38a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:21.026397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977a4db-e698-46f4-a187-6dcc78c38a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:21.028075 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977a4db-e698-46f4-a187-6dcc78c38a63 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:21.028485 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d99ecbd4-8504-4925-82dd-30f247e451b6 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:21.030561 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d99ecbd4-8504-4925-82dd-30f247e451b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:21.045593 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 930/1860] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:00:21.055783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b1953-bbfb-4c31-80f9-949f28171d12 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:21.056155 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b1953-bbfb-4c31-80f9-949f28171d12 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:21.056470 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b1953-bbfb-4c31-80f9-949f28171d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:21.066673 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 931/1861] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:21.068317 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977a4db-e698-46f4-a187-6dcc78c38a63 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:21.086632 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9977a4db-e698-46f4-a187-6dcc78c38a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:21.109202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-3c5b1953-bbfb-4c31-80f9-949f28171d12 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:21.110882 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3c5b1953-bbfb-4c31-80f9-949f28171d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:21.124209 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 931/1862] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:21.125837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b1953-bbfb-4c31-80f9-949f28171d12 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:21.128702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977a4db-e698-46f4-a187-6dcc78c38a63 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:21.140743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b1953-bbfb-4c31-80f9-949f28171d12 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:21.142267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8be8d-60db-4b6a-8a20-1c42fd33643b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:21.142910 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8be8d-60db-4b6a-8a20-1c42fd33643b admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:21.143199 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8be8d-60db-4b6a-8a20-1c42fd33643b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:21.143473 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8be8d-60db-4b6a-8a20-1c42fd33643b admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:21.144145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d8be8d-60db-4b6a-8a20-1c42fd33643b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:21.145823 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d8be8d-60db-4b6a-8a20-1c42fd33643b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:21.150853 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d002b60-f251-46fc-9d31-52e51ea8db6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:21.151718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d002b60-f251-46fc-9d31-52e51ea8db6f admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:21.152116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d002b60-f251-46fc-9d31-52e51ea8db6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:21.152857 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d002b60-f251-46fc-9d31-52e51ea8db6f admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:21.157904 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d002b60-f251-46fc-9d31-52e51ea8db6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:00:21.158349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d002b60-f251-46fc-9d31-52e51ea8db6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:21.160607 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d002b60-f251-46fc-9d31-52e51ea8db6f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:21.172591 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 932/1863] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:21.173709 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8be8d-60db-4b6a-8a20-1c42fd33643b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:21.185652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8be8d-60db-4b6a-8a20-1c42fd33643b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:21.190830 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 932/1864] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:00:21.194858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d002b60-f251-46fc-9d31-52e51ea8db6f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:21.196939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b4ebd-3d0a-4cba-9bbb-182b6edee1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:21.197667 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b4ebd-3d0a-4cba-9bbb-182b6edee1cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:21.197954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b4ebd-3d0a-4cba-9bbb-182b6edee1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:21.199813 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b4ebd-3d0a-4cba-9bbb-182b6edee1cf admin admin] PATH_INFO: `/v3/projects/9fbdbc4d0f8f4ef295fcf2cdd01c89b6/users/d7f61b6252fd4b279dd33bfc4ce41663/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:21.220350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d002b60-f251-46fc-9d31-52e51ea8db6f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:21.243385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17dde1-f0be-4911-a586-ebda6550ee01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:21.245569 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17dde1-f0be-4911-a586-ebda6550ee01 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:21.245963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17dde1-f0be-4911-a586-ebda6550ee01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:21.246861 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17dde1-f0be-4911-a586-ebda6550ee01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:21.249540 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17dde1-f0be-4911-a586-ebda6550ee01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:21.263324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b4ebd-3d0a-4cba-9bbb-182b6edee1cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fbdbc4d0f8f4ef295fcf2cdd01c89b6, user_id=d7f61b6252fd4b279dd33bfc4ce41663, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:21.264469 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17dde1-f0be-4911-a586-ebda6550ee01 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:21.268435 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b4ebd-3d0a-4cba-9bbb-182b6edee1cf admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:21.292672 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 933/1865] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:21 2022] PUT /identity/v3/projects/9fbdbc4d0f8f4ef295fcf2cdd01c89b6/users/d7f61b6252fd4b279dd33bfc4ce41663/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:00:21.305297 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a32f77-f10f-4dc8-b544-593c28d099e2 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:21.306349 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a32f77-f10f-4dc8-b544-593c28d099e2 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:21.306858 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a32f77-f10f-4dc8-b544-593c28d099e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:21.363365 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:21.376324 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 933/1866] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:00:21 2022] POST /identity/v3/projects => generated 399 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:21.380987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-04a32f77-f10f-4dc8-b544-593c28d099e2 None None] MFA Rules not processed for user `d7f61b6252fd4b279dd33bfc4ce41663`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:21.385627 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-04a32f77-f10f-4dc8-b544-593c28d099e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:21.390347 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17dde1-f0be-4911-a586-ebda6550ee01 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:21.410267 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:21.503236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17dde1-f0be-4911-a586-ebda6550ee01 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:21.516807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eccca0-443f-48f8-a24e-84e1bd94e336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:21.517649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eccca0-443f-48f8-a24e-84e1bd94e336 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:21.518061 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eccca0-443f-48f8-a24e-84e1bd94e336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:21.518466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eccca0-443f-48f8-a24e-84e1bd94e336 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:21.519356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eccca0-443f-48f8-a24e-84e1bd94e336 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:21.522529 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eccca0-443f-48f8-a24e-84e1bd94e336 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:21.526856 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 934/1867] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:00:21.527903 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a32f77-f10f-4dc8-b544-593c28d099e2 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:21.542134 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a32f77-f10f-4dc8-b544-593c28d099e2 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:21.547971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadbd5b-52e2-4fdd-bd57-905479351c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:21.549083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadbd5b-52e2-4fdd-bd57-905479351c37 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:21.549367 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadbd5b-52e2-4fdd-bd57-905479351c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:21.549723 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadbd5b-52e2-4fdd-bd57-905479351c37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:21.550378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddadbd5b-52e2-4fdd-bd57-905479351c37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:21.553996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddadbd5b-52e2-4fdd-bd57-905479351c37 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:21.581605 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 934/1868] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:21 2022] POST /identity/v3/users => generated 300 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:21.587409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eccca0-443f-48f8-a24e-84e1bd94e336 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:21.619490 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eccca0-443f-48f8-a24e-84e1bd94e336 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:21.621768 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 935/1869] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:00:21 2022] POST /identity/v3/projects => generated 391 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:21.622693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadbd5b-52e2-4fdd-bd57-905479351c37 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:21.727198 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadbd5b-52e2-4fdd-bd57-905479351c37 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:21.733316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93dfa45-5653-4c6b-8021-5c0a51df30c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:21.734308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93dfa45-5653-4c6b-8021-5c0a51df30c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:21.734597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93dfa45-5653-4c6b-8021-5c0a51df30c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:21.734871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93dfa45-5653-4c6b-8021-5c0a51df30c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:21.736789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93dfa45-5653-4c6b-8021-5c0a51df30c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:21.739247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93dfa45-5653-4c6b-8021-5c0a51df30c8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:21.756789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68cbcf4-997a-4a45-a154-1a4b3cea7cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:21.757658 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68cbcf4-997a-4a45-a154-1a4b3cea7cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:21.757867 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68cbcf4-997a-4a45-a154-1a4b3cea7cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:21.758158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68cbcf4-997a-4a45-a154-1a4b3cea7cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:21.758809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68cbcf4-997a-4a45-a154-1a4b3cea7cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:21.760449 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68cbcf4-997a-4a45-a154-1a4b3cea7cd8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:21.786801 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 935/1871] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:21.787406 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 936/1871] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:21 2022] POST /identity/v3/users => generated 302 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:21.787903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68cbcf4-997a-4a45-a154-1a4b3cea7cd8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:21.788828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93dfa45-5653-4c6b-8021-5c0a51df30c8 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:21.811021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68cbcf4-997a-4a45-a154-1a4b3cea7cd8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:21.813739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93dfa45-5653-4c6b-8021-5c0a51df30c8 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:21.823370 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7b29f-3381-4d44-b885-f2c80ef80d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:21.824501 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ba224-32ae-4066-bc16-0dc540acd2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:21.825248 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ba224-32ae-4066-bc16-0dc540acd2fd admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:21.828031 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ba224-32ae-4066-bc16-0dc540acd2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:21.828413 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ba224-32ae-4066-bc16-0dc540acd2fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:21.829182 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ba224-32ae-4066-bc16-0dc540acd2fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:21.829305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7b29f-3381-4d44-b885-f2c80ef80d3c admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:21.830120 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7b29f-3381-4d44-b885-f2c80ef80d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:21.830471 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7b29f-3381-4d44-b885-f2c80ef80d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:21.831272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7b29f-3381-4d44-b885-f2c80ef80d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:21.831582 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ba224-32ae-4066-bc16-0dc540acd2fd admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:21.833295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7b29f-3381-4d44-b885-f2c80ef80d3c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:21.846169 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 936/1872] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:21.847497 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ba224-32ae-4066-bc16-0dc540acd2fd admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:21.850902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c47ba224-32ae-4066-bc16-0dc540acd2fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:21.869985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ba224-32ae-4066-bc16-0dc540acd2fd admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:21.873426 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 937/1873] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:21.874466 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7b29f-3381-4d44-b885-f2c80ef80d3c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:21.878381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7366f-00ab-4957-844a-f51d8258d5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:21.879830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7366f-00ab-4957-844a-f51d8258d5a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:21.880785 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7366f-00ab-4957-844a-f51d8258d5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:21.881181 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7366f-00ab-4957-844a-f51d8258d5a1 admin admin] PATH_INFO: `/v3/projects/035addf456164d10994a7c3c701e794c` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:21.882552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7366f-00ab-4957-844a-f51d8258d5a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=035addf456164d10994a7c3c701e794c)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:21.884757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7366f-00ab-4957-844a-f51d8258d5a1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:21.890185 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7b29f-3381-4d44-b885-f2c80ef80d3c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:21.899144 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64198937-1fbd-4200-a169-29b93ef6999c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:21.900753 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64198937-1fbd-4200-a169-29b93ef6999c admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:21.902152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64198937-1fbd-4200-a169-29b93ef6999c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:21.903519 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64198937-1fbd-4200-a169-29b93ef6999c admin admin] PATH_INFO: `/v3/projects/54ecfe2a8d3e4ec0b0f86cc71c82ba14/users/d91eb94ab26f4f6f97c90e14a95a3b36/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:21.924334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64198937-1fbd-4200-a169-29b93ef6999c admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ecfe2a8d3e4ec0b0f86cc71c82ba14, user_id=d91eb94ab26f4f6f97c90e14a95a3b36, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:21.935553 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64198937-1fbd-4200-a169-29b93ef6999c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:21.954552 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 938/1874] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:21 2022] PUT /identity/v3/projects/54ecfe2a8d3e4ec0b0f86cc71c82ba14/users/d91eb94ab26f4f6f97c90e14a95a3b36/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:21.955804 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64198937-1fbd-4200-a169-29b93ef6999c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:21.974890 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-47a7366f-00ab-4957-844a-f51d8258d5a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '035addf456164d10994a7c3c701e794c', 'request_id': 'req-47a7366f-00ab-4957-844a-f51d8258d5a1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:21.987912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-47a7366f-00ab-4957-844a-f51d8258d5a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '035addf456164d10994a7c3c701e794c', 'request_id': 'req-47a7366f-00ab-4957-844a-f51d8258d5a1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:21.995906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-47a7366f-00ab-4957-844a-f51d8258d5a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '035addf456164d10994a7c3c701e794c', 'request_id': 'req-47a7366f-00ab-4957-844a-f51d8258d5a1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:22.011838 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:22.016105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-47a7366f-00ab-4957-844a-f51d8258d5a1 admin admin] The token cache is being invalidate because project 035addf456164d10994a7c3c701e794c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:22.016410 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-47a7366f-00ab-4957-844a-f51d8258d5a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:22.023266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-47a7366f-00ab-4957-844a-f51d8258d5a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:22.025826 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 937/1875] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:21 2022] DELETE /identity/v3/projects/035addf456164d10994a7c3c701e794c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:22.026657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7366f-00ab-4957-844a-f51d8258d5a1 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:22.037173 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-47a7366f-00ab-4957-844a-f51d8258d5a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:22.044020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64198937-1fbd-4200-a169-29b93ef6999c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:22.047093 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:22.140868 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7366f-00ab-4957-844a-f51d8258d5a1 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:22.148700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f89f9-2db5-43ad-ab25-5f8fa2317e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:22.149612 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f89f9-2db5-43ad-ab25-5f8fa2317e0a admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:22.150052 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f89f9-2db5-43ad-ab25-5f8fa2317e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:22.150494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f89f9-2db5-43ad-ab25-5f8fa2317e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:22.150679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6dc72c-e54f-4983-90c2-5324d0750032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:22.151463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6dc72c-e54f-4983-90c2-5324d0750032 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:22.151756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6dc72c-e54f-4983-90c2-5324d0750032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:22.151958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f89f9-2db5-43ad-ab25-5f8fa2317e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:22.152200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6dc72c-e54f-4983-90c2-5324d0750032 admin admin] PATH_INFO: `/v3/projects/64847ed3509a48f4bf368038fe86ad43/users/17039b57cea942868f4f8abc6c89fdbb/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:22.154294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f89f9-2db5-43ad-ab25-5f8fa2317e0a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:22.170404 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6dc72c-e54f-4983-90c2-5324d0750032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64847ed3509a48f4bf368038fe86ad43, user_id=17039b57cea942868f4f8abc6c89fdbb, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:22.171530 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 938/1876] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:22.172446 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f89f9-2db5-43ad-ab25-5f8fa2317e0a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:22.173927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6dc72c-e54f-4983-90c2-5324d0750032 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:22.182446 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ea0f89f9-2db5-43ad-ab25-5f8fa2317e0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:22.192166 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 939/1877] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:21 2022] PUT /identity/v3/projects/64847ed3509a48f4bf368038fe86ad43/users/17039b57cea942868f4f8abc6c89fdbb/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:22.194057 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6dc72c-e54f-4983-90c2-5324d0750032 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:22.212018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f89f9-2db5-43ad-ab25-5f8fa2317e0a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:22.283803 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6dc72c-e54f-4983-90c2-5324d0750032 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:22.299727 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0eb13b-0085-46be-9ca9-d8c5b750a780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:22.300426 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0eb13b-0085-46be-9ca9-d8c5b750a780 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:22.300708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0eb13b-0085-46be-9ca9-d8c5b750a780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:22.300983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0eb13b-0085-46be-9ca9-d8c5b750a780 admin admin] PATH_INFO: `/v3/projects/54ecfe2a8d3e4ec0b0f86cc71c82ba14/users/d91eb94ab26f4f6f97c90e14a95a3b36/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:22.303603 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0eb13b-0085-46be-9ca9-d8c5b750a780 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ecfe2a8d3e4ec0b0f86cc71c82ba14, user_id=d91eb94ab26f4f6f97c90e14a95a3b36, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:22.306793 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0eb13b-0085-46be-9ca9-d8c5b750a780 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:22.319111 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 940/1878] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:22 2022] PUT /identity/v3/projects/54ecfe2a8d3e4ec0b0f86cc71c82ba14/users/d91eb94ab26f4f6f97c90e14a95a3b36/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:22.320377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72552e-06d8-44dc-a8f4-f24fdadc0447 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:22.320665 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72552e-06d8-44dc-a8f4-f24fdadc0447 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:22.321068 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72552e-06d8-44dc-a8f4-f24fdadc0447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:22.327664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b5951-2f62-43dd-99c4-13d293db93d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:22.328828 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b5951-2f62-43dd-99c4-13d293db93d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:22.329450 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b5951-2f62-43dd-99c4-13d293db93d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:22.329878 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b5951-2f62-43dd-99c4-13d293db93d7 admin admin] PATH_INFO: `/v3/users/a0b47bb20c2f4257a2a96dfa6fff704e` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:22.331243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b5951-2f62-43dd-99c4-13d293db93d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0b47bb20c2f4257a2a96dfa6fff704e)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:22.333178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b5951-2f62-43dd-99c4-13d293db93d7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:22.362736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-aa72552e-06d8-44dc-a8f4-f24fdadc0447 None None] MFA Rules not processed for user `17039b57cea942868f4f8abc6c89fdbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:22.364244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-aa72552e-06d8-44dc-a8f4-f24fdadc0447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:22.420227 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-978b5951-2f62-43dd-99c4-13d293db93d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0b47bb20c2f4257a2a96dfa6fff704e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:22.421865 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-978b5951-2f62-43dd-99c4-13d293db93d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0b47bb20c2f4257a2a96dfa6fff704e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:22.438720 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-978b5951-2f62-43dd-99c4-13d293db93d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0b47bb20c2f4257a2a96dfa6fff704e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:22.454398 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:22.457306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-978b5951-2f62-43dd-99c4-13d293db93d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0b47bb20c2f4257a2a96dfa6fff704e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:22.458262 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-978b5951-2f62-43dd-99c4-13d293db93d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0b47bb20c2f4257a2a96dfa6fff704e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:22.495811 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 941/1879] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:22 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:22.497389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c81d0-c6b1-46f1-8dd8-e7231dce5695 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:22.500963 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 939/1880] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:00:22 2022] DELETE /identity/v3/users/a0b47bb20c2f4257a2a96dfa6fff704e => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:22.501130 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c81d0-c6b1-46f1-8dd8-e7231dce5695 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:22.501266 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c81d0-c6b1-46f1-8dd8-e7231dce5695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:22.513824 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b5951-2f62-43dd-99c4-13d293db93d7 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:22.515742 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-978b5951-2f62-43dd-99c4-13d293db93d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:22.547722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a66c81d0-c6b1-46f1-8dd8-e7231dce5695 None None] MFA Rules not processed for user `d91eb94ab26f4f6f97c90e14a95a3b36`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:22.549114 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a66c81d0-c6b1-46f1-8dd8-e7231dce5695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:22.552680 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:22.659466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b5951-2f62-43dd-99c4-13d293db93d7 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:22.672374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e748fdb-3764-4f6c-ad4d-4bc2fe922579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:22.673001 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e748fdb-3764-4f6c-ad4d-4bc2fe922579 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:22.673279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e748fdb-3764-4f6c-ad4d-4bc2fe922579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:22.673614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e748fdb-3764-4f6c-ad4d-4bc2fe922579 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:22.674452 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e748fdb-3764-4f6c-ad4d-4bc2fe922579 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:22.679417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e748fdb-3764-4f6c-ad4d-4bc2fe922579 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:22.710663 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 942/1881] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:22 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:22.732921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c81d0-c6b1-46f1-8dd8-e7231dce5695 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:22.734658 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a66c81d0-c6b1-46f1-8dd8-e7231dce5695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:22.740264 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 940/1882] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:00:22 2022] POST /identity/v3/projects => generated 397 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:22.741333 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e748fdb-3764-4f6c-ad4d-4bc2fe922579 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:22.814112 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e748fdb-3764-4f6c-ad4d-4bc2fe922579 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:22.824598 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a0e0f2-9bf4-442d-9a3a-f64dd5ce3292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:22.825513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0e0f2-9bf4-442d-9a3a-f64dd5ce3292 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:22.826101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0e0f2-9bf4-442d-9a3a-f64dd5ce3292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:22.826469 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0e0f2-9bf4-442d-9a3a-f64dd5ce3292 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:22.827210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a0e0f2-9bf4-442d-9a3a-f64dd5ce3292 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:22.829343 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a0e0f2-9bf4-442d-9a3a-f64dd5ce3292 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:22.860739 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 941/1883] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:22 2022] POST /identity/v3/users => generated 305 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:22.864119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a0e0f2-9bf4-442d-9a3a-f64dd5ce3292 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:22.885822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a0e0f2-9bf4-442d-9a3a-f64dd5ce3292 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:22.898420 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7f781-67fa-4035-81bd-5a5f145673f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:22.899396 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7f781-67fa-4035-81bd-5a5f145673f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:22.899858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7f781-67fa-4035-81bd-5a5f145673f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:22.900316 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7f781-67fa-4035-81bd-5a5f145673f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:22.901194 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd7f781-67fa-4035-81bd-5a5f145673f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:22.904351 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd7f781-67fa-4035-81bd-5a5f145673f5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:22.935600 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 942/1884] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:22.942921 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7f781-67fa-4035-81bd-5a5f145673f5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:22.951351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c81d0-c6b1-46f1-8dd8-e7231dce5695 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:22.958936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7f781-67fa-4035-81bd-5a5f145673f5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:22.966081 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f90ce-671a-4fbf-a3ad-8c0abf4b860b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:22.966991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f90ce-671a-4fbf-a3ad-8c0abf4b860b admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:22.967945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f90ce-671a-4fbf-a3ad-8c0abf4b860b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:22.969523 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f90ce-671a-4fbf-a3ad-8c0abf4b860b admin admin] PATH_INFO: `/v3/projects/77bc962e0abe407581460ebf648f9598/users/f87c9d09a2b946829d0832a657fe4bdb/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:22.993205 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f90ce-671a-4fbf-a3ad-8c0abf4b860b admin admin] RBAC: Authorizing `identity:create_grant(project_id=77bc962e0abe407581460ebf648f9598, user_id=f87c9d09a2b946829d0832a657fe4bdb, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:22.995953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f90ce-671a-4fbf-a3ad-8c0abf4b860b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:23.011739 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 943/1885] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:22 2022] PUT /identity/v3/projects/77bc962e0abe407581460ebf648f9598/users/f87c9d09a2b946829d0832a657fe4bdb/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:23.015804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f90ce-671a-4fbf-a3ad-8c0abf4b860b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:23.063213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11cd16-40b6-4ccc-8ca1-6c3b110b838a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:23.066272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11cd16-40b6-4ccc-8ca1-6c3b110b838a service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:23.066756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11cd16-40b6-4ccc-8ca1-6c3b110b838a service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:23.067282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11cd16-40b6-4ccc-8ca1-6c3b110b838a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:23.091733 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f90ce-671a-4fbf-a3ad-8c0abf4b860b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:23.097453 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd208251-acb0-4780-8d77-1bde949d5599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:23.098146 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd208251-acb0-4780-8d77-1bde949d5599 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:23.098491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd208251-acb0-4780-8d77-1bde949d5599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:23.098896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd208251-acb0-4780-8d77-1bde949d5599 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:23.100086 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd208251-acb0-4780-8d77-1bde949d5599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:23.102224 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd208251-acb0-4780-8d77-1bde949d5599 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:23.105947 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:23.117139 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:23.121305 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 944/1886] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:00:23.121305 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd208251-acb0-4780-8d77-1bde949d5599 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:23.123302 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bd208251-acb0-4780-8d77-1bde949d5599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:23.142185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd208251-acb0-4780-8d77-1bde949d5599 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:23.151275 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e1c2a-0c63-41e8-822d-32f201f59c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:23.152049 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e1c2a-0c63-41e8-822d-32f201f59c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:23.152430 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e1c2a-0c63-41e8-822d-32f201f59c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:23.152729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e1c2a-0c63-41e8-822d-32f201f59c0e admin admin] PATH_INFO: `/v3/projects/bff41c3c3ab641359a95669035859c27` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:23.159168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e1c2a-0c63-41e8-822d-32f201f59c0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bff41c3c3ab641359a95669035859c27)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:23.162095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e1c2a-0c63-41e8-822d-32f201f59c0e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:23.232334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11cd16-40b6-4ccc-8ca1-6c3b110b838a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:23.236685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11cd16-40b6-4ccc-8ca1-6c3b110b838a service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:23.263589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e93e1c2a-0c63-41e8-822d-32f201f59c0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bff41c3c3ab641359a95669035859c27', 'request_id': 'req-e93e1c2a-0c63-41e8-822d-32f201f59c0e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:23.268404 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 943/1887] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:22 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:23.269944 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11cd16-40b6-4ccc-8ca1-6c3b110b838a service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:23.274250 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e93e1c2a-0c63-41e8-822d-32f201f59c0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bff41c3c3ab641359a95669035859c27', 'request_id': 'req-e93e1c2a-0c63-41e8-822d-32f201f59c0e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:23.281880 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e93e1c2a-0c63-41e8-822d-32f201f59c0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bff41c3c3ab641359a95669035859c27', 'request_id': 'req-e93e1c2a-0c63-41e8-822d-32f201f59c0e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:23.310602 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e93e1c2a-0c63-41e8-822d-32f201f59c0e admin admin] The token cache is being invalidate because project bff41c3c3ab641359a95669035859c27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:23.310898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e93e1c2a-0c63-41e8-822d-32f201f59c0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:23.311535 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11cd16-40b6-4ccc-8ca1-6c3b110b838a service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:23.318092 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e93e1c2a-0c63-41e8-822d-32f201f59c0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:23.328828 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 945/1888] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:23 2022] DELETE /identity/v3/projects/bff41c3c3ab641359a95669035859c27 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:23.334705 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa84599-6dd6-405a-9874-746457b629ea None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:23.335046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa84599-6dd6-405a-9874-746457b629ea None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:23.335959 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa84599-6dd6-405a-9874-746457b629ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:23.370800 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-2aa84599-6dd6-405a-9874-746457b629ea None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:23.372027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2aa84599-6dd6-405a-9874-746457b629ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:23.416929 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85b6d9-6a6f-4f94-ad11-fae8af8118b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:23.418790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85b6d9-6a6f-4f94-ad11-fae8af8118b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:23.419227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85b6d9-6a6f-4f94-ad11-fae8af8118b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:23.420025 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85b6d9-6a6f-4f94-ad11-fae8af8118b3 admin admin] PATH_INFO: `/v3/projects/77bc962e0abe407581460ebf648f9598/users/f87c9d09a2b946829d0832a657fe4bdb/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:23.423038 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b85b6d9-6a6f-4f94-ad11-fae8af8118b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77bc962e0abe407581460ebf648f9598, user_id=f87c9d09a2b946829d0832a657fe4bdb, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:23.427303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b85b6d9-6a6f-4f94-ad11-fae8af8118b3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:23.441079 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 944/1889] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:23 2022] PUT /identity/v3/projects/77bc962e0abe407581460ebf648f9598/users/f87c9d09a2b946829d0832a657fe4bdb/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:23.453622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485357d-fb18-48eb-ab53-e54a844439f8 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:23.453909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485357d-fb18-48eb-ab53-e54a844439f8 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:23.454187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485357d-fb18-48eb-ab53-e54a844439f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:23.463087 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 946/1890] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:23.472526 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bac99-0060-406c-ba30-9ec3daaa3d10 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:23.472825 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bac99-0060-406c-ba30-9ec3daaa3d10 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:23.473133 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bac99-0060-406c-ba30-9ec3daaa3d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:23.498296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c96bac99-0060-406c-ba30-9ec3daaa3d10 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:23.499718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c96bac99-0060-406c-ba30-9ec3daaa3d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:23.520394 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-9485357d-fb18-48eb-ab53-e54a844439f8 None None] MFA Rules not processed for user `f87c9d09a2b946829d0832a657fe4bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:23.522592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9485357d-fb18-48eb-ab53-e54a844439f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:23.635412 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 945/1891] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:23 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:23.641228 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 947/1892] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:23.647526 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485357d-fb18-48eb-ab53-e54a844439f8 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:23.660518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485357d-fb18-48eb-ab53-e54a844439f8 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:23.666389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f8333-8320-4ee8-bc4a-3127214c5d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:23.667789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f8333-8320-4ee8-bc4a-3127214c5d3b admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:23.668185 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f8333-8320-4ee8-bc4a-3127214c5d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:23.668666 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f8333-8320-4ee8-bc4a-3127214c5d3b admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:23.669643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f8333-8320-4ee8-bc4a-3127214c5d3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:00:23.677753 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f8333-8320-4ee8-bc4a-3127214c5d3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:23.679750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f8333-8320-4ee8-bc4a-3127214c5d3b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:23.701197 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96bac99-0060-406c-ba30-9ec3daaa3d10 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:23.702812 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 946/1893] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:00:23.703301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c96bac99-0060-406c-ba30-9ec3daaa3d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:23.703804 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f8333-8320-4ee8-bc4a-3127214c5d3b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:23.705734 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7f0f8333-8320-4ee8-bc4a-3127214c5d3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:23.733818 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f8333-8320-4ee8-bc4a-3127214c5d3b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:23.746772 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:23.747159 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a822daa-4c0b-45cf-af24-d634e663b99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:23.747908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a822daa-4c0b-45cf-af24-d634e663b99f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:23.748093 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a822daa-4c0b-45cf-af24-d634e663b99f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:23.748402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a822daa-4c0b-45cf-af24-d634e663b99f admin admin] PATH_INFO: `/v3/users/d7f61b6252fd4b279dd33bfc4ce41663` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:23.752283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a822daa-4c0b-45cf-af24-d634e663b99f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7f61b6252fd4b279dd33bfc4ce41663)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:23.754347 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a822daa-4c0b-45cf-af24-d634e663b99f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:23.769636 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:23.822003 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96bac99-0060-406c-ba30-9ec3daaa3d10 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:23.827868 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9f230-9267-490f-a2a0-68165d229654 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:23.828698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9f230-9267-490f-a2a0-68165d229654 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:23.829113 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9f230-9267-490f-a2a0-68165d229654 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:23.829285 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9f230-9267-490f-a2a0-68165d229654 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:23.831526 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-37a9f230-9267-490f-a2a0-68165d229654 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:23.853484 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6a822daa-4c0b-45cf-af24-d634e663b99f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7f61b6252fd4b279dd33bfc4ce41663'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:23.853484 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6a822daa-4c0b-45cf-af24-d634e663b99f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7f61b6252fd4b279dd33bfc4ce41663'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:23.871802 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6a822daa-4c0b-45cf-af24-d634e663b99f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7f61b6252fd4b279dd33bfc4ce41663'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:23.882493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6a822daa-4c0b-45cf-af24-d634e663b99f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7f61b6252fd4b279dd33bfc4ce41663'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:23.883744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6a822daa-4c0b-45cf-af24-d634e663b99f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7f61b6252fd4b279dd33bfc4ce41663'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:23.911119 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 947/1894] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:00:23 2022] DELETE /identity/v3/users/d7f61b6252fd4b279dd33bfc4ce41663 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:23.912304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a822daa-4c0b-45cf-af24-d634e663b99f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:23.915416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6a822daa-4c0b-45cf-af24-d634e663b99f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:23.928534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9f230-9267-490f-a2a0-68165d229654 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:23.930903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9f230-9267-490f-a2a0-68165d229654 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:23.948385 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 948/1895] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:23 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:00:23.949918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6f588-8818-4c29-90a5-dc8d57a70302 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:23.950198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6f588-8818-4c29-90a5-dc8d57a70302 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:23.950500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6f588-8818-4c29-90a5-dc8d57a70302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:23.987885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-21c6f588-8818-4c29-90a5-dc8d57a70302 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:23.989041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-21c6f588-8818-4c29-90a5-dc8d57a70302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:24.035239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a822daa-4c0b-45cf-af24-d634e663b99f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:24.041276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c93913-0cc9-4fdc-950c-37286615055a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:24.042329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c93913-0cc9-4fdc-950c-37286615055a admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:24.042829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c93913-0cc9-4fdc-950c-37286615055a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:24.043324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c93913-0cc9-4fdc-950c-37286615055a admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:24.045120 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c93913-0cc9-4fdc-950c-37286615055a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:24.053086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c93913-0cc9-4fdc-950c-37286615055a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:24.091410 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 948/1896] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:00:23 2022] POST /identity/v3/projects => generated 359 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:24.092504 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c93913-0cc9-4fdc-950c-37286615055a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:24.094353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e0c93913-0cc9-4fdc-950c-37286615055a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:24.106976 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 949/1897] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:24.108646 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6f588-8818-4c29-90a5-dc8d57a70302 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:24.141655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6f588-8818-4c29-90a5-dc8d57a70302 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:24.200613 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c93913-0cc9-4fdc-950c-37286615055a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:24.200846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bddf32-bd7b-48c8-bc83-1dcccb3c007d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:24.201500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bddf32-bd7b-48c8-bc83-1dcccb3c007d admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:24.201705 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bddf32-bd7b-48c8-bc83-1dcccb3c007d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:24.201997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bddf32-bd7b-48c8-bc83-1dcccb3c007d admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:24.202614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bddf32-bd7b-48c8-bc83-1dcccb3c007d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:24.204882 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bddf32-bd7b-48c8-bc83-1dcccb3c007d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:24.207574 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c336d-265d-4ab9-9d81-d54876e19587 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:24.208259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c336d-265d-4ab9-9d81-d54876e19587 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:24.209137 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c336d-265d-4ab9-9d81-d54876e19587 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:24.209415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c336d-265d-4ab9-9d81-d54876e19587 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:24.211287 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-280c336d-265d-4ab9-9d81-d54876e19587 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:24.215749 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:24.216894 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:24.234485 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 950/1898] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:24 2022] POST /identity/v3/users => generated 280 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:24.236126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bddf32-bd7b-48c8-bc83-1dcccb3c007d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:24.238827 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-94bddf32-bd7b-48c8-bc83-1dcccb3c007d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:24.301206 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bddf32-bd7b-48c8-bc83-1dcccb3c007d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:24.303808 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c336d-265d-4ab9-9d81-d54876e19587 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:24.304943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8416508-f4db-4b75-95b8-a6d9f1ebbbc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:24.305600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8416508-f4db-4b75-95b8-a6d9f1ebbbc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:24.305783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c336d-265d-4ab9-9d81-d54876e19587 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:24.305897 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8416508-f4db-4b75-95b8-a6d9f1ebbbc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:24.306168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8416508-f4db-4b75-95b8-a6d9f1ebbbc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:24.317310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8416508-f4db-4b75-95b8-a6d9f1ebbbc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:24.319356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8416508-f4db-4b75-95b8-a6d9f1ebbbc4 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:24.319692 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 949/1899] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:24 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:24.322344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c336d-265d-4ab9-9d81-d54876e19587 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:24.334345 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 951/1900] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:24.347106 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c336d-265d-4ab9-9d81-d54876e19587 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:24.353916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096bed0-f982-4127-886b-c3174c25d882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:24.354433 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096bed0-f982-4127-886b-c3174c25d882 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:24.354719 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096bed0-f982-4127-886b-c3174c25d882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:24.354984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096bed0-f982-4127-886b-c3174c25d882 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:24.355965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096bed0-f982-4127-886b-c3174c25d882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:24.357670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096bed0-f982-4127-886b-c3174c25d882 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:24.371414 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 950/1901] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:24.375168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8416508-f4db-4b75-95b8-a6d9f1ebbbc4 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:24.388591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8416508-f4db-4b75-95b8-a6d9f1ebbbc4 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:24.396806 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b0f13-0bef-4bf9-b2cb-0161feb93869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:24.397815 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b0f13-0bef-4bf9-b2cb-0161feb93869 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:24.398210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b0f13-0bef-4bf9-b2cb-0161feb93869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:24.398669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b0f13-0bef-4bf9-b2cb-0161feb93869 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:24.399434 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b0f13-0bef-4bf9-b2cb-0161feb93869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:24.401340 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b0f13-0bef-4bf9-b2cb-0161feb93869 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:24.426511 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 952/1902] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:00:24.427913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096bed0-f982-4127-886b-c3174c25d882 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:24.455138 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096bed0-f982-4127-886b-c3174c25d882 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:24.477971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bcd2f-5247-4cb5-a0ae-8798d9e746e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:24.478661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bcd2f-5247-4cb5-a0ae-8798d9e746e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:24.478944 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bcd2f-5247-4cb5-a0ae-8798d9e746e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:24.479210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bcd2f-5247-4cb5-a0ae-8798d9e746e4 admin admin] PATH_INFO: `/v3/projects/f1c77a8482934a0b863a652fd957cafc/users/a5c41b200dad41c3b587e3d55f604d86/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:24.579989 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175bcd2f-5247-4cb5-a0ae-8798d9e746e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1c77a8482934a0b863a652fd957cafc, user_id=a5c41b200dad41c3b587e3d55f604d86, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:24.586510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175bcd2f-5247-4cb5-a0ae-8798d9e746e4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:24.657156 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 951/1903] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:24 2022] PUT /identity/v3/projects/f1c77a8482934a0b863a652fd957cafc/users/a5c41b200dad41c3b587e3d55f604d86/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:24.659963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3aa4c-bfe1-4a50-a3ff-0d004bb85107 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:24.659963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3aa4c-bfe1-4a50-a3ff-0d004bb85107 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:24.659963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3aa4c-bfe1-4a50-a3ff-0d004bb85107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:24.674521 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bcd2f-5247-4cb5-a0ae-8798d9e746e4 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:24.683306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-175bcd2f-5247-4cb5-a0ae-8798d9e746e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:24.790478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-16b3aa4c-bfe1-4a50-a3ff-0d004bb85107 None None] MFA Rules not processed for user `a5c41b200dad41c3b587e3d55f604d86`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:24.791629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-16b3aa4c-bfe1-4a50-a3ff-0d004bb85107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:24.850424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bcd2f-5247-4cb5-a0ae-8798d9e746e4 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:24.858853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158b5c4-0fe2-426a-ad12-af0a0d5c67c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:24.859948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158b5c4-0fe2-426a-ad12-af0a0d5c67c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:24.860348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158b5c4-0fe2-426a-ad12-af0a0d5c67c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:24.860562 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158b5c4-0fe2-426a-ad12-af0a0d5c67c2 admin admin] PATH_INFO: `/v3/users/17039b57cea942868f4f8abc6c89fdbb` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:24.861945 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158b5c4-0fe2-426a-ad12-af0a0d5c67c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17039b57cea942868f4f8abc6c89fdbb)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:24.863927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158b5c4-0fe2-426a-ad12-af0a0d5c67c2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:24.910612 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 953/1904] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:24 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:24.916966 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3aa4c-bfe1-4a50-a3ff-0d004bb85107 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:24.953620 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3aa4c-bfe1-4a50-a3ff-0d004bb85107 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:24.968654 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676cad5-04c0-4067-bb00-6c4cce0dd520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:24.969337 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676cad5-04c0-4067-bb00-6c4cce0dd520 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:24.969651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676cad5-04c0-4067-bb00-6c4cce0dd520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:24.969928 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676cad5-04c0-4067-bb00-6c4cce0dd520 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:24.970751 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8676cad5-04c0-4067-bb00-6c4cce0dd520 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:24.972825 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8676cad5-04c0-4067-bb00-6c4cce0dd520 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:24.993591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b158b5c4-0fe2-426a-ad12-af0a0d5c67c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17039b57cea942868f4f8abc6c89fdbb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:24.994380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b158b5c4-0fe2-426a-ad12-af0a0d5c67c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17039b57cea942868f4f8abc6c89fdbb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:25.007752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b158b5c4-0fe2-426a-ad12-af0a0d5c67c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17039b57cea942868f4f8abc6c89fdbb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:25.023960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b158b5c4-0fe2-426a-ad12-af0a0d5c67c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17039b57cea942868f4f8abc6c89fdbb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:25.024811 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b158b5c4-0fe2-426a-ad12-af0a0d5c67c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17039b57cea942868f4f8abc6c89fdbb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:25.033348 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:25.040418 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 954/1905] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:00:24 2022] POST /identity/v3/projects => generated 359 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:00:25.042424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676cad5-04c0-4067-bb00-6c4cce0dd520 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:25.047282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8676cad5-04c0-4067-bb00-6c4cce0dd520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:25.106431 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 952/1906] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:00:24 2022] DELETE /identity/v3/users/17039b57cea942868f4f8abc6c89fdbb => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:25.107657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158b5c4-0fe2-426a-ad12-af0a0d5c67c2 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:25.109369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b158b5c4-0fe2-426a-ad12-af0a0d5c67c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:25.141249 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:25.189977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676cad5-04c0-4067-bb00-6c4cce0dd520 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:25.294383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158b5c4-0fe2-426a-ad12-af0a0d5c67c2 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:25.309599 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d810c-36d7-46cd-aa7e-93e03dcafa3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:25.310677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d810c-36d7-46cd-aa7e-93e03dcafa3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:25.310965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d810c-36d7-46cd-aa7e-93e03dcafa3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:25.311306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d810c-36d7-46cd-aa7e-93e03dcafa3a admin admin] PATH_INFO: `/v3/projects/9fbdbc4d0f8f4ef295fcf2cdd01c89b6` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:25.312271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f009f-2a59-42fe-a42b-5add6133eec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:25.312688 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d810c-36d7-46cd-aa7e-93e03dcafa3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fbdbc4d0f8f4ef295fcf2cdd01c89b6)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:25.313295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f009f-2a59-42fe-a42b-5add6133eec8 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:25.313731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f009f-2a59-42fe-a42b-5add6133eec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:25.314246 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f009f-2a59-42fe-a42b-5add6133eec8 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:25.314965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f009f-2a59-42fe-a42b-5add6133eec8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:25.315395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d810c-36d7-46cd-aa7e-93e03dcafa3a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:25.319473 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f009f-2a59-42fe-a42b-5add6133eec8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:25.359263 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 953/1907] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:25 2022] POST /identity/v3/users => generated 286 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:25.361517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4f30c-d4b7-49f8-ad1d-e0eb90cf6a72 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:25.361800 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4f30c-d4b7-49f8-ad1d-e0eb90cf6a72 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:25.362117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4f30c-d4b7-49f8-ad1d-e0eb90cf6a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:25.402059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-1ea4f30c-d4b7-49f8-ad1d-e0eb90cf6a72 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:25.403397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6b0d810c-36d7-46cd-aa7e-93e03dcafa3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fbdbc4d0f8f4ef295fcf2cdd01c89b6', 'request_id': 'req-6b0d810c-36d7-46cd-aa7e-93e03dcafa3a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:25.408199 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1ea4f30c-d4b7-49f8-ad1d-e0eb90cf6a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:25.415161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6b0d810c-36d7-46cd-aa7e-93e03dcafa3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fbdbc4d0f8f4ef295fcf2cdd01c89b6', 'request_id': 'req-6b0d810c-36d7-46cd-aa7e-93e03dcafa3a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:25.423110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6b0d810c-36d7-46cd-aa7e-93e03dcafa3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fbdbc4d0f8f4ef295fcf2cdd01c89b6', 'request_id': 'req-6b0d810c-36d7-46cd-aa7e-93e03dcafa3a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:25.456312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6b0d810c-36d7-46cd-aa7e-93e03dcafa3a admin admin] The token cache is being invalidate because project 9fbdbc4d0f8f4ef295fcf2cdd01c89b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:25.456638 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6b0d810c-36d7-46cd-aa7e-93e03dcafa3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:25.457317 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6b0d810c-36d7-46cd-aa7e-93e03dcafa3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:25.459105 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 955/1908] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:25 2022] DELETE /identity/v3/projects/9fbdbc4d0f8f4ef295fcf2cdd01c89b6 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:25.459675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d810c-36d7-46cd-aa7e-93e03dcafa3a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:25.461090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6b0d810c-36d7-46cd-aa7e-93e03dcafa3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:25.502838 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 954/1909] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:25.503925 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4f30c-d4b7-49f8-ad1d-e0eb90cf6a72 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:25.511314 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1ea4f30c-d4b7-49f8-ad1d-e0eb90cf6a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:25.523966 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4f30c-d4b7-49f8-ad1d-e0eb90cf6a72 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:25.530996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a2243-5fd9-40a7-b98c-be20393ef425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:25.531639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a2243-5fd9-40a7-b98c-be20393ef425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:25.531940 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a2243-5fd9-40a7-b98c-be20393ef425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:25.532225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a2243-5fd9-40a7-b98c-be20393ef425 admin admin] PATH_INFO: `/v3/users/d91eb94ab26f4f6f97c90e14a95a3b36` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:25.533380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a2243-5fd9-40a7-b98c-be20393ef425 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d91eb94ab26f4f6f97c90e14a95a3b36)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:25.535340 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a2243-5fd9-40a7-b98c-be20393ef425 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:25.545779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d810c-36d7-46cd-aa7e-93e03dcafa3a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:25.550743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf538437-5948-42c4-9d3f-85a87d59183a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:25.551603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf538437-5948-42c4-9d3f-85a87d59183a admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:25.552102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf538437-5948-42c4-9d3f-85a87d59183a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:25.552978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf538437-5948-42c4-9d3f-85a87d59183a admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:25.553670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf538437-5948-42c4-9d3f-85a87d59183a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:25.555311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf538437-5948-42c4-9d3f-85a87d59183a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:25.565902 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 956/1910] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:25.566847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf538437-5948-42c4-9d3f-85a87d59183a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:25.570362 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-cf538437-5948-42c4-9d3f-85a87d59183a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:25.598480 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:25.606554 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7c7a2243-5fd9-40a7-b98c-be20393ef425 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd91eb94ab26f4f6f97c90e14a95a3b36'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:25.607327 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7c7a2243-5fd9-40a7-b98c-be20393ef425 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd91eb94ab26f4f6f97c90e14a95a3b36'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:25.624052 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7c7a2243-5fd9-40a7-b98c-be20393ef425 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd91eb94ab26f4f6f97c90e14a95a3b36'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:25.632475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7c7a2243-5fd9-40a7-b98c-be20393ef425 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd91eb94ab26f4f6f97c90e14a95a3b36'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:25.633296 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7c7a2243-5fd9-40a7-b98c-be20393ef425 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd91eb94ab26f4f6f97c90e14a95a3b36'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:25.639886 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf538437-5948-42c4-9d3f-85a87d59183a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:25.643418 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:25.643653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ca9260-907d-4e16-ac2e-be3d95e98db1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:25.644565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca9260-907d-4e16-ac2e-be3d95e98db1 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:25.644565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca9260-907d-4e16-ac2e-be3d95e98db1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:25.644851 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca9260-907d-4e16-ac2e-be3d95e98db1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:25.646867 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-81ca9260-907d-4e16-ac2e-be3d95e98db1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:25.659852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ca9260-907d-4e16-ac2e-be3d95e98db1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:25.661829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ca9260-907d-4e16-ac2e-be3d95e98db1 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:25.663883 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 955/1911] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:00:25 2022] DELETE /identity/v3/users/d91eb94ab26f4f6f97c90e14a95a3b36 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:25.664766 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a2243-5fd9-40a7-b98c-be20393ef425 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:25.666387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7c7a2243-5fd9-40a7-b98c-be20393ef425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:25.675126 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 957/1912] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:25.749982 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a2243-5fd9-40a7-b98c-be20393ef425 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:25.758179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837d352-0c7b-4c83-ac15-1ca38954289f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:25.758751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837d352-0c7b-4c83-ac15-1ca38954289f admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:25.759611 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837d352-0c7b-4c83-ac15-1ca38954289f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:25.759806 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837d352-0c7b-4c83-ac15-1ca38954289f admin admin] PATH_INFO: `/v3/projects/169814b97edb47549269b3ee157857f3/users/8970abbf7d984aecb244a5b96db29b21/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:25.792199 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837d352-0c7b-4c83-ac15-1ca38954289f admin admin] RBAC: Authorizing `identity:create_grant(project_id=169814b97edb47549269b3ee157857f3, user_id=8970abbf7d984aecb244a5b96db29b21, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:25.796632 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837d352-0c7b-4c83-ac15-1ca38954289f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:25.825013 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 956/1913] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:25 2022] PUT /identity/v3/projects/169814b97edb47549269b3ee157857f3/users/8970abbf7d984aecb244a5b96db29b21/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:25.828908 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ca9260-907d-4e16-ac2e-be3d95e98db1 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:25.848699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ca9260-907d-4e16-ac2e-be3d95e98db1 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:26.003140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb1df0-d1cf-4dd9-b5d5-c53f6d6cf470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:26.003745 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb1df0-d1cf-4dd9-b5d5-c53f6d6cf470 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:26.004035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb1df0-d1cf-4dd9-b5d5-c53f6d6cf470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:26.004316 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb1df0-d1cf-4dd9-b5d5-c53f6d6cf470 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:26.005037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb1df0-d1cf-4dd9-b5d5-c53f6d6cf470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:26.006829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb1df0-d1cf-4dd9-b5d5-c53f6d6cf470 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:26.037618 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 958/1914] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:26.038866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837d352-0c7b-4c83-ac15-1ca38954289f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:26.052011 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837d352-0c7b-4c83-ac15-1ca38954289f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:26.057455 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db281716-92d2-4d0e-af1d-bf28dcae376e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:26.058472 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db281716-92d2-4d0e-af1d-bf28dcae376e admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:26.058939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db281716-92d2-4d0e-af1d-bf28dcae376e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:26.059409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db281716-92d2-4d0e-af1d-bf28dcae376e admin admin] PATH_INFO: `/v3/projects/169814b97edb47549269b3ee157857f3/users/8970abbf7d984aecb244a5b96db29b21/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:26.061911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db281716-92d2-4d0e-af1d-bf28dcae376e admin admin] RBAC: Authorizing `identity:create_grant(project_id=169814b97edb47549269b3ee157857f3, user_id=8970abbf7d984aecb244a5b96db29b21, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:26.064906 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db281716-92d2-4d0e-af1d-bf28dcae376e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:26.077518 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 957/1915] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:26 2022] PUT /identity/v3/projects/169814b97edb47549269b3ee157857f3/users/8970abbf7d984aecb244a5b96db29b21/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:26.089905 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ab69f-5d3f-480d-9619-3451aefd48f0 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:26.090667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ab69f-5d3f-480d-9619-3451aefd48f0 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:26.091173 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ab69f-5d3f-480d-9619-3451aefd48f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:26.133622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-069ab69f-5d3f-480d-9619-3451aefd48f0 None None] MFA Rules not processed for user `8970abbf7d984aecb244a5b96db29b21`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:26.135477 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-069ab69f-5d3f-480d-9619-3451aefd48f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:26.252597 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 959/1916] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:26 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:26.260015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db281716-92d2-4d0e-af1d-bf28dcae376e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:26.262083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-db281716-92d2-4d0e-af1d-bf28dcae376e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:26.315324 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ab69f-5d3f-480d-9619-3451aefd48f0 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:26.322246 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-069ab69f-5d3f-480d-9619-3451aefd48f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:26.468158 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db281716-92d2-4d0e-af1d-bf28dcae376e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:26.470544 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:26.487446 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790a541-2288-4ff7-a705-dbba267f0c3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:26.487446 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790a541-2288-4ff7-a705-dbba267f0c3f service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:26.487446 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790a541-2288-4ff7-a705-dbba267f0c3f service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:26.487446 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790a541-2288-4ff7-a705-dbba267f0c3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:26.509475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790a541-2288-4ff7-a705-dbba267f0c3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:26.522178 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790a541-2288-4ff7-a705-dbba267f0c3f service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:26.536895 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 958/1917] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:26 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:26.536895 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790a541-2288-4ff7-a705-dbba267f0c3f service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:26.541568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ab69f-5d3f-480d-9619-3451aefd48f0 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:26.544756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f790a541-2288-4ff7-a705-dbba267f0c3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:26.570448 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689966c6-9166-4b8d-a19b-96800a76e5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:26.571722 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689966c6-9166-4b8d-a19b-96800a76e5e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:26.572264 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689966c6-9166-4b8d-a19b-96800a76e5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:26.572544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689966c6-9166-4b8d-a19b-96800a76e5e7 admin admin] PATH_INFO: `/v3/projects/64847ed3509a48f4bf368038fe86ad43` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:26.576580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689966c6-9166-4b8d-a19b-96800a76e5e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64847ed3509a48f4bf368038fe86ad43)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:26.576896 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790a541-2288-4ff7-a705-dbba267f0c3f service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:26.579403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689966c6-9166-4b8d-a19b-96800a76e5e7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:26.589266 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7203a-37c9-49e3-b792-9f151db651ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:26.591361 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7203a-37c9-49e3-b792-9f151db651ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:26.591641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7203a-37c9-49e3-b792-9f151db651ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:26.591922 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7203a-37c9-49e3-b792-9f151db651ff admin admin] PATH_INFO: `/v3/projects/54ecfe2a8d3e4ec0b0f86cc71c82ba14` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:26.594984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da7203a-37c9-49e3-b792-9f151db651ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=54ecfe2a8d3e4ec0b0f86cc71c82ba14)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:26.597280 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da7203a-37c9-49e3-b792-9f151db651ff admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:26.682588 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:26.697820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-689966c6-9166-4b8d-a19b-96800a76e5e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64847ed3509a48f4bf368038fe86ad43', 'request_id': 'req-689966c6-9166-4b8d-a19b-96800a76e5e7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:26.703177 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2da7203a-37c9-49e3-b792-9f151db651ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54ecfe2a8d3e4ec0b0f86cc71c82ba14', 'request_id': 'req-2da7203a-37c9-49e3-b792-9f151db651ff'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:26.711637 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-689966c6-9166-4b8d-a19b-96800a76e5e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64847ed3509a48f4bf368038fe86ad43', 'request_id': 'req-689966c6-9166-4b8d-a19b-96800a76e5e7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:26.715148 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2da7203a-37c9-49e3-b792-9f151db651ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54ecfe2a8d3e4ec0b0f86cc71c82ba14', 'request_id': 'req-2da7203a-37c9-49e3-b792-9f151db651ff'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:26.725803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-689966c6-9166-4b8d-a19b-96800a76e5e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64847ed3509a48f4bf368038fe86ad43', 'request_id': 'req-689966c6-9166-4b8d-a19b-96800a76e5e7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:26.728292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2da7203a-37c9-49e3-b792-9f151db651ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54ecfe2a8d3e4ec0b0f86cc71c82ba14', 'request_id': 'req-2da7203a-37c9-49e3-b792-9f151db651ff'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:26.745204 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-689966c6-9166-4b8d-a19b-96800a76e5e7 admin admin] The token cache is being invalidate because project 64847ed3509a48f4bf368038fe86ad43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:26.745705 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-689966c6-9166-4b8d-a19b-96800a76e5e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:26.747415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-689966c6-9166-4b8d-a19b-96800a76e5e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:26.749713 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 960/1918] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:26 2022] DELETE /identity/v3/projects/64847ed3509a48f4bf368038fe86ad43 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:26.751573 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2da7203a-37c9-49e3-b792-9f151db651ff admin admin] The token cache is being invalidate because project 54ecfe2a8d3e4ec0b0f86cc71c82ba14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:26.751869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2da7203a-37c9-49e3-b792-9f151db651ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:26.752991 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2da7203a-37c9-49e3-b792-9f151db651ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:26.754137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689966c6-9166-4b8d-a19b-96800a76e5e7 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:26.754836 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 959/1919] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:26 2022] DELETE /identity/v3/projects/54ecfe2a8d3e4ec0b0f86cc71c82ba14 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:26.756183 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-689966c6-9166-4b8d-a19b-96800a76e5e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:26.759448 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f89187-348f-4eb8-82d1-c116c3527bfe None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:26.759740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f89187-348f-4eb8-82d1-c116c3527bfe None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:26.760003 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f89187-348f-4eb8-82d1-c116c3527bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:26.781695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-69f89187-348f-4eb8-82d1-c116c3527bfe None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:26.782915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-69f89187-348f-4eb8-82d1-c116c3527bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:26.855422 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689966c6-9166-4b8d-a19b-96800a76e5e7 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:26.885701 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 960/1920] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:26.893601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78badc55-1332-4a5d-a6c8-431ded1b3d14 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:26.894070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78badc55-1332-4a5d-a6c8-431ded1b3d14 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:26.894275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78badc55-1332-4a5d-a6c8-431ded1b3d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:26.920947 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-78badc55-1332-4a5d-a6c8-431ded1b3d14 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:26.922331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-78badc55-1332-4a5d-a6c8-431ded1b3d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:26.930615 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 961/1921] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:26.932153 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e5168-2aea-4ad9-9ca0-77d7f2ad96b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:26.933496 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e5168-2aea-4ad9-9ca0-77d7f2ad96b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:26.933496 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e5168-2aea-4ad9-9ca0-77d7f2ad96b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:26.933496 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e5168-2aea-4ad9-9ca0-77d7f2ad96b5 admin admin] PATH_INFO: `/v3/users/f87c9d09a2b946829d0832a657fe4bdb` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:26.934548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e5168-2aea-4ad9-9ca0-77d7f2ad96b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f87c9d09a2b946829d0832a657fe4bdb)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:26.934995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78badc55-1332-4a5d-a6c8-431ded1b3d14 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:26.936461 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e5168-2aea-4ad9-9ca0-77d7f2ad96b5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:26.944674 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78badc55-1332-4a5d-a6c8-431ded1b3d14 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:26.949672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f24f32-8d94-4fbb-a218-1f4a0dbf2d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:26.950403 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f24f32-8d94-4fbb-a218-1f4a0dbf2d24 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:26.950808 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f24f32-8d94-4fbb-a218-1f4a0dbf2d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:26.951166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f24f32-8d94-4fbb-a218-1f4a0dbf2d24 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:26.951941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f24f32-8d94-4fbb-a218-1f4a0dbf2d24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:00:26.952333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f24f32-8d94-4fbb-a218-1f4a0dbf2d24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:26.954084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f24f32-8d94-4fbb-a218-1f4a0dbf2d24 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:26.968111 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:26.972734 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 962/1922] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:00:26.974889 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f24f32-8d94-4fbb-a218-1f4a0dbf2d24 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:26.987589 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f24f32-8d94-4fbb-a218-1f4a0dbf2d24 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:26.993232 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b10e5168-2aea-4ad9-9ca0-77d7f2ad96b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f87c9d09a2b946829d0832a657fe4bdb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:26.993392 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64085e0e-13ac-4baf-bf62-3efa579ef66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:26.994000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64085e0e-13ac-4baf-bf62-3efa579ef66f admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:26.994353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64085e0e-13ac-4baf-bf62-3efa579ef66f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:26.994606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b10e5168-2aea-4ad9-9ca0-77d7f2ad96b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f87c9d09a2b946829d0832a657fe4bdb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:26.994716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64085e0e-13ac-4baf-bf62-3efa579ef66f admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:26.995437 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64085e0e-13ac-4baf-bf62-3efa579ef66f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:26.997747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64085e0e-13ac-4baf-bf62-3efa579ef66f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:27.003066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b10e5168-2aea-4ad9-9ca0-77d7f2ad96b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f87c9d09a2b946829d0832a657fe4bdb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:27.014873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b10e5168-2aea-4ad9-9ca0-77d7f2ad96b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f87c9d09a2b946829d0832a657fe4bdb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:27.016259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b10e5168-2aea-4ad9-9ca0-77d7f2ad96b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f87c9d09a2b946829d0832a657fe4bdb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:27.039832 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 961/1923] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:00:26 2022] DELETE /identity/v3/users/f87c9d09a2b946829d0832a657fe4bdb => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:00:27.040898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e5168-2aea-4ad9-9ca0-77d7f2ad96b5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:27.042216 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 963/1924] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:00:26 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:27.042655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b10e5168-2aea-4ad9-9ca0-77d7f2ad96b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:27.045975 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64085e0e-13ac-4baf-bf62-3efa579ef66f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:27.048109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-64085e0e-13ac-4baf-bf62-3efa579ef66f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:27.144783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64085e0e-13ac-4baf-bf62-3efa579ef66f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:27.154095 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bcf61-337b-4316-939d-9c3d3acd7126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:27.154838 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bcf61-337b-4316-939d-9c3d3acd7126 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:27.155755 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bcf61-337b-4316-939d-9c3d3acd7126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:27.156278 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bcf61-337b-4316-939d-9c3d3acd7126 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:27.156900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649bcf61-337b-4316-939d-9c3d3acd7126 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:27.159153 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649bcf61-337b-4316-939d-9c3d3acd7126 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:27.159513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e5168-2aea-4ad9-9ca0-77d7f2ad96b5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:27.164769 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8cdf6-be27-4bae-9550-190a0c339251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:27.165557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8cdf6-be27-4bae-9550-190a0c339251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:27.165908 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8cdf6-be27-4bae-9550-190a0c339251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:27.166248 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8cdf6-be27-4bae-9550-190a0c339251 admin admin] PATH_INFO: `/v3/users/a5c41b200dad41c3b587e3d55f604d86` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:27.167653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f8cdf6-be27-4bae-9550-190a0c339251 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5c41b200dad41c3b587e3d55f604d86)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:27.170032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f8cdf6-be27-4bae-9550-190a0c339251 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:27.204208 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 964/1925] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:27 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:00:27.205374 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bcf61-337b-4316-939d-9c3d3acd7126 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:27.216072 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bcf61-337b-4316-939d-9c3d3acd7126 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:27.221465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13b697-cd2e-45b5-b2b6-ad9109f7cb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:27.222099 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13b697-cd2e-45b5-b2b6-ad9109f7cb6e admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:27.222445 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13b697-cd2e-45b5-b2b6-ad9109f7cb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:27.222813 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13b697-cd2e-45b5-b2b6-ad9109f7cb6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:27.223429 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac13b697-cd2e-45b5-b2b6-ad9109f7cb6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:27.225624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac13b697-cd2e-45b5-b2b6-ad9109f7cb6e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:27.237766 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 965/1926] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:27.241613 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13b697-cd2e-45b5-b2b6-ad9109f7cb6e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:27.247127 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:27.252751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13b697-cd2e-45b5-b2b6-ad9109f7cb6e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:27.256432 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-21f8cdf6-be27-4bae-9550-190a0c339251 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5c41b200dad41c3b587e3d55f604d86'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:27.258146 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-21f8cdf6-be27-4bae-9550-190a0c339251 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5c41b200dad41c3b587e3d55f604d86'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:27.260695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82736af2-ceff-4881-bd77-9fed363ac648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:27.261762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82736af2-ceff-4881-bd77-9fed363ac648 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:27.262220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82736af2-ceff-4881-bd77-9fed363ac648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:27.262638 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82736af2-ceff-4881-bd77-9fed363ac648 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:27.263740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82736af2-ceff-4881-bd77-9fed363ac648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:27.266642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82736af2-ceff-4881-bd77-9fed363ac648 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:27.271245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-21f8cdf6-be27-4bae-9550-190a0c339251 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5c41b200dad41c3b587e3d55f604d86'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:27.283723 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 966/1927] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:00:27.287528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82736af2-ceff-4881-bd77-9fed363ac648 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:27.288175 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-21f8cdf6-be27-4bae-9550-190a0c339251 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5c41b200dad41c3b587e3d55f604d86'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:27.290388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-21f8cdf6-be27-4bae-9550-190a0c339251 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5c41b200dad41c3b587e3d55f604d86'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:27.292801 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-82736af2-ceff-4881-bd77-9fed363ac648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:27.319008 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82736af2-ceff-4881-bd77-9fed363ac648 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:27.327478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09c4d0-e2dd-4b2f-b19d-998a70402869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:27.328726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09c4d0-e2dd-4b2f-b19d-998a70402869 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:27.329668 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 962/1928] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:00:27 2022] DELETE /identity/v3/users/a5c41b200dad41c3b587e3d55f604d86 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:27.330152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09c4d0-e2dd-4b2f-b19d-998a70402869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:27.330268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09c4d0-e2dd-4b2f-b19d-998a70402869 admin admin] PATH_INFO: `/v3/projects/5d8e661355c1454fbeabfe02863dea63/users/679c0393aac04fccbc1c858e879323ce/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:27.335921 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fdeaf-85ea-49b0-aab8-31ebcc3125da None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:27.336378 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fdeaf-85ea-49b0-aab8-31ebcc3125da None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:27.336771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fdeaf-85ea-49b0-aab8-31ebcc3125da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:27.362329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09c4d0-e2dd-4b2f-b19d-998a70402869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d8e661355c1454fbeabfe02863dea63, user_id=679c0393aac04fccbc1c858e879323ce, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:27.365975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5d4fdeaf-85ea-49b0-aab8-31ebcc3125da None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:27.367361 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5d4fdeaf-85ea-49b0-aab8-31ebcc3125da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:27.368056 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09c4d0-e2dd-4b2f-b19d-998a70402869 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:27.389639 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 967/1929] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:27 2022] PUT /identity/v3/projects/5d8e661355c1454fbeabfe02863dea63/users/679c0393aac04fccbc1c858e879323ce/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:00:27.390818 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09c4d0-e2dd-4b2f-b19d-998a70402869 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:27.400310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9f09c4d0-e2dd-4b2f-b19d-998a70402869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:27.405365 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:27.473046 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 963/1930] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:00:27.474379 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb02e61-d79d-4eba-9eeb-75ce620e3954 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:27.475059 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb02e61-d79d-4eba-9eeb-75ce620e3954 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:27.475175 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb02e61-d79d-4eba-9eeb-75ce620e3954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:27.491836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09c4d0-e2dd-4b2f-b19d-998a70402869 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:27.498102 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1be54-301c-4ace-b9bb-506274364666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:27.498959 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1be54-301c-4ace-b9bb-506274364666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:27.499249 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1be54-301c-4ace-b9bb-506274364666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:27.499573 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1be54-301c-4ace-b9bb-506274364666 admin admin] PATH_INFO: `/v3/projects/77bc962e0abe407581460ebf648f9598` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:27.502905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c1be54-301c-4ace-b9bb-506274364666 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77bc962e0abe407581460ebf648f9598)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:27.503617 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c1be54-301c-4ace-b9bb-506274364666 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:27.506066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-6fb02e61-d79d-4eba-9eeb-75ce620e3954 None None] MFA Rules not processed for user `679c0393aac04fccbc1c858e879323ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:27.507283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6fb02e61-d79d-4eba-9eeb-75ce620e3954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:27.557234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a0c1be54-301c-4ace-b9bb-506274364666 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77bc962e0abe407581460ebf648f9598', 'request_id': 'req-a0c1be54-301c-4ace-b9bb-506274364666'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:27.566037 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a0c1be54-301c-4ace-b9bb-506274364666 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77bc962e0abe407581460ebf648f9598', 'request_id': 'req-a0c1be54-301c-4ace-b9bb-506274364666'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:27.573498 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a0c1be54-301c-4ace-b9bb-506274364666 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77bc962e0abe407581460ebf648f9598', 'request_id': 'req-a0c1be54-301c-4ace-b9bb-506274364666'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:27.585741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a0c1be54-301c-4ace-b9bb-506274364666 admin admin] The token cache is being invalidate because project 77bc962e0abe407581460ebf648f9598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:27.586031 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a0c1be54-301c-4ace-b9bb-506274364666 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:27.586697 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a0c1be54-301c-4ace-b9bb-506274364666 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:27.588265 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 968/1931] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:27 2022] DELETE /identity/v3/projects/77bc962e0abe407581460ebf648f9598 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:27.590180 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1be54-301c-4ace-b9bb-506274364666 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:27.591909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a0c1be54-301c-4ace-b9bb-506274364666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:27.592637 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 964/1932] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:27.594177 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea29e5d-e528-4692-8530-7fa5d50275d2 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:27.594569 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea29e5d-e528-4692-8530-7fa5d50275d2 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:27.594972 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea29e5d-e528-4692-8530-7fa5d50275d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:27.617294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-0ea29e5d-e528-4692-8530-7fa5d50275d2 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:27.618528 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0ea29e5d-e528-4692-8530-7fa5d50275d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:27.657522 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1be54-301c-4ace-b9bb-506274364666 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:27.661780 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a62c7f-7af7-4e86-a678-9f8f18a9c262 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:27.662372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a62c7f-7af7-4e86-a678-9f8f18a9c262 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:27.662755 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a62c7f-7af7-4e86-a678-9f8f18a9c262 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:27.663132 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a62c7f-7af7-4e86-a678-9f8f18a9c262 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:27.665079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e3a62c7f-7af7-4e86-a678-9f8f18a9c262 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:27.678636 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:27.708202 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 965/1933] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:27.709149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea29e5d-e528-4692-8530-7fa5d50275d2 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:27.710585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0ea29e5d-e528-4692-8530-7fa5d50275d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:27.725732 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea29e5d-e528-4692-8530-7fa5d50275d2 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:27.731783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f315113-63b9-4415-a257-e8427039c1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:27.732496 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f315113-63b9-4415-a257-e8427039c1bf admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:27.732786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f315113-63b9-4415-a257-e8427039c1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:27.733602 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f315113-63b9-4415-a257-e8427039c1bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:27.734257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f315113-63b9-4415-a257-e8427039c1bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:27.736750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f315113-63b9-4415-a257-e8427039c1bf admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:27.758396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a62c7f-7af7-4e86-a678-9f8f18a9c262 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:27.761418 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a62c7f-7af7-4e86-a678-9f8f18a9c262 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:27.774412 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 969/1934] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:27.776194 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ae744-299d-43b0-93b2-45433922716b None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:27.776585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ae744-299d-43b0-93b2-45433922716b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:27.776951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ae744-299d-43b0-93b2-45433922716b None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:27.778418 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 970/1935] 10.222.0.30 () {54 vars in 921 bytes} [Sun Sep 4 01:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:00:27.779511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65822226-21c8-4fe6-90c2-756fbc7bc273 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:27.779939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65822226-21c8-4fe6-90c2-756fbc7bc273 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:27.780309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65822226-21c8-4fe6-90c2-756fbc7bc273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:27.783265 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 966/1936] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:00:27 2022] POST /identity/v3/projects => generated 375 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:27.784307 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f315113-63b9-4415-a257-e8427039c1bf admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:27.813587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-65822226-21c8-4fe6-90c2-756fbc7bc273 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:27.815190 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-65822226-21c8-4fe6-90c2-756fbc7bc273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:27.827387 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:27.867701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f315113-63b9-4415-a257-e8427039c1bf admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:27.887961 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126a214-d664-4ab7-af8d-ba546d6f324f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:27.888686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126a214-d664-4ab7-af8d-ba546d6f324f admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:27.888869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126a214-d664-4ab7-af8d-ba546d6f324f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:27.889163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126a214-d664-4ab7-af8d-ba546d6f324f admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:27.889844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126a214-d664-4ab7-af8d-ba546d6f324f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:27.897292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126a214-d664-4ab7-af8d-ba546d6f324f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:27.898823 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 971/1937] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:27.900710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a864a5-450b-44b0-90f4-41cd18ad9941 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:27.901170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a864a5-450b-44b0-90f4-41cd18ad9941 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:27.917265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a864a5-450b-44b0-90f4-41cd18ad9941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:27.942164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-73a864a5-450b-44b0-90f4-41cd18ad9941 None None] MFA Rules not processed for user `13f0f341bf2c475d82b4e7b34d503dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:27.944235 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-73a864a5-450b-44b0-90f4-41cd18ad9941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:27.949759 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 967/1938] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:27 2022] POST /identity/v3/users => generated 294 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:27.950897 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126a214-d664-4ab7-af8d-ba546d6f324f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:27.966833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126a214-d664-4ab7-af8d-ba546d6f324f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:27.976162 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35cc07-1420-41fa-894f-fb39114349e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:27.976840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35cc07-1420-41fa-894f-fb39114349e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:27.977131 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35cc07-1420-41fa-894f-fb39114349e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:27.977403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35cc07-1420-41fa-894f-fb39114349e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:27.978083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35cc07-1420-41fa-894f-fb39114349e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:00:27.978934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35cc07-1420-41fa-894f-fb39114349e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:27.981329 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35cc07-1420-41fa-894f-fb39114349e6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:28.007353 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 968/1939] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:00:28.008359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35cc07-1420-41fa-894f-fb39114349e6 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:28.028065 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35cc07-1420-41fa-894f-fb39114349e6 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:28.039550 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03857a-277d-4bed-8723-4e72a8c70e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:28.041025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03857a-277d-4bed-8723-4e72a8c70e7f admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:28.041696 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03857a-277d-4bed-8723-4e72a8c70e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:28.042116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03857a-277d-4bed-8723-4e72a8c70e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:28.043322 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a03857a-277d-4bed-8723-4e72a8c70e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:28.045868 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a03857a-277d-4bed-8723-4e72a8c70e7f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:28.065928 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 969/1940] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:28.066831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03857a-277d-4bed-8723-4e72a8c70e7f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:28.079071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03857a-277d-4bed-8723-4e72a8c70e7f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:28.085562 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f47772-2136-4b40-95db-f9bdfa5d47a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:28.086192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f47772-2136-4b40-95db-f9bdfa5d47a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:28.086472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f47772-2136-4b40-95db-f9bdfa5d47a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:28.086744 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f47772-2136-4b40-95db-f9bdfa5d47a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:28.087383 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f47772-2136-4b40-95db-f9bdfa5d47a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:28.089308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f47772-2136-4b40-95db-f9bdfa5d47a2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:28.093545 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 972/1941] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Sep 4 01:00:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:28.094643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a864a5-450b-44b0-90f4-41cd18ad9941 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:28.106603 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a864a5-450b-44b0-90f4-41cd18ad9941 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:28.116205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da08aa-ce8d-45c1-92ad-5a74b9043877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:28.117072 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da08aa-ce8d-45c1-92ad-5a74b9043877 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:28.117572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da08aa-ce8d-45c1-92ad-5a74b9043877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:28.118034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da08aa-ce8d-45c1-92ad-5a74b9043877 admin admin] PATH_INFO: `/v3/projects/05b9e55d6da94bce82300a73c0a3841e/users/97157111173e43c39d7b5c91ee3e9f67/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:28.131367 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 970/1942] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:00:28 2022] POST /identity/v3/projects => generated 411 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:28.132880 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f47772-2136-4b40-95db-f9bdfa5d47a2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:28.134747 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a9f47772-2136-4b40-95db-f9bdfa5d47a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:28.143367 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da08aa-ce8d-45c1-92ad-5a74b9043877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05b9e55d6da94bce82300a73c0a3841e, user_id=97157111173e43c39d7b5c91ee3e9f67, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:28.146877 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da08aa-ce8d-45c1-92ad-5a74b9043877 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:28.164530 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 973/1943] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:28 2022] PUT /identity/v3/projects/05b9e55d6da94bce82300a73c0a3841e/users/97157111173e43c39d7b5c91ee3e9f67/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:28.164530 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da08aa-ce8d-45c1-92ad-5a74b9043877 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:28.185834 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:28.241966 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da08aa-ce8d-45c1-92ad-5a74b9043877 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:28.243785 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f47772-2136-4b40-95db-f9bdfa5d47a2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:28.246625 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b483ea6-bd8f-4e76-8b9e-cae511b3caad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:28.247232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b483ea6-bd8f-4e76-8b9e-cae511b3caad admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:28.247512 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b483ea6-bd8f-4e76-8b9e-cae511b3caad admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:28.247783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b483ea6-bd8f-4e76-8b9e-cae511b3caad admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:28.248415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b483ea6-bd8f-4e76-8b9e-cae511b3caad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:28.250384 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b483ea6-bd8f-4e76-8b9e-cae511b3caad admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:28.275406 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 974/1944] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:28 2022] POST /identity/v3/users => generated 306 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:28.276262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b483ea6-bd8f-4e76-8b9e-cae511b3caad admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:28.286839 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b483ea6-bd8f-4e76-8b9e-cae511b3caad admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:28.291711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e51ed-8c9b-401b-8527-c06525ed7436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:28.292437 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e51ed-8c9b-401b-8527-c06525ed7436 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:28.292797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e51ed-8c9b-401b-8527-c06525ed7436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:28.293073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e51ed-8c9b-401b-8527-c06525ed7436 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:28.293890 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1e51ed-8c9b-401b-8527-c06525ed7436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:28.295490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1e51ed-8c9b-401b-8527-c06525ed7436 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:28.307852 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 975/1945] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:28.308589 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e51ed-8c9b-401b-8527-c06525ed7436 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:28.310295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3d1e51ed-8c9b-401b-8527-c06525ed7436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:28.323623 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78849fd-98b7-48fc-adcd-b202831416fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:28.324367 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78849fd-98b7-48fc-adcd-b202831416fb service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:28.324723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78849fd-98b7-48fc-adcd-b202831416fb service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:28.325112 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78849fd-98b7-48fc-adcd-b202831416fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:28.327338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e51ed-8c9b-401b-8527-c06525ed7436 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:28.332025 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054f3a4-6d89-4d5f-93ef-be9354830c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:28.332689 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054f3a4-6d89-4d5f-93ef-be9354830c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:28.333008 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054f3a4-6d89-4d5f-93ef-be9354830c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:28.333287 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054f3a4-6d89-4d5f-93ef-be9354830c97 admin admin] PATH_INFO: `/v3/projects/f1c77a8482934a0b863a652fd957cafc` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:28.334458 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054f3a4-6d89-4d5f-93ef-be9354830c97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1c77a8482934a0b863a652fd957cafc)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:28.334852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78849fd-98b7-48fc-adcd-b202831416fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:28.336500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054f3a4-6d89-4d5f-93ef-be9354830c97 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:28.336618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78849fd-98b7-48fc-adcd-b202831416fb service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:28.341595 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:28.357627 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 971/1946] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:28.359174 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78849fd-98b7-48fc-adcd-b202831416fb service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:28.373813 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78849fd-98b7-48fc-adcd-b202831416fb service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:28.379629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054c4a7-1f28-424b-95fd-ef957ddcaa7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:28.381070 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054c4a7-1f28-424b-95fd-ef957ddcaa7f admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:28.381694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054c4a7-1f28-424b-95fd-ef957ddcaa7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:28.381804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054c4a7-1f28-424b-95fd-ef957ddcaa7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:28.382452 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054c4a7-1f28-424b-95fd-ef957ddcaa7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:28.384066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054c4a7-1f28-424b-95fd-ef957ddcaa7f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:28.409912 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 972/1947] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:28.409912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054c4a7-1f28-424b-95fd-ef957ddcaa7f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:28.410136 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4054f3a4-6d89-4d5f-93ef-be9354830c97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1c77a8482934a0b863a652fd957cafc', 'request_id': 'req-4054f3a4-6d89-4d5f-93ef-be9354830c97'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:28.410398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4054f3a4-6d89-4d5f-93ef-be9354830c97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1c77a8482934a0b863a652fd957cafc', 'request_id': 'req-4054f3a4-6d89-4d5f-93ef-be9354830c97'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:28.416444 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4054f3a4-6d89-4d5f-93ef-be9354830c97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1c77a8482934a0b863a652fd957cafc', 'request_id': 'req-4054f3a4-6d89-4d5f-93ef-be9354830c97'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:28.418825 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054c4a7-1f28-424b-95fd-ef957ddcaa7f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:28.428875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4054f3a4-6d89-4d5f-93ef-be9354830c97 admin admin] The token cache is being invalidate because project f1c77a8482934a0b863a652fd957cafc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:28.429162 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4054f3a4-6d89-4d5f-93ef-be9354830c97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:28.429909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4054f3a4-6d89-4d5f-93ef-be9354830c97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:28.431491 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 976/1948] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:28 2022] DELETE /identity/v3/projects/f1c77a8482934a0b863a652fd957cafc => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:28.435093 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054f3a4-6d89-4d5f-93ef-be9354830c97 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:28.436867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4054f3a4-6d89-4d5f-93ef-be9354830c97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:28.487197 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0e775-9199-4f04-8cc0-2b47943be1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:28.488331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0e775-9199-4f04-8cc0-2b47943be1db admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:28.488609 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0e775-9199-4f04-8cc0-2b47943be1db admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:28.488887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0e775-9199-4f04-8cc0-2b47943be1db admin admin] PATH_INFO: `/v3/projects/05b9e55d6da94bce82300a73c0a3841e/users/97157111173e43c39d7b5c91ee3e9f67/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:28.490882 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0e775-9199-4f04-8cc0-2b47943be1db admin admin] RBAC: Authorizing `identity:create_grant(project_id=05b9e55d6da94bce82300a73c0a3841e, user_id=97157111173e43c39d7b5c91ee3e9f67, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:28.493630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0e775-9199-4f04-8cc0-2b47943be1db admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:28.503776 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 973/1949] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:28 2022] PUT /identity/v3/projects/05b9e55d6da94bce82300a73c0a3841e/users/97157111173e43c39d7b5c91ee3e9f67/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:28.504575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0e775-9199-4f04-8cc0-2b47943be1db admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:28.505608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054f3a4-6d89-4d5f-93ef-be9354830c97 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:28.512373 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-68d0e775-9199-4f04-8cc0-2b47943be1db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:28.533340 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:28.572894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a407cfb-f24a-4fe9-8a27-1874e6584531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:28.573530 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a407cfb-f24a-4fe9-8a27-1874e6584531 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:28.573809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a407cfb-f24a-4fe9-8a27-1874e6584531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:28.574079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a407cfb-f24a-4fe9-8a27-1874e6584531 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:28.574729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a407cfb-f24a-4fe9-8a27-1874e6584531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:28.576307 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a407cfb-f24a-4fe9-8a27-1874e6584531 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:28.587326 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 977/1950] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:28.587626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0e775-9199-4f04-8cc0-2b47943be1db admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:28.588564 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d65c8-4c94-4a54-9452-3aae900db04c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:28.588844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d65c8-4c94-4a54-9452-3aae900db04c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:28.589115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d65c8-4c94-4a54-9452-3aae900db04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:28.595028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c86e9d-f7ad-4bf9-b094-c65945ce64f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:28.595671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c86e9d-f7ad-4bf9-b094-c65945ce64f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:28.595953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c86e9d-f7ad-4bf9-b094-c65945ce64f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:28.596229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c86e9d-f7ad-4bf9-b094-c65945ce64f6 admin admin] PATH_INFO: `/v3/users/8970abbf7d984aecb244a5b96db29b21` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:28.597579 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c86e9d-f7ad-4bf9-b094-c65945ce64f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8970abbf7d984aecb244a5b96db29b21)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:28.599549 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c86e9d-f7ad-4bf9-b094-c65945ce64f6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:28.622378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-041d65c8-4c94-4a54-9452-3aae900db04c None None] MFA Rules not processed for user `97157111173e43c39d7b5c91ee3e9f67`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:28.623749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-041d65c8-4c94-4a54-9452-3aae900db04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:28.663942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d3c86e9d-f7ad-4bf9-b094-c65945ce64f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8970abbf7d984aecb244a5b96db29b21'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:28.664978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d3c86e9d-f7ad-4bf9-b094-c65945ce64f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8970abbf7d984aecb244a5b96db29b21'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:28.674412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d3c86e9d-f7ad-4bf9-b094-c65945ce64f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8970abbf7d984aecb244a5b96db29b21'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:28.682216 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d3c86e9d-f7ad-4bf9-b094-c65945ce64f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8970abbf7d984aecb244a5b96db29b21'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:28.682963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d3c86e9d-f7ad-4bf9-b094-c65945ce64f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8970abbf7d984aecb244a5b96db29b21'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:28.698808 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:28.704065 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 974/1951] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:00:28 2022] DELETE /identity/v3/users/8970abbf7d984aecb244a5b96db29b21 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:28.710376 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c86e9d-f7ad-4bf9-b094-c65945ce64f6 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:28.711675 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 978/1952] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:28.714414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d3c86e9d-f7ad-4bf9-b094-c65945ce64f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:28.719229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d65c8-4c94-4a54-9452-3aae900db04c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:28.729036 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d65c8-4c94-4a54-9452-3aae900db04c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:28.800026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1282f-d62d-4cb6-93e3-e2f278d6f741 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97157111173e43c39d7b5c91ee3e9f67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b9e55d6da94bce82300a73c0a3841e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:28.800474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1282f-d62d-4cb6-93e3-e2f278d6f741 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:28.800814 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1282f-d62d-4cb6-93e3-e2f278d6f741 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:28.801031 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1282f-d62d-4cb6-93e3-e2f278d6f741 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:28.802223 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa1282f-d62d-4cb6-93e3-e2f278d6f741 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:00:28.802823 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa1282f-d62d-4cb6-93e3-e2f278d6f741 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:28.804943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa1282f-d62d-4cb6-93e3-e2f278d6f741 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:28.807987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c86e9d-f7ad-4bf9-b094-c65945ce64f6 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:28.813652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e3205-22c9-427d-9415-a8f06662e19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:28.814326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e3205-22c9-427d-9415-a8f06662e19b admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:28.814601 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e3205-22c9-427d-9415-a8f06662e19b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:28.814873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e3205-22c9-427d-9415-a8f06662e19b admin admin] PATH_INFO: `/v3/projects/736baf137a034c11b6b3711b211eef84/users/794e8d5261e143618517e53b66d07f62/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:28.819965 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 979/1953] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:00:28.824530 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1282f-d62d-4cb6-93e3-e2f278d6f741 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:28.832025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e3205-22c9-427d-9415-a8f06662e19b admin admin] RBAC: Authorizing `identity:create_grant(project_id=736baf137a034c11b6b3711b211eef84, user_id=794e8d5261e143618517e53b66d07f62, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:28.835335 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1282f-d62d-4cb6-93e3-e2f278d6f741 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:28.835456 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e3205-22c9-427d-9415-a8f06662e19b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:28.840740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc386e-c0a3-4a9a-98cd-50df63cb792c tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97157111173e43c39d7b5c91ee3e9f67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b9e55d6da94bce82300a73c0a3841e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:28.841495 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc386e-c0a3-4a9a-98cd-50df63cb792c tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:28.841883 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc386e-c0a3-4a9a-98cd-50df63cb792c tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:28.842232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc386e-c0a3-4a9a-98cd-50df63cb792c tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:28.843076 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc386e-c0a3-4a9a-98cd-50df63cb792c tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:28.845316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc386e-c0a3-4a9a-98cd-50df63cb792c tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:28.850934 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 975/1954] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:28 2022] PUT /identity/v3/projects/736baf137a034c11b6b3711b211eef84/users/794e8d5261e143618517e53b66d07f62/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:28.861114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc332d-7c06-47c0-98a8-22127af3dfb2 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:28.861511 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc332d-7c06-47c0-98a8-22127af3dfb2 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:28.861903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc332d-7c06-47c0-98a8-22127af3dfb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:28.888925 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 980/1955] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:00:28 2022] POST /identity/v3/projects => generated 369 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:28.891702 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-12bc332d-7c06-47c0-98a8-22127af3dfb2 None None] MFA Rules not processed for user `794e8d5261e143618517e53b66d07f62`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:28.892823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-12bc332d-7c06-47c0-98a8-22127af3dfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:28.892946 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc386e-c0a3-4a9a-98cd-50df63cb792c tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:28.931470 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:28.967852 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 976/1956] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:28 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:00:28.971947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc332d-7c06-47c0-98a8-22127af3dfb2 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:28.994201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc386e-c0a3-4a9a-98cd-50df63cb792c tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:29.000772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8f69a-ca83-43d4-8f45-d5f75753d55d tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97157111173e43c39d7b5c91ee3e9f67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b9e55d6da94bce82300a73c0a3841e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:29.001406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8f69a-ca83-43d4-8f45-d5f75753d55d tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:29.001730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8f69a-ca83-43d4-8f45-d5f75753d55d tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:29.002017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8f69a-ca83-43d4-8f45-d5f75753d55d tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:29.002709 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd8f69a-ca83-43d4-8f45-d5f75753d55d tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:00:29.003026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd8f69a-ca83-43d4-8f45-d5f75753d55d tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:29.004659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd8f69a-ca83-43d4-8f45-d5f75753d55d tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:29.019301 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 981/1957] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:00:29.028518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8f69a-ca83-43d4-8f45-d5f75753d55d tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:29.031129 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ffd8f69a-ca83-43d4-8f45-d5f75753d55d tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:29.049543 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc332d-7c06-47c0-98a8-22127af3dfb2 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:29.054766 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7cba2-9c20-4ed0-beae-a7dbe4c41855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:29.055383 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7cba2-9c20-4ed0-beae-a7dbe4c41855 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:29.055672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7cba2-9c20-4ed0-beae-a7dbe4c41855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:29.055940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7cba2-9c20-4ed0-beae-a7dbe4c41855 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:29.056665 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7cba2-9c20-4ed0-beae-a7dbe4c41855 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:29.062328 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7cba2-9c20-4ed0-beae-a7dbe4c41855 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:29.092063 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:29.105785 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 977/1958] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:00:28 2022] POST /identity/v3/projects => generated 409 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:00:29.105785 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7cba2-9c20-4ed0-beae-a7dbe4c41855 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:29.105785 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-23b7cba2-9c20-4ed0-beae-a7dbe4c41855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:29.154214 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8f69a-ca83-43d4-8f45-d5f75753d55d tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:29.183001 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7cba2-9c20-4ed0-beae-a7dbe4c41855 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:29.190824 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616851cb-6b78-4048-b485-bc011a8c82e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:29.192483 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616851cb-6b78-4048-b485-bc011a8c82e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:29.192765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616851cb-6b78-4048-b485-bc011a8c82e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:29.193041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616851cb-6b78-4048-b485-bc011a8c82e8 admin admin] PATH_INFO: `/v3/projects/169814b97edb47549269b3ee157857f3` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:29.194325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616851cb-6b78-4048-b485-bc011a8c82e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=169814b97edb47549269b3ee157857f3)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:29.196728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616851cb-6b78-4048-b485-bc011a8c82e8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:29.236996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04415b-b6f0-413f-9808-460c580d1fbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:29.237657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04415b-b6f0-413f-9808-460c580d1fbb service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:29.237938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04415b-b6f0-413f-9808-460c580d1fbb service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:29.238890 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04415b-b6f0-413f-9808-460c580d1fbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:29.253074 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-616851cb-6b78-4048-b485-bc011a8c82e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '169814b97edb47549269b3ee157857f3', 'request_id': 'req-616851cb-6b78-4048-b485-bc011a8c82e8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:29.263162 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-616851cb-6b78-4048-b485-bc011a8c82e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '169814b97edb47549269b3ee157857f3', 'request_id': 'req-616851cb-6b78-4048-b485-bc011a8c82e8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:29.269876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-616851cb-6b78-4048-b485-bc011a8c82e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '169814b97edb47549269b3ee157857f3', 'request_id': 'req-616851cb-6b78-4048-b485-bc011a8c82e8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:29.283109 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-616851cb-6b78-4048-b485-bc011a8c82e8 admin admin] The token cache is being invalidate because project 169814b97edb47549269b3ee157857f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:29.283834 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-616851cb-6b78-4048-b485-bc011a8c82e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:29.284878 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-616851cb-6b78-4048-b485-bc011a8c82e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:29.286946 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 978/1959] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:29 2022] DELETE /identity/v3/projects/169814b97edb47549269b3ee157857f3 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:29.287967 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616851cb-6b78-4048-b485-bc011a8c82e8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:29.289294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-616851cb-6b78-4048-b485-bc011a8c82e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:29.293097 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:29.312177 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04415b-b6f0-413f-9808-460c580d1fbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:29.313968 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04415b-b6f0-413f-9808-460c580d1fbb service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:29.325076 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 982/1960] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:29 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:29.326455 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971010a1-ef50-4187-b5a7-3ed0bdb722d1 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:29.326810 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971010a1-ef50-4187-b5a7-3ed0bdb722d1 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:29.327150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971010a1-ef50-4187-b5a7-3ed0bdb722d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:29.348693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-971010a1-ef50-4187-b5a7-3ed0bdb722d1 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:29.349908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-971010a1-ef50-4187-b5a7-3ed0bdb722d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:29.358710 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 983/1961] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:29.359855 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616851cb-6b78-4048-b485-bc011a8c82e8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:29.361519 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78aa18-74ae-4438-beff-709101de6117 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:29.361871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78aa18-74ae-4438-beff-709101de6117 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:29.362143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78aa18-74ae-4438-beff-709101de6117 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:29.363402 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 984/1962] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:00:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:00:29.366528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5239184-5cf4-4832-9e3f-baec8173af07 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:29.366878 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5239184-5cf4-4832-9e3f-baec8173af07 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:29.367220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5239184-5cf4-4832-9e3f-baec8173af07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:29.369711 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094290b-567a-4dc9-96a9-8b3aa92aba62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:29.370453 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094290b-567a-4dc9-96a9-8b3aa92aba62 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:29.370825 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094290b-567a-4dc9-96a9-8b3aa92aba62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:29.371165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094290b-567a-4dc9-96a9-8b3aa92aba62 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:29.371803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8094290b-567a-4dc9-96a9-8b3aa92aba62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:29.373823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8094290b-567a-4dc9-96a9-8b3aa92aba62 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:29.387220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-f5239184-5cf4-4832-9e3f-baec8173af07 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:29.388513 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f5239184-5cf4-4832-9e3f-baec8173af07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:29.398733 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 979/1963] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:29 2022] POST /identity/v3/users => generated 311 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:29.398733 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094290b-567a-4dc9-96a9-8b3aa92aba62 admin admin] Authenticating service token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:00:29.398963 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 985/1964] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:29.399037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8094290b-567a-4dc9-96a9-8b3aa92aba62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:29.400901 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5239184-5cf4-4832-9e3f-baec8173af07 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:29.410167 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5239184-5cf4-4832-9e3f-baec8173af07 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:29.414749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdab772-f572-4cac-bfd7-17d382ce7c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:29.415336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdab772-f572-4cac-bfd7-17d382ce7c4a admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:29.415612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdab772-f572-4cac-bfd7-17d382ce7c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:29.417381 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdab772-f572-4cac-bfd7-17d382ce7c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:29.418263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdab772-f572-4cac-bfd7-17d382ce7c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:29.419754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdab772-f572-4cac-bfd7-17d382ce7c4a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:29.423702 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:29.433811 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 986/1965] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:29.434856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdab772-f572-4cac-bfd7-17d382ce7c4a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:29.446407 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdab772-f572-4cac-bfd7-17d382ce7c4a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:29.451819 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2145d7e-0c56-4e72-9e81-5f32a80281e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:29.452845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2145d7e-0c56-4e72-9e81-5f32a80281e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:29.452845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2145d7e-0c56-4e72-9e81-5f32a80281e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:29.453007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2145d7e-0c56-4e72-9e81-5f32a80281e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:29.453638 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2145d7e-0c56-4e72-9e81-5f32a80281e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:00:29.453936 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2145d7e-0c56-4e72-9e81-5f32a80281e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:29.455597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2145d7e-0c56-4e72-9e81-5f32a80281e9 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:29.472020 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 987/1966] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:00:29.472020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2145d7e-0c56-4e72-9e81-5f32a80281e9 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:29.481158 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2145d7e-0c56-4e72-9e81-5f32a80281e9 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:29.486537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba866870-b1ef-4829-8c03-670ea7e027e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:29.487195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba866870-b1ef-4829-8c03-670ea7e027e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:29.487473 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba866870-b1ef-4829-8c03-670ea7e027e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:29.487788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba866870-b1ef-4829-8c03-670ea7e027e1 admin admin] PATH_INFO: `/v3/projects/7fcaead77e6a4d4baf40f9b688626113/users/38de2174bdd04a24bb6362ba344c8b04/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:29.498247 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094290b-567a-4dc9-96a9-8b3aa92aba62 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:29.499392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8094290b-567a-4dc9-96a9-8b3aa92aba62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:29.506387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba866870-b1ef-4829-8c03-670ea7e027e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fcaead77e6a4d4baf40f9b688626113, user_id=38de2174bdd04a24bb6362ba344c8b04, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:29.509468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba866870-b1ef-4829-8c03-670ea7e027e1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:29.529007 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 988/1967] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:29 2022] PUT /identity/v3/projects/7fcaead77e6a4d4baf40f9b688626113/users/38de2174bdd04a24bb6362ba344c8b04/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:29.529963 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba866870-b1ef-4829-8c03-670ea7e027e1 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:29.572206 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094290b-567a-4dc9-96a9-8b3aa92aba62 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:29.604752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba866870-b1ef-4829-8c03-670ea7e027e1 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:29.609467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32ba20-0629-40e2-a57b-1df39d1709e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:29.610339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32ba20-0629-40e2-a57b-1df39d1709e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:29.610619 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32ba20-0629-40e2-a57b-1df39d1709e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:29.610897 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32ba20-0629-40e2-a57b-1df39d1709e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:29.611524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c32ba20-0629-40e2-a57b-1df39d1709e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:29.613475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c32ba20-0629-40e2-a57b-1df39d1709e8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:29.634308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82f81d-6cce-4a03-af02-c9fda67006da tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97157111173e43c39d7b5c91ee3e9f67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b9e55d6da94bce82300a73c0a3841e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:29.635243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82f81d-6cce-4a03-af02-c9fda67006da tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:29.635560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82f81d-6cce-4a03-af02-c9fda67006da tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:29.635840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82f81d-6cce-4a03-af02-c9fda67006da tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] PATH_INFO: `/v3/projects/171fee697f24485fa7dbf1c677ce0132` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:29.636993 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82f81d-6cce-4a03-af02-c9fda67006da tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorizing `identity:get_project(project_id=171fee697f24485fa7dbf1c677ce0132)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:29.639141 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82f81d-6cce-4a03-af02-c9fda67006da tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:29.640789 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 989/1968] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:00:29 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:29.641251 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 980/1969] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:00:29 2022] GET /identity/v3/projects/171fee697f24485fa7dbf1c677ce0132 => generated 369 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:00:29.641928 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32ba20-0629-40e2-a57b-1df39d1709e8 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:29.644837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82f81d-6cce-4a03-af02-c9fda67006da tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:29.658798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82f81d-6cce-4a03-af02-c9fda67006da tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:29.710744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32ba20-0629-40e2-a57b-1df39d1709e8 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:29.715681 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b057b-0d2a-489f-9a98-2fa208fe0157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:29.716283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b057b-0d2a-489f-9a98-2fa208fe0157 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:29.716561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b057b-0d2a-489f-9a98-2fa208fe0157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:29.716836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b057b-0d2a-489f-9a98-2fa208fe0157 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:29.717494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b057b-0d2a-489f-9a98-2fa208fe0157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:29.719083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b057b-0d2a-489f-9a98-2fa208fe0157 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:29.723355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e751214-42a5-4925-83be-6397bf6d9829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:29.724610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e751214-42a5-4925-83be-6397bf6d9829 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:29.724889 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e751214-42a5-4925-83be-6397bf6d9829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:29.725161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e751214-42a5-4925-83be-6397bf6d9829 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:29.725817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e751214-42a5-4925-83be-6397bf6d9829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:29.727717 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e751214-42a5-4925-83be-6397bf6d9829 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:29.729199 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 990/1970] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:29.730464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f6539-3e45-424c-a8a5-ca84581c3f20 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:29.730748 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f6539-3e45-424c-a8a5-ca84581c3f20 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:29.731020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f6539-3e45-424c-a8a5-ca84581c3f20 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:29.732599 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 991/1971] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:00:29.733277 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f6539-3e45-424c-a8a5-ca84581c3f20 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:29.737172 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:29.741889 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:29.748636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f6539-3e45-424c-a8a5-ca84581c3f20 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:29.753054 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 981/1972] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:29 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:29.753054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e751214-42a5-4925-83be-6397bf6d9829 admin admin] Authenticating service token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:00:29.753054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1e751214-42a5-4925-83be-6397bf6d9829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:29.753840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ace272-cfab-4d50-a7c2-e049d14eab5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:29.754809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ace272-cfab-4d50-a7c2-e049d14eab5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:29.755523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ace272-cfab-4d50-a7c2-e049d14eab5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:29.755797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ace272-cfab-4d50-a7c2-e049d14eab5a admin admin] PATH_INFO: `/v3/projects/7fcaead77e6a4d4baf40f9b688626113/users/38de2174bdd04a24bb6362ba344c8b04/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:29.757691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ace272-cfab-4d50-a7c2-e049d14eab5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fcaead77e6a4d4baf40f9b688626113, user_id=38de2174bdd04a24bb6362ba344c8b04, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:29.760495 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ace272-cfab-4d50-a7c2-e049d14eab5a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:29.771056 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 992/1973] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:29 2022] PUT /identity/v3/projects/7fcaead77e6a4d4baf40f9b688626113/users/38de2174bdd04a24bb6362ba344c8b04/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:29.771980 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ace272-cfab-4d50-a7c2-e049d14eab5a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:29.833792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ace272-cfab-4d50-a7c2-e049d14eab5a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:29.834421 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e751214-42a5-4925-83be-6397bf6d9829 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:29.838664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3e266-f841-4b5c-9e93-e3dda6c9c4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:29.839271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3e266-f841-4b5c-9e93-e3dda6c9c4fe admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:29.839575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3e266-f841-4b5c-9e93-e3dda6c9c4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:29.839995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3e266-f841-4b5c-9e93-e3dda6c9c4fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:29.840629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3e266-f841-4b5c-9e93-e3dda6c9c4fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:29.842313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3e266-f841-4b5c-9e93-e3dda6c9c4fe admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:29.852672 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 993/1974] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:29.853863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a0054-8fee-4b39-af63-4e0a0576bb69 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:29.854151 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a0054-8fee-4b39-af63-4e0a0576bb69 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:29.854422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a0054-8fee-4b39-af63-4e0a0576bb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:29.882497 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-928a0054-8fee-4b39-af63-4e0a0576bb69 None None] MFA Rules not processed for user `38de2174bdd04a24bb6362ba344c8b04`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:29.883735 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-928a0054-8fee-4b39-af63-4e0a0576bb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:29.896223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e751214-42a5-4925-83be-6397bf6d9829 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:29.953974 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914e0a7-a970-4b69-b00e-b87a463671cc tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97157111173e43c39d7b5c91ee3e9f67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b9e55d6da94bce82300a73c0a3841e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:29.954757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914e0a7-a970-4b69-b00e-b87a463671cc tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:29.954876 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 994/1975] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:29 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:29.959675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914e0a7-a970-4b69-b00e-b87a463671cc tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:29.959675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914e0a7-a970-4b69-b00e-b87a463671cc tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] PATH_INFO: `/v3/projects/171fee697f24485fa7dbf1c677ce0132` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:29.959875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a0054-8fee-4b39-af63-4e0a0576bb69 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:29.959969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914e0a7-a970-4b69-b00e-b87a463671cc tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorizing `identity:get_project(project_id=171fee697f24485fa7dbf1c677ce0132)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:29.959969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914e0a7-a970-4b69-b00e-b87a463671cc tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:29.960852 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 982/1976] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:00:29 2022] GET /identity/v3/projects/171fee697f24485fa7dbf1c677ce0132 => generated 369 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:00:29.966809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a0054-8fee-4b39-af63-4e0a0576bb69 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:29.967254 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914e0a7-a970-4b69-b00e-b87a463671cc tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:29.972479 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b7752-9d97-4268-b193-3b325fd83572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:29.973426 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b7752-9d97-4268-b193-3b325fd83572 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:29.976249 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b7752-9d97-4268-b193-3b325fd83572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:29.976511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b7752-9d97-4268-b193-3b325fd83572 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:29.977808 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b7752-9d97-4268-b193-3b325fd83572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:29.983552 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b7752-9d97-4268-b193-3b325fd83572 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:29.999660 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 995/1977] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:30.001058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b7752-9d97-4268-b193-3b325fd83572 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:30.014221 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:30.017071 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b7752-9d97-4268-b193-3b325fd83572 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:30.024289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a47ee-7d01-4935-813e-4d97b352a7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:30.025100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a47ee-7d01-4935-813e-4d97b352a7b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:30.025534 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a47ee-7d01-4935-813e-4d97b352a7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:30.026229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a47ee-7d01-4935-813e-4d97b352a7b5 admin admin] PATH_INFO: `/v3/projects/e2ced27be1da4adc8389fdef12bb4b34/users/a648e1ac627e49cdb6d5d478614c5e82/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:30.048134 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a47ee-7d01-4935-813e-4d97b352a7b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2ced27be1da4adc8389fdef12bb4b34, user_id=a648e1ac627e49cdb6d5d478614c5e82, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:30.059563 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a47ee-7d01-4935-813e-4d97b352a7b5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:30.084967 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 996/1978] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:29 2022] PUT /identity/v3/projects/e2ced27be1da4adc8389fdef12bb4b34/users/a648e1ac627e49cdb6d5d478614c5e82/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:30.085192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914e0a7-a970-4b69-b00e-b87a463671cc tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:30.092290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643db019-93c1-4f4a-9e62-2909d31e408a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:30.095932 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643db019-93c1-4f4a-9e62-2909d31e408a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:30.095932 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643db019-93c1-4f4a-9e62-2909d31e408a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:30.122244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-643db019-93c1-4f4a-9e62-2909d31e408a None None] MFA Rules not processed for user `a648e1ac627e49cdb6d5d478614c5e82`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:30.123458 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-643db019-93c1-4f4a-9e62-2909d31e408a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:30.151397 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:30.166391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091745d8-64b3-4221-a112-49eba6295f4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:30.167109 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091745d8-64b3-4221-a112-49eba6295f4c service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:30.167459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091745d8-64b3-4221-a112-49eba6295f4c service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:30.167804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091745d8-64b3-4221-a112-49eba6295f4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:30.197706 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 997/1979] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:30.202654 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a67ec5-b343-4dcd-814e-c7325fa5d9bc None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:30.202942 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a67ec5-b343-4dcd-814e-c7325fa5d9bc None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:30.203218 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a67ec5-b343-4dcd-814e-c7325fa5d9bc None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:30.204824 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 998/1980] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:00:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:00:30.205544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a67ec5-b343-4dcd-814e-c7325fa5d9bc None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:30.231084 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091745d8-64b3-4221-a112-49eba6295f4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:30.232824 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091745d8-64b3-4221-a112-49eba6295f4c service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:30.243360 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 983/1981] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:29 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:00:30.244248 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091745d8-64b3-4221-a112-49eba6295f4c service nova] Authenticating service token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:00:30.258126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091745d8-64b3-4221-a112-49eba6295f4c service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:30.279179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a67ec5-b343-4dcd-814e-c7325fa5d9bc None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:30.285348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e34834-61e1-45f5-9930-846c1e91c1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:30.287011 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e34834-61e1-45f5-9930-846c1e91c1f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:30.287214 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e34834-61e1-45f5-9930-846c1e91c1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:30.287493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e34834-61e1-45f5-9930-846c1e91c1f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:30.288138 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e34834-61e1-45f5-9930-846c1e91c1f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:30.291017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e34834-61e1-45f5-9930-846c1e91c1f7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:30.328236 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 999/1982] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:00:30 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:30.329118 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e34834-61e1-45f5-9930-846c1e91c1f7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:30.339328 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091745d8-64b3-4221-a112-49eba6295f4c service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:30.347784 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:30.401565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e34834-61e1-45f5-9930-846c1e91c1f7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:30.406700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721a788-03e9-43bb-a3f9-c74bc65dff22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:30.407368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721a788-03e9-43bb-a3f9-c74bc65dff22 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:30.407645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721a788-03e9-43bb-a3f9-c74bc65dff22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:30.407935 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721a788-03e9-43bb-a3f9-c74bc65dff22 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:30.408598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721a788-03e9-43bb-a3f9-c74bc65dff22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:30.410669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721a788-03e9-43bb-a3f9-c74bc65dff22 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:30.422798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5cf2b2-60e1-4d97-89c8-fc339cd8ba20 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97157111173e43c39d7b5c91ee3e9f67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b9e55d6da94bce82300a73c0a3841e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:30.423645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5cf2b2-60e1-4d97-89c8-fc339cd8ba20 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:30.423998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5cf2b2-60e1-4d97-89c8-fc339cd8ba20 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:30.424385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5cf2b2-60e1-4d97-89c8-fc339cd8ba20 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] PATH_INFO: `/v3/projects/171fee697f24485fa7dbf1c677ce0132` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:30.425675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5cf2b2-60e1-4d97-89c8-fc339cd8ba20 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorizing `identity:get_project(project_id=171fee697f24485fa7dbf1c677ce0132)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:30.428683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5cf2b2-60e1-4d97-89c8-fc339cd8ba20 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:30.431020 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 984/1983] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:00:30 2022] GET /identity/v3/projects/171fee697f24485fa7dbf1c677ce0132 => generated 369 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:00:30.435795 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1000/1984] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:30 2022] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:30.443201 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5cf2b2-60e1-4d97-89c8-fc339cd8ba20 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:30.459631 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5cf2b2-60e1-4d97-89c8-fc339cd8ba20 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:30.460310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721a788-03e9-43bb-a3f9-c74bc65dff22 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:30.468185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a78e1-4c78-4cc8-b116-85f5202a4175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:30.468888 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a78e1-4c78-4cc8-b116-85f5202a4175 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:30.469294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a78e1-4c78-4cc8-b116-85f5202a4175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:30.469655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a78e1-4c78-4cc8-b116-85f5202a4175 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:30.470372 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4a78e1-4c78-4cc8-b116-85f5202a4175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:30.472090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4a78e1-4c78-4cc8-b116-85f5202a4175 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:30.474609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721a788-03e9-43bb-a3f9-c74bc65dff22 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:30.480684 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ffdfcb-69ed-45b5-b362-ad795dc494e7 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97157111173e43c39d7b5c91ee3e9f67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b9e55d6da94bce82300a73c0a3841e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:30.481585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffdfcb-69ed-45b5-b362-ad795dc494e7 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:30.481781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffdfcb-69ed-45b5-b362-ad795dc494e7 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:30.482057 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffdfcb-69ed-45b5-b362-ad795dc494e7 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] PATH_INFO: `/v3/projects/171fee697f24485fa7dbf1c677ce0132` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:30.483201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ffdfcb-69ed-45b5-b362-ad795dc494e7 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorizing `identity:delete_project(project_id=171fee697f24485fa7dbf1c677ce0132)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:30.483716 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 985/1985] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:30.484521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a78e1-4c78-4cc8-b116-85f5202a4175 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:30.488773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ffdfcb-69ed-45b5-b362-ad795dc494e7 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:30.535123 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:30.550240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c5ffdfcb-69ed-45b5-b362-ad795dc494e7 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '171fee697f24485fa7dbf1c677ce0132', 'request_id': 'req-c5ffdfcb-69ed-45b5-b362-ad795dc494e7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:30.560070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c5ffdfcb-69ed-45b5-b362-ad795dc494e7 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '171fee697f24485fa7dbf1c677ce0132', 'request_id': 'req-c5ffdfcb-69ed-45b5-b362-ad795dc494e7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:30.570453 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c5ffdfcb-69ed-45b5-b362-ad795dc494e7 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '171fee697f24485fa7dbf1c677ce0132', 'request_id': 'req-c5ffdfcb-69ed-45b5-b362-ad795dc494e7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:30.581519 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a78e1-4c78-4cc8-b116-85f5202a4175 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:30.591686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c5ffdfcb-69ed-45b5-b362-ad795dc494e7 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] The token cache is being invalidate because project 171fee697f24485fa7dbf1c677ce0132 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:30.592329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c5ffdfcb-69ed-45b5-b362-ad795dc494e7 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:30.593286 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c5ffdfcb-69ed-45b5-b362-ad795dc494e7 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:30.595515 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1001/1986] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:30 2022] DELETE /identity/v3/projects/171fee697f24485fa7dbf1c677ce0132 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:30.596825 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ffdfcb-69ed-45b5-b362-ad795dc494e7 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:30.602240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c5ffdfcb-69ed-45b5-b362-ad795dc494e7 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:30.677384 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052deec-d2bc-4ffe-9687-2cb56585b461 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:30.680447 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052deec-d2bc-4ffe-9687-2cb56585b461 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:30.680447 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052deec-d2bc-4ffe-9687-2cb56585b461 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:30.681300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052deec-d2bc-4ffe-9687-2cb56585b461 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:30.684603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0052deec-d2bc-4ffe-9687-2cb56585b461 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:30.726904 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:30.731142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ffdfcb-69ed-45b5-b362-ad795dc494e7 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:30.737310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3465477-241f-4d10-8148-a7edf0638a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:30.737948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3465477-241f-4d10-8148-a7edf0638a86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:30.738232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3465477-241f-4d10-8148-a7edf0638a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:30.738507 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3465477-241f-4d10-8148-a7edf0638a86 admin admin] PATH_INFO: `/v3/projects/998adaa72fcf448f9d321a8ed8a880ec/users/ddd91ebb3eac42b2bb5e129ada311342/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:30.756010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0052deec-d2bc-4ffe-9687-2cb56585b461 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:30.757737 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3465477-241f-4d10-8148-a7edf0638a86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=998adaa72fcf448f9d321a8ed8a880ec, user_id=ddd91ebb3eac42b2bb5e129ada311342, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:30.757908 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0052deec-d2bc-4ffe-9687-2cb56585b461 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:30.760443 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3465477-241f-4d10-8148-a7edf0638a86 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:30.770690 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 986/1987] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:30 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:30.786983 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1002/1988] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:30 2022] PUT /identity/v3/projects/998adaa72fcf448f9d321a8ed8a880ec/users/ddd91ebb3eac42b2bb5e129ada311342/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:30.790874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052deec-d2bc-4ffe-9687-2cb56585b461 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:30.803062 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052deec-d2bc-4ffe-9687-2cb56585b461 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:30.877822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba81ff4-3b7c-49f7-948a-edbd5107fa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:30.878574 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba81ff4-3b7c-49f7-948a-edbd5107fa91 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:30.879077 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba81ff4-3b7c-49f7-948a-edbd5107fa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:30.879381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba81ff4-3b7c-49f7-948a-edbd5107fa91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:30.880074 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba81ff4-3b7c-49f7-948a-edbd5107fa91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:30.881728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba81ff4-3b7c-49f7-948a-edbd5107fa91 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:30.896758 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 987/1989] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:30.898124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3465477-241f-4d10-8148-a7edf0638a86 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:30.913553 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e56478-a9af-430e-9d41-10ad0bd92d0b None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:30.913839 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e56478-a9af-430e-9d41-10ad0bd92d0b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:30.914106 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e56478-a9af-430e-9d41-10ad0bd92d0b None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:30.916425 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 988/1990] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:00:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:00:30.922123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e56478-a9af-430e-9d41-10ad0bd92d0b None None] Authenticating service token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:00:30.923738 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3465477-241f-4d10-8148-a7edf0638a86 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:30.924075 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-83e56478-a9af-430e-9d41-10ad0bd92d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:30.930592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4785e-7fa2-4c3c-ac16-b5489a45c928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:30.931274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4785e-7fa2-4c3c-ac16-b5489a45c928 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:30.931748 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4785e-7fa2-4c3c-ac16-b5489a45c928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:30.932107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4785e-7fa2-4c3c-ac16-b5489a45c928 admin admin] PATH_INFO: `/v3/projects/998adaa72fcf448f9d321a8ed8a880ec/users/ddd91ebb3eac42b2bb5e129ada311342/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:30.934575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b4785e-7fa2-4c3c-ac16-b5489a45c928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=998adaa72fcf448f9d321a8ed8a880ec, user_id=ddd91ebb3eac42b2bb5e129ada311342, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:30.937914 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b4785e-7fa2-4c3c-ac16-b5489a45c928 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:30.966952 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1003/1991] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:30 2022] PUT /identity/v3/projects/998adaa72fcf448f9d321a8ed8a880ec/users/ddd91ebb3eac42b2bb5e129ada311342/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:30.969350 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ea004-4508-4700-ac85-1e7c59191703 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:30.969883 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ea004-4508-4700-ac85-1e7c59191703 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:30.970336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ea004-4508-4700-ac85-1e7c59191703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:31.012000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-535ea004-4508-4700-ac85-1e7c59191703 None None] MFA Rules not processed for user `ddd91ebb3eac42b2bb5e129ada311342`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:31.013650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-535ea004-4508-4700-ac85-1e7c59191703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:31.036976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e56478-a9af-430e-9d41-10ad0bd92d0b None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:31.038958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-83e56478-a9af-430e-9d41-10ad0bd92d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:31.117402 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1004/1992] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:31.118641 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e56478-a9af-430e-9d41-10ad0bd92d0b None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:31.118756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ea004-4508-4700-ac85-1e7c59191703 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:31.120429 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-535ea004-4508-4700-ac85-1e7c59191703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:31.130579 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:31.151239 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:31.199441 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ed2be-b2d9-4dde-ba1b-99cd9101eca6 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97157111173e43c39d7b5c91ee3e9f67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b9e55d6da94bce82300a73c0a3841e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:31.199945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ed2be-b2d9-4dde-ba1b-99cd9101eca6 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:31.200422 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ed2be-b2d9-4dde-ba1b-99cd9101eca6 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:31.200647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ed2be-b2d9-4dde-ba1b-99cd9101eca6 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] PATH_INFO: `/v3/projects/5d8e661355c1454fbeabfe02863dea63` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:31.201889 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ed2be-b2d9-4dde-ba1b-99cd9101eca6 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorizing `identity:get_project(project_id=5d8e661355c1454fbeabfe02863dea63)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:31.204060 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ed2be-b2d9-4dde-ba1b-99cd9101eca6 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:31.207602 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 989/1993] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:00:30 2022] GET /identity/v3/projects/5d8e661355c1454fbeabfe02863dea63 => generated 373 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:00:31.209877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7369d-488e-4f3c-8f18-c900df759f99 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:31.210227 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7369d-488e-4f3c-8f18-c900df759f99 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:31.210573 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7369d-488e-4f3c-8f18-c900df759f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:31.215910 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ea004-4508-4700-ac85-1e7c59191703 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:31.222043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e1791-98de-4e9d-95cf-522fe328a848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:31.223124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e1791-98de-4e9d-95cf-522fe328a848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:31.223702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e1791-98de-4e9d-95cf-522fe328a848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:31.224664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e1791-98de-4e9d-95cf-522fe328a848 admin admin] PATH_INFO: `/v3/users/794e8d5261e143618517e53b66d07f62` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:31.227377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370e1791-98de-4e9d-95cf-522fe328a848 admin admin] RBAC: Authorizing `identity:delete_user(user_id=794e8d5261e143618517e53b66d07f62)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:31.233628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370e1791-98de-4e9d-95cf-522fe328a848 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:31.246678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e3e7369d-488e-4f3c-8f18-c900df759f99 None None] MFA Rules not processed for user `a648e1ac627e49cdb6d5d478614c5e82`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:31.248138 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e3e7369d-488e-4f3c-8f18-c900df759f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:31.290621 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-370e1791-98de-4e9d-95cf-522fe328a848 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '794e8d5261e143618517e53b66d07f62'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:31.291441 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-370e1791-98de-4e9d-95cf-522fe328a848 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '794e8d5261e143618517e53b66d07f62'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:31.299650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-370e1791-98de-4e9d-95cf-522fe328a848 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '794e8d5261e143618517e53b66d07f62'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:31.310045 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-370e1791-98de-4e9d-95cf-522fe328a848 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '794e8d5261e143618517e53b66d07f62'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:31.310777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-370e1791-98de-4e9d-95cf-522fe328a848 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '794e8d5261e143618517e53b66d07f62'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:31.314717 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 990/1994] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:31.315623 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7369d-488e-4f3c-8f18-c900df759f99 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:31.316915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e3e7369d-488e-4f3c-8f18-c900df759f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:31.331373 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7369d-488e-4f3c-8f18-c900df759f99 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:31.333645 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1005/1995] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:00:31 2022] DELETE /identity/v3/users/794e8d5261e143618517e53b66d07f62 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:31.334729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e1791-98de-4e9d-95cf-522fe328a848 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:31.336063 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-370e1791-98de-4e9d-95cf-522fe328a848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:31.402420 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2728af-da94-46b9-a7ae-3947e27f4366 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97157111173e43c39d7b5c91ee3e9f67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b9e55d6da94bce82300a73c0a3841e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:31.403015 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2728af-da94-46b9-a7ae-3947e27f4366 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:31.403295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2728af-da94-46b9-a7ae-3947e27f4366 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:31.403562 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2728af-da94-46b9-a7ae-3947e27f4366 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:31.404199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2728af-da94-46b9-a7ae-3947e27f4366 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:00:31.404514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2728af-da94-46b9-a7ae-3947e27f4366 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:31.406267 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2728af-da94-46b9-a7ae-3947e27f4366 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:31.422065 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 991/1996] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:00:31.422267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e1791-98de-4e9d-95cf-522fe328a848 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:31.422389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04151fd-f358-4162-b0fb-9e1a9e683718 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:31.422389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04151fd-f358-4162-b0fb-9e1a9e683718 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:31.422389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04151fd-f358-4162-b0fb-9e1a9e683718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:31.428143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fcd23f-2d8b-4f75-9905-f8c1f1a50e45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:31.428831 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcd23f-2d8b-4f75-9905-f8c1f1a50e45 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:31.429216 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcd23f-2d8b-4f75-9905-f8c1f1a50e45 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:31.429581 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcd23f-2d8b-4f75-9905-f8c1f1a50e45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:31.431861 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-72fcd23f-2d8b-4f75-9905-f8c1f1a50e45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:31.442478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c04151fd-f358-4162-b0fb-9e1a9e683718 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:31.448096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c04151fd-f358-4162-b0fb-9e1a9e683718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:31.474202 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:31.505665 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fcd23f-2d8b-4f75-9905-f8c1f1a50e45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:31.507281 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fcd23f-2d8b-4f75-9905-f8c1f1a50e45 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:31.508383 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:31.517468 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1006/1997] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:31.518204 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fcd23f-2d8b-4f75-9905-f8c1f1a50e45 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:31.522606 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 992/1998] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:31.532459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04151fd-f358-4162-b0fb-9e1a9e683718 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:31.533137 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fcd23f-2d8b-4f75-9905-f8c1f1a50e45 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:31.534084 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c04151fd-f358-4162-b0fb-9e1a9e683718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:31.537933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ddf69-8887-4753-b2a2-f69767b0b863 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97157111173e43c39d7b5c91ee3e9f67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b9e55d6da94bce82300a73c0a3841e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:31.538545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ddf69-8887-4753-b2a2-f69767b0b863 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:31.538829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ddf69-8887-4753-b2a2-f69767b0b863 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:31.539103 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ddf69-8887-4753-b2a2-f69767b0b863 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:31.539740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ddf69-8887-4753-b2a2-f69767b0b863 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:31.541697 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ddf69-8887-4753-b2a2-f69767b0b863 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:31.587533 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1007/1999] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:00:31 2022] POST /identity/v3/projects => generated 369 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:31.591768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ddf69-8887-4753-b2a2-f69767b0b863 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:31.612804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04151fd-f358-4162-b0fb-9e1a9e683718 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:31.679259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ddf69-8887-4753-b2a2-f69767b0b863 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:31.684046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9e394-1019-4e8b-a81c-eb15f6a3cea0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:31.684794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9e394-1019-4e8b-a81c-eb15f6a3cea0 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:31.685067 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9e394-1019-4e8b-a81c-eb15f6a3cea0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:31.685466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9e394-1019-4e8b-a81c-eb15f6a3cea0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:31.685867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf21351-69f8-4661-abdf-1dc49ab7098b tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97157111173e43c39d7b5c91ee3e9f67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b9e55d6da94bce82300a73c0a3841e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:31.686605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf21351-69f8-4661-abdf-1dc49ab7098b tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:31.687028 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf21351-69f8-4661-abdf-1dc49ab7098b tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:31.687309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf21351-69f8-4661-abdf-1dc49ab7098b tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:31.687979 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf21351-69f8-4661-abdf-1dc49ab7098b tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:00:31.688289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf21351-69f8-4661-abdf-1dc49ab7098b tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:31.690330 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf21351-69f8-4661-abdf-1dc49ab7098b tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:31.706875 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1008/2000] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:00:31.769962 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9e394-1019-4e8b-a81c-eb15f6a3cea0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:31.772097 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9e394-1019-4e8b-a81c-eb15f6a3cea0 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:31.783537 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 993/2001] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:00:31.991574 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32f512-9709-4619-8de3-ad8564a4c360 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:31.991863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32f512-9709-4619-8de3-ad8564a4c360 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:31.992159 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32f512-9709-4619-8de3-ad8564a4c360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:32.018952 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b4282-5c74-4c7b-a6ef-08674a209832 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:32.019240 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b4282-5c74-4c7b-a6ef-08674a209832 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:32.019515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b4282-5c74-4c7b-a6ef-08674a209832 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:32.022052 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 994/2002] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:00:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:00:32.025998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b4282-5c74-4c7b-a6ef-08674a209832 None None] Authenticating service token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:00:32.046480 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-2e32f512-9709-4619-8de3-ad8564a4c360 None None] MFA Rules not processed for user `a648e1ac627e49cdb6d5d478614c5e82`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:32.047992 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2e32f512-9709-4619-8de3-ad8564a4c360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:32.114646 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:32.134988 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b4282-5c74-4c7b-a6ef-08674a209832 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:32.148429 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b4282-5c74-4c7b-a6ef-08674a209832 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:32.156820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197fbd2a-5f28-48ec-9a6d-4040e61d966e tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97157111173e43c39d7b5c91ee3e9f67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b9e55d6da94bce82300a73c0a3841e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:32.158049 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fbd2a-5f28-48ec-9a6d-4040e61d966e tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:32.158876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fbd2a-5f28-48ec-9a6d-4040e61d966e tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:32.159862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fbd2a-5f28-48ec-9a6d-4040e61d966e tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] PATH_INFO: `/v3/projects/1d5b845033a743b8960045fe0d49f5cb` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:32.167591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197fbd2a-5f28-48ec-9a6d-4040e61d966e tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorizing `identity:get_project(project_id=1d5b845033a743b8960045fe0d49f5cb)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:32.170004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197fbd2a-5f28-48ec-9a6d-4040e61d966e tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:32.172071 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 995/2003] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:00:32 2022] GET /identity/v3/projects/1d5b845033a743b8960045fe0d49f5cb => generated 369 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:00:32.174130 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1009/2004] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:32.211564 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197fbd2a-5f28-48ec-9a6d-4040e61d966e tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:32.215241 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-197fbd2a-5f28-48ec-9a6d-4040e61d966e tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:32.247931 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197fbd2a-5f28-48ec-9a6d-4040e61d966e tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:32.254142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3f667-8116-4546-9a0e-d9caa75cee8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:32.254849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3f667-8116-4546-9a0e-d9caa75cee8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:32.255094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3f667-8116-4546-9a0e-d9caa75cee8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:32.255446 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3f667-8116-4546-9a0e-d9caa75cee8c admin admin] PATH_INFO: `/v3/projects/736baf137a034c11b6b3711b211eef84` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:32.256993 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3f667-8116-4546-9a0e-d9caa75cee8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=736baf137a034c11b6b3711b211eef84)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:32.258944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3f667-8116-4546-9a0e-d9caa75cee8c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:32.329550 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-62a3f667-8116-4546-9a0e-d9caa75cee8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '736baf137a034c11b6b3711b211eef84', 'request_id': 'req-62a3f667-8116-4546-9a0e-d9caa75cee8c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:32.351499 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-62a3f667-8116-4546-9a0e-d9caa75cee8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '736baf137a034c11b6b3711b211eef84', 'request_id': 'req-62a3f667-8116-4546-9a0e-d9caa75cee8c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:32.359577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-62a3f667-8116-4546-9a0e-d9caa75cee8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '736baf137a034c11b6b3711b211eef84', 'request_id': 'req-62a3f667-8116-4546-9a0e-d9caa75cee8c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:32.382256 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-62a3f667-8116-4546-9a0e-d9caa75cee8c admin admin] The token cache is being invalidate because project 736baf137a034c11b6b3711b211eef84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:32.382549 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-62a3f667-8116-4546-9a0e-d9caa75cee8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:32.383234 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-62a3f667-8116-4546-9a0e-d9caa75cee8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:32.385511 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 996/2005] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:32 2022] DELETE /identity/v3/projects/736baf137a034c11b6b3711b211eef84 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:32.389155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32f512-9709-4619-8de3-ad8564a4c360 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:32.403165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32f512-9709-4619-8de3-ad8564a4c360 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:32.486586 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:32.500525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88303de7-1051-4971-a31b-7482ece79af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:32.501259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88303de7-1051-4971-a31b-7482ece79af2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:32.501670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88303de7-1051-4971-a31b-7482ece79af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:32.502234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88303de7-1051-4971-a31b-7482ece79af2 admin admin] PATH_INFO: `/v3/users/38de2174bdd04a24bb6362ba344c8b04` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:32.505183 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88303de7-1051-4971-a31b-7482ece79af2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38de2174bdd04a24bb6362ba344c8b04)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:32.508663 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88303de7-1051-4971-a31b-7482ece79af2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:32.535944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87442aa-47c2-4266-9a0c-7b98f0d7d7ae None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:32.536454 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87442aa-47c2-4266-9a0c-7b98f0d7d7ae None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:32.537258 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87442aa-47c2-4266-9a0c-7b98f0d7d7ae None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:32.538106 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 997/2006] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:00:32.542916 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87442aa-47c2-4266-9a0c-7b98f0d7d7ae None None] Authenticating service token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:00:32.545195 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e87442aa-47c2-4266-9a0c-7b98f0d7d7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:32.582734 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-88303de7-1051-4971-a31b-7482ece79af2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38de2174bdd04a24bb6362ba344c8b04'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:32.589851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-88303de7-1051-4971-a31b-7482ece79af2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38de2174bdd04a24bb6362ba344c8b04'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:32.598630 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-88303de7-1051-4971-a31b-7482ece79af2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38de2174bdd04a24bb6362ba344c8b04'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:32.607310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-88303de7-1051-4971-a31b-7482ece79af2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38de2174bdd04a24bb6362ba344c8b04'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:32.608073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-88303de7-1051-4971-a31b-7482ece79af2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38de2174bdd04a24bb6362ba344c8b04'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:32.629613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87442aa-47c2-4266-9a0c-7b98f0d7d7ae None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:32.631487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e87442aa-47c2-4266-9a0c-7b98f0d7d7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:32.635769 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1010/2007] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:00:32 2022] DELETE /identity/v3/users/38de2174bdd04a24bb6362ba344c8b04 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:32.716945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87442aa-47c2-4266-9a0c-7b98f0d7d7ae None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:32.731200 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:32.811796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c4d025-40e5-4d59-a732-92c7c5a240ef tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97157111173e43c39d7b5c91ee3e9f67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b9e55d6da94bce82300a73c0a3841e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:32.812407 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4d025-40e5-4d59-a732-92c7c5a240ef tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:32.812717 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4d025-40e5-4d59-a732-92c7c5a240ef tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:32.813005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4d025-40e5-4d59-a732-92c7c5a240ef tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] PATH_INFO: `/v3/projects/1d5b845033a743b8960045fe0d49f5cb` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:32.816140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c4d025-40e5-4d59-a732-92c7c5a240ef tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorizing `identity:get_project(project_id=1d5b845033a743b8960045fe0d49f5cb)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:32.819122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c4d025-40e5-4d59-a732-92c7c5a240ef tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:32.821012 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 998/2008] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:00:32 2022] GET /identity/v3/projects/1d5b845033a743b8960045fe0d49f5cb => generated 369 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:00:32.901469 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88303de7-1051-4971-a31b-7482ece79af2 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:32.902712 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-88303de7-1051-4971-a31b-7482ece79af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:32.923752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88303de7-1051-4971-a31b-7482ece79af2 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:32.933309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765eaf4-bc23-48b9-97e5-f7786a0a7cd7 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97157111173e43c39d7b5c91ee3e9f67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b9e55d6da94bce82300a73c0a3841e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:32.934437 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765eaf4-bc23-48b9-97e5-f7786a0a7cd7 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:32.934915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765eaf4-bc23-48b9-97e5-f7786a0a7cd7 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:32.935258 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765eaf4-bc23-48b9-97e5-f7786a0a7cd7 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:32.936210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765eaf4-bc23-48b9-97e5-f7786a0a7cd7 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:00:32.936586 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765eaf4-bc23-48b9-97e5-f7786a0a7cd7 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:32.938766 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765eaf4-bc23-48b9-97e5-f7786a0a7cd7 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:32.959251 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1011/2009] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:00:32.959834 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c4d025-40e5-4d59-a732-92c7c5a240ef tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:32.960850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765eaf4-bc23-48b9-97e5-f7786a0a7cd7 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:32.961676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-78c4d025-40e5-4d59-a732-92c7c5a240ef tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:32.974387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765eaf4-bc23-48b9-97e5-f7786a0a7cd7 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:32.980322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9fe38f-7bf1-475b-8a46-8c5d1ea0bcea tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97157111173e43c39d7b5c91ee3e9f67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b9e55d6da94bce82300a73c0a3841e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:32.981382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9fe38f-7bf1-475b-8a46-8c5d1ea0bcea tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:32.982183 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9fe38f-7bf1-475b-8a46-8c5d1ea0bcea tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:32.982602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9fe38f-7bf1-475b-8a46-8c5d1ea0bcea tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:32.983669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9fe38f-7bf1-475b-8a46-8c5d1ea0bcea tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:32.986069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9fe38f-7bf1-475b-8a46-8c5d1ea0bcea tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:33.015959 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1012/2010] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:32 2022] POST /identity/v3/users => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:33.017091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9fe38f-7bf1-475b-8a46-8c5d1ea0bcea tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:33.027433 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9fe38f-7bf1-475b-8a46-8c5d1ea0bcea tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:33.032236 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c60835-557f-4d8f-9e5d-a16ba04ecfd1 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97157111173e43c39d7b5c91ee3e9f67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b9e55d6da94bce82300a73c0a3841e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:33.032953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c60835-557f-4d8f-9e5d-a16ba04ecfd1 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:33.033308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c60835-557f-4d8f-9e5d-a16ba04ecfd1 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:33.033683 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c60835-557f-4d8f-9e5d-a16ba04ecfd1 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:33.034337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c60835-557f-4d8f-9e5d-a16ba04ecfd1 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:00:33.034653 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c60835-557f-4d8f-9e5d-a16ba04ecfd1 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:33.036961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c60835-557f-4d8f-9e5d-a16ba04ecfd1 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:33.046032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c4d025-40e5-4d59-a732-92c7c5a240ef tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:33.050833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32e272-a3be-4c58-b38e-f65631be92d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:33.051495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32e272-a3be-4c58-b38e-f65631be92d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:33.052491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32e272-a3be-4c58-b38e-f65631be92d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:33.052768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32e272-a3be-4c58-b38e-f65631be92d9 admin admin] PATH_INFO: `/v3/projects/7fcaead77e6a4d4baf40f9b688626113` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:33.053930 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb32e272-a3be-4c58-b38e-f65631be92d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fcaead77e6a4d4baf40f9b688626113)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:33.054987 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1013/2011] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:00:33.055828 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb32e272-a3be-4c58-b38e-f65631be92d9 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:33.076568 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b2f9f-357e-49b1-8fab-2dbe8513bc26 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:33.076850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b2f9f-357e-49b1-8fab-2dbe8513bc26 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:33.077045 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b2f9f-357e-49b1-8fab-2dbe8513bc26 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:33.078393 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1014/2012] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 04 01:00:33.083213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b2f9f-357e-49b1-8fab-2dbe8513bc26 None None] Authenticating service token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:00:33.085542 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e41b2f9f-357e-49b1-8fab-2dbe8513bc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:33.114933 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-fb32e272-a3be-4c58-b38e-f65631be92d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fcaead77e6a4d4baf40f9b688626113', 'request_id': 'req-fb32e272-a3be-4c58-b38e-f65631be92d9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:33.126779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-fb32e272-a3be-4c58-b38e-f65631be92d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fcaead77e6a4d4baf40f9b688626113', 'request_id': 'req-fb32e272-a3be-4c58-b38e-f65631be92d9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:33.136944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-fb32e272-a3be-4c58-b38e-f65631be92d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fcaead77e6a4d4baf40f9b688626113', 'request_id': 'req-fb32e272-a3be-4c58-b38e-f65631be92d9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:33.163255 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-fb32e272-a3be-4c58-b38e-f65631be92d9 admin admin] The token cache is being invalidate because project 7fcaead77e6a4d4baf40f9b688626113 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:33.164005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-fb32e272-a3be-4c58-b38e-f65631be92d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:33.164823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-fb32e272-a3be-4c58-b38e-f65631be92d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:33.166842 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 999/2013] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:32 2022] DELETE /identity/v3/projects/7fcaead77e6a4d4baf40f9b688626113 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:33.172244 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bc068-a8f3-4386-80ac-a7d1d9768e57 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:33.172604 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bc068-a8f3-4386-80ac-a7d1d9768e57 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:33.173005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bc068-a8f3-4386-80ac-a7d1d9768e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:33.198179 n-d-master-1 devstack@keystone.service[81824]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-e41b2f9f-357e-49b1-8fab-2dbe8513bc26 None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Sep 04 01:00:33.198972 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b2f9f-357e-49b1-8fab-2dbe8513bc26 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:33.203384 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-9d0bc068-a8f3-4386-80ac-a7d1d9768e57 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:33.204780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9d0bc068-a8f3-4386-80ac-a7d1d9768e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:33.211184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b2f9f-357e-49b1-8fab-2dbe8513bc26 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:33.230037 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:33.270211 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:33.315415 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1000/2014] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:00:33.316406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197c995-fbf6-4ef9-950f-ce3b2dfd9043 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97157111173e43c39d7b5c91ee3e9f67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b9e55d6da94bce82300a73c0a3841e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:33.317725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197c995-fbf6-4ef9-950f-ce3b2dfd9043 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:33.317966 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197c995-fbf6-4ef9-950f-ce3b2dfd9043 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:33.318243 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197c995-fbf6-4ef9-950f-ce3b2dfd9043 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] PATH_INFO: `/v3/projects/1d5b845033a743b8960045fe0d49f5cb` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:33.319472 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197c995-fbf6-4ef9-950f-ce3b2dfd9043 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorizing `identity:get_project(project_id=1d5b845033a743b8960045fe0d49f5cb)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:33.321669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197c995-fbf6-4ef9-950f-ce3b2dfd9043 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:33.323645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e60384-4ad8-4aa8-8155-50165d6fb7c4 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:33.324194 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e60384-4ad8-4aa8-8155-50165d6fb7c4 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:33.324683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e60384-4ad8-4aa8-8155-50165d6fb7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:33.325935 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1015/2015] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:00:33 2022] GET /identity/v3/projects/1d5b845033a743b8960045fe0d49f5cb => generated 369 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:00:33.349868 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-55e60384-4ad8-4aa8-8155-50165d6fb7c4 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:33.351193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-55e60384-4ad8-4aa8-8155-50165d6fb7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:33.359484 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1001/2016] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:00:33.364759 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197c995-fbf6-4ef9-950f-ce3b2dfd9043 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:33.376222 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197c995-fbf6-4ef9-950f-ce3b2dfd9043 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:33.382304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572f866-b6c5-45af-8633-64aa1bc40cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:33.382738 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572f866-b6c5-45af-8633-64aa1bc40cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:33.383017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572f866-b6c5-45af-8633-64aa1bc40cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:33.383431 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572f866-b6c5-45af-8633-64aa1bc40cb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:33.384081 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572f866-b6c5-45af-8633-64aa1bc40cb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:00:33.384385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572f866-b6c5-45af-8633-64aa1bc40cb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:33.386007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572f866-b6c5-45af-8633-64aa1bc40cb8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:33.401608 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1016/2017] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:00:33.403525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e60384-4ad8-4aa8-8155-50165d6fb7c4 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:33.414744 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e60384-4ad8-4aa8-8155-50165d6fb7c4 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:33.420694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d42b771-0b57-4e6d-be68-4285c728562a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:33.422043 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42b771-0b57-4e6d-be68-4285c728562a admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:33.422043 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42b771-0b57-4e6d-be68-4285c728562a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:33.422248 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42b771-0b57-4e6d-be68-4285c728562a admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:33.422903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d42b771-0b57-4e6d-be68-4285c728562a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:33.424855 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d42b771-0b57-4e6d-be68-4285c728562a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:33.469802 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1002/2018] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:00:33 2022] POST /identity/v3/projects => generated 395 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:33.472500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572f866-b6c5-45af-8633-64aa1bc40cb8 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:33.483859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572f866-b6c5-45af-8633-64aa1bc40cb8 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:33.507451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105d44f-aef1-4617-a766-83c0daf2fe39 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:33.507788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105d44f-aef1-4617-a766-83c0daf2fe39 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:33.508063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105d44f-aef1-4617-a766-83c0daf2fe39 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:33.509423 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1003/2019] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:00:33.514593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105d44f-aef1-4617-a766-83c0daf2fe39 None None] Authenticating service token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:00:33.516411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3105d44f-aef1-4617-a766-83c0daf2fe39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:33.558488 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee6308-29fa-4165-bebf-93262288f049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:33.559716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee6308-29fa-4165-bebf-93262288f049 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:33.560501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee6308-29fa-4165-bebf-93262288f049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:33.560791 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee6308-29fa-4165-bebf-93262288f049 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:33.561664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee6308-29fa-4165-bebf-93262288f049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:33.564772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee6308-29fa-4165-bebf-93262288f049 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:33.593515 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1017/2020] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:33 2022] POST /identity/v3/users => generated 298 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:00:33.594341 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee6308-29fa-4165-bebf-93262288f049 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:33.603121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105d44f-aef1-4617-a766-83c0daf2fe39 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:33.604391 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee6308-29fa-4165-bebf-93262288f049 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:33.604519 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3105d44f-aef1-4617-a766-83c0daf2fe39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:33.609099 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0bbc1f-5ead-47df-ba7a-bbab760fa540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:33.609748 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bbc1f-5ead-47df-ba7a-bbab760fa540 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:33.610276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bbc1f-5ead-47df-ba7a-bbab760fa540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:33.610547 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bbc1f-5ead-47df-ba7a-bbab760fa540 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:33.611237 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0bbc1f-5ead-47df-ba7a-bbab760fa540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:33.612772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0bbc1f-5ead-47df-ba7a-bbab760fa540 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:33.629530 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1018/2021] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:33.632528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0bbc1f-5ead-47df-ba7a-bbab760fa540 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:33.643093 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0bbc1f-5ead-47df-ba7a-bbab760fa540 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:33.648622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4dda0e-eebd-4fbc-af37-2376811e3f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:33.648886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4dda0e-eebd-4fbc-af37-2376811e3f07 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:33.649167 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4dda0e-eebd-4fbc-af37-2376811e3f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:33.650624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4dda0e-eebd-4fbc-af37-2376811e3f07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:33.650739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4dda0e-eebd-4fbc-af37-2376811e3f07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:33.653053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4dda0e-eebd-4fbc-af37-2376811e3f07 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:33.669194 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1019/2022] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:33.670547 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4dda0e-eebd-4fbc-af37-2376811e3f07 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:33.674860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105d44f-aef1-4617-a766-83c0daf2fe39 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:33.680237 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663a27a-0514-4684-a843-073ba172fc2e tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97157111173e43c39d7b5c91ee3e9f67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b9e55d6da94bce82300a73c0a3841e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:33.680981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663a27a-0514-4684-a843-073ba172fc2e tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:33.681344 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663a27a-0514-4684-a843-073ba172fc2e tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:33.681716 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663a27a-0514-4684-a843-073ba172fc2e tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] PATH_INFO: `/v3/projects/1d5b845033a743b8960045fe0d49f5cb` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:33.682927 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663a27a-0514-4684-a843-073ba172fc2e tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorizing `identity:get_project(project_id=1d5b845033a743b8960045fe0d49f5cb)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:33.683248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4dda0e-eebd-4fbc-af37-2376811e3f07 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:33.685127 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663a27a-0514-4684-a843-073ba172fc2e tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:33.686907 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1004/2023] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:00:33 2022] GET /identity/v3/projects/1d5b845033a743b8960045fe0d49f5cb => generated 369 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:00:33.688457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7ba94-3994-41ea-af55-3e246048e4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:33.689109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7ba94-3994-41ea-af55-3e246048e4be admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:33.689387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7ba94-3994-41ea-af55-3e246048e4be admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:33.689691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7ba94-3994-41ea-af55-3e246048e4be admin admin] PATH_INFO: `/v3/projects/371b0bd7015f4f70aef1fd76572a52ff/users/41571ce2b64c4762b04ed0848bf34c4e/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:33.709817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7ba94-3994-41ea-af55-3e246048e4be admin admin] RBAC: Authorizing `identity:create_grant(project_id=371b0bd7015f4f70aef1fd76572a52ff, user_id=41571ce2b64c4762b04ed0848bf34c4e, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:33.712515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7ba94-3994-41ea-af55-3e246048e4be admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:33.727887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663a27a-0514-4684-a843-073ba172fc2e tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:33.733560 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1020/2024] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:33 2022] PUT /identity/v3/projects/371b0bd7015f4f70aef1fd76572a52ff/users/41571ce2b64c4762b04ed0848bf34c4e/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:33.735332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff07c8d-4bb8-443b-81ed-79fc1f80f9ee None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:33.736114 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff07c8d-4bb8-443b-81ed-79fc1f80f9ee None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:33.736114 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff07c8d-4bb8-443b-81ed-79fc1f80f9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:33.741315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663a27a-0514-4684-a843-073ba172fc2e tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:33.759247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-fff07c8d-4bb8-443b-81ed-79fc1f80f9ee None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:33.760456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fff07c8d-4bb8-443b-81ed-79fc1f80f9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:33.803760 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:33.812220 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:33.817796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3edad4-925f-45e3-a8d2-10c0ec165561 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97157111173e43c39d7b5c91ee3e9f67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b9e55d6da94bce82300a73c0a3841e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:33.818809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3edad4-925f-45e3-a8d2-10c0ec165561 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:33.820161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3edad4-925f-45e3-a8d2-10c0ec165561 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:33.821350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3edad4-925f-45e3-a8d2-10c0ec165561 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] PATH_INFO: `/v3/users/6bdfac8474da4f1fa8022030d28ebbf3` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:33.831274 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1021/2025] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:00:33.838211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff07c8d-4bb8-443b-81ed-79fc1f80f9ee None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:33.838385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3edad4-925f-45e3-a8d2-10c0ec165561 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6bdfac8474da4f1fa8022030d28ebbf3)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:33.839593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fff07c8d-4bb8-443b-81ed-79fc1f80f9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:33.840449 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3edad4-925f-45e3-a8d2-10c0ec165561 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:33.908681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ea3edad4-925f-45e3-a8d2-10c0ec165561 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bdfac8474da4f1fa8022030d28ebbf3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:33.910492 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ea3edad4-925f-45e3-a8d2-10c0ec165561 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bdfac8474da4f1fa8022030d28ebbf3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:33.922343 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ea3edad4-925f-45e3-a8d2-10c0ec165561 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bdfac8474da4f1fa8022030d28ebbf3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:33.931039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff07c8d-4bb8-443b-81ed-79fc1f80f9ee None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:33.936603 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d233ce-7802-4f9b-b8ff-9ed3805099af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:33.936984 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ea3edad4-925f-45e3-a8d2-10c0ec165561 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bdfac8474da4f1fa8022030d28ebbf3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:33.937247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d233ce-7802-4f9b-b8ff-9ed3805099af service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:33.937575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d233ce-7802-4f9b-b8ff-9ed3805099af service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:33.937851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d233ce-7802-4f9b-b8ff-9ed3805099af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:33.938715 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ea3edad4-925f-45e3-a8d2-10c0ec165561 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bdfac8474da4f1fa8022030d28ebbf3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:33.939638 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a7d233ce-7802-4f9b-b8ff-9ed3805099af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:33.952592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d233ce-7802-4f9b-b8ff-9ed3805099af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:33.956195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d233ce-7802-4f9b-b8ff-9ed3805099af service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:33.976793 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1005/2026] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:00:33 2022] DELETE /identity/v3/users/6bdfac8474da4f1fa8022030d28ebbf3 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:33.977532 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1022/2027] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:00:33.980587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3edad4-925f-45e3-a8d2-10c0ec165561 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:33.982044 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ea3edad4-925f-45e3-a8d2-10c0ec165561 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:34.094432 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3edad4-925f-45e3-a8d2-10c0ec165561 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:34.101055 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464a17b-d38b-4cec-a4ea-b2e4d95cb9fd tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97157111173e43c39d7b5c91ee3e9f67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b9e55d6da94bce82300a73c0a3841e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:34.101671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464a17b-d38b-4cec-a4ea-b2e4d95cb9fd tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:34.102297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464a17b-d38b-4cec-a4ea-b2e4d95cb9fd tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:34.102583 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464a17b-d38b-4cec-a4ea-b2e4d95cb9fd tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] PATH_INFO: `/v3/projects/1d5b845033a743b8960045fe0d49f5cb` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:34.104033 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2464a17b-d38b-4cec-a4ea-b2e4d95cb9fd tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1d5b845033a743b8960045fe0d49f5cb)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:34.106734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2464a17b-d38b-4cec-a4ea-b2e4d95cb9fd tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:34.167887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2464a17b-d38b-4cec-a4ea-b2e4d95cb9fd tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d5b845033a743b8960045fe0d49f5cb', 'request_id': 'req-2464a17b-d38b-4cec-a4ea-b2e4d95cb9fd'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:34.183042 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2464a17b-d38b-4cec-a4ea-b2e4d95cb9fd tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d5b845033a743b8960045fe0d49f5cb', 'request_id': 'req-2464a17b-d38b-4cec-a4ea-b2e4d95cb9fd'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:34.192463 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2464a17b-d38b-4cec-a4ea-b2e4d95cb9fd tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d5b845033a743b8960045fe0d49f5cb', 'request_id': 'req-2464a17b-d38b-4cec-a4ea-b2e4d95cb9fd'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:34.195591 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:34.212119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2464a17b-d38b-4cec-a4ea-b2e4d95cb9fd tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] The token cache is being invalidate because project 1d5b845033a743b8960045fe0d49f5cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:34.212757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2464a17b-d38b-4cec-a4ea-b2e4d95cb9fd tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:34.214168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2464a17b-d38b-4cec-a4ea-b2e4d95cb9fd tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:34.222364 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1006/2028] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:33 2022] DELETE /identity/v3/projects/1d5b845033a743b8960045fe0d49f5cb => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:00:34.249493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffebf8-0240-4e9e-a42b-10d314d040f4 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:34.249791 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffebf8-0240-4e9e-a42b-10d314d040f4 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:34.250072 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffebf8-0240-4e9e-a42b-10d314d040f4 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:34.257095 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1023/2029] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:00:34 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:00:34.264087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464a17b-d38b-4cec-a4ea-b2e4d95cb9fd tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Authenticating service token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:00:34.265763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2464a17b-d38b-4cec-a4ea-b2e4d95cb9fd tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:34.476146 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464a17b-d38b-4cec-a4ea-b2e4d95cb9fd tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:34.479588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2464a17b-d38b-4cec-a4ea-b2e4d95cb9fd tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:34.621490 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464a17b-d38b-4cec-a4ea-b2e4d95cb9fd tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:34.631582 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7304c29-3517-4e05-89d0-d6dadcdf6e13 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97157111173e43c39d7b5c91ee3e9f67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b9e55d6da94bce82300a73c0a3841e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:34.632677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7304c29-3517-4e05-89d0-d6dadcdf6e13 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:34.632677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7304c29-3517-4e05-89d0-d6dadcdf6e13 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:34.632851 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7304c29-3517-4e05-89d0-d6dadcdf6e13 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] PATH_INFO: `/v3/projects/5d8e661355c1454fbeabfe02863dea63` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:34.636108 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7304c29-3517-4e05-89d0-d6dadcdf6e13 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorizing `identity:get_project(project_id=5d8e661355c1454fbeabfe02863dea63)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:34.639732 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7304c29-3517-4e05-89d0-d6dadcdf6e13 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:34.641860 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1007/2030] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:00:34 2022] GET /identity/v3/projects/5d8e661355c1454fbeabfe02863dea63 => generated 373 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:00:34.829660 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33521a-d9ba-47c1-a523-d967102f9347 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:34.830974 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33521a-d9ba-47c1-a523-d967102f9347 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:34.831295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33521a-d9ba-47c1-a523-d967102f9347 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:34.833793 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1024/2031] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:00:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:00:34.840836 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7304c29-3517-4e05-89d0-d6dadcdf6e13 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:34.855903 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33521a-d9ba-47c1-a523-d967102f9347 None None] Authenticating service token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:00:34.857823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7304c29-3517-4e05-89d0-d6dadcdf6e13 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:34.858146 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ac33521a-d9ba-47c1-a523-d967102f9347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:34.866005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51a8a7-b5b1-4d07-89d5-0bf414c18614 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:34.866631 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51a8a7-b5b1-4d07-89d5-0bf414c18614 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:34.866910 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51a8a7-b5b1-4d07-89d5-0bf414c18614 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:34.867182 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51a8a7-b5b1-4d07-89d5-0bf414c18614 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:34.869032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ef51a8a7-b5b1-4d07-89d5-0bf414c18614 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:34.885520 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33521a-d9ba-47c1-a523-d967102f9347 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:34.899660 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33521a-d9ba-47c1-a523-d967102f9347 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:34.905060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe903c2-9fd3-451d-a813-a2caede2d6e5 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97157111173e43c39d7b5c91ee3e9f67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b9e55d6da94bce82300a73c0a3841e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:34.905735 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe903c2-9fd3-451d-a813-a2caede2d6e5 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:34.906018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe903c2-9fd3-451d-a813-a2caede2d6e5 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:34.906294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe903c2-9fd3-451d-a813-a2caede2d6e5 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] PATH_INFO: `/v3/projects/5d8e661355c1454fbeabfe02863dea63` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:34.907530 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe903c2-9fd3-451d-a813-a2caede2d6e5 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorizing `identity:get_project(project_id=5d8e661355c1454fbeabfe02863dea63)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:34.909711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe903c2-9fd3-451d-a813-a2caede2d6e5 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:34.911748 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1025/2032] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:00:34 2022] GET /identity/v3/projects/5d8e661355c1454fbeabfe02863dea63 => generated 373 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:00:34.958723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51a8a7-b5b1-4d07-89d5-0bf414c18614 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:34.960606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51a8a7-b5b1-4d07-89d5-0bf414c18614 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:34.985911 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1008/2033] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:34 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:35.848239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af09a8-2737-432d-b70a-d495a547514f None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:35.849296 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af09a8-2737-432d-b70a-d495a547514f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:35.849505 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af09a8-2737-432d-b70a-d495a547514f None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:35.850880 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1026/2034] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:00:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:00:35.856887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51a8a7-b5b1-4d07-89d5-0bf414c18614 service nova] Authenticating service token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:00:35.870978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51a8a7-b5b1-4d07-89d5-0bf414c18614 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:35.887134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51a8a7-b5b1-4d07-89d5-0bf414c18614 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:35.897224 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774c8f1-1f9f-47ed-840d-f05454eba5c0 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97157111173e43c39d7b5c91ee3e9f67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b9e55d6da94bce82300a73c0a3841e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:35.898036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774c8f1-1f9f-47ed-840d-f05454eba5c0 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:35.898391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774c8f1-1f9f-47ed-840d-f05454eba5c0 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:35.899087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774c8f1-1f9f-47ed-840d-f05454eba5c0 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] PATH_INFO: `/v3/projects/5d8e661355c1454fbeabfe02863dea63` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:35.901122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d774c8f1-1f9f-47ed-840d-f05454eba5c0 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorizing `identity:get_project(project_id=5d8e661355c1454fbeabfe02863dea63)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:35.904470 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d774c8f1-1f9f-47ed-840d-f05454eba5c0 tempest-QuotasAdminTestJSON-1829196148 tempest-QuotasAdminTestJSON-1829196148-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:35.911924 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1009/2035] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:00:35 2022] GET /identity/v3/projects/5d8e661355c1454fbeabfe02863dea63 => generated 373 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:00:36.375549 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4409b-42e7-423e-a726-9dfaba49504b None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:36.375825 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4409b-42e7-423e-a726-9dfaba49504b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:36.376536 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4409b-42e7-423e-a726-9dfaba49504b None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:36.378516 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1027/2036] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:00:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:00:36.384153 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37d374-3dce-45d0-80ab-0692a5317d98 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:36.384471 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37d374-3dce-45d0-80ab-0692a5317d98 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:36.384707 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37d374-3dce-45d0-80ab-0692a5317d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:36.421055 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-0a37d374-3dce-45d0-80ab-0692a5317d98 None None] MFA Rules not processed for user `f908fda75ef8440cb6a0ef9440127d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:36.422400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0a37d374-3dce-45d0-80ab-0692a5317d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:36.472162 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:36.510676 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4409b-42e7-423e-a726-9dfaba49504b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:36.513327 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f3c4409b-42e7-423e-a726-9dfaba49504b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:36.557517 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1010/2037] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:00:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:36.584824 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a37d374-3dce-45d0-80ab-0692a5317d98 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:36.586420 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0a37d374-3dce-45d0-80ab-0692a5317d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:36.618765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a37d374-3dce-45d0-80ab-0692a5317d98 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:36.620377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4409b-42e7-423e-a726-9dfaba49504b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:36.626020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a574e6-0d23-4940-87b4-8a7db288dc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:36.626946 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a574e6-0d23-4940-87b4-8a7db288dc23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:36.627301 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a574e6-0d23-4940-87b4-8a7db288dc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:36.627741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a574e6-0d23-4940-87b4-8a7db288dc23 admin admin] PATH_INFO: `/v3/users/679c0393aac04fccbc1c858e879323ce` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:36.629121 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a574e6-0d23-4940-87b4-8a7db288dc23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=679c0393aac04fccbc1c858e879323ce)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:36.631326 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a574e6-0d23-4940-87b4-8a7db288dc23 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:36.631531 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b15785-9f63-44c2-b2e3-ceaca7afcea5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:36.632996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b15785-9f63-44c2-b2e3-ceaca7afcea5 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:36.633906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b15785-9f63-44c2-b2e3-ceaca7afcea5 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:36.635009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b15785-9f63-44c2-b2e3-ceaca7afcea5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:36.652661 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b15785-9f63-44c2-b2e3-ceaca7afcea5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:36.655085 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b15785-9f63-44c2-b2e3-ceaca7afcea5 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:36.671026 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1011/2038] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:00:36.715467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-60a574e6-0d23-4940-87b4-8a7db288dc23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '679c0393aac04fccbc1c858e879323ce'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:36.716792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-60a574e6-0d23-4940-87b4-8a7db288dc23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '679c0393aac04fccbc1c858e879323ce'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:36.729879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-60a574e6-0d23-4940-87b4-8a7db288dc23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '679c0393aac04fccbc1c858e879323ce'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:36.742605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-60a574e6-0d23-4940-87b4-8a7db288dc23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '679c0393aac04fccbc1c858e879323ce'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:36.743310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-60a574e6-0d23-4940-87b4-8a7db288dc23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '679c0393aac04fccbc1c858e879323ce'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:36.779369 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1028/2039] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:00:36 2022] DELETE /identity/v3/users/679c0393aac04fccbc1c858e879323ce => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:36.781698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c51ca0-1b2d-4305-b313-265be659dbcc None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:36.782153 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c51ca0-1b2d-4305-b313-265be659dbcc None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:36.782576 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c51ca0-1b2d-4305-b313-265be659dbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:36.856435 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e1c51ca0-1b2d-4305-b313-265be659dbcc None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:36.874848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e1c51ca0-1b2d-4305-b313-265be659dbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:37.076597 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1012/2040] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:37.170572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a574e6-0d23-4940-87b4-8a7db288dc23 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:37.173671 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-60a574e6-0d23-4940-87b4-8a7db288dc23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:37.190947 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:37.268537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a574e6-0d23-4940-87b4-8a7db288dc23 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:37.272666 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e249d-5dc6-42f8-9474-567d44c87662 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:37.273699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e249d-5dc6-42f8-9474-567d44c87662 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:37.273814 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e249d-5dc6-42f8-9474-567d44c87662 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:37.274051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e249d-5dc6-42f8-9474-567d44c87662 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:37.284976 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e249d-5dc6-42f8-9474-567d44c87662 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:37.286776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e249d-5dc6-42f8-9474-567d44c87662 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:37.306449 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1029/2041] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:39.266571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c51ca0-1b2d-4305-b313-265be659dbcc None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:39.269021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e1c51ca0-1b2d-4305-b313-265be659dbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:39.299930 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c51ca0-1b2d-4305-b313-265be659dbcc None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:39.318774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec596d-316d-4668-a7f6-16202146ad74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:39.319445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec596d-316d-4668-a7f6-16202146ad74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:39.319726 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec596d-316d-4668-a7f6-16202146ad74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:39.320002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec596d-316d-4668-a7f6-16202146ad74 admin admin] PATH_INFO: `/v3/projects/5d8e661355c1454fbeabfe02863dea63` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:39.325689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec596d-316d-4668-a7f6-16202146ad74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d8e661355c1454fbeabfe02863dea63)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:39.327772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec596d-316d-4668-a7f6-16202146ad74 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:39.500858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-91ec596d-316d-4668-a7f6-16202146ad74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d8e661355c1454fbeabfe02863dea63', 'request_id': 'req-91ec596d-316d-4668-a7f6-16202146ad74'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:39.523800 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-91ec596d-316d-4668-a7f6-16202146ad74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d8e661355c1454fbeabfe02863dea63', 'request_id': 'req-91ec596d-316d-4668-a7f6-16202146ad74'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:39.567415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-91ec596d-316d-4668-a7f6-16202146ad74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d8e661355c1454fbeabfe02863dea63', 'request_id': 'req-91ec596d-316d-4668-a7f6-16202146ad74'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:39.625292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-91ec596d-316d-4668-a7f6-16202146ad74 admin admin] The token cache is being invalidate because project 5d8e661355c1454fbeabfe02863dea63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:39.627908 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-91ec596d-316d-4668-a7f6-16202146ad74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:39.631554 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-91ec596d-316d-4668-a7f6-16202146ad74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:39.641861 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e249d-5dc6-42f8-9474-567d44c87662 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:39.642305 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1013/2042] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:39 2022] DELETE /identity/v3/projects/5d8e661355c1454fbeabfe02863dea63 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:39.666024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e249d-5dc6-42f8-9474-567d44c87662 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:39.878255 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db038cd9-4578-45c7-bd0a-2ba8b2770980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:39.879183 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db038cd9-4578-45c7-bd0a-2ba8b2770980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:39.880256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db038cd9-4578-45c7-bd0a-2ba8b2770980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:39.880713 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db038cd9-4578-45c7-bd0a-2ba8b2770980 admin admin] PATH_INFO: `/v3/users/97157111173e43c39d7b5c91ee3e9f67` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:39.882419 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db038cd9-4578-45c7-bd0a-2ba8b2770980 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97157111173e43c39d7b5c91ee3e9f67)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:39.885184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db038cd9-4578-45c7-bd0a-2ba8b2770980 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:40.021700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-db038cd9-4578-45c7-bd0a-2ba8b2770980 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97157111173e43c39d7b5c91ee3e9f67'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:40.025155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-db038cd9-4578-45c7-bd0a-2ba8b2770980 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97157111173e43c39d7b5c91ee3e9f67'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:40.059082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-db038cd9-4578-45c7-bd0a-2ba8b2770980 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97157111173e43c39d7b5c91ee3e9f67'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:40.073049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-db038cd9-4578-45c7-bd0a-2ba8b2770980 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97157111173e43c39d7b5c91ee3e9f67'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:40.073832 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-db038cd9-4578-45c7-bd0a-2ba8b2770980 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97157111173e43c39d7b5c91ee3e9f67'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:40.124607 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1030/2043] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:00:39 2022] DELETE /identity/v3/users/97157111173e43c39d7b5c91ee3e9f67 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:40.812123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a65b9-24d3-4d24-a3a2-f1a6a26e6799 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:40.813034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a65b9-24d3-4d24-a3a2-f1a6a26e6799 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:40.814098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a65b9-24d3-4d24-a3a2-f1a6a26e6799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:40.860976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-784a65b9-24d3-4d24-a3a2-f1a6a26e6799 None None] MFA Rules not processed for user `05f54677df04452fb4d1c76cdf9febaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:40.862879 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-784a65b9-24d3-4d24-a3a2-f1a6a26e6799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:40.929835 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:41.152812 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1014/2044] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:41.436289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db038cd9-4578-45c7-bd0a-2ba8b2770980 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:41.436767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a65b9-24d3-4d24-a3a2-f1a6a26e6799 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:41.437988 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-db038cd9-4578-45c7-bd0a-2ba8b2770980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:41.439692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-784a65b9-24d3-4d24-a3a2-f1a6a26e6799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:41.502704 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:41.592928 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db038cd9-4578-45c7-bd0a-2ba8b2770980 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:41.605534 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93115850-116c-471a-a1bc-0207a599eb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:41.606608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93115850-116c-471a-a1bc-0207a599eb5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:41.608054 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93115850-116c-471a-a1bc-0207a599eb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:41.608540 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93115850-116c-471a-a1bc-0207a599eb5d admin admin] PATH_INFO: `/v3/projects/05b9e55d6da94bce82300a73c0a3841e` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:41.608866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a65b9-24d3-4d24-a3a2-f1a6a26e6799 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:41.614145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93115850-116c-471a-a1bc-0207a599eb5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=05b9e55d6da94bce82300a73c0a3841e)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:41.621360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93115850-116c-471a-a1bc-0207a599eb5d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:41.634096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94184abb-623c-422f-aef8-47ebfe883c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:41.634872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94184abb-623c-422f-aef8-47ebfe883c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:41.635154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94184abb-623c-422f-aef8-47ebfe883c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:41.635906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94184abb-623c-422f-aef8-47ebfe883c2a admin admin] PATH_INFO: `/v3/users/b896c96e48e74034aadf845869ac7f4a` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:41.637343 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94184abb-623c-422f-aef8-47ebfe883c2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b896c96e48e74034aadf845869ac7f4a)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:41.640620 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94184abb-623c-422f-aef8-47ebfe883c2a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:41.736795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-94184abb-623c-422f-aef8-47ebfe883c2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b896c96e48e74034aadf845869ac7f4a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:41.738042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-93115850-116c-471a-a1bc-0207a599eb5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05b9e55d6da94bce82300a73c0a3841e', 'request_id': 'req-93115850-116c-471a-a1bc-0207a599eb5d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:41.738734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-94184abb-623c-422f-aef8-47ebfe883c2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b896c96e48e74034aadf845869ac7f4a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:41.755193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-94184abb-623c-422f-aef8-47ebfe883c2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b896c96e48e74034aadf845869ac7f4a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:41.757950 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-93115850-116c-471a-a1bc-0207a599eb5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05b9e55d6da94bce82300a73c0a3841e', 'request_id': 'req-93115850-116c-471a-a1bc-0207a599eb5d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:41.772263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-93115850-116c-471a-a1bc-0207a599eb5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05b9e55d6da94bce82300a73c0a3841e', 'request_id': 'req-93115850-116c-471a-a1bc-0207a599eb5d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:41.776375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-94184abb-623c-422f-aef8-47ebfe883c2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b896c96e48e74034aadf845869ac7f4a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:41.778705 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-94184abb-623c-422f-aef8-47ebfe883c2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b896c96e48e74034aadf845869ac7f4a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:41.798311 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-93115850-116c-471a-a1bc-0207a599eb5d admin admin] The token cache is being invalidate because project 05b9e55d6da94bce82300a73c0a3841e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:41.799035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-93115850-116c-471a-a1bc-0207a599eb5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:41.800310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-93115850-116c-471a-a1bc-0207a599eb5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:41.803796 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1031/2045] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:41 2022] DELETE /identity/v3/projects/05b9e55d6da94bce82300a73c0a3841e => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:41.811220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd93456-3710-46e6-ba00-5f4098063555 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:41.812502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd93456-3710-46e6-ba00-5f4098063555 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:41.813420 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd93456-3710-46e6-ba00-5f4098063555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:41.839080 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1015/2046] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:00:41 2022] DELETE /identity/v3/users/b896c96e48e74034aadf845869ac7f4a => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:41.843648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4d870-3b6a-47e8-9c2b-e5f1c6a9cfd9 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:41.843933 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4d870-3b6a-47e8-9c2b-e5f1c6a9cfd9 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:41.844208 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4d870-3b6a-47e8-9c2b-e5f1c6a9cfd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:41.848993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-0dd93456-3710-46e6-ba00-5f4098063555 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:41.850628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0dd93456-3710-46e6-ba00-5f4098063555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:41.891522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a6c4d870-3b6a-47e8-9c2b-e5f1c6a9cfd9 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:41.894712 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a6c4d870-3b6a-47e8-9c2b-e5f1c6a9cfd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:41.989759 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1032/2047] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:41.991450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a13d8-3ca8-4158-90b8-c00da18b6bd9 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:41.992126 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a13d8-3ca8-4158-90b8-c00da18b6bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:41.992612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a13d8-3ca8-4158-90b8-c00da18b6bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:42.011049 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:42.024365 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-456a13d8-3ca8-4158-90b8-c00da18b6bd9 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:42.026074 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-456a13d8-3ca8-4158-90b8-c00da18b6bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:42.039417 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1033/2048] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:42.039788 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1016/2049] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:42.043160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a13d8-3ca8-4158-90b8-c00da18b6bd9 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:42.056983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a13d8-3ca8-4158-90b8-c00da18b6bd9 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:42.079538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf85d5-236a-4714-81eb-3be14badf945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:42.080218 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf85d5-236a-4714-81eb-3be14badf945 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:42.080501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf85d5-236a-4714-81eb-3be14badf945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:42.080775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf85d5-236a-4714-81eb-3be14badf945 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:42.081459 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edf85d5-236a-4714-81eb-3be14badf945 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:00:42.081765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edf85d5-236a-4714-81eb-3be14badf945 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:42.083929 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edf85d5-236a-4714-81eb-3be14badf945 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:42.109840 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1034/2050] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:00:42.111505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4d870-3b6a-47e8-9c2b-e5f1c6a9cfd9 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:42.124015 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4d870-3b6a-47e8-9c2b-e5f1c6a9cfd9 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:42.154504 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf85d5-236a-4714-81eb-3be14badf945 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:42.156838 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2edf85d5-236a-4714-81eb-3be14badf945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:42.171291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2672a8-0fd2-4b6f-84d0-d249a0a811b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:42.171291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2672a8-0fd2-4b6f-84d0-d249a0a811b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:42.171291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2672a8-0fd2-4b6f-84d0-d249a0a811b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:42.171291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2672a8-0fd2-4b6f-84d0-d249a0a811b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:42.171666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2672a8-0fd2-4b6f-84d0-d249a0a811b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:42.196389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2672a8-0fd2-4b6f-84d0-d249a0a811b6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:42.287015 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:42.294151 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1017/2051] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:00:42 2022] POST /identity/v3/projects => generated 393 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:42.299558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a8477-c7eb-483d-a95c-b8a065ba4e33 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:42.299961 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a8477-c7eb-483d-a95c-b8a065ba4e33 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:42.300588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a8477-c7eb-483d-a95c-b8a065ba4e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:42.306684 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf85d5-236a-4714-81eb-3be14badf945 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:42.384181 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-2d9a8477-c7eb-483d-a95c-b8a065ba4e33 None None] MFA Rules not processed for user `41571ce2b64c4762b04ed0848bf34c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:42.385450 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2d9a8477-c7eb-483d-a95c-b8a065ba4e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:42.397032 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a137b-da3f-4ce9-a4ca-2036c562c889 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:42.397676 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a137b-da3f-4ce9-a4ca-2036c562c889 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:42.398101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a137b-da3f-4ce9-a4ca-2036c562c889 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:42.398380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a137b-da3f-4ce9-a4ca-2036c562c889 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:42.530328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a137b-da3f-4ce9-a4ca-2036c562c889 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:42.530945 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1018/2052] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:42 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:42.530945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a8477-c7eb-483d-a95c-b8a065ba4e33 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:42.532585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a137b-da3f-4ce9-a4ca-2036c562c889 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:42.552864 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a8477-c7eb-483d-a95c-b8a065ba4e33 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:42.554389 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1035/2053] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:42.555198 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a137b-da3f-4ce9-a4ca-2036c562c889 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:42.557900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5a2a137b-da3f-4ce9-a4ca-2036c562c889 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:42.565220 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a534eb5-2dc4-4e2e-8939-c7abc0f8c093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:42.566070 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a534eb5-2dc4-4e2e-8939-c7abc0f8c093 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:42.566773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a534eb5-2dc4-4e2e-8939-c7abc0f8c093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:42.566773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a534eb5-2dc4-4e2e-8939-c7abc0f8c093 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:42.567877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a534eb5-2dc4-4e2e-8939-c7abc0f8c093 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:42.574586 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a534eb5-2dc4-4e2e-8939-c7abc0f8c093 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:42.587732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a137b-da3f-4ce9-a4ca-2036c562c889 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:42.597905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b511ed1-5802-46ec-97fd-d5645b346282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:42.600247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b511ed1-5802-46ec-97fd-d5645b346282 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:42.600683 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b511ed1-5802-46ec-97fd-d5645b346282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:42.601752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b511ed1-5802-46ec-97fd-d5645b346282 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:42.602710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b511ed1-5802-46ec-97fd-d5645b346282 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:42.604579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b511ed1-5802-46ec-97fd-d5645b346282 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:42.618715 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1019/2054] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:42 2022] POST /identity/v3/users => generated 297 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:42.622901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a534eb5-2dc4-4e2e-8939-c7abc0f8c093 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:42.636755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a534eb5-2dc4-4e2e-8939-c7abc0f8c093 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:42.666791 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c07308-1ed8-4158-a0f2-4b76a9b17bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:42.668461 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c07308-1ed8-4158-a0f2-4b76a9b17bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:42.669674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c07308-1ed8-4158-a0f2-4b76a9b17bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:42.670458 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c07308-1ed8-4158-a0f2-4b76a9b17bf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:42.671133 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c07308-1ed8-4158-a0f2-4b76a9b17bf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:42.676743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c07308-1ed8-4158-a0f2-4b76a9b17bf9 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:42.686988 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1036/2055] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:00:42 2022] POST /identity/v3/projects => generated 395 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:42.691006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b511ed1-5802-46ec-97fd-d5645b346282 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:42.705566 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1020/2056] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:42.706070 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c07308-1ed8-4158-a0f2-4b76a9b17bf9 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:42.730517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c07308-1ed8-4158-a0f2-4b76a9b17bf9 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:42.866397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b511ed1-5802-46ec-97fd-d5645b346282 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:42.878168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b8202-e6d5-4d2c-b99a-14bd0466e383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:42.878800 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b8202-e6d5-4d2c-b99a-14bd0466e383 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:42.879083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b8202-e6d5-4d2c-b99a-14bd0466e383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:42.880027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b8202-e6d5-4d2c-b99a-14bd0466e383 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:42.880718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b8202-e6d5-4d2c-b99a-14bd0466e383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:42.885699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b8202-e6d5-4d2c-b99a-14bd0466e383 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:42.917540 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6c73d-088f-4516-93ec-926b31823e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:42.918734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6c73d-088f-4516-93ec-926b31823e80 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:42.919798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6c73d-088f-4516-93ec-926b31823e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:42.920290 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6c73d-088f-4516-93ec-926b31823e80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:42.921128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6c73d-088f-4516-93ec-926b31823e80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:42.923406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6c73d-088f-4516-93ec-926b31823e80 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:42.938410 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1021/2057] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:42.947080 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6c73d-088f-4516-93ec-926b31823e80 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:42.972676 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1037/2058] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:42 2022] POST /identity/v3/users => generated 304 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:42.978670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b8202-e6d5-4d2c-b99a-14bd0466e383 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:42.986157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6c73d-088f-4516-93ec-926b31823e80 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:43.001090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9af30-2d9c-459f-ae24-64c4fdc982db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:43.002433 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9af30-2d9c-459f-ae24-64c4fdc982db admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:43.003622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9af30-2d9c-459f-ae24-64c4fdc982db admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:43.004155 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9af30-2d9c-459f-ae24-64c4fdc982db admin admin] PATH_INFO: `/v3/projects/89a7ede3e627408bae939d06405906c7/users/609e569a8ed64fa5aa88632ecf7f6702/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:43.012254 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b8202-e6d5-4d2c-b99a-14bd0466e383 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:43.026925 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6b9ae-7d49-4011-97a6-043df6ab7d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:43.027963 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6b9ae-7d49-4011-97a6-043df6ab7d87 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:43.028342 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6b9ae-7d49-4011-97a6-043df6ab7d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:43.028638 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6b9ae-7d49-4011-97a6-043df6ab7d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:43.029366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6b9ae-7d49-4011-97a6-043df6ab7d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:43.038166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6b9ae-7d49-4011-97a6-043df6ab7d87 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:43.073390 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1038/2059] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:43.074297 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6b9ae-7d49-4011-97a6-043df6ab7d87 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:43.078771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9af30-2d9c-459f-ae24-64c4fdc982db admin admin] RBAC: Authorizing `identity:create_grant(project_id=89a7ede3e627408bae939d06405906c7, user_id=609e569a8ed64fa5aa88632ecf7f6702, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:43.081483 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9af30-2d9c-459f-ae24-64c4fdc982db admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:43.087827 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:43.100675 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6b9ae-7d49-4011-97a6-043df6ab7d87 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:43.109194 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:43.112069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8a234-cf8d-49be-bfe5-62e7426d77b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:43.114954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8a234-cf8d-49be-bfe5-62e7426d77b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:43.115605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8a234-cf8d-49be-bfe5-62e7426d77b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:43.116313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8a234-cf8d-49be-bfe5-62e7426d77b4 admin admin] PATH_INFO: `/v3/projects/8f13113792d4413aad6feb6fb3e1f5d5/users/1c179ae7b86c41a080ade6fae2897387/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:43.118554 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1022/2060] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:42 2022] PUT /identity/v3/projects/89a7ede3e627408bae939d06405906c7/users/609e569a8ed64fa5aa88632ecf7f6702/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:43.131305 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9af30-2d9c-459f-ae24-64c4fdc982db admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:43.138122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-74a9af30-2d9c-459f-ae24-64c4fdc982db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:43.158891 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c8a234-cf8d-49be-bfe5-62e7426d77b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f13113792d4413aad6feb6fb3e1f5d5, user_id=1c179ae7b86c41a080ade6fae2897387, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:43.167307 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c8a234-cf8d-49be-bfe5-62e7426d77b4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:43.212496 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1039/2061] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:43 2022] PUT /identity/v3/projects/8f13113792d4413aad6feb6fb3e1f5d5/users/1c179ae7b86c41a080ade6fae2897387/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:43.215665 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327342c-d6b3-4fca-bca0-cc330148a422 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:43.215951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327342c-d6b3-4fca-bca0-cc330148a422 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:43.216222 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327342c-d6b3-4fca-bca0-cc330148a422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:43.280879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-0327342c-d6b3-4fca-bca0-cc330148a422 None None] MFA Rules not processed for user `609e569a8ed64fa5aa88632ecf7f6702`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:43.280879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0327342c-d6b3-4fca-bca0-cc330148a422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:43.304015 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9af30-2d9c-459f-ae24-64c4fdc982db admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:43.365285 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1040/2062] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:43.368836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327342c-d6b3-4fca-bca0-cc330148a422 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:43.463228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d16cfd-2ee3-4ba4-89fc-af56db85d01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:43.464669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d16cfd-2ee3-4ba4-89fc-af56db85d01c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:43.464956 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d16cfd-2ee3-4ba4-89fc-af56db85d01c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:43.465229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d16cfd-2ee3-4ba4-89fc-af56db85d01c admin admin] PATH_INFO: `/v3/users/6153466275a841079473eb61068f8ec7` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:43.467672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d16cfd-2ee3-4ba4-89fc-af56db85d01c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6153466275a841079473eb61068f8ec7)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:43.469005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327342c-d6b3-4fca-bca0-cc330148a422 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:43.469675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d16cfd-2ee3-4ba4-89fc-af56db85d01c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:43.474537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb8862-5f4b-4b78-80ea-18581e8acc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:43.475147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb8862-5f4b-4b78-80ea-18581e8acc4f admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:43.475424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb8862-5f4b-4b78-80ea-18581e8acc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:43.475695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb8862-5f4b-4b78-80ea-18581e8acc4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:43.476341 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb8862-5f4b-4b78-80ea-18581e8acc4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:43.477988 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb8862-5f4b-4b78-80ea-18581e8acc4f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:43.509020 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1041/2063] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:43.509935 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb8862-5f4b-4b78-80ea-18581e8acc4f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:43.527481 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb8862-5f4b-4b78-80ea-18581e8acc4f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:43.532867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac30595-572a-4cc5-9bdd-e82ae0803653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:43.533634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac30595-572a-4cc5-9bdd-e82ae0803653 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:43.533913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac30595-572a-4cc5-9bdd-e82ae0803653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:43.534184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac30595-572a-4cc5-9bdd-e82ae0803653 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:43.534874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac30595-572a-4cc5-9bdd-e82ae0803653 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:43.537062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac30595-572a-4cc5-9bdd-e82ae0803653 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:43.567529 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d1d16cfd-2ee3-4ba4-89fc-af56db85d01c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6153466275a841079473eb61068f8ec7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:43.572389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d1d16cfd-2ee3-4ba4-89fc-af56db85d01c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6153466275a841079473eb61068f8ec7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:43.586669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d1d16cfd-2ee3-4ba4-89fc-af56db85d01c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6153466275a841079473eb61068f8ec7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:43.589715 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1042/2064] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:00:43 2022] POST /identity/v3/projects => generated 395 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:43.591530 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac30595-572a-4cc5-9bdd-e82ae0803653 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:43.593738 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-dac30595-572a-4cc5-9bdd-e82ae0803653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:43.610308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d1d16cfd-2ee3-4ba4-89fc-af56db85d01c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6153466275a841079473eb61068f8ec7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:43.611109 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d1d16cfd-2ee3-4ba4-89fc-af56db85d01c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6153466275a841079473eb61068f8ec7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:43.700287 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:43.710616 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1023/2065] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:00:43 2022] DELETE /identity/v3/users/6153466275a841079473eb61068f8ec7 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:43.714160 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d16cfd-2ee3-4ba4-89fc-af56db85d01c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:43.721343 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d1d16cfd-2ee3-4ba4-89fc-af56db85d01c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:43.777447 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:43.781704 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac30595-572a-4cc5-9bdd-e82ae0803653 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:43.850490 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d16cfd-2ee3-4ba4-89fc-af56db85d01c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:43.859717 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9d559-86df-4b14-b3d9-8723ad05ac44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:43.860632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9d559-86df-4b14-b3d9-8723ad05ac44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:43.860919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9d559-86df-4b14-b3d9-8723ad05ac44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:43.861189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9d559-86df-4b14-b3d9-8723ad05ac44 admin admin] PATH_INFO: `/v3/projects/8f13113792d4413aad6feb6fb3e1f5d5/users/1c179ae7b86c41a080ade6fae2897387/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:43.866231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d9d559-86df-4b14-b3d9-8723ad05ac44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f13113792d4413aad6feb6fb3e1f5d5, user_id=1c179ae7b86c41a080ade6fae2897387, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:43.872479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d9d559-86df-4b14-b3d9-8723ad05ac44 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:43.887893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97a6da-19e1-4396-9aab-0d29dafc3a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:43.888878 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97a6da-19e1-4396-9aab-0d29dafc3a72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:43.888878 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97a6da-19e1-4396-9aab-0d29dafc3a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:43.889149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97a6da-19e1-4396-9aab-0d29dafc3a72 admin admin] PATH_INFO: `/v3/users/5705a5c5ea2b46e0a98841ea0d82dc2b` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:43.890473 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97a6da-19e1-4396-9aab-0d29dafc3a72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5705a5c5ea2b46e0a98841ea0d82dc2b)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:43.892535 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97a6da-19e1-4396-9aab-0d29dafc3a72 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:43.903615 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1024/2066] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:43 2022] PUT /identity/v3/projects/8f13113792d4413aad6feb6fb3e1f5d5/users/1c179ae7b86c41a080ade6fae2897387/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:43.903615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9d559-86df-4b14-b3d9-8723ad05ac44 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:43.906789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-69d9d559-86df-4b14-b3d9-8723ad05ac44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:43.990456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9f97a6da-19e1-4396-9aab-0d29dafc3a72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5705a5c5ea2b46e0a98841ea0d82dc2b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:43.991178 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9f97a6da-19e1-4396-9aab-0d29dafc3a72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5705a5c5ea2b46e0a98841ea0d82dc2b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:44.006892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9f97a6da-19e1-4396-9aab-0d29dafc3a72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5705a5c5ea2b46e0a98841ea0d82dc2b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:44.007203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9d559-86df-4b14-b3d9-8723ad05ac44 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:44.013227 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa38cd-0237-4022-a062-9910a3182cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:44.013937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa38cd-0237-4022-a062-9910a3182cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:44.014154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa38cd-0237-4022-a062-9910a3182cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:44.014423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa38cd-0237-4022-a062-9910a3182cd6 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:44.015063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa38cd-0237-4022-a062-9910a3182cd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:44.019351 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa38cd-0237-4022-a062-9910a3182cd6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:44.030009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9f97a6da-19e1-4396-9aab-0d29dafc3a72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5705a5c5ea2b46e0a98841ea0d82dc2b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:44.031332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9f97a6da-19e1-4396-9aab-0d29dafc3a72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5705a5c5ea2b46e0a98841ea0d82dc2b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:44.052659 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1025/2067] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:43 2022] POST /identity/v3/users => generated 304 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:44.054359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c740f9-3c54-4622-9ffc-cea8a408ac26 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:44.054993 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c740f9-3c54-4622-9ffc-cea8a408ac26 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:44.055283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c740f9-3c54-4622-9ffc-cea8a408ac26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:44.078742 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1043/2068] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:00:43 2022] DELETE /identity/v3/users/5705a5c5ea2b46e0a98841ea0d82dc2b => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:44.080068 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97a6da-19e1-4396-9aab-0d29dafc3a72 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:44.080432 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-98c740f9-3c54-4622-9ffc-cea8a408ac26 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:44.083294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-98c740f9-3c54-4622-9ffc-cea8a408ac26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:44.083860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9f97a6da-19e1-4396-9aab-0d29dafc3a72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:44.167444 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1026/2069] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:44.168360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c740f9-3c54-4622-9ffc-cea8a408ac26 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:44.169944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-98c740f9-3c54-4622-9ffc-cea8a408ac26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:44.185777 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c740f9-3c54-4622-9ffc-cea8a408ac26 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:44.193064 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a3e81-ea7b-4cdd-a7a9-c10f5d62d99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:44.194061 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a3e81-ea7b-4cdd-a7a9-c10f5d62d99b admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:44.194341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a3e81-ea7b-4cdd-a7a9-c10f5d62d99b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:44.194610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a3e81-ea7b-4cdd-a7a9-c10f5d62d99b admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:44.195251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a3e81-ea7b-4cdd-a7a9-c10f5d62d99b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:44.197670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a3e81-ea7b-4cdd-a7a9-c10f5d62d99b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:44.213695 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1027/2070] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:44.215040 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b56431-109d-4b07-add1-9e660a41c5ef None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:44.215323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b56431-109d-4b07-add1-9e660a41c5ef None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:44.215596 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b56431-109d-4b07-add1-9e660a41c5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:44.219246 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97a6da-19e1-4396-9aab-0d29dafc3a72 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:44.234065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf23852-b1e4-478a-9962-d4edad316428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:44.236321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf23852-b1e4-478a-9962-d4edad316428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:44.236905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf23852-b1e4-478a-9962-d4edad316428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:44.237823 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf23852-b1e4-478a-9962-d4edad316428 admin admin] PATH_INFO: `/v3/projects/73d93fd9c4444ffdb1caf71d6911f1ef` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:44.240470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf23852-b1e4-478a-9962-d4edad316428 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73d93fd9c4444ffdb1caf71d6911f1ef)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:44.243894 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-68b56431-109d-4b07-add1-9e660a41c5ef None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:44.245916 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-68b56431-109d-4b07-add1-9e660a41c5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:44.248509 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf23852-b1e4-478a-9962-d4edad316428 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:44.259933 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1028/2071] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:44.261695 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b56431-109d-4b07-add1-9e660a41c5ef None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:44.263284 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-68b56431-109d-4b07-add1-9e660a41c5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:44.267716 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:44.314663 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:44.341333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3cf23852-b1e4-478a-9962-d4edad316428 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73d93fd9c4444ffdb1caf71d6911f1ef', 'request_id': 'req-3cf23852-b1e4-478a-9962-d4edad316428'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:44.353544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3cf23852-b1e4-478a-9962-d4edad316428 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73d93fd9c4444ffdb1caf71d6911f1ef', 'request_id': 'req-3cf23852-b1e4-478a-9962-d4edad316428'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:44.365685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3cf23852-b1e4-478a-9962-d4edad316428 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73d93fd9c4444ffdb1caf71d6911f1ef', 'request_id': 'req-3cf23852-b1e4-478a-9962-d4edad316428'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:44.386528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3cf23852-b1e4-478a-9962-d4edad316428 admin admin] The token cache is being invalidate because project 73d93fd9c4444ffdb1caf71d6911f1ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:44.386818 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3cf23852-b1e4-478a-9962-d4edad316428 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:44.387513 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3cf23852-b1e4-478a-9962-d4edad316428 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:44.387826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b56431-109d-4b07-add1-9e660a41c5ef None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:44.389140 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1044/2072] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:44 2022] DELETE /identity/v3/projects/73d93fd9c4444ffdb1caf71d6911f1ef => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:44.393665 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf23852-b1e4-478a-9962-d4edad316428 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:44.395612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3cf23852-b1e4-478a-9962-d4edad316428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:44.478473 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf23852-b1e4-478a-9962-d4edad316428 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:44.487584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb82f5-0f85-4c28-870c-441b6f495dac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:44.488217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb82f5-0f85-4c28-870c-441b6f495dac service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:44.488536 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb82f5-0f85-4c28-870c-441b6f495dac service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:44.491577 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb82f5-0f85-4c28-870c-441b6f495dac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:44.494610 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a0bb82f5-0f85-4c28-870c-441b6f495dac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:44.511586 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7416575-afb4-42f3-9386-670be6b0ca74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:44.512718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7416575-afb4-42f3-9386-670be6b0ca74 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:44.513005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7416575-afb4-42f3-9386-670be6b0ca74 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:44.513862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7416575-afb4-42f3-9386-670be6b0ca74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:44.516940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c7416575-afb4-42f3-9386-670be6b0ca74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:44.590522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7416575-afb4-42f3-9386-670be6b0ca74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:44.592138 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7416575-afb4-42f3-9386-670be6b0ca74 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:44.602916 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1029/2073] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:44 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:44.603736 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7416575-afb4-42f3-9386-670be6b0ca74 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:44.605363 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c7416575-afb4-42f3-9386-670be6b0ca74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:44.619252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb82f5-0f85-4c28-870c-441b6f495dac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:44.620817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb82f5-0f85-4c28-870c-441b6f495dac service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:44.630327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7416575-afb4-42f3-9386-670be6b0ca74 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:44.642778 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1045/2074] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:44.643649 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb82f5-0f85-4c28-870c-441b6f495dac service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:44.645844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed8bff-94b1-4be0-b93a-819fc0479a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:44.646528 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed8bff-94b1-4be0-b93a-819fc0479a17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:44.646808 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed8bff-94b1-4be0-b93a-819fc0479a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:44.647087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed8bff-94b1-4be0-b93a-819fc0479a17 admin admin] PATH_INFO: `/v3/projects/a5fedcbfd52d4212baecc63dc33c54e9/users/7cc4afc41da94db5b00dd152b1e5db8f/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:44.667769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb82f5-0f85-4c28-870c-441b6f495dac service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:44.673918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed8bff-94b1-4be0-b93a-819fc0479a17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5fedcbfd52d4212baecc63dc33c54e9, user_id=7cc4afc41da94db5b00dd152b1e5db8f, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:44.677200 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed8bff-94b1-4be0-b93a-819fc0479a17 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:44.682015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb60ac-4f69-4748-a230-71a6342c6289 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:44.682650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb60ac-4f69-4748-a230-71a6342c6289 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:44.682973 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb60ac-4f69-4748-a230-71a6342c6289 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:44.683636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb60ac-4f69-4748-a230-71a6342c6289 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:44.686177 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-83cb60ac-4f69-4748-a230-71a6342c6289 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:44.707370 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb60ac-4f69-4748-a230-71a6342c6289 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:44.709865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb60ac-4f69-4748-a230-71a6342c6289 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:44.711089 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1030/2075] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:44 2022] PUT /identity/v3/projects/a5fedcbfd52d4212baecc63dc33c54e9/users/7cc4afc41da94db5b00dd152b1e5db8f/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:44.717472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed8bff-94b1-4be0-b93a-819fc0479a17 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:44.721941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-07ed8bff-94b1-4be0-b93a-819fc0479a17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:44.730428 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1046/2076] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:44.747986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb60ac-4f69-4748-a230-71a6342c6289 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:44.792935 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb60ac-4f69-4748-a230-71a6342c6289 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:44.805764 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:44.879803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed8bff-94b1-4be0-b93a-819fc0479a17 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:44.887469 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d03c1-5316-4002-aebf-1f54ecc574eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:44.888121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d03c1-5316-4002-aebf-1f54ecc574eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:44.888400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d03c1-5316-4002-aebf-1f54ecc574eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:44.889303 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d03c1-5316-4002-aebf-1f54ecc574eb admin admin] PATH_INFO: `/v3/users/434c194ab7f64624acc657c2b595847a` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:44.890448 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:44.890600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d03c1-5316-4002-aebf-1f54ecc574eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=434c194ab7f64624acc657c2b595847a)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:44.892527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d03c1-5316-4002-aebf-1f54ecc574eb admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:44.929136 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38e258-4e61-438f-b13e-8915f5652002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:44.930357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38e258-4e61-438f-b13e-8915f5652002 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:44.930870 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38e258-4e61-438f-b13e-8915f5652002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:44.931358 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38e258-4e61-438f-b13e-8915f5652002 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:44.932461 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f38e258-4e61-438f-b13e-8915f5652002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:44.934594 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f38e258-4e61-438f-b13e-8915f5652002 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:44.947996 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1047/2077] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:44.949659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ec5cb-003f-49b3-bc32-d749da0813ca None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:44.950171 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ec5cb-003f-49b3-bc32-d749da0813ca None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:44.950702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ec5cb-003f-49b3-bc32-d749da0813ca None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:44.952159 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1048/2078] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:00:44.953201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ec5cb-003f-49b3-bc32-d749da0813ca None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:44.963982 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2e2d03c1-5316-4002-aebf-1f54ecc574eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '434c194ab7f64624acc657c2b595847a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:44.966007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2e2d03c1-5316-4002-aebf-1f54ecc574eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '434c194ab7f64624acc657c2b595847a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:44.971492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ec5cb-003f-49b3-bc32-d749da0813ca None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:44.980273 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a280dd-9433-43d8-a2bf-66639e0e5610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:44.980544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2e2d03c1-5316-4002-aebf-1f54ecc574eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '434c194ab7f64624acc657c2b595847a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:44.981799 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a280dd-9433-43d8-a2bf-66639e0e5610 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:44.982192 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a280dd-9433-43d8-a2bf-66639e0e5610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:44.982574 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a280dd-9433-43d8-a2bf-66639e0e5610 admin admin] PATH_INFO: `/v3/projects/a5fedcbfd52d4212baecc63dc33c54e9/users/7cc4afc41da94db5b00dd152b1e5db8f/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:44.985378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a280dd-9433-43d8-a2bf-66639e0e5610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5fedcbfd52d4212baecc63dc33c54e9, user_id=7cc4afc41da94db5b00dd152b1e5db8f, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:44.989946 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a280dd-9433-43d8-a2bf-66639e0e5610 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:45.001271 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2e2d03c1-5316-4002-aebf-1f54ecc574eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '434c194ab7f64624acc657c2b595847a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:45.003435 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2e2d03c1-5316-4002-aebf-1f54ecc574eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '434c194ab7f64624acc657c2b595847a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:45.024995 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1049/2079] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:44 2022] PUT /identity/v3/projects/a5fedcbfd52d4212baecc63dc33c54e9/users/7cc4afc41da94db5b00dd152b1e5db8f/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:45.024995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc625b5-e5ab-4295-841f-3f42c5946ea3 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:45.024995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc625b5-e5ab-4295-841f-3f42c5946ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:45.024995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc625b5-e5ab-4295-841f-3f42c5946ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:45.045376 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1031/2080] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:00:44 2022] DELETE /identity/v3/users/434c194ab7f64624acc657c2b595847a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:45.046955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca67a47-eab6-4588-a282-5cd6f9859be0 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:45.047220 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca67a47-eab6-4588-a282-5cd6f9859be0 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:45.047505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca67a47-eab6-4588-a282-5cd6f9859be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:45.054729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-0fc625b5-e5ab-4295-841f-3f42c5946ea3 None None] MFA Rules not processed for user `2cdde7a212954a01a2591ad5ac30d049`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:45.056419 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0fc625b5-e5ab-4295-841f-3f42c5946ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:45.088422 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-1ca67a47-eab6-4588-a282-5cd6f9859be0 None None] MFA Rules not processed for user `7cc4afc41da94db5b00dd152b1e5db8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:45.089923 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1ca67a47-eab6-4588-a282-5cd6f9859be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:45.170654 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1050/2081] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:00:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:45.188440 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc625b5-e5ab-4295-841f-3f42c5946ea3 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:45.190343 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0fc625b5-e5ab-4295-841f-3f42c5946ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:45.206359 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc625b5-e5ab-4295-841f-3f42c5946ea3 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:45.213714 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d5949-15ba-4e04-a387-7e779cb644fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:45.214677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d5949-15ba-4e04-a387-7e779cb644fc service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:45.214677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d5949-15ba-4e04-a387-7e779cb644fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:45.215400 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d5949-15ba-4e04-a387-7e779cb644fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:45.233729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750d5949-15ba-4e04-a387-7e779cb644fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:45.236178 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750d5949-15ba-4e04-a387-7e779cb644fc service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:45.244004 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1032/2082] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:45 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:45.251507 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1051/2083] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:00:45.255982 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca67a47-eab6-4588-a282-5cd6f9859be0 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:45.259027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1ca67a47-eab6-4588-a282-5cd6f9859be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:45.330659 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:45.358049 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca67a47-eab6-4588-a282-5cd6f9859be0 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:45.372821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71167a51-be56-4f7a-94b7-df8a99534dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:45.372821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71167a51-be56-4f7a-94b7-df8a99534dc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:45.372821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71167a51-be56-4f7a-94b7-df8a99534dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:45.373262 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71167a51-be56-4f7a-94b7-df8a99534dc4 admin admin] PATH_INFO: `/v3/projects/eb9892d9ceda458f84d3880b3193d33d` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:45.377907 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71167a51-be56-4f7a-94b7-df8a99534dc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb9892d9ceda458f84d3880b3193d33d)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:45.380020 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71167a51-be56-4f7a-94b7-df8a99534dc4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:45.405152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d5949-15ba-4e04-a387-7e779cb644fc service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:45.406728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-750d5949-15ba-4e04-a387-7e779cb644fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:45.504804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-71167a51-be56-4f7a-94b7-df8a99534dc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb9892d9ceda458f84d3880b3193d33d', 'request_id': 'req-71167a51-be56-4f7a-94b7-df8a99534dc4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:45.516913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-71167a51-be56-4f7a-94b7-df8a99534dc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb9892d9ceda458f84d3880b3193d33d', 'request_id': 'req-71167a51-be56-4f7a-94b7-df8a99534dc4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:45.527789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-71167a51-be56-4f7a-94b7-df8a99534dc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb9892d9ceda458f84d3880b3193d33d', 'request_id': 'req-71167a51-be56-4f7a-94b7-df8a99534dc4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:45.543982 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-71167a51-be56-4f7a-94b7-df8a99534dc4 admin admin] The token cache is being invalidate because project eb9892d9ceda458f84d3880b3193d33d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:45.544306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-71167a51-be56-4f7a-94b7-df8a99534dc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:45.544992 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-71167a51-be56-4f7a-94b7-df8a99534dc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:45.547265 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1033/2084] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:45 2022] DELETE /identity/v3/projects/eb9892d9ceda458f84d3880b3193d33d => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:45.548160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d5949-15ba-4e04-a387-7e779cb644fc service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:45.551071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71167a51-be56-4f7a-94b7-df8a99534dc4 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:45.554189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-71167a51-be56-4f7a-94b7-df8a99534dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:45.623597 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:45.642649 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0c347-f138-45a2-a283-444ebd55bf5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:45.643226 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0c347-f138-45a2-a283-444ebd55bf5b service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:45.643516 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0c347-f138-45a2-a283-444ebd55bf5b service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:45.643842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0c347-f138-45a2-a283-444ebd55bf5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:45.646900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-84a0c347-f138-45a2-a283-444ebd55bf5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:45.683909 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71167a51-be56-4f7a-94b7-df8a99534dc4 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:45.692946 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d089b-d6c7-4948-990b-d4167ec0b1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:45.693798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d089b-d6c7-4948-990b-d4167ec0b1b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:45.694441 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d089b-d6c7-4948-990b-d4167ec0b1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:45.694441 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d089b-d6c7-4948-990b-d4167ec0b1b4 admin admin] PATH_INFO: `/v3/users/a609137f14a6492dabd80d8aa93a875f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:45.696259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d089b-d6c7-4948-990b-d4167ec0b1b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a609137f14a6492dabd80d8aa93a875f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:45.698774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d089b-d6c7-4948-990b-d4167ec0b1b4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:45.743871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0c347-f138-45a2-a283-444ebd55bf5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:45.746126 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0c347-f138-45a2-a283-444ebd55bf5b service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:45.776323 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1052/2085] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:45 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:00:45.799251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5a2d089b-d6c7-4948-990b-d4167ec0b1b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a609137f14a6492dabd80d8aa93a875f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:45.802484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5a2d089b-d6c7-4948-990b-d4167ec0b1b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a609137f14a6492dabd80d8aa93a875f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:45.811372 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5a2d089b-d6c7-4948-990b-d4167ec0b1b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a609137f14a6492dabd80d8aa93a875f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:45.825126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5a2d089b-d6c7-4948-990b-d4167ec0b1b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a609137f14a6492dabd80d8aa93a875f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:45.828938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634219d-92ad-4954-a675-0f16e4431f9f None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:45.829228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634219d-92ad-4954-a675-0f16e4431f9f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:45.829584 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5a2d089b-d6c7-4948-990b-d4167ec0b1b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a609137f14a6492dabd80d8aa93a875f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:45.830194 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634219d-92ad-4954-a675-0f16e4431f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:45.843192 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:45.862828 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1034/2086] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:00:45 2022] DELETE /identity/v3/users/a609137f14a6492dabd80d8aa93a875f => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:45.886727 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-1634219d-92ad-4954-a675-0f16e4431f9f None None] MFA Rules not processed for user `c0dfe5b82e7045d19b82685fab4290cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:45.891440 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1634219d-92ad-4954-a675-0f16e4431f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:46.015636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d089b-d6c7-4948-990b-d4167ec0b1b4 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:46.017485 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5a2d089b-d6c7-4948-990b-d4167ec0b1b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:46.017975 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1053/2087] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:00:46.178082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d089b-d6c7-4948-990b-d4167ec0b1b4 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:46.196686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74accbc4-e4d4-4fd8-8626-628e51784332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:46.197541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74accbc4-e4d4-4fd8-8626-628e51784332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:46.197912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74accbc4-e4d4-4fd8-8626-628e51784332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:46.198741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74accbc4-e4d4-4fd8-8626-628e51784332 admin admin] PATH_INFO: `/v3/projects/3ba3107862654eb483e9693ed761c4ac` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:46.200490 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74accbc4-e4d4-4fd8-8626-628e51784332 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ba3107862654eb483e9693ed761c4ac)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:46.204502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74accbc4-e4d4-4fd8-8626-628e51784332 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:46.335679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-74accbc4-e4d4-4fd8-8626-628e51784332 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ba3107862654eb483e9693ed761c4ac', 'request_id': 'req-74accbc4-e4d4-4fd8-8626-628e51784332'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:46.367527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-74accbc4-e4d4-4fd8-8626-628e51784332 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ba3107862654eb483e9693ed761c4ac', 'request_id': 'req-74accbc4-e4d4-4fd8-8626-628e51784332'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:46.378286 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-74accbc4-e4d4-4fd8-8626-628e51784332 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ba3107862654eb483e9693ed761c4ac', 'request_id': 'req-74accbc4-e4d4-4fd8-8626-628e51784332'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:46.412256 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-74accbc4-e4d4-4fd8-8626-628e51784332 admin admin] The token cache is being invalidate because project 3ba3107862654eb483e9693ed761c4ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:46.412810 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-74accbc4-e4d4-4fd8-8626-628e51784332 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:46.414788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-74accbc4-e4d4-4fd8-8626-628e51784332 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:46.417258 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1035/2088] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:46 2022] DELETE /identity/v3/projects/3ba3107862654eb483e9693ed761c4ac => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:00:46.421211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634219d-92ad-4954-a675-0f16e4431f9f None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:46.456829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634219d-92ad-4954-a675-0f16e4431f9f None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:46.634168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb0115-59fc-4d3c-af9d-992ce802e8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:46.634835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb0115-59fc-4d3c-af9d-992ce802e8dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:46.634918 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb0115-59fc-4d3c-af9d-992ce802e8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:46.635215 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb0115-59fc-4d3c-af9d-992ce802e8dd admin admin] PATH_INFO: `/v3/users/91025e1413374083ba70f600f70cc7fe` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:46.636533 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb0115-59fc-4d3c-af9d-992ce802e8dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=91025e1413374083ba70f600f70cc7fe)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:46.638587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb0115-59fc-4d3c-af9d-992ce802e8dd admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:46.697644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74accbc4-e4d4-4fd8-8626-628e51784332 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:46.699350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-74accbc4-e4d4-4fd8-8626-628e51784332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:46.729966 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:46.732506 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74accbc4-e4d4-4fd8-8626-628e51784332 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:46.752353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104de535-3233-4e5b-98e2-2748ec60edbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:46.753019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104de535-3233-4e5b-98e2-2748ec60edbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:46.753302 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104de535-3233-4e5b-98e2-2748ec60edbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:46.757048 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104de535-3233-4e5b-98e2-2748ec60edbe admin admin] PATH_INFO: `/v3/projects/12e547a50be8494083c2a3693813e47b` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:46.762008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104de535-3233-4e5b-98e2-2748ec60edbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=12e547a50be8494083c2a3693813e47b)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:46.763800 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104de535-3233-4e5b-98e2-2748ec60edbe admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:46.765871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-03cb0115-59fc-4d3c-af9d-992ce802e8dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91025e1413374083ba70f600f70cc7fe'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:46.766906 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-03cb0115-59fc-4d3c-af9d-992ce802e8dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91025e1413374083ba70f600f70cc7fe'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:46.783167 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-03cb0115-59fc-4d3c-af9d-992ce802e8dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91025e1413374083ba70f600f70cc7fe'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:46.807447 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-03cb0115-59fc-4d3c-af9d-992ce802e8dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91025e1413374083ba70f600f70cc7fe'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:46.808621 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-03cb0115-59fc-4d3c-af9d-992ce802e8dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91025e1413374083ba70f600f70cc7fe'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:46.861344 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1054/2089] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:00:46 2022] DELETE /identity/v3/users/91025e1413374083ba70f600f70cc7fe => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:46.894333 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-104de535-3233-4e5b-98e2-2748ec60edbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12e547a50be8494083c2a3693813e47b', 'request_id': 'req-104de535-3233-4e5b-98e2-2748ec60edbe'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:46.908976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-104de535-3233-4e5b-98e2-2748ec60edbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12e547a50be8494083c2a3693813e47b', 'request_id': 'req-104de535-3233-4e5b-98e2-2748ec60edbe'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:46.932380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-104de535-3233-4e5b-98e2-2748ec60edbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12e547a50be8494083c2a3693813e47b', 'request_id': 'req-104de535-3233-4e5b-98e2-2748ec60edbe'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:46.963501 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-104de535-3233-4e5b-98e2-2748ec60edbe admin admin] The token cache is being invalidate because project 12e547a50be8494083c2a3693813e47b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:46.963940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-104de535-3233-4e5b-98e2-2748ec60edbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:46.964712 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-104de535-3233-4e5b-98e2-2748ec60edbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:46.970065 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1036/2090] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:46 2022] DELETE /identity/v3/projects/12e547a50be8494083c2a3693813e47b => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:00:46.974447 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f1e15-313d-4382-b387-92d4908cd28b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:46.974855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f1e15-313d-4382-b387-92d4908cd28b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:46.975320 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f1e15-313d-4382-b387-92d4908cd28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:47.010620 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-f56f1e15-313d-4382-b387-92d4908cd28b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:47.013078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f56f1e15-313d-4382-b387-92d4908cd28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:47.042185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104de535-3233-4e5b-98e2-2748ec60edbe admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:47.043799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-104de535-3233-4e5b-98e2-2748ec60edbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:47.060498 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:47.224331 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1055/2091] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:00:47.237461 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e3d0d-a80d-4ab5-b6d6-b7e04ad9a196 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:47.237685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e3d0d-a80d-4ab5-b6d6-b7e04ad9a196 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:47.238338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e3d0d-a80d-4ab5-b6d6-b7e04ad9a196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:47.274089 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ed2e3d0d-a80d-4ab5-b6d6-b7e04ad9a196 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:47.278154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ed2e3d0d-a80d-4ab5-b6d6-b7e04ad9a196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:47.279176 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104de535-3233-4e5b-98e2-2748ec60edbe admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:47.296408 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a593b-eaa3-452e-a71a-1e06a682db09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:47.298211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a593b-eaa3-452e-a71a-1e06a682db09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:47.298500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a593b-eaa3-452e-a71a-1e06a682db09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:47.300345 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1056/2092] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:47.301074 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a593b-eaa3-452e-a71a-1e06a682db09 admin admin] PATH_INFO: `/v3/projects/7d8124f215d94e4f95b53ace98d5b234` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:47.302858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a593b-eaa3-452e-a71a-1e06a682db09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d8124f215d94e4f95b53ace98d5b234)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:47.304636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e3d0d-a80d-4ab5-b6d6-b7e04ad9a196 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:47.306068 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ed2e3d0d-a80d-4ab5-b6d6-b7e04ad9a196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:47.308649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a593b-eaa3-452e-a71a-1e06a682db09 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:47.406333 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-090a593b-eaa3-452e-a71a-1e06a682db09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d8124f215d94e4f95b53ace98d5b234', 'request_id': 'req-090a593b-eaa3-452e-a71a-1e06a682db09'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:47.418404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-090a593b-eaa3-452e-a71a-1e06a682db09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d8124f215d94e4f95b53ace98d5b234', 'request_id': 'req-090a593b-eaa3-452e-a71a-1e06a682db09'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:47.429817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-090a593b-eaa3-452e-a71a-1e06a682db09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d8124f215d94e4f95b53ace98d5b234', 'request_id': 'req-090a593b-eaa3-452e-a71a-1e06a682db09'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:47.466429 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-090a593b-eaa3-452e-a71a-1e06a682db09 admin admin] The token cache is being invalidate because project 7d8124f215d94e4f95b53ace98d5b234 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:47.466731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-090a593b-eaa3-452e-a71a-1e06a682db09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:47.467435 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-090a593b-eaa3-452e-a71a-1e06a682db09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:47.469592 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1037/2093] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:47 2022] DELETE /identity/v3/projects/7d8124f215d94e4f95b53ace98d5b234 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:47.470432 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a593b-eaa3-452e-a71a-1e06a682db09 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:47.472147 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-090a593b-eaa3-452e-a71a-1e06a682db09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:47.501490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e3d0d-a80d-4ab5-b6d6-b7e04ad9a196 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:47.616852 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:47.618234 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a593b-eaa3-452e-a71a-1e06a682db09 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:47.631067 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7909b6-378c-4765-ab98-d36a5801f777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:47.632002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7909b6-378c-4765-ab98-d36a5801f777 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:47.632468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7909b6-378c-4765-ab98-d36a5801f777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:47.632883 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7909b6-378c-4765-ab98-d36a5801f777 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:47.634243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7909b6-378c-4765-ab98-d36a5801f777 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:00:47.634753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7909b6-378c-4765-ab98-d36a5801f777 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:47.636805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7909b6-378c-4765-ab98-d36a5801f777 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:47.653733 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1038/2094] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:00:47.654793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7909b6-378c-4765-ab98-d36a5801f777 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:47.657622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7f7909b6-378c-4765-ab98-d36a5801f777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:47.688360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7909b6-378c-4765-ab98-d36a5801f777 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:47.689135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9aa2a-742f-43fd-be1e-5a47b5add5b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:47.690755 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9aa2a-742f-43fd-be1e-5a47b5add5b4 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:47.691065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9aa2a-742f-43fd-be1e-5a47b5add5b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:47.691329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9aa2a-742f-43fd-be1e-5a47b5add5b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:47.695031 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185931e-67f8-487d-833d-0d526ca3a072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:47.695515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-cad9aa2a-742f-43fd-be1e-5a47b5add5b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:47.695657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185931e-67f8-487d-833d-0d526ca3a072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:47.696014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185931e-67f8-487d-833d-0d526ca3a072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:47.696354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185931e-67f8-487d-833d-0d526ca3a072 admin admin] PATH_INFO: `/v3/projects/b1145855880e4f6db8ccf257ccd35d2b` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:47.698308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d185931e-67f8-487d-833d-0d526ca3a072 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1145855880e4f6db8ccf257ccd35d2b)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:47.700387 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d185931e-67f8-487d-833d-0d526ca3a072 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:47.758432 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:47.788312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d185931e-67f8-487d-833d-0d526ca3a072 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1145855880e4f6db8ccf257ccd35d2b', 'request_id': 'req-d185931e-67f8-487d-833d-0d526ca3a072'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:47.811431 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d185931e-67f8-487d-833d-0d526ca3a072 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1145855880e4f6db8ccf257ccd35d2b', 'request_id': 'req-d185931e-67f8-487d-833d-0d526ca3a072'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:47.824260 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d185931e-67f8-487d-833d-0d526ca3a072 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1145855880e4f6db8ccf257ccd35d2b', 'request_id': 'req-d185931e-67f8-487d-833d-0d526ca3a072'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:47.831061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9aa2a-742f-43fd-be1e-5a47b5add5b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:47.833021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9aa2a-742f-43fd-be1e-5a47b5add5b4 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:47.862884 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1057/2095] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:47 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:47.865157 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f430645-37b5-41d8-8a9f-0f0ab9d97bda None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:47.865910 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f430645-37b5-41d8-8a9f-0f0ab9d97bda None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:47.865910 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f430645-37b5-41d8-8a9f-0f0ab9d97bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:47.885086 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d185931e-67f8-487d-833d-0d526ca3a072 admin admin] The token cache is being invalidate because project b1145855880e4f6db8ccf257ccd35d2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:47.892363 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d185931e-67f8-487d-833d-0d526ca3a072 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:47.893317 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d185931e-67f8-487d-833d-0d526ca3a072 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:47.897620 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1039/2096] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:47 2022] DELETE /identity/v3/projects/b1145855880e4f6db8ccf257ccd35d2b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:47.900698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185931e-67f8-487d-833d-0d526ca3a072 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:47.903550 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d185931e-67f8-487d-833d-0d526ca3a072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:47.918172 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-7f430645-37b5-41d8-8a9f-0f0ab9d97bda None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:47.926794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7f430645-37b5-41d8-8a9f-0f0ab9d97bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:48.068955 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1058/2097] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:48.068955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f430645-37b5-41d8-8a9f-0f0ab9d97bda None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:48.070599 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7f430645-37b5-41d8-8a9f-0f0ab9d97bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:48.080084 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185931e-67f8-487d-833d-0d526ca3a072 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:48.089508 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360bac61-d6ae-413e-86af-10531a4d816f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:48.091029 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bac61-d6ae-413e-86af-10531a4d816f admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:48.091327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bac61-d6ae-413e-86af-10531a4d816f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:48.091961 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bac61-d6ae-413e-86af-10531a4d816f admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:48.092743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360bac61-d6ae-413e-86af-10531a4d816f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:48.093971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f430645-37b5-41d8-8a9f-0f0ab9d97bda None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:48.094993 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360bac61-d6ae-413e-86af-10531a4d816f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:48.106095 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a7349-b8c1-4309-b3f6-e28a7cd92458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:48.108073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a7349-b8c1-4309-b3f6-e28a7cd92458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:48.108369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a7349-b8c1-4309-b3f6-e28a7cd92458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:48.108644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a7349-b8c1-4309-b3f6-e28a7cd92458 admin admin] PATH_INFO: `/v3/users/609e569a8ed64fa5aa88632ecf7f6702` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:48.113407 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a7349-b8c1-4309-b3f6-e28a7cd92458 admin admin] RBAC: Authorizing `identity:delete_user(user_id=609e569a8ed64fa5aa88632ecf7f6702)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:48.118183 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a7349-b8c1-4309-b3f6-e28a7cd92458 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:48.154782 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1040/2098] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:00:47 2022] POST /identity/v3/projects => generated 403 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:48.159115 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72026200-0faf-4b7b-bac2-c39a73ef3d6e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:48.159272 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72026200-0faf-4b7b-bac2-c39a73ef3d6e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:48.159580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72026200-0faf-4b7b-bac2-c39a73ef3d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:48.202471 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-72026200-0faf-4b7b-bac2-c39a73ef3d6e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:48.205640 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-72026200-0faf-4b7b-bac2-c39a73ef3d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:48.220671 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-626a7349-b8c1-4309-b3f6-e28a7cd92458 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '609e569a8ed64fa5aa88632ecf7f6702'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:48.221938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-626a7349-b8c1-4309-b3f6-e28a7cd92458 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '609e569a8ed64fa5aa88632ecf7f6702'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:48.241411 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-626a7349-b8c1-4309-b3f6-e28a7cd92458 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '609e569a8ed64fa5aa88632ecf7f6702'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:48.256880 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-626a7349-b8c1-4309-b3f6-e28a7cd92458 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '609e569a8ed64fa5aa88632ecf7f6702'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:48.257813 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-626a7349-b8c1-4309-b3f6-e28a7cd92458 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '609e569a8ed64fa5aa88632ecf7f6702'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:48.268132 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:48.280428 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1059/2099] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:00:48 2022] DELETE /identity/v3/users/609e569a8ed64fa5aa88632ecf7f6702 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:48.282290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a34005-10a6-42a5-9bef-098bc9bf8ff8 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:48.283009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a34005-10a6-42a5-9bef-098bc9bf8ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:48.283324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a34005-10a6-42a5-9bef-098bc9bf8ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:48.315695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-27a34005-10a6-42a5-9bef-098bc9bf8ff8 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:48.317206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-27a34005-10a6-42a5-9bef-098bc9bf8ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:48.390798 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1041/2100] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:48.392732 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72026200-0faf-4b7b-bac2-c39a73ef3d6e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:48.394261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-72026200-0faf-4b7b-bac2-c39a73ef3d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:48.418736 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72026200-0faf-4b7b-bac2-c39a73ef3d6e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:48.430308 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1060/2101] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:48.431206 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c804f-47f3-4a87-97be-70897f08ea19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:48.432146 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3653f9-f22f-4402-bf23-543b974e3e7f None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:48.432146 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3653f9-f22f-4402-bf23-543b974e3e7f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:48.432329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3653f9-f22f-4402-bf23-543b974e3e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:48.433765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c804f-47f3-4a87-97be-70897f08ea19 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:48.434255 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c804f-47f3-4a87-97be-70897f08ea19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:48.435807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c804f-47f3-4a87-97be-70897f08ea19 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:48.437322 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c804f-47f3-4a87-97be-70897f08ea19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:48.444295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c804f-47f3-4a87-97be-70897f08ea19 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:48.453201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-cb3653f9-f22f-4402-bf23-543b974e3e7f None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:48.466255 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-cb3653f9-f22f-4402-bf23-543b974e3e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:48.490560 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1042/2102] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:48 2022] POST /identity/v3/users => generated 302 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:48.492943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fe48e-3959-468f-b452-a212968b0431 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:48.493347 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fe48e-3959-468f-b452-a212968b0431 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:48.493776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fe48e-3959-468f-b452-a212968b0431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:48.498232 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1061/2103] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:48.499370 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3653f9-f22f-4402-bf23-543b974e3e7f None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:48.524793 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3653f9-f22f-4402-bf23-543b974e3e7f None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:48.530998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-614fe48e-3959-468f-b452-a212968b0431 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:48.532404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-614fe48e-3959-468f-b452-a212968b0431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:48.542523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a3128-02b2-4049-b0ce-ad022cff7f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:48.543155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a3128-02b2-4049-b0ce-ad022cff7f32 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:48.543436 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a3128-02b2-4049-b0ce-ad022cff7f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:48.543707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a3128-02b2-4049-b0ce-ad022cff7f32 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:48.544551 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309a3128-02b2-4049-b0ce-ad022cff7f32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:00:48.544854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309a3128-02b2-4049-b0ce-ad022cff7f32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:48.548733 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1043/2104] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:48.548889 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309a3128-02b2-4049-b0ce-ad022cff7f32 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:48.548984 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fe48e-3959-468f-b452-a212968b0431 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:48.562517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fe48e-3959-468f-b452-a212968b0431 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:48.573259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f4ebd-da48-4f1e-9c63-afc671b3df27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:48.574542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f4ebd-da48-4f1e-9c63-afc671b3df27 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:48.574959 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f4ebd-da48-4f1e-9c63-afc671b3df27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:48.575370 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f4ebd-da48-4f1e-9c63-afc671b3df27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:48.581210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f4ebd-da48-4f1e-9c63-afc671b3df27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:48.581766 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1062/2105] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:00:48.583223 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a3128-02b2-4049-b0ce-ad022cff7f32 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:48.584827 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f4ebd-da48-4f1e-9c63-afc671b3df27 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:48.591232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-309a3128-02b2-4049-b0ce-ad022cff7f32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:48.613595 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1044/2106] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:48.613595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f4ebd-da48-4f1e-9c63-afc671b3df27 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:48.625084 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:48.635285 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f4ebd-da48-4f1e-9c63-afc671b3df27 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:48.645176 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f834e-1bad-49be-9213-3464adef0248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:48.645981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f834e-1bad-49be-9213-3464adef0248 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:48.646311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f834e-1bad-49be-9213-3464adef0248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:48.649874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f834e-1bad-49be-9213-3464adef0248 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:48.654639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f834e-1bad-49be-9213-3464adef0248 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:00:48.654977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f834e-1bad-49be-9213-3464adef0248 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:48.656923 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f834e-1bad-49be-9213-3464adef0248 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:48.673406 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1045/2107] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:00:48.675281 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f834e-1bad-49be-9213-3464adef0248 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:48.704462 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f834e-1bad-49be-9213-3464adef0248 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:48.735395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db6982-3ed8-4b76-9249-588ce229d3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:48.739795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db6982-3ed8-4b76-9249-588ce229d3c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:48.739795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db6982-3ed8-4b76-9249-588ce229d3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:48.739986 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db6982-3ed8-4b76-9249-588ce229d3c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:48.740634 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db6982-3ed8-4b76-9249-588ce229d3c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:48.742737 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db6982-3ed8-4b76-9249-588ce229d3c6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:48.790835 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1046/2108] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:00:48 2022] POST /identity/v3/projects => generated 393 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:48.791987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db6982-3ed8-4b76-9249-588ce229d3c6 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:48.851576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a3128-02b2-4049-b0ce-ad022cff7f32 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:48.972023 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db6982-3ed8-4b76-9249-588ce229d3c6 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:48.980041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe8bb2-e64e-4464-a975-de9e3c3053a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:48.981091 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe8bb2-e64e-4464-a975-de9e3c3053a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:48.981380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe8bb2-e64e-4464-a975-de9e3c3053a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:48.981698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe8bb2-e64e-4464-a975-de9e3c3053a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:48.983342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe8bb2-e64e-4464-a975-de9e3c3053a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:48.987084 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe8bb2-e64e-4464-a975-de9e3c3053a1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:48.988955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788bb8be-d520-434c-8b95-b2504f7a0531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:48.989611 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788bb8be-d520-434c-8b95-b2504f7a0531 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:48.989890 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788bb8be-d520-434c-8b95-b2504f7a0531 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:48.990160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788bb8be-d520-434c-8b95-b2504f7a0531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:49.006680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788bb8be-d520-434c-8b95-b2504f7a0531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:49.008355 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788bb8be-d520-434c-8b95-b2504f7a0531 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:49.013050 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1047/2109] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:49.014454 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe8bb2-e64e-4464-a975-de9e3c3053a1 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:49.025915 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1063/2110] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:49.029170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788bb8be-d520-434c-8b95-b2504f7a0531 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:49.036523 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe8bb2-e64e-4464-a975-de9e3c3053a1 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:49.059982 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7f603-44e6-405d-9103-293a124787b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:49.065820 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788bb8be-d520-434c-8b95-b2504f7a0531 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:49.068818 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7f603-44e6-405d-9103-293a124787b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:49.070270 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7f603-44e6-405d-9103-293a124787b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:49.071555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7f603-44e6-405d-9103-293a124787b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:49.073112 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7f603-44e6-405d-9103-293a124787b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:49.083076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7f603-44e6-405d-9103-293a124787b2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:49.095043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b2b6b-bd22-4787-b1cc-9a642f04d573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:49.095669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b2b6b-bd22-4787-b1cc-9a642f04d573 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:49.095956 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b2b6b-bd22-4787-b1cc-9a642f04d573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:49.096231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b2b6b-bd22-4787-b1cc-9a642f04d573 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:49.096984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b2b6b-bd22-4787-b1cc-9a642f04d573 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:49.099001 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b2b6b-bd22-4787-b1cc-9a642f04d573 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:49.150944 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1064/2111] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:49 2022] POST /identity/v3/users => generated 297 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:49.158155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b2b6b-bd22-4787-b1cc-9a642f04d573 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:49.168089 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1048/2112] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:00:49 2022] POST /identity/v3/projects => generated 399 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:49.169044 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7f603-44e6-405d-9103-293a124787b2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:49.181045 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b2b6b-bd22-4787-b1cc-9a642f04d573 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:49.203524 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:49.266392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7f603-44e6-405d-9103-293a124787b2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:49.272391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240fc92-34b3-411a-888c-06a57202ebd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:49.273011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240fc92-34b3-411a-888c-06a57202ebd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:49.273304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240fc92-34b3-411a-888c-06a57202ebd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:49.273628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240fc92-34b3-411a-888c-06a57202ebd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:49.274288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240fc92-34b3-411a-888c-06a57202ebd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:49.275918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240fc92-34b3-411a-888c-06a57202ebd1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:49.293741 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1049/2113] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:49.294614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240fc92-34b3-411a-888c-06a57202ebd1 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:49.309457 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240fc92-34b3-411a-888c-06a57202ebd1 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:49.315092 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf155b02-e8c9-49af-a354-08d70bbfc726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:49.315794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf155b02-e8c9-49af-a354-08d70bbfc726 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:49.316123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf155b02-e8c9-49af-a354-08d70bbfc726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:49.316465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf155b02-e8c9-49af-a354-08d70bbfc726 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:49.317689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf155b02-e8c9-49af-a354-08d70bbfc726 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:49.320037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf155b02-e8c9-49af-a354-08d70bbfc726 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:49.334038 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f1473-3fa1-45c4-b852-3da7f79ec84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:49.335090 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f1473-3fa1-45c4-b852-3da7f79ec84a admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:49.335319 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f1473-3fa1-45c4-b852-3da7f79ec84a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:49.335629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f1473-3fa1-45c4-b852-3da7f79ec84a admin admin] PATH_INFO: `/v3/projects/113d5ee0ee684fa3a129461b17b162e1/users/134d179e5e784ca8867b48bcd3e92c41/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:49.356164 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1050/2114] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:49 2022] POST /identity/v3/users => generated 300 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:49.357505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf155b02-e8c9-49af-a354-08d70bbfc726 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:49.368900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f1473-3fa1-45c4-b852-3da7f79ec84a admin admin] RBAC: Authorizing `identity:create_grant(project_id=113d5ee0ee684fa3a129461b17b162e1, user_id=134d179e5e784ca8867b48bcd3e92c41, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:49.371480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf155b02-e8c9-49af-a354-08d70bbfc726 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:49.377634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f1473-3fa1-45c4-b852-3da7f79ec84a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:49.388363 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f1f59-68b7-40af-9c13-d44230f3f5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:49.389110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f1f59-68b7-40af-9c13-d44230f3f5c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:49.389542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f1f59-68b7-40af-9c13-d44230f3f5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:49.389887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f1f59-68b7-40af-9c13-d44230f3f5c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:49.390613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f1f59-68b7-40af-9c13-d44230f3f5c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:49.392467 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f1f59-68b7-40af-9c13-d44230f3f5c6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:49.408795 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1065/2115] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:49 2022] PUT /identity/v3/projects/113d5ee0ee684fa3a129461b17b162e1/users/134d179e5e784ca8867b48bcd3e92c41/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:49.410954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f1473-3fa1-45c4-b852-3da7f79ec84a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:49.417719 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1051/2116] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:49.417719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c0a01-030e-442e-af9c-f7cb1994d6be None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:49.417719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c0a01-030e-442e-af9c-f7cb1994d6be None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:49.417719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c0a01-030e-442e-af9c-f7cb1994d6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:49.445695 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-460c0a01-030e-442e-af9c-f7cb1994d6be None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:49.447662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-460c0a01-030e-442e-af9c-f7cb1994d6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:49.456862 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:49.561386 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1052/2117] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:49.562525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c0a01-030e-442e-af9c-f7cb1994d6be None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:49.575772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f1473-3fa1-45c4-b852-3da7f79ec84a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:49.589730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80560e18-64d0-46e2-a860-fba9289b79d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:49.590422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80560e18-64d0-46e2-a860-fba9289b79d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:49.590706 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80560e18-64d0-46e2-a860-fba9289b79d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:49.590978 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80560e18-64d0-46e2-a860-fba9289b79d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:49.591639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80560e18-64d0-46e2-a860-fba9289b79d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:49.593953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c0a01-030e-442e-af9c-f7cb1994d6be None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:49.599716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80560e18-64d0-46e2-a860-fba9289b79d3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:49.607613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151cdb9-b351-40b0-a517-84dcd6632bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:49.608918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151cdb9-b351-40b0-a517-84dcd6632bce admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:49.609829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151cdb9-b351-40b0-a517-84dcd6632bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:49.610585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151cdb9-b351-40b0-a517-84dcd6632bce admin admin] PATH_INFO: `/v3/projects/21b4bbd0beaa4a83aebc5d4879953d7d/users/ef2335a02d6f4abdb502317f62c7f961/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:49.623175 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1066/2118] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:49.626275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80560e18-64d0-46e2-a860-fba9289b79d3 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:49.646379 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151cdb9-b351-40b0-a517-84dcd6632bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=21b4bbd0beaa4a83aebc5d4879953d7d, user_id=ef2335a02d6f4abdb502317f62c7f961, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:49.652151 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151cdb9-b351-40b0-a517-84dcd6632bce admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:49.678040 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1053/2119] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:49 2022] PUT /identity/v3/projects/21b4bbd0beaa4a83aebc5d4879953d7d/users/ef2335a02d6f4abdb502317f62c7f961/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:49.679048 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151cdb9-b351-40b0-a517-84dcd6632bce admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:49.768220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80560e18-64d0-46e2-a860-fba9289b79d3 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:49.795228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151cdb9-b351-40b0-a517-84dcd6632bce admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:49.801821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896673f-b92f-41b7-9202-f6f015a67b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:49.802903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896673f-b92f-41b7-9202-f6f015a67b1e admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:49.803423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896673f-b92f-41b7-9202-f6f015a67b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:49.803914 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896673f-b92f-41b7-9202-f6f015a67b1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:49.806174 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d896673f-b92f-41b7-9202-f6f015a67b1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:49.808223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d896673f-b92f-41b7-9202-f6f015a67b1e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:49.837194 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1054/2120] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:49.839292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a99fe-eaae-407e-acfc-a0cdb4d312b3 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:49.840084 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a99fe-eaae-407e-acfc-a0cdb4d312b3 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:49.840633 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a99fe-eaae-407e-acfc-a0cdb4d312b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:49.878315 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:49.891310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-de9a99fe-eaae-407e-acfc-a0cdb4d312b3 None None] MFA Rules not processed for user `ef2335a02d6f4abdb502317f62c7f961`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:49.891567 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47776a3-326d-4c06-9b5b-5912e17d9db7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:49.893135 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-de9a99fe-eaae-407e-acfc-a0cdb4d312b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:49.896427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47776a3-326d-4c06-9b5b-5912e17d9db7 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:49.896761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47776a3-326d-4c06-9b5b-5912e17d9db7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:49.897047 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47776a3-326d-4c06-9b5b-5912e17d9db7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:49.919910 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47776a3-326d-4c06-9b5b-5912e17d9db7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:49.921397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47776a3-326d-4c06-9b5b-5912e17d9db7 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:49.953823 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1067/2121] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:49.954741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47776a3-326d-4c06-9b5b-5912e17d9db7 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:49.974158 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47776a3-326d-4c06-9b5b-5912e17d9db7 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:49.983773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefad5fb-3e78-4853-b0ad-a19af20602d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:49.984440 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefad5fb-3e78-4853-b0ad-a19af20602d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:49.986617 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefad5fb-3e78-4853-b0ad-a19af20602d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:49.986992 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefad5fb-3e78-4853-b0ad-a19af20602d0 admin admin] PATH_INFO: `/v3/projects/319dd3922e1a4309b93d50c44a43d6a3/users/35e510fa44df46fba8e354c6293c863c/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:50.015554 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1055/2122] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:50.018990 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a99fe-eaae-407e-acfc-a0cdb4d312b3 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:50.026585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefad5fb-3e78-4853-b0ad-a19af20602d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=319dd3922e1a4309b93d50c44a43d6a3, user_id=35e510fa44df46fba8e354c6293c863c, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:50.029797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefad5fb-3e78-4853-b0ad-a19af20602d0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:50.045747 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a99fe-eaae-407e-acfc-a0cdb4d312b3 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:50.066858 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1068/2123] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:49 2022] PUT /identity/v3/projects/319dd3922e1a4309b93d50c44a43d6a3/users/35e510fa44df46fba8e354c6293c863c/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:50.071974 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d05839-b604-48fe-93ed-d6cd1ea273fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:50.072714 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d05839-b604-48fe-93ed-d6cd1ea273fe admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:50.072999 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d05839-b604-48fe-93ed-d6cd1ea273fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:50.073276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d05839-b604-48fe-93ed-d6cd1ea273fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:50.074430 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d05839-b604-48fe-93ed-d6cd1ea273fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:50.078328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692b45d-9340-4da3-9182-2d86274a3548 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:50.078624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692b45d-9340-4da3-9182-2d86274a3548 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:50.078941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692b45d-9340-4da3-9182-2d86274a3548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:50.084499 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d05839-b604-48fe-93ed-d6cd1ea273fe admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:50.115308 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:50.151379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-0692b45d-9340-4da3-9182-2d86274a3548 None None] MFA Rules not processed for user `35e510fa44df46fba8e354c6293c863c`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:50.155316 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1056/2124] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:00:50 2022] POST /identity/v3/projects => generated 395 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:50.158639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0692b45d-9340-4da3-9182-2d86274a3548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:50.161059 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d05839-b604-48fe-93ed-d6cd1ea273fe admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:50.324500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d05839-b604-48fe-93ed-d6cd1ea273fe admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:50.330835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ddb46-6ccb-491c-bf09-47bed0438946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:50.331854 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ddb46-6ccb-491c-bf09-47bed0438946 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:50.332867 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ddb46-6ccb-491c-bf09-47bed0438946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:50.333217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ddb46-6ccb-491c-bf09-47bed0438946 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:50.334038 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ddb46-6ccb-491c-bf09-47bed0438946 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:50.337314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ddb46-6ccb-491c-bf09-47bed0438946 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:50.364378 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1069/2125] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:50 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:50.364378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692b45d-9340-4da3-9182-2d86274a3548 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:50.368584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0692b45d-9340-4da3-9182-2d86274a3548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:50.378443 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1057/2126] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:50 2022] POST /identity/v3/users => generated 304 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:50.379997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ddb46-6ccb-491c-bf09-47bed0438946 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:50.395676 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692b45d-9340-4da3-9182-2d86274a3548 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:50.400642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ab93f-c520-48f3-a313-840c2b0ad59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:50.401386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ab93f-c520-48f3-a313-840c2b0ad59f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:50.401773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ab93f-c520-48f3-a313-840c2b0ad59f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:50.402291 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ab93f-c520-48f3-a313-840c2b0ad59f admin admin] PATH_INFO: `/v3/projects/89a7ede3e627408bae939d06405906c7` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:50.403578 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ab93f-c520-48f3-a313-840c2b0ad59f admin admin] RBAC: Authorizing `identity:delete_project(project_id=89a7ede3e627408bae939d06405906c7)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:50.405756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ab93f-c520-48f3-a313-840c2b0ad59f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:50.408572 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ddb46-6ccb-491c-bf09-47bed0438946 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:50.417955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f3cc9-0550-4581-9f33-b71e9e4a7868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:50.418378 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f3cc9-0550-4581-9f33-b71e9e4a7868 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:50.418666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f3cc9-0550-4581-9f33-b71e9e4a7868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:50.419014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f3cc9-0550-4581-9f33-b71e9e4a7868 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:50.420222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f3cc9-0550-4581-9f33-b71e9e4a7868 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:50.423868 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f3cc9-0550-4581-9f33-b71e9e4a7868 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:50.474729 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1058/2127] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:00:50 2022] POST /identity/v3/projects => generated 399 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:50.474729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f3cc9-0550-4581-9f33-b71e9e4a7868 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:50.507801 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-451ab93f-c520-48f3-a313-840c2b0ad59f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89a7ede3e627408bae939d06405906c7', 'request_id': 'req-451ab93f-c520-48f3-a313-840c2b0ad59f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:50.522354 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-451ab93f-c520-48f3-a313-840c2b0ad59f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89a7ede3e627408bae939d06405906c7', 'request_id': 'req-451ab93f-c520-48f3-a313-840c2b0ad59f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:50.533201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-451ab93f-c520-48f3-a313-840c2b0ad59f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89a7ede3e627408bae939d06405906c7', 'request_id': 'req-451ab93f-c520-48f3-a313-840c2b0ad59f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:50.558198 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-451ab93f-c520-48f3-a313-840c2b0ad59f admin admin] The token cache is being invalidate because project 89a7ede3e627408bae939d06405906c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:50.558492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-451ab93f-c520-48f3-a313-840c2b0ad59f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:50.562192 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-451ab93f-c520-48f3-a313-840c2b0ad59f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:50.568368 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1070/2128] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:50 2022] DELETE /identity/v3/projects/89a7ede3e627408bae939d06405906c7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:50.569301 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ab93f-c520-48f3-a313-840c2b0ad59f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:50.572309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-451ab93f-c520-48f3-a313-840c2b0ad59f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:50.573781 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f3cc9-0550-4581-9f33-b71e9e4a7868 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:50.674978 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:50.713010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d3473-d8ff-4322-b096-cdbbc1a70999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:50.715247 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d3473-d8ff-4322-b096-cdbbc1a70999 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:50.715615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d3473-d8ff-4322-b096-cdbbc1a70999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:50.719514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d3473-d8ff-4322-b096-cdbbc1a70999 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:50.720477 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d3473-d8ff-4322-b096-cdbbc1a70999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:50.722391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d3473-d8ff-4322-b096-cdbbc1a70999 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:50.735796 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ab93f-c520-48f3-a313-840c2b0ad59f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:50.746165 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1059/2129] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:50.749696 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d3473-d8ff-4322-b096-cdbbc1a70999 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:50.751487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-770d3473-d8ff-4322-b096-cdbbc1a70999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:50.755462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f630b-9205-43bc-b745-2193c0a0f15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:50.756299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f630b-9205-43bc-b745-2193c0a0f15d admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:50.756891 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f630b-9205-43bc-b745-2193c0a0f15d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:50.757377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f630b-9205-43bc-b745-2193c0a0f15d admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:50.758370 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f630b-9205-43bc-b745-2193c0a0f15d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:50.763613 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f630b-9205-43bc-b745-2193c0a0f15d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:50.776205 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:50.782753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d3473-d8ff-4322-b096-cdbbc1a70999 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:50.800067 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518f2f5-692c-4086-b61b-2403cfb1859b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:50.803560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518f2f5-692c-4086-b61b-2403cfb1859b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:50.804846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518f2f5-692c-4086-b61b-2403cfb1859b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:50.804846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518f2f5-692c-4086-b61b-2403cfb1859b admin admin] PATH_INFO: `/v3/users/7cc4afc41da94db5b00dd152b1e5db8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:50.808459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518f2f5-692c-4086-b61b-2403cfb1859b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cc4afc41da94db5b00dd152b1e5db8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:50.813657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518f2f5-692c-4086-b61b-2403cfb1859b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:50.818133 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1071/2130] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:50 2022] POST /identity/v3/users => generated 306 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:50.823842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f630b-9205-43bc-b745-2193c0a0f15d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:50.826925 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-012f630b-9205-43bc-b745-2193c0a0f15d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:50.846668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f630b-9205-43bc-b745-2193c0a0f15d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:50.854428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ab63c-621f-4de6-8464-9e62f291e59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:50.855471 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ab63c-621f-4de6-8464-9e62f291e59e admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:50.855958 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ab63c-621f-4de6-8464-9e62f291e59e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:50.856450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ab63c-621f-4de6-8464-9e62f291e59e admin admin] PATH_INFO: `/v3/projects/7a24a531138d4a2bbabea3706f602c1a/users/693561d7dc6c4906a29e7451e93f9e05/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:50.877715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ab63c-621f-4de6-8464-9e62f291e59e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a24a531138d4a2bbabea3706f602c1a, user_id=693561d7dc6c4906a29e7451e93f9e05, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:50.882517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ab63c-621f-4de6-8464-9e62f291e59e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:50.921659 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1072/2131] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:50 2022] PUT /identity/v3/projects/7a24a531138d4a2bbabea3706f602c1a/users/693561d7dc6c4906a29e7451e93f9e05/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:50.923385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ab63c-621f-4de6-8464-9e62f291e59e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:50.939680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8518f2f5-692c-4086-b61b-2403cfb1859b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cc4afc41da94db5b00dd152b1e5db8f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:50.940413 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8518f2f5-692c-4086-b61b-2403cfb1859b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cc4afc41da94db5b00dd152b1e5db8f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:50.958582 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8518f2f5-692c-4086-b61b-2403cfb1859b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cc4afc41da94db5b00dd152b1e5db8f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:50.979983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8518f2f5-692c-4086-b61b-2403cfb1859b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cc4afc41da94db5b00dd152b1e5db8f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:50.980703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8518f2f5-692c-4086-b61b-2403cfb1859b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cc4afc41da94db5b00dd152b1e5db8f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:51.009716 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1060/2132] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:00:50 2022] DELETE /identity/v3/users/7cc4afc41da94db5b00dd152b1e5db8f => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:51.011247 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518f2f5-692c-4086-b61b-2403cfb1859b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:51.013125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8518f2f5-692c-4086-b61b-2403cfb1859b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:51.044193 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ab63c-621f-4de6-8464-9e62f291e59e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:51.145144 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a170a-e485-4c78-bd0e-98004caa7833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:51.146084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a170a-e485-4c78-bd0e-98004caa7833 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:51.146729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a170a-e485-4c78-bd0e-98004caa7833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:51.147155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a170a-e485-4c78-bd0e-98004caa7833 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:51.148066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a170a-e485-4c78-bd0e-98004caa7833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:51.150416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a170a-e485-4c78-bd0e-98004caa7833 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:51.178979 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1073/2133] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:51.181467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a170a-e485-4c78-bd0e-98004caa7833 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:51.186088 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-043a170a-e485-4c78-bd0e-98004caa7833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:51.190353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518f2f5-692c-4086-b61b-2403cfb1859b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:51.198167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6fecf4-ba56-4d72-b325-117009ac1477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:51.199053 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fecf4-ba56-4d72-b325-117009ac1477 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:51.199484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fecf4-ba56-4d72-b325-117009ac1477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:51.200735 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fecf4-ba56-4d72-b325-117009ac1477 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:51.203084 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6fecf4-ba56-4d72-b325-117009ac1477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:51.203398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a170a-e485-4c78-bd0e-98004caa7833 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:51.205314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6fecf4-ba56-4d72-b325-117009ac1477 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:51.210325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae222853-ed35-4d04-8c97-bf31a1296ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:51.212338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae222853-ed35-4d04-8c97-bf31a1296ab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:51.212824 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae222853-ed35-4d04-8c97-bf31a1296ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:51.213152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae222853-ed35-4d04-8c97-bf31a1296ab5 admin admin] PATH_INFO: `/v3/projects/81cb25f95f4c481c9c9fb4b9c367051f/users/fe9b7dd983234c72a844c1b973e26d17/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:51.218107 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1061/2134] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:51.224701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6fecf4-ba56-4d72-b325-117009ac1477 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:51.237960 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6fecf4-ba56-4d72-b325-117009ac1477 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:51.241901 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae222853-ed35-4d04-8c97-bf31a1296ab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81cb25f95f4c481c9c9fb4b9c367051f, user_id=fe9b7dd983234c72a844c1b973e26d17, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:51.245503 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c9544-266f-45e9-b284-4ed06ea75a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:51.246149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c9544-266f-45e9-b284-4ed06ea75a1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:51.246550 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c9544-266f-45e9-b284-4ed06ea75a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:51.246858 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae222853-ed35-4d04-8c97-bf31a1296ab5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:51.247275 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c9544-266f-45e9-b284-4ed06ea75a1f admin admin] PATH_INFO: `/v3/projects/7a24a531138d4a2bbabea3706f602c1a/users/693561d7dc6c4906a29e7451e93f9e05/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:51.249701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c9544-266f-45e9-b284-4ed06ea75a1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a24a531138d4a2bbabea3706f602c1a, user_id=693561d7dc6c4906a29e7451e93f9e05, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:51.252683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c9544-266f-45e9-b284-4ed06ea75a1f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:51.273577 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1062/2135] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:51 2022] PUT /identity/v3/projects/7a24a531138d4a2bbabea3706f602c1a/users/693561d7dc6c4906a29e7451e93f9e05/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:51.280862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c9544-266f-45e9-b284-4ed06ea75a1f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:51.281407 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1074/2136] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:51 2022] PUT /identity/v3/projects/81cb25f95f4c481c9c9fb4b9c367051f/users/fe9b7dd983234c72a844c1b973e26d17/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:51.285601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46d3e8-1716-4f92-8036-136a9194bf7a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:51.285897 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46d3e8-1716-4f92-8036-136a9194bf7a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:51.286171 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46d3e8-1716-4f92-8036-136a9194bf7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:51.365768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-7f46d3e8-1716-4f92-8036-136a9194bf7a None None] MFA Rules not processed for user `693561d7dc6c4906a29e7451e93f9e05`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:51.367066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7f46d3e8-1716-4f92-8036-136a9194bf7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:51.383027 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:51.402571 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:51.414655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c9544-266f-45e9-b284-4ed06ea75a1f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:51.429883 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222ad47-9d4a-4285-8a2d-1d7b4daed55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:51.430798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222ad47-9d4a-4285-8a2d-1d7b4daed55e admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:51.431254 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222ad47-9d4a-4285-8a2d-1d7b4daed55e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:51.433782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222ad47-9d4a-4285-8a2d-1d7b4daed55e admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:51.434630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222ad47-9d4a-4285-8a2d-1d7b4daed55e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:51.438837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222ad47-9d4a-4285-8a2d-1d7b4daed55e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:51.473544 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1063/2137] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:51.474677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222ad47-9d4a-4285-8a2d-1d7b4daed55e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:51.495232 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222ad47-9d4a-4285-8a2d-1d7b4daed55e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:51.500082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57072bd-6ff5-49b6-bd24-d9a31bc707bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:51.500746 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57072bd-6ff5-49b6-bd24-d9a31bc707bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:51.501022 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57072bd-6ff5-49b6-bd24-d9a31bc707bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:51.501300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57072bd-6ff5-49b6-bd24-d9a31bc707bb admin admin] PATH_INFO: `/v3/projects/81cb25f95f4c481c9c9fb4b9c367051f/users/fe9b7dd983234c72a844c1b973e26d17/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:51.503446 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57072bd-6ff5-49b6-bd24-d9a31bc707bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=81cb25f95f4c481c9c9fb4b9c367051f, user_id=fe9b7dd983234c72a844c1b973e26d17, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:51.506908 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57072bd-6ff5-49b6-bd24-d9a31bc707bb admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:51.520521 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1064/2138] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:51 2022] PUT /identity/v3/projects/81cb25f95f4c481c9c9fb4b9c367051f/users/fe9b7dd983234c72a844c1b973e26d17/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:51.527072 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1075/2139] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:51 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:51.532951 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db7623-861b-4a03-8c41-1c17960d49cc None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:51.533522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db7623-861b-4a03-8c41-1c17960d49cc None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:51.533967 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db7623-861b-4a03-8c41-1c17960d49cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:51.538034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46d3e8-1716-4f92-8036-136a9194bf7a None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:51.540461 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7f46d3e8-1716-4f92-8036-136a9194bf7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:51.582061 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-96db7623-861b-4a03-8c41-1c17960d49cc None None] MFA Rules not processed for user `fe9b7dd983234c72a844c1b973e26d17`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:51.584157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-96db7623-861b-4a03-8c41-1c17960d49cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:51.672500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46d3e8-1716-4f92-8036-136a9194bf7a None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:51.737959 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1065/2140] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:51 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:51.783343 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd143521-bccf-402a-89fe-5438bd6a4585 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:51.786037 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd143521-bccf-402a-89fe-5438bd6a4585 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:51.786320 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd143521-bccf-402a-89fe-5438bd6a4585 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:51.786699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd143521-bccf-402a-89fe-5438bd6a4585 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:51.852593 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:51.889246 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db7623-861b-4a03-8c41-1c17960d49cc None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:51.890917 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-96db7623-861b-4a03-8c41-1c17960d49cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:51.902092 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd143521-bccf-402a-89fe-5438bd6a4585 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:51.904177 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd143521-bccf-402a-89fe-5438bd6a4585 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:51.922342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db7623-861b-4a03-8c41-1c17960d49cc None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:51.937541 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1076/2141] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:51 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:00:51.960495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97336f-c783-48a4-8242-2148e638b95e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:51.961707 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97336f-c783-48a4-8242-2148e638b95e service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:51.961993 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97336f-c783-48a4-8242-2148e638b95e service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:51.964768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97336f-c783-48a4-8242-2148e638b95e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:51.998638 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97336f-c783-48a4-8242-2148e638b95e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:52.001396 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97336f-c783-48a4-8242-2148e638b95e service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:52.021005 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1066/2142] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:51 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:52.086988 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd143521-bccf-402a-89fe-5438bd6a4585 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:52.248771 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd143521-bccf-402a-89fe-5438bd6a4585 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:52.253410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feee29d-37dd-4895-82ef-c1c7ed63a038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:52.254128 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feee29d-37dd-4895-82ef-c1c7ed63a038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:52.254407 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feee29d-37dd-4895-82ef-c1c7ed63a038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:52.254901 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feee29d-37dd-4895-82ef-c1c7ed63a038 admin admin] PATH_INFO: `/v3/users/ef2335a02d6f4abdb502317f62c7f961` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:52.256082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feee29d-37dd-4895-82ef-c1c7ed63a038 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef2335a02d6f4abdb502317f62c7f961)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:52.258088 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feee29d-37dd-4895-82ef-c1c7ed63a038 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:52.335856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8feee29d-37dd-4895-82ef-c1c7ed63a038 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef2335a02d6f4abdb502317f62c7f961'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:52.338115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8feee29d-37dd-4895-82ef-c1c7ed63a038 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef2335a02d6f4abdb502317f62c7f961'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:52.364605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8feee29d-37dd-4895-82ef-c1c7ed63a038 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef2335a02d6f4abdb502317f62c7f961'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:52.380053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8feee29d-37dd-4895-82ef-c1c7ed63a038 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef2335a02d6f4abdb502317f62c7f961'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:52.380948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8feee29d-37dd-4895-82ef-c1c7ed63a038 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef2335a02d6f4abdb502317f62c7f961'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:52.429180 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1077/2143] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:00:52 2022] DELETE /identity/v3/users/ef2335a02d6f4abdb502317f62c7f961 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:52.433100 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df47756-8b66-4322-a742-8b71e79c9af7 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:52.433935 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df47756-8b66-4322-a742-8b71e79c9af7 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:52.434409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df47756-8b66-4322-a742-8b71e79c9af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:52.488667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-2df47756-8b66-4322-a742-8b71e79c9af7 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:52.490452 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2df47756-8b66-4322-a742-8b71e79c9af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:52.619672 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1067/2144] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:52.677113 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feee29d-37dd-4895-82ef-c1c7ed63a038 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:52.679810 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8feee29d-37dd-4895-82ef-c1c7ed63a038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:52.804593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feee29d-37dd-4895-82ef-c1c7ed63a038 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:52.814515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9356d5-3870-49c6-90f2-f5e00b5831af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:52.817581 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9356d5-3870-49c6-90f2-f5e00b5831af service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:52.817884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9356d5-3870-49c6-90f2-f5e00b5831af service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:52.818326 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9356d5-3870-49c6-90f2-f5e00b5831af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:52.838670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9356d5-3870-49c6-90f2-f5e00b5831af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:52.841797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9356d5-3870-49c6-90f2-f5e00b5831af service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:52.855502 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1078/2145] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:53.319083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df47756-8b66-4322-a742-8b71e79c9af7 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:53.321060 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2df47756-8b66-4322-a742-8b71e79c9af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:53.345292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df47756-8b66-4322-a742-8b71e79c9af7 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:53.357902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b32d54-68e4-47a6-8c12-4867667d479a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:53.358672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b32d54-68e4-47a6-8c12-4867667d479a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:53.359624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b32d54-68e4-47a6-8c12-4867667d479a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:53.360329 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b32d54-68e4-47a6-8c12-4867667d479a admin admin] PATH_INFO: `/v3/projects/a5fedcbfd52d4212baecc63dc33c54e9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:53.361674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b32d54-68e4-47a6-8c12-4867667d479a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5fedcbfd52d4212baecc63dc33c54e9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:53.364803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b32d54-68e4-47a6-8c12-4867667d479a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:53.450479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-35b32d54-68e4-47a6-8c12-4867667d479a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5fedcbfd52d4212baecc63dc33c54e9', 'request_id': 'req-35b32d54-68e4-47a6-8c12-4867667d479a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:53.453593 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:53.473399 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-35b32d54-68e4-47a6-8c12-4867667d479a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5fedcbfd52d4212baecc63dc33c54e9', 'request_id': 'req-35b32d54-68e4-47a6-8c12-4867667d479a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:53.485179 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-35b32d54-68e4-47a6-8c12-4867667d479a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5fedcbfd52d4212baecc63dc33c54e9', 'request_id': 'req-35b32d54-68e4-47a6-8c12-4867667d479a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:53.508222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-35b32d54-68e4-47a6-8c12-4867667d479a admin admin] The token cache is being invalidate because project a5fedcbfd52d4212baecc63dc33c54e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:53.508593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-35b32d54-68e4-47a6-8c12-4867667d479a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:53.511244 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-35b32d54-68e4-47a6-8c12-4867667d479a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:53.514910 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1068/2146] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:53 2022] DELETE /identity/v3/projects/a5fedcbfd52d4212baecc63dc33c54e9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:53.522601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae5cbb-ba6d-4c3a-8c91-3bba821bf8ee None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:53.523415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae5cbb-ba6d-4c3a-8c91-3bba821bf8ee None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:53.523823 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae5cbb-ba6d-4c3a-8c91-3bba821bf8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:53.538399 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:53.575688 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b32d54-68e4-47a6-8c12-4867667d479a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:53.577377 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-35b32d54-68e4-47a6-8c12-4867667d479a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:53.582700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-50ae5cbb-ba6d-4c3a-8c91-3bba821bf8ee None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:53.586672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-50ae5cbb-ba6d-4c3a-8c91-3bba821bf8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:53.725455 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1079/2147] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:53.728365 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cff06-3c63-47fe-ac6c-3680bdec17e3 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:53.728792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cff06-3c63-47fe-ac6c-3680bdec17e3 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:53.729245 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cff06-3c63-47fe-ac6c-3680bdec17e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:53.746734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b32d54-68e4-47a6-8c12-4867667d479a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:53.761267 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878af2f3-6082-4c9a-849b-c6d2b5bf5e5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:53.761547 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e59cff06-3c63-47fe-ac6c-3680bdec17e3 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:53.762322 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878af2f3-6082-4c9a-849b-c6d2b5bf5e5f service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:53.762753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878af2f3-6082-4c9a-849b-c6d2b5bf5e5f service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:53.763179 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878af2f3-6082-4c9a-849b-c6d2b5bf5e5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:53.763545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e59cff06-3c63-47fe-ac6c-3680bdec17e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:53.774962 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-878af2f3-6082-4c9a-849b-c6d2b5bf5e5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:53.780670 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1080/2148] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:00:53.790262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59cff06-3c63-47fe-ac6c-3680bdec17e3 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:53.810722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59cff06-3c63-47fe-ac6c-3680bdec17e3 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:53.830722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd377632-e02b-41d0-a29d-4454790e1413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:53.831391 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd377632-e02b-41d0-a29d-4454790e1413 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:53.831730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd377632-e02b-41d0-a29d-4454790e1413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:53.832109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd377632-e02b-41d0-a29d-4454790e1413 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:53.832984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd377632-e02b-41d0-a29d-4454790e1413 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:00:53.833298 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd377632-e02b-41d0-a29d-4454790e1413 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:53.835083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd377632-e02b-41d0-a29d-4454790e1413 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:53.855907 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1081/2149] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:00:53.863887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd377632-e02b-41d0-a29d-4454790e1413 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:53.887378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd377632-e02b-41d0-a29d-4454790e1413 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:53.899485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d3b8b-150a-484d-a6e5-9749a96e5322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:53.900123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d3b8b-150a-484d-a6e5-9749a96e5322 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:53.900406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d3b8b-150a-484d-a6e5-9749a96e5322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:53.900680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d3b8b-150a-484d-a6e5-9749a96e5322 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:53.901326 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d3b8b-150a-484d-a6e5-9749a96e5322 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:53.905012 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d3b8b-150a-484d-a6e5-9749a96e5322 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:53.913731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878af2f3-6082-4c9a-849b-c6d2b5bf5e5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:53.915031 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878af2f3-6082-4c9a-849b-c6d2b5bf5e5f service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:53.935498 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1069/2150] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:53 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:00:53.962229 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1082/2151] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:00:53 2022] POST /identity/v3/projects => generated 363 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:53.963773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878af2f3-6082-4c9a-849b-c6d2b5bf5e5f service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:53.978443 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878af2f3-6082-4c9a-849b-c6d2b5bf5e5f service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:54.125599 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc29428-6bb1-4d2c-9982-eb2c96cf9f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:54.126601 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc29428-6bb1-4d2c-9982-eb2c96cf9f4a admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:54.126725 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc29428-6bb1-4d2c-9982-eb2c96cf9f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:54.127106 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc29428-6bb1-4d2c-9982-eb2c96cf9f4a admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:54.127860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc29428-6bb1-4d2c-9982-eb2c96cf9f4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:54.134069 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc29428-6bb1-4d2c-9982-eb2c96cf9f4a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:54.188162 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1070/2152] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:53 2022] POST /identity/v3/users => generated 282 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:54.192853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d3b8b-150a-484d-a6e5-9749a96e5322 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:54.214155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d3b8b-150a-484d-a6e5-9749a96e5322 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:54.233984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc331e0c-a690-48fc-b9af-30e4b366d03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:54.234690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc331e0c-a690-48fc-b9af-30e4b366d03a admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:54.235226 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc331e0c-a690-48fc-b9af-30e4b366d03a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:54.235747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc331e0c-a690-48fc-b9af-30e4b366d03a admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:54.238756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc331e0c-a690-48fc-b9af-30e4b366d03a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:54.249834 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc331e0c-a690-48fc-b9af-30e4b366d03a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:54.275888 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc29428-6bb1-4d2c-9982-eb2c96cf9f4a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:54.283021 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:54.290872 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1083/2153] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:54.294813 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc29428-6bb1-4d2c-9982-eb2c96cf9f4a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:54.312123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c4120-00fe-4644-9a21-fc6c4d3713b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:54.312123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c4120-00fe-4644-9a21-fc6c4d3713b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:54.312123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c4120-00fe-4644-9a21-fc6c4d3713b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:54.312123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c4120-00fe-4644-9a21-fc6c4d3713b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:54.313635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c4120-00fe-4644-9a21-fc6c4d3713b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:54.316012 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c4120-00fe-4644-9a21-fc6c4d3713b7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:54.347345 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc331e0c-a690-48fc-b9af-30e4b366d03a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:54.359304 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1071/2154] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:54.370464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc331e0c-a690-48fc-b9af-30e4b366d03a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:54.385104 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19aff00-3cda-41bb-8ef1-b9c1b2351c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:54.385801 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19aff00-3cda-41bb-8ef1-b9c1b2351c7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:54.386077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19aff00-3cda-41bb-8ef1-b9c1b2351c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:54.386352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19aff00-3cda-41bb-8ef1-b9c1b2351c7d admin admin] PATH_INFO: `/v3/projects/cb1fc9a3f0a24bca8154d8885e2efa7f/users/545e0ebcbe314ee1a8419e3583e74d23/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:54.424586 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19aff00-3cda-41bb-8ef1-b9c1b2351c7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb1fc9a3f0a24bca8154d8885e2efa7f, user_id=545e0ebcbe314ee1a8419e3583e74d23, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:54.428673 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19aff00-3cda-41bb-8ef1-b9c1b2351c7d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:54.455350 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1084/2155] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:54 2022] PUT /identity/v3/projects/cb1fc9a3f0a24bca8154d8885e2efa7f/users/545e0ebcbe314ee1a8419e3583e74d23/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:54.460962 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de7aad-a617-42c7-adbf-c63bcf19082e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:54.461450 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de7aad-a617-42c7-adbf-c63bcf19082e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:54.461547 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de7aad-a617-42c7-adbf-c63bcf19082e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:54.502934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-44de7aad-a617-42c7-adbf-c63bcf19082e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:54.526317 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-44de7aad-a617-42c7-adbf-c63bcf19082e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:54.689552 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1072/2156] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:54.722485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19aff00-3cda-41bb-8ef1-b9c1b2351c7d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:54.725190 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a19aff00-3cda-41bb-8ef1-b9c1b2351c7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:54.871683 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19aff00-3cda-41bb-8ef1-b9c1b2351c7d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:54.879883 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61450441-644d-424e-898d-817ea207e5c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:54.880520 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61450441-644d-424e-898d-817ea207e5c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:54.883735 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61450441-644d-424e-898d-817ea207e5c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:54.884045 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61450441-644d-424e-898d-817ea207e5c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:54.918445 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61450441-644d-424e-898d-817ea207e5c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:54.920045 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61450441-644d-424e-898d-817ea207e5c0 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:54.930816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de7aad-a617-42c7-adbf-c63bcf19082e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:54.932459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-44de7aad-a617-42c7-adbf-c63bcf19082e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:54.933177 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1085/2157] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:54.969949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de7aad-a617-42c7-adbf-c63bcf19082e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:54.986454 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577fed4-fd79-4e3a-9e58-df69de9c40cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:54.988227 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577fed4-fd79-4e3a-9e58-df69de9c40cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:54.993606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577fed4-fd79-4e3a-9e58-df69de9c40cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:54.994177 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577fed4-fd79-4e3a-9e58-df69de9c40cd admin admin] PATH_INFO: `/v3/projects/21b4bbd0beaa4a83aebc5d4879953d7d` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:54.998051 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577fed4-fd79-4e3a-9e58-df69de9c40cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=21b4bbd0beaa4a83aebc5d4879953d7d)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:55.013121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577fed4-fd79-4e3a-9e58-df69de9c40cd admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:55.148414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e577fed4-fd79-4e3a-9e58-df69de9c40cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21b4bbd0beaa4a83aebc5d4879953d7d', 'request_id': 'req-e577fed4-fd79-4e3a-9e58-df69de9c40cd'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:55.176523 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e577fed4-fd79-4e3a-9e58-df69de9c40cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21b4bbd0beaa4a83aebc5d4879953d7d', 'request_id': 'req-e577fed4-fd79-4e3a-9e58-df69de9c40cd'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:55.185156 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e577fed4-fd79-4e3a-9e58-df69de9c40cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21b4bbd0beaa4a83aebc5d4879953d7d', 'request_id': 'req-e577fed4-fd79-4e3a-9e58-df69de9c40cd'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:55.225251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e577fed4-fd79-4e3a-9e58-df69de9c40cd admin admin] The token cache is being invalidate because project 21b4bbd0beaa4a83aebc5d4879953d7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:55.226035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e577fed4-fd79-4e3a-9e58-df69de9c40cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:55.251382 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e577fed4-fd79-4e3a-9e58-df69de9c40cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:55.254399 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1073/2158] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:54 2022] DELETE /identity/v3/projects/21b4bbd0beaa4a83aebc5d4879953d7d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:55.258553 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61450441-644d-424e-898d-817ea207e5c0 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:55.271066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61450441-644d-424e-898d-817ea207e5c0 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:55.346493 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:55.438729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19283821-12c6-4c13-a0bb-f25ce32deff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:55.440272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19283821-12c6-4c13-a0bb-f25ce32deff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:55.440831 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19283821-12c6-4c13-a0bb-f25ce32deff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:55.442187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19283821-12c6-4c13-a0bb-f25ce32deff6 admin admin] PATH_INFO: `/v3/users/693561d7dc6c4906a29e7451e93f9e05` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:55.443920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19283821-12c6-4c13-a0bb-f25ce32deff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=693561d7dc6c4906a29e7451e93f9e05)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:55.446728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19283821-12c6-4c13-a0bb-f25ce32deff6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:55.565626 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-19283821-12c6-4c13-a0bb-f25ce32deff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '693561d7dc6c4906a29e7451e93f9e05'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:55.569584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-19283821-12c6-4c13-a0bb-f25ce32deff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '693561d7dc6c4906a29e7451e93f9e05'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:55.583070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-19283821-12c6-4c13-a0bb-f25ce32deff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '693561d7dc6c4906a29e7451e93f9e05'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:55.606692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-19283821-12c6-4c13-a0bb-f25ce32deff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '693561d7dc6c4906a29e7451e93f9e05'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:55.608059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-19283821-12c6-4c13-a0bb-f25ce32deff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '693561d7dc6c4906a29e7451e93f9e05'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:55.650148 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1086/2159] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:00:55 2022] DELETE /identity/v3/users/693561d7dc6c4906a29e7451e93f9e05 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:57.569987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577fed4-fd79-4e3a-9e58-df69de9c40cd admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:57.576340 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e577fed4-fd79-4e3a-9e58-df69de9c40cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:57.615858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577fed4-fd79-4e3a-9e58-df69de9c40cd admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:57.774273 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050441f1-d8db-4b0b-8aa0-99a473b0f5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:57.775018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050441f1-d8db-4b0b-8aa0-99a473b0f5a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:57.775018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050441f1-d8db-4b0b-8aa0-99a473b0f5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:57.775219 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050441f1-d8db-4b0b-8aa0-99a473b0f5a7 admin admin] PATH_INFO: `/v3/users/35e510fa44df46fba8e354c6293c863c` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:57.778754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050441f1-d8db-4b0b-8aa0-99a473b0f5a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35e510fa44df46fba8e354c6293c863c)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:57.780793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050441f1-d8db-4b0b-8aa0-99a473b0f5a7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:57.826124 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:57.953085 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-050441f1-d8db-4b0b-8aa0-99a473b0f5a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35e510fa44df46fba8e354c6293c863c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:57.954942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-050441f1-d8db-4b0b-8aa0-99a473b0f5a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35e510fa44df46fba8e354c6293c863c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:57.968334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19283821-12c6-4c13-a0bb-f25ce32deff6 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:57.970210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-19283821-12c6-4c13-a0bb-f25ce32deff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:57.976914 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-050441f1-d8db-4b0b-8aa0-99a473b0f5a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35e510fa44df46fba8e354c6293c863c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:57.996601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19283821-12c6-4c13-a0bb-f25ce32deff6 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:58.001007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-050441f1-d8db-4b0b-8aa0-99a473b0f5a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35e510fa44df46fba8e354c6293c863c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:58.001615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-050441f1-d8db-4b0b-8aa0-99a473b0f5a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35e510fa44df46fba8e354c6293c863c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:58.010760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee79a94-d2e4-4c02-8994-0884eebf5356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:58.012428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee79a94-d2e4-4c02-8994-0884eebf5356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:58.012850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee79a94-d2e4-4c02-8994-0884eebf5356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:58.013275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee79a94-d2e4-4c02-8994-0884eebf5356 admin admin] PATH_INFO: `/v3/projects/7a24a531138d4a2bbabea3706f602c1a` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:58.018609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee79a94-d2e4-4c02-8994-0884eebf5356 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a24a531138d4a2bbabea3706f602c1a)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:58.025493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee79a94-d2e4-4c02-8994-0884eebf5356 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:58.039728 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1074/2160] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:00:57 2022] DELETE /identity/v3/users/35e510fa44df46fba8e354c6293c863c => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:58.043821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7de422-4dd1-42a5-aa9e-b7046fc25732 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:58.044114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7de422-4dd1-42a5-aa9e-b7046fc25732 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:58.044399 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7de422-4dd1-42a5-aa9e-b7046fc25732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:58.087615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-dc7de422-4dd1-42a5-aa9e-b7046fc25732 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:58.090788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-dc7de422-4dd1-42a5-aa9e-b7046fc25732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:58.174214 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0ee79a94-d2e4-4c02-8994-0884eebf5356 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a24a531138d4a2bbabea3706f602c1a', 'request_id': 'req-0ee79a94-d2e4-4c02-8994-0884eebf5356'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:58.196346 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0ee79a94-d2e4-4c02-8994-0884eebf5356 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a24a531138d4a2bbabea3706f602c1a', 'request_id': 'req-0ee79a94-d2e4-4c02-8994-0884eebf5356'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:58.223645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0ee79a94-d2e4-4c02-8994-0884eebf5356 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a24a531138d4a2bbabea3706f602c1a', 'request_id': 'req-0ee79a94-d2e4-4c02-8994-0884eebf5356'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:58.225549 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1075/2161] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:58.255415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7de422-4dd1-42a5-aa9e-b7046fc25732 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:58.256881 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-dc7de422-4dd1-42a5-aa9e-b7046fc25732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:58.259595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0ee79a94-d2e4-4c02-8994-0884eebf5356 admin admin] The token cache is being invalidate because project 7a24a531138d4a2bbabea3706f602c1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:00:58.260192 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0ee79a94-d2e4-4c02-8994-0884eebf5356 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:58.261927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0ee79a94-d2e4-4c02-8994-0884eebf5356 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:00:58.265083 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1087/2162] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:00:57 2022] DELETE /identity/v3/projects/7a24a531138d4a2bbabea3706f602c1a => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:00:58.271804 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513e8a4-5362-4557-92fb-d451ae3077c9 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:58.272490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513e8a4-5362-4557-92fb-d451ae3077c9 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:58.273733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513e8a4-5362-4557-92fb-d451ae3077c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:58.345869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-4513e8a4-5362-4557-92fb-d451ae3077c9 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:58.348642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4513e8a4-5362-4557-92fb-d451ae3077c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:58.378993 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7de422-4dd1-42a5-aa9e-b7046fc25732 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:58.384452 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:58.442177 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1088/2163] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:58.454229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c128eb5-dc83-418f-aafa-911cc26def9b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:58.456282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c128eb5-dc83-418f-aafa-911cc26def9b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:58.456282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c128eb5-dc83-418f-aafa-911cc26def9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:58.490338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0bb07-55be-4a65-9c05-04ea71f42175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:58.490983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0bb07-55be-4a65-9c05-04ea71f42175 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:58.491264 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0bb07-55be-4a65-9c05-04ea71f42175 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:58.491537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0bb07-55be-4a65-9c05-04ea71f42175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:58.494583 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f3c0bb07-55be-4a65-9c05-04ea71f42175 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:58.511065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-7c128eb5-dc83-418f-aafa-911cc26def9b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:58.513381 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7c128eb5-dc83-418f-aafa-911cc26def9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:58.518470 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:58.526325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c0bb07-55be-4a65-9c05-04ea71f42175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:58.531128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c0bb07-55be-4a65-9c05-04ea71f42175 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:58.538016 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1089/2164] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:58.539193 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c128eb5-dc83-418f-aafa-911cc26def9b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:58.555475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c128eb5-dc83-418f-aafa-911cc26def9b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:58.560486 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1076/2165] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:00:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:00:58.561995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495701c8-b33b-42d4-aacd-eaddd961f3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:58.568593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495701c8-b33b-42d4-aacd-eaddd961f3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:58.569195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495701c8-b33b-42d4-aacd-eaddd961f3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:58.569753 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495701c8-b33b-42d4-aacd-eaddd961f3f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:58.570793 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495701c8-b33b-42d4-aacd-eaddd961f3f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:00:58.571306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495701c8-b33b-42d4-aacd-eaddd961f3f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:58.573344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495701c8-b33b-42d4-aacd-eaddd961f3f0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:58.588927 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1090/2166] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:00:58.593240 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0bb07-55be-4a65-9c05-04ea71f42175 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:58.607664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0bb07-55be-4a65-9c05-04ea71f42175 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:58.627621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65149339-3658-4b18-9654-d029126f8be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:58.628390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65149339-3658-4b18-9654-d029126f8be5 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:58.629076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65149339-3658-4b18-9654-d029126f8be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:58.629374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65149339-3658-4b18-9654-d029126f8be5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:58.630103 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65149339-3658-4b18-9654-d029126f8be5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:58.637988 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65149339-3658-4b18-9654-d029126f8be5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:58.679984 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1077/2167] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:00:58 2022] POST /identity/v3/projects => generated 393 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:58.684267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495701c8-b33b-42d4-aacd-eaddd961f3f0 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:58.698776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495701c8-b33b-42d4-aacd-eaddd961f3f0 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:58.847006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85fe63-407e-40dd-86cc-46ccc04047a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:58.848399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85fe63-407e-40dd-86cc-46ccc04047a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:58.848816 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85fe63-407e-40dd-86cc-46ccc04047a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:58.849404 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85fe63-407e-40dd-86cc-46ccc04047a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:58.850426 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85fe63-407e-40dd-86cc-46ccc04047a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:58.855147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85fe63-407e-40dd-86cc-46ccc04047a8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:58.897928 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1091/2168] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:58 2022] POST /identity/v3/users => generated 297 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:58.902043 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65149339-3658-4b18-9654-d029126f8be5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:58.915482 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65149339-3658-4b18-9654-d029126f8be5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:58.924996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a0683-c35d-466c-9939-098822fe2a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:58.926520 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a0683-c35d-466c-9939-098822fe2a5c admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:58.927041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a0683-c35d-466c-9939-098822fe2a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:58.927424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a0683-c35d-466c-9939-098822fe2a5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:58.928183 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a0683-c35d-466c-9939-098822fe2a5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:58.930380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a0683-c35d-466c-9939-098822fe2a5c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:58.947102 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1078/2169] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:58.950458 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85fe63-407e-40dd-86cc-46ccc04047a8 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:58.966344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85fe63-407e-40dd-86cc-46ccc04047a8 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:58.972684 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5cd7c-6bdc-421b-8fb9-23e74542ea4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:58.973740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5cd7c-6bdc-421b-8fb9-23e74542ea4f admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:58.974351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5cd7c-6bdc-421b-8fb9-23e74542ea4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:58.974749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5cd7c-6bdc-421b-8fb9-23e74542ea4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:58.975665 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5cd7c-6bdc-421b-8fb9-23e74542ea4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:58.982855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5cd7c-6bdc-421b-8fb9-23e74542ea4f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:59.010793 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1092/2170] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:59.016094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a0683-c35d-466c-9939-098822fe2a5c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:59.032348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a0683-c35d-466c-9939-098822fe2a5c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:59.043009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb9884-fa1d-46bb-a5aa-33c4d83d8239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:59.043698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb9884-fa1d-46bb-a5aa-33c4d83d8239 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:59.043979 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb9884-fa1d-46bb-a5aa-33c4d83d8239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:59.044253 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb9884-fa1d-46bb-a5aa-33c4d83d8239 admin admin] PATH_INFO: `/v3/projects/3e68b453ac4b4c458a0b91431da2332c/users/6e0026a1a659485f98e1f7e780caa9bf/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:59.088519 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb9884-fa1d-46bb-a5aa-33c4d83d8239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e68b453ac4b4c458a0b91431da2332c, user_id=6e0026a1a659485f98e1f7e780caa9bf, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:59.091456 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb9884-fa1d-46bb-a5aa-33c4d83d8239 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:59.122120 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1079/2171] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:59 2022] PUT /identity/v3/projects/3e68b453ac4b4c458a0b91431da2332c/users/6e0026a1a659485f98e1f7e780caa9bf/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:00:59.134021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fbad5-9a2e-44ad-bcf3-4c7c033511b8 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:59.134505 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fbad5-9a2e-44ad-bcf3-4c7c033511b8 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:59.135001 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fbad5-9a2e-44ad-bcf3-4c7c033511b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:59.244541 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-081fbad5-9a2e-44ad-bcf3-4c7c033511b8 None None] MFA Rules not processed for user `6e0026a1a659485f98e1f7e780caa9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:00:59.246177 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-081fbad5-9a2e-44ad-bcf3-4c7c033511b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:00:59.377981 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1093/2172] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:00:59.383175 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb9884-fa1d-46bb-a5aa-33c4d83d8239 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:59.505760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb9884-fa1d-46bb-a5aa-33c4d83d8239 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:59.512323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef0fd2-3e2e-4e12-9086-7c85e9c64a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:59.512961 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef0fd2-3e2e-4e12-9086-7c85e9c64a8b admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:59.513247 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef0fd2-3e2e-4e12-9086-7c85e9c64a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:59.513550 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef0fd2-3e2e-4e12-9086-7c85e9c64a8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:59.514201 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef0fd2-3e2e-4e12-9086-7c85e9c64a8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:59.516125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef0fd2-3e2e-4e12-9086-7c85e9c64a8b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:59.564486 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1080/2173] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:00:59 2022] POST /identity/v3/projects => generated 393 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:59.565423 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081fbad5-9a2e-44ad-bcf3-4c7c033511b8 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:59.589062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081fbad5-9a2e-44ad-bcf3-4c7c033511b8 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:59.623420 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:00:59.710062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5dbeb-4d80-41ff-8fcc-b61abf58d51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:59.711205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5dbeb-4d80-41ff-8fcc-b61abf58d51b admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:59.711669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5dbeb-4d80-41ff-8fcc-b61abf58d51b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:59.712099 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5dbeb-4d80-41ff-8fcc-b61abf58d51b admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:59.713049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5dbeb-4d80-41ff-8fcc-b61abf58d51b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:59.715354 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5dbeb-4d80-41ff-8fcc-b61abf58d51b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:59.767961 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1094/2174] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:00:59 2022] POST /identity/v3/users => generated 303 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:00:59.776327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef0fd2-3e2e-4e12-9086-7c85e9c64a8b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:59.795511 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef0fd2-3e2e-4e12-9086-7c85e9c64a8b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:59.802799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7ca84-d7fd-4ced-978c-1a3fc4cfcc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:59.803487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7ca84-d7fd-4ced-978c-1a3fc4cfcc08 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:59.805697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7ca84-d7fd-4ced-978c-1a3fc4cfcc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:59.806022 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7ca84-d7fd-4ced-978c-1a3fc4cfcc08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:59.806899 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7ca84-d7fd-4ced-978c-1a3fc4cfcc08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:59.808613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7ca84-d7fd-4ced-978c-1a3fc4cfcc08 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:59.835014 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5dbeb-4d80-41ff-8fcc-b61abf58d51b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:59.837013 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1081/2175] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:00:59.859609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5dbeb-4d80-41ff-8fcc-b61abf58d51b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:00:59.878384 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7a362-404a-41e3-a04a-3cbdb0867524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:00:59.879949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7a362-404a-41e3-a04a-3cbdb0867524 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:59.880409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7a362-404a-41e3-a04a-3cbdb0867524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:59.880832 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7a362-404a-41e3-a04a-3cbdb0867524 admin admin] PATH_INFO: `/v3/projects/867a276e37e44ccb97253578feee2d04/users/866c09d08c664b7ca85770c91832ab73/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:59.916395 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7a362-404a-41e3-a04a-3cbdb0867524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=867a276e37e44ccb97253578feee2d04, user_id=866c09d08c664b7ca85770c91832ab73, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:00:59.919368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7a362-404a-41e3-a04a-3cbdb0867524 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:00:59.952535 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1095/2176] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:00:59 2022] PUT /identity/v3/projects/867a276e37e44ccb97253578feee2d04/users/866c09d08c664b7ca85770c91832ab73/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:00:59.960210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7ca84-d7fd-4ced-978c-1a3fc4cfcc08 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:00:59.975979 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f04ba-9eca-43cb-a567-c4ed5796f005 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:00:59.976863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f04ba-9eca-43cb-a567-c4ed5796f005 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:00:59.977298 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f04ba-9eca-43cb-a567-c4ed5796f005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:00:59.997704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7ca84-d7fd-4ced-978c-1a3fc4cfcc08 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:00.029583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-2a2f04ba-9eca-43cb-a567-c4ed5796f005 None None] MFA Rules not processed for user `a648e1ac627e49cdb6d5d478614c5e82`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:00.044065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2a2f04ba-9eca-43cb-a567-c4ed5796f005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:00.141208 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d5d99-9028-4dc2-9be4-82ad6d86ed88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:00.142077 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d5d99-9028-4dc2-9be4-82ad6d86ed88 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:00.142435 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d5d99-9028-4dc2-9be4-82ad6d86ed88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:00.142818 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d5d99-9028-4dc2-9be4-82ad6d86ed88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:00.144363 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d5d99-9028-4dc2-9be4-82ad6d86ed88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:00.146460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d5d99-9028-4dc2-9be4-82ad6d86ed88 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:00.188496 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1096/2177] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:00:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:01:00.190909 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1082/2178] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:01:00.203778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f04ba-9eca-43cb-a567-c4ed5796f005 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:00.228234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f04ba-9eca-43cb-a567-c4ed5796f005 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:00.248781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b0ed0-4927-4486-b69d-e1384359d60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:00.250793 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b0ed0-4927-4486-b69d-e1384359d60f admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:00.251071 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b0ed0-4927-4486-b69d-e1384359d60f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:00.251339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b0ed0-4927-4486-b69d-e1384359d60f admin admin] PATH_INFO: `/v3/projects/867a276e37e44ccb97253578feee2d04/users/866c09d08c664b7ca85770c91832ab73/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:00.259341 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b0ed0-4927-4486-b69d-e1384359d60f admin admin] RBAC: Authorizing `identity:create_grant(project_id=867a276e37e44ccb97253578feee2d04, user_id=866c09d08c664b7ca85770c91832ab73, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:00.268546 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b0ed0-4927-4486-b69d-e1384359d60f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:00.314452 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1097/2179] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:01:00 2022] PUT /identity/v3/projects/867a276e37e44ccb97253578feee2d04/users/866c09d08c664b7ca85770c91832ab73/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:00.316773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745941b9-219b-4f7b-9195-a019cfc69fd7 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:00.317064 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745941b9-219b-4f7b-9195-a019cfc69fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:00.317335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745941b9-219b-4f7b-9195-a019cfc69fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:00.340116 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:00.354173 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700771b9-57cf-4501-8fce-7ae7fc063163 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:00.354459 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700771b9-57cf-4501-8fce-7ae7fc063163 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:00.354736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700771b9-57cf-4501-8fce-7ae7fc063163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:00.384909 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-745941b9-219b-4f7b-9195-a019cfc69fd7 None None] MFA Rules not processed for user `866c09d08c664b7ca85770c91832ab73`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:00.386056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-745941b9-219b-4f7b-9195-a019cfc69fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:00.455892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-700771b9-57cf-4501-8fce-7ae7fc063163 None None] MFA Rules not processed for user `1c179ae7b86c41a080ade6fae2897387`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:00.458204 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-700771b9-57cf-4501-8fce-7ae7fc063163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:00.554048 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1083/2180] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:00 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:00.555087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745941b9-219b-4f7b-9195-a019cfc69fd7 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:00.556545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-745941b9-219b-4f7b-9195-a019cfc69fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:00.604561 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1098/2181] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:00 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:00.606340 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b763364-2962-4889-a4c3-c426ade83bac None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:00.607138 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b763364-2962-4889-a4c3-c426ade83bac None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:00.607629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b763364-2962-4889-a4c3-c426ade83bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:00.622376 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:00.650279 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-9b763364-2962-4889-a4c3-c426ade83bac None None] MFA Rules not processed for user `6e0026a1a659485f98e1f7e780caa9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:00.653321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9b763364-2962-4889-a4c3-c426ade83bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:00.692534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745941b9-219b-4f7b-9195-a019cfc69fd7 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:00.704265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8826ab-54d7-4827-9c80-47789605a6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:00.704930 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8826ab-54d7-4827-9c80-47789605a6a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:00.705408 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8826ab-54d7-4827-9c80-47789605a6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:00.705551 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8826ab-54d7-4827-9c80-47789605a6a8 admin admin] PATH_INFO: `/v3/projects/319dd3922e1a4309b93d50c44a43d6a3` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:00.708450 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8826ab-54d7-4827-9c80-47789605a6a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=319dd3922e1a4309b93d50c44a43d6a3)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:00.710910 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8826ab-54d7-4827-9c80-47789605a6a8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:00.795800 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1099/2182] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:00.797106 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a6b7f-6480-4d0c-b7b9-b8858b20db80 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:00.797386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a6b7f-6480-4d0c-b7b9-b8858b20db80 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:00.797692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a6b7f-6480-4d0c-b7b9-b8858b20db80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:00.821488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ce8826ab-54d7-4827-9c80-47789605a6a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '319dd3922e1a4309b93d50c44a43d6a3', 'request_id': 'req-ce8826ab-54d7-4827-9c80-47789605a6a8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:00.840076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ce8826ab-54d7-4827-9c80-47789605a6a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '319dd3922e1a4309b93d50c44a43d6a3', 'request_id': 'req-ce8826ab-54d7-4827-9c80-47789605a6a8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:00.847048 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ce8826ab-54d7-4827-9c80-47789605a6a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '319dd3922e1a4309b93d50c44a43d6a3', 'request_id': 'req-ce8826ab-54d7-4827-9c80-47789605a6a8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:00.863507 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a12a6b7f-6480-4d0c-b7b9-b8858b20db80 None None] MFA Rules not processed for user `41571ce2b64c4762b04ed0848bf34c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:00.865187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a12a6b7f-6480-4d0c-b7b9-b8858b20db80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:00.872466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ce8826ab-54d7-4827-9c80-47789605a6a8 admin admin] The token cache is being invalidate because project 319dd3922e1a4309b93d50c44a43d6a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:01:00.872774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ce8826ab-54d7-4827-9c80-47789605a6a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:00.873835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ce8826ab-54d7-4827-9c80-47789605a6a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:00.879133 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1084/2183] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:01:00 2022] DELETE /identity/v3/projects/319dd3922e1a4309b93d50c44a43d6a3 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:00.882916 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8826ab-54d7-4827-9c80-47789605a6a8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:00.885917 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ce8826ab-54d7-4827-9c80-47789605a6a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:00.940226 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:00.995986 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1100/2184] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:00 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:01.011491 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a6b7f-6480-4d0c-b7b9-b8858b20db80 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:01.014612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a12a6b7f-6480-4d0c-b7b9-b8858b20db80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:01.043454 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8826ab-54d7-4827-9c80-47789605a6a8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:01.049681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c0e3d-6ea8-4275-82f0-ac830e8983a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:01.051659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c0e3d-6ea8-4275-82f0-ac830e8983a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:01.052426 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c0e3d-6ea8-4275-82f0-ac830e8983a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:01.053328 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c0e3d-6ea8-4275-82f0-ac830e8983a8 admin admin] PATH_INFO: `/v3/users/fe9b7dd983234c72a844c1b973e26d17` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:01.055762 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c0e3d-6ea8-4275-82f0-ac830e8983a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe9b7dd983234c72a844c1b973e26d17)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:01.058526 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c0e3d-6ea8-4275-82f0-ac830e8983a8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:01.170833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3f4c0e3d-6ea8-4275-82f0-ac830e8983a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe9b7dd983234c72a844c1b973e26d17'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:01.172331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3f4c0e3d-6ea8-4275-82f0-ac830e8983a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe9b7dd983234c72a844c1b973e26d17'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:01.186191 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3f4c0e3d-6ea8-4275-82f0-ac830e8983a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe9b7dd983234c72a844c1b973e26d17'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:01.208178 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a6b7f-6480-4d0c-b7b9-b8858b20db80 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:01.211660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3f4c0e3d-6ea8-4275-82f0-ac830e8983a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe9b7dd983234c72a844c1b973e26d17'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:01.213399 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3f4c0e3d-6ea8-4275-82f0-ac830e8983a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe9b7dd983234c72a844c1b973e26d17'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:01.221401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436d7f0-2604-4203-b95e-9f502140c35e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:01.222454 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436d7f0-2604-4203-b95e-9f502140c35e service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:01.224851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436d7f0-2604-4203-b95e-9f502140c35e service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:01.226368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436d7f0-2604-4203-b95e-9f502140c35e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:01.232166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d436d7f0-2604-4203-b95e-9f502140c35e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:01.259875 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1085/2185] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:01:00 2022] DELETE /identity/v3/users/fe9b7dd983234c72a844c1b973e26d17 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:01.366364 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:01.396458 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436d7f0-2604-4203-b95e-9f502140c35e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:01.398401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436d7f0-2604-4203-b95e-9f502140c35e service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:01.411338 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1101/2186] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:01:01 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:01:02.508201 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c0e3d-6ea8-4275-82f0-ac830e8983a8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:02.509834 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3f4c0e3d-6ea8-4275-82f0-ac830e8983a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:02.725089 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436d7f0-2604-4203-b95e-9f502140c35e service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:02.727999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d436d7f0-2604-4203-b95e-9f502140c35e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:02.770300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436d7f0-2604-4203-b95e-9f502140c35e service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:02.787475 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c0e3d-6ea8-4275-82f0-ac830e8983a8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:02.807999 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac17df6-fa82-479c-b21a-e8825b3484ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:02.809503 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac17df6-fa82-479c-b21a-e8825b3484ec service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:02.809503 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac17df6-fa82-479c-b21a-e8825b3484ec service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:02.809503 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac17df6-fa82-479c-b21a-e8825b3484ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:02.815254 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-cac17df6-fa82-479c-b21a-e8825b3484ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:02.935343 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a21970-ba09-420f-8e48-b6f84222ef02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:02.935884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a21970-ba09-420f-8e48-b6f84222ef02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:02.936170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a21970-ba09-420f-8e48-b6f84222ef02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:02.936438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a21970-ba09-420f-8e48-b6f84222ef02 admin admin] PATH_INFO: `/v3/projects/81cb25f95f4c481c9c9fb4b9c367051f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:02.939334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a21970-ba09-420f-8e48-b6f84222ef02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81cb25f95f4c481c9c9fb4b9c367051f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:02.945612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a21970-ba09-420f-8e48-b6f84222ef02 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:02.946079 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:02.996253 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac17df6-fa82-479c-b21a-e8825b3484ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:02.998258 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac17df6-fa82-479c-b21a-e8825b3484ec service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:03.033161 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1086/2187] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:01:02 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:01:03.053556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-48a21970-ba09-420f-8e48-b6f84222ef02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81cb25f95f4c481c9c9fb4b9c367051f', 'request_id': 'req-48a21970-ba09-420f-8e48-b6f84222ef02'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:03.074666 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-48a21970-ba09-420f-8e48-b6f84222ef02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81cb25f95f4c481c9c9fb4b9c367051f', 'request_id': 'req-48a21970-ba09-420f-8e48-b6f84222ef02'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:03.082328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-48a21970-ba09-420f-8e48-b6f84222ef02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81cb25f95f4c481c9c9fb4b9c367051f', 'request_id': 'req-48a21970-ba09-420f-8e48-b6f84222ef02'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:03.109179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-48a21970-ba09-420f-8e48-b6f84222ef02 admin admin] The token cache is being invalidate because project 81cb25f95f4c481c9c9fb4b9c367051f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:01:03.109699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-48a21970-ba09-420f-8e48-b6f84222ef02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:03.114921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-48a21970-ba09-420f-8e48-b6f84222ef02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:03.127566 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1102/2188] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:01:02 2022] DELETE /identity/v3/projects/81cb25f95f4c481c9c9fb4b9c367051f => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:03.135347 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235114ad-d586-44b8-8b73-74381c742f4f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:03.135935 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235114ad-d586-44b8-8b73-74381c742f4f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:03.136434 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235114ad-d586-44b8-8b73-74381c742f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:03.209754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-235114ad-d586-44b8-8b73-74381c742f4f None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:03.215564 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-235114ad-d586-44b8-8b73-74381c742f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:03.469725 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1087/2189] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:03.478156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545638b-1a40-49b5-a82d-bb2833cddb24 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:03.478442 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545638b-1a40-49b5-a82d-bb2833cddb24 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:03.478758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545638b-1a40-49b5-a82d-bb2833cddb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:03.526000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-b545638b-1a40-49b5-a82d-bb2833cddb24 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:03.527809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b545638b-1a40-49b5-a82d-bb2833cddb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:03.539945 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1103/2190] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:03.543867 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235114ad-d586-44b8-8b73-74381c742f4f None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:03.560578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235114ad-d586-44b8-8b73-74381c742f4f None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:03.574514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee24c3c-caa3-49bc-870f-b2e46f84fb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:03.578423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee24c3c-caa3-49bc-870f-b2e46f84fb31 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:03.579213 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee24c3c-caa3-49bc-870f-b2e46f84fb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:03.580417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee24c3c-caa3-49bc-870f-b2e46f84fb31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:03.581125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee24c3c-caa3-49bc-870f-b2e46f84fb31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:01:03.583569 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee24c3c-caa3-49bc-870f-b2e46f84fb31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:03.592816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee24c3c-caa3-49bc-870f-b2e46f84fb31 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:03.628400 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1088/2191] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:01:03.633069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545638b-1a40-49b5-a82d-bb2833cddb24 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:03.644162 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545638b-1a40-49b5-a82d-bb2833cddb24 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:03.695085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79fb5cd-1ee6-48a2-b792-a4099f33df15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:03.697083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fb5cd-1ee6-48a2-b792-a4099f33df15 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:03.698672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fb5cd-1ee6-48a2-b792-a4099f33df15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:03.699186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fb5cd-1ee6-48a2-b792-a4099f33df15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:03.700447 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79fb5cd-1ee6-48a2-b792-a4099f33df15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:03.705032 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79fb5cd-1ee6-48a2-b792-a4099f33df15 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:03.753290 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1104/2192] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:01:03 2022] POST /identity/v3/projects => generated 393 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:01:03.757225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee24c3c-caa3-49bc-870f-b2e46f84fb31 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:03.773967 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee24c3c-caa3-49bc-870f-b2e46f84fb31 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:03.936106 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed996aaf-2fb5-4f4a-a586-85d9f997007b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:03.936749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed996aaf-2fb5-4f4a-a586-85d9f997007b admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:03.937024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed996aaf-2fb5-4f4a-a586-85d9f997007b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:03.937289 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed996aaf-2fb5-4f4a-a586-85d9f997007b admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:03.937972 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed996aaf-2fb5-4f4a-a586-85d9f997007b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:03.940694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed996aaf-2fb5-4f4a-a586-85d9f997007b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:03.990203 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1089/2193] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:01:03 2022] POST /identity/v3/users => generated 297 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:01:03.993854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79fb5cd-1ee6-48a2-b792-a4099f33df15 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:04.013299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79fb5cd-1ee6-48a2-b792-a4099f33df15 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:04.036098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc330f41-c694-4fab-98da-73292753f5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:04.042287 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc330f41-c694-4fab-98da-73292753f5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:04.042757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc330f41-c694-4fab-98da-73292753f5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:04.043343 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc330f41-c694-4fab-98da-73292753f5f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:04.063207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc330f41-c694-4fab-98da-73292753f5f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:04.068578 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc330f41-c694-4fab-98da-73292753f5f4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:04.119293 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1105/2194] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:01:04.123045 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed996aaf-2fb5-4f4a-a586-85d9f997007b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:04.147107 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed996aaf-2fb5-4f4a-a586-85d9f997007b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:04.162497 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b3ccc-d238-4ad5-a9ba-2cccb34e2215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:04.163200 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b3ccc-d238-4ad5-a9ba-2cccb34e2215 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:04.163553 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b3ccc-d238-4ad5-a9ba-2cccb34e2215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:04.163894 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b3ccc-d238-4ad5-a9ba-2cccb34e2215 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:04.164795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b3ccc-d238-4ad5-a9ba-2cccb34e2215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:04.166335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b3ccc-d238-4ad5-a9ba-2cccb34e2215 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:04.196262 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1090/2195] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:01:04.200705 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc330f41-c694-4fab-98da-73292753f5f4 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:04.235631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc330f41-c694-4fab-98da-73292753f5f4 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:04.252992 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0782f44f-099a-4d44-9e57-4d169b668e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:04.254256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782f44f-099a-4d44-9e57-4d169b668e5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:04.254537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782f44f-099a-4d44-9e57-4d169b668e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:04.254813 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782f44f-099a-4d44-9e57-4d169b668e5e admin admin] PATH_INFO: `/v3/projects/9fdc82f43f074f9897c024a3cd212219/users/6392b6cd927e4474a5a2b1e19a6a2c57/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:04.302401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0782f44f-099a-4d44-9e57-4d169b668e5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fdc82f43f074f9897c024a3cd212219, user_id=6392b6cd927e4474a5a2b1e19a6a2c57, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:04.305421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0782f44f-099a-4d44-9e57-4d169b668e5e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:04.355812 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1106/2196] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:01:04 2022] PUT /identity/v3/projects/9fdc82f43f074f9897c024a3cd212219/users/6392b6cd927e4474a5a2b1e19a6a2c57/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:04.356038 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec000b-4bf6-4916-a3d0-89a6c5e9ea37 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:04.356038 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec000b-4bf6-4916-a3d0-89a6c5e9ea37 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:04.356038 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec000b-4bf6-4916-a3d0-89a6c5e9ea37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:04.442829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-8bec000b-4bf6-4916-a3d0-89a6c5e9ea37 None None] MFA Rules not processed for user `6392b6cd927e4474a5a2b1e19a6a2c57`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:04.444151 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8bec000b-4bf6-4916-a3d0-89a6c5e9ea37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:04.503600 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:04.565588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0782f44f-099a-4d44-9e57-4d169b668e5e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:04.571589 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1091/2197] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:01:04.589732 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:04.718155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0782f44f-099a-4d44-9e57-4d169b668e5e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:04.727812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e307a08-9ad6-4607-b3c2-d9ed3bc97af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:04.728457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e307a08-9ad6-4607-b3c2-d9ed3bc97af7 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:04.728789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e307a08-9ad6-4607-b3c2-d9ed3bc97af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:04.729072 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e307a08-9ad6-4607-b3c2-d9ed3bc97af7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:04.729809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e307a08-9ad6-4607-b3c2-d9ed3bc97af7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:04.731884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e307a08-9ad6-4607-b3c2-d9ed3bc97af7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:04.792540 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1107/2198] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:01:04 2022] POST /identity/v3/projects => generated 395 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:01:04.797700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec000b-4bf6-4916-a3d0-89a6c5e9ea37 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:04.832093 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec000b-4bf6-4916-a3d0-89a6c5e9ea37 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:05.034464 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfd775-b642-4221-bf7e-63d6d864d8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:05.035544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfd775-b642-4221-bf7e-63d6d864d8fe admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:05.035823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfd775-b642-4221-bf7e-63d6d864d8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:05.036291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfd775-b642-4221-bf7e-63d6d864d8fe admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:05.036941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cfd775-b642-4221-bf7e-63d6d864d8fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:05.038927 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cfd775-b642-4221-bf7e-63d6d864d8fe admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:05.071049 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1092/2199] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:01:04 2022] POST /identity/v3/users => generated 304 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:01:05.075254 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e307a08-9ad6-4607-b3c2-d9ed3bc97af7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:05.094630 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e307a08-9ad6-4607-b3c2-d9ed3bc97af7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:05.126421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb70ea-e073-49a5-aaea-287a46ccb785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:05.128971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb70ea-e073-49a5-aaea-287a46ccb785 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:05.129409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb70ea-e073-49a5-aaea-287a46ccb785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:05.129712 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb70ea-e073-49a5-aaea-287a46ccb785 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:05.131520 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb70ea-e073-49a5-aaea-287a46ccb785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:05.141976 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb70ea-e073-49a5-aaea-287a46ccb785 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:05.172243 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1108/2200] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:01:05.174265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfd775-b642-4221-bf7e-63d6d864d8fe admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:05.191828 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfd775-b642-4221-bf7e-63d6d864d8fe admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:05.219593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c1302-0598-4782-b811-a3d7d576668c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:05.219593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c1302-0598-4782-b811-a3d7d576668c admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:05.219593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c1302-0598-4782-b811-a3d7d576668c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:05.219869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c1302-0598-4782-b811-a3d7d576668c admin admin] PATH_INFO: `/v3/projects/6759aedc7b7d4f6891d4db9d1368f2b3/users/f07f15fe172e451a9a27822c68e134d8/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:05.245014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93c1302-0598-4782-b811-a3d7d576668c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6759aedc7b7d4f6891d4db9d1368f2b3, user_id=f07f15fe172e451a9a27822c68e134d8, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:05.248297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93c1302-0598-4782-b811-a3d7d576668c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:05.277178 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1093/2201] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:01:05 2022] PUT /identity/v3/projects/6759aedc7b7d4f6891d4db9d1368f2b3/users/f07f15fe172e451a9a27822c68e134d8/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:05.281646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb70ea-e073-49a5-aaea-287a46ccb785 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:05.298110 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb70ea-e073-49a5-aaea-287a46ccb785 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:05.426750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98dacf9-3811-47e1-b72d-784ec7206ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:05.426750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98dacf9-3811-47e1-b72d-784ec7206ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:05.426750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98dacf9-3811-47e1-b72d-784ec7206ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:05.426750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98dacf9-3811-47e1-b72d-784ec7206ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:05.427354 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98dacf9-3811-47e1-b72d-784ec7206ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:05.427354 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98dacf9-3811-47e1-b72d-784ec7206ff0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:05.456129 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1109/2202] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:01:05.460202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c1302-0598-4782-b811-a3d7d576668c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:05.515688 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c1302-0598-4782-b811-a3d7d576668c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:05.545061 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff8e4c-aaf2-4749-98fb-13d610c10d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:05.545258 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff8e4c-aaf2-4749-98fb-13d610c10d31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:05.546395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff8e4c-aaf2-4749-98fb-13d610c10d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:05.546668 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff8e4c-aaf2-4749-98fb-13d610c10d31 admin admin] PATH_INFO: `/v3/projects/6759aedc7b7d4f6891d4db9d1368f2b3/users/f07f15fe172e451a9a27822c68e134d8/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:05.557980 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff8e4c-aaf2-4749-98fb-13d610c10d31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6759aedc7b7d4f6891d4db9d1368f2b3, user_id=f07f15fe172e451a9a27822c68e134d8, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:05.560975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff8e4c-aaf2-4749-98fb-13d610c10d31 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:05.587790 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1094/2203] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:01:05 2022] PUT /identity/v3/projects/6759aedc7b7d4f6891d4db9d1368f2b3/users/f07f15fe172e451a9a27822c68e134d8/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:05.599122 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6063fe9-1d60-43cb-862a-1fce7dab0d42 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:05.599411 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6063fe9-1d60-43cb-862a-1fce7dab0d42 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:05.599696 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6063fe9-1d60-43cb-862a-1fce7dab0d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:05.655083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-f6063fe9-1d60-43cb-862a-1fce7dab0d42 None None] MFA Rules not processed for user `f07f15fe172e451a9a27822c68e134d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:05.656319 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f6063fe9-1d60-43cb-862a-1fce7dab0d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:05.836148 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1110/2204] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:05 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:05.842334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff8e4c-aaf2-4749-98fb-13d610c10d31 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:06.043927 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff8e4c-aaf2-4749-98fb-13d610c10d31 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:06.066898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f4c8e-c7ca-450f-8a47-8eb1820082a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:06.067783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f4c8e-c7ca-450f-8a47-8eb1820082a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:06.068491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f4c8e-c7ca-450f-8a47-8eb1820082a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:06.068970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f4c8e-c7ca-450f-8a47-8eb1820082a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:06.069870 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f4c8e-c7ca-450f-8a47-8eb1820082a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:06.078534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f4c8e-c7ca-450f-8a47-8eb1820082a7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:06.166512 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1095/2205] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:01:05 2022] POST /identity/v3/projects => generated 391 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:01:06.167637 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6063fe9-1d60-43cb-862a-1fce7dab0d42 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:06.188075 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6063fe9-1d60-43cb-862a-1fce7dab0d42 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:06.207660 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:06.340475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570a59f-fbde-4640-a858-6015ec1b3860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:06.341334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570a59f-fbde-4640-a858-6015ec1b3860 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:06.341819 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570a59f-fbde-4640-a858-6015ec1b3860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:06.342195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570a59f-fbde-4640-a858-6015ec1b3860 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:06.352738 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570a59f-fbde-4640-a858-6015ec1b3860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:06.355079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570a59f-fbde-4640-a858-6015ec1b3860 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:06.434895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f4c8e-c7ca-450f-8a47-8eb1820082a7 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:06.444220 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1111/2206] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:01:06 2022] POST /identity/v3/users => generated 296 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:01:06.451081 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f4c8e-c7ca-450f-8a47-8eb1820082a7 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:06.459697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0d48a-dafd-4d04-bc90-d2e32b670976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:06.460500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0d48a-dafd-4d04-bc90-d2e32b670976 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:06.460959 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0d48a-dafd-4d04-bc90-d2e32b670976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:06.461321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0d48a-dafd-4d04-bc90-d2e32b670976 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:06.462219 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0d48a-dafd-4d04-bc90-d2e32b670976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:06.463979 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0d48a-dafd-4d04-bc90-d2e32b670976 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:06.472827 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:06.484269 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570a59f-fbde-4640-a858-6015ec1b3860 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:06.485710 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1096/2207] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:01:06.499772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570a59f-fbde-4640-a858-6015ec1b3860 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:06.505543 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa7546-f4d0-4bba-be19-3c8f51a0d95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:06.506317 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa7546-f4d0-4bba-be19-3c8f51a0d95f admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:06.506706 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa7546-f4d0-4bba-be19-3c8f51a0d95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:06.507063 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa7546-f4d0-4bba-be19-3c8f51a0d95f admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:06.507841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa7546-f4d0-4bba-be19-3c8f51a0d95f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:06.509769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa7546-f4d0-4bba-be19-3c8f51a0d95f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:06.524071 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1112/2208] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:01:06.528844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0d48a-dafd-4d04-bc90-d2e32b670976 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:06.541001 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0d48a-dafd-4d04-bc90-d2e32b670976 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:06.546072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80524d-fa9d-417a-952d-ea8e9ed2e28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:06.547157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80524d-fa9d-417a-952d-ea8e9ed2e28b admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:06.547490 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80524d-fa9d-417a-952d-ea8e9ed2e28b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:06.547872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80524d-fa9d-417a-952d-ea8e9ed2e28b admin admin] PATH_INFO: `/v3/projects/fdc4cb52c3e548d98d7b4c29aaf08252/users/f567e424923d439c8770ba9882f0ed61/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:06.572334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80524d-fa9d-417a-952d-ea8e9ed2e28b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdc4cb52c3e548d98d7b4c29aaf08252, user_id=f567e424923d439c8770ba9882f0ed61, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:06.581025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80524d-fa9d-417a-952d-ea8e9ed2e28b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:06.633158 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b6733-3b20-43d2-a3e4-9cc52f0af10f None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:06.633717 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b6733-3b20-43d2-a3e4-9cc52f0af10f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:06.634079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b6733-3b20-43d2-a3e4-9cc52f0af10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:06.637553 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1097/2209] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:01:06 2022] PUT /identity/v3/projects/fdc4cb52c3e548d98d7b4c29aaf08252/users/f567e424923d439c8770ba9882f0ed61/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:06.695733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-d21b6733-3b20-43d2-a3e4-9cc52f0af10f None None] MFA Rules not processed for user `f567e424923d439c8770ba9882f0ed61`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:06.697108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d21b6733-3b20-43d2-a3e4-9cc52f0af10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:06.920975 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1113/2210] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:07.543553 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45c710-f7e2-452c-b13e-d40cf1818898 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:07.543848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45c710-f7e2-452c-b13e-d40cf1818898 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:07.544198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45c710-f7e2-452c-b13e-d40cf1818898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:07.563681 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b6733-3b20-43d2-a3e4-9cc52f0af10f None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:07.565392 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d21b6733-3b20-43d2-a3e4-9cc52f0af10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:07.663953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5f45c710-f7e2-452c-b13e-d40cf1818898 None None] MFA Rules not processed for user `134d179e5e784ca8867b48bcd3e92c41`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:07.665202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5f45c710-f7e2-452c-b13e-d40cf1818898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:07.785850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b6733-3b20-43d2-a3e4-9cc52f0af10f None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:07.800186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4683c-5488-403e-9e04-b120837ec195 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:07.800683 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4683c-5488-403e-9e04-b120837ec195 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:07.800960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4683c-5488-403e-9e04-b120837ec195 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:07.803178 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4683c-5488-403e-9e04-b120837ec195 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:07.828553 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:07.829463 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1098/2211] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:07 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:07.830648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45c710-f7e2-452c-b13e-d40cf1818898 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:07.832939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5f45c710-f7e2-452c-b13e-d40cf1818898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:07.899121 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4683c-5488-403e-9e04-b120837ec195 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:07.901038 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4683c-5488-403e-9e04-b120837ec195 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:07.906306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45c710-f7e2-452c-b13e-d40cf1818898 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:07.911331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d5133-22e3-4b92-8c0b-1fe1b8aaeb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:07.911952 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d5133-22e3-4b92-8c0b-1fe1b8aaeb6b admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:07.912231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d5133-22e3-4b92-8c0b-1fe1b8aaeb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:07.912504 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d5133-22e3-4b92-8c0b-1fe1b8aaeb6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:07.913136 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d5133-22e3-4b92-8c0b-1fe1b8aaeb6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:07.914979 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1114/2212] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:01:07 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:01:07.915530 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d5133-22e3-4b92-8c0b-1fe1b8aaeb6b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:07.956989 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1099/2213] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:01:07 2022] POST /identity/v3/projects => generated 403 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:01:07.957258 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4683c-5488-403e-9e04-b120837ec195 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:07.970601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4683c-5488-403e-9e04-b120837ec195 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:08.087311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14a787-f000-4960-81ff-1a073da9e7e7 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:08.087620 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14a787-f000-4960-81ff-1a073da9e7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:08.087929 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14a787-f000-4960-81ff-1a073da9e7e7 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:08.095617 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1100/2214] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:01:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 04 01:01:08.114137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14a787-f000-4960-81ff-1a073da9e7e7 None None] Authenticating service token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:01:08.119716 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7d14a787-f000-4960-81ff-1a073da9e7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:08.178308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252fd7e-9e1a-498e-9608-5b473f019fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:08.181238 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252fd7e-9e1a-498e-9608-5b473f019fbf admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:08.181751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252fd7e-9e1a-498e-9608-5b473f019fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:08.183054 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252fd7e-9e1a-498e-9608-5b473f019fbf admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:08.183919 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252fd7e-9e1a-498e-9608-5b473f019fbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:08.187885 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252fd7e-9e1a-498e-9608-5b473f019fbf admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:08.276668 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1115/2215] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:01:07 2022] POST /identity/v3/users => generated 308 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:01:08.285803 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252fd7e-9e1a-498e-9608-5b473f019fbf admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:08.306708 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:08.313514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252fd7e-9e1a-498e-9608-5b473f019fbf admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:08.327424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16496b3a-364b-40a4-8d8e-89f64090daf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:08.328047 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16496b3a-364b-40a4-8d8e-89f64090daf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:08.328327 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16496b3a-364b-40a4-8d8e-89f64090daf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:08.328597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16496b3a-364b-40a4-8d8e-89f64090daf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:08.329251 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16496b3a-364b-40a4-8d8e-89f64090daf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:08.333579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16496b3a-364b-40a4-8d8e-89f64090daf4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:08.381704 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1116/2216] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:01:08.391870 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14a787-f000-4960-81ff-1a073da9e7e7 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:08.392342 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16496b3a-364b-40a4-8d8e-89f64090daf4 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:08.426172 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16496b3a-364b-40a4-8d8e-89f64090daf4 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:08.449210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d016707-a058-4c17-aca0-2ffb5c3085d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:08.449933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d016707-a058-4c17-aca0-2ffb5c3085d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:08.450222 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d016707-a058-4c17-aca0-2ffb5c3085d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:08.450499 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d016707-a058-4c17-aca0-2ffb5c3085d8 admin admin] PATH_INFO: `/v3/projects/13f9ce4520b94fb28f73ecfb55dcf646/users/485ed575604440a880171a0bbc87616d/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:08.500019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d016707-a058-4c17-aca0-2ffb5c3085d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13f9ce4520b94fb28f73ecfb55dcf646, user_id=485ed575604440a880171a0bbc87616d, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:08.508141 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d016707-a058-4c17-aca0-2ffb5c3085d8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:08.528104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14a787-f000-4960-81ff-1a073da9e7e7 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:08.543929 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1117/2217] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:01:08 2022] PUT /identity/v3/projects/13f9ce4520b94fb28f73ecfb55dcf646/users/485ed575604440a880171a0bbc87616d/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:08.544883 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d016707-a058-4c17-aca0-2ffb5c3085d8 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:08.664152 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878ace2-01ce-48ee-8596-0c8bbb58f315 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07f15fe172e451a9a27822c68e134d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6759aedc7b7d4f6891d4db9d1368f2b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:08.667814 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878ace2-01ce-48ee-8596-0c8bbb58f315 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:08.668156 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878ace2-01ce-48ee-8596-0c8bbb58f315 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:08.668445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878ace2-01ce-48ee-8596-0c8bbb58f315 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] PATH_INFO: `/v3/projects/9fdc82f43f074f9897c024a3cd212219` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:08.668581 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d016707-a058-4c17-aca0-2ffb5c3085d8 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:08.671385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3878ace2-01ce-48ee-8596-0c8bbb58f315 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] RBAC: Authorizing `identity:get_project(project_id=9fdc82f43f074f9897c024a3cd212219)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:08.681524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77731bd9-00bc-4cc5-93cd-6c99655bf682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:08.682024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3878ace2-01ce-48ee-8596-0c8bbb58f315 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:08.682313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77731bd9-00bc-4cc5-93cd-6c99655bf682 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:08.683221 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77731bd9-00bc-4cc5-93cd-6c99655bf682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:08.683514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77731bd9-00bc-4cc5-93cd-6c99655bf682 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:08.684176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77731bd9-00bc-4cc5-93cd-6c99655bf682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:08.685841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77731bd9-00bc-4cc5-93cd-6c99655bf682 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:08.704172 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1101/2218] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:01:08 2022] GET /identity/v3/projects/9fdc82f43f074f9897c024a3cd212219 => generated 393 bytes in 590 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:01:08.720856 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878ace2-01ce-48ee-8596-0c8bbb58f315 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:08.721543 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1118/2219] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:01:08.764222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878ace2-01ce-48ee-8596-0c8bbb58f315 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:08.786312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66cc30-4bf8-4310-9bdf-1cc535e89f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:08.788648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66cc30-4bf8-4310-9bdf-1cc535e89f6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:08.788934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66cc30-4bf8-4310-9bdf-1cc535e89f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:08.789211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66cc30-4bf8-4310-9bdf-1cc535e89f6a admin admin] PATH_INFO: `/v3/projects/13f9ce4520b94fb28f73ecfb55dcf646/users/485ed575604440a880171a0bbc87616d/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:08.800986 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66cc30-4bf8-4310-9bdf-1cc535e89f6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=13f9ce4520b94fb28f73ecfb55dcf646, user_id=485ed575604440a880171a0bbc87616d, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:08.806479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66cc30-4bf8-4310-9bdf-1cc535e89f6a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:08.843016 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1102/2220] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:01:08 2022] PUT /identity/v3/projects/13f9ce4520b94fb28f73ecfb55dcf646/users/485ed575604440a880171a0bbc87616d/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:01:09.512564 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48980a8-8ac6-48b3-8a62-aa728b3ba215 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:09.513521 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48980a8-8ac6-48b3-8a62-aa728b3ba215 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:09.514026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48980a8-8ac6-48b3-8a62-aa728b3ba215 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:09.516561 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1119/2221] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:01:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:01:09.525952 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66cc30-4bf8-4310-9bdf-1cc535e89f6a admin admin] Authenticating service token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:01:09.706850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66cc30-4bf8-4310-9bdf-1cc535e89f6a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:09.758157 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:09.914411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66cc30-4bf8-4310-9bdf-1cc535e89f6a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:09.935799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c694b-8b40-45d4-8630-b21fbfb64326 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07f15fe172e451a9a27822c68e134d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6759aedc7b7d4f6891d4db9d1368f2b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:09.939263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c694b-8b40-45d4-8630-b21fbfb64326 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:09.939263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c694b-8b40-45d4-8630-b21fbfb64326 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:09.939263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c694b-8b40-45d4-8630-b21fbfb64326 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] PATH_INFO: `/v3/projects/9fdc82f43f074f9897c024a3cd212219` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:09.939263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c694b-8b40-45d4-8630-b21fbfb64326 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] RBAC: Authorizing `identity:get_project(project_id=9fdc82f43f074f9897c024a3cd212219)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:09.940317 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c694b-8b40-45d4-8630-b21fbfb64326 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:09.942128 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1103/2222] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:01:09 2022] GET /identity/v3/projects/9fdc82f43f074f9897c024a3cd212219 => generated 393 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:01:11.295044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ed544-6d75-4bf4-95af-406345ab9203 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:11.295672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ed544-6d75-4bf4-95af-406345ab9203 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:11.295672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ed544-6d75-4bf4-95af-406345ab9203 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:11.297400 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1120/2223] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:01:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:01:11.310338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c694b-8b40-45d4-8630-b21fbfb64326 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] Authenticating service token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:01:11.333249 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c694b-8b40-45d4-8630-b21fbfb64326 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:11.360208 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c694b-8b40-45d4-8630-b21fbfb64326 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:11.386274 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e5dd0-874e-4b04-ae5d-c23ea5c7c842 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07f15fe172e451a9a27822c68e134d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6759aedc7b7d4f6891d4db9d1368f2b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:11.386940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e5dd0-874e-4b04-ae5d-c23ea5c7c842 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:11.387225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e5dd0-874e-4b04-ae5d-c23ea5c7c842 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:11.387502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e5dd0-874e-4b04-ae5d-c23ea5c7c842 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] PATH_INFO: `/v3/projects/9fdc82f43f074f9897c024a3cd212219` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:11.393997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e5dd0-874e-4b04-ae5d-c23ea5c7c842 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] RBAC: Authorizing `identity:get_project(project_id=9fdc82f43f074f9897c024a3cd212219)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:11.396400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e5dd0-874e-4b04-ae5d-c23ea5c7c842 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:11.398299 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1104/2224] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:01:11 2022] GET /identity/v3/projects/9fdc82f43f074f9897c024a3cd212219 => generated 393 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:01:12.448652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61130233-a8b1-4828-a1f0-581650deb30e None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:12.449173 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61130233-a8b1-4828-a1f0-581650deb30e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:12.449173 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61130233-a8b1-4828-a1f0-581650deb30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:12.460380 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:12.568031 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-61130233-a8b1-4828-a1f0-581650deb30e None None] MFA Rules not processed for user `545e0ebcbe314ee1a8419e3583e74d23`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:12.569781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-61130233-a8b1-4828-a1f0-581650deb30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:12.768062 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1121/2225] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:12.778913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e856db-1fc0-4910-8e81-dcb591dc720f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:12.779763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e856db-1fc0-4910-8e81-dcb591dc720f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:12.780211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e856db-1fc0-4910-8e81-dcb591dc720f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:12.815892 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-16e856db-1fc0-4910-8e81-dcb591dc720f None None] MFA Rules not processed for user `545e0ebcbe314ee1a8419e3583e74d23`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:12.817355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-16e856db-1fc0-4910-8e81-dcb591dc720f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:12.834082 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1105/2226] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:13.377108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61130233-a8b1-4828-a1f0-581650deb30e None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:13.392708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61130233-a8b1-4828-a1f0-581650deb30e None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:13.405041 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da3fe1-7b11-4e8e-b845-d1e45b515071 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:13.406043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da3fe1-7b11-4e8e-b845-d1e45b515071 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:13.406532 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da3fe1-7b11-4e8e-b845-d1e45b515071 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:13.407149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da3fe1-7b11-4e8e-b845-d1e45b515071 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:13.418707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13da3fe1-7b11-4e8e-b845-d1e45b515071 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:13.422431 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13da3fe1-7b11-4e8e-b845-d1e45b515071 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:13.460295 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1122/2227] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:01:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:01:16.048116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e856db-1fc0-4910-8e81-dcb591dc720f None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:16.071106 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e856db-1fc0-4910-8e81-dcb591dc720f None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:16.077321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aab6c8-90a3-437f-bd31-e870fc468f71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:16.078226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aab6c8-90a3-437f-bd31-e870fc468f71 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:16.078650 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aab6c8-90a3-437f-bd31-e870fc468f71 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:16.079604 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aab6c8-90a3-437f-bd31-e870fc468f71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:16.158403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aab6c8-90a3-437f-bd31-e870fc468f71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:16.160672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aab6c8-90a3-437f-bd31-e870fc468f71 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:16.198581 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1106/2228] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:01:16 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:01:19.019469 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b036e3-7187-4db2-8ff7-e704ee7e9466 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:19.020050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b036e3-7187-4db2-8ff7-e704ee7e9466 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:19.020050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b036e3-7187-4db2-8ff7-e704ee7e9466 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:19.021552 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1123/2229] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:01:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:01:19.040105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aab6c8-90a3-437f-bd31-e870fc468f71 service nova] Authenticating service token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:01:19.055381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aab6c8-90a3-437f-bd31-e870fc468f71 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:19.078976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aab6c8-90a3-437f-bd31-e870fc468f71 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:19.090760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c08e3-a956-459a-a108-b95fc76c0ad6 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07f15fe172e451a9a27822c68e134d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6759aedc7b7d4f6891d4db9d1368f2b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:19.092528 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c08e3-a956-459a-a108-b95fc76c0ad6 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:19.092980 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c08e3-a956-459a-a108-b95fc76c0ad6 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:19.094700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c08e3-a956-459a-a108-b95fc76c0ad6 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] PATH_INFO: `/v3/projects/9fdc82f43f074f9897c024a3cd212219` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:19.096199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c08e3-a956-459a-a108-b95fc76c0ad6 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] RBAC: Authorizing `identity:get_project(project_id=9fdc82f43f074f9897c024a3cd212219)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:19.099199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c08e3-a956-459a-a108-b95fc76c0ad6 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:19.108040 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1107/2230] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:01:19 2022] GET /identity/v3/projects/9fdc82f43f074f9897c024a3cd212219 => generated 393 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:01:19.263683 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f26c87-aabc-423e-a544-c4876ce52c26 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:19.263987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f26c87-aabc-423e-a544-c4876ce52c26 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:19.264283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f26c87-aabc-423e-a544-c4876ce52c26 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:19.266367 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1124/2231] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:01:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:01:19.287480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c08e3-a956-459a-a108-b95fc76c0ad6 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] Authenticating service token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:01:19.292434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b1138-e8a9-4338-baae-7e2a715fae21 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:19.292713 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b1138-e8a9-4338-baae-7e2a715fae21 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:19.292985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b1138-e8a9-4338-baae-7e2a715fae21 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:19.294332 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1125/2232] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 04 01:01:19.300746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c879fee-e1b2-47ea-9e35-c08a071c80e3 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:19.301260 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c879fee-e1b2-47ea-9e35-c08a071c80e3 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:19.301730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c879fee-e1b2-47ea-9e35-c08a071c80e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:19.322333 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c08e3-a956-459a-a108-b95fc76c0ad6 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:19.354405 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c08e3-a956-459a-a108-b95fc76c0ad6 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:19.357083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-9c879fee-e1b2-47ea-9e35-c08a071c80e3 None None] MFA Rules not processed for user `2cdde7a212954a01a2591ad5ac30d049`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:19.358869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9c879fee-e1b2-47ea-9e35-c08a071c80e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:19.367304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a567cb-b277-4993-acaf-0843ca6fb7c7 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07f15fe172e451a9a27822c68e134d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6759aedc7b7d4f6891d4db9d1368f2b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:19.369989 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a567cb-b277-4993-acaf-0843ca6fb7c7 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:19.370567 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a567cb-b277-4993-acaf-0843ca6fb7c7 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:19.372037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a567cb-b277-4993-acaf-0843ca6fb7c7 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] PATH_INFO: `/v3/projects/9fdc82f43f074f9897c024a3cd212219` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:19.375703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a567cb-b277-4993-acaf-0843ca6fb7c7 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] RBAC: Authorizing `identity:get_project(project_id=9fdc82f43f074f9897c024a3cd212219)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:19.385190 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a567cb-b277-4993-acaf-0843ca6fb7c7 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:19.394060 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1108/2233] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:01:19 2022] GET /identity/v3/projects/9fdc82f43f074f9897c024a3cd212219 => generated 393 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:01:19.479257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a567cb-b277-4993-acaf-0843ca6fb7c7 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:19.481056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-17a567cb-b277-4993-acaf-0843ca6fb7c7 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:19.489753 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1126/2234] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:01:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:19.499850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a567cb-b277-4993-acaf-0843ca6fb7c7 tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:19.505832 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147720cd-5cd8-463a-8de8-45cac6616834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:19.506726 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147720cd-5cd8-463a-8de8-45cac6616834 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:19.507198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147720cd-5cd8-463a-8de8-45cac6616834 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:19.507626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147720cd-5cd8-463a-8de8-45cac6616834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:19.540590 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147720cd-5cd8-463a-8de8-45cac6616834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:19.542380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147720cd-5cd8-463a-8de8-45cac6616834 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:19.586557 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1109/2235] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:01:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:01:20.766933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8085006-4642-4269-b6ff-b3af05ec1f01 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:20.767438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8085006-4642-4269-b6ff-b3af05ec1f01 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:20.767438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8085006-4642-4269-b6ff-b3af05ec1f01 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:20.768763 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1127/2236] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:01:20.773821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147720cd-5cd8-463a-8de8-45cac6616834 service neutron] Authenticating service token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:01:20.790873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147720cd-5cd8-463a-8de8-45cac6616834 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:20.803586 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147720cd-5cd8-463a-8de8-45cac6616834 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:20.812161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5824c6a-a6e6-4495-85ff-dda9cefea30d tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07f15fe172e451a9a27822c68e134d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6759aedc7b7d4f6891d4db9d1368f2b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:20.812815 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5824c6a-a6e6-4495-85ff-dda9cefea30d tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:20.813105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5824c6a-a6e6-4495-85ff-dda9cefea30d tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:20.813385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5824c6a-a6e6-4495-85ff-dda9cefea30d tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] PATH_INFO: `/v3/projects/fdc4cb52c3e548d98d7b4c29aaf08252` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:20.814625 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5824c6a-a6e6-4495-85ff-dda9cefea30d tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] RBAC: Authorizing `identity:get_project(project_id=fdc4cb52c3e548d98d7b4c29aaf08252)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:20.817110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5824c6a-a6e6-4495-85ff-dda9cefea30d tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:20.821646 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1110/2237] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:01:20 2022] GET /identity/v3/projects/fdc4cb52c3e548d98d7b4c29aaf08252 => generated 391 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:01:20.883442 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8085006-4642-4269-b6ff-b3af05ec1f01 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:20.884967 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c8085006-4642-4269-b6ff-b3af05ec1f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:20.989259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5824c6a-a6e6-4495-85ff-dda9cefea30d tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:21.030876 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8085006-4642-4269-b6ff-b3af05ec1f01 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:21.036806 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7013d47-061a-456e-a99e-acbe39175e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:21.037998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7013d47-061a-456e-a99e-acbe39175e15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:21.039542 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7013d47-061a-456e-a99e-acbe39175e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:21.039885 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7013d47-061a-456e-a99e-acbe39175e15 admin admin] PATH_INFO: `/v3/users/05f54677df04452fb4d1c76cdf9febaf` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:21.041592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7013d47-061a-456e-a99e-acbe39175e15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05f54677df04452fb4d1c76cdf9febaf)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:21.043629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7013d47-061a-456e-a99e-acbe39175e15 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:21.126385 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:21.126621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5824c6a-a6e6-4495-85ff-dda9cefea30d tempest-FlavorsAccessNegativeTestJSON-1407105090 tempest-FlavorsAccessNegativeTestJSON-1407105090-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:21.133673 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e7fde-3895-4023-8527-fb061d290ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:21.134684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e7fde-3895-4023-8527-fb061d290ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:21.135482 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e7fde-3895-4023-8527-fb061d290ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:21.136104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e7fde-3895-4023-8527-fb061d290ce1 admin admin] PATH_INFO: `/v3/users/6392b6cd927e4474a5a2b1e19a6a2c57` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:21.148302 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e7fde-3895-4023-8527-fb061d290ce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6392b6cd927e4474a5a2b1e19a6a2c57)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:21.152472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e7fde-3895-4023-8527-fb061d290ce1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:21.157408 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:21.178850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d7013d47-061a-456e-a99e-acbe39175e15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05f54677df04452fb4d1c76cdf9febaf'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:21.179898 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d7013d47-061a-456e-a99e-acbe39175e15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05f54677df04452fb4d1c76cdf9febaf'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:21.199503 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d7013d47-061a-456e-a99e-acbe39175e15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05f54677df04452fb4d1c76cdf9febaf'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:21.219142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d7013d47-061a-456e-a99e-acbe39175e15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05f54677df04452fb4d1c76cdf9febaf'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:21.220235 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d7013d47-061a-456e-a99e-acbe39175e15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05f54677df04452fb4d1c76cdf9febaf'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:21.257047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d72e7fde-3895-4023-8527-fb061d290ce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6392b6cd927e4474a5a2b1e19a6a2c57'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:21.258245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d72e7fde-3895-4023-8527-fb061d290ce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6392b6cd927e4474a5a2b1e19a6a2c57'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:21.274801 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1128/2238] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:01:20 2022] DELETE /identity/v3/users/05f54677df04452fb4d1c76cdf9febaf => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:21.276483 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49efaa-0fbb-45cf-bc03-b6693670972d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:21.277385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d72e7fde-3895-4023-8527-fb061d290ce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6392b6cd927e4474a5a2b1e19a6a2c57'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:21.277844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49efaa-0fbb-45cf-bc03-b6693670972d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:21.285591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49efaa-0fbb-45cf-bc03-b6693670972d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:21.296603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d72e7fde-3895-4023-8527-fb061d290ce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6392b6cd927e4474a5a2b1e19a6a2c57'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:21.298143 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d72e7fde-3895-4023-8527-fb061d290ce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6392b6cd927e4474a5a2b1e19a6a2c57'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:21.317107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-db49efaa-0fbb-45cf-bc03-b6693670972d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:21.320718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-db49efaa-0fbb-45cf-bc03-b6693670972d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:21.344502 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1111/2239] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:01:20 2022] DELETE /identity/v3/users/6392b6cd927e4474a5a2b1e19a6a2c57 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:21.351338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41599b77-455e-4fc4-9241-b2646a179bf6 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:21.351702 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41599b77-455e-4fc4-9241-b2646a179bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:21.352724 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41599b77-455e-4fc4-9241-b2646a179bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:21.374956 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-41599b77-455e-4fc4-9241-b2646a179bf6 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:21.376560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-41599b77-455e-4fc4-9241-b2646a179bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:21.478062 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1112/2240] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:21.478252 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1129/2241] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:21.487725 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41599b77-455e-4fc4-9241-b2646a179bf6 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:21.490535 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-41599b77-455e-4fc4-9241-b2646a179bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:21.494811 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49efaa-0fbb-45cf-bc03-b6693670972d None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:21.496423 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-db49efaa-0fbb-45cf-bc03-b6693670972d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:21.590060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49efaa-0fbb-45cf-bc03-b6693670972d None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:21.603455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41599b77-455e-4fc4-9241-b2646a179bf6 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:21.614739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec78f4-045f-45ae-b6d0-72abd4e97005 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:21.615377 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec78f4-045f-45ae-b6d0-72abd4e97005 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:21.615665 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec78f4-045f-45ae-b6d0-72abd4e97005 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:21.616027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec78f4-045f-45ae-b6d0-72abd4e97005 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:21.630041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec78f4-045f-45ae-b6d0-72abd4e97005 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:21.632012 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec78f4-045f-45ae-b6d0-72abd4e97005 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:21.642431 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1113/2242] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:01:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:01:21.658640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c7402-28c7-4020-8bc5-142f4cea7f7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:21.659299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c7402-28c7-4020-8bc5-142f4cea7f7f service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:21.659583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c7402-28c7-4020-8bc5-142f4cea7f7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:21.659916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c7402-28c7-4020-8bc5-142f4cea7f7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:21.679665 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e26ff-53b3-41eb-bc45-45e2be7f7352 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:21.679977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e26ff-53b3-41eb-bc45-45e2be7f7352 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:21.680227 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e26ff-53b3-41eb-bc45-45e2be7f7352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:21.681600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c7402-28c7-4020-8bc5-142f4cea7f7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:21.683410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c7402-28c7-4020-8bc5-142f4cea7f7f service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:21.728123 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1130/2243] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:01:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:01:21.775716 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-385e26ff-53b3-41eb-bc45-45e2be7f7352 None None] MFA Rules not processed for user `485ed575604440a880171a0bbc87616d`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:21.778218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-385e26ff-53b3-41eb-bc45-45e2be7f7352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:21.812543 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:21.932412 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1114/2244] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:21 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:01:22.195072 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c7402-28c7-4020-8bc5-142f4cea7f7f service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:22.197700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a10c7402-28c7-4020-8bc5-142f4cea7f7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:22.214208 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:22.350024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c7402-28c7-4020-8bc5-142f4cea7f7f service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:22.357657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017399b-2f41-4c58-b114-6b2f7496da0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:22.358310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017399b-2f41-4c58-b114-6b2f7496da0f service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:22.358585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017399b-2f41-4c58-b114-6b2f7496da0f service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:22.358855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017399b-2f41-4c58-b114-6b2f7496da0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:22.363489 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e017399b-2f41-4c58-b114-6b2f7496da0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:22.489320 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e017399b-2f41-4c58-b114-6b2f7496da0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:22.506413 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e017399b-2f41-4c58-b114-6b2f7496da0f service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:22.516390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e26ff-53b3-41eb-bc45-45e2be7f7352 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:22.518686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-385e26ff-53b3-41eb-bc45-45e2be7f7352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:22.549699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e26ff-53b3-41eb-bc45-45e2be7f7352 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:22.568528 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1131/2245] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:01:22 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:01:22.573996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d7c59-6281-46be-a817-9b0019b12d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:22.574666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d7c59-6281-46be-a817-9b0019b12d85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:22.574950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d7c59-6281-46be-a817-9b0019b12d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:22.575223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d7c59-6281-46be-a817-9b0019b12d85 admin admin] PATH_INFO: `/v3/projects/318b4f17029a4240bffcd94d5103cf56` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:22.578131 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d7c59-6281-46be-a817-9b0019b12d85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=318b4f17029a4240bffcd94d5103cf56)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:22.582481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d7c59-6281-46be-a817-9b0019b12d85 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:22.658753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cf2d7c59-6281-46be-a817-9b0019b12d85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '318b4f17029a4240bffcd94d5103cf56', 'request_id': 'req-cf2d7c59-6281-46be-a817-9b0019b12d85'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:22.673131 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cf2d7c59-6281-46be-a817-9b0019b12d85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '318b4f17029a4240bffcd94d5103cf56', 'request_id': 'req-cf2d7c59-6281-46be-a817-9b0019b12d85'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:22.684470 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cf2d7c59-6281-46be-a817-9b0019b12d85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '318b4f17029a4240bffcd94d5103cf56', 'request_id': 'req-cf2d7c59-6281-46be-a817-9b0019b12d85'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:22.705172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cf2d7c59-6281-46be-a817-9b0019b12d85 admin admin] The token cache is being invalidate because project 318b4f17029a4240bffcd94d5103cf56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:01:22.706320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cf2d7c59-6281-46be-a817-9b0019b12d85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:22.707277 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cf2d7c59-6281-46be-a817-9b0019b12d85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:22.709480 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1115/2246] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:01:22 2022] DELETE /identity/v3/projects/318b4f17029a4240bffcd94d5103cf56 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:22.713082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017399b-2f41-4c58-b114-6b2f7496da0f service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:22.729722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017399b-2f41-4c58-b114-6b2f7496da0f service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:22.799681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d7c59-6281-46be-a817-9b0019b12d85 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:22.805907 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-cf2d7c59-6281-46be-a817-9b0019b12d85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:22.844485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b49e76-98d5-45de-ac39-f2372f152799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:22.847779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b49e76-98d5-45de-ac39-f2372f152799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:22.848311 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b49e76-98d5-45de-ac39-f2372f152799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:22.849379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b49e76-98d5-45de-ac39-f2372f152799 admin admin] PATH_INFO: `/v3/users/fdf930a72819412a86da9fb0078dc343` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:22.853086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b49e76-98d5-45de-ac39-f2372f152799 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdf930a72819412a86da9fb0078dc343)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:22.856107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b49e76-98d5-45de-ac39-f2372f152799 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:22.945793 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:22.952160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-34b49e76-98d5-45de-ac39-f2372f152799 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdf930a72819412a86da9fb0078dc343'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:22.953460 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-34b49e76-98d5-45de-ac39-f2372f152799 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdf930a72819412a86da9fb0078dc343'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:22.964632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d7c59-6281-46be-a817-9b0019b12d85 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:22.970234 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f63581-0d85-40db-97f3-e2dd66af2281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:22.970936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f63581-0d85-40db-97f3-e2dd66af2281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:22.971052 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-34b49e76-98d5-45de-ac39-f2372f152799 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdf930a72819412a86da9fb0078dc343'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:22.971276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f63581-0d85-40db-97f3-e2dd66af2281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:22.971708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f63581-0d85-40db-97f3-e2dd66af2281 admin admin] PATH_INFO: `/v3/projects/9fdc82f43f074f9897c024a3cd212219` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:22.973037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f63581-0d85-40db-97f3-e2dd66af2281 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fdc82f43f074f9897c024a3cd212219)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:22.975317 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f63581-0d85-40db-97f3-e2dd66af2281 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:22.987971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-34b49e76-98d5-45de-ac39-f2372f152799 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdf930a72819412a86da9fb0078dc343'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:22.988780 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-34b49e76-98d5-45de-ac39-f2372f152799 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdf930a72819412a86da9fb0078dc343'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:23.013230 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1132/2247] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:01:22 2022] DELETE /identity/v3/users/fdf930a72819412a86da9fb0078dc343 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:01:23.014781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b49e76-98d5-45de-ac39-f2372f152799 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:23.023978 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-34b49e76-98d5-45de-ac39-f2372f152799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:23.037109 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:23.061028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-97f63581-0d85-40db-97f3-e2dd66af2281 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fdc82f43f074f9897c024a3cd212219', 'request_id': 'req-97f63581-0d85-40db-97f3-e2dd66af2281'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:23.077964 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-97f63581-0d85-40db-97f3-e2dd66af2281 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fdc82f43f074f9897c024a3cd212219', 'request_id': 'req-97f63581-0d85-40db-97f3-e2dd66af2281'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:23.086358 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-97f63581-0d85-40db-97f3-e2dd66af2281 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fdc82f43f074f9897c024a3cd212219', 'request_id': 'req-97f63581-0d85-40db-97f3-e2dd66af2281'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:23.111354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-97f63581-0d85-40db-97f3-e2dd66af2281 admin admin] The token cache is being invalidate because project 9fdc82f43f074f9897c024a3cd212219 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:01:23.111689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-97f63581-0d85-40db-97f3-e2dd66af2281 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:23.114129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-97f63581-0d85-40db-97f3-e2dd66af2281 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:23.118333 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1116/2248] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:01:22 2022] DELETE /identity/v3/projects/9fdc82f43f074f9897c024a3cd212219 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:23.122453 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f63581-0d85-40db-97f3-e2dd66af2281 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:23.124968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-97f63581-0d85-40db-97f3-e2dd66af2281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:23.183078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b49e76-98d5-45de-ac39-f2372f152799 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:23.283421 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f63581-0d85-40db-97f3-e2dd66af2281 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:23.302245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3a433-a6ad-45b1-94b8-a366e38717d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:23.304398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3a433-a6ad-45b1-94b8-a366e38717d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:23.304965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3a433-a6ad-45b1-94b8-a366e38717d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:23.305515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3a433-a6ad-45b1-94b8-a366e38717d7 admin admin] PATH_INFO: `/v3/users/f07f15fe172e451a9a27822c68e134d8` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:23.307235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3a433-a6ad-45b1-94b8-a366e38717d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f07f15fe172e451a9a27822c68e134d8)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:23.310635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3a433-a6ad-45b1-94b8-a366e38717d7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:23.311867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095372fd-a3e2-43a2-884b-eee8862d2aef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:23.312504 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095372fd-a3e2-43a2-884b-eee8862d2aef service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:23.312786 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095372fd-a3e2-43a2-884b-eee8862d2aef service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:23.313066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095372fd-a3e2-43a2-884b-eee8862d2aef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:23.316428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-095372fd-a3e2-43a2-884b-eee8862d2aef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:23.407548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b1e3a433-a6ad-45b1-94b8-a366e38717d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f07f15fe172e451a9a27822c68e134d8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:23.410308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b1e3a433-a6ad-45b1-94b8-a366e38717d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f07f15fe172e451a9a27822c68e134d8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:23.423196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b1e3a433-a6ad-45b1-94b8-a366e38717d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f07f15fe172e451a9a27822c68e134d8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:23.447683 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:23.456783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095372fd-a3e2-43a2-884b-eee8862d2aef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:23.459407 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095372fd-a3e2-43a2-884b-eee8862d2aef service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:23.463422 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b1e3a433-a6ad-45b1-94b8-a366e38717d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f07f15fe172e451a9a27822c68e134d8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:23.464627 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b1e3a433-a6ad-45b1-94b8-a366e38717d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f07f15fe172e451a9a27822c68e134d8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:23.496383 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1133/2249] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:01:23 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:01:23.551863 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1117/2250] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:01:23 2022] DELETE /identity/v3/users/f07f15fe172e451a9a27822c68e134d8 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:23.726676 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095372fd-a3e2-43a2-884b-eee8862d2aef service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:23.728581 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-095372fd-a3e2-43a2-884b-eee8862d2aef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:23.753677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095372fd-a3e2-43a2-884b-eee8862d2aef service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:23.773160 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3a433-a6ad-45b1-94b8-a366e38717d7 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:23.775392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b1e3a433-a6ad-45b1-94b8-a366e38717d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:23.820916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd339e64-78f9-45a7-bd53-9eb588897387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:23.821698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd339e64-78f9-45a7-bd53-9eb588897387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:23.821985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd339e64-78f9-45a7-bd53-9eb588897387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:23.822516 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd339e64-78f9-45a7-bd53-9eb588897387 admin admin] PATH_INFO: `/v3/projects/88b355d418ba425d84496d4ef1d5b328` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:23.823797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd339e64-78f9-45a7-bd53-9eb588897387 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88b355d418ba425d84496d4ef1d5b328)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:23.826130 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd339e64-78f9-45a7-bd53-9eb588897387 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:23.870910 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:23.918562 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3a433-a6ad-45b1-94b8-a366e38717d7 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:23.930230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dd339e64-78f9-45a7-bd53-9eb588897387 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88b355d418ba425d84496d4ef1d5b328', 'request_id': 'req-dd339e64-78f9-45a7-bd53-9eb588897387'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:23.943870 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dd339e64-78f9-45a7-bd53-9eb588897387 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88b355d418ba425d84496d4ef1d5b328', 'request_id': 'req-dd339e64-78f9-45a7-bd53-9eb588897387'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:23.988517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dd339e64-78f9-45a7-bd53-9eb588897387 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88b355d418ba425d84496d4ef1d5b328', 'request_id': 'req-dd339e64-78f9-45a7-bd53-9eb588897387'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:24.006903 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dd339e64-78f9-45a7-bd53-9eb588897387 admin admin] The token cache is being invalidate because project 88b355d418ba425d84496d4ef1d5b328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:01:24.007504 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dd339e64-78f9-45a7-bd53-9eb588897387 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:24.008567 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dd339e64-78f9-45a7-bd53-9eb588897387 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:24.010721 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1134/2251] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:01:23 2022] DELETE /identity/v3/projects/88b355d418ba425d84496d4ef1d5b328 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:01:24.017313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec009ab8-35e8-454e-a00d-7257e61114f6 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:24.017879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec009ab8-35e8-454e-a00d-7257e61114f6 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:24.019122 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec009ab8-35e8-454e-a00d-7257e61114f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:24.093185 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ec009ab8-35e8-454e-a00d-7257e61114f6 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:24.097382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ec009ab8-35e8-454e-a00d-7257e61114f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:24.113135 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ad7a9-cce6-4fa1-a21b-2380647f2d5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:24.114327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ad7a9-cce6-4fa1-a21b-2380647f2d5c service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:24.115089 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ad7a9-cce6-4fa1-a21b-2380647f2d5c service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:24.115578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ad7a9-cce6-4fa1-a21b-2380647f2d5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:24.132263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-052ad7a9-cce6-4fa1-a21b-2380647f2d5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:24.269407 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1135/2252] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:24.271580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec009ab8-35e8-454e-a00d-7257e61114f6 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:24.275746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ec009ab8-35e8-454e-a00d-7257e61114f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:24.314189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec009ab8-35e8-454e-a00d-7257e61114f6 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:24.315603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ad7a9-cce6-4fa1-a21b-2380647f2d5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:24.317831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ad7a9-cce6-4fa1-a21b-2380647f2d5c service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:24.321493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd90650-14e4-4364-ae28-6e27631dd749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:24.322689 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd90650-14e4-4364-ae28-6e27631dd749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:24.323169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd90650-14e4-4364-ae28-6e27631dd749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:24.323638 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd90650-14e4-4364-ae28-6e27631dd749 admin admin] PATH_INFO: `/v3/projects/6759aedc7b7d4f6891d4db9d1368f2b3` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:24.324980 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd90650-14e4-4364-ae28-6e27631dd749 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6759aedc7b7d4f6891d4db9d1368f2b3)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:24.327700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd90650-14e4-4364-ae28-6e27631dd749 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:24.344377 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1118/2253] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:01:23 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:01:24.345913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b0817-25ea-4a79-b84b-e0773b08af61 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:24.346875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b0817-25ea-4a79-b84b-e0773b08af61 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:24.347869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b0817-25ea-4a79-b84b-e0773b08af61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:24.356739 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:24.400596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4dd90650-14e4-4364-ae28-6e27631dd749 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6759aedc7b7d4f6891d4db9d1368f2b3', 'request_id': 'req-4dd90650-14e4-4364-ae28-6e27631dd749'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:24.409585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-068b0817-25ea-4a79-b84b-e0773b08af61 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:24.414592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-068b0817-25ea-4a79-b84b-e0773b08af61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:24.415617 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4dd90650-14e4-4364-ae28-6e27631dd749 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6759aedc7b7d4f6891d4db9d1368f2b3', 'request_id': 'req-4dd90650-14e4-4364-ae28-6e27631dd749'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:24.426170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4dd90650-14e4-4364-ae28-6e27631dd749 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6759aedc7b7d4f6891d4db9d1368f2b3', 'request_id': 'req-4dd90650-14e4-4364-ae28-6e27631dd749'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:24.461911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4dd90650-14e4-4364-ae28-6e27631dd749 admin admin] The token cache is being invalidate because project 6759aedc7b7d4f6891d4db9d1368f2b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:01:24.462207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4dd90650-14e4-4364-ae28-6e27631dd749 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:24.463062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4dd90650-14e4-4364-ae28-6e27631dd749 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:24.468215 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1136/2254] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:01:24 2022] DELETE /identity/v3/projects/6759aedc7b7d4f6891d4db9d1368f2b3 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:24.469675 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d844de-4fbf-4d30-a8b6-26f3a92d3ca4 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:24.470025 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d844de-4fbf-4d30-a8b6-26f3a92d3ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:24.470236 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d844de-4fbf-4d30-a8b6-26f3a92d3ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:24.501744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-50d844de-4fbf-4d30-a8b6-26f3a92d3ca4 None None] MFA Rules not processed for user `6e0026a1a659485f98e1f7e780caa9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:24.506576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-50d844de-4fbf-4d30-a8b6-26f3a92d3ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:24.624100 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1137/2255] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:24.625296 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d844de-4fbf-4d30-a8b6-26f3a92d3ca4 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:24.626687 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-50d844de-4fbf-4d30-a8b6-26f3a92d3ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:24.637731 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1119/2256] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:24.638527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b0817-25ea-4a79-b84b-e0773b08af61 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:24.648279 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d844de-4fbf-4d30-a8b6-26f3a92d3ca4 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:24.657403 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e85975-269b-4507-ac4b-450df7a9d3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:24.659031 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e85975-269b-4507-ac4b-450df7a9d3b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:24.659829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e85975-269b-4507-ac4b-450df7a9d3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:24.660455 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e85975-269b-4507-ac4b-450df7a9d3b1 admin admin] PATH_INFO: `/v3/users/f567e424923d439c8770ba9882f0ed61` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:24.661209 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b0817-25ea-4a79-b84b-e0773b08af61 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:24.661949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e85975-269b-4507-ac4b-450df7a9d3b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f567e424923d439c8770ba9882f0ed61)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:24.666215 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e85975-269b-4507-ac4b-450df7a9d3b1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:24.688837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162d647-6cb2-4ee3-bd0f-524828bdfccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:24.689787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162d647-6cb2-4ee3-bd0f-524828bdfccd admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:24.690814 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162d647-6cb2-4ee3-bd0f-524828bdfccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:24.692178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162d647-6cb2-4ee3-bd0f-524828bdfccd admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:24.693051 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162d647-6cb2-4ee3-bd0f-524828bdfccd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:01:24.695811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162d647-6cb2-4ee3-bd0f-524828bdfccd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:24.700962 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162d647-6cb2-4ee3-bd0f-524828bdfccd admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:24.721492 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:24.733783 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1120/2257] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:01:24.735963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162d647-6cb2-4ee3-bd0f-524828bdfccd admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:24.757196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162d647-6cb2-4ee3-bd0f-524828bdfccd admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:24.767642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913818c-fb4a-486c-9219-4d292d6f41de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:24.770512 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913818c-fb4a-486c-9219-4d292d6f41de admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:24.771449 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913818c-fb4a-486c-9219-4d292d6f41de admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:24.771825 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913818c-fb4a-486c-9219-4d292d6f41de admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:24.772644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913818c-fb4a-486c-9219-4d292d6f41de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:24.774856 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913818c-fb4a-486c-9219-4d292d6f41de admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:24.783697 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-42e85975-269b-4507-ac4b-450df7a9d3b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f567e424923d439c8770ba9882f0ed61'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:24.785946 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-42e85975-269b-4507-ac4b-450df7a9d3b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f567e424923d439c8770ba9882f0ed61'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:24.806794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-42e85975-269b-4507-ac4b-450df7a9d3b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f567e424923d439c8770ba9882f0ed61'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:24.839828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-42e85975-269b-4507-ac4b-450df7a9d3b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f567e424923d439c8770ba9882f0ed61'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:24.841625 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-42e85975-269b-4507-ac4b-450df7a9d3b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f567e424923d439c8770ba9882f0ed61'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:24.843694 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1121/2258] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:01:24 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:01:24.849200 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913818c-fb4a-486c-9219-4d292d6f41de admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:24.853698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9913818c-fb4a-486c-9219-4d292d6f41de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:24.905273 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1138/2259] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:01:24 2022] DELETE /identity/v3/users/f567e424923d439c8770ba9882f0ed61 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:24.973426 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913818c-fb4a-486c-9219-4d292d6f41de admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:25.085527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342644cd-120a-4163-996a-bcfabea1b47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:25.086196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342644cd-120a-4163-996a-bcfabea1b47c admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:25.086480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342644cd-120a-4163-996a-bcfabea1b47c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:25.086750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342644cd-120a-4163-996a-bcfabea1b47c admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:25.087401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342644cd-120a-4163-996a-bcfabea1b47c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:25.098644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342644cd-120a-4163-996a-bcfabea1b47c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:25.133133 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1122/2260] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:01:24 2022] POST /identity/v3/users => generated 289 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:01:25.137331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e85975-269b-4507-ac4b-450df7a9d3b1 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:25.150111 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e85975-269b-4507-ac4b-450df7a9d3b1 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:25.155197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd402c39-daf9-4050-bcd7-08019e202402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:25.155845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd402c39-daf9-4050-bcd7-08019e202402 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:25.156294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd402c39-daf9-4050-bcd7-08019e202402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:25.156570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd402c39-daf9-4050-bcd7-08019e202402 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:25.157211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd402c39-daf9-4050-bcd7-08019e202402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:25.160097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd402c39-daf9-4050-bcd7-08019e202402 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:25.178048 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1139/2261] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:01:25.181719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342644cd-120a-4163-996a-bcfabea1b47c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:25.203796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342644cd-120a-4163-996a-bcfabea1b47c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:25.212348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443ffaf-1f5e-4510-a49d-cf001117b28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:25.213047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443ffaf-1f5e-4510-a49d-cf001117b28f admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:25.214085 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443ffaf-1f5e-4510-a49d-cf001117b28f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:25.214486 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443ffaf-1f5e-4510-a49d-cf001117b28f admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:25.215249 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a443ffaf-1f5e-4510-a49d-cf001117b28f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:25.217864 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a443ffaf-1f5e-4510-a49d-cf001117b28f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:25.232435 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1123/2262] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:01:25.237621 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd402c39-daf9-4050-bcd7-08019e202402 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:25.251957 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd402c39-daf9-4050-bcd7-08019e202402 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:25.259703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc414489-962b-44d2-9f47-c313e5702fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:25.260477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc414489-962b-44d2-9f47-c313e5702fb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:25.260987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc414489-962b-44d2-9f47-c313e5702fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:25.261961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc414489-962b-44d2-9f47-c313e5702fb3 admin admin] PATH_INFO: `/v3/projects/073ad976898c4f8ea817b4f200b50e8c/users/90c2f38f38464a679231fa6538b22732/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:25.291705 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:25.307601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc414489-962b-44d2-9f47-c313e5702fb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=073ad976898c4f8ea817b4f200b50e8c, user_id=90c2f38f38464a679231fa6538b22732, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:25.313281 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc414489-962b-44d2-9f47-c313e5702fb3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:25.336860 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1140/2263] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:01:25 2022] PUT /identity/v3/projects/073ad976898c4f8ea817b4f200b50e8c/users/90c2f38f38464a679231fa6538b22732/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:25.349511 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d779ec4-6983-42cf-90d1-6c4ddaea5428 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:25.350370 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d779ec4-6983-42cf-90d1-6c4ddaea5428 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:25.351238 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d779ec4-6983-42cf-90d1-6c4ddaea5428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:25.436023 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-7d779ec4-6983-42cf-90d1-6c4ddaea5428 None None] MFA Rules not processed for user `90c2f38f38464a679231fa6538b22732`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:25.437768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7d779ec4-6983-42cf-90d1-6c4ddaea5428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:25.520045 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc414489-962b-44d2-9f47-c313e5702fb3 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:25.521297 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:25.523313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-dc414489-962b-44d2-9f47-c313e5702fb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:25.544961 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1124/2264] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:25.546468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d779ec4-6983-42cf-90d1-6c4ddaea5428 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:25.638290 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d779ec4-6983-42cf-90d1-6c4ddaea5428 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:25.643642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc414489-962b-44d2-9f47-c313e5702fb3 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:25.644044 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8b32f-921a-416f-836e-e19276399e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:25.644758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8b32f-921a-416f-836e-e19276399e1f admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:25.644947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8b32f-921a-416f-836e-e19276399e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:25.645219 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8b32f-921a-416f-836e-e19276399e1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:25.645968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8b32f-921a-416f-836e-e19276399e1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:25.647975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8b32f-921a-416f-836e-e19276399e1f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:25.666428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8a58c-c109-4949-b7ba-9d13371390d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:25.667102 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8a58c-c109-4949-b7ba-9d13371390d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:25.667381 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8a58c-c109-4949-b7ba-9d13371390d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:25.667659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8a58c-c109-4949-b7ba-9d13371390d3 admin admin] PATH_INFO: `/v3/projects/fdc4cb52c3e548d98d7b4c29aaf08252` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:25.668906 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8a58c-c109-4949-b7ba-9d13371390d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdc4cb52c3e548d98d7b4c29aaf08252)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:25.670875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8a58c-c109-4949-b7ba-9d13371390d3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:25.690221 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1125/2265] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:01:25 2022] POST /identity/v3/projects => generated 377 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:01:25.691304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8b32f-921a-416f-836e-e19276399e1f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:25.751675 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e5a8a58c-c109-4949-b7ba-9d13371390d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdc4cb52c3e548d98d7b4c29aaf08252', 'request_id': 'req-e5a8a58c-c109-4949-b7ba-9d13371390d3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:25.764486 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8b32f-921a-416f-836e-e19276399e1f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:25.766229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e5a8a58c-c109-4949-b7ba-9d13371390d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdc4cb52c3e548d98d7b4c29aaf08252', 'request_id': 'req-e5a8a58c-c109-4949-b7ba-9d13371390d3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:25.782995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e5a8a58c-c109-4949-b7ba-9d13371390d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdc4cb52c3e548d98d7b4c29aaf08252', 'request_id': 'req-e5a8a58c-c109-4949-b7ba-9d13371390d3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:25.811474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e5a8a58c-c109-4949-b7ba-9d13371390d3 admin admin] The token cache is being invalidate because project fdc4cb52c3e548d98d7b4c29aaf08252 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:01:25.811772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e5a8a58c-c109-4949-b7ba-9d13371390d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:25.815590 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e5a8a58c-c109-4949-b7ba-9d13371390d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:25.823237 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1141/2266] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:01:25 2022] DELETE /identity/v3/projects/fdc4cb52c3e548d98d7b4c29aaf08252 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:25.840397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92f6b5-51e8-44f3-8518-240e44b7a95d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:25.840694 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92f6b5-51e8-44f3-8518-240e44b7a95d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:25.841003 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92f6b5-51e8-44f3-8518-240e44b7a95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:25.900331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-fc92f6b5-51e8-44f3-8518-240e44b7a95d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:25.903736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fc92f6b5-51e8-44f3-8518-240e44b7a95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:25.910158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b723e-70a5-43d3-ac65-647bb69a03c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:25.910729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b723e-70a5-43d3-ac65-647bb69a03c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:25.911095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b723e-70a5-43d3-ac65-647bb69a03c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:25.911642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b723e-70a5-43d3-ac65-647bb69a03c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:25.912394 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b723e-70a5-43d3-ac65-647bb69a03c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:25.915031 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b723e-70a5-43d3-ac65-647bb69a03c0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:25.941053 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1142/2267] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:25.959819 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b762ea-80f0-41ed-93ed-30d04b998064 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:25.960210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b762ea-80f0-41ed-93ed-30d04b998064 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:25.960590 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b762ea-80f0-41ed-93ed-30d04b998064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:25.963038 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1126/2268] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:01:25 2022] POST /identity/v3/users => generated 295 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:01:25.965193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b723e-70a5-43d3-ac65-647bb69a03c0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:25.977079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a02b723e-70a5-43d3-ac65-647bb69a03c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:25.998926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b723e-70a5-43d3-ac65-647bb69a03c0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:26.009996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab1737-f236-4a15-8aec-813e58df2f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:26.010783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab1737-f236-4a15-8aec-813e58df2f06 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:26.011101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab1737-f236-4a15-8aec-813e58df2f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:26.011618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab1737-f236-4a15-8aec-813e58df2f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:26.012484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab1737-f236-4a15-8aec-813e58df2f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:26.014191 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab1737-f236-4a15-8aec-813e58df2f06 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:26.029537 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1127/2269] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:01:26.030547 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab1737-f236-4a15-8aec-813e58df2f06 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:26.032329 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a3ab1737-f236-4a15-8aec-813e58df2f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:26.036339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-95b762ea-80f0-41ed-93ed-30d04b998064 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:26.037738 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-95b762ea-80f0-41ed-93ed-30d04b998064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:26.044825 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:26.057861 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1143/2270] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:26.060189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b762ea-80f0-41ed-93ed-30d04b998064 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:26.083811 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b762ea-80f0-41ed-93ed-30d04b998064 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:26.094011 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c575f37-76c3-42d2-ae43-b33fe989578f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:26.094868 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c575f37-76c3-42d2-ae43-b33fe989578f admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:26.095155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c575f37-76c3-42d2-ae43-b33fe989578f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:26.095432 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c575f37-76c3-42d2-ae43-b33fe989578f admin admin] PATH_INFO: `/v3/projects/aed82ba4d57841b2ab266c82ba838918/users/addfabe3dfaf49c189d4c834ffc55ef0/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:26.117621 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c575f37-76c3-42d2-ae43-b33fe989578f admin admin] RBAC: Authorizing `identity:create_grant(project_id=aed82ba4d57841b2ab266c82ba838918, user_id=addfabe3dfaf49c189d4c834ffc55ef0, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:26.121590 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c575f37-76c3-42d2-ae43-b33fe989578f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:26.143712 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1144/2271] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:01:26 2022] PUT /identity/v3/projects/aed82ba4d57841b2ab266c82ba838918/users/addfabe3dfaf49c189d4c834ffc55ef0/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:26.144776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c575f37-76c3-42d2-ae43-b33fe989578f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:26.146897 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab1737-f236-4a15-8aec-813e58df2f06 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:26.274422 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:26.310926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b4121-908a-4f50-886c-0e3bac637d7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:26.311570 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b4121-908a-4f50-886c-0e3bac637d7c service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:26.311849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b4121-908a-4f50-886c-0e3bac637d7c service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:26.312123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b4121-908a-4f50-886c-0e3bac637d7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:26.317813 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c575f37-76c3-42d2-ae43-b33fe989578f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:26.319201 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ca7b4121-908a-4f50-886c-0e3bac637d7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:26.329116 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ceaca-5dd7-4bea-9973-0d213f0d558c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:26.329764 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ceaca-5dd7-4bea-9973-0d213f0d558c admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:26.331787 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ceaca-5dd7-4bea-9973-0d213f0d558c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:26.332847 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ceaca-5dd7-4bea-9973-0d213f0d558c admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:26.334836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ceaca-5dd7-4bea-9973-0d213f0d558c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:01:26.336035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ceaca-5dd7-4bea-9973-0d213f0d558c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:26.341077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ceaca-5dd7-4bea-9973-0d213f0d558c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:26.369669 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1145/2272] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:01:26.373369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ceaca-5dd7-4bea-9973-0d213f0d558c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:26.398840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ceaca-5dd7-4bea-9973-0d213f0d558c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:26.431500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548163a-283c-4f07-96b1-9455fc781f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:26.433897 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548163a-283c-4f07-96b1-9455fc781f34 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:26.434538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548163a-283c-4f07-96b1-9455fc781f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:26.438000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548163a-283c-4f07-96b1-9455fc781f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:26.439299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548163a-283c-4f07-96b1-9455fc781f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:26.441614 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548163a-283c-4f07-96b1-9455fc781f34 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:26.463074 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b4121-908a-4f50-886c-0e3bac637d7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:26.467083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b4121-908a-4f50-886c-0e3bac637d7c service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:26.478475 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1128/2273] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:01:26 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:01:26.479750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b4121-908a-4f50-886c-0e3bac637d7c service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:26.492791 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b4121-908a-4f50-886c-0e3bac637d7c service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:26.494165 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1146/2274] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:01:26.497446 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548163a-283c-4f07-96b1-9455fc781f34 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:26.498889 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075d075-e5bb-4630-8dfe-83f5e48bf7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:26.499623 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075d075-e5bb-4630-8dfe-83f5e48bf7a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:26.500004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075d075-e5bb-4630-8dfe-83f5e48bf7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:26.500379 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075d075-e5bb-4630-8dfe-83f5e48bf7a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:26.501107 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075d075-e5bb-4630-8dfe-83f5e48bf7a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:26.504054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075d075-e5bb-4630-8dfe-83f5e48bf7a8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:26.529468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548163a-283c-4f07-96b1-9455fc781f34 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:26.547400 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226adead-7354-4b6a-bef1-dd773d3359b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:26.548089 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226adead-7354-4b6a-bef1-dd773d3359b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:26.548362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226adead-7354-4b6a-bef1-dd773d3359b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:26.548655 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226adead-7354-4b6a-bef1-dd773d3359b1 admin admin] PATH_INFO: `/v3/projects/aed82ba4d57841b2ab266c82ba838918/users/addfabe3dfaf49c189d4c834ffc55ef0/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:26.553314 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1129/2275] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:01:26 2022] POST /identity/v3/projects => generated 387 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:01:26.555904 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075d075-e5bb-4630-8dfe-83f5e48bf7a8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:26.565652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226adead-7354-4b6a-bef1-dd773d3359b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aed82ba4d57841b2ab266c82ba838918, user_id=addfabe3dfaf49c189d4c834ffc55ef0, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:26.577855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226adead-7354-4b6a-bef1-dd773d3359b1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:26.587354 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:26.604709 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1147/2276] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:01:26 2022] PUT /identity/v3/projects/aed82ba4d57841b2ab266c82ba838918/users/addfabe3dfaf49c189d4c834ffc55ef0/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:26.621012 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278b8eb-ca07-4d71-9f06-55d83f514ebd None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:26.622363 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278b8eb-ca07-4d71-9f06-55d83f514ebd None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:26.622546 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278b8eb-ca07-4d71-9f06-55d83f514ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:26.678303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-8278b8eb-ca07-4d71-9f06-55d83f514ebd None None] MFA Rules not processed for user `addfabe3dfaf49c189d4c834ffc55ef0`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:26.678846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075d075-e5bb-4630-8dfe-83f5e48bf7a8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:26.679923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8278b8eb-ca07-4d71-9f06-55d83f514ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:26.802111 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1148/2277] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:26.814782 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278b8eb-ca07-4d71-9f06-55d83f514ebd None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:26.816794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8278b8eb-ca07-4d71-9f06-55d83f514ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:26.866474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4493f86-e76b-4814-a864-d248cf69dc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:26.867215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4493f86-e76b-4814-a864-d248cf69dc7d admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:26.867497 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4493f86-e76b-4814-a864-d248cf69dc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:26.868007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4493f86-e76b-4814-a864-d248cf69dc7d admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:26.868658 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4493f86-e76b-4814-a864-d248cf69dc7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:26.873349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4493f86-e76b-4814-a864-d248cf69dc7d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:26.932805 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1130/2278] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:01:26 2022] POST /identity/v3/users => generated 294 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:01:26.937785 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4493f86-e76b-4814-a864-d248cf69dc7d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:26.950424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4493f86-e76b-4814-a864-d248cf69dc7d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:26.952455 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278b8eb-ca07-4d71-9f06-55d83f514ebd None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:26.967195 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320b28a-70ef-48f1-bf81-fa622713d818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:26.968233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320b28a-70ef-48f1-bf81-fa622713d818 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:26.968233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320b28a-70ef-48f1-bf81-fa622713d818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:26.968518 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320b28a-70ef-48f1-bf81-fa622713d818 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:26.969218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320b28a-70ef-48f1-bf81-fa622713d818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:26.971713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320b28a-70ef-48f1-bf81-fa622713d818 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:26.982241 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f12c62-94e5-418c-bc4d-5bc7492b32ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:26.982885 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f12c62-94e5-418c-bc4d-5bc7492b32ad service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:26.983161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f12c62-94e5-418c-bc4d-5bc7492b32ad service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:26.990086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f12c62-94e5-418c-bc4d-5bc7492b32ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:26.991795 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1131/2279] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:01:26.998174 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320b28a-70ef-48f1-bf81-fa622713d818 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:27.010664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f12c62-94e5-418c-bc4d-5bc7492b32ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:27.012520 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f12c62-94e5-418c-bc4d-5bc7492b32ad service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:27.027432 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1149/2280] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:01:26 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:01:27.029528 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320b28a-70ef-48f1-bf81-fa622713d818 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:27.048404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45bea0-b2f4-447b-9c9a-d04c2650577e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:27.048404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45bea0-b2f4-447b-9c9a-d04c2650577e admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:27.048404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45bea0-b2f4-447b-9c9a-d04c2650577e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:27.048709 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45bea0-b2f4-447b-9c9a-d04c2650577e admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:27.049174 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45bea0-b2f4-447b-9c9a-d04c2650577e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:27.051323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45bea0-b2f4-447b-9c9a-d04c2650577e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:27.083174 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1132/2281] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:01:27.084950 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f12c62-94e5-418c-bc4d-5bc7492b32ad service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:27.107578 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f12c62-94e5-418c-bc4d-5bc7492b32ad service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:27.120155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d0552-2890-42e7-83bd-9f653516a181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:27.121021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d0552-2890-42e7-83bd-9f653516a181 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:27.121300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d0552-2890-42e7-83bd-9f653516a181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:27.121604 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d0552-2890-42e7-83bd-9f653516a181 admin admin] PATH_INFO: `/v3/projects/b0773c4ed5f24051ad339f69c140181b/users/c0798d824bdb49eeb682753346b8a99a/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:27.145608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d0552-2890-42e7-83bd-9f653516a181 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0773c4ed5f24051ad339f69c140181b, user_id=c0798d824bdb49eeb682753346b8a99a, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:27.148623 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d0552-2890-42e7-83bd-9f653516a181 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:27.168002 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:27.194667 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1150/2282] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:01:27 2022] PUT /identity/v3/projects/b0773c4ed5f24051ad339f69c140181b/users/c0798d824bdb49eeb682753346b8a99a/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:27.197317 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb4565-5f3f-467a-bc78-07d0c5ce6930 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:27.197767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb4565-5f3f-467a-bc78-07d0c5ce6930 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:27.198271 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb4565-5f3f-467a-bc78-07d0c5ce6930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:27.254813 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-aeeb4565-5f3f-467a-bc78-07d0c5ce6930 None None] MFA Rules not processed for user `c0798d824bdb49eeb682753346b8a99a`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:27.256034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-aeeb4565-5f3f-467a-bc78-07d0c5ce6930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:27.385786 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1133/2283] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:27.390550 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d0552-2890-42e7-83bd-9f653516a181 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:27.485624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d0552-2890-42e7-83bd-9f653516a181 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:27.505342 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f4deb-a0f3-488e-aa20-fc9408b923d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:27.506120 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f4deb-a0f3-488e-aa20-fc9408b923d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:27.506469 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f4deb-a0f3-488e-aa20-fc9408b923d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:27.506893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f4deb-a0f3-488e-aa20-fc9408b923d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:27.507623 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f4deb-a0f3-488e-aa20-fc9408b923d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:27.511312 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f4deb-a0f3-488e-aa20-fc9408b923d7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:27.557925 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1151/2284] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:01:27 2022] POST /identity/v3/projects => generated 387 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:01:27.559385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb4565-5f3f-467a-bc78-07d0c5ce6930 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:27.576141 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb4565-5f3f-467a-bc78-07d0c5ce6930 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:27.596879 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:27.659753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcc354-a60f-4389-97d9-aa61b0b56d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:27.660455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcc354-a60f-4389-97d9-aa61b0b56d68 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:27.660792 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcc354-a60f-4389-97d9-aa61b0b56d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:27.661165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcc354-a60f-4389-97d9-aa61b0b56d68 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:27.661871 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fcc354-a60f-4389-97d9-aa61b0b56d68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:27.663983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fcc354-a60f-4389-97d9-aa61b0b56d68 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:27.727584 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1134/2285] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:01:27 2022] POST /identity/v3/users => generated 300 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:01:27.731473 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f4deb-a0f3-488e-aa20-fc9408b923d7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:27.748759 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f4deb-a0f3-488e-aa20-fc9408b923d7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:27.762398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f39dda-52ee-4318-82b4-0dca04943ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:27.763115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f39dda-52ee-4318-82b4-0dca04943ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:27.763547 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f39dda-52ee-4318-82b4-0dca04943ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:27.765009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f39dda-52ee-4318-82b4-0dca04943ea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:27.765009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f39dda-52ee-4318-82b4-0dca04943ea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:27.782263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f39dda-52ee-4318-82b4-0dca04943ea5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:27.809144 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1152/2286] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:01:27.813571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcc354-a60f-4389-97d9-aa61b0b56d68 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:27.826186 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcc354-a60f-4389-97d9-aa61b0b56d68 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:27.834704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3be57-2bf8-4f85-9d1b-49eb09d9a580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:27.835563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3be57-2bf8-4f85-9d1b-49eb09d9a580 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:27.835951 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3be57-2bf8-4f85-9d1b-49eb09d9a580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:27.836322 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3be57-2bf8-4f85-9d1b-49eb09d9a580 admin admin] PATH_INFO: `/v3/projects/6b3ce8e6eb11474887bef10141a43572/users/33761e690c754fa0addff2ba1eb6a866/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:27.878191 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d3be57-2bf8-4f85-9d1b-49eb09d9a580 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b3ce8e6eb11474887bef10141a43572, user_id=33761e690c754fa0addff2ba1eb6a866, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:27.880977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d3be57-2bf8-4f85-9d1b-49eb09d9a580 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:27.897858 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1135/2287] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:01:27 2022] PUT /identity/v3/projects/6b3ce8e6eb11474887bef10141a43572/users/33761e690c754fa0addff2ba1eb6a866/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:27.901865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f39dda-52ee-4318-82b4-0dca04943ea5 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:27.913786 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f39dda-52ee-4318-82b4-0dca04943ea5 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:28.024165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226296d0-82c3-47e7-8527-52fb30b8196c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:28.025207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226296d0-82c3-47e7-8527-52fb30b8196c admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:28.025780 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226296d0-82c3-47e7-8527-52fb30b8196c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:28.026164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226296d0-82c3-47e7-8527-52fb30b8196c admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:28.026973 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226296d0-82c3-47e7-8527-52fb30b8196c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:28.029127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226296d0-82c3-47e7-8527-52fb30b8196c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:28.049234 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3be57-2bf8-4f85-9d1b-49eb09d9a580 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:28.049850 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1153/2288] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:01:28.063949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3be57-2bf8-4f85-9d1b-49eb09d9a580 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:28.074404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e36f0-f46b-4e37-bec5-5c719fb1e687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:28.074986 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e36f0-f46b-4e37-bec5-5c719fb1e687 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:28.075265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e36f0-f46b-4e37-bec5-5c719fb1e687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:28.075532 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e36f0-f46b-4e37-bec5-5c719fb1e687 admin admin] PATH_INFO: `/v3/projects/6b3ce8e6eb11474887bef10141a43572/users/33761e690c754fa0addff2ba1eb6a866/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:28.088312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e36f0-f46b-4e37-bec5-5c719fb1e687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b3ce8e6eb11474887bef10141a43572, user_id=33761e690c754fa0addff2ba1eb6a866, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:28.091519 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e36f0-f46b-4e37-bec5-5c719fb1e687 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:28.127147 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1136/2289] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:01:28 2022] PUT /identity/v3/projects/6b3ce8e6eb11474887bef10141a43572/users/33761e690c754fa0addff2ba1eb6a866/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:01:28.143659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b646af-04a9-4c3d-87a6-3b3dbb5cd266 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:28.144650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b646af-04a9-4c3d-87a6-3b3dbb5cd266 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:28.144975 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b646af-04a9-4c3d-87a6-3b3dbb5cd266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:28.189211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-45b646af-04a9-4c3d-87a6-3b3dbb5cd266 None None] MFA Rules not processed for user `33761e690c754fa0addff2ba1eb6a866`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:28.191677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-45b646af-04a9-4c3d-87a6-3b3dbb5cd266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:28.365944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277dc8ce-1f04-4be6-bfca-c306e9e2e34b None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:28.366233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277dc8ce-1f04-4be6-bfca-c306e9e2e34b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:28.366711 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277dc8ce-1f04-4be6-bfca-c306e9e2e34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:28.372313 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:28.403323 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1154/2290] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:28 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:28.448791 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-277dc8ce-1f04-4be6-bfca-c306e9e2e34b None None] MFA Rules not processed for user `134d179e5e784ca8867b48bcd3e92c41`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:28.459497 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-277dc8ce-1f04-4be6-bfca-c306e9e2e34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:28.599369 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1137/2291] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:28 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:28.806765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b646af-04a9-4c3d-87a6-3b3dbb5cd266 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:28.929255 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b646af-04a9-4c3d-87a6-3b3dbb5cd266 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:28.937820 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64837c9d-e309-4720-a98f-a7eb7a8f9bf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:28.939362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64837c9d-e309-4720-a98f-a7eb7a8f9bf3 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:28.940511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64837c9d-e309-4720-a98f-a7eb7a8f9bf3 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:28.940941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64837c9d-e309-4720-a98f-a7eb7a8f9bf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:28.952281 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64837c9d-e309-4720-a98f-a7eb7a8f9bf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:28.954336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64837c9d-e309-4720-a98f-a7eb7a8f9bf3 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:28.971599 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1155/2292] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:01:28 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:01:29.750496 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277dc8ce-1f04-4be6-bfca-c306e9e2e34b None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:29.767130 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277dc8ce-1f04-4be6-bfca-c306e9e2e34b None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:29.772708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1546bd-bfd9-40b1-969f-d346c6c464ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:29.773322 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1546bd-bfd9-40b1-969f-d346c6c464ce service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:29.773636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1546bd-bfd9-40b1-969f-d346c6c464ce service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:29.773912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1546bd-bfd9-40b1-969f-d346c6c464ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:29.835586 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1546bd-bfd9-40b1-969f-d346c6c464ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:29.837447 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1546bd-bfd9-40b1-969f-d346c6c464ce service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:29.849689 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1138/2293] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:01:29 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:01:32.294170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64837c9d-e309-4720-a98f-a7eb7a8f9bf3 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:32.308621 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64837c9d-e309-4720-a98f-a7eb7a8f9bf3 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:32.316076 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9365ea1-ab9b-473d-8aa9-8eeba30f3dc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:32.316948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9365ea1-ab9b-473d-8aa9-8eeba30f3dc5 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:32.317428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9365ea1-ab9b-473d-8aa9-8eeba30f3dc5 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:32.317885 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9365ea1-ab9b-473d-8aa9-8eeba30f3dc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:32.320284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c9365ea1-ab9b-473d-8aa9-8eeba30f3dc5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:32.424444 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9365ea1-ab9b-473d-8aa9-8eeba30f3dc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:32.425985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9365ea1-ab9b-473d-8aa9-8eeba30f3dc5 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:32.437525 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1156/2294] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:01:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:01:32.520839 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1546bd-bfd9-40b1-969f-d346c6c464ce service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:32.537176 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1546bd-bfd9-40b1-969f-d346c6c464ce service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:32.552042 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5978d829-ce55-4f6f-b1fb-e8048f3b993e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:32.553117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978d829-ce55-4f6f-b1fb-e8048f3b993e service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:32.553749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978d829-ce55-4f6f-b1fb-e8048f3b993e service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:32.554037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978d829-ce55-4f6f-b1fb-e8048f3b993e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:32.556151 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5978d829-ce55-4f6f-b1fb-e8048f3b993e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:32.568401 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:32.662175 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5978d829-ce55-4f6f-b1fb-e8048f3b993e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:32.663904 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5978d829-ce55-4f6f-b1fb-e8048f3b993e service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:32.678266 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1139/2295] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:01:32 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:01:33.294844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9365ea1-ab9b-473d-8aa9-8eeba30f3dc5 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:33.402129 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9365ea1-ab9b-473d-8aa9-8eeba30f3dc5 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:33.418675 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15469f37-aba6-4c0d-aef0-f55bf125cf1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:33.437424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15469f37-aba6-4c0d-aef0-f55bf125cf1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:33.437424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15469f37-aba6-4c0d-aef0-f55bf125cf1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:33.437424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15469f37-aba6-4c0d-aef0-f55bf125cf1f admin admin] PATH_INFO: `/v3/users/c0798d824bdb49eeb682753346b8a99a` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:33.438967 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15469f37-aba6-4c0d-aef0-f55bf125cf1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0798d824bdb49eeb682753346b8a99a)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:33.441673 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15469f37-aba6-4c0d-aef0-f55bf125cf1f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:33.484080 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:33.554533 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-15469f37-aba6-4c0d-aef0-f55bf125cf1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0798d824bdb49eeb682753346b8a99a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:33.555196 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-15469f37-aba6-4c0d-aef0-f55bf125cf1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0798d824bdb49eeb682753346b8a99a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:33.564022 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-15469f37-aba6-4c0d-aef0-f55bf125cf1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0798d824bdb49eeb682753346b8a99a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:33.591512 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-15469f37-aba6-4c0d-aef0-f55bf125cf1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0798d824bdb49eeb682753346b8a99a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:33.592241 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-15469f37-aba6-4c0d-aef0-f55bf125cf1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0798d824bdb49eeb682753346b8a99a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:33.630983 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1157/2296] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:01:33 2022] DELETE /identity/v3/users/c0798d824bdb49eeb682753346b8a99a => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:33.635416 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d0293-0708-4b33-934b-ee543eb2102d None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:33.635902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d0293-0708-4b33-934b-ee543eb2102d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:33.635997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d0293-0708-4b33-934b-ee543eb2102d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:33.688639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-397d0293-0708-4b33-934b-ee543eb2102d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:33.690423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-397d0293-0708-4b33-934b-ee543eb2102d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:33.850817 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1140/2297] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:33.871115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15469f37-aba6-4c0d-aef0-f55bf125cf1f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:33.878880 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-15469f37-aba6-4c0d-aef0-f55bf125cf1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:33.983859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15469f37-aba6-4c0d-aef0-f55bf125cf1f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:33.989164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f6ef4-6c10-4367-9555-72a671c8404c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:33.990376 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f6ef4-6c10-4367-9555-72a671c8404c service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:33.990376 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f6ef4-6c10-4367-9555-72a671c8404c service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:33.990598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f6ef4-6c10-4367-9555-72a671c8404c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:34.004473 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f6ef4-6c10-4367-9555-72a671c8404c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:34.006231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f6ef4-6c10-4367-9555-72a671c8404c service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:34.020559 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1158/2298] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:01:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:01:34.210142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d0293-0708-4b33-934b-ee543eb2102d None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:34.211780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-397d0293-0708-4b33-934b-ee543eb2102d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:34.227809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d0293-0708-4b33-934b-ee543eb2102d None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:34.232587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c394fc-8fa0-485a-b718-91309ebc2955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:34.233240 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c394fc-8fa0-485a-b718-91309ebc2955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:34.233554 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c394fc-8fa0-485a-b718-91309ebc2955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:34.234040 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c394fc-8fa0-485a-b718-91309ebc2955 admin admin] PATH_INFO: `/v3/users/c0dfe5b82e7045d19b82685fab4290cd` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:34.235752 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c394fc-8fa0-485a-b718-91309ebc2955 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0dfe5b82e7045d19b82685fab4290cd)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:34.239433 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c394fc-8fa0-485a-b718-91309ebc2955 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:34.300923 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-69c394fc-8fa0-485a-b718-91309ebc2955 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0dfe5b82e7045d19b82685fab4290cd'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:34.301655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-69c394fc-8fa0-485a-b718-91309ebc2955 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0dfe5b82e7045d19b82685fab4290cd'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:34.310354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-69c394fc-8fa0-485a-b718-91309ebc2955 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0dfe5b82e7045d19b82685fab4290cd'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:34.320278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-69c394fc-8fa0-485a-b718-91309ebc2955 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0dfe5b82e7045d19b82685fab4290cd'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:34.320919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-69c394fc-8fa0-485a-b718-91309ebc2955 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0dfe5b82e7045d19b82685fab4290cd'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:34.350272 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1141/2299] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:01:34 2022] DELETE /identity/v3/users/c0dfe5b82e7045d19b82685fab4290cd => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:01:34.351831 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd16fc-5045-4314-aeb1-13afb8ce7ce8 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:34.352304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd16fc-5045-4314-aeb1-13afb8ce7ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:34.352385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd16fc-5045-4314-aeb1-13afb8ce7ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:34.379205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-8cdd16fc-5045-4314-aeb1-13afb8ce7ce8 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:34.380798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8cdd16fc-5045-4314-aeb1-13afb8ce7ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:34.460131 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1159/2300] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:34.492529 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c394fc-8fa0-485a-b718-91309ebc2955 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:34.493986 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-69c394fc-8fa0-485a-b718-91309ebc2955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:34.532966 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:34.585699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c394fc-8fa0-485a-b718-91309ebc2955 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:34.592439 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b8190-bf34-445e-b8bb-68341d60fa47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:34.593410 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b8190-bf34-445e-b8bb-68341d60fa47 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:34.593879 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b8190-bf34-445e-b8bb-68341d60fa47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:34.594741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b8190-bf34-445e-b8bb-68341d60fa47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:34.609985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47b8190-bf34-445e-b8bb-68341d60fa47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:34.612353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47b8190-bf34-445e-b8bb-68341d60fa47 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:34.643662 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1142/2301] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:01:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:01:34.917098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd16fc-5045-4314-aeb1-13afb8ce7ce8 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:34.918983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8cdd16fc-5045-4314-aeb1-13afb8ce7ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:34.950252 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b8190-bf34-445e-b8bb-68341d60fa47 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:34.951852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a47b8190-bf34-445e-b8bb-68341d60fa47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:34.975532 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b8190-bf34-445e-b8bb-68341d60fa47 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:34.982642 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:34.983780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768e9e2-0f21-484f-8b7f-261f930bb965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:34.984876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768e9e2-0f21-484f-8b7f-261f930bb965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:34.985164 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768e9e2-0f21-484f-8b7f-261f930bb965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:34.987103 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768e9e2-0f21-484f-8b7f-261f930bb965 admin admin] PATH_INFO: `/v3/projects/b0773c4ed5f24051ad339f69c140181b` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:34.989070 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9768e9e2-0f21-484f-8b7f-261f930bb965 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0773c4ed5f24051ad339f69c140181b)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:34.996914 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9768e9e2-0f21-484f-8b7f-261f930bb965 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:35.067950 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd16fc-5045-4314-aeb1-13afb8ce7ce8 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:35.082410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd55dd-4a14-4506-bb65-642799c673d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:35.083195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd55dd-4a14-4506-bb65-642799c673d9 service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:35.083580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd55dd-4a14-4506-bb65-642799c673d9 service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:35.083886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd55dd-4a14-4506-bb65-642799c673d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:35.086058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-04dd55dd-4a14-4506-bb65-642799c673d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:35.108678 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd55dd-4a14-4506-bb65-642799c673d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:35.110590 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd55dd-4a14-4506-bb65-642799c673d9 service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:35.116784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9768e9e2-0f21-484f-8b7f-261f930bb965 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0773c4ed5f24051ad339f69c140181b', 'request_id': 'req-9768e9e2-0f21-484f-8b7f-261f930bb965'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:35.125747 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1160/2302] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:01:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:01:35.126645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd55dd-4a14-4506-bb65-642799c673d9 service placement] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:35.128337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-04dd55dd-4a14-4506-bb65-642799c673d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:35.130305 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9768e9e2-0f21-484f-8b7f-261f930bb965 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0773c4ed5f24051ad339f69c140181b', 'request_id': 'req-9768e9e2-0f21-484f-8b7f-261f930bb965'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:35.140412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9768e9e2-0f21-484f-8b7f-261f930bb965 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0773c4ed5f24051ad339f69c140181b', 'request_id': 'req-9768e9e2-0f21-484f-8b7f-261f930bb965'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:35.144302 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd55dd-4a14-4506-bb65-642799c673d9 service placement] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:35.155643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9768e9e2-0f21-484f-8b7f-261f930bb965 admin admin] The token cache is being invalidate because project b0773c4ed5f24051ad339f69c140181b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:01:35.156293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9768e9e2-0f21-484f-8b7f-261f930bb965 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:35.157498 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9768e9e2-0f21-484f-8b7f-261f930bb965 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:35.160297 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1143/2303] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:01:34 2022] DELETE /identity/v3/projects/b0773c4ed5f24051ad339f69c140181b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:35.163974 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768e9e2-0f21-484f-8b7f-261f930bb965 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:35.165610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9768e9e2-0f21-484f-8b7f-261f930bb965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:35.243210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a57437-e0e9-420d-9202-0ccdbf46a6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:35.244137 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a57437-e0e9-420d-9202-0ccdbf46a6a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:35.244519 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a57437-e0e9-420d-9202-0ccdbf46a6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:35.245261 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a57437-e0e9-420d-9202-0ccdbf46a6a7 admin admin] PATH_INFO: `/v3/projects/511d2111500e4050a488a8bb6d688109` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:35.248121 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a57437-e0e9-420d-9202-0ccdbf46a6a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=511d2111500e4050a488a8bb6d688109)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:35.250795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768e9e2-0f21-484f-8b7f-261f930bb965 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:35.251771 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a57437-e0e9-420d-9202-0ccdbf46a6a7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:35.256350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3eb14-63ed-4284-85c1-83a84c17633d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:35.257314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3eb14-63ed-4284-85c1-83a84c17633d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:35.258161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3eb14-63ed-4284-85c1-83a84c17633d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:35.258587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3eb14-63ed-4284-85c1-83a84c17633d admin admin] PATH_INFO: `/v3/users/33761e690c754fa0addff2ba1eb6a866` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:35.260185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3eb14-63ed-4284-85c1-83a84c17633d admin admin] RBAC: Authorizing `identity:delete_user(user_id=33761e690c754fa0addff2ba1eb6a866)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:35.262584 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3eb14-63ed-4284-85c1-83a84c17633d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:35.350954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-78a57437-e0e9-420d-9202-0ccdbf46a6a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '511d2111500e4050a488a8bb6d688109', 'request_id': 'req-78a57437-e0e9-420d-9202-0ccdbf46a6a7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:35.356896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-57c3eb14-63ed-4284-85c1-83a84c17633d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33761e690c754fa0addff2ba1eb6a866'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:35.357675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-57c3eb14-63ed-4284-85c1-83a84c17633d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33761e690c754fa0addff2ba1eb6a866'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:35.359381 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:35.363887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-78a57437-e0e9-420d-9202-0ccdbf46a6a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '511d2111500e4050a488a8bb6d688109', 'request_id': 'req-78a57437-e0e9-420d-9202-0ccdbf46a6a7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:35.378720 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-57c3eb14-63ed-4284-85c1-83a84c17633d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33761e690c754fa0addff2ba1eb6a866'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:35.386260 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-78a57437-e0e9-420d-9202-0ccdbf46a6a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '511d2111500e4050a488a8bb6d688109', 'request_id': 'req-78a57437-e0e9-420d-9202-0ccdbf46a6a7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:35.391201 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-57c3eb14-63ed-4284-85c1-83a84c17633d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33761e690c754fa0addff2ba1eb6a866'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:35.392038 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-57c3eb14-63ed-4284-85c1-83a84c17633d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33761e690c754fa0addff2ba1eb6a866'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:35.404507 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-78a57437-e0e9-420d-9202-0ccdbf46a6a7 admin admin] The token cache is being invalidate because project 511d2111500e4050a488a8bb6d688109 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:01:35.404898 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-78a57437-e0e9-420d-9202-0ccdbf46a6a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:35.405792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-78a57437-e0e9-420d-9202-0ccdbf46a6a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:35.412507 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1161/2304] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:01:35 2022] DELETE /identity/v3/projects/511d2111500e4050a488a8bb6d688109 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:35.413701 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a57437-e0e9-420d-9202-0ccdbf46a6a7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:35.415664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-78a57437-e0e9-420d-9202-0ccdbf46a6a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:35.423006 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1144/2305] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:01:35 2022] DELETE /identity/v3/users/33761e690c754fa0addff2ba1eb6a866 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:01:35.550102 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a57437-e0e9-420d-9202-0ccdbf46a6a7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:35.562872 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:35.672950 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc4af4-29a1-41c9-9d60-2c686c5c3a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:35.674155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc4af4-29a1-41c9-9d60-2c686c5c3a90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:35.674247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc4af4-29a1-41c9-9d60-2c686c5c3a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:35.674455 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc4af4-29a1-41c9-9d60-2c686c5c3a90 admin admin] PATH_INFO: `/v3/users/90ded921a9374e01b10a67cb23898f52` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:35.675641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc4af4-29a1-41c9-9d60-2c686c5c3a90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90ded921a9374e01b10a67cb23898f52)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:35.677628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc4af4-29a1-41c9-9d60-2c686c5c3a90 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:35.739659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-07fc4af4-29a1-41c9-9d60-2c686c5c3a90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90ded921a9374e01b10a67cb23898f52'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:35.740440 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-07fc4af4-29a1-41c9-9d60-2c686c5c3a90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90ded921a9374e01b10a67cb23898f52'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:35.747698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-07fc4af4-29a1-41c9-9d60-2c686c5c3a90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90ded921a9374e01b10a67cb23898f52'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:35.759309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-07fc4af4-29a1-41c9-9d60-2c686c5c3a90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90ded921a9374e01b10a67cb23898f52'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:35.760045 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-07fc4af4-29a1-41c9-9d60-2c686c5c3a90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90ded921a9374e01b10a67cb23898f52'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:35.783258 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1162/2306] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:01:35 2022] DELETE /identity/v3/users/90ded921a9374e01b10a67cb23898f52 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:35.899576 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3eb14-63ed-4284-85c1-83a84c17633d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:35.902005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-57c3eb14-63ed-4284-85c1-83a84c17633d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:35.932571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3eb14-63ed-4284-85c1-83a84c17633d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:36.036338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db6809-caf1-4b76-9440-4742f261c0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:36.037423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db6809-caf1-4b76-9440-4742f261c0c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:36.037923 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db6809-caf1-4b76-9440-4742f261c0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:36.038621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db6809-caf1-4b76-9440-4742f261c0c4 admin admin] PATH_INFO: `/v3/projects/6b3ce8e6eb11474887bef10141a43572` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:36.041508 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db6809-caf1-4b76-9440-4742f261c0c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b3ce8e6eb11474887bef10141a43572)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:36.050787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db6809-caf1-4b76-9440-4742f261c0c4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:36.072819 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc4af4-29a1-41c9-9d60-2c686c5c3a90 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:36.074519 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-07fc4af4-29a1-41c9-9d60-2c686c5c3a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:36.099279 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc4af4-29a1-41c9-9d60-2c686c5c3a90 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:36.115386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ade5f1-8f62-4b9c-83ba-a24b03579fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:36.115809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ade5f1-8f62-4b9c-83ba-a24b03579fba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:36.116093 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ade5f1-8f62-4b9c-83ba-a24b03579fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:36.116370 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ade5f1-8f62-4b9c-83ba-a24b03579fba admin admin] PATH_INFO: `/v3/projects/83d634f78d3147cfb1c72d41dd3eecef` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:36.133501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ade5f1-8f62-4b9c-83ba-a24b03579fba admin admin] RBAC: Authorizing `identity:delete_project(project_id=83d634f78d3147cfb1c72d41dd3eecef)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:36.133501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ade5f1-8f62-4b9c-83ba-a24b03579fba admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:36.177158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f3db6809-caf1-4b76-9440-4742f261c0c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b3ce8e6eb11474887bef10141a43572', 'request_id': 'req-f3db6809-caf1-4b76-9440-4742f261c0c4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:36.202946 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f3db6809-caf1-4b76-9440-4742f261c0c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b3ce8e6eb11474887bef10141a43572', 'request_id': 'req-f3db6809-caf1-4b76-9440-4742f261c0c4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:36.226792 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f3db6809-caf1-4b76-9440-4742f261c0c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b3ce8e6eb11474887bef10141a43572', 'request_id': 'req-f3db6809-caf1-4b76-9440-4742f261c0c4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:36.244632 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e3ade5f1-8f62-4b9c-83ba-a24b03579fba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83d634f78d3147cfb1c72d41dd3eecef', 'request_id': 'req-e3ade5f1-8f62-4b9c-83ba-a24b03579fba'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:36.256680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f3db6809-caf1-4b76-9440-4742f261c0c4 admin admin] The token cache is being invalidate because project 6b3ce8e6eb11474887bef10141a43572 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:01:36.256835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e3ade5f1-8f62-4b9c-83ba-a24b03579fba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83d634f78d3147cfb1c72d41dd3eecef', 'request_id': 'req-e3ade5f1-8f62-4b9c-83ba-a24b03579fba'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:36.258604 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f3db6809-caf1-4b76-9440-4742f261c0c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:36.261021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f3db6809-caf1-4b76-9440-4742f261c0c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:36.264820 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e3ade5f1-8f62-4b9c-83ba-a24b03579fba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83d634f78d3147cfb1c72d41dd3eecef', 'request_id': 'req-e3ade5f1-8f62-4b9c-83ba-a24b03579fba'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:36.267527 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1145/2307] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:01:35 2022] DELETE /identity/v3/projects/6b3ce8e6eb11474887bef10141a43572 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:36.270441 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37485cb-1970-47b3-a961-f7f0fb2767c9 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:36.271153 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37485cb-1970-47b3-a961-f7f0fb2767c9 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:36.272016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37485cb-1970-47b3-a961-f7f0fb2767c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:36.278772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e3ade5f1-8f62-4b9c-83ba-a24b03579fba admin admin] The token cache is being invalidate because project 83d634f78d3147cfb1c72d41dd3eecef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:01:36.279111 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e3ade5f1-8f62-4b9c-83ba-a24b03579fba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:36.279792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e3ade5f1-8f62-4b9c-83ba-a24b03579fba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:36.281895 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1163/2308] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:01:36 2022] DELETE /identity/v3/projects/83d634f78d3147cfb1c72d41dd3eecef => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:36.290228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a43c9-4544-49de-85e2-a333b44a273d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:36.290583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a43c9-4544-49de-85e2-a333b44a273d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:36.290798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a43c9-4544-49de-85e2-a333b44a273d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:36.318808 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-5a8a43c9-4544-49de-85e2-a333b44a273d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:36.321842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5a8a43c9-4544-49de-85e2-a333b44a273d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:36.327713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-f37485cb-1970-47b3-a961-f7f0fb2767c9 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:36.329171 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f37485cb-1970-47b3-a961-f7f0fb2767c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:36.332757 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:36.402166 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:36.442416 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1146/2309] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:36.444313 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53706fc6-fbc2-4bbd-a7e9-a43410f136ff None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:36.444598 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53706fc6-fbc2-4bbd-a7e9-a43410f136ff None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:36.444880 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53706fc6-fbc2-4bbd-a7e9-a43410f136ff None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:36.452739 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1147/2310] 10.222.0.30 () {54 vars in 921 bytes} [Sun Sep 4 01:01:36 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:01:36.454479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7d7de-84f8-42d7-ad21-c119c0a8071a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:36.455341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7d7de-84f8-42d7-ad21-c119c0a8071a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:36.456370 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7d7de-84f8-42d7-ad21-c119c0a8071a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:36.460547 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1164/2311] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:36.469482 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65372eb0-85e6-47ad-9aa5-825a175fb8a8 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:36.470177 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65372eb0-85e6-47ad-9aa5-825a175fb8a8 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:36.471632 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65372eb0-85e6-47ad-9aa5-825a175fb8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:36.489266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-efe7d7de-84f8-42d7-ad21-c119c0a8071a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:36.491004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-efe7d7de-84f8-42d7-ad21-c119c0a8071a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:36.499958 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-65372eb0-85e6-47ad-9aa5-825a175fb8a8 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:36.501652 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1148/2312] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:36.502280 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-65372eb0-85e6-47ad-9aa5-825a175fb8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:36.503030 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fed90-2861-4f00-a94b-ee5c7d606bd7 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:36.503315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fed90-2861-4f00-a94b-ee5c7d606bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:36.503587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fed90-2861-4f00-a94b-ee5c7d606bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:36.515704 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1165/2313] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:36.516804 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65372eb0-85e6-47ad-9aa5-825a175fb8a8 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:36.527615 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65372eb0-85e6-47ad-9aa5-825a175fb8a8 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:36.534358 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-772fed90-2861-4f00-a94b-ee5c7d606bd7 None None] MFA Rules not processed for user `13f0f341bf2c475d82b4e7b34d503dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:36.535578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-772fed90-2861-4f00-a94b-ee5c7d606bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:36.537467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdecc057-915c-4117-a5aa-3e62018ad0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:36.538862 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecc057-915c-4117-a5aa-3e62018ad0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:36.539297 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecc057-915c-4117-a5aa-3e62018ad0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:36.539746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecc057-915c-4117-a5aa-3e62018ad0d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:36.540558 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdecc057-915c-4117-a5aa-3e62018ad0d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:01:36.541015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdecc057-915c-4117-a5aa-3e62018ad0d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:36.542951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdecc057-915c-4117-a5aa-3e62018ad0d3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:36.559688 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1166/2314] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:01:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:01:36.561620 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdecc057-915c-4117-a5aa-3e62018ad0d3 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:36.579708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdecc057-915c-4117-a5aa-3e62018ad0d3 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:36.590835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3107819-8337-4974-abef-930e83489cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:36.592300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3107819-8337-4974-abef-930e83489cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:36.592661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3107819-8337-4974-abef-930e83489cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:36.593049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3107819-8337-4974-abef-930e83489cc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:36.594263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3107819-8337-4974-abef-930e83489cc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:01:36.594676 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3107819-8337-4974-abef-930e83489cc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:36.598234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3107819-8337-4974-abef-930e83489cc6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:36.615612 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1167/2315] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:01:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:01:36.616515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3107819-8337-4974-abef-930e83489cc6 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:36.626878 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3107819-8337-4974-abef-930e83489cc6 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:36.631753 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625e35f-4994-4811-8eaf-483a8fd555d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:36.632443 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625e35f-4994-4811-8eaf-483a8fd555d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:36.632910 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625e35f-4994-4811-8eaf-483a8fd555d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:36.633259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625e35f-4994-4811-8eaf-483a8fd555d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:36.633985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625e35f-4994-4811-8eaf-483a8fd555d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:36.635952 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625e35f-4994-4811-8eaf-483a8fd555d7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:36.636379 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1149/2316] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Sep 4 01:01:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:36.637349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772fed90-2861-4f00-a94b-ee5c7d606bd7 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:36.648501 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772fed90-2861-4f00-a94b-ee5c7d606bd7 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:36.658539 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6e8f3-1b0f-4c51-ac14-97adcd6b761e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:36.659613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6e8f3-1b0f-4c51-ac14-97adcd6b761e admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:36.660143 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6e8f3-1b0f-4c51-ac14-97adcd6b761e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:36.660766 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6e8f3-1b0f-4c51-ac14-97adcd6b761e admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:36.661675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6e8f3-1b0f-4c51-ac14-97adcd6b761e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:36.664496 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6e8f3-1b0f-4c51-ac14-97adcd6b761e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:36.685856 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1168/2317] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:01:36 2022] POST /identity/v3/projects => generated 403 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:01:36.687232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625e35f-4994-4811-8eaf-483a8fd555d7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:36.690152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f625e35f-4994-4811-8eaf-483a8fd555d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:36.700720 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1150/2318] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:01:36 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:01:36.701793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6e8f3-1b0f-4c51-ac14-97adcd6b761e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:36.778679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6e8f3-1b0f-4c51-ac14-97adcd6b761e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:36.784865 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab56590-62c4-4292-8d56-561d6623f798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:36.785773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab56590-62c4-4292-8d56-561d6623f798 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:36.785910 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625e35f-4994-4811-8eaf-483a8fd555d7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:36.786325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab56590-62c4-4292-8d56-561d6623f798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:36.786736 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab56590-62c4-4292-8d56-561d6623f798 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:36.787503 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab56590-62c4-4292-8d56-561d6623f798 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:36.789763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab56590-62c4-4292-8d56-561d6623f798 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:36.817310 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1151/2319] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:01:36 2022] POST /identity/v3/users => generated 302 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:01:36.818706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab56590-62c4-4292-8d56-561d6623f798 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:36.839774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab56590-62c4-4292-8d56-561d6623f798 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:36.844979 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfabb1a-43bc-4bec-a4bb-e29e918c467a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:36.846220 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfabb1a-43bc-4bec-a4bb-e29e918c467a admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:36.846518 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfabb1a-43bc-4bec-a4bb-e29e918c467a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:36.846935 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfabb1a-43bc-4bec-a4bb-e29e918c467a admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:36.847571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfabb1a-43bc-4bec-a4bb-e29e918c467a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:36.847852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc383c-77ab-4273-a534-c96b4642e527 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:36.848467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc383c-77ab-4273-a534-c96b4642e527 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:36.848746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc383c-77ab-4273-a534-c96b4642e527 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:36.849015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc383c-77ab-4273-a534-c96b4642e527 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:36.849668 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfabb1a-43bc-4bec-a4bb-e29e918c467a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:36.875563 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:36.881846 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1152/2320] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:01:36 2022] POST /identity/v3/users => generated 288 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:01:36.881846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfabb1a-43bc-4bec-a4bb-e29e918c467a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:36.893257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfabb1a-43bc-4bec-a4bb-e29e918c467a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:36.899024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24441b20-6d05-4f73-a837-40e5c940e4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:36.899664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24441b20-6d05-4f73-a837-40e5c940e4ef admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:36.900216 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24441b20-6d05-4f73-a837-40e5c940e4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:36.900216 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24441b20-6d05-4f73-a837-40e5c940e4ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:36.900831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24441b20-6d05-4f73-a837-40e5c940e4ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:36.902713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24441b20-6d05-4f73-a837-40e5c940e4ef admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:36.943123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc383c-77ab-4273-a534-c96b4642e527 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:36.946939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc383c-77ab-4273-a534-c96b4642e527 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:36.992177 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1169/2321] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:01:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:01:36.993344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc383c-77ab-4273-a534-c96b4642e527 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:37.011335 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc383c-77ab-4273-a534-c96b4642e527 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:37.022926 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1b745-5c26-4971-9cbb-ca63c4d5dae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:37.023725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1b745-5c26-4971-9cbb-ca63c4d5dae7 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:37.024115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1b745-5c26-4971-9cbb-ca63c4d5dae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:37.024575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1b745-5c26-4971-9cbb-ca63c4d5dae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:37.025341 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1b745-5c26-4971-9cbb-ca63c4d5dae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:37.027763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1b745-5c26-4971-9cbb-ca63c4d5dae7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:37.042885 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1153/2322] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:01:37.042885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088db04-19c9-4e06-aa73-d7cf5dfbe39a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:37.042885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088db04-19c9-4e06-aa73-d7cf5dfbe39a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:37.042885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088db04-19c9-4e06-aa73-d7cf5dfbe39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:37.045601 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1170/2323] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:01:37.047571 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1b745-5c26-4971-9cbb-ca63c4d5dae7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:37.059854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1b745-5c26-4971-9cbb-ca63c4d5dae7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:37.064211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-6088db04-19c9-4e06-aa73-d7cf5dfbe39a None None] MFA Rules not processed for user `2cdde7a212954a01a2591ad5ac30d049`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:37.065392 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89f23d-89c4-42ea-955a-b2d6da8a3135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:37.065583 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6088db04-19c9-4e06-aa73-d7cf5dfbe39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:37.066073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89f23d-89c4-42ea-955a-b2d6da8a3135 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:37.066353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89f23d-89c4-42ea-955a-b2d6da8a3135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:37.066743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89f23d-89c4-42ea-955a-b2d6da8a3135 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:37.067383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f89f23d-89c4-42ea-955a-b2d6da8a3135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:37.069053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f89f23d-89c4-42ea-955a-b2d6da8a3135 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:37.072964 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1154/2324] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Sep 4 01:01:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:37.073892 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088db04-19c9-4e06-aa73-d7cf5dfbe39a None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:37.085374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088db04-19c9-4e06-aa73-d7cf5dfbe39a None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:37.087951 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1171/2325] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:01:37.090167 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89f23d-89c4-42ea-955a-b2d6da8a3135 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:37.094249 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469c32b-0dd9-4a73-9a62-fe2d29a6b558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:37.094872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469c32b-0dd9-4a73-9a62-fe2d29a6b558 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:37.095149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469c32b-0dd9-4a73-9a62-fe2d29a6b558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:37.095417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469c32b-0dd9-4a73-9a62-fe2d29a6b558 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:37.096719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469c32b-0dd9-4a73-9a62-fe2d29a6b558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:37.098406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469c32b-0dd9-4a73-9a62-fe2d29a6b558 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:37.110248 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1155/2326] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:01:37.111130 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469c32b-0dd9-4a73-9a62-fe2d29a6b558 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:37.114264 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89f23d-89c4-42ea-955a-b2d6da8a3135 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:37.117729 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:37.119937 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcd91a-3525-422e-b50e-7a03c8eecd9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:37.121173 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcd91a-3525-422e-b50e-7a03c8eecd9f service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:37.121950 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcd91a-3525-422e-b50e-7a03c8eecd9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:37.122591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcd91a-3525-422e-b50e-7a03c8eecd9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:37.122918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469c32b-0dd9-4a73-9a62-fe2d29a6b558 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:37.131487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d083b48-a163-4b9f-bc09-6834abd2b158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:37.132379 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d083b48-a163-4b9f-bc09-6834abd2b158 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:37.132870 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d083b48-a163-4b9f-bc09-6834abd2b158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:37.133200 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d083b48-a163-4b9f-bc09-6834abd2b158 admin admin] PATH_INFO: `/v3/projects/d27aee1d9b5b41b3bb8abc684bc9d8d0/users/ef8ea76acc2142af83ff880df9c144b8/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:37.134560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fcd91a-3525-422e-b50e-7a03c8eecd9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:37.136701 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fcd91a-3525-422e-b50e-7a03c8eecd9f service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:37.148714 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1172/2327] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:01:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:01:37.149840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcd91a-3525-422e-b50e-7a03c8eecd9f service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:37.165230 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d083b48-a163-4b9f-bc09-6834abd2b158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d27aee1d9b5b41b3bb8abc684bc9d8d0, user_id=ef8ea76acc2142af83ff880df9c144b8, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:37.165230 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d083b48-a163-4b9f-bc09-6834abd2b158 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:37.165565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcd91a-3525-422e-b50e-7a03c8eecd9f service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:37.170485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225a18f-77c0-4e1d-b213-5a63bc639fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:37.171242 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225a18f-77c0-4e1d-b213-5a63bc639fec admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:37.171526 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225a18f-77c0-4e1d-b213-5a63bc639fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:37.171857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225a18f-77c0-4e1d-b213-5a63bc639fec admin admin] PATH_INFO: `/v3/projects/3a0b934447e24decaac6431f53b4a1f7/users/a4c913daf63c433287eaf338b4ab2070/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:37.190872 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1156/2328] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:01:37 2022] PUT /identity/v3/projects/d27aee1d9b5b41b3bb8abc684bc9d8d0/users/ef8ea76acc2142af83ff880df9c144b8/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:37.193024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574c07e-62f3-4b27-8af9-7205affac493 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:37.193308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574c07e-62f3-4b27-8af9-7205affac493 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:37.193610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574c07e-62f3-4b27-8af9-7205affac493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:37.197292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5225a18f-77c0-4e1d-b213-5a63bc639fec admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a0b934447e24decaac6431f53b4a1f7, user_id=a4c913daf63c433287eaf338b4ab2070, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:37.200006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5225a18f-77c0-4e1d-b213-5a63bc639fec admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:37.222050 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1173/2329] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:01:37 2022] PUT /identity/v3/projects/3a0b934447e24decaac6431f53b4a1f7/users/a4c913daf63c433287eaf338b4ab2070/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:37.235249 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e6ece-5c6e-42de-9c12-dee27dfb5be5 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:37.235705 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e6ece-5c6e-42de-9c12-dee27dfb5be5 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:37.236182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e6ece-5c6e-42de-9c12-dee27dfb5be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:37.244355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c574c07e-62f3-4b27-8af9-7205affac493 None None] MFA Rules not processed for user `ef8ea76acc2142af83ff880df9c144b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:37.245633 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c574c07e-62f3-4b27-8af9-7205affac493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:37.280868 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-fe4e6ece-5c6e-42de-9c12-dee27dfb5be5 None None] MFA Rules not processed for user `a4c913daf63c433287eaf338b4ab2070`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:37.282569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fe4e6ece-5c6e-42de-9c12-dee27dfb5be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:37.325649 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1157/2330] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:37 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:37.329631 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574c07e-62f3-4b27-8af9-7205affac493 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:37.377787 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1174/2331] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:37.382331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e6ece-5c6e-42de-9c12-dee27dfb5be5 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:37.432306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574c07e-62f3-4b27-8af9-7205affac493 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:37.445460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ede6a-3446-4a87-a223-3490fc2c96e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:37.445460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ede6a-3446-4a87-a223-3490fc2c96e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:37.445460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ede6a-3446-4a87-a223-3490fc2c96e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:37.445460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ede6a-3446-4a87-a223-3490fc2c96e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:37.446147 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99ede6a-3446-4a87-a223-3490fc2c96e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:37.446147 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99ede6a-3446-4a87-a223-3490fc2c96e0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:37.464268 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:37.492066 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1158/2332] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:01:37 2022] POST /identity/v3/projects => generated 403 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:01:37.494337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e6ece-5c6e-42de-9c12-dee27dfb5be5 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:37.496504 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ede6a-3446-4a87-a223-3490fc2c96e0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:37.574764 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:37.584395 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5e519-11ad-443c-a6fa-bb36be054118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:37.585184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5e519-11ad-443c-a6fa-bb36be054118 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:37.585617 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5e519-11ad-443c-a6fa-bb36be054118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:37.585993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5e519-11ad-443c-a6fa-bb36be054118 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:37.586742 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5e519-11ad-443c-a6fa-bb36be054118 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:37.589040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5e519-11ad-443c-a6fa-bb36be054118 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:37.592782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ede6a-3446-4a87-a223-3490fc2c96e0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:37.600761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1d12e-547e-4997-9b05-198b4b18dd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:37.601720 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1d12e-547e-4997-9b05-198b4b18dd6f admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:37.602509 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1d12e-547e-4997-9b05-198b4b18dd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:37.603016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1d12e-547e-4997-9b05-198b4b18dd6f admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:37.604480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a1d12e-547e-4997-9b05-198b4b18dd6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:37.607204 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a1d12e-547e-4997-9b05-198b4b18dd6f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:37.637972 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1175/2333] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:01:37 2022] POST /identity/v3/projects => generated 373 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:01:37.639983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5e519-11ad-443c-a6fa-bb36be054118 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:37.653379 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1159/2334] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:01:37 2022] POST /identity/v3/users => generated 308 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:01:37.654794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1d12e-547e-4997-9b05-198b4b18dd6f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:37.669348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1d12e-547e-4997-9b05-198b4b18dd6f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:37.811259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5e519-11ad-443c-a6fa-bb36be054118 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:37.825862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69041b3c-64b4-4821-8c9b-c7f93822524b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:37.826829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69041b3c-64b4-4821-8c9b-c7f93822524b admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:37.829468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69041b3c-64b4-4821-8c9b-c7f93822524b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:37.831670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69041b3c-64b4-4821-8c9b-c7f93822524b admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:37.832779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69041b3c-64b4-4821-8c9b-c7f93822524b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:37.833938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d9968-cd4f-4568-95b5-47b6a9e905e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:37.836564 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d9968-cd4f-4568-95b5-47b6a9e905e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:37.838635 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d9968-cd4f-4568-95b5-47b6a9e905e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:37.838761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69041b3c-64b4-4821-8c9b-c7f93822524b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:37.838862 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d9968-cd4f-4568-95b5-47b6a9e905e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:37.839076 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d9968-cd4f-4568-95b5-47b6a9e905e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:37.850599 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d9968-cd4f-4568-95b5-47b6a9e905e9 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:37.855816 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1160/2335] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:01:37.860770 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69041b3c-64b4-4821-8c9b-c7f93822524b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:37.874051 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69041b3c-64b4-4821-8c9b-c7f93822524b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:37.880526 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcee02b-bb5b-4c20-b315-fa5d3bcdb118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:37.881926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcee02b-bb5b-4c20-b315-fa5d3bcdb118 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:37.882738 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcee02b-bb5b-4c20-b315-fa5d3bcdb118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:37.883002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcee02b-bb5b-4c20-b315-fa5d3bcdb118 admin admin] PATH_INFO: `/v3/projects/89eaebd34c454131afd9a1c057dc475f/users/f422ed3060134bd298c7e2b19d3ae203/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:37.888282 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1176/2336] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:01:37 2022] POST /identity/v3/users => generated 293 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:01:37.891868 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d9968-cd4f-4568-95b5-47b6a9e905e9 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:37.904983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d9968-cd4f-4568-95b5-47b6a9e905e9 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:37.905166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcee02b-bb5b-4c20-b315-fa5d3bcdb118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89eaebd34c454131afd9a1c057dc475f, user_id=f422ed3060134bd298c7e2b19d3ae203, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:37.910150 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcee02b-bb5b-4c20-b315-fa5d3bcdb118 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:37.912770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822e48b-bb9e-48ea-b88f-077eb9262c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:37.913095 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822e48b-bb9e-48ea-b88f-077eb9262c5d admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:37.913599 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822e48b-bb9e-48ea-b88f-077eb9262c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:37.914070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822e48b-bb9e-48ea-b88f-077eb9262c5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:37.915657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2822e48b-bb9e-48ea-b88f-077eb9262c5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:37.917914 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2822e48b-bb9e-48ea-b88f-077eb9262c5d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:37.934484 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1177/2337] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:01:37.943312 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822e48b-bb9e-48ea-b88f-077eb9262c5d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:37.944069 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1161/2338] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:01:37 2022] PUT /identity/v3/projects/89eaebd34c454131afd9a1c057dc475f/users/f422ed3060134bd298c7e2b19d3ae203/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:37.945191 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcee02b-bb5b-4c20-b315-fa5d3bcdb118 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:37.966939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822e48b-bb9e-48ea-b88f-077eb9262c5d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:38.034677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcee02b-bb5b-4c20-b315-fa5d3bcdb118 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:38.040352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6226bf0-1f25-46ac-8c8f-e1ea870af6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:38.041251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6226bf0-1f25-46ac-8c8f-e1ea870af6ad admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:38.041898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6226bf0-1f25-46ac-8c8f-e1ea870af6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:38.042451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6226bf0-1f25-46ac-8c8f-e1ea870af6ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:38.043341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6226bf0-1f25-46ac-8c8f-e1ea870af6ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:38.045282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6226bf0-1f25-46ac-8c8f-e1ea870af6ad admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:38.060915 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1162/2339] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:01:38.062162 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6226bf0-1f25-46ac-8c8f-e1ea870af6ad admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:38.079821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6226bf0-1f25-46ac-8c8f-e1ea870af6ad admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:38.086456 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:38.087310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d7bf8-e156-46ae-967a-d221ce9b3ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:38.088313 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d7bf8-e156-46ae-967a-d221ce9b3ec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:38.088441 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d7bf8-e156-46ae-967a-d221ce9b3ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:38.088700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d7bf8-e156-46ae-967a-d221ce9b3ec2 admin admin] PATH_INFO: `/v3/projects/89eaebd34c454131afd9a1c057dc475f/users/f422ed3060134bd298c7e2b19d3ae203/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:38.090849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d7bf8-e156-46ae-967a-d221ce9b3ec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89eaebd34c454131afd9a1c057dc475f, user_id=f422ed3060134bd298c7e2b19d3ae203, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:38.093828 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d7bf8-e156-46ae-967a-d221ce9b3ec2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:38.105528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28013c60-4975-4c5d-806d-61c749a224bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:38.106206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28013c60-4975-4c5d-806d-61c749a224bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:38.106848 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28013c60-4975-4c5d-806d-61c749a224bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:38.107140 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28013c60-4975-4c5d-806d-61c749a224bb admin admin] PATH_INFO: `/v3/projects/adee4aff2edc4a578c79cd852dda25ca/users/1e626d0f329f45e28cf2ae78d96d944b/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:38.111803 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1163/2340] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:01:38 2022] PUT /identity/v3/projects/89eaebd34c454131afd9a1c057dc475f/users/f422ed3060134bd298c7e2b19d3ae203/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:38.125534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41cee3-1550-4567-a4d7-ef2836dc7d4f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:38.125858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41cee3-1550-4567-a4d7-ef2836dc7d4f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:38.126079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41cee3-1550-4567-a4d7-ef2836dc7d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:38.149565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28013c60-4975-4c5d-806d-61c749a224bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=adee4aff2edc4a578c79cd852dda25ca, user_id=1e626d0f329f45e28cf2ae78d96d944b, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:38.152592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28013c60-4975-4c5d-806d-61c749a224bb admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:38.168871 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5d41cee3-1550-4567-a4d7-ef2836dc7d4f None None] MFA Rules not processed for user `f422ed3060134bd298c7e2b19d3ae203`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:38.171070 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5d41cee3-1550-4567-a4d7-ef2836dc7d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:38.181349 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1178/2341] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:01:37 2022] PUT /identity/v3/projects/adee4aff2edc4a578c79cd852dda25ca/users/1e626d0f329f45e28cf2ae78d96d944b/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:38.182968 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28013c60-4975-4c5d-806d-61c749a224bb admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:38.202140 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:38.262671 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28013c60-4975-4c5d-806d-61c749a224bb admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:38.267886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73381d-bcb8-405e-a354-1b09247e211c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:38.268569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73381d-bcb8-405e-a354-1b09247e211c admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:38.268921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73381d-bcb8-405e-a354-1b09247e211c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:38.269277 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73381d-bcb8-405e-a354-1b09247e211c admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:38.274362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd73381d-bcb8-405e-a354-1b09247e211c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:38.276522 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd73381d-bcb8-405e-a354-1b09247e211c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:38.278097 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1164/2342] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:38 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:38.291680 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1179/2343] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:01:38.292806 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41cee3-1550-4567-a4d7-ef2836dc7d4f None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:38.304431 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41cee3-1550-4567-a4d7-ef2836dc7d4f None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:38.309056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2aadaa-0dfa-40b7-a8a8-6b661bfd4157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:38.309754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2aadaa-0dfa-40b7-a8a8-6b661bfd4157 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:38.310028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2aadaa-0dfa-40b7-a8a8-6b661bfd4157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:38.310295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2aadaa-0dfa-40b7-a8a8-6b661bfd4157 admin admin] PATH_INFO: `/v3/projects/adee4aff2edc4a578c79cd852dda25ca/users/1e626d0f329f45e28cf2ae78d96d944b/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:38.312260 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2aadaa-0dfa-40b7-a8a8-6b661bfd4157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adee4aff2edc4a578c79cd852dda25ca, user_id=1e626d0f329f45e28cf2ae78d96d944b, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:38.316037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2aadaa-0dfa-40b7-a8a8-6b661bfd4157 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:38.331080 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1165/2344] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:01:38 2022] PUT /identity/v3/projects/adee4aff2edc4a578c79cd852dda25ca/users/1e626d0f329f45e28cf2ae78d96d944b/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:38.341757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bfc91-ad67-4fd8-a7ec-639eb0e6a38d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:38.342051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bfc91-ad67-4fd8-a7ec-639eb0e6a38d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:38.342247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bfc91-ad67-4fd8-a7ec-639eb0e6a38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:38.344456 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2aadaa-0dfa-40b7-a8a8-6b661bfd4157 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:38.346191 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8e2aadaa-0dfa-40b7-a8a8-6b661bfd4157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:38.372180 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c73bfc91-ad67-4fd8-a7ec-639eb0e6a38d None None] MFA Rules not processed for user `1e626d0f329f45e28cf2ae78d96d944b`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:38.373427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c73bfc91-ad67-4fd8-a7ec-639eb0e6a38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:38.456421 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2aadaa-0dfa-40b7-a8a8-6b661bfd4157 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:38.462452 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f56f1-ce08-4da4-a396-0fa3bb7677ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:38.463060 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f56f1-ce08-4da4-a396-0fa3bb7677ca service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:38.463336 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f56f1-ce08-4da4-a396-0fa3bb7677ca service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:38.463620 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f56f1-ce08-4da4-a396-0fa3bb7677ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:38.488015 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1180/2345] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:38.488927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bfc91-ad67-4fd8-a7ec-639eb0e6a38d None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:38.490442 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c73bfc91-ad67-4fd8-a7ec-639eb0e6a38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:38.525611 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f56f1-ce08-4da4-a396-0fa3bb7677ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:38.527199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f56f1-ce08-4da4-a396-0fa3bb7677ca service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:38.536567 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1166/2346] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:01:38 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:01:38.537786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c000dc-7c18-4b60-b5f2-133e4a1c1e18 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:38.538161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c000dc-7c18-4b60-b5f2-133e4a1c1e18 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:38.538438 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c000dc-7c18-4b60-b5f2-133e4a1c1e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:38.552158 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:38.559049 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d8c000dc-7c18-4b60-b5f2-133e4a1c1e18 None None] MFA Rules not processed for user `a4c913daf63c433287eaf338b4ab2070`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:38.560360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d8c000dc-7c18-4b60-b5f2-133e4a1c1e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:38.560578 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bfc91-ad67-4fd8-a7ec-639eb0e6a38d None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:38.567060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4ff98-c1d8-46aa-a858-bfae750fd148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:38.567694 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4ff98-c1d8-46aa-a858-bfae750fd148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:38.567970 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4ff98-c1d8-46aa-a858-bfae750fd148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:38.568246 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4ff98-c1d8-46aa-a858-bfae750fd148 admin admin] PATH_INFO: `/v3/users/90c2f38f38464a679231fa6538b22732` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:38.569375 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c4ff98-c1d8-46aa-a858-bfae750fd148 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90c2f38f38464a679231fa6538b22732)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:38.571449 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c4ff98-c1d8-46aa-a858-bfae750fd148 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:38.615172 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:38.627756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d7c4ff98-c1d8-46aa-a858-bfae750fd148 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90c2f38f38464a679231fa6538b22732'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:38.628427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d7c4ff98-c1d8-46aa-a858-bfae750fd148 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90c2f38f38464a679231fa6538b22732'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:38.635456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d7c4ff98-c1d8-46aa-a858-bfae750fd148 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90c2f38f38464a679231fa6538b22732'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:38.638628 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1167/2347] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:38.639734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c000dc-7c18-4b60-b5f2-133e4a1c1e18 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:38.641183 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d8c000dc-7c18-4b60-b5f2-133e4a1c1e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:38.646322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d7c4ff98-c1d8-46aa-a858-bfae750fd148 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90c2f38f38464a679231fa6538b22732'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:38.646962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d7c4ff98-c1d8-46aa-a858-bfae750fd148 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90c2f38f38464a679231fa6538b22732'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:38.659272 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c000dc-7c18-4b60-b5f2-133e4a1c1e18 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:38.664964 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed11773-b83e-41c0-ab38-cac7576049a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:38.666338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed11773-b83e-41c0-ab38-cac7576049a4 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:38.666338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed11773-b83e-41c0-ab38-cac7576049a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:38.666338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed11773-b83e-41c0-ab38-cac7576049a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:38.668093 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1ed11773-b83e-41c0-ab38-cac7576049a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:38.673519 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1181/2348] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:01:38 2022] DELETE /identity/v3/users/90c2f38f38464a679231fa6538b22732 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:38.678571 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57b9c9-e5bc-424d-891e-065460293599 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:38.678866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57b9c9-e5bc-424d-891e-065460293599 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:38.679211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57b9c9-e5bc-424d-891e-065460293599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:38.702445 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-0e57b9c9-e5bc-424d-891e-065460293599 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:38.703666 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0e57b9c9-e5bc-424d-891e-065460293599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:38.745088 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed11773-b83e-41c0-ab38-cac7576049a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:38.746732 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed11773-b83e-41c0-ab38-cac7576049a4 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:38.772775 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1168/2349] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:01:38 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:01:38.774894 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed11773-b83e-41c0-ab38-cac7576049a4 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:38.776164 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1ed11773-b83e-41c0-ab38-cac7576049a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:38.790642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed11773-b83e-41c0-ab38-cac7576049a4 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:38.801473 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1182/2350] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:01:38.812292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57b9c9-e5bc-424d-891e-065460293599 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:38.813996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0e57b9c9-e5bc-424d-891e-065460293599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:38.897931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57b9c9-e5bc-424d-891e-065460293599 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:38.902911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdcf70-4f27-4f1b-98a0-df6f143c5af7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:38.904723 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdcf70-4f27-4f1b-98a0-df6f143c5af7 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:38.905028 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdcf70-4f27-4f1b-98a0-df6f143c5af7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:38.905305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdcf70-4f27-4f1b-98a0-df6f143c5af7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:38.907482 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f533be-58f6-4d02-a083-6592ec0bf58e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:38.908204 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f533be-58f6-4d02-a083-6592ec0bf58e service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:38.908552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f533be-58f6-4d02-a083-6592ec0bf58e service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:38.908891 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f533be-58f6-4d02-a083-6592ec0bf58e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:38.910794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a9f533be-58f6-4d02-a083-6592ec0bf58e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:38.916797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bdcf70-4f27-4f1b-98a0-df6f143c5af7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:38.920516 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bdcf70-4f27-4f1b-98a0-df6f143c5af7 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:38.931566 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1183/2351] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:01:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:01:39.003626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f533be-58f6-4d02-a083-6592ec0bf58e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:39.005986 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f533be-58f6-4d02-a083-6592ec0bf58e service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:39.016288 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1169/2352] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:01:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:01:39.474296 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdcf70-4f27-4f1b-98a0-df6f143c5af7 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:39.477245 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-70bdcf70-4f27-4f1b-98a0-df6f143c5af7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:39.532305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdcf70-4f27-4f1b-98a0-df6f143c5af7 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:39.556367 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17531e-6fd1-4293-ac28-8ff88ab3bec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:39.557719 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17531e-6fd1-4293-ac28-8ff88ab3bec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:39.559257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17531e-6fd1-4293-ac28-8ff88ab3bec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:39.559694 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17531e-6fd1-4293-ac28-8ff88ab3bec6 admin admin] PATH_INFO: `/v3/projects/073ad976898c4f8ea817b4f200b50e8c` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:39.561100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab17531e-6fd1-4293-ac28-8ff88ab3bec6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=073ad976898c4f8ea817b4f200b50e8c)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:39.563106 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab17531e-6fd1-4293-ac28-8ff88ab3bec6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:39.585126 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:39.622595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ab17531e-6fd1-4293-ac28-8ff88ab3bec6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '073ad976898c4f8ea817b4f200b50e8c', 'request_id': 'req-ab17531e-6fd1-4293-ac28-8ff88ab3bec6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:39.641558 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ab17531e-6fd1-4293-ac28-8ff88ab3bec6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '073ad976898c4f8ea817b4f200b50e8c', 'request_id': 'req-ab17531e-6fd1-4293-ac28-8ff88ab3bec6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:39.652793 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ab17531e-6fd1-4293-ac28-8ff88ab3bec6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '073ad976898c4f8ea817b4f200b50e8c', 'request_id': 'req-ab17531e-6fd1-4293-ac28-8ff88ab3bec6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:39.682801 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ab17531e-6fd1-4293-ac28-8ff88ab3bec6 admin admin] The token cache is being invalidate because project 073ad976898c4f8ea817b4f200b50e8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:01:39.683209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ab17531e-6fd1-4293-ac28-8ff88ab3bec6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:39.683950 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ab17531e-6fd1-4293-ac28-8ff88ab3bec6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:39.689924 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1184/2353] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:01:39 2022] DELETE /identity/v3/projects/073ad976898c4f8ea817b4f200b50e8c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:39.691266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f533be-58f6-4d02-a083-6592ec0bf58e service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:39.709885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f533be-58f6-4d02-a083-6592ec0bf58e service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:39.739260 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:39.747133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17531e-6fd1-4293-ac28-8ff88ab3bec6 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:39.748690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ab17531e-6fd1-4293-ac28-8ff88ab3bec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:39.808156 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592c3e2-56e5-4552-acce-54d80afe7807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:39.808880 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592c3e2-56e5-4552-acce-54d80afe7807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:39.809243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592c3e2-56e5-4552-acce-54d80afe7807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:39.809598 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592c3e2-56e5-4552-acce-54d80afe7807 admin admin] PATH_INFO: `/v3/users/addfabe3dfaf49c189d4c834ffc55ef0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:39.810784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592c3e2-56e5-4552-acce-54d80afe7807 admin admin] RBAC: Authorizing `identity:delete_user(user_id=addfabe3dfaf49c189d4c834ffc55ef0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:39.812744 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592c3e2-56e5-4552-acce-54d80afe7807 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:39.851091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17531e-6fd1-4293-ac28-8ff88ab3bec6 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:39.859806 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112748e6-c7f2-4e20-ac2e-bd4a03e3174f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:39.862560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112748e6-c7f2-4e20-ac2e-bd4a03e3174f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:39.863211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112748e6-c7f2-4e20-ac2e-bd4a03e3174f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:39.863668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112748e6-c7f2-4e20-ac2e-bd4a03e3174f admin admin] PATH_INFO: `/v3/users/ef8ea76acc2142af83ff880df9c144b8` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:39.865453 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112748e6-c7f2-4e20-ac2e-bd4a03e3174f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef8ea76acc2142af83ff880df9c144b8)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:39.868151 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112748e6-c7f2-4e20-ac2e-bd4a03e3174f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:39.915897 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1592c3e2-56e5-4552-acce-54d80afe7807 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'addfabe3dfaf49c189d4c834ffc55ef0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:39.916560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1592c3e2-56e5-4552-acce-54d80afe7807 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'addfabe3dfaf49c189d4c834ffc55ef0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:39.938817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1592c3e2-56e5-4552-acce-54d80afe7807 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'addfabe3dfaf49c189d4c834ffc55ef0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:39.952994 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1592c3e2-56e5-4552-acce-54d80afe7807 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'addfabe3dfaf49c189d4c834ffc55ef0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:39.953733 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1592c3e2-56e5-4552-acce-54d80afe7807 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'addfabe3dfaf49c189d4c834ffc55ef0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:39.979926 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1170/2354] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:01:39 2022] DELETE /identity/v3/users/addfabe3dfaf49c189d4c834ffc55ef0 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:39.988277 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-112748e6-c7f2-4e20-ac2e-bd4a03e3174f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef8ea76acc2142af83ff880df9c144b8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:39.988950 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-112748e6-c7f2-4e20-ac2e-bd4a03e3174f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef8ea76acc2142af83ff880df9c144b8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:39.998162 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-112748e6-c7f2-4e20-ac2e-bd4a03e3174f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef8ea76acc2142af83ff880df9c144b8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:40.008185 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-112748e6-c7f2-4e20-ac2e-bd4a03e3174f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef8ea76acc2142af83ff880df9c144b8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:40.009859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-112748e6-c7f2-4e20-ac2e-bd4a03e3174f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef8ea76acc2142af83ff880df9c144b8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:40.031667 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1185/2355] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:01:39 2022] DELETE /identity/v3/users/ef8ea76acc2142af83ff880df9c144b8 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:40.036662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0a56a-015b-444c-9396-05f24c287552 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:40.037006 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0a56a-015b-444c-9396-05f24c287552 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:40.037288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0a56a-015b-444c-9396-05f24c287552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:40.063194 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c7c0a56a-015b-444c-9396-05f24c287552 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:40.065307 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c7c0a56a-015b-444c-9396-05f24c287552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:40.173014 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1171/2356] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:40.214005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112748e6-c7f2-4e20-ac2e-bd4a03e3174f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:40.215562 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-112748e6-c7f2-4e20-ac2e-bd4a03e3174f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:40.275172 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:40.339617 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112748e6-c7f2-4e20-ac2e-bd4a03e3174f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:40.347029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ad119-48d7-470d-a829-b7f9b78c6046 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:40.348190 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ad119-48d7-470d-a829-b7f9b78c6046 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:40.348543 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ad119-48d7-470d-a829-b7f9b78c6046 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:40.348889 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ad119-48d7-470d-a829-b7f9b78c6046 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:40.361783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ad119-48d7-470d-a829-b7f9b78c6046 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:40.364800 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ad119-48d7-470d-a829-b7f9b78c6046 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:40.380515 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1186/2357] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:01:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:01:40.656613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0a56a-015b-444c-9396-05f24c287552 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:40.658782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c7c0a56a-015b-444c-9396-05f24c287552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:40.690445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0a56a-015b-444c-9396-05f24c287552 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:40.701821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e10bb-3fae-48b8-9ba2-ca47727b669c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:40.701821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e10bb-3fae-48b8-9ba2-ca47727b669c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:40.701821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e10bb-3fae-48b8-9ba2-ca47727b669c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:40.703456 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e10bb-3fae-48b8-9ba2-ca47727b669c admin admin] PATH_INFO: `/v3/projects/aed82ba4d57841b2ab266c82ba838918` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:40.705029 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e10bb-3fae-48b8-9ba2-ca47727b669c admin admin] RBAC: Authorizing `identity:delete_project(project_id=aed82ba4d57841b2ab266c82ba838918)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:40.709983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e10bb-3fae-48b8-9ba2-ca47727b669c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:40.818705 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:40.839163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ba5e10bb-3fae-48b8-9ba2-ca47727b669c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aed82ba4d57841b2ab266c82ba838918', 'request_id': 'req-ba5e10bb-3fae-48b8-9ba2-ca47727b669c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:40.856604 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ba5e10bb-3fae-48b8-9ba2-ca47727b669c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aed82ba4d57841b2ab266c82ba838918', 'request_id': 'req-ba5e10bb-3fae-48b8-9ba2-ca47727b669c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:40.869113 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ba5e10bb-3fae-48b8-9ba2-ca47727b669c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aed82ba4d57841b2ab266c82ba838918', 'request_id': 'req-ba5e10bb-3fae-48b8-9ba2-ca47727b669c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:40.891123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ba5e10bb-3fae-48b8-9ba2-ca47727b669c admin admin] The token cache is being invalidate because project aed82ba4d57841b2ab266c82ba838918 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:01:40.891424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ba5e10bb-3fae-48b8-9ba2-ca47727b669c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:40.894505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ba5e10bb-3fae-48b8-9ba2-ca47727b669c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:40.899576 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1172/2358] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:01:40 2022] DELETE /identity/v3/projects/aed82ba4d57841b2ab266c82ba838918 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:40.904881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8b883-0ec4-4ac7-a2f1-0846710cd39c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:40.905385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8b883-0ec4-4ac7-a2f1-0846710cd39c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:40.905588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8b883-0ec4-4ac7-a2f1-0846710cd39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:40.942465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e0a8b883-0ec4-4ac7-a2f1-0846710cd39c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:40.943706 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e0a8b883-0ec4-4ac7-a2f1-0846710cd39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:41.107650 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1187/2359] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:41.115799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26994c-114f-4a7a-a4c0-22b5ec8307f3 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:41.116996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26994c-114f-4a7a-a4c0-22b5ec8307f3 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:41.118192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26994c-114f-4a7a-a4c0-22b5ec8307f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:41.158637 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-fc26994c-114f-4a7a-a4c0-22b5ec8307f3 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:41.161499 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-fc26994c-114f-4a7a-a4c0-22b5ec8307f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:41.182515 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1173/2360] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:41.187259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8b883-0ec4-4ac7-a2f1-0846710cd39c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:41.202244 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26994c-114f-4a7a-a4c0-22b5ec8307f3 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:41.203676 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8b883-0ec4-4ac7-a2f1-0846710cd39c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:41.204332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-fc26994c-114f-4a7a-a4c0-22b5ec8307f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:41.218956 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4e080-227f-47d8-8ea7-7d4cf9c93fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:41.219595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4e080-227f-47d8-8ea7-7d4cf9c93fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:41.219940 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4e080-227f-47d8-8ea7-7d4cf9c93fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:41.220434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4e080-227f-47d8-8ea7-7d4cf9c93fe4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:41.221108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4e080-227f-47d8-8ea7-7d4cf9c93fe4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:01:41.221425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4e080-227f-47d8-8ea7-7d4cf9c93fe4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:41.221696 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26994c-114f-4a7a-a4c0-22b5ec8307f3 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:41.229013 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4e080-227f-47d8-8ea7-7d4cf9c93fe4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:41.239565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3af7e-72bf-44e3-9316-50b8366ff4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:41.240298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3af7e-72bf-44e3-9316-50b8366ff4f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:41.240797 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3af7e-72bf-44e3-9316-50b8366ff4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:41.242762 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3af7e-72bf-44e3-9316-50b8366ff4f2 admin admin] PATH_INFO: `/v3/projects/d27aee1d9b5b41b3bb8abc684bc9d8d0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:41.244738 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b3af7e-72bf-44e3-9316-50b8366ff4f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d27aee1d9b5b41b3bb8abc684bc9d8d0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:41.249020 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b3af7e-72bf-44e3-9316-50b8366ff4f2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:41.257391 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1188/2361] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:01:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:01:41.261378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4e080-227f-47d8-8ea7-7d4cf9c93fe4 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:41.284885 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4e080-227f-47d8-8ea7-7d4cf9c93fe4 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:41.308181 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b294272-ee3c-4f27-b7fd-2d9be224919b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:41.308815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b294272-ee3c-4f27-b7fd-2d9be224919b admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:41.309096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b294272-ee3c-4f27-b7fd-2d9be224919b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:41.309371 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b294272-ee3c-4f27-b7fd-2d9be224919b admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:41.320433 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b294272-ee3c-4f27-b7fd-2d9be224919b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:41.338144 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b294272-ee3c-4f27-b7fd-2d9be224919b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:41.393234 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-75b3af7e-72bf-44e3-9316-50b8366ff4f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd27aee1d9b5b41b3bb8abc684bc9d8d0', 'request_id': 'req-75b3af7e-72bf-44e3-9316-50b8366ff4f2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:41.405090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-75b3af7e-72bf-44e3-9316-50b8366ff4f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd27aee1d9b5b41b3bb8abc684bc9d8d0', 'request_id': 'req-75b3af7e-72bf-44e3-9316-50b8366ff4f2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:41.415548 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1189/2362] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:01:41 2022] POST /identity/v3/projects => generated 375 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:01:41.415747 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-75b3af7e-72bf-44e3-9316-50b8366ff4f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd27aee1d9b5b41b3bb8abc684bc9d8d0', 'request_id': 'req-75b3af7e-72bf-44e3-9316-50b8366ff4f2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:41.418546 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b294272-ee3c-4f27-b7fd-2d9be224919b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:41.430119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-75b3af7e-72bf-44e3-9316-50b8366ff4f2 admin admin] The token cache is being invalidate because project d27aee1d9b5b41b3bb8abc684bc9d8d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:01:41.430416 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-75b3af7e-72bf-44e3-9316-50b8366ff4f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:41.431094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-75b3af7e-72bf-44e3-9316-50b8366ff4f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:41.435811 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1174/2363] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:01:41 2022] DELETE /identity/v3/projects/d27aee1d9b5b41b3bb8abc684bc9d8d0 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:41.439809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3af7e-72bf-44e3-9316-50b8366ff4f2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:41.441821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-75b3af7e-72bf-44e3-9316-50b8366ff4f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:41.600308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3af7e-72bf-44e3-9316-50b8366ff4f2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:41.630649 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b294272-ee3c-4f27-b7fd-2d9be224919b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:41.636723 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6627e4b-e3a7-42c7-81d6-f028fa0e0bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:41.637478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6627e4b-e3a7-42c7-81d6-f028fa0e0bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:41.637853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6627e4b-e3a7-42c7-81d6-f028fa0e0bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:41.638407 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6627e4b-e3a7-42c7-81d6-f028fa0e0bc8 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:41.639239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6627e4b-e3a7-42c7-81d6-f028fa0e0bc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:41.642687 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6627e4b-e3a7-42c7-81d6-f028fa0e0bc8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:41.679956 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1190/2364] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:01:41 2022] POST /identity/v3/users => generated 288 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:01:41.684783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6627e4b-e3a7-42c7-81d6-f028fa0e0bc8 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:41.694107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c6627e4b-e3a7-42c7-81d6-f028fa0e0bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:41.722095 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6627e4b-e3a7-42c7-81d6-f028fa0e0bc8 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:41.732596 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:41.747215 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261eac58-8d8e-42df-b793-7222c1f7eb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:41.747885 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261eac58-8d8e-42df-b793-7222c1f7eb6d admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:41.748166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261eac58-8d8e-42df-b793-7222c1f7eb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:41.748441 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261eac58-8d8e-42df-b793-7222c1f7eb6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:41.751633 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261eac58-8d8e-42df-b793-7222c1f7eb6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:41.753358 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261eac58-8d8e-42df-b793-7222c1f7eb6d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:41.770854 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb815b-088d-43bf-9f9d-0e8c7e028cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:41.771575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb815b-088d-43bf-9f9d-0e8c7e028cb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:41.771853 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb815b-088d-43bf-9f9d-0e8c7e028cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:41.772125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb815b-088d-43bf-9f9d-0e8c7e028cb0 admin admin] PATH_INFO: `/v3/users/f422ed3060134bd298c7e2b19d3ae203` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:41.774403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb815b-088d-43bf-9f9d-0e8c7e028cb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f422ed3060134bd298c7e2b19d3ae203)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:41.776713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb815b-088d-43bf-9f9d-0e8c7e028cb0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:41.785167 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1191/2365] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:01:41.787150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261eac58-8d8e-42df-b793-7222c1f7eb6d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:41.804998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261eac58-8d8e-42df-b793-7222c1f7eb6d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:41.819598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a0ec0-c84f-4033-8fb4-d6606aec7267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:41.820580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a0ec0-c84f-4033-8fb4-d6606aec7267 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:41.820911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a0ec0-c84f-4033-8fb4-d6606aec7267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:41.821188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a0ec0-c84f-4033-8fb4-d6606aec7267 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:41.821860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a0ec0-c84f-4033-8fb4-d6606aec7267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:41.823961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a0ec0-c84f-4033-8fb4-d6606aec7267 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:41.832083 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:41.852507 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1192/2366] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:01:41.855283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a0ec0-c84f-4033-8fb4-d6606aec7267 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:41.873246 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a0ec0-c84f-4033-8fb4-d6606aec7267 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:41.878852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286c842-b8db-4cd0-b18f-acfb1ac4838d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:41.879295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286c842-b8db-4cd0-b18f-acfb1ac4838d admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:41.879423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6dfb815b-088d-43bf-9f9d-0e8c7e028cb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f422ed3060134bd298c7e2b19d3ae203'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:41.879570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286c842-b8db-4cd0-b18f-acfb1ac4838d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:41.879920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286c842-b8db-4cd0-b18f-acfb1ac4838d admin admin] PATH_INFO: `/v3/projects/8f6e69d6f84b4c2ea356167a93d86b65/users/0686ed48f80c42689017595920a47eef/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:41.880395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6dfb815b-088d-43bf-9f9d-0e8c7e028cb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f422ed3060134bd298c7e2b19d3ae203'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:41.893058 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6dfb815b-088d-43bf-9f9d-0e8c7e028cb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f422ed3060134bd298c7e2b19d3ae203'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:41.906302 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6dfb815b-088d-43bf-9f9d-0e8c7e028cb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f422ed3060134bd298c7e2b19d3ae203'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:41.907132 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6dfb815b-088d-43bf-9f9d-0e8c7e028cb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f422ed3060134bd298c7e2b19d3ae203'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:41.922362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286c842-b8db-4cd0-b18f-acfb1ac4838d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f6e69d6f84b4c2ea356167a93d86b65, user_id=0686ed48f80c42689017595920a47eef, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:41.933469 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286c842-b8db-4cd0-b18f-acfb1ac4838d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:41.945492 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1175/2367] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:01:41 2022] DELETE /identity/v3/users/f422ed3060134bd298c7e2b19d3ae203 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:41.960062 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1193/2368] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:01:41 2022] PUT /identity/v3/projects/8f6e69d6f84b4c2ea356167a93d86b65/users/0686ed48f80c42689017595920a47eef/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:41.971063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576146fa-41fe-4eda-89f0-f504f42f150f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:41.971349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576146fa-41fe-4eda-89f0-f504f42f150f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:41.971615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576146fa-41fe-4eda-89f0-f504f42f150f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:42.001712 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-576146fa-41fe-4eda-89f0-f504f42f150f None None] MFA Rules not processed for user `0686ed48f80c42689017595920a47eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:42.002950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-576146fa-41fe-4eda-89f0-f504f42f150f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:42.094310 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1176/2369] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:01:42.100300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286c842-b8db-4cd0-b18f-acfb1ac4838d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:42.104047 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9286c842-b8db-4cd0-b18f-acfb1ac4838d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:42.192601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286c842-b8db-4cd0-b18f-acfb1ac4838d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:42.198083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c91b40-3c33-4bfd-ac23-acb7f64a33d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:42.198688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c91b40-3c33-4bfd-ac23-acb7f64a33d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:42.198968 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c91b40-3c33-4bfd-ac23-acb7f64a33d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:42.199244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c91b40-3c33-4bfd-ac23-acb7f64a33d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:42.199899 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c91b40-3c33-4bfd-ac23-acb7f64a33d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:42.202007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c91b40-3c33-4bfd-ac23-acb7f64a33d4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:42.243408 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1194/2370] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:01:42 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:01:42.249007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576146fa-41fe-4eda-89f0-f504f42f150f None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:42.259261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576146fa-41fe-4eda-89f0-f504f42f150f None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:42.333804 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:42.341327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752ab87-bddc-4a50-b662-288a4eaff3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:42.342208 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752ab87-bddc-4a50-b662-288a4eaff3d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:42.342670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752ab87-bddc-4a50-b662-288a4eaff3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:42.343072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752ab87-bddc-4a50-b662-288a4eaff3d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:42.343949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752ab87-bddc-4a50-b662-288a4eaff3d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:42.346827 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752ab87-bddc-4a50-b662-288a4eaff3d2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:42.375742 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1177/2371] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:01:42 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:01:42.394500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c91b40-3c33-4bfd-ac23-acb7f64a33d4 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:42.405211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c91b40-3c33-4bfd-ac23-acb7f64a33d4 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:42.411411 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec8710-7c34-4e05-8e68-c80ac0edfcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:42.412029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec8710-7c34-4e05-8e68-c80ac0edfcc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:42.412306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec8710-7c34-4e05-8e68-c80ac0edfcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:42.412574 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec8710-7c34-4e05-8e68-c80ac0edfcc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:42.413266 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec8710-7c34-4e05-8e68-c80ac0edfcc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:42.414909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec8710-7c34-4e05-8e68-c80ac0edfcc7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:42.433186 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1195/2372] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:01:42.434486 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752ab87-bddc-4a50-b662-288a4eaff3d2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:42.453150 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752ab87-bddc-4a50-b662-288a4eaff3d2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:42.465365 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1c68f-9358-420e-a007-f266cdb5659a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:42.466303 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1c68f-9358-420e-a007-f266cdb5659a admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:42.466770 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1c68f-9358-420e-a007-f266cdb5659a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:42.467855 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1c68f-9358-420e-a007-f266cdb5659a admin admin] PATH_INFO: `/v3/projects/55e8361b0a0444d5900e37eff8dcea41/users/2d85d793b82c4b47983e9087eddec6a1/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:42.488376 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1c68f-9358-420e-a007-f266cdb5659a admin admin] RBAC: Authorizing `identity:create_grant(project_id=55e8361b0a0444d5900e37eff8dcea41, user_id=2d85d793b82c4b47983e9087eddec6a1, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:42.491390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1c68f-9358-420e-a007-f266cdb5659a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:42.503279 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec8710-7c34-4e05-8e68-c80ac0edfcc7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:42.505276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8dec8710-7c34-4e05-8e68-c80ac0edfcc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:42.525977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec8710-7c34-4e05-8e68-c80ac0edfcc7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:42.537405 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1178/2373] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:01:42 2022] PUT /identity/v3/projects/55e8361b0a0444d5900e37eff8dcea41/users/2d85d793b82c4b47983e9087eddec6a1/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:42.538562 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1c68f-9358-420e-a007-f266cdb5659a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:42.600295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e40cc-a21b-4f7d-86ff-4b0bf0640190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:42.601196 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e40cc-a21b-4f7d-86ff-4b0bf0640190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:42.601659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e40cc-a21b-4f7d-86ff-4b0bf0640190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:42.608635 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e40cc-a21b-4f7d-86ff-4b0bf0640190 admin admin] PATH_INFO: `/v3/projects/89eaebd34c454131afd9a1c057dc475f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:42.611088 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06e40cc-a21b-4f7d-86ff-4b0bf0640190 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89eaebd34c454131afd9a1c057dc475f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:42.613044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06e40cc-a21b-4f7d-86ff-4b0bf0640190 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:42.679592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1c68f-9358-420e-a007-f266cdb5659a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:42.708197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f06e40cc-a21b-4f7d-86ff-4b0bf0640190 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89eaebd34c454131afd9a1c057dc475f', 'request_id': 'req-f06e40cc-a21b-4f7d-86ff-4b0bf0640190'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:42.713423 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:42.731778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f06e40cc-a21b-4f7d-86ff-4b0bf0640190 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89eaebd34c454131afd9a1c057dc475f', 'request_id': 'req-f06e40cc-a21b-4f7d-86ff-4b0bf0640190'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:42.741275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f06e40cc-a21b-4f7d-86ff-4b0bf0640190 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89eaebd34c454131afd9a1c057dc475f', 'request_id': 'req-f06e40cc-a21b-4f7d-86ff-4b0bf0640190'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:42.797977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f06e40cc-a21b-4f7d-86ff-4b0bf0640190 admin admin] The token cache is being invalidate because project 89eaebd34c454131afd9a1c057dc475f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:01:42.798277 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f06e40cc-a21b-4f7d-86ff-4b0bf0640190 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:42.799986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f06e40cc-a21b-4f7d-86ff-4b0bf0640190 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:42.805540 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1196/2374] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:01:42 2022] DELETE /identity/v3/projects/89eaebd34c454131afd9a1c057dc475f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:42.813304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1ce29-c145-4e58-b627-057806791e2a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:42.813587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1ce29-c145-4e58-b627-057806791e2a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:42.814112 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1ce29-c145-4e58-b627-057806791e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:42.865738 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76150f65-20c2-4d91-aa7e-a9590e8d04a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:42.866699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76150f65-20c2-4d91-aa7e-a9590e8d04a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:42.867467 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76150f65-20c2-4d91-aa7e-a9590e8d04a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:42.867467 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76150f65-20c2-4d91-aa7e-a9590e8d04a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:42.868722 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76150f65-20c2-4d91-aa7e-a9590e8d04a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:42.874800 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76150f65-20c2-4d91-aa7e-a9590e8d04a4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:42.882595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e1c1ce29-c145-4e58-b627-057806791e2a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:42.884186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e1c1ce29-c145-4e58-b627-057806791e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:42.898781 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1179/2375] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:01:42.902791 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76150f65-20c2-4d91-aa7e-a9590e8d04a4 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:42.905487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-76150f65-20c2-4d91-aa7e-a9590e8d04a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:42.908368 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1197/2376] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:42.914467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e922d-3837-48af-936f-fa183a73fa1f None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:42.914761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e922d-3837-48af-936f-fa183a73fa1f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:42.915023 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e922d-3837-48af-936f-fa183a73fa1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:42.932538 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76150f65-20c2-4d91-aa7e-a9590e8d04a4 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:42.938630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9f42f-49aa-43bb-bc06-7d515cb2add3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:42.940025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9f42f-49aa-43bb-bc06-7d515cb2add3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:42.940375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9f42f-49aa-43bb-bc06-7d515cb2add3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:42.940715 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9f42f-49aa-43bb-bc06-7d515cb2add3 admin admin] PATH_INFO: `/v3/projects/55e8361b0a0444d5900e37eff8dcea41/users/2d85d793b82c4b47983e9087eddec6a1/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:42.942877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c9f42f-49aa-43bb-bc06-7d515cb2add3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55e8361b0a0444d5900e37eff8dcea41, user_id=2d85d793b82c4b47983e9087eddec6a1, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:42.948262 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c9f42f-49aa-43bb-bc06-7d515cb2add3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:42.979665 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1180/2377] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:01:42 2022] PUT /identity/v3/projects/55e8361b0a0444d5900e37eff8dcea41/users/2d85d793b82c4b47983e9087eddec6a1/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:42.980809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-7e2e922d-3837-48af-936f-fa183a73fa1f None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:42.981531 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db9370-1e42-4400-bcc1-9680e5641ef2 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:42.981531 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db9370-1e42-4400-bcc1-9680e5641ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:42.981531 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db9370-1e42-4400-bcc1-9680e5641ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:42.987825 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7e2e922d-3837-48af-936f-fa183a73fa1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:43.071190 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d5db9370-1e42-4400-bcc1-9680e5641ef2 None None] MFA Rules not processed for user `2d85d793b82c4b47983e9087eddec6a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:43.071190 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d5db9370-1e42-4400-bcc1-9680e5641ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:43.107884 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1198/2378] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:43.114481 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e922d-3837-48af-936f-fa183a73fa1f None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:43.136921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e922d-3837-48af-936f-fa183a73fa1f None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:43.146868 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec32189-9d9a-4bf4-8456-d9aa2428ef45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:43.147555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec32189-9d9a-4bf4-8456-d9aa2428ef45 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:43.147847 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec32189-9d9a-4bf4-8456-d9aa2428ef45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:43.148112 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec32189-9d9a-4bf4-8456-d9aa2428ef45 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:43.148773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec32189-9d9a-4bf4-8456-d9aa2428ef45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:01:43.149086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec32189-9d9a-4bf4-8456-d9aa2428ef45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:43.151796 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec32189-9d9a-4bf4-8456-d9aa2428ef45 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:43.185657 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:43.189241 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1199/2379] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:01:43.193731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec32189-9d9a-4bf4-8456-d9aa2428ef45 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:43.212143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec32189-9d9a-4bf4-8456-d9aa2428ef45 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:43.223477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61320626-692f-4253-b3ff-edac20472c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:43.224349 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61320626-692f-4253-b3ff-edac20472c5f admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:43.224802 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61320626-692f-4253-b3ff-edac20472c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:43.225222 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61320626-692f-4253-b3ff-edac20472c5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:43.226070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61320626-692f-4253-b3ff-edac20472c5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:43.228407 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61320626-692f-4253-b3ff-edac20472c5f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:43.240753 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1181/2380] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:01:43.242304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db9370-1e42-4400-bcc1-9680e5641ef2 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:43.253215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db9370-1e42-4400-bcc1-9680e5641ef2 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:43.263563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cdfbc-9b01-417c-8c2c-c256502e80ff tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d85d793b82c4b47983e9087eddec6a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e8361b0a0444d5900e37eff8dcea41', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:43.264198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cdfbc-9b01-417c-8c2c-c256502e80ff tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:43.264591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cdfbc-9b01-417c-8c2c-c256502e80ff tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:43.264854 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cdfbc-9b01-417c-8c2c-c256502e80ff tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:43.265817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87cdfbc-9b01-417c-8c2c-c256502e80ff tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:01:43.266167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87cdfbc-9b01-417c-8c2c-c256502e80ff tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:43.268338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87cdfbc-9b01-417c-8c2c-c256502e80ff tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:43.283839 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1182/2381] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:01:43.287916 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cdfbc-9b01-417c-8c2c-c256502e80ff tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:43.291814 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1200/2382] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:01:43 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:01:43.295694 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61320626-692f-4253-b3ff-edac20472c5f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:43.314122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cdfbc-9b01-417c-8c2c-c256502e80ff tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:43.401934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261a8ee-6fc4-4a4c-a85a-24abdb989491 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d85d793b82c4b47983e9087eddec6a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e8361b0a0444d5900e37eff8dcea41', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:43.403352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261a8ee-6fc4-4a4c-a85a-24abdb989491 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:43.403352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261a8ee-6fc4-4a4c-a85a-24abdb989491 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:43.403352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261a8ee-6fc4-4a4c-a85a-24abdb989491 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:43.405150 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2261a8ee-6fc4-4a4c-a85a-24abdb989491 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:43.410667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2261a8ee-6fc4-4a4c-a85a-24abdb989491 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:43.435079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61320626-692f-4253-b3ff-edac20472c5f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:43.452607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49691d-a75e-45ec-a38c-8e6d9f2c189e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:43.452607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49691d-a75e-45ec-a38c-8e6d9f2c189e admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:43.452607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49691d-a75e-45ec-a38c-8e6d9f2c189e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:43.452607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49691d-a75e-45ec-a38c-8e6d9f2c189e admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:43.453066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed49691d-a75e-45ec-a38c-8e6d9f2c189e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:43.459721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed49691d-a75e-45ec-a38c-8e6d9f2c189e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:43.506487 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1183/2383] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:01:43 2022] POST /identity/v3/projects => generated 371 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:01:43.510193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261a8ee-6fc4-4a4c-a85a-24abdb989491 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:43.511597 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1201/2384] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:01:43 2022] POST /identity/v3/users => generated 288 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:01:43.512496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49691d-a75e-45ec-a38c-8e6d9f2c189e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:43.527927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49691d-a75e-45ec-a38c-8e6d9f2c189e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:43.560772 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:43.624979 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261a8ee-6fc4-4a4c-a85a-24abdb989491 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:43.640443 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5b21e-8b73-459b-9271-db677380757e tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d85d793b82c4b47983e9087eddec6a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e8361b0a0444d5900e37eff8dcea41', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:43.641069 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5b21e-8b73-459b-9271-db677380757e tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:43.641342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5b21e-8b73-459b-9271-db677380757e tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:43.641640 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5b21e-8b73-459b-9271-db677380757e tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:43.642830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5b21e-8b73-459b-9271-db677380757e tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:01:43.643135 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5b21e-8b73-459b-9271-db677380757e tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:43.644743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5b21e-8b73-459b-9271-db677380757e tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:43.650759 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdab5b3-46ea-4a90-9105-f3e3095a5f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:43.651846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdab5b3-46ea-4a90-9105-f3e3095a5f00 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:43.652320 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdab5b3-46ea-4a90-9105-f3e3095a5f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:43.652781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdab5b3-46ea-4a90-9105-f3e3095a5f00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:43.653631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdab5b3-46ea-4a90-9105-f3e3095a5f00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:43.655762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdab5b3-46ea-4a90-9105-f3e3095a5f00 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:43.674379 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1184/2385] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:01:43.680267 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1202/2386] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:01:43.683999 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5b21e-8b73-459b-9271-db677380757e tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:43.696213 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5b21e-8b73-459b-9271-db677380757e tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:43.701200 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba43806-8d4d-4cb5-b9d7-a19c4aed30a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:43.701869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba43806-8d4d-4cb5-b9d7-a19c4aed30a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:43.702276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba43806-8d4d-4cb5-b9d7-a19c4aed30a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:43.702562 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba43806-8d4d-4cb5-b9d7-a19c4aed30a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:43.703454 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba43806-8d4d-4cb5-b9d7-a19c4aed30a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:43.705605 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba43806-8d4d-4cb5-b9d7-a19c4aed30a3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:43.717470 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1185/2387] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:01:43.722521 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdab5b3-46ea-4a90-9105-f3e3095a5f00 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:43.733333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdab5b3-46ea-4a90-9105-f3e3095a5f00 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:43.739875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca550a5-7503-4a51-934b-0aabffffe8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:43.740545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca550a5-7503-4a51-934b-0aabffffe8f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:43.740825 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca550a5-7503-4a51-934b-0aabffffe8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:43.741100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca550a5-7503-4a51-934b-0aabffffe8f2 admin admin] PATH_INFO: `/v3/projects/71065b18e3d44e2e8ba4f00954988ea7/users/7c4f37489333488291462da78b38a7a1/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:43.758985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca550a5-7503-4a51-934b-0aabffffe8f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71065b18e3d44e2e8ba4f00954988ea7, user_id=7c4f37489333488291462da78b38a7a1, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:43.762374 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca550a5-7503-4a51-934b-0aabffffe8f2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:43.769115 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba43806-8d4d-4cb5-b9d7-a19c4aed30a3 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:43.779145 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5ba43806-8d4d-4cb5-b9d7-a19c4aed30a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:43.794053 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1203/2388] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:01:43 2022] PUT /identity/v3/projects/71065b18e3d44e2e8ba4f00954988ea7/users/7c4f37489333488291462da78b38a7a1/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:43.804648 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f068b-5b10-4a11-b8cd-44db12398fb3 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:43.805033 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f068b-5b10-4a11-b8cd-44db12398fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:43.805187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f068b-5b10-4a11-b8cd-44db12398fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:43.830868 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:43.841060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-d59f068b-5b10-4a11-b8cd-44db12398fb3 None None] MFA Rules not processed for user `7c4f37489333488291462da78b38a7a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:43.844407 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d59f068b-5b10-4a11-b8cd-44db12398fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:43.881135 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba43806-8d4d-4cb5-b9d7-a19c4aed30a3 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:43.952233 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1204/2389] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:01:43.953419 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f068b-5b10-4a11-b8cd-44db12398fb3 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:43.976823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac1961-3bb5-4d6b-b320-170c1340c8f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:43.977782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac1961-3bb5-4d6b-b320-170c1340c8f1 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:43.978299 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac1961-3bb5-4d6b-b320-170c1340c8f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:43.978569 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac1961-3bb5-4d6b-b320-170c1340c8f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:44.030314 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f068b-5b10-4a11-b8cd-44db12398fb3 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:44.035239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5c6a9-4d46-4ccb-be0d-5cf4f19b8a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:44.035913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5c6a9-4d46-4ccb-be0d-5cf4f19b8a25 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:44.036262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5c6a9-4d46-4ccb-be0d-5cf4f19b8a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:44.036603 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5c6a9-4d46-4ccb-be0d-5cf4f19b8a25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:44.037302 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5c6a9-4d46-4ccb-be0d-5cf4f19b8a25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:44.039350 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5c6a9-4d46-4ccb-be0d-5cf4f19b8a25 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:44.047077 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac1961-3bb5-4d6b-b320-170c1340c8f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:44.049046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac1961-3bb5-4d6b-b320-170c1340c8f1 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:44.066832 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1186/2390] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:01:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:01:44.075789 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1205/2391] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:01:43 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:01:44.077642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac1961-3bb5-4d6b-b320-170c1340c8f1 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:44.087137 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c9bf2-6687-4452-bf70-8aac5e4e1df1 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:44.087636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c9bf2-6687-4452-bf70-8aac5e4e1df1 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:44.088007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c9bf2-6687-4452-bf70-8aac5e4e1df1 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:44.089459 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1206/2392] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:01:44.093471 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac1961-3bb5-4d6b-b320-170c1340c8f1 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:44.096260 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c9bf2-6687-4452-bf70-8aac5e4e1df1 None None] Authenticating service token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:01:44.113620 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:44.164740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21704591-8cf9-484f-88cf-f96737c01aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:44.167680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21704591-8cf9-484f-88cf-f96737c01aae admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:44.167680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21704591-8cf9-484f-88cf-f96737c01aae admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:44.167680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21704591-8cf9-484f-88cf-f96737c01aae admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:44.168044 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21704591-8cf9-484f-88cf-f96737c01aae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:44.169888 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21704591-8cf9-484f-88cf-f96737c01aae admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:44.182879 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:44.196914 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c9bf2-6687-4452-bf70-8aac5e4e1df1 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:44.199164 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1187/2393] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:01:44 2022] POST /identity/v3/users => generated 294 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:01:44.202056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21704591-8cf9-484f-88cf-f96737c01aae admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:44.214604 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21704591-8cf9-484f-88cf-f96737c01aae admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:44.220257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ad91d-f9c1-4928-a62d-b3fd1a236bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:44.221140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ad91d-f9c1-4928-a62d-b3fd1a236bab admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:44.221140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ad91d-f9c1-4928-a62d-b3fd1a236bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:44.221405 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ad91d-f9c1-4928-a62d-b3fd1a236bab admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:44.222074 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ad91d-f9c1-4928-a62d-b3fd1a236bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:44.223824 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ad91d-f9c1-4928-a62d-b3fd1a236bab admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:44.237007 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1188/2394] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:01:44.240949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ad91d-f9c1-4928-a62d-b3fd1a236bab admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:44.254945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ad91d-f9c1-4928-a62d-b3fd1a236bab admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:44.270480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12205b56-fe94-4e92-b449-25c64ebe1479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:44.271165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12205b56-fe94-4e92-b449-25c64ebe1479 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:44.271443 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12205b56-fe94-4e92-b449-25c64ebe1479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:44.271716 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12205b56-fe94-4e92-b449-25c64ebe1479 admin admin] PATH_INFO: `/v3/projects/567f503eb797446399e19189887917ce/users/477664231436407b9e4439e1605adf56/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:44.293843 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c9bf2-6687-4452-bf70-8aac5e4e1df1 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:44.296502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12205b56-fe94-4e92-b449-25c64ebe1479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=567f503eb797446399e19189887917ce, user_id=477664231436407b9e4439e1605adf56, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:44.302481 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c13c36-beff-4d8d-9a04-a6a001f82c78 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d85d793b82c4b47983e9087eddec6a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e8361b0a0444d5900e37eff8dcea41', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:44.303214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12205b56-fe94-4e92-b449-25c64ebe1479 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:44.303335 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c13c36-beff-4d8d-9a04-a6a001f82c78 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:44.303504 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c13c36-beff-4d8d-9a04-a6a001f82c78 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:44.303790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c13c36-beff-4d8d-9a04-a6a001f82c78 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] PATH_INFO: `/v3/projects/f60968e392eb41548928b2cd5f2567fe` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:44.305044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c13c36-beff-4d8d-9a04-a6a001f82c78 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: Authorizing `identity:get_project(project_id=f60968e392eb41548928b2cd5f2567fe)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:44.308438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c13c36-beff-4d8d-9a04-a6a001f82c78 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:44.310406 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1207/2395] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:01:44 2022] GET /identity/v3/projects/f60968e392eb41548928b2cd5f2567fe => generated 371 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:01:44.331223 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1189/2396] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:01:44 2022] PUT /identity/v3/projects/567f503eb797446399e19189887917ce/users/477664231436407b9e4439e1605adf56/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:01:44.335005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c13c36-beff-4d8d-9a04-a6a001f82c78 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:44.347071 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c13c36-beff-4d8d-9a04-a6a001f82c78 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:44.429734 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4013dc-7d4b-4ea2-b412-4ec743d6233c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:44.430501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4013dc-7d4b-4ea2-b412-4ec743d6233c admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:44.430856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4013dc-7d4b-4ea2-b412-4ec743d6233c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:44.431202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4013dc-7d4b-4ea2-b412-4ec743d6233c admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:44.431913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4013dc-7d4b-4ea2-b412-4ec743d6233c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:44.433611 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4013dc-7d4b-4ea2-b412-4ec743d6233c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:44.441386 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690b643-a688-48e8-b408-09bd35eae672 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:44.441741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690b643-a688-48e8-b408-09bd35eae672 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:44.444299 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690b643-a688-48e8-b408-09bd35eae672 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:44.449514 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1208/2397] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:01:44.451492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4013dc-7d4b-4ea2-b412-4ec743d6233c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:44.451622 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1190/2398] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:01:44 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:01:44.463957 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690b643-a688-48e8-b408-09bd35eae672 None None] Authenticating service token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:01:44.466789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4013dc-7d4b-4ea2-b412-4ec743d6233c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:44.474386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a691f-d4e2-4e2b-b40b-fc604f820d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:44.475065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a691f-d4e2-4e2b-b40b-fc604f820d0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:44.475350 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a691f-d4e2-4e2b-b40b-fc604f820d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:44.475631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a691f-d4e2-4e2b-b40b-fc604f820d0d admin admin] PATH_INFO: `/v3/projects/567f503eb797446399e19189887917ce/users/477664231436407b9e4439e1605adf56/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:44.477822 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a691f-d4e2-4e2b-b40b-fc604f820d0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=567f503eb797446399e19189887917ce, user_id=477664231436407b9e4439e1605adf56, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:44.480963 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a691f-d4e2-4e2b-b40b-fc604f820d0d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:44.496185 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1209/2399] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:01:44 2022] PUT /identity/v3/projects/567f503eb797446399e19189887917ce/users/477664231436407b9e4439e1605adf56/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:44.508698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20426fa-c135-4bfe-bc90-750ed3d2cf7a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:44.508991 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20426fa-c135-4bfe-bc90-750ed3d2cf7a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:44.509323 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20426fa-c135-4bfe-bc90-750ed3d2cf7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:44.549728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-d20426fa-c135-4bfe-bc90-750ed3d2cf7a None None] MFA Rules not processed for user `477664231436407b9e4439e1605adf56`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:44.550858 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d20426fa-c135-4bfe-bc90-750ed3d2cf7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:44.576022 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690b643-a688-48e8-b408-09bd35eae672 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:44.581974 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:44.659431 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690b643-a688-48e8-b408-09bd35eae672 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:44.665468 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1210/2400] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:01:44.733452 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27209128-4045-4d56-b972-2fa8a9c7503b tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d85d793b82c4b47983e9087eddec6a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e8361b0a0444d5900e37eff8dcea41', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:44.734126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27209128-4045-4d56-b972-2fa8a9c7503b tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:44.734411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27209128-4045-4d56-b972-2fa8a9c7503b tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:44.734941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27209128-4045-4d56-b972-2fa8a9c7503b tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] PATH_INFO: `/v3/projects/f60968e392eb41548928b2cd5f2567fe` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:44.736656 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27209128-4045-4d56-b972-2fa8a9c7503b tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: Authorizing `identity:get_project(project_id=f60968e392eb41548928b2cd5f2567fe)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:44.738734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27209128-4045-4d56-b972-2fa8a9c7503b tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:44.740525 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1191/2401] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:01:44 2022] GET /identity/v3/projects/f60968e392eb41548928b2cd5f2567fe => generated 371 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:01:44.782035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20426fa-c135-4bfe-bc90-750ed3d2cf7a None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:44.796471 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20426fa-c135-4bfe-bc90-750ed3d2cf7a None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:44.801873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f8f6b-2799-4c27-a8ad-58062b2e7b0c tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d85d793b82c4b47983e9087eddec6a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e8361b0a0444d5900e37eff8dcea41', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:44.802721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f8f6b-2799-4c27-a8ad-58062b2e7b0c tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:44.803011 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f8f6b-2799-4c27-a8ad-58062b2e7b0c tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:44.803291 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f8f6b-2799-4c27-a8ad-58062b2e7b0c tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:44.803986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f8f6b-2799-4c27-a8ad-58062b2e7b0c tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:01:44.804300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f8f6b-2799-4c27-a8ad-58062b2e7b0c tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:44.805972 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f8f6b-2799-4c27-a8ad-58062b2e7b0c tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:44.818284 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27209128-4045-4d56-b972-2fa8a9c7503b tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:44.823284 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-27209128-4045-4d56-b972-2fa8a9c7503b tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:44.828862 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:44.835836 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1211/2402] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:01:44.840171 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f8f6b-2799-4c27-a8ad-58062b2e7b0c tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:44.850867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f8f6b-2799-4c27-a8ad-58062b2e7b0c tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:44.857793 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7a9c0-aa96-4e31-8afe-55a95dcfde86 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d85d793b82c4b47983e9087eddec6a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e8361b0a0444d5900e37eff8dcea41', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:44.858397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7a9c0-aa96-4e31-8afe-55a95dcfde86 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:44.858681 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7a9c0-aa96-4e31-8afe-55a95dcfde86 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:44.858956 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7a9c0-aa96-4e31-8afe-55a95dcfde86 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:44.859875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b7a9c0-aa96-4e31-8afe-55a95dcfde86 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:44.862447 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b7a9c0-aa96-4e31-8afe-55a95dcfde86 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:44.895024 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1212/2403] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:01:44 2022] POST /identity/v3/users => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:01:44.899129 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7a9c0-aa96-4e31-8afe-55a95dcfde86 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:44.913207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7a9c0-aa96-4e31-8afe-55a95dcfde86 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:44.918642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fe700-93e7-4791-aa96-67af30652846 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d85d793b82c4b47983e9087eddec6a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e8361b0a0444d5900e37eff8dcea41', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:44.919331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fe700-93e7-4791-aa96-67af30652846 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:44.919782 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fe700-93e7-4791-aa96-67af30652846 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:44.921682 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fe700-93e7-4791-aa96-67af30652846 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:44.922585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9fe700-93e7-4791-aa96-67af30652846 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:01:44.922986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9fe700-93e7-4791-aa96-67af30652846 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:44.925539 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9fe700-93e7-4791-aa96-67af30652846 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:44.929188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27209128-4045-4d56-b972-2fa8a9c7503b tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:44.935289 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9a235-3a0f-4003-a5c6-cac99281e1d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:44.936021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9a235-3a0f-4003-a5c6-cac99281e1d8 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:44.936308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9a235-3a0f-4003-a5c6-cac99281e1d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:44.936581 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9a235-3a0f-4003-a5c6-cac99281e1d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:44.942803 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1213/2404] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:01:44.946703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf9a235-3a0f-4003-a5c6-cac99281e1d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:44.948293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf9a235-3a0f-4003-a5c6-cac99281e1d8 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:44.958856 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1192/2405] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:01:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:01:45.176383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6628f-9656-4dd4-9fdd-55bc99bc966d None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:45.176883 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6628f-9656-4dd4-9fdd-55bc99bc966d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:45.176965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6628f-9656-4dd4-9fdd-55bc99bc966d None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:45.178354 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1214/2406] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:01:45.183425 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9a235-3a0f-4003-a5c6-cac99281e1d8 service nova] Authenticating service token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:01:45.194951 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9a235-3a0f-4003-a5c6-cac99281e1d8 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:45.213745 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9a235-3a0f-4003-a5c6-cac99281e1d8 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:45.213745 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba72c47-f4d4-40df-8119-c5bdf4b05525 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d85d793b82c4b47983e9087eddec6a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e8361b0a0444d5900e37eff8dcea41', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:45.213745 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba72c47-f4d4-40df-8119-c5bdf4b05525 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:45.214047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba72c47-f4d4-40df-8119-c5bdf4b05525 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:45.214047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba72c47-f4d4-40df-8119-c5bdf4b05525 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] PATH_INFO: `/v3/projects/f60968e392eb41548928b2cd5f2567fe` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:45.214047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba72c47-f4d4-40df-8119-c5bdf4b05525 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: Authorizing `identity:get_project(project_id=f60968e392eb41548928b2cd5f2567fe)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:45.218091 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba72c47-f4d4-40df-8119-c5bdf4b05525 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:45.218091 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1193/2407] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:01:45 2022] GET /identity/v3/projects/f60968e392eb41548928b2cd5f2567fe => generated 371 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:01:45.220911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6628f-9656-4dd4-9fdd-55bc99bc966d None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:45.237810 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6628f-9656-4dd4-9fdd-55bc99bc966d None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:45.245718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769b96b-e0db-48a4-a465-45797d731d40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:45.246475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769b96b-e0db-48a4-a465-45797d731d40 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:45.246846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769b96b-e0db-48a4-a465-45797d731d40 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:45.247175 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769b96b-e0db-48a4-a465-45797d731d40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:45.317274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9769b96b-e0db-48a4-a465-45797d731d40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:45.319168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9769b96b-e0db-48a4-a465-45797d731d40 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:45.341856 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1215/2408] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:01:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:01:45.441774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217c37a-c781-4392-99c4-40638d7fb84e None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:45.442266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217c37a-c781-4392-99c4-40638d7fb84e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:45.442266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217c37a-c781-4392-99c4-40638d7fb84e None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:45.443659 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1194/2409] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:01:45.456507 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769b96b-e0db-48a4-a465-45797d731d40 service nova] Authenticating service token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:01:45.470476 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769b96b-e0db-48a4-a465-45797d731d40 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:45.480502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769b96b-e0db-48a4-a465-45797d731d40 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:45.485321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf9a5d-29d1-4875-a0a6-ae6cc5a6b0c1 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d85d793b82c4b47983e9087eddec6a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e8361b0a0444d5900e37eff8dcea41', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:45.488293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf9a5d-29d1-4875-a0a6-ae6cc5a6b0c1 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:45.488591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf9a5d-29d1-4875-a0a6-ae6cc5a6b0c1 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:45.488872 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf9a5d-29d1-4875-a0a6-ae6cc5a6b0c1 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] PATH_INFO: `/v3/projects/f60968e392eb41548928b2cd5f2567fe` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:45.490104 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf9a5d-29d1-4875-a0a6-ae6cc5a6b0c1 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: Authorizing `identity:get_project(project_id=f60968e392eb41548928b2cd5f2567fe)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:45.492179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf9a5d-29d1-4875-a0a6-ae6cc5a6b0c1 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:45.493990 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1216/2410] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:01:45 2022] GET /identity/v3/projects/f60968e392eb41548928b2cd5f2567fe => generated 371 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:01:45.524416 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217c37a-c781-4392-99c4-40638d7fb84e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:45.536827 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217c37a-c781-4392-99c4-40638d7fb84e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:45.541887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a15425-a0d3-480a-b452-c1f34ab71562 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d85d793b82c4b47983e9087eddec6a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e8361b0a0444d5900e37eff8dcea41', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:45.542519 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a15425-a0d3-480a-b452-c1f34ab71562 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:45.542798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a15425-a0d3-480a-b452-c1f34ab71562 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:45.543065 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a15425-a0d3-480a-b452-c1f34ab71562 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] PATH_INFO: `/v3/users/40631b85910541b4971499bd547a02e1` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:45.561040 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a15425-a0d3-480a-b452-c1f34ab71562 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: Authorizing `identity:delete_user(user_id=40631b85910541b4971499bd547a02e1)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:45.563024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a15425-a0d3-480a-b452-c1f34ab71562 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:45.635965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-57a15425-a0d3-480a-b452-c1f34ab71562 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40631b85910541b4971499bd547a02e1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:45.637500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-57a15425-a0d3-480a-b452-c1f34ab71562 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40631b85910541b4971499bd547a02e1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:45.647802 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-57a15425-a0d3-480a-b452-c1f34ab71562 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40631b85910541b4971499bd547a02e1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:45.660206 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-57a15425-a0d3-480a-b452-c1f34ab71562 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40631b85910541b4971499bd547a02e1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:45.661989 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-57a15425-a0d3-480a-b452-c1f34ab71562 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40631b85910541b4971499bd547a02e1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:45.684821 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1195/2411] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:01:45 2022] DELETE /identity/v3/users/40631b85910541b4971499bd547a02e1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:45.689101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf9a5d-29d1-4875-a0a6-ae6cc5a6b0c1 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:45.690898 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f6cf9a5d-29d1-4875-a0a6-ae6cc5a6b0c1 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:45.706126 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf9a5d-29d1-4875-a0a6-ae6cc5a6b0c1 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:45.798008 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de04bbd-4963-41e8-a4b3-a942b68a4850 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d85d793b82c4b47983e9087eddec6a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55e8361b0a0444d5900e37eff8dcea41', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:45.798991 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de04bbd-4963-41e8-a4b3-a942b68a4850 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:45.799422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de04bbd-4963-41e8-a4b3-a942b68a4850 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:45.799869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de04bbd-4963-41e8-a4b3-a942b68a4850 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] PATH_INFO: `/v3/projects/f60968e392eb41548928b2cd5f2567fe` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:45.801321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de04bbd-4963-41e8-a4b3-a942b68a4850 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f60968e392eb41548928b2cd5f2567fe)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:45.803556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de04bbd-4963-41e8-a4b3-a942b68a4850 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:45.809773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a15425-a0d3-480a-b452-c1f34ab71562 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:45.811235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-57a15425-a0d3-480a-b452-c1f34ab71562 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:45.813361 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:45.889624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8de04bbd-4963-41e8-a4b3-a942b68a4850 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f60968e392eb41548928b2cd5f2567fe', 'request_id': 'req-8de04bbd-4963-41e8-a4b3-a942b68a4850'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:45.910414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8de04bbd-4963-41e8-a4b3-a942b68a4850 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f60968e392eb41548928b2cd5f2567fe', 'request_id': 'req-8de04bbd-4963-41e8-a4b3-a942b68a4850'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:45.914274 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:45.919494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8de04bbd-4963-41e8-a4b3-a942b68a4850 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f60968e392eb41548928b2cd5f2567fe', 'request_id': 'req-8de04bbd-4963-41e8-a4b3-a942b68a4850'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:45.933922 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8de04bbd-4963-41e8-a4b3-a942b68a4850 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] The token cache is being invalidate because project f60968e392eb41548928b2cd5f2567fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:01:45.934210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8de04bbd-4963-41e8-a4b3-a942b68a4850 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:45.934870 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8de04bbd-4963-41e8-a4b3-a942b68a4850 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:45.936464 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1217/2412] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:01:45 2022] DELETE /identity/v3/projects/f60968e392eb41548928b2cd5f2567fe => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:45.944232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de04bbd-4963-41e8-a4b3-a942b68a4850 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:45.945680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8de04bbd-4963-41e8-a4b3-a942b68a4850 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:45.948988 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a15425-a0d3-480a-b452-c1f34ab71562 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:46.027841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de04bbd-4963-41e8-a4b3-a942b68a4850 tempest-QuotasAdminTestV257-768947850 tempest-QuotasAdminTestV257-768947850-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:46.031486 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1bd6cb-a821-49e7-81d5-a3556b4fda5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:46.032257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bd6cb-a821-49e7-81d5-a3556b4fda5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:46.032748 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bd6cb-a821-49e7-81d5-a3556b4fda5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:46.033644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bd6cb-a821-49e7-81d5-a3556b4fda5e admin admin] PATH_INFO: `/v3/users/7c4f37489333488291462da78b38a7a1` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:46.033794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a3887-1e20-4c5e-ab13-eea13af6032e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:46.034719 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a3887-1e20-4c5e-ab13-eea13af6032e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:46.035006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a3887-1e20-4c5e-ab13-eea13af6032e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:46.035551 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a3887-1e20-4c5e-ab13-eea13af6032e admin admin] PATH_INFO: `/v3/users/0686ed48f80c42689017595920a47eef` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:46.035701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1bd6cb-a821-49e7-81d5-a3556b4fda5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c4f37489333488291462da78b38a7a1)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:46.039679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1bd6cb-a821-49e7-81d5-a3556b4fda5e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:46.056081 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a3887-1e20-4c5e-ab13-eea13af6032e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0686ed48f80c42689017595920a47eef)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:46.058109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a3887-1e20-4c5e-ab13-eea13af6032e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:46.129854 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7e1bd6cb-a821-49e7-81d5-a3556b4fda5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c4f37489333488291462da78b38a7a1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:46.131470 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7e1bd6cb-a821-49e7-81d5-a3556b4fda5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c4f37489333488291462da78b38a7a1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:46.161020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a98a3887-1e20-4c5e-ab13-eea13af6032e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0686ed48f80c42689017595920a47eef'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:46.161848 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a98a3887-1e20-4c5e-ab13-eea13af6032e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0686ed48f80c42689017595920a47eef'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:46.162578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7e1bd6cb-a821-49e7-81d5-a3556b4fda5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c4f37489333488291462da78b38a7a1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:46.170390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a98a3887-1e20-4c5e-ab13-eea13af6032e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0686ed48f80c42689017595920a47eef'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:46.179021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7e1bd6cb-a821-49e7-81d5-a3556b4fda5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c4f37489333488291462da78b38a7a1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:46.179788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7e1bd6cb-a821-49e7-81d5-a3556b4fda5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c4f37489333488291462da78b38a7a1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:46.186746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a98a3887-1e20-4c5e-ab13-eea13af6032e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0686ed48f80c42689017595920a47eef'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:46.187419 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a98a3887-1e20-4c5e-ab13-eea13af6032e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0686ed48f80c42689017595920a47eef'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:46.228978 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1196/2413] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:01:45 2022] DELETE /identity/v3/users/7c4f37489333488291462da78b38a7a1 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:01:46.232894 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0517c-6624-4855-8989-ae72c2a32fc4 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:46.233177 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0517c-6624-4855-8989-ae72c2a32fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:46.237674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0517c-6624-4855-8989-ae72c2a32fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:46.257538 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1218/2414] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:01:45 2022] DELETE /identity/v3/users/0686ed48f80c42689017595920a47eef => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:46.261913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f92a9-b454-48a0-a98e-96c567eaac63 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:46.262234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f92a9-b454-48a0-a98e-96c567eaac63 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:46.262543 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f92a9-b454-48a0-a98e-96c567eaac63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:46.308666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-ffb0517c-6624-4855-8989-ae72c2a32fc4 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:46.312122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ffb0517c-6624-4855-8989-ae72c2a32fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:46.322850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ca4f92a9-b454-48a0-a98e-96c567eaac63 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:46.324046 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ca4f92a9-b454-48a0-a98e-96c567eaac63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:46.344957 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:46.470769 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1197/2415] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:46.477527 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1219/2416] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:46.490252 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0517c-6624-4855-8989-ae72c2a32fc4 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:46.499682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ffb0517c-6624-4855-8989-ae72c2a32fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:46.500112 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f92a9-b454-48a0-a98e-96c567eaac63 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:46.502244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ca4f92a9-b454-48a0-a98e-96c567eaac63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:46.520207 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:46.593664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f92a9-b454-48a0-a98e-96c567eaac63 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:46.600210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b91103-bc20-4ebb-8816-5d8d684d3a3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:46.601084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b91103-bc20-4ebb-8816-5d8d684d3a3e service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:46.601373 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b91103-bc20-4ebb-8816-5d8d684d3a3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:46.601796 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b91103-bc20-4ebb-8816-5d8d684d3a3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:46.619225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b91103-bc20-4ebb-8816-5d8d684d3a3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:46.620655 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b91103-bc20-4ebb-8816-5d8d684d3a3e service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:46.633615 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1220/2417] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:01:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:01:46.645154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0517c-6624-4855-8989-ae72c2a32fc4 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:46.649817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964c606-4014-4974-8cfb-84a73f9724c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:46.651342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964c606-4014-4974-8cfb-84a73f9724c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:46.651632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964c606-4014-4974-8cfb-84a73f9724c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:46.651903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964c606-4014-4974-8cfb-84a73f9724c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:46.664382 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964c606-4014-4974-8cfb-84a73f9724c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:46.666269 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964c606-4014-4974-8cfb-84a73f9724c5 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:46.680423 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1198/2418] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:01:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:01:46.723961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f99a3-ad14-4e7f-aa34-0487cc5ae4f2 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:46.724239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f99a3-ad14-4e7f-aa34-0487cc5ae4f2 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:46.724568 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f99a3-ad14-4e7f-aa34-0487cc5ae4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:46.759034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-4d6f99a3-ad14-4e7f-aa34-0487cc5ae4f2 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:46.761215 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4d6f99a3-ad14-4e7f-aa34-0487cc5ae4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:46.907393 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1221/2419] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:01:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:46.959258 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964c606-4014-4974-8cfb-84a73f9724c5 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:46.960949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5964c606-4014-4974-8cfb-84a73f9724c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:47.052050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964c606-4014-4974-8cfb-84a73f9724c5 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:47.058879 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c5b67-3420-4c55-9ec2-d1de7dcf607b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:47.059196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c5b67-3420-4c55-9ec2-d1de7dcf607b service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:47.059530 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c5b67-3420-4c55-9ec2-d1de7dcf607b service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:47.059810 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c5b67-3420-4c55-9ec2-d1de7dcf607b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:47.069980 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c5b67-3420-4c55-9ec2-d1de7dcf607b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:47.071812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c5b67-3420-4c55-9ec2-d1de7dcf607b service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:47.085995 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1199/2420] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:01:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 04 01:01:47.341843 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f99a3-ad14-4e7f-aa34-0487cc5ae4f2 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:47.343400 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4d6f99a3-ad14-4e7f-aa34-0487cc5ae4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:47.377470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f99a3-ad14-4e7f-aa34-0487cc5ae4f2 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:47.398865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a424d-fb29-4261-823b-efcf0eafd914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:47.399892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a424d-fb29-4261-823b-efcf0eafd914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:47.399892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a424d-fb29-4261-823b-efcf0eafd914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:47.400093 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a424d-fb29-4261-823b-efcf0eafd914 admin admin] PATH_INFO: `/v3/projects/8f6e69d6f84b4c2ea356167a93d86b65` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:47.403303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a424d-fb29-4261-823b-efcf0eafd914 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f6e69d6f84b4c2ea356167a93d86b65)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:47.405342 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a424d-fb29-4261-823b-efcf0eafd914 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:47.474016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c5b67-3420-4c55-9ec2-d1de7dcf607b service swift] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:47.475770 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-818c5b67-3420-4c55-9ec2-d1de7dcf607b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:47.512735 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c5b67-3420-4c55-9ec2-d1de7dcf607b service swift] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:47.536256 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01467f-4f64-4406-a37f-ccd0a614f6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:47.536921 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01467f-4f64-4406-a37f-ccd0a614f6c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:47.537199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01467f-4f64-4406-a37f-ccd0a614f6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:47.537553 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01467f-4f64-4406-a37f-ccd0a614f6c4 admin admin] PATH_INFO: `/v3/projects/71065b18e3d44e2e8ba4f00954988ea7` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:47.538809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01467f-4f64-4406-a37f-ccd0a614f6c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71065b18e3d44e2e8ba4f00954988ea7)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:47.541332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01467f-4f64-4406-a37f-ccd0a614f6c4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:47.570123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dc1a424d-fb29-4261-823b-efcf0eafd914 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f6e69d6f84b4c2ea356167a93d86b65', 'request_id': 'req-dc1a424d-fb29-4261-823b-efcf0eafd914'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:47.597321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dc1a424d-fb29-4261-823b-efcf0eafd914 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f6e69d6f84b4c2ea356167a93d86b65', 'request_id': 'req-dc1a424d-fb29-4261-823b-efcf0eafd914'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:47.598836 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:47.611170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dc1a424d-fb29-4261-823b-efcf0eafd914 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f6e69d6f84b4c2ea356167a93d86b65', 'request_id': 'req-dc1a424d-fb29-4261-823b-efcf0eafd914'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:47.634026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dc1a424d-fb29-4261-823b-efcf0eafd914 admin admin] The token cache is being invalidate because project 8f6e69d6f84b4c2ea356167a93d86b65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:01:47.634320 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dc1a424d-fb29-4261-823b-efcf0eafd914 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:47.639152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dc1a424d-fb29-4261-823b-efcf0eafd914 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:47.640647 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1222/2421] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:01:47 2022] DELETE /identity/v3/projects/8f6e69d6f84b4c2ea356167a93d86b65 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:47.645072 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a424d-fb29-4261-823b-efcf0eafd914 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:47.646526 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-dc1a424d-fb29-4261-823b-efcf0eafd914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:47.732306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6f01467f-4f64-4406-a37f-ccd0a614f6c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71065b18e3d44e2e8ba4f00954988ea7', 'request_id': 'req-6f01467f-4f64-4406-a37f-ccd0a614f6c4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:47.769764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6f01467f-4f64-4406-a37f-ccd0a614f6c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71065b18e3d44e2e8ba4f00954988ea7', 'request_id': 'req-6f01467f-4f64-4406-a37f-ccd0a614f6c4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:47.794613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6f01467f-4f64-4406-a37f-ccd0a614f6c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71065b18e3d44e2e8ba4f00954988ea7', 'request_id': 'req-6f01467f-4f64-4406-a37f-ccd0a614f6c4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:47.805731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a424d-fb29-4261-823b-efcf0eafd914 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:47.850657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6f01467f-4f64-4406-a37f-ccd0a614f6c4 admin admin] The token cache is being invalidate because project 71065b18e3d44e2e8ba4f00954988ea7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:01:47.851121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6f01467f-4f64-4406-a37f-ccd0a614f6c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:47.851891 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6f01467f-4f64-4406-a37f-ccd0a614f6c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:47.856698 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1200/2422] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:01:47 2022] DELETE /identity/v3/projects/71065b18e3d44e2e8ba4f00954988ea7 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:47.857618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01467f-4f64-4406-a37f-ccd0a614f6c4 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:47.864427 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6f01467f-4f64-4406-a37f-ccd0a614f6c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:47.958423 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:47.963495 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed2e20-8034-4eee-a5b9-afd8bd98ac87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:47.966991 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed2e20-8034-4eee-a5b9-afd8bd98ac87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:47.970370 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed2e20-8034-4eee-a5b9-afd8bd98ac87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:47.970673 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed2e20-8034-4eee-a5b9-afd8bd98ac87 admin admin] PATH_INFO: `/v3/users/2d85d793b82c4b47983e9087eddec6a1` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:47.981313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed2e20-8034-4eee-a5b9-afd8bd98ac87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d85d793b82c4b47983e9087eddec6a1)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:47.990592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed2e20-8034-4eee-a5b9-afd8bd98ac87 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:48.046089 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01467f-4f64-4406-a37f-ccd0a614f6c4 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:48.061730 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4351e01-6548-4181-a6f0-49c34f4a0dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:48.062386 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4351e01-6548-4181-a6f0-49c34f4a0dc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:48.062656 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4351e01-6548-4181-a6f0-49c34f4a0dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:48.062925 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4351e01-6548-4181-a6f0-49c34f4a0dc2 admin admin] PATH_INFO: `/v3/users/477664231436407b9e4439e1605adf56` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:48.065707 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4351e01-6548-4181-a6f0-49c34f4a0dc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=477664231436407b9e4439e1605adf56)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:48.067703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4351e01-6548-4181-a6f0-49c34f4a0dc2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:48.127944 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3eed2e20-8034-4eee-a5b9-afd8bd98ac87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d85d793b82c4b47983e9087eddec6a1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:48.130588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3eed2e20-8034-4eee-a5b9-afd8bd98ac87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d85d793b82c4b47983e9087eddec6a1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:48.157810 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3eed2e20-8034-4eee-a5b9-afd8bd98ac87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d85d793b82c4b47983e9087eddec6a1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:48.173850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f4351e01-6548-4181-a6f0-49c34f4a0dc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '477664231436407b9e4439e1605adf56'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:48.179088 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f4351e01-6548-4181-a6f0-49c34f4a0dc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '477664231436407b9e4439e1605adf56'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:48.179338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3eed2e20-8034-4eee-a5b9-afd8bd98ac87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d85d793b82c4b47983e9087eddec6a1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:48.180225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3eed2e20-8034-4eee-a5b9-afd8bd98ac87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d85d793b82c4b47983e9087eddec6a1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:48.207863 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f4351e01-6548-4181-a6f0-49c34f4a0dc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '477664231436407b9e4439e1605adf56'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:48.224849 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1223/2423] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:01:47 2022] DELETE /identity/v3/users/2d85d793b82c4b47983e9087eddec6a1 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:01:48.232606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f4351e01-6548-4181-a6f0-49c34f4a0dc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '477664231436407b9e4439e1605adf56'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:48.233314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f4351e01-6548-4181-a6f0-49c34f4a0dc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '477664231436407b9e4439e1605adf56'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:48.273958 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1201/2424] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:01:47 2022] DELETE /identity/v3/users/477664231436407b9e4439e1605adf56 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:49.410824 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed2e20-8034-4eee-a5b9-afd8bd98ac87 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:49.412909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3eed2e20-8034-4eee-a5b9-afd8bd98ac87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:49.431035 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:49.529744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed2e20-8034-4eee-a5b9-afd8bd98ac87 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:49.588620 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4351e01-6548-4181-a6f0-49c34f4a0dc2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:49.592793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f4351e01-6548-4181-a6f0-49c34f4a0dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:49.691428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b913e-b7ec-416e-8fc9-7faf8e50693e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:49.692087 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b913e-b7ec-416e-8fc9-7faf8e50693e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:49.692359 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b913e-b7ec-416e-8fc9-7faf8e50693e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:49.692857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b913e-b7ec-416e-8fc9-7faf8e50693e admin admin] PATH_INFO: `/v3/projects/567f503eb797446399e19189887917ce` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:49.696706 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b913e-b7ec-416e-8fc9-7faf8e50693e admin admin] RBAC: Authorizing `identity:delete_project(project_id=567f503eb797446399e19189887917ce)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:49.698691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b913e-b7ec-416e-8fc9-7faf8e50693e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:49.720649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4351e01-6548-4181-a6f0-49c34f4a0dc2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:49.731292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c021847-e29d-455a-add3-93ca6f615a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:49.731957 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c021847-e29d-455a-add3-93ca6f615a43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:49.732233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c021847-e29d-455a-add3-93ca6f615a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:49.732504 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c021847-e29d-455a-add3-93ca6f615a43 admin admin] PATH_INFO: `/v3/projects/55e8361b0a0444d5900e37eff8dcea41` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:49.733827 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c021847-e29d-455a-add3-93ca6f615a43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55e8361b0a0444d5900e37eff8dcea41)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:49.736154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c021847-e29d-455a-add3-93ca6f615a43 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:49.791075 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:49.796300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7c021847-e29d-455a-add3-93ca6f615a43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55e8361b0a0444d5900e37eff8dcea41', 'request_id': 'req-7c021847-e29d-455a-add3-93ca6f615a43'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:49.826890 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-053b913e-b7ec-416e-8fc9-7faf8e50693e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '567f503eb797446399e19189887917ce', 'request_id': 'req-053b913e-b7ec-416e-8fc9-7faf8e50693e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:49.832733 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7c021847-e29d-455a-add3-93ca6f615a43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55e8361b0a0444d5900e37eff8dcea41', 'request_id': 'req-7c021847-e29d-455a-add3-93ca6f615a43'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:49.840032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7c021847-e29d-455a-add3-93ca6f615a43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55e8361b0a0444d5900e37eff8dcea41', 'request_id': 'req-7c021847-e29d-455a-add3-93ca6f615a43'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:49.857977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-053b913e-b7ec-416e-8fc9-7faf8e50693e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '567f503eb797446399e19189887917ce', 'request_id': 'req-053b913e-b7ec-416e-8fc9-7faf8e50693e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:49.871475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-053b913e-b7ec-416e-8fc9-7faf8e50693e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '567f503eb797446399e19189887917ce', 'request_id': 'req-053b913e-b7ec-416e-8fc9-7faf8e50693e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:49.874084 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7c021847-e29d-455a-add3-93ca6f615a43 admin admin] The token cache is being invalidate because project 55e8361b0a0444d5900e37eff8dcea41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:01:49.874378 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7c021847-e29d-455a-add3-93ca6f615a43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:49.877370 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7c021847-e29d-455a-add3-93ca6f615a43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:49.886378 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1202/2425] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:01:49 2022] DELETE /identity/v3/projects/55e8361b0a0444d5900e37eff8dcea41 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:01:49.888959 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8754aff-6291-4b92-8719-34c3a68fd799 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:49.889249 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8754aff-6291-4b92-8719-34c3a68fd799 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:49.889559 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8754aff-6291-4b92-8719-34c3a68fd799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:49.918729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-053b913e-b7ec-416e-8fc9-7faf8e50693e admin admin] The token cache is being invalidate because project 567f503eb797446399e19189887917ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:01:49.919093 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-053b913e-b7ec-416e-8fc9-7faf8e50693e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:49.930377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-053b913e-b7ec-416e-8fc9-7faf8e50693e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:49.941266 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1224/2426] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:01:49 2022] DELETE /identity/v3/projects/567f503eb797446399e19189887917ce => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:49.946599 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59547ee-26fd-4429-88b5-19a806ace512 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:49.947178 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59547ee-26fd-4429-88b5-19a806ace512 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:49.947178 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59547ee-26fd-4429-88b5-19a806ace512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:49.999117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c8754aff-6291-4b92-8719-34c3a68fd799 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:49.999997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c8754aff-6291-4b92-8719-34c3a68fd799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:50.040291 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a59547ee-26fd-4429-88b5-19a806ace512 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:50.041580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a59547ee-26fd-4429-88b5-19a806ace512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:50.178212 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:50.222127 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1225/2427] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:50.224152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c80f5-6adc-4ed8-acea-55066d4ebfe5 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:50.224445 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c80f5-6adc-4ed8-acea-55066d4ebfe5 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:50.224961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c80f5-6adc-4ed8-acea-55066d4ebfe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:50.227892 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1203/2428] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:50.229326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e508be8-bed8-40a5-8827-89ce82529433 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:50.231350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e508be8-bed8-40a5-8827-89ce82529433 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:50.232586 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e508be8-bed8-40a5-8827-89ce82529433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:50.267219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e49c80f5-6adc-4ed8-acea-55066d4ebfe5 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:50.268461 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e49c80f5-6adc-4ed8-acea-55066d4ebfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:50.288864 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-9e508be8-bed8-40a5-8827-89ce82529433 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:50.294553 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1226/2429] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:50.294742 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9e508be8-bed8-40a5-8827-89ce82529433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:50.296064 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c80f5-6adc-4ed8-acea-55066d4ebfe5 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:50.311886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c80f5-6adc-4ed8-acea-55066d4ebfe5 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:50.324411 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c48eb-fb73-4c28-b42f-784a2d84e55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:50.325034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c48eb-fb73-4c28-b42f-784a2d84e55a admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:50.325310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c48eb-fb73-4c28-b42f-784a2d84e55a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:50.325610 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c48eb-fb73-4c28-b42f-784a2d84e55a admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:50.326310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c48eb-fb73-4c28-b42f-784a2d84e55a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:01:50.326548 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c48eb-fb73-4c28-b42f-784a2d84e55a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:50.328431 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c48eb-fb73-4c28-b42f-784a2d84e55a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:50.328885 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1204/2430] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:50.329758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e508be8-bed8-40a5-8827-89ce82529433 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:50.357520 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e508be8-bed8-40a5-8827-89ce82529433 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:50.363770 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1227/2431] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:01:50.365244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c48eb-fb73-4c28-b42f-784a2d84e55a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:50.378296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f76a3-3b30-4e77-8c61-0b348a304ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:50.378931 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f76a3-3b30-4e77-8c61-0b348a304ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:50.379215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f76a3-3b30-4e77-8c61-0b348a304ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:50.379552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f76a3-3b30-4e77-8c61-0b348a304ed9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:50.386691 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f76a3-3b30-4e77-8c61-0b348a304ed9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:01:50.387136 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f76a3-3b30-4e77-8c61-0b348a304ed9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:50.387311 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c48eb-fb73-4c28-b42f-784a2d84e55a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:50.388810 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f76a3-3b30-4e77-8c61-0b348a304ed9 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:50.398037 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1db144-3195-4f2a-a940-11e0a9360ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:50.398651 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1db144-3195-4f2a-a940-11e0a9360ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:50.399206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1db144-3195-4f2a-a940-11e0a9360ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:50.399489 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1db144-3195-4f2a-a940-11e0a9360ff8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:50.400188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1db144-3195-4f2a-a940-11e0a9360ff8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:50.404947 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1db144-3195-4f2a-a940-11e0a9360ff8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:50.429487 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1205/2432] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:01:50.433551 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f76a3-3b30-4e77-8c61-0b348a304ed9 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:50.463177 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1228/2433] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:01:50 2022] POST /identity/v3/projects => generated 409 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:01:50.467521 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1db144-3195-4f2a-a940-11e0a9360ff8 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:50.487320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f76a3-3b30-4e77-8c61-0b348a304ed9 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:50.572578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd36949-3477-4810-b349-ebf8283cbb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:50.574495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd36949-3477-4810-b349-ebf8283cbb1f admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:50.574965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd36949-3477-4810-b349-ebf8283cbb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:50.575379 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd36949-3477-4810-b349-ebf8283cbb1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:50.576169 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd36949-3477-4810-b349-ebf8283cbb1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:50.578471 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd36949-3477-4810-b349-ebf8283cbb1f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:50.600275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1db144-3195-4f2a-a940-11e0a9360ff8 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:50.621689 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff837cfe-21b3-427d-89b6-2aaa77230690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:50.633844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff837cfe-21b3-427d-89b6-2aaa77230690 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:50.633844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff837cfe-21b3-427d-89b6-2aaa77230690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:50.633844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff837cfe-21b3-427d-89b6-2aaa77230690 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:50.633844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff837cfe-21b3-427d-89b6-2aaa77230690 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:50.633844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff837cfe-21b3-427d-89b6-2aaa77230690 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:50.639661 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1206/2434] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:01:50 2022] POST /identity/v3/projects => generated 395 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:01:50.640193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd36949-3477-4810-b349-ebf8283cbb1f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:50.694823 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1229/2435] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:01:50 2022] POST /identity/v3/users => generated 305 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:01:50.699332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff837cfe-21b3-427d-89b6-2aaa77230690 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:50.721330 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff837cfe-21b3-427d-89b6-2aaa77230690 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:50.726214 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:50.755187 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd36949-3477-4810-b349-ebf8283cbb1f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:50.761586 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a05024-fd63-4e53-bfc1-0343ef76aa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:50.762809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a05024-fd63-4e53-bfc1-0343ef76aa85 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:50.763193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a05024-fd63-4e53-bfc1-0343ef76aa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:50.763622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a05024-fd63-4e53-bfc1-0343ef76aa85 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:50.764406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a05024-fd63-4e53-bfc1-0343ef76aa85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:50.767272 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a05024-fd63-4e53-bfc1-0343ef76aa85 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:50.801651 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1207/2436] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:01:50 2022] POST /identity/v3/users => generated 298 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:01:50.806120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a05024-fd63-4e53-bfc1-0343ef76aa85 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:50.818317 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a05024-fd63-4e53-bfc1-0343ef76aa85 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:50.826519 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f3926-b813-4267-a74b-4c0f954a5d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:50.827716 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f3926-b813-4267-a74b-4c0f954a5d3b admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:50.828209 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f3926-b813-4267-a74b-4c0f954a5d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:50.828692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f3926-b813-4267-a74b-4c0f954a5d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:50.831544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f3926-b813-4267-a74b-4c0f954a5d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:50.834700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f3926-b813-4267-a74b-4c0f954a5d3b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:50.855735 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1208/2437] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:01:50.863065 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f3926-b813-4267-a74b-4c0f954a5d3b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:50.877487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f3926-b813-4267-a74b-4c0f954a5d3b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:50.883793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4aa9f-33cf-46e6-81cd-be936591a0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:50.885016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4aa9f-33cf-46e6-81cd-be936591a0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:50.885424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4aa9f-33cf-46e6-81cd-be936591a0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:50.885824 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4aa9f-33cf-46e6-81cd-be936591a0e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:50.887144 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa4aa9f-33cf-46e6-81cd-be936591a0e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:50.888939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa4aa9f-33cf-46e6-81cd-be936591a0e1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:50.902819 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1209/2438] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:01:50.915488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4aa9f-33cf-46e6-81cd-be936591a0e1 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:50.936757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4aa9f-33cf-46e6-81cd-be936591a0e1 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:50.944090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab41c35-d406-4794-a443-acbae62d0f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:50.945391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab41c35-d406-4794-a443-acbae62d0f27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:50.945736 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab41c35-d406-4794-a443-acbae62d0f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:50.946150 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab41c35-d406-4794-a443-acbae62d0f27 admin admin] PATH_INFO: `/v3/projects/322283b484d24e47a0d17588a4a50038/users/046f548e010b4f06a664d82f5bc1bae2/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:50.966161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00686d-1fb4-49d0-8e15-eb1eeece05fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:50.967090 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00686d-1fb4-49d0-8e15-eb1eeece05fc admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:50.967375 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00686d-1fb4-49d0-8e15-eb1eeece05fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:50.967725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00686d-1fb4-49d0-8e15-eb1eeece05fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:50.968398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00686d-1fb4-49d0-8e15-eb1eeece05fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:50.971000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00686d-1fb4-49d0-8e15-eb1eeece05fc admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:50.982369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab41c35-d406-4794-a443-acbae62d0f27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=322283b484d24e47a0d17588a4a50038, user_id=046f548e010b4f06a664d82f5bc1bae2, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:50.989037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab41c35-d406-4794-a443-acbae62d0f27 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:50.997298 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1230/2439] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:01:51.002387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00686d-1fb4-49d0-8e15-eb1eeece05fc admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:51.019826 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1210/2440] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:01:50 2022] PUT /identity/v3/projects/322283b484d24e47a0d17588a4a50038/users/046f548e010b4f06a664d82f5bc1bae2/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:51.030766 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124e3c0-cc0d-4d95-a284-0463548bc4b6 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:51.031607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00686d-1fb4-49d0-8e15-eb1eeece05fc admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:51.034869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124e3c0-cc0d-4d95-a284-0463548bc4b6 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:51.035280 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124e3c0-cc0d-4d95-a284-0463548bc4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:51.096715 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-0124e3c0-cc0d-4d95-a284-0463548bc4b6 None None] MFA Rules not processed for user `046f548e010b4f06a664d82f5bc1bae2`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:51.101532 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0124e3c0-cc0d-4d95-a284-0463548bc4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:51.102947 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:51.158633 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b4af7-553d-4426-89e5-872f4eed6e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:51.161741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b4af7-553d-4426-89e5-872f4eed6e71 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:51.161741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b4af7-553d-4426-89e5-872f4eed6e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:51.161741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b4af7-553d-4426-89e5-872f4eed6e71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:51.161741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b4af7-553d-4426-89e5-872f4eed6e71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:51.162784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b4af7-553d-4426-89e5-872f4eed6e71 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:51.174687 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1231/2441] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:01:51.180064 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b4af7-553d-4426-89e5-872f4eed6e71 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:51.211245 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b4af7-553d-4426-89e5-872f4eed6e71 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:51.221935 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a8e94-a968-4adb-8566-e2a9c7b886f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:51.223200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a8e94-a968-4adb-8566-e2a9c7b886f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:51.223477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a8e94-a968-4adb-8566-e2a9c7b886f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:51.223749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a8e94-a968-4adb-8566-e2a9c7b886f4 admin admin] PATH_INFO: `/v3/projects/a40ffc2c2875417fb4027371d3a8aad0/users/a8bd2d3bf52c461abc669981f945e872/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:51.248570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a8e94-a968-4adb-8566-e2a9c7b886f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a40ffc2c2875417fb4027371d3a8aad0, user_id=a8bd2d3bf52c461abc669981f945e872, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:51.251203 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a8e94-a968-4adb-8566-e2a9c7b886f4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:51.281836 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1211/2442] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:51 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:01:51.281836 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124e3c0-cc0d-4d95-a284-0463548bc4b6 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:51.285319 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1232/2443] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:01:51 2022] PUT /identity/v3/projects/a40ffc2c2875417fb4027371d3a8aad0/users/a8bd2d3bf52c461abc669981f945e872/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:51.299436 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb872a-1f60-4472-bd65-2fbd5f101d19 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:51.299821 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb872a-1f60-4472-bd65-2fbd5f101d19 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:51.300201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb872a-1f60-4472-bd65-2fbd5f101d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:51.315950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124e3c0-cc0d-4d95-a284-0463548bc4b6 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:51.386065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a6fb872a-1f60-4472-bd65-2fbd5f101d19 None None] MFA Rules not processed for user `a8bd2d3bf52c461abc669981f945e872`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:51.391122 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a6fb872a-1f60-4472-bd65-2fbd5f101d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:51.482688 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83985694-07ba-454c-9411-8aafbcd0ab40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:51.482688 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83985694-07ba-454c-9411-8aafbcd0ab40 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:51.482688 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83985694-07ba-454c-9411-8aafbcd0ab40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:51.482688 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83985694-07ba-454c-9411-8aafbcd0ab40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:51.483557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83985694-07ba-454c-9411-8aafbcd0ab40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:51.488066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83985694-07ba-454c-9411-8aafbcd0ab40 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:51.532138 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:51.561255 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1233/2444] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:51 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:51.561944 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1212/2445] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:01:51 2022] POST /identity/v3/projects => generated 393 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:01:51.562222 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb872a-1f60-4472-bd65-2fbd5f101d19 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:51.562515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83985694-07ba-454c-9411-8aafbcd0ab40 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:51.588537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb872a-1f60-4472-bd65-2fbd5f101d19 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:51.666995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd6e3d-cf2b-4ff5-8955-24e9a312cd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:51.667949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd6e3d-cf2b-4ff5-8955-24e9a312cd15 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:51.668385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd6e3d-cf2b-4ff5-8955-24e9a312cd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:51.668757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd6e3d-cf2b-4ff5-8955-24e9a312cd15 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:51.669561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd6e3d-cf2b-4ff5-8955-24e9a312cd15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:51.672157 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd6e3d-cf2b-4ff5-8955-24e9a312cd15 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:51.718414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83985694-07ba-454c-9411-8aafbcd0ab40 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:51.730276 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1234/2446] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:01:51 2022] POST /identity/v3/users => generated 303 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:01:51.731682 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd6e3d-cf2b-4ff5-8955-24e9a312cd15 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:51.733461 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c519edd-a0d8-48cf-a005-5f0932a63a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:51.736780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c519edd-a0d8-48cf-a005-5f0932a63a72 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:51.739215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c519edd-a0d8-48cf-a005-5f0932a63a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:51.739603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c519edd-a0d8-48cf-a005-5f0932a63a72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:51.740647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c519edd-a0d8-48cf-a005-5f0932a63a72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:51.748021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c519edd-a0d8-48cf-a005-5f0932a63a72 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:51.760897 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd6e3d-cf2b-4ff5-8955-24e9a312cd15 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:51.775977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a5f27-a662-4179-8347-a8bed4a09de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:51.776886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a5f27-a662-4179-8347-a8bed4a09de7 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:51.777266 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a5f27-a662-4179-8347-a8bed4a09de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:51.777673 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a5f27-a662-4179-8347-a8bed4a09de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:51.778425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a5f27-a662-4179-8347-a8bed4a09de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:51.780155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a5f27-a662-4179-8347-a8bed4a09de7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:51.794824 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1235/2447] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:01:51.807051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a5f27-a662-4179-8347-a8bed4a09de7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:51.814711 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1213/2448] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:01:51 2022] POST /identity/v3/projects => generated 409 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:01:51.815718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c519edd-a0d8-48cf-a005-5f0932a63a72 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:51.836138 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a5f27-a662-4179-8347-a8bed4a09de7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:51.861072 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:51.969325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c519edd-a0d8-48cf-a005-5f0932a63a72 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:51.972223 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354cb99a-8593-41bf-9478-85bc760ba6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:51.973222 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354cb99a-8593-41bf-9478-85bc760ba6ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:51.973593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354cb99a-8593-41bf-9478-85bc760ba6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:51.974465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354cb99a-8593-41bf-9478-85bc760ba6ba admin admin] PATH_INFO: `/v3/projects/ccb7633c69ef47dd915ebf1e69b4f866/users/9f2e19edfa5949818efd0a30bda6adcc/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:51.984095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc3972-feef-48ec-9fe1-35b3b0c28bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:51.985130 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc3972-feef-48ec-9fe1-35b3b0c28bae admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:51.990237 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc3972-feef-48ec-9fe1-35b3b0c28bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:51.990714 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc3972-feef-48ec-9fe1-35b3b0c28bae admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:51.991509 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc3972-feef-48ec-9fe1-35b3b0c28bae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:51.993739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc3972-feef-48ec-9fe1-35b3b0c28bae admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:52.011309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354cb99a-8593-41bf-9478-85bc760ba6ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccb7633c69ef47dd915ebf1e69b4f866, user_id=9f2e19edfa5949818efd0a30bda6adcc, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:52.015913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354cb99a-8593-41bf-9478-85bc760ba6ba admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:52.046505 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1214/2449] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:01:51 2022] POST /identity/v3/users => generated 311 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:01:52.057392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc3972-feef-48ec-9fe1-35b3b0c28bae admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:52.062151 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1236/2450] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:01:51 2022] PUT /identity/v3/projects/ccb7633c69ef47dd915ebf1e69b4f866/users/9f2e19edfa5949818efd0a30bda6adcc/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:52.068030 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354cb99a-8593-41bf-9478-85bc760ba6ba admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:52.089926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc3972-feef-48ec-9fe1-35b3b0c28bae admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:52.180812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e6b68-3f24-4984-9028-5fc553e6205e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:52.181461 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e6b68-3f24-4984-9028-5fc553e6205e admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:52.181750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e6b68-3f24-4984-9028-5fc553e6205e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:52.182023 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e6b68-3f24-4984-9028-5fc553e6205e admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:52.183515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e6b68-3f24-4984-9028-5fc553e6205e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:52.185901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e6b68-3f24-4984-9028-5fc553e6205e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:52.200923 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1215/2451] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:01:52.209265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e6b68-3f24-4984-9028-5fc553e6205e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:52.222720 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e6b68-3f24-4984-9028-5fc553e6205e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:52.229896 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354cb99a-8593-41bf-9478-85bc760ba6ba admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:52.230134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e3ee6-3629-41d7-9d98-d6cc416fb5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:52.230785 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e3ee6-3629-41d7-9d98-d6cc416fb5a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:52.231530 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e3ee6-3629-41d7-9d98-d6cc416fb5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:52.232301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e3ee6-3629-41d7-9d98-d6cc416fb5a8 admin admin] PATH_INFO: `/v3/projects/7a8f0059f1674a0d86ed510952c31c64/users/4e6456181c474a94ae31b1d21144816e/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:52.236412 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:52.239842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c648a-4f2d-4d11-9a52-85f54be0499c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:52.240089 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c648a-4f2d-4d11-9a52-85f54be0499c admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:52.240374 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c648a-4f2d-4d11-9a52-85f54be0499c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:52.241558 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c648a-4f2d-4d11-9a52-85f54be0499c admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:52.242242 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c648a-4f2d-4d11-9a52-85f54be0499c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:52.244121 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c648a-4f2d-4d11-9a52-85f54be0499c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:52.263343 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e3ee6-3629-41d7-9d98-d6cc416fb5a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a8f0059f1674a0d86ed510952c31c64, user_id=4e6456181c474a94ae31b1d21144816e, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:52.264367 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1237/2452] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:01:52.267228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e3ee6-3629-41d7-9d98-d6cc416fb5a8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:52.269167 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c648a-4f2d-4d11-9a52-85f54be0499c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:52.287148 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c648a-4f2d-4d11-9a52-85f54be0499c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:52.306310 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1216/2453] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:01:52 2022] PUT /identity/v3/projects/7a8f0059f1674a0d86ed510952c31c64/users/4e6456181c474a94ae31b1d21144816e/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:52.312361 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e3ee6-3629-41d7-9d98-d6cc416fb5a8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:52.407780 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ccc82-0d76-4c62-93ff-9d93077d215e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:52.408472 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ccc82-0d76-4c62-93ff-9d93077d215e admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:52.408751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ccc82-0d76-4c62-93ff-9d93077d215e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:52.409028 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ccc82-0d76-4c62-93ff-9d93077d215e admin admin] PATH_INFO: `/v3/projects/ccb7633c69ef47dd915ebf1e69b4f866/users/9f2e19edfa5949818efd0a30bda6adcc/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:52.413268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2ccc82-0d76-4c62-93ff-9d93077d215e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccb7633c69ef47dd915ebf1e69b4f866, user_id=9f2e19edfa5949818efd0a30bda6adcc, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:52.415986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2ccc82-0d76-4c62-93ff-9d93077d215e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:52.440279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e3ee6-3629-41d7-9d98-d6cc416fb5a8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:52.445654 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1238/2454] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:01:52 2022] PUT /identity/v3/projects/ccb7633c69ef47dd915ebf1e69b4f866/users/9f2e19edfa5949818efd0a30bda6adcc/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:52.458003 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce60e23-0e4d-4bbb-bf21-a867e3b5d9ac None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:52.458280 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce60e23-0e4d-4bbb-bf21-a867e3b5d9ac None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:52.458557 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce60e23-0e4d-4bbb-bf21-a867e3b5d9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:52.521630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388a965-dbda-41e9-8193-3dcd59eca2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:52.522881 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388a965-dbda-41e9-8193-3dcd59eca2e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:52.522881 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388a965-dbda-41e9-8193-3dcd59eca2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:52.523308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388a965-dbda-41e9-8193-3dcd59eca2e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:52.524144 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388a965-dbda-41e9-8193-3dcd59eca2e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:52.529787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388a965-dbda-41e9-8193-3dcd59eca2e1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:52.532478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-2ce60e23-0e4d-4bbb-bf21-a867e3b5d9ac None None] MFA Rules not processed for user `9f2e19edfa5949818efd0a30bda6adcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:52.533763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2ce60e23-0e4d-4bbb-bf21-a867e3b5d9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:52.557944 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:52.573652 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1217/2455] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:01:52.574937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388a965-dbda-41e9-8193-3dcd59eca2e1 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:52.606306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388a965-dbda-41e9-8193-3dcd59eca2e1 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:52.630774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf41ae3-3376-4468-9ee7-cdc0e92df359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:52.631469 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf41ae3-3376-4468-9ee7-cdc0e92df359 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:52.631751 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf41ae3-3376-4468-9ee7-cdc0e92df359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:52.632027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf41ae3-3376-4468-9ee7-cdc0e92df359 admin admin] PATH_INFO: `/v3/projects/7a8f0059f1674a0d86ed510952c31c64/users/4e6456181c474a94ae31b1d21144816e/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:52.635870 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf41ae3-3376-4468-9ee7-cdc0e92df359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a8f0059f1674a0d86ed510952c31c64, user_id=4e6456181c474a94ae31b1d21144816e, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:52.638685 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf41ae3-3376-4468-9ee7-cdc0e92df359 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:52.679637 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1218/2456] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:01:52 2022] PUT /identity/v3/projects/7a8f0059f1674a0d86ed510952c31c64/users/4e6456181c474a94ae31b1d21144816e/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:52.715758 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1239/2457] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:52 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:52.719555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005c11c-2fc5-4aa0-af87-31c30989f903 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:52.720694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005c11c-2fc5-4aa0-af87-31c30989f903 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:52.720694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005c11c-2fc5-4aa0-af87-31c30989f903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:52.753337 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5005c11c-2fc5-4aa0-af87-31c30989f903 None None] MFA Rules not processed for user `046f548e010b4f06a664d82f5bc1bae2`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:52.754955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5005c11c-2fc5-4aa0-af87-31c30989f903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:52.777124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da91cbf-1c9c-45ab-b590-6964b2d611c8 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:52.777536 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da91cbf-1c9c-45ab-b590-6964b2d611c8 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:52.777901 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da91cbf-1c9c-45ab-b590-6964b2d611c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:52.871132 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-8da91cbf-1c9c-45ab-b590-6964b2d611c8 None None] MFA Rules not processed for user `4e6456181c474a94ae31b1d21144816e`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:52.872630 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8da91cbf-1c9c-45ab-b590-6964b2d611c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:52.929841 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1219/2458] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:52 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:52.939979 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005c11c-2fc5-4aa0-af87-31c30989f903 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:52.966847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5005c11c-2fc5-4aa0-af87-31c30989f903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:53.023743 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:53.124800 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1240/2459] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:52 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:53.135255 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da91cbf-1c9c-45ab-b590-6964b2d611c8 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:53.138277 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8da91cbf-1c9c-45ab-b590-6964b2d611c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:53.197930 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005c11c-2fc5-4aa0-af87-31c30989f903 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:53.223224 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5575e-b205-4bfd-8334-a9d2d3170cef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:53.228528 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5575e-b205-4bfd-8334-a9d2d3170cef service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:53.228888 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5575e-b205-4bfd-8334-a9d2d3170cef service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:53.229232 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5575e-b205-4bfd-8334-a9d2d3170cef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:53.252506 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d5575e-b205-4bfd-8334-a9d2d3170cef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:53.255978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d5575e-b205-4bfd-8334-a9d2d3170cef service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:53.292215 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1220/2460] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:01:52 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:01:53.319661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da91cbf-1c9c-45ab-b590-6964b2d611c8 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:53.335100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38022e-b372-46ca-beea-e47bf7753c2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:53.335829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38022e-b372-46ca-beea-e47bf7753c2e service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:53.336182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38022e-b372-46ca-beea-e47bf7753c2e service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:53.336866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38022e-b372-46ca-beea-e47bf7753c2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:53.349934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38022e-b372-46ca-beea-e47bf7753c2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:53.352733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38022e-b372-46ca-beea-e47bf7753c2e service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:53.368061 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1241/2461] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:01:53 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:01:53.903226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5575e-b205-4bfd-8334-a9d2d3170cef service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:53.924046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5575e-b205-4bfd-8334-a9d2d3170cef service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:53.934538 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab09162-d02d-4b48-9c25-f3966f0246c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:53.935167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab09162-d02d-4b48-9c25-f3966f0246c1 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:53.935442 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab09162-d02d-4b48-9c25-f3966f0246c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:53.935710 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab09162-d02d-4b48-9c25-f3966f0246c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:54.076151 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab09162-d02d-4b48-9c25-f3966f0246c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:54.077890 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab09162-d02d-4b48-9c25-f3966f0246c1 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:54.103547 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1221/2462] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:01:53 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:01:54.962825 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38022e-b372-46ca-beea-e47bf7753c2e service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:55.002014 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:55.045776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38022e-b372-46ca-beea-e47bf7753c2e service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:55.050845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10779da4-bc34-47df-a325-b065a8ed3bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:55.051469 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10779da4-bc34-47df-a325-b065a8ed3bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:55.051749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10779da4-bc34-47df-a325-b065a8ed3bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:55.052020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10779da4-bc34-47df-a325-b065a8ed3bcd admin admin] PATH_INFO: `/v3/users/a8bd2d3bf52c461abc669981f945e872` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:55.057503 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10779da4-bc34-47df-a325-b065a8ed3bcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8bd2d3bf52c461abc669981f945e872)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:55.063088 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10779da4-bc34-47df-a325-b065a8ed3bcd admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:55.165247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-10779da4-bc34-47df-a325-b065a8ed3bcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8bd2d3bf52c461abc669981f945e872'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:55.168644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-10779da4-bc34-47df-a325-b065a8ed3bcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8bd2d3bf52c461abc669981f945e872'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:55.179893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-10779da4-bc34-47df-a325-b065a8ed3bcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8bd2d3bf52c461abc669981f945e872'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:55.193300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-10779da4-bc34-47df-a325-b065a8ed3bcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8bd2d3bf52c461abc669981f945e872'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:55.194108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-10779da4-bc34-47df-a325-b065a8ed3bcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8bd2d3bf52c461abc669981f945e872'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:55.221188 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1242/2463] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:01:54 2022] DELETE /identity/v3/users/a8bd2d3bf52c461abc669981f945e872 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:55.225337 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be3fed-e5bb-47c6-9022-0ee6265a68ef None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:55.225867 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be3fed-e5bb-47c6-9022-0ee6265a68ef None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:55.226752 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be3fed-e5bb-47c6-9022-0ee6265a68ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:55.299057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-27be3fed-e5bb-47c6-9022-0ee6265a68ef None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:55.300273 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-27be3fed-e5bb-47c6-9022-0ee6265a68ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:55.335889 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c73ab-c488-4d6a-b4d8-48e8b777c0b4 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:55.336234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c73ab-c488-4d6a-b4d8-48e8b777c0b4 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:55.336714 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c73ab-c488-4d6a-b4d8-48e8b777c0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:55.361202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-934c73ab-c488-4d6a-b4d8-48e8b777c0b4 None None] MFA Rules not processed for user `41571ce2b64c4762b04ed0848bf34c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:55.365776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-934c73ab-c488-4d6a-b4d8-48e8b777c0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:55.434159 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1222/2464] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:55.446150 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be3fed-e5bb-47c6-9022-0ee6265a68ef None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:55.448431 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-27be3fed-e5bb-47c6-9022-0ee6265a68ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:55.467830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be3fed-e5bb-47c6-9022-0ee6265a68ef None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:55.473917 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e98219-7d7c-4d04-99cd-7e329cda570c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:55.474803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e98219-7d7c-4d04-99cd-7e329cda570c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:55.475288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e98219-7d7c-4d04-99cd-7e329cda570c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:55.475756 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e98219-7d7c-4d04-99cd-7e329cda570c admin admin] PATH_INFO: `/v3/users/6e0026a1a659485f98e1f7e780caa9bf` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:55.477005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e98219-7d7c-4d04-99cd-7e329cda570c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e0026a1a659485f98e1f7e780caa9bf)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:55.477578 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1243/2465] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:55 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:01:55.478485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c73ab-c488-4d6a-b4d8-48e8b777c0b4 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:55.479865 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e98219-7d7c-4d04-99cd-7e329cda570c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:55.479985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-934c73ab-c488-4d6a-b4d8-48e8b777c0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:55.570581 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:55.573115 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:55.577153 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c73ab-c488-4d6a-b4d8-48e8b777c0b4 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:55.584179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa1658-edc9-4815-b81c-e78ea474b39e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:55.585244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa1658-edc9-4815-b81c-e78ea474b39e service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:55.586673 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa1658-edc9-4815-b81c-e78ea474b39e service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:55.586956 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa1658-edc9-4815-b81c-e78ea474b39e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:55.600883 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa1658-edc9-4815-b81c-e78ea474b39e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:55.604646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa1658-edc9-4815-b81c-e78ea474b39e service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:55.609947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-87e98219-7d7c-4d04-99cd-7e329cda570c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e0026a1a659485f98e1f7e780caa9bf'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:55.612921 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-87e98219-7d7c-4d04-99cd-7e329cda570c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e0026a1a659485f98e1f7e780caa9bf'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:55.623219 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-87e98219-7d7c-4d04-99cd-7e329cda570c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e0026a1a659485f98e1f7e780caa9bf'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:55.624366 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1244/2466] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:01:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:01:55.638814 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-87e98219-7d7c-4d04-99cd-7e329cda570c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e0026a1a659485f98e1f7e780caa9bf'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:55.640742 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-87e98219-7d7c-4d04-99cd-7e329cda570c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e0026a1a659485f98e1f7e780caa9bf'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:55.696484 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1223/2467] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:01:55 2022] DELETE /identity/v3/users/6e0026a1a659485f98e1f7e780caa9bf => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:01:55.698451 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9cd392-49e5-49bf-a5b3-6dc965b16f79 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:55.698735 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9cd392-49e5-49bf-a5b3-6dc965b16f79 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:55.699075 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9cd392-49e5-49bf-a5b3-6dc965b16f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:55.728933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-fd9cd392-49e5-49bf-a5b3-6dc965b16f79 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:55.730269 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fd9cd392-49e5-49bf-a5b3-6dc965b16f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:55.826253 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1245/2468] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:55.860858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e98219-7d7c-4d04-99cd-7e329cda570c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:55.862445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-87e98219-7d7c-4d04-99cd-7e329cda570c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:55.963667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e98219-7d7c-4d04-99cd-7e329cda570c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:55.983507 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590683c9-1f6a-45f5-aa4f-e7d2c8c48077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:55.984140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590683c9-1f6a-45f5-aa4f-e7d2c8c48077 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:55.984675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590683c9-1f6a-45f5-aa4f-e7d2c8c48077 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:55.984949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590683c9-1f6a-45f5-aa4f-e7d2c8c48077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:56.009846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590683c9-1f6a-45f5-aa4f-e7d2c8c48077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:56.011593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590683c9-1f6a-45f5-aa4f-e7d2c8c48077 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:56.030223 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1224/2469] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:01:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:01:56.667899 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9cd392-49e5-49bf-a5b3-6dc965b16f79 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:56.671762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fd9cd392-49e5-49bf-a5b3-6dc965b16f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:56.690428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9cd392-49e5-49bf-a5b3-6dc965b16f79 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:56.697242 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590683c9-1f6a-45f5-aa4f-e7d2c8c48077 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:56.699564 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-590683c9-1f6a-45f5-aa4f-e7d2c8c48077 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:56.704967 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef9799-8237-4a0a-a91f-9a64347154da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:56.709656 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef9799-8237-4a0a-a91f-9a64347154da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:56.709918 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef9799-8237-4a0a-a91f-9a64347154da admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:56.710196 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef9799-8237-4a0a-a91f-9a64347154da admin admin] PATH_INFO: `/v3/projects/3e68b453ac4b4c458a0b91431da2332c` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:56.727544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef9799-8237-4a0a-a91f-9a64347154da admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e68b453ac4b4c458a0b91431da2332c)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:56.743422 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590683c9-1f6a-45f5-aa4f-e7d2c8c48077 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:56.745726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef9799-8237-4a0a-a91f-9a64347154da admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:56.749731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b3eb8-c7c1-491d-a0b1-18ef0dbc6d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:56.751997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b3eb8-c7c1-491d-a0b1-18ef0dbc6d43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:56.752287 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b3eb8-c7c1-491d-a0b1-18ef0dbc6d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:56.752564 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b3eb8-c7c1-491d-a0b1-18ef0dbc6d43 admin admin] PATH_INFO: `/v3/projects/a40ffc2c2875417fb4027371d3a8aad0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:56.757054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b3eb8-c7c1-491d-a0b1-18ef0dbc6d43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a40ffc2c2875417fb4027371d3a8aad0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:56.763393 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b3eb8-c7c1-491d-a0b1-18ef0dbc6d43 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:56.949084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-50ef9799-8237-4a0a-a91f-9a64347154da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e68b453ac4b4c458a0b91431da2332c', 'request_id': 'req-50ef9799-8237-4a0a-a91f-9a64347154da'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:56.965657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3a4b3eb8-c7c1-491d-a0b1-18ef0dbc6d43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a40ffc2c2875417fb4027371d3a8aad0', 'request_id': 'req-3a4b3eb8-c7c1-491d-a0b1-18ef0dbc6d43'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:56.983573 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-50ef9799-8237-4a0a-a91f-9a64347154da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e68b453ac4b4c458a0b91431da2332c', 'request_id': 'req-50ef9799-8237-4a0a-a91f-9a64347154da'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:57.004329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-50ef9799-8237-4a0a-a91f-9a64347154da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e68b453ac4b4c458a0b91431da2332c', 'request_id': 'req-50ef9799-8237-4a0a-a91f-9a64347154da'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:57.006108 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3a4b3eb8-c7c1-491d-a0b1-18ef0dbc6d43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a40ffc2c2875417fb4027371d3a8aad0', 'request_id': 'req-3a4b3eb8-c7c1-491d-a0b1-18ef0dbc6d43'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:57.022266 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-50ef9799-8237-4a0a-a91f-9a64347154da admin admin] The token cache is being invalidate because project 3e68b453ac4b4c458a0b91431da2332c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:01:57.022539 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-50ef9799-8237-4a0a-a91f-9a64347154da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:57.023389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-50ef9799-8237-4a0a-a91f-9a64347154da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:57.027903 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1246/2470] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:01:56 2022] DELETE /identity/v3/projects/3e68b453ac4b4c458a0b91431da2332c => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:57.028086 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3a4b3eb8-c7c1-491d-a0b1-18ef0dbc6d43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a40ffc2c2875417fb4027371d3a8aad0', 'request_id': 'req-3a4b3eb8-c7c1-491d-a0b1-18ef0dbc6d43'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:57.041799 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef9799-8237-4a0a-a91f-9a64347154da admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:57.055021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-50ef9799-8237-4a0a-a91f-9a64347154da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:57.058053 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3a4b3eb8-c7c1-491d-a0b1-18ef0dbc6d43 admin admin] The token cache is being invalidate because project a40ffc2c2875417fb4027371d3a8aad0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:01:57.058347 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3a4b3eb8-c7c1-491d-a0b1-18ef0dbc6d43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:57.060992 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3a4b3eb8-c7c1-491d-a0b1-18ef0dbc6d43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:57.065836 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1225/2471] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:01:56 2022] DELETE /identity/v3/projects/a40ffc2c2875417fb4027371d3a8aad0 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:01:57.067004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b3eb8-c7c1-491d-a0b1-18ef0dbc6d43 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:57.069199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3a4b3eb8-c7c1-491d-a0b1-18ef0dbc6d43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:57.214477 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:57.248467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef9799-8237-4a0a-a91f-9a64347154da admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:57.263965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99204f-cf83-4685-9b00-54c4b3e9b8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:57.264663 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99204f-cf83-4685-9b00-54c4b3e9b8bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:57.264955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99204f-cf83-4685-9b00-54c4b3e9b8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:57.265229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99204f-cf83-4685-9b00-54c4b3e9b8bb admin admin] PATH_INFO: `/v3/users/866c09d08c664b7ca85770c91832ab73` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:57.268932 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99204f-cf83-4685-9b00-54c4b3e9b8bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=866c09d08c664b7ca85770c91832ab73)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:57.271103 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99204f-cf83-4685-9b00-54c4b3e9b8bb admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:57.276350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b3eb8-c7c1-491d-a0b1-18ef0dbc6d43 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:57.290126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97125b17-3f89-477a-9998-7c62e5e125c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:57.291085 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97125b17-3f89-477a-9998-7c62e5e125c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:57.291309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97125b17-3f89-477a-9998-7c62e5e125c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:57.293590 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97125b17-3f89-477a-9998-7c62e5e125c1 admin admin] PATH_INFO: `/v3/users/4e6456181c474a94ae31b1d21144816e` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:57.296667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97125b17-3f89-477a-9998-7c62e5e125c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e6456181c474a94ae31b1d21144816e)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:57.302164 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97125b17-3f89-477a-9998-7c62e5e125c1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:57.303424 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:57.370018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0c99204f-cf83-4685-9b00-54c4b3e9b8bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '866c09d08c664b7ca85770c91832ab73'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:57.370715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0c99204f-cf83-4685-9b00-54c4b3e9b8bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '866c09d08c664b7ca85770c91832ab73'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:57.387264 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0c99204f-cf83-4685-9b00-54c4b3e9b8bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '866c09d08c664b7ca85770c91832ab73'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:57.408787 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0c99204f-cf83-4685-9b00-54c4b3e9b8bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '866c09d08c664b7ca85770c91832ab73'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:57.409729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0c99204f-cf83-4685-9b00-54c4b3e9b8bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '866c09d08c664b7ca85770c91832ab73'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:57.442126 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1247/2472] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:01:57 2022] DELETE /identity/v3/users/866c09d08c664b7ca85770c91832ab73 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:57.459373 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-97125b17-3f89-477a-9998-7c62e5e125c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e6456181c474a94ae31b1d21144816e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:57.460225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-97125b17-3f89-477a-9998-7c62e5e125c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e6456181c474a94ae31b1d21144816e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:57.476198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-97125b17-3f89-477a-9998-7c62e5e125c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e6456181c474a94ae31b1d21144816e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:57.517261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-97125b17-3f89-477a-9998-7c62e5e125c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e6456181c474a94ae31b1d21144816e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:57.518926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-97125b17-3f89-477a-9998-7c62e5e125c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e6456181c474a94ae31b1d21144816e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:57.561724 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1226/2473] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:01:57 2022] DELETE /identity/v3/users/4e6456181c474a94ae31b1d21144816e => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:01:58.149233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99204f-cf83-4685-9b00-54c4b3e9b8bb admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:58.150810 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0c99204f-cf83-4685-9b00-54c4b3e9b8bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:58.291701 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99204f-cf83-4685-9b00-54c4b3e9b8bb admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:58.384287 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ad86f-8f00-4bb5-8061-b69696174d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:58.385055 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ad86f-8f00-4bb5-8061-b69696174d57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:58.385333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ad86f-8f00-4bb5-8061-b69696174d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:58.385649 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ad86f-8f00-4bb5-8061-b69696174d57 admin admin] PATH_INFO: `/v3/projects/867a276e37e44ccb97253578feee2d04` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:58.387299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ad86f-8f00-4bb5-8061-b69696174d57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=867a276e37e44ccb97253578feee2d04)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:58.389593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ad86f-8f00-4bb5-8061-b69696174d57 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:58.477883 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:58.491394 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ef8ad86f-8f00-4bb5-8061-b69696174d57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '867a276e37e44ccb97253578feee2d04', 'request_id': 'req-ef8ad86f-8f00-4bb5-8061-b69696174d57'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:58.511914 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ef8ad86f-8f00-4bb5-8061-b69696174d57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '867a276e37e44ccb97253578feee2d04', 'request_id': 'req-ef8ad86f-8f00-4bb5-8061-b69696174d57'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:58.518749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ef8ad86f-8f00-4bb5-8061-b69696174d57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '867a276e37e44ccb97253578feee2d04', 'request_id': 'req-ef8ad86f-8f00-4bb5-8061-b69696174d57'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:58.546812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ef8ad86f-8f00-4bb5-8061-b69696174d57 admin admin] The token cache is being invalidate because project 867a276e37e44ccb97253578feee2d04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:01:58.547229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ef8ad86f-8f00-4bb5-8061-b69696174d57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:58.558194 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ef8ad86f-8f00-4bb5-8061-b69696174d57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:58.558194 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1248/2474] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:01:58 2022] DELETE /identity/v3/projects/867a276e37e44ccb97253578feee2d04 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:58.560769 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ded2d-a925-42dc-a208-6685027b7008 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:58.560769 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ded2d-a925-42dc-a208-6685027b7008 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:58.561761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ded2d-a925-42dc-a208-6685027b7008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:58.600459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-295ded2d-a925-42dc-a208-6685027b7008 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:58.602168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-295ded2d-a925-42dc-a208-6685027b7008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:58.799948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ad86f-8f00-4bb5-8061-b69696174d57 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:58.801644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ef8ad86f-8f00-4bb5-8061-b69696174d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:58.853217 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1227/2475] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:58.871843 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225362dc-340a-4702-8e30-d76b9d1fd920 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:58.872301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225362dc-340a-4702-8e30-d76b9d1fd920 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:58.872465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225362dc-340a-4702-8e30-d76b9d1fd920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:58.963622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-225362dc-340a-4702-8e30-d76b9d1fd920 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:58.973051 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-225362dc-340a-4702-8e30-d76b9d1fd920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:59.005469 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1228/2476] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:59.015802 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225362dc-340a-4702-8e30-d76b9d1fd920 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:59.050842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225362dc-340a-4702-8e30-d76b9d1fd920 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:59.080993 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e6482-4a7d-4c46-bee8-48723224533f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:59.081935 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e6482-4a7d-4c46-bee8-48723224533f admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:59.082742 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ad86f-8f00-4bb5-8061-b69696174d57 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:59.084452 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e6482-4a7d-4c46-bee8-48723224533f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:59.085922 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e6482-4a7d-4c46-bee8-48723224533f admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:59.088896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e6482-4a7d-4c46-bee8-48723224533f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:01:59.090257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e6482-4a7d-4c46-bee8-48723224533f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:59.105667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e6482-4a7d-4c46-bee8-48723224533f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:59.109639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc322625-0166-4fd9-b52f-e79c5e381788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:59.113773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc322625-0166-4fd9-b52f-e79c5e381788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:59.114822 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc322625-0166-4fd9-b52f-e79c5e381788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:59.117921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc322625-0166-4fd9-b52f-e79c5e381788 admin admin] PATH_INFO: `/v3/projects/7a8f0059f1674a0d86ed510952c31c64` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:59.122750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc322625-0166-4fd9-b52f-e79c5e381788 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a8f0059f1674a0d86ed510952c31c64)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:59.127508 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc322625-0166-4fd9-b52f-e79c5e381788 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:59.168704 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1229/2477] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:01:59.175344 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e6482-4a7d-4c46-bee8-48723224533f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:59.217802 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e6482-4a7d-4c46-bee8-48723224533f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:59.234606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a8820-8b52-4145-88c1-566a3754a468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:59.237122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a8820-8b52-4145-88c1-566a3754a468 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:59.237422 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a8820-8b52-4145-88c1-566a3754a468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:59.237950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a8820-8b52-4145-88c1-566a3754a468 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:59.239004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a8820-8b52-4145-88c1-566a3754a468 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:59.245259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a8820-8b52-4145-88c1-566a3754a468 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:59.290445 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bc322625-0166-4fd9-b52f-e79c5e381788 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a8f0059f1674a0d86ed510952c31c64', 'request_id': 'req-bc322625-0166-4fd9-b52f-e79c5e381788'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:59.337787 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bc322625-0166-4fd9-b52f-e79c5e381788 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a8f0059f1674a0d86ed510952c31c64', 'request_id': 'req-bc322625-0166-4fd9-b52f-e79c5e381788'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:59.368726 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1230/2478] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:01:59 2022] POST /identity/v3/projects => generated 381 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:01:59.374287 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a8820-8b52-4145-88c1-566a3754a468 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:59.377269 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bc322625-0166-4fd9-b52f-e79c5e381788 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a8f0059f1674a0d86ed510952c31c64', 'request_id': 'req-bc322625-0166-4fd9-b52f-e79c5e381788'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:59.429505 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bc322625-0166-4fd9-b52f-e79c5e381788 admin admin] The token cache is being invalidate because project 7a8f0059f1674a0d86ed510952c31c64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:01:59.429873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bc322625-0166-4fd9-b52f-e79c5e381788 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:59.433182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bc322625-0166-4fd9-b52f-e79c5e381788 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:01:59.450907 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1249/2479] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:01:58 2022] DELETE /identity/v3/projects/7a8f0059f1674a0d86ed510952c31c64 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:01:59.455570 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:59.459345 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9e2c0-c8db-420f-b796-23f69d3a167c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:59.459691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9e2c0-c8db-420f-b796-23f69d3a167c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:59.460892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9e2c0-c8db-420f-b796-23f69d3a167c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:59.508846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-35b9e2c0-c8db-420f-b796-23f69d3a167c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:59.510106 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-35b9e2c0-c8db-420f-b796-23f69d3a167c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:59.574391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a8820-8b52-4145-88c1-566a3754a468 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:59.575595 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:59.591301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33f4c5-2e4c-44b3-8108-68dcc15c58c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:59.591891 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33f4c5-2e4c-44b3-8108-68dcc15c58c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:59.592172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33f4c5-2e4c-44b3-8108-68dcc15c58c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:59.592445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33f4c5-2e4c-44b3-8108-68dcc15c58c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:59.592988 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1250/2480] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:59.593110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33f4c5-2e4c-44b3-8108-68dcc15c58c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:59.595603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33f4c5-2e4c-44b3-8108-68dcc15c58c0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:59.601901 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ab99f-3887-4be3-aeed-739d16c1d91d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:59.601901 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ab99f-3887-4be3-aeed-739d16c1d91d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:59.602532 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ab99f-3887-4be3-aeed-739d16c1d91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:59.628092 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-cf4ab99f-3887-4be3-aeed-739d16c1d91d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:01:59.629563 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-cf4ab99f-3887-4be3-aeed-739d16c1d91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:59.642108 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1251/2481] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:01:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:01:59.644792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ab99f-3887-4be3-aeed-739d16c1d91d None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:59.659350 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1231/2482] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:01:59 2022] POST /identity/v3/users => generated 291 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:01:59.663911 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33f4c5-2e4c-44b3-8108-68dcc15c58c0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:59.666810 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ab99f-3887-4be3-aeed-739d16c1d91d None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:59.674628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4a33f4c5-2e4c-44b3-8108-68dcc15c58c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:01:59.702767 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614c551-db3c-4a5b-b25c-9337726d3483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:59.704188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614c551-db3c-4a5b-b25c-9337726d3483 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:59.704324 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33f4c5-2e4c-44b3-8108-68dcc15c58c0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:59.704777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614c551-db3c-4a5b-b25c-9337726d3483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:59.705151 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614c551-db3c-4a5b-b25c-9337726d3483 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:59.706478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614c551-db3c-4a5b-b25c-9337726d3483 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:01:59.706892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614c551-db3c-4a5b-b25c-9337726d3483 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:59.708632 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614c551-db3c-4a5b-b25c-9337726d3483 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:59.753939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8bf75-230a-40e0-972b-0397c5368932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:59.753939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8bf75-230a-40e0-972b-0397c5368932 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:59.753939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8bf75-230a-40e0-972b-0397c5368932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:59.753939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8bf75-230a-40e0-972b-0397c5368932 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:59.754506 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8bf75-230a-40e0-972b-0397c5368932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:59.758080 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8bf75-230a-40e0-972b-0397c5368932 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:59.806908 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1252/2483] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:01:59.808823 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614c551-db3c-4a5b-b25c-9337726d3483 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:59.812255 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1232/2484] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:01:59.820723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8bf75-230a-40e0-972b-0397c5368932 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:59.849397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8bf75-230a-40e0-972b-0397c5368932 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:59.914782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2da37c-176e-4ba2-bc28-7c269508f47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:59.915429 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2da37c-176e-4ba2-bc28-7c269508f47b admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:59.915710 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2da37c-176e-4ba2-bc28-7c269508f47b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:59.915982 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2da37c-176e-4ba2-bc28-7c269508f47b admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:59.916640 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2da37c-176e-4ba2-bc28-7c269508f47b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:59.918607 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2da37c-176e-4ba2-bc28-7c269508f47b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:01:59.926532 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614c551-db3c-4a5b-b25c-9337726d3483 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:59.947330 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1233/2485] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:01:59.948266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2da37c-176e-4ba2-bc28-7c269508f47b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:01:59.978122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2da37c-176e-4ba2-bc28-7c269508f47b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:01:59.981972 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205db19-0a11-4d73-b721-cf9f8418ffc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:01:59.982749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205db19-0a11-4d73-b721-cf9f8418ffc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:01:59.983131 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205db19-0a11-4d73-b721-cf9f8418ffc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:01:59.983517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205db19-0a11-4d73-b721-cf9f8418ffc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:01:59.984253 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205db19-0a11-4d73-b721-cf9f8418ffc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:01:59.990324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205db19-0a11-4d73-b721-cf9f8418ffc1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:00.002348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b93e1a-606d-4f93-9a52-0db547a557c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:00.003037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b93e1a-606d-4f93-9a52-0db547a557c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:00.003320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b93e1a-606d-4f93-9a52-0db547a557c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:00.003677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b93e1a-606d-4f93-9a52-0db547a557c8 admin admin] PATH_INFO: `/v3/projects/46050caead134b438622b9ba505cf6cc/users/94d139d4b19f423189a68e959e338edf/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:00.041036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b93e1a-606d-4f93-9a52-0db547a557c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46050caead134b438622b9ba505cf6cc, user_id=94d139d4b19f423189a68e959e338edf, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:00.043750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b93e1a-606d-4f93-9a52-0db547a557c8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:00.079680 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1253/2486] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:01:59 2022] POST /identity/v3/projects => generated 405 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:02:00.081315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205db19-0a11-4d73-b721-cf9f8418ffc1 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:00.091892 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1234/2487] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:01:59 2022] PUT /identity/v3/projects/46050caead134b438622b9ba505cf6cc/users/94d139d4b19f423189a68e959e338edf/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:02:00.093313 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db14fdb-b9c7-4d6a-8231-bd04dd153e09 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:00.093634 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db14fdb-b9c7-4d6a-8231-bd04dd153e09 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:00.093913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db14fdb-b9c7-4d6a-8231-bd04dd153e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:00.151659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-3db14fdb-b9c7-4d6a-8231-bd04dd153e09 None None] MFA Rules not processed for user `94d139d4b19f423189a68e959e338edf`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:02:00.153662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3db14fdb-b9c7-4d6a-8231-bd04dd153e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:00.240012 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205db19-0a11-4d73-b721-cf9f8418ffc1 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:00.248439 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5665f-4f3d-4213-ae06-845de70b858a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:00.255373 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5665f-4f3d-4213-ae06-845de70b858a admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:00.257565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5665f-4f3d-4213-ae06-845de70b858a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:00.257960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5665f-4f3d-4213-ae06-845de70b858a admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:00.260248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae5665f-4f3d-4213-ae06-845de70b858a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:00.265021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae5665f-4f3d-4213-ae06-845de70b858a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:00.312232 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1235/2488] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:02:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:02:00.314058 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1254/2489] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:02:00 2022] POST /identity/v3/users => generated 303 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:02:00.317813 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db14fdb-b9c7-4d6a-8231-bd04dd153e09 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:00.320215 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5665f-4f3d-4213-ae06-845de70b858a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:00.340123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db14fdb-b9c7-4d6a-8231-bd04dd153e09 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:00.342707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5665f-4f3d-4213-ae06-845de70b858a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:00.353166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6583d-0207-4ba8-b079-92550caa1485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:00.354291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6583d-0207-4ba8-b079-92550caa1485 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:00.354796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6583d-0207-4ba8-b079-92550caa1485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:00.355128 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15597b-835f-45ec-8fba-1d0d911b328f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:00.355522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6583d-0207-4ba8-b079-92550caa1485 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:00.356087 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15597b-835f-45ec-8fba-1d0d911b328f admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:00.356441 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15597b-835f-45ec-8fba-1d0d911b328f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:00.356805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15597b-835f-45ec-8fba-1d0d911b328f admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:00.357556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d15597b-835f-45ec-8fba-1d0d911b328f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:00.358089 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6583d-0207-4ba8-b079-92550caa1485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:00.360348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6583d-0207-4ba8-b079-92550caa1485 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:00.362850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d15597b-835f-45ec-8fba-1d0d911b328f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:00.391959 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1236/2490] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:02:00.397250 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6583d-0207-4ba8-b079-92550caa1485 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:00.423776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6583d-0207-4ba8-b079-92550caa1485 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:00.428909 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1255/2491] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:02:00 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:02:00.430348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15597b-835f-45ec-8fba-1d0d911b328f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:00.498780 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:02:00.539987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc020a7-0194-4aa6-9aee-75dc82175348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:00.555626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc020a7-0194-4aa6-9aee-75dc82175348 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:00.555957 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc020a7-0194-4aa6-9aee-75dc82175348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:00.556181 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc020a7-0194-4aa6-9aee-75dc82175348 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:00.560092 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc020a7-0194-4aa6-9aee-75dc82175348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:00.565961 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc020a7-0194-4aa6-9aee-75dc82175348 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:00.575906 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15597b-835f-45ec-8fba-1d0d911b328f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:00.595474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62c572-3218-45dd-b14f-05377aa98b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:00.595474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62c572-3218-45dd-b14f-05377aa98b4f admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:00.595474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62c572-3218-45dd-b14f-05377aa98b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:00.595474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62c572-3218-45dd-b14f-05377aa98b4f admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:00.596016 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af62c572-3218-45dd-b14f-05377aa98b4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:00.597608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af62c572-3218-45dd-b14f-05377aa98b4f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:00.597801 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1237/2492] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:02:00.599646 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc020a7-0194-4aa6-9aee-75dc82175348 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:00.622560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc020a7-0194-4aa6-9aee-75dc82175348 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:00.634297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea014b22-06d3-4ed2-bfd9-86686bed4efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:00.636177 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea014b22-06d3-4ed2-bfd9-86686bed4efd admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:00.636712 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea014b22-06d3-4ed2-bfd9-86686bed4efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:00.637760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea014b22-06d3-4ed2-bfd9-86686bed4efd admin admin] PATH_INFO: `/v3/projects/ae068d2070f4424ebda9b7409dbdee7b/users/0aa865979f5d4abfaa9390151ec671fe/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:00.648252 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1256/2493] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:02:00 2022] POST /identity/v3/users => generated 297 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:02:00.649408 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62c572-3218-45dd-b14f-05377aa98b4f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:00.670737 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62c572-3218-45dd-b14f-05377aa98b4f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:00.676024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea014b22-06d3-4ed2-bfd9-86686bed4efd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae068d2070f4424ebda9b7409dbdee7b, user_id=0aa865979f5d4abfaa9390151ec671fe, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:00.683689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea014b22-06d3-4ed2-bfd9-86686bed4efd admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:00.684164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1592331-2e89-49ec-8f94-ebdf0984b383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:00.684909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1592331-2e89-49ec-8f94-ebdf0984b383 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:00.685282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1592331-2e89-49ec-8f94-ebdf0984b383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:00.685674 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1592331-2e89-49ec-8f94-ebdf0984b383 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:00.686644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1592331-2e89-49ec-8f94-ebdf0984b383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:00.688139 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1592331-2e89-49ec-8f94-ebdf0984b383 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:00.721669 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1257/2494] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:02:00.725726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1592331-2e89-49ec-8f94-ebdf0984b383 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:00.739448 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:02:00.744201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1592331-2e89-49ec-8f94-ebdf0984b383 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:00.748600 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1238/2495] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:02:00 2022] PUT /identity/v3/projects/ae068d2070f4424ebda9b7409dbdee7b/users/0aa865979f5d4abfaa9390151ec671fe/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:02:00.758971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c166f5-4b36-4964-b703-dee3195b13a9 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:00.759373 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c166f5-4b36-4964-b703-dee3195b13a9 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:00.759665 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c166f5-4b36-4964-b703-dee3195b13a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:00.828281 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d1c166f5-4b36-4964-b703-dee3195b13a9 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:02:00.830999 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d1c166f5-4b36-4964-b703-dee3195b13a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:00.909885 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641cf69b-fdf8-46a8-ac4f-bfeb61da15ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:00.911138 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641cf69b-fdf8-46a8-ac4f-bfeb61da15ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:00.911601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641cf69b-fdf8-46a8-ac4f-bfeb61da15ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:00.912052 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641cf69b-fdf8-46a8-ac4f-bfeb61da15ae admin admin] PATH_INFO: `/v3/projects/762bba83ebe641fc874f13477d8f6a43/users/c6a5033cbac548d19a917c92de1fd86b/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:00.951320 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641cf69b-fdf8-46a8-ac4f-bfeb61da15ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=762bba83ebe641fc874f13477d8f6a43, user_id=c6a5033cbac548d19a917c92de1fd86b, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:00.962362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641cf69b-fdf8-46a8-ac4f-bfeb61da15ae admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:01.000477 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1258/2496] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:02:00 2022] PUT /identity/v3/projects/762bba83ebe641fc874f13477d8f6a43/users/c6a5033cbac548d19a917c92de1fd86b/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:02:01.001630 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641cf69b-fdf8-46a8-ac4f-bfeb61da15ae admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:01.008065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-641cf69b-fdf8-46a8-ac4f-bfeb61da15ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:01.015170 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1239/2497] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:02:01.017119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c166f5-4b36-4964-b703-dee3195b13a9 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:01.057875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c166f5-4b36-4964-b703-dee3195b13a9 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:01.196114 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641cf69b-fdf8-46a8-ac4f-bfeb61da15ae admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:01.208435 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cf573-4a35-4340-88c1-c90fe1dc1ad0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:01.209757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cf573-4a35-4340-88c1-c90fe1dc1ad0 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:01.210744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cf573-4a35-4340-88c1-c90fe1dc1ad0 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:01.211244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cf573-4a35-4340-88c1-c90fe1dc1ad0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:01.219253 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77fc8a-f5bf-47c5-a0f7-7a093e74bafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:01.219970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77fc8a-f5bf-47c5-a0f7-7a093e74bafc admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:01.220274 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77fc8a-f5bf-47c5-a0f7-7a093e74bafc admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:01.220543 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77fc8a-f5bf-47c5-a0f7-7a093e74bafc admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:01.221193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77fc8a-f5bf-47c5-a0f7-7a093e74bafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:01.223075 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77fc8a-f5bf-47c5-a0f7-7a093e74bafc admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:01.232038 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-599cf573-4a35-4340-88c1-c90fe1dc1ad0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:01.264011 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1240/2498] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:02:01.264665 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77fc8a-f5bf-47c5-a0f7-7a093e74bafc admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:01.270886 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9a77fc8a-f5bf-47c5-a0f7-7a093e74bafc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:01.475036 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:02:01.484005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77fc8a-f5bf-47c5-a0f7-7a093e74bafc admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:01.486775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599cf573-4a35-4340-88c1-c90fe1dc1ad0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:01.488427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599cf573-4a35-4340-88c1-c90fe1dc1ad0 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:01.492957 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1454ab3-8dbb-4e58-9d5e-3ff739dde94d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:01.494214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1454ab3-8dbb-4e58-9d5e-3ff739dde94d service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:01.497889 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1454ab3-8dbb-4e58-9d5e-3ff739dde94d service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:01.498174 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1454ab3-8dbb-4e58-9d5e-3ff739dde94d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:01.517090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1454ab3-8dbb-4e58-9d5e-3ff739dde94d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:01.518601 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1454ab3-8dbb-4e58-9d5e-3ff739dde94d service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:01.528739 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1259/2499] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:02:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:02:01.529426 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cf573-4a35-4340-88c1-c90fe1dc1ad0 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:01.540407 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1241/2500] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:02:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:02:01.570887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cf573-4a35-4340-88c1-c90fe1dc1ad0 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:01.591915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6b61a-5745-4d6d-866a-f8d9e7cf197a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:01.592650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6b61a-5745-4d6d-866a-f8d9e7cf197a admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:01.592932 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6b61a-5745-4d6d-866a-f8d9e7cf197a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:01.593210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6b61a-5745-4d6d-866a-f8d9e7cf197a admin admin] PATH_INFO: `/v3/projects/762bba83ebe641fc874f13477d8f6a43/users/c6a5033cbac548d19a917c92de1fd86b/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:01.611337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de6b61a-5745-4d6d-866a-f8d9e7cf197a admin admin] RBAC: Authorizing `identity:create_grant(project_id=762bba83ebe641fc874f13477d8f6a43, user_id=c6a5033cbac548d19a917c92de1fd86b, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:01.614040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de6b61a-5745-4d6d-866a-f8d9e7cf197a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:01.639393 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1260/2501] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:02:01 2022] PUT /identity/v3/projects/762bba83ebe641fc874f13477d8f6a43/users/c6a5033cbac548d19a917c92de1fd86b/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:02:01.649574 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c0204-fc45-494a-8c04-9a04cbe6244f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:01.650140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c0204-fc45-494a-8c04-9a04cbe6244f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:01.650140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c0204-fc45-494a-8c04-9a04cbe6244f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:01.710823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-0d0c0204-fc45-494a-8c04-9a04cbe6244f None None] MFA Rules not processed for user `c6a5033cbac548d19a917c92de1fd86b`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:02:01.712107 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0d0c0204-fc45-494a-8c04-9a04cbe6244f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:01.922232 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1242/2502] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:02:01 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:02:01.935354 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a85b73-13c9-4fbb-afec-e72036d3598f None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:01.936193 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a85b73-13c9-4fbb-afec-e72036d3598f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:01.936641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a85b73-13c9-4fbb-afec-e72036d3598f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:01.977736 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:02:01.988723 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-20a85b73-13c9-4fbb-afec-e72036d3598f None None] MFA Rules not processed for user `94d139d4b19f423189a68e959e338edf`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:02:01.990891 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-20a85b73-13c9-4fbb-afec-e72036d3598f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:02.103714 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1261/2503] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:02:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:02:02.243818 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c0204-fc45-494a-8c04-9a04cbe6244f None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:02.356101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c0204-fc45-494a-8c04-9a04cbe6244f None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:02.374217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980418f7-8661-4bb1-96a7-fe843702b525 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:02.374990 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980418f7-8661-4bb1-96a7-fe843702b525 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:02.375370 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980418f7-8661-4bb1-96a7-fe843702b525 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:02.375779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980418f7-8661-4bb1-96a7-fe843702b525 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:02.389289 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980418f7-8661-4bb1-96a7-fe843702b525 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:02.391122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980418f7-8661-4bb1-96a7-fe843702b525 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:02.423921 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1243/2504] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:02:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:02:02.613546 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c811dbf-dfba-4328-a602-852b62ebe8fe None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:02.614512 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c811dbf-dfba-4328-a602-852b62ebe8fe None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:02.614978 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c811dbf-dfba-4328-a602-852b62ebe8fe None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:02.616743 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1262/2505] 10.222.0.30 () {54 vars in 921 bytes} [Sun Sep 4 01:02:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:02:02.624776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0a2ab-ec90-4b62-adcd-5094778d196a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:02.625155 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0a2ab-ec90-4b62-adcd-5094778d196a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:02.625726 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0a2ab-ec90-4b62-adcd-5094778d196a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:02.654032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-ccd0a2ab-ec90-4b62-adcd-5094778d196a None None] MFA Rules not processed for user `2cdde7a212954a01a2591ad5ac30d049`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:02:02.655635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ccd0a2ab-ec90-4b62-adcd-5094778d196a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:02.769048 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1244/2506] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Sep 4 01:02:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:02:02.804679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c811dbf-dfba-4328-a602-852b62ebe8fe None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:02.806482 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7c811dbf-dfba-4328-a602-852b62ebe8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:02.827755 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c811dbf-dfba-4328-a602-852b62ebe8fe None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:02.837135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970b060-a08d-4f42-ba24-ac0efeadc151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:02.837801 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970b060-a08d-4f42-ba24-ac0efeadc151 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:02.838083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970b060-a08d-4f42-ba24-ac0efeadc151 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:02.838352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970b060-a08d-4f42-ba24-ac0efeadc151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:02.850812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970b060-a08d-4f42-ba24-ac0efeadc151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:02.853168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970b060-a08d-4f42-ba24-ac0efeadc151 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:02.873846 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1263/2507] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:02:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:02:03.774390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3508e2-6748-46d9-8e98-5704108bfc98 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:03.774880 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3508e2-6748-46d9-8e98-5704108bfc98 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:03.774978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3508e2-6748-46d9-8e98-5704108bfc98 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:03.776497 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1245/2508] 10.222.0.30 () {54 vars in 921 bytes} [Sun Sep 4 01:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 04 01:02:03.787357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e74d6-6eb5-4e1c-b0e1-cfba1f14c0a1 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:03.787894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e74d6-6eb5-4e1c-b0e1-cfba1f14c0a1 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:03.787894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e74d6-6eb5-4e1c-b0e1-cfba1f14c0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:03.835162 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-612e74d6-6eb5-4e1c-b0e1-cfba1f14c0a1 None None] MFA Rules not processed for user `13f0f341bf2c475d82b4e7b34d503dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:02:03.846017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-612e74d6-6eb5-4e1c-b0e1-cfba1f14c0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:03.901110 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1264/2509] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Sep 4 01:02:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:02:03.966526 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3508e2-6748-46d9-8e98-5704108bfc98 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:03.986132 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3508e2-6748-46d9-8e98-5704108bfc98 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:04.002098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd3b89-1451-4249-b33d-fb6b8e93f812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:04.003748 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd3b89-1451-4249-b33d-fb6b8e93f812 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:04.004272 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd3b89-1451-4249-b33d-fb6b8e93f812 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:04.005258 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd3b89-1451-4249-b33d-fb6b8e93f812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:04.046750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd3b89-1451-4249-b33d-fb6b8e93f812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:04.049466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd3b89-1451-4249-b33d-fb6b8e93f812 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:04.055675 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:02:04.074587 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1246/2510] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:02:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:02:09.186288 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0ebe4-9fc4-4f01-9f5e-bd0ca8a64e24 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:09.187217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0ebe4-9fc4-4f01-9f5e-bd0ca8a64e24 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:09.187717 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0ebe4-9fc4-4f01-9f5e-bd0ca8a64e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:09.212415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-67c0ebe4-9fc4-4f01-9f5e-bd0ca8a64e24 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:02:09.214491 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-67c0ebe4-9fc4-4f01-9f5e-bd0ca8a64e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:09.294350 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1265/2511] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 01:02:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:02:09.310490 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd3b89-1451-4249-b33d-fb6b8e93f812 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:09.312245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-98cd3b89-1451-4249-b33d-fb6b8e93f812 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:09.395380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd3b89-1451-4249-b33d-fb6b8e93f812 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:09.400077 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c98f75-4477-40c1-9743-8ad831b48ab5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:09.400945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c98f75-4477-40c1-9743-8ad831b48ab5 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:09.401416 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c98f75-4477-40c1-9743-8ad831b48ab5 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:09.401926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c98f75-4477-40c1-9743-8ad831b48ab5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:09.419587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c98f75-4477-40c1-9743-8ad831b48ab5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:09.421231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c98f75-4477-40c1-9743-8ad831b48ab5 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:09.435489 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1247/2512] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:02:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:02:10.682514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486917f-43d1-4acc-85c1-47846454809a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:10.683047 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486917f-43d1-4acc-85c1-47846454809a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:10.683156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486917f-43d1-4acc-85c1-47846454809a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:10.725244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-f486917f-43d1-4acc-85c1-47846454809a None None] MFA Rules not processed for user `545e0ebcbe314ee1a8419e3583e74d23`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:02:10.727382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f486917f-43d1-4acc-85c1-47846454809a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:10.849235 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1266/2513] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:02:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:02:12.926891 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421319b9-170e-416e-ae81-17b39c25c065 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:12.927378 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421319b9-170e-416e-ae81-17b39c25c065 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:12.927462 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421319b9-170e-416e-ae81-17b39c25c065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:12.998142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-421319b9-170e-416e-ae81-17b39c25c065 None None] MFA Rules not processed for user `0aa865979f5d4abfaa9390151ec671fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:02:12.999870 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-421319b9-170e-416e-ae81-17b39c25c065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:13.140501 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1248/2514] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:02:12 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:02:13.145725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486917f-43d1-4acc-85c1-47846454809a None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:13.262840 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:02:13.314350 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486917f-43d1-4acc-85c1-47846454809a None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:13.323614 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c81df-2104-4844-a108-7aaffe42eb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:13.324430 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c81df-2104-4844-a108-7aaffe42eb34 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:13.324872 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c81df-2104-4844-a108-7aaffe42eb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:13.325286 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c81df-2104-4844-a108-7aaffe42eb34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:13.329344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c81df-2104-4844-a108-7aaffe42eb34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:13.331696 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c81df-2104-4844-a108-7aaffe42eb34 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:13.407244 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1267/2515] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:02:13 2022] POST /identity/v3/projects => generated 405 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:02:13.409860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421319b9-170e-416e-ae81-17b39c25c065 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:13.441633 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421319b9-170e-416e-ae81-17b39c25c065 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:13.559557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41248bb5-944b-41cc-b53f-0e13e7653ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:13.560293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41248bb5-944b-41cc-b53f-0e13e7653ef9 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:13.560681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41248bb5-944b-41cc-b53f-0e13e7653ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:13.561050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41248bb5-944b-41cc-b53f-0e13e7653ef9 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:13.562073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41248bb5-944b-41cc-b53f-0e13e7653ef9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:13.564831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41248bb5-944b-41cc-b53f-0e13e7653ef9 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:13.632083 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1249/2516] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:02:13 2022] POST /identity/v3/users => generated 309 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:02:13.636324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c81df-2104-4844-a108-7aaffe42eb34 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:13.653247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c81df-2104-4844-a108-7aaffe42eb34 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:13.668727 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f75749-af29-45dc-aba4-2854fc0fca89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:13.673188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f75749-af29-45dc-aba4-2854fc0fca89 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:13.673796 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f75749-af29-45dc-aba4-2854fc0fca89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:13.674281 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f75749-af29-45dc-aba4-2854fc0fca89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:13.675323 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f75749-af29-45dc-aba4-2854fc0fca89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:13.680285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f75749-af29-45dc-aba4-2854fc0fca89 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:13.710448 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1268/2517] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:02:13.711445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41248bb5-944b-41cc-b53f-0e13e7653ef9 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:13.733261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41248bb5-944b-41cc-b53f-0e13e7653ef9 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:13.745003 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d6b2c-46de-481a-9d32-7c9666dc5acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:13.745858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d6b2c-46de-481a-9d32-7c9666dc5acc admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:13.746214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d6b2c-46de-481a-9d32-7c9666dc5acc admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:13.746554 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d6b2c-46de-481a-9d32-7c9666dc5acc admin admin] PATH_INFO: `/v3/projects/8d6b9cc25b9b44c181d1704f68bb247d/users/7b5e6f0632bc4bdfa63c619a5797d95b/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:13.749228 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:02:13.778969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d6b2c-46de-481a-9d32-7c9666dc5acc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d6b9cc25b9b44c181d1704f68bb247d, user_id=7b5e6f0632bc4bdfa63c619a5797d95b, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:13.782994 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d6b2c-46de-481a-9d32-7c9666dc5acc admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:13.811867 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1250/2518] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:02:13 2022] PUT /identity/v3/projects/8d6b9cc25b9b44c181d1704f68bb247d/users/7b5e6f0632bc4bdfa63c619a5797d95b/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:02:13.819489 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f75749-af29-45dc-aba4-2854fc0fca89 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:13.843785 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f75749-af29-45dc-aba4-2854fc0fca89 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:14.262147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2c48b-cea8-48a7-9839-3e690044ac52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:14.262779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2c48b-cea8-48a7-9839-3e690044ac52 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:14.263100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2c48b-cea8-48a7-9839-3e690044ac52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:14.263378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2c48b-cea8-48a7-9839-3e690044ac52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:14.264019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d2c48b-cea8-48a7-9839-3e690044ac52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:14.266220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d2c48b-cea8-48a7-9839-3e690044ac52 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:14.278344 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1269/2519] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 462 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:02:14.283382 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d6b2c-46de-481a-9d32-7c9666dc5acc admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:14.300949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d6b2c-46de-481a-9d32-7c9666dc5acc admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:14.320237 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c536a4-a94c-4ad7-a820-5b6ff5dd1c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:14.321293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c536a4-a94c-4ad7-a820-5b6ff5dd1c17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:14.321935 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c536a4-a94c-4ad7-a820-5b6ff5dd1c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:14.322507 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c536a4-a94c-4ad7-a820-5b6ff5dd1c17 admin admin] PATH_INFO: `/v3/projects/8d6b9cc25b9b44c181d1704f68bb247d/users/7b5e6f0632bc4bdfa63c619a5797d95b/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:14.325041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c536a4-a94c-4ad7-a820-5b6ff5dd1c17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d6b9cc25b9b44c181d1704f68bb247d, user_id=7b5e6f0632bc4bdfa63c619a5797d95b, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:14.329380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c536a4-a94c-4ad7-a820-5b6ff5dd1c17 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:14.350296 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1251/2520] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:02:14 2022] PUT /identity/v3/projects/8d6b9cc25b9b44c181d1704f68bb247d/users/7b5e6f0632bc4bdfa63c619a5797d95b/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:02:19.169581 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2c48b-cea8-48a7-9839-3e690044ac52 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:19.171440 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e2d2c48b-cea8-48a7-9839-3e690044ac52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:19.186844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2c48b-cea8-48a7-9839-3e690044ac52 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:19.276376 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73ed54-0522-4172-bc9a-35948fa5a788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:19.277173 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73ed54-0522-4172-bc9a-35948fa5a788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:19.277601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73ed54-0522-4172-bc9a-35948fa5a788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:19.277974 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73ed54-0522-4172-bc9a-35948fa5a788 admin admin] PATH_INFO: `/v3/users/046f548e010b4f06a664d82f5bc1bae2` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:19.279265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73ed54-0522-4172-bc9a-35948fa5a788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=046f548e010b4f06a664d82f5bc1bae2)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:19.282504 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73ed54-0522-4172-bc9a-35948fa5a788 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:19.358366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1e73ed54-0522-4172-bc9a-35948fa5a788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '046f548e010b4f06a664d82f5bc1bae2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:19.359128 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1e73ed54-0522-4172-bc9a-35948fa5a788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '046f548e010b4f06a664d82f5bc1bae2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:19.372994 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:02:19.381605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1e73ed54-0522-4172-bc9a-35948fa5a788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '046f548e010b4f06a664d82f5bc1bae2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:19.395107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1e73ed54-0522-4172-bc9a-35948fa5a788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '046f548e010b4f06a664d82f5bc1bae2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:19.398767 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1e73ed54-0522-4172-bc9a-35948fa5a788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '046f548e010b4f06a664d82f5bc1bae2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:19.433091 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1270/2521] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:02:19 2022] DELETE /identity/v3/users/046f548e010b4f06a664d82f5bc1bae2 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:02:19.436047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463dbbd-c724-4809-b5f7-ab778ce73a3c None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:19.436522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463dbbd-c724-4809-b5f7-ab778ce73a3c None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:19.436868 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463dbbd-c724-4809-b5f7-ab778ce73a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:19.467667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-4463dbbd-c724-4809-b5f7-ab778ce73a3c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:02:19.470009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4463dbbd-c724-4809-b5f7-ab778ce73a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:19.570164 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1252/2522] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:02:19.580029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73ed54-0522-4172-bc9a-35948fa5a788 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:19.582576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1e73ed54-0522-4172-bc9a-35948fa5a788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:19.667348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73ed54-0522-4172-bc9a-35948fa5a788 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:19.670949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c29a9f-5672-47ae-b232-b22959c0b695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:19.671614 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c29a9f-5672-47ae-b232-b22959c0b695 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:19.671986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c29a9f-5672-47ae-b232-b22959c0b695 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:19.672320 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c29a9f-5672-47ae-b232-b22959c0b695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:19.682815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c29a9f-5672-47ae-b232-b22959c0b695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:19.684469 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c29a9f-5672-47ae-b232-b22959c0b695 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:19.696604 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1271/2523] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:02:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:02:20.189639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463dbbd-c724-4809-b5f7-ab778ce73a3c None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:20.191254 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4463dbbd-c724-4809-b5f7-ab778ce73a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:20.225199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463dbbd-c724-4809-b5f7-ab778ce73a3c None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:20.240572 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae2495-a288-4be3-8fc2-43a8c7740eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:20.241369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae2495-a288-4be3-8fc2-43a8c7740eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:20.241768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae2495-a288-4be3-8fc2-43a8c7740eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:20.242068 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae2495-a288-4be3-8fc2-43a8c7740eb4 admin admin] PATH_INFO: `/v3/projects/322283b484d24e47a0d17588a4a50038` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:20.247461 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae2495-a288-4be3-8fc2-43a8c7740eb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=322283b484d24e47a0d17588a4a50038)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:20.249529 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae2495-a288-4be3-8fc2-43a8c7740eb4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:20.346650 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a3ae2495-a288-4be3-8fc2-43a8c7740eb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '322283b484d24e47a0d17588a4a50038', 'request_id': 'req-a3ae2495-a288-4be3-8fc2-43a8c7740eb4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:20.362509 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a3ae2495-a288-4be3-8fc2-43a8c7740eb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '322283b484d24e47a0d17588a4a50038', 'request_id': 'req-a3ae2495-a288-4be3-8fc2-43a8c7740eb4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:20.370453 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a3ae2495-a288-4be3-8fc2-43a8c7740eb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '322283b484d24e47a0d17588a4a50038', 'request_id': 'req-a3ae2495-a288-4be3-8fc2-43a8c7740eb4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:20.386624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a3ae2495-a288-4be3-8fc2-43a8c7740eb4 admin admin] The token cache is being invalidate because project 322283b484d24e47a0d17588a4a50038 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:02:20.386942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a3ae2495-a288-4be3-8fc2-43a8c7740eb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:20.387904 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a3ae2495-a288-4be3-8fc2-43a8c7740eb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:20.393652 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1253/2524] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:02:20 2022] DELETE /identity/v3/projects/322283b484d24e47a0d17588a4a50038 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:02:20.394903 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c29a9f-5672-47ae-b232-b22959c0b695 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:20.412342 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c29a9f-5672-47ae-b232-b22959c0b695 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:20.496895 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcfed8-3396-4c83-8f29-52212ac87812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:20.497583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcfed8-3396-4c83-8f29-52212ac87812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:20.497877 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcfed8-3396-4c83-8f29-52212ac87812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:20.498131 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcfed8-3396-4c83-8f29-52212ac87812 admin admin] PATH_INFO: `/v3/users/9f2e19edfa5949818efd0a30bda6adcc` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:20.499663 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afcfed8-3396-4c83-8f29-52212ac87812 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f2e19edfa5949818efd0a30bda6adcc)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:20.503103 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afcfed8-3396-4c83-8f29-52212ac87812 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:20.571833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5afcfed8-3396-4c83-8f29-52212ac87812 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f2e19edfa5949818efd0a30bda6adcc'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:20.572507 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5afcfed8-3396-4c83-8f29-52212ac87812 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f2e19edfa5949818efd0a30bda6adcc'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:20.580324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5afcfed8-3396-4c83-8f29-52212ac87812 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f2e19edfa5949818efd0a30bda6adcc'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:20.592896 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5afcfed8-3396-4c83-8f29-52212ac87812 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f2e19edfa5949818efd0a30bda6adcc'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:20.594253 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5afcfed8-3396-4c83-8f29-52212ac87812 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f2e19edfa5949818efd0a30bda6adcc'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:20.622230 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:02:20.644533 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1272/2525] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:02:20 2022] DELETE /identity/v3/users/9f2e19edfa5949818efd0a30bda6adcc => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:02:21.384982 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae2495-a288-4be3-8fc2-43a8c7740eb4 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:21.387694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a3ae2495-a288-4be3-8fc2-43a8c7740eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:21.464921 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:02:21.510525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae2495-a288-4be3-8fc2-43a8c7740eb4 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:21.589326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3ba9b-6fd1-43bc-8ef2-53ac72621740 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:21.590271 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3ba9b-6fd1-43bc-8ef2-53ac72621740 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:21.590810 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3ba9b-6fd1-43bc-8ef2-53ac72621740 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:21.591091 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3ba9b-6fd1-43bc-8ef2-53ac72621740 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:21.592898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5dd3ba9b-6fd1-43bc-8ef2-53ac72621740 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:21.658595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcfed8-3396-4c83-8f29-52212ac87812 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:21.660396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5afcfed8-3396-4c83-8f29-52212ac87812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:21.711912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3ba9b-6fd1-43bc-8ef2-53ac72621740 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:21.713544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3ba9b-6fd1-43bc-8ef2-53ac72621740 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:21.728026 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1254/2526] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:02:21 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:02:21.774227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcfed8-3396-4c83-8f29-52212ac87812 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:21.779133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193f293-7744-4268-af75-9ddad4e44ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:21.779921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193f293-7744-4268-af75-9ddad4e44ca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:21.780201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193f293-7744-4268-af75-9ddad4e44ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:21.780474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193f293-7744-4268-af75-9ddad4e44ca2 admin admin] PATH_INFO: `/v3/projects/ccb7633c69ef47dd915ebf1e69b4f866` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:21.782163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4193f293-7744-4268-af75-9ddad4e44ca2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccb7633c69ef47dd915ebf1e69b4f866)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:21.794300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4193f293-7744-4268-af75-9ddad4e44ca2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:21.864408 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4193f293-7744-4268-af75-9ddad4e44ca2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccb7633c69ef47dd915ebf1e69b4f866', 'request_id': 'req-4193f293-7744-4268-af75-9ddad4e44ca2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:21.884464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4193f293-7744-4268-af75-9ddad4e44ca2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccb7633c69ef47dd915ebf1e69b4f866', 'request_id': 'req-4193f293-7744-4268-af75-9ddad4e44ca2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:21.895495 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4193f293-7744-4268-af75-9ddad4e44ca2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccb7633c69ef47dd915ebf1e69b4f866', 'request_id': 'req-4193f293-7744-4268-af75-9ddad4e44ca2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:21.912802 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4193f293-7744-4268-af75-9ddad4e44ca2 admin admin] The token cache is being invalidate because project ccb7633c69ef47dd915ebf1e69b4f866 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:02:21.913459 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4193f293-7744-4268-af75-9ddad4e44ca2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:21.914220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4193f293-7744-4268-af75-9ddad4e44ca2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:21.920845 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1273/2527] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:02:21 2022] DELETE /identity/v3/projects/ccb7633c69ef47dd915ebf1e69b4f866 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:02:21.921555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65333f-0f9c-4e93-9740-5e8dc54ed0db None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:21.922061 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65333f-0f9c-4e93-9740-5e8dc54ed0db None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:21.922473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65333f-0f9c-4e93-9740-5e8dc54ed0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:21.998792 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-3d65333f-0f9c-4e93-9740-5e8dc54ed0db None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:02:22.003914 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3d65333f-0f9c-4e93-9740-5e8dc54ed0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:22.112858 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1255/2528] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:02:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:02:22.121932 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b4400-f85b-414b-b928-d8bcc2b608ce None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:22.122282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b4400-f85b-414b-b928-d8bcc2b608ce None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:22.125881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b4400-f85b-414b-b928-d8bcc2b608ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:22.180570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-5f8b4400-f85b-414b-b928-d8bcc2b608ce None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:02:22.184096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5f8b4400-f85b-414b-b928-d8bcc2b608ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:22.205598 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1274/2529] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:02:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:02:22.209909 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65333f-0f9c-4e93-9740-5e8dc54ed0db None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:22.222776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65333f-0f9c-4e93-9740-5e8dc54ed0db None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:22.237743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3942a91-d17c-4f93-a2c9-adf254202f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:22.238744 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3942a91-d17c-4f93-a2c9-adf254202f05 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:22.239795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3942a91-d17c-4f93-a2c9-adf254202f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:22.240235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3942a91-d17c-4f93-a2c9-adf254202f05 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:22.241059 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3942a91-d17c-4f93-a2c9-adf254202f05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:02:22.241562 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3942a91-d17c-4f93-a2c9-adf254202f05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:22.243571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3942a91-d17c-4f93-a2c9-adf254202f05 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:22.263034 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1256/2530] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:02:22.269887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b4400-f85b-414b-b928-d8bcc2b608ce None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:22.282800 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b4400-f85b-414b-b928-d8bcc2b608ce None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:22.290854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f4343-9604-4025-9448-1a08dfaeb29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:22.292737 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f4343-9604-4025-9448-1a08dfaeb29a admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:22.294597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f4343-9604-4025-9448-1a08dfaeb29a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:22.294977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f4343-9604-4025-9448-1a08dfaeb29a admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:22.295988 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f4343-9604-4025-9448-1a08dfaeb29a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:22.298338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f4343-9604-4025-9448-1a08dfaeb29a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:22.340771 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1275/2531] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:02:22 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:02:22.347467 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3942a91-d17c-4f93-a2c9-adf254202f05 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:22.366312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3942a91-d17c-4f93-a2c9-adf254202f05 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:22.383463 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:02:22.468026 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02caddc-594b-4f7d-9949-5daba6aa5385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:22.468705 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02caddc-594b-4f7d-9949-5daba6aa5385 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:22.468975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02caddc-594b-4f7d-9949-5daba6aa5385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:22.469244 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02caddc-594b-4f7d-9949-5daba6aa5385 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:22.469934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02caddc-594b-4f7d-9949-5daba6aa5385 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:22.472367 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02caddc-594b-4f7d-9949-5daba6aa5385 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:22.497332 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1257/2532] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:02:22 2022] POST /identity/v3/users => generated 287 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:02:22.501538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f4343-9604-4025-9448-1a08dfaeb29a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:22.517261 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f4343-9604-4025-9448-1a08dfaeb29a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:22.538318 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e253f8-297d-4d42-94f3-3bd4aaba8646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:22.538957 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e253f8-297d-4d42-94f3-3bd4aaba8646 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:22.539236 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e253f8-297d-4d42-94f3-3bd4aaba8646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:22.539508 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e253f8-297d-4d42-94f3-3bd4aaba8646 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:22.540164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e253f8-297d-4d42-94f3-3bd4aaba8646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:22.541813 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e253f8-297d-4d42-94f3-3bd4aaba8646 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:22.560268 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1276/2533] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:02:22.564506 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02caddc-594b-4f7d-9949-5daba6aa5385 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:22.578787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02caddc-594b-4f7d-9949-5daba6aa5385 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:22.586696 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad258e-208d-4290-b81f-f80936c69db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:22.587628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad258e-208d-4290-b81f-f80936c69db1 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:22.588379 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad258e-208d-4290-b81f-f80936c69db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:22.588978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad258e-208d-4290-b81f-f80936c69db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:22.592569 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad258e-208d-4290-b81f-f80936c69db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:22.596002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad258e-208d-4290-b81f-f80936c69db1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:22.620872 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e253f8-297d-4d42-94f3-3bd4aaba8646 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:22.630686 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1258/2534] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:02:22.638276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e253f8-297d-4d42-94f3-3bd4aaba8646 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:22.662804 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d138175-cfaf-419b-84e7-39d6f0540cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:22.663659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d138175-cfaf-419b-84e7-39d6f0540cad admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:22.664141 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d138175-cfaf-419b-84e7-39d6f0540cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:22.664410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d138175-cfaf-419b-84e7-39d6f0540cad admin admin] PATH_INFO: `/v3/projects/83a5160d4e7c47f08ba83aad0aa62a3d/users/3fbbe2f1619047ff8ddec6142525faf3/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:22.701535 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d138175-cfaf-419b-84e7-39d6f0540cad admin admin] RBAC: Authorizing `identity:create_grant(project_id=83a5160d4e7c47f08ba83aad0aa62a3d, user_id=3fbbe2f1619047ff8ddec6142525faf3, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:22.709733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d138175-cfaf-419b-84e7-39d6f0540cad admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:22.755239 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1277/2535] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:02:22 2022] PUT /identity/v3/projects/83a5160d4e7c47f08ba83aad0aa62a3d/users/3fbbe2f1619047ff8ddec6142525faf3/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:02:22.767363 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234ae2c-ed78-4d5e-bf16-664f3a721fe9 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:22.767647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234ae2c-ed78-4d5e-bf16-664f3a721fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:22.767921 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234ae2c-ed78-4d5e-bf16-664f3a721fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:22.811198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5234ae2c-ed78-4d5e-bf16-664f3a721fe9 None None] MFA Rules not processed for user `3fbbe2f1619047ff8ddec6142525faf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:02:22.811389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd52e4-898e-4d6c-967d-42af0b178af7 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:22.811389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd52e4-898e-4d6c-967d-42af0b178af7 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:22.811610 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd52e4-898e-4d6c-967d-42af0b178af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:22.811755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5234ae2c-ed78-4d5e-bf16-664f3a721fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:22.856087 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-82fd52e4-898e-4d6c-967d-42af0b178af7 None None] MFA Rules not processed for user `94d139d4b19f423189a68e959e338edf`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:02:22.857817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-82fd52e4-898e-4d6c-967d-42af0b178af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:22.920147 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:02:22.952584 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1259/2536] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:02:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:02:22.954650 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1869d71-d6ae-4e28-9784-636ebde167a6 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:22.954975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1869d71-d6ae-4e28-9784-636ebde167a6 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:22.955313 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1869d71-d6ae-4e28-9784-636ebde167a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:22.986899 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c1869d71-d6ae-4e28-9784-636ebde167a6 None None] MFA Rules not processed for user `7b5e6f0632bc4bdfa63c619a5797d95b`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:02:22.988159 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c1869d71-d6ae-4e28-9784-636ebde167a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:23.034524 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1278/2537] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:02:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:02:23.034524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd52e4-898e-4d6c-967d-42af0b178af7 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:23.116278 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1260/2538] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:02:22 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:02:23.132943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd52e4-898e-4d6c-967d-42af0b178af7 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:23.138767 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f85acf-6ce6-4681-ba95-fcd28fa37674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:23.139592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f85acf-6ce6-4681-ba95-fcd28fa37674 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:23.139872 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f85acf-6ce6-4681-ba95-fcd28fa37674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:23.140140 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f85acf-6ce6-4681-ba95-fcd28fa37674 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:23.141669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f85acf-6ce6-4681-ba95-fcd28fa37674 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:23.143645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f85acf-6ce6-4681-ba95-fcd28fa37674 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:23.185571 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1279/2539] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:02:23 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:02:23.186816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1869d71-d6ae-4e28-9784-636ebde167a6 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:23.196101 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:02:23.203955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1869d71-d6ae-4e28-9784-636ebde167a6 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:23.285626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7519d99-bed9-4a00-90ab-6baa2aeb270b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:23.286253 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7519d99-bed9-4a00-90ab-6baa2aeb270b admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:23.286538 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7519d99-bed9-4a00-90ab-6baa2aeb270b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:23.286812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7519d99-bed9-4a00-90ab-6baa2aeb270b admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:23.287454 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7519d99-bed9-4a00-90ab-6baa2aeb270b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:23.289512 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7519d99-bed9-4a00-90ab-6baa2aeb270b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:23.318210 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1261/2540] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:02:23 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:02:23.322778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f85acf-6ce6-4681-ba95-fcd28fa37674 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:23.334836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f85acf-6ce6-4681-ba95-fcd28fa37674 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:23.339557 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf26e4-75ce-4138-b443-73f2c5ece9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:23.340176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf26e4-75ce-4138-b443-73f2c5ece9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:23.340450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf26e4-75ce-4138-b443-73f2c5ece9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:23.340719 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf26e4-75ce-4138-b443-73f2c5ece9e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:23.341923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bf26e4-75ce-4138-b443-73f2c5ece9e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:23.343588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bf26e4-75ce-4138-b443-73f2c5ece9e1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:23.357469 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1280/2541] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:02:23.362752 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7519d99-bed9-4a00-90ab-6baa2aeb270b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:23.373866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7519d99-bed9-4a00-90ab-6baa2aeb270b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:23.379840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50046167-231f-46f5-a212-b27cd83ff039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:23.380523 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50046167-231f-46f5-a212-b27cd83ff039 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:23.380799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50046167-231f-46f5-a212-b27cd83ff039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:23.381068 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50046167-231f-46f5-a212-b27cd83ff039 admin admin] PATH_INFO: `/v3/projects/f77dac2228f0432ebd96b86bc0f19771/users/76281cf89fe14534bb9052170ac1d90e/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:23.399244 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50046167-231f-46f5-a212-b27cd83ff039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f77dac2228f0432ebd96b86bc0f19771, user_id=76281cf89fe14534bb9052170ac1d90e, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:23.402502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50046167-231f-46f5-a212-b27cd83ff039 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:23.419776 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1262/2542] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:02:23 2022] PUT /identity/v3/projects/f77dac2228f0432ebd96b86bc0f19771/users/76281cf89fe14534bb9052170ac1d90e/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:02:23.424400 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf26e4-75ce-4138-b443-73f2c5ece9e1 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:23.435238 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf26e4-75ce-4138-b443-73f2c5ece9e1 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:23.566294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc2808-5f48-49d3-b0af-f9175834d3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:23.567139 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc2808-5f48-49d3-b0af-f9175834d3da admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:23.567524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc2808-5f48-49d3-b0af-f9175834d3da admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:23.569838 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc2808-5f48-49d3-b0af-f9175834d3da admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:23.571585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc2808-5f48-49d3-b0af-f9175834d3da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:23.576752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc2808-5f48-49d3-b0af-f9175834d3da admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:23.589183 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1281/2543] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:02:23.593277 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50046167-231f-46f5-a212-b27cd83ff039 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:23.606398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50046167-231f-46f5-a212-b27cd83ff039 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:23.612498 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae216c6-ee82-4855-8690-9eae4037bb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:23.613179 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae216c6-ee82-4855-8690-9eae4037bb49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:23.613491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae216c6-ee82-4855-8690-9eae4037bb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:23.613768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae216c6-ee82-4855-8690-9eae4037bb49 admin admin] PATH_INFO: `/v3/projects/f77dac2228f0432ebd96b86bc0f19771/users/76281cf89fe14534bb9052170ac1d90e/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:23.615760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae216c6-ee82-4855-8690-9eae4037bb49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f77dac2228f0432ebd96b86bc0f19771, user_id=76281cf89fe14534bb9052170ac1d90e, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:23.618686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae216c6-ee82-4855-8690-9eae4037bb49 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:23.632914 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1263/2544] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:02:23 2022] PUT /identity/v3/projects/f77dac2228f0432ebd96b86bc0f19771/users/76281cf89fe14534bb9052170ac1d90e/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:02:23.643514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf99cf-defb-4717-9d29-54ffafb73920 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:23.644220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf99cf-defb-4717-9d29-54ffafb73920 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:23.644793 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf99cf-defb-4717-9d29-54ffafb73920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:23.683276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-6caf99cf-defb-4717-9d29-54ffafb73920 None None] MFA Rules not processed for user `76281cf89fe14534bb9052170ac1d90e`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:02:23.684698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6caf99cf-defb-4717-9d29-54ffafb73920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:23.712836 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:02:23.781555 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1282/2545] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:02:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:02:23.789527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ac64f-cc90-462e-8dab-a82dfe185741 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:23.790067 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ac64f-cc90-462e-8dab-a82dfe185741 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:23.790549 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ac64f-cc90-462e-8dab-a82dfe185741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:23.812063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-429ac64f-cc90-462e-8dab-a82dfe185741 None None] MFA Rules not processed for user `3fbbe2f1619047ff8ddec6142525faf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:02:23.814332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-429ac64f-cc90-462e-8dab-a82dfe185741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:23.885478 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1264/2546] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:02:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:02:24.501580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf99cf-defb-4717-9d29-54ffafb73920 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:24.503662 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6caf99cf-defb-4717-9d29-54ffafb73920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:24.665540 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf99cf-defb-4717-9d29-54ffafb73920 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:24.677668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a991d4c-3f2a-4550-ad39-96e85cf24816 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:24.682273 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a991d4c-3f2a-4550-ad39-96e85cf24816 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:24.682273 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a991d4c-3f2a-4550-ad39-96e85cf24816 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:24.689946 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a991d4c-3f2a-4550-ad39-96e85cf24816 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:24.705390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a991d4c-3f2a-4550-ad39-96e85cf24816 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:24.707002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a991d4c-3f2a-4550-ad39-96e85cf24816 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:24.727126 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1283/2547] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:02:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:02:25.981298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f79af-e2ed-4216-a827-64c8763a2461 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:25.982198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f79af-e2ed-4216-a827-64c8763a2461 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:25.982700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f79af-e2ed-4216-a827-64c8763a2461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:26.011217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-ac1f79af-e2ed-4216-a827-64c8763a2461 None None] MFA Rules not processed for user `134d179e5e784ca8867b48bcd3e92c41`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:02:26.012556 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ac1f79af-e2ed-4216-a827-64c8763a2461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:26.183725 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1265/2548] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:02:25 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:02:31.049709 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56af7e-c3cc-4e57-9dc3-f6c3183a7817 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:31.050591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56af7e-c3cc-4e57-9dc3-f6c3183a7817 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:31.051014 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56af7e-c3cc-4e57-9dc3-f6c3183a7817 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:31.052821 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1284/2549] 10.222.0.30 () {54 vars in 921 bytes} [Sun Sep 4 01:02:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:02:31.070570 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cd7dc-c14e-4e80-be01-1eb1fd649f02 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:31.071434 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cd7dc-c14e-4e80-be01-1eb1fd649f02 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:31.071895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cd7dc-c14e-4e80-be01-1eb1fd649f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:31.107256 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:02:31.140142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-245cd7dc-c14e-4e80-be01-1eb1fd649f02 None None] MFA Rules not processed for user `f908fda75ef8440cb6a0ef9440127d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:02:31.151222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-245cd7dc-c14e-4e80-be01-1eb1fd649f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:31.323489 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1266/2550] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Sep 4 01:02:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:02:31.343921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56af7e-c3cc-4e57-9dc3-f6c3183a7817 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:31.346078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8a56af7e-c3cc-4e57-9dc3-f6c3183a7817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:31.377545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56af7e-c3cc-4e57-9dc3-f6c3183a7817 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:31.389661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce20108-c5aa-4a1a-8972-702e692e30f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:31.391135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce20108-c5aa-4a1a-8972-702e692e30f1 service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:31.391585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce20108-c5aa-4a1a-8972-702e692e30f1 service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:31.392011 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce20108-c5aa-4a1a-8972-702e692e30f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:31.419509 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce20108-c5aa-4a1a-8972-702e692e30f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:31.422633 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce20108-c5aa-4a1a-8972-702e692e30f1 service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:31.454094 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1285/2551] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:02:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:02:38.897561 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245cd7dc-c14e-4e80-be01-1eb1fd649f02 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:38.899222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-245cd7dc-c14e-4e80-be01-1eb1fd649f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:38.990896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245cd7dc-c14e-4e80-be01-1eb1fd649f02 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:38.996641 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73974d54-5e5f-4724-83b6-c90a29a28508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:38.997390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73974d54-5e5f-4724-83b6-c90a29a28508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:38.997875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73974d54-5e5f-4724-83b6-c90a29a28508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:38.998310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73974d54-5e5f-4724-83b6-c90a29a28508 admin admin] PATH_INFO: `/v3/users/0aa865979f5d4abfaa9390151ec671fe` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:39.000167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73974d54-5e5f-4724-83b6-c90a29a28508 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aa865979f5d4abfaa9390151ec671fe)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:39.002185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73974d54-5e5f-4724-83b6-c90a29a28508 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:39.069726 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-73974d54-5e5f-4724-83b6-c90a29a28508 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aa865979f5d4abfaa9390151ec671fe'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:39.070502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-73974d54-5e5f-4724-83b6-c90a29a28508 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aa865979f5d4abfaa9390151ec671fe'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:39.078930 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-73974d54-5e5f-4724-83b6-c90a29a28508 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aa865979f5d4abfaa9390151ec671fe'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:39.093932 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-73974d54-5e5f-4724-83b6-c90a29a28508 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aa865979f5d4abfaa9390151ec671fe'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:39.094578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-73974d54-5e5f-4724-83b6-c90a29a28508 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aa865979f5d4abfaa9390151ec671fe'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:39.121939 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1267/2552] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:02:38 2022] DELETE /identity/v3/users/0aa865979f5d4abfaa9390151ec671fe => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:02:39.379124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce20108-c5aa-4a1a-8972-702e692e30f1 service placement] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:39.400064 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce20108-c5aa-4a1a-8972-702e692e30f1 service placement] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:39.477244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a072b7-d958-44ae-9f8e-8650555a1db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:39.477895 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a072b7-d958-44ae-9f8e-8650555a1db5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:39.478169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a072b7-d958-44ae-9f8e-8650555a1db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:39.478465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a072b7-d958-44ae-9f8e-8650555a1db5 admin admin] PATH_INFO: `/v3/projects/ae068d2070f4424ebda9b7409dbdee7b` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:39.479567 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a072b7-d958-44ae-9f8e-8650555a1db5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae068d2070f4424ebda9b7409dbdee7b)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:39.481499 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a072b7-d958-44ae-9f8e-8650555a1db5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:39.523307 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:02:39.533559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-29a072b7-d958-44ae-9f8e-8650555a1db5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae068d2070f4424ebda9b7409dbdee7b', 'request_id': 'req-29a072b7-d958-44ae-9f8e-8650555a1db5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:39.541272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-29a072b7-d958-44ae-9f8e-8650555a1db5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae068d2070f4424ebda9b7409dbdee7b', 'request_id': 'req-29a072b7-d958-44ae-9f8e-8650555a1db5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:39.547787 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-29a072b7-d958-44ae-9f8e-8650555a1db5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae068d2070f4424ebda9b7409dbdee7b', 'request_id': 'req-29a072b7-d958-44ae-9f8e-8650555a1db5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:39.559143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-29a072b7-d958-44ae-9f8e-8650555a1db5 admin admin] The token cache is being invalidate because project ae068d2070f4424ebda9b7409dbdee7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:02:39.559426 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-29a072b7-d958-44ae-9f8e-8650555a1db5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:39.560080 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-29a072b7-d958-44ae-9f8e-8650555a1db5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:39.562384 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1286/2553] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:02:39 2022] DELETE /identity/v3/projects/ae068d2070f4424ebda9b7409dbdee7b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:02:39.567348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73974d54-5e5f-4724-83b6-c90a29a28508 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:39.568972 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-73974d54-5e5f-4724-83b6-c90a29a28508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:39.581902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73974d54-5e5f-4724-83b6-c90a29a28508 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:39.600047 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:02:39.642891 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2a5fb-7a16-415d-8ad9-8b09d0990bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:39.643526 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2a5fb-7a16-415d-8ad9-8b09d0990bca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:39.643806 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2a5fb-7a16-415d-8ad9-8b09d0990bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:39.644079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2a5fb-7a16-415d-8ad9-8b09d0990bca admin admin] PATH_INFO: `/v3/users/7b5e6f0632bc4bdfa63c619a5797d95b` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:39.645216 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2a5fb-7a16-415d-8ad9-8b09d0990bca admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b5e6f0632bc4bdfa63c619a5797d95b)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:39.647282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2a5fb-7a16-415d-8ad9-8b09d0990bca admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:39.720948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3dd2a5fb-7a16-415d-8ad9-8b09d0990bca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b5e6f0632bc4bdfa63c619a5797d95b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:39.722230 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3dd2a5fb-7a16-415d-8ad9-8b09d0990bca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b5e6f0632bc4bdfa63c619a5797d95b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:39.737741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3dd2a5fb-7a16-415d-8ad9-8b09d0990bca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b5e6f0632bc4bdfa63c619a5797d95b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:39.752896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3dd2a5fb-7a16-415d-8ad9-8b09d0990bca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b5e6f0632bc4bdfa63c619a5797d95b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:39.753664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3dd2a5fb-7a16-415d-8ad9-8b09d0990bca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b5e6f0632bc4bdfa63c619a5797d95b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:39.791936 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1268/2554] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:02:39 2022] DELETE /identity/v3/users/7b5e6f0632bc4bdfa63c619a5797d95b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:02:40.209965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a072b7-d958-44ae-9f8e-8650555a1db5 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:40.211397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-29a072b7-d958-44ae-9f8e-8650555a1db5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:40.227248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a072b7-d958-44ae-9f8e-8650555a1db5 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:40.312097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb5c3f-d91d-4e6d-b8b9-0e5d3f69c3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:40.313421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb5c3f-d91d-4e6d-b8b9-0e5d3f69c3bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:40.313920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb5c3f-d91d-4e6d-b8b9-0e5d3f69c3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:40.314358 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb5c3f-d91d-4e6d-b8b9-0e5d3f69c3bd admin admin] PATH_INFO: `/v3/projects/8d6b9cc25b9b44c181d1704f68bb247d` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:40.316084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb5c3f-d91d-4e6d-b8b9-0e5d3f69c3bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d6b9cc25b9b44c181d1704f68bb247d)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:40.318036 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb5c3f-d91d-4e6d-b8b9-0e5d3f69c3bd admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:40.385116 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d8cb5c3f-d91d-4e6d-b8b9-0e5d3f69c3bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d6b9cc25b9b44c181d1704f68bb247d', 'request_id': 'req-d8cb5c3f-d91d-4e6d-b8b9-0e5d3f69c3bd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:40.393691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d8cb5c3f-d91d-4e6d-b8b9-0e5d3f69c3bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d6b9cc25b9b44c181d1704f68bb247d', 'request_id': 'req-d8cb5c3f-d91d-4e6d-b8b9-0e5d3f69c3bd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:40.402087 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d8cb5c3f-d91d-4e6d-b8b9-0e5d3f69c3bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d6b9cc25b9b44c181d1704f68bb247d', 'request_id': 'req-d8cb5c3f-d91d-4e6d-b8b9-0e5d3f69c3bd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:40.415036 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d8cb5c3f-d91d-4e6d-b8b9-0e5d3f69c3bd admin admin] The token cache is being invalidate because project 8d6b9cc25b9b44c181d1704f68bb247d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:02:40.415317 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d8cb5c3f-d91d-4e6d-b8b9-0e5d3f69c3bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:40.416237 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d8cb5c3f-d91d-4e6d-b8b9-0e5d3f69c3bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:02:40.417785 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1287/2555] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:02:40 2022] DELETE /identity/v3/projects/8d6b9cc25b9b44c181d1704f68bb247d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:02:40.423594 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b333a-68b8-4333-adea-bbc62c52b043 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:40.424146 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b333a-68b8-4333-adea-bbc62c52b043 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:40.424354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b333a-68b8-4333-adea-bbc62c52b043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:40.448799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-020b333a-68b8-4333-adea-bbc62c52b043 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:02:40.450238 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-020b333a-68b8-4333-adea-bbc62c52b043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:40.544677 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1269/2556] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:02:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:02:40.550714 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efb8e1-5c64-4629-91c6-3901953f142b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:40.551382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efb8e1-5c64-4629-91c6-3901953f142b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:40.551817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efb8e1-5c64-4629-91c6-3901953f142b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:40.574669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-10efb8e1-5c64-4629-91c6-3901953f142b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:02:40.575887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-10efb8e1-5c64-4629-91c6-3901953f142b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:40.595145 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1288/2557] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:02:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:02:40.595837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b333a-68b8-4333-adea-bbc62c52b043 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:40.607054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b333a-68b8-4333-adea-bbc62c52b043 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:40.615242 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28027e5-fbd7-4582-90b5-5357fc092a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:40.615886 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28027e5-fbd7-4582-90b5-5357fc092a18 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:40.616772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28027e5-fbd7-4582-90b5-5357fc092a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:40.617218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28027e5-fbd7-4582-90b5-5357fc092a18 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:40.618118 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28027e5-fbd7-4582-90b5-5357fc092a18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:02:40.618480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28027e5-fbd7-4582-90b5-5357fc092a18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:40.620368 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28027e5-fbd7-4582-90b5-5357fc092a18 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:40.634679 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1270/2558] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:02:40.639708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efb8e1-5c64-4629-91c6-3901953f142b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:40.649248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efb8e1-5c64-4629-91c6-3901953f142b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:40.654462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d828dff-9de1-44de-b48e-223e7860c36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:40.655832 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d828dff-9de1-44de-b48e-223e7860c36e admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:40.656270 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d828dff-9de1-44de-b48e-223e7860c36e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:40.656693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d828dff-9de1-44de-b48e-223e7860c36e admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:40.658663 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d828dff-9de1-44de-b48e-223e7860c36e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:40.660800 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d828dff-9de1-44de-b48e-223e7860c36e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:40.700092 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1289/2559] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:02:40 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:02:40.701356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28027e5-fbd7-4582-90b5-5357fc092a18 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:40.724800 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28027e5-fbd7-4582-90b5-5357fc092a18 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:40.756462 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:02:40.798011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024dbd07-e39c-453a-86cb-a26f4e02e020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:40.798629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dbd07-e39c-453a-86cb-a26f4e02e020 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:40.798913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dbd07-e39c-453a-86cb-a26f4e02e020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:40.799187 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dbd07-e39c-453a-86cb-a26f4e02e020 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:40.799821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024dbd07-e39c-453a-86cb-a26f4e02e020 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:40.801805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024dbd07-e39c-453a-86cb-a26f4e02e020 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:40.823078 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1271/2560] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:02:40 2022] POST /identity/v3/users => generated 286 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:02:40.827126 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d828dff-9de1-44de-b48e-223e7860c36e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:40.837263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d828dff-9de1-44de-b48e-223e7860c36e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:40.841862 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b282b-fcf3-46f2-ab1c-89f247c1abe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:40.842454 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b282b-fcf3-46f2-ab1c-89f247c1abe1 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:40.843257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b282b-fcf3-46f2-ab1c-89f247c1abe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:40.843531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b282b-fcf3-46f2-ab1c-89f247c1abe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:40.844199 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b282b-fcf3-46f2-ab1c-89f247c1abe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:40.845817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b282b-fcf3-46f2-ab1c-89f247c1abe1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:40.855582 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1290/2561] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:02:40.860388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024dbd07-e39c-453a-86cb-a26f4e02e020 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:40.870223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024dbd07-e39c-453a-86cb-a26f4e02e020 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:40.875015 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97861342-dcc8-4e44-a44a-dd1238cee06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:40.875606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97861342-dcc8-4e44-a44a-dd1238cee06e admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:40.875890 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97861342-dcc8-4e44-a44a-dd1238cee06e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:40.876163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97861342-dcc8-4e44-a44a-dd1238cee06e admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:40.876836 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97861342-dcc8-4e44-a44a-dd1238cee06e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:40.878587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97861342-dcc8-4e44-a44a-dd1238cee06e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:40.888432 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1272/2562] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:02:40.893087 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b282b-fcf3-46f2-ab1c-89f247c1abe1 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:40.902853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b282b-fcf3-46f2-ab1c-89f247c1abe1 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:40.907997 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98c3d6-f252-4888-9f91-c8ec2958850c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:40.908682 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98c3d6-f252-4888-9f91-c8ec2958850c admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:40.908950 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98c3d6-f252-4888-9f91-c8ec2958850c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:40.909261 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98c3d6-f252-4888-9f91-c8ec2958850c admin admin] PATH_INFO: `/v3/projects/77c8f017c2754126a39fc390b243a71e/users/e17afcbd7fd346b884e55a7a587343ed/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:40.921146 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:02:40.924524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98c3d6-f252-4888-9f91-c8ec2958850c admin admin] RBAC: Authorizing `identity:create_grant(project_id=77c8f017c2754126a39fc390b243a71e, user_id=e17afcbd7fd346b884e55a7a587343ed, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:40.927915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98c3d6-f252-4888-9f91-c8ec2958850c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:40.941201 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1291/2563] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:02:40 2022] PUT /identity/v3/projects/77c8f017c2754126a39fc390b243a71e/users/e17afcbd7fd346b884e55a7a587343ed/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:02:40.946255 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e032a3-638f-40d6-990d-413930589a7b None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:40.946542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e032a3-638f-40d6-990d-413930589a7b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:40.946814 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e032a3-638f-40d6-990d-413930589a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:40.970361 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b4e032a3-638f-40d6-990d-413930589a7b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:02:40.972333 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b4e032a3-638f-40d6-990d-413930589a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:41.032277 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1273/2564] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:02:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:02:41.042230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98c3d6-f252-4888-9f91-c8ec2958850c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:41.044904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5f98c3d6-f252-4888-9f91-c8ec2958850c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:41.107223 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98c3d6-f252-4888-9f91-c8ec2958850c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:41.111230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793758b-9ab4-4d95-9deb-06a0518d5cbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:41.111840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793758b-9ab4-4d95-9deb-06a0518d5cbf service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:41.112122 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793758b-9ab4-4d95-9deb-06a0518d5cbf service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:41.112393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793758b-9ab4-4d95-9deb-06a0518d5cbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:41.122712 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793758b-9ab4-4d95-9deb-06a0518d5cbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:41.134458 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793758b-9ab4-4d95-9deb-06a0518d5cbf service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:41.147548 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1292/2565] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:02:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:02:47.397232 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b92bab-bc9c-4a12-8923-090cd9a7a6d4 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:47.401150 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b92bab-bc9c-4a12-8923-090cd9a7a6d4 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:47.401459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b92bab-bc9c-4a12-8923-090cd9a7a6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:47.435085 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-43b92bab-bc9c-4a12-8923-090cd9a7a6d4 None None] MFA Rules not processed for user `41571ce2b64c4762b04ed0848bf34c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:02:47.452861 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-43b92bab-bc9c-4a12-8923-090cd9a7a6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:47.584399 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1274/2566] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:02:47 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:02:47.636514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220397e-65ee-4f65-b6dd-2fb32faeecd6 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:47.637269 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220397e-65ee-4f65-b6dd-2fb32faeecd6 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:47.637741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220397e-65ee-4f65-b6dd-2fb32faeecd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:47.659033 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a220397e-65ee-4f65-b6dd-2fb32faeecd6 None None] MFA Rules not processed for user `a4c913daf63c433287eaf338b4ab2070`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:02:47.660434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a220397e-65ee-4f65-b6dd-2fb32faeecd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:47.751435 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1293/2567] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:02:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:02:50.985563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0b607-94c7-4ab5-b579-145dd26b13d9 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:50.986551 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0b607-94c7-4ab5-b579-145dd26b13d9 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:50.987042 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0b607-94c7-4ab5-b579-145dd26b13d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:51.027530 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e3f0b607-94c7-4ab5-b579-145dd26b13d9 None None] MFA Rules not processed for user `e17afcbd7fd346b884e55a7a587343ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:02:51.029231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e3f0b607-94c7-4ab5-b579-145dd26b13d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:51.090390 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:02:51.138970 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1275/2568] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:02:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:02:51.143387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220397e-65ee-4f65-b6dd-2fb32faeecd6 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:51.156019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220397e-65ee-4f65-b6dd-2fb32faeecd6 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:51.165730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd59aeb-89c5-4167-9bae-28271f59759b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:51.166728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd59aeb-89c5-4167-9bae-28271f59759b admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:51.169844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd59aeb-89c5-4167-9bae-28271f59759b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:51.170821 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd59aeb-89c5-4167-9bae-28271f59759b admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:51.171875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd59aeb-89c5-4167-9bae-28271f59759b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:51.178539 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd59aeb-89c5-4167-9bae-28271f59759b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:51.296139 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1294/2569] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:02:51 2022] POST /identity/v3/projects => generated 369 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:02:51.299818 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0b607-94c7-4ab5-b579-145dd26b13d9 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:51.316381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0b607-94c7-4ab5-b579-145dd26b13d9 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:51.419001 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ee414-5ca9-48b2-a217-83b0c3e45c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:51.419633 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ee414-5ca9-48b2-a217-83b0c3e45c07 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:51.419930 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ee414-5ca9-48b2-a217-83b0c3e45c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:51.420215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ee414-5ca9-48b2-a217-83b0c3e45c07 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:51.420869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ee414-5ca9-48b2-a217-83b0c3e45c07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:51.423229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ee414-5ca9-48b2-a217-83b0c3e45c07 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:51.463472 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1276/2570] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:02:51 2022] POST /identity/v3/users => generated 291 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:02:51.468197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd59aeb-89c5-4167-9bae-28271f59759b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:51.482652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd59aeb-89c5-4167-9bae-28271f59759b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:51.494202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299690bd-6530-4596-8043-cb89b889ab2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:51.495344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299690bd-6530-4596-8043-cb89b889ab2d admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:51.495650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299690bd-6530-4596-8043-cb89b889ab2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:51.496077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299690bd-6530-4596-8043-cb89b889ab2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:51.496563 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299690bd-6530-4596-8043-cb89b889ab2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:51.498465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299690bd-6530-4596-8043-cb89b889ab2d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:51.519675 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1295/2571] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:02:51.527289 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ee414-5ca9-48b2-a217-83b0c3e45c07 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:51.543932 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ee414-5ca9-48b2-a217-83b0c3e45c07 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:51.556975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f87be-1fb6-40bf-83bd-7855347bc416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:51.558068 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f87be-1fb6-40bf-83bd-7855347bc416 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:51.558660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f87be-1fb6-40bf-83bd-7855347bc416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:51.560539 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f87be-1fb6-40bf-83bd-7855347bc416 admin admin] PATH_INFO: `/v3/projects/d45b96dc88684137abad839fd8bab131/users/bb875b06dd5b4a6f9ea3f3865d57d412/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:51.589812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f87be-1fb6-40bf-83bd-7855347bc416 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d45b96dc88684137abad839fd8bab131, user_id=bb875b06dd5b4a6f9ea3f3865d57d412, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:51.593133 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f87be-1fb6-40bf-83bd-7855347bc416 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:51.613085 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1277/2572] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:02:51 2022] PUT /identity/v3/projects/d45b96dc88684137abad839fd8bab131/users/bb875b06dd5b4a6f9ea3f3865d57d412/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:02:51.616744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299690bd-6530-4596-8043-cb89b889ab2d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:51.629798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299690bd-6530-4596-8043-cb89b889ab2d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:51.714476 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1529ea6-c2c4-4ef4-9c73-11251b122be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:51.715509 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1529ea6-c2c4-4ef4-9c73-11251b122be3 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:51.715965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1529ea6-c2c4-4ef4-9c73-11251b122be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:51.716771 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1529ea6-c2c4-4ef4-9c73-11251b122be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:51.718361 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1529ea6-c2c4-4ef4-9c73-11251b122be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:51.722295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1529ea6-c2c4-4ef4-9c73-11251b122be3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:51.732322 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:02:51.747593 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1296/2573] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:02:51.747767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f87be-1fb6-40bf-83bd-7855347bc416 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:02:51.757776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c5d21-e9cc-45dd-bf05-a4c7db2294ca None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:51.758120 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c5d21-e9cc-45dd-bf05-a4c7db2294ca None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:51.758397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c5d21-e9cc-45dd-bf05-a4c7db2294ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:51.760405 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f87be-1fb6-40bf-83bd-7855347bc416 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:02:51.775165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb640d-3b01-4bb3-b414-f3f3d998d413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:02:51.776017 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb640d-3b01-4bb3-b414-f3f3d998d413 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:02:51.776306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb640d-3b01-4bb3-b414-f3f3d998d413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:02:51.778199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb640d-3b01-4bb3-b414-f3f3d998d413 admin admin] PATH_INFO: `/v3/projects/d45b96dc88684137abad839fd8bab131/users/bb875b06dd5b4a6f9ea3f3865d57d412/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:02:51.782030 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb640d-3b01-4bb3-b414-f3f3d998d413 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d45b96dc88684137abad839fd8bab131, user_id=bb875b06dd5b4a6f9ea3f3865d57d412, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:02:51.784871 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb640d-3b01-4bb3-b414-f3f3d998d413 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:02:51.787550 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-bb6c5d21-e9cc-45dd-bf05-a4c7db2294ca None None] MFA Rules not processed for user `94d139d4b19f423189a68e959e338edf`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:02:51.789463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-bb6c5d21-e9cc-45dd-bf05-a4c7db2294ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:02:51.814757 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1278/2574] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:02:51 2022] PUT /identity/v3/projects/d45b96dc88684137abad839fd8bab131/users/bb875b06dd5b4a6f9ea3f3865d57d412/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:02:51.959464 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1297/2575] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:02:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:03:01.808346 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=52,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:03:01.938511 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=25 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:03:02.005718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb640d-3b01-4bb3-b414-f3f3d998d413 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:03:02.007511 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bfeb640d-3b01-4bb3-b414-f3f3d998d413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:03:02.163813 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb640d-3b01-4bb3-b414-f3f3d998d413 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:03:02.189878 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211148f-fd9a-4980-994d-1a610393e226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:03:02.193758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211148f-fd9a-4980-994d-1a610393e226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:02.194208 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211148f-fd9a-4980-994d-1a610393e226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:02.194849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211148f-fd9a-4980-994d-1a610393e226 admin admin] PATH_INFO: `/v3/users/a648e1ac627e49cdb6d5d478614c5e82` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:02.196846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9211148f-fd9a-4980-994d-1a610393e226 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a648e1ac627e49cdb6d5d478614c5e82)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:03:02.201797 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9211148f-fd9a-4980-994d-1a610393e226 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:03:02.387396 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9211148f-fd9a-4980-994d-1a610393e226 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a648e1ac627e49cdb6d5d478614c5e82'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:03:02.388522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9211148f-fd9a-4980-994d-1a610393e226 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a648e1ac627e49cdb6d5d478614c5e82'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:03:02.404706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9211148f-fd9a-4980-994d-1a610393e226 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a648e1ac627e49cdb6d5d478614c5e82'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:03:02.475380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9211148f-fd9a-4980-994d-1a610393e226 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a648e1ac627e49cdb6d5d478614c5e82'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:03:02.479428 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9211148f-fd9a-4980-994d-1a610393e226 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a648e1ac627e49cdb6d5d478614c5e82'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:03:02.531612 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1279/2576] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:03:02 2022] DELETE /identity/v3/users/a648e1ac627e49cdb6d5d478614c5e82 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:03:02.534062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4c19f-af35-4cca-882b-ad1ff5db07d5 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:02.534362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4c19f-af35-4cca-882b-ad1ff5db07d5 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:02.535226 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4c19f-af35-4cca-882b-ad1ff5db07d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:02.574741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e6d4c19f-af35-4cca-882b-ad1ff5db07d5 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:03:02.575911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e6d4c19f-af35-4cca-882b-ad1ff5db07d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:03:02.725861 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1298/2577] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:03:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:03:02.737090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211148f-fd9a-4980-994d-1a610393e226 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:03:02.738899 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9211148f-fd9a-4980-994d-1a610393e226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:03:02.835530 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211148f-fd9a-4980-994d-1a610393e226 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:03:02.842998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214778c9-08f9-4dc3-aeab-1dc03b989dd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:03:02.843891 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214778c9-08f9-4dc3-aeab-1dc03b989dd8 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:02.844901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214778c9-08f9-4dc3-aeab-1dc03b989dd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:02.845336 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214778c9-08f9-4dc3-aeab-1dc03b989dd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:02.860976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214778c9-08f9-4dc3-aeab-1dc03b989dd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:03:02.862743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214778c9-08f9-4dc3-aeab-1dc03b989dd8 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:03:02.892591 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1280/2578] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:03:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:03:03.212528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4c19f-af35-4cca-882b-ad1ff5db07d5 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:03:03.218901 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e6d4c19f-af35-4cca-882b-ad1ff5db07d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:03:03.255217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4c19f-af35-4cca-882b-ad1ff5db07d5 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:03:03.274301 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a99728-e963-4643-9713-b1a18d345627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:03:03.275165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a99728-e963-4643-9713-b1a18d345627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:03.275534 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a99728-e963-4643-9713-b1a18d345627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:03.275896 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a99728-e963-4643-9713-b1a18d345627 admin admin] PATH_INFO: `/v3/projects/e2ced27be1da4adc8389fdef12bb4b34` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:03.277232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a99728-e963-4643-9713-b1a18d345627 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2ced27be1da4adc8389fdef12bb4b34)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:03:03.281152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a99728-e963-4643-9713-b1a18d345627 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:03:03.370240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e4a99728-e963-4643-9713-b1a18d345627 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2ced27be1da4adc8389fdef12bb4b34', 'request_id': 'req-e4a99728-e963-4643-9713-b1a18d345627'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:03:03.392556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e4a99728-e963-4643-9713-b1a18d345627 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2ced27be1da4adc8389fdef12bb4b34', 'request_id': 'req-e4a99728-e963-4643-9713-b1a18d345627'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:03:03.414334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e4a99728-e963-4643-9713-b1a18d345627 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2ced27be1da4adc8389fdef12bb4b34', 'request_id': 'req-e4a99728-e963-4643-9713-b1a18d345627'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:03:03.427013 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e4a99728-e963-4643-9713-b1a18d345627 admin admin] The token cache is being invalidate because project e2ced27be1da4adc8389fdef12bb4b34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:03:03.427449 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e4a99728-e963-4643-9713-b1a18d345627 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:03:03.428211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e4a99728-e963-4643-9713-b1a18d345627 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:03:03.441306 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1299/2579] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:03:03 2022] DELETE /identity/v3/projects/e2ced27be1da4adc8389fdef12bb4b34 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:03:03.442181 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214778c9-08f9-4dc3-aeab-1dc03b989dd8 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:03:03.462186 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214778c9-08f9-4dc3-aeab-1dc03b989dd8 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:03:03.508586 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:03:03.559311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc179a3-a62c-4974-8b3d-fceacb1b3560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:03:03.560379 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc179a3-a62c-4974-8b3d-fceacb1b3560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:03.560733 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc179a3-a62c-4974-8b3d-fceacb1b3560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:03.561159 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc179a3-a62c-4974-8b3d-fceacb1b3560 admin admin] PATH_INFO: `/v3/users/ddd91ebb3eac42b2bb5e129ada311342` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:03.570202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc179a3-a62c-4974-8b3d-fceacb1b3560 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddd91ebb3eac42b2bb5e129ada311342)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:03:03.572687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc179a3-a62c-4974-8b3d-fceacb1b3560 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:03:03.664448 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-bcc179a3-a62c-4974-8b3d-fceacb1b3560 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddd91ebb3eac42b2bb5e129ada311342'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:03:03.665225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-bcc179a3-a62c-4974-8b3d-fceacb1b3560 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddd91ebb3eac42b2bb5e129ada311342'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:03:03.676024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-bcc179a3-a62c-4974-8b3d-fceacb1b3560 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddd91ebb3eac42b2bb5e129ada311342'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:03:03.692306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-bcc179a3-a62c-4974-8b3d-fceacb1b3560 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddd91ebb3eac42b2bb5e129ada311342'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:03:03.692973 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-bcc179a3-a62c-4974-8b3d-fceacb1b3560 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddd91ebb3eac42b2bb5e129ada311342'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:03:03.722175 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1281/2580] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:03:03 2022] DELETE /identity/v3/users/ddd91ebb3eac42b2bb5e129ada311342 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:03:03.909216 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a99728-e963-4643-9713-b1a18d345627 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:03:03.910885 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e4a99728-e963-4643-9713-b1a18d345627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:03:03.957889 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a99728-e963-4643-9713-b1a18d345627 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:03:04.034022 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662c098-35d7-4d1b-9bf9-f642d20e9948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:03:04.034871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662c098-35d7-4d1b-9bf9-f642d20e9948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:04.035243 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662c098-35d7-4d1b-9bf9-f642d20e9948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:04.035608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662c098-35d7-4d1b-9bf9-f642d20e9948 admin admin] PATH_INFO: `/v3/projects/998adaa72fcf448f9d321a8ed8a880ec` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:04.036817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662c098-35d7-4d1b-9bf9-f642d20e9948 admin admin] RBAC: Authorizing `identity:delete_project(project_id=998adaa72fcf448f9d321a8ed8a880ec)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:03:04.038845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662c098-35d7-4d1b-9bf9-f642d20e9948 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:03:04.094759 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:03:04.119961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1662c098-35d7-4d1b-9bf9-f642d20e9948 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '998adaa72fcf448f9d321a8ed8a880ec', 'request_id': 'req-1662c098-35d7-4d1b-9bf9-f642d20e9948'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:03:04.130045 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1662c098-35d7-4d1b-9bf9-f642d20e9948 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '998adaa72fcf448f9d321a8ed8a880ec', 'request_id': 'req-1662c098-35d7-4d1b-9bf9-f642d20e9948'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:03:04.137067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1662c098-35d7-4d1b-9bf9-f642d20e9948 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '998adaa72fcf448f9d321a8ed8a880ec', 'request_id': 'req-1662c098-35d7-4d1b-9bf9-f642d20e9948'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:03:04.152971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1662c098-35d7-4d1b-9bf9-f642d20e9948 admin admin] The token cache is being invalidate because project 998adaa72fcf448f9d321a8ed8a880ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:03:04.153427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1662c098-35d7-4d1b-9bf9-f642d20e9948 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:03:04.154911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1662c098-35d7-4d1b-9bf9-f642d20e9948 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:03:04.162489 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1300/2581] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:03:03 2022] DELETE /identity/v3/projects/998adaa72fcf448f9d321a8ed8a880ec => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:03:04.165077 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4155ca2-cd63-46be-8cb3-9afe17eae6b9 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:04.165566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4155ca2-cd63-46be-8cb3-9afe17eae6b9 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:04.165951 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4155ca2-cd63-46be-8cb3-9afe17eae6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:04.198360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c4155ca2-cd63-46be-8cb3-9afe17eae6b9 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:03:04.200660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c4155ca2-cd63-46be-8cb3-9afe17eae6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:03:04.320728 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1282/2582] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:03:04.330357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc5b7d-cabf-459a-9a69-4c0c18b73d6c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:04.330904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc5b7d-cabf-459a-9a69-4c0c18b73d6c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:04.331154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc5b7d-cabf-459a-9a69-4c0c18b73d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:04.365108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-19dc5b7d-cabf-459a-9a69-4c0c18b73d6c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:03:04.366360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-19dc5b7d-cabf-459a-9a69-4c0c18b73d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:03:04.382894 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4155ca2-cd63-46be-8cb3-9afe17eae6b9 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:03:04.389993 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1301/2583] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:03:04.398846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4155ca2-cd63-46be-8cb3-9afe17eae6b9 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:03:04.406381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9e6fc-bdf9-41be-aaba-b4d0eda1edf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:03:04.407479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9e6fc-bdf9-41be-aaba-b4d0eda1edf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:04.407771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9e6fc-bdf9-41be-aaba-b4d0eda1edf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:04.408047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9e6fc-bdf9-41be-aaba-b4d0eda1edf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:04.408702 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9e6fc-bdf9-41be-aaba-b4d0eda1edf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:03:04.409002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9e6fc-bdf9-41be-aaba-b4d0eda1edf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:03:04.410666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9e6fc-bdf9-41be-aaba-b4d0eda1edf2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:03:04.429428 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1283/2584] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:03:04.430413 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc5b7d-cabf-459a-9a69-4c0c18b73d6c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:03:04.457841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc5b7d-cabf-459a-9a69-4c0c18b73d6c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:03:04.463304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb358c0-44fd-40c2-954d-650fde207c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:03:04.464161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb358c0-44fd-40c2-954d-650fde207c8c admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:04.465832 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb358c0-44fd-40c2-954d-650fde207c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:04.466756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb358c0-44fd-40c2-954d-650fde207c8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:04.466934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb358c0-44fd-40c2-954d-650fde207c8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:03:04.471940 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb358c0-44fd-40c2-954d-650fde207c8c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:03:04.526985 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1302/2585] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:03:04 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:03:04.532168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9e6fc-bdf9-41be-aaba-b4d0eda1edf2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:03:04.544239 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9e6fc-bdf9-41be-aaba-b4d0eda1edf2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:03:04.582038 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:03:04.631230 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abe39d-a5af-4071-a3fd-3a5b82018872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:03:04.632040 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abe39d-a5af-4071-a3fd-3a5b82018872 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:04.632427 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abe39d-a5af-4071-a3fd-3a5b82018872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:04.633608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abe39d-a5af-4071-a3fd-3a5b82018872 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:04.634493 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29abe39d-a5af-4071-a3fd-3a5b82018872 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:03:04.636795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29abe39d-a5af-4071-a3fd-3a5b82018872 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:03:04.683772 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1284/2586] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:03:04 2022] POST /identity/v3/users => generated 292 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:03:04.688209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb358c0-44fd-40c2-954d-650fde207c8c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:03:04.738990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb358c0-44fd-40c2-954d-650fde207c8c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:03:04.767412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ddbf2-fcda-4f53-80f0-49db2d9a3700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:03:04.770270 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ddbf2-fcda-4f53-80f0-49db2d9a3700 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:04.770842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ddbf2-fcda-4f53-80f0-49db2d9a3700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:04.773954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ddbf2-fcda-4f53-80f0-49db2d9a3700 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:04.775013 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ddbf2-fcda-4f53-80f0-49db2d9a3700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:03:04.782175 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ddbf2-fcda-4f53-80f0-49db2d9a3700 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:03:04.816384 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1303/2587] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:03:04.820935 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abe39d-a5af-4071-a3fd-3a5b82018872 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:03:04.842094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abe39d-a5af-4071-a3fd-3a5b82018872 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:03:04.854967 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed2e9a-e669-4031-9d4e-97add2f6a93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:03:04.856005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed2e9a-e669-4031-9d4e-97add2f6a93e admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:04.856005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed2e9a-e669-4031-9d4e-97add2f6a93e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:04.857945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed2e9a-e669-4031-9d4e-97add2f6a93e admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:04.859064 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed2e9a-e669-4031-9d4e-97add2f6a93e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:03:04.860696 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed2e9a-e669-4031-9d4e-97add2f6a93e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:03:04.891733 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1285/2588] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:03:04.893397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ddbf2-fcda-4f53-80f0-49db2d9a3700 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:03:04.907810 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ddbf2-fcda-4f53-80f0-49db2d9a3700 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:03:04.929282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3ee71-4a32-42c0-9ac7-262bfe2a1743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:03:04.930594 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3ee71-4a32-42c0-9ac7-262bfe2a1743 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:04.932620 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3ee71-4a32-42c0-9ac7-262bfe2a1743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:04.933162 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3ee71-4a32-42c0-9ac7-262bfe2a1743 admin admin] PATH_INFO: `/v3/projects/d65f33abea4349f988289539b14245c0/users/1c03bc1208d547f386b0953aea835ae0/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:04.961878 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa3ee71-4a32-42c0-9ac7-262bfe2a1743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d65f33abea4349f988289539b14245c0, user_id=1c03bc1208d547f386b0953aea835ae0, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:03:04.965083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa3ee71-4a32-42c0-9ac7-262bfe2a1743 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:03:04.993664 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1304/2589] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:03:04 2022] PUT /identity/v3/projects/d65f33abea4349f988289539b14245c0/users/1c03bc1208d547f386b0953aea835ae0/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:03:04.995931 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09766561-3e43-404b-a9c9-60db55f26f76 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:04.996312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09766561-3e43-404b-a9c9-60db55f26f76 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:04.996682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09766561-3e43-404b-a9c9-60db55f26f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:05.035741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-09766561-3e43-404b-a9c9-60db55f26f76 None None] MFA Rules not processed for user `1c03bc1208d547f386b0953aea835ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:03:05.037388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-09766561-3e43-404b-a9c9-60db55f26f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:03:05.169189 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1286/2590] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:03:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:03:05.180679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c7d4f-f9d5-41ee-974c-7a38a1a8e08a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:05.181196 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c7d4f-f9d5-41ee-974c-7a38a1a8e08a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:05.182384 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c7d4f-f9d5-41ee-974c-7a38a1a8e08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:05.204338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-5f6c7d4f-f9d5-41ee-974c-7a38a1a8e08a None None] MFA Rules not processed for user `1c03bc1208d547f386b0953aea835ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:03:05.206642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5f6c7d4f-f9d5-41ee-974c-7a38a1a8e08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:03:05.220427 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1305/2591] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:03:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:03:05.356174 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09766561-3e43-404b-a9c9-60db55f26f76 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:03:05.357553 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-09766561-3e43-404b-a9c9-60db55f26f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:03:05.469228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09766561-3e43-404b-a9c9-60db55f26f76 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:03:05.477488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551998b1-d4a4-44e7-849f-fa89abbb3137 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:03:05.478198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551998b1-d4a4-44e7-849f-fa89abbb3137 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:05.478198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551998b1-d4a4-44e7-849f-fa89abbb3137 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:05.478415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551998b1-d4a4-44e7-849f-fa89abbb3137 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:05.488376 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551998b1-d4a4-44e7-849f-fa89abbb3137 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:03:05.490214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551998b1-d4a4-44e7-849f-fa89abbb3137 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:03:05.510706 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1287/2592] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:03:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:03:06.237301 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43413e-a41a-4932-aaa2-93aee44238f2 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:06.238783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43413e-a41a-4932-aaa2-93aee44238f2 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:06.239298 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43413e-a41a-4932-aaa2-93aee44238f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:06.321611 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-7c43413e-a41a-4932-aaa2-93aee44238f2 None None] MFA Rules not processed for user `bb875b06dd5b4a6f9ea3f3865d57d412`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:03:06.325210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7c43413e-a41a-4932-aaa2-93aee44238f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:03:06.493903 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1306/2593] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:03:06 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:03:06.496422 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ad7ba-4734-4310-a042-cc2bf22d19f0 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:06.496890 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ad7ba-4734-4310-a042-cc2bf22d19f0 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:06.497402 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ad7ba-4734-4310-a042-cc2bf22d19f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:06.536974 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-9e5ad7ba-4734-4310-a042-cc2bf22d19f0 None None] MFA Rules not processed for user `e17afcbd7fd346b884e55a7a587343ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:03:06.538230 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9e5ad7ba-4734-4310-a042-cc2bf22d19f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:03:06.581944 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:03:06.658006 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1288/2594] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:03:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:03:06.664684 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43413e-a41a-4932-aaa2-93aee44238f2 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:03:06.668614 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7c43413e-a41a-4932-aaa2-93aee44238f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:03:06.702497 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43413e-a41a-4932-aaa2-93aee44238f2 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:03:06.710361 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7310e20-c629-4501-979c-23a13b919998 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:03:06.711316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7310e20-c629-4501-979c-23a13b919998 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:06.711663 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7310e20-c629-4501-979c-23a13b919998 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:06.711869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7310e20-c629-4501-979c-23a13b919998 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:06.718337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e7310e20-c629-4501-979c-23a13b919998 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:03:06.747206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7310e20-c629-4501-979c-23a13b919998 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:03:06.750999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7310e20-c629-4501-979c-23a13b919998 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:03:06.781535 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1307/2595] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:03:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:03:08.081276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ad7ba-4734-4310-a042-cc2bf22d19f0 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:03:08.084336 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9e5ad7ba-4734-4310-a042-cc2bf22d19f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:03:08.257816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ad7ba-4734-4310-a042-cc2bf22d19f0 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:03:08.265819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299c368-6137-42da-aed4-a5f46198948d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:03:08.267007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299c368-6137-42da-aed4-a5f46198948d service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:08.267287 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299c368-6137-42da-aed4-a5f46198948d service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:08.267824 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299c368-6137-42da-aed4-a5f46198948d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:08.270099 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3299c368-6137-42da-aed4-a5f46198948d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:03:08.286345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299c368-6137-42da-aed4-a5f46198948d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:03:08.288895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299c368-6137-42da-aed4-a5f46198948d service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:03:08.301364 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1289/2596] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:03:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:03:11.201939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7310e20-c629-4501-979c-23a13b919998 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:03:11.227171 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7310e20-c629-4501-979c-23a13b919998 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:03:11.236028 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131e800-7e7a-46f3-b30c-03cb226b53aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:03:11.236655 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131e800-7e7a-46f3-b30c-03cb226b53aa service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:11.236933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131e800-7e7a-46f3-b30c-03cb226b53aa service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:11.237200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131e800-7e7a-46f3-b30c-03cb226b53aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:11.239558 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3131e800-7e7a-46f3-b30c-03cb226b53aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:03:11.256452 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:03:11.319427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131e800-7e7a-46f3-b30c-03cb226b53aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:03:11.321024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131e800-7e7a-46f3-b30c-03cb226b53aa service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:03:11.330374 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1308/2597] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:03:11 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:03:17.493201 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b9685-aef9-460c-a85a-2e8bb19fed38 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:17.493752 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b9685-aef9-460c-a85a-2e8bb19fed38 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:17.493939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b9685-aef9-460c-a85a-2e8bb19fed38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:17.535452 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-548b9685-aef9-460c-a85a-2e8bb19fed38 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:03:17.536893 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-548b9685-aef9-460c-a85a-2e8bb19fed38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:03:17.628735 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1290/2598] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:03:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:03:17.696959 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131e800-7e7a-46f3-b30c-03cb226b53aa service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:03:17.702393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3131e800-7e7a-46f3-b30c-03cb226b53aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:03:17.798575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131e800-7e7a-46f3-b30c-03cb226b53aa service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:03:17.808373 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f108bc-5afe-420e-802c-4c9066ef1019 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:03:17.809752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f108bc-5afe-420e-802c-4c9066ef1019 service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:17.810376 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f108bc-5afe-420e-802c-4c9066ef1019 service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:17.811050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f108bc-5afe-420e-802c-4c9066ef1019 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:17.824841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f108bc-5afe-420e-802c-4c9066ef1019 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:03:17.829425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f108bc-5afe-420e-802c-4c9066ef1019 service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:03:17.869030 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1309/2599] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:03:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:03:19.955949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b9685-aef9-460c-a85a-2e8bb19fed38 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:03:19.957543 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-548b9685-aef9-460c-a85a-2e8bb19fed38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:03:19.974594 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b9685-aef9-460c-a85a-2e8bb19fed38 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:03:19.981780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ce324-887f-42e4-976b-b14204327cf6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:03:19.983354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ce324-887f-42e4-976b-b14204327cf6 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:19.983354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ce324-887f-42e4-976b-b14204327cf6 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:19.983354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ce324-887f-42e4-976b-b14204327cf6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:19.992809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e50ce324-887f-42e4-976b-b14204327cf6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:03:20.012202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ce324-887f-42e4-976b-b14204327cf6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:03:20.014804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ce324-887f-42e4-976b-b14204327cf6 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:03:20.026472 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1291/2600] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:03:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:03:23.121601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ecfd3-d50f-427d-839d-5203c895cb38 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:23.122690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ecfd3-d50f-427d-839d-5203c895cb38 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:23.122690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ecfd3-d50f-427d-839d-5203c895cb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:23.157274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-bb6ecfd3-d50f-427d-839d-5203c895cb38 None None] MFA Rules not processed for user `94d139d4b19f423189a68e959e338edf`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:03:23.158514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-bb6ecfd3-d50f-427d-839d-5203c895cb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:03:23.230667 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1310/2601] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:03:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:03:25.052853 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ce324-887f-42e4-976b-b14204327cf6 service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:03:25.070525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ce324-887f-42e4-976b-b14204327cf6 service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:03:25.078025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a6d79-030c-4c56-a546-878a780ee538 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:03:25.079055 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a6d79-030c-4c56-a546-878a780ee538 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:25.081695 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a6d79-030c-4c56-a546-878a780ee538 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:25.081695 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a6d79-030c-4c56-a546-878a780ee538 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:25.089527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a6d79-030c-4c56-a546-878a780ee538 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:03:25.091259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a6d79-030c-4c56-a546-878a780ee538 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:03:25.102596 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1292/2602] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:03:25 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:03:26.758685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493c3a3-cc22-4ed6-9bed-4f81694aa29e None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:26.759608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493c3a3-cc22-4ed6-9bed-4f81694aa29e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:26.760037 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493c3a3-cc22-4ed6-9bed-4f81694aa29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:26.795927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-1493c3a3-cc22-4ed6-9bed-4f81694aa29e None None] MFA Rules not processed for user `13f0f341bf2c475d82b4e7b34d503dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:03:26.797535 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1493c3a3-cc22-4ed6-9bed-4f81694aa29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:03:26.819329 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1311/2603] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Sep 4 01:03:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:03:26.838154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a6d79-030c-4c56-a546-878a780ee538 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:03:26.840021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-250a6d79-030c-4c56-a546-878a780ee538 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:03:26.951579 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:03:26.998751 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a6d79-030c-4c56-a546-878a780ee538 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:03:27.006451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed31db-0ea6-4bca-b16f-067ebce7dc60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:03:27.007818 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed31db-0ea6-4bca-b16f-067ebce7dc60 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:27.008018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed31db-0ea6-4bca-b16f-067ebce7dc60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:27.009633 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed31db-0ea6-4bca-b16f-067ebce7dc60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:27.028650 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed31db-0ea6-4bca-b16f-067ebce7dc60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:03:27.030389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed31db-0ea6-4bca-b16f-067ebce7dc60 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:03:27.045790 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1293/2604] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:03:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:03:30.444651 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe25474-cea9-4c0c-a938-41e4cbb96bb7 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:30.445155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe25474-cea9-4c0c-a938-41e4cbb96bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:30.445248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe25474-cea9-4c0c-a938-41e4cbb96bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:30.464445 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-cfe25474-cea9-4c0c-a938-41e4cbb96bb7 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:03:30.465695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-cfe25474-cea9-4c0c-a938-41e4cbb96bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:03:30.472773 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1312/2605] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 01:03:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:03:30.486099 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed31db-0ea6-4bca-b16f-067ebce7dc60 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:03:30.498126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed31db-0ea6-4bca-b16f-067ebce7dc60 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:03:30.503694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085d5d9-3909-4924-8968-825ba13e4d09 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:03:30.504434 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085d5d9-3909-4924-8968-825ba13e4d09 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:30.504713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085d5d9-3909-4924-8968-825ba13e4d09 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:30.505088 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085d5d9-3909-4924-8968-825ba13e4d09 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:30.514573 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0085d5d9-3909-4924-8968-825ba13e4d09 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:03:30.516656 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0085d5d9-3909-4924-8968-825ba13e4d09 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:03:30.525765 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1294/2606] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:03:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:03:31.027554 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a71c0-95fa-4f43-beea-bf3c9f64adaa None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:31.027913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a71c0-95fa-4f43-beea-bf3c9f64adaa None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:31.028204 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a71c0-95fa-4f43-beea-bf3c9f64adaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:31.048358 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-1d0a71c0-95fa-4f43-beea-bf3c9f64adaa None None] MFA Rules not processed for user `545e0ebcbe314ee1a8419e3583e74d23`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:03:31.049851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1d0a71c0-95fa-4f43-beea-bf3c9f64adaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:03:31.083725 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:03:31.117958 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1313/2607] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:03:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:03:32.839085 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd0aab-6856-4579-af0a-898712f693c8 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:32.839563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd0aab-6856-4579-af0a-898712f693c8 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:32.839648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd0aab-6856-4579-af0a-898712f693c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:32.860325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-f3dd0aab-6856-4579-af0a-898712f693c8 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:03:32.861620 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f3dd0aab-6856-4579-af0a-898712f693c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:03:32.868900 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1295/2608] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:03:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:03:32.881367 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a71c0-95fa-4f43-beea-bf3c9f64adaa None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:03:32.893962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a71c0-95fa-4f43-beea-bf3c9f64adaa None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:03:32.900576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80514845-7cba-47c5-bf12-5e4501b513e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:03:32.901185 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80514845-7cba-47c5-bf12-5e4501b513e8 service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:32.901494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80514845-7cba-47c5-bf12-5e4501b513e8 service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:32.901783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80514845-7cba-47c5-bf12-5e4501b513e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:32.910128 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80514845-7cba-47c5-bf12-5e4501b513e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:03:32.911713 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80514845-7cba-47c5-bf12-5e4501b513e8 service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:03:32.920611 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1314/2609] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:03:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:03:42.854137 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=19 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:03:42.916565 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=17 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:03:43.394816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87abc2d-85b7-4418-8284-c4235aca93f5 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:43.395521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87abc2d-85b7-4418-8284-c4235aca93f5 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:43.396297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87abc2d-85b7-4418-8284-c4235aca93f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:43.454395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b87abc2d-85b7-4418-8284-c4235aca93f5 None None] MFA Rules not processed for user `94d139d4b19f423189a68e959e338edf`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:03:43.457153 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b87abc2d-85b7-4418-8284-c4235aca93f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:03:43.480860 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1296/2610] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:03:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:03:45.515842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06cd77-0b00-46fb-8c11-780bb66c61c9 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:45.516296 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06cd77-0b00-46fb-8c11-780bb66c61c9 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:45.516410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06cd77-0b00-46fb-8c11-780bb66c61c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:45.535402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-5e06cd77-0b00-46fb-8c11-780bb66c61c9 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:03:45.536565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5e06cd77-0b00-46fb-8c11-780bb66c61c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:03:45.543529 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1315/2611] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 01:03:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:03:45.555548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87abc2d-85b7-4418-8284-c4235aca93f5 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:03:45.567067 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87abc2d-85b7-4418-8284-c4235aca93f5 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:03:45.571977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6af47-b43d-46f7-b857-89a8a24021a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:03:45.572571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6af47-b43d-46f7-b857-89a8a24021a4 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:45.572851 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6af47-b43d-46f7-b857-89a8a24021a4 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:45.573126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6af47-b43d-46f7-b857-89a8a24021a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:45.581505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b6af47-b43d-46f7-b857-89a8a24021a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:03:45.583091 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b6af47-b43d-46f7-b857-89a8a24021a4 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:03:45.591524 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1297/2612] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:03:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:03:47.444882 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bec5e8-13dd-4723-a0cf-54dd4a689717 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:47.445724 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bec5e8-13dd-4723-a0cf-54dd4a689717 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:47.446144 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bec5e8-13dd-4723-a0cf-54dd4a689717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:47.468855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-10bec5e8-13dd-4723-a0cf-54dd4a689717 None None] MFA Rules not processed for user `e17afcbd7fd346b884e55a7a587343ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:03:47.470646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-10bec5e8-13dd-4723-a0cf-54dd4a689717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:03:47.481476 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1316/2613] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:03:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:03:50.715970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce341d9-53c7-41a8-bc42-fe3208721b3f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:50.717089 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce341d9-53c7-41a8-bc42-fe3208721b3f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:50.717367 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce341d9-53c7-41a8-bc42-fe3208721b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:50.740844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-1ce341d9-53c7-41a8-bc42-fe3208721b3f None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:03:50.742247 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1ce341d9-53c7-41a8-bc42-fe3208721b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:03:50.752950 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1298/2614] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:03:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:03:50.767096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bec5e8-13dd-4723-a0cf-54dd4a689717 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:03:50.786352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bec5e8-13dd-4723-a0cf-54dd4a689717 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:03:50.796560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656957a5-6530-47ba-9880-7bceaf7813bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:03:50.797227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656957a5-6530-47ba-9880-7bceaf7813bb service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:03:50.797772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656957a5-6530-47ba-9880-7bceaf7813bb service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:03:50.798250 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656957a5-6530-47ba-9880-7bceaf7813bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:03:50.827768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656957a5-6530-47ba-9880-7bceaf7813bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:03:50.829279 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656957a5-6530-47ba-9880-7bceaf7813bb service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:03:50.838082 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1317/2615] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:03:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:04:00.733781 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=12 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:04:00.834567 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=12 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:04:03.264540 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc5af9-04d7-43ce-a134-34f6c3c60df5 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:03.265077 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc5af9-04d7-43ce-a134-34f6c3c60df5 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:03.265077 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc5af9-04d7-43ce-a134-34f6c3c60df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:03.286093 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-7cbc5af9-04d7-43ce-a134-34f6c3c60df5 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:04:03.287580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7cbc5af9-04d7-43ce-a134-34f6c3c60df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:03.295334 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1299/2616] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 01:04:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:04:03.308342 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656957a5-6530-47ba-9880-7bceaf7813bb service swift] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:03.319370 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656957a5-6530-47ba-9880-7bceaf7813bb service swift] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:03.324465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b5928-93d1-46bf-814a-bb0cbc411ec8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:03.325061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b5928-93d1-46bf-814a-bb0cbc411ec8 service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:03.325338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b5928-93d1-46bf-814a-bb0cbc411ec8 service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:03.325640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b5928-93d1-46bf-814a-bb0cbc411ec8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:03.334165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b5928-93d1-46bf-814a-bb0cbc411ec8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:03.335816 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b5928-93d1-46bf-814a-bb0cbc411ec8 service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:03.344181 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1318/2617] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:04:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:04:04.020589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc5af9-04d7-43ce-a134-34f6c3c60df5 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:04.022227 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7cbc5af9-04d7-43ce-a134-34f6c3c60df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:04.127338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc5af9-04d7-43ce-a134-34f6c3c60df5 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:04.132409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62418578-8802-493b-82ce-a9c3731a264a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:04.133222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62418578-8802-493b-82ce-a9c3731a264a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:04.133724 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62418578-8802-493b-82ce-a9c3731a264a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:04.133994 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62418578-8802-493b-82ce-a9c3731a264a admin admin] PATH_INFO: `/v3/users/3fbbe2f1619047ff8ddec6142525faf3` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:04.135307 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62418578-8802-493b-82ce-a9c3731a264a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fbbe2f1619047ff8ddec6142525faf3)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:04.138215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62418578-8802-493b-82ce-a9c3731a264a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:04.211794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-62418578-8802-493b-82ce-a9c3731a264a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fbbe2f1619047ff8ddec6142525faf3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:04.212716 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-62418578-8802-493b-82ce-a9c3731a264a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fbbe2f1619047ff8ddec6142525faf3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:04.215003 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7026970-2d6e-4fd0-858c-826b6663cb6b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:04.215407 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7026970-2d6e-4fd0-858c-826b6663cb6b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:04.215776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7026970-2d6e-4fd0-858c-826b6663cb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:04.224977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-62418578-8802-493b-82ce-a9c3731a264a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fbbe2f1619047ff8ddec6142525faf3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:04.236536 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-62418578-8802-493b-82ce-a9c3731a264a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fbbe2f1619047ff8ddec6142525faf3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:04.237246 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-62418578-8802-493b-82ce-a9c3731a264a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fbbe2f1619047ff8ddec6142525faf3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:04.250993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-d7026970-2d6e-4fd0-858c-826b6663cb6b None None] MFA Rules not processed for user `94d139d4b19f423189a68e959e338edf`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:04:04.253506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d7026970-2d6e-4fd0-858c-826b6663cb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:04.269672 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1300/2618] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:04:04 2022] DELETE /identity/v3/users/3fbbe2f1619047ff8ddec6142525faf3 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:04:04.273518 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1319/2619] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:04:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:04:04.275649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2704b7-5c2e-4a24-afa6-231c2fc85f00 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:04.275939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2704b7-5c2e-4a24-afa6-231c2fc85f00 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:04.276260 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2704b7-5c2e-4a24-afa6-231c2fc85f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:04.296242 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-1f2704b7-5c2e-4a24-afa6-231c2fc85f00 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:04:04.297488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1f2704b7-5c2e-4a24-afa6-231c2fc85f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:04.381769 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1301/2620] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:04:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:04:04.394051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7026970-2d6e-4fd0-858c-826b6663cb6b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:04.395841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d7026970-2d6e-4fd0-858c-826b6663cb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:04.422377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7026970-2d6e-4fd0-858c-826b6663cb6b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:04.478645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7ddc9-6b19-415e-8171-2e864e96a37b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:04.479193 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7ddc9-6b19-415e-8171-2e864e96a37b service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:04.479609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7ddc9-6b19-415e-8171-2e864e96a37b service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:04.479974 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7ddc9-6b19-415e-8171-2e864e96a37b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:04.491391 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7ddc9-6b19-415e-8171-2e864e96a37b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:04.493122 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7ddc9-6b19-415e-8171-2e864e96a37b service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:04.504556 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1320/2621] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:04:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:04:05.035771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2704b7-5c2e-4a24-afa6-231c2fc85f00 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:05.037385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1f2704b7-5c2e-4a24-afa6-231c2fc85f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:05.101079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2704b7-5c2e-4a24-afa6-231c2fc85f00 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:05.106829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b814189-74f0-4b3a-82df-09c137fb03e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:05.107535 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b814189-74f0-4b3a-82df-09c137fb03e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:05.107882 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b814189-74f0-4b3a-82df-09c137fb03e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:05.108473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b814189-74f0-4b3a-82df-09c137fb03e5 admin admin] PATH_INFO: `/v3/projects/83a5160d4e7c47f08ba83aad0aa62a3d` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:05.114799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b814189-74f0-4b3a-82df-09c137fb03e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83a5160d4e7c47f08ba83aad0aa62a3d)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:05.117598 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b814189-74f0-4b3a-82df-09c137fb03e5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:05.128978 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:04:05.177263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9b814189-74f0-4b3a-82df-09c137fb03e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83a5160d4e7c47f08ba83aad0aa62a3d', 'request_id': 'req-9b814189-74f0-4b3a-82df-09c137fb03e5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:05.188843 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9b814189-74f0-4b3a-82df-09c137fb03e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83a5160d4e7c47f08ba83aad0aa62a3d', 'request_id': 'req-9b814189-74f0-4b3a-82df-09c137fb03e5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:05.196151 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9b814189-74f0-4b3a-82df-09c137fb03e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83a5160d4e7c47f08ba83aad0aa62a3d', 'request_id': 'req-9b814189-74f0-4b3a-82df-09c137fb03e5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:05.227230 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9b814189-74f0-4b3a-82df-09c137fb03e5 admin admin] The token cache is being invalidate because project 83a5160d4e7c47f08ba83aad0aa62a3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:04:05.227640 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9b814189-74f0-4b3a-82df-09c137fb03e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:05.228528 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9b814189-74f0-4b3a-82df-09c137fb03e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:05.230927 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1302/2622] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:04:05 2022] DELETE /identity/v3/projects/83a5160d4e7c47f08ba83aad0aa62a3d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:04:05.235227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7ddc9-6b19-415e-8171-2e864e96a37b service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:05.251671 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7ddc9-6b19-415e-8171-2e864e96a37b service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:05.352907 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2100f-fa14-438d-a1ca-2b5ae4053d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:05.354257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2100f-fa14-438d-a1ca-2b5ae4053d06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:05.354855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2100f-fa14-438d-a1ca-2b5ae4053d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:05.355290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2100f-fa14-438d-a1ca-2b5ae4053d06 admin admin] PATH_INFO: `/v3/users/76281cf89fe14534bb9052170ac1d90e` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:05.356872 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd2100f-fa14-438d-a1ca-2b5ae4053d06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76281cf89fe14534bb9052170ac1d90e)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:05.361174 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd2100f-fa14-438d-a1ca-2b5ae4053d06 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:05.447645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dcd2100f-fa14-438d-a1ca-2b5ae4053d06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76281cf89fe14534bb9052170ac1d90e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:05.449240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dcd2100f-fa14-438d-a1ca-2b5ae4053d06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76281cf89fe14534bb9052170ac1d90e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:05.459183 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dcd2100f-fa14-438d-a1ca-2b5ae4053d06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76281cf89fe14534bb9052170ac1d90e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:05.470490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dcd2100f-fa14-438d-a1ca-2b5ae4053d06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76281cf89fe14534bb9052170ac1d90e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:05.471253 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dcd2100f-fa14-438d-a1ca-2b5ae4053d06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76281cf89fe14534bb9052170ac1d90e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:05.505648 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1321/2623] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:04:05 2022] DELETE /identity/v3/users/76281cf89fe14534bb9052170ac1d90e => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:04:05.920551 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b814189-74f0-4b3a-82df-09c137fb03e5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:05.923300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9b814189-74f0-4b3a-82df-09c137fb03e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:05.939739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b814189-74f0-4b3a-82df-09c137fb03e5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:06.009115 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d97de7-77aa-448f-9650-f37815775d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:06.010055 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d97de7-77aa-448f-9650-f37815775d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:06.011178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d97de7-77aa-448f-9650-f37815775d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:06.011612 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d97de7-77aa-448f-9650-f37815775d8d admin admin] PATH_INFO: `/v3/projects/f77dac2228f0432ebd96b86bc0f19771` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:06.012940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d97de7-77aa-448f-9650-f37815775d8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f77dac2228f0432ebd96b86bc0f19771)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:06.016922 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d97de7-77aa-448f-9650-f37815775d8d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:06.079361 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-57d97de7-77aa-448f-9650-f37815775d8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f77dac2228f0432ebd96b86bc0f19771', 'request_id': 'req-57d97de7-77aa-448f-9650-f37815775d8d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:06.092233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-57d97de7-77aa-448f-9650-f37815775d8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f77dac2228f0432ebd96b86bc0f19771', 'request_id': 'req-57d97de7-77aa-448f-9650-f37815775d8d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:06.100450 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-57d97de7-77aa-448f-9650-f37815775d8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f77dac2228f0432ebd96b86bc0f19771', 'request_id': 'req-57d97de7-77aa-448f-9650-f37815775d8d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:06.118286 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-57d97de7-77aa-448f-9650-f37815775d8d admin admin] The token cache is being invalidate because project f77dac2228f0432ebd96b86bc0f19771 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:04:06.118711 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-57d97de7-77aa-448f-9650-f37815775d8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:06.120338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-57d97de7-77aa-448f-9650-f37815775d8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:06.123735 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1303/2624] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:04:05 2022] DELETE /identity/v3/projects/f77dac2228f0432ebd96b86bc0f19771 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:04:06.130085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d0ebb-3696-432e-b700-ff8f8c6a2acd None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:06.130372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d0ebb-3696-432e-b700-ff8f8c6a2acd None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:06.130645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d0ebb-3696-432e-b700-ff8f8c6a2acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:06.140682 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:04:06.191183 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-608d0ebb-3696-432e-b700-ff8f8c6a2acd None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:04:06.193881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-608d0ebb-3696-432e-b700-ff8f8c6a2acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:06.285005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e1e86-63ab-493a-8c2e-7a8e59459319 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:06.285293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e1e86-63ab-493a-8c2e-7a8e59459319 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:06.285603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e1e86-63ab-493a-8c2e-7a8e59459319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:06.292201 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1322/2625] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:04:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:04:06.327294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-4c6e1e86-63ab-493a-8c2e-7a8e59459319 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:04:06.328608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4c6e1e86-63ab-493a-8c2e-7a8e59459319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:06.340415 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1304/2626] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:04:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:04:06.342099 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d0ebb-3696-432e-b700-ff8f8c6a2acd None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:06.355616 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d0ebb-3696-432e-b700-ff8f8c6a2acd None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:06.361376 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fb1b4-f59a-4984-abb0-e7110a86ee2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:06.362558 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fb1b4-f59a-4984-abb0-e7110a86ee2f admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:06.363188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fb1b4-f59a-4984-abb0-e7110a86ee2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:06.363683 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fb1b4-f59a-4984-abb0-e7110a86ee2f admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:06.364533 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5fb1b4-f59a-4984-abb0-e7110a86ee2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:04:06.365038 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5fb1b4-f59a-4984-abb0-e7110a86ee2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:06.367468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5fb1b4-f59a-4984-abb0-e7110a86ee2f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:06.383542 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1323/2627] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:04:06.388373 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e1e86-63ab-493a-8c2e-7a8e59459319 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:06.400130 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e1e86-63ab-493a-8c2e-7a8e59459319 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:06.413465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf3187-fe1b-4d46-bc46-ce2e75068130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:06.414364 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf3187-fe1b-4d46-bc46-ce2e75068130 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:06.414736 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf3187-fe1b-4d46-bc46-ce2e75068130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:06.415185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf3187-fe1b-4d46-bc46-ce2e75068130 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:06.418866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf3187-fe1b-4d46-bc46-ce2e75068130 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:06.420904 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf3187-fe1b-4d46-bc46-ce2e75068130 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:06.461634 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:04:06.481484 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1305/2628] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:04:06 2022] POST /identity/v3/projects => generated 389 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:04:06.486476 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fb1b4-f59a-4984-abb0-e7110a86ee2f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:06.500280 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fb1b4-f59a-4984-abb0-e7110a86ee2f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:06.587586 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0240f5-de19-44f0-993c-16353e85a28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:06.588992 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0240f5-de19-44f0-993c-16353e85a28b admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:06.589337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0240f5-de19-44f0-993c-16353e85a28b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:06.589882 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0240f5-de19-44f0-993c-16353e85a28b admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:06.590636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0240f5-de19-44f0-993c-16353e85a28b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:06.592671 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0240f5-de19-44f0-993c-16353e85a28b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:06.631978 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1324/2629] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:04:06 2022] POST /identity/v3/users => generated 295 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:04:06.636257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf3187-fe1b-4d46-bc46-ce2e75068130 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:06.654129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf3187-fe1b-4d46-bc46-ce2e75068130 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:06.668177 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92143c3-e808-487f-a993-022261e2100b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:06.668995 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92143c3-e808-487f-a993-022261e2100b admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:06.669347 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92143c3-e808-487f-a993-022261e2100b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:06.669740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92143c3-e808-487f-a993-022261e2100b admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:06.670462 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92143c3-e808-487f-a993-022261e2100b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:06.675165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92143c3-e808-487f-a993-022261e2100b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:06.699964 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1306/2630] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:04:06.703103 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0240f5-de19-44f0-993c-16353e85a28b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:06.725095 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0240f5-de19-44f0-993c-16353e85a28b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:06.742500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76ba0a-4ec2-4b67-851a-ac24b6fc8c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:06.743122 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76ba0a-4ec2-4b67-851a-ac24b6fc8c15 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:06.743546 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76ba0a-4ec2-4b67-851a-ac24b6fc8c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:06.743826 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76ba0a-4ec2-4b67-851a-ac24b6fc8c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:06.744623 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb76ba0a-4ec2-4b67-851a-ac24b6fc8c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:06.746293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb76ba0a-4ec2-4b67-851a-ac24b6fc8c15 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:06.779604 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1325/2631] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:04:06.783137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92143c3-e808-487f-a993-022261e2100b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:06.797912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92143c3-e808-487f-a993-022261e2100b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:06.807361 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f6c60-a2a5-47b3-8a42-70153589ce1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:06.808161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f6c60-a2a5-47b3-8a42-70153589ce1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:06.808510 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f6c60-a2a5-47b3-8a42-70153589ce1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:06.809596 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f6c60-a2a5-47b3-8a42-70153589ce1f admin admin] PATH_INFO: `/v3/projects/64ac2e98dc8e4e758d3f2a47b91f766e/users/591ba527f17e4ce9bb8536b621d61e85/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:06.831334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f6c60-a2a5-47b3-8a42-70153589ce1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=64ac2e98dc8e4e758d3f2a47b91f766e, user_id=591ba527f17e4ce9bb8536b621d61e85, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:06.834394 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f6c60-a2a5-47b3-8a42-70153589ce1f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:06.875705 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1307/2632] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:04:06 2022] PUT /identity/v3/projects/64ac2e98dc8e4e758d3f2a47b91f766e/users/591ba527f17e4ce9bb8536b621d61e85/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:04:06.879027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e15910-e3f3-484a-8efb-5d7592032056 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:06.879364 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e15910-e3f3-484a-8efb-5d7592032056 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:06.879693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e15910-e3f3-484a-8efb-5d7592032056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:06.924604 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-46e15910-e3f3-484a-8efb-5d7592032056 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:04:06.937039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-46e15910-e3f3-484a-8efb-5d7592032056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:07.035417 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1326/2633] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:04:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:04:07.043245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f6c60-a2a5-47b3-8a42-70153589ce1f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:07.045166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f82f6c60-a2a5-47b3-8a42-70153589ce1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:07.136114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f6c60-a2a5-47b3-8a42-70153589ce1f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:07.140278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d66f47-ad94-46f5-954a-fd493a00732f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:07.141182 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d66f47-ad94-46f5-954a-fd493a00732f service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:07.141620 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d66f47-ad94-46f5-954a-fd493a00732f service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:07.141991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d66f47-ad94-46f5-954a-fd493a00732f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:07.154066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d66f47-ad94-46f5-954a-fd493a00732f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:07.154903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d66f47-ad94-46f5-954a-fd493a00732f service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:07.166183 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1308/2634] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:04:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:04:09.567633 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e15910-e3f3-484a-8efb-5d7592032056 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:09.571110 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-46e15910-e3f3-484a-8efb-5d7592032056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:09.608563 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e15910-e3f3-484a-8efb-5d7592032056 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:09.624242 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f09c1-cba6-4b46-835c-202f11dc88c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:09.625278 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f09c1-cba6-4b46-835c-202f11dc88c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:09.627991 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f09c1-cba6-4b46-835c-202f11dc88c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:09.628921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f09c1-cba6-4b46-835c-202f11dc88c9 admin admin] PATH_INFO: `/v3/users/1c03bc1208d547f386b0953aea835ae0` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:09.641375 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f09c1-cba6-4b46-835c-202f11dc88c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c03bc1208d547f386b0953aea835ae0)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:09.645782 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f09c1-cba6-4b46-835c-202f11dc88c9 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:09.659363 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:04:09.799395 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fc7f09c1-cba6-4b46-835c-202f11dc88c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c03bc1208d547f386b0953aea835ae0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:09.800984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fc7f09c1-cba6-4b46-835c-202f11dc88c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c03bc1208d547f386b0953aea835ae0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:09.821564 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fc7f09c1-cba6-4b46-835c-202f11dc88c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c03bc1208d547f386b0953aea835ae0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:09.841752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fc7f09c1-cba6-4b46-835c-202f11dc88c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c03bc1208d547f386b0953aea835ae0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:09.842740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fc7f09c1-cba6-4b46-835c-202f11dc88c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c03bc1208d547f386b0953aea835ae0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:09.880000 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1327/2635] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:04:09 2022] DELETE /identity/v3/users/1c03bc1208d547f386b0953aea835ae0 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:04:09.886209 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978fb63-575d-4830-9e93-c533bac7eba1 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:09.887174 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978fb63-575d-4830-9e93-c533bac7eba1 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:09.887653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978fb63-575d-4830-9e93-c533bac7eba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:09.927491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d978fb63-575d-4830-9e93-c533bac7eba1 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:04:09.929831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d978fb63-575d-4830-9e93-c533bac7eba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:10.079216 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1309/2636] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:04:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:04:10.095942 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f09c1-cba6-4b46-835c-202f11dc88c9 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:10.098098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fc7f09c1-cba6-4b46-835c-202f11dc88c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:10.252405 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f09c1-cba6-4b46-835c-202f11dc88c9 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:10.260120 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b9263-d294-4289-a6d1-57443a1f0247 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:10.261364 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b9263-d294-4289-a6d1-57443a1f0247 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:10.261782 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b9263-d294-4289-a6d1-57443a1f0247 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:10.262205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b9263-d294-4289-a6d1-57443a1f0247 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:10.281694 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b9263-d294-4289-a6d1-57443a1f0247 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:10.283678 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b9263-d294-4289-a6d1-57443a1f0247 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:10.299096 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1328/2637] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:04:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:04:11.617057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d978fb63-575d-4830-9e93-c533bac7eba1 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:11.620329 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d978fb63-575d-4830-9e93-c533bac7eba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:11.644145 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d978fb63-575d-4830-9e93-c533bac7eba1 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:11.661724 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86217f4a-b78c-437e-9019-da6500479ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:11.662862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86217f4a-b78c-437e-9019-da6500479ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:11.663314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86217f4a-b78c-437e-9019-da6500479ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:11.663762 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86217f4a-b78c-437e-9019-da6500479ea0 admin admin] PATH_INFO: `/v3/projects/d65f33abea4349f988289539b14245c0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:11.666581 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86217f4a-b78c-437e-9019-da6500479ea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d65f33abea4349f988289539b14245c0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:11.672750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86217f4a-b78c-437e-9019-da6500479ea0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:11.787700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-86217f4a-b78c-437e-9019-da6500479ea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd65f33abea4349f988289539b14245c0', 'request_id': 'req-86217f4a-b78c-437e-9019-da6500479ea0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:11.816194 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-86217f4a-b78c-437e-9019-da6500479ea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd65f33abea4349f988289539b14245c0', 'request_id': 'req-86217f4a-b78c-437e-9019-da6500479ea0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:11.822417 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:04:11.828951 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-86217f4a-b78c-437e-9019-da6500479ea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd65f33abea4349f988289539b14245c0', 'request_id': 'req-86217f4a-b78c-437e-9019-da6500479ea0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:11.852846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-86217f4a-b78c-437e-9019-da6500479ea0 admin admin] The token cache is being invalidate because project d65f33abea4349f988289539b14245c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:04:11.852846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-86217f4a-b78c-437e-9019-da6500479ea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:11.852846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-86217f4a-b78c-437e-9019-da6500479ea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:11.853949 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1310/2638] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:04:11 2022] DELETE /identity/v3/projects/d65f33abea4349f988289539b14245c0 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:04:11.859099 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f944b5-1a2f-42fc-92d9-f16bdfab3f9a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:11.859616 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f944b5-1a2f-42fc-92d9-f16bdfab3f9a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:11.859616 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f944b5-1a2f-42fc-92d9-f16bdfab3f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:11.896039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-91f944b5-1a2f-42fc-92d9-f16bdfab3f9a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:04:11.898794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-91f944b5-1a2f-42fc-92d9-f16bdfab3f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:12.143335 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1329/2639] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:04:12.154865 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6c8b1-decd-477c-868f-9707dfdb9a46 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:12.155161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6c8b1-decd-477c-868f-9707dfdb9a46 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:12.155497 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6c8b1-decd-477c-868f-9707dfdb9a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:12.178687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-8cf6c8b1-decd-477c-868f-9707dfdb9a46 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:04:12.179964 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8cf6c8b1-decd-477c-868f-9707dfdb9a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:12.190095 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1311/2640] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:04:12.194577 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f944b5-1a2f-42fc-92d9-f16bdfab3f9a None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:12.204592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f944b5-1a2f-42fc-92d9-f16bdfab3f9a None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:12.209704 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f27f82-b266-43ef-8872-ed03707854f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:12.210373 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f27f82-b266-43ef-8872-ed03707854f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:12.210650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f27f82-b266-43ef-8872-ed03707854f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:12.210919 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f27f82-b266-43ef-8872-ed03707854f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:12.211571 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f27f82-b266-43ef-8872-ed03707854f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:04:12.211873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f27f82-b266-43ef-8872-ed03707854f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:12.213875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f27f82-b266-43ef-8872-ed03707854f9 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:12.231697 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1330/2641] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:04:12.233331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6c8b1-decd-477c-868f-9707dfdb9a46 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:12.247673 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6c8b1-decd-477c-868f-9707dfdb9a46 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:12.254643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f7367-19c2-45df-b1a3-c27b8dbab95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:12.255653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f7367-19c2-45df-b1a3-c27b8dbab95f admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:12.256260 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f7367-19c2-45df-b1a3-c27b8dbab95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:12.256645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f7367-19c2-45df-b1a3-c27b8dbab95f admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:12.257870 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f7367-19c2-45df-b1a3-c27b8dbab95f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:12.260648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f7367-19c2-45df-b1a3-c27b8dbab95f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:12.330771 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1312/2642] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:04:12 2022] POST /identity/v3/projects => generated 401 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:04:12.335571 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f27f82-b266-43ef-8872-ed03707854f9 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:12.347239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f27f82-b266-43ef-8872-ed03707854f9 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:12.357716 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:04:12.458195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907f5b7-0caa-49bf-99ab-3ce24359a2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:12.460222 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907f5b7-0caa-49bf-99ab-3ce24359a2fd admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:12.460506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907f5b7-0caa-49bf-99ab-3ce24359a2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:12.460778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907f5b7-0caa-49bf-99ab-3ce24359a2fd admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:12.465496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4907f5b7-0caa-49bf-99ab-3ce24359a2fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:12.467943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4907f5b7-0caa-49bf-99ab-3ce24359a2fd admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:12.512905 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1331/2643] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:04:12 2022] POST /identity/v3/users => generated 301 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:04:12.516788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f7367-19c2-45df-b1a3-c27b8dbab95f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:12.530702 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f7367-19c2-45df-b1a3-c27b8dbab95f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:12.536620 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f696b39-b810-4329-9568-7d856a1ef2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:12.537847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f696b39-b810-4329-9568-7d856a1ef2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:12.538424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f696b39-b810-4329-9568-7d856a1ef2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:12.538963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f696b39-b810-4329-9568-7d856a1ef2d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:12.539840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f696b39-b810-4329-9568-7d856a1ef2d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:12.542669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f696b39-b810-4329-9568-7d856a1ef2d3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:12.555666 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1313/2644] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:04:12.559658 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907f5b7-0caa-49bf-99ab-3ce24359a2fd admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:12.570310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907f5b7-0caa-49bf-99ab-3ce24359a2fd admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:12.575221 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718e009-30e8-4bb4-9bf8-96c68204388c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:12.575835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718e009-30e8-4bb4-9bf8-96c68204388c admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:12.576111 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718e009-30e8-4bb4-9bf8-96c68204388c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:12.576381 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718e009-30e8-4bb4-9bf8-96c68204388c admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:12.577022 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f718e009-30e8-4bb4-9bf8-96c68204388c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:12.578836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f718e009-30e8-4bb4-9bf8-96c68204388c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:12.595641 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f696b39-b810-4329-9568-7d856a1ef2d3 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:12.597135 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1332/2645] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:04:12.611732 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f696b39-b810-4329-9568-7d856a1ef2d3 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:12.619534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e148f-f59e-4d4e-942d-28516a714233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:12.620941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e148f-f59e-4d4e-942d-28516a714233 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:12.621355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e148f-f59e-4d4e-942d-28516a714233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:12.621907 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e148f-f59e-4d4e-942d-28516a714233 admin admin] PATH_INFO: `/v3/projects/12895981ea924c29b6d05c6791748467/users/bc59405a0fb141978ad27533b0a68b4e/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:12.645253 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e148f-f59e-4d4e-942d-28516a714233 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12895981ea924c29b6d05c6791748467, user_id=bc59405a0fb141978ad27533b0a68b4e, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:12.648252 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e148f-f59e-4d4e-942d-28516a714233 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:12.689500 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1314/2646] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:04:12 2022] PUT /identity/v3/projects/12895981ea924c29b6d05c6791748467/users/bc59405a0fb141978ad27533b0a68b4e/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:04:12.759421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fe18b-f0a8-4fb4-8378-459972218b81 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:12.759906 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fe18b-f0a8-4fb4-8378-459972218b81 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:12.760782 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fe18b-f0a8-4fb4-8378-459972218b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:12.814605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-1d0fe18b-f0a8-4fb4-8378-459972218b81 None None] MFA Rules not processed for user `bc59405a0fb141978ad27533b0a68b4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:04:12.817094 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1d0fe18b-f0a8-4fb4-8378-459972218b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:12.957388 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1333/2647] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:04:12 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:04:12.966381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e148f-f59e-4d4e-942d-28516a714233 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:12.970880 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7c7e148f-f59e-4d4e-942d-28516a714233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:13.137519 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e148f-f59e-4d4e-942d-28516a714233 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:13.145091 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8130e6-d77f-4958-a5bf-a26c0739abec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:13.145811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8130e6-d77f-4958-a5bf-a26c0739abec service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:13.146197 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8130e6-d77f-4958-a5bf-a26c0739abec service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:13.146602 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8130e6-d77f-4958-a5bf-a26c0739abec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:13.158064 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8130e6-d77f-4958-a5bf-a26c0739abec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:13.159848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8130e6-d77f-4958-a5bf-a26c0739abec service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:13.171478 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1315/2648] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:04:12 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:04:13.228465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fe18b-f0a8-4fb4-8378-459972218b81 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:13.324289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fe18b-f0a8-4fb4-8378-459972218b81 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:13.332571 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8da020-1a4b-4ad2-83f4-464f321fa5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:13.333481 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8da020-1a4b-4ad2-83f4-464f321fa5ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:13.334245 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8da020-1a4b-4ad2-83f4-464f321fa5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:13.334766 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8da020-1a4b-4ad2-83f4-464f321fa5ab admin admin] PATH_INFO: `/v3/users/bc59405a0fb141978ad27533b0a68b4e` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:13.336782 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8da020-1a4b-4ad2-83f4-464f321fa5ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc59405a0fb141978ad27533b0a68b4e)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:13.339028 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8da020-1a4b-4ad2-83f4-464f321fa5ab admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:13.368349 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:04:13.418680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1d8da020-1a4b-4ad2-83f4-464f321fa5ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc59405a0fb141978ad27533b0a68b4e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:13.420398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1d8da020-1a4b-4ad2-83f4-464f321fa5ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc59405a0fb141978ad27533b0a68b4e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:13.431362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1d8da020-1a4b-4ad2-83f4-464f321fa5ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc59405a0fb141978ad27533b0a68b4e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:13.450482 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1d8da020-1a4b-4ad2-83f4-464f321fa5ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc59405a0fb141978ad27533b0a68b4e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:13.451516 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1d8da020-1a4b-4ad2-83f4-464f321fa5ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc59405a0fb141978ad27533b0a68b4e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:13.504785 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1334/2649] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:04:13 2022] DELETE /identity/v3/users/bc59405a0fb141978ad27533b0a68b4e => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:04:13.510771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f2b82-ff67-4e1f-a403-404ef18d2cd6 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:13.511381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f2b82-ff67-4e1f-a403-404ef18d2cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:13.511841 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f2b82-ff67-4e1f-a403-404ef18d2cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:13.582863 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5d8f2b82-ff67-4e1f-a403-404ef18d2cd6 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:04:13.586243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5d8f2b82-ff67-4e1f-a403-404ef18d2cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:13.683550 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1316/2650] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:04:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:04:13.701344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8da020-1a4b-4ad2-83f4-464f321fa5ab admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:13.703093 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1d8da020-1a4b-4ad2-83f4-464f321fa5ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:13.816786 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8da020-1a4b-4ad2-83f4-464f321fa5ab admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:13.822954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de143a22-3bd0-429c-91ae-115c6ad8dc7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:13.823879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de143a22-3bd0-429c-91ae-115c6ad8dc7a service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:13.824485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de143a22-3bd0-429c-91ae-115c6ad8dc7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:13.824932 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de143a22-3bd0-429c-91ae-115c6ad8dc7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:13.840794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de143a22-3bd0-429c-91ae-115c6ad8dc7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:13.843012 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de143a22-3bd0-429c-91ae-115c6ad8dc7a service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:13.859358 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1335/2651] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:04:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:04:14.362410 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7efa7-a2f6-47fa-b109-79e5651139de None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:14.362694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7efa7-a2f6-47fa-b109-79e5651139de None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:14.362966 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7efa7-a2f6-47fa-b109-79e5651139de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:14.399965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-6ae7efa7-a2f6-47fa-b109-79e5651139de None None] MFA Rules not processed for user `a4c913daf63c433287eaf338b4ab2070`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:04:14.401735 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6ae7efa7-a2f6-47fa-b109-79e5651139de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:14.415463 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:04:14.620092 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1317/2652] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:04:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:04:14.794434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba0a44-4767-4d41-92cd-ddc528a7a85a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:14.794852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba0a44-4767-4d41-92cd-ddc528a7a85a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:14.795289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba0a44-4767-4d41-92cd-ddc528a7a85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:14.869969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-01ba0a44-4767-4d41-92cd-ddc528a7a85a None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:04:14.871717 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-01ba0a44-4767-4d41-92cd-ddc528a7a85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:15.025237 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1336/2653] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:04:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:04:15.041656 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7efa7-a2f6-47fa-b109-79e5651139de None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:15.044374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6ae7efa7-a2f6-47fa-b109-79e5651139de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:15.095179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba0a44-4767-4d41-92cd-ddc528a7a85a None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:15.096995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-01ba0a44-4767-4d41-92cd-ddc528a7a85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:15.125602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba0a44-4767-4d41-92cd-ddc528a7a85a None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:15.132884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ec9f1-ee96-47d1-ba2d-043be0f5f632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:15.135644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ec9f1-ee96-47d1-ba2d-043be0f5f632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:15.136588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ec9f1-ee96-47d1-ba2d-043be0f5f632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:15.136588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ec9f1-ee96-47d1-ba2d-043be0f5f632 admin admin] PATH_INFO: `/v3/projects/12895981ea924c29b6d05c6791748467` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:15.139236 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ec9f1-ee96-47d1-ba2d-043be0f5f632 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12895981ea924c29b6d05c6791748467)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:15.143379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ec9f1-ee96-47d1-ba2d-043be0f5f632 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:15.161684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7efa7-a2f6-47fa-b109-79e5651139de None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:15.174107 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb83274-6f12-45bf-87d8-d10dc6c28d22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:15.175306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb83274-6f12-45bf-87d8-d10dc6c28d22 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:15.175968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb83274-6f12-45bf-87d8-d10dc6c28d22 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:15.176438 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb83274-6f12-45bf-87d8-d10dc6c28d22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:15.188112 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb83274-6f12-45bf-87d8-d10dc6c28d22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:15.190474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb83274-6f12-45bf-87d8-d10dc6c28d22 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:15.205152 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1318/2654] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:04:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:04:15.264802 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:04:15.269821 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bd3ec9f1-ee96-47d1-ba2d-043be0f5f632 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12895981ea924c29b6d05c6791748467', 'request_id': 'req-bd3ec9f1-ee96-47d1-ba2d-043be0f5f632'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:15.291393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bd3ec9f1-ee96-47d1-ba2d-043be0f5f632 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12895981ea924c29b6d05c6791748467', 'request_id': 'req-bd3ec9f1-ee96-47d1-ba2d-043be0f5f632'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:15.300644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bd3ec9f1-ee96-47d1-ba2d-043be0f5f632 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12895981ea924c29b6d05c6791748467', 'request_id': 'req-bd3ec9f1-ee96-47d1-ba2d-043be0f5f632'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:15.314881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bd3ec9f1-ee96-47d1-ba2d-043be0f5f632 admin admin] The token cache is being invalidate because project 12895981ea924c29b6d05c6791748467 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:04:15.315495 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bd3ec9f1-ee96-47d1-ba2d-043be0f5f632 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:15.316513 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bd3ec9f1-ee96-47d1-ba2d-043be0f5f632 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:15.324324 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b6e6f-12a0-4c4e-971d-f9a540fd8d0d None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:15.325045 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b6e6f-12a0-4c4e-971d-f9a540fd8d0d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:15.325514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b6e6f-12a0-4c4e-971d-f9a540fd8d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:15.329241 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1337/2655] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:04:15 2022] DELETE /identity/v3/projects/12895981ea924c29b6d05c6791748467 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:04:15.369890 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a99b6e6f-12a0-4c4e-971d-f9a540fd8d0d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:04:15.372828 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a99b6e6f-12a0-4c4e-971d-f9a540fd8d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:15.537545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5de77-420d-4d27-b020-d97cdda86720 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:15.538382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5de77-420d-4d27-b020-d97cdda86720 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:15.539384 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5de77-420d-4d27-b020-d97cdda86720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:15.556201 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1319/2656] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:04:15.589719 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-98f5de77-420d-4d27-b020-d97cdda86720 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:04:15.591728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-98f5de77-420d-4d27-b020-d97cdda86720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:15.608895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b6e6f-12a0-4c4e-971d-f9a540fd8d0d None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:15.617957 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1338/2657] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:04:15.624451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b6e6f-12a0-4c4e-971d-f9a540fd8d0d None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:15.629876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1850bf-08d4-4250-ad88-f569ae5b363f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:15.630503 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1850bf-08d4-4250-ad88-f569ae5b363f admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:15.630904 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1850bf-08d4-4250-ad88-f569ae5b363f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:15.631173 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1850bf-08d4-4250-ad88-f569ae5b363f admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:15.632544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1850bf-08d4-4250-ad88-f569ae5b363f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:04:15.632864 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1850bf-08d4-4250-ad88-f569ae5b363f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:15.634552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1850bf-08d4-4250-ad88-f569ae5b363f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:15.659643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5de77-420d-4d27-b020-d97cdda86720 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:15.672199 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5de77-420d-4d27-b020-d97cdda86720 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:15.672467 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1320/2658] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:04:15.692475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21f76b-b180-4822-8e50-ab267f31329f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:15.698939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21f76b-b180-4822-8e50-ab267f31329f admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:15.699700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21f76b-b180-4822-8e50-ab267f31329f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:15.700051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21f76b-b180-4822-8e50-ab267f31329f admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:15.701469 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21f76b-b180-4822-8e50-ab267f31329f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:15.703855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21f76b-b180-4822-8e50-ab267f31329f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:15.763581 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1339/2659] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:04:15 2022] POST /identity/v3/projects => generated 397 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:04:15.769632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1850bf-08d4-4250-ad88-f569ae5b363f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:15.782852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1850bf-08d4-4250-ad88-f569ae5b363f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:15.901811 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:04:16.014025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c714f-a0b4-49cf-b93a-8dfb370a56a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:16.014595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c714f-a0b4-49cf-b93a-8dfb370a56a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:16.016588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c714f-a0b4-49cf-b93a-8dfb370a56a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:16.016880 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c714f-a0b4-49cf-b93a-8dfb370a56a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:16.029902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c714f-a0b4-49cf-b93a-8dfb370a56a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:16.031889 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c714f-a0b4-49cf-b93a-8dfb370a56a4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:16.127229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21f76b-b180-4822-8e50-ab267f31329f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:16.142899 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1321/2660] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:04:15 2022] POST /identity/v3/users => generated 299 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:04:16.148058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21f76b-b180-4822-8e50-ab267f31329f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:16.163255 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01d7cb-94f6-494b-9aa7-6c6cc25d89e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:16.180081 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01d7cb-94f6-494b-9aa7-6c6cc25d89e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:16.180995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01d7cb-94f6-494b-9aa7-6c6cc25d89e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:16.183203 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01d7cb-94f6-494b-9aa7-6c6cc25d89e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:16.184184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01d7cb-94f6-494b-9aa7-6c6cc25d89e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:16.191650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01d7cb-94f6-494b-9aa7-6c6cc25d89e2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:16.287189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c714f-a0b4-49cf-b93a-8dfb370a56a4 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:16.289312 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1340/2661] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:04:16.303743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c714f-a0b4-49cf-b93a-8dfb370a56a4 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:16.316704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a7fed-1408-4f72-9dfa-c4aa19cdc264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:16.317591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a7fed-1408-4f72-9dfa-c4aa19cdc264 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:16.317939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a7fed-1408-4f72-9dfa-c4aa19cdc264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:16.319129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a7fed-1408-4f72-9dfa-c4aa19cdc264 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:16.319989 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a7fed-1408-4f72-9dfa-c4aa19cdc264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:16.327028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a7fed-1408-4f72-9dfa-c4aa19cdc264 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:16.356094 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1322/2662] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:04:16.380514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01d7cb-94f6-494b-9aa7-6c6cc25d89e2 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:16.400620 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01d7cb-94f6-494b-9aa7-6c6cc25d89e2 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:16.413681 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c29a01-8e9b-47ea-8430-fdd911b1ada8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:16.414483 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c29a01-8e9b-47ea-8430-fdd911b1ada8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:16.414629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c29a01-8e9b-47ea-8430-fdd911b1ada8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:16.414897 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c29a01-8e9b-47ea-8430-fdd911b1ada8 admin admin] PATH_INFO: `/v3/projects/605cab8e14f241138f014cba05310e6e/users/ac093602dbfc47a987194f34b3a228b0/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:16.468769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c29a01-8e9b-47ea-8430-fdd911b1ada8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=605cab8e14f241138f014cba05310e6e, user_id=ac093602dbfc47a987194f34b3a228b0, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:16.471741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c29a01-8e9b-47ea-8430-fdd911b1ada8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:16.505219 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1341/2663] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:04:16 2022] PUT /identity/v3/projects/605cab8e14f241138f014cba05310e6e/users/ac093602dbfc47a987194f34b3a228b0/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:04:16.514136 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107acf8-2e0a-4770-814e-1d3c1bca5ce5 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:16.514377 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107acf8-2e0a-4770-814e-1d3c1bca5ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:16.514664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107acf8-2e0a-4770-814e-1d3c1bca5ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:16.546008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c107acf8-2e0a-4770-814e-1d3c1bca5ce5 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:04:16.548371 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c107acf8-2e0a-4770-814e-1d3c1bca5ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:16.680352 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1323/2664] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:04:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:04:16.688015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c29a01-8e9b-47ea-8430-fdd911b1ada8 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:16.690261 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d8c29a01-8e9b-47ea-8430-fdd911b1ada8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:16.802260 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c29a01-8e9b-47ea-8430-fdd911b1ada8 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:16.807813 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ae8c5-223a-477f-a949-c5d7a27a9f6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:16.808722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ae8c5-223a-477f-a949-c5d7a27a9f6f service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:16.809162 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ae8c5-223a-477f-a949-c5d7a27a9f6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:16.809636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ae8c5-223a-477f-a949-c5d7a27a9f6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:16.824274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ae8c5-223a-477f-a949-c5d7a27a9f6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:16.826020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ae8c5-223a-477f-a949-c5d7a27a9f6f service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:16.851085 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1342/2665] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:04:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:04:18.409930 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104a2df-b728-491b-bf84-14f055e7ee52 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:18.410735 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104a2df-b728-491b-bf84-14f055e7ee52 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:18.411160 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104a2df-b728-491b-bf84-14f055e7ee52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:18.471651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-4104a2df-b728-491b-bf84-14f055e7ee52 None None] MFA Rules not processed for user `591ba527f17e4ce9bb8536b621d61e85`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:04:18.473237 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4104a2df-b728-491b-bf84-14f055e7ee52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:18.648858 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1324/2666] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:04:18 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:04:18.657556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ae8c5-223a-477f-a949-c5d7a27a9f6f service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:18.659536 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b24ae8c5-223a-477f-a949-c5d7a27a9f6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:18.890262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ae8c5-223a-477f-a949-c5d7a27a9f6f service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:18.898145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9f8ac-7a8e-4859-940c-3b0da0cf51db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:18.900330 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9f8ac-7a8e-4859-940c-3b0da0cf51db service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:18.900665 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9f8ac-7a8e-4859-940c-3b0da0cf51db service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:18.900952 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9f8ac-7a8e-4859-940c-3b0da0cf51db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:18.906920 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:04:18.914410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f9f8ac-7a8e-4859-940c-3b0da0cf51db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:18.916927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f9f8ac-7a8e-4859-940c-3b0da0cf51db service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:18.945987 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1343/2667] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:04:18 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:04:28.627548 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=78,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:04:28.934339 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:04:29.027466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7ddf6-9450-418f-afe7-5559821ab251 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:29.028008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7ddf6-9450-418f-afe7-5559821ab251 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:29.028703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7ddf6-9450-418f-afe7-5559821ab251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:29.159067 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-60b7ddf6-9450-418f-afe7-5559821ab251 None None] MFA Rules not processed for user `ac093602dbfc47a987194f34b3a228b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:04:29.169581 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-60b7ddf6-9450-418f-afe7-5559821ab251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:29.445080 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1325/2668] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:04:29 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:04:29.488977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9f8ac-7a8e-4859-940c-3b0da0cf51db service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:29.490848 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-00f9f8ac-7a8e-4859-940c-3b0da0cf51db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:29.533733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9f8ac-7a8e-4859-940c-3b0da0cf51db service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:29.566810 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382052a-6cb2-4115-a65a-0e144b1fee24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:29.567751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382052a-6cb2-4115-a65a-0e144b1fee24 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:29.568213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382052a-6cb2-4115-a65a-0e144b1fee24 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:29.568752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382052a-6cb2-4115-a65a-0e144b1fee24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:29.596030 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4382052a-6cb2-4115-a65a-0e144b1fee24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:29.597777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4382052a-6cb2-4115-a65a-0e144b1fee24 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:29.632097 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1344/2669] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:04:29 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:04:31.170790 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249e6fd-fe4b-4020-9d33-5453ba26529c None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:31.171357 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249e6fd-fe4b-4020-9d33-5453ba26529c None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:31.171478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249e6fd-fe4b-4020-9d33-5453ba26529c None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:31.172880 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1326/2670] 10.222.0.30 () {54 vars in 921 bytes} [Sun Sep 4 01:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:04:31.242744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185d7af-5a99-4908-838a-e0f86679c738 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:31.244586 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185d7af-5a99-4908-838a-e0f86679c738 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:31.245147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185d7af-5a99-4908-838a-e0f86679c738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:31.344446 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-3185d7af-5a99-4908-838a-e0f86679c738 None None] MFA Rules not processed for user `f908fda75ef8440cb6a0ef9440127d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:04:31.354898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249e6fd-fe4b-4020-9d33-5453ba26529c None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:31.361290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3185d7af-5a99-4908-838a-e0f86679c738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:31.365239 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d249e6fd-fe4b-4020-9d33-5453ba26529c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:31.385370 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249e6fd-fe4b-4020-9d33-5453ba26529c None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:31.391696 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2bb3e2-8cf7-44d6-8b78-8850b17de937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:31.393076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2bb3e2-8cf7-44d6-8b78-8850b17de937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:31.393728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2bb3e2-8cf7-44d6-8b78-8850b17de937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:31.394194 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2bb3e2-8cf7-44d6-8b78-8850b17de937 admin admin] PATH_INFO: `/v3/users/591ba527f17e4ce9bb8536b621d61e85` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:31.395594 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2bb3e2-8cf7-44d6-8b78-8850b17de937 admin admin] RBAC: Authorizing `identity:delete_user(user_id=591ba527f17e4ce9bb8536b621d61e85)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:31.398069 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2bb3e2-8cf7-44d6-8b78-8850b17de937 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:31.486953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ce2bb3e2-8cf7-44d6-8b78-8850b17de937 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '591ba527f17e4ce9bb8536b621d61e85'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:31.488146 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ce2bb3e2-8cf7-44d6-8b78-8850b17de937 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '591ba527f17e4ce9bb8536b621d61e85'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:31.501068 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ce2bb3e2-8cf7-44d6-8b78-8850b17de937 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '591ba527f17e4ce9bb8536b621d61e85'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:31.516045 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1345/2671] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Sep 4 01:04:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:04:31.527778 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ce2bb3e2-8cf7-44d6-8b78-8850b17de937 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '591ba527f17e4ce9bb8536b621d61e85'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:31.528789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ce2bb3e2-8cf7-44d6-8b78-8850b17de937 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '591ba527f17e4ce9bb8536b621d61e85'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:31.532854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185d7af-5a99-4908-838a-e0f86679c738 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:31.537325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3185d7af-5a99-4908-838a-e0f86679c738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:31.559996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185d7af-5a99-4908-838a-e0f86679c738 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:31.574616 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1327/2672] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:04:31 2022] DELETE /identity/v3/users/591ba527f17e4ce9bb8536b621d61e85 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:04:31.592180 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd0491-7f2e-4687-89c7-884e411e8719 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:31.593112 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd0491-7f2e-4687-89c7-884e411e8719 service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:31.593578 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd0491-7f2e-4687-89c7-884e411e8719 service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:31.594027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd0491-7f2e-4687-89c7-884e411e8719 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:31.613213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd0491-7f2e-4687-89c7-884e411e8719 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:31.621108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd0491-7f2e-4687-89c7-884e411e8719 service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:31.650485 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1346/2673] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:04:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:04:32.054209 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2bb3e2-8cf7-44d6-8b78-8850b17de937 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:32.055675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ce2bb3e2-8cf7-44d6-8b78-8850b17de937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:32.212967 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2bb3e2-8cf7-44d6-8b78-8850b17de937 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:32.224315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c1fc4-48f6-40c6-a096-9f3103b748fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:32.225839 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c1fc4-48f6-40c6-a096-9f3103b748fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:32.226416 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c1fc4-48f6-40c6-a096-9f3103b748fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:32.230868 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c1fc4-48f6-40c6-a096-9f3103b748fe admin admin] PATH_INFO: `/v3/projects/64ac2e98dc8e4e758d3f2a47b91f766e` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:32.233256 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c1fc4-48f6-40c6-a096-9f3103b748fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=64ac2e98dc8e4e758d3f2a47b91f766e)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:32.236784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c1fc4-48f6-40c6-a096-9f3103b748fe admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:32.241042 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:04:32.334641 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e09c1fc4-48f6-40c6-a096-9f3103b748fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64ac2e98dc8e4e758d3f2a47b91f766e', 'request_id': 'req-e09c1fc4-48f6-40c6-a096-9f3103b748fe'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:32.358535 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e09c1fc4-48f6-40c6-a096-9f3103b748fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64ac2e98dc8e4e758d3f2a47b91f766e', 'request_id': 'req-e09c1fc4-48f6-40c6-a096-9f3103b748fe'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:32.368054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e09c1fc4-48f6-40c6-a096-9f3103b748fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64ac2e98dc8e4e758d3f2a47b91f766e', 'request_id': 'req-e09c1fc4-48f6-40c6-a096-9f3103b748fe'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:32.396996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e09c1fc4-48f6-40c6-a096-9f3103b748fe admin admin] The token cache is being invalidate because project 64ac2e98dc8e4e758d3f2a47b91f766e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:04:32.397206 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e09c1fc4-48f6-40c6-a096-9f3103b748fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:32.397970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e09c1fc4-48f6-40c6-a096-9f3103b748fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:32.401218 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1328/2674] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:04:32 2022] DELETE /identity/v3/projects/64ac2e98dc8e4e758d3f2a47b91f766e => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:04:32.408498 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7db9b7-0b1c-4166-a1ac-89cb0f8ee756 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:32.409034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7db9b7-0b1c-4166-a1ac-89cb0f8ee756 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:32.409034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7db9b7-0b1c-4166-a1ac-89cb0f8ee756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:32.494787 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-6d7db9b7-0b1c-4166-a1ac-89cb0f8ee756 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:04:32.496592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6d7db9b7-0b1c-4166-a1ac-89cb0f8ee756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:32.636873 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1347/2675] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:04:32.644803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe0bff-ddc1-448b-a5cb-867a541c6997 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:32.645086 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe0bff-ddc1-448b-a5cb-867a541c6997 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:32.645578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe0bff-ddc1-448b-a5cb-867a541c6997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:32.692106 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-7dfe0bff-ddc1-448b-a5cb-867a541c6997 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:04:32.694591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7dfe0bff-ddc1-448b-a5cb-867a541c6997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:32.718814 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1329/2676] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:04:32.721473 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7db9b7-0b1c-4166-a1ac-89cb0f8ee756 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:32.740271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7db9b7-0b1c-4166-a1ac-89cb0f8ee756 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:32.757089 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc80818-79a2-4fb8-a770-9638231252a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:32.757751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc80818-79a2-4fb8-a770-9638231252a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:32.758027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc80818-79a2-4fb8-a770-9638231252a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:32.758293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc80818-79a2-4fb8-a770-9638231252a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:32.758946 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc80818-79a2-4fb8-a770-9638231252a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:04:32.759803 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc80818-79a2-4fb8-a770-9638231252a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:32.762206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc80818-79a2-4fb8-a770-9638231252a4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:32.782757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe0bff-ddc1-448b-a5cb-867a541c6997 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:32.793682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe0bff-ddc1-448b-a5cb-867a541c6997 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:32.794285 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1348/2677] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:04:32.800156 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3705f-ce9f-419a-9c1b-239efcf18e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:32.800955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3705f-ce9f-419a-9c1b-239efcf18e06 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:32.801420 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3705f-ce9f-419a-9c1b-239efcf18e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:32.801875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3705f-ce9f-419a-9c1b-239efcf18e06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:32.802655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3705f-ce9f-419a-9c1b-239efcf18e06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:32.804722 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3705f-ce9f-419a-9c1b-239efcf18e06 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:32.855117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc80818-79a2-4fb8-a770-9638231252a4 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:32.862793 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1330/2678] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:04:32 2022] POST /identity/v3/projects => generated 361 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:04:32.867333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc80818-79a2-4fb8-a770-9638231252a4 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:32.957653 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:04:32.968144 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101b894-94e9-4dc6-acf7-dd223b037e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:32.979508 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101b894-94e9-4dc6-acf7-dd223b037e85 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:32.980757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101b894-94e9-4dc6-acf7-dd223b037e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:32.981053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101b894-94e9-4dc6-acf7-dd223b037e85 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:32.981777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101b894-94e9-4dc6-acf7-dd223b037e85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:32.986411 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101b894-94e9-4dc6-acf7-dd223b037e85 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:33.053403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3705f-ce9f-419a-9c1b-239efcf18e06 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:33.054928 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1349/2679] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:04:32 2022] POST /identity/v3/users => generated 281 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:04:33.071240 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3705f-ce9f-419a-9c1b-239efcf18e06 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:33.116064 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0340094-24d0-456b-8d7c-6fc69d9e6a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:33.116704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0340094-24d0-456b-8d7c-6fc69d9e6a0d admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:33.116980 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0340094-24d0-456b-8d7c-6fc69d9e6a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:33.117238 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0340094-24d0-456b-8d7c-6fc69d9e6a0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:33.117936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0340094-24d0-456b-8d7c-6fc69d9e6a0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:33.120239 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0340094-24d0-456b-8d7c-6fc69d9e6a0d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:33.173338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101b894-94e9-4dc6-acf7-dd223b037e85 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:33.173838 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1331/2680] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:04:33.197301 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101b894-94e9-4dc6-acf7-dd223b037e85 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:33.236881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71311e78-1057-48fc-8532-4736df7e89e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:33.237466 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71311e78-1057-48fc-8532-4736df7e89e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:33.237765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71311e78-1057-48fc-8532-4736df7e89e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:33.238041 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71311e78-1057-48fc-8532-4736df7e89e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:33.238699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71311e78-1057-48fc-8532-4736df7e89e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:33.240322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71311e78-1057-48fc-8532-4736df7e89e2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:33.302221 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0340094-24d0-456b-8d7c-6fc69d9e6a0d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:33.309889 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1350/2681] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:04:33.320378 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0340094-24d0-456b-8d7c-6fc69d9e6a0d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:33.328690 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253cac30-78fc-46f4-9312-0af965d804a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:33.329655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253cac30-78fc-46f4-9312-0af965d804a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:33.330094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253cac30-78fc-46f4-9312-0af965d804a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:33.330540 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253cac30-78fc-46f4-9312-0af965d804a0 admin admin] PATH_INFO: `/v3/projects/a442682e63ce4a2fa653ce47b6834703/users/44a94f71c38d451b8e88dd7d27c516a7/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:33.369481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253cac30-78fc-46f4-9312-0af965d804a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a442682e63ce4a2fa653ce47b6834703, user_id=44a94f71c38d451b8e88dd7d27c516a7, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:33.372654 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253cac30-78fc-46f4-9312-0af965d804a0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:33.417709 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1332/2682] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:04:33 2022] PUT /identity/v3/projects/a442682e63ce4a2fa653ce47b6834703/users/44a94f71c38d451b8e88dd7d27c516a7/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:04:33.496570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f196f44-2544-4250-a3bf-f0252d56cd23 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:33.500378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f196f44-2544-4250-a3bf-f0252d56cd23 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:33.500976 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f196f44-2544-4250-a3bf-f0252d56cd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:33.576533 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-4f196f44-2544-4250-a3bf-f0252d56cd23 None None] MFA Rules not processed for user `44a94f71c38d451b8e88dd7d27c516a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:04:33.577815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4f196f44-2544-4250-a3bf-f0252d56cd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:33.751803 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1351/2683] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:04:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:04:34.197394 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253cac30-78fc-46f4-9312-0af965d804a0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:34.199532 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-253cac30-78fc-46f4-9312-0af965d804a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:34.338484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253cac30-78fc-46f4-9312-0af965d804a0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:34.372488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d2654-5141-4e5c-9731-70056bf326e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:34.373141 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d2654-5141-4e5c-9731-70056bf326e0 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:34.373541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d2654-5141-4e5c-9731-70056bf326e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:34.373799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d2654-5141-4e5c-9731-70056bf326e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:34.384962 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d2654-5141-4e5c-9731-70056bf326e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:34.386806 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d2654-5141-4e5c-9731-70056bf326e0 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:34.410548 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1333/2684] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:04:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:04:34.454756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f196f44-2544-4250-a3bf-f0252d56cd23 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:34.647809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f196f44-2544-4250-a3bf-f0252d56cd23 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:34.663088 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb0184-c17f-46c0-9183-e040a4da3c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:34.663949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb0184-c17f-46c0-9183-e040a4da3c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:34.664384 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb0184-c17f-46c0-9183-e040a4da3c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:34.664844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb0184-c17f-46c0-9183-e040a4da3c8e admin admin] PATH_INFO: `/v3/users/44a94f71c38d451b8e88dd7d27c516a7` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:34.675448 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb0184-c17f-46c0-9183-e040a4da3c8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=44a94f71c38d451b8e88dd7d27c516a7)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:34.679814 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb0184-c17f-46c0-9183-e040a4da3c8e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:34.839717 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d1cb0184-c17f-46c0-9183-e040a4da3c8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44a94f71c38d451b8e88dd7d27c516a7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:34.841392 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d1cb0184-c17f-46c0-9183-e040a4da3c8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44a94f71c38d451b8e88dd7d27c516a7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:34.877272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d1cb0184-c17f-46c0-9183-e040a4da3c8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44a94f71c38d451b8e88dd7d27c516a7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:34.919043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d1cb0184-c17f-46c0-9183-e040a4da3c8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44a94f71c38d451b8e88dd7d27c516a7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:34.922691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d1cb0184-c17f-46c0-9183-e040a4da3c8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44a94f71c38d451b8e88dd7d27c516a7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:34.933189 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:04:34.960789 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1352/2685] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:04:34 2022] DELETE /identity/v3/users/44a94f71c38d451b8e88dd7d27c516a7 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:04:34.965706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c7cb8-de1d-4985-9e8e-5b552b27bef1 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:34.965995 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c7cb8-de1d-4985-9e8e-5b552b27bef1 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:34.966270 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c7cb8-de1d-4985-9e8e-5b552b27bef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:35.012383 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-3f2c7cb8-de1d-4985-9e8e-5b552b27bef1 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:04:35.015455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3f2c7cb8-de1d-4985-9e8e-5b552b27bef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:35.033235 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:04:35.138076 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1334/2686] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:04:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:04:35.152726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb0184-c17f-46c0-9183-e040a4da3c8e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:35.161736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d1cb0184-c17f-46c0-9183-e040a4da3c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:35.308011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0c9e4-8af5-4148-8420-2693d6131d4b None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:35.308576 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0c9e4-8af5-4148-8420-2693d6131d4b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:35.309001 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0c9e4-8af5-4148-8420-2693d6131d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:35.356243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d0f0c9e4-8af5-4148-8420-2693d6131d4b None None] MFA Rules not processed for user `e17afcbd7fd346b884e55a7a587343ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:04:35.358884 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d0f0c9e4-8af5-4148-8420-2693d6131d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:35.458058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb0184-c17f-46c0-9183-e040a4da3c8e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:35.476649 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582f43c-a133-4859-9e0b-358f32b42048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:35.483251 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582f43c-a133-4859-9e0b-358f32b42048 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:35.483251 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582f43c-a133-4859-9e0b-358f32b42048 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:35.483251 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582f43c-a133-4859-9e0b-358f32b42048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:35.519673 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0582f43c-a133-4859-9e0b-358f32b42048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:35.521133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0582f43c-a133-4859-9e0b-358f32b42048 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:35.547688 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1353/2687] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:04:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:04:35.580749 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1335/2688] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:04:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:04:37.164170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582f43c-a133-4859-9e0b-358f32b42048 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:37.167379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0582f43c-a133-4859-9e0b-358f32b42048 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:37.191386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582f43c-a133-4859-9e0b-358f32b42048 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:37.204856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3d0cd-5e83-44ee-9c53-b8960afedb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:37.205911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3d0cd-5e83-44ee-9c53-b8960afedb55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:37.206414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3d0cd-5e83-44ee-9c53-b8960afedb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:37.207563 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3d0cd-5e83-44ee-9c53-b8960afedb55 admin admin] PATH_INFO: `/v3/projects/a442682e63ce4a2fa653ce47b6834703` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:37.208747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3d0cd-5e83-44ee-9c53-b8960afedb55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a442682e63ce4a2fa653ce47b6834703)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:37.210720 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3d0cd-5e83-44ee-9c53-b8960afedb55 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:37.280080 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c0f3d0cd-5e83-44ee-9c53-b8960afedb55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a442682e63ce4a2fa653ce47b6834703', 'request_id': 'req-c0f3d0cd-5e83-44ee-9c53-b8960afedb55'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:37.296903 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c0f3d0cd-5e83-44ee-9c53-b8960afedb55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a442682e63ce4a2fa653ce47b6834703', 'request_id': 'req-c0f3d0cd-5e83-44ee-9c53-b8960afedb55'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:37.303442 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c0f3d0cd-5e83-44ee-9c53-b8960afedb55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a442682e63ce4a2fa653ce47b6834703', 'request_id': 'req-c0f3d0cd-5e83-44ee-9c53-b8960afedb55'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:37.315138 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c0f3d0cd-5e83-44ee-9c53-b8960afedb55 admin admin] The token cache is being invalidate because project a442682e63ce4a2fa653ce47b6834703 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:04:37.315437 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c0f3d0cd-5e83-44ee-9c53-b8960afedb55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:37.316479 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c0f3d0cd-5e83-44ee-9c53-b8960afedb55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:37.318285 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1354/2689] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:04:37 2022] DELETE /identity/v3/projects/a442682e63ce4a2fa653ce47b6834703 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:04:37.323596 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c904ab-8a60-48e8-99ba-aa3849c58fc0 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:37.324134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c904ab-8a60-48e8-99ba-aa3849c58fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:37.324250 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c904ab-8a60-48e8-99ba-aa3849c58fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:37.349818 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-87c904ab-8a60-48e8-99ba-aa3849c58fc0 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:04:37.351058 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-87c904ab-8a60-48e8-99ba-aa3849c58fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:37.434968 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1336/2690] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:04:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:04:37.436842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e272e-35ac-4b46-8d81-d777636a0621 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:37.437189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e272e-35ac-4b46-8d81-d777636a0621 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:37.437421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e272e-35ac-4b46-8d81-d777636a0621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:37.470049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-5f4e272e-35ac-4b46-8d81-d777636a0621 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:04:37.471965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5f4e272e-35ac-4b46-8d81-d777636a0621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:37.483356 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1355/2691] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:04:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:04:37.487958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c904ab-8a60-48e8-99ba-aa3849c58fc0 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:37.499201 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c904ab-8a60-48e8-99ba-aa3849c58fc0 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:37.504684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2082cd6-f9a4-440e-bf5c-ea90905135cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:37.505969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2082cd6-f9a4-440e-bf5c-ea90905135cb admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:37.506451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2082cd6-f9a4-440e-bf5c-ea90905135cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:37.506923 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2082cd6-f9a4-440e-bf5c-ea90905135cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:37.508129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2082cd6-f9a4-440e-bf5c-ea90905135cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:04:37.508694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2082cd6-f9a4-440e-bf5c-ea90905135cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:37.513372 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2082cd6-f9a4-440e-bf5c-ea90905135cb admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:37.538788 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1337/2692] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:04:37.544056 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e272e-35ac-4b46-8d81-d777636a0621 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:37.555295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e272e-35ac-4b46-8d81-d777636a0621 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:37.563642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98560d-8790-4e4f-8126-fd96278087eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:37.564258 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98560d-8790-4e4f-8126-fd96278087eb admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:37.564537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98560d-8790-4e4f-8126-fd96278087eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:37.564927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98560d-8790-4e4f-8126-fd96278087eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:37.565620 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98560d-8790-4e4f-8126-fd96278087eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:37.567732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98560d-8790-4e4f-8126-fd96278087eb admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:37.601991 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1356/2693] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:04:37 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:04:37.606377 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2082cd6-f9a4-440e-bf5c-ea90905135cb admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:37.618024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2082cd6-f9a4-440e-bf5c-ea90905135cb admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:37.670978 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:04:37.684960 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd666277-502b-48f1-bb73-e4300a7590f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:37.685636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd666277-502b-48f1-bb73-e4300a7590f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:37.685911 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd666277-502b-48f1-bb73-e4300a7590f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:37.686179 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd666277-502b-48f1-bb73-e4300a7590f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:37.686839 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd666277-502b-48f1-bb73-e4300a7590f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:37.688777 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd666277-502b-48f1-bb73-e4300a7590f4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:37.718574 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1338/2694] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:04:37 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:04:37.723016 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98560d-8790-4e4f-8126-fd96278087eb admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:37.735048 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98560d-8790-4e4f-8126-fd96278087eb admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:37.743097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd8f94-06ec-4379-a55e-afafbdb47efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:37.743354 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd8f94-06ec-4379-a55e-afafbdb47efc admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:37.743564 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd8f94-06ec-4379-a55e-afafbdb47efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:37.743823 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd8f94-06ec-4379-a55e-afafbdb47efc admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:37.744452 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd8f94-06ec-4379-a55e-afafbdb47efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:37.746235 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd8f94-06ec-4379-a55e-afafbdb47efc admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:37.784733 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1357/2695] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:04:37.794811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd666277-502b-48f1-bb73-e4300a7590f4 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:37.823139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd666277-502b-48f1-bb73-e4300a7590f4 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:37.836936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9c265-58dc-48ff-a6b1-caca7924e44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:37.838205 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9c265-58dc-48ff-a6b1-caca7924e44f admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:37.838697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9c265-58dc-48ff-a6b1-caca7924e44f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:37.839210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9c265-58dc-48ff-a6b1-caca7924e44f admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:37.840068 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9c265-58dc-48ff-a6b1-caca7924e44f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:37.844339 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9c265-58dc-48ff-a6b1-caca7924e44f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:37.875861 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1339/2696] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:04:37.877131 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd8f94-06ec-4379-a55e-afafbdb47efc admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:37.889965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd8f94-06ec-4379-a55e-afafbdb47efc admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:37.896482 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780abcb3-4a91-4556-a094-5a3c3ed51802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:37.897373 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780abcb3-4a91-4556-a094-5a3c3ed51802 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:37.897689 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780abcb3-4a91-4556-a094-5a3c3ed51802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:37.897964 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780abcb3-4a91-4556-a094-5a3c3ed51802 admin admin] PATH_INFO: `/v3/projects/582ce97ed6c44762ad5962c259e34437/users/cd793e15c7d44ed7bc1fff15d57297c7/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:37.924738 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780abcb3-4a91-4556-a094-5a3c3ed51802 admin admin] RBAC: Authorizing `identity:create_grant(project_id=582ce97ed6c44762ad5962c259e34437, user_id=cd793e15c7d44ed7bc1fff15d57297c7, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:37.927771 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780abcb3-4a91-4556-a094-5a3c3ed51802 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:37.959539 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1358/2697] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:04:37 2022] PUT /identity/v3/projects/582ce97ed6c44762ad5962c259e34437/users/cd793e15c7d44ed7bc1fff15d57297c7/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:04:37.964677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29845200-72b8-4048-9d92-fce1012ba064 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:37.965257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29845200-72b8-4048-9d92-fce1012ba064 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:37.965768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29845200-72b8-4048-9d92-fce1012ba064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:38.008246 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-29845200-72b8-4048-9d92-fce1012ba064 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:04:38.010353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-29845200-72b8-4048-9d92-fce1012ba064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:38.165013 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1340/2698] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:04:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:04:38.171668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780abcb3-4a91-4556-a094-5a3c3ed51802 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:38.174092 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-780abcb3-4a91-4556-a094-5a3c3ed51802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:38.207181 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:04:38.366983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780abcb3-4a91-4556-a094-5a3c3ed51802 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:38.377271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4342709-a01b-4f23-81ee-0303fca02db2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:38.378642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4342709-a01b-4f23-81ee-0303fca02db2 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:38.379100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4342709-a01b-4f23-81ee-0303fca02db2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:38.380339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4342709-a01b-4f23-81ee-0303fca02db2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:38.394845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4342709-a01b-4f23-81ee-0303fca02db2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:38.396858 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4342709-a01b-4f23-81ee-0303fca02db2 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:38.414690 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1359/2699] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:04:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:04:38.654036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1cd90-6b16-40ec-a090-ff46a4491acb None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:38.654580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1cd90-6b16-40ec-a090-ff46a4491acb None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:38.654690 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1cd90-6b16-40ec-a090-ff46a4491acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:38.712789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-4ef1cd90-6b16-40ec-a090-ff46a4491acb None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:04:38.714938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4ef1cd90-6b16-40ec-a090-ff46a4491acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:38.883805 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1341/2700] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 01:04:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:04:38.898696 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4342709-a01b-4f23-81ee-0303fca02db2 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:38.902349 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e4342709-a01b-4f23-81ee-0303fca02db2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:39.177045 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4342709-a01b-4f23-81ee-0303fca02db2 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:39.199184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc4207-7ccb-46cd-8ce4-eb95e43b94d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:39.200207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc4207-7ccb-46cd-8ce4-eb95e43b94d0 service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:39.200652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc4207-7ccb-46cd-8ce4-eb95e43b94d0 service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:39.201121 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc4207-7ccb-46cd-8ce4-eb95e43b94d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:39.212764 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc4207-7ccb-46cd-8ce4-eb95e43b94d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:39.219233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc4207-7ccb-46cd-8ce4-eb95e43b94d0 service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:39.244757 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1360/2701] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:04:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:04:40.300660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aca094-0996-411c-9112-6f9bac7a7a0c None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:40.301106 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aca094-0996-411c-9112-6f9bac7a7a0c None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:40.301204 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aca094-0996-411c-9112-6f9bac7a7a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:40.339709 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-10aca094-0996-411c-9112-6f9bac7a7a0c None None] MFA Rules not processed for user `545e0ebcbe314ee1a8419e3583e74d23`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:04:40.342840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-10aca094-0996-411c-9112-6f9bac7a7a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:40.476389 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1342/2702] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:04:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:04:45.458881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e778b9c-103e-4f01-8bf3-796a4457dc7a None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:45.459372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e778b9c-103e-4f01-8bf3-796a4457dc7a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:45.459490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e778b9c-103e-4f01-8bf3-796a4457dc7a None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:45.461467 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1361/2703] 10.222.0.30 () {54 vars in 921 bytes} [Sun Sep 4 01:04:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:04:45.469905 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bd94d-518e-4ddf-b16c-ee558201d7b3 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:45.471196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bd94d-518e-4ddf-b16c-ee558201d7b3 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:45.471791 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bd94d-518e-4ddf-b16c-ee558201d7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:45.498502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-9d0bd94d-518e-4ddf-b16c-ee558201d7b3 None None] MFA Rules not processed for user `13f0f341bf2c475d82b4e7b34d503dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:04:45.500819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9d0bd94d-518e-4ddf-b16c-ee558201d7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:45.516503 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:04:45.659437 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1343/2704] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Sep 4 01:04:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:04:45.697217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e778b9c-103e-4f01-8bf3-796a4457dc7a None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:45.699075 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2e778b9c-103e-4f01-8bf3-796a4457dc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:45.720924 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e778b9c-103e-4f01-8bf3-796a4457dc7a None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:45.733335 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb485c5b-cceb-4c84-b3cc-a7650ebf279b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:45.734017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb485c5b-cceb-4c84-b3cc-a7650ebf279b service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:45.734333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb485c5b-cceb-4c84-b3cc-a7650ebf279b service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:45.734593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb485c5b-cceb-4c84-b3cc-a7650ebf279b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:45.746432 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb485c5b-cceb-4c84-b3cc-a7650ebf279b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:45.747920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb485c5b-cceb-4c84-b3cc-a7650ebf279b service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:45.760665 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1362/2705] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:04:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:04:46.223288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0bd94d-518e-4ddf-b16c-ee558201d7b3 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:46.226739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9d0bd94d-518e-4ddf-b16c-ee558201d7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:46.252680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0bd94d-518e-4ddf-b16c-ee558201d7b3 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:46.272739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6480c-3ad4-4510-ae1a-5b6f6c2210b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:46.274874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6480c-3ad4-4510-ae1a-5b6f6c2210b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:46.275279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6480c-3ad4-4510-ae1a-5b6f6c2210b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:46.275731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6480c-3ad4-4510-ae1a-5b6f6c2210b8 admin admin] PATH_INFO: `/v3/users/ac093602dbfc47a987194f34b3a228b0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:46.277428 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c6480c-3ad4-4510-ae1a-5b6f6c2210b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac093602dbfc47a987194f34b3a228b0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:46.279630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c6480c-3ad4-4510-ae1a-5b6f6c2210b8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:46.421756 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c2c6480c-3ad4-4510-ae1a-5b6f6c2210b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac093602dbfc47a987194f34b3a228b0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:46.423096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c2c6480c-3ad4-4510-ae1a-5b6f6c2210b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac093602dbfc47a987194f34b3a228b0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:46.435922 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c2c6480c-3ad4-4510-ae1a-5b6f6c2210b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac093602dbfc47a987194f34b3a228b0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:46.458713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c2c6480c-3ad4-4510-ae1a-5b6f6c2210b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac093602dbfc47a987194f34b3a228b0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:46.459274 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c2c6480c-3ad4-4510-ae1a-5b6f6c2210b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac093602dbfc47a987194f34b3a228b0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:46.488530 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1344/2706] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:04:46 2022] DELETE /identity/v3/users/ac093602dbfc47a987194f34b3a228b0 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:04:46.953590 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb485c5b-cceb-4c84-b3cc-a7650ebf279b service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:46.968525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb485c5b-cceb-4c84-b3cc-a7650ebf279b service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:47.095334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132157d-3a39-4ec1-b96f-9b1c4cf42424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:47.096102 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132157d-3a39-4ec1-b96f-9b1c4cf42424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:47.096470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132157d-3a39-4ec1-b96f-9b1c4cf42424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:47.096823 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132157d-3a39-4ec1-b96f-9b1c4cf42424 admin admin] PATH_INFO: `/v3/projects/605cab8e14f241138f014cba05310e6e` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:47.098722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132157d-3a39-4ec1-b96f-9b1c4cf42424 admin admin] RBAC: Authorizing `identity:delete_project(project_id=605cab8e14f241138f014cba05310e6e)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:47.100769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132157d-3a39-4ec1-b96f-9b1c4cf42424 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:47.178190 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:04:47.204683 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4132157d-3a39-4ec1-b96f-9b1c4cf42424 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '605cab8e14f241138f014cba05310e6e', 'request_id': 'req-4132157d-3a39-4ec1-b96f-9b1c4cf42424'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:47.230691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4132157d-3a39-4ec1-b96f-9b1c4cf42424 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '605cab8e14f241138f014cba05310e6e', 'request_id': 'req-4132157d-3a39-4ec1-b96f-9b1c4cf42424'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:47.241330 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4132157d-3a39-4ec1-b96f-9b1c4cf42424 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '605cab8e14f241138f014cba05310e6e', 'request_id': 'req-4132157d-3a39-4ec1-b96f-9b1c4cf42424'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:47.264405 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4132157d-3a39-4ec1-b96f-9b1c4cf42424 admin admin] The token cache is being invalidate because project 605cab8e14f241138f014cba05310e6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:04:47.265341 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4132157d-3a39-4ec1-b96f-9b1c4cf42424 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:47.266303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4132157d-3a39-4ec1-b96f-9b1c4cf42424 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:04:47.269634 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1363/2707] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:04:46 2022] DELETE /identity/v3/projects/605cab8e14f241138f014cba05310e6e => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:04:47.275688 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af1944-e631-4477-8ba5-72cc8633ba9a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:47.275979 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af1944-e631-4477-8ba5-72cc8633ba9a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:47.276259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af1944-e631-4477-8ba5-72cc8633ba9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:47.326560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-21af1944-e631-4477-8ba5-72cc8633ba9a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:04:47.334675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-21af1944-e631-4477-8ba5-72cc8633ba9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:47.489207 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1345/2708] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:04:47.498677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8a6e4-ffe5-4ad4-b83e-e07d789d89d8 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:47.499268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8a6e4-ffe5-4ad4-b83e-e07d789d89d8 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:47.499764 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8a6e4-ffe5-4ad4-b83e-e07d789d89d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:47.562033 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-aac8a6e4-ffe5-4ad4-b83e-e07d789d89d8 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:04:47.565110 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-aac8a6e4-ffe5-4ad4-b83e-e07d789d89d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:47.588320 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1364/2709] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:04:47.590221 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af1944-e631-4477-8ba5-72cc8633ba9a None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:47.610655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af1944-e631-4477-8ba5-72cc8633ba9a None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:47.623195 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2eb2ee-2c95-49c1-8173-01dd0ebe3eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:47.623873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2eb2ee-2c95-49c1-8173-01dd0ebe3eee admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:47.624159 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2eb2ee-2c95-49c1-8173-01dd0ebe3eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:47.624457 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2eb2ee-2c95-49c1-8173-01dd0ebe3eee admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:47.625152 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2eb2ee-2c95-49c1-8173-01dd0ebe3eee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:04:47.625478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2eb2ee-2c95-49c1-8173-01dd0ebe3eee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:47.627466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2eb2ee-2c95-49c1-8173-01dd0ebe3eee admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:47.671785 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8a6e4-ffe5-4ad4-b83e-e07d789d89d8 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:47.673426 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1346/2710] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:04:47.690214 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8a6e4-ffe5-4ad4-b83e-e07d789d89d8 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:47.699207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f544c7-e4c2-4813-963e-cf82cabc03f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:47.700051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f544c7-e4c2-4813-963e-cf82cabc03f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:47.700492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f544c7-e4c2-4813-963e-cf82cabc03f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:47.700913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f544c7-e4c2-4813-963e-cf82cabc03f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:47.701998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f544c7-e4c2-4813-963e-cf82cabc03f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:47.704413 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f544c7-e4c2-4813-963e-cf82cabc03f5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:47.748220 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1365/2711] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:04:47 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:04:47.753069 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2eb2ee-2c95-49c1-8173-01dd0ebe3eee admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:47.769655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2eb2ee-2c95-49c1-8173-01dd0ebe3eee admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:47.780911 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:04:47.950952 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcedca-bdfa-4bf7-8894-1b0f3c6edf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:47.952037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcedca-bdfa-4bf7-8894-1b0f3c6edf62 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:47.961814 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcedca-bdfa-4bf7-8894-1b0f3c6edf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:47.962100 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcedca-bdfa-4bf7-8894-1b0f3c6edf62 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:47.966251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcedca-bdfa-4bf7-8894-1b0f3c6edf62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:47.970241 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcedca-bdfa-4bf7-8894-1b0f3c6edf62 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:48.024718 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1347/2712] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:04:47 2022] POST /identity/v3/users => generated 293 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:04:48.036021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f544c7-e4c2-4813-963e-cf82cabc03f5 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:48.052547 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f544c7-e4c2-4813-963e-cf82cabc03f5 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:48.059559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca2604-77f9-474a-8c1e-5b72f25034a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:48.060468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca2604-77f9-474a-8c1e-5b72f25034a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:48.060960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca2604-77f9-474a-8c1e-5b72f25034a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:48.061428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca2604-77f9-474a-8c1e-5b72f25034a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:48.062990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca2604-77f9-474a-8c1e-5b72f25034a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:48.065642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca2604-77f9-474a-8c1e-5b72f25034a1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:48.082049 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1366/2713] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:04:48.083094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcedca-bdfa-4bf7-8894-1b0f3c6edf62 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:48.094346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcedca-bdfa-4bf7-8894-1b0f3c6edf62 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:48.099668 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555acc3e-5646-4bae-856c-836ca666a788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:48.100554 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555acc3e-5646-4bae-856c-836ca666a788 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:48.101028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555acc3e-5646-4bae-856c-836ca666a788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:48.101529 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555acc3e-5646-4bae-856c-836ca666a788 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:48.103112 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555acc3e-5646-4bae-856c-836ca666a788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:48.104922 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555acc3e-5646-4bae-856c-836ca666a788 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:48.119517 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1348/2714] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:04:48.123767 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca2604-77f9-474a-8c1e-5b72f25034a1 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:48.136625 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca2604-77f9-474a-8c1e-5b72f25034a1 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:48.144021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be3c9c-b760-4643-8f60-fcab0c953056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:48.145808 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be3c9c-b760-4643-8f60-fcab0c953056 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:48.146868 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be3c9c-b760-4643-8f60-fcab0c953056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:48.147388 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be3c9c-b760-4643-8f60-fcab0c953056 admin admin] PATH_INFO: `/v3/projects/c22d64e1d046431aa4fbac844d97b8e2/users/067073373e894f5f9a146e6260ef793b/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:48.191010 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be3c9c-b760-4643-8f60-fcab0c953056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c22d64e1d046431aa4fbac844d97b8e2, user_id=067073373e894f5f9a146e6260ef793b, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:48.195133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be3c9c-b760-4643-8f60-fcab0c953056 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:48.211840 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1367/2715] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:04:48 2022] PUT /identity/v3/projects/c22d64e1d046431aa4fbac844d97b8e2/users/067073373e894f5f9a146e6260ef793b/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:04:48.217396 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74860cd1-b0f1-4972-b879-03d8f64ad4ab None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:48.217807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74860cd1-b0f1-4972-b879-03d8f64ad4ab None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:48.218174 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74860cd1-b0f1-4972-b879-03d8f64ad4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:48.246292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-74860cd1-b0f1-4972-b879-03d8f64ad4ab None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:04:48.247971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-74860cd1-b0f1-4972-b879-03d8f64ad4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:48.440812 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1349/2716] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:04:48.579876 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be3c9c-b760-4643-8f60-fcab0c953056 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:48.581695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-36be3c9c-b760-4643-8f60-fcab0c953056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:48.732159 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be3c9c-b760-4643-8f60-fcab0c953056 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:48.737357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f743f5-a96b-458a-96be-912099cee6bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:48.738218 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f743f5-a96b-458a-96be-912099cee6bb service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:48.738496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f743f5-a96b-458a-96be-912099cee6bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:48.738765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f743f5-a96b-458a-96be-912099cee6bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:48.761761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f743f5-a96b-458a-96be-912099cee6bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:48.763189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f743f5-a96b-458a-96be-912099cee6bb service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:48.787179 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1368/2717] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:04:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:04:55.988165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945b568-4499-4195-9a90-f6238e0858f2 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:55.988641 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945b568-4499-4195-9a90-f6238e0858f2 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:55.988739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945b568-4499-4195-9a90-f6238e0858f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:56.069082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-7945b568-4499-4195-9a90-f6238e0858f2 None None] MFA Rules not processed for user `cd793e15c7d44ed7bc1fff15d57297c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:04:56.070454 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7945b568-4499-4195-9a90-f6238e0858f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:56.349649 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1350/2718] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:04:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:04:56.375111 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f743f5-a96b-458a-96be-912099cee6bb service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:04:56.377890 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-77f743f5-a96b-458a-96be-912099cee6bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:04:56.411692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f743f5-a96b-458a-96be-912099cee6bb service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:04:56.417733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591cd99-c2a9-41a1-87cf-0e44a0a8b6dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:04:56.419215 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591cd99-c2a9-41a1-87cf-0e44a0a8b6dc service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:04:56.420127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591cd99-c2a9-41a1-87cf-0e44a0a8b6dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:04:56.420591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591cd99-c2a9-41a1-87cf-0e44a0a8b6dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:04:56.432639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591cd99-c2a9-41a1-87cf-0e44a0a8b6dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:04:56.435444 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591cd99-c2a9-41a1-87cf-0e44a0a8b6dc service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:04:56.468075 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1369/2719] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:04:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:05:02.918588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d77f1-1d3e-4527-9a86-575046231d03 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:02.919054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d77f1-1d3e-4527-9a86-575046231d03 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:02.919054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d77f1-1d3e-4527-9a86-575046231d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:02.965471 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d31d77f1-1d3e-4527-9a86-575046231d03 None None] MFA Rules not processed for user `067073373e894f5f9a146e6260ef793b`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:02.966950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d31d77f1-1d3e-4527-9a86-575046231d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:02.973572 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:03.105314 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1351/2720] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:03.122373 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591cd99-c2a9-41a1-87cf-0e44a0a8b6dc service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:03.127495 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c591cd99-c2a9-41a1-87cf-0e44a0a8b6dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:03.235420 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:03.307029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591cd99-c2a9-41a1-87cf-0e44a0a8b6dc service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:03.316227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6b9c9-c0d8-43c6-8523-430df4b3d3f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:03.317025 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6b9c9-c0d8-43c6-8523-430df4b3d3f3 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:03.317725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6b9c9-c0d8-43c6-8523-430df4b3d3f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:03.318101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6b9c9-c0d8-43c6-8523-430df4b3d3f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:03.328499 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6b9c9-c0d8-43c6-8523-430df4b3d3f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:03.331830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6b9c9-c0d8-43c6-8523-430df4b3d3f3 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:03.356618 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1370/2721] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:05:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:05:03.766830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d77f1-1d3e-4527-9a86-575046231d03 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:03.788002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d77f1-1d3e-4527-9a86-575046231d03 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:03.793910 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2220e-362a-41d9-9c8c-de8415fcf942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:03.794914 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2220e-362a-41d9-9c8c-de8415fcf942 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:03.795465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2220e-362a-41d9-9c8c-de8415fcf942 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:03.796052 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2220e-362a-41d9-9c8c-de8415fcf942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:03.798717 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f6f2220e-362a-41d9-9c8c-de8415fcf942 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:03.816496 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2220e-362a-41d9-9c8c-de8415fcf942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:03.818470 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2220e-362a-41d9-9c8c-de8415fcf942 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:03.834525 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1352/2722] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:05:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:05:03.864730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6b9c9-c0d8-43c6-8523-430df4b3d3f3 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:03.881853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6b9c9-c0d8-43c6-8523-430df4b3d3f3 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:03.890818 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9392b-71f9-47b0-91ca-a4d22e1088f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:03.891563 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9392b-71f9-47b0-91ca-a4d22e1088f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:03.892075 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9392b-71f9-47b0-91ca-a4d22e1088f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:03.892574 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9392b-71f9-47b0-91ca-a4d22e1088f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:03.895513 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f0b9392b-71f9-47b0-91ca-a4d22e1088f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:03.928517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9392b-71f9-47b0-91ca-a4d22e1088f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:03.935448 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9392b-71f9-47b0-91ca-a4d22e1088f5 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:03.964673 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1371/2723] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:05:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:05:05.518520 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b2e58-908a-40bd-96e6-fb851740dd7b None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:05.519014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b2e58-908a-40bd-96e6-fb851740dd7b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:05.519099 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b2e58-908a-40bd-96e6-fb851740dd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:05.563776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-483b2e58-908a-40bd-96e6-fb851740dd7b None None] MFA Rules not processed for user `cd793e15c7d44ed7bc1fff15d57297c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:05.565233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-483b2e58-908a-40bd-96e6-fb851740dd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:05.590126 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1353/2724] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:05.925066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d742d96-6928-4e5a-a3dc-8c643344bcc2 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:05.925944 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d742d96-6928-4e5a-a3dc-8c643344bcc2 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:05.925944 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d742d96-6928-4e5a-a3dc-8c643344bcc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:05.964434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-7d742d96-6928-4e5a-a3dc-8c643344bcc2 None None] MFA Rules not processed for user `067073373e894f5f9a146e6260ef793b`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:05.970867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7d742d96-6928-4e5a-a3dc-8c643344bcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:06.013780 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1372/2725] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:07.715390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b2e58-908a-40bd-96e6-fb851740dd7b None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:07.717091 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-483b2e58-908a-40bd-96e6-fb851740dd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:07.909765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b2e58-908a-40bd-96e6-fb851740dd7b None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:07.927868 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef4cf2-e0f3-4599-9a5c-232aa58c2b9b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:07.928832 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef4cf2-e0f3-4599-9a5c-232aa58c2b9b service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:07.933534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef4cf2-e0f3-4599-9a5c-232aa58c2b9b service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:07.934176 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef4cf2-e0f3-4599-9a5c-232aa58c2b9b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:07.940178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-65ef4cf2-e0f3-4599-9a5c-232aa58c2b9b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:07.968332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef4cf2-e0f3-4599-9a5c-232aa58c2b9b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:07.971068 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef4cf2-e0f3-4599-9a5c-232aa58c2b9b service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:07.987480 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1354/2726] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:05:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:05:10.239612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d742d96-6928-4e5a-a3dc-8c643344bcc2 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:10.268943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d742d96-6928-4e5a-a3dc-8c643344bcc2 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:10.296838 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f56a0-173e-488b-a725-b731799b14d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:10.297547 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f56a0-173e-488b-a725-b731799b14d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:10.302309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f56a0-173e-488b-a725-b731799b14d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:10.305309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f56a0-173e-488b-a725-b731799b14d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:10.318418 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9c1f56a0-173e-488b-a725-b731799b14d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:10.355527 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f56a0-173e-488b-a725-b731799b14d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:10.359046 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f56a0-173e-488b-a725-b731799b14d5 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:10.380816 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1373/2727] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:05:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:05:10.666607 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef4cf2-e0f3-4599-9a5c-232aa58c2b9b service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:10.668045 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-65ef4cf2-e0f3-4599-9a5c-232aa58c2b9b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:10.697471 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef4cf2-e0f3-4599-9a5c-232aa58c2b9b service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:10.708214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf7d82-28c1-4954-8a3a-78684839ef7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:10.708969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf7d82-28c1-4954-8a3a-78684839ef7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:10.709710 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf7d82-28c1-4954-8a3a-78684839ef7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:10.711276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf7d82-28c1-4954-8a3a-78684839ef7c admin admin] PATH_INFO: `/v3/users/94d139d4b19f423189a68e959e338edf` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:10.713933 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf7d82-28c1-4954-8a3a-78684839ef7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=94d139d4b19f423189a68e959e338edf)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:10.719180 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf7d82-28c1-4954-8a3a-78684839ef7c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:10.833796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-78cf7d82-28c1-4954-8a3a-78684839ef7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94d139d4b19f423189a68e959e338edf'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:10.834804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-78cf7d82-28c1-4954-8a3a-78684839ef7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94d139d4b19f423189a68e959e338edf'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:10.854292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-78cf7d82-28c1-4954-8a3a-78684839ef7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94d139d4b19f423189a68e959e338edf'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:10.874007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-78cf7d82-28c1-4954-8a3a-78684839ef7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94d139d4b19f423189a68e959e338edf'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:10.874624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-78cf7d82-28c1-4954-8a3a-78684839ef7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94d139d4b19f423189a68e959e338edf'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:10.881695 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:10.911117 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1355/2728] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:05:10 2022] DELETE /identity/v3/users/94d139d4b19f423189a68e959e338edf => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:10.916812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643dc20d-d4c5-4eab-89f0-1dc8b0dc3f6a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:10.917086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643dc20d-d4c5-4eab-89f0-1dc8b0dc3f6a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:10.919076 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643dc20d-d4c5-4eab-89f0-1dc8b0dc3f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:10.974631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-643dc20d-d4c5-4eab-89f0-1dc8b0dc3f6a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:10.975853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-643dc20d-d4c5-4eab-89f0-1dc8b0dc3f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:11.145923 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1374/2729] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:11.219876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf7d82-28c1-4954-8a3a-78684839ef7c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:11.221838 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-78cf7d82-28c1-4954-8a3a-78684839ef7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:11.399344 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf7d82-28c1-4954-8a3a-78684839ef7c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:11.414497 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9211cf7-2e79-4c2a-81a7-9dc64a3ccc57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:11.415113 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9211cf7-2e79-4c2a-81a7-9dc64a3ccc57 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:11.415401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9211cf7-2e79-4c2a-81a7-9dc64a3ccc57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:11.415676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9211cf7-2e79-4c2a-81a7-9dc64a3ccc57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:11.441284 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9211cf7-2e79-4c2a-81a7-9dc64a3ccc57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:11.447835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9211cf7-2e79-4c2a-81a7-9dc64a3ccc57 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:11.490373 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1356/2730] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:05:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:05:13.878380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643dc20d-d4c5-4eab-89f0-1dc8b0dc3f6a None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:13.880335 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-643dc20d-d4c5-4eab-89f0-1dc8b0dc3f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:13.911295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643dc20d-d4c5-4eab-89f0-1dc8b0dc3f6a None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:13.932212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff048c-97cb-41ab-a8c6-a77fdda0c72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:13.933193 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff048c-97cb-41ab-a8c6-a77fdda0c72a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:13.933914 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff048c-97cb-41ab-a8c6-a77fdda0c72a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:13.936019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff048c-97cb-41ab-a8c6-a77fdda0c72a admin admin] PATH_INFO: `/v3/projects/46050caead134b438622b9ba505cf6cc` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:13.945638 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff048c-97cb-41ab-a8c6-a77fdda0c72a admin admin] RBAC: Authorizing `identity:delete_project(project_id=46050caead134b438622b9ba505cf6cc)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:13.956316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff048c-97cb-41ab-a8c6-a77fdda0c72a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:14.103044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-caff048c-97cb-41ab-a8c6-a77fdda0c72a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46050caead134b438622b9ba505cf6cc', 'request_id': 'req-caff048c-97cb-41ab-a8c6-a77fdda0c72a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:14.127248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-caff048c-97cb-41ab-a8c6-a77fdda0c72a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46050caead134b438622b9ba505cf6cc', 'request_id': 'req-caff048c-97cb-41ab-a8c6-a77fdda0c72a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:14.136292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-caff048c-97cb-41ab-a8c6-a77fdda0c72a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46050caead134b438622b9ba505cf6cc', 'request_id': 'req-caff048c-97cb-41ab-a8c6-a77fdda0c72a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:14.153275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-caff048c-97cb-41ab-a8c6-a77fdda0c72a admin admin] The token cache is being invalidate because project 46050caead134b438622b9ba505cf6cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:05:14.153804 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-caff048c-97cb-41ab-a8c6-a77fdda0c72a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:14.154591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-caff048c-97cb-41ab-a8c6-a77fdda0c72a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:14.162984 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1375/2731] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:05:13 2022] DELETE /identity/v3/projects/46050caead134b438622b9ba505cf6cc => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:14.167719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9211cf7-2e79-4c2a-81a7-9dc64a3ccc57 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:14.179027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9211cf7-2e79-4c2a-81a7-9dc64a3ccc57 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:14.263522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904d01e-19c0-4579-9302-dac2fcc65999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:14.264441 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904d01e-19c0-4579-9302-dac2fcc65999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:14.265084 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904d01e-19c0-4579-9302-dac2fcc65999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:14.265763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904d01e-19c0-4579-9302-dac2fcc65999 admin admin] PATH_INFO: `/v3/users/c6a5033cbac548d19a917c92de1fd86b` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:14.267149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5904d01e-19c0-4579-9302-dac2fcc65999 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6a5033cbac548d19a917c92de1fd86b)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:14.271110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5904d01e-19c0-4579-9302-dac2fcc65999 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:14.355873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5904d01e-19c0-4579-9302-dac2fcc65999 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6a5033cbac548d19a917c92de1fd86b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:14.357063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5904d01e-19c0-4579-9302-dac2fcc65999 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6a5033cbac548d19a917c92de1fd86b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:14.365845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5904d01e-19c0-4579-9302-dac2fcc65999 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6a5033cbac548d19a917c92de1fd86b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:14.378575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5904d01e-19c0-4579-9302-dac2fcc65999 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6a5033cbac548d19a917c92de1fd86b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:14.379255 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5904d01e-19c0-4579-9302-dac2fcc65999 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6a5033cbac548d19a917c92de1fd86b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:14.409084 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1357/2732] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:05:14 2022] DELETE /identity/v3/users/c6a5033cbac548d19a917c92de1fd86b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:14.598783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff048c-97cb-41ab-a8c6-a77fdda0c72a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:14.600334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-caff048c-97cb-41ab-a8c6-a77fdda0c72a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:14.619672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff048c-97cb-41ab-a8c6-a77fdda0c72a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:14.656529 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:14.732761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d7675-2373-4eb4-b813-83f5068f0fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:14.733428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d7675-2373-4eb4-b813-83f5068f0fa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:14.733749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d7675-2373-4eb4-b813-83f5068f0fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:14.734228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d7675-2373-4eb4-b813-83f5068f0fa7 admin admin] PATH_INFO: `/v3/users/134d179e5e784ca8867b48bcd3e92c41` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:14.737015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d7675-2373-4eb4-b813-83f5068f0fa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=134d179e5e784ca8867b48bcd3e92c41)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:14.739257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d7675-2373-4eb4-b813-83f5068f0fa7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:14.857845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d97d7675-2373-4eb4-b813-83f5068f0fa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '134d179e5e784ca8867b48bcd3e92c41'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:14.858835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d97d7675-2373-4eb4-b813-83f5068f0fa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '134d179e5e784ca8867b48bcd3e92c41'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:14.878184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d97d7675-2373-4eb4-b813-83f5068f0fa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '134d179e5e784ca8867b48bcd3e92c41'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:14.893662 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d97d7675-2373-4eb4-b813-83f5068f0fa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '134d179e5e784ca8867b48bcd3e92c41'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:14.895867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d97d7675-2373-4eb4-b813-83f5068f0fa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '134d179e5e784ca8867b48bcd3e92c41'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:14.932235 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1376/2733] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:05:14 2022] DELETE /identity/v3/users/134d179e5e784ca8867b48bcd3e92c41 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:15.537641 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904d01e-19c0-4579-9302-dac2fcc65999 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:15.541675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5904d01e-19c0-4579-9302-dac2fcc65999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:15.560342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904d01e-19c0-4579-9302-dac2fcc65999 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:15.570430 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:15.713579 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b737c-59d0-4777-a7ec-4fdc87c6f934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:15.714236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b737c-59d0-4777-a7ec-4fdc87c6f934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:15.714513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b737c-59d0-4777-a7ec-4fdc87c6f934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:15.714786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b737c-59d0-4777-a7ec-4fdc87c6f934 admin admin] PATH_INFO: `/v3/projects/762bba83ebe641fc874f13477d8f6a43` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:15.715934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b737c-59d0-4777-a7ec-4fdc87c6f934 admin admin] RBAC: Authorizing `identity:delete_project(project_id=762bba83ebe641fc874f13477d8f6a43)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:15.718347 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b737c-59d0-4777-a7ec-4fdc87c6f934 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:15.816548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-148b737c-59d0-4777-a7ec-4fdc87c6f934 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '762bba83ebe641fc874f13477d8f6a43', 'request_id': 'req-148b737c-59d0-4777-a7ec-4fdc87c6f934'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:15.831977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-148b737c-59d0-4777-a7ec-4fdc87c6f934 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '762bba83ebe641fc874f13477d8f6a43', 'request_id': 'req-148b737c-59d0-4777-a7ec-4fdc87c6f934'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:15.850092 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-148b737c-59d0-4777-a7ec-4fdc87c6f934 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '762bba83ebe641fc874f13477d8f6a43', 'request_id': 'req-148b737c-59d0-4777-a7ec-4fdc87c6f934'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:15.881834 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-148b737c-59d0-4777-a7ec-4fdc87c6f934 admin admin] The token cache is being invalidate because project 762bba83ebe641fc874f13477d8f6a43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:05:15.882806 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-148b737c-59d0-4777-a7ec-4fdc87c6f934 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:15.884263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-148b737c-59d0-4777-a7ec-4fdc87c6f934 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:15.886795 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1358/2734] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:05:15 2022] DELETE /identity/v3/projects/762bba83ebe641fc874f13477d8f6a43 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:15.892352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968d7f3-acb5-4abf-ba53-608da3303d3c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:15.892663 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968d7f3-acb5-4abf-ba53-608da3303d3c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:15.892942 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968d7f3-acb5-4abf-ba53-608da3303d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:15.924996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-4968d7f3-acb5-4abf-ba53-608da3303d3c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:15.926414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4968d7f3-acb5-4abf-ba53-608da3303d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:16.034672 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1377/2735] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:16.043179 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e46be2-1f79-4910-b2af-090310a09f0a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:16.043654 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e46be2-1f79-4910-b2af-090310a09f0a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:16.044297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e46be2-1f79-4910-b2af-090310a09f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:16.094894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968d7f3-acb5-4abf-ba53-608da3303d3c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:16.097582 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4968d7f3-acb5-4abf-ba53-608da3303d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:16.106529 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a8e46be2-1f79-4910-b2af-090310a09f0a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:16.108141 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a8e46be2-1f79-4910-b2af-090310a09f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:16.113412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968d7f3-acb5-4abf-ba53-608da3303d3c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:16.120403 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfdfa7-64b2-4cc9-a7f8-79745b5adac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:16.121281 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfdfa7-64b2-4cc9-a7f8-79745b5adac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:16.121868 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfdfa7-64b2-4cc9-a7f8-79745b5adac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:16.122649 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfdfa7-64b2-4cc9-a7f8-79745b5adac0 admin admin] PATH_INFO: `/v3/projects/113d5ee0ee684fa3a129461b17b162e1` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:16.124387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bfdfa7-64b2-4cc9-a7f8-79745b5adac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=113d5ee0ee684fa3a129461b17b162e1)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:16.127238 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bfdfa7-64b2-4cc9-a7f8-79745b5adac0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:16.131551 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1359/2736] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:16.133417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e46be2-1f79-4910-b2af-090310a09f0a None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:16.149695 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e46be2-1f79-4910-b2af-090310a09f0a None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:16.165614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4894ff6-2f90-4492-9984-fed17435b82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:16.166247 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4894ff6-2f90-4492-9984-fed17435b82e admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:16.166784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4894ff6-2f90-4492-9984-fed17435b82e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:16.166992 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4894ff6-2f90-4492-9984-fed17435b82e admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:16.167610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4894ff6-2f90-4492-9984-fed17435b82e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:05:16.167912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4894ff6-2f90-4492-9984-fed17435b82e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:16.169561 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4894ff6-2f90-4492-9984-fed17435b82e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:16.193407 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1360/2737] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:05:16.194368 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4894ff6-2f90-4492-9984-fed17435b82e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:16.196777 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:16.208039 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4894ff6-2f90-4492-9984-fed17435b82e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:16.236911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-85bfdfa7-64b2-4cc9-a7f8-79745b5adac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '113d5ee0ee684fa3a129461b17b162e1', 'request_id': 'req-85bfdfa7-64b2-4cc9-a7f8-79745b5adac0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:16.249625 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-85bfdfa7-64b2-4cc9-a7f8-79745b5adac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '113d5ee0ee684fa3a129461b17b162e1', 'request_id': 'req-85bfdfa7-64b2-4cc9-a7f8-79745b5adac0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:16.263640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-85bfdfa7-64b2-4cc9-a7f8-79745b5adac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '113d5ee0ee684fa3a129461b17b162e1', 'request_id': 'req-85bfdfa7-64b2-4cc9-a7f8-79745b5adac0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:16.281102 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-85bfdfa7-64b2-4cc9-a7f8-79745b5adac0 admin admin] The token cache is being invalidate because project 113d5ee0ee684fa3a129461b17b162e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:05:16.281533 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-85bfdfa7-64b2-4cc9-a7f8-79745b5adac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:16.282656 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-85bfdfa7-64b2-4cc9-a7f8-79745b5adac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:16.287915 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1378/2738] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:05:16 2022] DELETE /identity/v3/projects/113d5ee0ee684fa3a129461b17b162e1 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:05:16.290064 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfdfa7-64b2-4cc9-a7f8-79745b5adac0 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:16.291721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-85bfdfa7-64b2-4cc9-a7f8-79745b5adac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:16.339229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229291b-306d-4be1-b519-a80ddb5ce9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:16.339890 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229291b-306d-4be1-b519-a80ddb5ce9ca admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:16.340234 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229291b-306d-4be1-b519-a80ddb5ce9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:16.340474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229291b-306d-4be1-b519-a80ddb5ce9ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:16.341055 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229291b-306d-4be1-b519-a80ddb5ce9ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:16.344852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229291b-306d-4be1-b519-a80ddb5ce9ca admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:16.411024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfdfa7-64b2-4cc9-a7f8-79745b5adac0 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:16.412674 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1361/2739] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:05:16 2022] POST /identity/v3/projects => generated 383 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:05:16.414749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229291b-306d-4be1-b519-a80ddb5ce9ca admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:16.417936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8229291b-306d-4be1-b519-a80ddb5ce9ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:16.429534 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:16.514558 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc15966-e8bc-41e5-b9c6-9a3de01720a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:16.515544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc15966-e8bc-41e5-b9c6-9a3de01720a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:16.516506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc15966-e8bc-41e5-b9c6-9a3de01720a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:16.517074 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc15966-e8bc-41e5-b9c6-9a3de01720a1 admin admin] PATH_INFO: `/v3/users/485ed575604440a880171a0bbc87616d` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:16.519035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc15966-e8bc-41e5-b9c6-9a3de01720a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=485ed575604440a880171a0bbc87616d)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:16.522746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc15966-e8bc-41e5-b9c6-9a3de01720a1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:16.532768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229291b-306d-4be1-b519-a80ddb5ce9ca admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:16.542761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c2e76-a5b3-486c-ba9f-49c03a7e3dfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:16.543397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c2e76-a5b3-486c-ba9f-49c03a7e3dfc service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:16.544054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c2e76-a5b3-486c-ba9f-49c03a7e3dfc service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:16.544748 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c2e76-a5b3-486c-ba9f-49c03a7e3dfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:16.547463 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-763c2e76-a5b3-486c-ba9f-49c03a7e3dfc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:16.566004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c2e76-a5b3-486c-ba9f-49c03a7e3dfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:16.568168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c2e76-a5b3-486c-ba9f-49c03a7e3dfc service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:16.580468 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1362/2740] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:05:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:05:16.581606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c2e76-a5b3-486c-ba9f-49c03a7e3dfc service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:16.583030 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-763c2e76-a5b3-486c-ba9f-49c03a7e3dfc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:16.593090 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dbc15966-e8bc-41e5-b9c6-9a3de01720a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '485ed575604440a880171a0bbc87616d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:16.596666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c2e76-a5b3-486c-ba9f-49c03a7e3dfc service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:16.602108 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bde30-4152-49dd-be8d-889f8e6513ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:16.602801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bde30-4152-49dd-be8d-889f8e6513ee admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:16.603155 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bde30-4152-49dd-be8d-889f8e6513ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:16.603680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bde30-4152-49dd-be8d-889f8e6513ee admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:16.604434 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761bde30-4152-49dd-be8d-889f8e6513ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:16.605232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dbc15966-e8bc-41e5-b9c6-9a3de01720a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '485ed575604440a880171a0bbc87616d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:16.606608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761bde30-4152-49dd-be8d-889f8e6513ee admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:16.620193 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dbc15966-e8bc-41e5-b9c6-9a3de01720a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '485ed575604440a880171a0bbc87616d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:16.634580 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1363/2741] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:05:16 2022] POST /identity/v3/users => generated 292 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:05:16.638514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dbc15966-e8bc-41e5-b9c6-9a3de01720a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '485ed575604440a880171a0bbc87616d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:16.638659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bde30-4152-49dd-be8d-889f8e6513ee admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:16.639737 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dbc15966-e8bc-41e5-b9c6-9a3de01720a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '485ed575604440a880171a0bbc87616d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:16.640616 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-761bde30-4152-49dd-be8d-889f8e6513ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:16.646600 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:16.660763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bde30-4152-49dd-be8d-889f8e6513ee admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:16.664645 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1379/2742] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:05:16 2022] DELETE /identity/v3/users/485ed575604440a880171a0bbc87616d => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:16.673104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995691d-848b-42a7-af01-cd5b66d288f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:16.673905 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995691d-848b-42a7-af01-cd5b66d288f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:16.674255 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995691d-848b-42a7-af01-cd5b66d288f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:16.674594 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995691d-848b-42a7-af01-cd5b66d288f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:16.675382 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995691d-848b-42a7-af01-cd5b66d288f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:16.677269 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995691d-848b-42a7-af01-cd5b66d288f5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:16.692401 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1364/2743] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:05:16.693986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc15966-e8bc-41e5-b9c6-9a3de01720a1 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:16.765618 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc15966-e8bc-41e5-b9c6-9a3de01720a1 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:16.771001 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7b8c0-ffff-4cea-9db2-40fac6dde043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:16.771854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7b8c0-ffff-4cea-9db2-40fac6dde043 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:16.772318 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7b8c0-ffff-4cea-9db2-40fac6dde043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:16.773621 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7b8c0-ffff-4cea-9db2-40fac6dde043 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:16.774554 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7b8c0-ffff-4cea-9db2-40fac6dde043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:16.776482 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7b8c0-ffff-4cea-9db2-40fac6dde043 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:16.792374 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1380/2744] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:05:16.796935 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995691d-848b-42a7-af01-cd5b66d288f5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:16.811571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995691d-848b-42a7-af01-cd5b66d288f5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:16.822259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a811723-d253-4cd3-876c-480a947ad543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:16.823343 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a811723-d253-4cd3-876c-480a947ad543 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:16.823896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a811723-d253-4cd3-876c-480a947ad543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:16.824370 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a811723-d253-4cd3-876c-480a947ad543 admin admin] PATH_INFO: `/v3/projects/49134d3485af4b0bbeef904dff960f7e/users/9482689feb8c4b6dad361610438a1b60/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:16.848017 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a811723-d253-4cd3-876c-480a947ad543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49134d3485af4b0bbeef904dff960f7e, user_id=9482689feb8c4b6dad361610438a1b60, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:16.850808 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a811723-d253-4cd3-876c-480a947ad543 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:16.871126 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1365/2745] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:05:16 2022] PUT /identity/v3/projects/49134d3485af4b0bbeef904dff960f7e/users/9482689feb8c4b6dad361610438a1b60/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:05:16.876391 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53117975-cc52-478c-be2a-d793f725f16e None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:16.876860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53117975-cc52-478c-be2a-d793f725f16e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:16.877243 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53117975-cc52-478c-be2a-d793f725f16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:16.900394 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-53117975-cc52-478c-be2a-d793f725f16e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:16.901652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-53117975-cc52-478c-be2a-d793f725f16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:16.940340 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a811723-d253-4cd3-876c-480a947ad543 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:16.942846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4a811723-d253-4cd3-876c-480a947ad543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:17.025878 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1381/2746] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:17.038139 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53117975-cc52-478c-be2a-d793f725f16e None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:17.040099 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-53117975-cc52-478c-be2a-d793f725f16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:17.064317 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a811723-d253-4cd3-876c-480a947ad543 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:17.069086 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89da47-99d1-4c27-8ad0-4c5ac898b490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:17.070378 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89da47-99d1-4c27-8ad0-4c5ac898b490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:17.070660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89da47-99d1-4c27-8ad0-4c5ac898b490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:17.070972 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89da47-99d1-4c27-8ad0-4c5ac898b490 admin admin] PATH_INFO: `/v3/projects/13f9ce4520b94fb28f73ecfb55dcf646` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:17.072135 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89da47-99d1-4c27-8ad0-4c5ac898b490 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13f9ce4520b94fb28f73ecfb55dcf646)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:17.074127 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89da47-99d1-4c27-8ad0-4c5ac898b490 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:17.113854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53117975-cc52-478c-be2a-d793f725f16e None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:17.125038 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667b6c4-0135-4464-bbac-c2c5b29753cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:17.126986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667b6c4-0135-4464-bbac-c2c5b29753cc service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:17.127672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667b6c4-0135-4464-bbac-c2c5b29753cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:17.129172 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667b6c4-0135-4464-bbac-c2c5b29753cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:17.133417 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:17.143971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4f89da47-99d1-4c27-8ad0-4c5ac898b490 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13f9ce4520b94fb28f73ecfb55dcf646', 'request_id': 'req-4f89da47-99d1-4c27-8ad0-4c5ac898b490'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:17.146619 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d667b6c4-0135-4464-bbac-c2c5b29753cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:17.150854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d667b6c4-0135-4464-bbac-c2c5b29753cc service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:17.153295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4f89da47-99d1-4c27-8ad0-4c5ac898b490 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13f9ce4520b94fb28f73ecfb55dcf646', 'request_id': 'req-4f89da47-99d1-4c27-8ad0-4c5ac898b490'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:17.160478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4f89da47-99d1-4c27-8ad0-4c5ac898b490 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13f9ce4520b94fb28f73ecfb55dcf646', 'request_id': 'req-4f89da47-99d1-4c27-8ad0-4c5ac898b490'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:17.170530 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1382/2747] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:05:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:05:17.173965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4f89da47-99d1-4c27-8ad0-4c5ac898b490 admin admin] The token cache is being invalidate because project 13f9ce4520b94fb28f73ecfb55dcf646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:05:17.174789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4f89da47-99d1-4c27-8ad0-4c5ac898b490 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:17.175476 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4f89da47-99d1-4c27-8ad0-4c5ac898b490 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:17.181521 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1366/2748] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:05:16 2022] DELETE /identity/v3/projects/13f9ce4520b94fb28f73ecfb55dcf646 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:17.183006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265aa40-4af6-4f49-a232-7bf306cf55e1 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:17.183300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265aa40-4af6-4f49-a232-7bf306cf55e1 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:17.183944 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265aa40-4af6-4f49-a232-7bf306cf55e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:17.208447 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-0265aa40-4af6-4f49-a232-7bf306cf55e1 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:17.209520 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0265aa40-4af6-4f49-a232-7bf306cf55e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:17.233980 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:17.279601 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1383/2749] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:17.287199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a002a0-8f4d-4c8a-aed8-456c4c988172 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:17.287902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a002a0-8f4d-4c8a-aed8-456c4c988172 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:17.288629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a002a0-8f4d-4c8a-aed8-456c4c988172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:17.314345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e1a002a0-8f4d-4c8a-aed8-456c4c988172 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:17.316568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e1a002a0-8f4d-4c8a-aed8-456c4c988172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:17.328312 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1367/2750] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:17.330544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265aa40-4af6-4f49-a232-7bf306cf55e1 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:17.341640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265aa40-4af6-4f49-a232-7bf306cf55e1 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:17.346446 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4cd074-9276-488c-a570-902b664b50b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:17.347319 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4cd074-9276-488c-a570-902b664b50b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:17.347319 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4cd074-9276-488c-a570-902b664b50b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:17.347646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4cd074-9276-488c-a570-902b664b50b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:17.348249 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4cd074-9276-488c-a570-902b664b50b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:05:17.348560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4cd074-9276-488c-a570-902b664b50b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:17.350252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4cd074-9276-488c-a570-902b664b50b5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:17.368312 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1384/2751] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:05:17.373186 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a002a0-8f4d-4c8a-aed8-456c4c988172 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:17.384613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a002a0-8f4d-4c8a-aed8-456c4c988172 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:17.389631 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5477f-04cc-4101-9b4f-5bc5ba81a652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:17.390252 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5477f-04cc-4101-9b4f-5bc5ba81a652 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:17.390661 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5477f-04cc-4101-9b4f-5bc5ba81a652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:17.390812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5477f-04cc-4101-9b4f-5bc5ba81a652 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:17.391632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5477f-04cc-4101-9b4f-5bc5ba81a652 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:17.393749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5477f-04cc-4101-9b4f-5bc5ba81a652 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:17.424918 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1368/2752] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:05:17 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:05:17.429451 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4cd074-9276-488c-a570-902b664b50b5 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:17.459882 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4cd074-9276-488c-a570-902b664b50b5 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:17.524027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da501047-6c53-4187-9129-a0d69799095b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:17.524652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da501047-6c53-4187-9129-a0d69799095b admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:17.525008 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da501047-6c53-4187-9129-a0d69799095b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:17.525287 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da501047-6c53-4187-9129-a0d69799095b admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:17.525987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da501047-6c53-4187-9129-a0d69799095b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:17.527978 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da501047-6c53-4187-9129-a0d69799095b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:17.552950 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1385/2753] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:05:17 2022] POST /identity/v3/users => generated 291 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:05:17.557787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5477f-04cc-4101-9b4f-5bc5ba81a652 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:17.569973 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5477f-04cc-4101-9b4f-5bc5ba81a652 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:17.578361 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13236b8b-9e77-4f6f-933b-041a28f7cefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:17.579332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13236b8b-9e77-4f6f-933b-041a28f7cefa admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:17.579741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13236b8b-9e77-4f6f-933b-041a28f7cefa admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:17.580126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13236b8b-9e77-4f6f-933b-041a28f7cefa admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:17.581014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13236b8b-9e77-4f6f-933b-041a28f7cefa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:17.582930 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13236b8b-9e77-4f6f-933b-041a28f7cefa admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:17.598071 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1369/2754] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:05:17.600014 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da501047-6c53-4187-9129-a0d69799095b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:17.612427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da501047-6c53-4187-9129-a0d69799095b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:17.619293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fa567-a2db-4ea0-affb-78c1d07a4073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:17.620002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fa567-a2db-4ea0-affb-78c1d07a4073 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:17.620476 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fa567-a2db-4ea0-affb-78c1d07a4073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:17.620619 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fa567-a2db-4ea0-affb-78c1d07a4073 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:17.621400 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11fa567-a2db-4ea0-affb-78c1d07a4073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:17.623219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11fa567-a2db-4ea0-affb-78c1d07a4073 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:17.641622 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1386/2755] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:05:17.643693 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13236b8b-9e77-4f6f-933b-041a28f7cefa admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:17.655538 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13236b8b-9e77-4f6f-933b-041a28f7cefa admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:17.660479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7b998-60dc-478b-88dd-b0bcf362a4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:17.661155 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7b998-60dc-478b-88dd-b0bcf362a4fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:17.661445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7b998-60dc-478b-88dd-b0bcf362a4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:17.661757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7b998-60dc-478b-88dd-b0bcf362a4fe admin admin] PATH_INFO: `/v3/projects/4d62253b9b82433f88c3011b33c158d5/users/cc2b6e790cfa405dafa3eb31de9f6b67/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:17.678803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7b998-60dc-478b-88dd-b0bcf362a4fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d62253b9b82433f88c3011b33c158d5, user_id=cc2b6e790cfa405dafa3eb31de9f6b67, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:17.681555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7b998-60dc-478b-88dd-b0bcf362a4fe admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:17.698173 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1370/2756] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:05:17 2022] PUT /identity/v3/projects/4d62253b9b82433f88c3011b33c158d5/users/cc2b6e790cfa405dafa3eb31de9f6b67/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:05:17.709042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109fca7-0698-4f9d-b802-9c9a785c6ad5 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:17.709331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109fca7-0698-4f9d-b802-9c9a785c6ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:17.709640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109fca7-0698-4f9d-b802-9c9a785c6ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:17.744511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-6109fca7-0698-4f9d-b802-9c9a785c6ad5 None None] MFA Rules not processed for user `cc2b6e790cfa405dafa3eb31de9f6b67`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:17.745761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6109fca7-0698-4f9d-b802-9c9a785c6ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:17.816742 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1387/2757] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:17.822110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7b998-60dc-478b-88dd-b0bcf362a4fe admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:17.898609 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7b998-60dc-478b-88dd-b0bcf362a4fe admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:17.904285 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde26620-3d5c-48d3-93d3-d8e066872198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:17.904911 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde26620-3d5c-48d3-93d3-d8e066872198 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:17.904911 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde26620-3d5c-48d3-93d3-d8e066872198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:17.905209 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde26620-3d5c-48d3-93d3-d8e066872198 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:17.905838 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde26620-3d5c-48d3-93d3-d8e066872198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:17.907751 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde26620-3d5c-48d3-93d3-d8e066872198 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:17.953025 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1371/2758] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:05:17 2022] POST /identity/v3/projects => generated 381 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:05:17.954072 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109fca7-0698-4f9d-b802-9c9a785c6ad5 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:17.971023 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109fca7-0698-4f9d-b802-9c9a785c6ad5 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:17.995418 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:18.077324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62114a-1bd3-4ec1-9274-7c01b7647de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:18.077324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62114a-1bd3-4ec1-9274-7c01b7647de4 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:18.077324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62114a-1bd3-4ec1-9274-7c01b7647de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:18.077324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62114a-1bd3-4ec1-9274-7c01b7647de4 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:18.078401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62114a-1bd3-4ec1-9274-7c01b7647de4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:18.079289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62114a-1bd3-4ec1-9274-7c01b7647de4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:18.117122 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1388/2759] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:05:17 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:05:18.121297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde26620-3d5c-48d3-93d3-d8e066872198 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:18.136082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde26620-3d5c-48d3-93d3-d8e066872198 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:18.141552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed5af5-61cc-4f60-8042-f741f0b2d693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:18.142382 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed5af5-61cc-4f60-8042-f741f0b2d693 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:18.142805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed5af5-61cc-4f60-8042-f741f0b2d693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:18.143254 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed5af5-61cc-4f60-8042-f741f0b2d693 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:18.144195 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed5af5-61cc-4f60-8042-f741f0b2d693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:18.146167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed5af5-61cc-4f60-8042-f741f0b2d693 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:18.159612 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1372/2760] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:05:18.163808 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62114a-1bd3-4ec1-9274-7c01b7647de4 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:18.179664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62114a-1bd3-4ec1-9274-7c01b7647de4 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:18.185877 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cc8e0-2fbb-410d-bc26-1452e5052f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:18.187142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cc8e0-2fbb-410d-bc26-1452e5052f13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:18.187579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cc8e0-2fbb-410d-bc26-1452e5052f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:18.188033 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cc8e0-2fbb-410d-bc26-1452e5052f13 admin admin] PATH_INFO: `/v3/projects/83b98454cf434e44adee47af7fb920bc/users/f360bc6886ff4d5ebe8c91a5cd8048f4/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:18.219591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4cc8e0-2fbb-410d-bc26-1452e5052f13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83b98454cf434e44adee47af7fb920bc, user_id=f360bc6886ff4d5ebe8c91a5cd8048f4, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:18.223063 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4cc8e0-2fbb-410d-bc26-1452e5052f13 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:18.244001 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1389/2761] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:05:18 2022] PUT /identity/v3/projects/83b98454cf434e44adee47af7fb920bc/users/f360bc6886ff4d5ebe8c91a5cd8048f4/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:05:18.248061 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed5af5-61cc-4f60-8042-f741f0b2d693 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:18.261390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed5af5-61cc-4f60-8042-f741f0b2d693 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:18.321841 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:18.357019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd7295-6c00-4045-a510-9524a6be856a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:18.358129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd7295-6c00-4045-a510-9524a6be856a admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:18.358514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd7295-6c00-4045-a510-9524a6be856a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:18.360588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd7295-6c00-4045-a510-9524a6be856a admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:18.362435 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd7295-6c00-4045-a510-9524a6be856a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:18.364809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd7295-6c00-4045-a510-9524a6be856a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:18.381561 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1373/2762] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:05:18.382105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cc8e0-2fbb-410d-bc26-1452e5052f13 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:18.405278 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cc8e0-2fbb-410d-bc26-1452e5052f13 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:18.420721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4053d-49c1-4297-ab45-eefeb881d4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:18.424835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4053d-49c1-4297-ab45-eefeb881d4d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:18.425352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4053d-49c1-4297-ab45-eefeb881d4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:18.427974 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4053d-49c1-4297-ab45-eefeb881d4d6 admin admin] PATH_INFO: `/v3/projects/83b98454cf434e44adee47af7fb920bc/users/f360bc6886ff4d5ebe8c91a5cd8048f4/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:18.434328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4053d-49c1-4297-ab45-eefeb881d4d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83b98454cf434e44adee47af7fb920bc, user_id=f360bc6886ff4d5ebe8c91a5cd8048f4, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:18.462866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4053d-49c1-4297-ab45-eefeb881d4d6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:18.479256 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1390/2763] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:05:18 2022] PUT /identity/v3/projects/83b98454cf434e44adee47af7fb920bc/users/f360bc6886ff4d5ebe8c91a5cd8048f4/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:18.489839 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703f318-68b2-468e-9900-773acc1e546e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:18.490564 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703f318-68b2-468e-9900-773acc1e546e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:18.490564 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703f318-68b2-468e-9900-773acc1e546e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:18.534365 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-8703f318-68b2-468e-9900-773acc1e546e None None] MFA Rules not processed for user `f360bc6886ff4d5ebe8c91a5cd8048f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:18.536139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8703f318-68b2-468e-9900-773acc1e546e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:18.647153 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1374/2764] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:18 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:18.652873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4053d-49c1-4297-ab45-eefeb881d4d6 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:18.655826 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-21c4053d-49c1-4297-ab45-eefeb881d4d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:18.765749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4053d-49c1-4297-ab45-eefeb881d4d6 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:18.778985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008508ab-b8e6-4663-bde6-c77a476b2821 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:18.779630 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008508ab-b8e6-4663-bde6-c77a476b2821 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:18.779891 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008508ab-b8e6-4663-bde6-c77a476b2821 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:18.780163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008508ab-b8e6-4663-bde6-c77a476b2821 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:18.820311 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008508ab-b8e6-4663-bde6-c77a476b2821 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:18.824315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008508ab-b8e6-4663-bde6-c77a476b2821 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:18.841953 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1391/2765] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:05:18 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:05:19.315069 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703f318-68b2-468e-9900-773acc1e546e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:19.316942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8703f318-68b2-468e-9900-773acc1e546e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:19.348555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703f318-68b2-468e-9900-773acc1e546e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:19.363972 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eacef0-d0cc-4958-8b6b-6e82abaae565 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:19.364615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eacef0-d0cc-4958-8b6b-6e82abaae565 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:19.364895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eacef0-d0cc-4958-8b6b-6e82abaae565 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:19.365175 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eacef0-d0cc-4958-8b6b-6e82abaae565 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:19.374448 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-24eacef0-d0cc-4958-8b6b-6e82abaae565 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:19.409328 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eacef0-d0cc-4958-8b6b-6e82abaae565 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:19.412694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eacef0-d0cc-4958-8b6b-6e82abaae565 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:19.443996 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1375/2766] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:05:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:05:21.541478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008508ab-b8e6-4663-bde6-c77a476b2821 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:21.693403 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008508ab-b8e6-4663-bde6-c77a476b2821 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:21.716364 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddbd7d-e1a8-4fb1-ba3b-98944c9fb9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:21.717261 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddbd7d-e1a8-4fb1-ba3b-98944c9fb9f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:21.718978 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddbd7d-e1a8-4fb1-ba3b-98944c9fb9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:21.719425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddbd7d-e1a8-4fb1-ba3b-98944c9fb9f7 admin admin] PATH_INFO: `/v3/users/cc2b6e790cfa405dafa3eb31de9f6b67` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:21.723855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ddbd7d-e1a8-4fb1-ba3b-98944c9fb9f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc2b6e790cfa405dafa3eb31de9f6b67)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:21.726176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ddbd7d-e1a8-4fb1-ba3b-98944c9fb9f7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:21.733779 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:21.834455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eacef0-d0cc-4958-8b6b-6e82abaae565 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:21.836687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-24eacef0-d0cc-4958-8b6b-6e82abaae565 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:21.862067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b3ddbd7d-e1a8-4fb1-ba3b-98944c9fb9f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc2b6e790cfa405dafa3eb31de9f6b67'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:21.862327 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b3ddbd7d-e1a8-4fb1-ba3b-98944c9fb9f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc2b6e790cfa405dafa3eb31de9f6b67'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:21.890958 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b3ddbd7d-e1a8-4fb1-ba3b-98944c9fb9f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc2b6e790cfa405dafa3eb31de9f6b67'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:21.909390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b3ddbd7d-e1a8-4fb1-ba3b-98944c9fb9f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc2b6e790cfa405dafa3eb31de9f6b67'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:21.910190 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b3ddbd7d-e1a8-4fb1-ba3b-98944c9fb9f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc2b6e790cfa405dafa3eb31de9f6b67'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:21.943000 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1392/2767] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:05:21 2022] DELETE /identity/v3/users/cc2b6e790cfa405dafa3eb31de9f6b67 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:21.948218 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18877fd9-2158-45ba-9e3b-ebf46c0ec104 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:21.948768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18877fd9-2158-45ba-9e3b-ebf46c0ec104 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:21.950286 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18877fd9-2158-45ba-9e3b-ebf46c0ec104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:21.972585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eacef0-d0cc-4958-8b6b-6e82abaae565 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:21.999809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-18877fd9-2158-45ba-9e3b-ebf46c0ec104 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:22.002298 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-18877fd9-2158-45ba-9e3b-ebf46c0ec104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:22.097938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3debf-3087-4f89-88d3-fda23220de5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:22.098566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3debf-3087-4f89-88d3-fda23220de5c service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:22.098842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3debf-3087-4f89-88d3-fda23220de5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:22.099145 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3debf-3087-4f89-88d3-fda23220de5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:22.101530 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-cea3debf-3087-4f89-88d3-fda23220de5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:22.123386 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea3debf-3087-4f89-88d3-fda23220de5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:22.124856 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea3debf-3087-4f89-88d3-fda23220de5c service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:22.142643 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1376/2768] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:05:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:05:22.184195 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1393/2769] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:22.238230 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3debf-3087-4f89-88d3-fda23220de5c service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:22.239695 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-cea3debf-3087-4f89-88d3-fda23220de5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:22.247615 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:22.263069 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3debf-3087-4f89-88d3-fda23220de5c service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:22.286138 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec353eb-0674-4ba1-b084-e3801a95d42e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:22.286789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec353eb-0674-4ba1-b084-e3801a95d42e service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:22.287614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec353eb-0674-4ba1-b084-e3801a95d42e service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:22.287900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec353eb-0674-4ba1-b084-e3801a95d42e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:22.350961 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec353eb-0674-4ba1-b084-e3801a95d42e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:22.362035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec353eb-0674-4ba1-b084-e3801a95d42e service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:22.375282 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1377/2770] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:05:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:05:24.465738 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18877fd9-2158-45ba-9e3b-ebf46c0ec104 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:24.467073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-18877fd9-2158-45ba-9e3b-ebf46c0ec104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:24.484254 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18877fd9-2158-45ba-9e3b-ebf46c0ec104 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:24.520390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98f32e-1cd9-4020-8df3-da5207abb054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:24.521324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98f32e-1cd9-4020-8df3-da5207abb054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:24.521978 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98f32e-1cd9-4020-8df3-da5207abb054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:24.522434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98f32e-1cd9-4020-8df3-da5207abb054 admin admin] PATH_INFO: `/v3/projects/4d62253b9b82433f88c3011b33c158d5` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:24.523844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b98f32e-1cd9-4020-8df3-da5207abb054 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d62253b9b82433f88c3011b33c158d5)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:24.526057 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b98f32e-1cd9-4020-8df3-da5207abb054 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:24.656820 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6b98f32e-1cd9-4020-8df3-da5207abb054 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d62253b9b82433f88c3011b33c158d5', 'request_id': 'req-6b98f32e-1cd9-4020-8df3-da5207abb054'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:24.670630 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6b98f32e-1cd9-4020-8df3-da5207abb054 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d62253b9b82433f88c3011b33c158d5', 'request_id': 'req-6b98f32e-1cd9-4020-8df3-da5207abb054'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:24.679026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6b98f32e-1cd9-4020-8df3-da5207abb054 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d62253b9b82433f88c3011b33c158d5', 'request_id': 'req-6b98f32e-1cd9-4020-8df3-da5207abb054'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:24.696592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6b98f32e-1cd9-4020-8df3-da5207abb054 admin admin] The token cache is being invalidate because project 4d62253b9b82433f88c3011b33c158d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:05:24.696960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6b98f32e-1cd9-4020-8df3-da5207abb054 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:24.698914 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6b98f32e-1cd9-4020-8df3-da5207abb054 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:24.700708 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1394/2771] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:05:24 2022] DELETE /identity/v3/projects/4d62253b9b82433f88c3011b33c158d5 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:24.704660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec353eb-0674-4ba1-b084-e3801a95d42e service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:24.715370 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec353eb-0674-4ba1-b084-e3801a95d42e service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:24.802321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39c652-2d09-4d5d-8a36-e655eb17f1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:24.804155 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39c652-2d09-4d5d-8a36-e655eb17f1cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:24.804659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39c652-2d09-4d5d-8a36-e655eb17f1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:24.805164 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39c652-2d09-4d5d-8a36-e655eb17f1cf admin admin] PATH_INFO: `/v3/users/f360bc6886ff4d5ebe8c91a5cd8048f4` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:24.806677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39c652-2d09-4d5d-8a36-e655eb17f1cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f360bc6886ff4d5ebe8c91a5cd8048f4)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:24.809197 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39c652-2d09-4d5d-8a36-e655eb17f1cf admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:24.882088 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6c39c652-2d09-4d5d-8a36-e655eb17f1cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f360bc6886ff4d5ebe8c91a5cd8048f4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:24.883357 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6c39c652-2d09-4d5d-8a36-e655eb17f1cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f360bc6886ff4d5ebe8c91a5cd8048f4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:24.896624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6c39c652-2d09-4d5d-8a36-e655eb17f1cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f360bc6886ff4d5ebe8c91a5cd8048f4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:24.908869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6c39c652-2d09-4d5d-8a36-e655eb17f1cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f360bc6886ff4d5ebe8c91a5cd8048f4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:24.910051 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6c39c652-2d09-4d5d-8a36-e655eb17f1cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f360bc6886ff4d5ebe8c91a5cd8048f4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:25.001861 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1378/2772] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:05:24 2022] DELETE /identity/v3/users/f360bc6886ff4d5ebe8c91a5cd8048f4 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:26.332648 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98f32e-1cd9-4020-8df3-da5207abb054 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:26.334429 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6b98f32e-1cd9-4020-8df3-da5207abb054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:26.343408 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:26.359301 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98f32e-1cd9-4020-8df3-da5207abb054 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:26.481633 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888cd46b-7a5e-4824-b252-f7a39bd03309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:26.482739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cd46b-7a5e-4824-b252-f7a39bd03309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:26.483019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cd46b-7a5e-4824-b252-f7a39bd03309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:26.483292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cd46b-7a5e-4824-b252-f7a39bd03309 admin admin] PATH_INFO: `/v3/projects/83b98454cf434e44adee47af7fb920bc` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:26.485071 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888cd46b-7a5e-4824-b252-f7a39bd03309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83b98454cf434e44adee47af7fb920bc)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:26.487329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888cd46b-7a5e-4824-b252-f7a39bd03309 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:26.551532 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-888cd46b-7a5e-4824-b252-f7a39bd03309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83b98454cf434e44adee47af7fb920bc', 'request_id': 'req-888cd46b-7a5e-4824-b252-f7a39bd03309'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:26.563237 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-888cd46b-7a5e-4824-b252-f7a39bd03309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83b98454cf434e44adee47af7fb920bc', 'request_id': 'req-888cd46b-7a5e-4824-b252-f7a39bd03309'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:26.571936 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-888cd46b-7a5e-4824-b252-f7a39bd03309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83b98454cf434e44adee47af7fb920bc', 'request_id': 'req-888cd46b-7a5e-4824-b252-f7a39bd03309'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:26.600841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-888cd46b-7a5e-4824-b252-f7a39bd03309 admin admin] The token cache is being invalidate because project 83b98454cf434e44adee47af7fb920bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:05:26.601159 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-888cd46b-7a5e-4824-b252-f7a39bd03309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:26.603978 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-888cd46b-7a5e-4824-b252-f7a39bd03309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:26.611934 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1395/2773] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:05:26 2022] DELETE /identity/v3/projects/83b98454cf434e44adee47af7fb920bc => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:26.612801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a8942-9d5b-44ae-acd3-f0f403baa3c2 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:26.613801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a8942-9d5b-44ae-acd3-f0f403baa3c2 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:26.614416 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a8942-9d5b-44ae-acd3-f0f403baa3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:26.659360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a51a8942-9d5b-44ae-acd3-f0f403baa3c2 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:26.663501 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a51a8942-9d5b-44ae-acd3-f0f403baa3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:26.794343 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1379/2774] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:26.802774 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb999af0-3b9b-4d14-b58c-bd4d5ba63d9e None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:26.803079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb999af0-3b9b-4d14-b58c-bd4d5ba63d9e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:26.803403 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb999af0-3b9b-4d14-b58c-bd4d5ba63d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:26.867426 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-eb999af0-3b9b-4d14-b58c-bd4d5ba63d9e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:26.869306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-eb999af0-3b9b-4d14-b58c-bd4d5ba63d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:26.884255 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1396/2775] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:26.885273 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a8942-9d5b-44ae-acd3-f0f403baa3c2 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:26.917384 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a8942-9d5b-44ae-acd3-f0f403baa3c2 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:26.931067 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0e6f3-7858-4879-8f84-35210c5b93d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:26.931961 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0e6f3-7858-4879-8f84-35210c5b93d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:26.932397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0e6f3-7858-4879-8f84-35210c5b93d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:26.932866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0e6f3-7858-4879-8f84-35210c5b93d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:26.933824 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db0e6f3-7858-4879-8f84-35210c5b93d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:05:26.934269 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db0e6f3-7858-4879-8f84-35210c5b93d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:26.937421 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db0e6f3-7858-4879-8f84-35210c5b93d4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:26.954011 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:26.970086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb999af0-3b9b-4d14-b58c-bd4d5ba63d9e None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:26.982943 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1380/2776] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:05:26.986914 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb999af0-3b9b-4d14-b58c-bd4d5ba63d9e None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:26.994902 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ff901-4312-4adf-a0f2-ef2e21189028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:26.995898 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ff901-4312-4adf-a0f2-ef2e21189028 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:26.996387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ff901-4312-4adf-a0f2-ef2e21189028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:26.996877 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ff901-4312-4adf-a0f2-ef2e21189028 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:26.997752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ff901-4312-4adf-a0f2-ef2e21189028 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:27.000772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ff901-4312-4adf-a0f2-ef2e21189028 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:27.068489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0e6f3-7858-4879-8f84-35210c5b93d4 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:27.078877 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1397/2777] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:05:26 2022] POST /identity/v3/projects => generated 391 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:05:27.083246 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0e6f3-7858-4879-8f84-35210c5b93d4 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:27.316784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24e90c-c092-41e9-8d42-682e08651b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:27.317655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24e90c-c092-41e9-8d42-682e08651b88 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:27.317940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24e90c-c092-41e9-8d42-682e08651b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:27.318217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24e90c-c092-41e9-8d42-682e08651b88 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:27.319651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24e90c-c092-41e9-8d42-682e08651b88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:27.323311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24e90c-c092-41e9-8d42-682e08651b88 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:27.371790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ff901-4312-4adf-a0f2-ef2e21189028 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:27.378377 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1381/2778] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:05:27 2022] POST /identity/v3/users => generated 296 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:05:27.398047 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ff901-4312-4adf-a0f2-ef2e21189028 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:27.404206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54869d9d-f7a9-4ebf-914f-cf9db404948f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:27.405040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54869d9d-f7a9-4ebf-914f-cf9db404948f admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:27.405523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54869d9d-f7a9-4ebf-914f-cf9db404948f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:27.406015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54869d9d-f7a9-4ebf-914f-cf9db404948f admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:27.407072 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54869d9d-f7a9-4ebf-914f-cf9db404948f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:27.409130 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54869d9d-f7a9-4ebf-914f-cf9db404948f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:27.436710 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24e90c-c092-41e9-8d42-682e08651b88 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:27.449945 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1398/2779] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:05:27.453801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24e90c-c092-41e9-8d42-682e08651b88 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:27.463017 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cda405-a825-44f9-8063-36ac7a304331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:27.463734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cda405-a825-44f9-8063-36ac7a304331 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:27.464129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cda405-a825-44f9-8063-36ac7a304331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:27.464495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cda405-a825-44f9-8063-36ac7a304331 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:27.465866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cda405-a825-44f9-8063-36ac7a304331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:27.467966 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cda405-a825-44f9-8063-36ac7a304331 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:27.488244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54869d9d-f7a9-4ebf-914f-cf9db404948f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:27.502884 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1382/2780] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:05:27.507291 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54869d9d-f7a9-4ebf-914f-cf9db404948f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:27.515137 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5eef42-5ae5-4212-adbd-781e9d59c05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:27.516523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5eef42-5ae5-4212-adbd-781e9d59c05d admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:27.517035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5eef42-5ae5-4212-adbd-781e9d59c05d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:27.517550 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5eef42-5ae5-4212-adbd-781e9d59c05d admin admin] PATH_INFO: `/v3/projects/174b8a5acea14af7b7bca4c179db88bc/users/e0f775dfd7194bdebf1d5a5baf280448/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:27.542598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5eef42-5ae5-4212-adbd-781e9d59c05d admin admin] RBAC: Authorizing `identity:create_grant(project_id=174b8a5acea14af7b7bca4c179db88bc, user_id=e0f775dfd7194bdebf1d5a5baf280448, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:27.546256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5eef42-5ae5-4212-adbd-781e9d59c05d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:27.586272 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1399/2781] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:05:27 2022] PUT /identity/v3/projects/174b8a5acea14af7b7bca4c179db88bc/users/e0f775dfd7194bdebf1d5a5baf280448/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:05:27.586669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d28c04-6a12-40e6-9ba4-746abf2a2a87 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:27.586964 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d28c04-6a12-40e6-9ba4-746abf2a2a87 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:27.587322 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d28c04-6a12-40e6-9ba4-746abf2a2a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:27.657560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-39d28c04-6a12-40e6-9ba4-746abf2a2a87 None None] MFA Rules not processed for user `e0f775dfd7194bdebf1d5a5baf280448`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:27.662121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-39d28c04-6a12-40e6-9ba4-746abf2a2a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:27.806668 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1383/2782] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:27.809280 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5eef42-5ae5-4212-adbd-781e9d59c05d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:27.869221 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:27.907120 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5eef42-5ae5-4212-adbd-781e9d59c05d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:27.913729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751596f-816e-44c0-8dd5-5f9d05b11d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:27.915042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751596f-816e-44c0-8dd5-5f9d05b11d1d admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:27.915519 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751596f-816e-44c0-8dd5-5f9d05b11d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:27.916281 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751596f-816e-44c0-8dd5-5f9d05b11d1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:27.917123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1751596f-816e-44c0-8dd5-5f9d05b11d1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:27.921220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1751596f-816e-44c0-8dd5-5f9d05b11d1d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:27.963696 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1400/2783] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:05:27 2022] POST /identity/v3/projects => generated 393 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:05:27.967895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d28c04-6a12-40e6-9ba4-746abf2a2a87 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:27.980135 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d28c04-6a12-40e6-9ba4-746abf2a2a87 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:28.084805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49570347-679b-4d3d-91d6-58d123e9e6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:28.085805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49570347-679b-4d3d-91d6-58d123e9e6ce admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:28.086551 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49570347-679b-4d3d-91d6-58d123e9e6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:28.086993 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49570347-679b-4d3d-91d6-58d123e9e6ce admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:28.087902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49570347-679b-4d3d-91d6-58d123e9e6ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:28.090326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49570347-679b-4d3d-91d6-58d123e9e6ce admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:28.105097 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:28.132090 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1384/2784] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:05:27 2022] POST /identity/v3/users => generated 303 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:05:28.134021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751596f-816e-44c0-8dd5-5f9d05b11d1d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:28.149195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751596f-816e-44c0-8dd5-5f9d05b11d1d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:28.161732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b159db7-13bd-4014-a0e5-0707ed29c9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:28.162370 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b159db7-13bd-4014-a0e5-0707ed29c9b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:28.162720 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b159db7-13bd-4014-a0e5-0707ed29c9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:28.168323 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b159db7-13bd-4014-a0e5-0707ed29c9b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:28.169107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b159db7-13bd-4014-a0e5-0707ed29c9b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:28.170887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b159db7-13bd-4014-a0e5-0707ed29c9b0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:28.189391 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1401/2785] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:05:28.189890 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49570347-679b-4d3d-91d6-58d123e9e6ce admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:28.203864 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49570347-679b-4d3d-91d6-58d123e9e6ce admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:28.212558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a107a-df01-40d3-90e9-f89c543ae22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:28.213927 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a107a-df01-40d3-90e9-f89c543ae22b admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:28.214218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a107a-df01-40d3-90e9-f89c543ae22b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:28.214495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a107a-df01-40d3-90e9-f89c543ae22b admin admin] PATH_INFO: `/v3/projects/2285a443474d4be9801b7f8d6cb0d15f/users/8c3d6ec5e7e74eed9b757fd7acb2e8b7/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:28.237920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3a107a-df01-40d3-90e9-f89c543ae22b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2285a443474d4be9801b7f8d6cb0d15f, user_id=8c3d6ec5e7e74eed9b757fd7acb2e8b7, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:28.241733 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3a107a-df01-40d3-90e9-f89c543ae22b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:28.267777 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1385/2786] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:05:28 2022] PUT /identity/v3/projects/2285a443474d4be9801b7f8d6cb0d15f/users/8c3d6ec5e7e74eed9b757fd7acb2e8b7/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:05:28.271807 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b159db7-13bd-4014-a0e5-0707ed29c9b0 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:28.282730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b159db7-13bd-4014-a0e5-0707ed29c9b0 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:28.375297 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca69ff6-c4bc-40e5-aa27-4be234e6ac75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:28.376849 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca69ff6-c4bc-40e5-aa27-4be234e6ac75 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:28.377328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca69ff6-c4bc-40e5-aa27-4be234e6ac75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:28.377781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca69ff6-c4bc-40e5-aa27-4be234e6ac75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:28.379198 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca69ff6-c4bc-40e5-aa27-4be234e6ac75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:28.381085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca69ff6-c4bc-40e5-aa27-4be234e6ac75 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:28.393991 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1402/2787] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:05:28.398425 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a107a-df01-40d3-90e9-f89c543ae22b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:28.416260 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a107a-df01-40d3-90e9-f89c543ae22b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:28.430218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d09c9-13e4-474c-a7ad-085512f28cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:28.431057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d09c9-13e4-474c-a7ad-085512f28cc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:28.431443 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d09c9-13e4-474c-a7ad-085512f28cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:28.431809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d09c9-13e4-474c-a7ad-085512f28cc2 admin admin] PATH_INFO: `/v3/projects/2285a443474d4be9801b7f8d6cb0d15f/users/8c3d6ec5e7e74eed9b757fd7acb2e8b7/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:28.434606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d09c9-13e4-474c-a7ad-085512f28cc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2285a443474d4be9801b7f8d6cb0d15f, user_id=8c3d6ec5e7e74eed9b757fd7acb2e8b7, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:28.437460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d09c9-13e4-474c-a7ad-085512f28cc2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:28.457675 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1386/2788] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:05:28 2022] PUT /identity/v3/projects/2285a443474d4be9801b7f8d6cb0d15f/users/8c3d6ec5e7e74eed9b757fd7acb2e8b7/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:05:28.467600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975eb82-6126-450d-9184-5977803ef40f None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:28.467895 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975eb82-6126-450d-9184-5977803ef40f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:28.468401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975eb82-6126-450d-9184-5977803ef40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:28.540005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-9975eb82-6126-450d-9184-5977803ef40f None None] MFA Rules not processed for user `8c3d6ec5e7e74eed9b757fd7acb2e8b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:28.541580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9975eb82-6126-450d-9184-5977803ef40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:28.649370 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1403/2789] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:28 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:28.786577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d09c9-13e4-474c-a7ad-085512f28cc2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:28.794341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-547d09c9-13e4-474c-a7ad-085512f28cc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:28.910206 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d09c9-13e4-474c-a7ad-085512f28cc2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:28.919514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc80d0-9fcf-4175-adb2-61d76bf7de3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:28.923117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc80d0-9fcf-4175-adb2-61d76bf7de3e service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:28.923779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc80d0-9fcf-4175-adb2-61d76bf7de3e service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:28.924841 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc80d0-9fcf-4175-adb2-61d76bf7de3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:28.939341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc80d0-9fcf-4175-adb2-61d76bf7de3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:28.944527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc80d0-9fcf-4175-adb2-61d76bf7de3e service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:28.975894 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1387/2790] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:05:28 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:05:29.262091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975eb82-6126-450d-9184-5977803ef40f None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:29.305675 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:29.361322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975eb82-6126-450d-9184-5977803ef40f None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:29.367865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b5ba0-2514-484c-946b-acbb68aff8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:29.368735 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b5ba0-2514-484c-946b-acbb68aff8bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:29.369164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b5ba0-2514-484c-946b-acbb68aff8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:29.369640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b5ba0-2514-484c-946b-acbb68aff8bc admin admin] PATH_INFO: `/v3/users/e0f775dfd7194bdebf1d5a5baf280448` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:29.371183 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b5ba0-2514-484c-946b-acbb68aff8bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0f775dfd7194bdebf1d5a5baf280448)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:29.373522 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b5ba0-2514-484c-946b-acbb68aff8bc admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:29.460892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7d6b5ba0-2514-484c-946b-acbb68aff8bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0f775dfd7194bdebf1d5a5baf280448'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:29.461743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7d6b5ba0-2514-484c-946b-acbb68aff8bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0f775dfd7194bdebf1d5a5baf280448'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:29.472461 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7d6b5ba0-2514-484c-946b-acbb68aff8bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0f775dfd7194bdebf1d5a5baf280448'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:29.485727 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7d6b5ba0-2514-484c-946b-acbb68aff8bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0f775dfd7194bdebf1d5a5baf280448'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:29.487248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7d6b5ba0-2514-484c-946b-acbb68aff8bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0f775dfd7194bdebf1d5a5baf280448'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:29.514843 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1404/2791] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:05:29 2022] DELETE /identity/v3/users/e0f775dfd7194bdebf1d5a5baf280448 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:29.519608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef581d-295c-4fb6-8f70-1ca14430bbbb None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:29.519899 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef581d-295c-4fb6-8f70-1ca14430bbbb None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:29.520171 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef581d-295c-4fb6-8f70-1ca14430bbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:29.561346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-44ef581d-295c-4fb6-8f70-1ca14430bbbb None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:29.562897 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-44ef581d-295c-4fb6-8f70-1ca14430bbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:29.669379 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1388/2792] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:29.720045 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b5ba0-2514-484c-946b-acbb68aff8bc admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:29.721552 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7d6b5ba0-2514-484c-946b-acbb68aff8bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:29.867397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b5ba0-2514-484c-946b-acbb68aff8bc admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:29.875512 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b78178-1de3-4adc-9efb-a59d9d65e20c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:29.876537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b78178-1de3-4adc-9efb-a59d9d65e20c service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:29.877986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b78178-1de3-4adc-9efb-a59d9d65e20c service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:29.878480 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b78178-1de3-4adc-9efb-a59d9d65e20c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:29.912414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b78178-1de3-4adc-9efb-a59d9d65e20c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:29.917252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b78178-1de3-4adc-9efb-a59d9d65e20c service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:29.957455 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1405/2793] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:05:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:05:30.648151 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c16fe-ccf7-4e09-9dd2-81d9a5756833 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:30.648648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c16fe-ccf7-4e09-9dd2-81d9a5756833 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:30.648748 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c16fe-ccf7-4e09-9dd2-81d9a5756833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:30.719539 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c37c16fe-ccf7-4e09-9dd2-81d9a5756833 None None] MFA Rules not processed for user `9482689feb8c4b6dad361610438a1b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:30.720794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c37c16fe-ccf7-4e09-9dd2-81d9a5756833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:30.804329 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:30.826834 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b78178-1de3-4adc-9efb-a59d9d65e20c service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:30.828266 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-88b78178-1de3-4adc-9efb-a59d9d65e20c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:30.905031 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1389/2794] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:30.905031 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c16fe-ccf7-4e09-9dd2-81d9a5756833 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:30.907853 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c37c16fe-ccf7-4e09-9dd2-81d9a5756833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:30.945294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c16fe-ccf7-4e09-9dd2-81d9a5756833 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:30.960303 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7f808-9ddc-4fcf-b71d-9dd065c2a2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:30.961601 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7f808-9ddc-4fcf-b71d-9dd065c2a2da admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:30.962606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7f808-9ddc-4fcf-b71d-9dd065c2a2da admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:30.963548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7f808-9ddc-4fcf-b71d-9dd065c2a2da admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:30.965475 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7f808-9ddc-4fcf-b71d-9dd065c2a2da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:30.967990 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7f808-9ddc-4fcf-b71d-9dd065c2a2da admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:30.970721 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:31.046813 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b78178-1de3-4adc-9efb-a59d9d65e20c service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:31.060059 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1390/2795] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:05:30 2022] POST /identity/v3/projects => generated 383 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:05:31.062537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7f808-9ddc-4fcf-b71d-9dd065c2a2da admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:31.067042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09b968-a5ff-427c-a160-ba34a20232c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:31.069632 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09b968-a5ff-427c-a160-ba34a20232c8 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:31.070046 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09b968-a5ff-427c-a160-ba34a20232c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:31.070643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09b968-a5ff-427c-a160-ba34a20232c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:31.077005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5b09b968-a5ff-427c-a160-ba34a20232c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:31.110542 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09b968-a5ff-427c-a160-ba34a20232c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:31.114576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09b968-a5ff-427c-a160-ba34a20232c8 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:31.145463 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1406/2796] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:05:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:05:31.228299 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7f808-9ddc-4fcf-b71d-9dd065c2a2da admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:31.239229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b63b2-5676-4418-8880-ef67f3cdca73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:31.240141 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b63b2-5676-4418-8880-ef67f3cdca73 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:31.242358 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b63b2-5676-4418-8880-ef67f3cdca73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:31.242818 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b63b2-5676-4418-8880-ef67f3cdca73 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:31.243674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b63b2-5676-4418-8880-ef67f3cdca73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:31.247312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b63b2-5676-4418-8880-ef67f3cdca73 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:31.308373 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1391/2797] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:05:31 2022] POST /identity/v3/users => generated 298 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:05:31.313721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09b968-a5ff-427c-a160-ba34a20232c8 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:31.329848 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09b968-a5ff-427c-a160-ba34a20232c8 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:31.363934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045f490-b3d1-4282-869b-adc45e8e1ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:31.364830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045f490-b3d1-4282-869b-adc45e8e1ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:31.365268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045f490-b3d1-4282-869b-adc45e8e1ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:31.365825 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045f490-b3d1-4282-869b-adc45e8e1ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:31.366645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045f490-b3d1-4282-869b-adc45e8e1ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:31.372639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045f490-b3d1-4282-869b-adc45e8e1ee6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:31.390628 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1407/2798] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:05:31.394497 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b63b2-5676-4418-8880-ef67f3cdca73 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:31.409763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b63b2-5676-4418-8880-ef67f3cdca73 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:31.415360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9bd502-ef16-4a0c-8f65-c0309b3a4d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:31.416202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bd502-ef16-4a0c-8f65-c0309b3a4d93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:31.416487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bd502-ef16-4a0c-8f65-c0309b3a4d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:31.416779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bd502-ef16-4a0c-8f65-c0309b3a4d93 admin admin] PATH_INFO: `/v3/projects/d347c2c0556e43a8a8cf5d319d8e119f/users/d4c163ad5ee148848513367b5e997c34/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:31.434615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9bd502-ef16-4a0c-8f65-c0309b3a4d93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d347c2c0556e43a8a8cf5d319d8e119f, user_id=d4c163ad5ee148848513367b5e997c34, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:31.438415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9bd502-ef16-4a0c-8f65-c0309b3a4d93 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:31.473763 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1392/2799] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:05:31 2022] PUT /identity/v3/projects/d347c2c0556e43a8a8cf5d319d8e119f/users/d4c163ad5ee148848513367b5e997c34/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:31.476156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045f490-b3d1-4282-869b-adc45e8e1ee6 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:31.486610 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045f490-b3d1-4282-869b-adc45e8e1ee6 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:31.625339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbc105-35e0-431b-933d-a6646da1e8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:31.625983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbc105-35e0-431b-933d-a6646da1e8bd admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:31.626825 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbc105-35e0-431b-933d-a6646da1e8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:31.626825 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbc105-35e0-431b-933d-a6646da1e8bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:31.627152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbc105-35e0-431b-933d-a6646da1e8bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:31.628752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbc105-35e0-431b-933d-a6646da1e8bd admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:31.660075 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1408/2800] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:05:31.661928 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9bd502-ef16-4a0c-8f65-c0309b3a4d93 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:31.680549 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9bd502-ef16-4a0c-8f65-c0309b3a4d93 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:31.699492 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56d9a8-eec8-455c-884b-ce04f36b4100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:31.700493 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56d9a8-eec8-455c-884b-ce04f36b4100 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:31.701044 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56d9a8-eec8-455c-884b-ce04f36b4100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:31.701486 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56d9a8-eec8-455c-884b-ce04f36b4100 admin admin] PATH_INFO: `/v3/projects/d347c2c0556e43a8a8cf5d319d8e119f/users/d4c163ad5ee148848513367b5e997c34/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:31.711866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a56d9a8-eec8-455c-884b-ce04f36b4100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d347c2c0556e43a8a8cf5d319d8e119f, user_id=d4c163ad5ee148848513367b5e997c34, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:31.716155 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a56d9a8-eec8-455c-884b-ce04f36b4100 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:31.743563 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1393/2801] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:05:31 2022] PUT /identity/v3/projects/d347c2c0556e43a8a8cf5d319d8e119f/users/d4c163ad5ee148848513367b5e997c34/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:31.868657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbc105-35e0-431b-933d-a6646da1e8bd admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:31.871398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f1bbc105-35e0-431b-933d-a6646da1e8bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:31.911747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbc105-35e0-431b-933d-a6646da1e8bd admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:32.035115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b484c1bf-e593-45d0-ab36-ba0865be630a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:32.036741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484c1bf-e593-45d0-ab36-ba0865be630a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:32.037360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484c1bf-e593-45d0-ab36-ba0865be630a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:32.038123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484c1bf-e593-45d0-ab36-ba0865be630a admin admin] PATH_INFO: `/v3/projects/174b8a5acea14af7b7bca4c179db88bc` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:32.039850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b484c1bf-e593-45d0-ab36-ba0865be630a admin admin] RBAC: Authorizing `identity:delete_project(project_id=174b8a5acea14af7b7bca4c179db88bc)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:32.043777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b484c1bf-e593-45d0-ab36-ba0865be630a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:32.102438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b484c1bf-e593-45d0-ab36-ba0865be630a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '174b8a5acea14af7b7bca4c179db88bc', 'request_id': 'req-b484c1bf-e593-45d0-ab36-ba0865be630a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:32.118403 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b484c1bf-e593-45d0-ab36-ba0865be630a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '174b8a5acea14af7b7bca4c179db88bc', 'request_id': 'req-b484c1bf-e593-45d0-ab36-ba0865be630a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:32.121558 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:32.127603 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b484c1bf-e593-45d0-ab36-ba0865be630a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '174b8a5acea14af7b7bca4c179db88bc', 'request_id': 'req-b484c1bf-e593-45d0-ab36-ba0865be630a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:32.167351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b484c1bf-e593-45d0-ab36-ba0865be630a admin admin] The token cache is being invalidate because project 174b8a5acea14af7b7bca4c179db88bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:05:32.167777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b484c1bf-e593-45d0-ab36-ba0865be630a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:32.170515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b484c1bf-e593-45d0-ab36-ba0865be630a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:32.173516 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1409/2802] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:05:31 2022] DELETE /identity/v3/projects/174b8a5acea14af7b7bca4c179db88bc => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:32.177207 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56d9a8-eec8-455c-884b-ce04f36b4100 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:32.179737 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0a56d9a8-eec8-455c-884b-ce04f36b4100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:32.205049 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56d9a8-eec8-455c-884b-ce04f36b4100 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:32.294703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d279679-c16f-46a2-ac1d-deaee98454d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:32.295358 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d279679-c16f-46a2-ac1d-deaee98454d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:32.295646 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d279679-c16f-46a2-ac1d-deaee98454d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:32.295924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d279679-c16f-46a2-ac1d-deaee98454d2 admin admin] PATH_INFO: `/v3/users/8c3d6ec5e7e74eed9b757fd7acb2e8b7` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:32.297129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d279679-c16f-46a2-ac1d-deaee98454d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c3d6ec5e7e74eed9b757fd7acb2e8b7)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:32.300581 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d279679-c16f-46a2-ac1d-deaee98454d2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:32.306929 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:32.377166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3d279679-c16f-46a2-ac1d-deaee98454d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c3d6ec5e7e74eed9b757fd7acb2e8b7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:32.378041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3d279679-c16f-46a2-ac1d-deaee98454d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c3d6ec5e7e74eed9b757fd7acb2e8b7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:32.388399 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3d279679-c16f-46a2-ac1d-deaee98454d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c3d6ec5e7e74eed9b757fd7acb2e8b7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:32.400711 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3d279679-c16f-46a2-ac1d-deaee98454d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c3d6ec5e7e74eed9b757fd7acb2e8b7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:32.401858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3d279679-c16f-46a2-ac1d-deaee98454d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c3d6ec5e7e74eed9b757fd7acb2e8b7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:32.461379 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1394/2803] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:05:32 2022] DELETE /identity/v3/users/8c3d6ec5e7e74eed9b757fd7acb2e8b7 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:33.252893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b484c1bf-e593-45d0-ab36-ba0865be630a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:33.276943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b484c1bf-e593-45d0-ab36-ba0865be630a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:33.386879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84400a43-91a7-4d67-a1a0-783a0ef9a22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:33.387650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84400a43-91a7-4d67-a1a0-783a0ef9a22b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:33.387933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84400a43-91a7-4d67-a1a0-783a0ef9a22b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:33.388205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84400a43-91a7-4d67-a1a0-783a0ef9a22b admin admin] PATH_INFO: `/v3/projects/2285a443474d4be9801b7f8d6cb0d15f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:33.389586 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84400a43-91a7-4d67-a1a0-783a0ef9a22b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2285a443474d4be9801b7f8d6cb0d15f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:33.392189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84400a43-91a7-4d67-a1a0-783a0ef9a22b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:33.493845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-84400a43-91a7-4d67-a1a0-783a0ef9a22b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2285a443474d4be9801b7f8d6cb0d15f', 'request_id': 'req-84400a43-91a7-4d67-a1a0-783a0ef9a22b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:33.514316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-84400a43-91a7-4d67-a1a0-783a0ef9a22b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2285a443474d4be9801b7f8d6cb0d15f', 'request_id': 'req-84400a43-91a7-4d67-a1a0-783a0ef9a22b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:33.522992 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-84400a43-91a7-4d67-a1a0-783a0ef9a22b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2285a443474d4be9801b7f8d6cb0d15f', 'request_id': 'req-84400a43-91a7-4d67-a1a0-783a0ef9a22b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:33.549444 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-84400a43-91a7-4d67-a1a0-783a0ef9a22b admin admin] The token cache is being invalidate because project 2285a443474d4be9801b7f8d6cb0d15f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:05:33.549743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-84400a43-91a7-4d67-a1a0-783a0ef9a22b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:33.550410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-84400a43-91a7-4d67-a1a0-783a0ef9a22b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:33.552238 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1410/2804] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:05:33 2022] DELETE /identity/v3/projects/2285a443474d4be9801b7f8d6cb0d15f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:33.557566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de4bfe-51e7-4258-ac09-5de50c99fc14 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:33.558085 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de4bfe-51e7-4258-ac09-5de50c99fc14 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:33.558354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de4bfe-51e7-4258-ac09-5de50c99fc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:33.594693 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-81de4bfe-51e7-4258-ac09-5de50c99fc14 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:33.608089 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-81de4bfe-51e7-4258-ac09-5de50c99fc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:33.739769 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1395/2805] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:33.747806 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d543310-d5e2-4195-b996-2b6ef3735cad None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:33.748150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d543310-d5e2-4195-b996-2b6ef3735cad None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:33.748609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d543310-d5e2-4195-b996-2b6ef3735cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:33.805421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-1d543310-d5e2-4195-b996-2b6ef3735cad None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:33.807206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1d543310-d5e2-4195-b996-2b6ef3735cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:33.823189 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1411/2806] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:33.827077 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de4bfe-51e7-4258-ac09-5de50c99fc14 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:33.840459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de4bfe-51e7-4258-ac09-5de50c99fc14 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:33.847294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba24b8-4feb-486a-ab6c-fc2c2ffbc1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:33.847980 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba24b8-4feb-486a-ab6c-fc2c2ffbc1fa admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:33.848390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba24b8-4feb-486a-ab6c-fc2c2ffbc1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:33.848910 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba24b8-4feb-486a-ab6c-fc2c2ffbc1fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:33.849798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba24b8-4feb-486a-ab6c-fc2c2ffbc1fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:05:33.850595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba24b8-4feb-486a-ab6c-fc2c2ffbc1fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:33.852889 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba24b8-4feb-486a-ab6c-fc2c2ffbc1fa admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:33.869399 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1396/2807] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:05:33.873646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d543310-d5e2-4195-b996-2b6ef3735cad None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:33.886399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d543310-d5e2-4195-b996-2b6ef3735cad None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:33.894507 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c1eb3-eee8-433e-b485-451b3d43a90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:33.897354 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c1eb3-eee8-433e-b485-451b3d43a90b admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:33.898673 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c1eb3-eee8-433e-b485-451b3d43a90b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:33.899245 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c1eb3-eee8-433e-b485-451b3d43a90b admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:33.900401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c1eb3-eee8-433e-b485-451b3d43a90b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:33.904681 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c1eb3-eee8-433e-b485-451b3d43a90b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:33.989148 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1412/2808] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:05:33 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:05:33.989577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba24b8-4feb-486a-ab6c-fc2c2ffbc1fa admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:34.009664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba24b8-4feb-486a-ab6c-fc2c2ffbc1fa admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:34.151344 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1241c-48c9-4c84-ad93-81f79c05b4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:34.152303 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1241c-48c9-4c84-ad93-81f79c05b4b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:34.152883 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1241c-48c9-4c84-ad93-81f79c05b4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:34.153298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1241c-48c9-4c84-ad93-81f79c05b4b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:34.154219 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1241c-48c9-4c84-ad93-81f79c05b4b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:34.156669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1241c-48c9-4c84-ad93-81f79c05b4b2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:34.192909 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:34.210244 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1397/2809] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:05:33 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:05:34.211521 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c1eb3-eee8-433e-b485-451b3d43a90b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:34.235163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c1eb3-eee8-433e-b485-451b3d43a90b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:34.243133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daebb62a-80b2-4d10-bf7d-282e8378f150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:34.243762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebb62a-80b2-4d10-bf7d-282e8378f150 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:34.244044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebb62a-80b2-4d10-bf7d-282e8378f150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:34.244344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebb62a-80b2-4d10-bf7d-282e8378f150 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:34.244970 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daebb62a-80b2-4d10-bf7d-282e8378f150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:34.248834 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daebb62a-80b2-4d10-bf7d-282e8378f150 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:34.279136 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1241c-48c9-4c84-ad93-81f79c05b4b2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:34.281838 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1413/2810] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:05:34.295033 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1241c-48c9-4c84-ad93-81f79c05b4b2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:34.308669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc2ec0-b182-41be-b638-2f43670ec576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:34.311693 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc2ec0-b182-41be-b638-2f43670ec576 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:34.312172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc2ec0-b182-41be-b638-2f43670ec576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:34.312677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc2ec0-b182-41be-b638-2f43670ec576 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:34.313702 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc2ec0-b182-41be-b638-2f43670ec576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:34.316238 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc2ec0-b182-41be-b638-2f43670ec576 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:34.344352 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1398/2811] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:05:34.345666 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daebb62a-80b2-4d10-bf7d-282e8378f150 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:34.360466 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daebb62a-80b2-4d10-bf7d-282e8378f150 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:34.376704 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5357266-7df4-4997-bc77-33afb8fb4d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:34.377717 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5357266-7df4-4997-bc77-33afb8fb4d86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:34.378091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5357266-7df4-4997-bc77-33afb8fb4d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:34.378308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5357266-7df4-4997-bc77-33afb8fb4d86 admin admin] PATH_INFO: `/v3/projects/67221db8c1c548fc903207a53f0559f8/users/3196a04fa8814d48b767b98e6830621c/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:34.407873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5357266-7df4-4997-bc77-33afb8fb4d86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67221db8c1c548fc903207a53f0559f8, user_id=3196a04fa8814d48b767b98e6830621c, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:34.410639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5357266-7df4-4997-bc77-33afb8fb4d86 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:34.453737 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ca4d3-4a5b-42b2-8d06-606821bbe658 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:34.453737 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ca4d3-4a5b-42b2-8d06-606821bbe658 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:34.453737 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ca4d3-4a5b-42b2-8d06-606821bbe658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:34.455203 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1414/2812] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:05:34 2022] PUT /identity/v3/projects/67221db8c1c548fc903207a53f0559f8/users/3196a04fa8814d48b767b98e6830621c/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:34.510005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a70ca4d3-4a5b-42b2-8d06-606821bbe658 None None] MFA Rules not processed for user `3196a04fa8814d48b767b98e6830621c`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:34.511319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a70ca4d3-4a5b-42b2-8d06-606821bbe658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:34.704837 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1399/2813] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:34.711528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5357266-7df4-4997-bc77-33afb8fb4d86 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:34.744985 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:34.877837 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5357266-7df4-4997-bc77-33afb8fb4d86 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:34.892698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc8dd7-5551-4cab-9987-e63ef6339cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:34.894569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc8dd7-5551-4cab-9987-e63ef6339cc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:34.894856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc8dd7-5551-4cab-9987-e63ef6339cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:34.896311 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc8dd7-5551-4cab-9987-e63ef6339cc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:34.897029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc8dd7-5551-4cab-9987-e63ef6339cc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:34.901332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc8dd7-5551-4cab-9987-e63ef6339cc3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:34.955706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ca4d3-4a5b-42b2-8d06-606821bbe658 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:34.957150 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a70ca4d3-4a5b-42b2-8d06-606821bbe658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:34.982906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ca4d3-4a5b-42b2-8d06-606821bbe658 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:35.001049 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a663d0-16b4-486d-b65b-0a027958ca8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:35.001843 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a663d0-16b4-486d-b65b-0a027958ca8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:35.002058 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a663d0-16b4-486d-b65b-0a027958ca8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:35.002299 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a663d0-16b4-486d-b65b-0a027958ca8c admin admin] PATH_INFO: `/v3/users/545e0ebcbe314ee1a8419e3583e74d23` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:35.003463 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a663d0-16b4-486d-b65b-0a027958ca8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=545e0ebcbe314ee1a8419e3583e74d23)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:35.005462 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a663d0-16b4-486d-b65b-0a027958ca8c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:35.007965 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1415/2814] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:05:34 2022] POST /identity/v3/projects => generated 377 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:05:35.009952 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc8dd7-5551-4cab-9987-e63ef6339cc3 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:35.111388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a7a663d0-16b4-486d-b65b-0a027958ca8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '545e0ebcbe314ee1a8419e3583e74d23'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:35.112085 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a7a663d0-16b4-486d-b65b-0a027958ca8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '545e0ebcbe314ee1a8419e3583e74d23'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:35.129176 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a7a663d0-16b4-486d-b65b-0a027958ca8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '545e0ebcbe314ee1a8419e3583e74d23'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:35.136744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc8dd7-5551-4cab-9987-e63ef6339cc3 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:35.142574 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef839a9-a1f2-4b28-a91f-e2785903c428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:35.143673 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef839a9-a1f2-4b28-a91f-e2785903c428 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:35.144382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef839a9-a1f2-4b28-a91f-e2785903c428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:35.144382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef839a9-a1f2-4b28-a91f-e2785903c428 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:35.145478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef839a9-a1f2-4b28-a91f-e2785903c428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:35.147729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef839a9-a1f2-4b28-a91f-e2785903c428 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:35.149573 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a7a663d0-16b4-486d-b65b-0a027958ca8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '545e0ebcbe314ee1a8419e3583e74d23'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:35.150477 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a7a663d0-16b4-486d-b65b-0a027958ca8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '545e0ebcbe314ee1a8419e3583e74d23'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:35.181491 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1416/2815] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:05:35 2022] POST /identity/v3/users => generated 295 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:05:35.185294 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1400/2816] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:05:34 2022] DELETE /identity/v3/users/545e0ebcbe314ee1a8419e3583e74d23 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:05:35.185499 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef839a9-a1f2-4b28-a91f-e2785903c428 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:35.190987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-aef839a9-a1f2-4b28-a91f-e2785903c428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:35.206084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef839a9-a1f2-4b28-a91f-e2785903c428 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:35.298695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4139cb-cb12-4b0a-9060-214ff53d59b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:35.300992 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4139cb-cb12-4b0a-9060-214ff53d59b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:35.301517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4139cb-cb12-4b0a-9060-214ff53d59b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:35.301955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4139cb-cb12-4b0a-9060-214ff53d59b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:35.304547 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4139cb-cb12-4b0a-9060-214ff53d59b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:35.306559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4139cb-cb12-4b0a-9060-214ff53d59b0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:35.319147 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1417/2817] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:05:35.323557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a663d0-16b4-486d-b65b-0a027958ca8c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:35.350296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a663d0-16b4-486d-b65b-0a027958ca8c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:35.356517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2dec4-27cb-4afa-bcd9-19aea9dad761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:35.357957 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2dec4-27cb-4afa-bcd9-19aea9dad761 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:35.359030 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2dec4-27cb-4afa-bcd9-19aea9dad761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:35.359502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2dec4-27cb-4afa-bcd9-19aea9dad761 admin admin] PATH_INFO: `/v3/projects/507b6658861d459bbcf665d0ce6353c6/users/e2b71aef4ef646e5aec42e887709a27a/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:35.384397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd2dec4-27cb-4afa-bcd9-19aea9dad761 admin admin] RBAC: Authorizing `identity:create_grant(project_id=507b6658861d459bbcf665d0ce6353c6, user_id=e2b71aef4ef646e5aec42e887709a27a, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:35.389591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd2dec4-27cb-4afa-bcd9-19aea9dad761 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:35.414227 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1401/2818] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:05:35 2022] PUT /identity/v3/projects/507b6658861d459bbcf665d0ce6353c6/users/e2b71aef4ef646e5aec42e887709a27a/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:35.414913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4139cb-cb12-4b0a-9060-214ff53d59b0 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:35.431645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4139cb-cb12-4b0a-9060-214ff53d59b0 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:35.520355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c95a3e-d502-4a7b-9fef-859ea6257664 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:35.521263 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:35.521866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c95a3e-d502-4a7b-9fef-859ea6257664 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:35.522416 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c95a3e-d502-4a7b-9fef-859ea6257664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:35.581000 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-63c95a3e-d502-4a7b-9fef-859ea6257664 None None] MFA Rules not processed for user `a4c913daf63c433287eaf338b4ab2070`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:35.582265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-63c95a3e-d502-4a7b-9fef-859ea6257664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:35.628609 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:35.640955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd63474-0d77-4784-ac55-a28ad7db5072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:35.641855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd63474-0d77-4784-ac55-a28ad7db5072 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:35.642260 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd63474-0d77-4784-ac55-a28ad7db5072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:35.642602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd63474-0d77-4784-ac55-a28ad7db5072 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:35.644481 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd63474-0d77-4784-ac55-a28ad7db5072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:35.648851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd63474-0d77-4784-ac55-a28ad7db5072 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:35.671421 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1418/2819] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:05:35.672767 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd63474-0d77-4784-ac55-a28ad7db5072 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:35.687945 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd63474-0d77-4784-ac55-a28ad7db5072 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:35.702751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95cdcf-2e54-4d86-b672-10198ad71b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:35.703595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95cdcf-2e54-4d86-b672-10198ad71b7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:35.704362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95cdcf-2e54-4d86-b672-10198ad71b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:35.704362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95cdcf-2e54-4d86-b672-10198ad71b7c admin admin] PATH_INFO: `/v3/projects/507b6658861d459bbcf665d0ce6353c6/users/e2b71aef4ef646e5aec42e887709a27a/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:35.704914 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1402/2820] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:35.706384 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c95a3e-d502-4a7b-9fef-859ea6257664 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:35.711866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-63c95a3e-d502-4a7b-9fef-859ea6257664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:35.712860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95cdcf-2e54-4d86-b672-10198ad71b7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=507b6658861d459bbcf665d0ce6353c6, user_id=e2b71aef4ef646e5aec42e887709a27a, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:35.716025 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95cdcf-2e54-4d86-b672-10198ad71b7c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:35.757871 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1419/2821] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:05:35 2022] PUT /identity/v3/projects/507b6658861d459bbcf665d0ce6353c6/users/e2b71aef4ef646e5aec42e887709a27a/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:35.759532 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af12dd9-24f4-49dc-b2ad-75fea603fe39 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:35.759924 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af12dd9-24f4-49dc-b2ad-75fea603fe39 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:35.760307 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af12dd9-24f4-49dc-b2ad-75fea603fe39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:35.782207 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c95a3e-d502-4a7b-9fef-859ea6257664 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:35.793647 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-9af12dd9-24f4-49dc-b2ad-75fea603fe39 None None] MFA Rules not processed for user `e2b71aef4ef646e5aec42e887709a27a`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:35.795357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9af12dd9-24f4-49dc-b2ad-75fea603fe39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:35.904528 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1420/2822] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:35.910542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570fcd4b-8905-4017-8c12-30bf9ab53094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:35.911382 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fcd4b-8905-4017-8c12-30bf9ab53094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:35.911849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fcd4b-8905-4017-8c12-30bf9ab53094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:35.912300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fcd4b-8905-4017-8c12-30bf9ab53094 admin admin] PATH_INFO: `/v3/projects/cb1fc9a3f0a24bca8154d8885e2efa7f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:35.914335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570fcd4b-8905-4017-8c12-30bf9ab53094 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb1fc9a3f0a24bca8154d8885e2efa7f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:35.916405 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570fcd4b-8905-4017-8c12-30bf9ab53094 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:36.017696 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-570fcd4b-8905-4017-8c12-30bf9ab53094 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb1fc9a3f0a24bca8154d8885e2efa7f', 'request_id': 'req-570fcd4b-8905-4017-8c12-30bf9ab53094'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:36.034820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-570fcd4b-8905-4017-8c12-30bf9ab53094 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb1fc9a3f0a24bca8154d8885e2efa7f', 'request_id': 'req-570fcd4b-8905-4017-8c12-30bf9ab53094'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:36.042771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-570fcd4b-8905-4017-8c12-30bf9ab53094 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb1fc9a3f0a24bca8154d8885e2efa7f', 'request_id': 'req-570fcd4b-8905-4017-8c12-30bf9ab53094'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:36.065298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-570fcd4b-8905-4017-8c12-30bf9ab53094 admin admin] The token cache is being invalidate because project cb1fc9a3f0a24bca8154d8885e2efa7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:05:36.066084 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-570fcd4b-8905-4017-8c12-30bf9ab53094 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:36.067698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-570fcd4b-8905-4017-8c12-30bf9ab53094 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:36.071339 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1403/2823] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:05:35 2022] DELETE /identity/v3/projects/cb1fc9a3f0a24bca8154d8885e2efa7f => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:36.076163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3bc86-0034-417b-bd7d-603a9caae6cd None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:36.076453 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3bc86-0034-417b-bd7d-603a9caae6cd None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:36.076792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3bc86-0034-417b-bd7d-603a9caae6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:36.128573 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-19b3bc86-0034-417b-bd7d-603a9caae6cd None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:36.129669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-19b3bc86-0034-417b-bd7d-603a9caae6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:36.217830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570fcd4b-8905-4017-8c12-30bf9ab53094 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:36.221182 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-570fcd4b-8905-4017-8c12-30bf9ab53094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:36.270214 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1421/2824] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:36.280722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ea9ee-882f-4c65-9031-a91273f53704 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:36.281066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ea9ee-882f-4c65-9031-a91273f53704 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:36.281352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ea9ee-882f-4c65-9031-a91273f53704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:36.324150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-517ea9ee-882f-4c65-9031-a91273f53704 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:36.327757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-517ea9ee-882f-4c65-9031-a91273f53704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:36.350983 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1422/2825] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:36.352462 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:36.356523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ea9ee-882f-4c65-9031-a91273f53704 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:36.385031 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ea9ee-882f-4c65-9031-a91273f53704 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:36.390114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570fcd4b-8905-4017-8c12-30bf9ab53094 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:36.395034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db728c-cade-4657-9ac4-93a5dfd97f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:36.395669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db728c-cade-4657-9ac4-93a5dfd97f9c admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:36.395950 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db728c-cade-4657-9ac4-93a5dfd97f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:36.396224 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db728c-cade-4657-9ac4-93a5dfd97f9c admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:36.396933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71db728c-cade-4657-9ac4-93a5dfd97f9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:05:36.397239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71db728c-cade-4657-9ac4-93a5dfd97f9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:36.399639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71db728c-cade-4657-9ac4-93a5dfd97f9c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:36.408791 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e2756-e9a6-4a03-adf1-1a3811b2b0dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:36.409461 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e2756-e9a6-4a03-adf1-1a3811b2b0dd service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:36.409750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e2756-e9a6-4a03-adf1-1a3811b2b0dd service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:36.410028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e2756-e9a6-4a03-adf1-1a3811b2b0dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:36.416392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-002e2756-e9a6-4a03-adf1-1a3811b2b0dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:36.431525 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1423/2826] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:05:36.433148 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db728c-cade-4657-9ac4-93a5dfd97f9c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:36.468475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db728c-cade-4657-9ac4-93a5dfd97f9c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:36.476207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed2048-f232-40f5-99b5-0417f6fa381d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:36.477702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed2048-f232-40f5-99b5-0417f6fa381d admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:36.478169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed2048-f232-40f5-99b5-0417f6fa381d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:36.478741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed2048-f232-40f5-99b5-0417f6fa381d admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:36.480490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed2048-f232-40f5-99b5-0417f6fa381d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:36.484798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed2048-f232-40f5-99b5-0417f6fa381d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:36.515102 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:36.572005 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1424/2827] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:05:36 2022] POST /identity/v3/projects => generated 393 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:05:36.573130 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed2048-f232-40f5-99b5-0417f6fa381d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:36.595213 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e2756-e9a6-4a03-adf1-1a3811b2b0dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:36.597036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e2756-e9a6-4a03-adf1-1a3811b2b0dd service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:36.610738 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1404/2828] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:05:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:05:36.686742 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed2048-f232-40f5-99b5-0417f6fa381d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:36.694579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399a0ef-bf2b-4ace-80e1-9c303d61a426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:36.695209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399a0ef-bf2b-4ace-80e1-9c303d61a426 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:36.695487 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399a0ef-bf2b-4ace-80e1-9c303d61a426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:36.695757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399a0ef-bf2b-4ace-80e1-9c303d61a426 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:36.696404 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7399a0ef-bf2b-4ace-80e1-9c303d61a426 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:36.699712 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7399a0ef-bf2b-4ace-80e1-9c303d61a426 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:36.771622 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1425/2829] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:05:36 2022] POST /identity/v3/users => generated 297 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:05:36.775156 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e2756-e9a6-4a03-adf1-1a3811b2b0dd service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:36.788750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e2756-e9a6-4a03-adf1-1a3811b2b0dd service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:36.795780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd41f42-72ed-49a4-b2bf-863339b7f164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:36.796742 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd41f42-72ed-49a4-b2bf-863339b7f164 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:36.797510 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd41f42-72ed-49a4-b2bf-863339b7f164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:36.798078 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd41f42-72ed-49a4-b2bf-863339b7f164 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:36.799173 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd41f42-72ed-49a4-b2bf-863339b7f164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:36.801676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd41f42-72ed-49a4-b2bf-863339b7f164 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:36.815942 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1405/2830] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:05:36.819791 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399a0ef-bf2b-4ace-80e1-9c303d61a426 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:36.835082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399a0ef-bf2b-4ace-80e1-9c303d61a426 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:36.841763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e16844-1c64-423c-b017-75cffa226215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:36.842551 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e16844-1c64-423c-b017-75cffa226215 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:36.842901 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e16844-1c64-423c-b017-75cffa226215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:36.843310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e16844-1c64-423c-b017-75cffa226215 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:36.844107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e16844-1c64-423c-b017-75cffa226215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:36.848007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e16844-1c64-423c-b017-75cffa226215 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:36.871286 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1426/2831] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:05:36.872335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd41f42-72ed-49a4-b2bf-863339b7f164 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:36.883958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd41f42-72ed-49a4-b2bf-863339b7f164 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:36.905801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172c88f-b194-4a3d-aa15-a60abab8c159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:36.906510 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172c88f-b194-4a3d-aa15-a60abab8c159 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:36.909661 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172c88f-b194-4a3d-aa15-a60abab8c159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:36.909951 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172c88f-b194-4a3d-aa15-a60abab8c159 admin admin] PATH_INFO: `/v3/projects/ccefe92798da4b7f908a1464a922d053/users/8983abd5910949509f36a92708ad02a9/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:36.962996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e172c88f-b194-4a3d-aa15-a60abab8c159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccefe92798da4b7f908a1464a922d053, user_id=8983abd5910949509f36a92708ad02a9, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:36.962996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e172c88f-b194-4a3d-aa15-a60abab8c159 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:37.039976 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1406/2832] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:05:36 2022] PUT /identity/v3/projects/ccefe92798da4b7f908a1464a922d053/users/8983abd5910949509f36a92708ad02a9/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:37.087726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917928a-5132-47b4-9cc4-e31612c625bb None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:37.088176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917928a-5132-47b4-9cc4-e31612c625bb None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:37.088430 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917928a-5132-47b4-9cc4-e31612c625bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:37.163909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-8917928a-5132-47b4-9cc4-e31612c625bb None None] MFA Rules not processed for user `8983abd5910949509f36a92708ad02a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:37.165273 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8917928a-5132-47b4-9cc4-e31612c625bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:37.358271 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1427/2833] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:37.651852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172c88f-b194-4a3d-aa15-a60abab8c159 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:37.894802 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172c88f-b194-4a3d-aa15-a60abab8c159 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:37.902844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae930d24-8eaf-4b2b-9cd4-1bc5eb66ec95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:37.904228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae930d24-8eaf-4b2b-9cd4-1bc5eb66ec95 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:37.904548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae930d24-8eaf-4b2b-9cd4-1bc5eb66ec95 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:37.904823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae930d24-8eaf-4b2b-9cd4-1bc5eb66ec95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:37.915736 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae930d24-8eaf-4b2b-9cd4-1bc5eb66ec95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:37.917830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae930d24-8eaf-4b2b-9cd4-1bc5eb66ec95 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:37.933908 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1407/2834] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:05:37 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:05:38.226716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917928a-5132-47b4-9cc4-e31612c625bb None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:38.228531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8917928a-5132-47b4-9cc4-e31612c625bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:38.354319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae930d24-8eaf-4b2b-9cd4-1bc5eb66ec95 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:38.466474 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:38.472561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917928a-5132-47b4-9cc4-e31612c625bb None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:38.487017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03821ac5-9727-46d8-8978-7e47dcc93156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:38.487981 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03821ac5-9727-46d8-8978-7e47dcc93156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:38.488426 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03821ac5-9727-46d8-8978-7e47dcc93156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:38.488889 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03821ac5-9727-46d8-8978-7e47dcc93156 admin admin] PATH_INFO: `/v3/users/3196a04fa8814d48b767b98e6830621c` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:38.493010 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03821ac5-9727-46d8-8978-7e47dcc93156 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3196a04fa8814d48b767b98e6830621c)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:38.495913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03821ac5-9727-46d8-8978-7e47dcc93156 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:38.501638 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:38.547310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae930d24-8eaf-4b2b-9cd4-1bc5eb66ec95 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:38.562881 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728673bd-ae15-4b95-bf12-3df4b1235813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:38.573761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728673bd-ae15-4b95-bf12-3df4b1235813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:38.575199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728673bd-ae15-4b95-bf12-3df4b1235813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:38.576591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728673bd-ae15-4b95-bf12-3df4b1235813 admin admin] PATH_INFO: `/v3/users/8983abd5910949509f36a92708ad02a9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:38.582725 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728673bd-ae15-4b95-bf12-3df4b1235813 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8983abd5910949509f36a92708ad02a9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:38.587404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728673bd-ae15-4b95-bf12-3df4b1235813 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:38.671095 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-03821ac5-9727-46d8-8978-7e47dcc93156 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3196a04fa8814d48b767b98e6830621c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:38.672024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-03821ac5-9727-46d8-8978-7e47dcc93156 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3196a04fa8814d48b767b98e6830621c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:38.685645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-03821ac5-9727-46d8-8978-7e47dcc93156 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3196a04fa8814d48b767b98e6830621c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:38.715372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-03821ac5-9727-46d8-8978-7e47dcc93156 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3196a04fa8814d48b767b98e6830621c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:38.717034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-03821ac5-9727-46d8-8978-7e47dcc93156 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3196a04fa8814d48b767b98e6830621c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:38.734069 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-728673bd-ae15-4b95-bf12-3df4b1235813 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8983abd5910949509f36a92708ad02a9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:38.736453 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-728673bd-ae15-4b95-bf12-3df4b1235813 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8983abd5910949509f36a92708ad02a9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:38.759124 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-728673bd-ae15-4b95-bf12-3df4b1235813 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8983abd5910949509f36a92708ad02a9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:38.765959 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1428/2835] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:05:38 2022] DELETE /identity/v3/users/3196a04fa8814d48b767b98e6830621c => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:38.774869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e469cac-187e-4430-9d0e-28b33f2c5684 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:38.775160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e469cac-187e-4430-9d0e-28b33f2c5684 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:38.775495 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e469cac-187e-4430-9d0e-28b33f2c5684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:38.788352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-728673bd-ae15-4b95-bf12-3df4b1235813 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8983abd5910949509f36a92708ad02a9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:38.790257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-728673bd-ae15-4b95-bf12-3df4b1235813 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8983abd5910949509f36a92708ad02a9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:38.859245 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-3e469cac-187e-4430-9d0e-28b33f2c5684 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:38.860570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3e469cac-187e-4430-9d0e-28b33f2c5684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:38.878997 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1408/2836] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:05:38 2022] DELETE /identity/v3/users/8983abd5910949509f36a92708ad02a9 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:38.883639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8f448-1b1e-406b-8e63-323f9f3fc9ee None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:38.885333 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8f448-1b1e-406b-8e63-323f9f3fc9ee None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:38.886682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8f448-1b1e-406b-8e63-323f9f3fc9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:38.926552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-05c8f448-1b1e-406b-8e63-323f9f3fc9ee None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:38.928359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-05c8f448-1b1e-406b-8e63-323f9f3fc9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:39.060038 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1429/2837] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:39.070750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e469cac-187e-4430-9d0e-28b33f2c5684 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:39.071980 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3e469cac-187e-4430-9d0e-28b33f2c5684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:39.096702 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1409/2838] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:39.105377 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8f448-1b1e-406b-8e63-323f9f3fc9ee None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:39.107394 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-05c8f448-1b1e-406b-8e63-323f9f3fc9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:39.200798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e469cac-187e-4430-9d0e-28b33f2c5684 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:39.204923 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8f448-1b1e-406b-8e63-323f9f3fc9ee None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:39.208434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50ba5f-9d28-4c81-ae8b-d758d8f1f1c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:39.210115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50ba5f-9d28-4c81-ae8b-d758d8f1f1c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:39.210395 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50ba5f-9d28-4c81-ae8b-d758d8f1f1c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:39.211171 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50ba5f-9d28-4c81-ae8b-d758d8f1f1c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:39.215377 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82683e08-d13e-4175-a431-549778329b4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:39.216016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82683e08-d13e-4175-a431-549778329b4a service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:39.216294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82683e08-d13e-4175-a431-549778329b4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:39.216566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82683e08-d13e-4175-a431-549778329b4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:39.233860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50ba5f-9d28-4c81-ae8b-d758d8f1f1c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:39.236367 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50ba5f-9d28-4c81-ae8b-d758d8f1f1c8 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:39.253546 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1430/2839] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:05:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:05:39.254009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82683e08-d13e-4175-a431-549778329b4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:39.255566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82683e08-d13e-4175-a431-549778329b4a service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:39.299560 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1410/2840] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:05:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:05:40.100821 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50ba5f-9d28-4c81-ae8b-d758d8f1f1c8 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:40.104661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8b50ba5f-9d28-4c81-ae8b-d758d8f1f1c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:40.151879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50ba5f-9d28-4c81-ae8b-d758d8f1f1c8 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:40.166214 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4afb17a-19ac-42fd-b515-2a398040fbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:40.167171 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afb17a-19ac-42fd-b515-2a398040fbc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:40.167610 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afb17a-19ac-42fd-b515-2a398040fbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:40.168046 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afb17a-19ac-42fd-b515-2a398040fbc2 admin admin] PATH_INFO: `/v3/projects/67221db8c1c548fc903207a53f0559f8` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:40.170920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4afb17a-19ac-42fd-b515-2a398040fbc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67221db8c1c548fc903207a53f0559f8)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:40.173072 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4afb17a-19ac-42fd-b515-2a398040fbc2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:40.226873 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:40.283135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f4afb17a-19ac-42fd-b515-2a398040fbc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67221db8c1c548fc903207a53f0559f8', 'request_id': 'req-f4afb17a-19ac-42fd-b515-2a398040fbc2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:40.293842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f4afb17a-19ac-42fd-b515-2a398040fbc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67221db8c1c548fc903207a53f0559f8', 'request_id': 'req-f4afb17a-19ac-42fd-b515-2a398040fbc2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:40.303895 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f4afb17a-19ac-42fd-b515-2a398040fbc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67221db8c1c548fc903207a53f0559f8', 'request_id': 'req-f4afb17a-19ac-42fd-b515-2a398040fbc2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:40.320253 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f4afb17a-19ac-42fd-b515-2a398040fbc2 admin admin] The token cache is being invalidate because project 67221db8c1c548fc903207a53f0559f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:05:40.320934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f4afb17a-19ac-42fd-b515-2a398040fbc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:40.322145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f4afb17a-19ac-42fd-b515-2a398040fbc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:40.326928 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1431/2841] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:05:40 2022] DELETE /identity/v3/projects/67221db8c1c548fc903207a53f0559f8 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:40.330730 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82683e08-d13e-4175-a431-549778329b4a service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:40.341858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82683e08-d13e-4175-a431-549778329b4a service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:40.360412 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:40.472468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe66af9-96e0-4a71-889f-e3587d829aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:40.473115 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe66af9-96e0-4a71-889f-e3587d829aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:40.473397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe66af9-96e0-4a71-889f-e3587d829aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:40.473697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe66af9-96e0-4a71-889f-e3587d829aee admin admin] PATH_INFO: `/v3/users/e2b71aef4ef646e5aec42e887709a27a` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:40.478216 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe66af9-96e0-4a71-889f-e3587d829aee admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2b71aef4ef646e5aec42e887709a27a)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:40.480149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe66af9-96e0-4a71-889f-e3587d829aee admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:40.558333 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dbe66af9-96e0-4a71-889f-e3587d829aee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2b71aef4ef646e5aec42e887709a27a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:40.569231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dbe66af9-96e0-4a71-889f-e3587d829aee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2b71aef4ef646e5aec42e887709a27a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:40.586546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dbe66af9-96e0-4a71-889f-e3587d829aee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2b71aef4ef646e5aec42e887709a27a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:40.597602 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dbe66af9-96e0-4a71-889f-e3587d829aee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2b71aef4ef646e5aec42e887709a27a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:40.598755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dbe66af9-96e0-4a71-889f-e3587d829aee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2b71aef4ef646e5aec42e887709a27a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:40.626840 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1411/2842] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:05:40 2022] DELETE /identity/v3/users/e2b71aef4ef646e5aec42e887709a27a => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:41.214965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4afb17a-19ac-42fd-b515-2a398040fbc2 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:41.216978 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f4afb17a-19ac-42fd-b515-2a398040fbc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:41.235737 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4afb17a-19ac-42fd-b515-2a398040fbc2 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:41.371503 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a834800-967f-4c5b-8148-771a8d735730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:41.372166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a834800-967f-4c5b-8148-771a8d735730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:41.372448 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a834800-967f-4c5b-8148-771a8d735730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:41.372722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a834800-967f-4c5b-8148-771a8d735730 admin admin] PATH_INFO: `/v3/projects/ccefe92798da4b7f908a1464a922d053` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:41.373931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a834800-967f-4c5b-8148-771a8d735730 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccefe92798da4b7f908a1464a922d053)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:41.376173 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a834800-967f-4c5b-8148-771a8d735730 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:41.508422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3a834800-967f-4c5b-8148-771a8d735730 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccefe92798da4b7f908a1464a922d053', 'request_id': 'req-3a834800-967f-4c5b-8148-771a8d735730'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:41.525091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3a834800-967f-4c5b-8148-771a8d735730 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccefe92798da4b7f908a1464a922d053', 'request_id': 'req-3a834800-967f-4c5b-8148-771a8d735730'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:41.538467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3a834800-967f-4c5b-8148-771a8d735730 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccefe92798da4b7f908a1464a922d053', 'request_id': 'req-3a834800-967f-4c5b-8148-771a8d735730'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:41.577004 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3a834800-967f-4c5b-8148-771a8d735730 admin admin] The token cache is being invalidate because project ccefe92798da4b7f908a1464a922d053 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:05:41.578096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3a834800-967f-4c5b-8148-771a8d735730 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:41.579952 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3a834800-967f-4c5b-8148-771a8d735730 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:41.586079 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1432/2843] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:05:41 2022] DELETE /identity/v3/projects/ccefe92798da4b7f908a1464a922d053 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:41.588516 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe66af9-96e0-4a71-889f-e3587d829aee admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:41.591063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-dbe66af9-96e0-4a71-889f-e3587d829aee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:41.591526 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce62b2-b721-4703-b28d-4024e0723cd6 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:41.592131 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce62b2-b721-4703-b28d-4024e0723cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:41.592622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce62b2-b721-4703-b28d-4024e0723cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:41.626690 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe66af9-96e0-4a71-889f-e3587d829aee admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:41.638579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-17ce62b2-b721-4703-b28d-4024e0723cd6 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:41.644099 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-17ce62b2-b721-4703-b28d-4024e0723cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:41.736025 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:41.819545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6b405-874d-468b-ab09-70563bccef3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:41.820259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6b405-874d-468b-ab09-70563bccef3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:41.820537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6b405-874d-468b-ab09-70563bccef3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:41.820814 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6b405-874d-468b-ab09-70563bccef3d admin admin] PATH_INFO: `/v3/projects/507b6658861d459bbcf665d0ce6353c6` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:41.822818 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6b405-874d-468b-ab09-70563bccef3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=507b6658861d459bbcf665d0ce6353c6)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:41.824751 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6b405-874d-468b-ab09-70563bccef3d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:41.848072 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1433/2844] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:05:41.852487 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2acc3b-eeb7-4ca9-ba5c-68aa5f9e5af8 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:41.852980 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2acc3b-eeb7-4ca9-ba5c-68aa5f9e5af8 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:41.853511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2acc3b-eeb7-4ca9-ba5c-68aa5f9e5af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:41.888702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-2c2acc3b-eeb7-4ca9-ba5c-68aa5f9e5af8 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:41.890258 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2c2acc3b-eeb7-4ca9-ba5c-68aa5f9e5af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:41.902060 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1434/2845] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:41.908452 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2acc3b-eeb7-4ca9-ba5c-68aa5f9e5af8 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:41.922037 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2acc3b-eeb7-4ca9-ba5c-68aa5f9e5af8 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:41.926624 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:41.933165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527bb6d-384e-4079-b85f-7d39f03c9bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:41.934567 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527bb6d-384e-4079-b85f-7d39f03c9bfb admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:41.935061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527bb6d-384e-4079-b85f-7d39f03c9bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:41.936885 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527bb6d-384e-4079-b85f-7d39f03c9bfb admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:41.937799 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527bb6d-384e-4079-b85f-7d39f03c9bfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:05:41.938355 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527bb6d-384e-4079-b85f-7d39f03c9bfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:41.941197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527bb6d-384e-4079-b85f-7d39f03c9bfb admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:41.957128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dbd6b405-874d-468b-ab09-70563bccef3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '507b6658861d459bbcf665d0ce6353c6', 'request_id': 'req-dbd6b405-874d-468b-ab09-70563bccef3d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:41.969150 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1435/2846] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:05:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:05:41.974125 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527bb6d-384e-4079-b85f-7d39f03c9bfb admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:41.990523 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dbd6b405-874d-468b-ab09-70563bccef3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '507b6658861d459bbcf665d0ce6353c6', 'request_id': 'req-dbd6b405-874d-468b-ab09-70563bccef3d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:41.992409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527bb6d-384e-4079-b85f-7d39f03c9bfb admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:42.007764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dbd6b405-874d-468b-ab09-70563bccef3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '507b6658861d459bbcf665d0ce6353c6', 'request_id': 'req-dbd6b405-874d-468b-ab09-70563bccef3d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:42.045154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dbd6b405-874d-468b-ab09-70563bccef3d admin admin] The token cache is being invalidate because project 507b6658861d459bbcf665d0ce6353c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:05:42.045476 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dbd6b405-874d-468b-ab09-70563bccef3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:42.046843 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dbd6b405-874d-468b-ab09-70563bccef3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:42.052631 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1412/2847] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:05:41 2022] DELETE /identity/v3/projects/507b6658861d459bbcf665d0ce6353c6 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:42.054068 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882efdd3-28ce-4121-91c7-c385acec1038 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:42.054352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882efdd3-28ce-4121-91c7-c385acec1038 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:42.054625 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882efdd3-28ce-4121-91c7-c385acec1038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:42.146191 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-882efdd3-28ce-4121-91c7-c385acec1038 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:42.155389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fb07e-4a4f-4b76-bab1-59dbef3f47f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:42.155565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fb07e-4a4f-4b76-bab1-59dbef3f47f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:42.155762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fb07e-4a4f-4b76-bab1-59dbef3f47f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:42.155929 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-882efdd3-28ce-4121-91c7-c385acec1038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:42.156036 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fb07e-4a4f-4b76-bab1-59dbef3f47f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:42.156675 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6fb07e-4a4f-4b76-bab1-59dbef3f47f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:42.167756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6fb07e-4a4f-4b76-bab1-59dbef3f47f4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:42.179891 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1413/2848] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:42.181265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c166c7-0fb6-4bdd-8a84-af75d76a252e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:42.181577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c166c7-0fb6-4bdd-8a84-af75d76a252e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:42.181848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c166c7-0fb6-4bdd-8a84-af75d76a252e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:42.228303 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-25c166c7-0fb6-4bdd-8a84-af75d76a252e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:42.229516 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-25c166c7-0fb6-4bdd-8a84-af75d76a252e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:42.242677 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1436/2849] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:05:41 2022] POST /identity/v3/projects => generated 373 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:05:42.246244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fb07e-4a4f-4b76-bab1-59dbef3f47f4 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:42.247561 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1414/2850] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:42.250793 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fc6fb07e-4a4f-4b76-bab1-59dbef3f47f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:42.252674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c166c7-0fb6-4bdd-8a84-af75d76a252e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:42.276439 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c166c7-0fb6-4bdd-8a84-af75d76a252e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:42.431566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f081a-e014-4d04-a227-3b9247f9d58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:42.432291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f081a-e014-4d04-a227-3b9247f9d58d admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:42.432666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f081a-e014-4d04-a227-3b9247f9d58d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:42.432841 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f081a-e014-4d04-a227-3b9247f9d58d admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:42.433484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f081a-e014-4d04-a227-3b9247f9d58d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:05:42.433961 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f081a-e014-4d04-a227-3b9247f9d58d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:42.435570 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f081a-e014-4d04-a227-3b9247f9d58d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:42.451213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fb07e-4a4f-4b76-bab1-59dbef3f47f4 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:42.466580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c780e-7c44-4909-b3e4-ab152d4a4c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:42.467341 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c780e-7c44-4909-b3e4-ab152d4a4c44 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:42.467631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c780e-7c44-4909-b3e4-ab152d4a4c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:42.467904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c780e-7c44-4909-b3e4-ab152d4a4c44 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:42.468698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c780e-7c44-4909-b3e4-ab152d4a4c44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:42.470693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c780e-7c44-4909-b3e4-ab152d4a4c44 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:42.494520 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1415/2851] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:05:42.497300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f081a-e014-4d04-a227-3b9247f9d58d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:42.516277 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1437/2852] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:05:42 2022] POST /identity/v3/users => generated 287 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:05:42.517026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c780e-7c44-4909-b3e4-ab152d4a4c44 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:42.536081 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f081a-e014-4d04-a227-3b9247f9d58d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:42.540300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c780e-7c44-4909-b3e4-ab152d4a4c44 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:42.550354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0843c9-cb53-4604-804e-a0342e1bf0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:42.550981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0843c9-cb53-4604-804e-a0342e1bf0d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:42.551259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0843c9-cb53-4604-804e-a0342e1bf0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:42.551532 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0843c9-cb53-4604-804e-a0342e1bf0d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:42.552168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0843c9-cb53-4604-804e-a0342e1bf0d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:42.554674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0843c9-cb53-4604-804e-a0342e1bf0d1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:42.556806 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f371913-b836-4f77-9c12-a5e27565e185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:42.557465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f371913-b836-4f77-9c12-a5e27565e185 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:42.558133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f371913-b836-4f77-9c12-a5e27565e185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:42.558420 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f371913-b836-4f77-9c12-a5e27565e185 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:42.559085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f371913-b836-4f77-9c12-a5e27565e185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:42.560703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f371913-b836-4f77-9c12-a5e27565e185 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:42.601821 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1438/2853] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:05:42.611674 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f371913-b836-4f77-9c12-a5e27565e185 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:42.624896 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1416/2854] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:05:42 2022] POST /identity/v3/projects => generated 381 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:05:42.630309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0843c9-cb53-4604-804e-a0342e1bf0d1 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:42.660494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f371913-b836-4f77-9c12-a5e27565e185 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:42.705997 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:42.826624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0b383-6872-45b3-8978-3af85e4ee6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:42.827257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0b383-6872-45b3-8978-3af85e4ee6c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:42.827542 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0b383-6872-45b3-8978-3af85e4ee6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:42.827888 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0b383-6872-45b3-8978-3af85e4ee6c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:42.828460 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0b383-6872-45b3-8978-3af85e4ee6c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:42.830143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0b383-6872-45b3-8978-3af85e4ee6c5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:42.832780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0843c9-cb53-4604-804e-a0342e1bf0d1 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:42.844250 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1feee-0ca0-4c66-95eb-b1fd3ae828dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:42.845793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1feee-0ca0-4c66-95eb-b1fd3ae828dd admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:42.847113 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1feee-0ca0-4c66-95eb-b1fd3ae828dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:42.848179 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1feee-0ca0-4c66-95eb-b1fd3ae828dd admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:42.850964 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee1feee-0ca0-4c66-95eb-b1fd3ae828dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:42.855708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee1feee-0ca0-4c66-95eb-b1fd3ae828dd admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:42.864876 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1439/2855] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:05:42.869864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0b383-6872-45b3-8978-3af85e4ee6c5 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:42.899724 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0b383-6872-45b3-8978-3af85e4ee6c5 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:42.920477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d686237-8711-487a-b94a-90b461fcc57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:42.922909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d686237-8711-487a-b94a-90b461fcc57d admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:42.924361 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1417/2856] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:05:42 2022] POST /identity/v3/users => generated 291 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:05:42.925847 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d686237-8711-487a-b94a-90b461fcc57d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:42.926350 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d686237-8711-487a-b94a-90b461fcc57d admin admin] PATH_INFO: `/v3/projects/fb1f06dd188c4ba0b37b91cfd1beb208/users/69fd161dbfb44a5c8c563536f8ad3348/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:42.929522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1feee-0ca0-4c66-95eb-b1fd3ae828dd admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:42.945998 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:42.953785 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1feee-0ca0-4c66-95eb-b1fd3ae828dd admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:42.969658 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e984f0-03f0-4ac6-a0a3-3531917c3d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:42.969924 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d686237-8711-487a-b94a-90b461fcc57d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb1f06dd188c4ba0b37b91cfd1beb208, user_id=69fd161dbfb44a5c8c563536f8ad3348, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:42.970551 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e984f0-03f0-4ac6-a0a3-3531917c3d39 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:42.970551 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e984f0-03f0-4ac6-a0a3-3531917c3d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:42.970827 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e984f0-03f0-4ac6-a0a3-3531917c3d39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:42.971471 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e984f0-03f0-4ac6-a0a3-3531917c3d39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:42.972446 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d686237-8711-487a-b94a-90b461fcc57d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:42.973467 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e984f0-03f0-4ac6-a0a3-3531917c3d39 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:43.001489 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1440/2857] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:05:42 2022] PUT /identity/v3/projects/fb1f06dd188c4ba0b37b91cfd1beb208/users/69fd161dbfb44a5c8c563536f8ad3348/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:43.012702 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1418/2858] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:05:43.013064 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2ff69-9da5-4ade-98f7-32ad9734ff27 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:43.013352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2ff69-9da5-4ade-98f7-32ad9734ff27 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:43.013649 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2ff69-9da5-4ade-98f7-32ad9734ff27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:43.016476 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e984f0-03f0-4ac6-a0a3-3531917c3d39 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:43.030904 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e984f0-03f0-4ac6-a0a3-3531917c3d39 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:43.089202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-8cf2ff69-9da5-4ade-98f7-32ad9734ff27 None None] MFA Rules not processed for user `69fd161dbfb44a5c8c563536f8ad3348`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:43.094512 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8cf2ff69-9da5-4ade-98f7-32ad9734ff27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:43.147865 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97765dcd-09d3-40fb-8b98-00a93bd1b1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:43.150427 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97765dcd-09d3-40fb-8b98-00a93bd1b1c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:43.151609 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97765dcd-09d3-40fb-8b98-00a93bd1b1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:43.152114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97765dcd-09d3-40fb-8b98-00a93bd1b1c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:43.153940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97765dcd-09d3-40fb-8b98-00a93bd1b1c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:43.158590 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97765dcd-09d3-40fb-8b98-00a93bd1b1c4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:43.192303 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1419/2859] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:05:43.195078 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97765dcd-09d3-40fb-8b98-00a93bd1b1c4 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:43.219477 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97765dcd-09d3-40fb-8b98-00a93bd1b1c4 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:43.238099 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83497778-9600-4c44-a2db-7c9435f59c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:43.239293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83497778-9600-4c44-a2db-7c9435f59c21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:43.239598 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83497778-9600-4c44-a2db-7c9435f59c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:43.240584 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83497778-9600-4c44-a2db-7c9435f59c21 admin admin] PATH_INFO: `/v3/projects/890f73569fa2487c8360fe9cf48423c0/users/da306544339649069bc7c2f4f743320a/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:43.281734 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1441/2860] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:43.301520 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2ff69-9da5-4ade-98f7-32ad9734ff27 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:43.304293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8cf2ff69-9da5-4ade-98f7-32ad9734ff27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:43.309473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83497778-9600-4c44-a2db-7c9435f59c21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=890f73569fa2487c8360fe9cf48423c0, user_id=da306544339649069bc7c2f4f743320a, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:43.315010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83497778-9600-4c44-a2db-7c9435f59c21 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:43.360926 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1420/2861] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:05:43 2022] PUT /identity/v3/projects/890f73569fa2487c8360fe9cf48423c0/users/da306544339649069bc7c2f4f743320a/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:43.373514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eeb125-7996-4e38-a333-7fdb69b12b96 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:43.373993 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eeb125-7996-4e38-a333-7fdb69b12b96 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:43.374380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eeb125-7996-4e38-a333-7fdb69b12b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:43.420038 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2ff69-9da5-4ade-98f7-32ad9734ff27 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:43.422945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a5eeb125-7996-4e38-a333-7fdb69b12b96 None None] MFA Rules not processed for user `da306544339649069bc7c2f4f743320a`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:43.424550 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a5eeb125-7996-4e38-a333-7fdb69b12b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:43.494490 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:43.571483 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1421/2862] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:05:43.576236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eeb125-7996-4e38-a333-7fdb69b12b96 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:43.618580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b27430-3e6c-4ca0-85dc-ab297162dfd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:43.621637 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b27430-3e6c-4ca0-85dc-ab297162dfd1 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:43.621969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b27430-3e6c-4ca0-85dc-ab297162dfd1 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:43.622252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b27430-3e6c-4ca0-85dc-ab297162dfd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:43.727342 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:43.739343 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eeb125-7996-4e38-a333-7fdb69b12b96 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:43.764045 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b85e78-8677-4571-a460-c10bfbb73d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:43.764289 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b85e78-8677-4571-a460-c10bfbb73d5e admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:43.767702 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b85e78-8677-4571-a460-c10bfbb73d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:43.767923 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b85e78-8677-4571-a460-c10bfbb73d5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:43.768587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b85e78-8677-4571-a460-c10bfbb73d5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:43.776801 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b27430-3e6c-4ca0-85dc-ab297162dfd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:43.778220 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b85e78-8677-4571-a460-c10bfbb73d5e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:43.780629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b27430-3e6c-4ca0-85dc-ab297162dfd1 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:43.819172 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1442/2863] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:05:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:05:43.877563 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1422/2864] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:05:43 2022] POST /identity/v3/projects => generated 383 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:05:43.878807 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b27430-3e6c-4ca0-85dc-ab297162dfd1 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:43.895606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c70df3-669a-4b1c-95a0-32afb9d97b63 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:43.895606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c70df3-669a-4b1c-95a0-32afb9d97b63 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:43.895606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c70df3-669a-4b1c-95a0-32afb9d97b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:43.902996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b27430-3e6c-4ca0-85dc-ab297162dfd1 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:44.014753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c9c70df3-669a-4b1c-95a0-32afb9d97b63 None None] MFA Rules not processed for user `d4c163ad5ee148848513367b5e997c34`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:44.018051 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c9c70df3-669a-4b1c-95a0-32afb9d97b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:44.091417 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32250753-0da9-407d-8141-f75c1072e082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:44.092142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32250753-0da9-407d-8141-f75c1072e082 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:44.092490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32250753-0da9-407d-8141-f75c1072e082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:44.092833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32250753-0da9-407d-8141-f75c1072e082 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:44.093738 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32250753-0da9-407d-8141-f75c1072e082 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:44.095778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32250753-0da9-407d-8141-f75c1072e082 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:44.150548 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1443/2865] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:05:43 2022] POST /identity/v3/users => generated 298 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:05:44.155635 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32250753-0da9-407d-8141-f75c1072e082 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:44.184201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32250753-0da9-407d-8141-f75c1072e082 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:44.223675 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2789422-4d25-4628-b537-15f45cc7b10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:44.224447 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2789422-4d25-4628-b537-15f45cc7b10e admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:44.224792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2789422-4d25-4628-b537-15f45cc7b10e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:44.225133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2789422-4d25-4628-b537-15f45cc7b10e admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:44.225899 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2789422-4d25-4628-b537-15f45cc7b10e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:44.227684 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1423/2866] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:44.232559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2789422-4d25-4628-b537-15f45cc7b10e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:44.257361 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1444/2867] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:05:44.258862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c70df3-669a-4b1c-95a0-32afb9d97b63 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:44.280400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c70df3-669a-4b1c-95a0-32afb9d97b63 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:44.289102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fccdb-d831-404b-98c3-dbb03b058ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:44.289968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fccdb-d831-404b-98c3-dbb03b058ac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:44.291036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fccdb-d831-404b-98c3-dbb03b058ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:44.291398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fccdb-d831-404b-98c3-dbb03b058ac4 admin admin] PATH_INFO: `/v3/projects/c58ee7b834e14d4eac02e2179d1286f5/users/13a3a6a395284191b641d737ade54b58/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:44.330784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821fccdb-d831-404b-98c3-dbb03b058ac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c58ee7b834e14d4eac02e2179d1286f5, user_id=13a3a6a395284191b641d737ade54b58, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:44.333589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821fccdb-d831-404b-98c3-dbb03b058ac4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:44.357967 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1424/2868] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:05:44 2022] PUT /identity/v3/projects/c58ee7b834e14d4eac02e2179d1286f5/users/13a3a6a395284191b641d737ade54b58/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:44.362069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2789422-4d25-4628-b537-15f45cc7b10e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:44.374672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2789422-4d25-4628-b537-15f45cc7b10e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:44.443222 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:44.524653 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48348894-b4d9-49ea-8ed6-23fcb6cc141d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:44.525838 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48348894-b4d9-49ea-8ed6-23fcb6cc141d admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:44.526283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48348894-b4d9-49ea-8ed6-23fcb6cc141d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:44.526717 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48348894-b4d9-49ea-8ed6-23fcb6cc141d admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:44.527697 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48348894-b4d9-49ea-8ed6-23fcb6cc141d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:44.529758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48348894-b4d9-49ea-8ed6-23fcb6cc141d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:44.554720 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1445/2869] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:05:44.570099 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fccdb-d831-404b-98c3-dbb03b058ac4 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:44.578069 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fccdb-d831-404b-98c3-dbb03b058ac4 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:44.590766 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a26bd-0b76-49f4-b127-a469349c42cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:44.592473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a26bd-0b76-49f4-b127-a469349c42cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:44.592749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a26bd-0b76-49f4-b127-a469349c42cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:44.593048 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a26bd-0b76-49f4-b127-a469349c42cc admin admin] PATH_INFO: `/v3/projects/c58ee7b834e14d4eac02e2179d1286f5/users/13a3a6a395284191b641d737ade54b58/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:44.598957 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a26bd-0b76-49f4-b127-a469349c42cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c58ee7b834e14d4eac02e2179d1286f5, user_id=13a3a6a395284191b641d737ade54b58, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:44.602552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a26bd-0b76-49f4-b127-a469349c42cc admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:44.647876 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1425/2870] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:05:44 2022] PUT /identity/v3/projects/c58ee7b834e14d4eac02e2179d1286f5/users/13a3a6a395284191b641d737ade54b58/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:44.648109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7573998-2b9c-4183-b4da-a25120223e9c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:44.648109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7573998-2b9c-4183-b4da-a25120223e9c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:44.648109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7573998-2b9c-4183-b4da-a25120223e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:44.699765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a26bd-0b76-49f4-b127-a469349c42cc admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:44.701883 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-031a26bd-0b76-49f4-b127-a469349c42cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:44.717714 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e7573998-2b9c-4183-b4da-a25120223e9c None None] MFA Rules not processed for user `13a3a6a395284191b641d737ade54b58`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:44.718960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e7573998-2b9c-4183-b4da-a25120223e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:44.821560 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1446/2871] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:44 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:44.844057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a26bd-0b76-49f4-b127-a469349c42cc admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:44.856155 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d613567-db3e-40e3-a7a2-7d7bd849670f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:44.856793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d613567-db3e-40e3-a7a2-7d7bd849670f service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:44.857330 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d613567-db3e-40e3-a7a2-7d7bd849670f service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:44.857653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d613567-db3e-40e3-a7a2-7d7bd849670f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:44.860613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4d613567-db3e-40e3-a7a2-7d7bd849670f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:44.900694 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:44.963058 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d613567-db3e-40e3-a7a2-7d7bd849670f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:44.965358 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d613567-db3e-40e3-a7a2-7d7bd849670f service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:44.976200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7573998-2b9c-4183-b4da-a25120223e9c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:44.979184 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1426/2872] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:05:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:05:45.083360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d613567-db3e-40e3-a7a2-7d7bd849670f service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:45.096126 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7573998-2b9c-4183-b4da-a25120223e9c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:45.101791 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0100d-cdd8-40e6-9cc3-ebe43788f641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:45.103247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0100d-cdd8-40e6-9cc3-ebe43788f641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:45.103633 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0100d-cdd8-40e6-9cc3-ebe43788f641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:45.104013 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0100d-cdd8-40e6-9cc3-ebe43788f641 admin admin] PATH_INFO: `/v3/users/69fd161dbfb44a5c8c563536f8ad3348` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:45.105308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d613567-db3e-40e3-a7a2-7d7bd849670f service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:45.105719 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc0100d-cdd8-40e6-9cc3-ebe43788f641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69fd161dbfb44a5c8c563536f8ad3348)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:45.108384 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc0100d-cdd8-40e6-9cc3-ebe43788f641 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:45.115557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ce540-4b05-4db4-89c8-1037515077f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:45.117336 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ce540-4b05-4db4-89c8-1037515077f5 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:45.118388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ce540-4b05-4db4-89c8-1037515077f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:45.119266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ce540-4b05-4db4-89c8-1037515077f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:45.148560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ce540-4b05-4db4-89c8-1037515077f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:45.150310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ce540-4b05-4db4-89c8-1037515077f5 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:45.161190 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1427/2873] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:05:45 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:05:45.178134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf542614-d3c9-4df0-940b-23cea1be7552 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:45.178489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf542614-d3c9-4df0-940b-23cea1be7552 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:45.178752 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf542614-d3c9-4df0-940b-23cea1be7552 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:45.180279 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1428/2874] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 04 01:05:45.185890 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf542614-d3c9-4df0-940b-23cea1be7552 None None] Authenticating service token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:05:45.212977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ebc0100d-cdd8-40e6-9cc3-ebe43788f641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69fd161dbfb44a5c8c563536f8ad3348'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:45.214276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ebc0100d-cdd8-40e6-9cc3-ebe43788f641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69fd161dbfb44a5c8c563536f8ad3348'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:45.215361 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf542614-d3c9-4df0-940b-23cea1be7552 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:45.224500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ebc0100d-cdd8-40e6-9cc3-ebe43788f641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69fd161dbfb44a5c8c563536f8ad3348'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:45.232854 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf542614-d3c9-4df0-940b-23cea1be7552 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:45.259743 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:45.270127 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d7b03-70bf-499b-8add-b29890118e1c tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13a3a6a395284191b641d737ade54b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c58ee7b834e14d4eac02e2179d1286f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:45.270814 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d7b03-70bf-499b-8add-b29890118e1c tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:45.271098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d7b03-70bf-499b-8add-b29890118e1c tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:45.271943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d7b03-70bf-499b-8add-b29890118e1c tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] PATH_INFO: `/v3/projects/890f73569fa2487c8360fe9cf48423c0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:45.288369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d7b03-70bf-499b-8add-b29890118e1c tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] RBAC: Authorizing `identity:get_project(project_id=890f73569fa2487c8360fe9cf48423c0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:45.289268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ebc0100d-cdd8-40e6-9cc3-ebe43788f641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69fd161dbfb44a5c8c563536f8ad3348'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:45.290256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ebc0100d-cdd8-40e6-9cc3-ebe43788f641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69fd161dbfb44a5c8c563536f8ad3348'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:45.293832 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d7b03-70bf-499b-8add-b29890118e1c tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:45.295885 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1429/2875] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:05:45 2022] GET /identity/v3/projects/890f73569fa2487c8360fe9cf48423c0 => generated 381 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:05:45.318899 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1447/2876] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:05:44 2022] DELETE /identity/v3/users/69fd161dbfb44a5c8c563536f8ad3348 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:05:45.323041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e024ad-28d9-431a-9603-ab08172aaf03 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:45.323471 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e024ad-28d9-431a-9603-ab08172aaf03 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:45.323591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e024ad-28d9-431a-9603-ab08172aaf03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:45.367683 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8b231-89fb-41bb-bb06-6dab402ca86c None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:45.368260 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8b231-89fb-41bb-bb06-6dab402ca86c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:45.368260 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8b231-89fb-41bb-bb06-6dab402ca86c None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:45.371241 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1448/2877] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:05:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:05:45.378410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8b231-89fb-41bb-bb06-6dab402ca86c None None] Authenticating service token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:05:45.381168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9ac8b231-89fb-41bb-bb06-6dab402ca86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:45.387528 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e3e024ad-28d9-431a-9603-ab08172aaf03 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:45.392134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e3e024ad-28d9-431a-9603-ab08172aaf03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:45.527032 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8b231-89fb-41bb-bb06-6dab402ca86c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:45.527403 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1430/2878] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:45.529757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9ac8b231-89fb-41bb-bb06-6dab402ca86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:45.543558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e024ad-28d9-431a-9603-ab08172aaf03 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:45.544987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e3e024ad-28d9-431a-9603-ab08172aaf03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:45.653375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e024ad-28d9-431a-9603-ab08172aaf03 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:45.655032 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8b231-89fb-41bb-bb06-6dab402ca86c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:45.658991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfbf3d-48cc-496b-8c9d-ceca55658069 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:45.660293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfbf3d-48cc-496b-8c9d-ceca55658069 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:45.661253 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfbf3d-48cc-496b-8c9d-ceca55658069 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:45.661577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfbf3d-48cc-496b-8c9d-ceca55658069 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:45.670103 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daed4e9-35e6-41ff-b7d4-436e3b2edbef tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13a3a6a395284191b641d737ade54b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c58ee7b834e14d4eac02e2179d1286f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:45.670756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daed4e9-35e6-41ff-b7d4-436e3b2edbef tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:45.671091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daed4e9-35e6-41ff-b7d4-436e3b2edbef tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:45.671362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daed4e9-35e6-41ff-b7d4-436e3b2edbef tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] PATH_INFO: `/v3/projects/890f73569fa2487c8360fe9cf48423c0` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:45.672574 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daed4e9-35e6-41ff-b7d4-436e3b2edbef tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] RBAC: Authorizing `identity:get_project(project_id=890f73569fa2487c8360fe9cf48423c0)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:45.674771 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daed4e9-35e6-41ff-b7d4-436e3b2edbef tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:45.674939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebfbf3d-48cc-496b-8c9d-ceca55658069 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:45.676831 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1449/2879] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:05:45 2022] GET /identity/v3/projects/890f73569fa2487c8360fe9cf48423c0 => generated 381 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:05:45.677046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebfbf3d-48cc-496b-8c9d-ceca55658069 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:45.694559 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1431/2880] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:05:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:05:45.828366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128880f-95eb-4b82-a9cd-995fa0d3b84e None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:45.828721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128880f-95eb-4b82-a9cd-995fa0d3b84e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:45.828923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128880f-95eb-4b82-a9cd-995fa0d3b84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:45.872387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a128880f-95eb-4b82-a9cd-995fa0d3b84e None None] MFA Rules not processed for user `da306544339649069bc7c2f4f743320a`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:45.873484 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a128880f-95eb-4b82-a9cd-995fa0d3b84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:46.057736 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1450/2881] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:46.269469 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfbf3d-48cc-496b-8c9d-ceca55658069 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:46.302879 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfbf3d-48cc-496b-8c9d-ceca55658069 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:46.310916 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ad943-066e-4204-8007-e3ac25ceb97e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:46.311552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ad943-066e-4204-8007-e3ac25ceb97e service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:46.311884 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ad943-066e-4204-8007-e3ac25ceb97e service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:46.312212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ad943-066e-4204-8007-e3ac25ceb97e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:46.327957 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128880f-95eb-4b82-a9cd-995fa0d3b84e None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:46.329451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a48ad943-066e-4204-8007-e3ac25ceb97e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:46.330007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a128880f-95eb-4b82-a9cd-995fa0d3b84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:46.349011 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128880f-95eb-4b82-a9cd-995fa0d3b84e None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:46.354424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8259966-2878-44ea-b07a-db3b1eb26149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:46.355175 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8259966-2878-44ea-b07a-db3b1eb26149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:46.356789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8259966-2878-44ea-b07a-db3b1eb26149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:46.356789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8259966-2878-44ea-b07a-db3b1eb26149 admin admin] PATH_INFO: `/v3/projects/fb1f06dd188c4ba0b37b91cfd1beb208` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:46.359978 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8259966-2878-44ea-b07a-db3b1eb26149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb1f06dd188c4ba0b37b91cfd1beb208)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:46.363186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8259966-2878-44ea-b07a-db3b1eb26149 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:46.374715 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ad943-066e-4204-8007-e3ac25ceb97e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:46.376739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ad943-066e-4204-8007-e3ac25ceb97e service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:46.401919 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:46.415805 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1432/2882] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:05:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:05:46.496751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b8259966-2878-44ea-b07a-db3b1eb26149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb1f06dd188c4ba0b37b91cfd1beb208', 'request_id': 'req-b8259966-2878-44ea-b07a-db3b1eb26149'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:46.515463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b8259966-2878-44ea-b07a-db3b1eb26149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb1f06dd188c4ba0b37b91cfd1beb208', 'request_id': 'req-b8259966-2878-44ea-b07a-db3b1eb26149'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:46.524414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b8259966-2878-44ea-b07a-db3b1eb26149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb1f06dd188c4ba0b37b91cfd1beb208', 'request_id': 'req-b8259966-2878-44ea-b07a-db3b1eb26149'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:46.547895 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b8259966-2878-44ea-b07a-db3b1eb26149 admin admin] The token cache is being invalidate because project fb1f06dd188c4ba0b37b91cfd1beb208 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:05:46.548549 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b8259966-2878-44ea-b07a-db3b1eb26149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:46.549348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b8259966-2878-44ea-b07a-db3b1eb26149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:46.551318 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1451/2883] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:05:46 2022] DELETE /identity/v3/projects/fb1f06dd188c4ba0b37b91cfd1beb208 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:46.557617 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814a6de-68e1-4257-9110-2f1c88d9d108 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:46.557982 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814a6de-68e1-4257-9110-2f1c88d9d108 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:46.558320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814a6de-68e1-4257-9110-2f1c88d9d108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:46.588763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-7814a6de-68e1-4257-9110-2f1c88d9d108 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:46.590533 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7814a6de-68e1-4257-9110-2f1c88d9d108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:46.642236 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:46.714021 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1433/2884] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:46.723121 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36bb9a-75f6-40e5-ab4f-6e4e9d46e0a9 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:46.723922 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36bb9a-75f6-40e5-ab4f-6e4e9d46e0a9 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:46.724464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36bb9a-75f6-40e5-ab4f-6e4e9d46e0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:46.756496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-2a36bb9a-75f6-40e5-ab4f-6e4e9d46e0a9 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:46.759626 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2a36bb9a-75f6-40e5-ab4f-6e4e9d46e0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:46.793961 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814a6de-68e1-4257-9110-2f1c88d9d108 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:46.795596 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1452/2885] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:46.813595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814a6de-68e1-4257-9110-2f1c88d9d108 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:46.842806 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b441d4-5c5e-4635-9e97-4722051df806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:46.843480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b441d4-5c5e-4635-9e97-4722051df806 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:46.843762 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b441d4-5c5e-4635-9e97-4722051df806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:46.844034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b441d4-5c5e-4635-9e97-4722051df806 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:46.850344 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b441d4-5c5e-4635-9e97-4722051df806 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:05:46.850704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b441d4-5c5e-4635-9e97-4722051df806 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:46.852688 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b441d4-5c5e-4635-9e97-4722051df806 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:46.906376 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36bb9a-75f6-40e5-ab4f-6e4e9d46e0a9 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:46.920230 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1434/2886] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:05:46.920661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36bb9a-75f6-40e5-ab4f-6e4e9d46e0a9 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:46.932510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f290c255-afe1-4b07-841e-867b04cd4074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:46.933324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290c255-afe1-4b07-841e-867b04cd4074 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:46.933778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290c255-afe1-4b07-841e-867b04cd4074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:46.934127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290c255-afe1-4b07-841e-867b04cd4074 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:46.935726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f290c255-afe1-4b07-841e-867b04cd4074 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:46.937930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f290c255-afe1-4b07-841e-867b04cd4074 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:46.978140 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1453/2887] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:05:46 2022] POST /identity/v3/projects => generated 397 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:05:46.979682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b441d4-5c5e-4635-9e97-4722051df806 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:46.992856 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b441d4-5c5e-4635-9e97-4722051df806 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:47.048135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571ba2d-508a-42f4-adfd-6df43979f54b None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:47.048423 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571ba2d-508a-42f4-adfd-6df43979f54b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:47.048676 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571ba2d-508a-42f4-adfd-6df43979f54b None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:47.050650 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1454/2888] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:05:47.058522 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571ba2d-508a-42f4-adfd-6df43979f54b None None] Authenticating service token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:05:47.065553 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b571ba2d-508a-42f4-adfd-6df43979f54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:47.101560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe78f982-e0bd-429d-9c20-69aabf962cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:47.102777 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78f982-e0bd-429d-9c20-69aabf962cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:47.103694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78f982-e0bd-429d-9c20-69aabf962cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:47.104184 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78f982-e0bd-429d-9c20-69aabf962cb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:47.105267 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe78f982-e0bd-429d-9c20-69aabf962cb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:47.108414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe78f982-e0bd-429d-9c20-69aabf962cb1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:47.155304 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1435/2889] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:05:46 2022] POST /identity/v3/users => generated 299 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:05:47.158706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe78f982-e0bd-429d-9c20-69aabf962cb1 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:47.171949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe78f982-e0bd-429d-9c20-69aabf962cb1 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:47.177835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5b34b-135b-4ff6-a218-fae65cb4fbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:47.179064 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5b34b-135b-4ff6-a218-fae65cb4fbc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:47.179706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5b34b-135b-4ff6-a218-fae65cb4fbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:47.180167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5b34b-135b-4ff6-a218-fae65cb4fbc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:47.181568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5b34b-135b-4ff6-a218-fae65cb4fbc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:47.187770 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5b34b-135b-4ff6-a218-fae65cb4fbc3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:47.198724 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571ba2d-508a-42f4-adfd-6df43979f54b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:47.200161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b571ba2d-508a-42f4-adfd-6df43979f54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:47.204201 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1436/2890] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:05:47.209229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5b34b-135b-4ff6-a218-fae65cb4fbc3 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:47.222583 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5b34b-135b-4ff6-a218-fae65cb4fbc3 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:47.229447 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f1812-f72d-416b-bd01-b9bbae181a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:47.230598 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f1812-f72d-416b-bd01-b9bbae181a10 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:47.231178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f1812-f72d-416b-bd01-b9bbae181a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:47.231856 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f1812-f72d-416b-bd01-b9bbae181a10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:47.233002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f1812-f72d-416b-bd01-b9bbae181a10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:47.234993 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f1812-f72d-416b-bd01-b9bbae181a10 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:47.252924 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1437/2891] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:05:47.253850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f1812-f72d-416b-bd01-b9bbae181a10 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:47.266387 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f1812-f72d-416b-bd01-b9bbae181a10 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:47.272040 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888324b-2053-4578-a6c7-5335f282f9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:47.273123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888324b-2053-4578-a6c7-5335f282f9f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:47.273409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888324b-2053-4578-a6c7-5335f282f9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:47.273816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888324b-2053-4578-a6c7-5335f282f9f9 admin admin] PATH_INFO: `/v3/projects/e22b725786d04bbc8543ade455701674/users/a73bec36a2094acc881374fcfe953961/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:47.293605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571ba2d-508a-42f4-adfd-6df43979f54b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:47.305744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26882d-bd24-4b9b-942b-d85f32ead7fd tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13a3a6a395284191b641d737ade54b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c58ee7b834e14d4eac02e2179d1286f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:47.306299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26882d-bd24-4b9b-942b-d85f32ead7fd tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:47.306584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26882d-bd24-4b9b-942b-d85f32ead7fd tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:47.307456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26882d-bd24-4b9b-942b-d85f32ead7fd tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] PATH_INFO: `/v3/projects/890f73569fa2487c8360fe9cf48423c0` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:47.308590 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26882d-bd24-4b9b-942b-d85f32ead7fd tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] RBAC: Authorizing `identity:get_project(project_id=890f73569fa2487c8360fe9cf48423c0)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:47.313008 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26882d-bd24-4b9b-942b-d85f32ead7fd tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:47.317471 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888324b-2053-4578-a6c7-5335f282f9f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e22b725786d04bbc8543ade455701674, user_id=a73bec36a2094acc881374fcfe953961, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:47.324456 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888324b-2053-4578-a6c7-5335f282f9f9 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:47.325814 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1455/2892] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:05:47 2022] GET /identity/v3/projects/890f73569fa2487c8360fe9cf48423c0 => generated 381 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:05:47.353397 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1438/2893] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:05:47 2022] PUT /identity/v3/projects/e22b725786d04bbc8543ade455701674/users/a73bec36a2094acc881374fcfe953961/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:47.364029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e242ae-1e12-42c4-a6bb-4334e9b89b8d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:47.364628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e242ae-1e12-42c4-a6bb-4334e9b89b8d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:47.364969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e242ae-1e12-42c4-a6bb-4334e9b89b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:47.397672 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:47.412292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c5e242ae-1e12-42c4-a6bb-4334e9b89b8d None None] MFA Rules not processed for user `a73bec36a2094acc881374fcfe953961`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:47.415961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c5e242ae-1e12-42c4-a6bb-4334e9b89b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:47.476565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff96f5-7836-4e3f-b632-06f169e1ffff None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:47.476901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff96f5-7836-4e3f-b632-06f169e1ffff None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:47.477259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff96f5-7836-4e3f-b632-06f169e1ffff None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:47.479585 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1439/2894] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:05:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:05:47.484892 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff96f5-7836-4e3f-b632-06f169e1ffff None None] Authenticating service token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:05:47.520119 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1456/2895] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:47 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:47.575381 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:47.586581 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff96f5-7836-4e3f-b632-06f169e1ffff None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:47.641510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e242ae-1e12-42c4-a6bb-4334e9b89b8d None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:47.643014 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c5e242ae-1e12-42c4-a6bb-4334e9b89b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:47.667539 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e242ae-1e12-42c4-a6bb-4334e9b89b8d None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:47.671334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff96f5-7836-4e3f-b632-06f169e1ffff None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:47.677862 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42136e2-afd0-4094-9628-24af2abf9e97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:47.678207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42136e2-afd0-4094-9628-24af2abf9e97 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:47.678482 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42136e2-afd0-4094-9628-24af2abf9e97 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:47.678764 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42136e2-afd0-4094-9628-24af2abf9e97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:47.681197 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749315a-03e1-4d55-91b8-bc06c6296dd9 tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13a3a6a395284191b641d737ade54b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c58ee7b834e14d4eac02e2179d1286f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:47.681941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749315a-03e1-4d55-91b8-bc06c6296dd9 tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:47.682286 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749315a-03e1-4d55-91b8-bc06c6296dd9 tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:47.682631 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749315a-03e1-4d55-91b8-bc06c6296dd9 tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] PATH_INFO: `/v3/projects/890f73569fa2487c8360fe9cf48423c0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:47.684272 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3749315a-03e1-4d55-91b8-bc06c6296dd9 tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] RBAC: Authorizing `identity:get_project(project_id=890f73569fa2487c8360fe9cf48423c0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:47.686539 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3749315a-03e1-4d55-91b8-bc06c6296dd9 tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:47.688691 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1440/2896] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:05:47 2022] GET /identity/v3/projects/890f73569fa2487c8360fe9cf48423c0 => generated 381 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:05:47.698031 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42136e2-afd0-4094-9628-24af2abf9e97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:47.699864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42136e2-afd0-4094-9628-24af2abf9e97 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:47.715480 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1457/2897] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:05:47 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:05:47.740585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e959d79-b1e5-486b-9437-ea5a2f48bc19 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:47.741067 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e959d79-b1e5-486b-9437-ea5a2f48bc19 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:47.741367 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e959d79-b1e5-486b-9437-ea5a2f48bc19 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:47.743007 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1441/2898] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:05:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:05:47.750983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42136e2-afd0-4094-9628-24af2abf9e97 service nova] Authenticating service token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:05:47.787740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55e476-1d3f-4889-b6e4-e7fb83351b13 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:47.788071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55e476-1d3f-4889-b6e4-e7fb83351b13 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:47.788288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55e476-1d3f-4889-b6e4-e7fb83351b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:47.797747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42136e2-afd0-4094-9628-24af2abf9e97 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:47.809928 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-6f55e476-1d3f-4889-b6e4-e7fb83351b13 None None] MFA Rules not processed for user `a73bec36a2094acc881374fcfe953961`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:47.810745 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6f55e476-1d3f-4889-b6e4-e7fb83351b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:47.832937 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1442/2899] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:47 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:05:47.842014 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42136e2-afd0-4094-9628-24af2abf9e97 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:47.848365 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7075188-c5fc-4539-9a90-eecaae9fe0d2 tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13a3a6a395284191b641d737ade54b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c58ee7b834e14d4eac02e2179d1286f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:47.849454 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7075188-c5fc-4539-9a90-eecaae9fe0d2 tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:47.849990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7075188-c5fc-4539-9a90-eecaae9fe0d2 tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:47.850486 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7075188-c5fc-4539-9a90-eecaae9fe0d2 tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] PATH_INFO: `/v3/projects/890f73569fa2487c8360fe9cf48423c0` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:47.851887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7075188-c5fc-4539-9a90-eecaae9fe0d2 tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] RBAC: Authorizing `identity:get_project(project_id=890f73569fa2487c8360fe9cf48423c0)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:47.854334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7075188-c5fc-4539-9a90-eecaae9fe0d2 tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:47.857310 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1458/2900] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:05:47 2022] GET /identity/v3/projects/890f73569fa2487c8360fe9cf48423c0 => generated 381 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:05:47.972007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00fd38-6bae-42c3-b594-a61e76b30a20 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:47.972007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00fd38-6bae-42c3-b594-a61e76b30a20 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:47.972331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00fd38-6bae-42c3-b594-a61e76b30a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:48.022141 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5b00fd38-6bae-42c3-b594-a61e76b30a20 None None] MFA Rules not processed for user `da306544339649069bc7c2f4f743320a`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:48.028331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5b00fd38-6bae-42c3-b594-a61e76b30a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:48.150087 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1443/2901] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:48.388810 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3148d69-8619-4866-a51d-5e888153f0a0 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:48.389102 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3148d69-8619-4866-a51d-5e888153f0a0 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:48.389377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3148d69-8619-4866-a51d-5e888153f0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:48.426765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-b3148d69-8619-4866-a51d-5e888153f0a0 None None] MFA Rules not processed for user `9482689feb8c4b6dad361610438a1b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:48.428105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b3148d69-8619-4866-a51d-5e888153f0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:48.532879 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1459/2902] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:48.720433 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00fd38-6bae-42c3-b594-a61e76b30a20 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:48.834461 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00fd38-6bae-42c3-b594-a61e76b30a20 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:48.840283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e786002-7eb9-4237-8f9e-7409b0fe6a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:48.840976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e786002-7eb9-4237-8f9e-7409b0fe6a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:48.841256 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e786002-7eb9-4237-8f9e-7409b0fe6a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:48.841568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e786002-7eb9-4237-8f9e-7409b0fe6a28 admin admin] PATH_INFO: `/v3/users/a73bec36a2094acc881374fcfe953961` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:48.843122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e786002-7eb9-4237-8f9e-7409b0fe6a28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a73bec36a2094acc881374fcfe953961)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:48.845219 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e786002-7eb9-4237-8f9e-7409b0fe6a28 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:48.922970 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:48.945082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2e786002-7eb9-4237-8f9e-7409b0fe6a28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a73bec36a2094acc881374fcfe953961'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:48.946428 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2e786002-7eb9-4237-8f9e-7409b0fe6a28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a73bec36a2094acc881374fcfe953961'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:48.962827 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2e786002-7eb9-4237-8f9e-7409b0fe6a28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a73bec36a2094acc881374fcfe953961'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:48.978583 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2e786002-7eb9-4237-8f9e-7409b0fe6a28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a73bec36a2094acc881374fcfe953961'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:48.979161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2e786002-7eb9-4237-8f9e-7409b0fe6a28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a73bec36a2094acc881374fcfe953961'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:49.011586 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1444/2903] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:05:48 2022] DELETE /identity/v3/users/a73bec36a2094acc881374fcfe953961 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:49.015604 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ada231-63e5-427e-bce9-31a8786b4448 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:49.016147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ada231-63e5-427e-bce9-31a8786b4448 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:49.016673 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ada231-63e5-427e-bce9-31a8786b4448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:49.043608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c3ada231-63e5-427e-bce9-31a8786b4448 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:49.046008 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c3ada231-63e5-427e-bce9-31a8786b4448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:49.178865 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1460/2904] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:49.188303 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e786002-7eb9-4237-8f9e-7409b0fe6a28 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:49.189707 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2e786002-7eb9-4237-8f9e-7409b0fe6a28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:49.351184 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e786002-7eb9-4237-8f9e-7409b0fe6a28 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:49.373562 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b945d3-ef0d-46f6-89d6-99030d6b5acd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:49.374206 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b945d3-ef0d-46f6-89d6-99030d6b5acd service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:49.374489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b945d3-ef0d-46f6-89d6-99030d6b5acd service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:49.374765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b945d3-ef0d-46f6-89d6-99030d6b5acd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:49.391913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b945d3-ef0d-46f6-89d6-99030d6b5acd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:49.400557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b945d3-ef0d-46f6-89d6-99030d6b5acd service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:49.425017 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1445/2905] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:05:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:05:49.701032 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16212724-d440-4919-b13f-c5bf1842a14c None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:49.702074 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16212724-d440-4919-b13f-c5bf1842a14c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:49.702541 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16212724-d440-4919-b13f-c5bf1842a14c None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:49.704618 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1461/2906] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:05:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:05:49.711095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b945d3-ef0d-46f6-89d6-99030d6b5acd service neutron] Authenticating service token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:05:49.713568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-48b945d3-ef0d-46f6-89d6-99030d6b5acd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:49.809188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16212724-d440-4919-b13f-c5bf1842a14c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:49.819224 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b945d3-ef0d-46f6-89d6-99030d6b5acd service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:49.820607 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-48b945d3-ef0d-46f6-89d6-99030d6b5acd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:49.824776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16212724-d440-4919-b13f-c5bf1842a14c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:49.833196 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bec4a-731b-4655-865b-10a2d809605c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:49.834156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bec4a-731b-4655-865b-10a2d809605c service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:49.834790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bec4a-731b-4655-865b-10a2d809605c service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:49.835232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bec4a-731b-4655-865b-10a2d809605c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:49.838127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-789bec4a-731b-4655-865b-10a2d809605c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:49.864334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789bec4a-731b-4655-865b-10a2d809605c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:49.866890 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789bec4a-731b-4655-865b-10a2d809605c service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:49.889355 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1462/2907] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:05:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:05:49.928585 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:49.941619 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b945d3-ef0d-46f6-89d6-99030d6b5acd service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:49.956012 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0bf0f-b03d-409a-9811-0ed1ec62a7ee tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13a3a6a395284191b641d737ade54b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c58ee7b834e14d4eac02e2179d1286f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:49.956786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0bf0f-b03d-409a-9811-0ed1ec62a7ee tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:49.957168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0bf0f-b03d-409a-9811-0ed1ec62a7ee tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:49.961428 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0bf0f-b03d-409a-9811-0ed1ec62a7ee tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] PATH_INFO: `/v3/projects/890f73569fa2487c8360fe9cf48423c0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:49.963442 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0bf0f-b03d-409a-9811-0ed1ec62a7ee tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] RBAC: Authorizing `identity:get_project(project_id=890f73569fa2487c8360fe9cf48423c0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:49.966136 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0bf0f-b03d-409a-9811-0ed1ec62a7ee tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:49.982116 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1446/2908] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:05:49 2022] GET /identity/v3/projects/890f73569fa2487c8360fe9cf48423c0 => generated 381 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:05:50.645406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bec4a-731b-4655-865b-10a2d809605c service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:50.647252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-789bec4a-731b-4655-865b-10a2d809605c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:50.672770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bec4a-731b-4655-865b-10a2d809605c service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:50.685284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c137ae-d828-4e94-900b-6eacfa0c9d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:50.685987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c137ae-d828-4e94-900b-6eacfa0c9d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:50.686270 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c137ae-d828-4e94-900b-6eacfa0c9d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:50.686690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c137ae-d828-4e94-900b-6eacfa0c9d5c admin admin] PATH_INFO: `/v3/projects/e22b725786d04bbc8543ade455701674` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:50.690270 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c137ae-d828-4e94-900b-6eacfa0c9d5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e22b725786d04bbc8543ade455701674)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:50.692218 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c137ae-d828-4e94-900b-6eacfa0c9d5c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:50.696575 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:50.815943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-81c137ae-d828-4e94-900b-6eacfa0c9d5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e22b725786d04bbc8543ade455701674', 'request_id': 'req-81c137ae-d828-4e94-900b-6eacfa0c9d5c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:50.842931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-81c137ae-d828-4e94-900b-6eacfa0c9d5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e22b725786d04bbc8543ade455701674', 'request_id': 'req-81c137ae-d828-4e94-900b-6eacfa0c9d5c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:50.862814 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-81c137ae-d828-4e94-900b-6eacfa0c9d5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e22b725786d04bbc8543ade455701674', 'request_id': 'req-81c137ae-d828-4e94-900b-6eacfa0c9d5c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:50.892977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-81c137ae-d828-4e94-900b-6eacfa0c9d5c admin admin] The token cache is being invalidate because project e22b725786d04bbc8543ade455701674 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:05:50.893360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-81c137ae-d828-4e94-900b-6eacfa0c9d5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:50.894204 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-81c137ae-d828-4e94-900b-6eacfa0c9d5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:50.901176 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1463/2909] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:05:50 2022] DELETE /identity/v3/projects/e22b725786d04bbc8543ade455701674 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:50.907232 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183adfe-48d2-4b23-bd5d-53d3e62827d4 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:50.907724 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183adfe-48d2-4b23-bd5d-53d3e62827d4 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:50.908049 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183adfe-48d2-4b23-bd5d-53d3e62827d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:50.979286 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e183adfe-48d2-4b23-bd5d-53d3e62827d4 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:50.985716 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e183adfe-48d2-4b23-bd5d-53d3e62827d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:50.992864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfdee0-6fa2-480f-aef6-599394aaa5b0 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:50.993250 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfdee0-6fa2-480f-aef6-599394aaa5b0 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:50.993732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfdee0-6fa2-480f-aef6-599394aaa5b0 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:50.995778 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1464/2910] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:05:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 04 01:05:51.012742 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfdee0-6fa2-480f-aef6-599394aaa5b0 None None] Authenticating service token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:05:51.014675 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-60cfdee0-6fa2-480f-aef6-599394aaa5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:51.172237 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1447/2911] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:51.174035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfdee0-6fa2-480f-aef6-599394aaa5b0 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:51.180094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae4f43-61cd-4ae7-949a-433ef6284514 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:51.180482 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae4f43-61cd-4ae7-949a-433ef6284514 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:51.180842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae4f43-61cd-4ae7-949a-433ef6284514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:51.188742 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-60cfdee0-6fa2-480f-aef6-599394aaa5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:51.230987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-edae4f43-61cd-4ae7-949a-433ef6284514 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:51.232178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-edae4f43-61cd-4ae7-949a-433ef6284514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:51.254513 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1448/2912] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:05:51.258829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae4f43-61cd-4ae7-949a-433ef6284514 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:51.284212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae4f43-61cd-4ae7-949a-433ef6284514 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:51.316412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73279e00-dcb8-4665-a7d5-d623858c5951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:51.317047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73279e00-dcb8-4665-a7d5-d623858c5951 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:51.317326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73279e00-dcb8-4665-a7d5-d623858c5951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:51.317623 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73279e00-dcb8-4665-a7d5-d623858c5951 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:51.323284 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73279e00-dcb8-4665-a7d5-d623858c5951 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:05:51.323621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73279e00-dcb8-4665-a7d5-d623858c5951 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:51.327905 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73279e00-dcb8-4665-a7d5-d623858c5951 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:51.378814 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1449/2913] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:05:51.389215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73279e00-dcb8-4665-a7d5-d623858c5951 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:51.403686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfdee0-6fa2-480f-aef6-599394aaa5b0 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:51.407930 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73279e00-dcb8-4665-a7d5-d623858c5951 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:51.416711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b3acd-6d5f-4d0e-b15f-b723f94b264e tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13a3a6a395284191b641d737ade54b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c58ee7b834e14d4eac02e2179d1286f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:51.417935 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b3acd-6d5f-4d0e-b15f-b723f94b264e tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:51.418588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b3acd-6d5f-4d0e-b15f-b723f94b264e tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:51.419046 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b3acd-6d5f-4d0e-b15f-b723f94b264e tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] PATH_INFO: `/v3/projects/890f73569fa2487c8360fe9cf48423c0` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:51.420283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b3acd-6d5f-4d0e-b15f-b723f94b264e tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] RBAC: Authorizing `identity:get_project(project_id=890f73569fa2487c8360fe9cf48423c0)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:51.421947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabc048-d950-4e39-8c9e-e44b0a8fbc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:51.422541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabc048-d950-4e39-8c9e-e44b0a8fbc93 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:51.422819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabc048-d950-4e39-8c9e-e44b0a8fbc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:51.423155 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabc048-d950-4e39-8c9e-e44b0a8fbc93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:51.423803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dabc048-d950-4e39-8c9e-e44b0a8fbc93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:51.425747 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dabc048-d950-4e39-8c9e-e44b0a8fbc93 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:51.432131 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b3acd-6d5f-4d0e-b15f-b723f94b264e tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:51.451896 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1465/2914] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:05:51 2022] GET /identity/v3/projects/890f73569fa2487c8360fe9cf48423c0 => generated 381 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:05:51.492748 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1450/2915] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:05:51 2022] POST /identity/v3/projects => generated 403 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:05:51.497731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b3acd-6d5f-4d0e-b15f-b723f94b264e tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:51.539243 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b3acd-6d5f-4d0e-b15f-b723f94b264e tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:51.615735 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:51.730200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f3e72-60aa-4c25-82f1-a495fc4dae39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:51.732374 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f3e72-60aa-4c25-82f1-a495fc4dae39 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:51.734630 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f3e72-60aa-4c25-82f1-a495fc4dae39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:51.735076 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f3e72-60aa-4c25-82f1-a495fc4dae39 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:51.736600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f3e72-60aa-4c25-82f1-a495fc4dae39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:51.740298 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f3e72-60aa-4c25-82f1-a495fc4dae39 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:51.816756 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76613c-1d21-4601-965c-5bfc0fefa55c None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:51.817048 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76613c-1d21-4601-965c-5bfc0fefa55c None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:51.817325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76613c-1d21-4601-965c-5bfc0fefa55c None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:51.818714 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1451/2916] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:05:51.829795 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1466/2917] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:05:51 2022] POST /identity/v3/users => generated 302 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:05:51.834053 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76613c-1d21-4601-965c-5bfc0fefa55c None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:51.842706 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f3e72-60aa-4c25-82f1-a495fc4dae39 admin admin] Authenticating service token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:05:51.850914 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76613c-1d21-4601-965c-5bfc0fefa55c None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:51.857261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661bd73-cf41-4293-9a5f-bc77583e49f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:51.858372 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661bd73-cf41-4293-9a5f-bc77583e49f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:51.858864 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661bd73-cf41-4293-9a5f-bc77583e49f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:51.859319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661bd73-cf41-4293-9a5f-bc77583e49f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:51.860207 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661bd73-cf41-4293-9a5f-bc77583e49f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:51.864681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661bd73-cf41-4293-9a5f-bc77583e49f2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:51.895091 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1452/2918] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:05:51.896628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661bd73-cf41-4293-9a5f-bc77583e49f2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:51.918438 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661bd73-cf41-4293-9a5f-bc77583e49f2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:51.924952 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a329160-8ed1-4a75-8b60-68dbfff43252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:51.928314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a329160-8ed1-4a75-8b60-68dbfff43252 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:51.929378 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a329160-8ed1-4a75-8b60-68dbfff43252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:51.929912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a329160-8ed1-4a75-8b60-68dbfff43252 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:51.930841 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a329160-8ed1-4a75-8b60-68dbfff43252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:51.933415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a329160-8ed1-4a75-8b60-68dbfff43252 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:51.969340 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1453/2919] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:05:51.971100 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a329160-8ed1-4a75-8b60-68dbfff43252 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:51.993706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a329160-8ed1-4a75-8b60-68dbfff43252 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:52.029159 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6dd42-372d-40e2-ae59-bc854c6d3216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:52.032421 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6dd42-372d-40e2-ae59-bc854c6d3216 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:52.034195 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6dd42-372d-40e2-ae59-bc854c6d3216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:52.036010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6dd42-372d-40e2-ae59-bc854c6d3216 admin admin] PATH_INFO: `/v3/projects/465aff51d8a54229a7956a67a47ebd5a/users/11e841b1ead547559aa16eb1aac48d01/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:52.066657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f3e72-60aa-4c25-82f1-a495fc4dae39 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:52.096381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6dd42-372d-40e2-ae59-bc854c6d3216 admin admin] RBAC: Authorizing `identity:create_grant(project_id=465aff51d8a54229a7956a67a47ebd5a, user_id=11e841b1ead547559aa16eb1aac48d01, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:52.099648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6dd42-372d-40e2-ae59-bc854c6d3216 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:52.160636 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1454/2920] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:05:51 2022] PUT /identity/v3/projects/465aff51d8a54229a7956a67a47ebd5a/users/11e841b1ead547559aa16eb1aac48d01/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:52.162887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebd76e-66b2-49b0-8528-711f6495e268 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:52.163179 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebd76e-66b2-49b0-8528-711f6495e268 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:52.163431 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebd76e-66b2-49b0-8528-711f6495e268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:52.221189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-bfebd76e-66b2-49b0-8528-711f6495e268 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:52.222457 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bfebd76e-66b2-49b0-8528-711f6495e268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:52.263957 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f3e72-60aa-4c25-82f1-a495fc4dae39 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:52.365004 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4dd7b-1616-4694-9195-12fac098860c tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13a3a6a395284191b641d737ade54b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c58ee7b834e14d4eac02e2179d1286f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:52.366009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4dd7b-1616-4694-9195-12fac098860c tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:52.366456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4dd7b-1616-4694-9195-12fac098860c tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:52.366891 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4dd7b-1616-4694-9195-12fac098860c tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] PATH_INFO: `/v3/projects/890f73569fa2487c8360fe9cf48423c0` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:52.368563 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c4dd7b-1616-4694-9195-12fac098860c tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] RBAC: Authorizing `identity:get_project(project_id=890f73569fa2487c8360fe9cf48423c0)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:52.371482 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c4dd7b-1616-4694-9195-12fac098860c tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:52.375041 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1467/2921] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:05:51 2022] GET /identity/v3/projects/890f73569fa2487c8360fe9cf48423c0 => generated 381 bytes in 533 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:05:52.469577 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1455/2922] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:05:52.483280 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4dd7b-1616-4694-9195-12fac098860c tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:52.485150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-29c4dd7b-1616-4694-9195-12fac098860c tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:52.493792 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:52.607766 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4dd7b-1616-4694-9195-12fac098860c tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:52.614093 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebc470-8b2b-4cd9-ad30-78c6997c3b64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:52.615104 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebc470-8b2b-4cd9-ad30-78c6997c3b64 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:52.615482 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebc470-8b2b-4cd9-ad30-78c6997c3b64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:52.615824 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebc470-8b2b-4cd9-ad30-78c6997c3b64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:52.643196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abe8c7-b60d-4a4e-a846-2bea0311505f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:52.643523 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abe8c7-b60d-4a4e-a846-2bea0311505f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:52.643809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abe8c7-b60d-4a4e-a846-2bea0311505f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:52.664399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ebc470-8b2b-4cd9-ad30-78c6997c3b64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:52.670074 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ebc470-8b2b-4cd9-ad30-78c6997c3b64 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:52.690455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a1abe8c7-b60d-4a4e-a846-2bea0311505f None None] MFA Rules not processed for user `da306544339649069bc7c2f4f743320a`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:52.691681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a1abe8c7-b60d-4a4e-a846-2bea0311505f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:52.697180 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1468/2923] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:05:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:05:52.726808 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:52.853555 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1456/2924] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:53.484665 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396af217-beb5-4401-adf9-61aeaeb145a1 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:53.486358 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396af217-beb5-4401-adf9-61aeaeb145a1 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:53.486854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396af217-beb5-4401-adf9-61aeaeb145a1 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:53.492242 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1469/2925] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:05:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:05:53.497459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1abe8c7-b60d-4a4e-a846-2bea0311505f None None] Authenticating service token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:05:53.618748 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1abe8c7-b60d-4a4e-a846-2bea0311505f None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:53.633917 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1abe8c7-b60d-4a4e-a846-2bea0311505f None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:53.643804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405bb223-aa25-4db2-8dcd-e257fa7c4755 tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13a3a6a395284191b641d737ade54b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c58ee7b834e14d4eac02e2179d1286f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:53.647438 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bb223-aa25-4db2-8dcd-e257fa7c4755 tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:53.647942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bb223-aa25-4db2-8dcd-e257fa7c4755 tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:53.648566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bb223-aa25-4db2-8dcd-e257fa7c4755 tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] PATH_INFO: `/v3/projects/890f73569fa2487c8360fe9cf48423c0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:53.650432 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405bb223-aa25-4db2-8dcd-e257fa7c4755 tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] RBAC: Authorizing `identity:get_project(project_id=890f73569fa2487c8360fe9cf48423c0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:53.653301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405bb223-aa25-4db2-8dcd-e257fa7c4755 tempest-QuotasAdminNegativeTest-1599952492 tempest-QuotasAdminNegativeTest-1599952492-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:53.658320 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1457/2926] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:05:53 2022] GET /identity/v3/projects/890f73569fa2487c8360fe9cf48423c0 => generated 381 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:05:53.790517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396af217-beb5-4401-adf9-61aeaeb145a1 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:53.790517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-396af217-beb5-4401-adf9-61aeaeb145a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:53.834520 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396af217-beb5-4401-adf9-61aeaeb145a1 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:53.845504 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540804bf-b0da-45c2-ad54-a62469cfc192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:53.846582 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540804bf-b0da-45c2-ad54-a62469cfc192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:53.847129 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540804bf-b0da-45c2-ad54-a62469cfc192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:53.847669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540804bf-b0da-45c2-ad54-a62469cfc192 admin admin] PATH_INFO: `/v3/users/da306544339649069bc7c2f4f743320a` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:53.850295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540804bf-b0da-45c2-ad54-a62469cfc192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da306544339649069bc7c2f4f743320a)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:53.852363 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540804bf-b0da-45c2-ad54-a62469cfc192 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:53.966066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-540804bf-b0da-45c2-ad54-a62469cfc192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da306544339649069bc7c2f4f743320a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:53.966852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-540804bf-b0da-45c2-ad54-a62469cfc192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da306544339649069bc7c2f4f743320a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:53.979098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-540804bf-b0da-45c2-ad54-a62469cfc192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da306544339649069bc7c2f4f743320a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:53.992511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-540804bf-b0da-45c2-ad54-a62469cfc192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da306544339649069bc7c2f4f743320a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:53.994333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-540804bf-b0da-45c2-ad54-a62469cfc192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da306544339649069bc7c2f4f743320a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:54.020548 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1470/2927] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:05:53 2022] DELETE /identity/v3/users/da306544339649069bc7c2f4f743320a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:54.025376 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f871592-1aca-46ad-b186-98f5ef465df0 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:54.025964 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f871592-1aca-46ad-b186-98f5ef465df0 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:54.026589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f871592-1aca-46ad-b186-98f5ef465df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:54.076156 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-0f871592-1aca-46ad-b186-98f5ef465df0 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:54.086411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0f871592-1aca-46ad-b186-98f5ef465df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:54.190643 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1458/2928] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:54.207185 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540804bf-b0da-45c2-ad54-a62469cfc192 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:54.210340 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-540804bf-b0da-45c2-ad54-a62469cfc192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:54.318920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540804bf-b0da-45c2-ad54-a62469cfc192 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:54.324707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4cafe-b30f-4e2b-82aa-d05232334cae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:54.325809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4cafe-b30f-4e2b-82aa-d05232334cae service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:54.325940 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4cafe-b30f-4e2b-82aa-d05232334cae service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:54.326679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4cafe-b30f-4e2b-82aa-d05232334cae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:54.340837 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f4cafe-b30f-4e2b-82aa-d05232334cae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:54.342431 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f4cafe-b30f-4e2b-82aa-d05232334cae service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:54.359682 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1471/2929] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:05:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:05:55.781148 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f871592-1aca-46ad-b186-98f5ef465df0 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:55.782670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0f871592-1aca-46ad-b186-98f5ef465df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:55.799737 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f871592-1aca-46ad-b186-98f5ef465df0 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:55.859124 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149546a2-ba26-4695-b2fe-bf7edeeac8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:55.860136 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149546a2-ba26-4695-b2fe-bf7edeeac8cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:55.860613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149546a2-ba26-4695-b2fe-bf7edeeac8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:55.861090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149546a2-ba26-4695-b2fe-bf7edeeac8cf admin admin] PATH_INFO: `/v3/projects/890f73569fa2487c8360fe9cf48423c0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:55.862557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149546a2-ba26-4695-b2fe-bf7edeeac8cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=890f73569fa2487c8360fe9cf48423c0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:55.865643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149546a2-ba26-4695-b2fe-bf7edeeac8cf admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:55.949650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4cafe-b30f-4e2b-82aa-d05232334cae service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:55.951826 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f5f4cafe-b30f-4e2b-82aa-d05232334cae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:55.953736 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:55.965140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-149546a2-ba26-4695-b2fe-bf7edeeac8cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '890f73569fa2487c8360fe9cf48423c0', 'request_id': 'req-149546a2-ba26-4695-b2fe-bf7edeeac8cf'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:55.987486 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-149546a2-ba26-4695-b2fe-bf7edeeac8cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '890f73569fa2487c8360fe9cf48423c0', 'request_id': 'req-149546a2-ba26-4695-b2fe-bf7edeeac8cf'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:55.987743 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:55.999342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-149546a2-ba26-4695-b2fe-bf7edeeac8cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '890f73569fa2487c8360fe9cf48423c0', 'request_id': 'req-149546a2-ba26-4695-b2fe-bf7edeeac8cf'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:56.039163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-149546a2-ba26-4695-b2fe-bf7edeeac8cf admin admin] The token cache is being invalidate because project 890f73569fa2487c8360fe9cf48423c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:05:56.039751 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-149546a2-ba26-4695-b2fe-bf7edeeac8cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:56.041726 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-149546a2-ba26-4695-b2fe-bf7edeeac8cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:56.044532 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1459/2930] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:05:55 2022] DELETE /identity/v3/projects/890f73569fa2487c8360fe9cf48423c0 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:56.048838 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149546a2-ba26-4695-b2fe-bf7edeeac8cf admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:56.050347 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-149546a2-ba26-4695-b2fe-bf7edeeac8cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:56.057247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4cafe-b30f-4e2b-82aa-d05232334cae service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:56.144872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149546a2-ba26-4695-b2fe-bf7edeeac8cf admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:56.153021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc6025-c21b-4836-a8a3-79715e454562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:56.153953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc6025-c21b-4836-a8a3-79715e454562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:56.154112 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc6025-c21b-4836-a8a3-79715e454562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:56.154371 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc6025-c21b-4836-a8a3-79715e454562 admin admin] PATH_INFO: `/v3/users/13a3a6a395284191b641d737ade54b58` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:56.155879 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc6025-c21b-4836-a8a3-79715e454562 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13a3a6a395284191b641d737ade54b58)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:56.158135 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc6025-c21b-4836-a8a3-79715e454562 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:56.212622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3337f-ccd6-4f5e-a939-90704c8c3650 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:56.212622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3337f-ccd6-4f5e-a939-90704c8c3650 service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:56.212964 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3337f-ccd6-4f5e-a939-90704c8c3650 service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:56.213062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3337f-ccd6-4f5e-a939-90704c8c3650 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:56.219893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a1a3337f-ccd6-4f5e-a939-90704c8c3650 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:56.259152 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e3dc6025-c21b-4836-a8a3-79715e454562 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13a3a6a395284191b641d737ade54b58'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:56.262101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e3dc6025-c21b-4836-a8a3-79715e454562 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13a3a6a395284191b641d737ade54b58'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:56.265241 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a3337f-ccd6-4f5e-a939-90704c8c3650 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:56.267027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a3337f-ccd6-4f5e-a939-90704c8c3650 service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:56.290468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e3dc6025-c21b-4836-a8a3-79715e454562 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13a3a6a395284191b641d737ade54b58'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:56.306149 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1472/2931] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:05:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:05:56.327515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e3dc6025-c21b-4836-a8a3-79715e454562 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13a3a6a395284191b641d737ade54b58'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:56.329224 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e3dc6025-c21b-4836-a8a3-79715e454562 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13a3a6a395284191b641d737ade54b58'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:56.387310 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1460/2932] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:05:56 2022] DELETE /identity/v3/users/13a3a6a395284191b641d737ade54b58 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:05:57.682466 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3337f-ccd6-4f5e-a939-90704c8c3650 service placement] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:57.705602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3337f-ccd6-4f5e-a939-90704c8c3650 service placement] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:57.852232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bade45d-1d63-4de2-a4ca-bc689783a2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:57.852877 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bade45d-1d63-4de2-a4ca-bc689783a2aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:57.853221 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bade45d-1d63-4de2-a4ca-bc689783a2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:57.853631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bade45d-1d63-4de2-a4ca-bc689783a2aa admin admin] PATH_INFO: `/v3/projects/c58ee7b834e14d4eac02e2179d1286f5` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:57.856077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bade45d-1d63-4de2-a4ca-bc689783a2aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=c58ee7b834e14d4eac02e2179d1286f5)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:57.860149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bade45d-1d63-4de2-a4ca-bc689783a2aa admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:57.953683 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1bade45d-1d63-4de2-a4ca-bc689783a2aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c58ee7b834e14d4eac02e2179d1286f5', 'request_id': 'req-1bade45d-1d63-4de2-a4ca-bc689783a2aa'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:57.960392 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:57.964522 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1bade45d-1d63-4de2-a4ca-bc689783a2aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c58ee7b834e14d4eac02e2179d1286f5', 'request_id': 'req-1bade45d-1d63-4de2-a4ca-bc689783a2aa'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:57.975035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1bade45d-1d63-4de2-a4ca-bc689783a2aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c58ee7b834e14d4eac02e2179d1286f5', 'request_id': 'req-1bade45d-1d63-4de2-a4ca-bc689783a2aa'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:57.993147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1bade45d-1d63-4de2-a4ca-bc689783a2aa admin admin] The token cache is being invalidate because project c58ee7b834e14d4eac02e2179d1286f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:05:57.994008 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1bade45d-1d63-4de2-a4ca-bc689783a2aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:57.995134 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1bade45d-1d63-4de2-a4ca-bc689783a2aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:05:57.998261 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1473/2933] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:05:57 2022] DELETE /identity/v3/projects/c58ee7b834e14d4eac02e2179d1286f5 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:58.004621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a82ffa-d571-454e-a762-00b74ebc5be5 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:58.005261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a82ffa-d571-454e-a762-00b74ebc5be5 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:58.005261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a82ffa-d571-454e-a762-00b74ebc5be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:58.041604 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-67a82ffa-d571-454e-a762-00b74ebc5be5 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:58.042842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-67a82ffa-d571-454e-a762-00b74ebc5be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:58.127569 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:58.152295 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1461/2934] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:58.236399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4dd19d-3065-470a-acd9-9c17b917595a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:58.237058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4dd19d-3065-470a-acd9-9c17b917595a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:58.237562 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4dd19d-3065-470a-acd9-9c17b917595a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:58.289202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-7d4dd19d-3065-470a-acd9-9c17b917595a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:58.296615 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7d4dd19d-3065-470a-acd9-9c17b917595a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:58.314976 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1474/2935] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:58.321495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a82ffa-d571-454e-a762-00b74ebc5be5 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:58.353110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a82ffa-d571-454e-a762-00b74ebc5be5 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:58.370235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d24cab-0301-4458-a3d9-81bd4bbdbf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:58.370965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d24cab-0301-4458-a3d9-81bd4bbdbf34 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:58.371344 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d24cab-0301-4458-a3d9-81bd4bbdbf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:58.371802 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d24cab-0301-4458-a3d9-81bd4bbdbf34 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:58.372552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d24cab-0301-4458-a3d9-81bd4bbdbf34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:05:58.372952 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d24cab-0301-4458-a3d9-81bd4bbdbf34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:58.374838 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d24cab-0301-4458-a3d9-81bd4bbdbf34 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:58.388464 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1462/2936] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:05:58.392519 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4dd19d-3065-470a-acd9-9c17b917595a None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:58.407696 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4dd19d-3065-470a-acd9-9c17b917595a None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:58.416197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f035afe-6b88-4a61-ab19-2cd1fac925ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:58.417262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f035afe-6b88-4a61-ab19-2cd1fac925ab admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:58.417963 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f035afe-6b88-4a61-ab19-2cd1fac925ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:58.418451 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f035afe-6b88-4a61-ab19-2cd1fac925ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:58.419422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f035afe-6b88-4a61-ab19-2cd1fac925ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:58.422462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f035afe-6b88-4a61-ab19-2cd1fac925ab admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:58.491549 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1475/2937] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:05:58 2022] POST /identity/v3/projects => generated 389 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:05:58.493907 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d24cab-0301-4458-a3d9-81bd4bbdbf34 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:58.510419 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d24cab-0301-4458-a3d9-81bd4bbdbf34 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:58.653540 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d149f9-5289-4c75-ab23-373b126960aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:58.653987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d149f9-5289-4c75-ab23-373b126960aa admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:58.654269 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d149f9-5289-4c75-ab23-373b126960aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:58.654545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d149f9-5289-4c75-ab23-373b126960aa admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:58.655189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d149f9-5289-4c75-ab23-373b126960aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:58.657144 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d149f9-5289-4c75-ab23-373b126960aa admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:58.710916 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1463/2938] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:05:58 2022] POST /identity/v3/users => generated 295 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:05:58.716517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f035afe-6b88-4a61-ab19-2cd1fac925ab admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:58.752289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f035afe-6b88-4a61-ab19-2cd1fac925ab admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:58.768480 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22477bc-bef5-4e94-a42a-5d4adb60bc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:58.769402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22477bc-bef5-4e94-a42a-5d4adb60bc0f admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:58.786733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22477bc-bef5-4e94-a42a-5d4adb60bc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:58.787159 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22477bc-bef5-4e94-a42a-5d4adb60bc0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:58.789776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22477bc-bef5-4e94-a42a-5d4adb60bc0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:58.793731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22477bc-bef5-4e94-a42a-5d4adb60bc0f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:58.814972 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1476/2939] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:05:58.820300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d149f9-5289-4c75-ab23-373b126960aa admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:58.841163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d149f9-5289-4c75-ab23-373b126960aa admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:58.852835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f102e-c3b1-4141-b0a7-8ce12be8352f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:58.854207 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f102e-c3b1-4141-b0a7-8ce12be8352f admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:58.854517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f102e-c3b1-4141-b0a7-8ce12be8352f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:58.855176 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f102e-c3b1-4141-b0a7-8ce12be8352f admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:58.855568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f102e-c3b1-4141-b0a7-8ce12be8352f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:58.860350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f102e-c3b1-4141-b0a7-8ce12be8352f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:58.889095 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1464/2940] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:05:58.891304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22477bc-bef5-4e94-a42a-5d4adb60bc0f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:58.908176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22477bc-bef5-4e94-a42a-5d4adb60bc0f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:58.920208 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e77180-85a7-412d-8643-16cc41f07901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:58.924198 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e77180-85a7-412d-8643-16cc41f07901 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:58.924875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e77180-85a7-412d-8643-16cc41f07901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:58.925332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e77180-85a7-412d-8643-16cc41f07901 admin admin] PATH_INFO: `/v3/projects/4a2cbfef6c7f400fbb9be18396d9cfad/users/0bea5a05fa6a48858e1b72c96aa36a07/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:58.957257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e77180-85a7-412d-8643-16cc41f07901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a2cbfef6c7f400fbb9be18396d9cfad, user_id=0bea5a05fa6a48858e1b72c96aa36a07, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:58.960799 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e77180-85a7-412d-8643-16cc41f07901 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:58.995065 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c73fec-c263-4f40-9ba1-c9e39a32336e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:58.995386 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c73fec-c263-4f40-9ba1-c9e39a32336e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:58.995663 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c73fec-c263-4f40-9ba1-c9e39a32336e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:58.998683 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1477/2941] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:05:58 2022] PUT /identity/v3/projects/4a2cbfef6c7f400fbb9be18396d9cfad/users/0bea5a05fa6a48858e1b72c96aa36a07/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:59.039963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-39c73fec-c263-4f40-9ba1-c9e39a32336e None None] MFA Rules not processed for user `0bea5a05fa6a48858e1b72c96aa36a07`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:59.041270 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-39c73fec-c263-4f40-9ba1-c9e39a32336e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:59.181485 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1465/2942] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:58 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:59.185961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e77180-85a7-412d-8643-16cc41f07901 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:59.270062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e77180-85a7-412d-8643-16cc41f07901 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:59.276785 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab3225-9de1-4691-824f-e6f2be0fa8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:59.277540 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab3225-9de1-4691-824f-e6f2be0fa8af admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:59.278036 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab3225-9de1-4691-824f-e6f2be0fa8af admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:59.278279 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab3225-9de1-4691-824f-e6f2be0fa8af admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:59.279010 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab3225-9de1-4691-824f-e6f2be0fa8af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:59.281499 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab3225-9de1-4691-824f-e6f2be0fa8af admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:59.327889 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1478/2943] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:05:59 2022] POST /identity/v3/projects => generated 391 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:05:59.330213 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c73fec-c263-4f40-9ba1-c9e39a32336e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:59.344068 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c73fec-c263-4f40-9ba1-c9e39a32336e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:59.399548 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:59.427597 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765651b-b1b2-4a43-8bda-85dd31694377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:59.428567 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765651b-b1b2-4a43-8bda-85dd31694377 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:59.429067 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765651b-b1b2-4a43-8bda-85dd31694377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:59.429657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765651b-b1b2-4a43-8bda-85dd31694377 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:59.430604 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765651b-b1b2-4a43-8bda-85dd31694377 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:59.433535 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765651b-b1b2-4a43-8bda-85dd31694377 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:59.477209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab3225-9de1-4691-824f-e6f2be0fa8af admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:59.481697 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1466/2944] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:05:59 2022] POST /identity/v3/users => generated 302 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:05:59.510438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab3225-9de1-4691-824f-e6f2be0fa8af admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:59.515619 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15036ea-6f34-4730-9e3c-1c3e654453bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:59.516785 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15036ea-6f34-4730-9e3c-1c3e654453bf admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:59.517074 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15036ea-6f34-4730-9e3c-1c3e654453bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:59.517424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15036ea-6f34-4730-9e3c-1c3e654453bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:59.519442 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15036ea-6f34-4730-9e3c-1c3e654453bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:59.521287 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15036ea-6f34-4730-9e3c-1c3e654453bf admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:59.538184 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1479/2945] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:05:59.538658 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765651b-b1b2-4a43-8bda-85dd31694377 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:59.553488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765651b-b1b2-4a43-8bda-85dd31694377 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:59.567234 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b850f-ba5a-456c-8b04-6c63139b6ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:59.568057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b850f-ba5a-456c-8b04-6c63139b6ef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:59.568403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b850f-ba5a-456c-8b04-6c63139b6ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:59.568761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b850f-ba5a-456c-8b04-6c63139b6ef2 admin admin] PATH_INFO: `/v3/projects/d071df031ad245d5853eb543ced9c9e3/users/5dbd21b71dfd446ba0a8e8408624c52f/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:59.586395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b850f-ba5a-456c-8b04-6c63139b6ef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d071df031ad245d5853eb543ced9c9e3, user_id=5dbd21b71dfd446ba0a8e8408624c52f, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:59.589163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b850f-ba5a-456c-8b04-6c63139b6ef2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:59.605634 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1467/2946] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:05:59 2022] PUT /identity/v3/projects/d071df031ad245d5853eb543ced9c9e3/users/5dbd21b71dfd446ba0a8e8408624c52f/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:59.619090 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15036ea-6f34-4730-9e3c-1c3e654453bf admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:59.631389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15036ea-6f34-4730-9e3c-1c3e654453bf admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:59.684201 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:05:59.700694 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71442e38-cf0a-4fa2-ae7d-f67503a209dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:59.702157 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71442e38-cf0a-4fa2-ae7d-f67503a209dc admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:59.702157 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71442e38-cf0a-4fa2-ae7d-f67503a209dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:59.702394 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71442e38-cf0a-4fa2-ae7d-f67503a209dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:59.703018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71442e38-cf0a-4fa2-ae7d-f67503a209dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:59.704791 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71442e38-cf0a-4fa2-ae7d-f67503a209dc admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:59.719792 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1480/2947] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:05:59.722639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b850f-ba5a-456c-8b04-6c63139b6ef2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:59.735274 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b850f-ba5a-456c-8b04-6c63139b6ef2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:05:59.740952 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df846bc1-b076-4e41-899c-e5790918848d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:05:59.741833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df846bc1-b076-4e41-899c-e5790918848d admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:59.742218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df846bc1-b076-4e41-899c-e5790918848d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:59.742619 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df846bc1-b076-4e41-899c-e5790918848d admin admin] PATH_INFO: `/v3/projects/d071df031ad245d5853eb543ced9c9e3/users/5dbd21b71dfd446ba0a8e8408624c52f/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:59.745006 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df846bc1-b076-4e41-899c-e5790918848d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d071df031ad245d5853eb543ced9c9e3, user_id=5dbd21b71dfd446ba0a8e8408624c52f, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:05:59.747974 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df846bc1-b076-4e41-899c-e5790918848d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:05:59.761366 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1468/2948] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:05:59 2022] PUT /identity/v3/projects/d071df031ad245d5853eb543ced9c9e3/users/5dbd21b71dfd446ba0a8e8408624c52f/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:05:59.771497 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9ae47-12fe-485a-89f7-04139645e21b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:05:59.771781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9ae47-12fe-485a-89f7-04139645e21b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:05:59.772276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9ae47-12fe-485a-89f7-04139645e21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:05:59.814066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a8d9ae47-12fe-485a-89f7-04139645e21b None None] MFA Rules not processed for user `5dbd21b71dfd446ba0a8e8408624c52f`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:05:59.815578 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a8d9ae47-12fe-485a-89f7-04139645e21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:05:59.899267 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1481/2949] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:05:59 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:05:59.911307 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df846bc1-b076-4e41-899c-e5790918848d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:05:59.914646 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-df846bc1-b076-4e41-899c-e5790918848d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:00.014003 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df846bc1-b076-4e41-899c-e5790918848d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:00.019851 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea860c-f337-4db6-8bb7-3296204e2027 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:00.020513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea860c-f337-4db6-8bb7-3296204e2027 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:00.020913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea860c-f337-4db6-8bb7-3296204e2027 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:00.021279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea860c-f337-4db6-8bb7-3296204e2027 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:00.151287 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea860c-f337-4db6-8bb7-3296204e2027 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:00.160040 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea860c-f337-4db6-8bb7-3296204e2027 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:00.198170 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1469/2950] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:05:59 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:06:01.807147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9ae47-12fe-485a-89f7-04139645e21b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:01.849749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9ae47-12fe-485a-89f7-04139645e21b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:01.863860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb137b6-a90f-4504-a09d-65c2bf4c2efc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:01.865032 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb137b6-a90f-4504-a09d-65c2bf4c2efc service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:01.865347 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb137b6-a90f-4504-a09d-65c2bf4c2efc service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:01.865619 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb137b6-a90f-4504-a09d-65c2bf4c2efc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:01.877541 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb137b6-a90f-4504-a09d-65c2bf4c2efc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:01.879334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb137b6-a90f-4504-a09d-65c2bf4c2efc service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:01.896886 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1482/2951] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:06:01 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:06:04.129139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3aaf6-b9cd-4ded-9c4d-e6bc6ee150da None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:04.130266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3aaf6-b9cd-4ded-9c4d-e6bc6ee150da None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:04.130266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3aaf6-b9cd-4ded-9c4d-e6bc6ee150da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:04.196605 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c6c3aaf6-b9cd-4ded-9c4d-e6bc6ee150da None None] MFA Rules not processed for user `11e841b1ead547559aa16eb1aac48d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:06:04.197891 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c6c3aaf6-b9cd-4ded-9c4d-e6bc6ee150da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:04.257861 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:06:04.375288 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1470/2952] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:06:04 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:06:04.820248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb137b6-a90f-4504-a09d-65c2bf4c2efc service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:04.837561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb137b6-a90f-4504-a09d-65c2bf4c2efc service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:04.857359 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59e78b-f63c-4289-9941-c51001d6b9d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:04.858018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59e78b-f63c-4289-9941-c51001d6b9d4 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:04.858298 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59e78b-f63c-4289-9941-c51001d6b9d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:04.858571 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59e78b-f63c-4289-9941-c51001d6b9d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:04.860397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8c59e78b-f63c-4289-9941-c51001d6b9d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:05.043230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59e78b-f63c-4289-9941-c51001d6b9d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:05.044861 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59e78b-f63c-4289-9941-c51001d6b9d4 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:05.069080 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1483/2953] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:06:04 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:06:05.164552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c3aaf6-b9cd-4ded-9c4d-e6bc6ee150da None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:05.185493 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c3aaf6-b9cd-4ded-9c4d-e6bc6ee150da None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:05.196435 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee41e1-eb67-460d-be81-19c71ed93a68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:05.197163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee41e1-eb67-460d-be81-19c71ed93a68 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:05.200473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee41e1-eb67-460d-be81-19c71ed93a68 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:05.201367 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee41e1-eb67-460d-be81-19c71ed93a68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:05.214752 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee41e1-eb67-460d-be81-19c71ed93a68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:05.233601 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee41e1-eb67-460d-be81-19c71ed93a68 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:05.259392 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1471/2954] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:06:05 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:06:05.860164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a71032-ad06-4fed-a07a-5148e89c9e6b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:05.860608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a71032-ad06-4fed-a07a-5148e89c9e6b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:05.860947 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a71032-ad06-4fed-a07a-5148e89c9e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:05.940783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-99a71032-ad06-4fed-a07a-5148e89c9e6b None None] MFA Rules not processed for user `cd793e15c7d44ed7bc1fff15d57297c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:06:05.943725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-99a71032-ad06-4fed-a07a-5148e89c9e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:06.100194 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1484/2955] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:06:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:06:09.126565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2005c-d661-4491-a2f2-dca7b80ec8c9 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:09.127114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2005c-d661-4491-a2f2-dca7b80ec8c9 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:09.127722 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2005c-d661-4491-a2f2-dca7b80ec8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:09.187284 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a1d2005c-d661-4491-a2f2-dca7b80ec8c9 None None] MFA Rules not processed for user `41571ce2b64c4762b04ed0848bf34c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:06:09.189717 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a1d2005c-d661-4491-a2f2-dca7b80ec8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:09.222871 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1472/2956] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:06:09 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:06:14.407688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a71032-ad06-4fed-a07a-5148e89c9e6b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:14.414561 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:06:14.506556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a71032-ad06-4fed-a07a-5148e89c9e6b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:14.530038 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a948352-9949-45c3-918f-48e4d2e9da3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:14.532122 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a948352-9949-45c3-918f-48e4d2e9da3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:14.533783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a948352-9949-45c3-918f-48e4d2e9da3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:14.534253 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a948352-9949-45c3-918f-48e4d2e9da3b admin admin] PATH_INFO: `/v3/users/0bea5a05fa6a48858e1b72c96aa36a07` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:14.540523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a948352-9949-45c3-918f-48e4d2e9da3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bea5a05fa6a48858e1b72c96aa36a07)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:14.556247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a948352-9949-45c3-918f-48e4d2e9da3b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:14.797449 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8a948352-9949-45c3-918f-48e4d2e9da3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bea5a05fa6a48858e1b72c96aa36a07'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:14.798471 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8a948352-9949-45c3-918f-48e4d2e9da3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bea5a05fa6a48858e1b72c96aa36a07'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:14.813333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8a948352-9949-45c3-918f-48e4d2e9da3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bea5a05fa6a48858e1b72c96aa36a07'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:14.842612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8a948352-9949-45c3-918f-48e4d2e9da3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bea5a05fa6a48858e1b72c96aa36a07'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:14.843710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8a948352-9949-45c3-918f-48e4d2e9da3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bea5a05fa6a48858e1b72c96aa36a07'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:14.898521 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1485/2957] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:06:14 2022] DELETE /identity/v3/users/0bea5a05fa6a48858e1b72c96aa36a07 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:06:14.899207 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e8a97-0e67-4d99-babc-0c7954e7c0e9 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:14.900074 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e8a97-0e67-4d99-babc-0c7954e7c0e9 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:14.900567 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e8a97-0e67-4d99-babc-0c7954e7c0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:14.953206 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-836e8a97-0e67-4d99-babc-0c7954e7c0e9 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:06:14.957629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-836e8a97-0e67-4d99-babc-0c7954e7c0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:15.157944 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1473/2958] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:06:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:06:15.168776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a948352-9949-45c3-918f-48e4d2e9da3b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:15.171410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8a948352-9949-45c3-918f-48e4d2e9da3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:15.323127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a948352-9949-45c3-918f-48e4d2e9da3b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:15.332118 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb63955-da3a-4061-9773-b1307359386e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:15.332934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb63955-da3a-4061-9773-b1307359386e service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:15.333321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb63955-da3a-4061-9773-b1307359386e service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:15.333719 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb63955-da3a-4061-9773-b1307359386e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:15.357807 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb63955-da3a-4061-9773-b1307359386e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:15.359935 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb63955-da3a-4061-9773-b1307359386e service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:15.376800 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1486/2959] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:06:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:06:15.807493 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e8a97-0e67-4d99-babc-0c7954e7c0e9 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:15.808906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-836e8a97-0e67-4d99-babc-0c7954e7c0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:15.853947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e8a97-0e67-4d99-babc-0c7954e7c0e9 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:15.869397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca861c8-40c1-48ed-88d0-f26622d56d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:15.874447 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca861c8-40c1-48ed-88d0-f26622d56d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:15.877112 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca861c8-40c1-48ed-88d0-f26622d56d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:15.877535 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca861c8-40c1-48ed-88d0-f26622d56d5d admin admin] PATH_INFO: `/v3/projects/4a2cbfef6c7f400fbb9be18396d9cfad` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:15.900997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca861c8-40c1-48ed-88d0-f26622d56d5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a2cbfef6c7f400fbb9be18396d9cfad)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:15.903210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca861c8-40c1-48ed-88d0-f26622d56d5d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:16.010747 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6ca861c8-40c1-48ed-88d0-f26622d56d5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a2cbfef6c7f400fbb9be18396d9cfad', 'request_id': 'req-6ca861c8-40c1-48ed-88d0-f26622d56d5d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:16.023508 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6ca861c8-40c1-48ed-88d0-f26622d56d5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a2cbfef6c7f400fbb9be18396d9cfad', 'request_id': 'req-6ca861c8-40c1-48ed-88d0-f26622d56d5d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:16.031671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6ca861c8-40c1-48ed-88d0-f26622d56d5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a2cbfef6c7f400fbb9be18396d9cfad', 'request_id': 'req-6ca861c8-40c1-48ed-88d0-f26622d56d5d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:16.049795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6ca861c8-40c1-48ed-88d0-f26622d56d5d admin admin] The token cache is being invalidate because project 4a2cbfef6c7f400fbb9be18396d9cfad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:06:16.050510 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6ca861c8-40c1-48ed-88d0-f26622d56d5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:16.052367 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6ca861c8-40c1-48ed-88d0-f26622d56d5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:16.054788 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1474/2960] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:06:15 2022] DELETE /identity/v3/projects/4a2cbfef6c7f400fbb9be18396d9cfad => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:06:16.058765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb63955-da3a-4061-9773-b1307359386e service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:16.074198 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb63955-da3a-4061-9773-b1307359386e service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:16.119863 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:06:16.182719 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8773d1-f63c-4c53-b5b4-368265549f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:16.184192 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8773d1-f63c-4c53-b5b4-368265549f18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:16.186461 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8773d1-f63c-4c53-b5b4-368265549f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:16.186794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8773d1-f63c-4c53-b5b4-368265549f18 admin admin] PATH_INFO: `/v3/users/5dbd21b71dfd446ba0a8e8408624c52f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:16.191221 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8773d1-f63c-4c53-b5b4-368265549f18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dbd21b71dfd446ba0a8e8408624c52f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:16.194808 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8773d1-f63c-4c53-b5b4-368265549f18 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:16.276741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2d8773d1-f63c-4c53-b5b4-368265549f18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dbd21b71dfd446ba0a8e8408624c52f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:16.278697 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2d8773d1-f63c-4c53-b5b4-368265549f18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dbd21b71dfd446ba0a8e8408624c52f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:16.305477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2d8773d1-f63c-4c53-b5b4-368265549f18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dbd21b71dfd446ba0a8e8408624c52f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:16.318784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2d8773d1-f63c-4c53-b5b4-368265549f18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dbd21b71dfd446ba0a8e8408624c52f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:16.319850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2d8773d1-f63c-4c53-b5b4-368265549f18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dbd21b71dfd446ba0a8e8408624c52f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:16.364492 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1487/2961] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:06:16 2022] DELETE /identity/v3/users/5dbd21b71dfd446ba0a8e8408624c52f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:06:17.260265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca861c8-40c1-48ed-88d0-f26622d56d5d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:17.262420 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6ca861c8-40c1-48ed-88d0-f26622d56d5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:17.278699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca861c8-40c1-48ed-88d0-f26622d56d5d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:17.417936 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:06:17.460718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e2bbe-b07f-4c1a-b6bf-9edadad08805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:17.462388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e2bbe-b07f-4c1a-b6bf-9edadad08805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:17.462773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e2bbe-b07f-4c1a-b6bf-9edadad08805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:17.463154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e2bbe-b07f-4c1a-b6bf-9edadad08805 admin admin] PATH_INFO: `/v3/projects/d071df031ad245d5853eb543ced9c9e3` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:17.464757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e2bbe-b07f-4c1a-b6bf-9edadad08805 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d071df031ad245d5853eb543ced9c9e3)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:17.467241 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e2bbe-b07f-4c1a-b6bf-9edadad08805 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:17.537203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dc9e2bbe-b07f-4c1a-b6bf-9edadad08805 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd071df031ad245d5853eb543ced9c9e3', 'request_id': 'req-dc9e2bbe-b07f-4c1a-b6bf-9edadad08805'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:17.566847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dc9e2bbe-b07f-4c1a-b6bf-9edadad08805 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd071df031ad245d5853eb543ced9c9e3', 'request_id': 'req-dc9e2bbe-b07f-4c1a-b6bf-9edadad08805'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:17.577037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dc9e2bbe-b07f-4c1a-b6bf-9edadad08805 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd071df031ad245d5853eb543ced9c9e3', 'request_id': 'req-dc9e2bbe-b07f-4c1a-b6bf-9edadad08805'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:17.591982 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dc9e2bbe-b07f-4c1a-b6bf-9edadad08805 admin admin] The token cache is being invalidate because project d071df031ad245d5853eb543ced9c9e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:06:17.592712 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dc9e2bbe-b07f-4c1a-b6bf-9edadad08805 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:17.593707 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dc9e2bbe-b07f-4c1a-b6bf-9edadad08805 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:17.596817 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1475/2962] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:06:17 2022] DELETE /identity/v3/projects/d071df031ad245d5853eb543ced9c9e3 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:06:17.601907 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a321d42-039b-49fa-8db2-e4ac75aaa7d1 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:17.603043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a321d42-039b-49fa-8db2-e4ac75aaa7d1 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:17.605453 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a321d42-039b-49fa-8db2-e4ac75aaa7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:17.658383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-2a321d42-039b-49fa-8db2-e4ac75aaa7d1 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:06:17.663572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2a321d42-039b-49fa-8db2-e4ac75aaa7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:17.834478 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1488/2963] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:06:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:06:17.843004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d0f86-f8e0-4229-b15c-216c57747138 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:17.843347 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d0f86-f8e0-4229-b15c-216c57747138 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:17.844826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d0f86-f8e0-4229-b15c-216c57747138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:17.910943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-ba0d0f86-f8e0-4229-b15c-216c57747138 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:06:17.912029 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ba0d0f86-f8e0-4229-b15c-216c57747138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:17.939534 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1476/2964] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:06:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:06:17.944478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a321d42-039b-49fa-8db2-e4ac75aaa7d1 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:17.974442 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a321d42-039b-49fa-8db2-e4ac75aaa7d1 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:18.002767 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3a865-1ebe-415c-885c-4c09ea889cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:18.004537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3a865-1ebe-415c-885c-4c09ea889cba admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:18.005167 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3a865-1ebe-415c-885c-4c09ea889cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:18.005570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3a865-1ebe-415c-885c-4c09ea889cba admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:18.006925 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec3a865-1ebe-415c-885c-4c09ea889cba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:06:18.007342 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec3a865-1ebe-415c-885c-4c09ea889cba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:18.009515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec3a865-1ebe-415c-885c-4c09ea889cba admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:18.029472 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1489/2965] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:06:18.035383 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d0f86-f8e0-4229-b15c-216c57747138 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:18.048811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d0f86-f8e0-4229-b15c-216c57747138 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:18.056095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c269a-392c-4708-ac53-8d34382dce6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:18.057394 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c269a-392c-4708-ac53-8d34382dce6a admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:18.057394 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c269a-392c-4708-ac53-8d34382dce6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:18.057394 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c269a-392c-4708-ac53-8d34382dce6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:18.058958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c269a-392c-4708-ac53-8d34382dce6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:18.063013 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c269a-392c-4708-ac53-8d34382dce6a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:18.145796 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1477/2966] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:06:18 2022] POST /identity/v3/projects => generated 369 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:06:18.149474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3a865-1ebe-415c-885c-4c09ea889cba admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:18.163720 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3a865-1ebe-415c-885c-4c09ea889cba admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:18.216490 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:06:18.254818 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb7635-8d70-47bf-9613-a2f386c5b971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:18.255541 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb7635-8d70-47bf-9613-a2f386c5b971 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:18.255882 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb7635-8d70-47bf-9613-a2f386c5b971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:18.256837 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb7635-8d70-47bf-9613-a2f386c5b971 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:18.257402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb7635-8d70-47bf-9613-a2f386c5b971 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:18.259675 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb7635-8d70-47bf-9613-a2f386c5b971 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:18.302566 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1490/2967] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:06:18 2022] POST /identity/v3/users => generated 285 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:06:18.306642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c269a-392c-4708-ac53-8d34382dce6a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:18.323215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c269a-392c-4708-ac53-8d34382dce6a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:18.345094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564b94a-a573-4658-ab18-839d3696a0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:18.346509 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564b94a-a573-4658-ab18-839d3696a0cd admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:18.347450 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564b94a-a573-4658-ab18-839d3696a0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:18.347772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564b94a-a573-4658-ab18-839d3696a0cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:18.348720 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564b94a-a573-4658-ab18-839d3696a0cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:18.362956 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564b94a-a573-4658-ab18-839d3696a0cd admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:18.394235 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1478/2968] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:06:18.395466 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb7635-8d70-47bf-9613-a2f386c5b971 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:18.411099 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb7635-8d70-47bf-9613-a2f386c5b971 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:18.422331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8f9f9-6068-49e3-b2fc-101930215391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:18.423079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8f9f9-6068-49e3-b2fc-101930215391 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:18.424775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8f9f9-6068-49e3-b2fc-101930215391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:18.425367 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8f9f9-6068-49e3-b2fc-101930215391 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:18.426668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8f9f9-6068-49e3-b2fc-101930215391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:18.429391 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8f9f9-6068-49e3-b2fc-101930215391 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:18.461964 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1491/2969] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:06:18.464371 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564b94a-a573-4658-ab18-839d3696a0cd admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:18.483356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564b94a-a573-4658-ab18-839d3696a0cd admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:18.487529 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211bce66-867a-4460-8ca8-59b0689be71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:18.488213 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bce66-867a-4460-8ca8-59b0689be71a admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:18.488539 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bce66-867a-4460-8ca8-59b0689be71a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:18.488812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bce66-867a-4460-8ca8-59b0689be71a admin admin] PATH_INFO: `/v3/projects/23214774643944acbd5ab786f04ecaa6/users/d15709caf7cf4db4bba6a6e0074a637d/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:18.515977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211bce66-867a-4460-8ca8-59b0689be71a admin admin] RBAC: Authorizing `identity:create_grant(project_id=23214774643944acbd5ab786f04ecaa6, user_id=d15709caf7cf4db4bba6a6e0074a637d, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:18.520340 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211bce66-867a-4460-8ca8-59b0689be71a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:18.553591 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1479/2970] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:06:18 2022] PUT /identity/v3/projects/23214774643944acbd5ab786f04ecaa6/users/d15709caf7cf4db4bba6a6e0074a637d/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:06:18.556636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba3503-f20b-4540-ad69-38f20e9046fb None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:18.557225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba3503-f20b-4540-ad69-38f20e9046fb None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:18.557997 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba3503-f20b-4540-ad69-38f20e9046fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:18.657945 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-09ba3503-f20b-4540-ad69-38f20e9046fb None None] MFA Rules not processed for user `d15709caf7cf4db4bba6a6e0074a637d`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:06:18.659428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-09ba3503-f20b-4540-ad69-38f20e9046fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:18.868675 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1492/2971] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:06:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:06:19.179861 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211bce66-867a-4460-8ca8-59b0689be71a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:19.181985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-211bce66-867a-4460-8ca8-59b0689be71a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:19.387065 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:06:19.491107 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211bce66-867a-4460-8ca8-59b0689be71a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:19.511665 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f150d-7278-480a-97f3-d2cd08bb0cfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:19.512259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f150d-7278-480a-97f3-d2cd08bb0cfa service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:19.512551 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f150d-7278-480a-97f3-d2cd08bb0cfa service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:19.512820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f150d-7278-480a-97f3-d2cd08bb0cfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:19.529017 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f150d-7278-480a-97f3-d2cd08bb0cfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:19.531812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f150d-7278-480a-97f3-d2cd08bb0cfa service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:19.559760 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1480/2972] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:06:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:06:21.692915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba3503-f20b-4540-ad69-38f20e9046fb None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:21.815532 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba3503-f20b-4540-ad69-38f20e9046fb None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:21.820679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52747138-dcb0-4913-9fcf-6a35f0789e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:21.821319 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52747138-dcb0-4913-9fcf-6a35f0789e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:21.821640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52747138-dcb0-4913-9fcf-6a35f0789e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:21.822095 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52747138-dcb0-4913-9fcf-6a35f0789e42 admin admin] PATH_INFO: `/v3/users/d15709caf7cf4db4bba6a6e0074a637d` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:21.823530 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52747138-dcb0-4913-9fcf-6a35f0789e42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d15709caf7cf4db4bba6a6e0074a637d)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:21.825634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52747138-dcb0-4913-9fcf-6a35f0789e42 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:21.903504 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:06:21.906981 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-52747138-dcb0-4913-9fcf-6a35f0789e42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd15709caf7cf4db4bba6a6e0074a637d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:21.910468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-52747138-dcb0-4913-9fcf-6a35f0789e42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd15709caf7cf4db4bba6a6e0074a637d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:21.927945 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-52747138-dcb0-4913-9fcf-6a35f0789e42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd15709caf7cf4db4bba6a6e0074a637d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:21.947467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-52747138-dcb0-4913-9fcf-6a35f0789e42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd15709caf7cf4db4bba6a6e0074a637d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:21.948195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-52747138-dcb0-4913-9fcf-6a35f0789e42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd15709caf7cf4db4bba6a6e0074a637d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:21.973750 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1493/2973] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:06:21 2022] DELETE /identity/v3/users/d15709caf7cf4db4bba6a6e0074a637d => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:06:21.980774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037174c-dc9a-435d-a88d-8f66e44f5adf None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:21.981352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037174c-dc9a-435d-a88d-8f66e44f5adf None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:21.981352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037174c-dc9a-435d-a88d-8f66e44f5adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:22.023845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-0037174c-dc9a-435d-a88d-8f66e44f5adf None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:06:22.026810 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0037174c-dc9a-435d-a88d-8f66e44f5adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:22.153465 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1481/2974] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:06:22.180372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52747138-dcb0-4913-9fcf-6a35f0789e42 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:22.181835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-52747138-dcb0-4913-9fcf-6a35f0789e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:22.246674 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52747138-dcb0-4913-9fcf-6a35f0789e42 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:22.250772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de87580-e19f-4d8d-a07b-3f6f546c205a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:22.251398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de87580-e19f-4d8d-a07b-3f6f546c205a service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:22.251683 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de87580-e19f-4d8d-a07b-3f6f546c205a service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:22.252039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de87580-e19f-4d8d-a07b-3f6f546c205a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:22.267615 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de87580-e19f-4d8d-a07b-3f6f546c205a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:22.269093 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de87580-e19f-4d8d-a07b-3f6f546c205a service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:22.280524 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1494/2975] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:06:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:06:23.499240 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037174c-dc9a-435d-a88d-8f66e44f5adf None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:23.500546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0037174c-dc9a-435d-a88d-8f66e44f5adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:23.513930 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037174c-dc9a-435d-a88d-8f66e44f5adf None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:23.518718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61211f9c-3223-4908-a96a-c8cb00ba0898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:23.519935 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61211f9c-3223-4908-a96a-c8cb00ba0898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:23.520217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61211f9c-3223-4908-a96a-c8cb00ba0898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:23.520700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61211f9c-3223-4908-a96a-c8cb00ba0898 admin admin] PATH_INFO: `/v3/projects/23214774643944acbd5ab786f04ecaa6` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:23.522120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61211f9c-3223-4908-a96a-c8cb00ba0898 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23214774643944acbd5ab786f04ecaa6)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:23.524269 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61211f9c-3223-4908-a96a-c8cb00ba0898 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:23.594519 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-61211f9c-3223-4908-a96a-c8cb00ba0898 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23214774643944acbd5ab786f04ecaa6', 'request_id': 'req-61211f9c-3223-4908-a96a-c8cb00ba0898'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:23.609306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-61211f9c-3223-4908-a96a-c8cb00ba0898 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23214774643944acbd5ab786f04ecaa6', 'request_id': 'req-61211f9c-3223-4908-a96a-c8cb00ba0898'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:23.627881 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-61211f9c-3223-4908-a96a-c8cb00ba0898 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23214774643944acbd5ab786f04ecaa6', 'request_id': 'req-61211f9c-3223-4908-a96a-c8cb00ba0898'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:23.640928 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-61211f9c-3223-4908-a96a-c8cb00ba0898 admin admin] The token cache is being invalidate because project 23214774643944acbd5ab786f04ecaa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:06:23.641401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-61211f9c-3223-4908-a96a-c8cb00ba0898 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:23.642215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-61211f9c-3223-4908-a96a-c8cb00ba0898 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:23.644196 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1482/2976] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:06:23 2022] DELETE /identity/v3/projects/23214774643944acbd5ab786f04ecaa6 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:06:23.649295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54fd65-a8d6-4ba7-b949-87f8ed516f3b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:23.650490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54fd65-a8d6-4ba7-b949-87f8ed516f3b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:23.651011 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54fd65-a8d6-4ba7-b949-87f8ed516f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:23.698838 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ae54fd65-a8d6-4ba7-b949-87f8ed516f3b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:06:23.700871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ae54fd65-a8d6-4ba7-b949-87f8ed516f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:23.807213 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534acf8d-ac2e-4cef-b4c8-38a1f0e6337f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:23.807767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534acf8d-ac2e-4cef-b4c8-38a1f0e6337f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:23.808261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534acf8d-ac2e-4cef-b4c8-38a1f0e6337f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:23.809774 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1495/2977] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:06:23.838508 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-534acf8d-ac2e-4cef-b4c8-38a1f0e6337f None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:06:23.840569 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-534acf8d-ac2e-4cef-b4c8-38a1f0e6337f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:23.858743 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1483/2978] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:06:23.860710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54fd65-a8d6-4ba7-b949-87f8ed516f3b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:23.896699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54fd65-a8d6-4ba7-b949-87f8ed516f3b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:23.904744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c68013-922f-4089-9d77-f8ff9e86eb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:23.905375 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c68013-922f-4089-9d77-f8ff9e86eb21 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:23.906554 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c68013-922f-4089-9d77-f8ff9e86eb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:23.906835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c68013-922f-4089-9d77-f8ff9e86eb21 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:23.907506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c68013-922f-4089-9d77-f8ff9e86eb21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:06:23.907812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c68013-922f-4089-9d77-f8ff9e86eb21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:23.909954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c68013-922f-4089-9d77-f8ff9e86eb21 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:23.936522 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1496/2979] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:06:23.938142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534acf8d-ac2e-4cef-b4c8-38a1f0e6337f None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:23.961468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534acf8d-ac2e-4cef-b4c8-38a1f0e6337f None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:23.972207 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcffd87f-c9f4-4158-812f-a30a8905ee74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:23.976252 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffd87f-c9f4-4158-812f-a30a8905ee74 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:23.976548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffd87f-c9f4-4158-812f-a30a8905ee74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:23.976828 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffd87f-c9f4-4158-812f-a30a8905ee74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:23.982363 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcffd87f-c9f4-4158-812f-a30a8905ee74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:23.987414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcffd87f-c9f4-4158-812f-a30a8905ee74 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:24.045137 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1484/2980] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:06:23 2022] POST /identity/v3/projects => generated 411 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:06:24.048818 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c68013-922f-4089-9d77-f8ff9e86eb21 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:24.071602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c68013-922f-4089-9d77-f8ff9e86eb21 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:24.208769 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:06:24.257405 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0ec6b-96e4-4996-9187-0287a31183aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:24.258073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0ec6b-96e4-4996-9187-0287a31183aa admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:24.258357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0ec6b-96e4-4996-9187-0287a31183aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:24.258629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0ec6b-96e4-4996-9187-0287a31183aa admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:24.259273 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0ec6b-96e4-4996-9187-0287a31183aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:24.261256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0ec6b-96e4-4996-9187-0287a31183aa admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:24.308710 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1497/2981] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:06:24 2022] POST /identity/v3/users => generated 306 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:06:24.313374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcffd87f-c9f4-4158-812f-a30a8905ee74 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:24.338257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcffd87f-c9f4-4158-812f-a30a8905ee74 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:24.344301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632ee7d-d5ff-4ae4-9b71-0ae8277a68b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:24.344929 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632ee7d-d5ff-4ae4-9b71-0ae8277a68b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:24.345210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632ee7d-d5ff-4ae4-9b71-0ae8277a68b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:24.345508 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632ee7d-d5ff-4ae4-9b71-0ae8277a68b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:24.346160 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632ee7d-d5ff-4ae4-9b71-0ae8277a68b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:24.347827 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632ee7d-d5ff-4ae4-9b71-0ae8277a68b3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:24.368740 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1485/2982] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:06:24.372336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0ec6b-96e4-4996-9187-0287a31183aa admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:24.386405 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0ec6b-96e4-4996-9187-0287a31183aa admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:24.405767 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa83741-c6c2-4fb4-8b0b-96b1ea7fa642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:24.406267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa83741-c6c2-4fb4-8b0b-96b1ea7fa642 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:24.406611 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa83741-c6c2-4fb4-8b0b-96b1ea7fa642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:24.406838 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa83741-c6c2-4fb4-8b0b-96b1ea7fa642 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:24.407539 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa83741-c6c2-4fb4-8b0b-96b1ea7fa642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:24.409458 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa83741-c6c2-4fb4-8b0b-96b1ea7fa642 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:24.454772 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1498/2983] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:06:24.455992 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632ee7d-d5ff-4ae4-9b71-0ae8277a68b3 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:24.467561 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632ee7d-d5ff-4ae4-9b71-0ae8277a68b3 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:24.477503 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b031b-4c15-4b31-9bd1-db3783933fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:24.478192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b031b-4c15-4b31-9bd1-db3783933fb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:24.478470 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b031b-4c15-4b31-9bd1-db3783933fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:24.478744 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b031b-4c15-4b31-9bd1-db3783933fb5 admin admin] PATH_INFO: `/v3/projects/06aea84da6f84417a4a9c42220c86d50/users/3965adf51d564b62a2ff36d5cad032a3/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:24.496290 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b031b-4c15-4b31-9bd1-db3783933fb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06aea84da6f84417a4a9c42220c86d50, user_id=3965adf51d564b62a2ff36d5cad032a3, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:24.499073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b031b-4c15-4b31-9bd1-db3783933fb5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:24.510284 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:06:24.518164 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1486/2984] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:06:24 2022] PUT /identity/v3/projects/06aea84da6f84417a4a9c42220c86d50/users/3965adf51d564b62a2ff36d5cad032a3/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:06:24.524762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1351d94-23c1-4de3-bc6d-2f8737516eef None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:24.525105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1351d94-23c1-4de3-bc6d-2f8737516eef None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:24.525320 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1351d94-23c1-4de3-bc6d-2f8737516eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:24.556046 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-b1351d94-23c1-4de3-bc6d-2f8737516eef None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:06:24.557413 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b1351d94-23c1-4de3-bc6d-2f8737516eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:24.651936 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1499/2985] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:06:24.669765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b031b-4c15-4b31-9bd1-db3783933fb5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:24.671872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d91b031b-4c15-4b31-9bd1-db3783933fb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:24.822993 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b031b-4c15-4b31-9bd1-db3783933fb5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:24.827843 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25bc4eb-1bf2-4676-93b3-1299a1d3ea5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:24.828482 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25bc4eb-1bf2-4676-93b3-1299a1d3ea5a service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:24.828759 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25bc4eb-1bf2-4676-93b3-1299a1d3ea5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:24.829036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25bc4eb-1bf2-4676-93b3-1299a1d3ea5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:24.843322 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25bc4eb-1bf2-4676-93b3-1299a1d3ea5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:24.848673 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25bc4eb-1bf2-4676-93b3-1299a1d3ea5a service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:24.887780 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1487/2986] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:06:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:06:30.193243 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1351d94-23c1-4de3-bc6d-2f8737516eef None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:30.194841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b1351d94-23c1-4de3-bc6d-2f8737516eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:30.228147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1351d94-23c1-4de3-bc6d-2f8737516eef None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:30.243197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ae3a7-d4eb-4e6f-a7b4-e283c87a16b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:30.244059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ae3a7-d4eb-4e6f-a7b4-e283c87a16b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:30.244533 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ae3a7-d4eb-4e6f-a7b4-e283c87a16b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:30.244989 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ae3a7-d4eb-4e6f-a7b4-e283c87a16b2 admin admin] PATH_INFO: `/v3/users/067073373e894f5f9a146e6260ef793b` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:30.246690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ae3a7-d4eb-4e6f-a7b4-e283c87a16b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=067073373e894f5f9a146e6260ef793b)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:30.253029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ae3a7-d4eb-4e6f-a7b4-e283c87a16b2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:30.407319 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1c1ae3a7-d4eb-4e6f-a7b4-e283c87a16b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '067073373e894f5f9a146e6260ef793b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:30.409957 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1c1ae3a7-d4eb-4e6f-a7b4-e283c87a16b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '067073373e894f5f9a146e6260ef793b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:30.421237 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1c1ae3a7-d4eb-4e6f-a7b4-e283c87a16b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '067073373e894f5f9a146e6260ef793b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:30.456932 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1c1ae3a7-d4eb-4e6f-a7b4-e283c87a16b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '067073373e894f5f9a146e6260ef793b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:30.457527 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1c1ae3a7-d4eb-4e6f-a7b4-e283c87a16b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '067073373e894f5f9a146e6260ef793b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:30.480622 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1500/2987] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:06:30 2022] DELETE /identity/v3/users/067073373e894f5f9a146e6260ef793b => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:06:31.902110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25bc4eb-1bf2-4676-93b3-1299a1d3ea5a service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:31.934790 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25bc4eb-1bf2-4676-93b3-1299a1d3ea5a service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:32.120224 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5c72b-143a-4473-8b89-1d3860df23a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:32.121292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5c72b-143a-4473-8b89-1d3860df23a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:32.123091 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5c72b-143a-4473-8b89-1d3860df23a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:32.123778 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5c72b-143a-4473-8b89-1d3860df23a6 admin admin] PATH_INFO: `/v3/projects/c22d64e1d046431aa4fbac844d97b8e2` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:32.128817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f5c72b-143a-4473-8b89-1d3860df23a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c22d64e1d046431aa4fbac844d97b8e2)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:32.144395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f5c72b-143a-4473-8b89-1d3860df23a6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:32.247513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-23f5c72b-143a-4473-8b89-1d3860df23a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c22d64e1d046431aa4fbac844d97b8e2', 'request_id': 'req-23f5c72b-143a-4473-8b89-1d3860df23a6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:32.271652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-23f5c72b-143a-4473-8b89-1d3860df23a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c22d64e1d046431aa4fbac844d97b8e2', 'request_id': 'req-23f5c72b-143a-4473-8b89-1d3860df23a6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:32.278622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-23f5c72b-143a-4473-8b89-1d3860df23a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c22d64e1d046431aa4fbac844d97b8e2', 'request_id': 'req-23f5c72b-143a-4473-8b89-1d3860df23a6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:32.290846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ae3a7-d4eb-4e6f-a7b4-e283c87a16b2 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:32.293679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1c1ae3a7-d4eb-4e6f-a7b4-e283c87a16b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:32.298678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-23f5c72b-143a-4473-8b89-1d3860df23a6 admin admin] The token cache is being invalidate because project c22d64e1d046431aa4fbac844d97b8e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:06:32.299216 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-23f5c72b-143a-4473-8b89-1d3860df23a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:32.303869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-23f5c72b-143a-4473-8b89-1d3860df23a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:32.309870 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1488/2988] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:06:31 2022] DELETE /identity/v3/projects/c22d64e1d046431aa4fbac844d97b8e2 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:06:32.311640 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da13430-d58a-4126-9779-fad00f05e3b2 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:32.312195 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da13430-d58a-4126-9779-fad00f05e3b2 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:32.312637 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da13430-d58a-4126-9779-fad00f05e3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:32.338630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5da13430-d58a-4126-9779-fad00f05e3b2 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:06:32.340146 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5da13430-d58a-4126-9779-fad00f05e3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:32.340636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ae3a7-d4eb-4e6f-a7b4-e283c87a16b2 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:32.386082 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:06:32.446636 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:06:32.515025 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578fc98-4005-4932-908d-945be660a2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:32.515946 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578fc98-4005-4932-908d-945be660a2b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:32.516420 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578fc98-4005-4932-908d-945be660a2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:32.516848 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578fc98-4005-4932-908d-945be660a2b9 admin admin] PATH_INFO: `/v3/users/11e841b1ead547559aa16eb1aac48d01` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:32.519970 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578fc98-4005-4932-908d-945be660a2b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11e841b1ead547559aa16eb1aac48d01)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:32.522639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578fc98-4005-4932-908d-945be660a2b9 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:32.531263 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1489/2989] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:06:32.539528 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3da48-198f-4738-bb1d-07948b1a727f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:32.540001 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3da48-198f-4738-bb1d-07948b1a727f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:32.540437 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3da48-198f-4738-bb1d-07948b1a727f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:32.581037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-32c3da48-198f-4738-bb1d-07948b1a727f None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:06:32.582869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-32c3da48-198f-4738-bb1d-07948b1a727f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:32.614338 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1490/2990] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:06:32.626031 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7578fc98-4005-4932-908d-945be660a2b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11e841b1ead547559aa16eb1aac48d01'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:32.626581 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3da48-198f-4738-bb1d-07948b1a727f None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:32.626872 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7578fc98-4005-4932-908d-945be660a2b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11e841b1ead547559aa16eb1aac48d01'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:32.634750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7578fc98-4005-4932-908d-945be660a2b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11e841b1ead547559aa16eb1aac48d01'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:32.645340 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7578fc98-4005-4932-908d-945be660a2b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11e841b1ead547559aa16eb1aac48d01'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:32.647014 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7578fc98-4005-4932-908d-945be660a2b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11e841b1ead547559aa16eb1aac48d01'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:32.647231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3da48-198f-4738-bb1d-07948b1a727f None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:32.665502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3320456-6ccf-492f-b3d8-2567985981aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:32.666194 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3320456-6ccf-492f-b3d8-2567985981aa admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:32.666479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3320456-6ccf-492f-b3d8-2567985981aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:32.666750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3320456-6ccf-492f-b3d8-2567985981aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:32.667409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3320456-6ccf-492f-b3d8-2567985981aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:06:32.667713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3320456-6ccf-492f-b3d8-2567985981aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:32.669318 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3320456-6ccf-492f-b3d8-2567985981aa admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:32.687497 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1501/2991] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:06:32 2022] DELETE /identity/v3/users/11e841b1ead547559aa16eb1aac48d01 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:06:32.715907 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1491/2992] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:06:32.720406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578fc98-4005-4932-908d-945be660a2b9 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:32.722614 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7578fc98-4005-4932-908d-945be660a2b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:32.821328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578fc98-4005-4932-908d-945be660a2b9 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:32.831820 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fac6c9-96f8-4367-9b24-016e8d71784e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:32.832731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fac6c9-96f8-4367-9b24-016e8d71784e admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:32.833187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fac6c9-96f8-4367-9b24-016e8d71784e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:32.833667 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fac6c9-96f8-4367-9b24-016e8d71784e admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:32.834474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fac6c9-96f8-4367-9b24-016e8d71784e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:32.836597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fac6c9-96f8-4367-9b24-016e8d71784e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:32.882209 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1502/2993] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:06:32 2022] POST /identity/v3/projects => generated 399 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:06:32.886076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3320456-6ccf-492f-b3d8-2567985981aa admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:32.904221 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3320456-6ccf-492f-b3d8-2567985981aa admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:32.995273 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e53d49-1037-4bb4-a7ea-6dce4f96149f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:32.996116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e53d49-1037-4bb4-a7ea-6dce4f96149f admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:32.996256 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e53d49-1037-4bb4-a7ea-6dce4f96149f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:32.996416 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e53d49-1037-4bb4-a7ea-6dce4f96149f admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:32.997040 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e53d49-1037-4bb4-a7ea-6dce4f96149f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:32.999037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e53d49-1037-4bb4-a7ea-6dce4f96149f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:33.033053 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1492/2994] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:06:32 2022] POST /identity/v3/users => generated 300 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:06:33.038233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fac6c9-96f8-4367-9b24-016e8d71784e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:33.066325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fac6c9-96f8-4367-9b24-016e8d71784e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:33.076132 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3964d-49df-4683-81b7-27d005306f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:33.078421 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e53d49-1037-4bb4-a7ea-6dce4f96149f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:33.080381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-69e53d49-1037-4bb4-a7ea-6dce4f96149f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:33.089734 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3964d-49df-4683-81b7-27d005306f24 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:33.089946 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3964d-49df-4683-81b7-27d005306f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:33.090177 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3964d-49df-4683-81b7-27d005306f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:33.090846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3964d-49df-4683-81b7-27d005306f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:33.092537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3964d-49df-4683-81b7-27d005306f24 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:33.100619 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e53d49-1037-4bb4-a7ea-6dce4f96149f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:33.112450 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c0fa1-4588-427e-8a41-3e9b386c1d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:33.113680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c0fa1-4588-427e-8a41-3e9b386c1d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:33.113957 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c0fa1-4588-427e-8a41-3e9b386c1d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:33.115984 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c0fa1-4588-427e-8a41-3e9b386c1d6f admin admin] PATH_INFO: `/v3/projects/465aff51d8a54229a7956a67a47ebd5a` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:33.118288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c0fa1-4588-427e-8a41-3e9b386c1d6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=465aff51d8a54229a7956a67a47ebd5a)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:33.120806 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1503/2995] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:06:33.121730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3964d-49df-4683-81b7-27d005306f24 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:33.121880 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c0fa1-4588-427e-8a41-3e9b386c1d6f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:33.135097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3964d-49df-4683-81b7-27d005306f24 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:33.140081 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07072700-d61f-4067-ad38-ec31f99906b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:33.141416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07072700-d61f-4067-ad38-ec31f99906b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:33.141750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07072700-d61f-4067-ad38-ec31f99906b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:33.142024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07072700-d61f-4067-ad38-ec31f99906b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:33.143200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07072700-d61f-4067-ad38-ec31f99906b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:33.144859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07072700-d61f-4067-ad38-ec31f99906b3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:33.161767 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1504/2996] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:06:33.162648 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07072700-d61f-4067-ad38-ec31f99906b3 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:33.174757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07072700-d61f-4067-ad38-ec31f99906b3 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:33.195656 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e73c0fa1-4588-427e-8a41-3e9b386c1d6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '465aff51d8a54229a7956a67a47ebd5a', 'request_id': 'req-e73c0fa1-4588-427e-8a41-3e9b386c1d6f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:33.203076 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:06:33.205716 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e73c0fa1-4588-427e-8a41-3e9b386c1d6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '465aff51d8a54229a7956a67a47ebd5a', 'request_id': 'req-e73c0fa1-4588-427e-8a41-3e9b386c1d6f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:33.215912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e73c0fa1-4588-427e-8a41-3e9b386c1d6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '465aff51d8a54229a7956a67a47ebd5a', 'request_id': 'req-e73c0fa1-4588-427e-8a41-3e9b386c1d6f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:33.237630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e73c0fa1-4588-427e-8a41-3e9b386c1d6f admin admin] The token cache is being invalidate because project 465aff51d8a54229a7956a67a47ebd5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:06:33.238574 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e73c0fa1-4588-427e-8a41-3e9b386c1d6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:33.239392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e73c0fa1-4588-427e-8a41-3e9b386c1d6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:06:33.241329 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1493/2997] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:06:33 2022] DELETE /identity/v3/projects/465aff51d8a54229a7956a67a47ebd5a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:06:33.247208 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453efaaa-7f93-4f42-91ac-a2b81c97e530 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:33.247646 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453efaaa-7f93-4f42-91ac-a2b81c97e530 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:33.248427 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453efaaa-7f93-4f42-91ac-a2b81c97e530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:33.261707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525ea3e-f15e-4f55-b0c3-ad8a288a89a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:33.262800 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525ea3e-f15e-4f55-b0c3-ad8a288a89a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:33.263085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525ea3e-f15e-4f55-b0c3-ad8a288a89a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:33.263361 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525ea3e-f15e-4f55-b0c3-ad8a288a89a2 admin admin] PATH_INFO: `/v3/projects/484dec51a1bc4d89a2b874dc29a697ec/users/653bbf56943e40b791f843e117c91f71/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:33.272169 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-453efaaa-7f93-4f42-91ac-a2b81c97e530 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:06:33.273763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-453efaaa-7f93-4f42-91ac-a2b81c97e530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:33.290101 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1494/2998] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:06:33.290332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525ea3e-f15e-4f55-b0c3-ad8a288a89a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=484dec51a1bc4d89a2b874dc29a697ec, user_id=653bbf56943e40b791f843e117c91f71, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:33.290332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525ea3e-f15e-4f55-b0c3-ad8a288a89a2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:33.293123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308f0da-4d59-440b-8337-6f0b5226bd96 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:33.293545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308f0da-4d59-440b-8337-6f0b5226bd96 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:33.293831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308f0da-4d59-440b-8337-6f0b5226bd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:33.305141 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1505/2999] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:06:33 2022] PUT /identity/v3/projects/484dec51a1bc4d89a2b874dc29a697ec/users/653bbf56943e40b791f843e117c91f71/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:06:33.310244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01932878-d542-436c-8405-c7aea1298dff None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:33.310760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01932878-d542-436c-8405-c7aea1298dff None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:33.311210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01932878-d542-436c-8405-c7aea1298dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:33.321849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e308f0da-4d59-440b-8337-6f0b5226bd96 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:06:33.323263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e308f0da-4d59-440b-8337-6f0b5226bd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:33.337352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-01932878-d542-436c-8405-c7aea1298dff None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:06:33.339325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-01932878-d542-436c-8405-c7aea1298dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:33.346871 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:06:33.419470 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1495/3000] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:06:33.424889 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308f0da-4d59-440b-8337-6f0b5226bd96 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:33.430734 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1506/3001] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:06:33.453806 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01932878-d542-436c-8405-c7aea1298dff None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:33.455236 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-01932878-d542-436c-8405-c7aea1298dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:33.456040 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308f0da-4d59-440b-8337-6f0b5226bd96 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:33.462402 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bcb56c-5914-4f75-8568-1b98c349c5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:33.463328 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcb56c-5914-4f75-8568-1b98c349c5e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:33.463612 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcb56c-5914-4f75-8568-1b98c349c5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:33.463886 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcb56c-5914-4f75-8568-1b98c349c5e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:33.464843 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bcb56c-5914-4f75-8568-1b98c349c5e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:06:33.465202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bcb56c-5914-4f75-8568-1b98c349c5e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:33.467077 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bcb56c-5914-4f75-8568-1b98c349c5e4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:33.482618 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1496/3002] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:06:33.486887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bcb56c-5914-4f75-8568-1b98c349c5e4 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:33.500591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bcb56c-5914-4f75-8568-1b98c349c5e4 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:33.507841 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989bc13-ad9a-4dc6-b8fa-54c99fbc619a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:33.508531 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989bc13-ad9a-4dc6-b8fa-54c99fbc619a admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:33.508900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989bc13-ad9a-4dc6-b8fa-54c99fbc619a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:33.509232 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989bc13-ad9a-4dc6-b8fa-54c99fbc619a admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:33.510199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8989bc13-ad9a-4dc6-b8fa-54c99fbc619a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:33.512451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8989bc13-ad9a-4dc6-b8fa-54c99fbc619a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:33.544790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01932878-d542-436c-8405-c7aea1298dff None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:33.548904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8cfa7-e484-4d8d-ba03-5d3ae0911c3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:33.549900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8cfa7-e484-4d8d-ba03-5d3ae0911c3b service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:33.550719 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8cfa7-e484-4d8d-ba03-5d3ae0911c3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:33.550992 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8cfa7-e484-4d8d-ba03-5d3ae0911c3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:33.562164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8cfa7-e484-4d8d-ba03-5d3ae0911c3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:33.563699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8cfa7-e484-4d8d-ba03-5d3ae0911c3b service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:33.578381 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1497/3003] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:06:33 2022] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:06:33.583893 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989bc13-ad9a-4dc6-b8fa-54c99fbc619a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:33.601173 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1507/3004] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:06:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:06:33.703820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989bc13-ad9a-4dc6-b8fa-54c99fbc619a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:33.711173 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c44bef-96fc-48ec-a2ad-9c0312c41277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:33.712298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c44bef-96fc-48ec-a2ad-9c0312c41277 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:33.712796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c44bef-96fc-48ec-a2ad-9c0312c41277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:33.714212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c44bef-96fc-48ec-a2ad-9c0312c41277 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:33.715874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c44bef-96fc-48ec-a2ad-9c0312c41277 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:33.718187 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c44bef-96fc-48ec-a2ad-9c0312c41277 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:33.774122 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1498/3005] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:06:33 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:06:33.777678 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8cfa7-e484-4d8d-ba03-5d3ae0911c3b service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:33.790918 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8cfa7-e484-4d8d-ba03-5d3ae0911c3b service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:33.801480 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9237b-711f-4e09-818d-21f1126ba2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:33.804280 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9237b-711f-4e09-818d-21f1126ba2ae admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:33.804844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9237b-711f-4e09-818d-21f1126ba2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:33.807482 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9237b-711f-4e09-818d-21f1126ba2ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:33.809864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b9237b-711f-4e09-818d-21f1126ba2ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:33.814890 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b9237b-711f-4e09-818d-21f1126ba2ae admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:33.837056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c44bef-96fc-48ec-a2ad-9c0312c41277 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:33.845226 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1508/3006] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:06:33.850283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c44bef-96fc-48ec-a2ad-9c0312c41277 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:33.855476 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a6a9a-d120-4c8f-8858-f21a79d50c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:33.856727 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a6a9a-d120-4c8f-8858-f21a79d50c1f admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:33.857230 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a6a9a-d120-4c8f-8858-f21a79d50c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:33.857987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a6a9a-d120-4c8f-8858-f21a79d50c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:33.859336 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3a6a9a-d120-4c8f-8858-f21a79d50c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:33.861982 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3a6a9a-d120-4c8f-8858-f21a79d50c1f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:33.882062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9237b-711f-4e09-818d-21f1126ba2ae admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:33.906064 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1499/3007] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:06:33.911182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9237b-711f-4e09-818d-21f1126ba2ae admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:33.929479 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94af197-6477-4d7d-a0ad-6a89201af932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:33.930279 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94af197-6477-4d7d-a0ad-6a89201af932 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:33.930623 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94af197-6477-4d7d-a0ad-6a89201af932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:33.930992 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94af197-6477-4d7d-a0ad-6a89201af932 admin admin] PATH_INFO: `/v3/projects/8eb65d155e5745c392747c7d3d4d0c07/users/a0067546d2f94a1db3b16750f5dfa909/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:33.948485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94af197-6477-4d7d-a0ad-6a89201af932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eb65d155e5745c392747c7d3d4d0c07, user_id=a0067546d2f94a1db3b16750f5dfa909, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:33.951710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94af197-6477-4d7d-a0ad-6a89201af932 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:33.981694 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1509/3008] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:06:33 2022] PUT /identity/v3/projects/8eb65d155e5745c392747c7d3d4d0c07/users/a0067546d2f94a1db3b16750f5dfa909/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:06:33.982590 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb3300-69e3-46e7-b98e-ff8f32972146 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:33.982884 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb3300-69e3-46e7-b98e-ff8f32972146 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:33.983233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb3300-69e3-46e7-b98e-ff8f32972146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:34.018692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-76cb3300-69e3-46e7-b98e-ff8f32972146 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:06:34.019981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-76cb3300-69e3-46e7-b98e-ff8f32972146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:34.157551 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1500/3009] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:06:34.182360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94af197-6477-4d7d-a0ad-6a89201af932 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:34.219494 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:06:34.303887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94af197-6477-4d7d-a0ad-6a89201af932 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:34.308765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd332ef9-0982-438c-aa8c-72b7eb7e0387 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:34.310551 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd332ef9-0982-438c-aa8c-72b7eb7e0387 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:34.311053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd332ef9-0982-438c-aa8c-72b7eb7e0387 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:34.311631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd332ef9-0982-438c-aa8c-72b7eb7e0387 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:34.329779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd332ef9-0982-438c-aa8c-72b7eb7e0387 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:34.332488 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd332ef9-0982-438c-aa8c-72b7eb7e0387 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:34.346433 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1510/3010] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:06:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:06:38.908137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb3300-69e3-46e7-b98e-ff8f32972146 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:38.910118 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-76cb3300-69e3-46e7-b98e-ff8f32972146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:38.916276 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:06:39.018435 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd6906-6bc8-4a07-b719-c52d0cb1fd98 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:39.019322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd6906-6bc8-4a07-b719-c52d0cb1fd98 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:39.019819 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd6906-6bc8-4a07-b719-c52d0cb1fd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:39.111927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-82cd6906-6bc8-4a07-b719-c52d0cb1fd98 None None] MFA Rules not processed for user `3965adf51d564b62a2ff36d5cad032a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:06:39.114145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-82cd6906-6bc8-4a07-b719-c52d0cb1fd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:39.129906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb3300-69e3-46e7-b98e-ff8f32972146 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:39.160083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57d7cc-b776-46b3-ac61-36ee2717f0fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:39.160854 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57d7cc-b776-46b3-ac61-36ee2717f0fc service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:39.162223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57d7cc-b776-46b3-ac61-36ee2717f0fc service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:39.162613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57d7cc-b776-46b3-ac61-36ee2717f0fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:39.171377 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3d57d7cc-b776-46b3-ac61-36ee2717f0fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:39.327228 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1511/3011] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:06:39 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:06:39.337999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17b561-7558-4b8f-99fe-9ededb6b5062 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:39.338703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17b561-7558-4b8f-99fe-9ededb6b5062 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:39.339244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17b561-7558-4b8f-99fe-9ededb6b5062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:39.359960 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d57d7cc-b776-46b3-ac61-36ee2717f0fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:39.362999 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d57d7cc-b776-46b3-ac61-36ee2717f0fc service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:39.400679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-8d17b561-7558-4b8f-99fe-9ededb6b5062 None None] MFA Rules not processed for user `3965adf51d564b62a2ff36d5cad032a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:06:39.400972 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1501/3012] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:06:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:06:39.402437 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8d17b561-7558-4b8f-99fe-9ededb6b5062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:39.420936 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1512/3013] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:06:39 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:06:39.882456 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57d7cc-b776-46b3-ac61-36ee2717f0fc service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:39.890156 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3d57d7cc-b776-46b3-ac61-36ee2717f0fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:39.922996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57d7cc-b776-46b3-ac61-36ee2717f0fc service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:39.931402 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301c377-fe1a-412a-b4ba-77d8cbcbf35a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:39.932290 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301c377-fe1a-412a-b4ba-77d8cbcbf35a service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:39.932973 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301c377-fe1a-412a-b4ba-77d8cbcbf35a service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:39.933407 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301c377-fe1a-412a-b4ba-77d8cbcbf35a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:39.942798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301c377-fe1a-412a-b4ba-77d8cbcbf35a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:39.944701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301c377-fe1a-412a-b4ba-77d8cbcbf35a service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:39.963263 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1502/3014] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:06:39 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:06:41.903537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17b561-7558-4b8f-99fe-9ededb6b5062 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:41.917830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17b561-7558-4b8f-99fe-9ededb6b5062 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:41.944613 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f08a42-7e81-495f-b5a1-47c2c56496c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:41.945639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f08a42-7e81-495f-b5a1-47c2c56496c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:41.946105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f08a42-7e81-495f-b5a1-47c2c56496c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:41.946532 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f08a42-7e81-495f-b5a1-47c2c56496c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:41.950688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-65f08a42-7e81-495f-b5a1-47c2c56496c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:41.977042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f08a42-7e81-495f-b5a1-47c2c56496c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:41.979379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f08a42-7e81-495f-b5a1-47c2c56496c7 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:42.001126 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1513/3015] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:06:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:06:46.741863 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ec73d-3af2-4e52-9e9e-96b13ff89d94 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:46.742776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ec73d-3af2-4e52-9e9e-96b13ff89d94 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:46.743245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ec73d-3af2-4e52-9e9e-96b13ff89d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:46.854218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-8c5ec73d-3af2-4e52-9e9e-96b13ff89d94 None None] MFA Rules not processed for user `653bbf56943e40b791f843e117c91f71`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:06:46.855485 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8c5ec73d-3af2-4e52-9e9e-96b13ff89d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:47.041832 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1503/3016] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:06:46 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:06:47.044787 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e6946-4a8f-484d-be14-6078da83b204 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:47.045324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e6946-4a8f-484d-be14-6078da83b204 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:47.045423 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e6946-4a8f-484d-be14-6078da83b204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:47.117108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-267e6946-4a8f-484d-be14-6078da83b204 None None] MFA Rules not processed for user `653bbf56943e40b791f843e117c91f71`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:06:47.123587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-267e6946-4a8f-484d-be14-6078da83b204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:47.157424 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1514/3017] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:06:47 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:06:47.215076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ec73d-3af2-4e52-9e9e-96b13ff89d94 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:47.243331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ec73d-3af2-4e52-9e9e-96b13ff89d94 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:47.256687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ea5eb-7c0e-440e-8b86-964c9b6c7958 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:47.257331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ea5eb-7c0e-440e-8b86-964c9b6c7958 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:47.259495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ea5eb-7c0e-440e-8b86-964c9b6c7958 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:47.259786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ea5eb-7c0e-440e-8b86-964c9b6c7958 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:47.282410 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ea5eb-7c0e-440e-8b86-964c9b6c7958 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:47.284120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ea5eb-7c0e-440e-8b86-964c9b6c7958 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:47.300055 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1504/3018] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:06:47 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:06:55.307443 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6c9f3-3e51-4460-b43d-787f5500ef82 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:55.308514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6c9f3-3e51-4460-b43d-787f5500ef82 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:55.308983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6c9f3-3e51-4460-b43d-787f5500ef82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:55.391291 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-4bd6c9f3-3e51-4460-b43d-787f5500ef82 None None] MFA Rules not processed for user `a0067546d2f94a1db3b16750f5dfa909`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:06:55.392524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4bd6c9f3-3e51-4460-b43d-787f5500ef82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:55.556476 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1515/3019] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:06:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:06:55.569338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22232db6-cf8d-4a3b-b3e4-7deb74a08563 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:55.569910 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22232db6-cf8d-4a3b-b3e4-7deb74a08563 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:55.570199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22232db6-cf8d-4a3b-b3e4-7deb74a08563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:55.578798 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:06:55.605056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-22232db6-cf8d-4a3b-b3e4-7deb74a08563 None None] MFA Rules not processed for user `a0067546d2f94a1db3b16750f5dfa909`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:06:55.607621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-22232db6-cf8d-4a3b-b3e4-7deb74a08563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:06:55.628250 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1505/3020] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:06:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:06:56.238283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6c9f3-3e51-4460-b43d-787f5500ef82 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:06:56.271844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6c9f3-3e51-4460-b43d-787f5500ef82 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:06:56.291081 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2c1ca-8fa3-489a-8bf2-3fab8ccc4c53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:06:56.294098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2c1ca-8fa3-489a-8bf2-3fab8ccc4c53 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:06:56.294627 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2c1ca-8fa3-489a-8bf2-3fab8ccc4c53 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:06:56.295119 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2c1ca-8fa3-489a-8bf2-3fab8ccc4c53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:06:56.334530 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2c1ca-8fa3-489a-8bf2-3fab8ccc4c53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:06:56.339779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2c1ca-8fa3-489a-8bf2-3fab8ccc4c53 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:06:56.348831 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:06:56.362030 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1516/3021] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:06:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:07:05.591628 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:06.360608 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:07.563918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bf9de-ae9a-40a6-a222-372f76b0f745 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:07.564854 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bf9de-ae9a-40a6-a222-372f76b0f745 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:07.565299 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bf9de-ae9a-40a6-a222-372f76b0f745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:07.613261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-476bf9de-ae9a-40a6-a222-372f76b0f745 None None] MFA Rules not processed for user `e17afcbd7fd346b884e55a7a587343ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:07.616026 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-476bf9de-ae9a-40a6-a222-372f76b0f745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:07.773909 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1506/3022] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:07:11.083275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2c1ca-8fa3-489a-8bf2-3fab8ccc4c53 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:11.085805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3ca2c1ca-8fa3-489a-8bf2-3fab8ccc4c53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:11.121501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2c1ca-8fa3-489a-8bf2-3fab8ccc4c53 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:11.128107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0c36f-cbff-43dd-ae76-c38d0024ffb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:11.138285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0c36f-cbff-43dd-ae76-c38d0024ffb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:11.138800 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0c36f-cbff-43dd-ae76-c38d0024ffb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:11.139249 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0c36f-cbff-43dd-ae76-c38d0024ffb9 admin admin] PATH_INFO: `/v3/users/cd793e15c7d44ed7bc1fff15d57297c7` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:11.140699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d0c36f-cbff-43dd-ae76-c38d0024ffb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd793e15c7d44ed7bc1fff15d57297c7)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:11.143617 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d0c36f-cbff-43dd-ae76-c38d0024ffb9 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:11.245979 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b8d0c36f-cbff-43dd-ae76-c38d0024ffb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd793e15c7d44ed7bc1fff15d57297c7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:11.246902 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b8d0c36f-cbff-43dd-ae76-c38d0024ffb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd793e15c7d44ed7bc1fff15d57297c7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:11.265710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b8d0c36f-cbff-43dd-ae76-c38d0024ffb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd793e15c7d44ed7bc1fff15d57297c7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:11.276557 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b8d0c36f-cbff-43dd-ae76-c38d0024ffb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd793e15c7d44ed7bc1fff15d57297c7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:11.277360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b8d0c36f-cbff-43dd-ae76-c38d0024ffb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd793e15c7d44ed7bc1fff15d57297c7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:11.307137 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1517/3023] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:07:11 2022] DELETE /identity/v3/users/cd793e15c7d44ed7bc1fff15d57297c7 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:07:11.552307 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bf9de-ae9a-40a6-a222-372f76b0f745 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:11.579203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bf9de-ae9a-40a6-a222-372f76b0f745 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:11.774781 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e210831-15c0-44a3-8af1-a0442200e6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:11.775931 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e210831-15c0-44a3-8af1-a0442200e6ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:11.776404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e210831-15c0-44a3-8af1-a0442200e6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:11.776844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e210831-15c0-44a3-8af1-a0442200e6ee admin admin] PATH_INFO: `/v3/projects/582ce97ed6c44762ad5962c259e34437` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:11.778266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e210831-15c0-44a3-8af1-a0442200e6ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=582ce97ed6c44762ad5962c259e34437)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:11.780562 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e210831-15c0-44a3-8af1-a0442200e6ee admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:11.885018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8e210831-15c0-44a3-8af1-a0442200e6ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '582ce97ed6c44762ad5962c259e34437', 'request_id': 'req-8e210831-15c0-44a3-8af1-a0442200e6ee'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:11.898425 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8e210831-15c0-44a3-8af1-a0442200e6ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '582ce97ed6c44762ad5962c259e34437', 'request_id': 'req-8e210831-15c0-44a3-8af1-a0442200e6ee'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:11.922782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8e210831-15c0-44a3-8af1-a0442200e6ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '582ce97ed6c44762ad5962c259e34437', 'request_id': 'req-8e210831-15c0-44a3-8af1-a0442200e6ee'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:11.952364 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8e210831-15c0-44a3-8af1-a0442200e6ee admin admin] The token cache is being invalidate because project 582ce97ed6c44762ad5962c259e34437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:07:11.952670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8e210831-15c0-44a3-8af1-a0442200e6ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:11.953555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8e210831-15c0-44a3-8af1-a0442200e6ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:11.957486 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1507/3024] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:07:11 2022] DELETE /identity/v3/projects/582ce97ed6c44762ad5962c259e34437 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:07:11.962010 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b44f74-bd9e-48da-89f0-94b864ded095 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:11.962588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b44f74-bd9e-48da-89f0-94b864ded095 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:11.962835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b44f74-bd9e-48da-89f0-94b864ded095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:11.995380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-f8b44f74-bd9e-48da-89f0-94b864ded095 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:11.998528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f8b44f74-bd9e-48da-89f0-94b864ded095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:12.180837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93bc3b6-1d3f-4940-9dd3-12302874d0b1 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:12.181380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93bc3b6-1d3f-4940-9dd3-12302874d0b1 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:12.181593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93bc3b6-1d3f-4940-9dd3-12302874d0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:12.181687 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1518/3025] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:07:12.206633 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a93bc3b6-1d3f-4940-9dd3-12302874d0b1 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:12.207860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a93bc3b6-1d3f-4940-9dd3-12302874d0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:12.220506 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1508/3026] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:07:12.221836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b44f74-bd9e-48da-89f0-94b864ded095 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:12.232135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b44f74-bd9e-48da-89f0-94b864ded095 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:12.247495 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb4917-4112-49c7-942b-3069f59d351a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:12.248295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb4917-4112-49c7-942b-3069f59d351a admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:12.248676 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb4917-4112-49c7-942b-3069f59d351a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:12.249086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb4917-4112-49c7-942b-3069f59d351a admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:12.249879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb4917-4112-49c7-942b-3069f59d351a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:07:12.250302 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb4917-4112-49c7-942b-3069f59d351a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:12.252259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb4917-4112-49c7-942b-3069f59d351a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:12.269303 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1519/3027] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:07:12.272873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93bc3b6-1d3f-4940-9dd3-12302874d0b1 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:12.284380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93bc3b6-1d3f-4940-9dd3-12302874d0b1 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:12.292189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dee737-1f8f-4850-9505-1d8dcc69eefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:12.293244 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dee737-1f8f-4850-9505-1d8dcc69eefd admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:12.293644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dee737-1f8f-4850-9505-1d8dcc69eefd admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:12.294230 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dee737-1f8f-4850-9505-1d8dcc69eefd admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:12.295206 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dee737-1f8f-4850-9505-1d8dcc69eefd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:12.297964 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dee737-1f8f-4850-9505-1d8dcc69eefd admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:12.359075 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1509/3028] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:07:12 2022] POST /identity/v3/projects => generated 385 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:07:12.359860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb4917-4112-49c7-942b-3069f59d351a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:12.373589 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb4917-4112-49c7-942b-3069f59d351a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:12.463894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db9c5c-0ff2-4d72-84aa-59bcbd314b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:12.464927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db9c5c-0ff2-4d72-84aa-59bcbd314b4d admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:12.465369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db9c5c-0ff2-4d72-84aa-59bcbd314b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:12.466090 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db9c5c-0ff2-4d72-84aa-59bcbd314b4d admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:12.467323 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db9c5c-0ff2-4d72-84aa-59bcbd314b4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:12.469765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db9c5c-0ff2-4d72-84aa-59bcbd314b4d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:12.483761 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:12.507719 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1520/3029] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:07:12 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:07:12.511808 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dee737-1f8f-4850-9505-1d8dcc69eefd admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:12.529096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dee737-1f8f-4850-9505-1d8dcc69eefd admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:12.547907 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d8260-5c06-4001-a8ec-a246036dd517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:12.549120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d8260-5c06-4001-a8ec-a246036dd517 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:12.549634 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d8260-5c06-4001-a8ec-a246036dd517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:12.550301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d8260-5c06-4001-a8ec-a246036dd517 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:12.553165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17d8260-5c06-4001-a8ec-a246036dd517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:12.555718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17d8260-5c06-4001-a8ec-a246036dd517 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:12.560770 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:12.584639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db9c5c-0ff2-4d72-84aa-59bcbd314b4d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:12.592085 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1510/3030] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:07:12.597771 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db9c5c-0ff2-4d72-84aa-59bcbd314b4d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:12.604027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0fb04c-184f-44b0-a6a7-db59e0523d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:12.604657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fb04c-184f-44b0-a6a7-db59e0523d75 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:12.604939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fb04c-184f-44b0-a6a7-db59e0523d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:12.605453 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fb04c-184f-44b0-a6a7-db59e0523d75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:12.606409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0fb04c-184f-44b0-a6a7-db59e0523d75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:12.608047 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0fb04c-184f-44b0-a6a7-db59e0523d75 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:12.625483 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d8260-5c06-4001-a8ec-a246036dd517 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:12.626651 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1521/3031] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:07:12.637240 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d8260-5c06-4001-a8ec-a246036dd517 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:12.644095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410ef41-9193-48b8-807e-c3f445bcbb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:12.644784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410ef41-9193-48b8-807e-c3f445bcbb0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:12.645071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410ef41-9193-48b8-807e-c3f445bcbb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:12.645349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410ef41-9193-48b8-807e-c3f445bcbb0e admin admin] PATH_INFO: `/v3/projects/7e33e70b344f461db9c652d35fdc9675/users/43fe21f4d970435c858903bc9e8579ae/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:12.668408 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c410ef41-9193-48b8-807e-c3f445bcbb0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e33e70b344f461db9c652d35fdc9675, user_id=43fe21f4d970435c858903bc9e8579ae, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:12.671720 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c410ef41-9193-48b8-807e-c3f445bcbb0e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:12.696458 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1511/3032] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:07:12 2022] PUT /identity/v3/projects/7e33e70b344f461db9c652d35fdc9675/users/43fe21f4d970435c858903bc9e8579ae/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:07:12.701371 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1d50a-e8d0-4ca1-8a96-8fc9af12ba84 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:12.701986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1d50a-e8d0-4ca1-8a96-8fc9af12ba84 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:12.702275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1d50a-e8d0-4ca1-8a96-8fc9af12ba84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:12.729258 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-17c1d50a-e8d0-4ca1-8a96-8fc9af12ba84 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:12.730688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-17c1d50a-e8d0-4ca1-8a96-8fc9af12ba84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:12.826379 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1522/3033] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:07:12.845202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410ef41-9193-48b8-807e-c3f445bcbb0e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:12.846971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c410ef41-9193-48b8-807e-c3f445bcbb0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:12.938528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1d50a-e8d0-4ca1-8a96-8fc9af12ba84 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:12.939256 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410ef41-9193-48b8-807e-c3f445bcbb0e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:12.941461 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-17c1d50a-e8d0-4ca1-8a96-8fc9af12ba84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:12.945070 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737e172-9a91-4ce4-97ca-0670d9f86c8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:12.945818 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737e172-9a91-4ce4-97ca-0670d9f86c8f service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:12.946161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737e172-9a91-4ce4-97ca-0670d9f86c8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:12.946498 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737e172-9a91-4ce4-97ca-0670d9f86c8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:12.968659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737e172-9a91-4ce4-97ca-0670d9f86c8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:12.971430 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737e172-9a91-4ce4-97ca-0670d9f86c8f service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:12.987672 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1512/3034] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:07:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:07:13.075552 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1d50a-e8d0-4ca1-8a96-8fc9af12ba84 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:13.098147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee08c0-ffac-43c4-8bea-beb89e1c8a68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:13.099047 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee08c0-ffac-43c4-8bea-beb89e1c8a68 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:13.099421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee08c0-ffac-43c4-8bea-beb89e1c8a68 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:13.099875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee08c0-ffac-43c4-8bea-beb89e1c8a68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:13.103200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-cdee08c0-ffac-43c4-8bea-beb89e1c8a68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:13.191103 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee08c0-ffac-43c4-8bea-beb89e1c8a68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:13.192648 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee08c0-ffac-43c4-8bea-beb89e1c8a68 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:13.204665 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1523/3035] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:07:12 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:07:14.152234 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ef53d-963b-46df-9f08-e635f558ef78 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:14.153062 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ef53d-963b-46df-9f08-e635f558ef78 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:14.153625 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ef53d-963b-46df-9f08-e635f558ef78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:14.211939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c60ef53d-963b-46df-9f08-e635f558ef78 None None] MFA Rules not processed for user `43fe21f4d970435c858903bc9e8579ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:14.214125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c60ef53d-963b-46df-9f08-e635f558ef78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:14.366359 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1513/3036] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:07:14.369669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac7daa-370d-4835-b24e-8a7b5dc65703 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:14.370173 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac7daa-370d-4835-b24e-8a7b5dc65703 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:14.370413 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac7daa-370d-4835-b24e-8a7b5dc65703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:14.395931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-48ac7daa-370d-4835-b24e-8a7b5dc65703 None None] MFA Rules not processed for user `43fe21f4d970435c858903bc9e8579ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:14.397316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-48ac7daa-370d-4835-b24e-8a7b5dc65703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:14.415116 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1524/3037] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:07:14.418040 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a833c-43fe-4b24-b08e-ef5e010eb2fe None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:14.418623 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a833c-43fe-4b24-b08e-ef5e010eb2fe None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:14.419116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a833c-43fe-4b24-b08e-ef5e010eb2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:14.457286 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-050a833c-43fe-4b24-b08e-ef5e010eb2fe None None] MFA Rules not processed for user `43fe21f4d970435c858903bc9e8579ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:14.458847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-050a833c-43fe-4b24-b08e-ef5e010eb2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:14.481114 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1514/3038] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:07:14.608328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac7daa-370d-4835-b24e-8a7b5dc65703 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:14.618525 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:14.627871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac7daa-370d-4835-b24e-8a7b5dc65703 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:14.636427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c8b8c-dd8c-4f2f-9167-b02f6d4000c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:14.637608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c8b8c-dd8c-4f2f-9167-b02f6d4000c1 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:14.638049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c8b8c-dd8c-4f2f-9167-b02f6d4000c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:14.638686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c8b8c-dd8c-4f2f-9167-b02f6d4000c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:14.651633 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c8b8c-dd8c-4f2f-9167-b02f6d4000c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:14.654536 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c8b8c-dd8c-4f2f-9167-b02f6d4000c1 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:14.685669 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1525/3039] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:07:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:07:15.648723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a833c-43fe-4b24-b08e-ef5e010eb2fe None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:15.650496 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-050a833c-43fe-4b24-b08e-ef5e010eb2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:15.831671 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:15.889632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a833c-43fe-4b24-b08e-ef5e010eb2fe None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:15.902524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a32e6-2c8f-480c-bab4-718f8f14b6e1 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:15.903040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a32e6-2c8f-480c-bab4-718f8f14b6e1 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:15.903040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a32e6-2c8f-480c-bab4-718f8f14b6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:15.908774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ddd05-72d7-4f5d-a534-40d01eb3fdf1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:15.910140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ddd05-72d7-4f5d-a534-40d01eb3fdf1 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:15.910822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ddd05-72d7-4f5d-a534-40d01eb3fdf1 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:15.911524 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ddd05-72d7-4f5d-a534-40d01eb3fdf1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:15.915849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-293ddd05-72d7-4f5d-a534-40d01eb3fdf1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:15.960998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ddd05-72d7-4f5d-a534-40d01eb3fdf1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:15.961386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-836a32e6-2c8f-480c-bab4-718f8f14b6e1 None None] MFA Rules not processed for user `43fe21f4d970435c858903bc9e8579ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:15.962928 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-836a32e6-2c8f-480c-bab4-718f8f14b6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:15.969183 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ddd05-72d7-4f5d-a534-40d01eb3fdf1 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:15.979166 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1526/3040] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:07:16.010030 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1515/3041] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:07:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:07:17.552657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a32e6-2c8f-480c-bab4-718f8f14b6e1 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:17.555237 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-836a32e6-2c8f-480c-bab4-718f8f14b6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:17.586938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a32e6-2c8f-480c-bab4-718f8f14b6e1 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:17.601049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f9b4f-d281-4605-ba90-3f3f2f2fb436 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:17.601822 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f9b4f-d281-4605-ba90-3f3f2f2fb436 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:17.602496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f9b4f-d281-4605-ba90-3f3f2f2fb436 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:17.603616 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f9b4f-d281-4605-ba90-3f3f2f2fb436 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:17.608252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ad2f9b4f-d281-4605-ba90-3f3f2f2fb436 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:17.622192 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f9b4f-d281-4605-ba90-3f3f2f2fb436 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:17.628425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f9b4f-d281-4605-ba90-3f3f2f2fb436 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:17.641913 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1527/3042] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:07:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:07:20.118447 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ddd05-72d7-4f5d-a534-40d01eb3fdf1 service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:20.132952 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ddd05-72d7-4f5d-a534-40d01eb3fdf1 service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:20.143955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298150e-26ea-4620-a86d-f696a50b6aca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:20.145487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298150e-26ea-4620-a86d-f696a50b6aca service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:20.145946 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298150e-26ea-4620-a86d-f696a50b6aca service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:20.147933 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298150e-26ea-4620-a86d-f696a50b6aca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:20.153554 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4298150e-26ea-4620-a86d-f696a50b6aca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:20.255792 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4298150e-26ea-4620-a86d-f696a50b6aca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:20.257868 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4298150e-26ea-4620-a86d-f696a50b6aca service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:20.281779 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1516/3043] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:07:20 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:07:21.511219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe25d7-5701-49e2-b97a-06c3b4ae1b03 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:21.511601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe25d7-5701-49e2-b97a-06c3b4ae1b03 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:21.511864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe25d7-5701-49e2-b97a-06c3b4ae1b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:21.558492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-75fe25d7-5701-49e2-b97a-06c3b4ae1b03 None None] MFA Rules not processed for user `43fe21f4d970435c858903bc9e8579ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:21.559759 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-75fe25d7-5701-49e2-b97a-06c3b4ae1b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:21.580467 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1528/3044] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:07:23.965056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298150e-26ea-4620-a86d-f696a50b6aca service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:23.967550 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4298150e-26ea-4620-a86d-f696a50b6aca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:24.001989 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298150e-26ea-4620-a86d-f696a50b6aca service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:24.012780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675cc828-fd77-4cee-a993-cc497b8fddec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:24.014596 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cc828-fd77-4cee-a993-cc497b8fddec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:24.015788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cc828-fd77-4cee-a993-cc497b8fddec admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:24.016307 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cc828-fd77-4cee-a993-cc497b8fddec admin admin] PATH_INFO: `/v3/users/653bbf56943e40b791f843e117c91f71` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:24.019349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675cc828-fd77-4cee-a993-cc497b8fddec admin admin] RBAC: Authorizing `identity:delete_user(user_id=653bbf56943e40b791f843e117c91f71)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:24.024525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675cc828-fd77-4cee-a993-cc497b8fddec admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:24.159275 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-675cc828-fd77-4cee-a993-cc497b8fddec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '653bbf56943e40b791f843e117c91f71'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:24.160339 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-675cc828-fd77-4cee-a993-cc497b8fddec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '653bbf56943e40b791f843e117c91f71'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:24.175348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-675cc828-fd77-4cee-a993-cc497b8fddec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '653bbf56943e40b791f843e117c91f71'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:24.187050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-675cc828-fd77-4cee-a993-cc497b8fddec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '653bbf56943e40b791f843e117c91f71'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:24.187738 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-675cc828-fd77-4cee-a993-cc497b8fddec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '653bbf56943e40b791f843e117c91f71'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:24.212442 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1517/3045] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:07:23 2022] DELETE /identity/v3/users/653bbf56943e40b791f843e117c91f71 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:07:26.032968 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe25d7-5701-49e2-b97a-06c3b4ae1b03 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:26.062827 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe25d7-5701-49e2-b97a-06c3b4ae1b03 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:26.248481 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33cc30-9032-4e31-86fa-92cc2075263b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:26.249467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33cc30-9032-4e31-86fa-92cc2075263b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:26.249817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33cc30-9032-4e31-86fa-92cc2075263b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:26.250219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33cc30-9032-4e31-86fa-92cc2075263b admin admin] PATH_INFO: `/v3/projects/484dec51a1bc4d89a2b874dc29a697ec` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:26.253223 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33cc30-9032-4e31-86fa-92cc2075263b admin admin] RBAC: Authorizing `identity:delete_project(project_id=484dec51a1bc4d89a2b874dc29a697ec)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:26.256635 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33cc30-9032-4e31-86fa-92cc2075263b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:26.383150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fe33cc30-9032-4e31-86fa-92cc2075263b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '484dec51a1bc4d89a2b874dc29a697ec', 'request_id': 'req-fe33cc30-9032-4e31-86fa-92cc2075263b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:26.399257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675cc828-fd77-4cee-a993-cc497b8fddec admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:26.401592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-675cc828-fd77-4cee-a993-cc497b8fddec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:26.404231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fe33cc30-9032-4e31-86fa-92cc2075263b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '484dec51a1bc4d89a2b874dc29a697ec', 'request_id': 'req-fe33cc30-9032-4e31-86fa-92cc2075263b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:26.420367 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fe33cc30-9032-4e31-86fa-92cc2075263b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '484dec51a1bc4d89a2b874dc29a697ec', 'request_id': 'req-fe33cc30-9032-4e31-86fa-92cc2075263b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:26.423559 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675cc828-fd77-4cee-a993-cc497b8fddec admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:26.459671 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fe33cc30-9032-4e31-86fa-92cc2075263b admin admin] The token cache is being invalidate because project 484dec51a1bc4d89a2b874dc29a697ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:07:26.461269 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fe33cc30-9032-4e31-86fa-92cc2075263b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:26.462182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fe33cc30-9032-4e31-86fa-92cc2075263b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:26.469024 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1529/3046] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:07:26 2022] DELETE /identity/v3/projects/484dec51a1bc4d89a2b874dc29a697ec => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:07:26.472308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97826427-d596-4b87-a858-396904393ea8 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:26.472622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97826427-d596-4b87-a858-396904393ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:26.472900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97826427-d596-4b87-a858-396904393ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:26.526178 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-97826427-d596-4b87-a858-396904393ea8 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:26.529977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-97826427-d596-4b87-a858-396904393ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:26.583232 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:26.605546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484dec2-3857-4f33-8ae6-cd8fbf2168fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:26.606456 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484dec2-3857-4f33-8ae6-cd8fbf2168fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:26.607743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484dec2-3857-4f33-8ae6-cd8fbf2168fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:26.608022 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484dec2-3857-4f33-8ae6-cd8fbf2168fe admin admin] PATH_INFO: `/v3/users/a4c913daf63c433287eaf338b4ab2070` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:26.610603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484dec2-3857-4f33-8ae6-cd8fbf2168fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4c913daf63c433287eaf338b4ab2070)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:26.615905 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484dec2-3857-4f33-8ae6-cd8fbf2168fe admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:26.652360 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:26.714009 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1530/3047] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:07:26.717477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e38e03-221e-412a-88c7-adf7676f75b8 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:26.717772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e38e03-221e-412a-88c7-adf7676f75b8 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:26.718048 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e38e03-221e-412a-88c7-adf7676f75b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:26.783058 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6484dec2-3857-4f33-8ae6-cd8fbf2168fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4c913daf63c433287eaf338b4ab2070'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:26.784721 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6484dec2-3857-4f33-8ae6-cd8fbf2168fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4c913daf63c433287eaf338b4ab2070'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:26.787836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-10e38e03-221e-412a-88c7-adf7676f75b8 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:26.793748 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-10e38e03-221e-412a-88c7-adf7676f75b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:26.810156 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6484dec2-3857-4f33-8ae6-cd8fbf2168fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4c913daf63c433287eaf338b4ab2070'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:26.829142 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1531/3048] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:07:26.831044 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6484dec2-3857-4f33-8ae6-cd8fbf2168fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4c913daf63c433287eaf338b4ab2070'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:26.831882 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6484dec2-3857-4f33-8ae6-cd8fbf2168fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4c913daf63c433287eaf338b4ab2070'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:26.835362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e38e03-221e-412a-88c7-adf7676f75b8 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:26.871648 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e38e03-221e-412a-88c7-adf7676f75b8 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:26.879996 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1518/3049] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:07:26 2022] DELETE /identity/v3/users/a4c913daf63c433287eaf338b4ab2070 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:07:26.881968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52cac3-60cd-4e1a-b1cc-335c61abfe1a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:26.882458 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52cac3-60cd-4e1a-b1cc-335c61abfe1a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:26.883408 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52cac3-60cd-4e1a-b1cc-335c61abfe1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:26.911695 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5a52cac3-60cd-4e1a-b1cc-335c61abfe1a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:26.913232 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5a52cac3-60cd-4e1a-b1cc-335c61abfe1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:27.053267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fe732-ad54-41e9-9df7-f419dc6a468d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:27.053267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fe732-ad54-41e9-9df7-f419dc6a468d admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:27.054628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fe732-ad54-41e9-9df7-f419dc6a468d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:27.054628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fe732-ad54-41e9-9df7-f419dc6a468d admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:27.054628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13fe732-ad54-41e9-9df7-f419dc6a468d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:07:27.055097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13fe732-ad54-41e9-9df7-f419dc6a468d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:27.057269 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13fe732-ad54-41e9-9df7-f419dc6a468d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:27.072057 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1519/3050] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:07:27.079635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52cac3-60cd-4e1a-b1cc-335c61abfe1a None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:27.081642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5a52cac3-60cd-4e1a-b1cc-335c61abfe1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:27.088430 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1532/3051] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:07:27.092811 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fe732-ad54-41e9-9df7-f419dc6a468d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:27.118650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fe732-ad54-41e9-9df7-f419dc6a468d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:27.130920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80868f03-776d-44fc-9957-056dd213ff39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:27.132007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80868f03-776d-44fc-9957-056dd213ff39 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:27.132301 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80868f03-776d-44fc-9957-056dd213ff39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:27.132582 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80868f03-776d-44fc-9957-056dd213ff39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:27.133378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80868f03-776d-44fc-9957-056dd213ff39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:27.136622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80868f03-776d-44fc-9957-056dd213ff39 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:27.188594 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1533/3052] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:07:27 2022] POST /identity/v3/projects => generated 397 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:07:27.195679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80868f03-776d-44fc-9957-056dd213ff39 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:27.249251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52cac3-60cd-4e1a-b1cc-335c61abfe1a None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:27.292352 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:27.303696 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80868f03-776d-44fc-9957-056dd213ff39 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:27.313711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687ddf3-78a0-47ca-a795-9c18eafa89ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:27.314378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687ddf3-78a0-47ca-a795-9c18eafa89ca admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:27.314667 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687ddf3-78a0-47ca-a795-9c18eafa89ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:27.314945 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687ddf3-78a0-47ca-a795-9c18eafa89ca admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:27.315690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8687ddf3-78a0-47ca-a795-9c18eafa89ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:27.317553 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8687ddf3-78a0-47ca-a795-9c18eafa89ca admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:27.339829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc47799-7aac-4088-b57c-26dcad21732a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:27.340767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc47799-7aac-4088-b57c-26dcad21732a service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:27.341212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc47799-7aac-4088-b57c-26dcad21732a service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:27.341719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc47799-7aac-4088-b57c-26dcad21732a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:27.351678 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1534/3053] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:07:27 2022] POST /identity/v3/users => generated 299 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:07:27.357663 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc47799-7aac-4088-b57c-26dcad21732a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:27.358365 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687ddf3-78a0-47ca-a795-9c18eafa89ca admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:27.359648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc47799-7aac-4088-b57c-26dcad21732a service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:27.372167 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1520/3054] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:07:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:07:27.385379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687ddf3-78a0-47ca-a795-9c18eafa89ca admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:27.393845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a706ece-caf5-4eb6-b432-df089a14397c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:27.395150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a706ece-caf5-4eb6-b432-df089a14397c admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:27.395898 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a706ece-caf5-4eb6-b432-df089a14397c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:27.396804 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a706ece-caf5-4eb6-b432-df089a14397c admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:27.398035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a706ece-caf5-4eb6-b432-df089a14397c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:27.400556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a706ece-caf5-4eb6-b432-df089a14397c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:27.428492 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc47799-7aac-4088-b57c-26dcad21732a service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:27.435625 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1535/3055] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:07:27.440589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc47799-7aac-4088-b57c-26dcad21732a service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:27.447114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a703c35-c53e-4151-b2ae-457ffaeac021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:27.448276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a703c35-c53e-4151-b2ae-457ffaeac021 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:27.448623 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a703c35-c53e-4151-b2ae-457ffaeac021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:27.449066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a703c35-c53e-4151-b2ae-457ffaeac021 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:27.450412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a703c35-c53e-4151-b2ae-457ffaeac021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:27.452394 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a703c35-c53e-4151-b2ae-457ffaeac021 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:27.471748 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a706ece-caf5-4eb6-b432-df089a14397c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:27.483277 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1521/3056] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:07:27.488256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a706ece-caf5-4eb6-b432-df089a14397c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:27.496100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d418222-ff5f-4754-9d8d-51d2d3f07964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:27.496911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d418222-ff5f-4754-9d8d-51d2d3f07964 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:27.497305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d418222-ff5f-4754-9d8d-51d2d3f07964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:27.497717 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d418222-ff5f-4754-9d8d-51d2d3f07964 admin admin] PATH_INFO: `/v3/projects/74c12154c2f74ea3b0dd44b44a7a7c63/users/5bef0e1ea58949fb9830c969e80387a5/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:27.520657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d418222-ff5f-4754-9d8d-51d2d3f07964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74c12154c2f74ea3b0dd44b44a7a7c63, user_id=5bef0e1ea58949fb9830c969e80387a5, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:27.523984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d418222-ff5f-4754-9d8d-51d2d3f07964 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:27.557109 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1536/3057] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:07:27 2022] PUT /identity/v3/projects/74c12154c2f74ea3b0dd44b44a7a7c63/users/5bef0e1ea58949fb9830c969e80387a5/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:07:27.558635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4985aa-0a40-4b48-921e-0e34acdc6f33 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:27.558930 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4985aa-0a40-4b48-921e-0e34acdc6f33 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:27.559321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4985aa-0a40-4b48-921e-0e34acdc6f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:27.604262 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-ca4985aa-0a40-4b48-921e-0e34acdc6f33 None None] MFA Rules not processed for user `5bef0e1ea58949fb9830c969e80387a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:27.611662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ca4985aa-0a40-4b48-921e-0e34acdc6f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:27.703269 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1522/3058] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:27 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:07:27.716467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e435f-7234-43a4-a4ec-b542de4ab6a4 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:27.716750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e435f-7234-43a4-a4ec-b542de4ab6a4 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:27.717026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e435f-7234-43a4-a4ec-b542de4ab6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:27.753832 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c58e435f-7234-43a4-a4ec-b542de4ab6a4 None None] MFA Rules not processed for user `5bef0e1ea58949fb9830c969e80387a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:27.755264 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c58e435f-7234-43a4-a4ec-b542de4ab6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:27.760037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4985aa-0a40-4b48-921e-0e34acdc6f33 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:27.762001 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ca4985aa-0a40-4b48-921e-0e34acdc6f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:27.791987 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1537/3059] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:27 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:07:27.873320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4985aa-0a40-4b48-921e-0e34acdc6f33 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:27.880561 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7bd100-a911-408d-99b6-9b122e2fcd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:27.881135 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7bd100-a911-408d-99b6-9b122e2fcd64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:27.881568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7bd100-a911-408d-99b6-9b122e2fcd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:27.881948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7bd100-a911-408d-99b6-9b122e2fcd64 admin admin] PATH_INFO: `/v3/projects/3a0b934447e24decaac6431f53b4a1f7` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:27.883311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7bd100-a911-408d-99b6-9b122e2fcd64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a0b934447e24decaac6431f53b4a1f7)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:27.885817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7bd100-a911-408d-99b6-9b122e2fcd64 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:27.971600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e435f-7234-43a4-a4ec-b542de4ab6a4 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:27.972901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-bd7bd100-a911-408d-99b6-9b122e2fcd64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a0b934447e24decaac6431f53b4a1f7', 'request_id': 'req-bd7bd100-a911-408d-99b6-9b122e2fcd64'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:27.973125 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c58e435f-7234-43a4-a4ec-b542de4ab6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:27.976420 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:27.988574 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-bd7bd100-a911-408d-99b6-9b122e2fcd64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a0b934447e24decaac6431f53b4a1f7', 'request_id': 'req-bd7bd100-a911-408d-99b6-9b122e2fcd64'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:27.993722 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:27.998886 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-bd7bd100-a911-408d-99b6-9b122e2fcd64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a0b934447e24decaac6431f53b4a1f7', 'request_id': 'req-bd7bd100-a911-408d-99b6-9b122e2fcd64'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:28.013265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-bd7bd100-a911-408d-99b6-9b122e2fcd64 admin admin] The token cache is being invalidate because project 3a0b934447e24decaac6431f53b4a1f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:07:28.013748 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-bd7bd100-a911-408d-99b6-9b122e2fcd64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:28.015681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-bd7bd100-a911-408d-99b6-9b122e2fcd64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:28.021494 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1523/3060] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:07:27 2022] DELETE /identity/v3/projects/3a0b934447e24decaac6431f53b4a1f7 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:07:28.028330 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7bd100-a911-408d-99b6-9b122e2fcd64 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:28.030122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bd7bd100-a911-408d-99b6-9b122e2fcd64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:28.133061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e435f-7234-43a4-a4ec-b542de4ab6a4 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:28.162131 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7bd100-a911-408d-99b6-9b122e2fcd64 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:28.174298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada9f41-0785-4668-a697-e876256f719d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:28.175073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada9f41-0785-4668-a697-e876256f719d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:28.175350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada9f41-0785-4668-a697-e876256f719d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:28.175619 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada9f41-0785-4668-a697-e876256f719d admin admin] PATH_INFO: `/v3/users/1e626d0f329f45e28cf2ae78d96d944b` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:28.176881 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada9f41-0785-4668-a697-e876256f719d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e626d0f329f45e28cf2ae78d96d944b)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:28.180398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada9f41-0785-4668-a697-e876256f719d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:28.227788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d51afb-8f8f-4261-a923-f6731fb81d81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:28.228566 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d51afb-8f8f-4261-a923-f6731fb81d81 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:28.228982 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d51afb-8f8f-4261-a923-f6731fb81d81 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:28.229498 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d51afb-8f8f-4261-a923-f6731fb81d81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:28.232303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-01d51afb-8f8f-4261-a923-f6731fb81d81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:28.266462 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2ada9f41-0785-4668-a697-e876256f719d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e626d0f329f45e28cf2ae78d96d944b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:28.267097 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2ada9f41-0785-4668-a697-e876256f719d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e626d0f329f45e28cf2ae78d96d944b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:28.279547 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2ada9f41-0785-4668-a697-e876256f719d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e626d0f329f45e28cf2ae78d96d944b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:28.299585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2ada9f41-0785-4668-a697-e876256f719d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e626d0f329f45e28cf2ae78d96d944b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:28.300881 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2ada9f41-0785-4668-a697-e876256f719d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e626d0f329f45e28cf2ae78d96d944b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:28.325686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d51afb-8f8f-4261-a923-f6731fb81d81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:28.328313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d51afb-8f8f-4261-a923-f6731fb81d81 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:28.341660 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1524/3061] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:07:28 2022] DELETE /identity/v3/users/1e626d0f329f45e28cf2ae78d96d944b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:07:28.343900 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1538/3062] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:07:27 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:07:28.375097 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855245e3-a7c8-4ced-9ce6-2bad5b0c9924 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:28.375379 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855245e3-a7c8-4ced-9ce6-2bad5b0c9924 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:28.376238 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855245e3-a7c8-4ced-9ce6-2bad5b0c9924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:28.399670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-855245e3-a7c8-4ced-9ce6-2bad5b0c9924 None None] MFA Rules not processed for user `5bef0e1ea58949fb9830c969e80387a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:28.400927 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-855245e3-a7c8-4ced-9ce6-2bad5b0c9924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:28.484688 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1525/3063] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:28 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:07:28.541852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dd2b3-5517-4fe9-9a7c-bf004bfdf437 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:28.542182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dd2b3-5517-4fe9-9a7c-bf004bfdf437 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:28.542393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dd2b3-5517-4fe9-9a7c-bf004bfdf437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:28.584872 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-343dd2b3-5517-4fe9-9a7c-bf004bfdf437 None None] MFA Rules not processed for user `5bef0e1ea58949fb9830c969e80387a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:28.587732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-343dd2b3-5517-4fe9-9a7c-bf004bfdf437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:28.603550 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1539/3064] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:28 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:07:28.625475 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f0ed7-b482-4323-8346-0e02f9c44dfc None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:28.625790 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f0ed7-b482-4323-8346-0e02f9c44dfc None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:28.626023 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f0ed7-b482-4323-8346-0e02f9c44dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:28.651744 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:28.675374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-760f0ed7-b482-4323-8346-0e02f9c44dfc None None] MFA Rules not processed for user `5bef0e1ea58949fb9830c969e80387a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:28.676688 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-760f0ed7-b482-4323-8346-0e02f9c44dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:28.698162 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1526/3065] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:28 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:07:29.061736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dd2b3-5517-4fe9-9a7c-bf004bfdf437 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:29.063399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-343dd2b3-5517-4fe9-9a7c-bf004bfdf437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:29.117884 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:29.177822 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dd2b3-5517-4fe9-9a7c-bf004bfdf437 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:29.183544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f84d0-6978-47e6-92e8-c35475b98c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:29.184186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f84d0-6978-47e6-92e8-c35475b98c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:29.184462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f84d0-6978-47e6-92e8-c35475b98c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:29.184872 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f84d0-6978-47e6-92e8-c35475b98c88 admin admin] PATH_INFO: `/v3/projects/adee4aff2edc4a578c79cd852dda25ca` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:29.186059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f84d0-6978-47e6-92e8-c35475b98c88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adee4aff2edc4a578c79cd852dda25ca)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:29.188386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f84d0-6978-47e6-92e8-c35475b98c88 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:29.253677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-858f84d0-6978-47e6-92e8-c35475b98c88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adee4aff2edc4a578c79cd852dda25ca', 'request_id': 'req-858f84d0-6978-47e6-92e8-c35475b98c88'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:29.264306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-858f84d0-6978-47e6-92e8-c35475b98c88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adee4aff2edc4a578c79cd852dda25ca', 'request_id': 'req-858f84d0-6978-47e6-92e8-c35475b98c88'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:29.290880 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-858f84d0-6978-47e6-92e8-c35475b98c88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adee4aff2edc4a578c79cd852dda25ca', 'request_id': 'req-858f84d0-6978-47e6-92e8-c35475b98c88'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:29.317643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-858f84d0-6978-47e6-92e8-c35475b98c88 admin admin] The token cache is being invalidate because project adee4aff2edc4a578c79cd852dda25ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:07:29.318420 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-858f84d0-6978-47e6-92e8-c35475b98c88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:29.319527 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-858f84d0-6978-47e6-92e8-c35475b98c88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:29.321824 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1540/3066] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:07:29 2022] DELETE /identity/v3/projects/adee4aff2edc4a578c79cd852dda25ca => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:07:29.328159 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c55a62-6944-465e-8175-b7ab2304a03a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:29.328428 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c55a62-6944-465e-8175-b7ab2304a03a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:29.329329 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c55a62-6944-465e-8175-b7ab2304a03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:29.383164 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-84c55a62-6944-465e-8175-b7ab2304a03a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:29.385765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-84c55a62-6944-465e-8175-b7ab2304a03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:29.398207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a6481-123c-4d6b-8714-a6e7536db9e8 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:29.398494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a6481-123c-4d6b-8714-a6e7536db9e8 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:29.398774 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a6481-123c-4d6b-8714-a6e7536db9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:29.494495 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-dd0a6481-123c-4d6b-8714-a6e7536db9e8 None None] MFA Rules not processed for user `5bef0e1ea58949fb9830c969e80387a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:29.499068 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-dd0a6481-123c-4d6b-8714-a6e7536db9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:29.544987 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1527/3067] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:07:29.546774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e626199-f39c-4a7a-a9d1-5dd52af5a339 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:29.547063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e626199-f39c-4a7a-a9d1-5dd52af5a339 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:29.547390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e626199-f39c-4a7a-a9d1-5dd52af5a339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:29.613669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-8e626199-f39c-4a7a-a9d1-5dd52af5a339 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:29.619411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8e626199-f39c-4a7a-a9d1-5dd52af5a339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:29.642312 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1528/3068] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:07:29.643226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e626199-f39c-4a7a-a9d1-5dd52af5a339 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:29.662640 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1541/3069] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:29 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:07:29.662887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e626199-f39c-4a7a-a9d1-5dd52af5a339 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:29.672948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f673196-d4cf-4358-87cc-192df2c2cdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:29.673604 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f673196-d4cf-4358-87cc-192df2c2cdae admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:29.673883 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f673196-d4cf-4358-87cc-192df2c2cdae admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:29.674154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f673196-d4cf-4358-87cc-192df2c2cdae admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:29.674810 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f673196-d4cf-4358-87cc-192df2c2cdae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:07:29.675111 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f673196-d4cf-4358-87cc-192df2c2cdae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:29.677489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f673196-d4cf-4358-87cc-192df2c2cdae admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:29.694304 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1529/3070] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:07:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:07:29.698901 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a6481-123c-4d6b-8714-a6e7536db9e8 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:29.714706 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a6481-123c-4d6b-8714-a6e7536db9e8 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:29.741117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a6b6d-8534-4c77-8332-45c8fc0aa5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:29.741751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a6b6d-8534-4c77-8332-45c8fc0aa5d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:29.742031 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a6b6d-8534-4c77-8332-45c8fc0aa5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:29.742304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a6b6d-8534-4c77-8332-45c8fc0aa5d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:29.742944 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a6b6d-8534-4c77-8332-45c8fc0aa5d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:29.748168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a6b6d-8534-4c77-8332-45c8fc0aa5d4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:29.824702 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1542/3071] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:07:29 2022] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:07:29.828772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f673196-d4cf-4358-87cc-192df2c2cdae admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:29.846301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f673196-d4cf-4358-87cc-192df2c2cdae admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:29.972204 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6a609-654f-4d32-8c35-48e8043bb687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:29.973185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6a609-654f-4d32-8c35-48e8043bb687 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:29.974424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6a609-654f-4d32-8c35-48e8043bb687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:29.975390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6a609-654f-4d32-8c35-48e8043bb687 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:29.976238 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6a609-654f-4d32-8c35-48e8043bb687 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:29.995295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6a609-654f-4d32-8c35-48e8043bb687 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:30.046161 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1530/3072] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:07:29 2022] POST /identity/v3/users => generated 294 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:07:30.051329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a6b6d-8534-4c77-8332-45c8fc0aa5d4 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:30.065988 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a6b6d-8534-4c77-8332-45c8fc0aa5d4 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:30.079187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2615be-e7a4-4f22-b493-5ee6adebfa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:30.081134 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2615be-e7a4-4f22-b493-5ee6adebfa30 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:30.081882 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2615be-e7a4-4f22-b493-5ee6adebfa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:30.082389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2615be-e7a4-4f22-b493-5ee6adebfa30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:30.083452 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2615be-e7a4-4f22-b493-5ee6adebfa30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:30.087190 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2615be-e7a4-4f22-b493-5ee6adebfa30 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:30.113111 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1543/3073] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:07:30 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:07:30.116778 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6a609-654f-4d32-8c35-48e8043bb687 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:30.136691 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6a609-654f-4d32-8c35-48e8043bb687 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:30.143992 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb548fc-f221-4b17-9f23-82b5b2bb7b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:30.145163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb548fc-f221-4b17-9f23-82b5b2bb7b40 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:30.145939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb548fc-f221-4b17-9f23-82b5b2bb7b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:30.146588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb548fc-f221-4b17-9f23-82b5b2bb7b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:30.147927 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb548fc-f221-4b17-9f23-82b5b2bb7b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:30.151023 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb548fc-f221-4b17-9f23-82b5b2bb7b40 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:30.166828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2615be-e7a4-4f22-b493-5ee6adebfa30 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:30.166828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9a2615be-e7a4-4f22-b493-5ee6adebfa30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:30.183031 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1531/3074] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:07:30 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:07:30.189417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb548fc-f221-4b17-9f23-82b5b2bb7b40 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:30.191336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2615be-e7a4-4f22-b493-5ee6adebfa30 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:30.206238 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f64105-2967-4cda-bbed-57a00b88e97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:30.207089 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f64105-2967-4cda-bbed-57a00b88e97e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:30.207427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f64105-2967-4cda-bbed-57a00b88e97e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:30.207720 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f64105-2967-4cda-bbed-57a00b88e97e admin admin] PATH_INFO: `/v3/users/5bef0e1ea58949fb9830c969e80387a5` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:30.210362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f64105-2967-4cda-bbed-57a00b88e97e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bef0e1ea58949fb9830c969e80387a5)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:30.211739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f64105-2967-4cda-bbed-57a00b88e97e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:30.223799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb548fc-f221-4b17-9f23-82b5b2bb7b40 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:30.242222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1decd-9fda-409a-9413-1db3d16394c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:30.243631 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1decd-9fda-409a-9413-1db3d16394c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:30.245803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1decd-9fda-409a-9413-1db3d16394c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:30.246511 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1decd-9fda-409a-9413-1db3d16394c1 admin admin] PATH_INFO: `/v3/projects/95cdfe8bc6814228b08278ff47195ec5/users/d408c543e59b40f597d3d5781da4e87d/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:30.299963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c1decd-9fda-409a-9413-1db3d16394c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95cdfe8bc6814228b08278ff47195ec5, user_id=d408c543e59b40f597d3d5781da4e87d, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:30.306053 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c1decd-9fda-409a-9413-1db3d16394c1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:30.317807 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:30.340514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-87f64105-2967-4cda-bbed-57a00b88e97e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bef0e1ea58949fb9830c969e80387a5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:30.342340 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-87f64105-2967-4cda-bbed-57a00b88e97e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bef0e1ea58949fb9830c969e80387a5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:30.354438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-87f64105-2967-4cda-bbed-57a00b88e97e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bef0e1ea58949fb9830c969e80387a5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:30.382523 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1532/3075] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:07:30 2022] PUT /identity/v3/projects/95cdfe8bc6814228b08278ff47195ec5/users/d408c543e59b40f597d3d5781da4e87d/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:07:30.383023 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-87f64105-2967-4cda-bbed-57a00b88e97e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bef0e1ea58949fb9830c969e80387a5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:30.384743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-87f64105-2967-4cda-bbed-57a00b88e97e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bef0e1ea58949fb9830c969e80387a5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:30.394785 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894519c9-b48d-4a05-b5ec-2de5228ba749 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:30.395069 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894519c9-b48d-4a05-b5ec-2de5228ba749 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:30.395343 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894519c9-b48d-4a05-b5ec-2de5228ba749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:30.462975 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1544/3076] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:07:30 2022] DELETE /identity/v3/users/5bef0e1ea58949fb9830c969e80387a5 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:07:30.468145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef3aeb-7960-430b-b702-30eeaf0360c8 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:30.468715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef3aeb-7960-430b-b702-30eeaf0360c8 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:30.469223 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef3aeb-7960-430b-b702-30eeaf0360c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:30.503431 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-894519c9-b48d-4a05-b5ec-2de5228ba749 None None] MFA Rules not processed for user `d408c543e59b40f597d3d5781da4e87d`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:30.504686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-894519c9-b48d-4a05-b5ec-2de5228ba749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:30.512273 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-51ef3aeb-7960-430b-b702-30eeaf0360c8 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:30.513833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-51ef3aeb-7960-430b-b702-30eeaf0360c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:30.543747 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:30.644072 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1545/3077] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:07:30.649941 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1533/3078] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:07:30.650954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef3aeb-7960-430b-b702-30eeaf0360c8 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:30.652371 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-51ef3aeb-7960-430b-b702-30eeaf0360c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:30.672987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef3aeb-7960-430b-b702-30eeaf0360c8 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:30.697948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe91897-5a05-422a-b3a1-be5f6cf22ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:30.698580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe91897-5a05-422a-b3a1-be5f6cf22ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:30.698860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe91897-5a05-422a-b3a1-be5f6cf22ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:30.699132 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe91897-5a05-422a-b3a1-be5f6cf22ba6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:30.699781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe91897-5a05-422a-b3a1-be5f6cf22ba6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:30.706096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe91897-5a05-422a-b3a1-be5f6cf22ba6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:30.791157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894519c9-b48d-4a05-b5ec-2de5228ba749 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:30.792918 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1546/3079] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:07:30 2022] POST /identity/v3/projects => generated 387 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:07:30.809130 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe91897-5a05-422a-b3a1-be5f6cf22ba6 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:30.809658 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894519c9-b48d-4a05-b5ec-2de5228ba749 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:30.811991 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-bfe91897-5a05-422a-b3a1-be5f6cf22ba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:31.012909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe91897-5a05-422a-b3a1-be5f6cf22ba6 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:31.024295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042924c-e9e8-4d8c-9745-8918e958125d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:31.024908 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042924c-e9e8-4d8c-9745-8918e958125d admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:31.025183 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042924c-e9e8-4d8c-9745-8918e958125d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:31.025480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042924c-e9e8-4d8c-9745-8918e958125d admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:31.032405 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1042924c-e9e8-4d8c-9745-8918e958125d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:31.034404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1042924c-e9e8-4d8c-9745-8918e958125d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:31.036660 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fcaaa-bda2-4d70-9360-28ff4ef4bbfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:31.037293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fcaaa-bda2-4d70-9360-28ff4ef4bbfc service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:31.037600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fcaaa-bda2-4d70-9360-28ff4ef4bbfc service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:31.037874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fcaaa-bda2-4d70-9360-28ff4ef4bbfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:31.092239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2fcaaa-bda2-4d70-9360-28ff4ef4bbfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:31.093761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2fcaaa-bda2-4d70-9360-28ff4ef4bbfc service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:31.125970 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1534/3080] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:07:30 2022] POST /identity/v3/users => generated 300 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:07:31.134537 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1547/3081] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:07:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:07:31.135761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042924c-e9e8-4d8c-9745-8918e958125d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:31.179454 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042924c-e9e8-4d8c-9745-8918e958125d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:31.198237 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435a57f-1b5f-4409-8df9-c117956a1c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:31.198869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435a57f-1b5f-4409-8df9-c117956a1c7e admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:31.199131 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435a57f-1b5f-4409-8df9-c117956a1c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:31.199401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435a57f-1b5f-4409-8df9-c117956a1c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:31.200056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435a57f-1b5f-4409-8df9-c117956a1c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:31.202037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435a57f-1b5f-4409-8df9-c117956a1c7e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:31.264201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fcaaa-bda2-4d70-9360-28ff4ef4bbfc service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:31.273567 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fcaaa-bda2-4d70-9360-28ff4ef4bbfc service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:31.285025 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1535/3082] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:07:31.300561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc3a81-7e54-416d-a0f5-f9adf9a6d0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:31.301639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc3a81-7e54-416d-a0f5-f9adf9a6d0cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:31.302069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc3a81-7e54-416d-a0f5-f9adf9a6d0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:31.302567 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc3a81-7e54-416d-a0f5-f9adf9a6d0cb admin admin] PATH_INFO: `/v3/projects/7cfa512e39de4a2c9bfa7fa2f164bb64/users/5f07754afdbb4c60b2c3e611563b7520/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:31.379673 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc3a81-7e54-416d-a0f5-f9adf9a6d0cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cfa512e39de4a2c9bfa7fa2f164bb64, user_id=5f07754afdbb4c60b2c3e611563b7520, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:31.382509 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc3a81-7e54-416d-a0f5-f9adf9a6d0cb admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:31.433913 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1548/3083] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:07:31 2022] PUT /identity/v3/projects/7cfa512e39de4a2c9bfa7fa2f164bb64/users/5f07754afdbb4c60b2c3e611563b7520/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:07:31.435268 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435a57f-1b5f-4409-8df9-c117956a1c7e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:31.456430 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435a57f-1b5f-4409-8df9-c117956a1c7e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:31.639451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873d4df-1020-4ffa-b2d2-3f1cad8158bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:31.641258 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873d4df-1020-4ffa-b2d2-3f1cad8158bc admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:31.641733 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873d4df-1020-4ffa-b2d2-3f1cad8158bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:31.642168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873d4df-1020-4ffa-b2d2-3f1cad8158bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:31.643459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0873d4df-1020-4ffa-b2d2-3f1cad8158bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:31.645330 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0873d4df-1020-4ffa-b2d2-3f1cad8158bc admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:31.677822 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1536/3084] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:07:31.678814 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc3a81-7e54-416d-a0f5-f9adf9a6d0cb admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:31.701108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc3a81-7e54-416d-a0f5-f9adf9a6d0cb admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:31.713411 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7a7bd-c5bb-44bf-acd8-898348ccd18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:31.714375 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7a7bd-c5bb-44bf-acd8-898348ccd18c admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:31.715368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7a7bd-c5bb-44bf-acd8-898348ccd18c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:31.715867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7a7bd-c5bb-44bf-acd8-898348ccd18c admin admin] PATH_INFO: `/v3/projects/7cfa512e39de4a2c9bfa7fa2f164bb64/users/5f07754afdbb4c60b2c3e611563b7520/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:31.718216 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7a7bd-c5bb-44bf-acd8-898348ccd18c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cfa512e39de4a2c9bfa7fa2f164bb64, user_id=5f07754afdbb4c60b2c3e611563b7520, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:31.731843 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7a7bd-c5bb-44bf-acd8-898348ccd18c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:31.740323 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:31.770990 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1549/3085] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:07:31 2022] PUT /identity/v3/projects/7cfa512e39de4a2c9bfa7fa2f164bb64/users/5f07754afdbb4c60b2c3e611563b7520/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:07:31.781147 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccc44b-74a3-4dc7-9a1a-de97532dcb94 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:31.781428 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccc44b-74a3-4dc7-9a1a-de97532dcb94 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:31.781940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccc44b-74a3-4dc7-9a1a-de97532dcb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:31.852217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-94ccc44b-74a3-4dc7-9a1a-de97532dcb94 None None] MFA Rules not processed for user `5f07754afdbb4c60b2c3e611563b7520`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:31.853782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-94ccc44b-74a3-4dc7-9a1a-de97532dcb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:31.909143 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:31.979822 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1537/3086] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:31 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:07:32.619414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7a7bd-c5bb-44bf-acd8-898348ccd18c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:32.621466 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6fb7a7bd-c5bb-44bf-acd8-898348ccd18c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:32.798384 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7a7bd-c5bb-44bf-acd8-898348ccd18c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:32.814994 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aec2b9-ac7e-461e-be60-f42b9c7804db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:32.815733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aec2b9-ac7e-461e-be60-f42b9c7804db service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:32.816085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aec2b9-ac7e-461e-be60-f42b9c7804db service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:32.816427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aec2b9-ac7e-461e-be60-f42b9c7804db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:32.839867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aec2b9-ac7e-461e-be60-f42b9c7804db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:32.841662 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aec2b9-ac7e-461e-be60-f42b9c7804db service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:32.858617 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1550/3087] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:07:32 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:07:32.931893 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ccc44b-74a3-4dc7-9a1a-de97532dcb94 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:32.933465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-94ccc44b-74a3-4dc7-9a1a-de97532dcb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:33.072242 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ccc44b-74a3-4dc7-9a1a-de97532dcb94 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:33.087080 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05dac62-1265-42c0-8054-e30910e50a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:33.087969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05dac62-1265-42c0-8054-e30910e50a14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:33.088335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05dac62-1265-42c0-8054-e30910e50a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:33.088600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05dac62-1265-42c0-8054-e30910e50a14 admin admin] PATH_INFO: `/v3/projects/74c12154c2f74ea3b0dd44b44a7a7c63` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:33.091911 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05dac62-1265-42c0-8054-e30910e50a14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74c12154c2f74ea3b0dd44b44a7a7c63)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:33.093883 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05dac62-1265-42c0-8054-e30910e50a14 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:33.226156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b55fa8-a47b-4c69-8d95-c91e545083b2 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:33.226521 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b55fa8-a47b-4c69-8d95-c91e545083b2 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:33.226770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b55fa8-a47b-4c69-8d95-c91e545083b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:33.232111 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c05dac62-1265-42c0-8054-e30910e50a14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74c12154c2f74ea3b0dd44b44a7a7c63', 'request_id': 'req-c05dac62-1265-42c0-8054-e30910e50a14'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:33.254550 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c05dac62-1265-42c0-8054-e30910e50a14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74c12154c2f74ea3b0dd44b44a7a7c63', 'request_id': 'req-c05dac62-1265-42c0-8054-e30910e50a14'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:33.267271 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c05dac62-1265-42c0-8054-e30910e50a14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74c12154c2f74ea3b0dd44b44a7a7c63', 'request_id': 'req-c05dac62-1265-42c0-8054-e30910e50a14'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:33.269830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-15b55fa8-a47b-4c69-8d95-c91e545083b2 None None] MFA Rules not processed for user `9482689feb8c4b6dad361610438a1b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:33.274321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-15b55fa8-a47b-4c69-8d95-c91e545083b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:33.303704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c05dac62-1265-42c0-8054-e30910e50a14 admin admin] The token cache is being invalidate because project 74c12154c2f74ea3b0dd44b44a7a7c63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:07:33.304058 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c05dac62-1265-42c0-8054-e30910e50a14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:33.306791 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c05dac62-1265-42c0-8054-e30910e50a14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:33.309183 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1538/3088] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:07:32 2022] DELETE /identity/v3/projects/74c12154c2f74ea3b0dd44b44a7a7c63 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:07:33.314643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f0e51-d437-4dec-bcc9-54c1e2b9bfe1 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:33.315229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f0e51-d437-4dec-bcc9-54c1e2b9bfe1 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:33.320764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f0e51-d437-4dec-bcc9-54c1e2b9bfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:33.365986 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b93f0e51-d437-4dec-bcc9-54c1e2b9bfe1 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:33.367889 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b93f0e51-d437-4dec-bcc9-54c1e2b9bfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:33.437315 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1551/3089] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:07:33.530878 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:33.586460 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1539/3090] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:07:33.588378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3d60b-8494-499f-a351-8c2368e490d3 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:33.588666 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3d60b-8494-499f-a351-8c2368e490d3 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:33.588943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3d60b-8494-499f-a351-8c2368e490d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:33.626809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-b2e3d60b-8494-499f-a351-8c2368e490d3 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:33.630406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b2e3d60b-8494-499f-a351-8c2368e490d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:33.654780 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1552/3091] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:07:33.656001 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f0e51-d437-4dec-bcc9-54c1e2b9bfe1 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:33.667776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f0e51-d437-4dec-bcc9-54c1e2b9bfe1 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:33.690659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3b471-08dd-4816-8f74-bcbcb87319d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:33.693601 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3b471-08dd-4816-8f74-bcbcb87319d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:33.694323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3b471-08dd-4816-8f74-bcbcb87319d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:33.696789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3b471-08dd-4816-8f74-bcbcb87319d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:33.698071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d3b471-08dd-4816-8f74-bcbcb87319d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:07:33.699656 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d3b471-08dd-4816-8f74-bcbcb87319d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:33.701381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d3b471-08dd-4816-8f74-bcbcb87319d5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:33.746755 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1540/3092] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:07:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:07:33.748289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3d60b-8494-499f-a351-8c2368e490d3 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:33.763925 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3d60b-8494-499f-a351-8c2368e490d3 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:33.775269 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833bf7b7-2e8b-420e-ac54-4d9288d75ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:33.775906 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bf7b7-2e8b-420e-ac54-4d9288d75ec8 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:33.776187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bf7b7-2e8b-420e-ac54-4d9288d75ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:33.776462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bf7b7-2e8b-420e-ac54-4d9288d75ec8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:33.782341 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833bf7b7-2e8b-420e-ac54-4d9288d75ec8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:33.796708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833bf7b7-2e8b-420e-ac54-4d9288d75ec8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:33.880051 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1553/3093] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:07:33 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:07:33.884178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3b471-08dd-4816-8f74-bcbcb87319d5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:33.909462 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3b471-08dd-4816-8f74-bcbcb87319d5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:34.142511 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008656c5-0408-430b-bb11-d153abb63482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:34.143222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008656c5-0408-430b-bb11-d153abb63482 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:34.143428 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008656c5-0408-430b-bb11-d153abb63482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:34.143708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008656c5-0408-430b-bb11-d153abb63482 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:34.144356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008656c5-0408-430b-bb11-d153abb63482 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:34.146632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008656c5-0408-430b-bb11-d153abb63482 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:34.214450 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1541/3094] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:07:33 2022] POST /identity/v3/users => generated 291 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:07:34.218138 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833bf7b7-2e8b-420e-ac54-4d9288d75ec8 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:34.237231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833bf7b7-2e8b-420e-ac54-4d9288d75ec8 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:34.251850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4f9e2-1b61-48e8-94c8-1ec66f1524a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:34.252519 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4f9e2-1b61-48e8-94c8-1ec66f1524a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:34.252758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4f9e2-1b61-48e8-94c8-1ec66f1524a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:34.253141 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4f9e2-1b61-48e8-94c8-1ec66f1524a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:34.253876 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4f9e2-1b61-48e8-94c8-1ec66f1524a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:34.257388 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4f9e2-1b61-48e8-94c8-1ec66f1524a5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:34.285607 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1554/3095] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:07:34.289056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008656c5-0408-430b-bb11-d153abb63482 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:34.302917 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008656c5-0408-430b-bb11-d153abb63482 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:34.335985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874a0af-f43b-4e6e-aef2-e905866e1ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:34.336747 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874a0af-f43b-4e6e-aef2-e905866e1ffa admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:34.337100 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874a0af-f43b-4e6e-aef2-e905866e1ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:34.337477 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874a0af-f43b-4e6e-aef2-e905866e1ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:34.338202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b874a0af-f43b-4e6e-aef2-e905866e1ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:34.340895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b874a0af-f43b-4e6e-aef2-e905866e1ffa admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:34.371438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4f9e2-1b61-48e8-94c8-1ec66f1524a5 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:34.373571 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1542/3096] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:07:34.389069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4f9e2-1b61-48e8-94c8-1ec66f1524a5 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:34.399988 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65cbaf-a99f-4ae0-97b9-7752c2e4843b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:34.400686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65cbaf-a99f-4ae0-97b9-7752c2e4843b admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:34.400966 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65cbaf-a99f-4ae0-97b9-7752c2e4843b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:34.401240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65cbaf-a99f-4ae0-97b9-7752c2e4843b admin admin] PATH_INFO: `/v3/projects/2d05779d1e4745cf9bc7e9dec46fb329/users/b83fa471d05144b6897fe6a74fc5d141/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:34.439517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd65cbaf-a99f-4ae0-97b9-7752c2e4843b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d05779d1e4745cf9bc7e9dec46fb329, user_id=b83fa471d05144b6897fe6a74fc5d141, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:34.442541 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd65cbaf-a99f-4ae0-97b9-7752c2e4843b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:34.477606 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1555/3097] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:07:34 2022] PUT /identity/v3/projects/2d05779d1e4745cf9bc7e9dec46fb329/users/b83fa471d05144b6897fe6a74fc5d141/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:07:34.483630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4144d-9c39-4c50-9f02-620029432239 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:34.483958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4144d-9c39-4c50-9f02-620029432239 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:34.484237 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4144d-9c39-4c50-9f02-620029432239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:34.525856 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-82e4144d-9c39-4c50-9f02-620029432239 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:34.530901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-82e4144d-9c39-4c50-9f02-620029432239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:34.698855 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1543/3098] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:07:34.723788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65cbaf-a99f-4ae0-97b9-7752c2e4843b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:34.726478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fd65cbaf-a99f-4ae0-97b9-7752c2e4843b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:34.819264 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:34.877514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65cbaf-a99f-4ae0-97b9-7752c2e4843b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:34.883934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebb986-c30e-471a-8831-1e1f211f721b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:34.884856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebb986-c30e-471a-8831-1e1f211f721b service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:34.885147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebb986-c30e-471a-8831-1e1f211f721b service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:34.885426 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebb986-c30e-471a-8831-1e1f211f721b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:34.912308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ebb986-c30e-471a-8831-1e1f211f721b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:34.913834 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ebb986-c30e-471a-8831-1e1f211f721b service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:34.927558 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1556/3099] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:07:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:07:38.596149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4144d-9c39-4c50-9f02-620029432239 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:38.598821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-82e4144d-9c39-4c50-9f02-620029432239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:38.624721 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4144d-9c39-4c50-9f02-620029432239 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:38.638195 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350cb32-1572-4248-836b-b67c63349693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:38.638963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350cb32-1572-4248-836b-b67c63349693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:38.639251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350cb32-1572-4248-836b-b67c63349693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:38.639531 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350cb32-1572-4248-836b-b67c63349693 admin admin] PATH_INFO: `/v3/users/d408c543e59b40f597d3d5781da4e87d` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:38.644047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350cb32-1572-4248-836b-b67c63349693 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d408c543e59b40f597d3d5781da4e87d)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:38.650768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350cb32-1572-4248-836b-b67c63349693 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:38.782151 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e350cb32-1572-4248-836b-b67c63349693 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd408c543e59b40f597d3d5781da4e87d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:38.783445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e350cb32-1572-4248-836b-b67c63349693 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd408c543e59b40f597d3d5781da4e87d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:38.791652 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:38.802378 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e350cb32-1572-4248-836b-b67c63349693 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd408c543e59b40f597d3d5781da4e87d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:38.816759 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e350cb32-1572-4248-836b-b67c63349693 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd408c543e59b40f597d3d5781da4e87d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:38.818727 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e350cb32-1572-4248-836b-b67c63349693 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd408c543e59b40f597d3d5781da4e87d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:38.864043 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1544/3100] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:07:38 2022] DELETE /identity/v3/users/d408c543e59b40f597d3d5781da4e87d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:07:38.868884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f399584-4411-4a2f-8773-151d0dc1083c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:38.869639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f399584-4411-4a2f-8773-151d0dc1083c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:38.869639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f399584-4411-4a2f-8773-151d0dc1083c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:38.912299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-5f399584-4411-4a2f-8773-151d0dc1083c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:38.915877 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5f399584-4411-4a2f-8773-151d0dc1083c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:39.053508 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1557/3101] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:07:39.121133 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350cb32-1572-4248-836b-b67c63349693 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:39.123038 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e350cb32-1572-4248-836b-b67c63349693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:39.288289 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350cb32-1572-4248-836b-b67c63349693 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:39.293697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b23d9-d0b9-4c31-b70a-06b97dd4648f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:39.294325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b23d9-d0b9-4c31-b70a-06b97dd4648f service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:39.294617 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b23d9-d0b9-4c31-b70a-06b97dd4648f service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:39.294890 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b23d9-d0b9-4c31-b70a-06b97dd4648f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:39.315892 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b23d9-d0b9-4c31-b70a-06b97dd4648f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:39.319978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b23d9-d0b9-4c31-b70a-06b97dd4648f service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:39.339233 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1545/3102] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:07:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:07:41.918793 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f399584-4411-4a2f-8773-151d0dc1083c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:41.920336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5f399584-4411-4a2f-8773-151d0dc1083c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:41.964201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f399584-4411-4a2f-8773-151d0dc1083c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:41.977139 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb0e10-ea2b-475d-b848-c9aab1334caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:41.977792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb0e10-ea2b-475d-b848-c9aab1334caa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:41.978077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb0e10-ea2b-475d-b848-c9aab1334caa admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:41.978662 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb0e10-ea2b-475d-b848-c9aab1334caa admin admin] PATH_INFO: `/v3/projects/95cdfe8bc6814228b08278ff47195ec5` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:41.979510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb0e10-ea2b-475d-b848-c9aab1334caa admin admin] RBAC: Authorizing `identity:delete_project(project_id=95cdfe8bc6814228b08278ff47195ec5)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:41.981746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb0e10-ea2b-475d-b848-c9aab1334caa admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:42.118196 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-86bb0e10-ea2b-475d-b848-c9aab1334caa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95cdfe8bc6814228b08278ff47195ec5', 'request_id': 'req-86bb0e10-ea2b-475d-b848-c9aab1334caa'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:42.140796 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-86bb0e10-ea2b-475d-b848-c9aab1334caa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95cdfe8bc6814228b08278ff47195ec5', 'request_id': 'req-86bb0e10-ea2b-475d-b848-c9aab1334caa'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:42.147889 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-86bb0e10-ea2b-475d-b848-c9aab1334caa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95cdfe8bc6814228b08278ff47195ec5', 'request_id': 'req-86bb0e10-ea2b-475d-b848-c9aab1334caa'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:42.170337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-86bb0e10-ea2b-475d-b848-c9aab1334caa admin admin] The token cache is being invalidate because project 95cdfe8bc6814228b08278ff47195ec5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:07:42.170969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-86bb0e10-ea2b-475d-b848-c9aab1334caa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:42.172395 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-86bb0e10-ea2b-475d-b848-c9aab1334caa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:42.178839 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b23d9-d0b9-4c31-b70a-06b97dd4648f service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:42.179393 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1558/3103] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:07:41 2022] DELETE /identity/v3/projects/95cdfe8bc6814228b08278ff47195ec5 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:07:42.192352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b23d9-d0b9-4c31-b70a-06b97dd4648f service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:42.328779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8b70b-7434-4cd0-91e6-1dd42fe46d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:42.329453 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8b70b-7434-4cd0-91e6-1dd42fe46d42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:42.329765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8b70b-7434-4cd0-91e6-1dd42fe46d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:42.330039 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8b70b-7434-4cd0-91e6-1dd42fe46d42 admin admin] PATH_INFO: `/v3/users/5f07754afdbb4c60b2c3e611563b7520` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:42.331197 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec8b70b-7434-4cd0-91e6-1dd42fe46d42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f07754afdbb4c60b2c3e611563b7520)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:42.337413 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec8b70b-7434-4cd0-91e6-1dd42fe46d42 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:42.460447 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-aec8b70b-7434-4cd0-91e6-1dd42fe46d42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f07754afdbb4c60b2c3e611563b7520'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:42.464253 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-aec8b70b-7434-4cd0-91e6-1dd42fe46d42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f07754afdbb4c60b2c3e611563b7520'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:42.477428 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-aec8b70b-7434-4cd0-91e6-1dd42fe46d42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f07754afdbb4c60b2c3e611563b7520'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:42.503014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-aec8b70b-7434-4cd0-91e6-1dd42fe46d42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f07754afdbb4c60b2c3e611563b7520'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:42.503651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-aec8b70b-7434-4cd0-91e6-1dd42fe46d42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f07754afdbb4c60b2c3e611563b7520'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:42.520925 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:42.548409 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1546/3104] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:07:42 2022] DELETE /identity/v3/users/5f07754afdbb4c60b2c3e611563b7520 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:07:44.245641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb0e10-ea2b-475d-b848-c9aab1334caa admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:44.247891 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-86bb0e10-ea2b-475d-b848-c9aab1334caa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:44.299152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb0e10-ea2b-475d-b848-c9aab1334caa admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:44.466196 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:44.502525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fbf316-d398-4058-a7f1-b8f97a9b85de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:44.504496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbf316-d398-4058-a7f1-b8f97a9b85de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:44.504982 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbf316-d398-4058-a7f1-b8f97a9b85de admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:44.509060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbf316-d398-4058-a7f1-b8f97a9b85de admin admin] PATH_INFO: `/v3/projects/7cfa512e39de4a2c9bfa7fa2f164bb64` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:44.512607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fbf316-d398-4058-a7f1-b8f97a9b85de admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cfa512e39de4a2c9bfa7fa2f164bb64)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:44.522602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fbf316-d398-4058-a7f1-b8f97a9b85de admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:44.714708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a1fbf316-d398-4058-a7f1-b8f97a9b85de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cfa512e39de4a2c9bfa7fa2f164bb64', 'request_id': 'req-a1fbf316-d398-4058-a7f1-b8f97a9b85de'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:44.743090 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a1fbf316-d398-4058-a7f1-b8f97a9b85de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cfa512e39de4a2c9bfa7fa2f164bb64', 'request_id': 'req-a1fbf316-d398-4058-a7f1-b8f97a9b85de'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:44.760457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a1fbf316-d398-4058-a7f1-b8f97a9b85de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cfa512e39de4a2c9bfa7fa2f164bb64', 'request_id': 'req-a1fbf316-d398-4058-a7f1-b8f97a9b85de'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:44.784706 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a1fbf316-d398-4058-a7f1-b8f97a9b85de admin admin] The token cache is being invalidate because project 7cfa512e39de4a2c9bfa7fa2f164bb64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:07:44.784706 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a1fbf316-d398-4058-a7f1-b8f97a9b85de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:44.791656 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a1fbf316-d398-4058-a7f1-b8f97a9b85de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:44.803203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a263a31-c2a0-455c-b55c-023c97662467 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:44.803741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a263a31-c2a0-455c-b55c-023c97662467 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:44.803851 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a263a31-c2a0-455c-b55c-023c97662467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:44.807437 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1559/3105] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:07:44 2022] DELETE /identity/v3/projects/7cfa512e39de4a2c9bfa7fa2f164bb64 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:07:44.879996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-1a263a31-c2a0-455c-b55c-023c97662467 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:44.881298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1a263a31-c2a0-455c-b55c-023c97662467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:45.090395 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1547/3106] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:07:45.148008 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e170d-6304-4489-a734-ff2dcf72262d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:45.148296 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e170d-6304-4489-a734-ff2dcf72262d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:45.148591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e170d-6304-4489-a734-ff2dcf72262d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:45.172571 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-502e170d-6304-4489-a734-ff2dcf72262d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:45.174473 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-502e170d-6304-4489-a734-ff2dcf72262d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:45.189596 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a263a31-c2a0-455c-b55c-023c97662467 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:45.194984 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1560/3107] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:07:45.200755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a263a31-c2a0-455c-b55c-023c97662467 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:45.207187 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c369e8e-d062-4c5f-a8d4-7e95abecbf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:45.207812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c369e8e-d062-4c5f-a8d4-7e95abecbf54 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:45.208094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c369e8e-d062-4c5f-a8d4-7e95abecbf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:45.208373 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c369e8e-d062-4c5f-a8d4-7e95abecbf54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:45.209039 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c369e8e-d062-4c5f-a8d4-7e95abecbf54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:07:45.209345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c369e8e-d062-4c5f-a8d4-7e95abecbf54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:45.211662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c369e8e-d062-4c5f-a8d4-7e95abecbf54 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:45.230745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e170d-6304-4489-a734-ff2dcf72262d None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:45.237629 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1548/3108] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:07:45.241879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e170d-6304-4489-a734-ff2dcf72262d None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:45.248178 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4579d-8d04-4ba2-a485-e31314850828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:45.250394 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4579d-8d04-4ba2-a485-e31314850828 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:45.251040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4579d-8d04-4ba2-a485-e31314850828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:45.251376 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4579d-8d04-4ba2-a485-e31314850828 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:45.252029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4579d-8d04-4ba2-a485-e31314850828 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:45.254853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4579d-8d04-4ba2-a485-e31314850828 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:45.301979 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c369e8e-d062-4c5f-a8d4-7e95abecbf54 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:45.311985 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1561/3109] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:07:45 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:07:45.318090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c369e8e-d062-4c5f-a8d4-7e95abecbf54 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:45.446043 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04e0e0-7fb0-475a-bd99-ecdb8da24ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:45.447595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04e0e0-7fb0-475a-bd99-ecdb8da24ad3 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:45.447985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04e0e0-7fb0-475a-bd99-ecdb8da24ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:45.448522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04e0e0-7fb0-475a-bd99-ecdb8da24ad3 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:45.450165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04e0e0-7fb0-475a-bd99-ecdb8da24ad3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:45.452425 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04e0e0-7fb0-475a-bd99-ecdb8da24ad3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:45.494435 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4579d-8d04-4ba2-a485-e31314850828 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:45.510428 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1549/3110] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:07:45 2022] POST /identity/v3/users => generated 287 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:07:45.516789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4579d-8d04-4ba2-a485-e31314850828 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:45.523760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9269d7-0abe-4479-8825-2113a70933f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:45.524671 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9269d7-0abe-4479-8825-2113a70933f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:45.524968 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9269d7-0abe-4479-8825-2113a70933f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:45.525253 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9269d7-0abe-4479-8825-2113a70933f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:45.526100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9269d7-0abe-4479-8825-2113a70933f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:45.528117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9269d7-0abe-4479-8825-2113a70933f1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:45.547104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04e0e0-7fb0-475a-bd99-ecdb8da24ad3 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:45.558368 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1562/3111] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:07:45.565214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04e0e0-7fb0-475a-bd99-ecdb8da24ad3 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:45.571315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e9144-c6ed-484b-a06b-d36383026046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:45.572359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e9144-c6ed-484b-a06b-d36383026046 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:45.572659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e9144-c6ed-484b-a06b-d36383026046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:45.574036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e9144-c6ed-484b-a06b-d36383026046 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:45.574941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e9144-c6ed-484b-a06b-d36383026046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:45.577297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e9144-c6ed-484b-a06b-d36383026046 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:45.603789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9269d7-0abe-4479-8825-2113a70933f1 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:45.604252 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1550/3112] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:07:45.621922 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9269d7-0abe-4479-8825-2113a70933f1 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:45.646263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58adcaa-e230-48fb-93b3-029253bac3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:45.647961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58adcaa-e230-48fb-93b3-029253bac3bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:45.648807 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58adcaa-e230-48fb-93b3-029253bac3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:45.650806 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58adcaa-e230-48fb-93b3-029253bac3bf admin admin] PATH_INFO: `/v3/projects/ad9cb0ddff75492cac7a4c896e7fc99b/users/cc56b26f1c094188b6313ab73bbc7e89/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:45.686631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58adcaa-e230-48fb-93b3-029253bac3bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad9cb0ddff75492cac7a4c896e7fc99b, user_id=cc56b26f1c094188b6313ab73bbc7e89, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:45.690008 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58adcaa-e230-48fb-93b3-029253bac3bf admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:45.720703 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1563/3113] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:07:45 2022] PUT /identity/v3/projects/ad9cb0ddff75492cac7a4c896e7fc99b/users/cc56b26f1c094188b6313ab73bbc7e89/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:07:45.735218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074e3ec-9251-443c-8b59-99b8e2bb8b60 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:45.735502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074e3ec-9251-443c-8b59-99b8e2bb8b60 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:45.735921 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074e3ec-9251-443c-8b59-99b8e2bb8b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:45.801161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-1074e3ec-9251-443c-8b59-99b8e2bb8b60 None None] MFA Rules not processed for user `cc56b26f1c094188b6313ab73bbc7e89`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:45.802634 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1074e3ec-9251-443c-8b59-99b8e2bb8b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:45.885992 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:45.923483 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1551/3114] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:07:45.927015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58adcaa-e230-48fb-93b3-029253bac3bf admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:46.081540 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58adcaa-e230-48fb-93b3-029253bac3bf admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:46.087758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a471d2c-fe04-44fe-8722-25ca5ed53794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:46.088383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a471d2c-fe04-44fe-8722-25ca5ed53794 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:46.088674 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a471d2c-fe04-44fe-8722-25ca5ed53794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:46.088938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a471d2c-fe04-44fe-8722-25ca5ed53794 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:46.089716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a471d2c-fe04-44fe-8722-25ca5ed53794 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:46.092122 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a471d2c-fe04-44fe-8722-25ca5ed53794 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:46.146038 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:46.177312 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1564/3115] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:07:45 2022] POST /identity/v3/projects => generated 375 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:07:46.181211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074e3ec-9251-443c-8b59-99b8e2bb8b60 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:46.200730 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074e3ec-9251-443c-8b59-99b8e2bb8b60 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:46.387416 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c0556-4575-4c1c-8f3d-8d05bd4f60fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:46.388720 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c0556-4575-4c1c-8f3d-8d05bd4f60fd admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:46.389645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c0556-4575-4c1c-8f3d-8d05bd4f60fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:46.390817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c0556-4575-4c1c-8f3d-8d05bd4f60fd admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:46.391879 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c0556-4575-4c1c-8f3d-8d05bd4f60fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:46.394739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c0556-4575-4c1c-8f3d-8d05bd4f60fd admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:46.470550 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1552/3116] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:07:46 2022] POST /identity/v3/users => generated 294 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:07:46.475052 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a471d2c-fe04-44fe-8722-25ca5ed53794 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:46.495924 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a471d2c-fe04-44fe-8722-25ca5ed53794 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:46.523206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d37d0-2d85-4b1d-b163-214a781e69d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:46.525794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d37d0-2d85-4b1d-b163-214a781e69d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:46.526663 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d37d0-2d85-4b1d-b163-214a781e69d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:46.528205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d37d0-2d85-4b1d-b163-214a781e69d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:46.529203 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d37d0-2d85-4b1d-b163-214a781e69d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:46.543868 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d37d0-2d85-4b1d-b163-214a781e69d1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:46.588492 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1565/3117] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:07:46.592300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c0556-4575-4c1c-8f3d-8d05bd4f60fd admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:46.626754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c0556-4575-4c1c-8f3d-8d05bd4f60fd admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:46.644322 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44672a9d-fefc-4eaf-9a21-a5816a1c64f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:46.645129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44672a9d-fefc-4eaf-9a21-a5816a1c64f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:46.645465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44672a9d-fefc-4eaf-9a21-a5816a1c64f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:46.645893 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44672a9d-fefc-4eaf-9a21-a5816a1c64f4 admin admin] PATH_INFO: `/v3/projects/eeb2c809a0cb46189190ae9640b04608/users/357350b979654d3faa188039ec710427/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:46.680683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44672a9d-fefc-4eaf-9a21-a5816a1c64f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeb2c809a0cb46189190ae9640b04608, user_id=357350b979654d3faa188039ec710427, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:46.684220 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44672a9d-fefc-4eaf-9a21-a5816a1c64f4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:46.724812 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1553/3118] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:07:46 2022] PUT /identity/v3/projects/eeb2c809a0cb46189190ae9640b04608/users/357350b979654d3faa188039ec710427/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:07:46.728993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d37d0-2d85-4b1d-b163-214a781e69d1 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:46.745193 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d37d0-2d85-4b1d-b163-214a781e69d1 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:46.917636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f942cb-9737-4223-8771-ce94f7e94016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:46.918627 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f942cb-9737-4223-8771-ce94f7e94016 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:46.918914 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f942cb-9737-4223-8771-ce94f7e94016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:46.919192 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f942cb-9737-4223-8771-ce94f7e94016 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:46.919852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f942cb-9737-4223-8771-ce94f7e94016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:46.923502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f942cb-9737-4223-8771-ce94f7e94016 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:46.964062 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44672a9d-fefc-4eaf-9a21-a5816a1c64f4 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:46.974328 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1566/3119] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:07:46.987245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44672a9d-fefc-4eaf-9a21-a5816a1c64f4 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:47.009966 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89d674-6b3e-4a53-afda-580b062ab9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:47.010908 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89d674-6b3e-4a53-afda-580b062ab9a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:47.011217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89d674-6b3e-4a53-afda-580b062ab9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:47.012396 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89d674-6b3e-4a53-afda-580b062ab9a0 admin admin] PATH_INFO: `/v3/projects/eeb2c809a0cb46189190ae9640b04608/users/357350b979654d3faa188039ec710427/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:47.017350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89d674-6b3e-4a53-afda-580b062ab9a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeb2c809a0cb46189190ae9640b04608, user_id=357350b979654d3faa188039ec710427, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:47.027506 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89d674-6b3e-4a53-afda-580b062ab9a0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:47.068632 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1554/3120] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:07:46 2022] PUT /identity/v3/projects/eeb2c809a0cb46189190ae9640b04608/users/357350b979654d3faa188039ec710427/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:07:47.081556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9524a82-ed44-404e-b1b7-8f7b3b55a3af None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:47.086032 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9524a82-ed44-404e-b1b7-8f7b3b55a3af None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:47.087449 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9524a82-ed44-404e-b1b7-8f7b3b55a3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:47.205804 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c9524a82-ed44-404e-b1b7-8f7b3b55a3af None None] MFA Rules not processed for user `357350b979654d3faa188039ec710427`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:47.207657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c9524a82-ed44-404e-b1b7-8f7b3b55a3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:47.392520 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1567/3121] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:07:47.399021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89d674-6b3e-4a53-afda-580b062ab9a0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:47.436327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89d674-6b3e-4a53-afda-580b062ab9a0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:47.490079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ced6eb-2048-42ad-9448-fe4dcb1d09da tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '357350b979654d3faa188039ec710427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb2c809a0cb46189190ae9640b04608', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:47.491543 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ced6eb-2048-42ad-9448-fe4dcb1d09da tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:47.491833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ced6eb-2048-42ad-9448-fe4dcb1d09da tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:47.492109 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ced6eb-2048-42ad-9448-fe4dcb1d09da tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:47.493272 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ced6eb-2048-42ad-9448-fe4dcb1d09da tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:07:47.494929 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ced6eb-2048-42ad-9448-fe4dcb1d09da tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:47.496890 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ced6eb-2048-42ad-9448-fe4dcb1d09da tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:47.519495 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1555/3122] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:07:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:07:47.520386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9524a82-ed44-404e-b1b7-8f7b3b55a3af None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:47.532195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9524a82-ed44-404e-b1b7-8f7b3b55a3af None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:47.564999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f9d6d-d5f1-44aa-857d-db8b073a3c29 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '357350b979654d3faa188039ec710427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb2c809a0cb46189190ae9640b04608', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:47.565772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f9d6d-d5f1-44aa-857d-db8b073a3c29 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:47.566057 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f9d6d-d5f1-44aa-857d-db8b073a3c29 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:47.566397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f9d6d-d5f1-44aa-857d-db8b073a3c29 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:47.567051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f9d6d-d5f1-44aa-857d-db8b073a3c29 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:47.576955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f9d6d-d5f1-44aa-857d-db8b073a3c29 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:47.679308 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1568/3123] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:07:47 2022] POST /identity/v3/projects => generated 371 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:07:47.680446 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ced6eb-2048-42ad-9448-fe4dcb1d09da tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:47.695486 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ced6eb-2048-42ad-9448-fe4dcb1d09da tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:47.903949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97371474-04ac-49b2-81ce-a9edd507f04a tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '357350b979654d3faa188039ec710427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb2c809a0cb46189190ae9640b04608', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:47.904813 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97371474-04ac-49b2-81ce-a9edd507f04a tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:47.905951 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97371474-04ac-49b2-81ce-a9edd507f04a tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:47.905951 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97371474-04ac-49b2-81ce-a9edd507f04a tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:47.906234 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97371474-04ac-49b2-81ce-a9edd507f04a tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:07:47.908026 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97371474-04ac-49b2-81ce-a9edd507f04a tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:47.909879 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97371474-04ac-49b2-81ce-a9edd507f04a tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:47.960163 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1556/3124] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:07:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:07:48.636357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f9d6d-d5f1-44aa-857d-db8b073a3c29 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:48.638241 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-653f9d6d-d5f1-44aa-857d-db8b073a3c29 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:48.775747 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:48.820210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f9d6d-d5f1-44aa-857d-db8b073a3c29 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:48.836003 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a5827c-1ef3-4d7f-a767-1149934c6101 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:48.837017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5827c-1ef3-4d7f-a767-1149934c6101 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:48.837498 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5827c-1ef3-4d7f-a767-1149934c6101 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:48.837962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5827c-1ef3-4d7f-a767-1149934c6101 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:48.860422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a5827c-1ef3-4d7f-a767-1149934c6101 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:48.863656 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a5827c-1ef3-4d7f-a767-1149934c6101 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:48.881322 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1569/3125] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:07:48 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:07:48.898895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97371474-04ac-49b2-81ce-a9edd507f04a tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:48.900799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-97371474-04ac-49b2-81ce-a9edd507f04a tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:48.943199 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85797c36-ffe4-4ba3-9f4e-384892020d48 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:48.944106 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85797c36-ffe4-4ba3-9f4e-384892020d48 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:48.944668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85797c36-ffe4-4ba3-9f4e-384892020d48 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:48.946736 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1570/3126] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:07:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 04 01:07:48.959018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85797c36-ffe4-4ba3-9f4e-384892020d48 None None] Authenticating service token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:07:48.971311 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:49.002592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85797c36-ffe4-4ba3-9f4e-384892020d48 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:49.027480 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85797c36-ffe4-4ba3-9f4e-384892020d48 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:49.034007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce66c93-3819-4f0c-9d4c-ec752d9a7f71 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '357350b979654d3faa188039ec710427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb2c809a0cb46189190ae9640b04608', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:49.035756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce66c93-3819-4f0c-9d4c-ec752d9a7f71 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:49.036292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce66c93-3819-4f0c-9d4c-ec752d9a7f71 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:49.036668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce66c93-3819-4f0c-9d4c-ec752d9a7f71 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] PATH_INFO: `/v3/projects/e2fd338c499d4c9cbf711c55524be871` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:49.038072 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce66c93-3819-4f0c-9d4c-ec752d9a7f71 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: Authorizing `identity:get_project(project_id=e2fd338c499d4c9cbf711c55524be871)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:49.041325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce66c93-3819-4f0c-9d4c-ec752d9a7f71 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:49.059691 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1571/3127] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:07:48 2022] GET /identity/v3/projects/e2fd338c499d4c9cbf711c55524be871 => generated 371 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:07:49.120530 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97371474-04ac-49b2-81ce-a9edd507f04a tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:49.135034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8e47d-3358-4e8f-a180-06e52df17a27 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:49.136303 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8e47d-3358-4e8f-a180-06e52df17a27 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:49.136763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8e47d-3358-4e8f-a180-06e52df17a27 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:49.137196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8e47d-3358-4e8f-a180-06e52df17a27 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:49.143043 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-76d8e47d-3358-4e8f-a180-06e52df17a27 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:49.167247 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8e47d-3358-4e8f-a180-06e52df17a27 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:49.169352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8e47d-3358-4e8f-a180-06e52df17a27 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:49.178758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce66c93-3819-4f0c-9d4c-ec752d9a7f71 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:49.180810 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6ce66c93-3819-4f0c-9d4c-ec752d9a7f71 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:49.192006 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1557/3128] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:07:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:07:49.302653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41420026-3e23-4229-9984-564fb18fd288 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:49.303143 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41420026-3e23-4229-9984-564fb18fd288 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:49.303554 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41420026-3e23-4229-9984-564fb18fd288 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:49.305145 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1558/3129] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:07:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:07:49.319094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41420026-3e23-4229-9984-564fb18fd288 None None] Authenticating service token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:07:49.323664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-41420026-3e23-4229-9984-564fb18fd288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:49.351710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce66c93-3819-4f0c-9d4c-ec752d9a7f71 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:49.364593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0750d82-434a-4e01-bc89-97030c9dfd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:49.365456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0750d82-434a-4e01-bc89-97030c9dfd9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:49.366153 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0750d82-434a-4e01-bc89-97030c9dfd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:49.367561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0750d82-434a-4e01-bc89-97030c9dfd9d admin admin] PATH_INFO: `/v3/users/a0067546d2f94a1db3b16750f5dfa909` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:49.370199 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0750d82-434a-4e01-bc89-97030c9dfd9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0067546d2f94a1db3b16750f5dfa909)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:49.370412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41420026-3e23-4229-9984-564fb18fd288 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:49.372899 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0750d82-434a-4e01-bc89-97030c9dfd9d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:49.406248 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41420026-3e23-4229-9984-564fb18fd288 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:49.426587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d44c9-df10-49af-a587-cc439152e2df tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '357350b979654d3faa188039ec710427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb2c809a0cb46189190ae9640b04608', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:49.427375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d44c9-df10-49af-a587-cc439152e2df tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:49.427664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d44c9-df10-49af-a587-cc439152e2df tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:49.427937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d44c9-df10-49af-a587-cc439152e2df tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] PATH_INFO: `/v3/projects/e2fd338c499d4c9cbf711c55524be871` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:49.429735 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d44c9-df10-49af-a587-cc439152e2df tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: Authorizing `identity:get_project(project_id=e2fd338c499d4c9cbf711c55524be871)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:49.437609 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d44c9-df10-49af-a587-cc439152e2df tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:49.438998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f0750d82-434a-4e01-bc89-97030c9dfd9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0067546d2f94a1db3b16750f5dfa909'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:49.439926 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f0750d82-434a-4e01-bc89-97030c9dfd9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0067546d2f94a1db3b16750f5dfa909'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:49.448715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f0750d82-434a-4e01-bc89-97030c9dfd9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0067546d2f94a1db3b16750f5dfa909'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:49.460189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f0750d82-434a-4e01-bc89-97030c9dfd9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0067546d2f94a1db3b16750f5dfa909'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:49.460346 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f0750d82-434a-4e01-bc89-97030c9dfd9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0067546d2f94a1db3b16750f5dfa909'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:49.462454 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1559/3130] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:07:49 2022] GET /identity/v3/projects/e2fd338c499d4c9cbf711c55524be871 => generated 371 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:07:49.491950 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1572/3131] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:07:49 2022] DELETE /identity/v3/users/a0067546d2f94a1db3b16750f5dfa909 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:07:49.537245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d44c9-df10-49af-a587-cc439152e2df tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:49.539104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e46d44c9-df10-49af-a587-cc439152e2df tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:49.560658 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d44c9-df10-49af-a587-cc439152e2df tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:49.689142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649e970-c76a-40b3-ba42-f172ab37ebd7 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '357350b979654d3faa188039ec710427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb2c809a0cb46189190ae9640b04608', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:49.693332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649e970-c76a-40b3-ba42-f172ab37ebd7 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:49.693656 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649e970-c76a-40b3-ba42-f172ab37ebd7 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:49.693943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649e970-c76a-40b3-ba42-f172ab37ebd7 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:49.694638 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649e970-c76a-40b3-ba42-f172ab37ebd7 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:07:49.694952 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649e970-c76a-40b3-ba42-f172ab37ebd7 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:49.696598 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649e970-c76a-40b3-ba42-f172ab37ebd7 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:49.736808 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1560/3132] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:07:49.741173 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0750d82-434a-4e01-bc89-97030c9dfd9d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:49.758125 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0750d82-434a-4e01-bc89-97030c9dfd9d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:49.766155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5baebd5-7af8-4ab8-9da9-1fe3a607ef83 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '357350b979654d3faa188039ec710427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb2c809a0cb46189190ae9640b04608', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:49.766790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5baebd5-7af8-4ab8-9da9-1fe3a607ef83 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:49.767076 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5baebd5-7af8-4ab8-9da9-1fe3a607ef83 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:49.767442 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5baebd5-7af8-4ab8-9da9-1fe3a607ef83 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:49.768023 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5baebd5-7af8-4ab8-9da9-1fe3a607ef83 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:49.770082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5baebd5-7af8-4ab8-9da9-1fe3a607ef83 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:49.817667 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1573/3133] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:07:49 2022] POST /identity/v3/users => generated 381 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:07:49.824378 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649e970-c76a-40b3-ba42-f172ab37ebd7 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:49.848465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649e970-c76a-40b3-ba42-f172ab37ebd7 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:49.858032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45681f0a-8932-4e5a-af97-b0288130fea5 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '357350b979654d3faa188039ec710427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb2c809a0cb46189190ae9640b04608', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:49.859771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45681f0a-8932-4e5a-af97-b0288130fea5 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:49.860064 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45681f0a-8932-4e5a-af97-b0288130fea5 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:49.860764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45681f0a-8932-4e5a-af97-b0288130fea5 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:49.861023 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45681f0a-8932-4e5a-af97-b0288130fea5 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:07:49.861339 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45681f0a-8932-4e5a-af97-b0288130fea5 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:49.863533 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45681f0a-8932-4e5a-af97-b0288130fea5 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:49.899841 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1561/3134] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:07:50.277335 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1f54a-b7df-4915-bef7-0c21378a75b6 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:50.277729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1f54a-b7df-4915-bef7-0c21378a75b6 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:50.278255 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1f54a-b7df-4915-bef7-0c21378a75b6 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:50.280293 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1574/3135] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:07:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:07:50.289491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45681f0a-8932-4e5a-af97-b0288130fea5 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] Authenticating service token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:07:50.291617 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-45681f0a-8932-4e5a-af97-b0288130fea5 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:50.477680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1f54a-b7df-4915-bef7-0c21378a75b6 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:50.479569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7ec1f54a-b7df-4915-bef7-0c21378a75b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:50.483587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45681f0a-8932-4e5a-af97-b0288130fea5 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:50.505327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45681f0a-8932-4e5a-af97-b0288130fea5 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:50.517410 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90fb0f-f062-4050-8095-fb6db8cfac57 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '357350b979654d3faa188039ec710427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb2c809a0cb46189190ae9640b04608', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:50.518438 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90fb0f-f062-4050-8095-fb6db8cfac57 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:50.518893 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90fb0f-f062-4050-8095-fb6db8cfac57 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:50.519332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90fb0f-f062-4050-8095-fb6db8cfac57 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] PATH_INFO: `/v3/projects/e2fd338c499d4c9cbf711c55524be871` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:50.520675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f90fb0f-f062-4050-8095-fb6db8cfac57 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: Authorizing `identity:get_project(project_id=e2fd338c499d4c9cbf711c55524be871)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:50.523100 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f90fb0f-f062-4050-8095-fb6db8cfac57 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:50.525417 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1562/3136] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:07:50 2022] GET /identity/v3/projects/e2fd338c499d4c9cbf711c55524be871 => generated 371 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:07:50.541746 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:50.623924 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1f54a-b7df-4915-bef7-0c21378a75b6 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:50.637089 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb6d59-01e2-41a9-920b-e93354f83397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:50.638667 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb6d59-01e2-41a9-920b-e93354f83397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:50.638667 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb6d59-01e2-41a9-920b-e93354f83397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:50.638940 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb6d59-01e2-41a9-920b-e93354f83397 admin admin] PATH_INFO: `/v3/projects/8eb65d155e5745c392747c7d3d4d0c07` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:50.645344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb6d59-01e2-41a9-920b-e93354f83397 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eb65d155e5745c392747c7d3d4d0c07)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:50.651235 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb6d59-01e2-41a9-920b-e93354f83397 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:50.784154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0cfb6d59-01e2-41a9-920b-e93354f83397 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eb65d155e5745c392747c7d3d4d0c07', 'request_id': 'req-0cfb6d59-01e2-41a9-920b-e93354f83397'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:50.800645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0cfb6d59-01e2-41a9-920b-e93354f83397 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eb65d155e5745c392747c7d3d4d0c07', 'request_id': 'req-0cfb6d59-01e2-41a9-920b-e93354f83397'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:50.815678 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0cfb6d59-01e2-41a9-920b-e93354f83397 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eb65d155e5745c392747c7d3d4d0c07', 'request_id': 'req-0cfb6d59-01e2-41a9-920b-e93354f83397'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:50.837670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0cfb6d59-01e2-41a9-920b-e93354f83397 admin admin] The token cache is being invalidate because project 8eb65d155e5745c392747c7d3d4d0c07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:07:50.837966 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0cfb6d59-01e2-41a9-920b-e93354f83397 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:50.840066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0cfb6d59-01e2-41a9-920b-e93354f83397 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:50.847867 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1575/3137] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:07:50 2022] DELETE /identity/v3/projects/8eb65d155e5745c392747c7d3d4d0c07 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:07:50.849691 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f48c11-a1cc-402e-a4c2-851adae414a6 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:50.850671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f48c11-a1cc-402e-a4c2-851adae414a6 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:50.851299 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f48c11-a1cc-402e-a4c2-851adae414a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:50.907005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-08f48c11-a1cc-402e-a4c2-851adae414a6 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:50.908314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-08f48c11-a1cc-402e-a4c2-851adae414a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:50.942329 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:51.077495 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1563/3138] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:07:51.082543 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730eba32-ef31-4c1b-ad74-96c2e2ca0f95 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:51.082832 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730eba32-ef31-4c1b-ad74-96c2e2ca0f95 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:51.083113 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730eba32-ef31-4c1b-ad74-96c2e2ca0f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:51.120205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-730eba32-ef31-4c1b-ad74-96c2e2ca0f95 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:51.120205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-730eba32-ef31-4c1b-ad74-96c2e2ca0f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:51.161278 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1576/3139] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:07:51.163135 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f48c11-a1cc-402e-a4c2-851adae414a6 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:51.178734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f48c11-a1cc-402e-a4c2-851adae414a6 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:51.185993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b17fc4-f076-4241-a56d-6e7d363ce3f6 None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:51.186278 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b17fc4-f076-4241-a56d-6e7d363ce3f6 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:51.186746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b17fc4-f076-4241-a56d-6e7d363ce3f6 None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:51.189199 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1577/3140] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:07:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:07:51.191222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9208f1-65c1-4249-ba2c-21bce6489da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:51.191985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9208f1-65c1-4249-ba2c-21bce6489da3 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:51.192373 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9208f1-65c1-4249-ba2c-21bce6489da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:51.192772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9208f1-65c1-4249-ba2c-21bce6489da3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:51.193564 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9208f1-65c1-4249-ba2c-21bce6489da3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:07:51.194124 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9208f1-65c1-4249-ba2c-21bce6489da3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:51.195900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9208f1-65c1-4249-ba2c-21bce6489da3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:51.197465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b17fc4-f076-4241-a56d-6e7d363ce3f6 None None] Authenticating service token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:07:51.199410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-69b17fc4-f076-4241-a56d-6e7d363ce3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:51.230176 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1564/3141] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:07:51.231930 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9208f1-65c1-4249-ba2c-21bce6489da3 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:51.250574 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9208f1-65c1-4249-ba2c-21bce6489da3 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:51.261406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3612a1f-e473-472b-bb15-945e415d8621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:51.261879 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3612a1f-e473-472b-bb15-945e415d8621 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:51.262271 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3612a1f-e473-472b-bb15-945e415d8621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:51.262713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3612a1f-e473-472b-bb15-945e415d8621 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:51.263465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3612a1f-e473-472b-bb15-945e415d8621 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:51.265607 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3612a1f-e473-472b-bb15-945e415d8621 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:51.343854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b17fc4-f076-4241-a56d-6e7d363ce3f6 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:51.345765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-69b17fc4-f076-4241-a56d-6e7d363ce3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:51.354285 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1565/3142] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:07:51 2022] POST /identity/v3/projects => generated 367 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:07:51.358591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3612a1f-e473-472b-bb15-945e415d8621 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:51.451063 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:51.513911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b17fc4-f076-4241-a56d-6e7d363ce3f6 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:51.534858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3612a1f-e473-472b-bb15-945e415d8621 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:51.549904 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0648555-d4ef-4c6b-9585-e672568b7626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:51.550545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0648555-d4ef-4c6b-9585-e672568b7626 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:51.550819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0648555-d4ef-4c6b-9585-e672568b7626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:51.551091 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0648555-d4ef-4c6b-9585-e672568b7626 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:51.551728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0648555-d4ef-4c6b-9585-e672568b7626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:51.553675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0648555-d4ef-4c6b-9585-e672568b7626 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:51.585668 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1566/3143] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:07:51 2022] POST /identity/v3/users => generated 284 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:07:51.589359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0648555-d4ef-4c6b-9585-e672568b7626 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:51.614317 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0648555-d4ef-4c6b-9585-e672568b7626 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:51.630975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe1296-7b8c-4472-9e71-26732efa1202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:51.632170 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe1296-7b8c-4472-9e71-26732efa1202 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:51.632761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe1296-7b8c-4472-9e71-26732efa1202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:51.633271 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe1296-7b8c-4472-9e71-26732efa1202 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:51.634199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe1296-7b8c-4472-9e71-26732efa1202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:51.638775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe1296-7b8c-4472-9e71-26732efa1202 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:51.663022 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1567/3144] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:07:51.664326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe1296-7b8c-4472-9e71-26732efa1202 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:51.665341 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1343d82c-59af-4eba-b522-b00090315942 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '357350b979654d3faa188039ec710427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb2c809a0cb46189190ae9640b04608', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:51.670123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343d82c-59af-4eba-b522-b00090315942 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:51.670416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343d82c-59af-4eba-b522-b00090315942 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:51.670700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343d82c-59af-4eba-b522-b00090315942 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] PATH_INFO: `/v3/projects/e2fd338c499d4c9cbf711c55524be871` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:51.673422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1343d82c-59af-4eba-b522-b00090315942 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: Authorizing `identity:get_project(project_id=e2fd338c499d4c9cbf711c55524be871)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:51.675582 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1343d82c-59af-4eba-b522-b00090315942 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:51.678217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe1296-7b8c-4472-9e71-26732efa1202 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:51.686193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f8035-ebb7-4eb7-8764-d9d037e98ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:51.687414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f8035-ebb7-4eb7-8764-d9d037e98ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:51.687862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f8035-ebb7-4eb7-8764-d9d037e98ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:51.688286 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f8035-ebb7-4eb7-8764-d9d037e98ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:51.689333 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f8035-ebb7-4eb7-8764-d9d037e98ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:51.691996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f8035-ebb7-4eb7-8764-d9d037e98ae0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:51.692319 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1578/3145] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:07:51 2022] GET /identity/v3/projects/e2fd338c499d4c9cbf711c55524be871 => generated 371 bytes in 495 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:07:51.713532 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1568/3146] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:07:51.714676 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1343d82c-59af-4eba-b522-b00090315942 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:51.731968 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1343d82c-59af-4eba-b522-b00090315942 tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:51.751685 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f8035-ebb7-4eb7-8764-d9d037e98ae0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:51.755331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119f059-0f73-42d2-98cb-8589aaf44b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:51.755967 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119f059-0f73-42d2-98cb-8589aaf44b72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:51.756951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119f059-0f73-42d2-98cb-8589aaf44b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:51.758697 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119f059-0f73-42d2-98cb-8589aaf44b72 admin admin] PATH_INFO: `/v3/projects/6638188f01c94925b70f849f1d4a9c98/users/575bb87368454c08a703e99526e6f00c/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:51.781033 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f8035-ebb7-4eb7-8764-d9d037e98ae0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:51.792541 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b119f059-0f73-42d2-98cb-8589aaf44b72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6638188f01c94925b70f849f1d4a9c98, user_id=575bb87368454c08a703e99526e6f00c, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:51.797463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b119f059-0f73-42d2-98cb-8589aaf44b72 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:51.800275 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076dc39-fd3d-46a4-9dd4-fb16ab2fa9cc tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '357350b979654d3faa188039ec710427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb2c809a0cb46189190ae9640b04608', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:51.801155 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076dc39-fd3d-46a4-9dd4-fb16ab2fa9cc tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:51.801639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076dc39-fd3d-46a4-9dd4-fb16ab2fa9cc tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:51.802772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076dc39-fd3d-46a4-9dd4-fb16ab2fa9cc tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] PATH_INFO: `/v3/users/cbd49294048841af8aab89c8b8d5df66` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:51.824027 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1579/3147] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:07:51 2022] PUT /identity/v3/projects/6638188f01c94925b70f849f1d4a9c98/users/575bb87368454c08a703e99526e6f00c/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:07:51.832876 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9b948-970d-43b2-b566-1f2f3c8e2218 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:51.833224 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9b948-970d-43b2-b566-1f2f3c8e2218 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:51.833536 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9b948-970d-43b2-b566-1f2f3c8e2218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:51.844223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c076dc39-fd3d-46a4-9dd4-fb16ab2fa9cc tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: Authorizing `identity:delete_user(user_id=cbd49294048841af8aab89c8b8d5df66)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:51.850523 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c076dc39-fd3d-46a4-9dd4-fb16ab2fa9cc tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:51.883672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-d0c9b948-970d-43b2-b566-1f2f3c8e2218 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:51.885782 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d0c9b948-970d-43b2-b566-1f2f3c8e2218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:51.914393 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:51.947201 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c076dc39-fd3d-46a4-9dd4-fb16ab2fa9cc tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbd49294048841af8aab89c8b8d5df66'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:51.948190 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c076dc39-fd3d-46a4-9dd4-fb16ab2fa9cc tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbd49294048841af8aab89c8b8d5df66'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:51.964596 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c076dc39-fd3d-46a4-9dd4-fb16ab2fa9cc tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbd49294048841af8aab89c8b8d5df66'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:51.981947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c076dc39-fd3d-46a4-9dd4-fb16ab2fa9cc tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbd49294048841af8aab89c8b8d5df66'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:51.983359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c076dc39-fd3d-46a4-9dd4-fb16ab2fa9cc tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbd49294048841af8aab89c8b8d5df66'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:52.003445 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1580/3148] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:07:52.025471 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9b948-970d-43b2-b566-1f2f3c8e2218 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:52.027070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d0c9b948-970d-43b2-b566-1f2f3c8e2218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:52.031492 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1569/3149] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:07:51 2022] DELETE /identity/v3/users/cbd49294048841af8aab89c8b8d5df66 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:07:52.032777 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076dc39-fd3d-46a4-9dd4-fb16ab2fa9cc tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:52.053046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c076dc39-fd3d-46a4-9dd4-fb16ab2fa9cc tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:52.221664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9b948-970d-43b2-b566-1f2f3c8e2218 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:52.226414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076dc39-fd3d-46a4-9dd4-fb16ab2fa9cc tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:52.237891 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780259cf-4279-4dab-adce-936497131377 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:52.238851 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780259cf-4279-4dab-adce-936497131377 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:52.239186 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780259cf-4279-4dab-adce-936497131377 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:52.239483 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780259cf-4279-4dab-adce-936497131377 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:52.248494 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:52.353951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67392546-f44b-41d4-bfba-07a2b66bb67e tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '357350b979654d3faa188039ec710427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb2c809a0cb46189190ae9640b04608', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:52.355128 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67392546-f44b-41d4-bfba-07a2b66bb67e tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:52.355673 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67392546-f44b-41d4-bfba-07a2b66bb67e tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:52.355955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67392546-f44b-41d4-bfba-07a2b66bb67e tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] PATH_INFO: `/v3/projects/e2fd338c499d4c9cbf711c55524be871` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:52.362489 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67392546-f44b-41d4-bfba-07a2b66bb67e tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e2fd338c499d4c9cbf711c55524be871)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:52.363775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780259cf-4279-4dab-adce-936497131377 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:52.365045 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67392546-f44b-41d4-bfba-07a2b66bb67e tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:52.365579 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780259cf-4279-4dab-adce-936497131377 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:52.378441 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1570/3150] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:07:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:07:52.380589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed76ef-be44-4a0f-89ac-1354e1db72eb None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:52.380944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed76ef-be44-4a0f-89ac-1354e1db72eb None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:52.381481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed76ef-be44-4a0f-89ac-1354e1db72eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:52.429018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-bbed76ef-be44-4a0f-89ac-1354e1db72eb None None] MFA Rules not processed for user `b83fa471d05144b6897fe6a74fc5d141`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:52.431246 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bbed76ef-be44-4a0f-89ac-1354e1db72eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:52.466807 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-67392546-f44b-41d4-bfba-07a2b66bb67e tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2fd338c499d4c9cbf711c55524be871', 'request_id': 'req-67392546-f44b-41d4-bfba-07a2b66bb67e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:52.477500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-67392546-f44b-41d4-bfba-07a2b66bb67e tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2fd338c499d4c9cbf711c55524be871', 'request_id': 'req-67392546-f44b-41d4-bfba-07a2b66bb67e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:52.486164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-67392546-f44b-41d4-bfba-07a2b66bb67e tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2fd338c499d4c9cbf711c55524be871', 'request_id': 'req-67392546-f44b-41d4-bfba-07a2b66bb67e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:52.500913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-67392546-f44b-41d4-bfba-07a2b66bb67e tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] The token cache is being invalidate because project e2fd338c499d4c9cbf711c55524be871 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:07:52.501749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-67392546-f44b-41d4-bfba-07a2b66bb67e tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:52.502824 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-67392546-f44b-41d4-bfba-07a2b66bb67e tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:52.505322 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1581/3151] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:07:52 2022] DELETE /identity/v3/projects/e2fd338c499d4c9cbf711c55524be871 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:07:52.510515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67392546-f44b-41d4-bfba-07a2b66bb67e tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:52.516511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-67392546-f44b-41d4-bfba-07a2b66bb67e tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:52.548085 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:52.599815 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1571/3152] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:07:52.609695 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a519fa-9bf1-4bbe-adbe-7ed69c641189 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:52.610084 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a519fa-9bf1-4bbe-adbe-7ed69c641189 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:52.610220 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a519fa-9bf1-4bbe-adbe-7ed69c641189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:52.646524 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-73a519fa-9bf1-4bbe-adbe-7ed69c641189 None None] MFA Rules not processed for user `b83fa471d05144b6897fe6a74fc5d141`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:52.649725 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-73a519fa-9bf1-4bbe-adbe-7ed69c641189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:52.680886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67392546-f44b-41d4-bfba-07a2b66bb67e tempest-QuotasAdminTestV236-1259421974 tempest-QuotasAdminTestV236-1259421974-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:52.699901 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a0f7a-b39c-439c-a9b4-865855537956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:52.703702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a0f7a-b39c-439c-a9b4-865855537956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:52.706889 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a0f7a-b39c-439c-a9b4-865855537956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:52.707376 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a0f7a-b39c-439c-a9b4-865855537956 admin admin] PATH_INFO: `/v3/users/cc56b26f1c094188b6313ab73bbc7e89` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:52.712202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a0f7a-b39c-439c-a9b4-865855537956 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc56b26f1c094188b6313ab73bbc7e89)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:52.721836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a0f7a-b39c-439c-a9b4-865855537956 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:52.750639 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1572/3153] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:07:52.842142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ce8a0f7a-b39c-439c-a9b4-865855537956 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc56b26f1c094188b6313ab73bbc7e89'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:52.843983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ce8a0f7a-b39c-439c-a9b4-865855537956 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc56b26f1c094188b6313ab73bbc7e89'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:52.846897 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:52.857226 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ce8a0f7a-b39c-439c-a9b4-865855537956 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc56b26f1c094188b6313ab73bbc7e89'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:52.871358 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ce8a0f7a-b39c-439c-a9b4-865855537956 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc56b26f1c094188b6313ab73bbc7e89'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:52.872577 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ce8a0f7a-b39c-439c-a9b4-865855537956 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc56b26f1c094188b6313ab73bbc7e89'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:52.918532 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1582/3154] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:07:52 2022] DELETE /identity/v3/users/cc56b26f1c094188b6313ab73bbc7e89 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:07:52.919590 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7725d0-12d4-44ea-a3f4-163c9d7e5fa0 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:52.920838 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7725d0-12d4-44ea-a3f4-163c9d7e5fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:52.920838 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7725d0-12d4-44ea-a3f4-163c9d7e5fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:52.946433 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a0f7a-b39c-439c-a9b4-865855537956 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:52.948035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ce8a0f7a-b39c-439c-a9b4-865855537956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:52.967866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-ec7725d0-12d4-44ea-a3f4-163c9d7e5fa0 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:52.970042 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ec7725d0-12d4-44ea-a3f4-163c9d7e5fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:53.048989 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1573/3155] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:07:53.080427 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7725d0-12d4-44ea-a3f4-163c9d7e5fa0 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:53.083191 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ec7725d0-12d4-44ea-a3f4-163c9d7e5fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:53.088092 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a0f7a-b39c-439c-a9b4-865855537956 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:53.095371 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a45838-4bf2-4707-8a84-9b316169b6e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:53.096126 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a45838-4bf2-4707-8a84-9b316169b6e5 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:53.096411 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a45838-4bf2-4707-8a84-9b316169b6e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:53.096738 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a45838-4bf2-4707-8a84-9b316169b6e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:53.098518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e3a45838-4bf2-4707-8a84-9b316169b6e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:53.202445 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a45838-4bf2-4707-8a84-9b316169b6e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:53.204341 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a45838-4bf2-4707-8a84-9b316169b6e5 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:53.225549 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1583/3156] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:07:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:07:53.251165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7725d0-12d4-44ea-a3f4-163c9d7e5fa0 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:53.265865 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6abf6a-7017-4803-aeb8-cefc8f7ec54c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:53.268724 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6abf6a-7017-4803-aeb8-cefc8f7ec54c service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:53.269024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6abf6a-7017-4803-aeb8-cefc8f7ec54c service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:53.269282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6abf6a-7017-4803-aeb8-cefc8f7ec54c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:53.301916 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6abf6a-7017-4803-aeb8-cefc8f7ec54c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:53.303478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6abf6a-7017-4803-aeb8-cefc8f7ec54c service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:53.328237 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1574/3157] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:07:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:07:54.456138 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a45838-4bf2-4707-8a84-9b316169b6e5 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:54.457760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e3a45838-4bf2-4707-8a84-9b316169b6e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:54.475661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a45838-4bf2-4707-8a84-9b316169b6e5 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:54.517497 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e0d05-4b11-48da-86c1-29c7d567aad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:54.523117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e0d05-4b11-48da-86c1-29c7d567aad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:54.523808 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e0d05-4b11-48da-86c1-29c7d567aad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:54.524350 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e0d05-4b11-48da-86c1-29c7d567aad6 admin admin] PATH_INFO: `/v3/projects/ad9cb0ddff75492cac7a4c896e7fc99b` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:54.528619 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e0d05-4b11-48da-86c1-29c7d567aad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad9cb0ddff75492cac7a4c896e7fc99b)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:54.531111 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e0d05-4b11-48da-86c1-29c7d567aad6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:54.685710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4d3e0d05-4b11-48da-86c1-29c7d567aad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad9cb0ddff75492cac7a4c896e7fc99b', 'request_id': 'req-4d3e0d05-4b11-48da-86c1-29c7d567aad6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:54.706707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4d3e0d05-4b11-48da-86c1-29c7d567aad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad9cb0ddff75492cac7a4c896e7fc99b', 'request_id': 'req-4d3e0d05-4b11-48da-86c1-29c7d567aad6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:54.710461 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:54.716351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4d3e0d05-4b11-48da-86c1-29c7d567aad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad9cb0ddff75492cac7a4c896e7fc99b', 'request_id': 'req-4d3e0d05-4b11-48da-86c1-29c7d567aad6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:54.738539 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4d3e0d05-4b11-48da-86c1-29c7d567aad6 admin admin] The token cache is being invalidate because project ad9cb0ddff75492cac7a4c896e7fc99b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:07:54.738897 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4d3e0d05-4b11-48da-86c1-29c7d567aad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:54.739815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4d3e0d05-4b11-48da-86c1-29c7d567aad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:54.744230 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1584/3158] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:07:54 2022] DELETE /identity/v3/projects/ad9cb0ddff75492cac7a4c896e7fc99b => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:07:54.745504 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6abf6a-7017-4803-aeb8-cefc8f7ec54c service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:54.761487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6abf6a-7017-4803-aeb8-cefc8f7ec54c service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:54.835913 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:54.871600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f1d60-e21e-4a49-b561-796c29ea1735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:54.872311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f1d60-e21e-4a49-b561-796c29ea1735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:54.872587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f1d60-e21e-4a49-b561-796c29ea1735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:54.872908 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f1d60-e21e-4a49-b561-796c29ea1735 admin admin] PATH_INFO: `/v3/users/357350b979654d3faa188039ec710427` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:54.874114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f1d60-e21e-4a49-b561-796c29ea1735 admin admin] RBAC: Authorizing `identity:delete_user(user_id=357350b979654d3faa188039ec710427)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:54.876185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f1d60-e21e-4a49-b561-796c29ea1735 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:54.946094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-688f1d60-e21e-4a49-b561-796c29ea1735 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '357350b979654d3faa188039ec710427'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:54.947251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-688f1d60-e21e-4a49-b561-796c29ea1735 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '357350b979654d3faa188039ec710427'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:54.966461 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-688f1d60-e21e-4a49-b561-796c29ea1735 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '357350b979654d3faa188039ec710427'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:54.985272 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-688f1d60-e21e-4a49-b561-796c29ea1735 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '357350b979654d3faa188039ec710427'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:54.986234 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-688f1d60-e21e-4a49-b561-796c29ea1735 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '357350b979654d3faa188039ec710427'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:55.010825 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1575/3159] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:07:54 2022] DELETE /identity/v3/users/357350b979654d3faa188039ec710427 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:07:57.991752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e0d05-4b11-48da-86c1-29c7d567aad6 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:57.994666 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4d3e0d05-4b11-48da-86c1-29c7d567aad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:58.192738 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e0d05-4b11-48da-86c1-29c7d567aad6 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:58.350560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b37b0-952c-4dce-8e3f-902231a7dda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:58.351464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b37b0-952c-4dce-8e3f-902231a7dda2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:58.354303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b37b0-952c-4dce-8e3f-902231a7dda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:58.354774 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b37b0-952c-4dce-8e3f-902231a7dda2 admin admin] PATH_INFO: `/v3/projects/eeb2c809a0cb46189190ae9640b04608` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:58.357681 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b37b0-952c-4dce-8e3f-902231a7dda2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeb2c809a0cb46189190ae9640b04608)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:58.360596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b37b0-952c-4dce-8e3f-902231a7dda2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:58.451823 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-960b37b0-952c-4dce-8e3f-902231a7dda2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeb2c809a0cb46189190ae9640b04608', 'request_id': 'req-960b37b0-952c-4dce-8e3f-902231a7dda2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:58.472416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-960b37b0-952c-4dce-8e3f-902231a7dda2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeb2c809a0cb46189190ae9640b04608', 'request_id': 'req-960b37b0-952c-4dce-8e3f-902231a7dda2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:58.500969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-960b37b0-952c-4dce-8e3f-902231a7dda2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeb2c809a0cb46189190ae9640b04608', 'request_id': 'req-960b37b0-952c-4dce-8e3f-902231a7dda2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:58.528593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-960b37b0-952c-4dce-8e3f-902231a7dda2 admin admin] The token cache is being invalidate because project eeb2c809a0cb46189190ae9640b04608 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:07:58.528938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-960b37b0-952c-4dce-8e3f-902231a7dda2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:58.529678 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-960b37b0-952c-4dce-8e3f-902231a7dda2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:07:58.539671 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1585/3160] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:07:57 2022] DELETE /identity/v3/projects/eeb2c809a0cb46189190ae9640b04608 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:07:58.541202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06a7e6-144a-4c9b-8129-11948e87833d None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:58.541841 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06a7e6-144a-4c9b-8129-11948e87833d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:58.541841 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06a7e6-144a-4c9b-8129-11948e87833d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:58.602976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-7c06a7e6-144a-4c9b-8129-11948e87833d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:58.604223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7c06a7e6-144a-4c9b-8129-11948e87833d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:58.728123 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1576/3161] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:07:58.745163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ea541-da04-4885-873c-d28937c77586 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:58.745360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ea541-da04-4885-873c-d28937c77586 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:58.745698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ea541-da04-4885-873c-d28937c77586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:58.815153 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-f67ea541-da04-4885-873c-d28937c77586 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:58.819601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f67ea541-da04-4885-873c-d28937c77586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:58.829352 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1586/3162] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:07:58.834161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06a7e6-144a-4c9b-8129-11948e87833d None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:58.852110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06a7e6-144a-4c9b-8129-11948e87833d None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:58.866025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf1aa2-5d5e-4951-9a3c-befeb85c941d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:58.866618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf1aa2-5d5e-4951-9a3c-befeb85c941d admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:58.869603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf1aa2-5d5e-4951-9a3c-befeb85c941d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:58.869970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf1aa2-5d5e-4951-9a3c-befeb85c941d admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:58.870731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf1aa2-5d5e-4951-9a3c-befeb85c941d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:07:58.871107 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf1aa2-5d5e-4951-9a3c-befeb85c941d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:58.874762 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf1aa2-5d5e-4951-9a3c-befeb85c941d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:58.906666 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1577/3163] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:07:58.911649 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ea541-da04-4885-873c-d28937c77586 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:58.925470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ea541-da04-4885-873c-d28937c77586 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:58.942111 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194f244-eb93-4f4e-b45c-f739d1a1c91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:58.943688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194f244-eb93-4f4e-b45c-f739d1a1c91f admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:58.944103 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194f244-eb93-4f4e-b45c-f739d1a1c91f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:58.944767 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194f244-eb93-4f4e-b45c-f739d1a1c91f admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:58.945507 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c194f244-eb93-4f4e-b45c-f739d1a1c91f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:58.948349 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c194f244-eb93-4f4e-b45c-f739d1a1c91f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:59.044890 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1587/3164] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:07:58 2022] POST /identity/v3/projects => generated 409 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:07:59.046333 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf1aa2-5d5e-4951-9a3c-befeb85c941d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:59.060424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf1aa2-5d5e-4951-9a3c-befeb85c941d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:59.164864 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:59.225104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc52259-a3f0-4757-bc3a-b511a4aeb0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:59.225754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc52259-a3f0-4757-bc3a-b511a4aeb0b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:59.226035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc52259-a3f0-4757-bc3a-b511a4aeb0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:59.226318 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc52259-a3f0-4757-bc3a-b511a4aeb0b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:59.226964 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc52259-a3f0-4757-bc3a-b511a4aeb0b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:59.228922 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc52259-a3f0-4757-bc3a-b511a4aeb0b0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:59.294842 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1578/3165] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:07:59 2022] POST /identity/v3/users => generated 305 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:07:59.295537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194f244-eb93-4f4e-b45c-f739d1a1c91f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:59.317892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194f244-eb93-4f4e-b45c-f739d1a1c91f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:59.340178 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c64fbc-c633-4d83-89b4-3d645ebe0216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:59.341128 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c64fbc-c633-4d83-89b4-3d645ebe0216 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:59.341875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c64fbc-c633-4d83-89b4-3d645ebe0216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:59.342307 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c64fbc-c633-4d83-89b4-3d645ebe0216 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:59.343164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c64fbc-c633-4d83-89b4-3d645ebe0216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:59.348745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c64fbc-c633-4d83-89b4-3d645ebe0216 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:59.372897 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1588/3166] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:07:59.376415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc52259-a3f0-4757-bc3a-b511a4aeb0b0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:59.392598 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc52259-a3f0-4757-bc3a-b511a4aeb0b0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:59.412304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1a2cc-5a58-475e-9d92-edc1c8d06566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:59.413238 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1a2cc-5a58-475e-9d92-edc1c8d06566 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:59.413714 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1a2cc-5a58-475e-9d92-edc1c8d06566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:59.414138 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1a2cc-5a58-475e-9d92-edc1c8d06566 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:59.415155 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1a2cc-5a58-475e-9d92-edc1c8d06566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:59.429043 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1a2cc-5a58-475e-9d92-edc1c8d06566 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:59.466011 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1579/3167] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:07:59.469918 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c64fbc-c633-4d83-89b4-3d645ebe0216 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:07:59.483004 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:59.491252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c64fbc-c633-4d83-89b4-3d645ebe0216 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:07:59.500286 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1d274-261d-4dfc-8a0c-8d6a669647d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:07:59.502510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1d274-261d-4dfc-8a0c-8d6a669647d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:59.503299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1d274-261d-4dfc-8a0c-8d6a669647d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:59.503830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1d274-261d-4dfc-8a0c-8d6a669647d7 admin admin] PATH_INFO: `/v3/projects/21cc880b9ed24dc2884e3666e7022e09/users/cf073844c3a149b69108b18bcdf48d1d/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:59.527250 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1d274-261d-4dfc-8a0c-8d6a669647d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21cc880b9ed24dc2884e3666e7022e09, user_id=cf073844c3a149b69108b18bcdf48d1d, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:07:59.532472 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1d274-261d-4dfc-8a0c-8d6a669647d7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:07:59.555971 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1589/3168] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:07:59 2022] PUT /identity/v3/projects/21cc880b9ed24dc2884e3666e7022e09/users/cf073844c3a149b69108b18bcdf48d1d/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:07:59.567950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa121e-b946-4de3-a9fe-0ee330acc5e1 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:07:59.568531 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa121e-b946-4de3-a9fe-0ee330acc5e1 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:07:59.568531 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa121e-b946-4de3-a9fe-0ee330acc5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:07:59.636748 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-f4aa121e-b946-4de3-a9fe-0ee330acc5e1 None None] MFA Rules not processed for user `cf073844c3a149b69108b18bcdf48d1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:07:59.641236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f4aa121e-b946-4de3-a9fe-0ee330acc5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:07:59.876301 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1580/3169] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:07:59 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:07:59.877380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1d274-261d-4dfc-8a0c-8d6a669647d7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:00.012668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1d274-261d-4dfc-8a0c-8d6a669647d7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:00.028891 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f30dc3-c858-41af-9738-39b6f96ee43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:00.032196 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f30dc3-c858-41af-9738-39b6f96ee43e admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:00.034104 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f30dc3-c858-41af-9738-39b6f96ee43e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:00.034871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f30dc3-c858-41af-9738-39b6f96ee43e admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:00.035811 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f30dc3-c858-41af-9738-39b6f96ee43e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:00.039562 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f30dc3-c858-41af-9738-39b6f96ee43e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:00.108842 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1590/3170] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:07:59 2022] POST /identity/v3/projects => generated 409 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:08:00.111160 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa121e-b946-4de3-a9fe-0ee330acc5e1 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:00.132207 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa121e-b946-4de3-a9fe-0ee330acc5e1 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:00.265855 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768285d-652a-4990-9a7f-664fdf5342a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:00.266851 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768285d-652a-4990-9a7f-664fdf5342a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:00.267448 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768285d-652a-4990-9a7f-664fdf5342a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:00.267890 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768285d-652a-4990-9a7f-664fdf5342a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:00.270492 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768285d-652a-4990-9a7f-664fdf5342a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:00.273025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768285d-652a-4990-9a7f-664fdf5342a2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:00.318489 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1581/3171] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:08:00 2022] POST /identity/v3/users => generated 311 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:08:00.338028 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f30dc3-c858-41af-9738-39b6f96ee43e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:00.387143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f30dc3-c858-41af-9738-39b6f96ee43e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:00.413298 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d560f-7f91-461d-bf3a-348d820d4d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:00.425086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d560f-7f91-461d-bf3a-348d820d4d8b admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:00.428407 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d560f-7f91-461d-bf3a-348d820d4d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:00.428740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d560f-7f91-461d-bf3a-348d820d4d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:00.429460 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d560f-7f91-461d-bf3a-348d820d4d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:00.450094 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d560f-7f91-461d-bf3a-348d820d4d8b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:00.467317 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1591/3172] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:08:00.470308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768285d-652a-4990-9a7f-664fdf5342a2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:00.494756 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768285d-652a-4990-9a7f-664fdf5342a2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:00.516691 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba89e0-3523-45d6-b3d1-746e491a7409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:00.517378 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba89e0-3523-45d6-b3d1-746e491a7409 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:00.518929 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba89e0-3523-45d6-b3d1-746e491a7409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:00.521718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba89e0-3523-45d6-b3d1-746e491a7409 admin admin] PATH_INFO: `/v3/projects/aed1cc351c1f40fcacf535185e9407fb/users/ea88e5c8eaed46db817de73befd519f9/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:00.566242 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba89e0-3523-45d6-b3d1-746e491a7409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aed1cc351c1f40fcacf535185e9407fb, user_id=ea88e5c8eaed46db817de73befd519f9, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:00.574895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba89e0-3523-45d6-b3d1-746e491a7409 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:00.620378 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1582/3173] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:08:00 2022] PUT /identity/v3/projects/aed1cc351c1f40fcacf535185e9407fb/users/ea88e5c8eaed46db817de73befd519f9/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:08:00.622848 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d560f-7f91-461d-bf3a-348d820d4d8b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:00.640323 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d560f-7f91-461d-bf3a-348d820d4d8b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:00.850322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4ffded-88a8-4f6c-8695-c1d3324335f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:00.851099 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ffded-88a8-4f6c-8695-c1d3324335f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:00.851454 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ffded-88a8-4f6c-8695-c1d3324335f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:00.851715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ffded-88a8-4f6c-8695-c1d3324335f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:00.852599 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4ffded-88a8-4f6c-8695-c1d3324335f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:00.854539 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4ffded-88a8-4f6c-8695-c1d3324335f9 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:00.876158 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1592/3174] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:08:00.877778 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba89e0-3523-45d6-b3d1-746e491a7409 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:00.889375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba89e0-3523-45d6-b3d1-746e491a7409 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:00.907411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea2a1a-f4e0-4f7f-9862-100cd6e8aaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:00.908134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea2a1a-f4e0-4f7f-9862-100cd6e8aaf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:00.908432 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea2a1a-f4e0-4f7f-9862-100cd6e8aaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:00.908699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea2a1a-f4e0-4f7f-9862-100cd6e8aaf7 admin admin] PATH_INFO: `/v3/projects/aed1cc351c1f40fcacf535185e9407fb/users/ea88e5c8eaed46db817de73befd519f9/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:00.912725 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea2a1a-f4e0-4f7f-9862-100cd6e8aaf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aed1cc351c1f40fcacf535185e9407fb, user_id=ea88e5c8eaed46db817de73befd519f9, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:00.915595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea2a1a-f4e0-4f7f-9862-100cd6e8aaf7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:00.918202 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:08:00.945471 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1583/3175] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:08:00 2022] PUT /identity/v3/projects/aed1cc351c1f40fcacf535185e9407fb/users/ea88e5c8eaed46db817de73befd519f9/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:08:00.958894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb996e2-5c84-42c0-8dce-abebbc286656 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:00.959378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb996e2-5c84-42c0-8dce-abebbc286656 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:00.959736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb996e2-5c84-42c0-8dce-abebbc286656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:01.063871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-9fb996e2-5c84-42c0-8dce-abebbc286656 None None] MFA Rules not processed for user `ea88e5c8eaed46db817de73befd519f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:08:01.065374 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9fb996e2-5c84-42c0-8dce-abebbc286656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:01.186477 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:08:01.253639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea2a1a-f4e0-4f7f-9862-100cd6e8aaf7 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:01.256412 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1593/3176] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:08:00 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:08:01.332575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea2a1a-f4e0-4f7f-9862-100cd6e8aaf7 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:01.340350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c4b52-04d4-4c9e-ba38-c9722d1e6270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:01.342165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c4b52-04d4-4c9e-ba38-c9722d1e6270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:01.342465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c4b52-04d4-4c9e-ba38-c9722d1e6270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:01.344521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c4b52-04d4-4c9e-ba38-c9722d1e6270 admin admin] PATH_INFO: `/v3/users/cf073844c3a149b69108b18bcdf48d1d` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:01.348446 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c4b52-04d4-4c9e-ba38-c9722d1e6270 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf073844c3a149b69108b18bcdf48d1d)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:01.351310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c4b52-04d4-4c9e-ba38-c9722d1e6270 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:01.471554 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1b6c4b52-04d4-4c9e-ba38-c9722d1e6270 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf073844c3a149b69108b18bcdf48d1d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:01.472371 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1b6c4b52-04d4-4c9e-ba38-c9722d1e6270 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf073844c3a149b69108b18bcdf48d1d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:01.484886 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1b6c4b52-04d4-4c9e-ba38-c9722d1e6270 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf073844c3a149b69108b18bcdf48d1d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:01.500939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1b6c4b52-04d4-4c9e-ba38-c9722d1e6270 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf073844c3a149b69108b18bcdf48d1d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:01.501704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1b6c4b52-04d4-4c9e-ba38-c9722d1e6270 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf073844c3a149b69108b18bcdf48d1d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:01.526176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb996e2-5c84-42c0-8dce-abebbc286656 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:01.527781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9fb996e2-5c84-42c0-8dce-abebbc286656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:01.562158 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb996e2-5c84-42c0-8dce-abebbc286656 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:01.565500 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1584/3177] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:08:01 2022] DELETE /identity/v3/users/cf073844c3a149b69108b18bcdf48d1d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:08:01.569732 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879491fd-c319-4414-89af-abfca2e7d634 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:01.570683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879491fd-c319-4414-89af-abfca2e7d634 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:01.571636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879491fd-c319-4414-89af-abfca2e7d634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:01.620276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-879491fd-c319-4414-89af-abfca2e7d634 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:08:01.625681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-879491fd-c319-4414-89af-abfca2e7d634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:01.710472 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ec110-5489-4633-86a1-2ea6071d90f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:01.712190 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ec110-5489-4633-86a1-2ea6071d90f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:01.713619 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ec110-5489-4633-86a1-2ea6071d90f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:01.717849 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ec110-5489-4633-86a1-2ea6071d90f0 admin admin] PATH_INFO: `/v3/users/3965adf51d564b62a2ff36d5cad032a3` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:01.720247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ec110-5489-4633-86a1-2ea6071d90f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3965adf51d564b62a2ff36d5cad032a3)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:01.723365 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ec110-5489-4633-86a1-2ea6071d90f0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:01.783039 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1585/3178] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:08:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:08:01.794683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879491fd-c319-4414-89af-abfca2e7d634 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:01.800016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-879491fd-c319-4414-89af-abfca2e7d634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:01.852227 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:08:01.860022 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a39ec110-5489-4633-86a1-2ea6071d90f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3965adf51d564b62a2ff36d5cad032a3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:01.864419 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a39ec110-5489-4633-86a1-2ea6071d90f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3965adf51d564b62a2ff36d5cad032a3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:01.880979 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a39ec110-5489-4633-86a1-2ea6071d90f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3965adf51d564b62a2ff36d5cad032a3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:01.902481 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a39ec110-5489-4633-86a1-2ea6071d90f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3965adf51d564b62a2ff36d5cad032a3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:01.905502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a39ec110-5489-4633-86a1-2ea6071d90f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3965adf51d564b62a2ff36d5cad032a3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:01.962440 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1594/3179] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:08:01 2022] DELETE /identity/v3/users/3965adf51d564b62a2ff36d5cad032a3 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:08:01.975110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879491fd-c319-4414-89af-abfca2e7d634 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:02.047989 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c217f2-b217-4724-83eb-fe985a0c1ab2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:02.048321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c217f2-b217-4724-83eb-fe985a0c1ab2 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:02.048597 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c217f2-b217-4724-83eb-fe985a0c1ab2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:02.048867 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c217f2-b217-4724-83eb-fe985a0c1ab2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:02.051577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a7c217f2-b217-4724-83eb-fe985a0c1ab2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:02.184412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c217f2-b217-4724-83eb-fe985a0c1ab2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:02.190451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c217f2-b217-4724-83eb-fe985a0c1ab2 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:02.226384 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1586/3180] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:08:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:08:02.934083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ec110-5489-4633-86a1-2ea6071d90f0 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:02.936609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a39ec110-5489-4633-86a1-2ea6071d90f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:02.981361 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ec110-5489-4633-86a1-2ea6071d90f0 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:03.003687 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e7544c-9456-435a-a873-6a090b246172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:03.006995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7544c-9456-435a-a873-6a090b246172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:03.008172 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7544c-9456-435a-a873-6a090b246172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:03.009117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7544c-9456-435a-a873-6a090b246172 admin admin] PATH_INFO: `/v3/projects/06aea84da6f84417a4a9c42220c86d50` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:03.012574 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e7544c-9456-435a-a873-6a090b246172 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06aea84da6f84417a4a9c42220c86d50)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:03.020318 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e7544c-9456-435a-a873-6a090b246172 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:03.106912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-68e7544c-9456-435a-a873-6a090b246172 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06aea84da6f84417a4a9c42220c86d50', 'request_id': 'req-68e7544c-9456-435a-a873-6a090b246172'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:03.112147 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:08:03.126627 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-68e7544c-9456-435a-a873-6a090b246172 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06aea84da6f84417a4a9c42220c86d50', 'request_id': 'req-68e7544c-9456-435a-a873-6a090b246172'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:03.157341 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-68e7544c-9456-435a-a873-6a090b246172 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06aea84da6f84417a4a9c42220c86d50', 'request_id': 'req-68e7544c-9456-435a-a873-6a090b246172'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:03.201238 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-68e7544c-9456-435a-a873-6a090b246172 admin admin] The token cache is being invalidate because project 06aea84da6f84417a4a9c42220c86d50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:08:03.201627 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-68e7544c-9456-435a-a873-6a090b246172 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:03.212202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-68e7544c-9456-435a-a873-6a090b246172 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:03.218315 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1595/3181] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:08:02 2022] DELETE /identity/v3/projects/06aea84da6f84417a4a9c42220c86d50 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:08:03.221239 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147121d8-3b7b-4191-9a3d-2ed381d4d4d1 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:03.221753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147121d8-3b7b-4191-9a3d-2ed381d4d4d1 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:03.221857 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147121d8-3b7b-4191-9a3d-2ed381d4d4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:03.272449 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-147121d8-3b7b-4191-9a3d-2ed381d4d4d1 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:08:03.276390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-147121d8-3b7b-4191-9a3d-2ed381d4d4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:03.318404 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e7544c-9456-435a-a873-6a090b246172 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:03.320011 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-68e7544c-9456-435a-a873-6a090b246172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:03.455432 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1587/3182] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:08:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:08:03.459900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e89f5-4530-4803-9582-9ee95c81c95b None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:03.460713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e89f5-4530-4803-9582-9ee95c81c95b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:03.464391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e89f5-4530-4803-9582-9ee95c81c95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:03.499469 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:08:03.510644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e7544c-9456-435a-a873-6a090b246172 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:03.515662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-788e89f5-4530-4803-9582-9ee95c81c95b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:08:03.517182 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-788e89f5-4530-4803-9582-9ee95c81c95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:03.524855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d8265-bbb7-4684-9e92-89a13adf478c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:03.528018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d8265-bbb7-4684-9e92-89a13adf478c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:03.528491 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d8265-bbb7-4684-9e92-89a13adf478c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:03.528952 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d8265-bbb7-4684-9e92-89a13adf478c admin admin] PATH_INFO: `/v3/projects/21cc880b9ed24dc2884e3666e7022e09` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:03.532327 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d8265-bbb7-4684-9e92-89a13adf478c admin admin] RBAC: Authorizing `identity:delete_project(project_id=21cc880b9ed24dc2884e3666e7022e09)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:03.533022 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1588/3183] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:08:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:08:03.537464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d8265-bbb7-4684-9e92-89a13adf478c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:03.538259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e89f5-4530-4803-9582-9ee95c81c95b None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:03.563637 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e89f5-4530-4803-9582-9ee95c81c95b None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:03.571560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83065f56-ef14-4337-b2ed-9a8b6b878349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:03.572547 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83065f56-ef14-4337-b2ed-9a8b6b878349 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:03.572992 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83065f56-ef14-4337-b2ed-9a8b6b878349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:03.573370 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83065f56-ef14-4337-b2ed-9a8b6b878349 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:03.574224 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83065f56-ef14-4337-b2ed-9a8b6b878349 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:08:03.574744 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83065f56-ef14-4337-b2ed-9a8b6b878349 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:03.579128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83065f56-ef14-4337-b2ed-9a8b6b878349 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:03.623417 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1589/3184] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:08:03.625051 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83065f56-ef14-4337-b2ed-9a8b6b878349 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:03.639963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83065f56-ef14-4337-b2ed-9a8b6b878349 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:03.660251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad99dd-570a-4f64-be37-c942d68fd1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:03.661233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad99dd-570a-4f64-be37-c942d68fd1eb admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:03.661903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad99dd-570a-4f64-be37-c942d68fd1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:03.662755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad99dd-570a-4f64-be37-c942d68fd1eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:03.664307 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad99dd-570a-4f64-be37-c942d68fd1eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:03.667204 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8f1d8265-bbb7-4684-9e92-89a13adf478c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21cc880b9ed24dc2884e3666e7022e09', 'request_id': 'req-8f1d8265-bbb7-4684-9e92-89a13adf478c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:03.669297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad99dd-570a-4f64-be37-c942d68fd1eb admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:03.687697 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8f1d8265-bbb7-4684-9e92-89a13adf478c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21cc880b9ed24dc2884e3666e7022e09', 'request_id': 'req-8f1d8265-bbb7-4684-9e92-89a13adf478c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:03.695537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8f1d8265-bbb7-4684-9e92-89a13adf478c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21cc880b9ed24dc2884e3666e7022e09', 'request_id': 'req-8f1d8265-bbb7-4684-9e92-89a13adf478c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:03.720036 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1590/3185] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:08:03 2022] POST /identity/v3/projects => generated 399 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:08:03.721683 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8f1d8265-bbb7-4684-9e92-89a13adf478c admin admin] The token cache is being invalidate because project 21cc880b9ed24dc2884e3666e7022e09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:08:03.722095 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8f1d8265-bbb7-4684-9e92-89a13adf478c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:03.723303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8f1d8265-bbb7-4684-9e92-89a13adf478c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:03.724390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad99dd-570a-4f64-be37-c942d68fd1eb admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:03.728779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e0ad99dd-570a-4f64-be37-c942d68fd1eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:03.738749 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1596/3186] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:08:03 2022] DELETE /identity/v3/projects/21cc880b9ed24dc2884e3666e7022e09 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:08:03.745120 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d8265-bbb7-4684-9e92-89a13adf478c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:03.747731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8f1d8265-bbb7-4684-9e92-89a13adf478c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:03.895847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad99dd-570a-4f64-be37-c942d68fd1eb admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:03.901869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33a933-a017-4f48-a1da-bf1407cb3abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:03.902336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d8265-bbb7-4684-9e92-89a13adf478c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:03.903340 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33a933-a017-4f48-a1da-bf1407cb3abc admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:03.904155 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33a933-a017-4f48-a1da-bf1407cb3abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:03.904642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33a933-a017-4f48-a1da-bf1407cb3abc admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:03.905532 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c33a933-a017-4f48-a1da-bf1407cb3abc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:03.908074 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c33a933-a017-4f48-a1da-bf1407cb3abc admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:03.908865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a29ac-99ea-4c75-882c-a39c99769161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:03.909626 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a29ac-99ea-4c75-882c-a39c99769161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:03.909978 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a29ac-99ea-4c75-882c-a39c99769161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:03.910327 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a29ac-99ea-4c75-882c-a39c99769161 admin admin] PATH_INFO: `/v3/users/ea88e5c8eaed46db817de73befd519f9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:03.911954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4a29ac-99ea-4c75-882c-a39c99769161 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea88e5c8eaed46db817de73befd519f9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:03.914480 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4a29ac-99ea-4c75-882c-a39c99769161 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:03.935756 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:08:03.940012 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1591/3187] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:08:03 2022] POST /identity/v3/users => generated 300 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:08:03.946111 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33a933-a017-4f48-a1da-bf1407cb3abc admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:03.960644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33a933-a017-4f48-a1da-bf1407cb3abc admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:03.967233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ecfeb2-0cff-4217-85d3-eb5abbedb326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:03.968971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecfeb2-0cff-4217-85d3-eb5abbedb326 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:03.969357 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecfeb2-0cff-4217-85d3-eb5abbedb326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:03.969776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecfeb2-0cff-4217-85d3-eb5abbedb326 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:03.970537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ecfeb2-0cff-4217-85d3-eb5abbedb326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:03.972364 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ecfeb2-0cff-4217-85d3-eb5abbedb326 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:03.987002 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1592/3188] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:08:03.988996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ecfeb2-0cff-4217-85d3-eb5abbedb326 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:04.007776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ea4a29ac-99ea-4c75-882c-a39c99769161 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea88e5c8eaed46db817de73befd519f9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:04.009324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ea4a29ac-99ea-4c75-882c-a39c99769161 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea88e5c8eaed46db817de73befd519f9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:04.017800 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ecfeb2-0cff-4217-85d3-eb5abbedb326 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:04.020982 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ea4a29ac-99ea-4c75-882c-a39c99769161 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea88e5c8eaed46db817de73befd519f9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:04.033788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb894130-94ae-428c-ab8c-3317ae2249ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:04.034289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ea4a29ac-99ea-4c75-882c-a39c99769161 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea88e5c8eaed46db817de73befd519f9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:04.034424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb894130-94ae-428c-ab8c-3317ae2249ab admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:04.034793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb894130-94ae-428c-ab8c-3317ae2249ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:04.035078 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb894130-94ae-428c-ab8c-3317ae2249ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:04.035496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ea4a29ac-99ea-4c75-882c-a39c99769161 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea88e5c8eaed46db817de73befd519f9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:04.035900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb894130-94ae-428c-ab8c-3317ae2249ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:04.038299 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb894130-94ae-428c-ab8c-3317ae2249ab admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:04.065462 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1593/3189] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:08:04.067363 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb894130-94ae-428c-ab8c-3317ae2249ab admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:04.068201 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1597/3190] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:08:03 2022] DELETE /identity/v3/users/ea88e5c8eaed46db817de73befd519f9 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:08:04.078555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bb894130-94ae-428c-ab8c-3317ae2249ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:04.102715 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb894130-94ae-428c-ab8c-3317ae2249ab admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:04.248530 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0f9b2-d160-4d08-badc-79c5e9315d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:04.251275 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0f9b2-d160-4d08-badc-79c5e9315d36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:04.251803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0f9b2-d160-4d08-badc-79c5e9315d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:04.252318 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0f9b2-d160-4d08-badc-79c5e9315d36 admin admin] PATH_INFO: `/v3/projects/6bd7dac12a074b5a910ba30e14691939/users/a76409b5ae334b8fa88b4b089ebfa79c/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:04.276600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f0f9b2-d160-4d08-badc-79c5e9315d36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bd7dac12a074b5a910ba30e14691939, user_id=a76409b5ae334b8fa88b4b089ebfa79c, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:04.280144 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f0f9b2-d160-4d08-badc-79c5e9315d36 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:04.309193 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1594/3191] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:08:04 2022] PUT /identity/v3/projects/6bd7dac12a074b5a910ba30e14691939/users/a76409b5ae334b8fa88b4b089ebfa79c/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:08:04.315537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7c5f7-a62f-4763-8f0a-479893b90339 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:04.316715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7c5f7-a62f-4763-8f0a-479893b90339 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:04.317107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7c5f7-a62f-4763-8f0a-479893b90339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:04.364275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-bbe7c5f7-a62f-4763-8f0a-479893b90339 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:08:04.366167 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-bbe7c5f7-a62f-4763-8f0a-479893b90339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:04.568140 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1598/3192] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:08:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:08:04.638263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0f9b2-d160-4d08-badc-79c5e9315d36 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:04.640232 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-92f0f9b2-d160-4d08-badc-79c5e9315d36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:04.678709 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:08:04.874890 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0f9b2-d160-4d08-badc-79c5e9315d36 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:04.879241 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a40aef-cd50-4d8c-a1d6-1dc5213e4cb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:04.879894 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a40aef-cd50-4d8c-a1d6-1dc5213e4cb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:04.880172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a40aef-cd50-4d8c-a1d6-1dc5213e4cb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:04.880462 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a40aef-cd50-4d8c-a1d6-1dc5213e4cb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:04.914749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a40aef-cd50-4d8c-a1d6-1dc5213e4cb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:04.916227 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a40aef-cd50-4d8c-a1d6-1dc5213e4cb8 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:04.939819 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1595/3193] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:08:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:08:05.566269 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe7c5f7-a62f-4763-8f0a-479893b90339 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:05.569372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-bbe7c5f7-a62f-4763-8f0a-479893b90339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:05.591113 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe7c5f7-a62f-4763-8f0a-479893b90339 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:05.598283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53a250-a5ff-4386-b4ff-bcd8841aade0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:05.599592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53a250-a5ff-4386-b4ff-bcd8841aade0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:05.600258 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53a250-a5ff-4386-b4ff-bcd8841aade0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:05.600927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53a250-a5ff-4386-b4ff-bcd8841aade0 admin admin] PATH_INFO: `/v3/projects/aed1cc351c1f40fcacf535185e9407fb` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:05.603195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53a250-a5ff-4386-b4ff-bcd8841aade0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aed1cc351c1f40fcacf535185e9407fb)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:05.610491 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53a250-a5ff-4386-b4ff-bcd8841aade0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:05.761322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3a53a250-a5ff-4386-b4ff-bcd8841aade0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aed1cc351c1f40fcacf535185e9407fb', 'request_id': 'req-3a53a250-a5ff-4386-b4ff-bcd8841aade0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:05.798732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3a53a250-a5ff-4386-b4ff-bcd8841aade0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aed1cc351c1f40fcacf535185e9407fb', 'request_id': 'req-3a53a250-a5ff-4386-b4ff-bcd8841aade0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:05.820057 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3a53a250-a5ff-4386-b4ff-bcd8841aade0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aed1cc351c1f40fcacf535185e9407fb', 'request_id': 'req-3a53a250-a5ff-4386-b4ff-bcd8841aade0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:05.843068 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3a53a250-a5ff-4386-b4ff-bcd8841aade0 admin admin] The token cache is being invalidate because project aed1cc351c1f40fcacf535185e9407fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:08:05.843516 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3a53a250-a5ff-4386-b4ff-bcd8841aade0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:05.844508 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3a53a250-a5ff-4386-b4ff-bcd8841aade0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:05.850371 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1599/3194] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:08:05 2022] DELETE /identity/v3/projects/aed1cc351c1f40fcacf535185e9407fb => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:08:05.856952 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0c0cf-aef4-47cd-9b48-f31b355e39a0 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:05.857514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0c0cf-aef4-47cd-9b48-f31b355e39a0 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:05.857514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0c0cf-aef4-47cd-9b48-f31b355e39a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:05.918576 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-7ee0c0cf-aef4-47cd-9b48-f31b355e39a0 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:08:05.921306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7ee0c0cf-aef4-47cd-9b48-f31b355e39a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:06.080269 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1596/3195] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:08:06.081909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3c409-a661-4e7c-80f4-2dc3bd245345 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:06.082308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3c409-a661-4e7c-80f4-2dc3bd245345 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:06.082690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3c409-a661-4e7c-80f4-2dc3bd245345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:06.154522 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-33f3c409-a661-4e7c-80f4-2dc3bd245345 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:08:06.173480 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-33f3c409-a661-4e7c-80f4-2dc3bd245345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:06.187860 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1600/3196] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:08:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:08:06.189686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0c0cf-aef4-47cd-9b48-f31b355e39a0 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:06.200128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0c0cf-aef4-47cd-9b48-f31b355e39a0 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:06.230159 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e8a27-b203-494e-82fe-9c8a3fcce05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:06.231349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e8a27-b203-494e-82fe-9c8a3fcce05f admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:06.231783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e8a27-b203-494e-82fe-9c8a3fcce05f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:06.232229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e8a27-b203-494e-82fe-9c8a3fcce05f admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:06.233800 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e8a27-b203-494e-82fe-9c8a3fcce05f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:08:06.234355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e8a27-b203-494e-82fe-9c8a3fcce05f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:06.245395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e8a27-b203-494e-82fe-9c8a3fcce05f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:06.285837 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3c409-a661-4e7c-80f4-2dc3bd245345 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:06.291980 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1597/3197] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:08:06.294402 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:08:06.307390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3c409-a661-4e7c-80f4-2dc3bd245345 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:06.346130 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0ff97-f10d-4163-82b4-4f029dc9bdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:06.346766 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0ff97-f10d-4163-82b4-4f029dc9bdfb admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:06.347049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0ff97-f10d-4163-82b4-4f029dc9bdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:06.351244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0ff97-f10d-4163-82b4-4f029dc9bdfb admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:06.356402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa0ff97-f10d-4163-82b4-4f029dc9bdfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:06.367250 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa0ff97-f10d-4163-82b4-4f029dc9bdfb admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:06.526374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e8a27-b203-494e-82fe-9c8a3fcce05f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:06.528413 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-511e8a27-b203-494e-82fe-9c8a3fcce05f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:06.532226 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1601/3198] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:08:06 2022] POST /identity/v3/projects => generated 379 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:08:06.535106 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0ff97-f10d-4163-82b4-4f029dc9bdfb admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:06.706336 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e8a27-b203-494e-82fe-9c8a3fcce05f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:06.732651 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0ff97-f10d-4163-82b4-4f029dc9bdfb admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:06.746201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58eb6da-1bb6-4c90-98cf-c68cc360e5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:06.747113 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58eb6da-1bb6-4c90-98cf-c68cc360e5c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:06.747290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58eb6da-1bb6-4c90-98cf-c68cc360e5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:06.747704 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58eb6da-1bb6-4c90-98cf-c68cc360e5c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:06.748353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58eb6da-1bb6-4c90-98cf-c68cc360e5c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:06.752116 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58eb6da-1bb6-4c90-98cf-c68cc360e5c7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:06.796360 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1602/3199] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:08:06 2022] POST /identity/v3/users => generated 290 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:08:06.797630 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58eb6da-1bb6-4c90-98cf-c68cc360e5c7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:06.809684 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58eb6da-1bb6-4c90-98cf-c68cc360e5c7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:06.816758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e230b-eba1-44a1-aeae-79d5512b0034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:06.817913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e230b-eba1-44a1-aeae-79d5512b0034 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:06.818424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e230b-eba1-44a1-aeae-79d5512b0034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:06.818943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e230b-eba1-44a1-aeae-79d5512b0034 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:06.819964 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e230b-eba1-44a1-aeae-79d5512b0034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:06.821867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e230b-eba1-44a1-aeae-79d5512b0034 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:06.906256 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1603/3200] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:08:06.906256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e230b-eba1-44a1-aeae-79d5512b0034 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:06.906256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e230b-eba1-44a1-aeae-79d5512b0034 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:06.908520 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a30c4-d099-4f4d-ad5a-143855cd0fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:06.909246 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a30c4-d099-4f4d-ad5a-143855cd0fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:06.909855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a30c4-d099-4f4d-ad5a-143855cd0fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:06.910200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a30c4-d099-4f4d-ad5a-143855cd0fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:06.910980 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a30c4-d099-4f4d-ad5a-143855cd0fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:06.912854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a30c4-d099-4f4d-ad5a-143855cd0fb8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:06.915442 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:08:06.944807 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1604/3201] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:08:06.945878 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a30c4-d099-4f4d-ad5a-143855cd0fb8 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:06.956084 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2255a6c-73b6-4154-9172-902eb4374640 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:06.958757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2255a6c-73b6-4154-9172-902eb4374640 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:06.959849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2255a6c-73b6-4154-9172-902eb4374640 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:06.959849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2255a6c-73b6-4154-9172-902eb4374640 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:06.961764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c2255a6c-73b6-4154-9172-902eb4374640 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:06.981193 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a30c4-d099-4f4d-ad5a-143855cd0fb8 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:07.012551 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f032954-753d-4efc-90b6-c27fdb3e775f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:07.013484 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f032954-753d-4efc-90b6-c27fdb3e775f admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:07.018984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f032954-753d-4efc-90b6-c27fdb3e775f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:07.019268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f032954-753d-4efc-90b6-c27fdb3e775f admin admin] PATH_INFO: `/v3/projects/138f6e224496479281ee3310218cacfe/users/3e0ec915d71a47a5b374ae742c1ca93f/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:07.048252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f032954-753d-4efc-90b6-c27fdb3e775f admin admin] RBAC: Authorizing `identity:create_grant(project_id=138f6e224496479281ee3310218cacfe, user_id=3e0ec915d71a47a5b374ae742c1ca93f, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:07.052279 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f032954-753d-4efc-90b6-c27fdb3e775f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:07.093742 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2255a6c-73b6-4154-9172-902eb4374640 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:07.094630 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1605/3202] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:08:06 2022] PUT /identity/v3/projects/138f6e224496479281ee3310218cacfe/users/3e0ec915d71a47a5b374ae742c1ca93f/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:08:07.096832 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2255a6c-73b6-4154-9172-902eb4374640 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:07.118470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26308b-7d65-4d4d-ad7f-4ec434d51a20 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:07.119496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26308b-7d65-4d4d-ad7f-4ec434d51a20 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:07.120587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26308b-7d65-4d4d-ad7f-4ec434d51a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:07.128135 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1598/3203] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:08:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:08:07.214541 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-7c26308b-7d65-4d4d-ad7f-4ec434d51a20 None None] MFA Rules not processed for user `3e0ec915d71a47a5b374ae742c1ca93f`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:08:07.222257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7c26308b-7d65-4d4d-ad7f-4ec434d51a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:07.432660 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1606/3204] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:08:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:08:07.874162 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2255a6c-73b6-4154-9172-902eb4374640 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:07.875741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c2255a6c-73b6-4154-9172-902eb4374640 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:07.900418 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2255a6c-73b6-4154-9172-902eb4374640 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:08.064157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3bbf77-26ec-46a4-8dd4-f40684336d43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:08.065082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bbf77-26ec-46a4-8dd4-f40684336d43 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:08.065601 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bbf77-26ec-46a4-8dd4-f40684336d43 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:08.066088 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bbf77-26ec-46a4-8dd4-f40684336d43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:08.084099 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3bbf77-26ec-46a4-8dd4-f40684336d43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:08.086393 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3bbf77-26ec-46a4-8dd4-f40684336d43 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:08.101127 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1599/3205] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:08:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:08:08.393058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e4a1a-413f-4505-b517-37efa90cf54f None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:08.393538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e4a1a-413f-4505-b517-37efa90cf54f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:08.393913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e4a1a-413f-4505-b517-37efa90cf54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:08.429664 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:08:08.445609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a25e4a1a-413f-4505-b517-37efa90cf54f None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:08:08.453290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a25e4a1a-413f-4505-b517-37efa90cf54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:08.494624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6f9ea-2994-4062-b6e5-21a6a657cd26 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:08.495184 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6f9ea-2994-4062-b6e5-21a6a657cd26 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:08.495652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6f9ea-2994-4062-b6e5-21a6a657cd26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:08.535919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-dfb6f9ea-2994-4062-b6e5-21a6a657cd26 None None] MFA Rules not processed for user `575bb87368454c08a703e99526e6f00c`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:08:08.537670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-dfb6f9ea-2994-4062-b6e5-21a6a657cd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:08.554662 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1607/3206] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:08:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:08:08.662914 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e4a1a-413f-4505-b517-37efa90cf54f None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:08.664712 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a25e4a1a-413f-4505-b517-37efa90cf54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:08.669779 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:08:08.700729 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1600/3207] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:08:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:08:08.715861 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff806c8-8fda-4e95-89ca-d654d5c8144b None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:08.716153 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff806c8-8fda-4e95-89ca-d654d5c8144b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:08.716443 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff806c8-8fda-4e95-89ca-d654d5c8144b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:08.770457 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-2ff806c8-8fda-4e95-89ca-d654d5c8144b None None] MFA Rules not processed for user `575bb87368454c08a703e99526e6f00c`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:08:08.771700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2ff806c8-8fda-4e95-89ca-d654d5c8144b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:08.792773 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1601/3208] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:08:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:08:08.805737 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff806c8-8fda-4e95-89ca-d654d5c8144b None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:08.824890 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff806c8-8fda-4e95-89ca-d654d5c8144b None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:08.851824 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf43a5-7e13-403c-b511-595aa040f01a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:08.852459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf43a5-7e13-403c-b511-595aa040f01a service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:08.852739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf43a5-7e13-403c-b511-595aa040f01a service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:08.853010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf43a5-7e13-403c-b511-595aa040f01a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:08.863941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e4a1a-413f-4505-b517-37efa90cf54f None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:08.877722 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf43a5-7e13-403c-b511-595aa040f01a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:08.880938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf43a5-7e13-403c-b511-595aa040f01a service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:08.886267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec811a-46bd-485d-aff5-47a059829176 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:08.886904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec811a-46bd-485d-aff5-47a059829176 service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:08.887183 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec811a-46bd-485d-aff5-47a059829176 service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:08.887457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec811a-46bd-485d-aff5-47a059829176 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:08.896569 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1602/3209] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:08:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:08:08.897171 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec811a-46bd-485d-aff5-47a059829176 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:08.898988 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec811a-46bd-485d-aff5-47a059829176 service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:08.936362 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1608/3210] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:08:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:08:09.092800 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d71ba-3f94-4e4b-9274-f6e26e7f0b4b None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:09.093326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d71ba-3f94-4e4b-9274-f6e26e7f0b4b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:09.093326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d71ba-3f94-4e4b-9274-f6e26e7f0b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:09.152225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-173d71ba-3f94-4e4b-9274-f6e26e7f0b4b None None] MFA Rules not processed for user `3e0ec915d71a47a5b374ae742c1ca93f`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:08:09.153478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-173d71ba-3f94-4e4b-9274-f6e26e7f0b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:09.172083 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1603/3211] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:08:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:08:10.235074 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf3e58-9c80-4993-91b9-4bceb99710ac None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:10.235899 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf3e58-9c80-4993-91b9-4bceb99710ac None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:10.236341 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf3e58-9c80-4993-91b9-4bceb99710ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:10.286790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-66cf3e58-9c80-4993-91b9-4bceb99710ac None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:08:10.288062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-66cf3e58-9c80-4993-91b9-4bceb99710ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:10.316871 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1609/3212] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 01:08:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:08:10.336772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d71ba-3f94-4e4b-9274-f6e26e7f0b4b None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:10.350752 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d71ba-3f94-4e4b-9274-f6e26e7f0b4b None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:10.365403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203258cc-fa2e-4109-bd87-39e9486e54ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:10.366492 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203258cc-fa2e-4109-bd87-39e9486e54ad service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:10.366831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203258cc-fa2e-4109-bd87-39e9486e54ad service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:10.367183 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203258cc-fa2e-4109-bd87-39e9486e54ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:10.404670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203258cc-fa2e-4109-bd87-39e9486e54ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:10.407029 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203258cc-fa2e-4109-bd87-39e9486e54ad service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:10.430682 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1604/3213] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:08:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 04 01:08:10.618853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf3e58-9c80-4993-91b9-4bceb99710ac None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:10.800579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf3e58-9c80-4993-91b9-4bceb99710ac None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:10.814499 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238c7a1-6f86-4fd9-b796-40d28bdb5a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:10.816439 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238c7a1-6f86-4fd9-b796-40d28bdb5a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:10.834021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238c7a1-6f86-4fd9-b796-40d28bdb5a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:10.834492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238c7a1-6f86-4fd9-b796-40d28bdb5a66 admin admin] PATH_INFO: `/v3/users/3e0ec915d71a47a5b374ae742c1ca93f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:10.836170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238c7a1-6f86-4fd9-b796-40d28bdb5a66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e0ec915d71a47a5b374ae742c1ca93f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:10.838376 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238c7a1-6f86-4fd9-b796-40d28bdb5a66 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:10.956375 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:08:10.976112 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9238c7a1-6f86-4fd9-b796-40d28bdb5a66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e0ec915d71a47a5b374ae742c1ca93f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:10.978520 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9238c7a1-6f86-4fd9-b796-40d28bdb5a66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e0ec915d71a47a5b374ae742c1ca93f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:10.993469 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9238c7a1-6f86-4fd9-b796-40d28bdb5a66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e0ec915d71a47a5b374ae742c1ca93f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:11.006647 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9238c7a1-6f86-4fd9-b796-40d28bdb5a66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e0ec915d71a47a5b374ae742c1ca93f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:11.007643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9238c7a1-6f86-4fd9-b796-40d28bdb5a66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e0ec915d71a47a5b374ae742c1ca93f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:11.118509 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1610/3214] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:08:10 2022] DELETE /identity/v3/users/3e0ec915d71a47a5b374ae742c1ca93f => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:08:11.120608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe3554-091c-4b0f-a843-54af1c1d693f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:11.121181 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe3554-091c-4b0f-a843-54af1c1d693f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:11.121618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe3554-091c-4b0f-a843-54af1c1d693f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:11.163991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-27fe3554-091c-4b0f-a843-54af1c1d693f None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:08:11.168702 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-27fe3554-091c-4b0f-a843-54af1c1d693f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:11.362123 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1605/3215] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:08:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:08:11.500780 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238c7a1-6f86-4fd9-b796-40d28bdb5a66 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:11.503900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9238c7a1-6f86-4fd9-b796-40d28bdb5a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:11.626608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe3554-091c-4b0f-a843-54af1c1d693f None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:11.630782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-27fe3554-091c-4b0f-a843-54af1c1d693f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:11.706272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238c7a1-6f86-4fd9-b796-40d28bdb5a66 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:11.725754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b784cf03-9a6a-4c3a-9938-760a1aebf203 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:11.726400 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784cf03-9a6a-4c3a-9938-760a1aebf203 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:11.726680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784cf03-9a6a-4c3a-9938-760a1aebf203 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:11.726951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784cf03-9a6a-4c3a-9938-760a1aebf203 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:11.739772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b784cf03-9a6a-4c3a-9938-760a1aebf203 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:11.741503 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b784cf03-9a6a-4c3a-9938-760a1aebf203 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:11.754167 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1611/3216] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:08:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:08:11.911338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe3554-091c-4b0f-a843-54af1c1d693f None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:11.917007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250994d-5096-4129-8978-e89d7c6f460e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:11.917919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250994d-5096-4129-8978-e89d7c6f460e service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:11.918387 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250994d-5096-4129-8978-e89d7c6f460e service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:11.918792 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250994d-5096-4129-8978-e89d7c6f460e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:11.921850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7250994d-5096-4129-8978-e89d7c6f460e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:11.937792 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250994d-5096-4129-8978-e89d7c6f460e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:11.943391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250994d-5096-4129-8978-e89d7c6f460e service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:11.956493 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1606/3217] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:08:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:08:14.526105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b784cf03-9a6a-4c3a-9938-760a1aebf203 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:14.528323 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b784cf03-9a6a-4c3a-9938-760a1aebf203 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:14.544781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b784cf03-9a6a-4c3a-9938-760a1aebf203 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:14.550337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e02910-fb2e-435b-8e1b-935fa358de26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:14.551309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e02910-fb2e-435b-8e1b-935fa358de26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:14.551786 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e02910-fb2e-435b-8e1b-935fa358de26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:14.552254 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e02910-fb2e-435b-8e1b-935fa358de26 admin admin] PATH_INFO: `/v3/projects/138f6e224496479281ee3310218cacfe` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:14.553604 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e02910-fb2e-435b-8e1b-935fa358de26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=138f6e224496479281ee3310218cacfe)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:14.556146 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e02910-fb2e-435b-8e1b-935fa358de26 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:14.672293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d1e02910-fb2e-435b-8e1b-935fa358de26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '138f6e224496479281ee3310218cacfe', 'request_id': 'req-d1e02910-fb2e-435b-8e1b-935fa358de26'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:14.692784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d1e02910-fb2e-435b-8e1b-935fa358de26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '138f6e224496479281ee3310218cacfe', 'request_id': 'req-d1e02910-fb2e-435b-8e1b-935fa358de26'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:14.703093 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d1e02910-fb2e-435b-8e1b-935fa358de26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '138f6e224496479281ee3310218cacfe', 'request_id': 'req-d1e02910-fb2e-435b-8e1b-935fa358de26'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:14.736198 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d1e02910-fb2e-435b-8e1b-935fa358de26 admin admin] The token cache is being invalidate because project 138f6e224496479281ee3310218cacfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:08:14.736565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d1e02910-fb2e-435b-8e1b-935fa358de26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:14.737703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d1e02910-fb2e-435b-8e1b-935fa358de26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:14.739796 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1612/3218] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:08:14 2022] DELETE /identity/v3/projects/138f6e224496479281ee3310218cacfe => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:08:14.745144 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405af41-bbe0-4daf-983c-a238174236bd None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:14.745984 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405af41-bbe0-4daf-983c-a238174236bd None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:14.746394 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405af41-bbe0-4daf-983c-a238174236bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:14.793184 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-8405af41-bbe0-4daf-983c-a238174236bd None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:08:14.794937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8405af41-bbe0-4daf-983c-a238174236bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:14.819545 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:08:14.947758 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1607/3219] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:08:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:08:14.955958 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fa7da-8b6c-4674-a499-f6cd40899297 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:14.956919 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fa7da-8b6c-4674-a499-f6cd40899297 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:14.957329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fa7da-8b6c-4674-a499-f6cd40899297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:15.000581 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ff7fa7da-8b6c-4674-a499-f6cd40899297 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:08:15.003417 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ff7fa7da-8b6c-4674-a499-f6cd40899297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:15.013571 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1613/3220] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:08:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:08:15.018205 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405af41-bbe0-4daf-983c-a238174236bd None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:15.031687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405af41-bbe0-4daf-983c-a238174236bd None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:15.043667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b923c-35a7-4660-8093-417801c04742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:15.046008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b923c-35a7-4660-8093-417801c04742 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:15.047126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b923c-35a7-4660-8093-417801c04742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:15.048066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b923c-35a7-4660-8093-417801c04742 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:15.049337 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b923c-35a7-4660-8093-417801c04742 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:08:15.049929 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b923c-35a7-4660-8093-417801c04742 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:15.051750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b923c-35a7-4660-8093-417801c04742 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:15.072759 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1608/3221] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:08:15.077754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7fa7da-8b6c-4674-a499-f6cd40899297 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:15.092703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7fa7da-8b6c-4674-a499-f6cd40899297 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:15.135886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a4341-09f3-4456-ac0d-c57f4af044fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:15.136836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a4341-09f3-4456-ac0d-c57f4af044fa admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:15.137332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a4341-09f3-4456-ac0d-c57f4af044fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:15.138141 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a4341-09f3-4456-ac0d-c57f4af044fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:15.139983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a4341-09f3-4456-ac0d-c57f4af044fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:15.146450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a4341-09f3-4456-ac0d-c57f4af044fa admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:15.211277 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1614/3222] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:08:15 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:08:15.215743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b923c-35a7-4660-8093-417801c04742 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:15.235098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b923c-35a7-4660-8093-417801c04742 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:15.393220 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815a2fe-ef68-4998-bfa2-7bb93631ba3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:15.394017 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815a2fe-ef68-4998-bfa2-7bb93631ba3f admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:15.394408 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815a2fe-ef68-4998-bfa2-7bb93631ba3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:15.394798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815a2fe-ef68-4998-bfa2-7bb93631ba3f admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:15.395564 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815a2fe-ef68-4998-bfa2-7bb93631ba3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:15.398505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815a2fe-ef68-4998-bfa2-7bb93631ba3f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:15.460236 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1609/3223] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:08:15 2022] POST /identity/v3/users => generated 293 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:08:15.464039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a4341-09f3-4456-ac0d-c57f4af044fa admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:15.481679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a4341-09f3-4456-ac0d-c57f4af044fa admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:15.501858 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b259a-985d-4593-a570-d67a63bcab29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:15.504278 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b259a-985d-4593-a570-d67a63bcab29 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:15.504278 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b259a-985d-4593-a570-d67a63bcab29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:15.504278 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b259a-985d-4593-a570-d67a63bcab29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:15.510677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58b259a-985d-4593-a570-d67a63bcab29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:15.513531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58b259a-985d-4593-a570-d67a63bcab29 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:15.534187 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:08:15.560147 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1615/3224] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:08:15.566397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815a2fe-ef68-4998-bfa2-7bb93631ba3f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:15.585255 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815a2fe-ef68-4998-bfa2-7bb93631ba3f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:15.604173 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74491a8d-fbb5-4488-9196-1bcd3f0286a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:15.604839 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74491a8d-fbb5-4488-9196-1bcd3f0286a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:15.605361 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74491a8d-fbb5-4488-9196-1bcd3f0286a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:15.609914 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74491a8d-fbb5-4488-9196-1bcd3f0286a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:15.610621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74491a8d-fbb5-4488-9196-1bcd3f0286a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:15.619361 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74491a8d-fbb5-4488-9196-1bcd3f0286a3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:15.664812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b259a-985d-4593-a570-d67a63bcab29 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:15.665582 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1610/3225] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:08:15.686533 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b259a-985d-4593-a570-d67a63bcab29 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:15.703382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58a8c5-666e-43f4-ae26-3d386463f631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:15.704071 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58a8c5-666e-43f4-ae26-3d386463f631 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:15.705749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58a8c5-666e-43f4-ae26-3d386463f631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:15.706326 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58a8c5-666e-43f4-ae26-3d386463f631 admin admin] PATH_INFO: `/v3/projects/0c00fd890a8a4f19a94c4af317ec7899/users/c76b3aab50ca4e8d8f890f0745b5c8e0/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:15.759940 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58a8c5-666e-43f4-ae26-3d386463f631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c00fd890a8a4f19a94c4af317ec7899, user_id=c76b3aab50ca4e8d8f890f0745b5c8e0, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:15.762646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58a8c5-666e-43f4-ae26-3d386463f631 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:15.828518 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2fcea-53a5-4200-8c51-073832d66232 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:15.829528 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2fcea-53a5-4200-8c51-073832d66232 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:15.829935 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2fcea-53a5-4200-8c51-073832d66232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:15.837027 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1616/3226] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:08:15 2022] PUT /identity/v3/projects/0c00fd890a8a4f19a94c4af317ec7899/users/c76b3aab50ca4e8d8f890f0745b5c8e0/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:08:15.871288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-34a2fcea-53a5-4200-8c51-073832d66232 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:08:15.872519 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-34a2fcea-53a5-4200-8c51-073832d66232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:16.041523 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1611/3227] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:08:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:08:16.075465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58a8c5-666e-43f4-ae26-3d386463f631 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:16.078058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8f58a8c5-666e-43f4-ae26-3d386463f631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:16.219915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58a8c5-666e-43f4-ae26-3d386463f631 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:16.243953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f8dc0-f00e-46b8-ab1f-4474a1ee1424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:16.244590 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f8dc0-f00e-46b8-ab1f-4474a1ee1424 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:16.244873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f8dc0-f00e-46b8-ab1f-4474a1ee1424 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:16.245679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f8dc0-f00e-46b8-ab1f-4474a1ee1424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:16.272788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f8dc0-f00e-46b8-ab1f-4474a1ee1424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:16.276949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f8dc0-f00e-46b8-ab1f-4474a1ee1424 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:16.294769 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1617/3228] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:08:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:08:22.267453 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2fcea-53a5-4200-8c51-073832d66232 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:22.271601 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-34a2fcea-53a5-4200-8c51-073832d66232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:22.354507 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:08:22.432050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46713f11-a223-40f8-b783-2e2db8524d34 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:22.432447 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46713f11-a223-40f8-b783-2e2db8524d34 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:22.432956 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46713f11-a223-40f8-b783-2e2db8524d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:22.590388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2fcea-53a5-4200-8c51-073832d66232 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:22.597177 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-46713f11-a223-40f8-b783-2e2db8524d34 None None] MFA Rules not processed for user `a76409b5ae334b8fa88b4b089ebfa79c`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:08:22.604204 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-46713f11-a223-40f8-b783-2e2db8524d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:22.614220 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311a6bf-4a76-4ee6-a883-6512499d3712 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:22.615417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311a6bf-4a76-4ee6-a883-6512499d3712 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:22.617196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311a6bf-4a76-4ee6-a883-6512499d3712 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:22.617659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311a6bf-4a76-4ee6-a883-6512499d3712 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:22.620535 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e311a6bf-4a76-4ee6-a883-6512499d3712 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:22.690349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311a6bf-4a76-4ee6-a883-6512499d3712 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:22.692774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311a6bf-4a76-4ee6-a883-6512499d3712 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:22.725336 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1612/3229] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:08:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:08:22.839470 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1618/3230] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:08:22 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:08:22.851128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e45e2-1a1d-4df8-a84f-5b58cfde6186 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:22.851440 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e45e2-1a1d-4df8-a84f-5b58cfde6186 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:22.851740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e45e2-1a1d-4df8-a84f-5b58cfde6186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:22.943763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b97e45e2-1a1d-4df8-a84f-5b58cfde6186 None None] MFA Rules not processed for user `a76409b5ae334b8fa88b4b089ebfa79c`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:08:22.958708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b97e45e2-1a1d-4df8-a84f-5b58cfde6186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:23.007187 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1613/3231] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:08:22 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:08:23.478438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46713f11-a223-40f8-b783-2e2db8524d34 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:23.480577 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-46713f11-a223-40f8-b783-2e2db8524d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:23.709256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46713f11-a223-40f8-b783-2e2db8524d34 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:23.744237 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9227994-7d43-424a-ba09-e2a625940062 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:23.745035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9227994-7d43-424a-ba09-e2a625940062 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:23.745318 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9227994-7d43-424a-ba09-e2a625940062 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:23.745624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9227994-7d43-424a-ba09-e2a625940062 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:23.783713 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:08:23.790410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9227994-7d43-424a-ba09-e2a625940062 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:23.797104 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9227994-7d43-424a-ba09-e2a625940062 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:23.833386 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1619/3232] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:08:23 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:08:28.687954 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b962178-56e4-4804-af33-604aa55380f3 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:28.688826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b962178-56e4-4804-af33-604aa55380f3 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:28.689297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b962178-56e4-4804-af33-604aa55380f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:28.732935 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-8b962178-56e4-4804-af33-604aa55380f3 None None] MFA Rules not processed for user `575bb87368454c08a703e99526e6f00c`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:08:28.734707 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8b962178-56e4-4804-af33-604aa55380f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:28.901871 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1614/3233] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:08:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:08:32.289244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7eeced-7ad0-444c-a65f-eee091a854a9 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:32.289808 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7eeced-7ad0-444c-a65f-eee091a854a9 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:32.289923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7eeced-7ad0-444c-a65f-eee091a854a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:32.354766 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-5b7eeced-7ad0-444c-a65f-eee091a854a9 None None] MFA Rules not processed for user `c76b3aab50ca4e8d8f890f0745b5c8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:08:32.358581 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5b7eeced-7ad0-444c-a65f-eee091a854a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:32.582557 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1620/3234] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:08:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:08:32.928433 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b962178-56e4-4804-af33-604aa55380f3 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:33.001690 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b962178-56e4-4804-af33-604aa55380f3 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:33.018364 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96918cc1-c7fa-406c-85bc-e7c83fd5dea0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:33.019751 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96918cc1-c7fa-406c-85bc-e7c83fd5dea0 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:33.021632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96918cc1-c7fa-406c-85bc-e7c83fd5dea0 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:33.023152 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96918cc1-c7fa-406c-85bc-e7c83fd5dea0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:33.044005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96918cc1-c7fa-406c-85bc-e7c83fd5dea0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:33.049556 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96918cc1-c7fa-406c-85bc-e7c83fd5dea0 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:33.058871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7eeced-7ad0-444c-a65f-eee091a854a9 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:33.060620 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5b7eeced-7ad0-444c-a65f-eee091a854a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:33.072940 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1615/3235] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:08:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:08:33.077706 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7eeced-7ad0-444c-a65f-eee091a854a9 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:33.086076 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf0fa2-1fc3-4f25-99ef-f905914a74fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:33.086695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf0fa2-1fc3-4f25-99ef-f905914a74fb service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:33.086971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf0fa2-1fc3-4f25-99ef-f905914a74fb service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:33.088602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf0fa2-1fc3-4f25-99ef-f905914a74fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:33.089057 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5ccf0fa2-1fc3-4f25-99ef-f905914a74fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:33.103059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf0fa2-1fc3-4f25-99ef-f905914a74fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:33.105115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf0fa2-1fc3-4f25-99ef-f905914a74fb service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:33.119221 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1621/3236] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:08:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:08:34.067482 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291bea7-97c6-443c-a1c2-d68391b10eb6 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:34.067937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291bea7-97c6-443c-a1c2-d68391b10eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:34.068009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291bea7-97c6-443c-a1c2-d68391b10eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:34.107441 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-4291bea7-97c6-443c-a1c2-d68391b10eb6 None None] MFA Rules not processed for user `575bb87368454c08a703e99526e6f00c`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:08:34.109550 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4291bea7-97c6-443c-a1c2-d68391b10eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:34.135280 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1616/3237] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:08:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:08:38.553334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf0fa2-1fc3-4f25-99ef-f905914a74fb service placement] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:38.555631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5ccf0fa2-1fc3-4f25-99ef-f905914a74fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:38.799730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf0fa2-1fc3-4f25-99ef-f905914a74fb service placement] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:38.809313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7c2af-673e-47d3-8565-47b8e5f29ffc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:38.812311 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7c2af-673e-47d3-8565-47b8e5f29ffc service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:38.813030 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7c2af-673e-47d3-8565-47b8e5f29ffc service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:38.813700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7c2af-673e-47d3-8565-47b8e5f29ffc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:38.823749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a4e7c2af-673e-47d3-8565-47b8e5f29ffc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:39.003672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e7c2af-673e-47d3-8565-47b8e5f29ffc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:39.008602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e7c2af-673e-47d3-8565-47b8e5f29ffc service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:39.025203 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:08:39.045046 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1622/3238] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:08:38 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:08:41.624415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291bea7-97c6-443c-a1c2-d68391b10eb6 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:41.627389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4291bea7-97c6-443c-a1c2-d68391b10eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:41.718694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291bea7-97c6-443c-a1c2-d68391b10eb6 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:41.724617 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84fcf14-7e24-4239-96ee-521140dbf300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:41.725530 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84fcf14-7e24-4239-96ee-521140dbf300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:41.726013 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84fcf14-7e24-4239-96ee-521140dbf300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:41.727064 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84fcf14-7e24-4239-96ee-521140dbf300 admin admin] PATH_INFO: `/v3/users/b83fa471d05144b6897fe6a74fc5d141` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:41.734849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84fcf14-7e24-4239-96ee-521140dbf300 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b83fa471d05144b6897fe6a74fc5d141)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:41.737417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84fcf14-7e24-4239-96ee-521140dbf300 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:41.815048 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b84fcf14-7e24-4239-96ee-521140dbf300 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b83fa471d05144b6897fe6a74fc5d141'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:41.816273 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b84fcf14-7e24-4239-96ee-521140dbf300 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b83fa471d05144b6897fe6a74fc5d141'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:41.819608 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:08:41.838660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b84fcf14-7e24-4239-96ee-521140dbf300 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b83fa471d05144b6897fe6a74fc5d141'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:41.852569 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b84fcf14-7e24-4239-96ee-521140dbf300 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b83fa471d05144b6897fe6a74fc5d141'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:41.853344 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b84fcf14-7e24-4239-96ee-521140dbf300 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b83fa471d05144b6897fe6a74fc5d141'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:41.882035 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1617/3239] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:08:41 2022] DELETE /identity/v3/users/b83fa471d05144b6897fe6a74fc5d141 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:08:42.237890 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7c2af-673e-47d3-8565-47b8e5f29ffc service cinder] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:42.270869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7c2af-673e-47d3-8565-47b8e5f29ffc service cinder] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:42.354566 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51d311-3f3e-42a9-9f20-5696bfadc7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:42.355392 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51d311-3f3e-42a9-9f20-5696bfadc7ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:42.355751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51d311-3f3e-42a9-9f20-5696bfadc7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:42.357606 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51d311-3f3e-42a9-9f20-5696bfadc7ad admin admin] PATH_INFO: `/v3/projects/2d05779d1e4745cf9bc7e9dec46fb329` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:42.359746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51d311-3f3e-42a9-9f20-5696bfadc7ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d05779d1e4745cf9bc7e9dec46fb329)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:42.361824 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51d311-3f3e-42a9-9f20-5696bfadc7ad admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:42.432250 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6d51d311-3f3e-42a9-9f20-5696bfadc7ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d05779d1e4745cf9bc7e9dec46fb329', 'request_id': 'req-6d51d311-3f3e-42a9-9f20-5696bfadc7ad'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:42.449083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6d51d311-3f3e-42a9-9f20-5696bfadc7ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d05779d1e4745cf9bc7e9dec46fb329', 'request_id': 'req-6d51d311-3f3e-42a9-9f20-5696bfadc7ad'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:42.461787 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6d51d311-3f3e-42a9-9f20-5696bfadc7ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d05779d1e4745cf9bc7e9dec46fb329', 'request_id': 'req-6d51d311-3f3e-42a9-9f20-5696bfadc7ad'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:42.476982 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6d51d311-3f3e-42a9-9f20-5696bfadc7ad admin admin] The token cache is being invalidate because project 2d05779d1e4745cf9bc7e9dec46fb329 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:08:42.477367 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6d51d311-3f3e-42a9-9f20-5696bfadc7ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:42.478224 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6d51d311-3f3e-42a9-9f20-5696bfadc7ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:08:42.480275 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1623/3240] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:08:42 2022] DELETE /identity/v3/projects/2d05779d1e4745cf9bc7e9dec46fb329 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:08:42.484990 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b8759-a390-4775-a5a0-b3f40285effb None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:42.485273 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b8759-a390-4775-a5a0-b3f40285effb None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:42.485570 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b8759-a390-4775-a5a0-b3f40285effb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:42.550023 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b70b8759-a390-4775-a5a0-b3f40285effb None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:08:42.551256 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b70b8759-a390-4775-a5a0-b3f40285effb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:42.657939 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1618/3241] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:08:42.667653 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab615063-986d-4e06-9e69-7a59db5e0ee9 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:42.667866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab615063-986d-4e06-9e69-7a59db5e0ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:42.668386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab615063-986d-4e06-9e69-7a59db5e0ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:42.694986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ab615063-986d-4e06-9e69-7a59db5e0ee9 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:08:42.697757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ab615063-986d-4e06-9e69-7a59db5e0ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:42.706637 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1624/3242] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:08:42.710938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b8759-a390-4775-a5a0-b3f40285effb None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:42.723205 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b8759-a390-4775-a5a0-b3f40285effb None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:42.728587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e686058-98fa-4b9e-a450-c91ccefda863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:42.729499 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e686058-98fa-4b9e-a450-c91ccefda863 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:42.730147 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e686058-98fa-4b9e-a450-c91ccefda863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:42.730456 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e686058-98fa-4b9e-a450-c91ccefda863 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:42.731238 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e686058-98fa-4b9e-a450-c91ccefda863 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:08:42.731557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e686058-98fa-4b9e-a450-c91ccefda863 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:42.733410 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e686058-98fa-4b9e-a450-c91ccefda863 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:42.751405 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1619/3243] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:08:42.757176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab615063-986d-4e06-9e69-7a59db5e0ee9 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:42.770070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab615063-986d-4e06-9e69-7a59db5e0ee9 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:42.779282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958844d3-9cb1-4693-9235-ce974294a88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:42.780855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958844d3-9cb1-4693-9235-ce974294a88c admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:42.781468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958844d3-9cb1-4693-9235-ce974294a88c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:42.781748 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958844d3-9cb1-4693-9235-ce974294a88c admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:42.782557 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958844d3-9cb1-4693-9235-ce974294a88c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:42.785408 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958844d3-9cb1-4693-9235-ce974294a88c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:42.829806 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e686058-98fa-4b9e-a450-c91ccefda863 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:42.840635 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1625/3244] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:08:42 2022] POST /identity/v3/projects => generated 379 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:08:42.845474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e686058-98fa-4b9e-a450-c91ccefda863 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:42.986778 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f60e3-cf6c-46ad-964e-9747648ad17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:42.987490 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f60e3-cf6c-46ad-964e-9747648ad17e admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:42.987779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f60e3-cf6c-46ad-964e-9747648ad17e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:42.988474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f60e3-cf6c-46ad-964e-9747648ad17e admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:42.990308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f60e3-cf6c-46ad-964e-9747648ad17e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:43.005425 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f60e3-cf6c-46ad-964e-9747648ad17e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:43.052308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958844d3-9cb1-4693-9235-ce974294a88c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:43.052738 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1620/3245] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:08:42 2022] POST /identity/v3/users => generated 290 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:08:43.068825 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958844d3-9cb1-4693-9235-ce974294a88c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:43.079638 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529bca47-d26a-4911-93d1-5b6a76fd2324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:43.080372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bca47-d26a-4911-93d1-5b6a76fd2324 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:43.080905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bca47-d26a-4911-93d1-5b6a76fd2324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:43.081235 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bca47-d26a-4911-93d1-5b6a76fd2324 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:43.082005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529bca47-d26a-4911-93d1-5b6a76fd2324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:43.084421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529bca47-d26a-4911-93d1-5b6a76fd2324 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:43.100256 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1626/3246] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:08:43.101627 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f60e3-cf6c-46ad-964e-9747648ad17e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:43.124687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f60e3-cf6c-46ad-964e-9747648ad17e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:43.137600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c26ef4-507f-4543-948d-89c226805e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:43.138344 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c26ef4-507f-4543-948d-89c226805e1f admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:43.138627 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c26ef4-507f-4543-948d-89c226805e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:43.138897 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c26ef4-507f-4543-948d-89c226805e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:43.139558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c26ef4-507f-4543-948d-89c226805e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:43.141308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c26ef4-507f-4543-948d-89c226805e1f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:43.156247 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1621/3247] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:08:43.160637 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529bca47-d26a-4911-93d1-5b6a76fd2324 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:43.175688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529bca47-d26a-4911-93d1-5b6a76fd2324 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:43.190650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e35e5-35b8-49bf-8b4c-9504054fcd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:43.191859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e35e5-35b8-49bf-8b4c-9504054fcd49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:43.192219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e35e5-35b8-49bf-8b4c-9504054fcd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:43.192571 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e35e5-35b8-49bf-8b4c-9504054fcd49 admin admin] PATH_INFO: `/v3/projects/0bf640ae8cdc47b1b58c18088b26344e/users/ec006790d4564069bf1c4787a6108f0e/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:43.218900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5e35e5-35b8-49bf-8b4c-9504054fcd49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bf640ae8cdc47b1b58c18088b26344e, user_id=ec006790d4564069bf1c4787a6108f0e, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:43.222117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5e35e5-35b8-49bf-8b4c-9504054fcd49 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:43.239869 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1627/3248] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:08:43 2022] PUT /identity/v3/projects/0bf640ae8cdc47b1b58c18088b26344e/users/ec006790d4564069bf1c4787a6108f0e/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:08:43.245884 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a44b1-10ee-474b-8985-cbe3d51d912c None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:43.247319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a44b1-10ee-474b-8985-cbe3d51d912c None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:43.247676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a44b1-10ee-474b-8985-cbe3d51d912c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:43.273983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-541a44b1-10ee-474b-8985-cbe3d51d912c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:08:43.275369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-541a44b1-10ee-474b-8985-cbe3d51d912c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:43.283166 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:08:43.389725 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1622/3249] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:08:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:08:43.404482 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e35e5-35b8-49bf-8b4c-9504054fcd49 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:43.414706 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fe5e35e5-35b8-49bf-8b4c-9504054fcd49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:43.488989 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:08:43.558079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e35e5-35b8-49bf-8b4c-9504054fcd49 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:43.562275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7f287-9a38-4df9-aa11-8c820c5f7646 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:43.562999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7f287-9a38-4df9-aa11-8c820c5f7646 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:43.563319 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7f287-9a38-4df9-aa11-8c820c5f7646 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:43.563602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7f287-9a38-4df9-aa11-8c820c5f7646 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:43.574178 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7f287-9a38-4df9-aa11-8c820c5f7646 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:43.575711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7f287-9a38-4df9-aa11-8c820c5f7646 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:43.587570 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1628/3250] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:08:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:08:53.371839 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=22 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:08:53.582891 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=23 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:08:57.146848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15031cd-53d7-4794-8843-0a53df68cf78 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:57.147306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15031cd-53d7-4794-8843-0a53df68cf78 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:57.147611 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15031cd-53d7-4794-8843-0a53df68cf78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:57.215293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c15031cd-53d7-4794-8843-0a53df68cf78 None None] MFA Rules not processed for user `ec006790d4564069bf1c4787a6108f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:08:57.218355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c15031cd-53d7-4794-8843-0a53df68cf78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:57.370205 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1623/3251] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:08:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:08:57.591292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7f287-9a38-4df9-aa11-8c820c5f7646 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:57.594044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0bb7f287-9a38-4df9-aa11-8c820c5f7646 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:57.795884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7f287-9a38-4df9-aa11-8c820c5f7646 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:57.821291 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5b9bb-56ff-41ef-8723-d6f04f3d050f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:57.821970 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5b9bb-56ff-41ef-8723-d6f04f3d050f service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:57.822252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5b9bb-56ff-41ef-8723-d6f04f3d050f service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:57.822542 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5b9bb-56ff-41ef-8723-d6f04f3d050f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:57.850180 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd5b9bb-56ff-41ef-8723-d6f04f3d050f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:57.851991 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd5b9bb-56ff-41ef-8723-d6f04f3d050f service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:57.889225 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1629/3252] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:08:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:08:59.006224 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15031cd-53d7-4794-8843-0a53df68cf78 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:08:59.008705 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c15031cd-53d7-4794-8843-0a53df68cf78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:59.027782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15031cd-53d7-4794-8843-0a53df68cf78 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:08:59.032992 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c1bfb-6697-4fe1-aa8e-b2cef7b6f642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:08:59.033884 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c1bfb-6697-4fe1-aa8e-b2cef7b6f642 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:08:59.034345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c1bfb-6697-4fe1-aa8e-b2cef7b6f642 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:08:59.034764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c1bfb-6697-4fe1-aa8e-b2cef7b6f642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:08:59.036719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-df9c1bfb-6697-4fe1-aa8e-b2cef7b6f642 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:08:59.052930 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c1bfb-6697-4fe1-aa8e-b2cef7b6f642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:08:59.055956 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c1bfb-6697-4fe1-aa8e-b2cef7b6f642 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:08:59.099882 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1624/3253] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:08:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:09:03.597936 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5b9bb-56ff-41ef-8723-d6f04f3d050f service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:03.599880 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3dd5b9bb-56ff-41ef-8723-d6f04f3d050f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:03.628458 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5b9bb-56ff-41ef-8723-d6f04f3d050f service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:03.645711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5a6db-8a4d-442c-b229-8a7f61af2868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:03.646978 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5a6db-8a4d-442c-b229-8a7f61af2868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:03.647816 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5a6db-8a4d-442c-b229-8a7f61af2868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:03.648707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5a6db-8a4d-442c-b229-8a7f61af2868 admin admin] PATH_INFO: `/v3/users/9482689feb8c4b6dad361610438a1b60` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:03.650363 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc5a6db-8a4d-442c-b229-8a7f61af2868 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9482689feb8c4b6dad361610438a1b60)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:03.653838 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc5a6db-8a4d-442c-b229-8a7f61af2868 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:03.739585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-cdc5a6db-8a4d-442c-b229-8a7f61af2868 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9482689feb8c4b6dad361610438a1b60'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:03.740281 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-cdc5a6db-8a4d-442c-b229-8a7f61af2868 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9482689feb8c4b6dad361610438a1b60'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:03.797176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-cdc5a6db-8a4d-442c-b229-8a7f61af2868 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9482689feb8c4b6dad361610438a1b60'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:03.816508 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-cdc5a6db-8a4d-442c-b229-8a7f61af2868 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9482689feb8c4b6dad361610438a1b60'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:03.829050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-cdc5a6db-8a4d-442c-b229-8a7f61af2868 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9482689feb8c4b6dad361610438a1b60'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:03.871849 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1630/3254] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:09:03 2022] DELETE /identity/v3/users/9482689feb8c4b6dad361610438a1b60 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:09:04.981409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c1bfb-6697-4fe1-aa8e-b2cef7b6f642 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:04.996517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c1bfb-6697-4fe1-aa8e-b2cef7b6f642 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:05.191023 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07a8a2-2219-40ca-91a9-67b8b7f9a599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:05.192185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07a8a2-2219-40ca-91a9-67b8b7f9a599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:05.192963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07a8a2-2219-40ca-91a9-67b8b7f9a599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:05.193693 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07a8a2-2219-40ca-91a9-67b8b7f9a599 admin admin] PATH_INFO: `/v3/projects/49134d3485af4b0bbeef904dff960f7e` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:05.195937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07a8a2-2219-40ca-91a9-67b8b7f9a599 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49134d3485af4b0bbeef904dff960f7e)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:05.198648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07a8a2-2219-40ca-91a9-67b8b7f9a599 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:05.307088 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-be07a8a2-2219-40ca-91a9-67b8b7f9a599 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49134d3485af4b0bbeef904dff960f7e', 'request_id': 'req-be07a8a2-2219-40ca-91a9-67b8b7f9a599'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:05.341333 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-be07a8a2-2219-40ca-91a9-67b8b7f9a599 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49134d3485af4b0bbeef904dff960f7e', 'request_id': 'req-be07a8a2-2219-40ca-91a9-67b8b7f9a599'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:05.352678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-be07a8a2-2219-40ca-91a9-67b8b7f9a599 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49134d3485af4b0bbeef904dff960f7e', 'request_id': 'req-be07a8a2-2219-40ca-91a9-67b8b7f9a599'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:05.369280 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-be07a8a2-2219-40ca-91a9-67b8b7f9a599 admin admin] The token cache is being invalidate because project 49134d3485af4b0bbeef904dff960f7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:09:05.369831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-be07a8a2-2219-40ca-91a9-67b8b7f9a599 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:05.371564 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-be07a8a2-2219-40ca-91a9-67b8b7f9a599 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:05.378124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5a6db-8a4d-442c-b229-8a7f61af2868 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:05.379681 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-cdc5a6db-8a4d-442c-b229-8a7f61af2868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:05.382923 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1625/3255] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:09:04 2022] DELETE /identity/v3/projects/49134d3485af4b0bbeef904dff960f7e => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:09:05.417319 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5a6db-8a4d-442c-b229-8a7f61af2868 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:05.502202 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:05.549522 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e948f72-ca83-4aa1-92c7-a4fae0aa19f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:05.572379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e948f72-ca83-4aa1-92c7-a4fae0aa19f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:05.572741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e948f72-ca83-4aa1-92c7-a4fae0aa19f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:05.573023 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e948f72-ca83-4aa1-92c7-a4fae0aa19f9 admin admin] PATH_INFO: `/v3/users/d4c163ad5ee148848513367b5e997c34` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:05.581851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e948f72-ca83-4aa1-92c7-a4fae0aa19f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4c163ad5ee148848513367b5e997c34)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:05.583921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e948f72-ca83-4aa1-92c7-a4fae0aa19f9 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:05.759887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8e948f72-ca83-4aa1-92c7-a4fae0aa19f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4c163ad5ee148848513367b5e997c34'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:05.761529 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8e948f72-ca83-4aa1-92c7-a4fae0aa19f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4c163ad5ee148848513367b5e997c34'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:05.813913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8e948f72-ca83-4aa1-92c7-a4fae0aa19f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4c163ad5ee148848513367b5e997c34'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:05.842182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8e948f72-ca83-4aa1-92c7-a4fae0aa19f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4c163ad5ee148848513367b5e997c34'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:05.843270 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8e948f72-ca83-4aa1-92c7-a4fae0aa19f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4c163ad5ee148848513367b5e997c34'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:05.900914 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1631/3256] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:09:05 2022] DELETE /identity/v3/users/d4c163ad5ee148848513367b5e997c34 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:09:06.495593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e0340-dcb0-469c-b2cc-2b55d06117f7 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:06.496723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e0340-dcb0-469c-b2cc-2b55d06117f7 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:06.496723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e0340-dcb0-469c-b2cc-2b55d06117f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:06.512664 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:06.520174 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-486e0340-dcb0-469c-b2cc-2b55d06117f7 None None] MFA Rules not processed for user `575bb87368454c08a703e99526e6f00c`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:06.522697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-486e0340-dcb0-469c-b2cc-2b55d06117f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:06.648365 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1626/3257] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:09:06.978285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e948f72-ca83-4aa1-92c7-a4fae0aa19f9 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:06.980672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8e948f72-ca83-4aa1-92c7-a4fae0aa19f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:07.147145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e948f72-ca83-4aa1-92c7-a4fae0aa19f9 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:07.155241 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adea99-a606-4675-a7da-e73d1e1c4bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:07.155900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adea99-a606-4675-a7da-e73d1e1c4bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:07.156170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adea99-a606-4675-a7da-e73d1e1c4bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:07.156444 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adea99-a606-4675-a7da-e73d1e1c4bf8 admin admin] PATH_INFO: `/v3/projects/d347c2c0556e43a8a8cf5d319d8e119f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:07.157635 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4adea99-a606-4675-a7da-e73d1e1c4bf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d347c2c0556e43a8a8cf5d319d8e119f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:07.161546 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4adea99-a606-4675-a7da-e73d1e1c4bf8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:07.272454 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f4adea99-a606-4675-a7da-e73d1e1c4bf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd347c2c0556e43a8a8cf5d319d8e119f', 'request_id': 'req-f4adea99-a606-4675-a7da-e73d1e1c4bf8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:07.294636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f4adea99-a606-4675-a7da-e73d1e1c4bf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd347c2c0556e43a8a8cf5d319d8e119f', 'request_id': 'req-f4adea99-a606-4675-a7da-e73d1e1c4bf8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:07.310957 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f4adea99-a606-4675-a7da-e73d1e1c4bf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd347c2c0556e43a8a8cf5d319d8e119f', 'request_id': 'req-f4adea99-a606-4675-a7da-e73d1e1c4bf8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:07.316962 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:07.342947 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f4adea99-a606-4675-a7da-e73d1e1c4bf8 admin admin] The token cache is being invalidate because project d347c2c0556e43a8a8cf5d319d8e119f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:09:07.343251 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f4adea99-a606-4675-a7da-e73d1e1c4bf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:07.345257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f4adea99-a606-4675-a7da-e73d1e1c4bf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:07.347273 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1632/3258] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:09:06 2022] DELETE /identity/v3/projects/d347c2c0556e43a8a8cf5d319d8e119f => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:09:07.352407 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed3ea3-ca6a-4b37-9a4c-c290c4c738a6 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:07.352769 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed3ea3-ca6a-4b37-9a4c-c290c4c738a6 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:07.353010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed3ea3-ca6a-4b37-9a4c-c290c4c738a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:07.402942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-4bed3ea3-ca6a-4b37-9a4c-c290c4c738a6 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:07.412047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4bed3ea3-ca6a-4b37-9a4c-c290c4c738a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:07.565032 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1627/3259] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:09:07.565978 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e9471-4f36-46a7-98bd-9211e9d19698 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:07.566327 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e9471-4f36-46a7-98bd-9211e9d19698 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:07.566910 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e9471-4f36-46a7-98bd-9211e9d19698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:07.610515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-8f1e9471-4f36-46a7-98bd-9211e9d19698 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:07.612917 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed3ea3-ca6a-4b37-9a4c-c290c4c738a6 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:07.615279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4bed3ea3-ca6a-4b37-9a4c-c290c4c738a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:07.629019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8f1e9471-4f36-46a7-98bd-9211e9d19698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:07.660812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed3ea3-ca6a-4b37-9a4c-c290c4c738a6 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:07.677096 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1633/3260] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:09:07.687280 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e9471-4f36-46a7-98bd-9211e9d19698 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:07.696096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245a27a-dd6b-4b34-8edf-6b595b5cca38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:07.696774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245a27a-dd6b-4b34-8edf-6b595b5cca38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:07.700507 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245a27a-dd6b-4b34-8edf-6b595b5cca38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:07.701633 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245a27a-dd6b-4b34-8edf-6b595b5cca38 admin admin] PATH_INFO: `/v3/users/43fe21f4d970435c858903bc9e8579ae` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:07.705925 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245a27a-dd6b-4b34-8edf-6b595b5cca38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43fe21f4d970435c858903bc9e8579ae)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:07.717815 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245a27a-dd6b-4b34-8edf-6b595b5cca38 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:07.735168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e9471-4f36-46a7-98bd-9211e9d19698 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:07.754231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629a107-4790-45d0-948b-dca917913d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:07.754848 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629a107-4790-45d0-948b-dca917913d54 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:07.755127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629a107-4790-45d0-948b-dca917913d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:07.755397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629a107-4790-45d0-948b-dca917913d54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:07.756360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6629a107-4790-45d0-948b-dca917913d54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:09:07.756360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6629a107-4790-45d0-948b-dca917913d54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:07.758056 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6629a107-4790-45d0-948b-dca917913d54 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:07.785712 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1634/3261] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:09:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:09:07.790568 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629a107-4790-45d0-948b-dca917913d54 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:07.807161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629a107-4790-45d0-948b-dca917913d54 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:07.820236 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb576f-8558-4d6d-bbea-c00604936504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:07.820864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb576f-8558-4d6d-bbea-c00604936504 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:07.821179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb576f-8558-4d6d-bbea-c00604936504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:07.821501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb576f-8558-4d6d-bbea-c00604936504 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:07.822189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb576f-8558-4d6d-bbea-c00604936504 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:07.829417 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb576f-8558-4d6d-bbea-c00604936504 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:07.866821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8245a27a-dd6b-4b34-8edf-6b595b5cca38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43fe21f4d970435c858903bc9e8579ae'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:07.870019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8245a27a-dd6b-4b34-8edf-6b595b5cca38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43fe21f4d970435c858903bc9e8579ae'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:07.894488 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1635/3262] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:09:07 2022] POST /identity/v3/projects => generated 397 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:09:07.900334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb576f-8558-4d6d-bbea-c00604936504 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:07.907653 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-83eb576f-8558-4d6d-bbea-c00604936504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:07.912561 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8245a27a-dd6b-4b34-8edf-6b595b5cca38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43fe21f4d970435c858903bc9e8579ae'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:07.930559 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8245a27a-dd6b-4b34-8edf-6b595b5cca38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43fe21f4d970435c858903bc9e8579ae'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:07.931349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8245a27a-dd6b-4b34-8edf-6b595b5cca38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43fe21f4d970435c858903bc9e8579ae'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:07.998888 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1628/3263] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:09:07 2022] DELETE /identity/v3/users/43fe21f4d970435c858903bc9e8579ae => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:09:08.053235 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb576f-8558-4d6d-bbea-c00604936504 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:08.135312 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aeca6d-c452-4b3c-9c21-5aab1ecf0cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:08.136415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aeca6d-c452-4b3c-9c21-5aab1ecf0cf7 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:08.137411 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aeca6d-c452-4b3c-9c21-5aab1ecf0cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:08.137919 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aeca6d-c452-4b3c-9c21-5aab1ecf0cf7 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:08.141801 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aeca6d-c452-4b3c-9c21-5aab1ecf0cf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:08.144239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aeca6d-c452-4b3c-9c21-5aab1ecf0cf7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:08.213340 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1636/3264] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:09:07 2022] POST /identity/v3/users => generated 299 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:09:08.217425 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245a27a-dd6b-4b34-8edf-6b595b5cca38 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:08.250981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245a27a-dd6b-4b34-8edf-6b595b5cca38 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:08.279892 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7b44a-e809-45ba-8ec7-73995d78770f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:08.280598 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7b44a-e809-45ba-8ec7-73995d78770f admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:08.282030 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7b44a-e809-45ba-8ec7-73995d78770f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:08.282325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7b44a-e809-45ba-8ec7-73995d78770f admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:08.285493 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7b44a-e809-45ba-8ec7-73995d78770f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:08.287245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7b44a-e809-45ba-8ec7-73995d78770f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:08.319652 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1629/3265] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:09:08.324711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aeca6d-c452-4b3c-9c21-5aab1ecf0cf7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:08.341335 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aeca6d-c452-4b3c-9c21-5aab1ecf0cf7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:08.365840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2190bc-ff8f-4d09-9618-1c3257d0d6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:08.365840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2190bc-ff8f-4d09-9618-1c3257d0d6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:08.365840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2190bc-ff8f-4d09-9618-1c3257d0d6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:08.365840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2190bc-ff8f-4d09-9618-1c3257d0d6d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:08.366415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2190bc-ff8f-4d09-9618-1c3257d0d6d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:08.366415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2190bc-ff8f-4d09-9618-1c3257d0d6d3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:08.410866 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1637/3266] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:09:08.414954 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7b44a-e809-45ba-8ec7-73995d78770f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:08.507640 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7b44a-e809-45ba-8ec7-73995d78770f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:08.528437 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134fa2d-7985-4d53-8c45-15d7d7895088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:08.528437 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134fa2d-7985-4d53-8c45-15d7d7895088 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:08.528437 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134fa2d-7985-4d53-8c45-15d7d7895088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:08.528437 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134fa2d-7985-4d53-8c45-15d7d7895088 admin admin] PATH_INFO: `/v3/projects/21275f28b9ba4a7686371e0dad4cc0b8/users/2f06e2312dcc49969c19772035ddab99/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:08.548262 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:08.560388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134fa2d-7985-4d53-8c45-15d7d7895088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21275f28b9ba4a7686371e0dad4cc0b8, user_id=2f06e2312dcc49969c19772035ddab99, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:08.564515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134fa2d-7985-4d53-8c45-15d7d7895088 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:08.595904 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1630/3267] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:09:08 2022] PUT /identity/v3/projects/21275f28b9ba4a7686371e0dad4cc0b8/users/2f06e2312dcc49969c19772035ddab99/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:09:08.601289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fdd0b-7079-48cf-8a8b-fa787b962d41 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:08.601778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fdd0b-7079-48cf-8a8b-fa787b962d41 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:08.602147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fdd0b-7079-48cf-8a8b-fa787b962d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:08.642142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-694fdd0b-7079-48cf-8a8b-fa787b962d41 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:08.643572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-694fdd0b-7079-48cf-8a8b-fa787b962d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:08.723133 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:08.768995 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1638/3268] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:09:08.821402 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134fa2d-7985-4d53-8c45-15d7d7895088 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:08.823174 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9134fa2d-7985-4d53-8c45-15d7d7895088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:08.952101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134fa2d-7985-4d53-8c45-15d7d7895088 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:08.956183 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb3c27-2b16-4b70-a8d1-11c87dcf6c59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:08.957044 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb3c27-2b16-4b70-a8d1-11c87dcf6c59 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:08.957319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb3c27-2b16-4b70-a8d1-11c87dcf6c59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:08.957816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb3c27-2b16-4b70-a8d1-11c87dcf6c59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:08.997395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb3c27-2b16-4b70-a8d1-11c87dcf6c59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:09.002522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb3c27-2b16-4b70-a8d1-11c87dcf6c59 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:09.040748 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1631/3269] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:09:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:09:10.314356 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fdd0b-7079-48cf-8a8b-fa787b962d41 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:10.316692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-694fdd0b-7079-48cf-8a8b-fa787b962d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:10.347787 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fdd0b-7079-48cf-8a8b-fa787b962d41 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:10.363738 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e8648-093b-4071-9848-d6a6f95077ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:10.364565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e8648-093b-4071-9848-d6a6f95077ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:10.364837 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e8648-093b-4071-9848-d6a6f95077ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:10.365115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e8648-093b-4071-9848-d6a6f95077ea admin admin] PATH_INFO: `/v3/projects/7e33e70b344f461db9c652d35fdc9675` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:10.367244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e8648-093b-4071-9848-d6a6f95077ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e33e70b344f461db9c652d35fdc9675)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:10.384511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e8648-093b-4071-9848-d6a6f95077ea admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:10.519444 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-256e8648-093b-4071-9848-d6a6f95077ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e33e70b344f461db9c652d35fdc9675', 'request_id': 'req-256e8648-093b-4071-9848-d6a6f95077ea'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:10.531300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-256e8648-093b-4071-9848-d6a6f95077ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e33e70b344f461db9c652d35fdc9675', 'request_id': 'req-256e8648-093b-4071-9848-d6a6f95077ea'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:10.544092 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-256e8648-093b-4071-9848-d6a6f95077ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e33e70b344f461db9c652d35fdc9675', 'request_id': 'req-256e8648-093b-4071-9848-d6a6f95077ea'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:10.571015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-256e8648-093b-4071-9848-d6a6f95077ea admin admin] The token cache is being invalidate because project 7e33e70b344f461db9c652d35fdc9675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:09:10.571629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-256e8648-093b-4071-9848-d6a6f95077ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:10.572531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-256e8648-093b-4071-9848-d6a6f95077ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:10.575718 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1639/3270] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:09:10 2022] DELETE /identity/v3/projects/7e33e70b344f461db9c652d35fdc9675 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:09:10.580259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da056cd9-ad79-4173-a8ab-13c10d6a9ee2 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:10.580750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da056cd9-ad79-4173-a8ab-13c10d6a9ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:10.580846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da056cd9-ad79-4173-a8ab-13c10d6a9ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:10.615707 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-da056cd9-ad79-4173-a8ab-13c10d6a9ee2 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:10.616925 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-da056cd9-ad79-4173-a8ab-13c10d6a9ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:10.763925 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1632/3271] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:09:10.769428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a45c5f-0f6b-4234-aa70-8f1ff31743bf None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:10.769938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a45c5f-0f6b-4234-aa70-8f1ff31743bf None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:10.770333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a45c5f-0f6b-4234-aa70-8f1ff31743bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:10.817884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-11a45c5f-0f6b-4234-aa70-8f1ff31743bf None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:10.819037 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-11a45c5f-0f6b-4234-aa70-8f1ff31743bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:10.834976 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1640/3272] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:09:10.841103 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da056cd9-ad79-4173-a8ab-13c10d6a9ee2 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:10.860977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da056cd9-ad79-4173-a8ab-13c10d6a9ee2 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:10.874251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204010ce-463e-4e29-a1d0-76c359810f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:10.879731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204010ce-463e-4e29-a1d0-76c359810f15 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:10.880962 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204010ce-463e-4e29-a1d0-76c359810f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:10.881425 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204010ce-463e-4e29-a1d0-76c359810f15 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:10.883796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204010ce-463e-4e29-a1d0-76c359810f15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:09:10.884310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204010ce-463e-4e29-a1d0-76c359810f15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:10.888881 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204010ce-463e-4e29-a1d0-76c359810f15 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:10.925614 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1633/3273] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:09:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:09:10.929743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a45c5f-0f6b-4234-aa70-8f1ff31743bf None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:10.944203 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a45c5f-0f6b-4234-aa70-8f1ff31743bf None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:10.960737 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5968f-08ca-4c5f-91bc-9ab4e5e08846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:10.961393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5968f-08ca-4c5f-91bc-9ab4e5e08846 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:10.961726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5968f-08ca-4c5f-91bc-9ab4e5e08846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:10.962001 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5968f-08ca-4c5f-91bc-9ab4e5e08846 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:10.962690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5968f-08ca-4c5f-91bc-9ab4e5e08846 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:10.965273 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5968f-08ca-4c5f-91bc-9ab4e5e08846 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:11.039411 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1641/3274] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:09:10 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:09:11.045306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204010ce-463e-4e29-a1d0-76c359810f15 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:11.059774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204010ce-463e-4e29-a1d0-76c359810f15 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:11.189447 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe360e-90b1-4cf2-a197-197c12c15fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:11.190233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe360e-90b1-4cf2-a197-197c12c15fba admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:11.190615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe360e-90b1-4cf2-a197-197c12c15fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:11.191010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe360e-90b1-4cf2-a197-197c12c15fba admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:11.192194 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbe360e-90b1-4cf2-a197-197c12c15fba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:11.194293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbe360e-90b1-4cf2-a197-197c12c15fba admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:11.231428 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1634/3275] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:09:11 2022] POST /identity/v3/users => generated 290 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:09:11.235313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5968f-08ca-4c5f-91bc-9ab4e5e08846 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:11.247865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5968f-08ca-4c5f-91bc-9ab4e5e08846 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:11.253012 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7630d-66fc-4c4a-9281-ecb7194a8682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:11.254271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7630d-66fc-4c4a-9281-ecb7194a8682 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:11.254565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7630d-66fc-4c4a-9281-ecb7194a8682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:11.254920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7630d-66fc-4c4a-9281-ecb7194a8682 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:11.255482 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d7630d-66fc-4c4a-9281-ecb7194a8682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:11.257197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d7630d-66fc-4c4a-9281-ecb7194a8682 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:11.275565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe360e-90b1-4cf2-a197-197c12c15fba admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:11.280997 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1642/3276] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:09:11.290089 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe360e-90b1-4cf2-a197-197c12c15fba admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:11.296596 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64afdb-4c0f-4bfa-81bb-453672517684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:11.297765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64afdb-4c0f-4bfa-81bb-453672517684 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:11.297765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64afdb-4c0f-4bfa-81bb-453672517684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:11.297765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64afdb-4c0f-4bfa-81bb-453672517684 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:11.298411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64afdb-4c0f-4bfa-81bb-453672517684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:11.304541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64afdb-4c0f-4bfa-81bb-453672517684 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:11.314418 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:11.324619 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7630d-66fc-4c4a-9281-ecb7194a8682 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:11.325831 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1635/3277] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:09:11.336250 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7630d-66fc-4c4a-9281-ecb7194a8682 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:11.344008 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c391d-6adc-44fb-b939-44fcb0d89d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:11.345162 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c391d-6adc-44fb-b939-44fcb0d89d36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:11.345853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c391d-6adc-44fb-b939-44fcb0d89d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:11.346349 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c391d-6adc-44fb-b939-44fcb0d89d36 admin admin] PATH_INFO: `/v3/projects/c28196b63fb94716951abfca405e5687/users/d531146522f24a368a8c6ab482495776/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:11.368693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c391d-6adc-44fb-b939-44fcb0d89d36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c28196b63fb94716951abfca405e5687, user_id=d531146522f24a368a8c6ab482495776, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:11.372441 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c391d-6adc-44fb-b939-44fcb0d89d36 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:11.401002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9363e77-3147-43aa-ac50-1c6185a18391 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:11.401316 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9363e77-3147-43aa-ac50-1c6185a18391 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:11.401755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9363e77-3147-43aa-ac50-1c6185a18391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:11.404661 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1643/3278] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:09:11 2022] PUT /identity/v3/projects/c28196b63fb94716951abfca405e5687/users/d531146522f24a368a8c6ab482495776/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:09:11.456099 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c9363e77-3147-43aa-ac50-1c6185a18391 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:11.458140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c9363e77-3147-43aa-ac50-1c6185a18391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:11.581246 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1636/3279] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:09:11.695261 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c391d-6adc-44fb-b939-44fcb0d89d36 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:11.697981 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-485c391d-6adc-44fb-b939-44fcb0d89d36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:11.879083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c391d-6adc-44fb-b939-44fcb0d89d36 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:11.898170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526320a-f4df-4775-a3fa-7dbe6597cc95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:11.898821 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526320a-f4df-4775-a3fa-7dbe6597cc95 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:11.899101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526320a-f4df-4775-a3fa-7dbe6597cc95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:11.899378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526320a-f4df-4775-a3fa-7dbe6597cc95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:11.934156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526320a-f4df-4775-a3fa-7dbe6597cc95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:11.936430 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526320a-f4df-4775-a3fa-7dbe6597cc95 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:11.987641 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1644/3280] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:09:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:09:13.547436 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9363e77-3147-43aa-ac50-1c6185a18391 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:13.549098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c9363e77-3147-43aa-ac50-1c6185a18391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:13.562031 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9363e77-3147-43aa-ac50-1c6185a18391 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:13.568173 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852297a3-f08a-4e84-a278-499dda244904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:13.569320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852297a3-f08a-4e84-a278-499dda244904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:13.569320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852297a3-f08a-4e84-a278-499dda244904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:13.569940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852297a3-f08a-4e84-a278-499dda244904 admin admin] PATH_INFO: `/v3/users/c76b3aab50ca4e8d8f890f0745b5c8e0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:13.571809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852297a3-f08a-4e84-a278-499dda244904 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c76b3aab50ca4e8d8f890f0745b5c8e0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:13.576675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852297a3-f08a-4e84-a278-499dda244904 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:13.664733 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-852297a3-f08a-4e84-a278-499dda244904 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c76b3aab50ca4e8d8f890f0745b5c8e0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:13.667183 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-852297a3-f08a-4e84-a278-499dda244904 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c76b3aab50ca4e8d8f890f0745b5c8e0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:13.685379 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-852297a3-f08a-4e84-a278-499dda244904 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c76b3aab50ca4e8d8f890f0745b5c8e0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:13.706964 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-852297a3-f08a-4e84-a278-499dda244904 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c76b3aab50ca4e8d8f890f0745b5c8e0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:13.709003 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-852297a3-f08a-4e84-a278-499dda244904 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c76b3aab50ca4e8d8f890f0745b5c8e0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:13.751029 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1637/3281] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:09:13 2022] DELETE /identity/v3/users/c76b3aab50ca4e8d8f890f0745b5c8e0 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:09:14.530403 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526320a-f4df-4775-a3fa-7dbe6597cc95 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:14.531917 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5526320a-f4df-4775-a3fa-7dbe6597cc95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:14.545469 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:14.557486 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526320a-f4df-4775-a3fa-7dbe6597cc95 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:14.690408 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967914b4-cfc6-430e-b869-bbfb00a279ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:14.691373 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967914b4-cfc6-430e-b869-bbfb00a279ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:14.691768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967914b4-cfc6-430e-b869-bbfb00a279ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:14.692134 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967914b4-cfc6-430e-b869-bbfb00a279ca admin admin] PATH_INFO: `/v3/users/ec006790d4564069bf1c4787a6108f0e` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:14.696728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967914b4-cfc6-430e-b869-bbfb00a279ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec006790d4564069bf1c4787a6108f0e)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:14.700230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967914b4-cfc6-430e-b869-bbfb00a279ca admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:14.797369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-967914b4-cfc6-430e-b869-bbfb00a279ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec006790d4564069bf1c4787a6108f0e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:14.798689 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-967914b4-cfc6-430e-b869-bbfb00a279ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec006790d4564069bf1c4787a6108f0e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:14.809570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-967914b4-cfc6-430e-b869-bbfb00a279ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec006790d4564069bf1c4787a6108f0e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:14.822095 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-967914b4-cfc6-430e-b869-bbfb00a279ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec006790d4564069bf1c4787a6108f0e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:14.825252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-967914b4-cfc6-430e-b869-bbfb00a279ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec006790d4564069bf1c4787a6108f0e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:14.864800 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1645/3282] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:09:14 2022] DELETE /identity/v3/users/ec006790d4564069bf1c4787a6108f0e => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:09:16.668343 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852297a3-f08a-4e84-a278-499dda244904 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:16.670064 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-852297a3-f08a-4e84-a278-499dda244904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:16.698020 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852297a3-f08a-4e84-a278-499dda244904 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:16.702983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967914b4-cfc6-430e-b869-bbfb00a279ca admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:16.704407 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-967914b4-cfc6-430e-b869-bbfb00a279ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:16.878145 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757208c-5517-493c-b775-8005c0c820ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:16.879388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757208c-5517-493c-b775-8005c0c820ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:16.880876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757208c-5517-493c-b775-8005c0c820ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:16.881817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757208c-5517-493c-b775-8005c0c820ca admin admin] PATH_INFO: `/v3/projects/0c00fd890a8a4f19a94c4af317ec7899` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:16.884125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757208c-5517-493c-b775-8005c0c820ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c00fd890a8a4f19a94c4af317ec7899)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:16.888450 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757208c-5517-493c-b775-8005c0c820ca admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:16.924585 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:16.935627 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967914b4-cfc6-430e-b869-bbfb00a279ca admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:16.945762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137fb64-126b-4d25-a2d4-2e13f4405405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:16.946820 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137fb64-126b-4d25-a2d4-2e13f4405405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:16.947201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137fb64-126b-4d25-a2d4-2e13f4405405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:16.947574 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137fb64-126b-4d25-a2d4-2e13f4405405 admin admin] PATH_INFO: `/v3/projects/0bf640ae8cdc47b1b58c18088b26344e` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:16.949777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137fb64-126b-4d25-a2d4-2e13f4405405 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bf640ae8cdc47b1b58c18088b26344e)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:16.952039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137fb64-126b-4d25-a2d4-2e13f4405405 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:17.007885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d757208c-5517-493c-b775-8005c0c820ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c00fd890a8a4f19a94c4af317ec7899', 'request_id': 'req-d757208c-5517-493c-b775-8005c0c820ca'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:17.017281 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:17.028131 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d757208c-5517-493c-b775-8005c0c820ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c00fd890a8a4f19a94c4af317ec7899', 'request_id': 'req-d757208c-5517-493c-b775-8005c0c820ca'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:17.068850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d757208c-5517-493c-b775-8005c0c820ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c00fd890a8a4f19a94c4af317ec7899', 'request_id': 'req-d757208c-5517-493c-b775-8005c0c820ca'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:17.101067 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d757208c-5517-493c-b775-8005c0c820ca admin admin] The token cache is being invalidate because project 0c00fd890a8a4f19a94c4af317ec7899 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:09:17.101814 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d757208c-5517-493c-b775-8005c0c820ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:17.103695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1137fb64-126b-4d25-a2d4-2e13f4405405 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bf640ae8cdc47b1b58c18088b26344e', 'request_id': 'req-1137fb64-126b-4d25-a2d4-2e13f4405405'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:17.104214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d757208c-5517-493c-b775-8005c0c820ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:17.107314 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1638/3283] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:09:16 2022] DELETE /identity/v3/projects/0c00fd890a8a4f19a94c4af317ec7899 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:09:17.112344 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3a91b-a81f-4852-b492-58059de00dee None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:17.116129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3a91b-a81f-4852-b492-58059de00dee None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:17.116483 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3a91b-a81f-4852-b492-58059de00dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:17.125891 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1137fb64-126b-4d25-a2d4-2e13f4405405 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bf640ae8cdc47b1b58c18088b26344e', 'request_id': 'req-1137fb64-126b-4d25-a2d4-2e13f4405405'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:17.141873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1137fb64-126b-4d25-a2d4-2e13f4405405 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bf640ae8cdc47b1b58c18088b26344e', 'request_id': 'req-1137fb64-126b-4d25-a2d4-2e13f4405405'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:17.181908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1137fb64-126b-4d25-a2d4-2e13f4405405 admin admin] The token cache is being invalidate because project 0bf640ae8cdc47b1b58c18088b26344e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:09:17.183125 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1137fb64-126b-4d25-a2d4-2e13f4405405 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:17.183889 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b0d3a91b-a81f-4852-b492-58059de00dee None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:17.185682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b0d3a91b-a81f-4852-b492-58059de00dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:17.187949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1137fb64-126b-4d25-a2d4-2e13f4405405 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:17.191423 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1646/3284] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:09:16 2022] DELETE /identity/v3/projects/0bf640ae8cdc47b1b58c18088b26344e => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:09:17.196113 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151109d8-c1ab-4d84-b31e-07da7103067a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:17.196563 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151109d8-c1ab-4d84-b31e-07da7103067a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:17.197467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151109d8-c1ab-4d84-b31e-07da7103067a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:17.280110 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-151109d8-c1ab-4d84-b31e-07da7103067a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:17.282302 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-151109d8-c1ab-4d84-b31e-07da7103067a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:17.453543 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1639/3285] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:09:17.465131 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629ebcc-ed08-41e0-ad59-2a03cae31edc None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:17.466492 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629ebcc-ed08-41e0-ad59-2a03cae31edc None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:17.467707 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629ebcc-ed08-41e0-ad59-2a03cae31edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:17.509160 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1647/3286] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:09:17.512988 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587139e-268f-41c6-8be6-8d4f56a76a61 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:17.513306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587139e-268f-41c6-8be6-8d4f56a76a61 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:17.513629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587139e-268f-41c6-8be6-8d4f56a76a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:17.553888 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-1587139e-268f-41c6-8be6-8d4f56a76a61 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:17.559707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1587139e-268f-41c6-8be6-8d4f56a76a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:17.587625 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1648/3287] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:09:17.598244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587139e-268f-41c6-8be6-8d4f56a76a61 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:17.605272 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5629ebcc-ed08-41e0-ad59-2a03cae31edc None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:17.617399 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5629ebcc-ed08-41e0-ad59-2a03cae31edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:17.633564 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587139e-268f-41c6-8be6-8d4f56a76a61 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:17.665019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e36b2-706a-4a9f-a7ef-5ad13e9d8ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:17.665681 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e36b2-706a-4a9f-a7ef-5ad13e9d8ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:17.665963 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e36b2-706a-4a9f-a7ef-5ad13e9d8ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:17.666239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e36b2-706a-4a9f-a7ef-5ad13e9d8ec2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:17.666919 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e36b2-706a-4a9f-a7ef-5ad13e9d8ec2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:09:17.667743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e36b2-706a-4a9f-a7ef-5ad13e9d8ec2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:17.669376 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e36b2-706a-4a9f-a7ef-5ad13e9d8ec2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:17.669894 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1640/3288] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:09:17.682115 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5629ebcc-ed08-41e0-ad59-2a03cae31edc None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:17.703463 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1649/3289] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:09:17.711591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5629ebcc-ed08-41e0-ad59-2a03cae31edc None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:17.714383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e36b2-706a-4a9f-a7ef-5ad13e9d8ec2 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:17.736846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e36b2-706a-4a9f-a7ef-5ad13e9d8ec2 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:17.749393 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a6e45-3370-472c-8378-5cd808ebc2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:17.750288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a6e45-3370-472c-8378-5cd808ebc2bb admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:17.750787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a6e45-3370-472c-8378-5cd808ebc2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:17.751258 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a6e45-3370-472c-8378-5cd808ebc2bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:17.752157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a6e45-3370-472c-8378-5cd808ebc2bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:09:17.758247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd032b0c-7ead-4e17-b143-bc58712ff939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:17.758886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd032b0c-7ead-4e17-b143-bc58712ff939 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:17.759170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd032b0c-7ead-4e17-b143-bc58712ff939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:17.759382 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a6e45-3370-472c-8378-5cd808ebc2bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:17.759485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd032b0c-7ead-4e17-b143-bc58712ff939 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:17.760077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd032b0c-7ead-4e17-b143-bc58712ff939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:17.762241 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd032b0c-7ead-4e17-b143-bc58712ff939 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:17.763760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a6e45-3370-472c-8378-5cd808ebc2bb admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:17.796584 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1641/3290] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:09:17.797844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a6e45-3370-472c-8378-5cd808ebc2bb admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:17.826837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a6e45-3370-472c-8378-5cd808ebc2bb admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:17.838710 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1650/3291] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:09:17 2022] POST /identity/v3/projects => generated 397 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:09:17.839631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd032b0c-7ead-4e17-b143-bc58712ff939 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:17.848685 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375204bf-f245-460b-ac52-a7b2c4b19bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:17.850033 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375204bf-f245-460b-ac52-a7b2c4b19bfc admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:17.854142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375204bf-f245-460b-ac52-a7b2c4b19bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:17.855360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375204bf-f245-460b-ac52-a7b2c4b19bfc admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:17.866315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375204bf-f245-460b-ac52-a7b2c4b19bfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:17.868429 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375204bf-f245-460b-ac52-a7b2c4b19bfc admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:17.965976 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1642/3292] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:09:17 2022] POST /identity/v3/projects => generated 381 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:09:17.970595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375204bf-f245-460b-ac52-a7b2c4b19bfc admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:18.000128 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd032b0c-7ead-4e17-b143-bc58712ff939 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:18.025384 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:18.123141 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8410151-d713-49ff-b504-4cf5204dfa39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:18.123777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8410151-d713-49ff-b504-4cf5204dfa39 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:18.124058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8410151-d713-49ff-b504-4cf5204dfa39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:18.124331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8410151-d713-49ff-b504-4cf5204dfa39 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:18.125712 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8410151-d713-49ff-b504-4cf5204dfa39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:18.128061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8410151-d713-49ff-b504-4cf5204dfa39 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:18.177668 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1651/3293] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:09:17 2022] POST /identity/v3/users => generated 299 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:09:18.184586 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8410151-d713-49ff-b504-4cf5204dfa39 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:18.186224 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375204bf-f245-460b-ac52-a7b2c4b19bfc admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:18.204339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8410151-d713-49ff-b504-4cf5204dfa39 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:18.205740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108433b-a396-4689-9e99-191d6a6d53b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:18.206385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108433b-a396-4689-9e99-191d6a6d53b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:18.207918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108433b-a396-4689-9e99-191d6a6d53b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:18.208211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108433b-a396-4689-9e99-191d6a6d53b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:18.208864 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108433b-a396-4689-9e99-191d6a6d53b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:18.210839 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108433b-a396-4689-9e99-191d6a6d53b0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:18.223772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102c532-8f68-4b4e-a02f-c93395158b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:18.224435 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102c532-8f68-4b4e-a02f-c93395158b47 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:18.224714 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102c532-8f68-4b4e-a02f-c93395158b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:18.224985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102c532-8f68-4b4e-a02f-c93395158b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:18.227073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6102c532-8f68-4b4e-a02f-c93395158b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:18.228727 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6102c532-8f68-4b4e-a02f-c93395158b47 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:18.236020 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:18.252072 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1652/3294] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:09:18.256768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102c532-8f68-4b4e-a02f-c93395158b47 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:18.272184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102c532-8f68-4b4e-a02f-c93395158b47 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:18.273667 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1643/3295] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:09:17 2022] POST /identity/v3/users => generated 291 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:09:18.278143 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108433b-a396-4689-9e99-191d6a6d53b0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:18.290753 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a0d7b-82da-458d-a5b1-c5a2be63633a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:18.291903 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a0d7b-82da-458d-a5b1-c5a2be63633a admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:18.293574 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a0d7b-82da-458d-a5b1-c5a2be63633a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:18.294171 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a0d7b-82da-458d-a5b1-c5a2be63633a admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:18.296903 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a0d7b-82da-458d-a5b1-c5a2be63633a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:18.300929 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a0d7b-82da-458d-a5b1-c5a2be63633a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:18.302043 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108433b-a396-4689-9e99-191d6a6d53b0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:18.316560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4da6ed-55d3-4b02-9bcf-e9b2f4e7d566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:18.317788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4da6ed-55d3-4b02-9bcf-e9b2f4e7d566 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:18.318165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4da6ed-55d3-4b02-9bcf-e9b2f4e7d566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:18.319944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4da6ed-55d3-4b02-9bcf-e9b2f4e7d566 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:18.321024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4da6ed-55d3-4b02-9bcf-e9b2f4e7d566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:18.324210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4da6ed-55d3-4b02-9bcf-e9b2f4e7d566 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:18.333310 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1653/3296] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:09:18.336181 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a0d7b-82da-458d-a5b1-c5a2be63633a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:18.357378 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1644/3297] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:09:18.360750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4da6ed-55d3-4b02-9bcf-e9b2f4e7d566 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:18.364422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a0d7b-82da-458d-a5b1-c5a2be63633a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:18.389698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae5298-72ce-410b-bab5-dbbd84dfb362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:18.389698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae5298-72ce-410b-bab5-dbbd84dfb362 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:18.389698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae5298-72ce-410b-bab5-dbbd84dfb362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:18.389698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae5298-72ce-410b-bab5-dbbd84dfb362 admin admin] PATH_INFO: `/v3/projects/322408cf9af04fbeb1f7770406e24cf8/users/56818ebbb5de483b85e6889ce59234e4/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:18.390098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4da6ed-55d3-4b02-9bcf-e9b2f4e7d566 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:18.401098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c8e37-174b-4c50-b89c-4c069f8c00d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:18.402502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c8e37-174b-4c50-b89c-4c069f8c00d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:18.405040 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c8e37-174b-4c50-b89c-4c069f8c00d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:18.406638 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c8e37-174b-4c50-b89c-4c069f8c00d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:18.410240 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c8e37-174b-4c50-b89c-4c069f8c00d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:18.416772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c8e37-174b-4c50-b89c-4c069f8c00d8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:18.434736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae5298-72ce-410b-bab5-dbbd84dfb362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=322408cf9af04fbeb1f7770406e24cf8, user_id=56818ebbb5de483b85e6889ce59234e4, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:18.453495 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae5298-72ce-410b-bab5-dbbd84dfb362 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:18.470862 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1645/3298] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:09:18.472791 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c8e37-174b-4c50-b89c-4c069f8c00d8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:18.494450 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1654/3299] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:09:18 2022] PUT /identity/v3/projects/322408cf9af04fbeb1f7770406e24cf8/users/56818ebbb5de483b85e6889ce59234e4/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:09:18.499971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cceb46-d5ee-4d23-a4f2-c3ca74a2ac63 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:18.500337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cceb46-d5ee-4d23-a4f2-c3ca74a2ac63 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:18.500560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cceb46-d5ee-4d23-a4f2-c3ca74a2ac63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:18.510468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c8e37-174b-4c50-b89c-4c069f8c00d8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:18.580326 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-22cceb46-d5ee-4d23-a4f2-c3ca74a2ac63 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:18.587141 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-22cceb46-d5ee-4d23-a4f2-c3ca74a2ac63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:18.739946 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81193b50-4b2d-4a2b-bfc7-dcfbc7fb3549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:18.743986 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81193b50-4b2d-4a2b-bfc7-dcfbc7fb3549 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:18.744417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81193b50-4b2d-4a2b-bfc7-dcfbc7fb3549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:18.744813 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81193b50-4b2d-4a2b-bfc7-dcfbc7fb3549 admin admin] PATH_INFO: `/v3/projects/224a8ff0e4d446f38fc3c7d56adadb17/users/929d38e4229443689a53f64845fc69b8/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:18.783220 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1655/3300] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:09:18.788018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81193b50-4b2d-4a2b-bfc7-dcfbc7fb3549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=224a8ff0e4d446f38fc3c7d56adadb17, user_id=929d38e4229443689a53f64845fc69b8, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:18.793920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81193b50-4b2d-4a2b-bfc7-dcfbc7fb3549 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:18.819175 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cceb46-d5ee-4d23-a4f2-c3ca74a2ac63 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:18.820686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-22cceb46-d5ee-4d23-a4f2-c3ca74a2ac63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:18.821827 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1646/3301] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:09:18 2022] PUT /identity/v3/projects/224a8ff0e4d446f38fc3c7d56adadb17/users/929d38e4229443689a53f64845fc69b8/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:09:18.834944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf28cc-ae78-4bdf-9cb5-07a582306dfe None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:18.835427 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf28cc-ae78-4bdf-9cb5-07a582306dfe None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:18.835849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf28cc-ae78-4bdf-9cb5-07a582306dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:18.910858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-42bf28cc-ae78-4bdf-9cb5-07a582306dfe None None] MFA Rules not processed for user `929d38e4229443689a53f64845fc69b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:18.916753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-42bf28cc-ae78-4bdf-9cb5-07a582306dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:18.969275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cceb46-d5ee-4d23-a4f2-c3ca74a2ac63 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:19.002576 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:19.130143 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1647/3302] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:09:19.145927 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf28cc-ae78-4bdf-9cb5-07a582306dfe None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:19.148435 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-42bf28cc-ae78-4bdf-9cb5-07a582306dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:19.176916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc58cec-2b77-4fc7-9716-b64fa93a4b00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:19.177654 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc58cec-2b77-4fc7-9716-b64fa93a4b00 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:19.180276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc58cec-2b77-4fc7-9716-b64fa93a4b00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:19.180706 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc58cec-2b77-4fc7-9716-b64fa93a4b00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:19.289848 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:19.355225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf28cc-ae78-4bdf-9cb5-07a582306dfe None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:19.363741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c740a63-6e4a-4a46-8f87-cbd0bcab2852 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efcee9b21ea94b1b8e5c9c5acb35839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:19.364804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c740a63-6e4a-4a46-8f87-cbd0bcab2852 service glance] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:19.366365 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c740a63-6e4a-4a46-8f87-cbd0bcab2852 service glance] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:19.366532 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c740a63-6e4a-4a46-8f87-cbd0bcab2852 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:19.396538 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c740a63-6e4a-4a46-8f87-cbd0bcab2852 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:19.396795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c740a63-6e4a-4a46-8f87-cbd0bcab2852 service glance] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:19.399245 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc58cec-2b77-4fc7-9716-b64fa93a4b00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:19.400756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc58cec-2b77-4fc7-9716-b64fa93a4b00 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:19.439562 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1656/3303] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:09:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:09:19.439811 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1648/3304] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:09:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:09:19.742380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfc2d4-bd01-46a2-b930-e918c39b8317 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:19.742735 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfc2d4-bd01-46a2-b930-e918c39b8317 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:19.743017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfc2d4-bd01-46a2-b930-e918c39b8317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:19.782641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-2fdfc2d4-bd01-46a2-b930-e918c39b8317 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:19.790886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2fdfc2d4-bd01-46a2-b930-e918c39b8317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:19.951508 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1657/3305] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:09:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:09:20.028017 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c740a63-6e4a-4a46-8f87-cbd0bcab2852 service glance] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:20.029022 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1c740a63-6e4a-4a46-8f87-cbd0bcab2852 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:20.191192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c740a63-6e4a-4a46-8f87-cbd0bcab2852 service glance] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:20.197083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123e416-b50e-4e7d-bf05-481bf087c68c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:20.199043 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123e416-b50e-4e7d-bf05-481bf087c68c service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:20.199337 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123e416-b50e-4e7d-bf05-481bf087c68c service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:20.199619 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123e416-b50e-4e7d-bf05-481bf087c68c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:20.209207 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9123e416-b50e-4e7d-bf05-481bf087c68c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:20.210912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9123e416-b50e-4e7d-bf05-481bf087c68c service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:20.221219 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1649/3306] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:09:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:09:24.900474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdfc2d4-bd01-46a2-b930-e918c39b8317 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:24.903324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2fdfc2d4-bd01-46a2-b930-e918c39b8317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:24.940944 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdfc2d4-bd01-46a2-b930-e918c39b8317 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:24.958209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b3778-50a9-4199-a21e-543a1681997e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:24.959034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b3778-50a9-4199-a21e-543a1681997e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:24.959437 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b3778-50a9-4199-a21e-543a1681997e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:24.962805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b3778-50a9-4199-a21e-543a1681997e admin admin] PATH_INFO: `/v3/users/41571ce2b64c4762b04ed0848bf34c4e` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:24.965155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b3778-50a9-4199-a21e-543a1681997e admin admin] RBAC: Authorizing `identity:delete_user(user_id=41571ce2b64c4762b04ed0848bf34c4e)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:24.969424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b3778-50a9-4199-a21e-543a1681997e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:25.086222 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c61b3778-50a9-4199-a21e-543a1681997e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41571ce2b64c4762b04ed0848bf34c4e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:25.087488 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c61b3778-50a9-4199-a21e-543a1681997e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41571ce2b64c4762b04ed0848bf34c4e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:25.103128 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c61b3778-50a9-4199-a21e-543a1681997e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41571ce2b64c4762b04ed0848bf34c4e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:25.125963 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c61b3778-50a9-4199-a21e-543a1681997e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41571ce2b64c4762b04ed0848bf34c4e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:25.127644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c61b3778-50a9-4199-a21e-543a1681997e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41571ce2b64c4762b04ed0848bf34c4e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:25.133816 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:25.169031 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1658/3307] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:09:24 2022] DELETE /identity/v3/users/41571ce2b64c4762b04ed0848bf34c4e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:09:26.627484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123e416-b50e-4e7d-bf05-481bf087c68c service swift] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:26.643862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123e416-b50e-4e7d-bf05-481bf087c68c service swift] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:26.804234 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2cd8b-cd73-4b95-be77-a2e560becaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:26.805904 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2cd8b-cd73-4b95-be77-a2e560becaa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:26.805904 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2cd8b-cd73-4b95-be77-a2e560becaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:26.805904 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2cd8b-cd73-4b95-be77-a2e560becaa6 admin admin] PATH_INFO: `/v3/projects/371b0bd7015f4f70aef1fd76572a52ff` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:26.807419 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2cd8b-cd73-4b95-be77-a2e560becaa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=371b0bd7015f4f70aef1fd76572a52ff)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:26.810469 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2cd8b-cd73-4b95-be77-a2e560becaa6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:26.949156 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a6c2cd8b-cd73-4b95-be77-a2e560becaa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '371b0bd7015f4f70aef1fd76572a52ff', 'request_id': 'req-a6c2cd8b-cd73-4b95-be77-a2e560becaa6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:26.968332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a6c2cd8b-cd73-4b95-be77-a2e560becaa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '371b0bd7015f4f70aef1fd76572a52ff', 'request_id': 'req-a6c2cd8b-cd73-4b95-be77-a2e560becaa6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:26.976981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a6c2cd8b-cd73-4b95-be77-a2e560becaa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '371b0bd7015f4f70aef1fd76572a52ff', 'request_id': 'req-a6c2cd8b-cd73-4b95-be77-a2e560becaa6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:27.010042 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a6c2cd8b-cd73-4b95-be77-a2e560becaa6 admin admin] The token cache is being invalidate because project 371b0bd7015f4f70aef1fd76572a52ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:09:27.010479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a6c2cd8b-cd73-4b95-be77-a2e560becaa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:27.011614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a6c2cd8b-cd73-4b95-be77-a2e560becaa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:27.014832 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1650/3308] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:09:26 2022] DELETE /identity/v3/projects/371b0bd7015f4f70aef1fd76572a52ff => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:09:27.019598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b3778-50a9-4199-a21e-543a1681997e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:27.022281 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c61b3778-50a9-4199-a21e-543a1681997e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:27.047093 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b3778-50a9-4199-a21e-543a1681997e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:27.145780 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c411047-ae1b-41f3-a2e8-b6f1623e9550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:27.146472 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c411047-ae1b-41f3-a2e8-b6f1623e9550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:27.146975 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c411047-ae1b-41f3-a2e8-b6f1623e9550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:27.160212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c411047-ae1b-41f3-a2e8-b6f1623e9550 admin admin] PATH_INFO: `/v3/users/1c179ae7b86c41a080ade6fae2897387` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:27.162890 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c411047-ae1b-41f3-a2e8-b6f1623e9550 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c179ae7b86c41a080ade6fae2897387)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:27.165803 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c411047-ae1b-41f3-a2e8-b6f1623e9550 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:27.241075 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4c411047-ae1b-41f3-a2e8-b6f1623e9550 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c179ae7b86c41a080ade6fae2897387'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:27.242303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4c411047-ae1b-41f3-a2e8-b6f1623e9550 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c179ae7b86c41a080ade6fae2897387'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:27.251765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4c411047-ae1b-41f3-a2e8-b6f1623e9550 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c179ae7b86c41a080ade6fae2897387'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:27.269664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4c411047-ae1b-41f3-a2e8-b6f1623e9550 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c179ae7b86c41a080ade6fae2897387'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:27.270722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4c411047-ae1b-41f3-a2e8-b6f1623e9550 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c179ae7b86c41a080ade6fae2897387'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:27.301743 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1659/3309] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:09:27 2022] DELETE /identity/v3/users/1c179ae7b86c41a080ade6fae2897387 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:09:27.821204 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2cd8b-cd73-4b95-be77-a2e560becaa6 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:27.823345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a6c2cd8b-cd73-4b95-be77-a2e560becaa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:27.835877 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:27.847685 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2cd8b-cd73-4b95-be77-a2e560becaa6 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:28.021481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c7287-3063-4d7a-ab2d-cced47c08362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:28.023202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c7287-3063-4d7a-ab2d-cced47c08362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:28.023700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c7287-3063-4d7a-ab2d-cced47c08362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:28.030787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c7287-3063-4d7a-ab2d-cced47c08362 admin admin] PATH_INFO: `/v3/projects/8f13113792d4413aad6feb6fb3e1f5d5` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:28.034777 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c7287-3063-4d7a-ab2d-cced47c08362 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f13113792d4413aad6feb6fb3e1f5d5)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:28.037535 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c7287-3063-4d7a-ab2d-cced47c08362 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:28.147145 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1c0c7287-3063-4d7a-ab2d-cced47c08362 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f13113792d4413aad6feb6fb3e1f5d5', 'request_id': 'req-1c0c7287-3063-4d7a-ab2d-cced47c08362'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:28.194499 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1c0c7287-3063-4d7a-ab2d-cced47c08362 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f13113792d4413aad6feb6fb3e1f5d5', 'request_id': 'req-1c0c7287-3063-4d7a-ab2d-cced47c08362'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:28.219376 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d5015-180e-4d9b-9eeb-91842bc0471d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:28.220374 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d5015-180e-4d9b-9eeb-91842bc0471d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:28.220861 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d5015-180e-4d9b-9eeb-91842bc0471d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:28.222801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1c0c7287-3063-4d7a-ab2d-cced47c08362 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f13113792d4413aad6feb6fb3e1f5d5', 'request_id': 'req-1c0c7287-3063-4d7a-ab2d-cced47c08362'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:28.250817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1c0c7287-3063-4d7a-ab2d-cced47c08362 admin admin] The token cache is being invalidate because project 8f13113792d4413aad6feb6fb3e1f5d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:09:28.251117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1c0c7287-3063-4d7a-ab2d-cced47c08362 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:28.253182 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1c0c7287-3063-4d7a-ab2d-cced47c08362 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:28.256610 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1651/3310] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:09:27 2022] DELETE /identity/v3/projects/8f13113792d4413aad6feb6fb3e1f5d5 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:09:28.261686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9108fc-8aac-4c71-ae95-ecf869cb0e6c None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:28.261982 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9108fc-8aac-4c71-ae95-ecf869cb0e6c None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:28.262247 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9108fc-8aac-4c71-ae95-ecf869cb0e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:28.279644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-602d5015-180e-4d9b-9eeb-91842bc0471d None None] MFA Rules not processed for user `d531146522f24a368a8c6ab482495776`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:28.281221 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-602d5015-180e-4d9b-9eeb-91842bc0471d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:28.294158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-1a9108fc-8aac-4c71-ae95-ecf869cb0e6c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:28.295400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1a9108fc-8aac-4c71-ae95-ecf869cb0e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:28.425546 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:28.434476 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1652/3311] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:09:28.442190 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744f4a6-aba2-4f0f-af26-a782e44ffc6b None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:28.470383 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1660/3312] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:09:28.476680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744f4a6-aba2-4f0f-af26-a782e44ffc6b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:28.476993 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744f4a6-aba2-4f0f-af26-a782e44ffc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:28.515509 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e744f4a6-aba2-4f0f-af26-a782e44ffc6b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:28.517914 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e744f4a6-aba2-4f0f-af26-a782e44ffc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:28.552928 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1653/3313] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:09:28.554539 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d5015-180e-4d9b-9eeb-91842bc0471d None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:28.592639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d5015-180e-4d9b-9eeb-91842bc0471d None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:28.612138 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de3ff8-e872-4dd3-abc5-0c906dd646a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:28.612551 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de3ff8-e872-4dd3-abc5-0c906dd646a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:28.612829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de3ff8-e872-4dd3-abc5-0c906dd646a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:28.613133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de3ff8-e872-4dd3-abc5-0c906dd646a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:28.613783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de3ff8-e872-4dd3-abc5-0c906dd646a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:09:28.614081 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de3ff8-e872-4dd3-abc5-0c906dd646a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:28.615773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de3ff8-e872-4dd3-abc5-0c906dd646a7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:28.648056 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1661/3314] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:09:28.652940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744f4a6-aba2-4f0f-af26-a782e44ffc6b None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:28.666682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744f4a6-aba2-4f0f-af26-a782e44ffc6b None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:28.684685 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f252ab-d5ce-4ccf-abf3-ba6ae2db44c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:28.686545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f252ab-d5ce-4ccf-abf3-ba6ae2db44c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:28.686545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f252ab-d5ce-4ccf-abf3-ba6ae2db44c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:28.686545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f252ab-d5ce-4ccf-abf3-ba6ae2db44c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:28.687309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f252ab-d5ce-4ccf-abf3-ba6ae2db44c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:28.689250 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f252ab-d5ce-4ccf-abf3-ba6ae2db44c4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:28.786067 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1654/3315] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:09:28 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:09:28.786545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de3ff8-e872-4dd3-abc5-0c906dd646a7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:28.802481 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de3ff8-e872-4dd3-abc5-0c906dd646a7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:29.029086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58409909-67c4-403c-af00-03cd845b3304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:29.029794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58409909-67c4-403c-af00-03cd845b3304 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:29.030076 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58409909-67c4-403c-af00-03cd845b3304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:29.030350 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58409909-67c4-403c-af00-03cd845b3304 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:29.031000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58409909-67c4-403c-af00-03cd845b3304 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:29.033087 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58409909-67c4-403c-af00-03cd845b3304 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:29.107901 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1662/3316] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:09:28 2022] POST /identity/v3/users => generated 293 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:09:29.112615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f252ab-d5ce-4ccf-abf3-ba6ae2db44c4 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:29.130650 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:29.145053 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f252ab-d5ce-4ccf-abf3-ba6ae2db44c4 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:29.161879 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9e043-9492-4073-8c2b-5f589c2e490a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:29.166982 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9e043-9492-4073-8c2b-5f589c2e490a admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:29.168926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9e043-9492-4073-8c2b-5f589c2e490a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:29.169761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9e043-9492-4073-8c2b-5f589c2e490a admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:29.172021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9e043-9492-4073-8c2b-5f589c2e490a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:29.178723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9e043-9492-4073-8c2b-5f589c2e490a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:29.243550 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1655/3317] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:09:29.248790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58409909-67c4-403c-af00-03cd845b3304 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:29.277185 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58409909-67c4-403c-af00-03cd845b3304 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:29.291981 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b64651-be4e-4eeb-a7fb-17fb1dc1ee4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:29.292775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b64651-be4e-4eeb-a7fb-17fb1dc1ee4d admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:29.293161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b64651-be4e-4eeb-a7fb-17fb1dc1ee4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:29.293593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b64651-be4e-4eeb-a7fb-17fb1dc1ee4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:29.296500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b64651-be4e-4eeb-a7fb-17fb1dc1ee4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:29.300671 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b64651-be4e-4eeb-a7fb-17fb1dc1ee4d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:29.337313 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1663/3318] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:09:29.342424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9e043-9492-4073-8c2b-5f589c2e490a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:29.358884 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9e043-9492-4073-8c2b-5f589c2e490a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:29.371067 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a01ec19-9fce-4484-bf20-6dfc60edc94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:29.371764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01ec19-9fce-4484-bf20-6dfc60edc94d admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:29.374492 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01ec19-9fce-4484-bf20-6dfc60edc94d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:29.374784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01ec19-9fce-4484-bf20-6dfc60edc94d admin admin] PATH_INFO: `/v3/projects/99e98b3dd5764d59ac409f5579b1a1e5/users/9f3809a6152945c49a1707624f3a56aa/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:29.417381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a01ec19-9fce-4484-bf20-6dfc60edc94d admin admin] RBAC: Authorizing `identity:create_grant(project_id=99e98b3dd5764d59ac409f5579b1a1e5, user_id=9f3809a6152945c49a1707624f3a56aa, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:29.420157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a01ec19-9fce-4484-bf20-6dfc60edc94d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:29.426893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b64651-be4e-4eeb-a7fb-17fb1dc1ee4d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:29.429074 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f5b64651-be4e-4eeb-a7fb-17fb1dc1ee4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:29.465320 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1656/3319] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:09:29 2022] PUT /identity/v3/projects/99e98b3dd5764d59ac409f5579b1a1e5/users/9f3809a6152945c49a1707624f3a56aa/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:09:29.552386 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270d563-5b81-458b-96b7-0e67f5cc6cf2 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:29.552671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270d563-5b81-458b-96b7-0e67f5cc6cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:29.552936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270d563-5b81-458b-96b7-0e67f5cc6cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:29.615384 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-6270d563-5b81-458b-96b7-0e67f5cc6cf2 None None] MFA Rules not processed for user `9f3809a6152945c49a1707624f3a56aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:29.616970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6270d563-5b81-458b-96b7-0e67f5cc6cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:29.632406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b64651-be4e-4eeb-a7fb-17fb1dc1ee4d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:29.749356 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:29.770504 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429eabb-08e9-44d3-9ea6-b1405a6727aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:29.771760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429eabb-08e9-44d3-9ea6-b1405a6727aa service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:29.772368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429eabb-08e9-44d3-9ea6-b1405a6727aa service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:29.772476 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1657/3320] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:09:29.772936 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429eabb-08e9-44d3-9ea6-b1405a6727aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:29.777135 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270d563-5b81-458b-96b7-0e67f5cc6cf2 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:29.891495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270d563-5b81-458b-96b7-0e67f5cc6cf2 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:29.906277 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32831a6c-bd52-4098-a9c8-9c86f6313f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:29.906964 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32831a6c-bd52-4098-a9c8-9c86f6313f4e admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:29.907242 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32831a6c-bd52-4098-a9c8-9c86f6313f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:29.907516 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32831a6c-bd52-4098-a9c8-9c86f6313f4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:29.909176 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32831a6c-bd52-4098-a9c8-9c86f6313f4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:29.914556 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32831a6c-bd52-4098-a9c8-9c86f6313f4e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:29.969247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429eabb-08e9-44d3-9ea6-b1405a6727aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:29.974002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429eabb-08e9-44d3-9ea6-b1405a6727aa service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:30.000410 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1658/3321] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:09:29 2022] POST /identity/v3/projects => generated 383 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:09:30.001708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32831a6c-bd52-4098-a9c8-9c86f6313f4e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:30.014147 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1664/3322] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:09:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:09:30.138026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71153703-4ac7-4281-92a6-aa71f84aa08e None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:30.138478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71153703-4ac7-4281-92a6-aa71f84aa08e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:30.139281 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71153703-4ac7-4281-92a6-aa71f84aa08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:30.170168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-71153703-4ac7-4281-92a6-aa71f84aa08e None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:30.172100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-71153703-4ac7-4281-92a6-aa71f84aa08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:30.196046 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:30.280716 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32831a6c-bd52-4098-a9c8-9c86f6313f4e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:30.294823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5813f10-5a16-4719-a989-d0618a16e052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:30.296381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5813f10-5a16-4719-a989-d0618a16e052 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:30.298870 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5813f10-5a16-4719-a989-d0618a16e052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:30.299332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5813f10-5a16-4719-a989-d0618a16e052 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:30.301919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5813f10-5a16-4719-a989-d0618a16e052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:30.310925 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5813f10-5a16-4719-a989-d0618a16e052 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:30.347007 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1665/3323] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 01:09:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:09:30.369702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71153703-4ac7-4281-92a6-aa71f84aa08e None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:30.371350 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-71153703-4ac7-4281-92a6-aa71f84aa08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:30.382376 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1659/3324] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:09:30 2022] POST /identity/v3/users => generated 298 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:09:30.387422 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5813f10-5a16-4719-a989-d0618a16e052 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:30.415621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5813f10-5a16-4719-a989-d0618a16e052 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:30.431323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192b224-1dc8-46a4-8540-4eee6fbd6508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:30.432741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192b224-1dc8-46a4-8540-4eee6fbd6508 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:30.434258 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192b224-1dc8-46a4-8540-4eee6fbd6508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:30.434639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192b224-1dc8-46a4-8540-4eee6fbd6508 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:30.437696 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d192b224-1dc8-46a4-8540-4eee6fbd6508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:30.441531 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d192b224-1dc8-46a4-8540-4eee6fbd6508 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:30.474565 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1660/3325] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:09:30.479133 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192b224-1dc8-46a4-8540-4eee6fbd6508 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:30.503369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192b224-1dc8-46a4-8540-4eee6fbd6508 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:30.515526 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793af76e-f537-46bb-af15-85fe8085ba80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:30.518315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793af76e-f537-46bb-af15-85fe8085ba80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:30.518460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793af76e-f537-46bb-af15-85fe8085ba80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:30.518663 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793af76e-f537-46bb-af15-85fe8085ba80 admin admin] PATH_INFO: `/v3/projects/19db92552d0047f9848b67aa4a8cb8f9/users/057c91d4b60f47ac97973bacceec5eef/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:30.566550 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793af76e-f537-46bb-af15-85fe8085ba80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19db92552d0047f9848b67aa4a8cb8f9, user_id=057c91d4b60f47ac97973bacceec5eef, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:30.572206 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793af76e-f537-46bb-af15-85fe8085ba80 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:30.578714 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71153703-4ac7-4281-92a6-aa71f84aa08e None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:30.598259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58b1ac-fcd0-40db-a2c6-f02e6da485ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:30.598911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58b1ac-fcd0-40db-a2c6-f02e6da485ff service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:30.599208 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58b1ac-fcd0-40db-a2c6-f02e6da485ff service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:30.599499 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58b1ac-fcd0-40db-a2c6-f02e6da485ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:30.610137 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1661/3326] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:09:30 2022] PUT /identity/v3/projects/19db92552d0047f9848b67aa4a8cb8f9/users/057c91d4b60f47ac97973bacceec5eef/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:09:30.615171 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793af76e-f537-46bb-af15-85fe8085ba80 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:30.654196 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58b1ac-fcd0-40db-a2c6-f02e6da485ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:30.656069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58b1ac-fcd0-40db-a2c6-f02e6da485ff service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:30.675277 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1666/3327] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:09:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 04 01:09:30.790951 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793af76e-f537-46bb-af15-85fe8085ba80 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:30.803544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef061f-12a7-42c2-9869-ec09b436342b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:30.806205 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef061f-12a7-42c2-9869-ec09b436342b admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:30.806493 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef061f-12a7-42c2-9869-ec09b436342b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:30.807473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef061f-12a7-42c2-9869-ec09b436342b admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:30.809306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef061f-12a7-42c2-9869-ec09b436342b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:30.811073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef061f-12a7-42c2-9869-ec09b436342b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:30.847770 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1662/3328] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:09:30.851418 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58b1ac-fcd0-40db-a2c6-f02e6da485ff service swift] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:30.882292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58b1ac-fcd0-40db-a2c6-f02e6da485ff service swift] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:30.894269 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143511f2-f4d9-4688-966b-fd8435e7321e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:30.895288 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143511f2-f4d9-4688-966b-fd8435e7321e admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:30.895781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143511f2-f4d9-4688-966b-fd8435e7321e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:30.896300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143511f2-f4d9-4688-966b-fd8435e7321e admin admin] PATH_INFO: `/v3/projects/19db92552d0047f9848b67aa4a8cb8f9/users/057c91d4b60f47ac97973bacceec5eef/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:30.902636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143511f2-f4d9-4688-966b-fd8435e7321e admin admin] RBAC: Authorizing `identity:create_grant(project_id=19db92552d0047f9848b67aa4a8cb8f9, user_id=057c91d4b60f47ac97973bacceec5eef, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:30.914858 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143511f2-f4d9-4688-966b-fd8435e7321e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:30.934204 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef061f-12a7-42c2-9869-ec09b436342b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:30.936985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-daef061f-12a7-42c2-9869-ec09b436342b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:30.953491 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1667/3329] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:09:30 2022] PUT /identity/v3/projects/19db92552d0047f9848b67aa4a8cb8f9/users/057c91d4b60f47ac97973bacceec5eef/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:09:30.962655 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7212365-816d-48e8-a784-0cce128ea1d9 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:30.963170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7212365-816d-48e8-a784-0cce128ea1d9 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:30.963449 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7212365-816d-48e8-a784-0cce128ea1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:30.975118 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef061f-12a7-42c2-9869-ec09b436342b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:31.041477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c7212365-816d-48e8-a784-0cce128ea1d9 None None] MFA Rules not processed for user `057c91d4b60f47ac97973bacceec5eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:31.043216 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c7212365-816d-48e8-a784-0cce128ea1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:31.050451 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:31.141790 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801dbb3-d28f-4039-b71a-12945ac9dd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:31.142459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801dbb3-d28f-4039-b71a-12945ac9dd24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:31.142753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801dbb3-d28f-4039-b71a-12945ac9dd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:31.143073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801dbb3-d28f-4039-b71a-12945ac9dd24 admin admin] PATH_INFO: `/v3/users/929d38e4229443689a53f64845fc69b8` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:31.156791 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e801dbb3-d28f-4039-b71a-12945ac9dd24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=929d38e4229443689a53f64845fc69b8)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:31.164168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e801dbb3-d28f-4039-b71a-12945ac9dd24 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:31.265225 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:31.277784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e801dbb3-d28f-4039-b71a-12945ac9dd24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '929d38e4229443689a53f64845fc69b8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:31.278691 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e801dbb3-d28f-4039-b71a-12945ac9dd24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '929d38e4229443689a53f64845fc69b8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:31.284416 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1668/3330] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:30 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:09:31.296279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e801dbb3-d28f-4039-b71a-12945ac9dd24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '929d38e4229443689a53f64845fc69b8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:31.313502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e801dbb3-d28f-4039-b71a-12945ac9dd24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '929d38e4229443689a53f64845fc69b8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:31.314591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e801dbb3-d28f-4039-b71a-12945ac9dd24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '929d38e4229443689a53f64845fc69b8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:31.355492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7212365-816d-48e8-a784-0cce128ea1d9 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:31.376201 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1663/3331] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:09:30 2022] DELETE /identity/v3/users/929d38e4229443689a53f64845fc69b8 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:09:31.381634 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6eb060-ff67-4a3a-b49f-ab1332ad6183 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:31.383588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6eb060-ff67-4a3a-b49f-ab1332ad6183 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:31.384025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6eb060-ff67-4a3a-b49f-ab1332ad6183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:31.460552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-3c6eb060-ff67-4a3a-b49f-ab1332ad6183 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:31.462831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3c6eb060-ff67-4a3a-b49f-ab1332ad6183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:31.481923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7212365-816d-48e8-a784-0cce128ea1d9 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:31.573036 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1664/3332] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:09:31.589307 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6eb060-ff67-4a3a-b49f-ab1332ad6183 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:31.592260 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3c6eb060-ff67-4a3a-b49f-ab1332ad6183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:31.617184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbbf4b-7e29-4d7f-9a64-68f9b90f0b26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:31.618158 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbbf4b-7e29-4d7f-9a64-68f9b90f0b26 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:31.619037 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbbf4b-7e29-4d7f-9a64-68f9b90f0b26 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:31.619898 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbbf4b-7e29-4d7f-9a64-68f9b90f0b26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:31.623551 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a0fbbf4b-7e29-4d7f-9a64-68f9b90f0b26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:31.696552 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:31.739304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6eb060-ff67-4a3a-b49f-ab1332ad6183 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:31.744330 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbef70-7b6a-4238-80e6-4fbcb34d70ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:31.745175 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbef70-7b6a-4238-80e6-4fbcb34d70ee service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:31.745581 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbef70-7b6a-4238-80e6-4fbcb34d70ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:31.745965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbef70-7b6a-4238-80e6-4fbcb34d70ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:31.751750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fbbf4b-7e29-4d7f-9a64-68f9b90f0b26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:31.753429 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fbbf4b-7e29-4d7f-9a64-68f9b90f0b26 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:31.762583 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cbef70-7b6a-4238-80e6-4fbcb34d70ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:31.765268 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cbef70-7b6a-4238-80e6-4fbcb34d70ee service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:31.782796 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1669/3333] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:09:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:09:31.821746 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1665/3334] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:09:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:09:32.319859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbbf4b-7e29-4d7f-9a64-68f9b90f0b26 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:32.321301 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a0fbbf4b-7e29-4d7f-9a64-68f9b90f0b26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:32.350828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbbf4b-7e29-4d7f-9a64-68f9b90f0b26 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:32.383141 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7563e18-344e-487d-b95b-af1c3b3e13eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:32.383810 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7563e18-344e-487d-b95b-af1c3b3e13eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:32.384225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7563e18-344e-487d-b95b-af1c3b3e13eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:32.384482 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7563e18-344e-487d-b95b-af1c3b3e13eb admin admin] PATH_INFO: `/v3/users/9f3809a6152945c49a1707624f3a56aa` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:32.392383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7563e18-344e-487d-b95b-af1c3b3e13eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f3809a6152945c49a1707624f3a56aa)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:32.394648 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7563e18-344e-487d-b95b-af1c3b3e13eb admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:32.554053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e7563e18-344e-487d-b95b-af1c3b3e13eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f3809a6152945c49a1707624f3a56aa'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:32.556477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e7563e18-344e-487d-b95b-af1c3b3e13eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f3809a6152945c49a1707624f3a56aa'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:32.581943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e7563e18-344e-487d-b95b-af1c3b3e13eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f3809a6152945c49a1707624f3a56aa'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:32.598094 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e7563e18-344e-487d-b95b-af1c3b3e13eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f3809a6152945c49a1707624f3a56aa'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:32.598733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e7563e18-344e-487d-b95b-af1c3b3e13eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f3809a6152945c49a1707624f3a56aa'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:32.646439 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1670/3335] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:09:32 2022] DELETE /identity/v3/users/9f3809a6152945c49a1707624f3a56aa => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:09:32.647953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff46239-ecdb-478c-8c84-96c191adefc0 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:32.648418 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff46239-ecdb-478c-8c84-96c191adefc0 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:32.648495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff46239-ecdb-478c-8c84-96c191adefc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:32.694855 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-cff46239-ecdb-478c-8c84-96c191adefc0 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:32.696532 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-cff46239-ecdb-478c-8c84-96c191adefc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:32.836199 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:32.859166 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1666/3336] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:09:32.875521 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7563e18-344e-487d-b95b-af1c3b3e13eb admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:32.877187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e7563e18-344e-487d-b95b-af1c3b3e13eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:32.985029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7563e18-344e-487d-b95b-af1c3b3e13eb admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:32.991712 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb9300-7fc1-484c-963c-4416c16f6842 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:32.992819 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb9300-7fc1-484c-963c-4416c16f6842 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:32.993201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb9300-7fc1-484c-963c-4416c16f6842 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:32.994653 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb9300-7fc1-484c-963c-4416c16f6842 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:33.019187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb9300-7fc1-484c-963c-4416c16f6842 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:33.022185 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb9300-7fc1-484c-963c-4416c16f6842 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:33.036247 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1671/3337] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:09:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:09:33.456469 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff46239-ecdb-478c-8c84-96c191adefc0 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:33.458352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-cff46239-ecdb-478c-8c84-96c191adefc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:33.486798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff46239-ecdb-478c-8c84-96c191adefc0 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:33.497753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd90f2-2345-4f8c-be88-43e1503718e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:33.498653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd90f2-2345-4f8c-be88-43e1503718e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:33.499021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd90f2-2345-4f8c-be88-43e1503718e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:33.499308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd90f2-2345-4f8c-be88-43e1503718e8 admin admin] PATH_INFO: `/v3/projects/224a8ff0e4d446f38fc3c7d56adadb17` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:33.501877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd90f2-2345-4f8c-be88-43e1503718e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=224a8ff0e4d446f38fc3c7d56adadb17)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:33.503872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd90f2-2345-4f8c-be88-43e1503718e8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:33.606889 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-01fd90f2-2345-4f8c-be88-43e1503718e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '224a8ff0e4d446f38fc3c7d56adadb17', 'request_id': 'req-01fd90f2-2345-4f8c-be88-43e1503718e8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:33.619006 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-01fd90f2-2345-4f8c-be88-43e1503718e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '224a8ff0e4d446f38fc3c7d56adadb17', 'request_id': 'req-01fd90f2-2345-4f8c-be88-43e1503718e8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:33.638590 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-01fd90f2-2345-4f8c-be88-43e1503718e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '224a8ff0e4d446f38fc3c7d56adadb17', 'request_id': 'req-01fd90f2-2345-4f8c-be88-43e1503718e8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:33.662583 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-01fd90f2-2345-4f8c-be88-43e1503718e8 admin admin] The token cache is being invalidate because project 224a8ff0e4d446f38fc3c7d56adadb17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:09:33.664035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-01fd90f2-2345-4f8c-be88-43e1503718e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:33.665499 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-01fd90f2-2345-4f8c-be88-43e1503718e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:33.668094 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1667/3338] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:09:33 2022] DELETE /identity/v3/projects/224a8ff0e4d446f38fc3c7d56adadb17 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:09:33.677407 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adaec47-67ab-40af-be57-49f665cda363 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:33.677407 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adaec47-67ab-40af-be57-49f665cda363 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:33.677991 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adaec47-67ab-40af-be57-49f665cda363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:33.728587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-9adaec47-67ab-40af-be57-49f665cda363 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:33.731607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9adaec47-67ab-40af-be57-49f665cda363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:33.803765 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:33.852855 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1672/3339] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:09:33.862269 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f6646-dbbb-4c58-8edf-0dfefc917c01 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:33.862674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f6646-dbbb-4c58-8edf-0dfefc917c01 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:33.862949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f6646-dbbb-4c58-8edf-0dfefc917c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:33.903326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-429f6646-dbbb-4c58-8edf-0dfefc917c01 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:33.904479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-429f6646-dbbb-4c58-8edf-0dfefc917c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:33.913605 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1668/3340] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:09:33.918328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adaec47-67ab-40af-be57-49f665cda363 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:33.931098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adaec47-67ab-40af-be57-49f665cda363 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:33.937717 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a2288-3799-4712-a277-04c036bccb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:33.940328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a2288-3799-4712-a277-04c036bccb2b admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:33.940328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a2288-3799-4712-a277-04c036bccb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:33.940328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a2288-3799-4712-a277-04c036bccb2b admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:33.940328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a2288-3799-4712-a277-04c036bccb2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:09:33.940328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a2288-3799-4712-a277-04c036bccb2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:33.942387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a2288-3799-4712-a277-04c036bccb2b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:33.981774 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1673/3341] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:09:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:09:33.987108 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f6646-dbbb-4c58-8edf-0dfefc917c01 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:34.002441 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f6646-dbbb-4c58-8edf-0dfefc917c01 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:34.009861 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012038a3-3386-468d-89dd-87b7dc5393e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:34.010500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012038a3-3386-468d-89dd-87b7dc5393e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:34.010850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012038a3-3386-468d-89dd-87b7dc5393e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:34.011125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012038a3-3386-468d-89dd-87b7dc5393e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:34.011952 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012038a3-3386-468d-89dd-87b7dc5393e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:34.016200 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012038a3-3386-468d-89dd-87b7dc5393e6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:34.058549 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1669/3342] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:09:33 2022] POST /identity/v3/projects => generated 397 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:09:34.063040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a2288-3799-4712-a277-04c036bccb2b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:34.081373 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a2288-3799-4712-a277-04c036bccb2b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:34.199657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b0e32-f9f2-40ef-a79f-42c1e67a241c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:34.200277 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b0e32-f9f2-40ef-a79f-42c1e67a241c admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:34.200556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b0e32-f9f2-40ef-a79f-42c1e67a241c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:34.200828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b0e32-f9f2-40ef-a79f-42c1e67a241c admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:34.201488 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b0e32-f9f2-40ef-a79f-42c1e67a241c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:34.203443 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b0e32-f9f2-40ef-a79f-42c1e67a241c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:34.250922 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1674/3343] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:09:34 2022] POST /identity/v3/users => generated 299 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:09:34.256020 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012038a3-3386-468d-89dd-87b7dc5393e6 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:34.273876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012038a3-3386-468d-89dd-87b7dc5393e6 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:34.288401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1ec9a-6244-479d-9317-560cef1179fe None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:34.288668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1ec9a-6244-479d-9317-560cef1179fe None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:34.288945 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1ec9a-6244-479d-9317-560cef1179fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:34.294389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f417a-6792-4189-9708-8f5eac751618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:34.295097 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f417a-6792-4189-9708-8f5eac751618 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:34.295537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f417a-6792-4189-9708-8f5eac751618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:34.295829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f417a-6792-4189-9708-8f5eac751618 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:34.296497 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f417a-6792-4189-9708-8f5eac751618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:34.304773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f417a-6792-4189-9708-8f5eac751618 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:34.320471 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c8a1ec9a-6244-479d-9317-560cef1179fe None None] MFA Rules not processed for user `a76409b5ae334b8fa88b4b089ebfa79c`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:34.322779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c8a1ec9a-6244-479d-9317-560cef1179fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:34.328378 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1670/3344] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:09:34.332919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f417a-6792-4189-9708-8f5eac751618 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:34.347782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f417a-6792-4189-9708-8f5eac751618 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:34.355843 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c73d0f-a9cc-4ea7-ad47-f37f0930b63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:34.357198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c73d0f-a9cc-4ea7-ad47-f37f0930b63b admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:34.358263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c73d0f-a9cc-4ea7-ad47-f37f0930b63b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:34.358804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c73d0f-a9cc-4ea7-ad47-f37f0930b63b admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:34.359679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c73d0f-a9cc-4ea7-ad47-f37f0930b63b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:34.362131 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c73d0f-a9cc-4ea7-ad47-f37f0930b63b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:34.378861 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1671/3345] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:09:34.382228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c73d0f-a9cc-4ea7-ad47-f37f0930b63b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:34.400069 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c73d0f-a9cc-4ea7-ad47-f37f0930b63b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:34.407874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5eea0-6f94-400f-8e61-e86a5e41897a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:34.408895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5eea0-6f94-400f-8e61-e86a5e41897a admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:34.409603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5eea0-6f94-400f-8e61-e86a5e41897a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:34.410124 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5eea0-6f94-400f-8e61-e86a5e41897a admin admin] PATH_INFO: `/v3/projects/1e11f1b859f144d4b369829be5a0a54a/users/8b7578fbd3264100b8e030353ff72ae4/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:34.458117 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1675/3346] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:34 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:09:34.460054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5eea0-6f94-400f-8e61-e86a5e41897a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e11f1b859f144d4b369829be5a0a54a, user_id=8b7578fbd3264100b8e030353ff72ae4, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:34.463647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5eea0-6f94-400f-8e61-e86a5e41897a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:34.488270 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1672/3347] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:09:34 2022] PUT /identity/v3/projects/1e11f1b859f144d4b369829be5a0a54a/users/8b7578fbd3264100b8e030353ff72ae4/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:09:34.498844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb562a1-e0ab-4d02-a778-93546df24b9c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:34.499495 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb562a1-e0ab-4d02-a778-93546df24b9c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:34.499913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb562a1-e0ab-4d02-a778-93546df24b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:34.560277 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-4bb562a1-e0ab-4d02-a778-93546df24b9c None None] MFA Rules not processed for user `8b7578fbd3264100b8e030353ff72ae4`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:34.562128 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4bb562a1-e0ab-4d02-a778-93546df24b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:34.683700 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:34.702246 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1676/3348] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:34 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:09:34.723759 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5eea0-6f94-400f-8e61-e86a5e41897a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:34.727438 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-90c5eea0-6f94-400f-8e61-e86a5e41897a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:34.788941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb562a1-e0ab-4d02-a778-93546df24b9c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:34.790590 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4bb562a1-e0ab-4d02-a778-93546df24b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:34.852958 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:34.874512 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5eea0-6f94-400f-8e61-e86a5e41897a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:34.875858 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb562a1-e0ab-4d02-a778-93546df24b9c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:34.880701 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb875669-a9f4-4684-9016-c8d925993aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:34.881308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb875669-a9f4-4684-9016-c8d925993aef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:34.881634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb875669-a9f4-4684-9016-c8d925993aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:34.881907 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb875669-a9f4-4684-9016-c8d925993aef admin admin] PATH_INFO: `/v3/projects/99e98b3dd5764d59ac409f5579b1a1e5` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:34.883085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb875669-a9f4-4684-9016-c8d925993aef admin admin] RBAC: Authorizing `identity:delete_project(project_id=99e98b3dd5764d59ac409f5579b1a1e5)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:34.884067 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6ad6d-2ddb-460b-ae46-ee8b7c884e34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:34.885205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb875669-a9f4-4684-9016-c8d925993aef admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:34.886780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6ad6d-2ddb-460b-ae46-ee8b7c884e34 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:34.887557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6ad6d-2ddb-460b-ae46-ee8b7c884e34 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:34.888089 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6ad6d-2ddb-460b-ae46-ee8b7c884e34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:34.899628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee6ad6d-2ddb-460b-ae46-ee8b7c884e34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:34.902701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee6ad6d-2ddb-460b-ae46-ee8b7c884e34 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:34.938232 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1673/3349] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:09:34 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:09:34.966827 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-eb875669-a9f4-4684-9016-c8d925993aef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99e98b3dd5764d59ac409f5579b1a1e5', 'request_id': 'req-eb875669-a9f4-4684-9016-c8d925993aef'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:34.978150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-eb875669-a9f4-4684-9016-c8d925993aef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99e98b3dd5764d59ac409f5579b1a1e5', 'request_id': 'req-eb875669-a9f4-4684-9016-c8d925993aef'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:34.991997 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-eb875669-a9f4-4684-9016-c8d925993aef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99e98b3dd5764d59ac409f5579b1a1e5', 'request_id': 'req-eb875669-a9f4-4684-9016-c8d925993aef'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:35.004343 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-eb875669-a9f4-4684-9016-c8d925993aef admin admin] The token cache is being invalidate because project 99e98b3dd5764d59ac409f5579b1a1e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:09:35.004628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-eb875669-a9f4-4684-9016-c8d925993aef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:35.005324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-eb875669-a9f4-4684-9016-c8d925993aef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:35.009706 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1677/3350] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:09:34 2022] DELETE /identity/v3/projects/99e98b3dd5764d59ac409f5579b1a1e5 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:09:35.012369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6ad6d-2ddb-460b-ae46-ee8b7c884e34 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:35.036338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6ad6d-2ddb-460b-ae46-ee8b7c884e34 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:35.123617 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c8bd2-1ea8-4a06-9332-c08b33ec2132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:35.124662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c8bd2-1ea8-4a06-9332-c08b33ec2132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:35.125154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c8bd2-1ea8-4a06-9332-c08b33ec2132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:35.125455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c8bd2-1ea8-4a06-9332-c08b33ec2132 admin admin] PATH_INFO: `/v3/users/057c91d4b60f47ac97973bacceec5eef` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:35.126699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c8bd2-1ea8-4a06-9332-c08b33ec2132 admin admin] RBAC: Authorizing `identity:delete_user(user_id=057c91d4b60f47ac97973bacceec5eef)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:35.128645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c8bd2-1ea8-4a06-9332-c08b33ec2132 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:35.209142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f91c8bd2-1ea8-4a06-9332-c08b33ec2132 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '057c91d4b60f47ac97973bacceec5eef'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:35.209883 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f91c8bd2-1ea8-4a06-9332-c08b33ec2132 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '057c91d4b60f47ac97973bacceec5eef'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:35.220931 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f91c8bd2-1ea8-4a06-9332-c08b33ec2132 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '057c91d4b60f47ac97973bacceec5eef'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:35.229889 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f91c8bd2-1ea8-4a06-9332-c08b33ec2132 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '057c91d4b60f47ac97973bacceec5eef'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:35.230787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f91c8bd2-1ea8-4a06-9332-c08b33ec2132 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '057c91d4b60f47ac97973bacceec5eef'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:35.261622 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1674/3351] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:09:35 2022] DELETE /identity/v3/users/057c91d4b60f47ac97973bacceec5eef => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:09:35.711816 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000151e-a5a4-48b8-b772-d2946bb29550 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:35.712639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000151e-a5a4-48b8-b772-d2946bb29550 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:35.713070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000151e-a5a4-48b8-b772-d2946bb29550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:35.735702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-4000151e-a5a4-48b8-b772-d2946bb29550 None None] MFA Rules not processed for user `d531146522f24a368a8c6ab482495776`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:35.737221 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4000151e-a5a4-48b8-b772-d2946bb29550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:35.832417 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1678/3352] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:09:36.037563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c8bd2-1ea8-4a06-9332-c08b33ec2132 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:36.040291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f91c8bd2-1ea8-4a06-9332-c08b33ec2132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:36.086855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d1237-15a1-4a1c-85e1-20955a02e7ab None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:36.087138 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d1237-15a1-4a1c-85e1-20955a02e7ab None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:36.087413 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d1237-15a1-4a1c-85e1-20955a02e7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:36.151740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-d41d1237-15a1-4a1c-85e1-20955a02e7ab None None] MFA Rules not processed for user `2f06e2312dcc49969c19772035ddab99`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:36.153240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d41d1237-15a1-4a1c-85e1-20955a02e7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:36.169484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c8bd2-1ea8-4a06-9332-c08b33ec2132 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:36.175788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbb3e0-3f0e-4b09-8491-72ba22f4fe38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:36.176923 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbb3e0-3f0e-4b09-8491-72ba22f4fe38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:36.177511 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbb3e0-3f0e-4b09-8491-72ba22f4fe38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:36.178185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbb3e0-3f0e-4b09-8491-72ba22f4fe38 admin admin] PATH_INFO: `/v3/projects/19db92552d0047f9848b67aa4a8cb8f9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:36.179873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bbb3e0-3f0e-4b09-8491-72ba22f4fe38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19db92552d0047f9848b67aa4a8cb8f9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:36.182373 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bbb3e0-3f0e-4b09-8491-72ba22f4fe38 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:36.204300 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:36.220033 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:36.277118 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e5bbb3e0-3f0e-4b09-8491-72ba22f4fe38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19db92552d0047f9848b67aa4a8cb8f9', 'request_id': 'req-e5bbb3e0-3f0e-4b09-8491-72ba22f4fe38'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:36.309382 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1679/3353] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:36 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:09:36.310101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e5bbb3e0-3f0e-4b09-8491-72ba22f4fe38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19db92552d0047f9848b67aa4a8cb8f9', 'request_id': 'req-e5bbb3e0-3f0e-4b09-8491-72ba22f4fe38'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:36.318374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e5bbb3e0-3f0e-4b09-8491-72ba22f4fe38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19db92552d0047f9848b67aa4a8cb8f9', 'request_id': 'req-e5bbb3e0-3f0e-4b09-8491-72ba22f4fe38'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:36.322117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab53f7b-985a-4da1-b4af-8240ce6adb64 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:36.323843 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab53f7b-985a-4da1-b4af-8240ce6adb64 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:36.324148 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab53f7b-985a-4da1-b4af-8240ce6adb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:36.340497 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e5bbb3e0-3f0e-4b09-8491-72ba22f4fe38 admin admin] The token cache is being invalidate because project 19db92552d0047f9848b67aa4a8cb8f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:09:36.342570 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e5bbb3e0-3f0e-4b09-8491-72ba22f4fe38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:36.344522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e5bbb3e0-3f0e-4b09-8491-72ba22f4fe38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:36.350808 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1675/3354] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:09:36 2022] DELETE /identity/v3/projects/19db92552d0047f9848b67aa4a8cb8f9 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:09:36.356247 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fb86e-4158-4387-a5f4-ffb6bedd9d83 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:36.357014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fb86e-4158-4387-a5f4-ffb6bedd9d83 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:36.357326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fb86e-4158-4387-a5f4-ffb6bedd9d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:36.393752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-5ab53f7b-985a-4da1-b4af-8240ce6adb64 None None] MFA Rules not processed for user `2f06e2312dcc49969c19772035ddab99`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:36.397977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5ab53f7b-985a-4da1-b4af-8240ce6adb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:36.406011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-4e0fb86e-4158-4387-a5f4-ffb6bedd9d83 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:36.408587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4e0fb86e-4158-4387-a5f4-ffb6bedd9d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:36.518445 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1676/3355] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:09:36.520809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac542d-d353-469b-8329-1427c59be214 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:36.521220 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac542d-d353-469b-8329-1427c59be214 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:36.521645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac542d-d353-469b-8329-1427c59be214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:36.546125 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1680/3356] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:36 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:09:36.573829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5dac542d-d353-469b-8329-1427c59be214 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:36.574781 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5dac542d-d353-469b-8329-1427c59be214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:36.596894 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1677/3357] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:09:36.600798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab53f7b-985a-4da1-b4af-8240ce6adb64 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:36.620237 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab53f7b-985a-4da1-b4af-8240ce6adb64 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:36.634100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b16b0-be0b-4bf7-9718-1eb576ba8d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:36.635267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b16b0-be0b-4bf7-9718-1eb576ba8d1e admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:36.636606 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b16b0-be0b-4bf7-9718-1eb576ba8d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:36.636606 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b16b0-be0b-4bf7-9718-1eb576ba8d1e admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:36.636999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b16b0-be0b-4bf7-9718-1eb576ba8d1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:09:36.637303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b16b0-be0b-4bf7-9718-1eb576ba8d1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:36.638960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b16b0-be0b-4bf7-9718-1eb576ba8d1e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:36.700893 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1681/3358] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:09:36.705362 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac542d-d353-469b-8329-1427c59be214 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:36.718637 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac542d-d353-469b-8329-1427c59be214 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:36.741586 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f362ce-e4bb-4d61-ace6-5fdf7c06f524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:36.745487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f362ce-e4bb-4d61-ace6-5fdf7c06f524 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:36.753874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f362ce-e4bb-4d61-ace6-5fdf7c06f524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:36.755845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f362ce-e4bb-4d61-ace6-5fdf7c06f524 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:36.756736 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f362ce-e4bb-4d61-ace6-5fdf7c06f524 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:36.763579 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f362ce-e4bb-4d61-ace6-5fdf7c06f524 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:36.869828 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1678/3359] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:09:36 2022] POST /identity/v3/projects => generated 403 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:09:36.871092 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b16b0-be0b-4bf7-9718-1eb576ba8d1e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:36.881903 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b16b0-be0b-4bf7-9718-1eb576ba8d1e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:37.073977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de2faf-2f37-440f-a104-9e673edb4e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:37.076315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de2faf-2f37-440f-a104-9e673edb4e57 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:37.076609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de2faf-2f37-440f-a104-9e673edb4e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:37.081090 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de2faf-2f37-440f-a104-9e673edb4e57 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:37.082512 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de2faf-2f37-440f-a104-9e673edb4e57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:37.086772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de2faf-2f37-440f-a104-9e673edb4e57 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:37.101759 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f362ce-e4bb-4d61-ace6-5fdf7c06f524 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:37.106222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-53f362ce-e4bb-4d61-ace6-5fdf7c06f524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:37.138991 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1682/3360] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:09:36 2022] POST /identity/v3/users => generated 302 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:09:37.146487 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de2faf-2f37-440f-a104-9e673edb4e57 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:37.161944 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de2faf-2f37-440f-a104-9e673edb4e57 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:37.175079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efdf123-6739-422c-8ad2-945bf16438fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:37.175717 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdf123-6739-422c-8ad2-945bf16438fa admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:37.176056 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdf123-6739-422c-8ad2-945bf16438fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:37.176323 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdf123-6739-422c-8ad2-945bf16438fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:37.176970 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efdf123-6739-422c-8ad2-945bf16438fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:37.178606 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efdf123-6739-422c-8ad2-945bf16438fa admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:37.204981 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1683/3361] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:09:37.209039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efdf123-6739-422c-8ad2-945bf16438fa admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:37.245083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efdf123-6739-422c-8ad2-945bf16438fa admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:37.267790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45013a-3cbb-4e89-9495-650eb28170ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:37.268417 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45013a-3cbb-4e89-9495-650eb28170ca admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:37.268695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45013a-3cbb-4e89-9495-650eb28170ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:37.268961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45013a-3cbb-4e89-9495-650eb28170ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:37.269628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf45013a-3cbb-4e89-9495-650eb28170ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:37.271225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf45013a-3cbb-4e89-9495-650eb28170ca admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:37.311816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f362ce-e4bb-4d61-ace6-5fdf7c06f524 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:37.323041 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1684/3362] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:09:37.325045 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45013a-3cbb-4e89-9495-650eb28170ca admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:37.338658 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d180dd-baa7-4f5e-8021-58a7ac498b01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:37.339626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d180dd-baa7-4f5e-8021-58a7ac498b01 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:37.339989 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d180dd-baa7-4f5e-8021-58a7ac498b01 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:37.340327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d180dd-baa7-4f5e-8021-58a7ac498b01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:37.342747 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f5d180dd-baa7-4f5e-8021-58a7ac498b01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:37.358961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45013a-3cbb-4e89-9495-650eb28170ca admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:37.372149 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:37.383496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be4ee2-6547-4ed9-83d2-00a7e6352477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:37.384389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be4ee2-6547-4ed9-83d2-00a7e6352477 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:37.385779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be4ee2-6547-4ed9-83d2-00a7e6352477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:37.386313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be4ee2-6547-4ed9-83d2-00a7e6352477 admin admin] PATH_INFO: `/v3/projects/c69b1eb1e2024f1f8fe4c57df75b3b2f/users/80d784ae6ed44d62b72ee596ef91d043/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:37.439537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be4ee2-6547-4ed9-83d2-00a7e6352477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c69b1eb1e2024f1f8fe4c57df75b3b2f, user_id=80d784ae6ed44d62b72ee596ef91d043, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:37.442538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be4ee2-6547-4ed9-83d2-00a7e6352477 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:37.468371 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:37.484254 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1685/3363] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:09:37 2022] PUT /identity/v3/projects/c69b1eb1e2024f1f8fe4c57df75b3b2f/users/80d784ae6ed44d62b72ee596ef91d043/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:09:37.497027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e240bd1-5618-4515-bdd3-e587799fcfdf None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:37.497625 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e240bd1-5618-4515-bdd3-e587799fcfdf None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:37.498194 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e240bd1-5618-4515-bdd3-e587799fcfdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:37.511743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d180dd-baa7-4f5e-8021-58a7ac498b01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:37.513357 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d180dd-baa7-4f5e-8021-58a7ac498b01 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:37.539595 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1679/3364] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:09:37 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:09:37.563775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-1e240bd1-5618-4515-bdd3-e587799fcfdf None None] MFA Rules not processed for user `80d784ae6ed44d62b72ee596ef91d043`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:37.565136 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1e240bd1-5618-4515-bdd3-e587799fcfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:37.735255 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1686/3365] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:37 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:09:37.736323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d180dd-baa7-4f5e-8021-58a7ac498b01 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:37.755843 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d180dd-baa7-4f5e-8021-58a7ac498b01 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:37.924614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cbcf5-fe7d-4000-8db2-61634fe96b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:37.926020 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cbcf5-fe7d-4000-8db2-61634fe96b1d admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:37.927477 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cbcf5-fe7d-4000-8db2-61634fe96b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:37.928389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cbcf5-fe7d-4000-8db2-61634fe96b1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:37.930511 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538cbcf5-fe7d-4000-8db2-61634fe96b1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:37.934429 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538cbcf5-fe7d-4000-8db2-61634fe96b1d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:37.993319 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e240bd1-5618-4515-bdd3-e587799fcfdf None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:37.994868 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1e240bd1-5618-4515-bdd3-e587799fcfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:38.022670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e240bd1-5618-4515-bdd3-e587799fcfdf None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:38.040311 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d5e0c-500e-4078-8b41-e70fa8b30273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:38.040979 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d5e0c-500e-4078-8b41-e70fa8b30273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:38.041263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d5e0c-500e-4078-8b41-e70fa8b30273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:38.041561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d5e0c-500e-4078-8b41-e70fa8b30273 admin admin] PATH_INFO: `/v3/users/8b7578fbd3264100b8e030353ff72ae4` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:38.043912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d5e0c-500e-4078-8b41-e70fa8b30273 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b7578fbd3264100b8e030353ff72ae4)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:38.046964 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d5e0c-500e-4078-8b41-e70fa8b30273 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:38.098449 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1680/3366] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:09:37 2022] POST /identity/v3/projects => generated 403 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:09:38.101336 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cbcf5-fe7d-4000-8db2-61634fe96b1d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:38.121248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-be8d5e0c-500e-4078-8b41-e70fa8b30273 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b7578fbd3264100b8e030353ff72ae4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:38.123119 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-be8d5e0c-500e-4078-8b41-e70fa8b30273 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b7578fbd3264100b8e030353ff72ae4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:38.134149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-be8d5e0c-500e-4078-8b41-e70fa8b30273 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b7578fbd3264100b8e030353ff72ae4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:38.154320 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-be8d5e0c-500e-4078-8b41-e70fa8b30273 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b7578fbd3264100b8e030353ff72ae4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:38.155520 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-be8d5e0c-500e-4078-8b41-e70fa8b30273 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b7578fbd3264100b8e030353ff72ae4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:38.200772 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1687/3367] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:09:37 2022] DELETE /identity/v3/users/8b7578fbd3264100b8e030353ff72ae4 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:09:38.204947 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bb845-0fde-49da-8694-a638f2220c39 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:38.205628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bb845-0fde-49da-8694-a638f2220c39 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:38.206044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bb845-0fde-49da-8694-a638f2220c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:38.246539 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c79bb845-0fde-49da-8694-a638f2220c39 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:38.247760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c79bb845-0fde-49da-8694-a638f2220c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:38.292420 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cbcf5-fe7d-4000-8db2-61634fe96b1d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:38.360753 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:38.381119 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1688/3368] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:09:38.412135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bb845-0fde-49da-8694-a638f2220c39 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:38.414267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c79bb845-0fde-49da-8694-a638f2220c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:38.417919 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:38.463110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee1ff4-f569-440c-bb07-3e31dcfefd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:38.464137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee1ff4-f569-440c-bb07-3e31dcfefd93 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:38.464137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee1ff4-f569-440c-bb07-3e31dcfefd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:38.464862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee1ff4-f569-440c-bb07-3e31dcfefd93 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:38.465666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee1ff4-f569-440c-bb07-3e31dcfefd93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:38.467972 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee1ff4-f569-440c-bb07-3e31dcfefd93 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:38.495969 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1681/3369] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:09:38 2022] POST /identity/v3/users => generated 308 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:09:38.510157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee1ff4-f569-440c-bb07-3e31dcfefd93 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:38.516177 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-76ee1ff4-f569-440c-bb07-3e31dcfefd93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:38.541291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee1ff4-f569-440c-bb07-3e31dcfefd93 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:38.559265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c163c88-3dea-411c-a581-47ee6772ff08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:38.566119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c163c88-3dea-411c-a581-47ee6772ff08 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:38.566549 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c163c88-3dea-411c-a581-47ee6772ff08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:38.567076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c163c88-3dea-411c-a581-47ee6772ff08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:38.568041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c163c88-3dea-411c-a581-47ee6772ff08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:38.569834 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c163c88-3dea-411c-a581-47ee6772ff08 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:38.597854 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1682/3370] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:09:38.600859 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c163c88-3dea-411c-a581-47ee6772ff08 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:38.633872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c163c88-3dea-411c-a581-47ee6772ff08 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:38.648650 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386138e9-3352-46c2-b03e-5215f055722a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:38.649719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386138e9-3352-46c2-b03e-5215f055722a admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:38.650079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386138e9-3352-46c2-b03e-5215f055722a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:38.651106 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386138e9-3352-46c2-b03e-5215f055722a admin admin] PATH_INFO: `/v3/projects/674cf6891e524959b2bb75ff4378fe58/users/b8cf7883b7324a36810bc10fef6b4326/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:38.659035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bb845-0fde-49da-8694-a638f2220c39 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:38.684754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386138e9-3352-46c2-b03e-5215f055722a admin admin] RBAC: Authorizing `identity:create_grant(project_id=674cf6891e524959b2bb75ff4378fe58, user_id=b8cf7883b7324a36810bc10fef6b4326, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:38.684754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386138e9-3352-46c2-b03e-5215f055722a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:38.685267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622a11c-fa33-422d-8791-6a241208c56a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:38.685267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622a11c-fa33-422d-8791-6a241208c56a service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:38.685267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622a11c-fa33-422d-8791-6a241208c56a service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:38.685267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622a11c-fa33-422d-8791-6a241208c56a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:38.706242 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1683/3371] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:09:38 2022] PUT /identity/v3/projects/674cf6891e524959b2bb75ff4378fe58/users/b8cf7883b7324a36810bc10fef6b4326/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:09:38.709275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622a11c-fa33-422d-8791-6a241208c56a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:38.710482 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386138e9-3352-46c2-b03e-5215f055722a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:38.711116 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622a11c-fa33-422d-8791-6a241208c56a service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:38.736886 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1689/3372] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:09:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:09:38.847013 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386138e9-3352-46c2-b03e-5215f055722a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:38.875723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa277238-0d56-4ce7-a9f6-905e407e9a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:38.876394 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa277238-0d56-4ce7-a9f6-905e407e9a99 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:38.877736 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa277238-0d56-4ce7-a9f6-905e407e9a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:38.878024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa277238-0d56-4ce7-a9f6-905e407e9a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:38.878884 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa277238-0d56-4ce7-a9f6-905e407e9a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:38.880561 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa277238-0d56-4ce7-a9f6-905e407e9a99 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:38.916443 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1684/3373] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:09:38.921177 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622a11c-fa33-422d-8791-6a241208c56a service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:38.935412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622a11c-fa33-422d-8791-6a241208c56a service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:38.944631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25957b2d-a0b4-4562-8d3b-7bdad8f169b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:38.948180 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25957b2d-a0b4-4562-8d3b-7bdad8f169b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:38.948180 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25957b2d-a0b4-4562-8d3b-7bdad8f169b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:38.948666 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25957b2d-a0b4-4562-8d3b-7bdad8f169b8 admin admin] PATH_INFO: `/v3/projects/674cf6891e524959b2bb75ff4378fe58/users/b8cf7883b7324a36810bc10fef6b4326/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:38.952579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25957b2d-a0b4-4562-8d3b-7bdad8f169b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=674cf6891e524959b2bb75ff4378fe58, user_id=b8cf7883b7324a36810bc10fef6b4326, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:38.955849 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25957b2d-a0b4-4562-8d3b-7bdad8f169b8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:38.971259 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1690/3374] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:09:38 2022] PUT /identity/v3/projects/674cf6891e524959b2bb75ff4378fe58/users/b8cf7883b7324a36810bc10fef6b4326/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:09:38.982891 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c99c2-f665-45f6-b7a4-b68a4c67eb3f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:38.983679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c99c2-f665-45f6-b7a4-b68a4c67eb3f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:38.984301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c99c2-f665-45f6-b7a4-b68a4c67eb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:39.056141 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-371c99c2-f665-45f6-b7a4-b68a4c67eb3f None None] MFA Rules not processed for user `b8cf7883b7324a36810bc10fef6b4326`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:39.058033 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-371c99c2-f665-45f6-b7a4-b68a4c67eb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:39.203504 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1685/3375] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:38 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:09:39.826824 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25957b2d-a0b4-4562-8d3b-7bdad8f169b8 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:39.828716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-25957b2d-a0b4-4562-8d3b-7bdad8f169b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:40.099182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25957b2d-a0b4-4562-8d3b-7bdad8f169b8 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:40.124292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb07ce5-61d4-4a20-852b-aacabf2bbf02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:40.127226 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb07ce5-61d4-4a20-852b-aacabf2bbf02 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:40.128180 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb07ce5-61d4-4a20-852b-aacabf2bbf02 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:40.128457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb07ce5-61d4-4a20-852b-aacabf2bbf02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:40.163299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb07ce5-61d4-4a20-852b-aacabf2bbf02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:40.173700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb07ce5-61d4-4a20-852b-aacabf2bbf02 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:40.232875 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1691/3376] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:09:39 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:09:40.468321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c99c2-f665-45f6-b7a4-b68a4c67eb3f None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:40.471147 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-371c99c2-f665-45f6-b7a4-b68a4c67eb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:40.569408 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:40.698599 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c99c2-f665-45f6-b7a4-b68a4c67eb3f None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:40.704432 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0dec5-da3d-4d10-a0ae-ffbfa4cf94c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:40.705354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0dec5-da3d-4d10-a0ae-ffbfa4cf94c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:40.705720 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0dec5-da3d-4d10-a0ae-ffbfa4cf94c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:40.706051 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0dec5-da3d-4d10-a0ae-ffbfa4cf94c6 admin admin] PATH_INFO: `/v3/projects/1e11f1b859f144d4b369829be5a0a54a` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:40.708635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c0dec5-da3d-4d10-a0ae-ffbfa4cf94c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e11f1b859f144d4b369829be5a0a54a)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:40.711300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c0dec5-da3d-4d10-a0ae-ffbfa4cf94c6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:40.825763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-09c0dec5-da3d-4d10-a0ae-ffbfa4cf94c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e11f1b859f144d4b369829be5a0a54a', 'request_id': 'req-09c0dec5-da3d-4d10-a0ae-ffbfa4cf94c6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:40.858042 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-09c0dec5-da3d-4d10-a0ae-ffbfa4cf94c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e11f1b859f144d4b369829be5a0a54a', 'request_id': 'req-09c0dec5-da3d-4d10-a0ae-ffbfa4cf94c6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:40.867246 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-09c0dec5-da3d-4d10-a0ae-ffbfa4cf94c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e11f1b859f144d4b369829be5a0a54a', 'request_id': 'req-09c0dec5-da3d-4d10-a0ae-ffbfa4cf94c6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:40.900352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-09c0dec5-da3d-4d10-a0ae-ffbfa4cf94c6 admin admin] The token cache is being invalidate because project 1e11f1b859f144d4b369829be5a0a54a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:09:40.900699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-09c0dec5-da3d-4d10-a0ae-ffbfa4cf94c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:40.905819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-09c0dec5-da3d-4d10-a0ae-ffbfa4cf94c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:40.914839 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1686/3377] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:09:40 2022] DELETE /identity/v3/projects/1e11f1b859f144d4b369829be5a0a54a => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:09:40.916975 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa00984-f6fe-4f5c-8ff7-a1bcae283b22 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:40.918297 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa00984-f6fe-4f5c-8ff7-a1bcae283b22 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:40.918850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa00984-f6fe-4f5c-8ff7-a1bcae283b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:40.986339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-7fa00984-f6fe-4f5c-8ff7-a1bcae283b22 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:40.988492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7fa00984-f6fe-4f5c-8ff7-a1bcae283b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:41.201463 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1692/3378] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:09:41.201981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf6420-7e16-46b2-b7c3-a50e5498388b None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:41.202277 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf6420-7e16-46b2-b7c3-a50e5498388b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:41.202576 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf6420-7e16-46b2-b7c3-a50e5498388b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:41.243900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-67bf6420-7e16-46b2-b7c3-a50e5498388b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:41.246349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-67bf6420-7e16-46b2-b7c3-a50e5498388b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:41.268810 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1687/3379] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:09:41.273257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa00984-f6fe-4f5c-8ff7-a1bcae283b22 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:41.291829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa00984-f6fe-4f5c-8ff7-a1bcae283b22 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:41.298577 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e55ab-3628-41df-aff8-1ab7ddeb9829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:41.299526 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e55ab-3628-41df-aff8-1ab7ddeb9829 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:41.299895 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e55ab-3628-41df-aff8-1ab7ddeb9829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:41.300472 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e55ab-3628-41df-aff8-1ab7ddeb9829 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:41.301875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e55ab-3628-41df-aff8-1ab7ddeb9829 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:09:41.302539 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e55ab-3628-41df-aff8-1ab7ddeb9829 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:41.306151 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e55ab-3628-41df-aff8-1ab7ddeb9829 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:41.339073 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1693/3380] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:09:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:09:41.340107 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf6420-7e16-46b2-b7c3-a50e5498388b None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:41.349348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf6420-7e16-46b2-b7c3-a50e5498388b None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:41.367477 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764da0bd-1434-4b29-a03d-be2f593c4527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:41.368135 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764da0bd-1434-4b29-a03d-be2f593c4527 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:41.368434 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764da0bd-1434-4b29-a03d-be2f593c4527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:41.368666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764da0bd-1434-4b29-a03d-be2f593c4527 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:41.369332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764da0bd-1434-4b29-a03d-be2f593c4527 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:41.380573 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764da0bd-1434-4b29-a03d-be2f593c4527 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:41.503416 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1688/3381] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:09:41 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:09:41.507396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e55ab-3628-41df-aff8-1ab7ddeb9829 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:41.514123 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:41.527426 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e55ab-3628-41df-aff8-1ab7ddeb9829 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:41.662141 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71ad11-2844-4248-90f2-0c0d5fd45c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:41.662692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71ad11-2844-4248-90f2-0c0d5fd45c3c admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:41.662977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71ad11-2844-4248-90f2-0c0d5fd45c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:41.663395 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71ad11-2844-4248-90f2-0c0d5fd45c3c admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:41.664105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b71ad11-2844-4248-90f2-0c0d5fd45c3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:41.668832 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b71ad11-2844-4248-90f2-0c0d5fd45c3c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:41.765496 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1694/3382] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:09:41 2022] POST /identity/v3/users => generated 292 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:09:41.772148 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764da0bd-1434-4b29-a03d-be2f593c4527 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:41.788399 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764da0bd-1434-4b29-a03d-be2f593c4527 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:41.801634 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dff952-5b7d-408e-a7d0-482190401632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:41.802278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dff952-5b7d-408e-a7d0-482190401632 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:41.802561 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dff952-5b7d-408e-a7d0-482190401632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:41.802836 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dff952-5b7d-408e-a7d0-482190401632 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:41.803495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dff952-5b7d-408e-a7d0-482190401632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:41.805112 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dff952-5b7d-408e-a7d0-482190401632 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:41.834053 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1689/3383] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:09:41.835234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71ad11-2844-4248-90f2-0c0d5fd45c3c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:41.849799 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71ad11-2844-4248-90f2-0c0d5fd45c3c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:41.859770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a908221-3602-43e7-b6d6-c036c6a9425a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:41.860582 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a908221-3602-43e7-b6d6-c036c6a9425a admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:41.860808 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a908221-3602-43e7-b6d6-c036c6a9425a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:41.861162 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a908221-3602-43e7-b6d6-c036c6a9425a admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:41.861983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a908221-3602-43e7-b6d6-c036c6a9425a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:41.863866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a908221-3602-43e7-b6d6-c036c6a9425a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:41.877000 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1695/3384] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:09:41.880980 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dff952-5b7d-408e-a7d0-482190401632 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:41.896292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dff952-5b7d-408e-a7d0-482190401632 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:41.910788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6ecf6-0ec0-4267-911b-ede8d3d1d318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:41.912274 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6ecf6-0ec0-4267-911b-ede8d3d1d318 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:41.912274 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6ecf6-0ec0-4267-911b-ede8d3d1d318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:41.912274 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6ecf6-0ec0-4267-911b-ede8d3d1d318 admin admin] PATH_INFO: `/v3/projects/5dcd937d2f56409193a5cf3349e5f677/users/141ca76f7a9d43cd9838ccd2b3d25295/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:41.945939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6ecf6-0ec0-4267-911b-ede8d3d1d318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dcd937d2f56409193a5cf3349e5f677, user_id=141ca76f7a9d43cd9838ccd2b3d25295, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:41.951677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6ecf6-0ec0-4267-911b-ede8d3d1d318 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:41.985835 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1690/3385] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:09:41 2022] PUT /identity/v3/projects/5dcd937d2f56409193a5cf3349e5f677/users/141ca76f7a9d43cd9838ccd2b3d25295/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:09:42.003482 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b853f1-2e47-493d-ae6c-c4f2a9f58e09 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:42.005939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b853f1-2e47-493d-ae6c-c4f2a9f58e09 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:42.007673 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b853f1-2e47-493d-ae6c-c4f2a9f58e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:42.089830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-10b853f1-2e47-493d-ae6c-c4f2a9f58e09 None None] MFA Rules not processed for user `141ca76f7a9d43cd9838ccd2b3d25295`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:42.092214 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-10b853f1-2e47-493d-ae6c-c4f2a9f58e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:42.316244 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1696/3386] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:09:42.331866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6ecf6-0ec0-4267-911b-ede8d3d1d318 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:42.333698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-86f6ecf6-0ec0-4267-911b-ede8d3d1d318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:42.468834 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:42.495819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6ecf6-0ec0-4267-911b-ede8d3d1d318 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:42.503321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e308ae-3ebe-44e8-9084-e6c06b3df6ab service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efcee9b21ea94b1b8e5c9c5acb35839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:42.504755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e308ae-3ebe-44e8-9084-e6c06b3df6ab service glance] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:42.511169 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e308ae-3ebe-44e8-9084-e6c06b3df6ab service glance] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:42.511755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e308ae-3ebe-44e8-9084-e6c06b3df6ab service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:42.529219 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e308ae-3ebe-44e8-9084-e6c06b3df6ab service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:42.532154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e308ae-3ebe-44e8-9084-e6c06b3df6ab service glance] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:42.552366 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1691/3387] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:09:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:09:43.860504 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313003b-c8f0-40d8-afce-b9dcc73d7211 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:43.860976 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313003b-c8f0-40d8-afce-b9dcc73d7211 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:43.861262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313003b-c8f0-40d8-afce-b9dcc73d7211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:43.911188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e313003b-c8f0-40d8-afce-b9dcc73d7211 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:43.912483 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e313003b-c8f0-40d8-afce-b9dcc73d7211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:44.100947 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1697/3388] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:09:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:09:44.113816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e308ae-3ebe-44e8-9084-e6c06b3df6ab service glance] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:44.122350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b8e308ae-3ebe-44e8-9084-e6c06b3df6ab service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:44.260341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e308ae-3ebe-44e8-9084-e6c06b3df6ab service glance] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:44.265577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53111559-4689-4fbf-a8d3-b92ccadd5944 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:44.266208 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53111559-4689-4fbf-a8d3-b92ccadd5944 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:44.266487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53111559-4689-4fbf-a8d3-b92ccadd5944 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:44.266977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53111559-4689-4fbf-a8d3-b92ccadd5944 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:44.280147 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53111559-4689-4fbf-a8d3-b92ccadd5944 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:44.281802 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53111559-4689-4fbf-a8d3-b92ccadd5944 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:44.291118 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1692/3389] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:09:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:09:44.518610 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d454d-fc04-4a4d-af73-75e0c9c90ca3 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:44.519228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d454d-fc04-4a4d-af73-75e0c9c90ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:44.520075 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d454d-fc04-4a4d-af73-75e0c9c90ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:44.553282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53111559-4689-4fbf-a8d3-b92ccadd5944 service swift] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:44.554473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-53111559-4689-4fbf-a8d3-b92ccadd5944 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:44.629569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-d90d454d-fc04-4a4d-af73-75e0c9c90ca3 None None] MFA Rules not processed for user `56818ebbb5de483b85e6889ce59234e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:44.630987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d90d454d-fc04-4a4d-af73-75e0c9c90ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:44.645778 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:44.775518 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53111559-4689-4fbf-a8d3-b92ccadd5944 service swift] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:44.800437 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55074a1-d78e-47cb-924a-659035f2fe0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:44.801014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55074a1-d78e-47cb-924a-659035f2fe0a service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:44.801479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55074a1-d78e-47cb-924a-659035f2fe0a service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:44.801911 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55074a1-d78e-47cb-924a-659035f2fe0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:44.806456 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d55074a1-d78e-47cb-924a-659035f2fe0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:44.831118 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1698/3390] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:44 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:09:44.835209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb326b-9dce-4784-a2af-987fcb86a622 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:44.835710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb326b-9dce-4784-a2af-987fcb86a622 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:44.836146 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb326b-9dce-4784-a2af-987fcb86a622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:44.875923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e0cb326b-9dce-4784-a2af-987fcb86a622 None None] MFA Rules not processed for user `56818ebbb5de483b85e6889ce59234e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:44.878280 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e0cb326b-9dce-4784-a2af-987fcb86a622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:44.895251 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1699/3391] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:44 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:09:44.962867 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55074a1-d78e-47cb-924a-659035f2fe0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:44.965077 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55074a1-d78e-47cb-924a-659035f2fe0a service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:44.978519 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1693/3392] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:09:44 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:09:45.005814 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb326b-9dce-4784-a2af-987fcb86a622 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:45.008932 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e0cb326b-9dce-4784-a2af-987fcb86a622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:45.021504 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55074a1-d78e-47cb-924a-659035f2fe0a service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:45.048172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55074a1-d78e-47cb-924a-659035f2fe0a service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:45.064862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273d429-637f-49e8-bd62-996b5c74d3c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:45.065525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273d429-637f-49e8-bd62-996b5c74d3c9 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:45.065864 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273d429-637f-49e8-bd62-996b5c74d3c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:45.066073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273d429-637f-49e8-bd62-996b5c74d3c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:45.085238 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273d429-637f-49e8-bd62-996b5c74d3c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:45.086939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273d429-637f-49e8-bd62-996b5c74d3c9 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:45.097531 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:45.122316 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1694/3393] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:09:45 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:09:45.140248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb326b-9dce-4784-a2af-987fcb86a622 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:45.157758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8880ccd-fcce-44a4-9d37-83a66ef6be49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:45.158417 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8880ccd-fcce-44a4-9d37-83a66ef6be49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:45.158702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8880ccd-fcce-44a4-9d37-83a66ef6be49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:45.158974 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8880ccd-fcce-44a4-9d37-83a66ef6be49 admin admin] PATH_INFO: `/v3/users/80d784ae6ed44d62b72ee596ef91d043` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:45.161538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8880ccd-fcce-44a4-9d37-83a66ef6be49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80d784ae6ed44d62b72ee596ef91d043)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:45.169779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8880ccd-fcce-44a4-9d37-83a66ef6be49 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:45.269348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d8880ccd-fcce-44a4-9d37-83a66ef6be49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80d784ae6ed44d62b72ee596ef91d043'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:45.270130 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d8880ccd-fcce-44a4-9d37-83a66ef6be49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80d784ae6ed44d62b72ee596ef91d043'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:45.277804 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d8880ccd-fcce-44a4-9d37-83a66ef6be49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80d784ae6ed44d62b72ee596ef91d043'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:45.286184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d8880ccd-fcce-44a4-9d37-83a66ef6be49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80d784ae6ed44d62b72ee596ef91d043'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:45.287054 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d8880ccd-fcce-44a4-9d37-83a66ef6be49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80d784ae6ed44d62b72ee596ef91d043'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:45.315480 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1700/3394] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:09:45 2022] DELETE /identity/v3/users/80d784ae6ed44d62b72ee596ef91d043 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:09:45.316608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddb831-65ce-46f7-8dc2-298471f8a160 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:45.316898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddb831-65ce-46f7-8dc2-298471f8a160 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:45.317170 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddb831-65ce-46f7-8dc2-298471f8a160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:45.338562 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-4cddb831-65ce-46f7-8dc2-298471f8a160 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:45.340308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4cddb831-65ce-46f7-8dc2-298471f8a160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:45.442399 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1695/3395] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:09:45.469944 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8880ccd-fcce-44a4-9d37-83a66ef6be49 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:45.476812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d8880ccd-fcce-44a4-9d37-83a66ef6be49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:45.482096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676a4cb-a8d7-4f4c-897e-96a08faff2c6 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:45.483189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676a4cb-a8d7-4f4c-897e-96a08faff2c6 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:45.483689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676a4cb-a8d7-4f4c-897e-96a08faff2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:45.509158 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:45.511971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e676a4cb-a8d7-4f4c-897e-96a08faff2c6 None None] MFA Rules not processed for user `575bb87368454c08a703e99526e6f00c`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:45.514102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e676a4cb-a8d7-4f4c-897e-96a08faff2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:45.590888 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8880ccd-fcce-44a4-9d37-83a66ef6be49 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:45.602587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f3413-c02c-4491-b23d-6848369458fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:45.603560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f3413-c02c-4491-b23d-6848369458fd service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:45.604119 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f3413-c02c-4491-b23d-6848369458fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:45.605059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f3413-c02c-4491-b23d-6848369458fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:45.618399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f3413-c02c-4491-b23d-6848369458fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:45.620474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f3413-c02c-4491-b23d-6848369458fd service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:45.631229 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1701/3396] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:09:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:09:45.633366 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1696/3397] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:09:46.880302 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f3413-c02c-4491-b23d-6848369458fd service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:46.883422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d45f3413-c02c-4491-b23d-6848369458fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:46.927671 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f3413-c02c-4491-b23d-6848369458fd service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:46.938085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164252b8-6d8d-406e-83ca-51ec3c345ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:46.939270 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164252b8-6d8d-406e-83ca-51ec3c345ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:46.939904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164252b8-6d8d-406e-83ca-51ec3c345ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:46.940324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164252b8-6d8d-406e-83ca-51ec3c345ed8 admin admin] PATH_INFO: `/v3/projects/c69b1eb1e2024f1f8fe4c57df75b3b2f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:46.942866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164252b8-6d8d-406e-83ca-51ec3c345ed8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c69b1eb1e2024f1f8fe4c57df75b3b2f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:46.947320 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164252b8-6d8d-406e-83ca-51ec3c345ed8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:47.139579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-164252b8-6d8d-406e-83ca-51ec3c345ed8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c69b1eb1e2024f1f8fe4c57df75b3b2f', 'request_id': 'req-164252b8-6d8d-406e-83ca-51ec3c345ed8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:47.141386 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abbf0e-9a87-4d18-828d-a7f6d07ff953 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:47.145888 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abbf0e-9a87-4d18-828d-a7f6d07ff953 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:47.146727 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abbf0e-9a87-4d18-828d-a7f6d07ff953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:47.159014 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-164252b8-6d8d-406e-83ca-51ec3c345ed8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c69b1eb1e2024f1f8fe4c57df75b3b2f', 'request_id': 'req-164252b8-6d8d-406e-83ca-51ec3c345ed8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:47.177288 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-164252b8-6d8d-406e-83ca-51ec3c345ed8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c69b1eb1e2024f1f8fe4c57df75b3b2f', 'request_id': 'req-164252b8-6d8d-406e-83ca-51ec3c345ed8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:47.205314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e7abbf0e-9a87-4d18-828d-a7f6d07ff953 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:47.206932 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e7abbf0e-9a87-4d18-828d-a7f6d07ff953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:47.221126 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-164252b8-6d8d-406e-83ca-51ec3c345ed8 admin admin] The token cache is being invalidate because project c69b1eb1e2024f1f8fe4c57df75b3b2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:09:47.221424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-164252b8-6d8d-406e-83ca-51ec3c345ed8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:47.225017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-164252b8-6d8d-406e-83ca-51ec3c345ed8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:47.229943 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1702/3398] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:09:46 2022] DELETE /identity/v3/projects/c69b1eb1e2024f1f8fe4c57df75b3b2f => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:09:47.235892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164252b8-6d8d-406e-83ca-51ec3c345ed8 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:47.239154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-164252b8-6d8d-406e-83ca-51ec3c345ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:47.293672 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1697/3399] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:09:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:09:47.310984 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7abbf0e-9a87-4d18-828d-a7f6d07ff953 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:47.314618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e7abbf0e-9a87-4d18-828d-a7f6d07ff953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:47.388862 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164252b8-6d8d-406e-83ca-51ec3c345ed8 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:47.396693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c2e2f-71c2-4986-b4c5-9992d85c4c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:47.397571 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c2e2f-71c2-4986-b4c5-9992d85c4c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:47.397865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c2e2f-71c2-4986-b4c5-9992d85c4c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:47.398142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c2e2f-71c2-4986-b4c5-9992d85c4c3a admin admin] PATH_INFO: `/v3/users/b8cf7883b7324a36810bc10fef6b4326` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:47.399698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c2e2f-71c2-4986-b4c5-9992d85c4c3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8cf7883b7324a36810bc10fef6b4326)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:47.403580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c2e2f-71c2-4986-b4c5-9992d85c4c3a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:47.467533 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:47.507063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7abbf0e-9a87-4d18-828d-a7f6d07ff953 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:47.516383 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797af17-289e-458e-843e-5868720e5dfb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:47.517371 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797af17-289e-458e-843e-5868720e5dfb service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:47.518078 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797af17-289e-458e-843e-5868720e5dfb service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:47.518494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797af17-289e-458e-843e-5868720e5dfb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:47.520077 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:47.523347 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ab7c2e2f-71c2-4986-b4c5-9992d85c4c3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8cf7883b7324a36810bc10fef6b4326'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:47.525016 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ab7c2e2f-71c2-4986-b4c5-9992d85c4c3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8cf7883b7324a36810bc10fef6b4326'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:47.543002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797af17-289e-458e-843e-5868720e5dfb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:47.544608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797af17-289e-458e-843e-5868720e5dfb service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:47.545271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ab7c2e2f-71c2-4986-b4c5-9992d85c4c3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8cf7883b7324a36810bc10fef6b4326'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:47.559763 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1698/3400] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:09:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:09:47.562788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ab7c2e2f-71c2-4986-b4c5-9992d85c4c3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8cf7883b7324a36810bc10fef6b4326'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:47.563619 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ab7c2e2f-71c2-4986-b4c5-9992d85c4c3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8cf7883b7324a36810bc10fef6b4326'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:47.631478 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1703/3401] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:09:47 2022] DELETE /identity/v3/users/b8cf7883b7324a36810bc10fef6b4326 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:09:48.810370 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797af17-289e-458e-843e-5868720e5dfb service swift] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:48.829809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797af17-289e-458e-843e-5868720e5dfb service swift] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:48.991711 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb016a9-2fc3-4edd-94f1-63d5ca9e927c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:49.001547 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb016a9-2fc3-4edd-94f1-63d5ca9e927c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:49.002180 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb016a9-2fc3-4edd-94f1-63d5ca9e927c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:49.002610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb016a9-2fc3-4edd-94f1-63d5ca9e927c admin admin] PATH_INFO: `/v3/projects/674cf6891e524959b2bb75ff4378fe58` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:49.004141 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb016a9-2fc3-4edd-94f1-63d5ca9e927c admin admin] RBAC: Authorizing `identity:delete_project(project_id=674cf6891e524959b2bb75ff4378fe58)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:49.006392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb016a9-2fc3-4edd-94f1-63d5ca9e927c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:49.107130 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-deb016a9-2fc3-4edd-94f1-63d5ca9e927c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '674cf6891e524959b2bb75ff4378fe58', 'request_id': 'req-deb016a9-2fc3-4edd-94f1-63d5ca9e927c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:49.129418 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-deb016a9-2fc3-4edd-94f1-63d5ca9e927c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '674cf6891e524959b2bb75ff4378fe58', 'request_id': 'req-deb016a9-2fc3-4edd-94f1-63d5ca9e927c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:49.173636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-deb016a9-2fc3-4edd-94f1-63d5ca9e927c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '674cf6891e524959b2bb75ff4378fe58', 'request_id': 'req-deb016a9-2fc3-4edd-94f1-63d5ca9e927c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:49.199566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-deb016a9-2fc3-4edd-94f1-63d5ca9e927c admin admin] The token cache is being invalidate because project 674cf6891e524959b2bb75ff4378fe58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:09:49.199892 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-deb016a9-2fc3-4edd-94f1-63d5ca9e927c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:49.202452 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-deb016a9-2fc3-4edd-94f1-63d5ca9e927c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:09:49.205286 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1699/3402] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:09:48 2022] DELETE /identity/v3/projects/674cf6891e524959b2bb75ff4378fe58 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:09:49.210084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03617e4f-c953-4b0a-af67-54cd390d9489 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:49.210624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03617e4f-c953-4b0a-af67-54cd390d9489 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:49.210624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03617e4f-c953-4b0a-af67-54cd390d9489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:49.256447 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-03617e4f-c953-4b0a-af67-54cd390d9489 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:49.257655 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-03617e4f-c953-4b0a-af67-54cd390d9489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:49.390556 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1704/3403] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:09:49.401897 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946a6ab-9d4d-43b3-8c45-676195ae5480 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:49.402672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946a6ab-9d4d-43b3-8c45-676195ae5480 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:49.403208 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946a6ab-9d4d-43b3-8c45-676195ae5480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:49.451840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-6946a6ab-9d4d-43b3-8c45-676195ae5480 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:49.454220 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6946a6ab-9d4d-43b3-8c45-676195ae5480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:49.467699 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1700/3404] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:09:49.468457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03617e4f-c953-4b0a-af67-54cd390d9489 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:49.480123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03617e4f-c953-4b0a-af67-54cd390d9489 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:49.487564 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da5378-d667-4515-bc69-06381d3137b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:49.488960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da5378-d667-4515-bc69-06381d3137b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:49.489427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da5378-d667-4515-bc69-06381d3137b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:49.489816 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da5378-d667-4515-bc69-06381d3137b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:49.490581 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da5378-d667-4515-bc69-06381d3137b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:09:49.491377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da5378-d667-4515-bc69-06381d3137b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:49.493701 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da5378-d667-4515-bc69-06381d3137b3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:49.534793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946a6ab-9d4d-43b3-8c45-676195ae5480 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:49.536029 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1705/3405] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:09:49.546175 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946a6ab-9d4d-43b3-8c45-676195ae5480 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:49.551268 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013f692-4093-4aca-b692-9d140916a9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:49.552029 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013f692-4093-4aca-b692-9d140916a9e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:49.552416 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013f692-4093-4aca-b692-9d140916a9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:49.552789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013f692-4093-4aca-b692-9d140916a9e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:49.553603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013f692-4093-4aca-b692-9d140916a9e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:49.556469 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013f692-4093-4aca-b692-9d140916a9e0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:49.571528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b286225-e18c-4066-8fff-a02ca279c132 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:49.572838 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b286225-e18c-4066-8fff-a02ca279c132 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:49.573989 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b286225-e18c-4066-8fff-a02ca279c132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:49.596204 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1701/3406] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:09:49 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:09:49.597167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013f692-4093-4aca-b692-9d140916a9e0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:49.604073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-7b286225-e18c-4066-8fff-a02ca279c132 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:49.606136 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7b286225-e18c-4066-8fff-a02ca279c132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:49.674715 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:49.684613 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1706/3407] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:09:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:09:49.697032 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b286225-e18c-4066-8fff-a02ca279c132 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:49.699448 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7b286225-e18c-4066-8fff-a02ca279c132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:49.709078 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013f692-4093-4aca-b692-9d140916a9e0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:49.716158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6b07d-1922-4f20-90a9-934a22ef1925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:49.717735 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6b07d-1922-4f20-90a9-934a22ef1925 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:49.718120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6b07d-1922-4f20-90a9-934a22ef1925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:49.718492 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6b07d-1922-4f20-90a9-934a22ef1925 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:49.719288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6b07d-1922-4f20-90a9-934a22ef1925 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:49.722144 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6b07d-1922-4f20-90a9-934a22ef1925 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:49.785812 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1702/3408] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:09:49 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:09:49.790952 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6b07d-1922-4f20-90a9-934a22ef1925 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:49.815410 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:49.815998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6b07d-1922-4f20-90a9-934a22ef1925 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:49.832275 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7cd8b-73aa-42f4-962a-ec90702dbd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:49.832991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7cd8b-73aa-42f4-962a-ec90702dbd6a admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:49.837704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7cd8b-73aa-42f4-962a-ec90702dbd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:49.838009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7cd8b-73aa-42f4-962a-ec90702dbd6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:49.838757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb7cd8b-73aa-42f4-962a-ec90702dbd6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:49.840630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb7cd8b-73aa-42f4-962a-ec90702dbd6a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:49.874432 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b286225-e18c-4066-8fff-a02ca279c132 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:49.889092 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe56cb-7afe-4e04-bf96-73bf4b0263dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:49.904908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe56cb-7afe-4e04-bf96-73bf4b0263dc service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:49.904908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe56cb-7afe-4e04-bf96-73bf4b0263dc service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:49.904908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe56cb-7afe-4e04-bf96-73bf4b0263dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:49.905866 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1703/3409] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:09:49.905866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7cd8b-73aa-42f4-962a-ec90702dbd6a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:49.905866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-dfb7cd8b-73aa-42f4-962a-ec90702dbd6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:49.926540 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe56cb-7afe-4e04-bf96-73bf4b0263dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:49.928060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe56cb-7afe-4e04-bf96-73bf4b0263dc service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:49.965964 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1707/3410] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:09:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 04 01:09:49.978946 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe56cb-7afe-4e04-bf96-73bf4b0263dc service swift] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:50.014464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe56cb-7afe-4e04-bf96-73bf4b0263dc service swift] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:50.046858 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b685bdc-c8c6-4352-9a1d-5ac80d7bd9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:50.047576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b685bdc-c8c6-4352-9a1d-5ac80d7bd9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:50.047831 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b685bdc-c8c6-4352-9a1d-5ac80d7bd9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:50.048099 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b685bdc-c8c6-4352-9a1d-5ac80d7bd9a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:50.048748 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b685bdc-c8c6-4352-9a1d-5ac80d7bd9a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:50.050412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b685bdc-c8c6-4352-9a1d-5ac80d7bd9a2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:50.090490 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1708/3411] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:09:50.091384 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b685bdc-c8c6-4352-9a1d-5ac80d7bd9a2 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:50.125582 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b685bdc-c8c6-4352-9a1d-5ac80d7bd9a2 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:50.126558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7cd8b-73aa-42f4-962a-ec90702dbd6a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:50.137097 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5ff3d-12bd-4b18-919b-a13cb9d59fea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:50.137732 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5ff3d-12bd-4b18-919b-a13cb9d59fea service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:50.138015 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5ff3d-12bd-4b18-919b-a13cb9d59fea service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:50.138311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5ff3d-12bd-4b18-919b-a13cb9d59fea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:50.138955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56f06a-4c79-4977-a95d-9256e725bc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:50.139639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56f06a-4c79-4977-a95d-9256e725bc2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:50.139905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56f06a-4c79-4977-a95d-9256e725bc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:50.140182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56f06a-4c79-4977-a95d-9256e725bc2d admin admin] PATH_INFO: `/v3/projects/750e7f8ac9c1437fa477bba2336d4d58/users/9bb80d11117547b681f80a38ce749370/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:50.143238 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3fd5ff3d-12bd-4b18-919b-a13cb9d59fea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:50.172706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5ff3d-12bd-4b18-919b-a13cb9d59fea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:50.173921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56f06a-4c79-4977-a95d-9256e725bc2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=750e7f8ac9c1437fa477bba2336d4d58, user_id=9bb80d11117547b681f80a38ce749370, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:50.174115 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5ff3d-12bd-4b18-919b-a13cb9d59fea service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:50.176662 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56f06a-4c79-4977-a95d-9256e725bc2d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:50.194688 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1704/3412] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:09:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:09:50.212211 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1709/3413] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:09:50 2022] PUT /identity/v3/projects/750e7f8ac9c1437fa477bba2336d4d58/users/9bb80d11117547b681f80a38ce749370/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:09:50.213886 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acf992-dcb7-406c-ac4c-b306f3aafd59 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:50.214176 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acf992-dcb7-406c-ac4c-b306f3aafd59 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:50.214451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acf992-dcb7-406c-ac4c-b306f3aafd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:50.278617 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d0acf992-dcb7-406c-ac4c-b306f3aafd59 None None] MFA Rules not processed for user `9bb80d11117547b681f80a38ce749370`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:50.280548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d0acf992-dcb7-406c-ac4c-b306f3aafd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:50.369052 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d80ca6-2da6-4ddd-8573-9b4f55bafd41 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:50.369344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d80ca6-2da6-4ddd-8573-9b4f55bafd41 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:50.369845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d80ca6-2da6-4ddd-8573-9b4f55bafd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:50.412904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-43d80ca6-2da6-4ddd-8573-9b4f55bafd41 None None] MFA Rules not processed for user `141ca76f7a9d43cd9838ccd2b3d25295`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:50.416426 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-43d80ca6-2da6-4ddd-8573-9b4f55bafd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:50.455595 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1705/3414] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:09:50.460319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0acf992-dcb7-406c-ac4c-b306f3aafd59 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:50.568202 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:50.581333 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1710/3415] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:09:50.600764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0acf992-dcb7-406c-ac4c-b306f3aafd59 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:50.606608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d0d4d-c554-474c-9ff6-c88f574d3b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:50.609134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d0d4d-c554-474c-9ff6-c88f574d3b6b admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:50.609134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d0d4d-c554-474c-9ff6-c88f574d3b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:50.609134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d0d4d-c554-474c-9ff6-c88f574d3b6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:50.609134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d0d4d-c554-474c-9ff6-c88f574d3b6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:50.610498 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d0d4d-c554-474c-9ff6-c88f574d3b6b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:50.649803 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1706/3416] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:09:50 2022] POST /identity/v3/projects => generated 375 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:09:50.654049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d80ca6-2da6-4ddd-8573-9b4f55bafd41 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:50.667643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d80ca6-2da6-4ddd-8573-9b4f55bafd41 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:50.753237 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03af80-416e-42b3-90ea-0eef2fe9c50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:50.754062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03af80-416e-42b3-90ea-0eef2fe9c50b admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:50.754351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03af80-416e-42b3-90ea-0eef2fe9c50b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:50.754629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03af80-416e-42b3-90ea-0eef2fe9c50b admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:50.755337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03af80-416e-42b3-90ea-0eef2fe9c50b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:50.757999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03af80-416e-42b3-90ea-0eef2fe9c50b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:50.816049 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1711/3417] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:09:50 2022] POST /identity/v3/users => generated 294 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:09:50.819924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d0d4d-c554-474c-9ff6-c88f574d3b6b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:50.841119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d0d4d-c554-474c-9ff6-c88f574d3b6b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:50.852958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2926ce-2712-44e0-aa40-c443e3847b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:50.856197 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2926ce-2712-44e0-aa40-c443e3847b8e admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:50.858197 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2926ce-2712-44e0-aa40-c443e3847b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:50.858600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2926ce-2712-44e0-aa40-c443e3847b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:50.859360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2926ce-2712-44e0-aa40-c443e3847b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:50.861047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2926ce-2712-44e0-aa40-c443e3847b8e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:50.875784 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1707/3418] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:09:50.876986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03af80-416e-42b3-90ea-0eef2fe9c50b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:50.891218 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03af80-416e-42b3-90ea-0eef2fe9c50b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:50.898493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fadd5a-7213-43ad-a344-0ff494c07c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:50.899369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fadd5a-7213-43ad-a344-0ff494c07c35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:50.899725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fadd5a-7213-43ad-a344-0ff494c07c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:50.900071 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fadd5a-7213-43ad-a344-0ff494c07c35 admin admin] PATH_INFO: `/v3/projects/1d74e7cd546f47ccb0cfcd880c2f5ce0/users/381f2994a4c84b39926eea474d60ef04/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:50.928282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fadd5a-7213-43ad-a344-0ff494c07c35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d74e7cd546f47ccb0cfcd880c2f5ce0, user_id=381f2994a4c84b39926eea474d60ef04, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:50.934732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fadd5a-7213-43ad-a344-0ff494c07c35 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:50.969789 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1712/3419] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:09:50 2022] PUT /identity/v3/projects/1d74e7cd546f47ccb0cfcd880c2f5ce0/users/381f2994a4c84b39926eea474d60ef04/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:09:50.973578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2926ce-2712-44e0-aa40-c443e3847b8e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:50.999152 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2926ce-2712-44e0-aa40-c443e3847b8e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:51.123622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2b09b-7a42-4a67-81b0-c6914d7a347e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:51.125063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2b09b-7a42-4a67-81b0-c6914d7a347e admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:51.126079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2b09b-7a42-4a67-81b0-c6914d7a347e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:51.126943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2b09b-7a42-4a67-81b0-c6914d7a347e admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:51.127811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b2b09b-7a42-4a67-81b0-c6914d7a347e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:51.130724 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b2b09b-7a42-4a67-81b0-c6914d7a347e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:51.147695 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1708/3420] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:09:51.151987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fadd5a-7213-43ad-a344-0ff494c07c35 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:51.162466 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fadd5a-7213-43ad-a344-0ff494c07c35 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:51.169584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ab16e-15ab-4923-8f3f-2f28c5a3bc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:51.170256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ab16e-15ab-4923-8f3f-2f28c5a3bc64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:51.171584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ab16e-15ab-4923-8f3f-2f28c5a3bc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:51.171584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ab16e-15ab-4923-8f3f-2f28c5a3bc64 admin admin] PATH_INFO: `/v3/projects/1d74e7cd546f47ccb0cfcd880c2f5ce0/users/381f2994a4c84b39926eea474d60ef04/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:51.172766 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ab16e-15ab-4923-8f3f-2f28c5a3bc64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d74e7cd546f47ccb0cfcd880c2f5ce0, user_id=381f2994a4c84b39926eea474d60ef04, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:51.175456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ab16e-15ab-4923-8f3f-2f28c5a3bc64 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:51.189507 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1713/3421] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:09:51 2022] PUT /identity/v3/projects/1d74e7cd546f47ccb0cfcd880c2f5ce0/users/381f2994a4c84b39926eea474d60ef04/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:09:51.200510 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5f6e6-3684-4d0d-a384-96d23345d45f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:51.201188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5f6e6-3684-4d0d-a384-96d23345d45f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:51.201510 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5f6e6-3684-4d0d-a384-96d23345d45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:51.239794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-7bf5f6e6-3684-4d0d-a384-96d23345d45f None None] MFA Rules not processed for user `381f2994a4c84b39926eea474d60ef04`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:51.241236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7bf5f6e6-3684-4d0d-a384-96d23345d45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:51.352315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa9b6e-6b46-441e-bdf5-1005251bdff8 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:51.352826 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa9b6e-6b46-441e-bdf5-1005251bdff8 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:51.352904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa9b6e-6b46-441e-bdf5-1005251bdff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:51.362728 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1709/3422] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:09:51.377225 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:51.384903 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-abaa9b6e-6b46-441e-bdf5-1005251bdff8 None None] MFA Rules not processed for user `9bb80d11117547b681f80a38ce749370`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:51.387485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-abaa9b6e-6b46-441e-bdf5-1005251bdff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:51.439197 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0877663-8580-4524-9dfe-d2d92d7a3964 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:51.439888 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0877663-8580-4524-9dfe-d2d92d7a3964 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:51.440426 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0877663-8580-4524-9dfe-d2d92d7a3964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:51.493796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d0877663-8580-4524-9dfe-d2d92d7a3964 None None] MFA Rules not processed for user `141ca76f7a9d43cd9838ccd2b3d25295`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:09:51.496070 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d0877663-8580-4524-9dfe-d2d92d7a3964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:51.513497 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1714/3423] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:09:51.528147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa9b6e-6b46-441e-bdf5-1005251bdff8 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:09:51.530372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-abaa9b6e-6b46-441e-bdf5-1005251bdff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:09:51.560138 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:51.583922 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1710/3424] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:09:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:09:51.655697 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa9b6e-6b46-441e-bdf5-1005251bdff8 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:09:51.664243 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda85bd5-577c-47d8-932b-951a2ab7d339 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:09:51.665052 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda85bd5-577c-47d8-932b-951a2ab7d339 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:09:51.665575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda85bd5-577c-47d8-932b-951a2ab7d339 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:09:51.666193 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda85bd5-577c-47d8-932b-951a2ab7d339 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:09:51.677571 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda85bd5-577c-47d8-932b-951a2ab7d339 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:09:51.680098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda85bd5-577c-47d8-932b-951a2ab7d339 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:09:51.694074 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1715/3425] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:09:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:10:01.275139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0877663-8580-4524-9dfe-d2d92d7a3964 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:01.276677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d0877663-8580-4524-9dfe-d2d92d7a3964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:01.408050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0877663-8580-4524-9dfe-d2d92d7a3964 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:01.415798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e61d7f-d803-465d-888d-0cd843df2268 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:01.417616 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e61d7f-d803-465d-888d-0cd843df2268 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:01.417987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e61d7f-d803-465d-888d-0cd843df2268 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:01.418268 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e61d7f-d803-465d-888d-0cd843df2268 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:01.421004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-04e61d7f-d803-465d-888d-0cd843df2268 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:01.439475 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e61d7f-d803-465d-888d-0cd843df2268 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:01.442028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e61d7f-d803-465d-888d-0cd843df2268 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:01.461251 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1711/3426] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:10:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:10:01.687114 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=56 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:10:03.916446 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda85bd5-577c-47d8-932b-951a2ab7d339 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:04.029261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e61d7f-d803-465d-888d-0cd843df2268 service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:04.031024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-04e61d7f-d803-465d-888d-0cd843df2268 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:04.031545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda85bd5-577c-47d8-932b-951a2ab7d339 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:04.038974 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa2b93-9a4a-4e4c-8f70-18c494fd3191 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:04.039979 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa2b93-9a4a-4e4c-8f70-18c494fd3191 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:04.039979 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa2b93-9a4a-4e4c-8f70-18c494fd3191 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:04.040240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa2b93-9a4a-4e4c-8f70-18c494fd3191 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:04.042605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-05aa2b93-9a4a-4e4c-8f70-18c494fd3191 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:04.051710 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e61d7f-d803-465d-888d-0cd843df2268 service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:04.057061 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4934a60a-587b-4c55-a354-d0dffd310602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:04.058665 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934a60a-587b-4c55-a354-d0dffd310602 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:04.059285 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934a60a-587b-4c55-a354-d0dffd310602 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:04.059782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934a60a-587b-4c55-a354-d0dffd310602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:04.062062 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4934a60a-587b-4c55-a354-d0dffd310602 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:04.069161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa2b93-9a4a-4e4c-8f70-18c494fd3191 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:04.070717 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa2b93-9a4a-4e4c-8f70-18c494fd3191 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:04.083378 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4934a60a-587b-4c55-a354-d0dffd310602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:04.085122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4934a60a-587b-4c55-a354-d0dffd310602 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:04.091345 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1716/3427] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:10:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:10:04.116077 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1712/3428] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:10:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:10:06.810391 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdaeb2-e1b6-45e5-9dd1-5e247d9b84a8 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:06.812217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdaeb2-e1b6-45e5-9dd1-5e247d9b84a8 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:06.812952 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdaeb2-e1b6-45e5-9dd1-5e247d9b84a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:06.845671 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-abfdaeb2-e1b6-45e5-9dd1-5e247d9b84a8 None None] MFA Rules not processed for user `56818ebbb5de483b85e6889ce59234e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:10:06.848409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-abfdaeb2-e1b6-45e5-9dd1-5e247d9b84a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:06.883351 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9b7bd-0d21-452f-b21a-53e3a972fa22 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:06.883852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9b7bd-0d21-452f-b21a-53e3a972fa22 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:06.883944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9b7bd-0d21-452f-b21a-53e3a972fa22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:06.918830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-81e9b7bd-0d21-452f-b21a-53e3a972fa22 None None] MFA Rules not processed for user `2f06e2312dcc49969c19772035ddab99`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:10:06.920424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-81e9b7bd-0d21-452f-b21a-53e3a972fa22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:07.028327 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1717/3429] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:10:06 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:10:07.049550 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1713/3430] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:10:06 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:10:08.096015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfdaeb2-e1b6-45e5-9dd1-5e247d9b84a8 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:08.110556 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9e22d-bc0d-48ee-9381-81aa8db164b3 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:08.111587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9e22d-bc0d-48ee-9381-81aa8db164b3 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:08.112007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9e22d-bc0d-48ee-9381-81aa8db164b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:08.114579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfdaeb2-e1b6-45e5-9dd1-5e247d9b84a8 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:08.123119 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4e898-543e-472a-b173-ffcad05d7ece service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:08.123869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4e898-543e-472a-b173-ffcad05d7ece service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:08.124386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4e898-543e-472a-b173-ffcad05d7ece service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:08.126139 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4e898-543e-472a-b173-ffcad05d7ece service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:08.128624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-68c4e898-543e-472a-b173-ffcad05d7ece service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:08.137359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-7be9e22d-bc0d-48ee-9381-81aa8db164b3 None None] MFA Rules not processed for user `56818ebbb5de483b85e6889ce59234e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:10:08.139592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7be9e22d-bc0d-48ee-9381-81aa8db164b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:08.143787 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4e898-543e-472a-b173-ffcad05d7ece service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:08.145531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4e898-543e-472a-b173-ffcad05d7ece service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:08.148521 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1714/3431] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:10:08 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:10:08.168804 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1718/3432] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:10:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:10:08.181277 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f540731-e87a-449e-907f-d364c0bb3e0a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:08.181849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f540731-e87a-449e-907f-d364c0bb3e0a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:08.183123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f540731-e87a-449e-907f-d364c0bb3e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:08.213765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-1f540731-e87a-449e-907f-d364c0bb3e0a None None] MFA Rules not processed for user `56818ebbb5de483b85e6889ce59234e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:10:08.215777 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1f540731-e87a-449e-907f-d364c0bb3e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:08.226861 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1715/3433] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:10:08 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:10:08.253840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506a375-e376-4c6c-9641-86cb0d5c7beb None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:08.254367 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506a375-e376-4c6c-9641-86cb0d5c7beb None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:08.254784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506a375-e376-4c6c-9641-86cb0d5c7beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:08.304501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-b506a375-e376-4c6c-9641-86cb0d5c7beb None None] MFA Rules not processed for user `56818ebbb5de483b85e6889ce59234e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:10:08.306747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b506a375-e376-4c6c-9641-86cb0d5c7beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:08.327879 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1719/3434] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:10:08 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:10:08.373510 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73c7cb-8608-4bc3-a687-9a1439c62e92 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:08.373959 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73c7cb-8608-4bc3-a687-9a1439c62e92 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:08.374434 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73c7cb-8608-4bc3-a687-9a1439c62e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:08.398024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-2d73c7cb-8608-4bc3-a687-9a1439c62e92 None None] MFA Rules not processed for user `56818ebbb5de483b85e6889ce59234e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:10:08.399483 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2d73c7cb-8608-4bc3-a687-9a1439c62e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:08.407731 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1716/3435] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:10:08 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:10:09.487024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506a375-e376-4c6c-9641-86cb0d5c7beb None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:09.488965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b506a375-e376-4c6c-9641-86cb0d5c7beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:09.559409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506a375-e376-4c6c-9641-86cb0d5c7beb None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:09.563861 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f80687-4d37-4d82-afed-dd5898bd1507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:09.564488 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f80687-4d37-4d82-afed-dd5898bd1507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:09.564769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f80687-4d37-4d82-afed-dd5898bd1507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:09.565043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f80687-4d37-4d82-afed-dd5898bd1507 admin admin] PATH_INFO: `/v3/users/e17afcbd7fd346b884e55a7a587343ed` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:09.566186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f80687-4d37-4d82-afed-dd5898bd1507 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e17afcbd7fd346b884e55a7a587343ed)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:09.568103 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f80687-4d37-4d82-afed-dd5898bd1507 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:09.608123 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:10:09.624068 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f6f80687-4d37-4d82-afed-dd5898bd1507 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e17afcbd7fd346b884e55a7a587343ed'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:09.624640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f6f80687-4d37-4d82-afed-dd5898bd1507 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e17afcbd7fd346b884e55a7a587343ed'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:09.631669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f6f80687-4d37-4d82-afed-dd5898bd1507 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e17afcbd7fd346b884e55a7a587343ed'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:09.643691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f6f80687-4d37-4d82-afed-dd5898bd1507 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e17afcbd7fd346b884e55a7a587343ed'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:09.644372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f6f80687-4d37-4d82-afed-dd5898bd1507 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e17afcbd7fd346b884e55a7a587343ed'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:09.667017 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1720/3436] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:10:09 2022] DELETE /identity/v3/users/e17afcbd7fd346b884e55a7a587343ed => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:10:09.890772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73c7cb-8608-4bc3-a687-9a1439c62e92 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:09.921359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73c7cb-8608-4bc3-a687-9a1439c62e92 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:10.012722 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:10:10.019485 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32a420-ce07-430b-ba90-3eb4067e5c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:10.020134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32a420-ce07-430b-ba90-3eb4067e5c06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:10.020644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32a420-ce07-430b-ba90-3eb4067e5c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:10.021138 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32a420-ce07-430b-ba90-3eb4067e5c06 admin admin] PATH_INFO: `/v3/projects/77c8f017c2754126a39fc390b243a71e` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:10.022537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32a420-ce07-430b-ba90-3eb4067e5c06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77c8f017c2754126a39fc390b243a71e)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:10.024691 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32a420-ce07-430b-ba90-3eb4067e5c06 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:10.084685 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4d32a420-ce07-430b-ba90-3eb4067e5c06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77c8f017c2754126a39fc390b243a71e', 'request_id': 'req-4d32a420-ce07-430b-ba90-3eb4067e5c06'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:10.094743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4d32a420-ce07-430b-ba90-3eb4067e5c06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77c8f017c2754126a39fc390b243a71e', 'request_id': 'req-4d32a420-ce07-430b-ba90-3eb4067e5c06'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:10.101582 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4d32a420-ce07-430b-ba90-3eb4067e5c06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77c8f017c2754126a39fc390b243a71e', 'request_id': 'req-4d32a420-ce07-430b-ba90-3eb4067e5c06'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:10.114981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4d32a420-ce07-430b-ba90-3eb4067e5c06 admin admin] The token cache is being invalidate because project 77c8f017c2754126a39fc390b243a71e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:10:10.115168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4d32a420-ce07-430b-ba90-3eb4067e5c06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:10.127466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4d32a420-ce07-430b-ba90-3eb4067e5c06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:10.131388 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1717/3437] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:10:09 2022] DELETE /identity/v3/projects/77c8f017c2754126a39fc390b243a71e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:10:10.135687 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f80687-4d37-4d82-afed-dd5898bd1507 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:10.137554 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f6f80687-4d37-4d82-afed-dd5898bd1507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:10.154514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f80687-4d37-4d82-afed-dd5898bd1507 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:10.220689 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ed44e-b857-4b21-8418-0b04cb14973b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:10.221561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ed44e-b857-4b21-8418-0b04cb14973b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:10.222572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ed44e-b857-4b21-8418-0b04cb14973b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:10.222852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ed44e-b857-4b21-8418-0b04cb14973b admin admin] PATH_INFO: `/v3/users/bb875b06dd5b4a6f9ea3f3865d57d412` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:10.224707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ed44e-b857-4b21-8418-0b04cb14973b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb875b06dd5b4a6f9ea3f3865d57d412)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:10.228000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ed44e-b857-4b21-8418-0b04cb14973b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:10.306009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f67ed44e-b857-4b21-8418-0b04cb14973b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb875b06dd5b4a6f9ea3f3865d57d412'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:10.306552 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f67ed44e-b857-4b21-8418-0b04cb14973b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb875b06dd5b4a6f9ea3f3865d57d412'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:10.315531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f67ed44e-b857-4b21-8418-0b04cb14973b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb875b06dd5b4a6f9ea3f3865d57d412'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:10.338382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f67ed44e-b857-4b21-8418-0b04cb14973b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb875b06dd5b4a6f9ea3f3865d57d412'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:10.341665 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f67ed44e-b857-4b21-8418-0b04cb14973b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb875b06dd5b4a6f9ea3f3865d57d412'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:10.379196 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1721/3438] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:10:10 2022] DELETE /identity/v3/users/bb875b06dd5b4a6f9ea3f3865d57d412 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:10:10.698627 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32a420-ce07-430b-ba90-3eb4067e5c06 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:10.700074 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4d32a420-ce07-430b-ba90-3eb4067e5c06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:10.722395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32a420-ce07-430b-ba90-3eb4067e5c06 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:10.848879 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f9711-ecfd-475b-b730-1d543dbb2ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:10.850024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f9711-ecfd-475b-b730-1d543dbb2ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:10.850138 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f9711-ecfd-475b-b730-1d543dbb2ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:10.850419 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f9711-ecfd-475b-b730-1d543dbb2ad6 admin admin] PATH_INFO: `/v3/projects/d45b96dc88684137abad839fd8bab131` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:10.852081 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f9711-ecfd-475b-b730-1d543dbb2ad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d45b96dc88684137abad839fd8bab131)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:10.854148 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f9711-ecfd-475b-b730-1d543dbb2ad6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:10.947617 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ed44e-b857-4b21-8418-0b04cb14973b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:10.950595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f67ed44e-b857-4b21-8418-0b04cb14973b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:10.970985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-eb7f9711-ecfd-475b-b730-1d543dbb2ad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd45b96dc88684137abad839fd8bab131', 'request_id': 'req-eb7f9711-ecfd-475b-b730-1d543dbb2ad6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:10.991232 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-eb7f9711-ecfd-475b-b730-1d543dbb2ad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd45b96dc88684137abad839fd8bab131', 'request_id': 'req-eb7f9711-ecfd-475b-b730-1d543dbb2ad6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:11.003255 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-eb7f9711-ecfd-475b-b730-1d543dbb2ad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd45b96dc88684137abad839fd8bab131', 'request_id': 'req-eb7f9711-ecfd-475b-b730-1d543dbb2ad6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:11.007246 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:10:11.053054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-eb7f9711-ecfd-475b-b730-1d543dbb2ad6 admin admin] The token cache is being invalidate because project d45b96dc88684137abad839fd8bab131 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:10:11.053354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-eb7f9711-ecfd-475b-b730-1d543dbb2ad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:11.056618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-eb7f9711-ecfd-475b-b730-1d543dbb2ad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:11.057524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ed44e-b857-4b21-8418-0b04cb14973b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:11.066702 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1718/3439] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:10:10 2022] DELETE /identity/v3/projects/d45b96dc88684137abad839fd8bab131 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:10:11.066702 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f9711-ecfd-475b-b730-1d543dbb2ad6 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:11.074181 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-eb7f9711-ecfd-475b-b730-1d543dbb2ad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:11.110160 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:10:11.137913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb5bbe-cc70-47b1-a96b-755548a67b73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:11.140653 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb5bbe-cc70-47b1-a96b-755548a67b73 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:11.141285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb5bbe-cc70-47b1-a96b-755548a67b73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:11.141737 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb5bbe-cc70-47b1-a96b-755548a67b73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:11.145214 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1feb5bbe-cc70-47b1-a96b-755548a67b73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:11.161460 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb5bbe-cc70-47b1-a96b-755548a67b73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:11.180383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb5bbe-cc70-47b1-a96b-755548a67b73 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:11.180383 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1722/3440] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:10:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:10:11.180383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed5d4b-1803-4a2b-b618-080e6f4874db None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:11.181452 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed5d4b-1803-4a2b-b618-080e6f4874db None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:11.181452 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed5d4b-1803-4a2b-b618-080e6f4874db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:11.208715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-48ed5d4b-1803-4a2b-b618-080e6f4874db None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:10:11.210564 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-48ed5d4b-1803-4a2b-b618-080e6f4874db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:11.234957 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f9711-ecfd-475b-b730-1d543dbb2ad6 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:11.240319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5bff8-458f-47bc-8f82-e6e2a011c16a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:11.240946 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5bff8-458f-47bc-8f82-e6e2a011c16a service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:11.241228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5bff8-458f-47bc-8f82-e6e2a011c16a service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:11.241602 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5bff8-458f-47bc-8f82-e6e2a011c16a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:11.255135 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5bff8-458f-47bc-8f82-e6e2a011c16a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:11.256579 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5bff8-458f-47bc-8f82-e6e2a011c16a service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:11.267437 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1719/3441] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:10:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:10:11.268629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d026b6-d3a9-42a7-9244-ad420b30c1d9 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:11.268916 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d026b6-d3a9-42a7-9244-ad420b30c1d9 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:11.269189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d026b6-d3a9-42a7-9244-ad420b30c1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:11.315699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-13d026b6-d3a9-42a7-9244-ad420b30c1d9 None None] MFA Rules not processed for user `575bb87368454c08a703e99526e6f00c`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:10:11.318811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-13d026b6-d3a9-42a7-9244-ad420b30c1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:11.355038 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1723/3442] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:10:11.365248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820962fc-672c-48a0-885a-91a500bc57b4 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:11.365733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820962fc-672c-48a0-885a-91a500bc57b4 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:11.366176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820962fc-672c-48a0-885a-91a500bc57b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:11.414050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-820962fc-672c-48a0-885a-91a500bc57b4 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:10:11.415495 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-820962fc-672c-48a0-885a-91a500bc57b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:11.427242 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1724/3443] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:10:11.430910 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820962fc-672c-48a0-885a-91a500bc57b4 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:11.454506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820962fc-672c-48a0-885a-91a500bc57b4 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:11.460350 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1720/3444] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:10:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:10:11.464024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505271c0-ca20-4d41-95bf-6aa20a4b7909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:11.464759 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505271c0-ca20-4d41-95bf-6aa20a4b7909 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:11.465823 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505271c0-ca20-4d41-95bf-6aa20a4b7909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:11.466458 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505271c0-ca20-4d41-95bf-6aa20a4b7909 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:11.467396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505271c0-ca20-4d41-95bf-6aa20a4b7909 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:10:11.467803 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505271c0-ca20-4d41-95bf-6aa20a4b7909 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:11.470529 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505271c0-ca20-4d41-95bf-6aa20a4b7909 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:11.489091 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1725/3445] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:10:11.490349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d026b6-d3a9-42a7-9244-ad420b30c1d9 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:11.504317 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d026b6-d3a9-42a7-9244-ad420b30c1d9 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:11.513319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722db080-e485-4c23-8cc3-4a6096a695ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:11.514008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722db080-e485-4c23-8cc3-4a6096a695ca admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:11.514290 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722db080-e485-4c23-8cc3-4a6096a695ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:11.514559 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722db080-e485-4c23-8cc3-4a6096a695ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:11.515453 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722db080-e485-4c23-8cc3-4a6096a695ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:11.517328 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722db080-e485-4c23-8cc3-4a6096a695ca admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:11.587776 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1721/3446] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:10:11 2022] POST /identity/v3/projects => generated 393 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:10:11.589536 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505271c0-ca20-4d41-95bf-6aa20a4b7909 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:11.604985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505271c0-ca20-4d41-95bf-6aa20a4b7909 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:11.722996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b853c94-32d1-419d-a52f-c8cb55c12321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:11.724091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b853c94-32d1-419d-a52f-c8cb55c12321 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:11.724598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b853c94-32d1-419d-a52f-c8cb55c12321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:11.725030 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b853c94-32d1-419d-a52f-c8cb55c12321 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:11.725950 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b853c94-32d1-419d-a52f-c8cb55c12321 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:11.729961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b853c94-32d1-419d-a52f-c8cb55c12321 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:11.747399 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:10:11.777576 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1726/3447] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:10:11 2022] POST /identity/v3/users => generated 297 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:10:11.781416 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722db080-e485-4c23-8cc3-4a6096a695ca admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:11.797807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722db080-e485-4c23-8cc3-4a6096a695ca admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:11.804081 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b96a48-8a12-4bbe-87c6-2fa05d766d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:11.804828 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b96a48-8a12-4bbe-87c6-2fa05d766d66 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:11.806137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b96a48-8a12-4bbe-87c6-2fa05d766d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:11.806510 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b96a48-8a12-4bbe-87c6-2fa05d766d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:11.807529 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b96a48-8a12-4bbe-87c6-2fa05d766d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:11.809841 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b96a48-8a12-4bbe-87c6-2fa05d766d66 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:11.837164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b853c94-32d1-419d-a52f-c8cb55c12321 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:11.838330 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1722/3448] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:10:11.854436 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b853c94-32d1-419d-a52f-c8cb55c12321 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:11.887255 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658b11b-d1e5-46c2-9ac7-454fc5ea6ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:11.888794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658b11b-d1e5-46c2-9ac7-454fc5ea6ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:11.889780 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658b11b-d1e5-46c2-9ac7-454fc5ea6ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:11.890280 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658b11b-d1e5-46c2-9ac7-454fc5ea6ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:11.895942 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658b11b-d1e5-46c2-9ac7-454fc5ea6ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:11.901762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658b11b-d1e5-46c2-9ac7-454fc5ea6ef9 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:11.916137 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1727/3449] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:10:11.921484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b96a48-8a12-4bbe-87c6-2fa05d766d66 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:11.938076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b96a48-8a12-4bbe-87c6-2fa05d766d66 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:11.945686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87341e09-3ec7-4bb5-9a74-56f988f59018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:11.946363 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87341e09-3ec7-4bb5-9a74-56f988f59018 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:11.946644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87341e09-3ec7-4bb5-9a74-56f988f59018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:11.946917 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87341e09-3ec7-4bb5-9a74-56f988f59018 admin admin] PATH_INFO: `/v3/projects/017f7f8c6ae746c99de3a7d374361523/users/aa10e4bfa8ec40e4805ab582831eb335/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:11.993772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87341e09-3ec7-4bb5-9a74-56f988f59018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=017f7f8c6ae746c99de3a7d374361523, user_id=aa10e4bfa8ec40e4805ab582831eb335, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:11.998134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87341e09-3ec7-4bb5-9a74-56f988f59018 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:12.020661 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1723/3450] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:10:11 2022] PUT /identity/v3/projects/017f7f8c6ae746c99de3a7d374361523/users/aa10e4bfa8ec40e4805ab582831eb335/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:10:12.032167 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d010bf8-35ad-4e9c-8ba7-891f28711ae2 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:12.033116 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d010bf8-35ad-4e9c-8ba7-891f28711ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:12.033701 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d010bf8-35ad-4e9c-8ba7-891f28711ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:12.067641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-6d010bf8-35ad-4e9c-8ba7-891f28711ae2 None None] MFA Rules not processed for user `aa10e4bfa8ec40e4805ab582831eb335`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:10:12.068941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6d010bf8-35ad-4e9c-8ba7-891f28711ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:12.153062 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1728/3451] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:10:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:10:12.157728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87341e09-3ec7-4bb5-9a74-56f988f59018 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:12.231534 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:10:12.238346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87341e09-3ec7-4bb5-9a74-56f988f59018 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:12.245866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44620cf-9c12-4d3d-a63c-03f84862ae64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:12.246520 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44620cf-9c12-4d3d-a63c-03f84862ae64 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:12.246831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44620cf-9c12-4d3d-a63c-03f84862ae64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:12.247021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44620cf-9c12-4d3d-a63c-03f84862ae64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:12.247657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44620cf-9c12-4d3d-a63c-03f84862ae64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:12.250513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44620cf-9c12-4d3d-a63c-03f84862ae64 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:12.286577 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1724/3452] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:10:12 2022] POST /identity/v3/projects => generated 391 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:10:12.290456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d010bf8-35ad-4e9c-8ba7-891f28711ae2 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:12.302553 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d010bf8-35ad-4e9c-8ba7-891f28711ae2 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:12.445905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c1d8a-a6a9-45ec-b62c-57eca478e973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:12.445905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c1d8a-a6a9-45ec-b62c-57eca478e973 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:12.453469 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c1d8a-a6a9-45ec-b62c-57eca478e973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:12.453469 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c1d8a-a6a9-45ec-b62c-57eca478e973 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:12.453469 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c1d8a-a6a9-45ec-b62c-57eca478e973 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:12.463440 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c1d8a-a6a9-45ec-b62c-57eca478e973 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:12.521961 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1729/3453] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:10:12 2022] POST /identity/v3/users => generated 302 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:10:12.525560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44620cf-9c12-4d3d-a63c-03f84862ae64 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:12.537083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44620cf-9c12-4d3d-a63c-03f84862ae64 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:12.563614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f72cf5-55d6-4920-a8fc-6305d57cafd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:12.564335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f72cf5-55d6-4920-a8fc-6305d57cafd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:12.564719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f72cf5-55d6-4920-a8fc-6305d57cafd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:12.564985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f72cf5-55d6-4920-a8fc-6305d57cafd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:12.565783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f72cf5-55d6-4920-a8fc-6305d57cafd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:12.567456 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f72cf5-55d6-4920-a8fc-6305d57cafd5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:12.616304 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1725/3454] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:10:12.621293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c1d8a-a6a9-45ec-b62c-57eca478e973 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:12.642146 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c1d8a-a6a9-45ec-b62c-57eca478e973 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:12.658869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565ae77-1ba6-4735-a315-860b281dbfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:12.659558 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565ae77-1ba6-4735-a315-860b281dbfa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:12.659839 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565ae77-1ba6-4735-a315-860b281dbfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:12.660120 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565ae77-1ba6-4735-a315-860b281dbfa3 admin admin] PATH_INFO: `/v3/projects/7bd177c105a7411ca7d7e1e11e319745/users/68c85ad54d324478bc012d078cb8744f/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:12.696294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8565ae77-1ba6-4735-a315-860b281dbfa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bd177c105a7411ca7d7e1e11e319745, user_id=68c85ad54d324478bc012d078cb8744f, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:12.701169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8565ae77-1ba6-4735-a315-860b281dbfa3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:12.731335 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1730/3455] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:10:12 2022] PUT /identity/v3/projects/7bd177c105a7411ca7d7e1e11e319745/users/68c85ad54d324478bc012d078cb8744f/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:10:12.735447 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f72cf5-55d6-4920-a8fc-6305d57cafd5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:12.746466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f72cf5-55d6-4920-a8fc-6305d57cafd5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:12.832229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e52a3-68da-406e-924f-4b5e9b749fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:12.833105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e52a3-68da-406e-924f-4b5e9b749fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:12.833395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e52a3-68da-406e-924f-4b5e9b749fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:12.834614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e52a3-68da-406e-924f-4b5e9b749fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:12.835383 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e52a3-68da-406e-924f-4b5e9b749fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:12.838216 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e52a3-68da-406e-924f-4b5e9b749fc0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:12.862047 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1726/3456] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:10:12.863576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565ae77-1ba6-4735-a315-860b281dbfa3 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:12.878660 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565ae77-1ba6-4735-a315-860b281dbfa3 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:12.894344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996565a-5165-4374-b89f-3491af36f3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:12.895115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996565a-5165-4374-b89f-3491af36f3b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:12.895375 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996565a-5165-4374-b89f-3491af36f3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:12.895658 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996565a-5165-4374-b89f-3491af36f3b2 admin admin] PATH_INFO: `/v3/projects/7bd177c105a7411ca7d7e1e11e319745/users/68c85ad54d324478bc012d078cb8744f/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:12.900613 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7996565a-5165-4374-b89f-3491af36f3b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bd177c105a7411ca7d7e1e11e319745, user_id=68c85ad54d324478bc012d078cb8744f, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:12.905365 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7996565a-5165-4374-b89f-3491af36f3b2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:12.948570 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1731/3457] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:10:12 2022] PUT /identity/v3/projects/7bd177c105a7411ca7d7e1e11e319745/users/68c85ad54d324478bc012d078cb8744f/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:10:12.953388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbab64-db33-412a-8a1b-b9ddd83ff606 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:12.953715 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbab64-db33-412a-8a1b-b9ddd83ff606 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:12.953994 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbab64-db33-412a-8a1b-b9ddd83ff606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:13.025622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-26cbab64-db33-412a-8a1b-b9ddd83ff606 None None] MFA Rules not processed for user `68c85ad54d324478bc012d078cb8744f`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:10:13.027148 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-26cbab64-db33-412a-8a1b-b9ddd83ff606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:13.177343 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1727/3458] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:10:12 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:10:13.182146 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564822a6-8c78-430a-a7e0-83cada09f1d5 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:13.183227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564822a6-8c78-430a-a7e0-83cada09f1d5 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:13.183227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564822a6-8c78-430a-a7e0-83cada09f1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:13.206300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-564822a6-8c78-430a-a7e0-83cada09f1d5 None None] MFA Rules not processed for user `aa10e4bfa8ec40e4805ab582831eb335`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:10:13.207723 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-564822a6-8c78-430a-a7e0-83cada09f1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:13.240526 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:10:13.290520 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1732/3459] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:10:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:10:13.570948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbab64-db33-412a-8a1b-b9ddd83ff606 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:13.572371 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-26cbab64-db33-412a-8a1b-b9ddd83ff606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:13.657842 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:10:13.696664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbab64-db33-412a-8a1b-b9ddd83ff606 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:13.703667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b4b8b-6e90-4a0a-b43c-5c8060650bbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:13.704664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b4b8b-6e90-4a0a-b43c-5c8060650bbc service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:13.705168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b4b8b-6e90-4a0a-b43c-5c8060650bbc service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:13.705835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b4b8b-6e90-4a0a-b43c-5c8060650bbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:13.717229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b4b8b-6e90-4a0a-b43c-5c8060650bbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:13.721093 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b4b8b-6e90-4a0a-b43c-5c8060650bbc service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:13.738586 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1728/3460] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:10:13 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:10:14.646346 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564822a6-8c78-430a-a7e0-83cada09f1d5 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:14.648076 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-564822a6-8c78-430a-a7e0-83cada09f1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:14.679942 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564822a6-8c78-430a-a7e0-83cada09f1d5 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:14.692875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423e27e-b5c4-49f2-a983-05682f75cb25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:14.693797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423e27e-b5c4-49f2-a983-05682f75cb25 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:14.694223 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423e27e-b5c4-49f2-a983-05682f75cb25 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:14.694631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423e27e-b5c4-49f2-a983-05682f75cb25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:14.696930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5423e27e-b5c4-49f2-a983-05682f75cb25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:14.786010 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423e27e-b5c4-49f2-a983-05682f75cb25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:14.788010 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423e27e-b5c4-49f2-a983-05682f75cb25 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:14.800539 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1733/3461] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:10:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:10:18.207960 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b4b8b-6e90-4a0a-b43c-5c8060650bbc service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:18.225300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b4b8b-6e90-4a0a-b43c-5c8060650bbc service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:18.243692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb43ed6-3458-4da0-acb3-cd445a6f3a45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:18.245110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb43ed6-3458-4da0-acb3-cd445a6f3a45 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:18.245574 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb43ed6-3458-4da0-acb3-cd445a6f3a45 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:18.245998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb43ed6-3458-4da0-acb3-cd445a6f3a45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:18.248137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ceb43ed6-3458-4da0-acb3-cd445a6f3a45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:18.264765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb43ed6-3458-4da0-acb3-cd445a6f3a45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:18.266673 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb43ed6-3458-4da0-acb3-cd445a6f3a45 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:18.282092 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1729/3462] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:10:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:10:20.618929 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423e27e-b5c4-49f2-a983-05682f75cb25 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:20.644716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423e27e-b5c4-49f2-a983-05682f75cb25 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:20.661811 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade61e54-595c-4c00-9429-bad07456d630 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:20.662753 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade61e54-595c-4c00-9429-bad07456d630 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:20.663214 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade61e54-595c-4c00-9429-bad07456d630 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:20.664449 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade61e54-595c-4c00-9429-bad07456d630 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:20.670745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ade61e54-595c-4c00-9429-bad07456d630 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:20.700413 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade61e54-595c-4c00-9429-bad07456d630 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:20.704005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade61e54-595c-4c00-9429-bad07456d630 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:20.730224 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1734/3463] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:10:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:10:21.064789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb43ed6-3458-4da0-acb3-cd445a6f3a45 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:21.067473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ceb43ed6-3458-4da0-acb3-cd445a6f3a45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:21.174186 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb43ed6-3458-4da0-acb3-cd445a6f3a45 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:21.195414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4a139-b233-4245-8140-5d0926c64fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:21.197784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4a139-b233-4245-8140-5d0926c64fa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:21.198657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4a139-b233-4245-8140-5d0926c64fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:21.199028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4a139-b233-4245-8140-5d0926c64fa6 admin admin] PATH_INFO: `/v3/users/9bb80d11117547b681f80a38ce749370` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:21.200334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4a139-b233-4245-8140-5d0926c64fa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bb80d11117547b681f80a38ce749370)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:21.204307 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4a139-b233-4245-8140-5d0926c64fa6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:21.292727 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dfa4a139-b233-4245-8140-5d0926c64fa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bb80d11117547b681f80a38ce749370'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:21.293517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dfa4a139-b233-4245-8140-5d0926c64fa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bb80d11117547b681f80a38ce749370'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:21.304014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dfa4a139-b233-4245-8140-5d0926c64fa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bb80d11117547b681f80a38ce749370'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:21.313671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dfa4a139-b233-4245-8140-5d0926c64fa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bb80d11117547b681f80a38ce749370'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:21.315038 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dfa4a139-b233-4245-8140-5d0926c64fa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bb80d11117547b681f80a38ce749370'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:21.360331 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1730/3464] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:10:21 2022] DELETE /identity/v3/users/9bb80d11117547b681f80a38ce749370 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:10:21.366809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4a139-b233-4245-8140-5d0926c64fa6 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:21.367596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281961c-aa41-48c3-a4c8-b0d2eb51111a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:21.368035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281961c-aa41-48c3-a4c8-b0d2eb51111a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:21.368515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281961c-aa41-48c3-a4c8-b0d2eb51111a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:21.368787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-dfa4a139-b233-4245-8140-5d0926c64fa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:21.391355 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-6281961c-aa41-48c3-a4c8-b0d2eb51111a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:10:21.393022 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6281961c-aa41-48c3-a4c8-b0d2eb51111a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:21.422128 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:10:21.443524 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4a139-b233-4245-8140-5d0926c64fa6 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:21.450809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b490c5-1808-43db-983c-22a321a839ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:21.451480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b490c5-1808-43db-983c-22a321a839ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:21.451758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b490c5-1808-43db-983c-22a321a839ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:21.452030 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b490c5-1808-43db-983c-22a321a839ee admin admin] PATH_INFO: `/v3/users/56818ebbb5de483b85e6889ce59234e4` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:21.453297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b490c5-1808-43db-983c-22a321a839ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=56818ebbb5de483b85e6889ce59234e4)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:21.455309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b490c5-1808-43db-983c-22a321a839ee admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:21.459169 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1735/3465] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:10:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:10:21.468471 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281961c-aa41-48c3-a4c8-b0d2eb51111a None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:21.469883 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6281961c-aa41-48c3-a4c8-b0d2eb51111a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:21.510618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-33b490c5-1808-43db-983c-22a321a839ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56818ebbb5de483b85e6889ce59234e4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:21.511359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-33b490c5-1808-43db-983c-22a321a839ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56818ebbb5de483b85e6889ce59234e4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:21.518409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-33b490c5-1808-43db-983c-22a321a839ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56818ebbb5de483b85e6889ce59234e4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:21.526401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-33b490c5-1808-43db-983c-22a321a839ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56818ebbb5de483b85e6889ce59234e4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:21.527035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-33b490c5-1808-43db-983c-22a321a839ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56818ebbb5de483b85e6889ce59234e4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:21.528868 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281961c-aa41-48c3-a4c8-b0d2eb51111a None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:21.532773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc179e-a7a3-4d86-884f-a54b311ab072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:21.533383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc179e-a7a3-4d86-884f-a54b311ab072 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:21.533699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc179e-a7a3-4d86-884f-a54b311ab072 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:21.534109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc179e-a7a3-4d86-884f-a54b311ab072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:21.535838 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6bdc179e-a7a3-4d86-884f-a54b311ab072 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:21.546147 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:10:21.546894 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1731/3466] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:10:21 2022] DELETE /identity/v3/users/56818ebbb5de483b85e6889ce59234e4 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:10:21.548596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc179e-a7a3-4d86-884f-a54b311ab072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:21.550762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc179e-a7a3-4d86-884f-a54b311ab072 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:21.561278 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1736/3467] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:10:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:10:21.769575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b490c5-1808-43db-983c-22a321a839ee admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:21.771278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-33b490c5-1808-43db-983c-22a321a839ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:21.786231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc179e-a7a3-4d86-884f-a54b311ab072 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:21.788068 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6bdc179e-a7a3-4d86-884f-a54b311ab072 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:21.807222 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc179e-a7a3-4d86-884f-a54b311ab072 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:21.858599 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b490c5-1808-43db-983c-22a321a839ee admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:21.863775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620e154-198b-4d4b-a055-78e19370db1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:21.864214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620e154-198b-4d4b-a055-78e19370db1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:21.864474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620e154-198b-4d4b-a055-78e19370db1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:21.864869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620e154-198b-4d4b-a055-78e19370db1e admin admin] PATH_INFO: `/v3/projects/322408cf9af04fbeb1f7770406e24cf8` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:21.866034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620e154-198b-4d4b-a055-78e19370db1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=322408cf9af04fbeb1f7770406e24cf8)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:21.868367 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620e154-198b-4d4b-a055-78e19370db1e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:21.877744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f5bde-fe90-46bc-bfe1-aedad9b37009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:21.878699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f5bde-fe90-46bc-bfe1-aedad9b37009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:21.879176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f5bde-fe90-46bc-bfe1-aedad9b37009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:21.879564 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f5bde-fe90-46bc-bfe1-aedad9b37009 admin admin] PATH_INFO: `/v3/projects/750e7f8ac9c1437fa477bba2336d4d58` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:21.880777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f5bde-fe90-46bc-bfe1-aedad9b37009 admin admin] RBAC: Authorizing `identity:delete_project(project_id=750e7f8ac9c1437fa477bba2336d4d58)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:21.882916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f5bde-fe90-46bc-bfe1-aedad9b37009 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:21.931751 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d620e154-198b-4d4b-a055-78e19370db1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '322408cf9af04fbeb1f7770406e24cf8', 'request_id': 'req-d620e154-198b-4d4b-a055-78e19370db1e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:21.949776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d620e154-198b-4d4b-a055-78e19370db1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '322408cf9af04fbeb1f7770406e24cf8', 'request_id': 'req-d620e154-198b-4d4b-a055-78e19370db1e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:21.959552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d620e154-198b-4d4b-a055-78e19370db1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '322408cf9af04fbeb1f7770406e24cf8', 'request_id': 'req-d620e154-198b-4d4b-a055-78e19370db1e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:21.966857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f51f5bde-fe90-46bc-bfe1-aedad9b37009 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '750e7f8ac9c1437fa477bba2336d4d58', 'request_id': 'req-f51f5bde-fe90-46bc-bfe1-aedad9b37009'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:21.973007 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:10:21.978575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f51f5bde-fe90-46bc-bfe1-aedad9b37009 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '750e7f8ac9c1437fa477bba2336d4d58', 'request_id': 'req-f51f5bde-fe90-46bc-bfe1-aedad9b37009'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:21.987687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d620e154-198b-4d4b-a055-78e19370db1e admin admin] The token cache is being invalidate because project 322408cf9af04fbeb1f7770406e24cf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:10:21.987958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d620e154-198b-4d4b-a055-78e19370db1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:21.989396 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d620e154-198b-4d4b-a055-78e19370db1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:21.990551 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f51f5bde-fe90-46bc-bfe1-aedad9b37009 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '750e7f8ac9c1437fa477bba2336d4d58', 'request_id': 'req-f51f5bde-fe90-46bc-bfe1-aedad9b37009'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:21.994039 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1732/3468] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:10:21 2022] DELETE /identity/v3/projects/322408cf9af04fbeb1f7770406e24cf8 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:10:21.998630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1a3ed-782a-4447-91a7-b1743cecef54 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:21.999019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1a3ed-782a-4447-91a7-b1743cecef54 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:21.999396 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1a3ed-782a-4447-91a7-b1743cecef54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:22.011153 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f51f5bde-fe90-46bc-bfe1-aedad9b37009 admin admin] The token cache is being invalidate because project 750e7f8ac9c1437fa477bba2336d4d58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:10:22.011769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f51f5bde-fe90-46bc-bfe1-aedad9b37009 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:22.012740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f51f5bde-fe90-46bc-bfe1-aedad9b37009 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:22.016564 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1737/3469] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:10:21 2022] DELETE /identity/v3/projects/750e7f8ac9c1437fa477bba2336d4d58 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:10:22.020859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f5bde-fe90-46bc-bfe1-aedad9b37009 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:22.022573 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f51f5bde-fe90-46bc-bfe1-aedad9b37009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:22.027483 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-f3e1a3ed-782a-4447-91a7-b1743cecef54 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:10:22.028809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f3e1a3ed-782a-4447-91a7-b1743cecef54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:22.139112 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1733/3470] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:10:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:10:22.148413 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998caf9-196f-456e-aebf-1468ec5f0ec4 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:22.148764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998caf9-196f-456e-aebf-1468ec5f0ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:22.149104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998caf9-196f-456e-aebf-1468ec5f0ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:22.154843 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f5bde-fe90-46bc-bfe1-aedad9b37009 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:22.164072 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e37b8c-7d7d-47d4-8924-c7603b31a2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:22.164857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e37b8c-7d7d-47d4-8924-c7603b31a2d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:22.165234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e37b8c-7d7d-47d4-8924-c7603b31a2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:22.165664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e37b8c-7d7d-47d4-8924-c7603b31a2d3 admin admin] PATH_INFO: `/v3/users/381f2994a4c84b39926eea474d60ef04` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:22.168725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e37b8c-7d7d-47d4-8924-c7603b31a2d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=381f2994a4c84b39926eea474d60ef04)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:22.171532 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e37b8c-7d7d-47d4-8924-c7603b31a2d3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:22.195547 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-7998caf9-196f-456e-aebf-1468ec5f0ec4 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:10:22.202745 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7998caf9-196f-456e-aebf-1468ec5f0ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:22.217949 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1734/3471] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:10:22.222127 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998caf9-196f-456e-aebf-1468ec5f0ec4 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:22.225821 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:10:22.236732 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998caf9-196f-456e-aebf-1468ec5f0ec4 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:22.242034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d39b8f-aaf2-44e0-a384-8201a929ba40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:22.242645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d39b8f-aaf2-44e0-a384-8201a929ba40 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:22.242932 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d39b8f-aaf2-44e0-a384-8201a929ba40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:22.243195 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d39b8f-aaf2-44e0-a384-8201a929ba40 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:22.243890 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d39b8f-aaf2-44e0-a384-8201a929ba40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:10:22.244197 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d39b8f-aaf2-44e0-a384-8201a929ba40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:22.245912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d39b8f-aaf2-44e0-a384-8201a929ba40 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:22.258870 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1735/3472] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:10:22.259428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-86e37b8c-7d7d-47d4-8924-c7603b31a2d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '381f2994a4c84b39926eea474d60ef04'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:22.260784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-86e37b8c-7d7d-47d4-8924-c7603b31a2d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '381f2994a4c84b39926eea474d60ef04'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:22.263852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d39b8f-aaf2-44e0-a384-8201a929ba40 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:22.265630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-14d39b8f-aaf2-44e0-a384-8201a929ba40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:22.269246 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-86e37b8c-7d7d-47d4-8924-c7603b31a2d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '381f2994a4c84b39926eea474d60ef04'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:22.280995 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d39b8f-aaf2-44e0-a384-8201a929ba40 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:22.281793 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-86e37b8c-7d7d-47d4-8924-c7603b31a2d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '381f2994a4c84b39926eea474d60ef04'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:22.282679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-86e37b8c-7d7d-47d4-8924-c7603b31a2d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '381f2994a4c84b39926eea474d60ef04'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:22.286707 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769c0f0-7d69-40b5-b126-26134922b081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:22.287402 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769c0f0-7d69-40b5-b126-26134922b081 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:22.287754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769c0f0-7d69-40b5-b126-26134922b081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:22.288153 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769c0f0-7d69-40b5-b126-26134922b081 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:22.289374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769c0f0-7d69-40b5-b126-26134922b081 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:22.294650 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769c0f0-7d69-40b5-b126-26134922b081 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:22.309721 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1738/3473] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:10:22 2022] DELETE /identity/v3/users/381f2994a4c84b39926eea474d60ef04 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:10:22.334173 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1736/3474] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:10:22 2022] POST /identity/v3/projects => generated 381 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:10:22.339397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e37b8c-7d7d-47d4-8924-c7603b31a2d3 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:22.431690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e37b8c-7d7d-47d4-8924-c7603b31a2d3 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:22.526260 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016ec81-19d0-45be-a4ef-c7a6854c0180 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:22.526628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016ec81-19d0-45be-a4ef-c7a6854c0180 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:22.526974 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016ec81-19d0-45be-a4ef-c7a6854c0180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:22.543166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c27f26-ac4a-40d5-a05a-e3cfcd9fc2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:22.543789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c27f26-ac4a-40d5-a05a-e3cfcd9fc2a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:22.544072 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c27f26-ac4a-40d5-a05a-e3cfcd9fc2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:22.544349 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c27f26-ac4a-40d5-a05a-e3cfcd9fc2a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:22.544980 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c27f26-ac4a-40d5-a05a-e3cfcd9fc2a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:22.547431 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c27f26-ac4a-40d5-a05a-e3cfcd9fc2a6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:22.589007 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1739/3475] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:10:22 2022] POST /identity/v3/users => generated 291 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:10:22.593632 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c27f26-ac4a-40d5-a05a-e3cfcd9fc2a6 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:22.603683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b016ec81-19d0-45be-a4ef-c7a6854c0180 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:10:22.604195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c27f26-ac4a-40d5-a05a-e3cfcd9fc2a6 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:22.604776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b016ec81-19d0-45be-a4ef-c7a6854c0180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:22.609487 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269f1e0-2a38-40e7-8a54-6656a28c3ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:22.610107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269f1e0-2a38-40e7-8a54-6656a28c3ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:22.610385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269f1e0-2a38-40e7-8a54-6656a28c3ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:22.610658 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269f1e0-2a38-40e7-8a54-6656a28c3ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:22.611297 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269f1e0-2a38-40e7-8a54-6656a28c3ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:22.612906 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269f1e0-2a38-40e7-8a54-6656a28c3ff0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:22.625486 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1740/3476] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:10:22.627964 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269f1e0-2a38-40e7-8a54-6656a28c3ff0 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:22.638939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269f1e0-2a38-40e7-8a54-6656a28c3ff0 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:22.645634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5f4de-e579-4def-911b-e7f0f77ce766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:22.646243 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5f4de-e579-4def-911b-e7f0f77ce766 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:22.646525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5f4de-e579-4def-911b-e7f0f77ce766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:22.646929 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5f4de-e579-4def-911b-e7f0f77ce766 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:22.647806 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b5f4de-e579-4def-911b-e7f0f77ce766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:22.649161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b5f4de-e579-4def-911b-e7f0f77ce766 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:22.660998 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1741/3477] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:10:22.665050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5f4de-e579-4def-911b-e7f0f77ce766 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:22.687322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5f4de-e579-4def-911b-e7f0f77ce766 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:22.693203 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794e912-eba9-4f5a-b200-462bd74ce5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:22.697237 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1737/3478] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:10:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:10:22.699094 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794e912-eba9-4f5a-b200-462bd74ce5c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:22.699558 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794e912-eba9-4f5a-b200-462bd74ce5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:22.700000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794e912-eba9-4f5a-b200-462bd74ce5c2 admin admin] PATH_INFO: `/v3/projects/132b86c03e6f48b2a6fe59bb6b6df842/users/5d072ddf52b9403eb9188d3f95bf9581/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:22.717318 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5794e912-eba9-4f5a-b200-462bd74ce5c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=132b86c03e6f48b2a6fe59bb6b6df842, user_id=5d072ddf52b9403eb9188d3f95bf9581, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:22.720681 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5794e912-eba9-4f5a-b200-462bd74ce5c2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:22.722555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016ec81-19d0-45be-a4ef-c7a6854c0180 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:22.724203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b016ec81-19d0-45be-a4ef-c7a6854c0180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:22.725286 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:10:22.737401 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1742/3479] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:10:22 2022] PUT /identity/v3/projects/132b86c03e6f48b2a6fe59bb6b6df842/users/5d072ddf52b9403eb9188d3f95bf9581/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:10:22.742625 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc934f55-cd3c-4060-9ad9-f2de62ca2047 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:22.742913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc934f55-cd3c-4060-9ad9-f2de62ca2047 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:22.743276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc934f55-cd3c-4060-9ad9-f2de62ca2047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:22.764852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-fc934f55-cd3c-4060-9ad9-f2de62ca2047 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:10:22.766274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fc934f55-cd3c-4060-9ad9-f2de62ca2047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:22.775641 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:10:22.828170 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1743/3480] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:10:22.830316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc934f55-cd3c-4060-9ad9-f2de62ca2047 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:22.832351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fc934f55-cd3c-4060-9ad9-f2de62ca2047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:22.844730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc934f55-cd3c-4060-9ad9-f2de62ca2047 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:22.845749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016ec81-19d0-45be-a4ef-c7a6854c0180 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:22.849491 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e14e3-4358-4a8f-9ff2-af2bffbd9b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:22.850105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e14e3-4358-4a8f-9ff2-af2bffbd9b3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:22.850390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e14e3-4358-4a8f-9ff2-af2bffbd9b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:22.850667 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e14e3-4358-4a8f-9ff2-af2bffbd9b3a admin admin] PATH_INFO: `/v3/projects/1d74e7cd546f47ccb0cfcd880c2f5ce0` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:22.851813 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e14e3-4358-4a8f-9ff2-af2bffbd9b3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d74e7cd546f47ccb0cfcd880c2f5ce0)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:22.853771 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e14e3-4358-4a8f-9ff2-af2bffbd9b3a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:22.908341 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d93e14e3-4358-4a8f-9ff2-af2bffbd9b3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d74e7cd546f47ccb0cfcd880c2f5ce0', 'request_id': 'req-d93e14e3-4358-4a8f-9ff2-af2bffbd9b3a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:22.913284 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e455561-bec4-4903-bb16-e5df432274d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:22.913932 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e455561-bec4-4903-bb16-e5df432274d2 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:22.914211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e455561-bec4-4903-bb16-e5df432274d2 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:22.914481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e455561-bec4-4903-bb16-e5df432274d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:22.917291 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d93e14e3-4358-4a8f-9ff2-af2bffbd9b3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d74e7cd546f47ccb0cfcd880c2f5ce0', 'request_id': 'req-d93e14e3-4358-4a8f-9ff2-af2bffbd9b3a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:22.925146 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d93e14e3-4358-4a8f-9ff2-af2bffbd9b3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d74e7cd546f47ccb0cfcd880c2f5ce0', 'request_id': 'req-d93e14e3-4358-4a8f-9ff2-af2bffbd9b3a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:22.939234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d93e14e3-4358-4a8f-9ff2-af2bffbd9b3a admin admin] The token cache is being invalidate because project 1d74e7cd546f47ccb0cfcd880c2f5ce0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:10:22.939521 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d93e14e3-4358-4a8f-9ff2-af2bffbd9b3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:22.940206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d93e14e3-4358-4a8f-9ff2-af2bffbd9b3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:22.941775 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1744/3481] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:10:22 2022] DELETE /identity/v3/projects/1d74e7cd546f47ccb0cfcd880c2f5ce0 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:10:22.942530 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e14e3-4358-4a8f-9ff2-af2bffbd9b3a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:22.944050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d93e14e3-4358-4a8f-9ff2-af2bffbd9b3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:22.983380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e455561-bec4-4903-bb16-e5df432274d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:22.985191 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e455561-bec4-4903-bb16-e5df432274d2 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:22.993837 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1738/3482] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:10:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 04 01:10:23.001965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccedbd-3e61-41b8-b891-8c46aba8deac None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:23.002554 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccedbd-3e61-41b8-b891-8c46aba8deac None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:23.002882 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccedbd-3e61-41b8-b891-8c46aba8deac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:23.008327 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e14e3-4358-4a8f-9ff2-af2bffbd9b3a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:23.012817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede4f0b-c694-4e6e-81fe-302bc126dd89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:23.013463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede4f0b-c694-4e6e-81fe-302bc126dd89 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:23.014429 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede4f0b-c694-4e6e-81fe-302bc126dd89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:23.014429 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede4f0b-c694-4e6e-81fe-302bc126dd89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:23.016749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-aede4f0b-c694-4e6e-81fe-302bc126dd89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:23.043916 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-10ccedbd-3e61-41b8-b891-8c46aba8deac None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:10:23.045169 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-10ccedbd-3e61-41b8-b891-8c46aba8deac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:23.063805 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:10:23.124168 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:10:23.142905 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1739/3483] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:10:23.150188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede4f0b-c694-4e6e-81fe-302bc126dd89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:23.150310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede4f0b-c694-4e6e-81fe-302bc126dd89 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:23.152031 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b5410-38c0-4707-be44-56db4d37884d None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:23.152272 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b5410-38c0-4707-be44-56db4d37884d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:23.152542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b5410-38c0-4707-be44-56db4d37884d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:23.166260 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1745/3484] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:10:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:10:23.179796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-241b5410-38c0-4707-be44-56db4d37884d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:10:23.181079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-241b5410-38c0-4707-be44-56db4d37884d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:23.201695 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1740/3485] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:10:23.205904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede4f0b-c694-4e6e-81fe-302bc126dd89 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:23.222624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede4f0b-c694-4e6e-81fe-302bc126dd89 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:23.228098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eec702-61a4-4860-a354-cf617c428418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:23.228923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eec702-61a4-4860-a354-cf617c428418 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:23.229206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eec702-61a4-4860-a354-cf617c428418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:23.229503 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eec702-61a4-4860-a354-cf617c428418 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:23.230150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eec702-61a4-4860-a354-cf617c428418 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:10:23.230560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eec702-61a4-4860-a354-cf617c428418 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:23.233082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eec702-61a4-4860-a354-cf617c428418 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:23.281796 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1746/3486] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:10:23.283338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b5410-38c0-4707-be44-56db4d37884d None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:23.297481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b5410-38c0-4707-be44-56db4d37884d None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:23.305147 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8f298-cb7c-41a2-a85d-8ae50bad848e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:23.306226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8f298-cb7c-41a2-a85d-8ae50bad848e admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:23.306762 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8f298-cb7c-41a2-a85d-8ae50bad848e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:23.307789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8f298-cb7c-41a2-a85d-8ae50bad848e admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:23.308847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8f298-cb7c-41a2-a85d-8ae50bad848e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:23.311938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8f298-cb7c-41a2-a85d-8ae50bad848e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:23.355962 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1741/3487] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:10:23 2022] POST /identity/v3/projects => generated 393 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:10:23.361104 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eec702-61a4-4860-a354-cf617c428418 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:23.389865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eec702-61a4-4860-a354-cf617c428418 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:23.423224 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8f298-cb7c-41a2-a85d-8ae50bad848e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:23.426486 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bad8f298-cb7c-41a2-a85d-8ae50bad848e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:23.649685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe9e4a-715d-4912-b65c-a04b93d24607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:23.655224 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe9e4a-715d-4912-b65c-a04b93d24607 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:23.656810 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe9e4a-715d-4912-b65c-a04b93d24607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:23.658957 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe9e4a-715d-4912-b65c-a04b93d24607 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:23.660948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe9e4a-715d-4912-b65c-a04b93d24607 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:23.664856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe9e4a-715d-4912-b65c-a04b93d24607 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:23.704274 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8f298-cb7c-41a2-a85d-8ae50bad848e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:23.722142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d6ccc-0bac-4e38-b5bd-892678f7a9e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:23.723107 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d6ccc-0bac-4e38-b5bd-892678f7a9e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:23.723642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d6ccc-0bac-4e38-b5bd-892678f7a9e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:23.724135 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d6ccc-0bac-4e38-b5bd-892678f7a9e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:23.726485 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-672d6ccc-0bac-4e38-b5bd-892678f7a9e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:23.740592 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1747/3488] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:10:23 2022] POST /identity/v3/users => generated 297 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:10:23.742409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe9e4a-715d-4912-b65c-a04b93d24607 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:23.756659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe9e4a-715d-4912-b65c-a04b93d24607 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:23.765164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb50370-98d5-4210-8fe1-1b72a075452d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:23.765358 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d6ccc-0bac-4e38-b5bd-892678f7a9e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:23.766422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb50370-98d5-4210-8fe1-1b72a075452d admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:23.766909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb50370-98d5-4210-8fe1-1b72a075452d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:23.767404 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb50370-98d5-4210-8fe1-1b72a075452d admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:23.768247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb50370-98d5-4210-8fe1-1b72a075452d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:23.768357 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d6ccc-0bac-4e38-b5bd-892678f7a9e6 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:23.770334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb50370-98d5-4210-8fe1-1b72a075452d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:23.788485 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1748/3489] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:10:23.789867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb50370-98d5-4210-8fe1-1b72a075452d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:23.802582 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1742/3490] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:10:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:10:23.804763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb50370-98d5-4210-8fe1-1b72a075452d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:23.821797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80868b3c-fd14-4df3-a5d8-358e1344f898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:23.821797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80868b3c-fd14-4df3-a5d8-358e1344f898 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:23.821797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80868b3c-fd14-4df3-a5d8-358e1344f898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:23.821797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80868b3c-fd14-4df3-a5d8-358e1344f898 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:23.822165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80868b3c-fd14-4df3-a5d8-358e1344f898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:23.822165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80868b3c-fd14-4df3-a5d8-358e1344f898 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:23.847153 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1749/3491] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:10:23.851693 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d6ccc-0bac-4e38-b5bd-892678f7a9e6 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:23.872729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d6ccc-0bac-4e38-b5bd-892678f7a9e6 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:23.884419 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e799c-308a-4061-bcf1-f0e291388793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:23.886344 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e799c-308a-4061-bcf1-f0e291388793 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:23.886782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e799c-308a-4061-bcf1-f0e291388793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:23.889409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e799c-308a-4061-bcf1-f0e291388793 admin admin] PATH_INFO: `/v3/projects/befa7438eda7474d97afb13fc48b0c57/users/64b69f98bbdb4317bf5b9a341ba28eb0/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:23.926365 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e799c-308a-4061-bcf1-f0e291388793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=befa7438eda7474d97afb13fc48b0c57, user_id=64b69f98bbdb4317bf5b9a341ba28eb0, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:23.930828 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e799c-308a-4061-bcf1-f0e291388793 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:23.961540 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1743/3492] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:10:23 2022] PUT /identity/v3/projects/befa7438eda7474d97afb13fc48b0c57/users/64b69f98bbdb4317bf5b9a341ba28eb0/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:10:23.990111 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e897f-8cde-4fcf-b069-02cf159c26d3 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:23.990799 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e897f-8cde-4fcf-b069-02cf159c26d3 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:23.991359 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e897f-8cde-4fcf-b069-02cf159c26d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:24.064442 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-993e897f-8cde-4fcf-b069-02cf159c26d3 None None] MFA Rules not processed for user `64b69f98bbdb4317bf5b9a341ba28eb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:10:24.064442 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-993e897f-8cde-4fcf-b069-02cf159c26d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:24.082845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e799c-308a-4061-bcf1-f0e291388793 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:24.084980 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-818e799c-308a-4061-bcf1-f0e291388793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:24.222084 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1750/3493] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:10:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:10:24.227767 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e897f-8cde-4fcf-b069-02cf159c26d3 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:24.247027 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:10:24.258589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e799c-308a-4061-bcf1-f0e291388793 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:24.280759 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d09e2-83e8-4f72-98f1-6eda44042abd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:24.282017 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d09e2-83e8-4f72-98f1-6eda44042abd service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:24.283774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d09e2-83e8-4f72-98f1-6eda44042abd service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:24.284267 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d09e2-83e8-4f72-98f1-6eda44042abd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:24.290103 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-812d09e2-83e8-4f72-98f1-6eda44042abd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:24.348465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e897f-8cde-4fcf-b069-02cf159c26d3 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:24.358876 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee41ff8-ec1e-49e9-8e9c-bd1b7c49ba6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:24.360041 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee41ff8-ec1e-49e9-8e9c-bd1b7c49ba6a admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:24.360338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee41ff8-ec1e-49e9-8e9c-bd1b7c49ba6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:24.360748 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee41ff8-ec1e-49e9-8e9c-bd1b7c49ba6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:24.362014 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee41ff8-ec1e-49e9-8e9c-bd1b7c49ba6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:24.365062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee41ff8-ec1e-49e9-8e9c-bd1b7c49ba6a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:24.408380 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1751/3494] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:10:24 2022] POST /identity/v3/projects => generated 391 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:10:24.409277 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee41ff8-ec1e-49e9-8e9c-bd1b7c49ba6a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:24.425815 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:10:24.470072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d09e2-83e8-4f72-98f1-6eda44042abd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:24.472443 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d09e2-83e8-4f72-98f1-6eda44042abd service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:24.493138 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1744/3495] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:10:24 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:10:24.592478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee41ff8-ec1e-49e9-8e9c-bd1b7c49ba6a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:24.601070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d43eeb-c4e7-4eec-9c8f-0d64b794a547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:24.601671 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d43eeb-c4e7-4eec-9c8f-0d64b794a547 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:24.602027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d43eeb-c4e7-4eec-9c8f-0d64b794a547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:24.602292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d43eeb-c4e7-4eec-9c8f-0d64b794a547 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:24.609743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d43eeb-c4e7-4eec-9c8f-0d64b794a547 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:24.612815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d43eeb-c4e7-4eec-9c8f-0d64b794a547 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:24.658892 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1752/3496] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:10:24 2022] POST /identity/v3/users => generated 302 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:10:24.662991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d09e2-83e8-4f72-98f1-6eda44042abd service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:24.683217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d09e2-83e8-4f72-98f1-6eda44042abd service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:24.699950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8dc6a8-bf3b-4a0a-aa23-0e84397e0508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:24.700591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8dc6a8-bf3b-4a0a-aa23-0e84397e0508 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:24.700872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8dc6a8-bf3b-4a0a-aa23-0e84397e0508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:24.701146 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8dc6a8-bf3b-4a0a-aa23-0e84397e0508 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:24.701829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8dc6a8-bf3b-4a0a-aa23-0e84397e0508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:24.703617 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8dc6a8-bf3b-4a0a-aa23-0e84397e0508 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:24.727257 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1745/3497] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:10:24.732345 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d43eeb-c4e7-4eec-9c8f-0d64b794a547 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:24.756066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d43eeb-c4e7-4eec-9c8f-0d64b794a547 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:24.771735 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab025b-fade-4d56-908c-ff891ffa9443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:24.772984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab025b-fade-4d56-908c-ff891ffa9443 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:24.773992 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab025b-fade-4d56-908c-ff891ffa9443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:24.774608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab025b-fade-4d56-908c-ff891ffa9443 admin admin] PATH_INFO: `/v3/projects/e8242e3969c74f3684b8392fdb03f18d/users/34bfef2519244bb49b983b26e4a6f1d3/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:24.800377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab025b-fade-4d56-908c-ff891ffa9443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8242e3969c74f3684b8392fdb03f18d, user_id=34bfef2519244bb49b983b26e4a6f1d3, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:24.803540 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab025b-fade-4d56-908c-ff891ffa9443 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:24.829274 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1753/3498] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:10:24 2022] PUT /identity/v3/projects/e8242e3969c74f3684b8392fdb03f18d/users/34bfef2519244bb49b983b26e4a6f1d3/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:10:24.833209 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8dc6a8-bf3b-4a0a-aa23-0e84397e0508 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:24.851109 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8dc6a8-bf3b-4a0a-aa23-0e84397e0508 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:24.953522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9bebe-df1f-4a1a-94e4-1d1d7c040cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:24.953522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9bebe-df1f-4a1a-94e4-1d1d7c040cba admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:24.953522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9bebe-df1f-4a1a-94e4-1d1d7c040cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:24.953522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9bebe-df1f-4a1a-94e4-1d1d7c040cba admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:24.954021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9bebe-df1f-4a1a-94e4-1d1d7c040cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:24.961466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9bebe-df1f-4a1a-94e4-1d1d7c040cba admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:24.971088 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1746/3499] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:10:24.975518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab025b-fade-4d56-908c-ff891ffa9443 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:24.989512 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab025b-fade-4d56-908c-ff891ffa9443 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:25.001637 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b95c4-f409-441f-b2a6-ceaa7a5dfd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:25.002471 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b95c4-f409-441f-b2a6-ceaa7a5dfd39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:25.003067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b95c4-f409-441f-b2a6-ceaa7a5dfd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:25.003418 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b95c4-f409-441f-b2a6-ceaa7a5dfd39 admin admin] PATH_INFO: `/v3/projects/e8242e3969c74f3684b8392fdb03f18d/users/34bfef2519244bb49b983b26e4a6f1d3/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:25.005514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b95c4-f409-441f-b2a6-ceaa7a5dfd39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8242e3969c74f3684b8392fdb03f18d, user_id=34bfef2519244bb49b983b26e4a6f1d3, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:25.010421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b95c4-f409-441f-b2a6-ceaa7a5dfd39 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:25.043522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570ff2b-7dcd-4704-ac82-b188468b6d55 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:25.044491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570ff2b-7dcd-4704-ac82-b188468b6d55 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:25.044840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570ff2b-7dcd-4704-ac82-b188468b6d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:25.066342 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1754/3500] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:10:24 2022] PUT /identity/v3/projects/e8242e3969c74f3684b8392fdb03f18d/users/34bfef2519244bb49b983b26e4a6f1d3/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:10:25.069250 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7192b-919a-496a-8a59-4aa880c89634 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:25.069578 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7192b-919a-496a-8a59-4aa880c89634 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:25.069846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7192b-919a-496a-8a59-4aa880c89634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:25.113614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-1570ff2b-7dcd-4704-ac82-b188468b6d55 None None] MFA Rules not processed for user `a76409b5ae334b8fa88b4b089ebfa79c`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:10:25.113614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1570ff2b-7dcd-4704-ac82-b188468b6d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:25.146064 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-8de7192b-919a-496a-8a59-4aa880c89634 None None] MFA Rules not processed for user `34bfef2519244bb49b983b26e4a6f1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:10:25.147419 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8de7192b-919a-496a-8a59-4aa880c89634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:25.232559 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:10:25.253874 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1747/3501] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:10:25 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:10:25.287938 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1755/3502] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:10:25 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:10:25.957787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570ff2b-7dcd-4704-ac82-b188468b6d55 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:25.961830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1570ff2b-7dcd-4704-ac82-b188468b6d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:26.139554 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:10:26.165499 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570ff2b-7dcd-4704-ac82-b188468b6d55 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:26.177989 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63300a39-ba82-4236-a160-4c1f94171154 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:26.178926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63300a39-ba82-4236-a160-4c1f94171154 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:26.179342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63300a39-ba82-4236-a160-4c1f94171154 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:26.180339 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63300a39-ba82-4236-a160-4c1f94171154 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:26.194894 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63300a39-ba82-4236-a160-4c1f94171154 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:26.198779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63300a39-ba82-4236-a160-4c1f94171154 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:26.216914 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1748/3503] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:10:25 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:10:26.761426 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7192b-919a-496a-8a59-4aa880c89634 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:26.790596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7192b-919a-496a-8a59-4aa880c89634 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:26.824294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506db6b-52bf-47bc-90d8-140c0fd1b399 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:26.825369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506db6b-52bf-47bc-90d8-140c0fd1b399 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:26.825714 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506db6b-52bf-47bc-90d8-140c0fd1b399 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:26.825997 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506db6b-52bf-47bc-90d8-140c0fd1b399 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:26.935686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506db6b-52bf-47bc-90d8-140c0fd1b399 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:26.937481 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506db6b-52bf-47bc-90d8-140c0fd1b399 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:26.952814 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1756/3504] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:10:26 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:10:26.984277 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63300a39-ba82-4236-a160-4c1f94171154 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:27.140589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63300a39-ba82-4236-a160-4c1f94171154 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:27.153640 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41170a33-20ab-42d8-8e30-bdc93f4fd565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:27.154354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41170a33-20ab-42d8-8e30-bdc93f4fd565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:27.154630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41170a33-20ab-42d8-8e30-bdc93f4fd565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:27.154899 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41170a33-20ab-42d8-8e30-bdc93f4fd565 admin admin] PATH_INFO: `/v3/users/64b69f98bbdb4317bf5b9a341ba28eb0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:27.156852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41170a33-20ab-42d8-8e30-bdc93f4fd565 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64b69f98bbdb4317bf5b9a341ba28eb0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:27.160212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41170a33-20ab-42d8-8e30-bdc93f4fd565 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:27.253282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-41170a33-20ab-42d8-8e30-bdc93f4fd565 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64b69f98bbdb4317bf5b9a341ba28eb0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:27.254105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-41170a33-20ab-42d8-8e30-bdc93f4fd565 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64b69f98bbdb4317bf5b9a341ba28eb0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:27.262872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-41170a33-20ab-42d8-8e30-bdc93f4fd565 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64b69f98bbdb4317bf5b9a341ba28eb0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:27.273547 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-41170a33-20ab-42d8-8e30-bdc93f4fd565 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64b69f98bbdb4317bf5b9a341ba28eb0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:27.276079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-41170a33-20ab-42d8-8e30-bdc93f4fd565 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64b69f98bbdb4317bf5b9a341ba28eb0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:27.308421 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1749/3505] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:10:26 2022] DELETE /identity/v3/users/64b69f98bbdb4317bf5b9a341ba28eb0 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:10:27.312593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfff70-9541-411b-a2a9-40c7b967a8da None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:27.313153 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfff70-9541-411b-a2a9-40c7b967a8da None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:27.313607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfff70-9541-411b-a2a9-40c7b967a8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:27.381292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-90bfff70-9541-411b-a2a9-40c7b967a8da None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:10:27.385989 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-90bfff70-9541-411b-a2a9-40c7b967a8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:27.548272 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1757/3506] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:10:27.567966 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41170a33-20ab-42d8-8e30-bdc93f4fd565 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:27.569626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-41170a33-20ab-42d8-8e30-bdc93f4fd565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:27.779547 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41170a33-20ab-42d8-8e30-bdc93f4fd565 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:27.794487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444e199-4393-4e1b-a08b-589e37b4cb83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:27.798117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444e199-4393-4e1b-a08b-589e37b4cb83 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:27.798421 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444e199-4393-4e1b-a08b-589e37b4cb83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:27.798705 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444e199-4393-4e1b-a08b-589e37b4cb83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:27.845621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444e199-4393-4e1b-a08b-589e37b4cb83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:27.847516 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444e199-4393-4e1b-a08b-589e37b4cb83 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:27.881628 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1750/3507] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:10:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:10:28.712194 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfff70-9541-411b-a2a9-40c7b967a8da None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:28.715195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-90bfff70-9541-411b-a2a9-40c7b967a8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:28.739778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfff70-9541-411b-a2a9-40c7b967a8da None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:28.760067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d22fd-e3d8-40a4-97dc-b155138f97b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:28.762710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d22fd-e3d8-40a4-97dc-b155138f97b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:28.763209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d22fd-e3d8-40a4-97dc-b155138f97b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:28.763762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d22fd-e3d8-40a4-97dc-b155138f97b9 admin admin] PATH_INFO: `/v3/projects/befa7438eda7474d97afb13fc48b0c57` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:28.784923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d22fd-e3d8-40a4-97dc-b155138f97b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=befa7438eda7474d97afb13fc48b0c57)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:28.787377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d22fd-e3d8-40a4-97dc-b155138f97b9 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:28.915186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9e8d22fd-e3d8-40a4-97dc-b155138f97b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'befa7438eda7474d97afb13fc48b0c57', 'request_id': 'req-9e8d22fd-e3d8-40a4-97dc-b155138f97b9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:28.935125 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9e8d22fd-e3d8-40a4-97dc-b155138f97b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'befa7438eda7474d97afb13fc48b0c57', 'request_id': 'req-9e8d22fd-e3d8-40a4-97dc-b155138f97b9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:28.942144 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9e8d22fd-e3d8-40a4-97dc-b155138f97b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'befa7438eda7474d97afb13fc48b0c57', 'request_id': 'req-9e8d22fd-e3d8-40a4-97dc-b155138f97b9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:28.958230 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:10:28.973887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9e8d22fd-e3d8-40a4-97dc-b155138f97b9 admin admin] The token cache is being invalidate because project befa7438eda7474d97afb13fc48b0c57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:10:28.974865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9e8d22fd-e3d8-40a4-97dc-b155138f97b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:28.976134 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9e8d22fd-e3d8-40a4-97dc-b155138f97b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:28.981391 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1758/3508] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:10:28 2022] DELETE /identity/v3/projects/befa7438eda7474d97afb13fc48b0c57 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:10:28.983124 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444e199-4393-4e1b-a08b-589e37b4cb83 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:29.006518 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444e199-4393-4e1b-a08b-589e37b4cb83 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:29.026903 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:10:29.168549 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660df97-71e2-424a-9a23-77e0b19bdc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:29.169123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660df97-71e2-424a-9a23-77e0b19bdc52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:29.169573 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660df97-71e2-424a-9a23-77e0b19bdc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:29.169859 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660df97-71e2-424a-9a23-77e0b19bdc52 admin admin] PATH_INFO: `/v3/users/34bfef2519244bb49b983b26e4a6f1d3` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:29.171060 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7660df97-71e2-424a-9a23-77e0b19bdc52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34bfef2519244bb49b983b26e4a6f1d3)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:29.190372 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7660df97-71e2-424a-9a23-77e0b19bdc52 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:29.319137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7660df97-71e2-424a-9a23-77e0b19bdc52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34bfef2519244bb49b983b26e4a6f1d3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:29.320152 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7660df97-71e2-424a-9a23-77e0b19bdc52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34bfef2519244bb49b983b26e4a6f1d3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:29.351908 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7660df97-71e2-424a-9a23-77e0b19bdc52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34bfef2519244bb49b983b26e4a6f1d3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:29.381910 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7660df97-71e2-424a-9a23-77e0b19bdc52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34bfef2519244bb49b983b26e4a6f1d3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:29.384228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7660df97-71e2-424a-9a23-77e0b19bdc52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34bfef2519244bb49b983b26e4a6f1d3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:29.435040 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1751/3509] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:10:28 2022] DELETE /identity/v3/users/34bfef2519244bb49b983b26e4a6f1d3 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:10:30.367189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d22fd-e3d8-40a4-97dc-b155138f97b9 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:30.368945 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9e8d22fd-e3d8-40a4-97dc-b155138f97b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:30.395022 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d22fd-e3d8-40a4-97dc-b155138f97b9 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:30.574429 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e610673-b17e-4a24-8c8a-8847634b9e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:30.575378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e610673-b17e-4a24-8c8a-8847634b9e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:30.575768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e610673-b17e-4a24-8c8a-8847634b9e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:30.576143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e610673-b17e-4a24-8c8a-8847634b9e1a admin admin] PATH_INFO: `/v3/projects/e8242e3969c74f3684b8392fdb03f18d` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:30.581634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e610673-b17e-4a24-8c8a-8847634b9e1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8242e3969c74f3684b8392fdb03f18d)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:30.588125 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e610673-b17e-4a24-8c8a-8847634b9e1a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:30.707017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6e610673-b17e-4a24-8c8a-8847634b9e1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8242e3969c74f3684b8392fdb03f18d', 'request_id': 'req-6e610673-b17e-4a24-8c8a-8847634b9e1a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:30.731123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6e610673-b17e-4a24-8c8a-8847634b9e1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8242e3969c74f3684b8392fdb03f18d', 'request_id': 'req-6e610673-b17e-4a24-8c8a-8847634b9e1a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:30.739430 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6e610673-b17e-4a24-8c8a-8847634b9e1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8242e3969c74f3684b8392fdb03f18d', 'request_id': 'req-6e610673-b17e-4a24-8c8a-8847634b9e1a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:30.768689 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6e610673-b17e-4a24-8c8a-8847634b9e1a admin admin] The token cache is being invalidate because project e8242e3969c74f3684b8392fdb03f18d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:10:30.773873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6e610673-b17e-4a24-8c8a-8847634b9e1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:30.774770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6e610673-b17e-4a24-8c8a-8847634b9e1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:10:30.777809 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1759/3510] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:10:30 2022] DELETE /identity/v3/projects/e8242e3969c74f3684b8392fdb03f18d => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:10:30.784244 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35919acf-5e0b-4c24-b732-6133544faabe None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:30.784830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35919acf-5e0b-4c24-b732-6133544faabe None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:30.784830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35919acf-5e0b-4c24-b732-6133544faabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:30.823454 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-35919acf-5e0b-4c24-b732-6133544faabe None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:10:30.824789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-35919acf-5e0b-4c24-b732-6133544faabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:31.024443 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1752/3511] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:10:31.026736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd5eb6-96db-4e6c-9ac6-c476dc2f77d0 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:31.027027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd5eb6-96db-4e6c-9ac6-c476dc2f77d0 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:31.027305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd5eb6-96db-4e6c-9ac6-c476dc2f77d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:31.072138 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-0ebd5eb6-96db-4e6c-9ac6-c476dc2f77d0 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:10:31.073566 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0ebd5eb6-96db-4e6c-9ac6-c476dc2f77d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:31.085212 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1760/3512] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:10:31.086565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35919acf-5e0b-4c24-b732-6133544faabe None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:31.114109 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35919acf-5e0b-4c24-b732-6133544faabe None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:31.123772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cda503-9bf7-47b6-8cd6-75d95000eb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:31.124394 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cda503-9bf7-47b6-8cd6-75d95000eb90 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:31.124677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cda503-9bf7-47b6-8cd6-75d95000eb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:31.124954 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cda503-9bf7-47b6-8cd6-75d95000eb90 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:31.125653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cda503-9bf7-47b6-8cd6-75d95000eb90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:10:31.125960 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cda503-9bf7-47b6-8cd6-75d95000eb90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:31.127580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cda503-9bf7-47b6-8cd6-75d95000eb90 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:31.157510 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1753/3513] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:10:31.161108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd5eb6-96db-4e6c-9ac6-c476dc2f77d0 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:31.171306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd5eb6-96db-4e6c-9ac6-c476dc2f77d0 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:31.186369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d5f5b-ff63-443e-a254-805b4949b7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:31.187173 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d5f5b-ff63-443e-a254-805b4949b7c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:31.187557 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d5f5b-ff63-443e-a254-805b4949b7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:31.187938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d5f5b-ff63-443e-a254-805b4949b7c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:31.190281 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04d5f5b-ff63-443e-a254-805b4949b7c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:31.193713 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04d5f5b-ff63-443e-a254-805b4949b7c3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:31.285926 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1761/3514] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:10:31 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:10:31.286642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cda503-9bf7-47b6-8cd6-75d95000eb90 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:31.307990 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cda503-9bf7-47b6-8cd6-75d95000eb90 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:31.343845 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:10:31.439974 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb25bd-394b-4a8a-8396-7fced4f174b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:31.440226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb25bd-394b-4a8a-8396-7fced4f174b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:31.440456 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb25bd-394b-4a8a-8396-7fced4f174b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:31.440732 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb25bd-394b-4a8a-8396-7fced4f174b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:31.441391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb25bd-394b-4a8a-8396-7fced4f174b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:31.443532 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb25bd-394b-4a8a-8396-7fced4f174b5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:31.490074 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1754/3515] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:10:31 2022] POST /identity/v3/users => generated 291 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:10:31.493777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d5f5b-ff63-443e-a254-805b4949b7c3 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:31.508762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d5f5b-ff63-443e-a254-805b4949b7c3 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:31.531251 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966dcc6-41d9-4dc1-a79d-8468b66c9d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:31.532481 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966dcc6-41d9-4dc1-a79d-8468b66c9d39 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:31.535610 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966dcc6-41d9-4dc1-a79d-8468b66c9d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:31.538559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966dcc6-41d9-4dc1-a79d-8468b66c9d39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:31.539390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966dcc6-41d9-4dc1-a79d-8468b66c9d39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:31.544060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966dcc6-41d9-4dc1-a79d-8468b66c9d39 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:31.578329 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1762/3516] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:10:31.582935 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb25bd-394b-4a8a-8396-7fced4f174b5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:31.594883 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb25bd-394b-4a8a-8396-7fced4f174b5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:31.616965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e658f0c-b219-4549-a236-ae3c747f708d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:31.618583 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e658f0c-b219-4549-a236-ae3c747f708d admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:31.621799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e658f0c-b219-4549-a236-ae3c747f708d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:31.623781 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e658f0c-b219-4549-a236-ae3c747f708d admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:31.627847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e658f0c-b219-4549-a236-ae3c747f708d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:31.634878 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e658f0c-b219-4549-a236-ae3c747f708d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:31.685217 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1755/3517] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:10:31.689679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966dcc6-41d9-4dc1-a79d-8468b66c9d39 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:31.704588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966dcc6-41d9-4dc1-a79d-8468b66c9d39 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:31.711136 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1084f36b-fc00-4bcc-963f-7c2d0a64461e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:31.712209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084f36b-fc00-4bcc-963f-7c2d0a64461e admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:31.712732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084f36b-fc00-4bcc-963f-7c2d0a64461e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:31.713248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084f36b-fc00-4bcc-963f-7c2d0a64461e admin admin] PATH_INFO: `/v3/projects/8bdfb4e90f8b457a98e8107599475566/users/96770d5c8d0b45748e5a73cd3c07c204/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:31.749104 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1084f36b-fc00-4bcc-963f-7c2d0a64461e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bdfb4e90f8b457a98e8107599475566, user_id=96770d5c8d0b45748e5a73cd3c07c204, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:31.752653 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1084f36b-fc00-4bcc-963f-7c2d0a64461e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:31.789230 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1763/3518] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:10:31 2022] PUT /identity/v3/projects/8bdfb4e90f8b457a98e8107599475566/users/96770d5c8d0b45748e5a73cd3c07c204/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:10:31.796137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efbf3f-d30c-4d05-92e9-47ab98149742 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:31.796665 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efbf3f-d30c-4d05-92e9-47ab98149742 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:31.796850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efbf3f-d30c-4d05-92e9-47ab98149742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:31.850719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c7efbf3f-d30c-4d05-92e9-47ab98149742 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:10:31.851984 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c7efbf3f-d30c-4d05-92e9-47ab98149742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:32.008154 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1756/3519] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:10:32.107301 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1084f36b-fc00-4bcc-963f-7c2d0a64461e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:32.111061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1084f36b-fc00-4bcc-963f-7c2d0a64461e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:32.183785 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:10:32.323360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1084f36b-fc00-4bcc-963f-7c2d0a64461e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:32.333283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482817f-430d-4e7b-822a-ce097985e3fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:32.333963 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482817f-430d-4e7b-822a-ce097985e3fe service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:32.334243 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482817f-430d-4e7b-822a-ce097985e3fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:32.334517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482817f-430d-4e7b-822a-ce097985e3fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:32.355792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0482817f-430d-4e7b-822a-ce097985e3fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:32.358085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0482817f-430d-4e7b-822a-ce097985e3fe service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:32.389655 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1764/3520] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:10:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:10:37.140168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa28fee-d155-463f-b170-59ac6262a9d8 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:37.140678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa28fee-d155-463f-b170-59ac6262a9d8 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:37.140798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa28fee-d155-463f-b170-59ac6262a9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:37.206194 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-1aa28fee-d155-463f-b170-59ac6262a9d8 None None] MFA Rules not processed for user `5d072ddf52b9403eb9188d3f95bf9581`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:10:37.207749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1aa28fee-d155-463f-b170-59ac6262a9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:37.304976 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1757/3521] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:10:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:10:37.315454 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b393a-829d-4e56-9f43-df415f3cc6d1 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:37.315916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b393a-829d-4e56-9f43-df415f3cc6d1 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:37.316010 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b393a-829d-4e56-9f43-df415f3cc6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:37.355884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-768b393a-829d-4e56-9f43-df415f3cc6d1 None None] MFA Rules not processed for user `5d072ddf52b9403eb9188d3f95bf9581`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:10:37.357388 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-768b393a-829d-4e56-9f43-df415f3cc6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:37.384682 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1765/3522] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:10:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:10:37.391758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa28fee-d155-463f-b170-59ac6262a9d8 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:37.393522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1aa28fee-d155-463f-b170-59ac6262a9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:37.456426 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:10:37.573206 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa28fee-d155-463f-b170-59ac6262a9d8 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:37.589665 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7961b5-4ed8-422a-9eaf-a1978d80bdd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:37.590658 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7961b5-4ed8-422a-9eaf-a1978d80bdd4 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:37.591403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7961b5-4ed8-422a-9eaf-a1978d80bdd4 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:37.591834 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7961b5-4ed8-422a-9eaf-a1978d80bdd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:37.612386 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7961b5-4ed8-422a-9eaf-a1978d80bdd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:37.614512 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7961b5-4ed8-422a-9eaf-a1978d80bdd4 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:37.640801 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1758/3523] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:10:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:10:41.939322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ddc831-d97e-4055-930d-7ed74b750885 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:41.940394 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ddc831-d97e-4055-930d-7ed74b750885 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:41.940593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ddc831-d97e-4055-930d-7ed74b750885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:42.009144 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-75ddc831-d97e-4055-930d-7ed74b750885 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:10:42.011079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-75ddc831-d97e-4055-930d-7ed74b750885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:42.228857 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1766/3524] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:10:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:10:42.230832 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7961b5-4ed8-422a-9eaf-a1978d80bdd4 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:42.232698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8c7961b5-4ed8-422a-9eaf-a1978d80bdd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:42.390126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7961b5-4ed8-422a-9eaf-a1978d80bdd4 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:42.404106 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a762c-feff-4584-a65f-eb4481c8dedc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:42.404856 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a762c-feff-4584-a65f-eb4481c8dedc service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:42.405214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a762c-feff-4584-a65f-eb4481c8dedc service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:42.405604 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a762c-feff-4584-a65f-eb4481c8dedc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:42.429016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a762c-feff-4584-a65f-eb4481c8dedc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:42.432856 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a762c-feff-4584-a65f-eb4481c8dedc service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:42.457854 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1759/3525] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:10:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:10:46.467420 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2ab77-2e23-4069-a18a-fec26bf2b2ab None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:46.467863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2ab77-2e23-4069-a18a-fec26bf2b2ab None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:46.467949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2ab77-2e23-4069-a18a-fec26bf2b2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:46.512662 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-22c2ab77-2e23-4069-a18a-fec26bf2b2ab None None] MFA Rules not processed for user `575bb87368454c08a703e99526e6f00c`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:10:46.514798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-22c2ab77-2e23-4069-a18a-fec26bf2b2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:46.654931 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1767/3526] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:10:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:10:46.790918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a762c-feff-4584-a65f-eb4481c8dedc service swift] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:46.796201 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ed8a762c-feff-4584-a65f-eb4481c8dedc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:46.830976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a762c-feff-4584-a65f-eb4481c8dedc service swift] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:46.846465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5730a-9aaa-499d-a840-4a0b63b2f2b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:46.847109 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5730a-9aaa-499d-a840-4a0b63b2f2b0 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:46.847392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5730a-9aaa-499d-a840-4a0b63b2f2b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:46.847677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5730a-9aaa-499d-a840-4a0b63b2f2b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:46.855975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a2a5730a-9aaa-499d-a840-4a0b63b2f2b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:46.892330 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5730a-9aaa-499d-a840-4a0b63b2f2b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:46.893301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5730a-9aaa-499d-a840-4a0b63b2f2b0 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:46.935362 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1760/3527] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:10:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:10:49.040398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2ab77-2e23-4069-a18a-fec26bf2b2ab None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:49.042842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-22c2ab77-2e23-4069-a18a-fec26bf2b2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:49.078345 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2ab77-2e23-4069-a18a-fec26bf2b2ab None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:49.083991 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40973144-24f8-4962-abdc-0578e8a7d35c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:49.084896 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40973144-24f8-4962-abdc-0578e8a7d35c service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:49.085405 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40973144-24f8-4962-abdc-0578e8a7d35c service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:49.085854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40973144-24f8-4962-abdc-0578e8a7d35c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:49.092585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-40973144-24f8-4962-abdc-0578e8a7d35c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:49.127042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40973144-24f8-4962-abdc-0578e8a7d35c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:49.135829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40973144-24f8-4962-abdc-0578e8a7d35c service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:49.168327 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1768/3528] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:10:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:10:49.919952 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd7a06-44b9-4913-af63-3744131dc9e6 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:49.920502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd7a06-44b9-4913-af63-3744131dc9e6 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:49.920502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd7a06-44b9-4913-af63-3744131dc9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:49.990780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-4dbd7a06-44b9-4913-af63-3744131dc9e6 None None] MFA Rules not processed for user `96770d5c8d0b45748e5a73cd3c07c204`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:10:49.992495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4dbd7a06-44b9-4913-af63-3744131dc9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:50.170696 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1761/3529] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:10:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:10:50.182441 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bc361-dbc2-4170-aada-3a56f01f312c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:50.182930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bc361-dbc2-4170-aada-3a56f01f312c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:50.183116 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bc361-dbc2-4170-aada-3a56f01f312c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:50.242464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-463bc361-dbc2-4170-aada-3a56f01f312c None None] MFA Rules not processed for user `96770d5c8d0b45748e5a73cd3c07c204`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:10:50.244084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-463bc361-dbc2-4170-aada-3a56f01f312c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:10:50.276028 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1769/3530] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:10:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:10:50.953247 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd7a06-44b9-4913-af63-3744131dc9e6 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:10:50.975557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd7a06-44b9-4913-af63-3744131dc9e6 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:10:50.988270 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac09a9c-fd4f-421d-9f6c-e9465fa968eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:10:50.994322 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac09a9c-fd4f-421d-9f6c-e9465fa968eb service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:10:50.995533 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac09a9c-fd4f-421d-9f6c-e9465fa968eb service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:10:50.996027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac09a9c-fd4f-421d-9f6c-e9465fa968eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:10:51.008786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac09a9c-fd4f-421d-9f6c-e9465fa968eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:10:51.012478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac09a9c-fd4f-421d-9f6c-e9465fa968eb service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:10:51.052517 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1762/3531] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:10:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:11:00.234134 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=77 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:11:01.020580 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:11:01.383271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b2b0c-5509-4703-9402-7e1d5c6b1ec3 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:01.384693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b2b0c-5509-4703-9402-7e1d5c6b1ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:01.385151 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b2b0c-5509-4703-9402-7e1d5c6b1ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:01.427158 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-229b2b0c-5509-4703-9402-7e1d5c6b1ec3 None None] MFA Rules not processed for user `5d072ddf52b9403eb9188d3f95bf9581`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:11:01.438523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-229b2b0c-5509-4703-9402-7e1d5c6b1ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:01.452787 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1770/3532] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:11:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:11:02.168305 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029fed0-17ab-42c9-be0b-f88f3595eca7 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:02.168798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029fed0-17ab-42c9-be0b-f88f3595eca7 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:02.169194 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029fed0-17ab-42c9-be0b-f88f3595eca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:02.205824 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-f029fed0-17ab-42c9-be0b-f88f3595eca7 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:11:02.207490 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f029fed0-17ab-42c9-be0b-f88f3595eca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:02.219682 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1763/3533] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:11:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:11:02.288518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b2b0c-5509-4703-9402-7e1d5c6b1ec3 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:02.317031 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b2b0c-5509-4703-9402-7e1d5c6b1ec3 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:02.340029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e585b-b50b-44f4-b058-86a22aee48fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:02.341061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e585b-b50b-44f4-b058-86a22aee48fd service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:02.341348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e585b-b50b-44f4-b058-86a22aee48fd service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:02.341659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e585b-b50b-44f4-b058-86a22aee48fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:02.352067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e585b-b50b-44f4-b058-86a22aee48fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:02.354409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e585b-b50b-44f4-b058-86a22aee48fd service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:02.402201 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1771/3534] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:11:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:11:08.169607 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424fc02-934c-479f-825f-875e9b6d94c5 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:08.170205 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424fc02-934c-479f-825f-875e9b6d94c5 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:08.170205 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424fc02-934c-479f-825f-875e9b6d94c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:08.262664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-6424fc02-934c-479f-825f-875e9b6d94c5 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:11:08.268201 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6424fc02-934c-479f-825f-875e9b6d94c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:08.329518 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1764/3535] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:11:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:11:08.342305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e585b-b50b-44f4-b058-86a22aee48fd service swift] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:08.358659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e585b-b50b-44f4-b058-86a22aee48fd service swift] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:08.378886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc684af-83c7-4c07-8e53-ca01d66c6fc6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:08.390756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc684af-83c7-4c07-8e53-ca01d66c6fc6 service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:08.393709 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc684af-83c7-4c07-8e53-ca01d66c6fc6 service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:08.394253 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc684af-83c7-4c07-8e53-ca01d66c6fc6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:08.433374 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc684af-83c7-4c07-8e53-ca01d66c6fc6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:08.435955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc684af-83c7-4c07-8e53-ca01d66c6fc6 service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:08.473371 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1772/3536] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:11:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:11:12.719067 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424fc02-934c-479f-825f-875e9b6d94c5 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:12.733018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6424fc02-934c-479f-825f-875e9b6d94c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:12.776285 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424fc02-934c-479f-825f-875e9b6d94c5 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:12.792429 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204290fb-3a5e-4ecb-bb41-31be4975c38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:12.793391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204290fb-3a5e-4ecb-bb41-31be4975c38f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:12.793861 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204290fb-3a5e-4ecb-bb41-31be4975c38f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:12.794796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204290fb-3a5e-4ecb-bb41-31be4975c38f admin admin] PATH_INFO: `/v3/users/a76409b5ae334b8fa88b4b089ebfa79c` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:12.821276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204290fb-3a5e-4ecb-bb41-31be4975c38f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a76409b5ae334b8fa88b4b089ebfa79c)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:12.824747 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204290fb-3a5e-4ecb-bb41-31be4975c38f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:12.984676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-204290fb-3a5e-4ecb-bb41-31be4975c38f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a76409b5ae334b8fa88b4b089ebfa79c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:12.995015 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-204290fb-3a5e-4ecb-bb41-31be4975c38f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a76409b5ae334b8fa88b4b089ebfa79c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:13.016333 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-204290fb-3a5e-4ecb-bb41-31be4975c38f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a76409b5ae334b8fa88b4b089ebfa79c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:13.046596 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-204290fb-3a5e-4ecb-bb41-31be4975c38f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a76409b5ae334b8fa88b4b089ebfa79c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:13.047382 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-204290fb-3a5e-4ecb-bb41-31be4975c38f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a76409b5ae334b8fa88b4b089ebfa79c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:13.123047 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1765/3537] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:11:12 2022] DELETE /identity/v3/users/a76409b5ae334b8fa88b4b089ebfa79c => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:11:13.477204 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc684af-83c7-4c07-8e53-ca01d66c6fc6 service swift] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:13.502988 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc684af-83c7-4c07-8e53-ca01d66c6fc6 service swift] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:13.656949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31fa204-89f4-4b9f-94fc-406c8abb5862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:13.657630 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fa204-89f4-4b9f-94fc-406c8abb5862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:13.657908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fa204-89f4-4b9f-94fc-406c8abb5862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:13.658180 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fa204-89f4-4b9f-94fc-406c8abb5862 admin admin] PATH_INFO: `/v3/projects/6bd7dac12a074b5a910ba30e14691939` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:13.659345 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31fa204-89f4-4b9f-94fc-406c8abb5862 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bd7dac12a074b5a910ba30e14691939)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:13.661286 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31fa204-89f4-4b9f-94fc-406c8abb5862 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:13.821893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c31fa204-89f4-4b9f-94fc-406c8abb5862 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bd7dac12a074b5a910ba30e14691939', 'request_id': 'req-c31fa204-89f4-4b9f-94fc-406c8abb5862'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:13.842586 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c31fa204-89f4-4b9f-94fc-406c8abb5862 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bd7dac12a074b5a910ba30e14691939', 'request_id': 'req-c31fa204-89f4-4b9f-94fc-406c8abb5862'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:13.850046 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c31fa204-89f4-4b9f-94fc-406c8abb5862 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bd7dac12a074b5a910ba30e14691939', 'request_id': 'req-c31fa204-89f4-4b9f-94fc-406c8abb5862'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:13.866643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c31fa204-89f4-4b9f-94fc-406c8abb5862 admin admin] The token cache is being invalidate because project 6bd7dac12a074b5a910ba30e14691939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:11:13.867212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c31fa204-89f4-4b9f-94fc-406c8abb5862 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:13.869161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c31fa204-89f4-4b9f-94fc-406c8abb5862 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:13.879362 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1773/3538] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:11:13 2022] DELETE /identity/v3/projects/6bd7dac12a074b5a910ba30e14691939 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:11:13.881040 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb8291-5374-4a2a-aa45-ddfd664287cf None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:13.881488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb8291-5374-4a2a-aa45-ddfd664287cf None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:13.882151 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb8291-5374-4a2a-aa45-ddfd664287cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:13.984990 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-bfeb8291-5374-4a2a-aa45-ddfd664287cf None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:11:13.991603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bfeb8291-5374-4a2a-aa45-ddfd664287cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:14.263569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0ea43-f0f2-4640-b66e-62ed4149aeba None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:14.264133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0ea43-f0f2-4640-b66e-62ed4149aeba None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:14.264549 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0ea43-f0f2-4640-b66e-62ed4149aeba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:14.270028 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1766/3539] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:11:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:11:14.319580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-22b0ea43-f0f2-4640-b66e-62ed4149aeba None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:11:14.321230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-22b0ea43-f0f2-4640-b66e-62ed4149aeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:14.345421 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1774/3540] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:11:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:11:14.350321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb8291-5374-4a2a-aa45-ddfd664287cf None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:14.375773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb8291-5374-4a2a-aa45-ddfd664287cf None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:14.386915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abbeaf-68a4-4af6-8929-e9a4bfca32ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:14.387975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abbeaf-68a4-4af6-8929-e9a4bfca32ef admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:14.388466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abbeaf-68a4-4af6-8929-e9a4bfca32ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:14.388967 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abbeaf-68a4-4af6-8929-e9a4bfca32ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:14.389875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7abbeaf-68a4-4af6-8929-e9a4bfca32ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:11:14.390432 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7abbeaf-68a4-4af6-8929-e9a4bfca32ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:14.392758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7abbeaf-68a4-4af6-8929-e9a4bfca32ef admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:14.426731 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1767/3541] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:11:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:11:14.427609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0ea43-f0f2-4640-b66e-62ed4149aeba None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:14.439557 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0ea43-f0f2-4640-b66e-62ed4149aeba None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:14.445658 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2a9d3-c7e1-4f2c-ba2c-c7dc18e13c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:14.447237 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2a9d3-c7e1-4f2c-ba2c-c7dc18e13c11 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:14.447600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2a9d3-c7e1-4f2c-ba2c-c7dc18e13c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:14.447882 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2a9d3-c7e1-4f2c-ba2c-c7dc18e13c11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:14.448529 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd2a9d3-c7e1-4f2c-ba2c-c7dc18e13c11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:14.450507 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd2a9d3-c7e1-4f2c-ba2c-c7dc18e13c11 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:14.522928 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abbeaf-68a4-4af6-8929-e9a4bfca32ef admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:14.531155 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1775/3542] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:11:14 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:11:14.536072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abbeaf-68a4-4af6-8929-e9a4bfca32ef admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:14.637757 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:11:14.665152 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bda92-cf94-4b98-8ef6-1d70e84b21b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:14.665911 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bda92-cf94-4b98-8ef6-1d70e84b21b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:14.666261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bda92-cf94-4b98-8ef6-1d70e84b21b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:14.666608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bda92-cf94-4b98-8ef6-1d70e84b21b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:14.668260 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5bda92-cf94-4b98-8ef6-1d70e84b21b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:14.669812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5bda92-cf94-4b98-8ef6-1d70e84b21b9 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:14.727972 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1768/3543] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:11:14 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:11:14.729874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2a9d3-c7e1-4f2c-ba2c-c7dc18e13c11 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:14.771593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2a9d3-c7e1-4f2c-ba2c-c7dc18e13c11 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:14.804385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e8e54-50cc-4a8c-8413-6831c410895c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:14.805233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e8e54-50cc-4a8c-8413-6831c410895c admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:14.805729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e8e54-50cc-4a8c-8413-6831c410895c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:14.806217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e8e54-50cc-4a8c-8413-6831c410895c admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:14.807596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e8e54-50cc-4a8c-8413-6831c410895c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:14.809477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e8e54-50cc-4a8c-8413-6831c410895c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:14.838637 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1776/3544] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:11:14.839857 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bda92-cf94-4b98-8ef6-1d70e84b21b9 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:14.862030 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bda92-cf94-4b98-8ef6-1d70e84b21b9 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:14.886422 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b464f7-5832-460a-83fd-fff921f84a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:14.896063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b464f7-5832-460a-83fd-fff921f84a63 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:14.896636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b464f7-5832-460a-83fd-fff921f84a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:14.897158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b464f7-5832-460a-83fd-fff921f84a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:14.902002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b464f7-5832-460a-83fd-fff921f84a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:14.909169 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b464f7-5832-460a-83fd-fff921f84a63 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:14.952293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e8e54-50cc-4a8c-8413-6831c410895c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:14.961997 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1769/3545] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:11:14.965375 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e8e54-50cc-4a8c-8413-6831c410895c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:14.977759 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2faece0-8552-4bbe-a353-8d538369a1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:14.978968 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faece0-8552-4bbe-a353-8d538369a1c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:14.979248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faece0-8552-4bbe-a353-8d538369a1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:14.979544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faece0-8552-4bbe-a353-8d538369a1c8 admin admin] PATH_INFO: `/v3/projects/e59d732480c1417e84eb3fe62c2f793a/users/a354f97b1199466a994d6beb2ce36785/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:15.073950 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2faece0-8552-4bbe-a353-8d538369a1c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e59d732480c1417e84eb3fe62c2f793a, user_id=a354f97b1199466a994d6beb2ce36785, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:15.080732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2faece0-8552-4bbe-a353-8d538369a1c8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:15.088159 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:11:15.149146 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1777/3546] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:11:14 2022] PUT /identity/v3/projects/e59d732480c1417e84eb3fe62c2f793a/users/a354f97b1199466a994d6beb2ce36785/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:11:15.160208 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0c063-8945-4b4b-af2a-fceebcb612be None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:15.160551 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0c063-8945-4b4b-af2a-fceebcb612be None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:15.160763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0c063-8945-4b4b-af2a-fceebcb612be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:15.211836 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-81a0c063-8945-4b4b-af2a-fceebcb612be None None] MFA Rules not processed for user `a354f97b1199466a994d6beb2ce36785`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:11:15.224884 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-81a0c063-8945-4b4b-af2a-fceebcb612be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:15.392480 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1770/3547] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:11:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:11:19.977221 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2faece0-8552-4bbe-a353-8d538369a1c8 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:19.979689 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d2faece0-8552-4bbe-a353-8d538369a1c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:20.103646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2faece0-8552-4bbe-a353-8d538369a1c8 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:20.112238 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c151d-e359-4562-b066-ba2bf6ba2a90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:20.113840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c151d-e359-4562-b066-ba2bf6ba2a90 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:20.114299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c151d-e359-4562-b066-ba2bf6ba2a90 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:20.115332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c151d-e359-4562-b066-ba2bf6ba2a90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:20.135123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c151d-e359-4562-b066-ba2bf6ba2a90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:20.138566 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c151d-e359-4562-b066-ba2bf6ba2a90 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:20.148937 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1778/3548] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:11:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:11:22.022531 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0c063-8945-4b4b-af2a-fceebcb612be None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:22.204767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0c063-8945-4b4b-af2a-fceebcb612be None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:22.209992 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361829f-0cdd-4b88-a694-4878b2853dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:22.211368 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361829f-0cdd-4b88-a694-4878b2853dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:22.211453 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361829f-0cdd-4b88-a694-4878b2853dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:22.211667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361829f-0cdd-4b88-a694-4878b2853dbd admin admin] PATH_INFO: `/v3/users/a354f97b1199466a994d6beb2ce36785` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:22.212894 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361829f-0cdd-4b88-a694-4878b2853dbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a354f97b1199466a994d6beb2ce36785)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:22.215896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361829f-0cdd-4b88-a694-4878b2853dbd admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:22.334649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1361829f-0cdd-4b88-a694-4878b2853dbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a354f97b1199466a994d6beb2ce36785'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:22.336004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1361829f-0cdd-4b88-a694-4878b2853dbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a354f97b1199466a994d6beb2ce36785'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:22.350805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1361829f-0cdd-4b88-a694-4878b2853dbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a354f97b1199466a994d6beb2ce36785'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:22.362429 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:11:22.390937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1361829f-0cdd-4b88-a694-4878b2853dbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a354f97b1199466a994d6beb2ce36785'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:22.392644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1361829f-0cdd-4b88-a694-4878b2853dbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a354f97b1199466a994d6beb2ce36785'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:22.427149 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1771/3549] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:11:22 2022] DELETE /identity/v3/users/a354f97b1199466a994d6beb2ce36785 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:11:22.433315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d80a61-115d-49a1-97c3-a0244a66878b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:22.433915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d80a61-115d-49a1-97c3-a0244a66878b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:22.433915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d80a61-115d-49a1-97c3-a0244a66878b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:22.475223 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-f6d80a61-115d-49a1-97c3-a0244a66878b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:11:22.476462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f6d80a61-115d-49a1-97c3-a0244a66878b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:22.610123 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1779/3550] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:11:22.622504 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361829f-0cdd-4b88-a694-4878b2853dbd admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:22.623451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1361829f-0cdd-4b88-a694-4878b2853dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:22.768236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361829f-0cdd-4b88-a694-4878b2853dbd admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:22.791860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4adfabf-1070-43e6-a342-6041c9f7fde1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:22.795462 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adfabf-1070-43e6-a342-6041c9f7fde1 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:22.796022 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adfabf-1070-43e6-a342-6041c9f7fde1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:22.796229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adfabf-1070-43e6-a342-6041c9f7fde1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:22.811918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4adfabf-1070-43e6-a342-6041c9f7fde1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:22.814271 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4adfabf-1070-43e6-a342-6041c9f7fde1 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:22.828957 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1772/3551] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:11:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:11:23.468289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d80a61-115d-49a1-97c3-a0244a66878b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:23.469781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f6d80a61-115d-49a1-97c3-a0244a66878b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:23.492788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d80a61-115d-49a1-97c3-a0244a66878b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:23.499459 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd79bb-5377-46f1-bbb4-1fdadff024e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:23.500365 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd79bb-5377-46f1-bbb4-1fdadff024e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:23.500876 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd79bb-5377-46f1-bbb4-1fdadff024e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:23.501364 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd79bb-5377-46f1-bbb4-1fdadff024e8 admin admin] PATH_INFO: `/v3/projects/e59d732480c1417e84eb3fe62c2f793a` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:23.503710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd79bb-5377-46f1-bbb4-1fdadff024e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e59d732480c1417e84eb3fe62c2f793a)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:23.505903 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd79bb-5377-46f1-bbb4-1fdadff024e8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:23.617070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-44dd79bb-5377-46f1-bbb4-1fdadff024e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e59d732480c1417e84eb3fe62c2f793a', 'request_id': 'req-44dd79bb-5377-46f1-bbb4-1fdadff024e8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:23.636032 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-44dd79bb-5377-46f1-bbb4-1fdadff024e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e59d732480c1417e84eb3fe62c2f793a', 'request_id': 'req-44dd79bb-5377-46f1-bbb4-1fdadff024e8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:23.654858 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-44dd79bb-5377-46f1-bbb4-1fdadff024e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e59d732480c1417e84eb3fe62c2f793a', 'request_id': 'req-44dd79bb-5377-46f1-bbb4-1fdadff024e8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:23.667873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-44dd79bb-5377-46f1-bbb4-1fdadff024e8 admin admin] The token cache is being invalidate because project e59d732480c1417e84eb3fe62c2f793a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:11:23.668542 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-44dd79bb-5377-46f1-bbb4-1fdadff024e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:23.669586 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-44dd79bb-5377-46f1-bbb4-1fdadff024e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:23.677012 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1780/3552] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:11:23 2022] DELETE /identity/v3/projects/e59d732480c1417e84eb3fe62c2f793a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:11:23.678386 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc1525-7233-4196-bcd2-7191d28e0c14 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:23.679001 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc1525-7233-4196-bcd2-7191d28e0c14 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:23.679096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc1525-7233-4196-bcd2-7191d28e0c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:23.711968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-f8fc1525-7233-4196-bcd2-7191d28e0c14 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:11:23.714019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f8fc1525-7233-4196-bcd2-7191d28e0c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:23.814495 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1773/3553] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:11:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:11:23.814862 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d2b8b-e8de-4f46-9efb-b2cb53d50eb8 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:23.815353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d2b8b-e8de-4f46-9efb-b2cb53d50eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:23.815699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d2b8b-e8de-4f46-9efb-b2cb53d50eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:23.823797 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:11:23.839899 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-050d2b8b-e8de-4f46-9efb-b2cb53d50eb8 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:11:23.841202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-050d2b8b-e8de-4f46-9efb-b2cb53d50eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:23.849401 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1781/3554] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:11:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:11:23.854270 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc1525-7233-4196-bcd2-7191d28e0c14 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:23.865629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc1525-7233-4196-bcd2-7191d28e0c14 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:23.870924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6c9d0-e22a-42f0-958a-544777d633e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:23.871753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6c9d0-e22a-42f0-958a-544777d633e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:23.872027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6c9d0-e22a-42f0-958a-544777d633e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:23.872341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6c9d0-e22a-42f0-958a-544777d633e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:23.872964 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6c9d0-e22a-42f0-958a-544777d633e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:11:23.873263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6c9d0-e22a-42f0-958a-544777d633e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:23.874893 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6c9d0-e22a-42f0-958a-544777d633e9 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:23.886589 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1774/3555] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:11:23.890680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d2b8b-e8de-4f46-9efb-b2cb53d50eb8 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:23.900227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d2b8b-e8de-4f46-9efb-b2cb53d50eb8 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:23.904895 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eae4db-e03a-442c-ad36-2234c9e8154f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:23.905833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eae4db-e03a-442c-ad36-2234c9e8154f admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:23.906116 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eae4db-e03a-442c-ad36-2234c9e8154f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:23.906390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eae4db-e03a-442c-ad36-2234c9e8154f admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:23.907022 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eae4db-e03a-442c-ad36-2234c9e8154f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:23.908926 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eae4db-e03a-442c-ad36-2234c9e8154f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:23.938013 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1782/3556] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:11:23 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:11:23.943894 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6c9d0-e22a-42f0-958a-544777d633e9 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:23.954751 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6c9d0-e22a-42f0-958a-544777d633e9 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:24.024603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ba3ad-0e93-448c-85d8-54c05240f8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:24.025306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ba3ad-0e93-448c-85d8-54c05240f8aa admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:24.025684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ba3ad-0e93-448c-85d8-54c05240f8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:24.026027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ba3ad-0e93-448c-85d8-54c05240f8aa admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:24.026733 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ba3ad-0e93-448c-85d8-54c05240f8aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:24.028737 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ba3ad-0e93-448c-85d8-54c05240f8aa admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:24.039935 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:11:24.059059 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1775/3557] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:11:23 2022] POST /identity/v3/users => generated 290 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:11:24.060664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eae4db-e03a-442c-ad36-2234c9e8154f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:24.076322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eae4db-e03a-442c-ad36-2234c9e8154f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:24.090272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5cb76-8382-46d5-a35b-ae51fae6ea09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:24.091100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5cb76-8382-46d5-a35b-ae51fae6ea09 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:24.091454 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5cb76-8382-46d5-a35b-ae51fae6ea09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:24.091798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5cb76-8382-46d5-a35b-ae51fae6ea09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:24.092576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5cb76-8382-46d5-a35b-ae51fae6ea09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:24.094914 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5cb76-8382-46d5-a35b-ae51fae6ea09 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:24.112263 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1783/3558] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:11:24.115797 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ba3ad-0e93-448c-85d8-54c05240f8aa admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:24.127828 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ba3ad-0e93-448c-85d8-54c05240f8aa admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:24.134191 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cba7e8-ed52-4777-97e2-2b650ff54576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:24.135468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cba7e8-ed52-4777-97e2-2b650ff54576 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:24.135751 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cba7e8-ed52-4777-97e2-2b650ff54576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:24.136031 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cba7e8-ed52-4777-97e2-2b650ff54576 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:24.136679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cba7e8-ed52-4777-97e2-2b650ff54576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:24.138329 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cba7e8-ed52-4777-97e2-2b650ff54576 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:24.150837 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1776/3559] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:11:24.155517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5cb76-8382-46d5-a35b-ae51fae6ea09 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:24.167703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5cb76-8382-46d5-a35b-ae51fae6ea09 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:24.172975 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665d58a-fc42-40e7-ac9e-d51ee08b3ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:24.173860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665d58a-fc42-40e7-ac9e-d51ee08b3ac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:24.174460 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665d58a-fc42-40e7-ac9e-d51ee08b3ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:24.175085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665d58a-fc42-40e7-ac9e-d51ee08b3ac6 admin admin] PATH_INFO: `/v3/projects/2e790ab9ef3446c0b76c34cfd1a665c2/users/832e32b86f334bf4bd36eb7f806d604c/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:24.200222 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c665d58a-fc42-40e7-ac9e-d51ee08b3ac6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e790ab9ef3446c0b76c34cfd1a665c2, user_id=832e32b86f334bf4bd36eb7f806d604c, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:24.203562 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c665d58a-fc42-40e7-ac9e-d51ee08b3ac6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:24.221807 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1784/3560] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:11:24 2022] PUT /identity/v3/projects/2e790ab9ef3446c0b76c34cfd1a665c2/users/832e32b86f334bf4bd36eb7f806d604c/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:11:24.223804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba400289-b658-4344-be36-5509ac7ff7d3 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:24.224239 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba400289-b658-4344-be36-5509ac7ff7d3 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:24.224705 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba400289-b658-4344-be36-5509ac7ff7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:24.268652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-ba400289-b658-4344-be36-5509ac7ff7d3 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:11:24.269996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ba400289-b658-4344-be36-5509ac7ff7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:24.333415 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1777/3561] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:11:24.342761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665d58a-fc42-40e7-ac9e-d51ee08b3ac6 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:24.344471 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c665d58a-fc42-40e7-ac9e-d51ee08b3ac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:24.401890 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665d58a-fc42-40e7-ac9e-d51ee08b3ac6 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:24.405747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2da690-a6c0-40f9-93f5-907880322638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:24.406365 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2da690-a6c0-40f9-93f5-907880322638 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:24.406645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2da690-a6c0-40f9-93f5-907880322638 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:24.406921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2da690-a6c0-40f9-93f5-907880322638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:24.418466 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2da690-a6c0-40f9-93f5-907880322638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:24.419921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2da690-a6c0-40f9-93f5-907880322638 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:24.431178 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1785/3562] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:11:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:11:24.921464 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba400289-b658-4344-be36-5509ac7ff7d3 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:24.923820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ba400289-b658-4344-be36-5509ac7ff7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:25.034231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba400289-b658-4344-be36-5509ac7ff7d3 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:25.034231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500204d5-f9f2-4782-a0dd-c82f084af08d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efcee9b21ea94b1b8e5c9c5acb35839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:25.034231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500204d5-f9f2-4782-a0dd-c82f084af08d service glance] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:25.034231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500204d5-f9f2-4782-a0dd-c82f084af08d service glance] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:25.035083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500204d5-f9f2-4782-a0dd-c82f084af08d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:25.035083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-500204d5-f9f2-4782-a0dd-c82f084af08d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:25.123739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500204d5-f9f2-4782-a0dd-c82f084af08d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:25.126177 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500204d5-f9f2-4782-a0dd-c82f084af08d service glance] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:25.147783 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1778/3563] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:11:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:11:25.297476 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2da690-a6c0-40f9-93f5-907880322638 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:25.298988 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6e2da690-a6c0-40f9-93f5-907880322638 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:25.314208 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2da690-a6c0-40f9-93f5-907880322638 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:25.319278 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad23c64-6cc4-44da-a357-ceb98960c094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:25.320786 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad23c64-6cc4-44da-a357-ceb98960c094 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:25.321282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad23c64-6cc4-44da-a357-ceb98960c094 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:25.321836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad23c64-6cc4-44da-a357-ceb98960c094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:25.325341 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5ad23c64-6cc4-44da-a357-ceb98960c094 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:25.373994 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad23c64-6cc4-44da-a357-ceb98960c094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:25.387672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad23c64-6cc4-44da-a357-ceb98960c094 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:25.410475 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1786/3564] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:11:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:11:26.590302 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e3dfb-6bc6-4795-a613-840539fa940f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:26.591128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e3dfb-6bc6-4795-a613-840539fa940f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:26.591557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e3dfb-6bc6-4795-a613-840539fa940f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:26.616270 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:11:26.668775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-4d6e3dfb-6bc6-4795-a613-840539fa940f None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:11:26.672151 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4d6e3dfb-6bc6-4795-a613-840539fa940f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:26.856066 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1779/3565] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:11:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:11:26.873999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad23c64-6cc4-44da-a357-ceb98960c094 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:26.876145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5ad23c64-6cc4-44da-a357-ceb98960c094 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:27.135727 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad23c64-6cc4-44da-a357-ceb98960c094 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:27.147520 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902467a-8259-433c-af9e-19a6840f697d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:27.148151 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902467a-8259-433c-af9e-19a6840f697d service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:27.148434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902467a-8259-433c-af9e-19a6840f697d service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:27.148715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902467a-8259-433c-af9e-19a6840f697d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:27.169943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6902467a-8259-433c-af9e-19a6840f697d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:27.171924 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6902467a-8259-433c-af9e-19a6840f697d service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:27.201859 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1787/3566] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:11:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:11:28.489863 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea9bab-3e24-4a3f-b9c1-748d8d6a8421 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:28.489863 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea9bab-3e24-4a3f-b9c1-748d8d6a8421 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:28.489863 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea9bab-3e24-4a3f-b9c1-748d8d6a8421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:28.531328 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-57ea9bab-3e24-4a3f-b9c1-748d8d6a8421 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:11:28.532563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-57ea9bab-3e24-4a3f-b9c1-748d8d6a8421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:28.554190 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1780/3567] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:11:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:11:28.565163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902467a-8259-433c-af9e-19a6840f697d service swift] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:28.589401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902467a-8259-433c-af9e-19a6840f697d service swift] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:28.630474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77e5c4-712c-440d-a4a3-96a012256a4e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:28.631922 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77e5c4-712c-440d-a4a3-96a012256a4e service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:28.632306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77e5c4-712c-440d-a4a3-96a012256a4e service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:28.632685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77e5c4-712c-440d-a4a3-96a012256a4e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:28.650959 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77e5c4-712c-440d-a4a3-96a012256a4e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:28.661961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77e5c4-712c-440d-a4a3-96a012256a4e service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:28.673063 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1788/3568] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:11:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:11:35.346549 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c54d1d-4469-42a8-bb1c-b25a483458fb None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:35.348060 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c54d1d-4469-42a8-bb1c-b25a483458fb None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:35.348494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c54d1d-4469-42a8-bb1c-b25a483458fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:35.403443 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c7c54d1d-4469-42a8-bb1c-b25a483458fb None None] MFA Rules not processed for user `5d072ddf52b9403eb9188d3f95bf9581`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:11:35.411591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c7c54d1d-4469-42a8-bb1c-b25a483458fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:35.677282 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1781/3569] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:11:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:11:38.298331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296c5df-bedd-4540-a437-f0189ac7a4c6 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:38.299353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296c5df-bedd-4540-a437-f0189ac7a4c6 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:38.299996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296c5df-bedd-4540-a437-f0189ac7a4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:38.312551 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:11:38.365786 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-b296c5df-bedd-4540-a437-f0189ac7a4c6 None None] MFA Rules not processed for user `575bb87368454c08a703e99526e6f00c`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:11:38.374896 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b296c5df-bedd-4540-a437-f0189ac7a4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:38.572831 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1789/3570] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:11:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:11:39.299047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb56301-b1ee-44cc-a5b8-dd9fc896d5be None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:39.300142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb56301-b1ee-44cc-a5b8-dd9fc896d5be None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:39.300603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb56301-b1ee-44cc-a5b8-dd9fc896d5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:39.357799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-fcb56301-b1ee-44cc-a5b8-dd9fc896d5be None None] MFA Rules not processed for user `832e32b86f334bf4bd36eb7f806d604c`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:11:39.359594 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-fcb56301-b1ee-44cc-a5b8-dd9fc896d5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:39.648769 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1782/3571] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:11:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:11:40.045964 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296c5df-bedd-4540-a437-f0189ac7a4c6 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:40.047412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b296c5df-bedd-4540-a437-f0189ac7a4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:40.083491 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296c5df-bedd-4540-a437-f0189ac7a4c6 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:40.102784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b3832-cc03-4690-9bb9-2da36b1da8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:40.104284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b3832-cc03-4690-9bb9-2da36b1da8a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:40.104732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b3832-cc03-4690-9bb9-2da36b1da8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:40.106517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b3832-cc03-4690-9bb9-2da36b1da8a6 admin admin] PATH_INFO: `/v3/users/2f06e2312dcc49969c19772035ddab99` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:40.111000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b3832-cc03-4690-9bb9-2da36b1da8a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f06e2312dcc49969c19772035ddab99)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:40.117280 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b3832-cc03-4690-9bb9-2da36b1da8a6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:40.242118 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1b9b3832-cc03-4690-9bb9-2da36b1da8a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f06e2312dcc49969c19772035ddab99'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:40.245699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1b9b3832-cc03-4690-9bb9-2da36b1da8a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f06e2312dcc49969c19772035ddab99'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:40.265778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1b9b3832-cc03-4690-9bb9-2da36b1da8a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f06e2312dcc49969c19772035ddab99'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:40.281959 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1b9b3832-cc03-4690-9bb9-2da36b1da8a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f06e2312dcc49969c19772035ddab99'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:40.282786 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1b9b3832-cc03-4690-9bb9-2da36b1da8a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f06e2312dcc49969c19772035ddab99'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:40.389897 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1790/3572] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:11:40 2022] DELETE /identity/v3/users/2f06e2312dcc49969c19772035ddab99 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:11:40.930796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb56301-b1ee-44cc-a5b8-dd9fc896d5be None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:40.953282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb56301-b1ee-44cc-a5b8-dd9fc896d5be None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:41.048810 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:11:41.111946 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689ac0d-2c62-4931-96cc-28b1d61e9c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:41.113480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689ac0d-2c62-4931-96cc-28b1d61e9c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:41.113929 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689ac0d-2c62-4931-96cc-28b1d61e9c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:41.114420 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689ac0d-2c62-4931-96cc-28b1d61e9c01 admin admin] PATH_INFO: `/v3/projects/21275f28b9ba4a7686371e0dad4cc0b8` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:41.120926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689ac0d-2c62-4931-96cc-28b1d61e9c01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21275f28b9ba4a7686371e0dad4cc0b8)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:41.124258 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689ac0d-2c62-4931-96cc-28b1d61e9c01 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:41.230113 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e689ac0d-2c62-4931-96cc-28b1d61e9c01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21275f28b9ba4a7686371e0dad4cc0b8', 'request_id': 'req-e689ac0d-2c62-4931-96cc-28b1d61e9c01'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:41.242384 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e689ac0d-2c62-4931-96cc-28b1d61e9c01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21275f28b9ba4a7686371e0dad4cc0b8', 'request_id': 'req-e689ac0d-2c62-4931-96cc-28b1d61e9c01'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:41.266749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e689ac0d-2c62-4931-96cc-28b1d61e9c01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21275f28b9ba4a7686371e0dad4cc0b8', 'request_id': 'req-e689ac0d-2c62-4931-96cc-28b1d61e9c01'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:41.303398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e689ac0d-2c62-4931-96cc-28b1d61e9c01 admin admin] The token cache is being invalidate because project 21275f28b9ba4a7686371e0dad4cc0b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:11:41.304000 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e689ac0d-2c62-4931-96cc-28b1d61e9c01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:41.304900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e689ac0d-2c62-4931-96cc-28b1d61e9c01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:41.313015 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1783/3573] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:11:40 2022] DELETE /identity/v3/projects/21275f28b9ba4a7686371e0dad4cc0b8 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:11:41.314573 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32c7a5-612a-463b-ae88-07de3ebd3350 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:41.315023 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32c7a5-612a-463b-ae88-07de3ebd3350 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:41.315121 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32c7a5-612a-463b-ae88-07de3ebd3350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:41.370118 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-db32c7a5-612a-463b-ae88-07de3ebd3350 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:11:41.371663 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-db32c7a5-612a-463b-ae88-07de3ebd3350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:41.564420 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1791/3574] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:11:41.572132 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c031c2-5600-4b00-9547-ca2af1ca1b8c None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:41.572535 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c031c2-5600-4b00-9547-ca2af1ca1b8c None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:41.572924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c031c2-5600-4b00-9547-ca2af1ca1b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:41.635349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-60c031c2-5600-4b00-9547-ca2af1ca1b8c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:11:41.640797 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-60c031c2-5600-4b00-9547-ca2af1ca1b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:41.673820 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1784/3575] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:11:41.674098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32c7a5-612a-463b-ae88-07de3ebd3350 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:41.686165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32c7a5-612a-463b-ae88-07de3ebd3350 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:41.706498 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd970f-3211-4cfb-88b0-585678b2f78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:41.707132 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd970f-3211-4cfb-88b0-585678b2f78d admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:41.707437 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd970f-3211-4cfb-88b0-585678b2f78d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:41.707719 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd970f-3211-4cfb-88b0-585678b2f78d admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:41.708389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd970f-3211-4cfb-88b0-585678b2f78d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:11:41.708693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd970f-3211-4cfb-88b0-585678b2f78d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:41.710364 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd970f-3211-4cfb-88b0-585678b2f78d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:41.777602 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1792/3576] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:11:41.777822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c031c2-5600-4b00-9547-ca2af1ca1b8c None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:41.798144 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c031c2-5600-4b00-9547-ca2af1ca1b8c None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:41.803530 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0348ef-80d6-4eca-bb26-7284930b1385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:41.804334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0348ef-80d6-4eca-bb26-7284930b1385 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:41.804728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0348ef-80d6-4eca-bb26-7284930b1385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:41.805253 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0348ef-80d6-4eca-bb26-7284930b1385 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:41.806100 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0348ef-80d6-4eca-bb26-7284930b1385 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:41.808160 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0348ef-80d6-4eca-bb26-7284930b1385 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:41.876669 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1785/3577] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:11:41 2022] POST /identity/v3/projects => generated 401 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:11:41.876918 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd970f-3211-4cfb-88b0-585678b2f78d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:41.890827 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd970f-3211-4cfb-88b0-585678b2f78d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:41.908963 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:11:42.184554 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2529442-13e6-49b5-91e7-116abd13ef43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:42.185235 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2529442-13e6-49b5-91e7-116abd13ef43 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:42.185545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2529442-13e6-49b5-91e7-116abd13ef43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:42.186035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2529442-13e6-49b5-91e7-116abd13ef43 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:42.186718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2529442-13e6-49b5-91e7-116abd13ef43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:42.191874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2529442-13e6-49b5-91e7-116abd13ef43 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:42.259277 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1793/3578] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:11:41 2022] POST /identity/v3/users => generated 301 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:11:42.263138 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0348ef-80d6-4eca-bb26-7284930b1385 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:42.274113 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0348ef-80d6-4eca-bb26-7284930b1385 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:42.293050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10113921-46b6-4148-a603-f9c6cec29597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:42.295180 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10113921-46b6-4148-a603-f9c6cec29597 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:42.298553 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10113921-46b6-4148-a603-f9c6cec29597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:42.298922 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10113921-46b6-4148-a603-f9c6cec29597 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:42.300773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10113921-46b6-4148-a603-f9c6cec29597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:42.304787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10113921-46b6-4148-a603-f9c6cec29597 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:42.354847 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1786/3579] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:11:42.356042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2529442-13e6-49b5-91e7-116abd13ef43 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:42.369225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2529442-13e6-49b5-91e7-116abd13ef43 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:42.376829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02ca9d-26db-4a3c-a010-3b539a92070b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:42.377990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02ca9d-26db-4a3c-a010-3b539a92070b admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:42.378575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02ca9d-26db-4a3c-a010-3b539a92070b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:42.379166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02ca9d-26db-4a3c-a010-3b539a92070b admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:42.380123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02ca9d-26db-4a3c-a010-3b539a92070b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:42.382445 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02ca9d-26db-4a3c-a010-3b539a92070b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:42.402470 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1794/3580] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:11:42.402984 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10113921-46b6-4148-a603-f9c6cec29597 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:42.416787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10113921-46b6-4148-a603-f9c6cec29597 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:42.450593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d4afa6-3488-42e6-926f-c15909d0d8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:42.452172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4afa6-3488-42e6-926f-c15909d0d8bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:42.454746 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4afa6-3488-42e6-926f-c15909d0d8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:42.457317 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4afa6-3488-42e6-926f-c15909d0d8bf admin admin] PATH_INFO: `/v3/projects/e885e2778d704d7cbf6840331fbc26ed/users/16f541b3213f46d6ad8885bf72155f1c/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:42.517026 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d4afa6-3488-42e6-926f-c15909d0d8bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e885e2778d704d7cbf6840331fbc26ed, user_id=16f541b3213f46d6ad8885bf72155f1c, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:42.527064 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d4afa6-3488-42e6-926f-c15909d0d8bf admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:42.578722 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1787/3581] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:11:42 2022] PUT /identity/v3/projects/e885e2778d704d7cbf6840331fbc26ed/users/16f541b3213f46d6ad8885bf72155f1c/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:11:42.590357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c937db0-6f64-4aa4-ae0d-35fcc6277399 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:42.590955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c937db0-6f64-4aa4-ae0d-35fcc6277399 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:42.591405 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c937db0-6f64-4aa4-ae0d-35fcc6277399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:42.660701 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-1c937db0-6f64-4aa4-ae0d-35fcc6277399 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:11:42.670156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1c937db0-6f64-4aa4-ae0d-35fcc6277399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:42.886712 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1795/3582] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:11:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:11:42.897230 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d4afa6-3488-42e6-926f-c15909d0d8bf admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:42.899254 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-87d4afa6-3488-42e6-926f-c15909d0d8bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:43.098050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d4afa6-3488-42e6-926f-c15909d0d8bf admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:43.114994 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1287e-7317-41f7-be38-93d416c06305 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:43.119918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1287e-7317-41f7-be38-93d416c06305 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:43.120221 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1287e-7317-41f7-be38-93d416c06305 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:43.121677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1287e-7317-41f7-be38-93d416c06305 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:43.158877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c1287e-7317-41f7-be38-93d416c06305 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:43.165613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c1287e-7317-41f7-be38-93d416c06305 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:43.192017 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1788/3583] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:11:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:11:44.278115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ba2d1-3b34-476e-a206-e1e94abcebc5 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:44.278732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ba2d1-3b34-476e-a206-e1e94abcebc5 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:44.279422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ba2d1-3b34-476e-a206-e1e94abcebc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:44.350548 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-5d4ba2d1-3b34-476e-a206-e1e94abcebc5 None None] MFA Rules not processed for user `5d072ddf52b9403eb9188d3f95bf9581`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:11:44.351805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5d4ba2d1-3b34-476e-a206-e1e94abcebc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:44.576026 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1796/3584] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:11:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:11:46.700535 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1287e-7317-41f7-be38-93d416c06305 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:46.702066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e4c1287e-7317-41f7-be38-93d416c06305 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:46.751301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1287e-7317-41f7-be38-93d416c06305 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:46.763282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97e42f-06ed-4c89-a1be-8e8fc9fcf609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:46.764018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97e42f-06ed-4c89-a1be-8e8fc9fcf609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:46.764307 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97e42f-06ed-4c89-a1be-8e8fc9fcf609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:46.764584 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97e42f-06ed-4c89-a1be-8e8fc9fcf609 admin admin] PATH_INFO: `/v3/users/96770d5c8d0b45748e5a73cd3c07c204` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:46.766073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97e42f-06ed-4c89-a1be-8e8fc9fcf609 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96770d5c8d0b45748e5a73cd3c07c204)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:46.770138 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97e42f-06ed-4c89-a1be-8e8fc9fcf609 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:46.776486 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:11:46.887600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ef97e42f-06ed-4c89-a1be-8e8fc9fcf609 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96770d5c8d0b45748e5a73cd3c07c204'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:46.888314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ef97e42f-06ed-4c89-a1be-8e8fc9fcf609 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96770d5c8d0b45748e5a73cd3c07c204'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:46.908664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ef97e42f-06ed-4c89-a1be-8e8fc9fcf609 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96770d5c8d0b45748e5a73cd3c07c204'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:46.923473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ef97e42f-06ed-4c89-a1be-8e8fc9fcf609 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96770d5c8d0b45748e5a73cd3c07c204'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:46.924773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ef97e42f-06ed-4c89-a1be-8e8fc9fcf609 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96770d5c8d0b45748e5a73cd3c07c204'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:46.965210 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1789/3585] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:11:46 2022] DELETE /identity/v3/users/96770d5c8d0b45748e5a73cd3c07c204 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:11:47.407364 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ba2d1-3b34-476e-a206-e1e94abcebc5 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:47.450530 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ba2d1-3b34-476e-a206-e1e94abcebc5 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:47.504878 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:11:47.566196 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2de21-b74a-497c-9ba3-78784d5ef95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:47.567573 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2de21-b74a-497c-9ba3-78784d5ef95e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:47.568014 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2de21-b74a-497c-9ba3-78784d5ef95e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:47.568457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2de21-b74a-497c-9ba3-78784d5ef95e admin admin] PATH_INFO: `/v3/projects/8bdfb4e90f8b457a98e8107599475566` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:47.570474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2de21-b74a-497c-9ba3-78784d5ef95e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bdfb4e90f8b457a98e8107599475566)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:47.573736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2de21-b74a-497c-9ba3-78784d5ef95e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:47.686974 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8bb2de21-b74a-497c-9ba3-78784d5ef95e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bdfb4e90f8b457a98e8107599475566', 'request_id': 'req-8bb2de21-b74a-497c-9ba3-78784d5ef95e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:47.712605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8bb2de21-b74a-497c-9ba3-78784d5ef95e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bdfb4e90f8b457a98e8107599475566', 'request_id': 'req-8bb2de21-b74a-497c-9ba3-78784d5ef95e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:47.729579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8bb2de21-b74a-497c-9ba3-78784d5ef95e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bdfb4e90f8b457a98e8107599475566', 'request_id': 'req-8bb2de21-b74a-497c-9ba3-78784d5ef95e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:47.770471 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8bb2de21-b74a-497c-9ba3-78784d5ef95e admin admin] The token cache is being invalidate because project 8bdfb4e90f8b457a98e8107599475566 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:11:47.772395 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8bb2de21-b74a-497c-9ba3-78784d5ef95e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:47.774263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8bb2de21-b74a-497c-9ba3-78784d5ef95e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:11:47.780612 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1797/3586] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:11:47 2022] DELETE /identity/v3/projects/8bdfb4e90f8b457a98e8107599475566 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:11:47.785937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f277060-645b-426a-a7f1-89513b749442 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:47.786543 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f277060-645b-426a-a7f1-89513b749442 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:47.786543 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f277060-645b-426a-a7f1-89513b749442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:47.837567 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-0f277060-645b-426a-a7f1-89513b749442 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:11:47.838818 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0f277060-645b-426a-a7f1-89513b749442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:47.876251 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2de21-b74a-497c-9ba3-78784d5ef95e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:47.878154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8bb2de21-b74a-497c-9ba3-78784d5ef95e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:48.085988 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1790/3587] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:11:48.091671 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2de21-b74a-497c-9ba3-78784d5ef95e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:48.098632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3863fd-c798-4487-8591-b72c3bbdf100 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:48.098900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3863fd-c798-4487-8591-b72c3bbdf100 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:48.099175 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3863fd-c798-4487-8591-b72c3bbdf100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:48.119432 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2ed3e-6a90-4024-873f-77399f652a99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:48.120640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2ed3e-6a90-4024-873f-77399f652a99 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:48.124074 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2ed3e-6a90-4024-873f-77399f652a99 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:48.124598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2ed3e-6a90-4024-873f-77399f652a99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:48.131247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e2b2ed3e-6a90-4024-873f-77399f652a99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:48.185714 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-7a3863fd-c798-4487-8591-b72c3bbdf100 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:11:48.186945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7a3863fd-c798-4487-8591-b72c3bbdf100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:48.219150 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1791/3588] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:11:48.225584 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3863fd-c798-4487-8591-b72c3bbdf100 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:48.248195 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3863fd-c798-4487-8591-b72c3bbdf100 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:48.253563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c44e49-24b1-45a7-80dc-bb946ecfba6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:48.254208 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c44e49-24b1-45a7-80dc-bb946ecfba6d admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:48.254483 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c44e49-24b1-45a7-80dc-bb946ecfba6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:48.254746 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c44e49-24b1-45a7-80dc-bb946ecfba6d admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:48.255401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c44e49-24b1-45a7-80dc-bb946ecfba6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:11:48.255699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c44e49-24b1-45a7-80dc-bb946ecfba6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:48.257305 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c44e49-24b1-45a7-80dc-bb946ecfba6d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:48.295154 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1792/3589] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:11:48.296030 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c44e49-24b1-45a7-80dc-bb946ecfba6d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:48.298775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2ed3e-6a90-4024-873f-77399f652a99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:48.300526 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2ed3e-6a90-4024-873f-77399f652a99 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:48.307559 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:11:48.309104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c44e49-24b1-45a7-80dc-bb946ecfba6d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:48.316450 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e42e8-8ade-418e-ad2c-8b6484e55e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:48.317306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e42e8-8ade-418e-ad2c-8b6484e55e15 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:48.318065 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e42e8-8ade-418e-ad2c-8b6484e55e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:48.318714 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e42e8-8ade-418e-ad2c-8b6484e55e15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:48.319636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e42e8-8ade-418e-ad2c-8b6484e55e15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:48.321618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e42e8-8ade-418e-ad2c-8b6484e55e15 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:48.330796 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1798/3590] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:11:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:11:48.398891 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1793/3591] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:11:48 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:11:48.400716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2ed3e-6a90-4024-873f-77399f652a99 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:48.453743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2ed3e-6a90-4024-873f-77399f652a99 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:48.638672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3910e6d-0ec7-4764-b38c-0487edf699fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:48.641039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3910e6d-0ec7-4764-b38c-0487edf699fd admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:48.641039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3910e6d-0ec7-4764-b38c-0487edf699fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:48.641039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3910e6d-0ec7-4764-b38c-0487edf699fd admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:48.646343 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3910e6d-0ec7-4764-b38c-0487edf699fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:48.651416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3910e6d-0ec7-4764-b38c-0487edf699fd admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:48.713941 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1799/3592] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:11:48 2022] POST /identity/v3/users => generated 290 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:11:48.717967 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e42e8-8ade-418e-ad2c-8b6484e55e15 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:48.731716 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e42e8-8ade-418e-ad2c-8b6484e55e15 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:48.762833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f154ab-1167-4039-b414-9aa42d3d2155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:48.763776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f154ab-1167-4039-b414-9aa42d3d2155 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:48.763776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f154ab-1167-4039-b414-9aa42d3d2155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:48.763987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f154ab-1167-4039-b414-9aa42d3d2155 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:48.764695 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f154ab-1167-4039-b414-9aa42d3d2155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:48.766940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f154ab-1167-4039-b414-9aa42d3d2155 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:48.813887 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1794/3593] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:11:48.814745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3910e6d-0ec7-4764-b38c-0487edf699fd admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:48.834356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7675ae-cb0a-4edb-bcf1-0ca6399e3512 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:48.835003 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7675ae-cb0a-4edb-bcf1-0ca6399e3512 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:48.835559 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7675ae-cb0a-4edb-bcf1-0ca6399e3512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:48.841150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3910e6d-0ec7-4764-b38c-0487edf699fd admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:48.872025 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9eead3-3d93-4c24-ab9a-c8a0cb5d18b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:48.872704 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9eead3-3d93-4c24-ab9a-c8a0cb5d18b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:48.872974 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9eead3-3d93-4c24-ab9a-c8a0cb5d18b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:48.874255 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9eead3-3d93-4c24-ab9a-c8a0cb5d18b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:48.877624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9eead3-3d93-4c24-ab9a-c8a0cb5d18b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:48.880831 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9eead3-3d93-4c24-ab9a-c8a0cb5d18b4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:48.890754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-0c7675ae-cb0a-4edb-bcf1-0ca6399e3512 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:11:48.892078 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0c7675ae-cb0a-4edb-bcf1-0ca6399e3512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:48.922286 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1800/3594] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:11:48.926533 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9eead3-3d93-4c24-ab9a-c8a0cb5d18b4 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:48.949091 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:11:48.954142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9eead3-3d93-4c24-ab9a-c8a0cb5d18b4 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:48.971613 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee80859-8f94-4e41-8bc1-15d3d222984e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:48.974263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee80859-8f94-4e41-8bc1-15d3d222984e admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:48.974495 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee80859-8f94-4e41-8bc1-15d3d222984e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:48.974769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee80859-8f94-4e41-8bc1-15d3d222984e admin admin] PATH_INFO: `/v3/projects/5a480e825064479f9c564e95ae3a692b/users/13d1460667de427b9dded0375954a6ac/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:49.016418 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee80859-8f94-4e41-8bc1-15d3d222984e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a480e825064479f9c564e95ae3a692b, user_id=13d1460667de427b9dded0375954a6ac, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:49.019223 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee80859-8f94-4e41-8bc1-15d3d222984e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:49.053229 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1801/3595] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:11:48 2022] PUT /identity/v3/projects/5a480e825064479f9c564e95ae3a692b/users/13d1460667de427b9dded0375954a6ac/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:11:49.058043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb008490-6790-43f9-b6fd-0a880d1b64e6 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:49.058320 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb008490-6790-43f9-b6fd-0a880d1b64e6 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:49.058597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb008490-6790-43f9-b6fd-0a880d1b64e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:49.065697 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1795/3596] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:11:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:11:49.086341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7675ae-cb0a-4edb-bcf1-0ca6399e3512 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:49.089236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0c7675ae-cb0a-4edb-bcf1-0ca6399e3512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:49.089809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-cb008490-6790-43f9-b6fd-0a880d1b64e6 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:11:49.091008 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-cb008490-6790-43f9-b6fd-0a880d1b64e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:49.228296 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1802/3597] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:11:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:11:49.241031 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb008490-6790-43f9-b6fd-0a880d1b64e6 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:49.243550 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-cb008490-6790-43f9-b6fd-0a880d1b64e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:49.290869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7675ae-cb0a-4edb-bcf1-0ca6399e3512 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:49.396291 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb008490-6790-43f9-b6fd-0a880d1b64e6 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:49.401283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee178f-a4d1-4cae-8693-d1ffb302719b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:49.401948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee178f-a4d1-4cae-8693-d1ffb302719b service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:49.402869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee178f-a4d1-4cae-8693-d1ffb302719b service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:49.403152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee178f-a4d1-4cae-8693-d1ffb302719b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:49.416746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee178f-a4d1-4cae-8693-d1ffb302719b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:49.418999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee178f-a4d1-4cae-8693-d1ffb302719b service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:49.423668 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:11:49.432603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d85f2-2957-4009-8332-419a5810583c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:49.433606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d85f2-2957-4009-8332-419a5810583c service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:49.434032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d85f2-2957-4009-8332-419a5810583c service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:49.434481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d85f2-2957-4009-8332-419a5810583c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:49.435746 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1803/3598] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:11:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:11:49.514998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d85f2-2957-4009-8332-419a5810583c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:49.516905 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d85f2-2957-4009-8332-419a5810583c service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:49.536512 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1796/3599] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:11:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:11:52.871862 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1b78f-0c7f-4619-a63d-18e5b7f3947c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:52.872401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1b78f-0c7f-4619-a63d-18e5b7f3947c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:52.872401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1b78f-0c7f-4619-a63d-18e5b7f3947c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:52.928695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-73f1b78f-0c7f-4619-a63d-18e5b7f3947c None None] MFA Rules not processed for user `832e32b86f334bf4bd36eb7f806d604c`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:11:52.930011 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-73f1b78f-0c7f-4619-a63d-18e5b7f3947c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:53.167733 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1804/3600] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:11:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:11:53.802750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac9abd-b0b1-4b21-8919-8130dd8a5774 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:53.803283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac9abd-b0b1-4b21-8919-8130dd8a5774 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:53.803955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac9abd-b0b1-4b21-8919-8130dd8a5774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:53.845898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-47ac9abd-b0b1-4b21-8919-8130dd8a5774 None None] MFA Rules not processed for user `5d072ddf52b9403eb9188d3f95bf9581`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:11:53.847640 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-47ac9abd-b0b1-4b21-8919-8130dd8a5774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:53.864473 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:11:53.986363 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1797/3601] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:11:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:11:54.114852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a545800-c824-47e7-a654-9392629e3f41 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:54.115693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a545800-c824-47e7-a654-9392629e3f41 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:54.116274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a545800-c824-47e7-a654-9392629e3f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:54.181857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-4a545800-c824-47e7-a654-9392629e3f41 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:11:54.184205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4a545800-c824-47e7-a654-9392629e3f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:54.218185 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1805/3602] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 01:11:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:11:54.246680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac9abd-b0b1-4b21-8919-8130dd8a5774 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:54.267422 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac9abd-b0b1-4b21-8919-8130dd8a5774 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:54.281567 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444681e8-ebd4-4488-b7e6-ab359b04699f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:54.284924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444681e8-ebd4-4488-b7e6-ab359b04699f service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:54.285400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444681e8-ebd4-4488-b7e6-ab359b04699f service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:54.288805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444681e8-ebd4-4488-b7e6-ab359b04699f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:54.318407 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444681e8-ebd4-4488-b7e6-ab359b04699f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:54.320723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444681e8-ebd4-4488-b7e6-ab359b04699f service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:54.344995 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1798/3603] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:11:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:11:54.663137 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a545800-c824-47e7-a654-9392629e3f41 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:54.692017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a545800-c824-47e7-a654-9392629e3f41 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:54.707043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c461b-fd98-47c7-9939-0cff73bf8173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:54.707920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c461b-fd98-47c7-9939-0cff73bf8173 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:54.708293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c461b-fd98-47c7-9939-0cff73bf8173 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:54.708668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c461b-fd98-47c7-9939-0cff73bf8173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:54.719867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e43c461b-fd98-47c7-9939-0cff73bf8173 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:54.757097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43c461b-fd98-47c7-9939-0cff73bf8173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:54.760887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43c461b-fd98-47c7-9939-0cff73bf8173 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:54.795274 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1806/3604] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:11:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:11:56.155840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724a6f9-4236-4c6c-90e9-e5829d472d4e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:56.156929 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724a6f9-4236-4c6c-90e9-e5829d472d4e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:56.157363 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724a6f9-4236-4c6c-90e9-e5829d472d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:56.161268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258ab31-3bed-4ef8-9a4a-31538af1af7a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:56.164535 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258ab31-3bed-4ef8-9a4a-31538af1af7a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:56.164970 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258ab31-3bed-4ef8-9a4a-31538af1af7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:56.238949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-0258ab31-3bed-4ef8-9a4a-31538af1af7a None None] MFA Rules not processed for user `16f541b3213f46d6ad8885bf72155f1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:11:56.240445 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0258ab31-3bed-4ef8-9a4a-31538af1af7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:56.257240 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-3724a6f9-4236-4c6c-90e9-e5829d472d4e None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:11:56.275623 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3724a6f9-4236-4c6c-90e9-e5829d472d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:56.315535 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1799/3605] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:11:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:11:56.334345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724a6f9-4236-4c6c-90e9-e5829d472d4e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:56.405705 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724a6f9-4236-4c6c-90e9-e5829d472d4e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:56.411887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd2edf-dc44-41b4-87c3-f94803cb6014 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:56.412724 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd2edf-dc44-41b4-87c3-f94803cb6014 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:56.413185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd2edf-dc44-41b4-87c3-f94803cb6014 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:56.413633 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd2edf-dc44-41b4-87c3-f94803cb6014 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:56.423808 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd2edf-dc44-41b4-87c3-f94803cb6014 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:56.427488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd2edf-dc44-41b4-87c3-f94803cb6014 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:56.440207 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1800/3606] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:11:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 04 01:11:56.444433 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1807/3607] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:11:56 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:11:57.992100 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd2edf-dc44-41b4-87c3-f94803cb6014 service swift] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:11:57.994136 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-47dd2edf-dc44-41b4-87c3-f94803cb6014 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:11:58.301086 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd2edf-dc44-41b4-87c3-f94803cb6014 service swift] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:11:58.327481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe653f6-049b-464e-bff8-64434cb35cc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:11:58.329471 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe653f6-049b-464e-bff8-64434cb35cc3 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:11:58.332079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe653f6-049b-464e-bff8-64434cb35cc3 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:11:58.332079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe653f6-049b-464e-bff8-64434cb35cc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:11:58.373133 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe653f6-049b-464e-bff8-64434cb35cc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:11:58.378209 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe653f6-049b-464e-bff8-64434cb35cc3 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:11:58.458613 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1801/3608] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:11:57 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:12:02.318298 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc59628-e4a1-469d-8f0d-c22f9f1a60fe None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:02.318891 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc59628-e4a1-469d-8f0d-c22f9f1a60fe None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:02.318891 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc59628-e4a1-469d-8f0d-c22f9f1a60fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:02.386381 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-acc59628-e4a1-469d-8f0d-c22f9f1a60fe None None] MFA Rules not processed for user `5d072ddf52b9403eb9188d3f95bf9581`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:02.388159 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-acc59628-e4a1-469d-8f0d-c22f9f1a60fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:02.420203 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1808/3609] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:12:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:12:05.597004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b5389-e499-4d33-931c-58020fccbc01 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:05.597538 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b5389-e499-4d33-931c-58020fccbc01 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:05.597820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b5389-e499-4d33-931c-58020fccbc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:05.778487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-8a2b5389-e499-4d33-931c-58020fccbc01 None None] MFA Rules not processed for user `13d1460667de427b9dded0375954a6ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:05.798026 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8a2b5389-e499-4d33-931c-58020fccbc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:06.031279 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1802/3610] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:12:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:12:11.398100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc59628-e4a1-469d-8f0d-c22f9f1a60fe None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:11.399936 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-acc59628-e4a1-469d-8f0d-c22f9f1a60fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:11.427528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc59628-e4a1-469d-8f0d-c22f9f1a60fe None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:11.463181 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5b9e2-5e0f-4ea0-8fb5-db84ef45bea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:11.463956 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5b9e2-5e0f-4ea0-8fb5-db84ef45bea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:11.466679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5b9e2-5e0f-4ea0-8fb5-db84ef45bea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:11.467081 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5b9e2-5e0f-4ea0-8fb5-db84ef45bea3 admin admin] PATH_INFO: `/v3/users/16f541b3213f46d6ad8885bf72155f1c` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:11.468494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5b9e2-5e0f-4ea0-8fb5-db84ef45bea3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16f541b3213f46d6ad8885bf72155f1c)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:11.475454 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5b9e2-5e0f-4ea0-8fb5-db84ef45bea3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:11.597950 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-84e5b9e2-5e0f-4ea0-8fb5-db84ef45bea3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16f541b3213f46d6ad8885bf72155f1c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:11.598867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-84e5b9e2-5e0f-4ea0-8fb5-db84ef45bea3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16f541b3213f46d6ad8885bf72155f1c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:11.622653 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-84e5b9e2-5e0f-4ea0-8fb5-db84ef45bea3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16f541b3213f46d6ad8885bf72155f1c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:11.627325 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:12:11.641079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-84e5b9e2-5e0f-4ea0-8fb5-db84ef45bea3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16f541b3213f46d6ad8885bf72155f1c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:11.642223 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-84e5b9e2-5e0f-4ea0-8fb5-db84ef45bea3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16f541b3213f46d6ad8885bf72155f1c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:11.666967 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1809/3611] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:12:11 2022] DELETE /identity/v3/users/16f541b3213f46d6ad8885bf72155f1c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:12:12.168528 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b5389-e499-4d33-931c-58020fccbc01 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:12.174332 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:12:12.189634 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b5389-e499-4d33-931c-58020fccbc01 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:12.366114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d1946-2d02-464b-a070-303ce2509d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:12.366763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d1946-2d02-464b-a070-303ce2509d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:12.367045 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d1946-2d02-464b-a070-303ce2509d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:12.367316 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d1946-2d02-464b-a070-303ce2509d67 admin admin] PATH_INFO: `/v3/projects/e885e2778d704d7cbf6840331fbc26ed` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:12.372124 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d1946-2d02-464b-a070-303ce2509d67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e885e2778d704d7cbf6840331fbc26ed)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:12.377816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d1946-2d02-464b-a070-303ce2509d67 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:12.503061 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a53d1946-2d02-464b-a070-303ce2509d67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e885e2778d704d7cbf6840331fbc26ed', 'request_id': 'req-a53d1946-2d02-464b-a070-303ce2509d67'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:12.520481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a53d1946-2d02-464b-a070-303ce2509d67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e885e2778d704d7cbf6840331fbc26ed', 'request_id': 'req-a53d1946-2d02-464b-a070-303ce2509d67'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:12.533671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a53d1946-2d02-464b-a070-303ce2509d67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e885e2778d704d7cbf6840331fbc26ed', 'request_id': 'req-a53d1946-2d02-464b-a070-303ce2509d67'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:12.575632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a53d1946-2d02-464b-a070-303ce2509d67 admin admin] The token cache is being invalidate because project e885e2778d704d7cbf6840331fbc26ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:12:12.576220 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a53d1946-2d02-464b-a070-303ce2509d67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:12.580767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a53d1946-2d02-464b-a070-303ce2509d67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:12.602077 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1803/3612] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:12:12 2022] DELETE /identity/v3/projects/e885e2778d704d7cbf6840331fbc26ed => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:12:12.606919 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278e0af-4ac0-4b49-82e0-2cd142b719e5 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:12.609059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278e0af-4ac0-4b49-82e0-2cd142b719e5 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:12.609525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278e0af-4ac0-4b49-82e0-2cd142b719e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:12.665002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-6278e0af-4ac0-4b49-82e0-2cd142b719e5 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:12.667065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6278e0af-4ac0-4b49-82e0-2cd142b719e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:12.800210 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1810/3613] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:12:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:12:12.810513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6336a-0e4a-4c2b-ad8c-f7516fbc85ab None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:12.811611 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6336a-0e4a-4c2b-ad8c-f7516fbc85ab None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:12.812149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6336a-0e4a-4c2b-ad8c-f7516fbc85ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:12.842470 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-42b6336a-0e4a-4c2b-ad8c-f7516fbc85ab None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:12.843711 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-42b6336a-0e4a-4c2b-ad8c-f7516fbc85ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:12.853329 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1804/3614] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:12:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:12:12.859088 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278e0af-4ac0-4b49-82e0-2cd142b719e5 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:12.870416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278e0af-4ac0-4b49-82e0-2cd142b719e5 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:12.875516 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e71041-12fd-4c33-9182-004bec04af1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:12.876103 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e71041-12fd-4c33-9182-004bec04af1c admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:12.876700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e71041-12fd-4c33-9182-004bec04af1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:12.877141 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e71041-12fd-4c33-9182-004bec04af1c admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:12.878101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e71041-12fd-4c33-9182-004bec04af1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:12:12.878560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e71041-12fd-4c33-9182-004bec04af1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:12.881005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e71041-12fd-4c33-9182-004bec04af1c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:12.899234 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1811/3615] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:12:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:12:12.903333 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6336a-0e4a-4c2b-ad8c-f7516fbc85ab None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:12.916063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6336a-0e4a-4c2b-ad8c-f7516fbc85ab None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:12.922199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17045f3d-382d-4a66-9450-1504cbe56876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:12.923048 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17045f3d-382d-4a66-9450-1504cbe56876 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:12.923639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17045f3d-382d-4a66-9450-1504cbe56876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:12.924138 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17045f3d-382d-4a66-9450-1504cbe56876 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:12.925897 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17045f3d-382d-4a66-9450-1504cbe56876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:12.928214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17045f3d-382d-4a66-9450-1504cbe56876 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:12.981850 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1805/3616] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:12:12 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:12:12.986931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e71041-12fd-4c33-9182-004bec04af1c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:13.016399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e71041-12fd-4c33-9182-004bec04af1c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:13.097856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfd771-4e4c-4fb7-aff6-3f1e810aefd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:13.098866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfd771-4e4c-4fb7-aff6-3f1e810aefd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:13.099217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfd771-4e4c-4fb7-aff6-3f1e810aefd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:13.099656 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfd771-4e4c-4fb7-aff6-3f1e810aefd5 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:13.100837 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cfd771-4e4c-4fb7-aff6-3f1e810aefd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:13.105570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cfd771-4e4c-4fb7-aff6-3f1e810aefd5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:13.151032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17045f3d-382d-4a66-9450-1504cbe56876 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:13.151266 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1812/3617] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:12:12 2022] POST /identity/v3/users => generated 287 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:12:13.162314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17045f3d-382d-4a66-9450-1504cbe56876 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:13.168735 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c2d2a-2550-4e6c-abfd-5aae2426e0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:13.170669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c2d2a-2550-4e6c-abfd-5aae2426e0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:13.171191 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c2d2a-2550-4e6c-abfd-5aae2426e0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:13.171703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c2d2a-2550-4e6c-abfd-5aae2426e0f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:13.173072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c2d2a-2550-4e6c-abfd-5aae2426e0f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:13.227906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c2d2a-2550-4e6c-abfd-5aae2426e0f2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:13.227906 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1806/3618] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:12:13.247774 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfd771-4e4c-4fb7-aff6-3f1e810aefd5 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:13.262691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfd771-4e4c-4fb7-aff6-3f1e810aefd5 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:13.267872 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad81d7-313b-47a8-ae16-5bff9493db21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:13.268695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad81d7-313b-47a8-ae16-5bff9493db21 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:13.269382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad81d7-313b-47a8-ae16-5bff9493db21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:13.269382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad81d7-313b-47a8-ae16-5bff9493db21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:13.269941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad81d7-313b-47a8-ae16-5bff9493db21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:13.271841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad81d7-313b-47a8-ae16-5bff9493db21 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:13.291487 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1813/3619] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:12:13.295706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c2d2a-2550-4e6c-abfd-5aae2426e0f2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:13.312886 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c2d2a-2550-4e6c-abfd-5aae2426e0f2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:13.321016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff0d1e3-9c5e-4357-9eb9-5e4c46039145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:13.321723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0d1e3-9c5e-4357-9eb9-5e4c46039145 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:13.322006 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0d1e3-9c5e-4357-9eb9-5e4c46039145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:13.322288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0d1e3-9c5e-4357-9eb9-5e4c46039145 admin admin] PATH_INFO: `/v3/projects/0d4b141262ae4fa084db017dcaf6553e/users/6ce9fdec68274dd19c80b9f79045436f/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:13.344779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff0d1e3-9c5e-4357-9eb9-5e4c46039145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d4b141262ae4fa084db017dcaf6553e, user_id=6ce9fdec68274dd19c80b9f79045436f, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:13.347656 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff0d1e3-9c5e-4357-9eb9-5e4c46039145 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:13.387309 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1807/3620] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:12:13 2022] PUT /identity/v3/projects/0d4b141262ae4fa084db017dcaf6553e/users/6ce9fdec68274dd19c80b9f79045436f/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:12:13.397537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed74a16-b7e8-40dc-be4a-88ef8205b07d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:13.398058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed74a16-b7e8-40dc-be4a-88ef8205b07d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:13.398590 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed74a16-b7e8-40dc-be4a-88ef8205b07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:13.473942 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-fed74a16-b7e8-40dc-be4a-88ef8205b07d None None] MFA Rules not processed for user `6ce9fdec68274dd19c80b9f79045436f`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:13.476334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fed74a16-b7e8-40dc-be4a-88ef8205b07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:13.544802 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:12:13.590244 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1814/3621] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:12:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:12:14.026538 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff0d1e3-9c5e-4357-9eb9-5e4c46039145 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:14.034996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-fff0d1e3-9c5e-4357-9eb9-5e4c46039145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:14.103271 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:12:14.196008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff0d1e3-9c5e-4357-9eb9-5e4c46039145 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:14.203340 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488db6b7-4647-4179-bbe6-8d35c669ee00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:14.204182 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488db6b7-4647-4179-bbe6-8d35c669ee00 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:14.204632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488db6b7-4647-4179-bbe6-8d35c669ee00 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:14.204911 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488db6b7-4647-4179-bbe6-8d35c669ee00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:14.206737 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-488db6b7-4647-4179-bbe6-8d35c669ee00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:14.282703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488db6b7-4647-4179-bbe6-8d35c669ee00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:14.285746 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488db6b7-4647-4179-bbe6-8d35c669ee00 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:14.303900 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1808/3622] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:12:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:12:14.683554 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed74a16-b7e8-40dc-be4a-88ef8205b07d None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:14.685097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fed74a16-b7e8-40dc-be4a-88ef8205b07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:14.704101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed74a16-b7e8-40dc-be4a-88ef8205b07d None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:14.712500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d519fe-4516-4755-b039-000455c938be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:14.713552 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d519fe-4516-4755-b039-000455c938be service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:14.713945 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d519fe-4516-4755-b039-000455c938be service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:14.714314 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d519fe-4516-4755-b039-000455c938be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:14.723725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d519fe-4516-4755-b039-000455c938be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:14.726042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d519fe-4516-4755-b039-000455c938be service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:14.749069 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1815/3623] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:12:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:12:15.184258 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86524a7-e1e2-4a47-9d15-ee8fde243351 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:15.184444 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86524a7-e1e2-4a47-9d15-ee8fde243351 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:15.184725 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86524a7-e1e2-4a47-9d15-ee8fde243351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:15.207931 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d86524a7-e1e2-4a47-9d15-ee8fde243351 None None] MFA Rules not processed for user `5d072ddf52b9403eb9188d3f95bf9581`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:15.210133 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d86524a7-e1e2-4a47-9d15-ee8fde243351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:15.388373 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1809/3624] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:12:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:12:15.448025 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce132c-c6f1-4096-b601-94650a730f36 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:15.448253 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce132c-c6f1-4096-b601-94650a730f36 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:15.448527 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce132c-c6f1-4096-b601-94650a730f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:15.472461 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-01ce132c-c6f1-4096-b601-94650a730f36 None None] MFA Rules not processed for user `13d1460667de427b9dded0375954a6ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:15.473728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-01ce132c-c6f1-4096-b601-94650a730f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:15.482937 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1816/3625] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:12:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:12:16.898586 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2993b10-776e-47b0-a03d-793820c51a4e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:16.899013 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2993b10-776e-47b0-a03d-793820c51a4e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:16.899202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2993b10-776e-47b0-a03d-793820c51a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:16.931416 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c2993b10-776e-47b0-a03d-793820c51a4e None None] MFA Rules not processed for user `5d072ddf52b9403eb9188d3f95bf9581`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:16.932638 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c2993b10-776e-47b0-a03d-793820c51a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:16.941351 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1810/3626] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:12:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:12:17.108333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36998c9d-e6ee-456e-90a0-a69f81478f74 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:17.109143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36998c9d-e6ee-456e-90a0-a69f81478f74 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:17.109353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36998c9d-e6ee-456e-90a0-a69f81478f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:17.135844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-36998c9d-e6ee-456e-90a0-a69f81478f74 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:17.137054 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-36998c9d-e6ee-456e-90a0-a69f81478f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:17.220054 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1817/3627] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 01:12:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:12:17.235065 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2993b10-776e-47b0-a03d-793820c51a4e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:17.238120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c2993b10-776e-47b0-a03d-793820c51a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:17.356619 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2993b10-776e-47b0-a03d-793820c51a4e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:17.362653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55384eb7-8c8a-4862-867f-12b27060fe98 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:17.363272 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55384eb7-8c8a-4862-867f-12b27060fe98 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:17.363556 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55384eb7-8c8a-4862-867f-12b27060fe98 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:17.363823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55384eb7-8c8a-4862-867f-12b27060fe98 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:17.371523 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:12:17.379997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55384eb7-8c8a-4862-867f-12b27060fe98 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:17.382116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55384eb7-8c8a-4862-867f-12b27060fe98 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:17.395991 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1811/3628] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:12:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:12:17.895017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb526e8-2e32-49c4-84f9-98e522afaf2c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:17.895568 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb526e8-2e32-49c4-84f9-98e522afaf2c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:17.895995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb526e8-2e32-49c4-84f9-98e522afaf2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:17.917557 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ecb526e8-2e32-49c4-84f9-98e522afaf2c None None] MFA Rules not processed for user `5d072ddf52b9403eb9188d3f95bf9581`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:17.918768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ecb526e8-2e32-49c4-84f9-98e522afaf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:17.929897 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1818/3629] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:12:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:12:18.833513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f9e2e-2b50-4064-b6e1-dbfdb801f7a9 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:18.834025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f9e2e-2b50-4064-b6e1-dbfdb801f7a9 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:18.834123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f9e2e-2b50-4064-b6e1-dbfdb801f7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:18.856924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-0f9f9e2e-2b50-4064-b6e1-dbfdb801f7a9 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:18.858358 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0f9f9e2e-2b50-4064-b6e1-dbfdb801f7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:18.887851 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1812/3630] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 01:12:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:12:18.888629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb526e8-2e32-49c4-84f9-98e522afaf2c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:18.904410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb526e8-2e32-49c4-84f9-98e522afaf2c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:18.914860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1cdba-64ca-4e47-9ca1-638a3cd36c06 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:18.917116 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1cdba-64ca-4e47-9ca1-638a3cd36c06 service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:18.917801 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1cdba-64ca-4e47-9ca1-638a3cd36c06 service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:18.918575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1cdba-64ca-4e47-9ca1-638a3cd36c06 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:18.936415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1cdba-64ca-4e47-9ca1-638a3cd36c06 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:18.938916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1cdba-64ca-4e47-9ca1-638a3cd36c06 service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:18.949021 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1819/3631] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:12:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:12:19.001916 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918d3ec-dd35-42f8-b85d-ef884a08c892 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:19.002243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918d3ec-dd35-42f8-b85d-ef884a08c892 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:19.002468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918d3ec-dd35-42f8-b85d-ef884a08c892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:19.025740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-7918d3ec-dd35-42f8-b85d-ef884a08c892 None None] MFA Rules not processed for user `5d072ddf52b9403eb9188d3f95bf9581`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:19.027203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7918d3ec-dd35-42f8-b85d-ef884a08c892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:19.039557 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1813/3632] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:12:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:12:19.454422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be81cf-c6a9-4e8f-9319-24399efd21b5 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:19.454951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be81cf-c6a9-4e8f-9319-24399efd21b5 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:19.456063 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be81cf-c6a9-4e8f-9319-24399efd21b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:19.480886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-97be81cf-c6a9-4e8f-9319-24399efd21b5 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:19.482446 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-97be81cf-c6a9-4e8f-9319-24399efd21b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:19.491276 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1820/3633] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 01:12:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:12:19.506125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918d3ec-dd35-42f8-b85d-ef884a08c892 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:19.533032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918d3ec-dd35-42f8-b85d-ef884a08c892 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:19.547830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ad406-9e7f-446e-b2f1-1b2b3ceaff60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:19.550192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ad406-9e7f-446e-b2f1-1b2b3ceaff60 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:19.550653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ad406-9e7f-446e-b2f1-1b2b3ceaff60 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:19.551469 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ad406-9e7f-446e-b2f1-1b2b3ceaff60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:19.573188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ad406-9e7f-446e-b2f1-1b2b3ceaff60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:19.574888 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ad406-9e7f-446e-b2f1-1b2b3ceaff60 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:19.603079 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1814/3634] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:12:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:12:20.377291 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eacc96-ce6e-4ebc-ad7e-06097de3a5d7 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:20.377833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eacc96-ce6e-4ebc-ad7e-06097de3a5d7 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:20.379055 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eacc96-ce6e-4ebc-ad7e-06097de3a5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:20.413942 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-94eacc96-ce6e-4ebc-ad7e-06097de3a5d7 None None] MFA Rules not processed for user `5d072ddf52b9403eb9188d3f95bf9581`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:20.416393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-94eacc96-ce6e-4ebc-ad7e-06097de3a5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:20.447843 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1821/3635] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:12:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:12:21.891828 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf8908-8a8e-434f-88ba-2a00bee7bec1 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:21.892798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf8908-8a8e-434f-88ba-2a00bee7bec1 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:21.893347 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf8908-8a8e-434f-88ba-2a00bee7bec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:21.917116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5adf8908-8a8e-434f-88ba-2a00bee7bec1 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:21.918545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5adf8908-8a8e-434f-88ba-2a00bee7bec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:21.926136 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1815/3636] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 01:12:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:12:21.948358 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eacc96-ce6e-4ebc-ad7e-06097de3a5d7 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:21.980910 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eacc96-ce6e-4ebc-ad7e-06097de3a5d7 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:21.987161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca88e3a-22ee-4690-a061-21f8a33848dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:21.987887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca88e3a-22ee-4690-a061-21f8a33848dd service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:21.988269 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca88e3a-22ee-4690-a061-21f8a33848dd service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:21.989082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca88e3a-22ee-4690-a061-21f8a33848dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:21.999000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca88e3a-22ee-4690-a061-21f8a33848dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:22.001033 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca88e3a-22ee-4690-a061-21f8a33848dd service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:22.012221 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1822/3637] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:12:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:12:22.260909 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01bf5f-d652-4ae2-93a8-80d64f522c1a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:22.261282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01bf5f-d652-4ae2-93a8-80d64f522c1a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:22.261705 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01bf5f-d652-4ae2-93a8-80d64f522c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:22.276212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca88e3a-22ee-4690-a061-21f8a33848dd service swift] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:22.316347 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-ea01bf5f-d652-4ae2-93a8-80d64f522c1a None None] MFA Rules not processed for user `5d072ddf52b9403eb9188d3f95bf9581`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:22.317616 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ea01bf5f-d652-4ae2-93a8-80d64f522c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:22.336461 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1816/3638] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:12:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:12:22.384351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca88e3a-22ee-4690-a061-21f8a33848dd service swift] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:22.392213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d605c5b-74e1-4fad-a3df-3b1beefdcd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:22.395012 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d605c5b-74e1-4fad-a3df-3b1beefdcd19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:22.395480 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d605c5b-74e1-4fad-a3df-3b1beefdcd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:22.395939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d605c5b-74e1-4fad-a3df-3b1beefdcd19 admin admin] PATH_INFO: `/v3/users/6ce9fdec68274dd19c80b9f79045436f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:22.398255 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d605c5b-74e1-4fad-a3df-3b1beefdcd19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ce9fdec68274dd19c80b9f79045436f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:22.400693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d605c5b-74e1-4fad-a3df-3b1beefdcd19 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:22.421265 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:12:22.487710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5d605c5b-74e1-4fad-a3df-3b1beefdcd19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ce9fdec68274dd19c80b9f79045436f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:22.488380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5d605c5b-74e1-4fad-a3df-3b1beefdcd19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ce9fdec68274dd19c80b9f79045436f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:22.498423 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5d605c5b-74e1-4fad-a3df-3b1beefdcd19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ce9fdec68274dd19c80b9f79045436f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:22.511763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5d605c5b-74e1-4fad-a3df-3b1beefdcd19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ce9fdec68274dd19c80b9f79045436f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:22.512465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5d605c5b-74e1-4fad-a3df-3b1beefdcd19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ce9fdec68274dd19c80b9f79045436f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:22.540936 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1823/3639] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:12:22 2022] DELETE /identity/v3/users/6ce9fdec68274dd19c80b9f79045436f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:12:22.545248 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf931e-f783-4a9d-8766-b12e054813de None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:22.545678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf931e-f783-4a9d-8766-b12e054813de None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:22.546025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf931e-f783-4a9d-8766-b12e054813de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:22.569927 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-3ccf931e-f783-4a9d-8766-b12e054813de None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:22.571283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3ccf931e-f783-4a9d-8766-b12e054813de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:22.661624 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1817/3640] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:12:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:12:22.703815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d605c5b-74e1-4fad-a3df-3b1beefdcd19 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:22.705302 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5d605c5b-74e1-4fad-a3df-3b1beefdcd19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:22.731757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7e58f-f49d-4b0f-b0af-218796c669e7 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:22.732383 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7e58f-f49d-4b0f-b0af-218796c669e7 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:22.732727 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7e58f-f49d-4b0f-b0af-218796c669e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:22.754835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d6f7e58f-f49d-4b0f-b0af-218796c669e7 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:22.756110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d6f7e58f-f49d-4b0f-b0af-218796c669e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:22.792108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d605c5b-74e1-4fad-a3df-3b1beefdcd19 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:22.798138 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9648e02-a5ae-4289-b02e-a61eb0e628fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:22.799302 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9648e02-a5ae-4289-b02e-a61eb0e628fb service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:22.799750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9648e02-a5ae-4289-b02e-a61eb0e628fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:22.800190 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9648e02-a5ae-4289-b02e-a61eb0e628fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:22.817012 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9648e02-a5ae-4289-b02e-a61eb0e628fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:22.819232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9648e02-a5ae-4289-b02e-a61eb0e628fb service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:22.831244 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1818/3641] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 01:12:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:12:22.831972 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1824/3642] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:12:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:12:22.853736 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7e58f-f49d-4b0f-b0af-218796c669e7 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:22.855223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d6f7e58f-f49d-4b0f-b0af-218796c669e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:22.921381 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:12:22.927745 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7e58f-f49d-4b0f-b0af-218796c669e7 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:22.933723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad47fc-1503-46e2-a200-de27d2610663 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:22.934197 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad47fc-1503-46e2-a200-de27d2610663 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:22.934479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad47fc-1503-46e2-a200-de27d2610663 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:22.934755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad47fc-1503-46e2-a200-de27d2610663 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:22.943449 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad47fc-1503-46e2-a200-de27d2610663 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:22.945058 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad47fc-1503-46e2-a200-de27d2610663 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:22.954005 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1819/3643] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:12:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:12:23.537914 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a92e44-fe85-42c9-88c0-57a2cfd2683a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:23.538879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a92e44-fe85-42c9-88c0-57a2cfd2683a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:23.539480 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a92e44-fe85-42c9-88c0-57a2cfd2683a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:23.562895 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-35a92e44-fe85-42c9-88c0-57a2cfd2683a None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:23.564991 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-35a92e44-fe85-42c9-88c0-57a2cfd2683a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:23.574066 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1825/3644] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 01:12:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:12:23.591055 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad47fc-1503-46e2-a200-de27d2610663 service swift] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:23.602643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad47fc-1503-46e2-a200-de27d2610663 service swift] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:23.611356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0725c8-a36e-435a-8062-adc9b7b0d7a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:23.612449 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0725c8-a36e-435a-8062-adc9b7b0d7a9 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:23.612954 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0725c8-a36e-435a-8062-adc9b7b0d7a9 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:23.613324 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0725c8-a36e-435a-8062-adc9b7b0d7a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:23.629557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0725c8-a36e-435a-8062-adc9b7b0d7a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:23.631513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0725c8-a36e-435a-8062-adc9b7b0d7a9 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:23.651181 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a92e44-fe85-42c9-88c0-57a2cfd2683a None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:23.654324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-35a92e44-fe85-42c9-88c0-57a2cfd2683a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:23.666251 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1820/3645] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:12:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:12:23.697454 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a92e44-fe85-42c9-88c0-57a2cfd2683a None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:23.708600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e298b103-7cae-432a-a23d-c4c9cbff1997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:23.709895 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298b103-7cae-432a-a23d-c4c9cbff1997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:23.710696 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298b103-7cae-432a-a23d-c4c9cbff1997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:23.711350 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298b103-7cae-432a-a23d-c4c9cbff1997 admin admin] PATH_INFO: `/v3/projects/0d4b141262ae4fa084db017dcaf6553e` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:23.715019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e298b103-7cae-432a-a23d-c4c9cbff1997 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d4b141262ae4fa084db017dcaf6553e)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:23.734832 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e298b103-7cae-432a-a23d-c4c9cbff1997 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:23.836629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e298b103-7cae-432a-a23d-c4c9cbff1997 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d4b141262ae4fa084db017dcaf6553e', 'request_id': 'req-e298b103-7cae-432a-a23d-c4c9cbff1997'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:23.848324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e298b103-7cae-432a-a23d-c4c9cbff1997 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d4b141262ae4fa084db017dcaf6553e', 'request_id': 'req-e298b103-7cae-432a-a23d-c4c9cbff1997'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:23.860441 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e298b103-7cae-432a-a23d-c4c9cbff1997 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d4b141262ae4fa084db017dcaf6553e', 'request_id': 'req-e298b103-7cae-432a-a23d-c4c9cbff1997'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:23.873099 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e298b103-7cae-432a-a23d-c4c9cbff1997 admin admin] The token cache is being invalidate because project 0d4b141262ae4fa084db017dcaf6553e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:12:23.873492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e298b103-7cae-432a-a23d-c4c9cbff1997 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:23.874228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e298b103-7cae-432a-a23d-c4c9cbff1997 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:23.875882 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1826/3646] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:12:23 2022] DELETE /identity/v3/projects/0d4b141262ae4fa084db017dcaf6553e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:12:23.880986 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05244254-d1d3-4d29-8365-daea3a53e9ab None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:23.881267 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05244254-d1d3-4d29-8365-daea3a53e9ab None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:23.881559 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05244254-d1d3-4d29-8365-daea3a53e9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:23.903704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-05244254-d1d3-4d29-8365-daea3a53e9ab None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:23.904919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-05244254-d1d3-4d29-8365-daea3a53e9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:23.989818 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1821/3647] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:12:23.991335 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03951455-8252-422d-b951-710a51cd07c1 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:23.992193 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03951455-8252-422d-b951-710a51cd07c1 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:23.993282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03951455-8252-422d-b951-710a51cd07c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:24.014182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-03951455-8252-422d-b951-710a51cd07c1 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:24.015572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-03951455-8252-422d-b951-710a51cd07c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:24.042900 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1827/3648] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:12:24.047352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05244254-d1d3-4d29-8365-daea3a53e9ab None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:24.059876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05244254-d1d3-4d29-8365-daea3a53e9ab None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:24.066156 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf55934-d054-4e87-9dda-d1699fff1812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:24.067013 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf55934-d054-4e87-9dda-d1699fff1812 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:24.067474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf55934-d054-4e87-9dda-d1699fff1812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:24.067749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf55934-d054-4e87-9dda-d1699fff1812 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:24.068816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf55934-d054-4e87-9dda-d1699fff1812 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:12:24.069137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf55934-d054-4e87-9dda-d1699fff1812 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:24.070859 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf55934-d054-4e87-9dda-d1699fff1812 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:24.089452 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1822/3649] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:12:24.096500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03951455-8252-422d-b951-710a51cd07c1 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:24.103145 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:12:24.118200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03951455-8252-422d-b951-710a51cd07c1 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:24.118200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67cc43a-6f05-4364-8195-40b2c9112692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:24.118200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67cc43a-6f05-4364-8195-40b2c9112692 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:24.118200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67cc43a-6f05-4364-8195-40b2c9112692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:24.118869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67cc43a-6f05-4364-8195-40b2c9112692 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:24.118869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67cc43a-6f05-4364-8195-40b2c9112692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:24.118869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67cc43a-6f05-4364-8195-40b2c9112692 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:24.161090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf55934-d054-4e87-9dda-d1699fff1812 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:24.161928 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1828/3650] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:12:24 2022] POST /identity/v3/projects => generated 387 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:12:24.184943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf55934-d054-4e87-9dda-d1699fff1812 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:24.338063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e05a2-6e56-4775-9fff-1f9453d24a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:24.338999 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e05a2-6e56-4775-9fff-1f9453d24a66 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:24.339249 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e05a2-6e56-4775-9fff-1f9453d24a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:24.339581 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e05a2-6e56-4775-9fff-1f9453d24a66 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:24.340306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e05a2-6e56-4775-9fff-1f9453d24a66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:24.342284 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e05a2-6e56-4775-9fff-1f9453d24a66 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:24.373603 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1823/3651] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:12:24 2022] POST /identity/v3/users => generated 294 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:12:24.375256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67cc43a-6f05-4364-8195-40b2c9112692 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:24.388797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67cc43a-6f05-4364-8195-40b2c9112692 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:24.394306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28e407-490a-4c22-a590-c1ed0425df60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:24.394918 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28e407-490a-4c22-a590-c1ed0425df60 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:24.395186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28e407-490a-4c22-a590-c1ed0425df60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:24.395457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28e407-490a-4c22-a590-c1ed0425df60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:24.396089 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28e407-490a-4c22-a590-c1ed0425df60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:24.397910 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28e407-490a-4c22-a590-c1ed0425df60 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:24.411528 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1829/3652] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:12:24.415504 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e05a2-6e56-4775-9fff-1f9453d24a66 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:24.425849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e05a2-6e56-4775-9fff-1f9453d24a66 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:24.430868 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3594ce-68e7-4461-9124-62322a32d88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:24.431584 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3594ce-68e7-4461-9124-62322a32d88a admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:24.431967 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3594ce-68e7-4461-9124-62322a32d88a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:24.432342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3594ce-68e7-4461-9124-62322a32d88a admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:24.433112 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3594ce-68e7-4461-9124-62322a32d88a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:24.434845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3594ce-68e7-4461-9124-62322a32d88a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:24.450578 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1824/3653] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:12:24.451722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28e407-490a-4c22-a590-c1ed0425df60 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:24.464225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28e407-490a-4c22-a590-c1ed0425df60 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:24.474829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025e0e7-ee14-4289-934e-9f396dbb5ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:24.475495 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025e0e7-ee14-4289-934e-9f396dbb5ba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:24.475784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025e0e7-ee14-4289-934e-9f396dbb5ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:24.476049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025e0e7-ee14-4289-934e-9f396dbb5ba4 admin admin] PATH_INFO: `/v3/projects/6aa6df124d7c486b86572fc272f125a9/users/62a2f5ccd5f34a8d8fc387e79029da2f/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:24.499719 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025e0e7-ee14-4289-934e-9f396dbb5ba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aa6df124d7c486b86572fc272f125a9, user_id=62a2f5ccd5f34a8d8fc387e79029da2f, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:24.502933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025e0e7-ee14-4289-934e-9f396dbb5ba4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:24.525123 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1830/3654] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:12:24 2022] PUT /identity/v3/projects/6aa6df124d7c486b86572fc272f125a9/users/62a2f5ccd5f34a8d8fc387e79029da2f/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:12:24.526865 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b045ae-1aa3-435e-b3c3-34c83a26bb77 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:24.527148 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b045ae-1aa3-435e-b3c3-34c83a26bb77 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:24.527420 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b045ae-1aa3-435e-b3c3-34c83a26bb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:24.554141 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-11b045ae-1aa3-435e-b3c3-34c83a26bb77 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:24.556439 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-11b045ae-1aa3-435e-b3c3-34c83a26bb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:24.601763 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:12:24.629494 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1825/3655] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:12:24.639784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025e0e7-ee14-4289-934e-9f396dbb5ba4 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:24.641695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4025e0e7-ee14-4289-934e-9f396dbb5ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:24.714835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025e0e7-ee14-4289-934e-9f396dbb5ba4 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:24.718533 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dac42a-ac25-4aba-8701-e4e0b2c4e593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:24.722087 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dac42a-ac25-4aba-8701-e4e0b2c4e593 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:24.722482 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dac42a-ac25-4aba-8701-e4e0b2c4e593 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:24.722828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dac42a-ac25-4aba-8701-e4e0b2c4e593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:24.734960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dac42a-ac25-4aba-8701-e4e0b2c4e593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:24.736414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dac42a-ac25-4aba-8701-e4e0b2c4e593 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:24.753245 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1831/3656] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:12:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:12:28.457685 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94924f53-3d9b-4234-9caf-c121c2a8d479 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:28.458205 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94924f53-3d9b-4234-9caf-c121c2a8d479 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:28.458205 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94924f53-3d9b-4234-9caf-c121c2a8d479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:28.538596 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-94924f53-3d9b-4234-9caf-c121c2a8d479 None None] MFA Rules not processed for user `5d072ddf52b9403eb9188d3f95bf9581`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:28.540145 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-94924f53-3d9b-4234-9caf-c121c2a8d479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:28.646962 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1826/3657] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:12:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:12:29.329983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4722c-e3c8-455b-84b5-86b1069afdb5 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:29.331012 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4722c-e3c8-455b-84b5-86b1069afdb5 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:29.331438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4722c-e3c8-455b-84b5-86b1069afdb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:29.355629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-00e4722c-e3c8-455b-84b5-86b1069afdb5 None None] MFA Rules not processed for user `5d072ddf52b9403eb9188d3f95bf9581`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:29.357426 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-00e4722c-e3c8-455b-84b5-86b1069afdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:29.371378 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1832/3658] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:12:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:12:31.252681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951e672-eef5-46db-9c8e-7378dec16370 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:31.253134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951e672-eef5-46db-9c8e-7378dec16370 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:31.253233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951e672-eef5-46db-9c8e-7378dec16370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:31.304354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-2951e672-eef5-46db-9c8e-7378dec16370 None None] MFA Rules not processed for user `62a2f5ccd5f34a8d8fc387e79029da2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:31.306377 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2951e672-eef5-46db-9c8e-7378dec16370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:31.439218 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1827/3659] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:12:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:12:31.896205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4722c-e3c8-455b-84b5-86b1069afdb5 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:31.898388 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-00e4722c-e3c8-455b-84b5-86b1069afdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:31.974362 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70847c6-49a1-46b2-a557-e17e80ba27cf None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:31.974653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70847c6-49a1-46b2-a557-e17e80ba27cf None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:31.974940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70847c6-49a1-46b2-a557-e17e80ba27cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:32.002291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d70847c6-49a1-46b2-a557-e17e80ba27cf None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:32.004317 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d70847c6-49a1-46b2-a557-e17e80ba27cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:32.026142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4722c-e3c8-455b-84b5-86b1069afdb5 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:32.033534 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81be5e-c2fc-4f12-8dbc-90bb74f1b237 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:32.034157 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81be5e-c2fc-4f12-8dbc-90bb74f1b237 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:32.034435 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81be5e-c2fc-4f12-8dbc-90bb74f1b237 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:32.034708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81be5e-c2fc-4f12-8dbc-90bb74f1b237 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:32.045153 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81be5e-c2fc-4f12-8dbc-90bb74f1b237 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:32.046790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81be5e-c2fc-4f12-8dbc-90bb74f1b237 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:32.056346 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1833/3660] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:12:31 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:12:32.085665 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1828/3661] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:12:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:12:32.106159 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81be5e-c2fc-4f12-8dbc-90bb74f1b237 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:32.107966 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0a81be5e-c2fc-4f12-8dbc-90bb74f1b237 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:32.146233 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:12:32.210746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81be5e-c2fc-4f12-8dbc-90bb74f1b237 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:32.217863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98b4fa-1635-4122-9f6e-866f30a0beae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:32.218493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98b4fa-1635-4122-9f6e-866f30a0beae service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:32.218793 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98b4fa-1635-4122-9f6e-866f30a0beae service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:32.219096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98b4fa-1635-4122-9f6e-866f30a0beae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:32.235371 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98b4fa-1635-4122-9f6e-866f30a0beae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:32.236445 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98b4fa-1635-4122-9f6e-866f30a0beae service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:32.250974 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1834/3662] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:12:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:12:33.075514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d3f2d-e4a0-49dc-8665-a81c14711f31 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:33.076110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d3f2d-e4a0-49dc-8665-a81c14711f31 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:33.076196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d3f2d-e4a0-49dc-8665-a81c14711f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:33.121383 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-521d3f2d-e4a0-49dc-8665-a81c14711f31 None None] MFA Rules not processed for user `d531146522f24a368a8c6ab482495776`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:33.125649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-521d3f2d-e4a0-49dc-8665-a81c14711f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:33.192129 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:12:33.254775 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1829/3663] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:12:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:12:37.757413 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82805721-5b0f-454a-b591-48057e0aa2a8 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:37.758372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82805721-5b0f-454a-b591-48057e0aa2a8 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:37.758644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82805721-5b0f-454a-b591-48057e0aa2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:37.789213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-82805721-5b0f-454a-b591-48057e0aa2a8 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:37.791059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-82805721-5b0f-454a-b591-48057e0aa2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:37.799874 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1835/3664] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 01:12:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:12:37.817362 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d3f2d-e4a0-49dc-8665-a81c14711f31 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:37.831819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d3f2d-e4a0-49dc-8665-a81c14711f31 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:37.838763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9c18a-5ca7-4445-a0d6-d78e142855ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:37.839673 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9c18a-5ca7-4445-a0d6-d78e142855ee service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:37.840171 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9c18a-5ca7-4445-a0d6-d78e142855ee service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:37.840684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9c18a-5ca7-4445-a0d6-d78e142855ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:37.853396 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf9c18a-5ca7-4445-a0d6-d78e142855ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:37.855780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf9c18a-5ca7-4445-a0d6-d78e142855ee service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:37.870988 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1830/3665] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:12:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:12:38.550175 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc53420-4a87-4c6f-85bf-8d8e1fcb6694 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:38.550466 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc53420-4a87-4c6f-85bf-8d8e1fcb6694 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:38.550730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc53420-4a87-4c6f-85bf-8d8e1fcb6694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:38.576778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-1cc53420-4a87-4c6f-85bf-8d8e1fcb6694 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:38.578585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1cc53420-4a87-4c6f-85bf-8d8e1fcb6694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:38.586575 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1836/3666] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 01:12:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:12:38.611672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9c18a-5ca7-4445-a0d6-d78e142855ee service swift] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:38.625050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9c18a-5ca7-4445-a0d6-d78e142855ee service swift] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:38.633857 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906bd15-0467-42a3-9fd2-d981cace03eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:38.634798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906bd15-0467-42a3-9fd2-d981cace03eb service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:38.635078 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906bd15-0467-42a3-9fd2-d981cace03eb service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:38.635398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906bd15-0467-42a3-9fd2-d981cace03eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:38.645488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906bd15-0467-42a3-9fd2-d981cace03eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:38.647491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906bd15-0467-42a3-9fd2-d981cace03eb service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:38.661515 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1831/3667] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:12:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 04 01:12:39.403853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0c9a6-7f11-4058-8d12-a648fa829eb9 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:39.404399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0c9a6-7f11-4058-8d12-a648fa829eb9 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:39.404399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0c9a6-7f11-4058-8d12-a648fa829eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:39.466951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-b6b0c9a6-7f11-4058-8d12-a648fa829eb9 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:39.468411 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b6b0c9a6-7f11-4058-8d12-a648fa829eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:39.503686 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1837/3668] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 01:12:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:12:39.516045 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906bd15-0467-42a3-9fd2-d981cace03eb service swift] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:39.562971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906bd15-0467-42a3-9fd2-d981cace03eb service swift] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:39.580418 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614a2d2-33c3-4f4d-ac29-f3ccda148cbc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:39.581311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614a2d2-33c3-4f4d-ac29-f3ccda148cbc service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:39.582736 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614a2d2-33c3-4f4d-ac29-f3ccda148cbc service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:39.583224 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614a2d2-33c3-4f4d-ac29-f3ccda148cbc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:39.616998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e614a2d2-33c3-4f4d-ac29-f3ccda148cbc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:39.619943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e614a2d2-33c3-4f4d-ac29-f3ccda148cbc service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:39.645275 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1832/3669] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:12:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:12:39.872233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0c9a6-7f11-4058-8d12-a648fa829eb9 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:39.873855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b6b0c9a6-7f11-4058-8d12-a648fa829eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:39.914952 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0c9a6-7f11-4058-8d12-a648fa829eb9 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:39.920090 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeca880-1745-43c6-8bcb-b4136d49152e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:39.920739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeca880-1745-43c6-8bcb-b4136d49152e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:39.921015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeca880-1745-43c6-8bcb-b4136d49152e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:39.921285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeca880-1745-43c6-8bcb-b4136d49152e admin admin] PATH_INFO: `/v3/users/141ca76f7a9d43cd9838ccd2b3d25295` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:39.930817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeca880-1745-43c6-8bcb-b4136d49152e admin admin] RBAC: Authorizing `identity:delete_user(user_id=141ca76f7a9d43cd9838ccd2b3d25295)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:39.932771 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeca880-1745-43c6-8bcb-b4136d49152e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:40.045976 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-edeca880-1745-43c6-8bcb-b4136d49152e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '141ca76f7a9d43cd9838ccd2b3d25295'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:40.067286 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-edeca880-1745-43c6-8bcb-b4136d49152e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '141ca76f7a9d43cd9838ccd2b3d25295'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:40.102398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-edeca880-1745-43c6-8bcb-b4136d49152e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '141ca76f7a9d43cd9838ccd2b3d25295'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:40.121745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-edeca880-1745-43c6-8bcb-b4136d49152e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '141ca76f7a9d43cd9838ccd2b3d25295'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:40.122983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-edeca880-1745-43c6-8bcb-b4136d49152e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '141ca76f7a9d43cd9838ccd2b3d25295'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:40.174322 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1838/3670] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:12:39 2022] DELETE /identity/v3/users/141ca76f7a9d43cd9838ccd2b3d25295 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:12:40.179484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf94b8-65a1-49d1-adf7-cc1b3a724371 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:40.180522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf94b8-65a1-49d1-adf7-cc1b3a724371 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:40.180795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf94b8-65a1-49d1-adf7-cc1b3a724371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:40.212782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-8fbf94b8-65a1-49d1-adf7-cc1b3a724371 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:40.214047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8fbf94b8-65a1-49d1-adf7-cc1b3a724371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:40.304245 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1833/3671] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:12:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:12:40.322476 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeca880-1745-43c6-8bcb-b4136d49152e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:40.323963 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-edeca880-1745-43c6-8bcb-b4136d49152e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:40.430226 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeca880-1745-43c6-8bcb-b4136d49152e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:40.435004 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a8aa1-e715-4b31-a97b-14710f4574ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:40.441133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a8aa1-e715-4b31-a97b-14710f4574ce service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:40.441133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a8aa1-e715-4b31-a97b-14710f4574ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:40.441133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a8aa1-e715-4b31-a97b-14710f4574ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:40.450098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a8aa1-e715-4b31-a97b-14710f4574ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:40.451377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a8aa1-e715-4b31-a97b-14710f4574ce service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:40.468609 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1839/3672] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:12:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:12:41.298502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf94b8-65a1-49d1-adf7-cc1b3a724371 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:41.302019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8fbf94b8-65a1-49d1-adf7-cc1b3a724371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:41.328640 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf94b8-65a1-49d1-adf7-cc1b3a724371 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:41.339402 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a87520-b884-46b6-94d6-7c39aff0a954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:41.340469 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a87520-b884-46b6-94d6-7c39aff0a954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:41.340923 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a87520-b884-46b6-94d6-7c39aff0a954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:41.342227 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a87520-b884-46b6-94d6-7c39aff0a954 admin admin] PATH_INFO: `/v3/projects/5dcd937d2f56409193a5cf3349e5f677` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:41.343620 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a87520-b884-46b6-94d6-7c39aff0a954 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dcd937d2f56409193a5cf3349e5f677)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:41.346566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a87520-b884-46b6-94d6-7c39aff0a954 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:41.467041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-88a87520-b884-46b6-94d6-7c39aff0a954 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dcd937d2f56409193a5cf3349e5f677', 'request_id': 'req-88a87520-b884-46b6-94d6-7c39aff0a954'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:41.485770 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-88a87520-b884-46b6-94d6-7c39aff0a954 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dcd937d2f56409193a5cf3349e5f677', 'request_id': 'req-88a87520-b884-46b6-94d6-7c39aff0a954'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:41.502165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-88a87520-b884-46b6-94d6-7c39aff0a954 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dcd937d2f56409193a5cf3349e5f677', 'request_id': 'req-88a87520-b884-46b6-94d6-7c39aff0a954'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:41.537575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-88a87520-b884-46b6-94d6-7c39aff0a954 admin admin] The token cache is being invalidate because project 5dcd937d2f56409193a5cf3349e5f677 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:12:41.538057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-88a87520-b884-46b6-94d6-7c39aff0a954 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:41.538923 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-88a87520-b884-46b6-94d6-7c39aff0a954 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:41.541890 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1834/3673] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:12:41 2022] DELETE /identity/v3/projects/5dcd937d2f56409193a5cf3349e5f677 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:12:41.553160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5dbe6-5f7b-4ebe-905b-5b52824ffd34 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:41.553722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5dbe6-5f7b-4ebe-905b-5b52824ffd34 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:41.553831 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5dbe6-5f7b-4ebe-905b-5b52824ffd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:41.584567 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-dfd5dbe6-5f7b-4ebe-905b-5b52824ffd34 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:41.585832 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-dfd5dbe6-5f7b-4ebe-905b-5b52824ffd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:41.597309 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:12:41.677966 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444ffd0-54e4-4c91-969e-61778ad3c8e9 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:41.678256 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444ffd0-54e4-4c91-969e-61778ad3c8e9 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:41.678533 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444ffd0-54e4-4c91-969e-61778ad3c8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:41.686812 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1840/3674] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:12:41.701185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-9444ffd0-54e4-4c91-969e-61778ad3c8e9 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:41.703518 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9444ffd0-54e4-4c91-969e-61778ad3c8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:41.719768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5dbe6-5f7b-4ebe-905b-5b52824ffd34 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:41.729784 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1835/3675] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:12:41.731946 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5dbe6-5f7b-4ebe-905b-5b52824ffd34 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:41.737565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dabf230-260d-4ab3-9d96-a48acb511bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:41.738561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabf230-260d-4ab3-9d96-a48acb511bda admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:41.739012 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabf230-260d-4ab3-9d96-a48acb511bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:41.739467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabf230-260d-4ab3-9d96-a48acb511bda admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:41.740280 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dabf230-260d-4ab3-9d96-a48acb511bda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:12:41.740741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dabf230-260d-4ab3-9d96-a48acb511bda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:41.742584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dabf230-260d-4ab3-9d96-a48acb511bda admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:41.763688 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444ffd0-54e4-4c91-969e-61778ad3c8e9 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:41.770176 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:12:41.770837 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1841/3676] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:12:41.775852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444ffd0-54e4-4c91-969e-61778ad3c8e9 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:41.781682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf2748-6dda-4998-990c-1deb3716a218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:41.782727 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf2748-6dda-4998-990c-1deb3716a218 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:41.783199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf2748-6dda-4998-990c-1deb3716a218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:41.783644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf2748-6dda-4998-990c-1deb3716a218 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:41.784449 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf2748-6dda-4998-990c-1deb3716a218 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:41.786858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf2748-6dda-4998-990c-1deb3716a218 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:41.839395 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dabf230-260d-4ab3-9d96-a48acb511bda admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:41.841251 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1836/3677] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:12:41 2022] POST /identity/v3/projects => generated 381 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:12:41.854817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dabf230-260d-4ab3-9d96-a48acb511bda admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:41.977846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e288ee5-4789-4421-8395-c7f072443feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:41.979555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e288ee5-4789-4421-8395-c7f072443feb admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:41.979991 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e288ee5-4789-4421-8395-c7f072443feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:41.980530 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e288ee5-4789-4421-8395-c7f072443feb admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:41.981422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e288ee5-4789-4421-8395-c7f072443feb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:41.984760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e288ee5-4789-4421-8395-c7f072443feb admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:42.026141 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1842/3678] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:12:41 2022] POST /identity/v3/users => generated 291 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:12:42.029935 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf2748-6dda-4998-990c-1deb3716a218 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:42.042705 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf2748-6dda-4998-990c-1deb3716a218 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:42.048444 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06032289-965b-4852-bac6-16600bc2a4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:42.049278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06032289-965b-4852-bac6-16600bc2a4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:42.049822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06032289-965b-4852-bac6-16600bc2a4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:42.050166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06032289-965b-4852-bac6-16600bc2a4b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:42.051016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06032289-965b-4852-bac6-16600bc2a4b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:42.052700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06032289-965b-4852-bac6-16600bc2a4b0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:42.065931 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1837/3679] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:12:42.069088 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e288ee5-4789-4421-8395-c7f072443feb admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:42.085915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e288ee5-4789-4421-8395-c7f072443feb admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:42.105611 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec3964-f2b0-4082-8c30-933a461143d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:42.106242 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec3964-f2b0-4082-8c30-933a461143d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:42.106517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec3964-f2b0-4082-8c30-933a461143d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:42.106792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec3964-f2b0-4082-8c30-933a461143d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:42.107454 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec3964-f2b0-4082-8c30-933a461143d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:42.109069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec3964-f2b0-4082-8c30-933a461143d7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:42.129127 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1843/3680] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:12:42.133015 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06032289-965b-4852-bac6-16600bc2a4b0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:42.145354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06032289-965b-4852-bac6-16600bc2a4b0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:42.150670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21692421-7e19-4e59-91be-744e9365ec47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:42.151433 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21692421-7e19-4e59-91be-744e9365ec47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:42.151782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21692421-7e19-4e59-91be-744e9365ec47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:42.152122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21692421-7e19-4e59-91be-744e9365ec47 admin admin] PATH_INFO: `/v3/projects/5be0569ef8424ff38d656d246f9517c7/users/7a07c40b753b41dbac2e90679a42dc70/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:42.191754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21692421-7e19-4e59-91be-744e9365ec47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5be0569ef8424ff38d656d246f9517c7, user_id=7a07c40b753b41dbac2e90679a42dc70, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:42.198340 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21692421-7e19-4e59-91be-744e9365ec47 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:42.242217 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1838/3681] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:12:42 2022] PUT /identity/v3/projects/5be0569ef8424ff38d656d246f9517c7/users/7a07c40b753b41dbac2e90679a42dc70/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:12:42.250000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bd775-b1ed-4c6b-85be-8764d43333a0 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:42.250289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bd775-b1ed-4c6b-85be-8764d43333a0 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:42.250566 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bd775-b1ed-4c6b-85be-8764d43333a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:42.292997 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-840bd775-b1ed-4c6b-85be-8764d43333a0 None None] MFA Rules not processed for user `7a07c40b753b41dbac2e90679a42dc70`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:42.295280 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-840bd775-b1ed-4c6b-85be-8764d43333a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:42.453353 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1844/3682] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:12:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:12:42.721123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21692421-7e19-4e59-91be-744e9365ec47 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:42.723885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-21692421-7e19-4e59-91be-744e9365ec47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:42.842564 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21692421-7e19-4e59-91be-744e9365ec47 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:42.847996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491e13f-a5a5-4f1d-9466-2cd60ccfc6c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:42.848613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491e13f-a5a5-4f1d-9466-2cd60ccfc6c0 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:42.848894 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491e13f-a5a5-4f1d-9466-2cd60ccfc6c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:42.849170 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491e13f-a5a5-4f1d-9466-2cd60ccfc6c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:42.860163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491e13f-a5a5-4f1d-9466-2cd60ccfc6c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:42.862163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491e13f-a5a5-4f1d-9466-2cd60ccfc6c0 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:42.871811 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1839/3683] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:12:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:12:42.970468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840bd775-b1ed-4c6b-85be-8764d43333a0 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:42.997623 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:12:43.108315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840bd775-b1ed-4c6b-85be-8764d43333a0 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:43.117739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61a708-224e-461a-bf0b-36b7f044b6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:43.120658 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61a708-224e-461a-bf0b-36b7f044b6d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:43.121006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61a708-224e-461a-bf0b-36b7f044b6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:43.121296 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61a708-224e-461a-bf0b-36b7f044b6d2 admin admin] PATH_INFO: `/v3/users/7a07c40b753b41dbac2e90679a42dc70` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:43.123187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61a708-224e-461a-bf0b-36b7f044b6d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a07c40b753b41dbac2e90679a42dc70)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:43.127401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61a708-224e-461a-bf0b-36b7f044b6d2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:43.199948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3f61a708-224e-461a-bf0b-36b7f044b6d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a07c40b753b41dbac2e90679a42dc70'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:43.200692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3f61a708-224e-461a-bf0b-36b7f044b6d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a07c40b753b41dbac2e90679a42dc70'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:43.209734 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3f61a708-224e-461a-bf0b-36b7f044b6d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a07c40b753b41dbac2e90679a42dc70'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:43.222355 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3f61a708-224e-461a-bf0b-36b7f044b6d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a07c40b753b41dbac2e90679a42dc70'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:43.223560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3f61a708-224e-461a-bf0b-36b7f044b6d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a07c40b753b41dbac2e90679a42dc70'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:43.253051 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1845/3684] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:12:42 2022] DELETE /identity/v3/users/7a07c40b753b41dbac2e90679a42dc70 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:12:43.254712 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7683a8-6985-479e-8219-9bb15fc17257 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:43.254999 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7683a8-6985-479e-8219-9bb15fc17257 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:43.255270 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7683a8-6985-479e-8219-9bb15fc17257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:43.293417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-cb7683a8-6985-479e-8219-9bb15fc17257 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:43.294670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-cb7683a8-6985-479e-8219-9bb15fc17257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:43.364732 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1840/3685] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:12:43.428526 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61a708-224e-461a-bf0b-36b7f044b6d2 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:43.429828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3f61a708-224e-461a-bf0b-36b7f044b6d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:43.579218 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61a708-224e-461a-bf0b-36b7f044b6d2 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:43.587230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec0f83-a224-43f6-8600-1b2c11cf43e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:43.588135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec0f83-a224-43f6-8600-1b2c11cf43e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:43.588575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec0f83-a224-43f6-8600-1b2c11cf43e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:43.589026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec0f83-a224-43f6-8600-1b2c11cf43e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:43.600373 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec0f83-a224-43f6-8600-1b2c11cf43e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:43.602500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec0f83-a224-43f6-8600-1b2c11cf43e6 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:43.630689 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1846/3686] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:12:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:12:44.126895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1154565-d3c8-4f1e-bb91-1a1c6b8cca41 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:44.127774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1154565-d3c8-4f1e-bb91-1a1c6b8cca41 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:44.128111 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1154565-d3c8-4f1e-bb91-1a1c6b8cca41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:44.163507 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b1154565-d3c8-4f1e-bb91-1a1c6b8cca41 None None] MFA Rules not processed for user `13d1460667de427b9dded0375954a6ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:44.170932 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b1154565-d3c8-4f1e-bb91-1a1c6b8cca41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:44.244072 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:12:44.385920 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1841/3687] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:12:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:12:44.433793 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec0f83-a224-43f6-8600-1b2c11cf43e6 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:44.435213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b8ec0f83-a224-43f6-8600-1b2c11cf43e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:44.463499 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec0f83-a224-43f6-8600-1b2c11cf43e6 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:44.471010 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a3547-8573-416e-b577-7c946c59aad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:44.471761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a3547-8573-416e-b577-7c946c59aad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:44.472267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a3547-8573-416e-b577-7c946c59aad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:44.472724 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a3547-8573-416e-b577-7c946c59aad8 admin admin] PATH_INFO: `/v3/projects/5be0569ef8424ff38d656d246f9517c7` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:44.474044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a3547-8573-416e-b577-7c946c59aad8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5be0569ef8424ff38d656d246f9517c7)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:44.476329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a3547-8573-416e-b577-7c946c59aad8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:44.567650 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:12:44.599028 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0c6a3547-8573-416e-b577-7c946c59aad8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5be0569ef8424ff38d656d246f9517c7', 'request_id': 'req-0c6a3547-8573-416e-b577-7c946c59aad8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:44.621819 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0c6a3547-8573-416e-b577-7c946c59aad8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5be0569ef8424ff38d656d246f9517c7', 'request_id': 'req-0c6a3547-8573-416e-b577-7c946c59aad8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:44.629244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0c6a3547-8573-416e-b577-7c946c59aad8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5be0569ef8424ff38d656d246f9517c7', 'request_id': 'req-0c6a3547-8573-416e-b577-7c946c59aad8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:44.649293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0c6a3547-8573-416e-b577-7c946c59aad8 admin admin] The token cache is being invalidate because project 5be0569ef8424ff38d656d246f9517c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:12:44.649812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0c6a3547-8573-416e-b577-7c946c59aad8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:44.655883 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0c6a3547-8573-416e-b577-7c946c59aad8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:44.661240 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1847/3688] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:12:44 2022] DELETE /identity/v3/projects/5be0569ef8424ff38d656d246f9517c7 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:12:44.663002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f3f66-840e-46f6-b413-0e2dbc4e1815 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:44.665517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f3f66-840e-46f6-b413-0e2dbc4e1815 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:44.666141 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f3f66-840e-46f6-b413-0e2dbc4e1815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:44.702703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-f62f3f66-840e-46f6-b413-0e2dbc4e1815 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:44.704985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f62f3f66-840e-46f6-b413-0e2dbc4e1815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:44.847113 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1842/3689] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:12:44.861240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bca81c-9b4b-4c49-96ba-2721d0469f04 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:44.862895 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bca81c-9b4b-4c49-96ba-2721d0469f04 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:44.863745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bca81c-9b4b-4c49-96ba-2721d0469f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:44.918895 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-33bca81c-9b4b-4c49-96ba-2721d0469f04 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:44.920193 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-33bca81c-9b4b-4c49-96ba-2721d0469f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:44.940169 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1848/3690] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:12:44.941334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f3f66-840e-46f6-b413-0e2dbc4e1815 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:44.955028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f3f66-840e-46f6-b413-0e2dbc4e1815 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:44.959977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0735b-7e9b-4635-87fb-123d62e4c72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:44.960594 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0735b-7e9b-4635-87fb-123d62e4c72c admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:44.960876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0735b-7e9b-4635-87fb-123d62e4c72c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:44.961729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0735b-7e9b-4635-87fb-123d62e4c72c admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:44.962431 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0735b-7e9b-4635-87fb-123d62e4c72c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:12:44.962737 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0735b-7e9b-4635-87fb-123d62e4c72c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:44.964484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0735b-7e9b-4635-87fb-123d62e4c72c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:44.982113 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1843/3691] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:12:44.983266 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bca81c-9b4b-4c49-96ba-2721d0469f04 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:44.998075 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bca81c-9b4b-4c49-96ba-2721d0469f04 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:45.011277 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3b65b-12b1-4167-95b0-a910e9c3ee99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:45.011815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3b65b-12b1-4167-95b0-a910e9c3ee99 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:45.012096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3b65b-12b1-4167-95b0-a910e9c3ee99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:45.012366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3b65b-12b1-4167-95b0-a910e9c3ee99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:45.013004 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3b65b-12b1-4167-95b0-a910e9c3ee99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:45.015030 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3b65b-12b1-4167-95b0-a910e9c3ee99 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:45.069874 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1849/3692] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:12:44 2022] POST /identity/v3/projects => generated 387 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:12:45.070100 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0735b-7e9b-4635-87fb-123d62e4c72c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:45.092007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0735b-7e9b-4635-87fb-123d62e4c72c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:45.254354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c509d-35f2-41f6-bd1b-36b3193d8799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:45.255078 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c509d-35f2-41f6-bd1b-36b3193d8799 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:45.257010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c509d-35f2-41f6-bd1b-36b3193d8799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:45.257497 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c509d-35f2-41f6-bd1b-36b3193d8799 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:45.260002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c509d-35f2-41f6-bd1b-36b3193d8799 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:45.262595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c509d-35f2-41f6-bd1b-36b3193d8799 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:45.308655 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1844/3693] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:12:45 2022] POST /identity/v3/users => generated 294 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:12:45.312893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3b65b-12b1-4167-95b0-a910e9c3ee99 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:45.330862 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3b65b-12b1-4167-95b0-a910e9c3ee99 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:45.358216 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248dc32-b3e7-4632-95ac-460bab668c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:45.358848 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248dc32-b3e7-4632-95ac-460bab668c6a admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:45.359249 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248dc32-b3e7-4632-95ac-460bab668c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:45.359634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248dc32-b3e7-4632-95ac-460bab668c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:45.360289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8248dc32-b3e7-4632-95ac-460bab668c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:45.361934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8248dc32-b3e7-4632-95ac-460bab668c6a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:45.385195 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c509d-35f2-41f6-bd1b-36b3193d8799 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:45.385464 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1850/3694] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:12:45.404339 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c509d-35f2-41f6-bd1b-36b3193d8799 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:45.413239 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcdfc9-70a8-4363-941a-d19855b94198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:45.415171 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcdfc9-70a8-4363-941a-d19855b94198 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:45.416108 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcdfc9-70a8-4363-941a-d19855b94198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:45.416108 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcdfc9-70a8-4363-941a-d19855b94198 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:45.417173 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fcdfc9-70a8-4363-941a-d19855b94198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:45.419645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fcdfc9-70a8-4363-941a-d19855b94198 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:45.440910 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1845/3695] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:12:45.442490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248dc32-b3e7-4632-95ac-460bab668c6a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:45.459322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248dc32-b3e7-4632-95ac-460bab668c6a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:45.483971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3fa88-6b87-4019-8b5c-34fd500f96ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:45.491290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3fa88-6b87-4019-8b5c-34fd500f96ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:45.515045 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3fa88-6b87-4019-8b5c-34fd500f96ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:45.515045 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3fa88-6b87-4019-8b5c-34fd500f96ef admin admin] PATH_INFO: `/v3/projects/5040033c21324d80976b3d9f520a3d3b/users/da8b6af4e9814647aa1334ca4f66c87c/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:45.567190 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f3fa88-6b87-4019-8b5c-34fd500f96ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=5040033c21324d80976b3d9f520a3d3b, user_id=da8b6af4e9814647aa1334ca4f66c87c, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:45.572131 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f3fa88-6b87-4019-8b5c-34fd500f96ef admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:45.596127 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1851/3696] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:12:45 2022] PUT /identity/v3/projects/5040033c21324d80976b3d9f520a3d3b/users/da8b6af4e9814647aa1334ca4f66c87c/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:12:45.602162 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8a67e-f95d-4de8-be03-1dd9e089bd45 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:45.602640 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8a67e-f95d-4de8-be03-1dd9e089bd45 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:45.603029 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8a67e-f95d-4de8-be03-1dd9e089bd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:45.631231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-f6d8a67e-f95d-4de8-be03-1dd9e089bd45 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:45.632839 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f6d8a67e-f95d-4de8-be03-1dd9e089bd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:45.710453 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:12:45.739570 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1846/3697] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:12:45.765697 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3fa88-6b87-4019-8b5c-34fd500f96ef admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:45.768482 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-40f3fa88-6b87-4019-8b5c-34fd500f96ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:45.938842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3fa88-6b87-4019-8b5c-34fd500f96ef admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:45.950545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415f5e0-9a75-44de-a95f-792335baf318 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:45.951186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415f5e0-9a75-44de-a95f-792335baf318 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:45.951468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415f5e0-9a75-44de-a95f-792335baf318 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:45.951745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415f5e0-9a75-44de-a95f-792335baf318 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:45.989597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b415f5e0-9a75-44de-a95f-792335baf318 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:45.991590 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b415f5e0-9a75-44de-a95f-792335baf318 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:46.031756 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1852/3698] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:12:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:12:52.467948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557d3d0-1400-4443-a1c8-e04d7df79e07 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:52.468533 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557d3d0-1400-4443-a1c8-e04d7df79e07 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:52.468533 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557d3d0-1400-4443-a1c8-e04d7df79e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:52.494058 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-2557d3d0-1400-4443-a1c8-e04d7df79e07 None None] MFA Rules not processed for user `5d072ddf52b9403eb9188d3f95bf9581`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:52.495758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2557d3d0-1400-4443-a1c8-e04d7df79e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:52.755380 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1847/3699] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:12:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:12:55.378457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728bce0-151a-4533-a7a4-1fe8eeb95a1e None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:55.379461 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728bce0-151a-4533-a7a4-1fe8eeb95a1e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:55.379895 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728bce0-151a-4533-a7a4-1fe8eeb95a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:55.462253 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-f728bce0-151a-4533-a7a4-1fe8eeb95a1e None None] MFA Rules not processed for user `da8b6af4e9814647aa1334ca4f66c87c`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:55.463595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f728bce0-151a-4533-a7a4-1fe8eeb95a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:55.582259 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:12:55.632998 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1853/3700] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:12:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:12:55.636953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557d3d0-1400-4443-a1c8-e04d7df79e07 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:55.654663 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557d3d0-1400-4443-a1c8-e04d7df79e07 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:55.672338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbb22c-c08a-45ad-a1b2-0cf0e2f86006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:55.672985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbb22c-c08a-45ad-a1b2-0cf0e2f86006 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:55.673262 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbb22c-c08a-45ad-a1b2-0cf0e2f86006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:55.673623 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbb22c-c08a-45ad-a1b2-0cf0e2f86006 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:55.674206 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dbb22c-c08a-45ad-a1b2-0cf0e2f86006 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:55.676309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dbb22c-c08a-45ad-a1b2-0cf0e2f86006 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:55.726154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728bce0-151a-4533-a7a4-1fe8eeb95a1e None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:55.727993 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1848/3701] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:12:55 2022] POST /identity/v3/projects => generated 387 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:12:55.766192 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728bce0-151a-4533-a7a4-1fe8eeb95a1e None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:55.936663 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d924342-3046-46f2-807e-bba1f612892b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:55.937298 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d924342-3046-46f2-807e-bba1f612892b admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:55.937603 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d924342-3046-46f2-807e-bba1f612892b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:55.937874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d924342-3046-46f2-807e-bba1f612892b admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:55.938513 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d924342-3046-46f2-807e-bba1f612892b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:55.940891 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d924342-3046-46f2-807e-bba1f612892b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:56.002618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbb22c-c08a-45ad-a1b2-0cf0e2f86006 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:56.008354 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1854/3702] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:12:55 2022] POST /identity/v3/users => generated 300 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:12:56.015885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbb22c-c08a-45ad-a1b2-0cf0e2f86006 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:56.045464 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9c28e-3afe-4380-9fd9-0ae098e08fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:56.045464 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9c28e-3afe-4380-9fd9-0ae098e08fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:56.045464 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9c28e-3afe-4380-9fd9-0ae098e08fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:56.045464 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9c28e-3afe-4380-9fd9-0ae098e08fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:56.046220 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9c28e-3afe-4380-9fd9-0ae098e08fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:56.046220 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9c28e-3afe-4380-9fd9-0ae098e08fc1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:56.064926 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1849/3703] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:12:56.070055 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d924342-3046-46f2-807e-bba1f612892b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:56.084010 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d924342-3046-46f2-807e-bba1f612892b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:56.089066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb076535-f898-45c8-9503-b6a7faccad8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:56.090572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb076535-f898-45c8-9503-b6a7faccad8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:56.090925 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb076535-f898-45c8-9503-b6a7faccad8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:56.091264 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb076535-f898-45c8-9503-b6a7faccad8b admin admin] PATH_INFO: `/v3/projects/add0e68b486846e4884e034665e5b2c8/users/cd0cea1d286a43e2bb10c5b15a497231/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:56.116068 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb076535-f898-45c8-9503-b6a7faccad8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=add0e68b486846e4884e034665e5b2c8, user_id=cd0cea1d286a43e2bb10c5b15a497231, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:56.120021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb076535-f898-45c8-9503-b6a7faccad8b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:56.142270 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1855/3704] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:12:56 2022] PUT /identity/v3/projects/add0e68b486846e4884e034665e5b2c8/users/cd0cea1d286a43e2bb10c5b15a497231/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:12:56.145967 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9c28e-3afe-4380-9fd9-0ae098e08fc1 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:56.163672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9c28e-3afe-4380-9fd9-0ae098e08fc1 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:56.292970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33d561-a5c0-4137-9453-2e1b52dc3b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:56.293930 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33d561-a5c0-4137-9453-2e1b52dc3b9f admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:56.294361 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33d561-a5c0-4137-9453-2e1b52dc3b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:56.294993 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33d561-a5c0-4137-9453-2e1b52dc3b9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:56.295826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d33d561-a5c0-4137-9453-2e1b52dc3b9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:56.297845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d33d561-a5c0-4137-9453-2e1b52dc3b9f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:56.311547 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1850/3705] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:12:56.316195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb076535-f898-45c8-9503-b6a7faccad8b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:56.334254 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb076535-f898-45c8-9503-b6a7faccad8b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:56.358753 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe3a0b-9bcf-4ad9-9d48-ad17b5457c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:56.359905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe3a0b-9bcf-4ad9-9d48-ad17b5457c07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:56.362206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe3a0b-9bcf-4ad9-9d48-ad17b5457c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:56.363550 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe3a0b-9bcf-4ad9-9d48-ad17b5457c07 admin admin] PATH_INFO: `/v3/projects/add0e68b486846e4884e034665e5b2c8/users/cd0cea1d286a43e2bb10c5b15a497231/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:56.369755 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe3a0b-9bcf-4ad9-9d48-ad17b5457c07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=add0e68b486846e4884e034665e5b2c8, user_id=cd0cea1d286a43e2bb10c5b15a497231, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:56.374416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe3a0b-9bcf-4ad9-9d48-ad17b5457c07 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:56.389536 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1856/3706] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:12:56 2022] PUT /identity/v3/projects/add0e68b486846e4884e034665e5b2c8/users/cd0cea1d286a43e2bb10c5b15a497231/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:12:56.681597 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533dedd-c966-4075-b4f0-5f5facad1f6a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:56.682447 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533dedd-c966-4075-b4f0-5f5facad1f6a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:56.682906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533dedd-c966-4075-b4f0-5f5facad1f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:56.709080 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-0533dedd-c966-4075-b4f0-5f5facad1f6a None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:56.710789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0533dedd-c966-4075-b4f0-5f5facad1f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:56.810175 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:12:56.823969 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1851/3707] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:12:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:12:56.838292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe3a0b-9bcf-4ad9-9d48-ad17b5457c07 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:56.840055 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b0fe3a0b-9bcf-4ad9-9d48-ad17b5457c07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:56.988592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe3a0b-9bcf-4ad9-9d48-ad17b5457c07 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:57.000525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aafe60-541e-4158-917d-f9bb0ae1b5f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:57.002474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aafe60-541e-4158-917d-f9bb0ae1b5f7 service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:57.002760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aafe60-541e-4158-917d-f9bb0ae1b5f7 service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:57.003005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aafe60-541e-4158-917d-f9bb0ae1b5f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:57.022184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aafe60-541e-4158-917d-f9bb0ae1b5f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:57.024795 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aafe60-541e-4158-917d-f9bb0ae1b5f7 service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:57.046209 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533dedd-c966-4075-b4f0-5f5facad1f6a None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:57.047303 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1857/3708] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:12:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:12:57.047990 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0533dedd-c966-4075-b4f0-5f5facad1f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:12:57.227348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533dedd-c966-4075-b4f0-5f5facad1f6a None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:57.240807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e6a0a-e671-4815-8bbc-0d2db47c4846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:57.241493 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e6a0a-e671-4815-8bbc-0d2db47c4846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:57.241780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e6a0a-e671-4815-8bbc-0d2db47c4846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:57.242723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e6a0a-e671-4815-8bbc-0d2db47c4846 admin admin] PATH_INFO: `/v3/users/62a2f5ccd5f34a8d8fc387e79029da2f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:57.245663 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e6a0a-e671-4815-8bbc-0d2db47c4846 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62a2f5ccd5f34a8d8fc387e79029da2f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:57.249019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e6a0a-e671-4815-8bbc-0d2db47c4846 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:57.348704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-657e6a0a-e671-4815-8bbc-0d2db47c4846 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62a2f5ccd5f34a8d8fc387e79029da2f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:57.349595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-657e6a0a-e671-4815-8bbc-0d2db47c4846 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62a2f5ccd5f34a8d8fc387e79029da2f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:57.369260 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-657e6a0a-e671-4815-8bbc-0d2db47c4846 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62a2f5ccd5f34a8d8fc387e79029da2f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:57.387016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-657e6a0a-e671-4815-8bbc-0d2db47c4846 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62a2f5ccd5f34a8d8fc387e79029da2f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:57.389190 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-657e6a0a-e671-4815-8bbc-0d2db47c4846 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62a2f5ccd5f34a8d8fc387e79029da2f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:57.477008 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1852/3709] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:12:57 2022] DELETE /identity/v3/users/62a2f5ccd5f34a8d8fc387e79029da2f => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:12:59.198805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aafe60-541e-4158-917d-f9bb0ae1b5f7 service swift] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:12:59.219002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aafe60-541e-4158-917d-f9bb0ae1b5f7 service swift] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:12:59.302440 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:12:59.435321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652207d-9779-4611-8b00-6407ef72cfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:12:59.435979 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652207d-9779-4611-8b00-6407ef72cfd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:59.436263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652207d-9779-4611-8b00-6407ef72cfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:59.436541 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652207d-9779-4611-8b00-6407ef72cfd7 admin admin] PATH_INFO: `/v3/projects/6aa6df124d7c486b86572fc272f125a9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:59.438239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4652207d-9779-4611-8b00-6407ef72cfd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aa6df124d7c486b86572fc272f125a9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:12:59.442233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4652207d-9779-4611-8b00-6407ef72cfd7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:12:59.545356 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4652207d-9779-4611-8b00-6407ef72cfd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aa6df124d7c486b86572fc272f125a9', 'request_id': 'req-4652207d-9779-4611-8b00-6407ef72cfd7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:59.573157 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4652207d-9779-4611-8b00-6407ef72cfd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aa6df124d7c486b86572fc272f125a9', 'request_id': 'req-4652207d-9779-4611-8b00-6407ef72cfd7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:59.591718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4652207d-9779-4611-8b00-6407ef72cfd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aa6df124d7c486b86572fc272f125a9', 'request_id': 'req-4652207d-9779-4611-8b00-6407ef72cfd7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:59.642660 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4652207d-9779-4611-8b00-6407ef72cfd7 admin admin] The token cache is being invalidate because project 6aa6df124d7c486b86572fc272f125a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:12:59.642956 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4652207d-9779-4611-8b00-6407ef72cfd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:59.645891 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4652207d-9779-4611-8b00-6407ef72cfd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:12:59.651195 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1858/3710] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:12:59 2022] DELETE /identity/v3/projects/6aa6df124d7c486b86572fc272f125a9 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:12:59.658423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba2b3b-5595-4808-b393-a6f2cff464cc None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:12:59.658971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba2b3b-5595-4808-b393-a6f2cff464cc None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:12:59.659068 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba2b3b-5595-4808-b393-a6f2cff464cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:12:59.722605 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-14ba2b3b-5595-4808-b393-a6f2cff464cc None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:12:59.745823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-14ba2b3b-5595-4808-b393-a6f2cff464cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:00.039565 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1853/3711] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:13:00.050874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a1b37-0b33-479a-ba39-305971b4eba1 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:00.051173 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a1b37-0b33-479a-ba39-305971b4eba1 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:00.051620 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a1b37-0b33-479a-ba39-305971b4eba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:00.113991 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-d99a1b37-0b33-479a-ba39-305971b4eba1 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:13:00.123321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d99a1b37-0b33-479a-ba39-305971b4eba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:00.162273 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1859/3712] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:13:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:13:00.166037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba2b3b-5595-4808-b393-a6f2cff464cc None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:00.203230 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba2b3b-5595-4808-b393-a6f2cff464cc None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:00.220893 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2fc8ee-3520-4a90-9a88-2d97345a09d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:00.223064 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fc8ee-3520-4a90-9a88-2d97345a09d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:00.223536 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fc8ee-3520-4a90-9a88-2d97345a09d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:00.224189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fc8ee-3520-4a90-9a88-2d97345a09d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:00.225078 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2fc8ee-3520-4a90-9a88-2d97345a09d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:13:00.225765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2fc8ee-3520-4a90-9a88-2d97345a09d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:00.228472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2fc8ee-3520-4a90-9a88-2d97345a09d8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:00.269917 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1854/3713] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:13:00.271135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a1b37-0b33-479a-ba39-305971b4eba1 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:00.287388 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a1b37-0b33-479a-ba39-305971b4eba1 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:00.300834 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399c2fa-1214-4147-90de-e41f78791be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:00.301572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399c2fa-1214-4147-90de-e41f78791be6 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:00.301750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399c2fa-1214-4147-90de-e41f78791be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:00.302211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399c2fa-1214-4147-90de-e41f78791be6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:00.303101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399c2fa-1214-4147-90de-e41f78791be6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:00.305608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399c2fa-1214-4147-90de-e41f78791be6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:00.385616 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1860/3714] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:13:00 2022] POST /identity/v3/projects => generated 391 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:13:00.386584 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2fc8ee-3520-4a90-9a88-2d97345a09d8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:00.396243 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:13:00.403318 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2fc8ee-3520-4a90-9a88-2d97345a09d8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:00.595071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ec8ad-58df-4673-9f79-2743a71729d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:00.597049 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ec8ad-58df-4673-9f79-2743a71729d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:00.597339 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ec8ad-58df-4673-9f79-2743a71729d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:00.597638 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ec8ad-58df-4673-9f79-2743a71729d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:00.601263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ec8ad-58df-4673-9f79-2743a71729d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:00.609182 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ec8ad-58df-4673-9f79-2743a71729d5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:00.678255 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1855/3715] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:13:00 2022] POST /identity/v3/users => generated 296 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:13:00.683163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399c2fa-1214-4147-90de-e41f78791be6 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:00.709711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399c2fa-1214-4147-90de-e41f78791be6 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:00.721529 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ee4ae-739e-449a-a4bc-5101ac57a36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:00.722420 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ee4ae-739e-449a-a4bc-5101ac57a36d admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:00.722775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ee4ae-739e-449a-a4bc-5101ac57a36d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:00.723241 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ee4ae-739e-449a-a4bc-5101ac57a36d admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:00.724012 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ee4ae-739e-449a-a4bc-5101ac57a36d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:00.725989 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ee4ae-739e-449a-a4bc-5101ac57a36d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:00.769599 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1861/3716] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:13:00.770872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ec8ad-58df-4673-9f79-2743a71729d5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:00.808494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ec8ad-58df-4673-9f79-2743a71729d5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:00.834026 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d31be-a4f1-4c7a-bd2e-7ede6e3f864a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:00.836867 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d31be-a4f1-4c7a-bd2e-7ede6e3f864a admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:00.837158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d31be-a4f1-4c7a-bd2e-7ede6e3f864a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:00.838039 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d31be-a4f1-4c7a-bd2e-7ede6e3f864a admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:00.840283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d31be-a4f1-4c7a-bd2e-7ede6e3f864a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:00.845061 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d31be-a4f1-4c7a-bd2e-7ede6e3f864a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:00.884107 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1856/3717] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:13:00.887547 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ee4ae-739e-449a-a4bc-5101ac57a36d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:00.903220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ee4ae-739e-449a-a4bc-5101ac57a36d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:00.930234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960a539-913b-44b2-bd52-917d82060247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:00.931206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960a539-913b-44b2-bd52-917d82060247 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:00.932930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960a539-913b-44b2-bd52-917d82060247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:00.933829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960a539-913b-44b2-bd52-917d82060247 admin admin] PATH_INFO: `/v3/projects/a7c6e9c3614a49dbb433b9fb3168e09a/users/1ec23e9ee11c43d8a016bf37576c7f6d/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:00.989180 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960a539-913b-44b2-bd52-917d82060247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7c6e9c3614a49dbb433b9fb3168e09a, user_id=1ec23e9ee11c43d8a016bf37576c7f6d, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:00.996707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960a539-913b-44b2-bd52-917d82060247 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:01.042872 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1862/3718] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:13:00 2022] PUT /identity/v3/projects/a7c6e9c3614a49dbb433b9fb3168e09a/users/1ec23e9ee11c43d8a016bf37576c7f6d/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:13:01.048343 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ff6b5-e896-4d09-9c4a-07961d3c0dc3 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:01.051223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ff6b5-e896-4d09-9c4a-07961d3c0dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:01.051364 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ff6b5-e896-4d09-9c4a-07961d3c0dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:01.102183 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-ec9ff6b5-e896-4d09-9c4a-07961d3c0dc3 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:13:01.104056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ec9ff6b5-e896-4d09-9c4a-07961d3c0dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:01.283383 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1857/3719] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:13:01.292309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960a539-913b-44b2-bd52-917d82060247 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:01.298003 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1960a539-913b-44b2-bd52-917d82060247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:01.549411 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960a539-913b-44b2-bd52-917d82060247 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:01.570895 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a601eb-9cbe-488c-956d-50c23656b387 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:01.571647 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a601eb-9cbe-488c-956d-50c23656b387 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:01.573735 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a601eb-9cbe-488c-956d-50c23656b387 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:01.577986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a601eb-9cbe-488c-956d-50c23656b387 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:01.608832 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:13:01.635053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a601eb-9cbe-488c-956d-50c23656b387 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:01.648541 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a601eb-9cbe-488c-956d-50c23656b387 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:01.678733 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1863/3720] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:13:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:13:07.288048 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c573d-cc30-46ef-be0e-a2a889f0fb81 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:07.288600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c573d-cc30-46ef-be0e-a2a889f0fb81 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:07.289358 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c573d-cc30-46ef-be0e-a2a889f0fb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:07.418971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-4b9c573d-cc30-46ef-be0e-a2a889f0fb81 None None] MFA Rules not processed for user `cd0cea1d286a43e2bb10c5b15a497231`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:13:07.428279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4b9c573d-cc30-46ef-be0e-a2a889f0fb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:07.643480 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1858/3721] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:13:07 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:13:07.657594 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a601eb-9cbe-488c-956d-50c23656b387 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:07.659102 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-07a601eb-9cbe-488c-956d-50c23656b387 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:07.755010 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a601eb-9cbe-488c-956d-50c23656b387 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:07.787394 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5ada6-9283-4011-854c-e0c6124c6903 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:07.788327 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5ada6-9283-4011-854c-e0c6124c6903 service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:07.789616 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5ada6-9283-4011-854c-e0c6124c6903 service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:07.790142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5ada6-9283-4011-854c-e0c6124c6903 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:07.793830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ffb5ada6-9283-4011-854c-e0c6124c6903 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:07.921840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb5ada6-9283-4011-854c-e0c6124c6903 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:07.923432 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb5ada6-9283-4011-854c-e0c6124c6903 service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:07.939744 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1864/3722] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:13:07 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:13:10.504314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c573d-cc30-46ef-be0e-a2a889f0fb81 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:10.506408 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4b9c573d-cc30-46ef-be0e-a2a889f0fb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:10.554073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c573d-cc30-46ef-be0e-a2a889f0fb81 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:10.564596 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2522d-8b4e-432e-86d2-7b29f23851eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:10.565234 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2522d-8b4e-432e-86d2-7b29f23851eb service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:10.565542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2522d-8b4e-432e-86d2-7b29f23851eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:10.565818 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2522d-8b4e-432e-86d2-7b29f23851eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:10.580584 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-65a2522d-8b4e-432e-86d2-7b29f23851eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:10.622503 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:13:10.866628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a2522d-8b4e-432e-86d2-7b29f23851eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:10.869108 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a2522d-8b4e-432e-86d2-7b29f23851eb service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:10.902646 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1859/3723] 10.222.0.30 () {60 vars in 1396 bytes} [Sun Sep 4 01:13:10 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3244 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:13:12.983647 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5ada6-9283-4011-854c-e0c6124c6903 service cinder] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:12.985562 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ffb5ada6-9283-4011-854c-e0c6124c6903 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:13.260318 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5ada6-9283-4011-854c-e0c6124c6903 service cinder] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:13.268160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93563a-c40f-4e69-af79-1515ff8838b4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:13.269377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93563a-c40f-4e69-af79-1515ff8838b4 service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:13.269688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93563a-c40f-4e69-af79-1515ff8838b4 service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:13.269970 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93563a-c40f-4e69-af79-1515ff8838b4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:13.272141 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8f93563a-c40f-4e69-af79-1515ff8838b4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:13.298767 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f93563a-c40f-4e69-af79-1515ff8838b4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:13.302281 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f93563a-c40f-4e69-af79-1515ff8838b4 service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:13.335270 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1865/3724] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:13:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:13:14.934030 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e190d-d99d-484f-9528-88c1b769c154 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:14.934642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e190d-d99d-484f-9528-88c1b769c154 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:14.935166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e190d-d99d-484f-9528-88c1b769c154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:15.009476 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-1d3e190d-d99d-484f-9528-88c1b769c154 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:13:15.015286 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1d3e190d-d99d-484f-9528-88c1b769c154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:15.174764 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1860/3725] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:13:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:13:15.187468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93563a-c40f-4e69-af79-1515ff8838b4 service placement] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:15.191659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8f93563a-c40f-4e69-af79-1515ff8838b4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:15.329084 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:13:15.475315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93563a-c40f-4e69-af79-1515ff8838b4 service placement] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:15.505105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a3ece-8c77-4595-9bc4-391d52d1a3f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:15.505776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a3ece-8c77-4595-9bc4-391d52d1a3f6 service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:15.510368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a3ece-8c77-4595-9bc4-391d52d1a3f6 service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:15.510661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a3ece-8c77-4595-9bc4-391d52d1a3f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:15.542768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a3ece-8c77-4595-9bc4-391d52d1a3f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:15.544470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a3ece-8c77-4595-9bc4-391d52d1a3f6 service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:15.563280 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1866/3726] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:13:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:13:17.998991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e190d-d99d-484f-9528-88c1b769c154 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:18.015082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e190d-d99d-484f-9528-88c1b769c154 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:18.028558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98901307-5c78-4b03-bae3-d5f96f4bc7b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:18.033786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98901307-5c78-4b03-bae3-d5f96f4bc7b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:18.035492 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98901307-5c78-4b03-bae3-d5f96f4bc7b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:18.036676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98901307-5c78-4b03-bae3-d5f96f4bc7b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:18.046076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-98901307-5c78-4b03-bae3-d5f96f4bc7b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:18.075233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98901307-5c78-4b03-bae3-d5f96f4bc7b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:18.079147 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98901307-5c78-4b03-bae3-d5f96f4bc7b0 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:18.123431 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1861/3727] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:13:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:13:20.751387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea45e8-fe19-4dbf-a467-5793d716d396 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:20.752637 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea45e8-fe19-4dbf-a467-5793d716d396 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:20.753285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea45e8-fe19-4dbf-a467-5793d716d396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:20.869082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-4bea45e8-fe19-4dbf-a467-5793d716d396 None None] MFA Rules not processed for user `1ec23e9ee11c43d8a016bf37576c7f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:13:20.873757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4bea45e8-fe19-4dbf-a467-5793d716d396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:21.219236 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1867/3728] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:13:20 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:13:21.231068 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e472abb-384e-4556-a846-43fb1f16a61d None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:21.231661 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e472abb-384e-4556-a846-43fb1f16a61d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:21.231827 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e472abb-384e-4556-a846-43fb1f16a61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:21.272104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-3e472abb-384e-4556-a846-43fb1f16a61d None None] MFA Rules not processed for user `1ec23e9ee11c43d8a016bf37576c7f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:13:21.278927 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3e472abb-384e-4556-a846-43fb1f16a61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:21.309052 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1862/3729] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:13:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:13:21.525058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea45e8-fe19-4dbf-a467-5793d716d396 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:21.526961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4bea45e8-fe19-4dbf-a467-5793d716d396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:21.748299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea45e8-fe19-4dbf-a467-5793d716d396 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:21.764290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e318dc-33e9-4d4c-b39a-d98d08a8e9d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:21.767724 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e318dc-33e9-4d4c-b39a-d98d08a8e9d0 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:21.768347 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e318dc-33e9-4d4c-b39a-d98d08a8e9d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:21.769593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e318dc-33e9-4d4c-b39a-d98d08a8e9d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:21.803761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e318dc-33e9-4d4c-b39a-d98d08a8e9d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:21.809268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e318dc-33e9-4d4c-b39a-d98d08a8e9d0 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:21.852139 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1868/3730] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:13:21 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:13:27.038444 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e472abb-384e-4556-a846-43fb1f16a61d None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:27.040954 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3e472abb-384e-4556-a846-43fb1f16a61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:27.083127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e318dc-33e9-4d4c-b39a-d98d08a8e9d0 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:27.085752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e9e318dc-33e9-4d4c-b39a-d98d08a8e9d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:27.087807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e472abb-384e-4556-a846-43fb1f16a61d None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:27.109239 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2300c62-fd5b-4e6d-97b3-36e8f0fc03b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:27.110353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2300c62-fd5b-4e6d-97b3-36e8f0fc03b2 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:27.112582 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2300c62-fd5b-4e6d-97b3-36e8f0fc03b2 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:27.113100 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2300c62-fd5b-4e6d-97b3-36e8f0fc03b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:27.119554 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c2300c62-fd5b-4e6d-97b3-36e8f0fc03b2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:27.121224 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e318dc-33e9-4d4c-b39a-d98d08a8e9d0 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:27.164142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2300c62-fd5b-4e6d-97b3-36e8f0fc03b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:27.167493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac603b-09c8-4bfc-b9d6-a6fe23024409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:27.168168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2300c62-fd5b-4e6d-97b3-36e8f0fc03b2 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:27.168942 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac603b-09c8-4bfc-b9d6-a6fe23024409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:27.170711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac603b-09c8-4bfc-b9d6-a6fe23024409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:27.171200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac603b-09c8-4bfc-b9d6-a6fe23024409 admin admin] PATH_INFO: `/v3/users/575bb87368454c08a703e99526e6f00c` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:27.178904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac603b-09c8-4bfc-b9d6-a6fe23024409 admin admin] RBAC: Authorizing `identity:delete_user(user_id=575bb87368454c08a703e99526e6f00c)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:27.181793 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac603b-09c8-4bfc-b9d6-a6fe23024409 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:27.193184 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1863/3731] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:13:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:13:27.318656 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:13:27.342448 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-37ac603b-09c8-4bfc-b9d6-a6fe23024409 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '575bb87368454c08a703e99526e6f00c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:27.343261 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-37ac603b-09c8-4bfc-b9d6-a6fe23024409 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '575bb87368454c08a703e99526e6f00c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:27.388612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-37ac603b-09c8-4bfc-b9d6-a6fe23024409 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '575bb87368454c08a703e99526e6f00c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:27.423627 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-37ac603b-09c8-4bfc-b9d6-a6fe23024409 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '575bb87368454c08a703e99526e6f00c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:27.424478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-37ac603b-09c8-4bfc-b9d6-a6fe23024409 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '575bb87368454c08a703e99526e6f00c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:27.468132 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1869/3732] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:13:27 2022] DELETE /identity/v3/users/575bb87368454c08a703e99526e6f00c => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:13:27.911437 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2300c62-fd5b-4e6d-97b3-36e8f0fc03b2 service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:27.954439 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2300c62-fd5b-4e6d-97b3-36e8f0fc03b2 service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:28.166807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab0a1b-c080-4a70-ab23-94aa9fa2b9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:28.177651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab0a1b-c080-4a70-ab23-94aa9fa2b9a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:28.178782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab0a1b-c080-4a70-ab23-94aa9fa2b9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:28.182486 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab0a1b-c080-4a70-ab23-94aa9fa2b9a7 admin admin] PATH_INFO: `/v3/projects/6638188f01c94925b70f849f1d4a9c98` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:28.184609 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab0a1b-c080-4a70-ab23-94aa9fa2b9a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6638188f01c94925b70f849f1d4a9c98)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:28.192236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab0a1b-c080-4a70-ab23-94aa9fa2b9a7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:28.271196 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:13:28.322901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-45ab0a1b-c080-4a70-ab23-94aa9fa2b9a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6638188f01c94925b70f849f1d4a9c98', 'request_id': 'req-45ab0a1b-c080-4a70-ab23-94aa9fa2b9a7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:28.344396 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-45ab0a1b-c080-4a70-ab23-94aa9fa2b9a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6638188f01c94925b70f849f1d4a9c98', 'request_id': 'req-45ab0a1b-c080-4a70-ab23-94aa9fa2b9a7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:28.352128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-45ab0a1b-c080-4a70-ab23-94aa9fa2b9a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6638188f01c94925b70f849f1d4a9c98', 'request_id': 'req-45ab0a1b-c080-4a70-ab23-94aa9fa2b9a7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:28.389958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-45ab0a1b-c080-4a70-ab23-94aa9fa2b9a7 admin admin] The token cache is being invalidate because project 6638188f01c94925b70f849f1d4a9c98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:13:28.390257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-45ab0a1b-c080-4a70-ab23-94aa9fa2b9a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:28.393992 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-45ab0a1b-c080-4a70-ab23-94aa9fa2b9a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:28.402288 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1864/3733] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:13:27 2022] DELETE /identity/v3/projects/6638188f01c94925b70f849f1d4a9c98 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:13:28.404047 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cb8cb-2fa1-4853-8a3b-e1188d960e3d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:28.405668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cb8cb-2fa1-4853-8a3b-e1188d960e3d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:28.406154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cb8cb-2fa1-4853-8a3b-e1188d960e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:28.474998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-330cb8cb-2fa1-4853-8a3b-e1188d960e3d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:13:28.479795 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-330cb8cb-2fa1-4853-8a3b-e1188d960e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:28.634653 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1870/3734] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:13:28.640843 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2f026-e116-481f-9c6b-0fe1457c2c6f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:28.641128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2f026-e116-481f-9c6b-0fe1457c2c6f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:28.641402 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2f026-e116-481f-9c6b-0fe1457c2c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:28.691568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-0af2f026-e116-481f-9c6b-0fe1457c2c6f None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:13:28.692810 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0af2f026-e116-481f-9c6b-0fe1457c2c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:28.727044 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1865/3735] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:13:28.732222 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cb8cb-2fa1-4853-8a3b-e1188d960e3d None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:28.745866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cb8cb-2fa1-4853-8a3b-e1188d960e3d None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:28.782963 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d0878-9c69-43a7-9f3d-6a8369be6dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:28.785823 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d0878-9c69-43a7-9f3d-6a8369be6dfc admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:28.786228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d0878-9c69-43a7-9f3d-6a8369be6dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:28.786751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d0878-9c69-43a7-9f3d-6a8369be6dfc admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:28.788140 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d0878-9c69-43a7-9f3d-6a8369be6dfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:13:28.790496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d0878-9c69-43a7-9f3d-6a8369be6dfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:28.800988 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d0878-9c69-43a7-9f3d-6a8369be6dfc admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:28.853072 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1871/3736] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:13:28.857317 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2f026-e116-481f-9c6b-0fe1457c2c6f None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:28.870741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2f026-e116-481f-9c6b-0fe1457c2c6f None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:28.888320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a6fee-d490-43a9-be29-ed6b2e2ae236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:28.889152 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a6fee-d490-43a9-be29-ed6b2e2ae236 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:28.889629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a6fee-d490-43a9-be29-ed6b2e2ae236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:28.890062 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a6fee-d490-43a9-be29-ed6b2e2ae236 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:28.896325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a6fee-d490-43a9-be29-ed6b2e2ae236 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:28.898834 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a6fee-d490-43a9-be29-ed6b2e2ae236 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:28.965607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d0878-9c69-43a7-9f3d-6a8369be6dfc admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:28.967694 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1866/3737] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:13:28 2022] POST /identity/v3/projects => generated 369 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:13:28.984584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d0878-9c69-43a7-9f3d-6a8369be6dfc admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:29.303547 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a0bce-a066-48e8-9cad-d6ae69265b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:29.305375 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a0bce-a066-48e8-9cad-d6ae69265b72 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:29.306813 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a0bce-a066-48e8-9cad-d6ae69265b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:29.306932 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a0bce-a066-48e8-9cad-d6ae69265b72 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:29.309769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a0bce-a066-48e8-9cad-d6ae69265b72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:29.317553 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a0bce-a066-48e8-9cad-d6ae69265b72 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:29.379274 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1872/3738] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:13:28 2022] POST /identity/v3/users => generated 285 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:13:29.380806 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a6fee-d490-43a9-be29-ed6b2e2ae236 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:29.403167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a6fee-d490-43a9-be29-ed6b2e2ae236 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:29.422559 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7dc1e-0b7b-4eb9-b189-f172aeff072c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:29.424016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7dc1e-0b7b-4eb9-b189-f172aeff072c admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:29.425763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7dc1e-0b7b-4eb9-b189-f172aeff072c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:29.426259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7dc1e-0b7b-4eb9-b189-f172aeff072c admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:29.428004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e7dc1e-0b7b-4eb9-b189-f172aeff072c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:29.431049 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e7dc1e-0b7b-4eb9-b189-f172aeff072c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:29.474773 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1867/3739] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:13:29.478053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a0bce-a066-48e8-9cad-d6ae69265b72 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:29.510385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a0bce-a066-48e8-9cad-d6ae69265b72 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:29.520852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1828e4-e792-4dd2-a78d-3702d9a6cabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:29.522329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1828e4-e792-4dd2-a78d-3702d9a6cabd admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:29.523733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1828e4-e792-4dd2-a78d-3702d9a6cabd admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:29.525073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1828e4-e792-4dd2-a78d-3702d9a6cabd admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:29.529292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1828e4-e792-4dd2-a78d-3702d9a6cabd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:29.531931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1828e4-e792-4dd2-a78d-3702d9a6cabd admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:29.553215 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1873/3740] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:13:29.557120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7dc1e-0b7b-4eb9-b189-f172aeff072c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:29.574206 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7dc1e-0b7b-4eb9-b189-f172aeff072c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:29.585876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a79b8-6ade-44a1-9efa-97e891c7b617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:29.586613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a79b8-6ade-44a1-9efa-97e891c7b617 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:29.587126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a79b8-6ade-44a1-9efa-97e891c7b617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:29.587596 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a79b8-6ade-44a1-9efa-97e891c7b617 admin admin] PATH_INFO: `/v3/projects/abefa3e65aea44a0b52ca7738eff44f7/users/c2880f4229814ec7a89b9dea123fc6d2/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:29.626323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a79b8-6ade-44a1-9efa-97e891c7b617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abefa3e65aea44a0b52ca7738eff44f7, user_id=c2880f4229814ec7a89b9dea123fc6d2, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:29.629703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a79b8-6ade-44a1-9efa-97e891c7b617 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:29.652176 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1868/3741] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:13:29 2022] PUT /identity/v3/projects/abefa3e65aea44a0b52ca7738eff44f7/users/c2880f4229814ec7a89b9dea123fc6d2/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:13:29.666831 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0450685-98f0-4dfa-a33d-4a4e9e32b067 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:29.667217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0450685-98f0-4dfa-a33d-4a4e9e32b067 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:29.667460 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0450685-98f0-4dfa-a33d-4a4e9e32b067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:29.768680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a0450685-98f0-4dfa-a33d-4a4e9e32b067 None None] MFA Rules not processed for user `c2880f4229814ec7a89b9dea123fc6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:13:29.769962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a0450685-98f0-4dfa-a33d-4a4e9e32b067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:29.789524 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:13:29.928091 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1874/3742] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:13:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:13:29.938754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93517ff6-a85f-4e6c-95a4-4f140cfe4e25 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:29.939495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93517ff6-a85f-4e6c-95a4-4f140cfe4e25 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:29.940219 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93517ff6-a85f-4e6c-95a4-4f140cfe4e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:29.988445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-93517ff6-a85f-4e6c-95a4-4f140cfe4e25 None None] MFA Rules not processed for user `c2880f4229814ec7a89b9dea123fc6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:13:29.992341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-93517ff6-a85f-4e6c-95a4-4f140cfe4e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:30.016116 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1869/3743] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:13:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:13:30.961045 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0450685-98f0-4dfa-a33d-4a4e9e32b067 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:30.964379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a0450685-98f0-4dfa-a33d-4a4e9e32b067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:31.136688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0450685-98f0-4dfa-a33d-4a4e9e32b067 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:31.159038 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae17af-5d1f-4961-9c26-2f4704484639 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:31.159685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae17af-5d1f-4961-9c26-2f4704484639 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:31.159978 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae17af-5d1f-4961-9c26-2f4704484639 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:31.160258 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae17af-5d1f-4961-9c26-2f4704484639 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:31.174915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae17af-5d1f-4961-9c26-2f4704484639 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:31.182212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae17af-5d1f-4961-9c26-2f4704484639 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:31.195331 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1875/3744] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:13:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:13:31.655534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff01a5-d1e1-4a2c-bf16-568af645b105 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:31.656562 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff01a5-d1e1-4a2c-bf16-568af645b105 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:31.656989 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff01a5-d1e1-4a2c-bf16-568af645b105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:31.689506 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-64ff01a5-d1e1-4a2c-bf16-568af645b105 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:13:31.691237 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-64ff01a5-d1e1-4a2c-bf16-568af645b105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:31.793365 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1870/3745] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 01:13:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:13:31.810569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae17af-5d1f-4961-9c26-2f4704484639 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:31.812806 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b2ae17af-5d1f-4961-9c26-2f4704484639 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:31.935561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae17af-5d1f-4961-9c26-2f4704484639 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:31.948280 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e2f62-4261-47ef-afd7-a86e23e87129 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:31.950760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e2f62-4261-47ef-afd7-a86e23e87129 service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:31.951327 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e2f62-4261-47ef-afd7-a86e23e87129 service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:31.954593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e2f62-4261-47ef-afd7-a86e23e87129 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:31.980023 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e2f62-4261-47ef-afd7-a86e23e87129 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:31.983422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e2f62-4261-47ef-afd7-a86e23e87129 service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:31.998852 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1876/3746] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:13:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:13:32.388718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff01a5-d1e1-4a2c-bf16-568af645b105 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:32.390839 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-64ff01a5-d1e1-4a2c-bf16-568af645b105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:32.459033 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:13:32.487393 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff01a5-d1e1-4a2c-bf16-568af645b105 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:32.501648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895013c0-10d0-4776-823f-a90b30a4901f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:32.502174 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895013c0-10d0-4776-823f-a90b30a4901f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:32.502455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895013c0-10d0-4776-823f-a90b30a4901f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:32.507913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895013c0-10d0-4776-823f-a90b30a4901f admin admin] PATH_INFO: `/v3/users/832e32b86f334bf4bd36eb7f806d604c` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:32.510592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895013c0-10d0-4776-823f-a90b30a4901f admin admin] RBAC: Authorizing `identity:delete_user(user_id=832e32b86f334bf4bd36eb7f806d604c)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:32.512994 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895013c0-10d0-4776-823f-a90b30a4901f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:32.617298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-895013c0-10d0-4776-823f-a90b30a4901f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '832e32b86f334bf4bd36eb7f806d604c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:32.618357 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-895013c0-10d0-4776-823f-a90b30a4901f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '832e32b86f334bf4bd36eb7f806d604c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:32.641155 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-895013c0-10d0-4776-823f-a90b30a4901f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '832e32b86f334bf4bd36eb7f806d604c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:32.658224 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-895013c0-10d0-4776-823f-a90b30a4901f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '832e32b86f334bf4bd36eb7f806d604c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:32.659003 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-895013c0-10d0-4776-823f-a90b30a4901f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '832e32b86f334bf4bd36eb7f806d604c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:32.687302 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1871/3747] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:13:32 2022] DELETE /identity/v3/users/832e32b86f334bf4bd36eb7f806d604c => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:13:33.102724 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e2f62-4261-47ef-afd7-a86e23e87129 service swift] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:33.118592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e2f62-4261-47ef-afd7-a86e23e87129 service swift] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:33.191727 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:13:33.258755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895013c0-10d0-4776-823f-a90b30a4901f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:33.260658 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-895013c0-10d0-4776-823f-a90b30a4901f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:33.299345 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9368630-e85b-4bf6-9783-8d4030205bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:33.301558 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9368630-e85b-4bf6-9783-8d4030205bba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:33.304351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9368630-e85b-4bf6-9783-8d4030205bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:33.305718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9368630-e85b-4bf6-9783-8d4030205bba admin admin] PATH_INFO: `/v3/projects/2e790ab9ef3446c0b76c34cfd1a665c2` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:33.310105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9368630-e85b-4bf6-9783-8d4030205bba admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e790ab9ef3446c0b76c34cfd1a665c2)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:33.316034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9368630-e85b-4bf6-9783-8d4030205bba admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:33.448082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b9368630-e85b-4bf6-9783-8d4030205bba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e790ab9ef3446c0b76c34cfd1a665c2', 'request_id': 'req-b9368630-e85b-4bf6-9783-8d4030205bba'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:33.470517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b9368630-e85b-4bf6-9783-8d4030205bba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e790ab9ef3446c0b76c34cfd1a665c2', 'request_id': 'req-b9368630-e85b-4bf6-9783-8d4030205bba'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:33.477369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895013c0-10d0-4776-823f-a90b30a4901f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:33.479505 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b9368630-e85b-4bf6-9783-8d4030205bba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e790ab9ef3446c0b76c34cfd1a665c2', 'request_id': 'req-b9368630-e85b-4bf6-9783-8d4030205bba'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:33.506309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b9368630-e85b-4bf6-9783-8d4030205bba admin admin] The token cache is being invalidate because project 2e790ab9ef3446c0b76c34cfd1a665c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:13:33.506614 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b9368630-e85b-4bf6-9783-8d4030205bba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:33.509727 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b9368630-e85b-4bf6-9783-8d4030205bba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:33.512831 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1877/3748] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:13:33 2022] DELETE /identity/v3/projects/2e790ab9ef3446c0b76c34cfd1a665c2 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:13:33.517674 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d151c8-b1ac-45f9-a31b-4daf831ca613 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:33.517876 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d151c8-b1ac-45f9-a31b-4daf831ca613 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:33.518153 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d151c8-b1ac-45f9-a31b-4daf831ca613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:33.566084 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f95cb-8481-42d3-bd13-ba6f39a7cd19 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:33.566939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f95cb-8481-42d3-bd13-ba6f39a7cd19 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:33.567871 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f95cb-8481-42d3-bd13-ba6f39a7cd19 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:33.568221 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f95cb-8481-42d3-bd13-ba6f39a7cd19 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:33.570802 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-462f95cb-8481-42d3-bd13-ba6f39a7cd19 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:33.582326 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-63d151c8-b1ac-45f9-a31b-4daf831ca613 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:13:33.583500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-63d151c8-b1ac-45f9-a31b-4daf831ca613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:33.595292 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:13:33.603878 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f95cb-8481-42d3-bd13-ba6f39a7cd19 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:33.605674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f95cb-8481-42d3-bd13-ba6f39a7cd19 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:33.627235 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1872/3749] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:13:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:13:33.761997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f0604-fbce-4daf-97f4-173ae7449251 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:33.763057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f0604-fbce-4daf-97f4-173ae7449251 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:33.763346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f0604-fbce-4daf-97f4-173ae7449251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:33.773375 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1878/3750] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:13:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:13:33.799026 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-cb0f0604-fbce-4daf-97f4-173ae7449251 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:13:33.800910 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-cb0f0604-fbce-4daf-97f4-173ae7449251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:33.829031 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1873/3751] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:13:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:13:33.833798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d151c8-b1ac-45f9-a31b-4daf831ca613 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:33.868225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d151c8-b1ac-45f9-a31b-4daf831ca613 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:33.888965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc664b9-6014-4d85-8d67-01f4acf69fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:33.889258 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc664b9-6014-4d85-8d67-01f4acf69fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:33.889573 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc664b9-6014-4d85-8d67-01f4acf69fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:33.889852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc664b9-6014-4d85-8d67-01f4acf69fa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:33.890521 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc664b9-6014-4d85-8d67-01f4acf69fa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:13:33.890828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc664b9-6014-4d85-8d67-01f4acf69fa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:33.898513 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc664b9-6014-4d85-8d67-01f4acf69fa2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:33.942190 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1879/3752] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:13:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:13:33.943505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f0604-fbce-4daf-97f4-173ae7449251 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:33.971068 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f0604-fbce-4daf-97f4-173ae7449251 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:33.996577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9e794-868e-4b3c-8dfa-c5a212553597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:33.997664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9e794-868e-4b3c-8dfa-c5a212553597 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:33.998117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9e794-868e-4b3c-8dfa-c5a212553597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:33.999172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9e794-868e-4b3c-8dfa-c5a212553597 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:33.999978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9e794-868e-4b3c-8dfa-c5a212553597 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:34.002105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9e794-868e-4b3c-8dfa-c5a212553597 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:34.081525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc664b9-6014-4d85-8d67-01f4acf69fa2 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:34.081746 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1874/3753] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:13:33 2022] POST /identity/v3/projects => generated 379 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:13:34.099962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc664b9-6014-4d85-8d67-01f4acf69fa2 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:34.203988 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:13:34.254325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b0dbb-5c3b-4680-9f99-2dd5ad3befce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:34.254959 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b0dbb-5c3b-4680-9f99-2dd5ad3befce admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:34.255928 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b0dbb-5c3b-4680-9f99-2dd5ad3befce admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:34.256371 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b0dbb-5c3b-4680-9f99-2dd5ad3befce admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:34.259617 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b0dbb-5c3b-4680-9f99-2dd5ad3befce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:34.261766 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b0dbb-5c3b-4680-9f99-2dd5ad3befce admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:34.330166 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1880/3754] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:13:34 2022] POST /identity/v3/users => generated 290 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:13:34.335616 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9e794-868e-4b3c-8dfa-c5a212553597 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:34.355454 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9e794-868e-4b3c-8dfa-c5a212553597 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:34.401924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648bc4f-c39f-4986-b06a-368e331aa1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:34.409363 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648bc4f-c39f-4986-b06a-368e331aa1cc admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:34.422216 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648bc4f-c39f-4986-b06a-368e331aa1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:34.422216 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648bc4f-c39f-4986-b06a-368e331aa1cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:34.422870 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648bc4f-c39f-4986-b06a-368e331aa1cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:34.424498 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648bc4f-c39f-4986-b06a-368e331aa1cc admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:34.493307 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1875/3755] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:13:34.497542 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b0dbb-5c3b-4680-9f99-2dd5ad3befce admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:34.514600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b0dbb-5c3b-4680-9f99-2dd5ad3befce admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:34.530194 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77962c6e-1390-49e3-9b91-4a99f42198d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:34.530890 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77962c6e-1390-49e3-9b91-4a99f42198d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:34.531239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77962c6e-1390-49e3-9b91-4a99f42198d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:34.531584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77962c6e-1390-49e3-9b91-4a99f42198d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:34.532450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77962c6e-1390-49e3-9b91-4a99f42198d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:34.536497 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77962c6e-1390-49e3-9b91-4a99f42198d6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:34.582151 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648bc4f-c39f-4986-b06a-368e331aa1cc admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:34.584217 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1881/3756] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:13:34.598685 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648bc4f-c39f-4986-b06a-368e331aa1cc admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:34.641071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f1694-625b-47a8-88b6-98ccdebb690a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:34.660937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f1694-625b-47a8-88b6-98ccdebb690a admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:34.661395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f1694-625b-47a8-88b6-98ccdebb690a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:34.663721 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f1694-625b-47a8-88b6-98ccdebb690a admin admin] PATH_INFO: `/v3/projects/66be3897d2bb460c93cf661260c102a4/users/5581a720105c400f8bee8ef53813288b/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:34.739939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f1694-625b-47a8-88b6-98ccdebb690a admin admin] RBAC: Authorizing `identity:create_grant(project_id=66be3897d2bb460c93cf661260c102a4, user_id=5581a720105c400f8bee8ef53813288b, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:34.747598 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f1694-625b-47a8-88b6-98ccdebb690a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:34.792861 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1876/3757] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:13:34 2022] PUT /identity/v3/projects/66be3897d2bb460c93cf661260c102a4/users/5581a720105c400f8bee8ef53813288b/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:13:34.793496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd4550-dfec-40ed-bb4c-510e1d75477d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:34.793496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd4550-dfec-40ed-bb4c-510e1d75477d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:34.793496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd4550-dfec-40ed-bb4c-510e1d75477d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:34.859605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-9bdd4550-dfec-40ed-bb4c-510e1d75477d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:13:34.861009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9bdd4550-dfec-40ed-bb4c-510e1d75477d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:35.034382 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1882/3758] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:13:35.048647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f1694-625b-47a8-88b6-98ccdebb690a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:35.055262 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-290f1694-625b-47a8-88b6-98ccdebb690a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:35.167955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f1694-625b-47a8-88b6-98ccdebb690a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:35.174351 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74c65a-fe3f-4c46-9b68-24c2cd7f0686 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:35.175760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74c65a-fe3f-4c46-9b68-24c2cd7f0686 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:35.176054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74c65a-fe3f-4c46-9b68-24c2cd7f0686 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:35.176503 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74c65a-fe3f-4c46-9b68-24c2cd7f0686 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:35.190942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee74c65a-fe3f-4c46-9b68-24c2cd7f0686 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:35.192754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee74c65a-fe3f-4c46-9b68-24c2cd7f0686 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:35.234296 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1877/3759] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:13:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:13:35.337188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d02b1a-e7fe-42fb-be78-b6f627c84b26 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:35.337721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d02b1a-e7fe-42fb-be78-b6f627c84b26 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:35.337822 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d02b1a-e7fe-42fb-be78-b6f627c84b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:35.364340 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-04d02b1a-e7fe-42fb-be78-b6f627c84b26 None None] MFA Rules not processed for user `d531146522f24a368a8c6ab482495776`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:13:35.365645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-04d02b1a-e7fe-42fb-be78-b6f627c84b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:35.441559 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1883/3760] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:13:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:13:38.947091 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74c65a-fe3f-4c46-9b68-24c2cd7f0686 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:38.949361 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ee74c65a-fe3f-4c46-9b68-24c2cd7f0686 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:38.979091 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74c65a-fe3f-4c46-9b68-24c2cd7f0686 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:39.029675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011de98-ba08-4f79-ab2f-1998180475fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:39.030254 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011de98-ba08-4f79-ab2f-1998180475fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:39.033316 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011de98-ba08-4f79-ab2f-1998180475fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:39.033879 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011de98-ba08-4f79-ab2f-1998180475fc admin admin] PATH_INFO: `/v3/users/aa10e4bfa8ec40e4805ab582831eb335` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:39.035445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011de98-ba08-4f79-ab2f-1998180475fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa10e4bfa8ec40e4805ab582831eb335)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:39.038827 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011de98-ba08-4f79-ab2f-1998180475fc admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:39.169216 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6011de98-ba08-4f79-ab2f-1998180475fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa10e4bfa8ec40e4805ab582831eb335'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:39.173837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6011de98-ba08-4f79-ab2f-1998180475fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa10e4bfa8ec40e4805ab582831eb335'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:39.214779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6011de98-ba08-4f79-ab2f-1998180475fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa10e4bfa8ec40e4805ab582831eb335'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:39.235095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6011de98-ba08-4f79-ab2f-1998180475fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa10e4bfa8ec40e4805ab582831eb335'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:39.236271 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6011de98-ba08-4f79-ab2f-1998180475fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa10e4bfa8ec40e4805ab582831eb335'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:39.261483 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1878/3761] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:13:38 2022] DELETE /identity/v3/users/aa10e4bfa8ec40e4805ab582831eb335 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:13:39.265688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66816360-dd36-4410-afcb-d9b4a82abbbb None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:39.267111 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66816360-dd36-4410-afcb-d9b4a82abbbb None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:39.267567 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66816360-dd36-4410-afcb-d9b4a82abbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:39.308050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-66816360-dd36-4410-afcb-d9b4a82abbbb None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:13:39.311017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-66816360-dd36-4410-afcb-d9b4a82abbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:39.499793 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1884/3762] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:13:39.548845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011de98-ba08-4f79-ab2f-1998180475fc admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:39.550752 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6011de98-ba08-4f79-ab2f-1998180475fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:39.571962 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:13:39.755057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011de98-ba08-4f79-ab2f-1998180475fc admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:39.769392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2581d53-3b01-45c5-a99d-0fa27632ba7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:39.770052 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2581d53-3b01-45c5-a99d-0fa27632ba7f service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:39.770334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2581d53-3b01-45c5-a99d-0fa27632ba7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:39.770603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2581d53-3b01-45c5-a99d-0fa27632ba7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:39.790293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2581d53-3b01-45c5-a99d-0fa27632ba7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:39.791772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2581d53-3b01-45c5-a99d-0fa27632ba7f service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:39.815880 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1879/3763] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:13:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:13:41.745501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66816360-dd36-4410-afcb-d9b4a82abbbb None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:41.750784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-66816360-dd36-4410-afcb-d9b4a82abbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:41.778351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66816360-dd36-4410-afcb-d9b4a82abbbb None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:41.805315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4517cd4-a0de-4e5b-ba66-1e0ae3aefce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:41.808215 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4517cd4-a0de-4e5b-ba66-1e0ae3aefce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:41.809453 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4517cd4-a0de-4e5b-ba66-1e0ae3aefce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:41.809916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4517cd4-a0de-4e5b-ba66-1e0ae3aefce5 admin admin] PATH_INFO: `/v3/projects/017f7f8c6ae746c99de3a7d374361523` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:41.815373 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4517cd4-a0de-4e5b-ba66-1e0ae3aefce5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=017f7f8c6ae746c99de3a7d374361523)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:41.835012 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4517cd4-a0de-4e5b-ba66-1e0ae3aefce5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:41.845612 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:13:42.030836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f4517cd4-a0de-4e5b-ba66-1e0ae3aefce5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '017f7f8c6ae746c99de3a7d374361523', 'request_id': 'req-f4517cd4-a0de-4e5b-ba66-1e0ae3aefce5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:42.068501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f4517cd4-a0de-4e5b-ba66-1e0ae3aefce5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '017f7f8c6ae746c99de3a7d374361523', 'request_id': 'req-f4517cd4-a0de-4e5b-ba66-1e0ae3aefce5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:42.091063 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f4517cd4-a0de-4e5b-ba66-1e0ae3aefce5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '017f7f8c6ae746c99de3a7d374361523', 'request_id': 'req-f4517cd4-a0de-4e5b-ba66-1e0ae3aefce5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:42.130354 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f4517cd4-a0de-4e5b-ba66-1e0ae3aefce5 admin admin] The token cache is being invalidate because project 017f7f8c6ae746c99de3a7d374361523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:13:42.132364 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f4517cd4-a0de-4e5b-ba66-1e0ae3aefce5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:42.133328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f4517cd4-a0de-4e5b-ba66-1e0ae3aefce5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:42.169004 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1885/3764] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:13:41 2022] DELETE /identity/v3/projects/017f7f8c6ae746c99de3a7d374361523 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:13:42.170750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2581d53-3b01-45c5-a99d-0fa27632ba7f service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:42.191049 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2581d53-3b01-45c5-a99d-0fa27632ba7f service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:42.376781 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16349425-dfe7-4c2c-9969-e3ba122a64a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:42.377458 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16349425-dfe7-4c2c-9969-e3ba122a64a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:42.377761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16349425-dfe7-4c2c-9969-e3ba122a64a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:42.378035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16349425-dfe7-4c2c-9969-e3ba122a64a3 admin admin] PATH_INFO: `/v3/users/68c85ad54d324478bc012d078cb8744f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:42.383580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16349425-dfe7-4c2c-9969-e3ba122a64a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68c85ad54d324478bc012d078cb8744f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:42.385397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16349425-dfe7-4c2c-9969-e3ba122a64a3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:42.544289 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-16349425-dfe7-4c2c-9969-e3ba122a64a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68c85ad54d324478bc012d078cb8744f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:42.545047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-16349425-dfe7-4c2c-9969-e3ba122a64a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68c85ad54d324478bc012d078cb8744f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:42.586159 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-16349425-dfe7-4c2c-9969-e3ba122a64a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68c85ad54d324478bc012d078cb8744f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:42.603422 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-16349425-dfe7-4c2c-9969-e3ba122a64a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68c85ad54d324478bc012d078cb8744f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:42.605124 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-16349425-dfe7-4c2c-9969-e3ba122a64a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68c85ad54d324478bc012d078cb8744f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:42.629522 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1880/3765] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:13:42 2022] DELETE /identity/v3/users/68c85ad54d324478bc012d078cb8744f => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:13:44.810846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4517cd4-a0de-4e5b-ba66-1e0ae3aefce5 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:44.812421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f4517cd4-a0de-4e5b-ba66-1e0ae3aefce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:44.845276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4517cd4-a0de-4e5b-ba66-1e0ae3aefce5 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:45.013958 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c92841-92a9-409a-9fdf-19286c0dc3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:45.015898 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c92841-92a9-409a-9fdf-19286c0dc3fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:45.016293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c92841-92a9-409a-9fdf-19286c0dc3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:45.016565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c92841-92a9-409a-9fdf-19286c0dc3fe admin admin] PATH_INFO: `/v3/projects/7bd177c105a7411ca7d7e1e11e319745` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:45.019137 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c92841-92a9-409a-9fdf-19286c0dc3fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bd177c105a7411ca7d7e1e11e319745)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:45.024376 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c92841-92a9-409a-9fdf-19286c0dc3fe admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:45.136491 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-83c92841-92a9-409a-9fdf-19286c0dc3fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bd177c105a7411ca7d7e1e11e319745', 'request_id': 'req-83c92841-92a9-409a-9fdf-19286c0dc3fe'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:45.152330 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-83c92841-92a9-409a-9fdf-19286c0dc3fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bd177c105a7411ca7d7e1e11e319745', 'request_id': 'req-83c92841-92a9-409a-9fdf-19286c0dc3fe'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:45.160655 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-83c92841-92a9-409a-9fdf-19286c0dc3fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bd177c105a7411ca7d7e1e11e319745', 'request_id': 'req-83c92841-92a9-409a-9fdf-19286c0dc3fe'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:45.182551 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-83c92841-92a9-409a-9fdf-19286c0dc3fe admin admin] The token cache is being invalidate because project 7bd177c105a7411ca7d7e1e11e319745 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:13:45.182842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-83c92841-92a9-409a-9fdf-19286c0dc3fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:45.183512 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-83c92841-92a9-409a-9fdf-19286c0dc3fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:45.185024 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1886/3766] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:13:44 2022] DELETE /identity/v3/projects/7bd177c105a7411ca7d7e1e11e319745 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:13:45.190253 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97cbe6-0dbb-420b-b51f-61722bf5a217 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:45.191064 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97cbe6-0dbb-420b-b51f-61722bf5a217 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:45.191595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97cbe6-0dbb-420b-b51f-61722bf5a217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:45.230009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-6e97cbe6-0dbb-420b-b51f-61722bf5a217 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:13:45.231291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6e97cbe6-0dbb-420b-b51f-61722bf5a217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:45.285645 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:13:45.348119 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1881/3767] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:13:45.350160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4adab-95d2-4238-ad46-c29c5d828b50 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:45.350160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4adab-95d2-4238-ad46-c29c5d828b50 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:45.351083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4adab-95d2-4238-ad46-c29c5d828b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:45.395298 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e7a4adab-95d2-4238-ad46-c29c5d828b50 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:13:45.396797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e7a4adab-95d2-4238-ad46-c29c5d828b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:45.414081 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97cbe6-0dbb-420b-b51f-61722bf5a217 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:45.414851 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1887/3768] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:13:45.425666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97cbe6-0dbb-420b-b51f-61722bf5a217 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:45.431055 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c2ae8-d6c8-4e12-9614-82dd7b5a4694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:45.431886 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c2ae8-d6c8-4e12-9614-82dd7b5a4694 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:45.432353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c2ae8-d6c8-4e12-9614-82dd7b5a4694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:45.432795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c2ae8-d6c8-4e12-9614-82dd7b5a4694 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:45.433655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c2ae8-d6c8-4e12-9614-82dd7b5a4694 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:13:45.434130 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c2ae8-d6c8-4e12-9614-82dd7b5a4694 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:45.436916 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c2ae8-d6c8-4e12-9614-82dd7b5a4694 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:45.469183 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1882/3769] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:13:45.473712 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4adab-95d2-4238-ad46-c29c5d828b50 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:45.484460 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4adab-95d2-4238-ad46-c29c5d828b50 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:45.503021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f884dd0-6213-4098-9fec-71d5d005ebf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:45.503844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f884dd0-6213-4098-9fec-71d5d005ebf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:45.504176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f884dd0-6213-4098-9fec-71d5d005ebf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:45.504568 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f884dd0-6213-4098-9fec-71d5d005ebf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:45.505346 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f884dd0-6213-4098-9fec-71d5d005ebf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:45.507943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f884dd0-6213-4098-9fec-71d5d005ebf2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:45.534620 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:13:45.567209 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1888/3770] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:13:45 2022] POST /identity/v3/projects => generated 377 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:13:45.568506 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c2ae8-d6c8-4e12-9614-82dd7b5a4694 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:45.587651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c2ae8-d6c8-4e12-9614-82dd7b5a4694 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:45.740503 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543e233-7570-461c-ada4-3c874cbec44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:45.743279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543e233-7570-461c-ada4-3c874cbec44a admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:45.743854 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543e233-7570-461c-ada4-3c874cbec44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:45.744752 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543e233-7570-461c-ada4-3c874cbec44a admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:45.746637 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543e233-7570-461c-ada4-3c874cbec44a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:45.780706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543e233-7570-461c-ada4-3c874cbec44a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:45.906609 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1883/3771] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:13:45 2022] POST /identity/v3/users => generated 289 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:13:45.911477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f884dd0-6213-4098-9fec-71d5d005ebf2 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:45.928236 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f884dd0-6213-4098-9fec-71d5d005ebf2 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:45.961029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d1970-72af-4fb2-8a2b-33b46076b97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:45.961940 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d1970-72af-4fb2-8a2b-33b46076b97e admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:45.962379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d1970-72af-4fb2-8a2b-33b46076b97e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:45.962835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d1970-72af-4fb2-8a2b-33b46076b97e admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:45.963664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d1970-72af-4fb2-8a2b-33b46076b97e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:45.965489 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d1970-72af-4fb2-8a2b-33b46076b97e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:45.988000 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1889/3772] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:13:45.992949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543e233-7570-461c-ada4-3c874cbec44a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:46.009339 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543e233-7570-461c-ada4-3c874cbec44a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:46.024675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782cc736-733c-4ad4-abf9-01c1d5f8349c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:46.025304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cc736-733c-4ad4-abf9-01c1d5f8349c admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:46.026077 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cc736-733c-4ad4-abf9-01c1d5f8349c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:46.026077 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cc736-733c-4ad4-abf9-01c1d5f8349c admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:46.026671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782cc736-733c-4ad4-abf9-01c1d5f8349c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:46.028416 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782cc736-733c-4ad4-abf9-01c1d5f8349c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:46.043052 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1884/3773] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:13:46.047075 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d1970-72af-4fb2-8a2b-33b46076b97e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:46.060472 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d1970-72af-4fb2-8a2b-33b46076b97e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:46.071537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a081a7f-c33a-4f36-b44d-a871df10152e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:46.072464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a081a7f-c33a-4f36-b44d-a871df10152e admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:46.072897 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a081a7f-c33a-4f36-b44d-a871df10152e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:46.073344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a081a7f-c33a-4f36-b44d-a871df10152e admin admin] PATH_INFO: `/v3/projects/29408e16bfb0498590bc9bdd0f56c778/users/7cb55b7a13604890a47c13df9b1029cf/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:46.108112 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a081a7f-c33a-4f36-b44d-a871df10152e admin admin] RBAC: Authorizing `identity:create_grant(project_id=29408e16bfb0498590bc9bdd0f56c778, user_id=7cb55b7a13604890a47c13df9b1029cf, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:46.111892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a081a7f-c33a-4f36-b44d-a871df10152e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:46.140400 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1890/3774] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:13:46 2022] PUT /identity/v3/projects/29408e16bfb0498590bc9bdd0f56c778/users/7cb55b7a13604890a47c13df9b1029cf/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:13:46.150731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83067cb1-b649-4480-9787-b9395cc50985 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:46.151013 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83067cb1-b649-4480-9787-b9395cc50985 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:46.151282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83067cb1-b649-4480-9787-b9395cc50985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:46.201391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-83067cb1-b649-4480-9787-b9395cc50985 None None] MFA Rules not processed for user `7cb55b7a13604890a47c13df9b1029cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:13:46.202972 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-83067cb1-b649-4480-9787-b9395cc50985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:46.350126 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1885/3775] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:13:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:13:46.354809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a081a7f-c33a-4f36-b44d-a871df10152e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:46.474888 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a081a7f-c33a-4f36-b44d-a871df10152e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:46.480056 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01690aee-5601-44e8-ab90-847f6292b35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:46.480672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01690aee-5601-44e8-ab90-847f6292b35c admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:46.480955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01690aee-5601-44e8-ab90-847f6292b35c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:46.481386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01690aee-5601-44e8-ab90-847f6292b35c admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:46.482072 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01690aee-5601-44e8-ab90-847f6292b35c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:46.484370 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01690aee-5601-44e8-ab90-847f6292b35c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:46.529819 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1891/3776] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:13:46 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:13:46.535538 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83067cb1-b649-4480-9787-b9395cc50985 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:46.549262 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83067cb1-b649-4480-9787-b9395cc50985 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:46.597297 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:13:46.664641 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2b530-845c-47c9-b91d-98eda60f309a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:46.665221 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2b530-845c-47c9-b91d-98eda60f309a admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:46.665608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2b530-845c-47c9-b91d-98eda60f309a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:46.665883 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2b530-845c-47c9-b91d-98eda60f309a admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:46.666657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae2b530-845c-47c9-b91d-98eda60f309a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:46.668951 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae2b530-845c-47c9-b91d-98eda60f309a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:46.704899 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1886/3777] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:13:46 2022] POST /identity/v3/users => generated 296 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:13:46.709093 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01690aee-5601-44e8-ab90-847f6292b35c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:46.724112 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01690aee-5601-44e8-ab90-847f6292b35c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:46.737539 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f1264-b629-4a18-bf51-ae387d942982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:46.738174 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f1264-b629-4a18-bf51-ae387d942982 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:46.738472 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f1264-b629-4a18-bf51-ae387d942982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:46.738731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f1264-b629-4a18-bf51-ae387d942982 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:46.739386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f1264-b629-4a18-bf51-ae387d942982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:46.741629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f1264-b629-4a18-bf51-ae387d942982 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:46.759546 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1892/3778] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:13:46.761310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2b530-845c-47c9-b91d-98eda60f309a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:46.772915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2b530-845c-47c9-b91d-98eda60f309a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:46.780021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3765470-f01f-4baa-8eea-1a1707a60e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:46.781019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3765470-f01f-4baa-8eea-1a1707a60e91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:46.781452 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3765470-f01f-4baa-8eea-1a1707a60e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:46.781775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3765470-f01f-4baa-8eea-1a1707a60e91 admin admin] PATH_INFO: `/v3/projects/980a8c150ed64398ae1ecff6c4ce79b0/users/7c209fbe94e945e6afa27155b43118e8/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:46.807320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3765470-f01f-4baa-8eea-1a1707a60e91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=980a8c150ed64398ae1ecff6c4ce79b0, user_id=7c209fbe94e945e6afa27155b43118e8, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:46.820039 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3765470-f01f-4baa-8eea-1a1707a60e91 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:46.844794 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1887/3779] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:13:46 2022] PUT /identity/v3/projects/980a8c150ed64398ae1ecff6c4ce79b0/users/7c209fbe94e945e6afa27155b43118e8/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:13:46.846495 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f1264-b629-4a18-bf51-ae387d942982 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:46.860752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f1264-b629-4a18-bf51-ae387d942982 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:46.947329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0900c0-a909-473f-87aa-5fc19ecea530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:46.948586 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0900c0-a909-473f-87aa-5fc19ecea530 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:46.949963 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0900c0-a909-473f-87aa-5fc19ecea530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:46.950616 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0900c0-a909-473f-87aa-5fc19ecea530 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:46.951476 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0900c0-a909-473f-87aa-5fc19ecea530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:46.954996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0900c0-a909-473f-87aa-5fc19ecea530 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:46.967133 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1893/3780] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:13:46.971443 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3765470-f01f-4baa-8eea-1a1707a60e91 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:46.983251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3765470-f01f-4baa-8eea-1a1707a60e91 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:46.988861 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f2c05-2d00-4845-aaeb-d9436320a487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:46.989653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f2c05-2d00-4845-aaeb-d9436320a487 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:46.990046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f2c05-2d00-4845-aaeb-d9436320a487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:46.990390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f2c05-2d00-4845-aaeb-d9436320a487 admin admin] PATH_INFO: `/v3/projects/980a8c150ed64398ae1ecff6c4ce79b0/users/7c209fbe94e945e6afa27155b43118e8/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:46.993278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f2c05-2d00-4845-aaeb-d9436320a487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=980a8c150ed64398ae1ecff6c4ce79b0, user_id=7c209fbe94e945e6afa27155b43118e8, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:46.997231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f2c05-2d00-4845-aaeb-d9436320a487 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:47.008660 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1888/3781] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:13:46 2022] PUT /identity/v3/projects/980a8c150ed64398ae1ecff6c4ce79b0/users/7c209fbe94e945e6afa27155b43118e8/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:13:47.020235 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd5a8f-41c6-4764-b43a-21f2af2b9a03 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:47.020833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd5a8f-41c6-4764-b43a-21f2af2b9a03 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:47.021591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd5a8f-41c6-4764-b43a-21f2af2b9a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:47.080442 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-84bd5a8f-41c6-4764-b43a-21f2af2b9a03 None None] MFA Rules not processed for user `7c209fbe94e945e6afa27155b43118e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:13:47.083510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-84bd5a8f-41c6-4764-b43a-21f2af2b9a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:47.106743 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:13:47.229814 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1894/3782] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:13:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:13:47.237828 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f2c05-2d00-4845-aaeb-d9436320a487 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:47.240863 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9a7f2c05-2d00-4845-aaeb-d9436320a487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:47.363301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f2c05-2d00-4845-aaeb-d9436320a487 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:47.371094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3197de-e47a-4721-b401-08bb602c2323 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:47.371729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3197de-e47a-4721-b401-08bb602c2323 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:47.372005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3197de-e47a-4721-b401-08bb602c2323 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:47.372319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3197de-e47a-4721-b401-08bb602c2323 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:47.384338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3197de-e47a-4721-b401-08bb602c2323 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:47.386313 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3197de-e47a-4721-b401-08bb602c2323 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:47.423382 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1889/3783] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:13:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:13:48.181962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd5a8f-41c6-4764-b43a-21f2af2b9a03 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:48.286852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551f12e-de5b-45af-b3d4-37cf4f18ed00 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:48.287326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551f12e-de5b-45af-b3d4-37cf4f18ed00 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:48.287412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551f12e-de5b-45af-b3d4-37cf4f18ed00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:48.322518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd5a8f-41c6-4764-b43a-21f2af2b9a03 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:48.335368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bcee2d-7d3b-4730-af29-7bfd20aab1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:48.336539 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcee2d-7d3b-4730-af29-7bfd20aab1f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:48.337226 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcee2d-7d3b-4730-af29-7bfd20aab1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:48.337938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcee2d-7d3b-4730-af29-7bfd20aab1f4 admin admin] PATH_INFO: `/v3/users/7cb55b7a13604890a47c13df9b1029cf` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:48.339597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bcee2d-7d3b-4730-af29-7bfd20aab1f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cb55b7a13604890a47c13df9b1029cf)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:48.342299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bcee2d-7d3b-4730-af29-7bfd20aab1f4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:48.372140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c551f12e-de5b-45af-b3d4-37cf4f18ed00 None None] MFA Rules not processed for user `5581a720105c400f8bee8ef53813288b`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:13:48.373388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c551f12e-de5b-45af-b3d4-37cf4f18ed00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:48.484139 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f6bcee2d-7d3b-4730-af29-7bfd20aab1f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cb55b7a13604890a47c13df9b1029cf'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:48.488486 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f6bcee2d-7d3b-4730-af29-7bfd20aab1f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cb55b7a13604890a47c13df9b1029cf'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:48.490307 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:13:48.520322 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1890/3784] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:13:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:13:48.531281 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d083c2a-a2dc-45c7-8f1d-44bef33229b2 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:48.534549 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d083c2a-a2dc-45c7-8f1d-44bef33229b2 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:48.534865 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d083c2a-a2dc-45c7-8f1d-44bef33229b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:48.538776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f6bcee2d-7d3b-4730-af29-7bfd20aab1f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cb55b7a13604890a47c13df9b1029cf'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:48.560645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f6bcee2d-7d3b-4730-af29-7bfd20aab1f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cb55b7a13604890a47c13df9b1029cf'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:48.561812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f6bcee2d-7d3b-4730-af29-7bfd20aab1f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cb55b7a13604890a47c13df9b1029cf'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:48.586376 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-9d083c2a-a2dc-45c7-8f1d-44bef33229b2 None None] MFA Rules not processed for user `5581a720105c400f8bee8ef53813288b`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:13:48.589088 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9d083c2a-a2dc-45c7-8f1d-44bef33229b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:48.598294 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1895/3785] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:13:48 2022] DELETE /identity/v3/users/7cb55b7a13604890a47c13df9b1029cf => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:13:48.603775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9a4cf-5622-4036-80bf-384a6e27ed0e None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:48.604164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9a4cf-5622-4036-80bf-384a6e27ed0e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:48.604541 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9a4cf-5622-4036-80bf-384a6e27ed0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:48.607414 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1891/3786] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:13:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:13:48.677495 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-52f9a4cf-5622-4036-80bf-384a6e27ed0e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:13:48.679318 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-52f9a4cf-5622-4036-80bf-384a6e27ed0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:48.727807 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:13:48.798388 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1896/3787] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:13:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:13:48.817689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d083c2a-a2dc-45c7-8f1d-44bef33229b2 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:48.817689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9d083c2a-a2dc-45c7-8f1d-44bef33229b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:48.817917 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9a4cf-5622-4036-80bf-384a6e27ed0e None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:48.819222 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-52f9a4cf-5622-4036-80bf-384a6e27ed0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:49.027209 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d083c2a-a2dc-45c7-8f1d-44bef33229b2 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:49.127226 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9a4cf-5622-4036-80bf-384a6e27ed0e None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:49.152383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2969a-0343-446e-abcf-427329ab2d08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:49.156507 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2969a-0343-446e-abcf-427329ab2d08 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:49.157200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2969a-0343-446e-abcf-427329ab2d08 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:49.158721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2969a-0343-446e-abcf-427329ab2d08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:49.203817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297856a9-15c8-432e-8976-5f7ccb0db61c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:49.204616 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297856a9-15c8-432e-8976-5f7ccb0db61c service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:49.205071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297856a9-15c8-432e-8976-5f7ccb0db61c service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:49.205935 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297856a9-15c8-432e-8976-5f7ccb0db61c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:49.220331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297856a9-15c8-432e-8976-5f7ccb0db61c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:49.221983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297856a9-15c8-432e-8976-5f7ccb0db61c service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:49.233799 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1892/3788] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:13:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:13:49.269778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2969a-0343-446e-abcf-427329ab2d08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:49.270558 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2969a-0343-446e-abcf-427329ab2d08 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:49.287315 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1897/3789] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:13:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:13:50.174225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297856a9-15c8-432e-8976-5f7ccb0db61c service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:50.176293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-297856a9-15c8-432e-8976-5f7ccb0db61c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:50.275810 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297856a9-15c8-432e-8976-5f7ccb0db61c service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:50.283786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3029ea-63c5-41ac-85c6-48f7ebfdf77d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efcee9b21ea94b1b8e5c9c5acb35839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:50.284559 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3029ea-63c5-41ac-85c6-48f7ebfdf77d service glance] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:50.284957 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3029ea-63c5-41ac-85c6-48f7ebfdf77d service glance] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:50.285352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3029ea-63c5-41ac-85c6-48f7ebfdf77d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:50.288426 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-da3029ea-63c5-41ac-85c6-48f7ebfdf77d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:50.307044 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3029ea-63c5-41ac-85c6-48f7ebfdf77d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:50.308644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3029ea-63c5-41ac-85c6-48f7ebfdf77d service glance] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:50.330554 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1893/3790] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:13:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:13:50.548928 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2969a-0343-446e-abcf-427329ab2d08 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:50.550513 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-39b2969a-0343-446e-abcf-427329ab2d08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:50.572283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2969a-0343-446e-abcf-427329ab2d08 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:50.581320 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f16558-9bb4-42a3-896a-422a88c6aa9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:50.582382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f16558-9bb4-42a3-896a-422a88c6aa9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:50.583039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f16558-9bb4-42a3-896a-422a88c6aa9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:50.583698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f16558-9bb4-42a3-896a-422a88c6aa9c admin admin] PATH_INFO: `/v3/projects/29408e16bfb0498590bc9bdd0f56c778` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:50.588026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f16558-9bb4-42a3-896a-422a88c6aa9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=29408e16bfb0498590bc9bdd0f56c778)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:50.590662 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f16558-9bb4-42a3-896a-422a88c6aa9c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:50.711300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3029ea-63c5-41ac-85c6-48f7ebfdf77d service glance] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:50.727565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3029ea-63c5-41ac-85c6-48f7ebfdf77d service glance] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:50.729515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-41f16558-9bb4-42a3-896a-422a88c6aa9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29408e16bfb0498590bc9bdd0f56c778', 'request_id': 'req-41f16558-9bb4-42a3-896a-422a88c6aa9c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:50.750473 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-41f16558-9bb4-42a3-896a-422a88c6aa9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29408e16bfb0498590bc9bdd0f56c778', 'request_id': 'req-41f16558-9bb4-42a3-896a-422a88c6aa9c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:50.759757 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:13:50.762428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-41f16558-9bb4-42a3-896a-422a88c6aa9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29408e16bfb0498590bc9bdd0f56c778', 'request_id': 'req-41f16558-9bb4-42a3-896a-422a88c6aa9c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:50.796404 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-41f16558-9bb4-42a3-896a-422a88c6aa9c admin admin] The token cache is being invalidate because project 29408e16bfb0498590bc9bdd0f56c778 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:13:50.796816 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-41f16558-9bb4-42a3-896a-422a88c6aa9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:50.797844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-41f16558-9bb4-42a3-896a-422a88c6aa9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:50.801222 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1898/3791] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:13:50 2022] DELETE /identity/v3/projects/29408e16bfb0498590bc9bdd0f56c778 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:13:50.806226 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f16558-9bb4-42a3-896a-422a88c6aa9c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:50.807766 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-41f16558-9bb4-42a3-896a-422a88c6aa9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:50.845026 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:13:50.860947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60199545-afd9-488c-b887-3808bfff7ad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:50.864771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60199545-afd9-488c-b887-3808bfff7ad3 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:50.865073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60199545-afd9-488c-b887-3808bfff7ad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:50.865353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60199545-afd9-488c-b887-3808bfff7ad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:50.873495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-60199545-afd9-488c-b887-3808bfff7ad3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:50.894534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60199545-afd9-488c-b887-3808bfff7ad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:50.894987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60199545-afd9-488c-b887-3808bfff7ad3 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:50.927271 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1894/3792] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:13:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:13:50.981029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f16558-9bb4-42a3-896a-422a88c6aa9c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:51.010823 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d9433-933f-4f18-8900-9653b19f8683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:51.011772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d9433-933f-4f18-8900-9653b19f8683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:51.013953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d9433-933f-4f18-8900-9653b19f8683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:51.013953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d9433-933f-4f18-8900-9653b19f8683 admin admin] PATH_INFO: `/v3/users/7c209fbe94e945e6afa27155b43118e8` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:51.013953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d9433-933f-4f18-8900-9653b19f8683 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c209fbe94e945e6afa27155b43118e8)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:51.016780 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d9433-933f-4f18-8900-9653b19f8683 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:51.083893 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60199545-afd9-488c-b887-3808bfff7ad3 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:51.086578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-60199545-afd9-488c-b887-3808bfff7ad3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:51.111758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60199545-afd9-488c-b887-3808bfff7ad3 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:51.136191 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb4438-892e-40bb-84a5-08e0ff897683 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:51.136924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb4438-892e-40bb-84a5-08e0ff897683 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:51.137713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb4438-892e-40bb-84a5-08e0ff897683 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:51.137993 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb4438-892e-40bb-84a5-08e0ff897683 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:51.143170 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2cbb4438-892e-40bb-84a5-08e0ff897683 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:51.156560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-793d9433-933f-4f18-8900-9653b19f8683 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c209fbe94e945e6afa27155b43118e8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:51.157377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-793d9433-933f-4f18-8900-9653b19f8683 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c209fbe94e945e6afa27155b43118e8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:51.172271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-793d9433-933f-4f18-8900-9653b19f8683 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c209fbe94e945e6afa27155b43118e8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:51.196104 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-793d9433-933f-4f18-8900-9653b19f8683 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c209fbe94e945e6afa27155b43118e8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:51.196729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-793d9433-933f-4f18-8900-9653b19f8683 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c209fbe94e945e6afa27155b43118e8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:51.238531 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1899/3793] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:13:50 2022] DELETE /identity/v3/users/7c209fbe94e945e6afa27155b43118e8 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:13:51.350748 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb4438-892e-40bb-84a5-08e0ff897683 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:51.357988 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb4438-892e-40bb-84a5-08e0ff897683 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:51.397555 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1895/3794] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:13:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:13:52.237579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d9433-933f-4f18-8900-9653b19f8683 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:52.239202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-793d9433-933f-4f18-8900-9653b19f8683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:52.460344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d9433-933f-4f18-8900-9653b19f8683 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:52.481251 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a54d0c-4d14-4475-b747-8277fb419a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:52.482071 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a54d0c-4d14-4475-b747-8277fb419a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:52.482424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a54d0c-4d14-4475-b747-8277fb419a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:52.486169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a54d0c-4d14-4475-b747-8277fb419a57 admin admin] PATH_INFO: `/v3/projects/980a8c150ed64398ae1ecff6c4ce79b0` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:52.490229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a54d0c-4d14-4475-b747-8277fb419a57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=980a8c150ed64398ae1ecff6c4ce79b0)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:52.493025 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a54d0c-4d14-4475-b747-8277fb419a57 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:52.557960 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:13:52.635234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b7a54d0c-4d14-4475-b747-8277fb419a57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '980a8c150ed64398ae1ecff6c4ce79b0', 'request_id': 'req-b7a54d0c-4d14-4475-b747-8277fb419a57'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:52.648290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b7a54d0c-4d14-4475-b747-8277fb419a57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '980a8c150ed64398ae1ecff6c4ce79b0', 'request_id': 'req-b7a54d0c-4d14-4475-b747-8277fb419a57'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:52.660224 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b7a54d0c-4d14-4475-b747-8277fb419a57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '980a8c150ed64398ae1ecff6c4ce79b0', 'request_id': 'req-b7a54d0c-4d14-4475-b747-8277fb419a57'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:52.715275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b7a54d0c-4d14-4475-b747-8277fb419a57 admin admin] The token cache is being invalidate because project 980a8c150ed64398ae1ecff6c4ce79b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:13:52.716574 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b7a54d0c-4d14-4475-b747-8277fb419a57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:52.718830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b7a54d0c-4d14-4475-b747-8277fb419a57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:13:52.737662 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1900/3795] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:13:52 2022] DELETE /identity/v3/projects/980a8c150ed64398ae1ecff6c4ce79b0 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:13:52.742306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514d46c-b07b-44fd-b861-0b5e10e2ef72 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:52.742839 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514d46c-b07b-44fd-b861-0b5e10e2ef72 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:52.742839 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514d46c-b07b-44fd-b861-0b5e10e2ef72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:52.798298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a514d46c-b07b-44fd-b861-0b5e10e2ef72 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:13:52.799667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a514d46c-b07b-44fd-b861-0b5e10e2ef72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:52.925754 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1896/3796] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:13:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:13:52.935395 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fed405-d43b-409c-b688-eab85611dabe None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:52.935952 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fed405-d43b-409c-b688-eab85611dabe None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:52.936302 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fed405-d43b-409c-b688-eab85611dabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:52.996946 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-51fed405-d43b-409c-b688-eab85611dabe None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:13:52.999644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-51fed405-d43b-409c-b688-eab85611dabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:53.044823 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1901/3797] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:13:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:13:53.048278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514d46c-b07b-44fd-b861-0b5e10e2ef72 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:53.081395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514d46c-b07b-44fd-b861-0b5e10e2ef72 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:53.104382 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f98a6-4820-4a2d-8038-8af8c437f6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:53.109366 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f98a6-4820-4a2d-8038-8af8c437f6a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:53.109714 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f98a6-4820-4a2d-8038-8af8c437f6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:53.110043 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f98a6-4820-4a2d-8038-8af8c437f6a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:53.110992 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f98a6-4820-4a2d-8038-8af8c437f6a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:13:53.111317 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f98a6-4820-4a2d-8038-8af8c437f6a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:53.117688 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f98a6-4820-4a2d-8038-8af8c437f6a2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:53.142401 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1897/3798] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:13:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:13:53.149093 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fed405-d43b-409c-b688-eab85611dabe None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:53.162029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fed405-d43b-409c-b688-eab85611dabe None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:53.171352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f7628-806c-452a-8ab2-fb62865c4c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:53.172171 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f7628-806c-452a-8ab2-fb62865c4c6c admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:53.173031 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f7628-806c-452a-8ab2-fb62865c4c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:53.173530 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f7628-806c-452a-8ab2-fb62865c4c6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:53.174387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f7628-806c-452a-8ab2-fb62865c4c6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:53.178513 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f7628-806c-452a-8ab2-fb62865c4c6c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:53.235751 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1902/3799] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:13:53 2022] POST /identity/v3/projects => generated 383 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:13:53.239869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f98a6-4820-4a2d-8038-8af8c437f6a2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:53.256380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f98a6-4820-4a2d-8038-8af8c437f6a2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:53.492801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff49bf-93b7-4740-a87f-f0ae615cd7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:53.493425 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff49bf-93b7-4740-a87f-f0ae615cd7e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:53.493742 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff49bf-93b7-4740-a87f-f0ae615cd7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:53.494153 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff49bf-93b7-4740-a87f-f0ae615cd7e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:53.494792 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff49bf-93b7-4740-a87f-f0ae615cd7e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:53.499886 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff49bf-93b7-4740-a87f-f0ae615cd7e3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:53.523089 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:13:53.547313 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1898/3800] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:13:53 2022] POST /identity/v3/users => generated 292 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:13:53.551879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f7628-806c-452a-8ab2-fb62865c4c6c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:53.573005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f7628-806c-452a-8ab2-fb62865c4c6c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:53.585812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38e9cc-5cac-4739-acbe-f34ae29562b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:53.586086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38e9cc-5cac-4739-acbe-f34ae29562b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:53.590849 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38e9cc-5cac-4739-acbe-f34ae29562b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:53.591167 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38e9cc-5cac-4739-acbe-f34ae29562b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:53.593599 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38e9cc-5cac-4739-acbe-f34ae29562b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:53.602262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38e9cc-5cac-4739-acbe-f34ae29562b1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:53.620443 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1903/3801] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:13:53.621963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff49bf-93b7-4740-a87f-f0ae615cd7e3 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:53.638507 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff49bf-93b7-4740-a87f-f0ae615cd7e3 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:53.646235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967ab55-a7e3-40d1-bbbe-7dd192d93e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:53.646927 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967ab55-a7e3-40d1-bbbe-7dd192d93e86 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:53.647358 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967ab55-a7e3-40d1-bbbe-7dd192d93e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:53.647640 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967ab55-a7e3-40d1-bbbe-7dd192d93e86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:53.649042 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0967ab55-a7e3-40d1-bbbe-7dd192d93e86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:53.651136 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0967ab55-a7e3-40d1-bbbe-7dd192d93e86 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:53.666558 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1899/3802] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:13:53.671281 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38e9cc-5cac-4739-acbe-f34ae29562b1 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:53.683038 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38e9cc-5cac-4739-acbe-f34ae29562b1 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:53.688328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf4cac-e5af-4f82-882b-33b7be4dbd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:53.688998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf4cac-e5af-4f82-882b-33b7be4dbd95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:53.689518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf4cac-e5af-4f82-882b-33b7be4dbd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:53.689803 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf4cac-e5af-4f82-882b-33b7be4dbd95 admin admin] PATH_INFO: `/v3/projects/d83f423f59844458a82413b3e71e7366/users/21f0adb3fe9f454b83e22dbdf526ee49/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:53.710628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf4cac-e5af-4f82-882b-33b7be4dbd95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d83f423f59844458a82413b3e71e7366, user_id=21f0adb3fe9f454b83e22dbdf526ee49, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:53.726848 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf4cac-e5af-4f82-882b-33b7be4dbd95 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:53.747879 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1904/3803] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:13:53 2022] PUT /identity/v3/projects/d83f423f59844458a82413b3e71e7366/users/21f0adb3fe9f454b83e22dbdf526ee49/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:13:53.749913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcaa59-7d81-4e81-94e6-c11e50890758 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:53.750382 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcaa59-7d81-4e81-94e6-c11e50890758 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:53.750652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcaa59-7d81-4e81-94e6-c11e50890758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:53.797312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b3bcaa59-7d81-4e81-94e6-c11e50890758 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:13:53.802755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b3bcaa59-7d81-4e81-94e6-c11e50890758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:53.913302 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1900/3804] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:13:53.947842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf4cac-e5af-4f82-882b-33b7be4dbd95 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:53.950937 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e9cf4cac-e5af-4f82-882b-33b7be4dbd95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:54.053749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf4cac-e5af-4f82-882b-33b7be4dbd95 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:54.058540 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91315c-0f22-4d93-8bfe-8badf2de4beb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:54.059303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91315c-0f22-4d93-8bfe-8badf2de4beb service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:54.059718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91315c-0f22-4d93-8bfe-8badf2de4beb service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:54.060721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91315c-0f22-4d93-8bfe-8badf2de4beb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:54.078716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91315c-0f22-4d93-8bfe-8badf2de4beb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:54.098534 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91315c-0f22-4d93-8bfe-8badf2de4beb service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:54.134966 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1905/3805] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:13:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:13:55.582851 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38af64-8888-4457-8e7e-0a08e58eb6ac None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:55.583835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38af64-8888-4457-8e7e-0a08e58eb6ac None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:55.584323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38af64-8888-4457-8e7e-0a08e58eb6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:55.619502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-3e38af64-8888-4457-8e7e-0a08e58eb6ac None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:13:55.621141 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3e38af64-8888-4457-8e7e-0a08e58eb6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:55.751315 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1901/3806] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:13:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:13:55.772695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91315c-0f22-4d93-8bfe-8badf2de4beb service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:13:55.774162 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-aa91315c-0f22-4d93-8bfe-8badf2de4beb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:13:55.880628 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:13:55.930663 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91315c-0f22-4d93-8bfe-8badf2de4beb service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:13:55.948176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8589d4-d03d-4abc-96ef-24d3d776a330 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:13:55.948883 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8589d4-d03d-4abc-96ef-24d3d776a330 service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:13:55.949421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8589d4-d03d-4abc-96ef-24d3d776a330 service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:13:55.949731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8589d4-d03d-4abc-96ef-24d3d776a330 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:13:55.967559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8589d4-d03d-4abc-96ef-24d3d776a330 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:13:55.969755 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8589d4-d03d-4abc-96ef-24d3d776a330 service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:13:55.983974 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1906/3807] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:13:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:14:05.745864 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:INSERT=2,keystone:SELECT=59 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:14:05.977788 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=14 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:14:06.306860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38af64-8888-4457-8e7e-0a08e58eb6ac None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:06.308492 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3e38af64-8888-4457-8e7e-0a08e58eb6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:06.336130 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38af64-8888-4457-8e7e-0a08e58eb6ac None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:06.348011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f576b4e-17a5-4462-8fb9-fdc1af29a822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:06.348877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f576b4e-17a5-4462-8fb9-fdc1af29a822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:06.349718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f576b4e-17a5-4462-8fb9-fdc1af29a822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:06.350804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f576b4e-17a5-4462-8fb9-fdc1af29a822 admin admin] PATH_INFO: `/v3/users/13d1460667de427b9dded0375954a6ac` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:06.356118 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f576b4e-17a5-4462-8fb9-fdc1af29a822 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13d1460667de427b9dded0375954a6ac)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:06.358360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f576b4e-17a5-4462-8fb9-fdc1af29a822 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:06.490255 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5f576b4e-17a5-4462-8fb9-fdc1af29a822 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13d1460667de427b9dded0375954a6ac'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:06.491736 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5f576b4e-17a5-4462-8fb9-fdc1af29a822 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13d1460667de427b9dded0375954a6ac'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:06.515063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5f576b4e-17a5-4462-8fb9-fdc1af29a822 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13d1460667de427b9dded0375954a6ac'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:06.529898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5f576b4e-17a5-4462-8fb9-fdc1af29a822 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13d1460667de427b9dded0375954a6ac'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:06.531008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5f576b4e-17a5-4462-8fb9-fdc1af29a822 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13d1460667de427b9dded0375954a6ac'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:06.609656 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1902/3808] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:14:06 2022] DELETE /identity/v3/users/13d1460667de427b9dded0375954a6ac => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:14:07.689239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8589d4-d03d-4abc-96ef-24d3d776a330 service swift] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:07.705414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ddc61-bf44-4f19-bf9e-c459ee9f38d5 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:07.705933 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ddc61-bf44-4f19-bf9e-c459ee9f38d5 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:07.706028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ddc61-bf44-4f19-bf9e-c459ee9f38d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:07.723866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8589d4-d03d-4abc-96ef-24d3d776a330 service swift] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:07.774260 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-ed5ddc61-bf44-4f19-bf9e-c459ee9f38d5 None None] MFA Rules not processed for user `da8b6af4e9814647aa1334ca4f66c87c`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:14:07.775604 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ed5ddc61-bf44-4f19-bf9e-c459ee9f38d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:07.888754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b23e9-edc2-43f1-b50c-292bbd6d1f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:07.889641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b23e9-edc2-43f1-b50c-292bbd6d1f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:07.890303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b23e9-edc2-43f1-b50c-292bbd6d1f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:07.890850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b23e9-edc2-43f1-b50c-292bbd6d1f80 admin admin] PATH_INFO: `/v3/projects/5a480e825064479f9c564e95ae3a692b` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:07.892125 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b23e9-edc2-43f1-b50c-292bbd6d1f80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a480e825064479f9c564e95ae3a692b)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:07.895453 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b23e9-edc2-43f1-b50c-292bbd6d1f80 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:07.997811 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1903/3809] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:14:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:14:08.004130 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083f0a2-74c2-41df-ae7e-fdf62ed3d60d None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:08.004347 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083f0a2-74c2-41df-ae7e-fdf62ed3d60d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:08.004533 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083f0a2-74c2-41df-ae7e-fdf62ed3d60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:08.035803 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-134b23e9-edc2-43f1-b50c-292bbd6d1f80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a480e825064479f9c564e95ae3a692b', 'request_id': 'req-134b23e9-edc2-43f1-b50c-292bbd6d1f80'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:08.046589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-1083f0a2-74c2-41df-ae7e-fdf62ed3d60d None None] MFA Rules not processed for user `da8b6af4e9814647aa1334ca4f66c87c`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:14:08.047845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1083f0a2-74c2-41df-ae7e-fdf62ed3d60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:08.051460 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-134b23e9-edc2-43f1-b50c-292bbd6d1f80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a480e825064479f9c564e95ae3a692b', 'request_id': 'req-134b23e9-edc2-43f1-b50c-292bbd6d1f80'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:08.066806 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-134b23e9-edc2-43f1-b50c-292bbd6d1f80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a480e825064479f9c564e95ae3a692b', 'request_id': 'req-134b23e9-edc2-43f1-b50c-292bbd6d1f80'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:08.105264 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-134b23e9-edc2-43f1-b50c-292bbd6d1f80 admin admin] The token cache is being invalidate because project 5a480e825064479f9c564e95ae3a692b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:14:08.107351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-134b23e9-edc2-43f1-b50c-292bbd6d1f80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:08.111318 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-134b23e9-edc2-43f1-b50c-292bbd6d1f80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:08.114832 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1907/3810] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:14:07 2022] DELETE /identity/v3/projects/5a480e825064479f9c564e95ae3a692b => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:14:08.121640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306a0f5-9ef1-48dc-8f07-bfcabf1ac740 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:08.121999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306a0f5-9ef1-48dc-8f07-bfcabf1ac740 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:08.122369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306a0f5-9ef1-48dc-8f07-bfcabf1ac740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:08.173556 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1904/3811] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:14:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:14:08.192314 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-6306a0f5-9ef1-48dc-8f07-bfcabf1ac740 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:14:08.194752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6306a0f5-9ef1-48dc-8f07-bfcabf1ac740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:08.370147 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1034db7-69d6-4cbc-b6d2-3b3b40a960b9 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:08.370508 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1034db7-69d6-4cbc-b6d2-3b3b40a960b9 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:08.370775 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1908/3812] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:14:08.370982 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1034db7-69d6-4cbc-b6d2-3b3b40a960b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:08.446950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d1034db7-69d6-4cbc-b6d2-3b3b40a960b9 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:14:08.452076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d1034db7-69d6-4cbc-b6d2-3b3b40a960b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:08.477415 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1905/3813] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:14:08.482304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306a0f5-9ef1-48dc-8f07-bfcabf1ac740 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:08.496926 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306a0f5-9ef1-48dc-8f07-bfcabf1ac740 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:08.512128 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff0c41-33de-49fe-b603-b610df872b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:08.512860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff0c41-33de-49fe-b603-b610df872b1a admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:08.513216 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff0c41-33de-49fe-b603-b610df872b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:08.513732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff0c41-33de-49fe-b603-b610df872b1a admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:08.516159 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff0c41-33de-49fe-b603-b610df872b1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:14:08.525280 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff0c41-33de-49fe-b603-b610df872b1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:08.529116 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff0c41-33de-49fe-b603-b610df872b1a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:08.565386 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1909/3814] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:14:08.569912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1034db7-69d6-4cbc-b6d2-3b3b40a960b9 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:08.581782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1034db7-69d6-4cbc-b6d2-3b3b40a960b9 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:08.596441 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dda5ee-0c2b-4623-a9c4-fcf0dfcd9c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:08.597395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dda5ee-0c2b-4623-a9c4-fcf0dfcd9c39 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:08.598243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dda5ee-0c2b-4623-a9c4-fcf0dfcd9c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:08.598243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dda5ee-0c2b-4623-a9c4-fcf0dfcd9c39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:08.598805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dda5ee-0c2b-4623-a9c4-fcf0dfcd9c39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:08.601370 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dda5ee-0c2b-4623-a9c4-fcf0dfcd9c39 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:08.638071 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:14:08.705863 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1906/3815] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:14:08 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:14:08.707505 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff0c41-33de-49fe-b603-b610df872b1a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:08.732184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff0c41-33de-49fe-b603-b610df872b1a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:08.787635 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:14:08.985140 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa8a13-0b0f-456b-b03b-c1ca4b98c73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:08.986392 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa8a13-0b0f-456b-b03b-c1ca4b98c73f admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:08.987080 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa8a13-0b0f-456b-b03b-c1ca4b98c73f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:08.987437 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa8a13-0b0f-456b-b03b-c1ca4b98c73f admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:08.988248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa8a13-0b0f-456b-b03b-c1ca4b98c73f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:08.991867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa8a13-0b0f-456b-b03b-c1ca4b98c73f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:09.049629 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1910/3816] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:14:08 2022] POST /identity/v3/users => generated 294 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:14:09.051996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dda5ee-0c2b-4623-a9c4-fcf0dfcd9c39 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:09.069014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dda5ee-0c2b-4623-a9c4-fcf0dfcd9c39 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:09.074618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4b7e6-9a8d-4245-977c-10779f9f7b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:09.079757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4b7e6-9a8d-4245-977c-10779f9f7b78 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:09.080040 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4b7e6-9a8d-4245-977c-10779f9f7b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:09.080312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4b7e6-9a8d-4245-977c-10779f9f7b78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:09.081925 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4b7e6-9a8d-4245-977c-10779f9f7b78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:09.084127 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4b7e6-9a8d-4245-977c-10779f9f7b78 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:09.109187 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1907/3817] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:14:09.112501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa8a13-0b0f-456b-b03b-c1ca4b98c73f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:09.128114 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa8a13-0b0f-456b-b03b-c1ca4b98c73f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:09.140916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3074484-c89b-4e36-8a0f-918548fa05b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:09.141751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3074484-c89b-4e36-8a0f-918548fa05b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:09.142112 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3074484-c89b-4e36-8a0f-918548fa05b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:09.142455 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3074484-c89b-4e36-8a0f-918548fa05b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:09.143237 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3074484-c89b-4e36-8a0f-918548fa05b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:09.144939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3074484-c89b-4e36-8a0f-918548fa05b9 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:09.189689 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1911/3818] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:14:09.193841 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4b7e6-9a8d-4245-977c-10779f9f7b78 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:09.218126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4b7e6-9a8d-4245-977c-10779f9f7b78 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:09.231551 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981e1da-3c13-45d5-93d8-da0d38e03d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:09.232432 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981e1da-3c13-45d5-93d8-da0d38e03d46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:09.233130 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981e1da-3c13-45d5-93d8-da0d38e03d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:09.233493 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981e1da-3c13-45d5-93d8-da0d38e03d46 admin admin] PATH_INFO: `/v3/projects/8881a3a48f104539b754874c6674562b/users/29e00b64247c492c99c32ad85827ddd7/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:09.302578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1981e1da-3c13-45d5-93d8-da0d38e03d46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8881a3a48f104539b754874c6674562b, user_id=29e00b64247c492c99c32ad85827ddd7, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:09.305475 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1981e1da-3c13-45d5-93d8-da0d38e03d46 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:09.353562 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1908/3819] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:14:09 2022] PUT /identity/v3/projects/8881a3a48f104539b754874c6674562b/users/29e00b64247c492c99c32ad85827ddd7/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:14:09.358725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2efaf-0962-45de-9f75-c87ceb1de60b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:09.359096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2efaf-0962-45de-9f75-c87ceb1de60b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:09.359438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2efaf-0962-45de-9f75-c87ceb1de60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:09.399199 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-d8f2efaf-0962-45de-9f75-c87ceb1de60b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:14:09.404289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d8f2efaf-0962-45de-9f75-c87ceb1de60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:09.569353 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1912/3820] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:14:09.640334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981e1da-3c13-45d5-93d8-da0d38e03d46 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:09.642836 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1981e1da-3c13-45d5-93d8-da0d38e03d46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:09.759125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981e1da-3c13-45d5-93d8-da0d38e03d46 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:09.764075 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1c614-da6f-4850-b22d-4bb1b7242d20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:09.764873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1c614-da6f-4850-b22d-4bb1b7242d20 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:09.765530 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1c614-da6f-4850-b22d-4bb1b7242d20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:09.765977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1c614-da6f-4850-b22d-4bb1b7242d20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:09.777751 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1c614-da6f-4850-b22d-4bb1b7242d20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:09.780083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1c614-da6f-4850-b22d-4bb1b7242d20 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:09.805687 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1909/3821] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:14:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:14:12.593187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb2670-37e3-46ba-9a61-e0826848f255 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:12.593847 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb2670-37e3-46ba-9a61-e0826848f255 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:12.594154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb2670-37e3-46ba-9a61-e0826848f255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:12.650113 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-7cdb2670-37e3-46ba-9a61-e0826848f255 None None] MFA Rules not processed for user `21f0adb3fe9f454b83e22dbdf526ee49`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:14:12.654122 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7cdb2670-37e3-46ba-9a61-e0826848f255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:12.822204 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1913/3822] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:14:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:14:12.827527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1c614-da6f-4850-b22d-4bb1b7242d20 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:12.829099 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-15d1c614-da6f-4850-b22d-4bb1b7242d20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:12.848672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1c614-da6f-4850-b22d-4bb1b7242d20 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:12.872767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940bb5ac-baba-4cc4-b5ac-a83a0a1b5e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:12.873875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bb5ac-baba-4cc4-b5ac-a83a0a1b5e41 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:12.874900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bb5ac-baba-4cc4-b5ac-a83a0a1b5e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:12.875445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bb5ac-baba-4cc4-b5ac-a83a0a1b5e41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:12.876796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940bb5ac-baba-4cc4-b5ac-a83a0a1b5e41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:12.894105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940bb5ac-baba-4cc4-b5ac-a83a0a1b5e41 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:12.950760 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1910/3823] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:14:12 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:14:12.955104 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb2670-37e3-46ba-9a61-e0826848f255 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:12.972200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb2670-37e3-46ba-9a61-e0826848f255 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:13.055694 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:14:13.180016 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff3363-aef1-4464-85d8-43fa1d58a0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:13.180878 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff3363-aef1-4464-85d8-43fa1d58a0e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:13.181091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff3363-aef1-4464-85d8-43fa1d58a0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:13.181677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff3363-aef1-4464-85d8-43fa1d58a0e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:13.182801 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff3363-aef1-4464-85d8-43fa1d58a0e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:13.189148 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff3363-aef1-4464-85d8-43fa1d58a0e3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:13.247176 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940bb5ac-baba-4cc4-b5ac-a83a0a1b5e41 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:13.249055 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1914/3824] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:14:12 2022] POST /identity/v3/users => generated 299 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:14:13.263024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940bb5ac-baba-4cc4-b5ac-a83a0a1b5e41 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:13.274006 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9889c73-6775-41d1-9df8-340c49daceeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:13.275356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9889c73-6775-41d1-9df8-340c49daceeb admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:13.276253 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9889c73-6775-41d1-9df8-340c49daceeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:13.277195 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9889c73-6775-41d1-9df8-340c49daceeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:13.287265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9889c73-6775-41d1-9df8-340c49daceeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:13.292425 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9889c73-6775-41d1-9df8-340c49daceeb admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:13.314430 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1911/3825] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:14:13.319259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff3363-aef1-4464-85d8-43fa1d58a0e3 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:13.334712 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff3363-aef1-4464-85d8-43fa1d58a0e3 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:13.353769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8fd1f-4411-4527-84e2-91123b9dafa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:13.354464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8fd1f-4411-4527-84e2-91123b9dafa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:13.354748 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8fd1f-4411-4527-84e2-91123b9dafa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:13.355027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8fd1f-4411-4527-84e2-91123b9dafa4 admin admin] PATH_INFO: `/v3/projects/28bceed415a7436b8f33f459898cc272/users/832547e11ed64c46bcd1eaf2de197e43/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:13.390261 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8fd1f-4411-4527-84e2-91123b9dafa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28bceed415a7436b8f33f459898cc272, user_id=832547e11ed64c46bcd1eaf2de197e43, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:13.398520 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8fd1f-4411-4527-84e2-91123b9dafa4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:13.433956 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1915/3826] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:14:13 2022] PUT /identity/v3/projects/28bceed415a7436b8f33f459898cc272/users/832547e11ed64c46bcd1eaf2de197e43/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:14:13.438306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9889c73-6775-41d1-9df8-340c49daceeb admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:13.467418 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9889c73-6775-41d1-9df8-340c49daceeb admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:13.637684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7cba8c-309e-4c10-bb5b-c223682f569a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:13.638437 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7cba8c-309e-4c10-bb5b-c223682f569a admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:13.638719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7cba8c-309e-4c10-bb5b-c223682f569a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:13.639394 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7cba8c-309e-4c10-bb5b-c223682f569a admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:13.640676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7cba8c-309e-4c10-bb5b-c223682f569a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:13.642360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7cba8c-309e-4c10-bb5b-c223682f569a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:13.668750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8fd1f-4411-4527-84e2-91123b9dafa4 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:13.672210 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1912/3827] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:14:13.683709 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8fd1f-4411-4527-84e2-91123b9dafa4 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:13.699409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a2146-e673-47c5-9336-fde109da1aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:13.700373 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a2146-e673-47c5-9336-fde109da1aa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:13.701736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a2146-e673-47c5-9336-fde109da1aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:13.702053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a2146-e673-47c5-9336-fde109da1aa0 admin admin] PATH_INFO: `/v3/projects/28bceed415a7436b8f33f459898cc272/users/832547e11ed64c46bcd1eaf2de197e43/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:13.722062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a2146-e673-47c5-9336-fde109da1aa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28bceed415a7436b8f33f459898cc272, user_id=832547e11ed64c46bcd1eaf2de197e43, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:13.725275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a2146-e673-47c5-9336-fde109da1aa0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:13.745943 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1916/3828] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:14:13 2022] PUT /identity/v3/projects/28bceed415a7436b8f33f459898cc272/users/832547e11ed64c46bcd1eaf2de197e43/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:14:15.650600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7cba8c-309e-4c10-bb5b-c223682f569a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:15.652660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bb7cba8c-309e-4c10-bb5b-c223682f569a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:15.679788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7cba8c-309e-4c10-bb5b-c223682f569a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:15.719540 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:14:15.805512 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0b4be-32c4-4e38-8955-bf90421bb37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:15.807232 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0b4be-32c4-4e38-8955-bf90421bb37c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:15.807676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0b4be-32c4-4e38-8955-bf90421bb37c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:15.808015 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0b4be-32c4-4e38-8955-bf90421bb37c admin admin] PATH_INFO: `/v3/users/1ec23e9ee11c43d8a016bf37576c7f6d` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:15.810019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf0b4be-32c4-4e38-8955-bf90421bb37c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ec23e9ee11c43d8a016bf37576c7f6d)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:15.812020 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf0b4be-32c4-4e38-8955-bf90421bb37c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:15.948727 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7bf0b4be-32c4-4e38-8955-bf90421bb37c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ec23e9ee11c43d8a016bf37576c7f6d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:15.949738 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7bf0b4be-32c4-4e38-8955-bf90421bb37c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ec23e9ee11c43d8a016bf37576c7f6d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:15.961731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7bf0b4be-32c4-4e38-8955-bf90421bb37c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ec23e9ee11c43d8a016bf37576c7f6d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:15.977844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7bf0b4be-32c4-4e38-8955-bf90421bb37c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ec23e9ee11c43d8a016bf37576c7f6d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:15.978547 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7bf0b4be-32c4-4e38-8955-bf90421bb37c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ec23e9ee11c43d8a016bf37576c7f6d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:16.034497 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1913/3829] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:14:15 2022] DELETE /identity/v3/users/1ec23e9ee11c43d8a016bf37576c7f6d => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:14:17.135263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a2146-e673-47c5-9336-fde109da1aa0 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:17.137316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-028a2146-e673-47c5-9336-fde109da1aa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:17.160143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a2146-e673-47c5-9336-fde109da1aa0 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:17.322830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eacf4b-11f4-4725-ad13-74e4375b47bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:17.323647 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eacf4b-11f4-4725-ad13-74e4375b47bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:17.324059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eacf4b-11f4-4725-ad13-74e4375b47bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:17.324432 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eacf4b-11f4-4725-ad13-74e4375b47bc admin admin] PATH_INFO: `/v3/projects/a7c6e9c3614a49dbb433b9fb3168e09a` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:17.327661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eacf4b-11f4-4725-ad13-74e4375b47bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7c6e9c3614a49dbb433b9fb3168e09a)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:17.338898 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eacf4b-11f4-4725-ad13-74e4375b47bc admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:17.508085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-84eacf4b-11f4-4725-ad13-74e4375b47bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7c6e9c3614a49dbb433b9fb3168e09a', 'request_id': 'req-84eacf4b-11f4-4725-ad13-74e4375b47bc'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:17.529470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-84eacf4b-11f4-4725-ad13-74e4375b47bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7c6e9c3614a49dbb433b9fb3168e09a', 'request_id': 'req-84eacf4b-11f4-4725-ad13-74e4375b47bc'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:17.537966 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-84eacf4b-11f4-4725-ad13-74e4375b47bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7c6e9c3614a49dbb433b9fb3168e09a', 'request_id': 'req-84eacf4b-11f4-4725-ad13-74e4375b47bc'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:17.559996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-84eacf4b-11f4-4725-ad13-74e4375b47bc admin admin] The token cache is being invalidate because project a7c6e9c3614a49dbb433b9fb3168e09a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:14:17.560301 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-84eacf4b-11f4-4725-ad13-74e4375b47bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:17.569933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-84eacf4b-11f4-4725-ad13-74e4375b47bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:17.575130 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1917/3830] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:14:17 2022] DELETE /identity/v3/projects/a7c6e9c3614a49dbb433b9fb3168e09a => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:14:17.577912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5977a2-f467-4302-9c7e-5bba07f41698 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:17.578395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5977a2-f467-4302-9c7e-5bba07f41698 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:17.578502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5977a2-f467-4302-9c7e-5bba07f41698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:17.613627 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-ff5977a2-f467-4302-9c7e-5bba07f41698 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:14:17.616399 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ff5977a2-f467-4302-9c7e-5bba07f41698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:17.755106 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1914/3831] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:14:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:14:17.758079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009406c-f3bd-48d4-acbd-357b1dbee0ed None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:17.758434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009406c-f3bd-48d4-acbd-357b1dbee0ed None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:17.758802 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009406c-f3bd-48d4-acbd-357b1dbee0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:17.793280 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5dee4-e153-4d95-8bbb-93e27a813536 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:17.793612 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5dee4-e153-4d95-8bbb-93e27a813536 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:17.793977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5dee4-e153-4d95-8bbb-93e27a813536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:17.803931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-5009406c-f3bd-48d4-acbd-357b1dbee0ed None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:14:17.805232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5009406c-f3bd-48d4-acbd-357b1dbee0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:17.826428 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1918/3832] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:14:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:14:17.830768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009406c-f3bd-48d4-acbd-357b1dbee0ed None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:17.835915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-cfd5dee4-e153-4d95-8bbb-93e27a813536 None None] MFA Rules not processed for user `5581a720105c400f8bee8ef53813288b`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:14:17.837044 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:14:17.837757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-cfd5dee4-e153-4d95-8bbb-93e27a813536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:17.847842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009406c-f3bd-48d4-acbd-357b1dbee0ed None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:17.860733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441634d-ede2-4a2e-95e4-f51d8475b3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:17.863684 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441634d-ede2-4a2e-95e4-f51d8475b3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:17.865150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441634d-ede2-4a2e-95e4-f51d8475b3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:17.865150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441634d-ede2-4a2e-95e4-f51d8475b3f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:17.869142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441634d-ede2-4a2e-95e4-f51d8475b3f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:14:17.869142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441634d-ede2-4a2e-95e4-f51d8475b3f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:17.870963 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441634d-ede2-4a2e-95e4-f51d8475b3f0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:17.912701 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1919/3833] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:14:17.913833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441634d-ede2-4a2e-95e4-f51d8475b3f0 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:17.926679 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:14:17.937027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441634d-ede2-4a2e-95e4-f51d8475b3f0 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:17.950880 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174c740-87e9-40d3-addf-3c64ee806d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:17.951524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174c740-87e9-40d3-addf-3c64ee806d9a admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:17.952306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174c740-87e9-40d3-addf-3c64ee806d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:17.952874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174c740-87e9-40d3-addf-3c64ee806d9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:17.953533 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174c740-87e9-40d3-addf-3c64ee806d9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:17.957213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174c740-87e9-40d3-addf-3c64ee806d9a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:17.959715 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1915/3834] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:14:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:14:18.003852 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1920/3835] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:14:17 2022] POST /identity/v3/projects => generated 389 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:14:18.008678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5dee4-e153-4d95-8bbb-93e27a813536 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:18.038998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5dee4-e153-4d95-8bbb-93e27a813536 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:18.141510 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44f97b-3963-4ad2-a8f8-2967559992ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:18.142319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44f97b-3963-4ad2-a8f8-2967559992ba admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:18.142682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44f97b-3963-4ad2-a8f8-2967559992ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:18.142889 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44f97b-3963-4ad2-a8f8-2967559992ba admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:18.143718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44f97b-3963-4ad2-a8f8-2967559992ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:18.145903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44f97b-3963-4ad2-a8f8-2967559992ba admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:18.182920 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1916/3836] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:14:18 2022] POST /identity/v3/users => generated 295 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:14:18.186866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174c740-87e9-40d3-addf-3c64ee806d9a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:18.202875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174c740-87e9-40d3-addf-3c64ee806d9a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:18.210416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfd81d-6690-49ef-9f27-ed3be7f8c36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:18.211285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfd81d-6690-49ef-9f27-ed3be7f8c36f admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:18.211663 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfd81d-6690-49ef-9f27-ed3be7f8c36f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:18.212031 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfd81d-6690-49ef-9f27-ed3be7f8c36f admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:18.213020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cfd81d-6690-49ef-9f27-ed3be7f8c36f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:18.215002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cfd81d-6690-49ef-9f27-ed3be7f8c36f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:18.230803 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1921/3837] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:14:18.234866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44f97b-3963-4ad2-a8f8-2967559992ba admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:18.256010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44f97b-3963-4ad2-a8f8-2967559992ba admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:18.261738 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc8d21-c62c-44b0-b87f-955d62a83dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:18.262510 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc8d21-c62c-44b0-b87f-955d62a83dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:18.262714 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc8d21-c62c-44b0-b87f-955d62a83dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:18.262986 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc8d21-c62c-44b0-b87f-955d62a83dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:18.264837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc8d21-c62c-44b0-b87f-955d62a83dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:18.269950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc8d21-c62c-44b0-b87f-955d62a83dc9 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:18.303519 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1917/3838] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:14:18.306078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfd81d-6690-49ef-9f27-ed3be7f8c36f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:18.318278 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfd81d-6690-49ef-9f27-ed3be7f8c36f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:18.353583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf060e27-b652-4f2a-8389-17a508dffc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:18.354240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf060e27-b652-4f2a-8389-17a508dffc3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:18.354522 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf060e27-b652-4f2a-8389-17a508dffc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:18.355446 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf060e27-b652-4f2a-8389-17a508dffc3d admin admin] PATH_INFO: `/v3/projects/1b5081c2462f4de2aecf108561908a31/users/fa6708d6eb5e4df58dec6b88c9968fd0/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:18.400418 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf060e27-b652-4f2a-8389-17a508dffc3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b5081c2462f4de2aecf108561908a31, user_id=fa6708d6eb5e4df58dec6b88c9968fd0, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:18.403519 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf060e27-b652-4f2a-8389-17a508dffc3d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:18.432083 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1922/3839] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:14:18 2022] PUT /identity/v3/projects/1b5081c2462f4de2aecf108561908a31/users/fa6708d6eb5e4df58dec6b88c9968fd0/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:14:18.452501 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6fc1e-b0b6-40ef-8936-2a5ea5a6b383 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:18.452785 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6fc1e-b0b6-40ef-8936-2a5ea5a6b383 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:18.453056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6fc1e-b0b6-40ef-8936-2a5ea5a6b383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:18.505163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-efc6fc1e-b0b6-40ef-8936-2a5ea5a6b383 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:14:18.506476 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-efc6fc1e-b0b6-40ef-8936-2a5ea5a6b383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:18.636689 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1918/3840] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:14:18.652084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf060e27-b652-4f2a-8389-17a508dffc3d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:18.653892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-bf060e27-b652-4f2a-8389-17a508dffc3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:18.794377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf060e27-b652-4f2a-8389-17a508dffc3d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:18.803836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef645f-9037-4dd7-8e56-4c63c112aaf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:18.805774 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef645f-9037-4dd7-8e56-4c63c112aaf0 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:18.806230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef645f-9037-4dd7-8e56-4c63c112aaf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:18.806641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef645f-9037-4dd7-8e56-4c63c112aaf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:18.825416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef645f-9037-4dd7-8e56-4c63c112aaf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:18.827546 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef645f-9037-4dd7-8e56-4c63c112aaf0 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:18.841769 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1923/3841] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:14:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:14:23.192204 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f24bf-dadd-492b-8fb0-eab2715868ec None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:23.192686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f24bf-dadd-492b-8fb0-eab2715868ec None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:23.192784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f24bf-dadd-492b-8fb0-eab2715868ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:23.243560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d68f24bf-dadd-492b-8fb0-eab2715868ec None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:14:23.245956 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d68f24bf-dadd-492b-8fb0-eab2715868ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:23.383860 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1919/3842] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 01:14:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:14:23.400401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef645f-9037-4dd7-8e56-4c63c112aaf0 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:23.402487 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1aef645f-9037-4dd7-8e56-4c63c112aaf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:23.568097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef645f-9037-4dd7-8e56-4c63c112aaf0 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:23.581145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca6bdf-821b-4a93-8411-b93981a0f8e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:23.582257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca6bdf-821b-4a93-8411-b93981a0f8e2 service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:23.582539 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca6bdf-821b-4a93-8411-b93981a0f8e2 service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:23.582814 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca6bdf-821b-4a93-8411-b93981a0f8e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:23.607097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca6bdf-821b-4a93-8411-b93981a0f8e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:23.613659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca6bdf-821b-4a93-8411-b93981a0f8e2 service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:23.639309 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1924/3843] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:14:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 04 01:14:23.727161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f24bf-dadd-492b-8fb0-eab2715868ec None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:23.730289 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d68f24bf-dadd-492b-8fb0-eab2715868ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:23.807146 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f24bf-dadd-492b-8fb0-eab2715868ec None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:23.856183 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a6dc9-2118-4965-b28a-216f5629cc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:23.857581 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a6dc9-2118-4965-b28a-216f5629cc40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:23.857581 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a6dc9-2118-4965-b28a-216f5629cc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:23.857581 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a6dc9-2118-4965-b28a-216f5629cc40 admin admin] PATH_INFO: `/v3/users/c2880f4229814ec7a89b9dea123fc6d2` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:23.864949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a6dc9-2118-4965-b28a-216f5629cc40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2880f4229814ec7a89b9dea123fc6d2)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:23.868097 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a6dc9-2118-4965-b28a-216f5629cc40 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:23.904439 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:14:24.047406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-551a6dc9-2118-4965-b28a-216f5629cc40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2880f4229814ec7a89b9dea123fc6d2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:24.048100 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-551a6dc9-2118-4965-b28a-216f5629cc40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2880f4229814ec7a89b9dea123fc6d2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:24.063877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-551a6dc9-2118-4965-b28a-216f5629cc40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2880f4229814ec7a89b9dea123fc6d2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:24.082395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-551a6dc9-2118-4965-b28a-216f5629cc40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2880f4229814ec7a89b9dea123fc6d2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:24.083057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-551a6dc9-2118-4965-b28a-216f5629cc40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2880f4229814ec7a89b9dea123fc6d2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:24.138137 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1920/3844] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:14:23 2022] DELETE /identity/v3/users/c2880f4229814ec7a89b9dea123fc6d2 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:14:24.142991 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab8c7b-e3bc-482c-99cf-f95d81ff9af0 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:24.143503 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab8c7b-e3bc-482c-99cf-f95d81ff9af0 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:24.143790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab8c7b-e3bc-482c-99cf-f95d81ff9af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:24.231208 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e9ab8c7b-e3bc-482c-99cf-f95d81ff9af0 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:14:24.233070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e9ab8c7b-e3bc-482c-99cf-f95d81ff9af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:24.288247 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:14:24.404992 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1925/3845] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:14:24.430358 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a6dc9-2118-4965-b28a-216f5629cc40 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:24.432473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-551a6dc9-2118-4965-b28a-216f5629cc40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:24.596335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a6dc9-2118-4965-b28a-216f5629cc40 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:24.612603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d322ef-06ad-488b-b9d9-8c0c67d10980 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:24.616912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d322ef-06ad-488b-b9d9-8c0c67d10980 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:24.622101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d322ef-06ad-488b-b9d9-8c0c67d10980 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:24.623330 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d322ef-06ad-488b-b9d9-8c0c67d10980 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:24.648082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d322ef-06ad-488b-b9d9-8c0c67d10980 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:24.650473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d322ef-06ad-488b-b9d9-8c0c67d10980 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:24.685138 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1921/3846] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:14:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:14:26.653880 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab8c7b-e3bc-482c-99cf-f95d81ff9af0 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:26.655339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e9ab8c7b-e3bc-482c-99cf-f95d81ff9af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:26.678521 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab8c7b-e3bc-482c-99cf-f95d81ff9af0 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:26.690399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957afd7-c503-4e2c-99da-7d8872ad1551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:26.691057 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957afd7-c503-4e2c-99da-7d8872ad1551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:26.691330 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957afd7-c503-4e2c-99da-7d8872ad1551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:26.691599 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957afd7-c503-4e2c-99da-7d8872ad1551 admin admin] PATH_INFO: `/v3/projects/abefa3e65aea44a0b52ca7738eff44f7` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:26.693800 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957afd7-c503-4e2c-99da-7d8872ad1551 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abefa3e65aea44a0b52ca7738eff44f7)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:26.695741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957afd7-c503-4e2c-99da-7d8872ad1551 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:26.783058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1957afd7-c503-4e2c-99da-7d8872ad1551 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abefa3e65aea44a0b52ca7738eff44f7', 'request_id': 'req-1957afd7-c503-4e2c-99da-7d8872ad1551'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:26.798504 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1957afd7-c503-4e2c-99da-7d8872ad1551 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abefa3e65aea44a0b52ca7738eff44f7', 'request_id': 'req-1957afd7-c503-4e2c-99da-7d8872ad1551'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:26.807907 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1957afd7-c503-4e2c-99da-7d8872ad1551 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abefa3e65aea44a0b52ca7738eff44f7', 'request_id': 'req-1957afd7-c503-4e2c-99da-7d8872ad1551'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:26.848474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1957afd7-c503-4e2c-99da-7d8872ad1551 admin admin] The token cache is being invalidate because project abefa3e65aea44a0b52ca7738eff44f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:14:26.848474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1957afd7-c503-4e2c-99da-7d8872ad1551 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:26.853815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1957afd7-c503-4e2c-99da-7d8872ad1551 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:26.858962 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1926/3847] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:14:26 2022] DELETE /identity/v3/projects/abefa3e65aea44a0b52ca7738eff44f7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:14:26.865962 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df6b93-2076-4329-b0f3-d46bb1705482 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:26.866772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df6b93-2076-4329-b0f3-d46bb1705482 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:26.867198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df6b93-2076-4329-b0f3-d46bb1705482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:26.918860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-84df6b93-2076-4329-b0f3-d46bb1705482 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:14:26.920412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-84df6b93-2076-4329-b0f3-d46bb1705482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:27.049571 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1922/3848] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:14:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:14:27.062251 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3364e2-15b3-407f-bfb8-65cdeca6d417 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:27.062251 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3364e2-15b3-407f-bfb8-65cdeca6d417 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:27.062251 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3364e2-15b3-407f-bfb8-65cdeca6d417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:27.116356 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ea3364e2-15b3-407f-bfb8-65cdeca6d417 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:14:27.122807 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ea3364e2-15b3-407f-bfb8-65cdeca6d417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:27.144328 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1927/3849] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:14:27.149235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df6b93-2076-4329-b0f3-d46bb1705482 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:27.162736 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df6b93-2076-4329-b0f3-d46bb1705482 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:27.170042 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b3cd16-0cbf-4ba3-b6f8-71d4d9eb58dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:27.170802 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3cd16-0cbf-4ba3-b6f8-71d4d9eb58dd admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:27.171187 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3cd16-0cbf-4ba3-b6f8-71d4d9eb58dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:27.171563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3cd16-0cbf-4ba3-b6f8-71d4d9eb58dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:27.172332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b3cd16-0cbf-4ba3-b6f8-71d4d9eb58dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:14:27.172740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b3cd16-0cbf-4ba3-b6f8-71d4d9eb58dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:27.175328 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b3cd16-0cbf-4ba3-b6f8-71d4d9eb58dd admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:27.207208 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1923/3850] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:14:27.211311 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3364e2-15b3-407f-bfb8-65cdeca6d417 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:27.229853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3364e2-15b3-407f-bfb8-65cdeca6d417 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:27.249091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53e591-ce25-434d-9176-b23b3bf51f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:27.250018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53e591-ce25-434d-9176-b23b3bf51f3f admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:27.250454 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53e591-ce25-434d-9176-b23b3bf51f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:27.250908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53e591-ce25-434d-9176-b23b3bf51f3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:27.251702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53e591-ce25-434d-9176-b23b3bf51f3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:27.256971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53e591-ce25-434d-9176-b23b3bf51f3f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:27.338732 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1928/3851] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:14:27 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:14:27.342672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b3cd16-0cbf-4ba3-b6f8-71d4d9eb58dd admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:27.360356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b3cd16-0cbf-4ba3-b6f8-71d4d9eb58dd admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:27.402651 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:14:27.468545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a7efe-2a2a-477b-9772-528bbb3bc0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:27.470191 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a7efe-2a2a-477b-9772-528bbb3bc0b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:27.470740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a7efe-2a2a-477b-9772-528bbb3bc0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:27.471173 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a7efe-2a2a-477b-9772-528bbb3bc0b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:27.472604 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a7efe-2a2a-477b-9772-528bbb3bc0b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:27.474827 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a7efe-2a2a-477b-9772-528bbb3bc0b6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:27.508385 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1924/3852] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:14:27 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:14:27.512633 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53e591-ce25-434d-9176-b23b3bf51f3f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:27.532126 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53e591-ce25-434d-9176-b23b3bf51f3f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:27.545157 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb270d2-3655-4a41-8344-2c4b91f571e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:27.546067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb270d2-3655-4a41-8344-2c4b91f571e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:27.546708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb270d2-3655-4a41-8344-2c4b91f571e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:27.547844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb270d2-3655-4a41-8344-2c4b91f571e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:27.548777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb270d2-3655-4a41-8344-2c4b91f571e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:27.551611 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb270d2-3655-4a41-8344-2c4b91f571e0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:27.578301 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1929/3853] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:14:27.581776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a7efe-2a2a-477b-9772-528bbb3bc0b6 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:27.597494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a7efe-2a2a-477b-9772-528bbb3bc0b6 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:27.620764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f317b27-1ef0-49a3-b0ce-1e4a13ebe901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:27.621417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f317b27-1ef0-49a3-b0ce-1e4a13ebe901 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:27.621727 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f317b27-1ef0-49a3-b0ce-1e4a13ebe901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:27.621974 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f317b27-1ef0-49a3-b0ce-1e4a13ebe901 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:27.622853 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f317b27-1ef0-49a3-b0ce-1e4a13ebe901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:27.624404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f317b27-1ef0-49a3-b0ce-1e4a13ebe901 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:27.661196 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1925/3854] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:14:27.665472 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb270d2-3655-4a41-8344-2c4b91f571e0 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:27.684108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb270d2-3655-4a41-8344-2c4b91f571e0 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:27.707960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697621f-00d6-4fae-8e54-b7a6e8f461ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:27.708657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697621f-00d6-4fae-8e54-b7a6e8f461ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:27.709522 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697621f-00d6-4fae-8e54-b7a6e8f461ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:27.709800 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697621f-00d6-4fae-8e54-b7a6e8f461ed admin admin] PATH_INFO: `/v3/projects/66380fd2a0094d5cbd672604c5fc2bac/users/098ab94ad35d48ee8b940369204ca811/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:27.758945 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697621f-00d6-4fae-8e54-b7a6e8f461ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=66380fd2a0094d5cbd672604c5fc2bac, user_id=098ab94ad35d48ee8b940369204ca811, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:27.764976 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697621f-00d6-4fae-8e54-b7a6e8f461ed admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:27.796693 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1930/3855] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:14:27 2022] PUT /identity/v3/projects/66380fd2a0094d5cbd672604c5fc2bac/users/098ab94ad35d48ee8b940369204ca811/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:14:27.807906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55cb75-c017-407b-bd8b-06316f376937 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:27.808115 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55cb75-c017-407b-bd8b-06316f376937 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:27.808241 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55cb75-c017-407b-bd8b-06316f376937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:27.900433 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-4a55cb75-c017-407b-bd8b-06316f376937 None None] MFA Rules not processed for user `098ab94ad35d48ee8b940369204ca811`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:14:27.901728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4a55cb75-c017-407b-bd8b-06316f376937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:28.067861 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1926/3856] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:14:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:14:28.248194 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab034d83-58d4-4967-8f35-2c42158ad000 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:28.249385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab034d83-58d4-4967-8f35-2c42158ad000 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:28.249957 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab034d83-58d4-4967-8f35-2c42158ad000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:28.338046 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ab034d83-58d4-4967-8f35-2c42158ad000 None None] MFA Rules not processed for user `29e00b64247c492c99c32ad85827ddd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:14:28.339473 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ab034d83-58d4-4967-8f35-2c42158ad000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:28.408535 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:14:28.488146 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1931/3857] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:14:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:14:28.532716 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55cb75-c017-407b-bd8b-06316f376937 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:28.534166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4a55cb75-c017-407b-bd8b-06316f376937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:28.622711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab034d83-58d4-4967-8f35-2c42158ad000 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:28.624746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ab034d83-58d4-4967-8f35-2c42158ad000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:28.769993 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55cb75-c017-407b-bd8b-06316f376937 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:28.793101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8c97f-ff18-4def-aafc-1b7ef38e2953 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:28.793785 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8c97f-ff18-4def-aafc-1b7ef38e2953 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:28.794064 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8c97f-ff18-4def-aafc-1b7ef38e2953 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:28.794333 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8c97f-ff18-4def-aafc-1b7ef38e2953 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:28.834136 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d8c97f-ff18-4def-aafc-1b7ef38e2953 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:28.839784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d8c97f-ff18-4def-aafc-1b7ef38e2953 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:28.858114 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1927/3858] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:14:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:14:28.859962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab034d83-58d4-4967-8f35-2c42158ad000 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:28.872584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae722a5-d14b-4f71-9ae4-b99476c26ad6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:28.873396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae722a5-d14b-4f71-9ae4-b99476c26ad6 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:28.873886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae722a5-d14b-4f71-9ae4-b99476c26ad6 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:28.874254 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae722a5-d14b-4f71-9ae4-b99476c26ad6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:28.893101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae722a5-d14b-4f71-9ae4-b99476c26ad6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:28.894848 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae722a5-d14b-4f71-9ae4-b99476c26ad6 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:28.943151 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1932/3859] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:14:28 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:14:29.183939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8c97f-ff18-4def-aafc-1b7ef38e2953 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:29.212422 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8c97f-ff18-4def-aafc-1b7ef38e2953 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:29.230278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d0f25-12c6-447e-8980-71567257f2fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:29.234022 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d0f25-12c6-447e-8980-71567257f2fe service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:29.234852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d0f25-12c6-447e-8980-71567257f2fe service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:29.237886 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d0f25-12c6-447e-8980-71567257f2fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:29.241387 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d10d0f25-12c6-447e-8980-71567257f2fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:29.257717 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:14:29.425188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d0f25-12c6-447e-8980-71567257f2fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:29.433649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d0f25-12c6-447e-8980-71567257f2fe service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:29.457011 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1928/3860] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:14:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:14:38.675794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf82ab-6bb3-44f1-89b3-7d7920c7d60a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:38.676757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf82ab-6bb3-44f1-89b3-7d7920c7d60a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:38.677267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf82ab-6bb3-44f1-89b3-7d7920c7d60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:38.730207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-43bf82ab-6bb3-44f1-89b3-7d7920c7d60a None None] MFA Rules not processed for user `832547e11ed64c46bcd1eaf2de197e43`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:14:38.733298 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-43bf82ab-6bb3-44f1-89b3-7d7920c7d60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:38.894166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52b459-deb8-4be1-945a-dc380d6392f8 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:38.895168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52b459-deb8-4be1-945a-dc380d6392f8 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:38.895816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52b459-deb8-4be1-945a-dc380d6392f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:38.976905 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1933/3861] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:14:38 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:14:38.981572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb2830-acac-4a32-aa9a-5f49207ff48b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:38.982738 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb2830-acac-4a32-aa9a-5f49207ff48b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:38.985571 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb2830-acac-4a32-aa9a-5f49207ff48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:38.991538 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-ba52b459-deb8-4be1-945a-dc380d6392f8 None None] MFA Rules not processed for user `fa6708d6eb5e4df58dec6b88c9968fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:14:38.997659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ba52b459-deb8-4be1-945a-dc380d6392f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:39.079976 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a0cb2830-acac-4a32-aa9a-5f49207ff48b None None] MFA Rules not processed for user `29e00b64247c492c99c32ad85827ddd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:14:39.081219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a0cb2830-acac-4a32-aa9a-5f49207ff48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:39.116044 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1934/3862] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:14:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:14:39.116044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb2830-acac-4a32-aa9a-5f49207ff48b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:39.118295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a0cb2830-acac-4a32-aa9a-5f49207ff48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:39.230361 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1929/3863] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:14:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:14:39.247605 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92f435-573b-4ede-9ff5-5e9c3c43b050 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:39.248143 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92f435-573b-4ede-9ff5-5e9c3c43b050 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:39.249054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92f435-573b-4ede-9ff5-5e9c3c43b050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:39.278686 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:14:39.299153 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-0a92f435-573b-4ede-9ff5-5e9c3c43b050 None None] MFA Rules not processed for user `fa6708d6eb5e4df58dec6b88c9968fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:14:39.312755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0a92f435-573b-4ede-9ff5-5e9c3c43b050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:39.330744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb2830-acac-4a32-aa9a-5f49207ff48b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:39.342788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08dea2-54f0-46a1-87d1-0acf67a3b86b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efcee9b21ea94b1b8e5c9c5acb35839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:39.343674 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08dea2-54f0-46a1-87d1-0acf67a3b86b service glance] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:39.344139 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08dea2-54f0-46a1-87d1-0acf67a3b86b service glance] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:39.344582 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08dea2-54f0-46a1-87d1-0acf67a3b86b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:39.358252 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1930/3864] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:14:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:14:39.370956 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92f435-573b-4ede-9ff5-5e9c3c43b050 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:39.378587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f08dea2-54f0-46a1-87d1-0acf67a3b86b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:39.385387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f08dea2-54f0-46a1-87d1-0acf67a3b86b service glance] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:39.410194 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92f435-573b-4ede-9ff5-5e9c3c43b050 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:39.425017 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db7d1e-f0d2-40c2-a949-85cfb291af12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:39.425906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db7d1e-f0d2-40c2-a949-85cfb291af12 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:39.426293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db7d1e-f0d2-40c2-a949-85cfb291af12 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:39.426670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db7d1e-f0d2-40c2-a949-85cfb291af12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:39.431773 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1935/3865] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:14:39 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:14:39.485979 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db7d1e-f0d2-40c2-a949-85cfb291af12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:39.503225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db7d1e-f0d2-40c2-a949-85cfb291af12 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:39.541143 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1931/3866] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:14:39 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:14:49.421851 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=9 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:14:49.521806 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=65 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:14:53.572912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9799b-8d0b-4bd0-a24c-7f828b9be34f None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:53.573559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9799b-8d0b-4bd0-a24c-7f828b9be34f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:53.573938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9799b-8d0b-4bd0-a24c-7f828b9be34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:53.633834 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-d0e9799b-8d0b-4bd0-a24c-7f828b9be34f None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:14:53.647745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d0e9799b-8d0b-4bd0-a24c-7f828b9be34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:53.813027 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1936/3867] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:14:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:14:53.846504 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db7d1e-f0d2-40c2-a949-85cfb291af12 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:53.849729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-45db7d1e-f0d2-40c2-a949-85cfb291af12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:54.030611 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db7d1e-f0d2-40c2-a949-85cfb291af12 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:54.062721 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60d886-c53a-4ab3-ba89-326fcd0d5fa3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:54.063468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60d886-c53a-4ab3-ba89-326fcd0d5fa3 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:54.063748 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60d886-c53a-4ab3-ba89-326fcd0d5fa3 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:54.064019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60d886-c53a-4ab3-ba89-326fcd0d5fa3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:54.084688 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60d886-c53a-4ab3-ba89-326fcd0d5fa3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:54.087644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60d886-c53a-4ab3-ba89-326fcd0d5fa3 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:54.119262 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1932/3868] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:14:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:14:55.170212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9799b-8d0b-4bd0-a24c-7f828b9be34f None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:55.430205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9799b-8d0b-4bd0-a24c-7f828b9be34f None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:55.448579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a65ba-1b37-4a16-abb1-daa56f66b8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:55.449399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a65ba-1b37-4a16-abb1-daa56f66b8c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:55.450122 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a65ba-1b37-4a16-abb1-daa56f66b8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:55.450398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a65ba-1b37-4a16-abb1-daa56f66b8c2 admin admin] PATH_INFO: `/v3/users/098ab94ad35d48ee8b940369204ca811` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:55.451620 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a65ba-1b37-4a16-abb1-daa56f66b8c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=098ab94ad35d48ee8b940369204ca811)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:55.453599 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a65ba-1b37-4a16-abb1-daa56f66b8c2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:55.596116 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-614a65ba-1b37-4a16-abb1-daa56f66b8c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '098ab94ad35d48ee8b940369204ca811'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:55.627979 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-614a65ba-1b37-4a16-abb1-daa56f66b8c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '098ab94ad35d48ee8b940369204ca811'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:55.667292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-614a65ba-1b37-4a16-abb1-daa56f66b8c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '098ab94ad35d48ee8b940369204ca811'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:55.701474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-614a65ba-1b37-4a16-abb1-daa56f66b8c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '098ab94ad35d48ee8b940369204ca811'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:55.702219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-614a65ba-1b37-4a16-abb1-daa56f66b8c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '098ab94ad35d48ee8b940369204ca811'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:55.779367 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1937/3869] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:14:55 2022] DELETE /identity/v3/users/098ab94ad35d48ee8b940369204ca811 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:14:55.783533 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb52f9-5f89-4747-8025-19eb9be007af None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:55.784043 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb52f9-5f89-4747-8025-19eb9be007af None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:55.784136 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb52f9-5f89-4747-8025-19eb9be007af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:55.819501 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-70bb52f9-5f89-4747-8025-19eb9be007af None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:14:55.820740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-70bb52f9-5f89-4747-8025-19eb9be007af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:56.027715 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1933/3870] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:14:56.062293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a65ba-1b37-4a16-abb1-daa56f66b8c2 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:56.063860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-614a65ba-1b37-4a16-abb1-daa56f66b8c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:56.182103 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:14:56.323979 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a65ba-1b37-4a16-abb1-daa56f66b8c2 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:56.336032 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e545fd-91e8-45b9-868c-9c4a300a886a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:56.336685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e545fd-91e8-45b9-868c-9c4a300a886a service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:56.339059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e545fd-91e8-45b9-868c-9c4a300a886a service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:56.340396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e545fd-91e8-45b9-868c-9c4a300a886a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:56.377480 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e545fd-91e8-45b9-868c-9c4a300a886a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:56.378888 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e545fd-91e8-45b9-868c-9c4a300a886a service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:56.430045 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1938/3871] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:14:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:14:58.198600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb52f9-5f89-4747-8025-19eb9be007af None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:58.200057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-70bb52f9-5f89-4747-8025-19eb9be007af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:58.230936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb52f9-5f89-4747-8025-19eb9be007af None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:58.252480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063abbd8-54b4-445e-b4f0-909b47dd4f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:58.253745 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063abbd8-54b4-445e-b4f0-909b47dd4f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:58.253745 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063abbd8-54b4-445e-b4f0-909b47dd4f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:58.259325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063abbd8-54b4-445e-b4f0-909b47dd4f86 admin admin] PATH_INFO: `/v3/projects/66380fd2a0094d5cbd672604c5fc2bac` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:58.264838 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063abbd8-54b4-445e-b4f0-909b47dd4f86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66380fd2a0094d5cbd672604c5fc2bac)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:58.266756 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063abbd8-54b4-445e-b4f0-909b47dd4f86 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:58.450619 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-063abbd8-54b4-445e-b4f0-909b47dd4f86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66380fd2a0094d5cbd672604c5fc2bac', 'request_id': 'req-063abbd8-54b4-445e-b4f0-909b47dd4f86'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:58.471850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-063abbd8-54b4-445e-b4f0-909b47dd4f86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66380fd2a0094d5cbd672604c5fc2bac', 'request_id': 'req-063abbd8-54b4-445e-b4f0-909b47dd4f86'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:58.486987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-063abbd8-54b4-445e-b4f0-909b47dd4f86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66380fd2a0094d5cbd672604c5fc2bac', 'request_id': 'req-063abbd8-54b4-445e-b4f0-909b47dd4f86'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:58.526502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-063abbd8-54b4-445e-b4f0-909b47dd4f86 admin admin] The token cache is being invalidate because project 66380fd2a0094d5cbd672604c5fc2bac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:14:58.538000 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-063abbd8-54b4-445e-b4f0-909b47dd4f86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:58.538942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-063abbd8-54b4-445e-b4f0-909b47dd4f86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:14:58.547111 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1934/3872] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:14:58 2022] DELETE /identity/v3/projects/66380fd2a0094d5cbd672604c5fc2bac => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:14:58.548060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e9463-8b53-407a-b891-2c6ec3bd2d69 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:58.548556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e9463-8b53-407a-b891-2c6ec3bd2d69 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:58.548664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e9463-8b53-407a-b891-2c6ec3bd2d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:58.632035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ae7e9463-8b53-407a-b891-2c6ec3bd2d69 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:14:58.636053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ae7e9463-8b53-407a-b891-2c6ec3bd2d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:58.935501 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1939/3873] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:14:58.945868 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928ffaa-1508-4f90-b26c-582e545cf029 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:58.946283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928ffaa-1508-4f90-b26c-582e545cf029 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:58.946665 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928ffaa-1508-4f90-b26c-582e545cf029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:59.061684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d928ffaa-1508-4f90-b26c-582e545cf029 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:14:59.063622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d928ffaa-1508-4f90-b26c-582e545cf029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:14:59.079885 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1935/3874] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:14:59.082386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e9463-8b53-407a-b891-2c6ec3bd2d69 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:59.102164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e9463-8b53-407a-b891-2c6ec3bd2d69 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:59.119885 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5d113-ee3c-46b2-afe8-0ce105d487cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:59.121357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5d113-ee3c-46b2-afe8-0ce105d487cb admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:59.121670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5d113-ee3c-46b2-afe8-0ce105d487cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:59.121943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5d113-ee3c-46b2-afe8-0ce105d487cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:59.122605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5d113-ee3c-46b2-afe8-0ce105d487cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:14:59.122906 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5d113-ee3c-46b2-afe8-0ce105d487cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:59.124548 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5d113-ee3c-46b2-afe8-0ce105d487cb admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:59.172942 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1940/3875] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:14:59.174833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928ffaa-1508-4f90-b26c-582e545cf029 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:59.185190 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928ffaa-1508-4f90-b26c-582e545cf029 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:59.206418 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9732a-9259-400a-a3e3-981fe43ae419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:59.207106 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9732a-9259-400a-a3e3-981fe43ae419 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:59.207308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9732a-9259-400a-a3e3-981fe43ae419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:59.207578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9732a-9259-400a-a3e3-981fe43ae419 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:59.208472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9732a-9259-400a-a3e3-981fe43ae419 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:59.210400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9732a-9259-400a-a3e3-981fe43ae419 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:59.232688 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:14:59.297888 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1936/3876] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:14:59 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:14:59.299037 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5d113-ee3c-46b2-afe8-0ce105d487cb admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:59.316254 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5d113-ee3c-46b2-afe8-0ce105d487cb admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:59.492672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f82ae4-2748-4ea9-a413-ac783fde32cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:59.499960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f82ae4-2748-4ea9-a413-ac783fde32cb admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:59.500326 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f82ae4-2748-4ea9-a413-ac783fde32cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:59.500522 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f82ae4-2748-4ea9-a413-ac783fde32cb admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:59.501171 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f82ae4-2748-4ea9-a413-ac783fde32cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:59.503169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f82ae4-2748-4ea9-a413-ac783fde32cb admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:59.585995 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1941/3877] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:14:59 2022] POST /identity/v3/users => generated 293 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:14:59.586654 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9732a-9259-400a-a3e3-981fe43ae419 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:59.612003 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9732a-9259-400a-a3e3-981fe43ae419 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:59.627991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5cebbd-1bce-4606-a1d3-e5ead62c84e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:59.629295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cebbd-1bce-4606-a1d3-e5ead62c84e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:59.629889 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cebbd-1bce-4606-a1d3-e5ead62c84e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:59.630423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cebbd-1bce-4606-a1d3-e5ead62c84e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:59.631418 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5cebbd-1bce-4606-a1d3-e5ead62c84e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:59.633539 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5cebbd-1bce-4606-a1d3-e5ead62c84e6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:59.659351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f82ae4-2748-4ea9-a413-ac783fde32cb admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:59.659737 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1937/3878] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:14:59.675218 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f82ae4-2748-4ea9-a413-ac783fde32cb admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:59.693935 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65bc74e-7dee-495e-8b71-b0be897a81ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:59.695017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bc74e-7dee-495e-8b71-b0be897a81ee admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:59.696452 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bc74e-7dee-495e-8b71-b0be897a81ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:59.697834 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bc74e-7dee-495e-8b71-b0be897a81ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:59.698778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65bc74e-7dee-495e-8b71-b0be897a81ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:59.704283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65bc74e-7dee-495e-8b71-b0be897a81ee admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:59.792578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5cebbd-1bce-4606-a1d3-e5ead62c84e6 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:14:59.805960 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1942/3879] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:14:59.816608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5cebbd-1bce-4606-a1d3-e5ead62c84e6 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:14:59.821930 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d26b82-c01e-4d41-b6c8-4d550e73df71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:14:59.824612 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d26b82-c01e-4d41-b6c8-4d550e73df71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:14:59.828414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d26b82-c01e-4d41-b6c8-4d550e73df71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:14:59.828414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d26b82-c01e-4d41-b6c8-4d550e73df71 admin admin] PATH_INFO: `/v3/projects/11405f1a89ad45d59877d2a4a1c6a7c9/users/6f9fb84303a84a24a1a03450957213c5/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:14:59.903296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d26b82-c01e-4d41-b6c8-4d550e73df71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11405f1a89ad45d59877d2a4a1c6a7c9, user_id=6f9fb84303a84a24a1a03450957213c5, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:14:59.912074 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d26b82-c01e-4d41-b6c8-4d550e73df71 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:14:59.979491 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1938/3880] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:14:59 2022] PUT /identity/v3/projects/11405f1a89ad45d59877d2a4a1c6a7c9/users/6f9fb84303a84a24a1a03450957213c5/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:15:00.057391 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4446793-e2bb-40ae-8ef4-4d12ebc771f1 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:00.057686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4446793-e2bb-40ae-8ef4-4d12ebc771f1 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:00.057966 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4446793-e2bb-40ae-8ef4-4d12ebc771f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:00.103531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-b4446793-e2bb-40ae-8ef4-4d12ebc771f1 None None] MFA Rules not processed for user `6f9fb84303a84a24a1a03450957213c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:00.104780 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b4446793-e2bb-40ae-8ef4-4d12ebc771f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:00.175444 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:00.303387 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1943/3881] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:00.306672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d26b82-c01e-4d41-b6c8-4d550e73df71 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:00.435079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d26b82-c01e-4d41-b6c8-4d550e73df71 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:00.468013 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f5b1e-bd1c-46e7-8fde-77749be8dd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:00.469161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f5b1e-bd1c-46e7-8fde-77749be8dd96 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:00.469535 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f5b1e-bd1c-46e7-8fde-77749be8dd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:00.469879 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f5b1e-bd1c-46e7-8fde-77749be8dd96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:00.470813 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f5b1e-bd1c-46e7-8fde-77749be8dd96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:00.473044 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f5b1e-bd1c-46e7-8fde-77749be8dd96 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:00.524895 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1939/3882] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:15:00 2022] POST /identity/v3/projects => generated 385 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:00.530109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4446793-e2bb-40ae-8ef4-4d12ebc771f1 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:00.556337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4446793-e2bb-40ae-8ef4-4d12ebc771f1 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:00.687701 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac1b0f-1d84-4ff2-aabd-b0d66d4c1249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:00.688356 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac1b0f-1d84-4ff2-aabd-b0d66d4c1249 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:00.688595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac1b0f-1d84-4ff2-aabd-b0d66d4c1249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:00.688864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac1b0f-1d84-4ff2-aabd-b0d66d4c1249 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:00.689661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac1b0f-1d84-4ff2-aabd-b0d66d4c1249 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:00.693599 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac1b0f-1d84-4ff2-aabd-b0d66d4c1249 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:00.735350 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1944/3883] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:15:00 2022] POST /identity/v3/users => generated 299 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:00.735917 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f5b1e-bd1c-46e7-8fde-77749be8dd96 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:00.754116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f5b1e-bd1c-46e7-8fde-77749be8dd96 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:00.767368 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770ba98-ad55-44de-953a-df5286827366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:00.767980 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770ba98-ad55-44de-953a-df5286827366 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:00.768256 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770ba98-ad55-44de-953a-df5286827366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:00.768539 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770ba98-ad55-44de-953a-df5286827366 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:00.769170 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770ba98-ad55-44de-953a-df5286827366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:00.770855 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770ba98-ad55-44de-953a-df5286827366 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:00.806456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac1b0f-1d84-4ff2-aabd-b0d66d4c1249 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:00.813910 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1940/3884] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:15:00.831502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac1b0f-1d84-4ff2-aabd-b0d66d4c1249 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:00.844523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8576e25-ee4a-46b5-ab07-7f85a5900f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:00.845210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8576e25-ee4a-46b5-ab07-7f85a5900f3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:00.845507 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8576e25-ee4a-46b5-ab07-7f85a5900f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:00.845781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8576e25-ee4a-46b5-ab07-7f85a5900f3b admin admin] PATH_INFO: `/v3/projects/8f2d97b7facf4d2abeded4b40c761d37/users/ba57dcbd9f5a4f8db2568e56c8e11ddc/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:00.888179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8576e25-ee4a-46b5-ab07-7f85a5900f3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f2d97b7facf4d2abeded4b40c761d37, user_id=ba57dcbd9f5a4f8db2568e56c8e11ddc, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:00.890952 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8576e25-ee4a-46b5-ab07-7f85a5900f3b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:00.923180 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1945/3885] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:15:00 2022] PUT /identity/v3/projects/8f2d97b7facf4d2abeded4b40c761d37/users/ba57dcbd9f5a4f8db2568e56c8e11ddc/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:00.927705 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770ba98-ad55-44de-953a-df5286827366 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:00.963030 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770ba98-ad55-44de-953a-df5286827366 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:01.106571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427fddc1-c554-4de3-b2ef-ca3bcf3ad2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:01.107129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fddc1-c554-4de3-b2ef-ca3bcf3ad2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:01.107410 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fddc1-c554-4de3-b2ef-ca3bcf3ad2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:01.107689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fddc1-c554-4de3-b2ef-ca3bcf3ad2c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:01.108341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427fddc1-c554-4de3-b2ef-ca3bcf3ad2c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:01.109992 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427fddc1-c554-4de3-b2ef-ca3bcf3ad2c4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:01.129976 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1941/3886] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:15:01.134167 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8576e25-ee4a-46b5-ab07-7f85a5900f3b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:01.164818 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8576e25-ee4a-46b5-ab07-7f85a5900f3b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:01.179291 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05fed1-0d1f-4f56-b0c8-1701b984d77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:01.180229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05fed1-0d1f-4f56-b0c8-1701b984d77b admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:01.180512 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05fed1-0d1f-4f56-b0c8-1701b984d77b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:01.180785 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05fed1-0d1f-4f56-b0c8-1701b984d77b admin admin] PATH_INFO: `/v3/projects/8f2d97b7facf4d2abeded4b40c761d37/users/ba57dcbd9f5a4f8db2568e56c8e11ddc/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:01.185735 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05fed1-0d1f-4f56-b0c8-1701b984d77b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f2d97b7facf4d2abeded4b40c761d37, user_id=ba57dcbd9f5a4f8db2568e56c8e11ddc, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:01.188426 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05fed1-0d1f-4f56-b0c8-1701b984d77b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:01.219514 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1946/3887] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:15:01 2022] PUT /identity/v3/projects/8f2d97b7facf4d2abeded4b40c761d37/users/ba57dcbd9f5a4f8db2568e56c8e11ddc/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:01.230103 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0470e-3450-4f00-bd02-a2fec462ef50 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:01.230413 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0470e-3450-4f00-bd02-a2fec462ef50 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:01.230652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0470e-3450-4f00-bd02-a2fec462ef50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:01.277379 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-75a0470e-3450-4f00-bd02-a2fec462ef50 None None] MFA Rules not processed for user `ba57dcbd9f5a4f8db2568e56c8e11ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:01.279149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-75a0470e-3450-4f00-bd02-a2fec462ef50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:01.292517 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:01.379443 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1942/3888] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:01 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:01.381415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05fed1-0d1f-4f56-b0c8-1701b984d77b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:01.396923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05fed1-0d1f-4f56-b0c8-1701b984d77b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:01.404434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28751386-346f-44df-83a6-b0ac149e047a tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba57dcbd9f5a4f8db2568e56c8e11ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f2d97b7facf4d2abeded4b40c761d37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:01.405787 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28751386-346f-44df-83a6-b0ac149e047a tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:01.406255 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28751386-346f-44df-83a6-b0ac149e047a tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:01.406782 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28751386-346f-44df-83a6-b0ac149e047a tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:01.407709 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28751386-346f-44df-83a6-b0ac149e047a tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:01.412027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28751386-346f-44df-83a6-b0ac149e047a tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:01.415906 n-d-master-1 devstack@keystone.service[81824]: WARNING keystone.server.flask.common [None req-28751386-346f-44df-83a6-b0ac149e047a tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 04 01:15:01.499532 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1947/3889] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:15:01 2022] POST /identity/v3/projects => generated 358 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:01.505759 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0470e-3450-4f00-bd02-a2fec462ef50 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:01.518659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0470e-3450-4f00-bd02-a2fec462ef50 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:01.758947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080ffd0-10c0-429a-bb67-e90d9894427d tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba57dcbd9f5a4f8db2568e56c8e11ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f2d97b7facf4d2abeded4b40c761d37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:01.762515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080ffd0-10c0-429a-bb67-e90d9894427d tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:01.764318 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080ffd0-10c0-429a-bb67-e90d9894427d tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:01.764999 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080ffd0-10c0-429a-bb67-e90d9894427d tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] PATH_INFO: `/v3/projects/ac4d1d94c1354aff87096e3c03886d76/tags/tempest-tag-254914243` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:01.767396 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0080ffd0-10c0-429a-bb67-e90d9894427d tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=ac4d1d94c1354aff87096e3c03886d76, value=tempest-tag-254914243)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:01.774558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0080ffd0-10c0-429a-bb67-e90d9894427d tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:01.978155 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-0080ffd0-10c0-429a-bb67-e90d9894427d tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-254914243. To ensure interoperability, identifiers should be a valid uuid. Sep 04 01:15:01.978155 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 04 01:15:01.978155 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:15:01.991082 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1943/3890] 10.222.0.30 () {60 vars in 1330 bytes} [Sun Sep 4 01:15:01 2022] PUT /identity/v3/projects/ac4d1d94c1354aff87096e3c03886d76/tags/tempest-tag-254914243 => generated 0 bytes in 487 msecs (HTTP/1.1 201) 6 headers in 290 bytes (1 switches on core 0) Sep 04 01:15:01.995503 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28751386-346f-44df-83a6-b0ac149e047a tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:02.050580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28751386-346f-44df-83a6-b0ac149e047a tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:02.062282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc0029-df6a-4ad4-878b-9885494ba2fd tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba57dcbd9f5a4f8db2568e56c8e11ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f2d97b7facf4d2abeded4b40c761d37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:02.062958 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc0029-df6a-4ad4-878b-9885494ba2fd tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:02.063818 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc0029-df6a-4ad4-878b-9885494ba2fd tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:02.064117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc0029-df6a-4ad4-878b-9885494ba2fd tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] PATH_INFO: `/v3/projects/ac4d1d94c1354aff87096e3c03886d76/tags/tempest-tag-254914243` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:02.159823 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc0029-df6a-4ad4-878b-9885494ba2fd tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=ac4d1d94c1354aff87096e3c03886d76, value=tempest-tag-254914243)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:02.163286 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc0029-df6a-4ad4-878b-9885494ba2fd tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:02.177896 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1948/3891] 10.222.0.30 () {58 vars in 1311 bytes} [Sun Sep 4 01:15:01 2022] GET /identity/v3/projects/ac4d1d94c1354aff87096e3c03886d76/tags/tempest-tag-254914243 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:02.181734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080ffd0-10c0-429a-bb67-e90d9894427d tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:02.214542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080ffd0-10c0-429a-bb67-e90d9894427d tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:02.290841 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd142a-c750-48ac-8877-09b6eb69b2b4 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba57dcbd9f5a4f8db2568e56c8e11ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f2d97b7facf4d2abeded4b40c761d37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:02.291594 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd142a-c750-48ac-8877-09b6eb69b2b4 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:02.291921 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd142a-c750-48ac-8877-09b6eb69b2b4 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:02.292226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd142a-c750-48ac-8877-09b6eb69b2b4 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] PATH_INFO: `/v3/projects/ac4d1d94c1354aff87096e3c03886d76/tags` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:02.303029 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd142a-c750-48ac-8877-09b6eb69b2b4 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=ac4d1d94c1354aff87096e3c03886d76)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:02.310303 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd142a-c750-48ac-8877-09b6eb69b2b4 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:02.505021 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1944/3892] 10.222.0.30 () {60 vars in 1265 bytes} [Sun Sep 4 01:15:02 2022] PUT /identity/v3/projects/ac4d1d94c1354aff87096e3c03886d76/tags => generated 139 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:15:02.505610 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc0029-df6a-4ad4-878b-9885494ba2fd tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:02.523074 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc0029-df6a-4ad4-878b-9885494ba2fd tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:02.572705 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8531c7-7509-4c9f-98fc-4c60ffdbd510 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba57dcbd9f5a4f8db2568e56c8e11ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f2d97b7facf4d2abeded4b40c761d37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:02.573414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8531c7-7509-4c9f-98fc-4c60ffdbd510 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:02.573750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8531c7-7509-4c9f-98fc-4c60ffdbd510 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:02.574065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8531c7-7509-4c9f-98fc-4c60ffdbd510 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] PATH_INFO: `/v3/projects/ac4d1d94c1354aff87096e3c03886d76/tags` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:02.600383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8531c7-7509-4c9f-98fc-4c60ffdbd510 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=ac4d1d94c1354aff87096e3c03886d76)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:02.603524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8531c7-7509-4c9f-98fc-4c60ffdbd510 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:02.632832 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1949/3893] 10.222.0.30 () {58 vars in 1245 bytes} [Sun Sep 4 01:15:02 2022] GET /identity/v3/projects/ac4d1d94c1354aff87096e3c03886d76/tags => generated 139 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:15:02.636612 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd142a-c750-48ac-8877-09b6eb69b2b4 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:02.648104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd142a-c750-48ac-8877-09b6eb69b2b4 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:02.665027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8829875-187a-4db8-b2df-a666a1d41c22 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba57dcbd9f5a4f8db2568e56c8e11ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f2d97b7facf4d2abeded4b40c761d37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:02.665808 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8829875-187a-4db8-b2df-a666a1d41c22 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:02.666912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8829875-187a-4db8-b2df-a666a1d41c22 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:02.667040 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8829875-187a-4db8-b2df-a666a1d41c22 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] PATH_INFO: `/v3/projects/ac4d1d94c1354aff87096e3c03886d76/tags/tempest-tag-504433241` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:02.669722 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8829875-187a-4db8-b2df-a666a1d41c22 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=ac4d1d94c1354aff87096e3c03886d76, value=tempest-tag-504433241)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:02.676202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8829875-187a-4db8-b2df-a666a1d41c22 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:02.782252 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:02.862195 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-d8829875-187a-4db8-b2df-a666a1d41c22 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-504433241. To ensure interoperability, identifiers should be a valid uuid. Sep 04 01:15:02.862195 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 04 01:15:02.862195 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:15:02.873395 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1945/3894] 10.222.0.30 () {58 vars in 1314 bytes} [Sun Sep 4 01:15:02 2022] DELETE /identity/v3/projects/ac4d1d94c1354aff87096e3c03886d76/tags/tempest-tag-504433241 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:15:02.882935 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8531c7-7509-4c9f-98fc-4c60ffdbd510 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:02.898966 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8531c7-7509-4c9f-98fc-4c60ffdbd510 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:02.922428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac577e6-bbe3-4588-9cc6-d6b1bc525fc2 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba57dcbd9f5a4f8db2568e56c8e11ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f2d97b7facf4d2abeded4b40c761d37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:02.924702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac577e6-bbe3-4588-9cc6-d6b1bc525fc2 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:02.924990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac577e6-bbe3-4588-9cc6-d6b1bc525fc2 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:02.925309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac577e6-bbe3-4588-9cc6-d6b1bc525fc2 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] PATH_INFO: `/v3/projects/ac4d1d94c1354aff87096e3c03886d76/tags/tempest-tag-504433241` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:02.945411 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:02.977456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac577e6-bbe3-4588-9cc6-d6b1bc525fc2 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=ac4d1d94c1354aff87096e3c03886d76, value=tempest-tag-504433241)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:02.979824 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac577e6-bbe3-4588-9cc6-d6b1bc525fc2 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:03.060892 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-9ac577e6-bbe3-4588-9cc6-d6b1bc525fc2 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] Could not find project tag: tempest-tag-504433241.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-504433241. Sep 04 01:15:03.060892 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:15:03.060892 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:15:03.060892 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:15:03.060892 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:15:03.060892 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:15:03.060892 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:15:03.060892 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:15:03.060892 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:15:03.060892 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:15:03.060892 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:15:03.060892 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:15:03.060892 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Sep 04 01:15:03.060892 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Sep 04 01:15:03.062695 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:15:03.062695 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:15:03.062695 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Sep 04 01:15:03.062695 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Sep 04 01:15:03.062695 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-504433241. Sep 04 01:15:03.062695 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:15:03.064347 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1950/3895] 10.222.0.30 () {58 vars in 1311 bytes} [Sun Sep 4 01:15:02 2022] GET /identity/v3/projects/ac4d1d94c1354aff87096e3c03886d76/tags/tempest-tag-504433241 => generated 106 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:15:03.069469 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8829875-187a-4db8-b2df-a666a1d41c22 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:03.094167 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac577e6-bbe3-4588-9cc6-d6b1bc525fc2 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:03.096432 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8829875-187a-4db8-b2df-a666a1d41c22 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:03.096790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9ac577e6-bbe3-4588-9cc6-d6b1bc525fc2 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:03.106939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861214f-906c-4df1-83c0-a1adf11ff86c tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba57dcbd9f5a4f8db2568e56c8e11ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f2d97b7facf4d2abeded4b40c761d37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:03.108016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861214f-906c-4df1-83c0-a1adf11ff86c tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:03.108543 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861214f-906c-4df1-83c0-a1adf11ff86c tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:03.109407 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861214f-906c-4df1-83c0-a1adf11ff86c tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] PATH_INFO: `/v3/projects/ac4d1d94c1354aff87096e3c03886d76/tags` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:03.123846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861214f-906c-4df1-83c0-a1adf11ff86c tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=ac4d1d94c1354aff87096e3c03886d76)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:03.128588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861214f-906c-4df1-83c0-a1adf11ff86c tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:03.259328 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1946/3896] 10.222.0.30 () {58 vars in 1248 bytes} [Sun Sep 4 01:15:03 2022] DELETE /identity/v3/projects/ac4d1d94c1354aff87096e3c03886d76/tags => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:03.263033 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861214f-906c-4df1-83c0-a1adf11ff86c tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:03.268235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d861214f-906c-4df1-83c0-a1adf11ff86c tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:03.296345 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac577e6-bbe3-4588-9cc6-d6b1bc525fc2 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:03.309871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f7baa-6726-4c98-8da8-a7dde683138d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:03.312273 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f7baa-6726-4c98-8da8-a7dde683138d service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:03.312560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f7baa-6726-4c98-8da8-a7dde683138d service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:03.312841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f7baa-6726-4c98-8da8-a7dde683138d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:03.314885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861214f-906c-4df1-83c0-a1adf11ff86c tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:03.320097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-384f7baa-6726-4c98-8da8-a7dde683138d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:03.326551 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770e7c0-89d5-4fac-94d5-1eefe77151f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:03.328912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770e7c0-89d5-4fac-94d5-1eefe77151f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:03.330519 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770e7c0-89d5-4fac-94d5-1eefe77151f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:03.332319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770e7c0-89d5-4fac-94d5-1eefe77151f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:03.341574 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4770e7c0-89d5-4fac-94d5-1eefe77151f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:03.488070 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770e7c0-89d5-4fac-94d5-1eefe77151f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:03.490752 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770e7c0-89d5-4fac-94d5-1eefe77151f8 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:03.508967 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1947/3897] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:15:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:15:03.513275 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770e7c0-89d5-4fac-94d5-1eefe77151f8 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:03.518047 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f7baa-6726-4c98-8da8-a7dde683138d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:03.520203 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f7baa-6726-4c98-8da8-a7dde683138d service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:03.542827 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770e7c0-89d5-4fac-94d5-1eefe77151f8 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:03.552460 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1951/3898] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:15:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:15:03.570979 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809909a-5402-4c4f-a78b-56f4ca4f6d79 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba57dcbd9f5a4f8db2568e56c8e11ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f2d97b7facf4d2abeded4b40c761d37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:03.573678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809909a-5402-4c4f-a78b-56f4ca4f6d79 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:03.575861 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809909a-5402-4c4f-a78b-56f4ca4f6d79 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:03.576250 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809909a-5402-4c4f-a78b-56f4ca4f6d79 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] PATH_INFO: `/v3/projects/ac4d1d94c1354aff87096e3c03886d76/tags` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:03.619705 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9809909a-5402-4c4f-a78b-56f4ca4f6d79 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=ac4d1d94c1354aff87096e3c03886d76)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:03.645374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9809909a-5402-4c4f-a78b-56f4ca4f6d79 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:03.733486 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1948/3899] 10.222.0.30 () {58 vars in 1245 bytes} [Sun Sep 4 01:15:03 2022] GET /identity/v3/projects/ac4d1d94c1354aff87096e3c03886d76/tags => generated 66 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:15:03.738038 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f7baa-6726-4c98-8da8-a7dde683138d service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:03.757115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f7baa-6726-4c98-8da8-a7dde683138d service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:03.766150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d32129-09c8-4131-8dc4-5a04d3a88891 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba57dcbd9f5a4f8db2568e56c8e11ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f2d97b7facf4d2abeded4b40c761d37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:03.767096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d32129-09c8-4131-8dc4-5a04d3a88891 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:03.768085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d32129-09c8-4131-8dc4-5a04d3a88891 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:03.768625 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d32129-09c8-4131-8dc4-5a04d3a88891 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] PATH_INFO: `/v3/projects/ac4d1d94c1354aff87096e3c03886d76` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:03.775173 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d32129-09c8-4131-8dc4-5a04d3a88891 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ac4d1d94c1354aff87096e3c03886d76)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:03.777238 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d32129-09c8-4131-8dc4-5a04d3a88891 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:03.885224 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-42d32129-09c8-4131-8dc4-5a04d3a88891 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac4d1d94c1354aff87096e3c03886d76', 'request_id': 'req-42d32129-09c8-4131-8dc4-5a04d3a88891'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:03.906406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-42d32129-09c8-4131-8dc4-5a04d3a88891 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac4d1d94c1354aff87096e3c03886d76', 'request_id': 'req-42d32129-09c8-4131-8dc4-5a04d3a88891'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:03.920783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-42d32129-09c8-4131-8dc4-5a04d3a88891 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac4d1d94c1354aff87096e3c03886d76', 'request_id': 'req-42d32129-09c8-4131-8dc4-5a04d3a88891'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:03.944607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-42d32129-09c8-4131-8dc4-5a04d3a88891 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] The token cache is being invalidate because project ac4d1d94c1354aff87096e3c03886d76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:15:03.946111 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-42d32129-09c8-4131-8dc4-5a04d3a88891 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:03.951092 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-42d32129-09c8-4131-8dc4-5a04d3a88891 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:03.959862 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1952/3900] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:15:03 2022] DELETE /identity/v3/projects/ac4d1d94c1354aff87096e3c03886d76 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:03.960126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809909a-5402-4c4f-a78b-56f4ca4f6d79 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:03.964259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9809909a-5402-4c4f-a78b-56f4ca4f6d79 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:04.131648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809909a-5402-4c4f-a78b-56f4ca4f6d79 tempest-IdentityV3ProjectTagsTest-409436654 tempest-IdentityV3ProjectTagsTest-409436654-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:04.159714 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:04.334648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bdcee-a175-4828-ad20-3d39baad3668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:04.335350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bdcee-a175-4828-ad20-3d39baad3668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:04.335628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bdcee-a175-4828-ad20-3d39baad3668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:04.340598 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bdcee-a175-4828-ad20-3d39baad3668 admin admin] PATH_INFO: `/v3/users/6f9fb84303a84a24a1a03450957213c5` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:04.342445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208bdcee-a175-4828-ad20-3d39baad3668 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f9fb84303a84a24a1a03450957213c5)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:04.350977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208bdcee-a175-4828-ad20-3d39baad3668 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:04.558606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-208bdcee-a175-4828-ad20-3d39baad3668 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f9fb84303a84a24a1a03450957213c5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:04.561759 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-208bdcee-a175-4828-ad20-3d39baad3668 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f9fb84303a84a24a1a03450957213c5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:04.603875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-208bdcee-a175-4828-ad20-3d39baad3668 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f9fb84303a84a24a1a03450957213c5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:04.630515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-208bdcee-a175-4828-ad20-3d39baad3668 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f9fb84303a84a24a1a03450957213c5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:04.631626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-208bdcee-a175-4828-ad20-3d39baad3668 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f9fb84303a84a24a1a03450957213c5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:04.672850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878ee98-2757-48eb-bc68-984d77e76977 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:04.674009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878ee98-2757-48eb-bc68-984d77e76977 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:04.674449 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878ee98-2757-48eb-bc68-984d77e76977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:04.678052 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1949/3901] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:15:03 2022] DELETE /identity/v3/users/6f9fb84303a84a24a1a03450957213c5 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:15:04.711563 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-f878ee98-2757-48eb-bc68-984d77e76977 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:04.715714 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f878ee98-2757-48eb-bc68-984d77e76977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:04.729473 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:04.871961 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1953/3902] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:04.912294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bdcee-a175-4828-ad20-3d39baad3668 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:04.914118 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-208bdcee-a175-4828-ad20-3d39baad3668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:05.066967 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bdcee-a175-4828-ad20-3d39baad3668 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:05.079748 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d960c4-6f1c-4224-9cab-670046e27851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:05.080585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d960c4-6f1c-4224-9cab-670046e27851 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:05.080974 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d960c4-6f1c-4224-9cab-670046e27851 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:05.081355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d960c4-6f1c-4224-9cab-670046e27851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:05.122799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d960c4-6f1c-4224-9cab-670046e27851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:05.124816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d960c4-6f1c-4224-9cab-670046e27851 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:05.161371 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1950/3903] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:15:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:15:07.430512 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878ee98-2757-48eb-bc68-984d77e76977 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:07.432337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f878ee98-2757-48eb-bc68-984d77e76977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:07.463973 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878ee98-2757-48eb-bc68-984d77e76977 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:07.491265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4b6f0-99c4-4c28-a8da-f47fd199e875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:07.492097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4b6f0-99c4-4c28-a8da-f47fd199e875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:07.492488 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4b6f0-99c4-4c28-a8da-f47fd199e875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:07.492869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4b6f0-99c4-4c28-a8da-f47fd199e875 admin admin] PATH_INFO: `/v3/projects/11405f1a89ad45d59877d2a4a1c6a7c9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:07.494697 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4b6f0-99c4-4c28-a8da-f47fd199e875 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11405f1a89ad45d59877d2a4a1c6a7c9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:07.497086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4b6f0-99c4-4c28-a8da-f47fd199e875 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:07.685810 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-aba4b6f0-99c4-4c28-a8da-f47fd199e875 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11405f1a89ad45d59877d2a4a1c6a7c9', 'request_id': 'req-aba4b6f0-99c4-4c28-a8da-f47fd199e875'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:07.716481 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-aba4b6f0-99c4-4c28-a8da-f47fd199e875 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11405f1a89ad45d59877d2a4a1c6a7c9', 'request_id': 'req-aba4b6f0-99c4-4c28-a8da-f47fd199e875'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:07.744655 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-aba4b6f0-99c4-4c28-a8da-f47fd199e875 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11405f1a89ad45d59877d2a4a1c6a7c9', 'request_id': 'req-aba4b6f0-99c4-4c28-a8da-f47fd199e875'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:07.793555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-aba4b6f0-99c4-4c28-a8da-f47fd199e875 admin admin] The token cache is being invalidate because project 11405f1a89ad45d59877d2a4a1c6a7c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:15:07.798628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-aba4b6f0-99c4-4c28-a8da-f47fd199e875 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:07.803236 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-aba4b6f0-99c4-4c28-a8da-f47fd199e875 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:07.810179 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1954/3904] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:15:07 2022] DELETE /identity/v3/projects/11405f1a89ad45d59877d2a4a1c6a7c9 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:07.811507 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d960c4-6f1c-4224-9cab-670046e27851 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:07.829309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d960c4-6f1c-4224-9cab-670046e27851 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:07.930372 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:07.989966 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf7c99-002d-4363-8937-5b48bff9fae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:08.015950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf7c99-002d-4363-8937-5b48bff9fae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:08.016476 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf7c99-002d-4363-8937-5b48bff9fae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:08.027206 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf7c99-002d-4363-8937-5b48bff9fae1 admin admin] PATH_INFO: `/v3/users/ba57dcbd9f5a4f8db2568e56c8e11ddc` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:08.029299 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf7c99-002d-4363-8937-5b48bff9fae1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba57dcbd9f5a4f8db2568e56c8e11ddc)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:08.031404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf7c99-002d-4363-8937-5b48bff9fae1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:08.252759 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dbaf7c99-002d-4363-8937-5b48bff9fae1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba57dcbd9f5a4f8db2568e56c8e11ddc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:08.259862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dbaf7c99-002d-4363-8937-5b48bff9fae1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba57dcbd9f5a4f8db2568e56c8e11ddc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:08.283857 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dbaf7c99-002d-4363-8937-5b48bff9fae1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba57dcbd9f5a4f8db2568e56c8e11ddc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:08.323681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dbaf7c99-002d-4363-8937-5b48bff9fae1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba57dcbd9f5a4f8db2568e56c8e11ddc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:08.324404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dbaf7c99-002d-4363-8937-5b48bff9fae1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba57dcbd9f5a4f8db2568e56c8e11ddc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:08.378615 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1951/3905] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:15:07 2022] DELETE /identity/v3/users/ba57dcbd9f5a4f8db2568e56c8e11ddc => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:09.731287 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4b6f0-99c4-4c28-a8da-f47fd199e875 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:09.733596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-aba4b6f0-99c4-4c28-a8da-f47fd199e875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:09.769910 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4b6f0-99c4-4c28-a8da-f47fd199e875 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:09.991848 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea41c5-3801-4019-8101-9a63b42a470b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:09.992510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea41c5-3801-4019-8101-9a63b42a470b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:09.992790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea41c5-3801-4019-8101-9a63b42a470b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:09.993063 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea41c5-3801-4019-8101-9a63b42a470b admin admin] PATH_INFO: `/v3/projects/8f2d97b7facf4d2abeded4b40c761d37` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:09.998225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea41c5-3801-4019-8101-9a63b42a470b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f2d97b7facf4d2abeded4b40c761d37)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:10.000643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea41c5-3801-4019-8101-9a63b42a470b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:10.092661 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:10.112078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3eea41c5-3801-4019-8101-9a63b42a470b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f2d97b7facf4d2abeded4b40c761d37', 'request_id': 'req-3eea41c5-3801-4019-8101-9a63b42a470b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:10.139889 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3eea41c5-3801-4019-8101-9a63b42a470b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f2d97b7facf4d2abeded4b40c761d37', 'request_id': 'req-3eea41c5-3801-4019-8101-9a63b42a470b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:10.151894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3eea41c5-3801-4019-8101-9a63b42a470b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f2d97b7facf4d2abeded4b40c761d37', 'request_id': 'req-3eea41c5-3801-4019-8101-9a63b42a470b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:10.182819 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3eea41c5-3801-4019-8101-9a63b42a470b admin admin] The token cache is being invalidate because project 8f2d97b7facf4d2abeded4b40c761d37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:15:10.183315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3eea41c5-3801-4019-8101-9a63b42a470b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:10.186231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3eea41c5-3801-4019-8101-9a63b42a470b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:10.188152 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1955/3906] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:15:09 2022] DELETE /identity/v3/projects/8f2d97b7facf4d2abeded4b40c761d37 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:10.193655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8bbb6-b96c-49ee-9cfc-424bf1efb16b None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:10.194212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8bbb6-b96c-49ee-9cfc-424bf1efb16b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:10.194319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8bbb6-b96c-49ee-9cfc-424bf1efb16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:10.253516 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-44c8bbb6-b96c-49ee-9cfc-424bf1efb16b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:10.256702 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-44c8bbb6-b96c-49ee-9cfc-424bf1efb16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:10.456294 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1952/3907] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:10.465025 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14d9ed-bc99-4155-873f-c05798cc2253 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:10.465555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14d9ed-bc99-4155-873f-c05798cc2253 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:10.465994 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14d9ed-bc99-4155-873f-c05798cc2253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:10.544487 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-6e14d9ed-bc99-4155-873f-c05798cc2253 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:10.545966 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6e14d9ed-bc99-4155-873f-c05798cc2253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:10.584771 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1956/3908] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:10.586019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8bbb6-b96c-49ee-9cfc-424bf1efb16b None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:10.598010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8bbb6-b96c-49ee-9cfc-424bf1efb16b None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:10.612431 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47fc30-37d6-4552-80ac-223441594429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:10.614502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47fc30-37d6-4552-80ac-223441594429 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:10.614969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47fc30-37d6-4552-80ac-223441594429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:10.615404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47fc30-37d6-4552-80ac-223441594429 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:10.616247 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47fc30-37d6-4552-80ac-223441594429 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:15:10.616726 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47fc30-37d6-4552-80ac-223441594429 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:10.620959 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47fc30-37d6-4552-80ac-223441594429 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:10.650806 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1953/3909] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:15:10.655088 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14d9ed-bc99-4155-873f-c05798cc2253 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:10.672396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14d9ed-bc99-4155-873f-c05798cc2253 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:10.717391 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85170b7e-ccd9-46cc-9179-6eb111d5182e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:10.718053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85170b7e-ccd9-46cc-9179-6eb111d5182e admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:10.718334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85170b7e-ccd9-46cc-9179-6eb111d5182e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:10.725945 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85170b7e-ccd9-46cc-9179-6eb111d5182e admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:10.726709 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85170b7e-ccd9-46cc-9179-6eb111d5182e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:10.736722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85170b7e-ccd9-46cc-9179-6eb111d5182e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:10.854695 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1957/3910] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:15:10 2022] POST /identity/v3/projects => generated 383 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:10.858639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47fc30-37d6-4552-80ac-223441594429 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:10.873844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47fc30-37d6-4552-80ac-223441594429 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:10.956724 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:11.003006 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8140b-b65f-49e7-b09e-5bfe8a21eb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:11.003642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8140b-b65f-49e7-b09e-5bfe8a21eb3b admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:11.003926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8140b-b65f-49e7-b09e-5bfe8a21eb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:11.004238 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8140b-b65f-49e7-b09e-5bfe8a21eb3b admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:11.004915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d8140b-b65f-49e7-b09e-5bfe8a21eb3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:11.006894 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d8140b-b65f-49e7-b09e-5bfe8a21eb3b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:11.063424 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1954/3911] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:15:10 2022] POST /identity/v3/users => generated 292 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:11.067110 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85170b7e-ccd9-46cc-9179-6eb111d5182e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:11.079939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85170b7e-ccd9-46cc-9179-6eb111d5182e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:11.100020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd643308-9e06-43b5-a616-32be23bd813d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:11.100891 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd643308-9e06-43b5-a616-32be23bd813d admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:11.101346 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd643308-9e06-43b5-a616-32be23bd813d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:11.101892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd643308-9e06-43b5-a616-32be23bd813d admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:11.102942 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd643308-9e06-43b5-a616-32be23bd813d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:11.104744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd643308-9e06-43b5-a616-32be23bd813d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:11.138437 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1958/3912] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:15:11.141996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8140b-b65f-49e7-b09e-5bfe8a21eb3b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:11.157624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8140b-b65f-49e7-b09e-5bfe8a21eb3b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:11.170198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557aacdf-857e-49a4-8417-0ecbdda251bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:11.170830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557aacdf-857e-49a4-8417-0ecbdda251bd admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:11.171112 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557aacdf-857e-49a4-8417-0ecbdda251bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:11.171382 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557aacdf-857e-49a4-8417-0ecbdda251bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:11.172029 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557aacdf-857e-49a4-8417-0ecbdda251bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:11.173724 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557aacdf-857e-49a4-8417-0ecbdda251bd admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:11.207143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd643308-9e06-43b5-a616-32be23bd813d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:11.220370 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd643308-9e06-43b5-a616-32be23bd813d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:11.227507 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1955/3913] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:15:11.248138 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b73fc7-481e-469e-8c31-0c353309d189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:11.248825 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b73fc7-481e-469e-8c31-0c353309d189 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:11.249104 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b73fc7-481e-469e-8c31-0c353309d189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:11.249379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b73fc7-481e-469e-8c31-0c353309d189 admin admin] PATH_INFO: `/v3/projects/fad43c215d8f42ceb2e0a8c3d65ff6a9/users/d859c8fdac8d4b1faa9be54d51dee307/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:11.294846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b73fc7-481e-469e-8c31-0c353309d189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad43c215d8f42ceb2e0a8c3d65ff6a9, user_id=d859c8fdac8d4b1faa9be54d51dee307, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:11.297473 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b73fc7-481e-469e-8c31-0c353309d189 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:11.349354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29cf3d-e421-465d-94ad-b96b86f40c4c None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:11.349935 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29cf3d-e421-465d-94ad-b96b86f40c4c None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:11.350398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29cf3d-e421-465d-94ad-b96b86f40c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:11.353554 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1959/3914] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:15:11 2022] PUT /identity/v3/projects/fad43c215d8f42ceb2e0a8c3d65ff6a9/users/d859c8fdac8d4b1faa9be54d51dee307/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:15:11.402405 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-ec29cf3d-e421-465d-94ad-b96b86f40c4c None None] MFA Rules not processed for user `d859c8fdac8d4b1faa9be54d51dee307`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:11.403944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ec29cf3d-e421-465d-94ad-b96b86f40c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:11.527188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b73fc7-481e-469e-8c31-0c353309d189 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:11.527885 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1956/3915] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:11.729894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b73fc7-481e-469e-8c31-0c353309d189 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:11.756692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91437dd7-1730-4932-ac23-5ab17e950a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:11.757330 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91437dd7-1730-4932-ac23-5ab17e950a5b admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:11.764486 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91437dd7-1730-4932-ac23-5ab17e950a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:11.765022 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91437dd7-1730-4932-ac23-5ab17e950a5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:11.766154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91437dd7-1730-4932-ac23-5ab17e950a5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:11.774038 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91437dd7-1730-4932-ac23-5ab17e950a5b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:11.947889 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1960/3916] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:15:11 2022] POST /identity/v3/projects => generated 385 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:11.951769 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29cf3d-e421-465d-94ad-b96b86f40c4c None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:11.972085 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29cf3d-e421-465d-94ad-b96b86f40c4c None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:12.131093 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0095fe-2814-48ef-b4e9-86b5233a6fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:12.131738 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0095fe-2814-48ef-b4e9-86b5233a6fea admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:12.132044 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0095fe-2814-48ef-b4e9-86b5233a6fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:12.132285 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0095fe-2814-48ef-b4e9-86b5233a6fea admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:12.133049 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0095fe-2814-48ef-b4e9-86b5233a6fea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:12.136289 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0095fe-2814-48ef-b4e9-86b5233a6fea admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:12.206815 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1957/3917] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:15:11 2022] POST /identity/v3/users => generated 299 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:15:12.208120 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91437dd7-1730-4932-ac23-5ab17e950a5b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:12.220579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91437dd7-1730-4932-ac23-5ab17e950a5b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:12.280730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee14a98-433f-47b6-ae28-d8b0aac02ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:12.286209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee14a98-433f-47b6-ae28-d8b0aac02ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:12.288343 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee14a98-433f-47b6-ae28-d8b0aac02ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:12.288658 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee14a98-433f-47b6-ae28-d8b0aac02ad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:12.289354 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee14a98-433f-47b6-ae28-d8b0aac02ad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:12.312769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee14a98-433f-47b6-ae28-d8b0aac02ad2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:12.411357 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0095fe-2814-48ef-b4e9-86b5233a6fea admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:12.411942 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1961/3918] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:15:12.428147 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0095fe-2814-48ef-b4e9-86b5233a6fea admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:12.461610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094acce-6ad2-4d86-8f45-96c81572bb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:12.477464 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094acce-6ad2-4d86-8f45-96c81572bb52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:12.477464 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094acce-6ad2-4d86-8f45-96c81572bb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:12.477464 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094acce-6ad2-4d86-8f45-96c81572bb52 admin admin] PATH_INFO: `/v3/projects/33fa6387d39e43c5aee7fe58b325947b/users/f105fc3bbda3468e82afd85a74cd038f/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:12.544032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a094acce-6ad2-4d86-8f45-96c81572bb52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33fa6387d39e43c5aee7fe58b325947b, user_id=f105fc3bbda3468e82afd85a74cd038f, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:12.547346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a094acce-6ad2-4d86-8f45-96c81572bb52 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:12.586768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee14a98-433f-47b6-ae28-d8b0aac02ad2 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:12.587105 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1958/3919] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:15:12 2022] PUT /identity/v3/projects/33fa6387d39e43c5aee7fe58b325947b/users/f105fc3bbda3468e82afd85a74cd038f/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:12.612415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee14a98-433f-47b6-ae28-d8b0aac02ad2 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:12.779761 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:12.873083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5bcbb-2ffa-4e98-b932-c1020960768d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:12.874028 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5bcbb-2ffa-4e98-b932-c1020960768d admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:12.874471 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5bcbb-2ffa-4e98-b932-c1020960768d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:12.874941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5bcbb-2ffa-4e98-b932-c1020960768d admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:12.876017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc5bcbb-2ffa-4e98-b932-c1020960768d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:12.878005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc5bcbb-2ffa-4e98-b932-c1020960768d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:12.902829 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1962/3920] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:15:12.916714 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094acce-6ad2-4d86-8f45-96c81572bb52 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:12.932002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094acce-6ad2-4d86-8f45-96c81572bb52 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:12.947913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c210a50-b110-44bf-9bfb-5662d8791dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:12.949105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c210a50-b110-44bf-9bfb-5662d8791dd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:12.949575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c210a50-b110-44bf-9bfb-5662d8791dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:12.950036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c210a50-b110-44bf-9bfb-5662d8791dd3 admin admin] PATH_INFO: `/v3/projects/33fa6387d39e43c5aee7fe58b325947b/users/f105fc3bbda3468e82afd85a74cd038f/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:12.952348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c210a50-b110-44bf-9bfb-5662d8791dd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33fa6387d39e43c5aee7fe58b325947b, user_id=f105fc3bbda3468e82afd85a74cd038f, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:12.955256 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c210a50-b110-44bf-9bfb-5662d8791dd3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:13.003385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db1cb6-67ce-45a5-84cb-2c957e27eac1 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:13.003953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db1cb6-67ce-45a5-84cb-2c957e27eac1 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:13.004393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db1cb6-67ce-45a5-84cb-2c957e27eac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:13.007742 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1959/3921] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:15:12 2022] PUT /identity/v3/projects/33fa6387d39e43c5aee7fe58b325947b/users/f105fc3bbda3468e82afd85a74cd038f/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:13.110416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-07db1cb6-67ce-45a5-84cb-2c957e27eac1 None None] MFA Rules not processed for user `f105fc3bbda3468e82afd85a74cd038f`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:13.111819 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-07db1cb6-67ce-45a5-84cb-2c957e27eac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:13.372084 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c210a50-b110-44bf-9bfb-5662d8791dd3 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:13.374026 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1963/3922] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:13 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:13.377886 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:13.386692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c210a50-b110-44bf-9bfb-5662d8791dd3 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:13.393687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7552424-35e6-4453-a28d-68f8f2225d39 tempest-ProjectsNegativeTestJSON-1697419205 tempest-ProjectsNegativeTestJSON-1697419205-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f105fc3bbda3468e82afd85a74cd038f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33fa6387d39e43c5aee7fe58b325947b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:13.394295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7552424-35e6-4453-a28d-68f8f2225d39 tempest-ProjectsNegativeTestJSON-1697419205 tempest-ProjectsNegativeTestJSON-1697419205-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:13.396691 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7552424-35e6-4453-a28d-68f8f2225d39 tempest-ProjectsNegativeTestJSON-1697419205 tempest-ProjectsNegativeTestJSON-1697419205-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:13.396977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7552424-35e6-4453-a28d-68f8f2225d39 tempest-ProjectsNegativeTestJSON-1697419205 tempest-ProjectsNegativeTestJSON-1697419205-project-admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:13.397645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7552424-35e6-4453-a28d-68f8f2225d39 tempest-ProjectsNegativeTestJSON-1697419205 tempest-ProjectsNegativeTestJSON-1697419205-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:13.399515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7552424-35e6-4453-a28d-68f8f2225d39 tempest-ProjectsNegativeTestJSON-1697419205 tempest-ProjectsNegativeTestJSON-1697419205-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:13.467864 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1960/3923] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:15:13 2022] POST /identity/v3/projects => generated 359 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:13.471940 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db1cb6-67ce-45a5-84cb-2c957e27eac1 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:13.624619 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db1cb6-67ce-45a5-84cb-2c957e27eac1 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:13.722882 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d8061-47b4-4f8c-8169-93912aa007d3 tempest-ProjectsNegativeTestJSON-570686108 tempest-ProjectsNegativeTestJSON-570686108-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd859c8fdac8d4b1faa9be54d51dee307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad43c215d8f42ceb2e0a8c3d65ff6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:13.723808 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d8061-47b4-4f8c-8169-93912aa007d3 tempest-ProjectsNegativeTestJSON-570686108 tempest-ProjectsNegativeTestJSON-570686108-project] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:13.724120 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d8061-47b4-4f8c-8169-93912aa007d3 tempest-ProjectsNegativeTestJSON-570686108 tempest-ProjectsNegativeTestJSON-570686108-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:13.724394 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d8061-47b4-4f8c-8169-93912aa007d3 tempest-ProjectsNegativeTestJSON-570686108 tempest-ProjectsNegativeTestJSON-570686108-project] PATH_INFO: `/v3/projects/efeefa2e868344a180be084c651515be` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:13.725659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d8061-47b4-4f8c-8169-93912aa007d3 tempest-ProjectsNegativeTestJSON-570686108 tempest-ProjectsNegativeTestJSON-570686108-project] RBAC: Authorizing `identity:delete_project(project_id=efeefa2e868344a180be084c651515be)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:13.762272 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-0a4d8061-47b4-4f8c-8169-93912aa007d3 tempest-ProjectsNegativeTestJSON-570686108 tempest-ProjectsNegativeTestJSON-570686108-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Sep 04 01:15:13.762272 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:15:13.762272 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:15:13.762272 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:15:13.762272 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:15:13.762272 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:15:13.762272 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:15:13.762272 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:15:13.762272 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:15:13.762272 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:15:13.762272 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:15:13.762272 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:15:13.762272 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Sep 04 01:15:13.762272 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Sep 04 01:15:13.763517 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Sep 04 01:15:13.763517 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application enforcer_obj._enforce( Sep 04 01:15:13.763517 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Sep 04 01:15:13.763517 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Sep 04 01:15:13.763517 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 04 01:15:13.763517 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Sep 04 01:15:13.763517 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Sep 04 01:15:13.763517 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:15:13.765768 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1964/3924] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:15:13 2022] DELETE /identity/v3/projects/efeefa2e868344a180be084c651515be => generated 136 bytes in 294 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:15:13.769974 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7552424-35e6-4453-a28d-68f8f2225d39 tempest-ProjectsNegativeTestJSON-1697419205 tempest-ProjectsNegativeTestJSON-1697419205-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:13.945357 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7552424-35e6-4453-a28d-68f8f2225d39 tempest-ProjectsNegativeTestJSON-1697419205 tempest-ProjectsNegativeTestJSON-1697419205-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:13.951893 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a6aa6-7a0d-4089-baf0-068a1de3dd0e tempest-ProjectsNegativeTestJSON-1697419205 tempest-ProjectsNegativeTestJSON-1697419205-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f105fc3bbda3468e82afd85a74cd038f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33fa6387d39e43c5aee7fe58b325947b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:13.953886 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a6aa6-7a0d-4089-baf0-068a1de3dd0e tempest-ProjectsNegativeTestJSON-1697419205 tempest-ProjectsNegativeTestJSON-1697419205-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:13.971032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a6aa6-7a0d-4089-baf0-068a1de3dd0e tempest-ProjectsNegativeTestJSON-1697419205 tempest-ProjectsNegativeTestJSON-1697419205-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:13.972837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a6aa6-7a0d-4089-baf0-068a1de3dd0e tempest-ProjectsNegativeTestJSON-1697419205 tempest-ProjectsNegativeTestJSON-1697419205-project-admin] PATH_INFO: `/v3/projects/efeefa2e868344a180be084c651515be` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:13.980521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3a6aa6-7a0d-4089-baf0-068a1de3dd0e tempest-ProjectsNegativeTestJSON-1697419205 tempest-ProjectsNegativeTestJSON-1697419205-project-admin] RBAC: Authorizing `identity:delete_project(project_id=efeefa2e868344a180be084c651515be)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:13.987800 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3a6aa6-7a0d-4089-baf0-068a1de3dd0e tempest-ProjectsNegativeTestJSON-1697419205 tempest-ProjectsNegativeTestJSON-1697419205-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:14.158709 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-da3a6aa6-7a0d-4089-baf0-068a1de3dd0e tempest-ProjectsNegativeTestJSON-1697419205 tempest-ProjectsNegativeTestJSON-1697419205-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efeefa2e868344a180be084c651515be', 'request_id': 'req-da3a6aa6-7a0d-4089-baf0-068a1de3dd0e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:14.180739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-da3a6aa6-7a0d-4089-baf0-068a1de3dd0e tempest-ProjectsNegativeTestJSON-1697419205 tempest-ProjectsNegativeTestJSON-1697419205-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efeefa2e868344a180be084c651515be', 'request_id': 'req-da3a6aa6-7a0d-4089-baf0-068a1de3dd0e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:14.192043 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-da3a6aa6-7a0d-4089-baf0-068a1de3dd0e tempest-ProjectsNegativeTestJSON-1697419205 tempest-ProjectsNegativeTestJSON-1697419205-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efeefa2e868344a180be084c651515be', 'request_id': 'req-da3a6aa6-7a0d-4089-baf0-068a1de3dd0e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:14.226551 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-da3a6aa6-7a0d-4089-baf0-068a1de3dd0e tempest-ProjectsNegativeTestJSON-1697419205 tempest-ProjectsNegativeTestJSON-1697419205-project-admin] The token cache is being invalidate because project efeefa2e868344a180be084c651515be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:15:14.227670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-da3a6aa6-7a0d-4089-baf0-068a1de3dd0e tempest-ProjectsNegativeTestJSON-1697419205 tempest-ProjectsNegativeTestJSON-1697419205-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:14.232330 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-da3a6aa6-7a0d-4089-baf0-068a1de3dd0e tempest-ProjectsNegativeTestJSON-1697419205 tempest-ProjectsNegativeTestJSON-1697419205-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:14.246295 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1961/3925] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:15:13 2022] DELETE /identity/v3/projects/efeefa2e868344a180be084c651515be => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:14.251012 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d8061-47b4-4f8c-8169-93912aa007d3 tempest-ProjectsNegativeTestJSON-570686108 tempest-ProjectsNegativeTestJSON-570686108-project] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:14.258019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0a4d8061-47b4-4f8c-8169-93912aa007d3 tempest-ProjectsNegativeTestJSON-570686108 tempest-ProjectsNegativeTestJSON-570686108-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:14.329859 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:14.545145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d8061-47b4-4f8c-8169-93912aa007d3 tempest-ProjectsNegativeTestJSON-570686108 tempest-ProjectsNegativeTestJSON-570686108-project] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:14.688125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a6aa6-7a0d-4089-baf0-068a1de3dd0e tempest-ProjectsNegativeTestJSON-1697419205 tempest-ProjectsNegativeTestJSON-1697419205-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:14.689803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-da3a6aa6-7a0d-4089-baf0-068a1de3dd0e tempest-ProjectsNegativeTestJSON-1697419205 tempest-ProjectsNegativeTestJSON-1697419205-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:14.774843 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352345e-53ba-41cf-95da-0fcfefd6b93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:14.777764 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352345e-53ba-41cf-95da-0fcfefd6b93c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:14.779983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352345e-53ba-41cf-95da-0fcfefd6b93c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:14.780475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352345e-53ba-41cf-95da-0fcfefd6b93c admin admin] PATH_INFO: `/v3/users/d859c8fdac8d4b1faa9be54d51dee307` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:14.783973 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1352345e-53ba-41cf-95da-0fcfefd6b93c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d859c8fdac8d4b1faa9be54d51dee307)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:14.789679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1352345e-53ba-41cf-95da-0fcfefd6b93c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:14.852723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a6aa6-7a0d-4089-baf0-068a1de3dd0e tempest-ProjectsNegativeTestJSON-1697419205 tempest-ProjectsNegativeTestJSON-1697419205-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:14.857325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b1bdd-92b6-4cbd-ae20-30b3e116ea96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:14.857980 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b1bdd-92b6-4cbd-ae20-30b3e116ea96 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:14.858261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b1bdd-92b6-4cbd-ae20-30b3e116ea96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:14.858540 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b1bdd-92b6-4cbd-ae20-30b3e116ea96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:14.866297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-341b1bdd-92b6-4cbd-ae20-30b3e116ea96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:14.891063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b1bdd-92b6-4cbd-ae20-30b3e116ea96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:14.893478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b1bdd-92b6-4cbd-ae20-30b3e116ea96 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:14.913280 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1962/3926] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:15:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:15:14.937857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1352345e-53ba-41cf-95da-0fcfefd6b93c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd859c8fdac8d4b1faa9be54d51dee307'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:14.940924 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1352345e-53ba-41cf-95da-0fcfefd6b93c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd859c8fdac8d4b1faa9be54d51dee307'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:14.957030 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1352345e-53ba-41cf-95da-0fcfefd6b93c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd859c8fdac8d4b1faa9be54d51dee307'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:14.968560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1352345e-53ba-41cf-95da-0fcfefd6b93c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd859c8fdac8d4b1faa9be54d51dee307'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:14.970475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1352345e-53ba-41cf-95da-0fcfefd6b93c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd859c8fdac8d4b1faa9be54d51dee307'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:14.997975 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1965/3927] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:15:14 2022] DELETE /identity/v3/users/d859c8fdac8d4b1faa9be54d51dee307 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:14.999838 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7493df-eece-48b2-82b0-3aacc044bb72 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:15.000133 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7493df-eece-48b2-82b0-3aacc044bb72 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:15.000412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7493df-eece-48b2-82b0-3aacc044bb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:15.033678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-fc7493df-eece-48b2-82b0-3aacc044bb72 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:15.034959 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-fc7493df-eece-48b2-82b0-3aacc044bb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:15.060452 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:15.150981 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1963/3928] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:15.162708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352345e-53ba-41cf-95da-0fcfefd6b93c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:15.164461 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1352345e-53ba-41cf-95da-0fcfefd6b93c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:15.287492 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:15.352566 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352345e-53ba-41cf-95da-0fcfefd6b93c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:15.370182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb67831-48aa-4c09-aaef-f335ef4fd305 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:15.370830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb67831-48aa-4c09-aaef-f335ef4fd305 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:15.371116 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb67831-48aa-4c09-aaef-f335ef4fd305 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:15.371396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb67831-48aa-4c09-aaef-f335ef4fd305 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:15.409020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb67831-48aa-4c09-aaef-f335ef4fd305 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:15.410541 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb67831-48aa-4c09-aaef-f335ef4fd305 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:15.435602 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1966/3929] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:15:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:15:17.063970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7493df-eece-48b2-82b0-3aacc044bb72 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:17.065551 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-fc7493df-eece-48b2-82b0-3aacc044bb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:17.088110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7493df-eece-48b2-82b0-3aacc044bb72 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:17.121838 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c997d53-9897-4798-8a72-9d7ff89dcd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:17.127698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c997d53-9897-4798-8a72-9d7ff89dcd13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:17.128331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c997d53-9897-4798-8a72-9d7ff89dcd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:17.130040 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c997d53-9897-4798-8a72-9d7ff89dcd13 admin admin] PATH_INFO: `/v3/projects/fad43c215d8f42ceb2e0a8c3d65ff6a9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:17.138859 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c997d53-9897-4798-8a72-9d7ff89dcd13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fad43c215d8f42ceb2e0a8c3d65ff6a9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:17.147072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c997d53-9897-4798-8a72-9d7ff89dcd13 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:17.295719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4c997d53-9897-4798-8a72-9d7ff89dcd13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fad43c215d8f42ceb2e0a8c3d65ff6a9', 'request_id': 'req-4c997d53-9897-4798-8a72-9d7ff89dcd13'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:17.319318 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4c997d53-9897-4798-8a72-9d7ff89dcd13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fad43c215d8f42ceb2e0a8c3d65ff6a9', 'request_id': 'req-4c997d53-9897-4798-8a72-9d7ff89dcd13'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:17.336798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4c997d53-9897-4798-8a72-9d7ff89dcd13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fad43c215d8f42ceb2e0a8c3d65ff6a9', 'request_id': 'req-4c997d53-9897-4798-8a72-9d7ff89dcd13'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:17.367917 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4c997d53-9897-4798-8a72-9d7ff89dcd13 admin admin] The token cache is being invalidate because project fad43c215d8f42ceb2e0a8c3d65ff6a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:15:17.368371 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4c997d53-9897-4798-8a72-9d7ff89dcd13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:17.371029 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4c997d53-9897-4798-8a72-9d7ff89dcd13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:17.378086 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1964/3930] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:15:17 2022] DELETE /identity/v3/projects/fad43c215d8f42ceb2e0a8c3d65ff6a9 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:17.378544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb67831-48aa-4c09-aaef-f335ef4fd305 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:17.390216 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb67831-48aa-4c09-aaef-f335ef4fd305 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:17.568258 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a0481-60cf-4b8f-b465-3abd8a52d73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:17.568856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a0481-60cf-4b8f-b465-3abd8a52d73a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:17.569157 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a0481-60cf-4b8f-b465-3abd8a52d73a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:17.569460 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a0481-60cf-4b8f-b465-3abd8a52d73a admin admin] PATH_INFO: `/v3/users/f105fc3bbda3468e82afd85a74cd038f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:17.570666 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a0481-60cf-4b8f-b465-3abd8a52d73a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f105fc3bbda3468e82afd85a74cd038f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:17.572674 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a0481-60cf-4b8f-b465-3abd8a52d73a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:17.686414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-563a0481-60cf-4b8f-b465-3abd8a52d73a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f105fc3bbda3468e82afd85a74cd038f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:17.687332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-563a0481-60cf-4b8f-b465-3abd8a52d73a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f105fc3bbda3468e82afd85a74cd038f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:17.695931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-563a0481-60cf-4b8f-b465-3abd8a52d73a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f105fc3bbda3468e82afd85a74cd038f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:17.710496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-563a0481-60cf-4b8f-b465-3abd8a52d73a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f105fc3bbda3468e82afd85a74cd038f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:17.711816 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-563a0481-60cf-4b8f-b465-3abd8a52d73a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f105fc3bbda3468e82afd85a74cd038f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:17.790934 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1967/3931] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:15:17 2022] DELETE /identity/v3/users/f105fc3bbda3468e82afd85a74cd038f => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:19.287842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c997d53-9897-4798-8a72-9d7ff89dcd13 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:19.287842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4c997d53-9897-4798-8a72-9d7ff89dcd13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:19.328194 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c997d53-9897-4798-8a72-9d7ff89dcd13 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:19.718282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fb2d5-338c-4ae7-a858-12685519cd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:19.721484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fb2d5-338c-4ae7-a858-12685519cd00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:19.726421 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fb2d5-338c-4ae7-a858-12685519cd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:19.728707 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fb2d5-338c-4ae7-a858-12685519cd00 admin admin] PATH_INFO: `/v3/projects/33fa6387d39e43c5aee7fe58b325947b` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:19.733850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26fb2d5-338c-4ae7-a858-12685519cd00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33fa6387d39e43c5aee7fe58b325947b)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:19.743317 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26fb2d5-338c-4ae7-a858-12685519cd00 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:19.923620 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:19.960625 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b26fb2d5-338c-4ae7-a858-12685519cd00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33fa6387d39e43c5aee7fe58b325947b', 'request_id': 'req-b26fb2d5-338c-4ae7-a858-12685519cd00'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:19.980875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b26fb2d5-338c-4ae7-a858-12685519cd00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33fa6387d39e43c5aee7fe58b325947b', 'request_id': 'req-b26fb2d5-338c-4ae7-a858-12685519cd00'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:19.995808 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b26fb2d5-338c-4ae7-a858-12685519cd00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33fa6387d39e43c5aee7fe58b325947b', 'request_id': 'req-b26fb2d5-338c-4ae7-a858-12685519cd00'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:20.022435 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b26fb2d5-338c-4ae7-a858-12685519cd00 admin admin] The token cache is being invalidate because project 33fa6387d39e43c5aee7fe58b325947b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:15:20.022997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b26fb2d5-338c-4ae7-a858-12685519cd00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:20.025892 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b26fb2d5-338c-4ae7-a858-12685519cd00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:20.033507 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1965/3932] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:15:19 2022] DELETE /identity/v3/projects/33fa6387d39e43c5aee7fe58b325947b => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:20.038316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf41c15-54b8-4545-a40c-91a28a1cfbb3 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:20.039171 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf41c15-54b8-4545-a40c-91a28a1cfbb3 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:20.039625 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf41c15-54b8-4545-a40c-91a28a1cfbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:20.102203 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ccf41c15-54b8-4545-a40c-91a28a1cfbb3 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:20.103686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ccf41c15-54b8-4545-a40c-91a28a1cfbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:20.372103 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fb2d5-338c-4ae7-a858-12685519cd00 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:20.373699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b26fb2d5-338c-4ae7-a858-12685519cd00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:20.511413 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1968/3933] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:20.529086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49114ae9-ecf8-419f-a1ac-7e882798d658 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:20.572990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49114ae9-ecf8-419f-a1ac-7e882798d658 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:20.578587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49114ae9-ecf8-419f-a1ac-7e882798d658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:20.624397 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:20.710997 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-49114ae9-ecf8-419f-a1ac-7e882798d658 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:20.710997 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-49114ae9-ecf8-419f-a1ac-7e882798d658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:20.724006 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1969/3934] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:20.726341 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49114ae9-ecf8-419f-a1ac-7e882798d658 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:20.768909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49114ae9-ecf8-419f-a1ac-7e882798d658 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:20.788419 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98477a3e-0c50-482d-821e-db16ed57e464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:20.790558 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98477a3e-0c50-482d-821e-db16ed57e464 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:20.791063 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98477a3e-0c50-482d-821e-db16ed57e464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:20.797612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98477a3e-0c50-482d-821e-db16ed57e464 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:20.798546 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98477a3e-0c50-482d-821e-db16ed57e464 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:15:20.800686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98477a3e-0c50-482d-821e-db16ed57e464 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:20.807344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98477a3e-0c50-482d-821e-db16ed57e464 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:20.829403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fb2d5-338c-4ae7-a858-12685519cd00 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:20.845158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5f8ef-5032-4437-a81d-c0024a179dbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:20.845876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5f8ef-5032-4437-a81d-c0024a179dbd service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:20.846160 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5f8ef-5032-4437-a81d-c0024a179dbd service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:20.846434 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5f8ef-5032-4437-a81d-c0024a179dbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:20.853644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b2a5f8ef-5032-4437-a81d-c0024a179dbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:20.855222 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1970/3935] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:15:20.855222 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98477a3e-0c50-482d-821e-db16ed57e464 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:20.884169 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5f8ef-5032-4437-a81d-c0024a179dbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:20.888194 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98477a3e-0c50-482d-821e-db16ed57e464 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:20.889684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5f8ef-5032-4437-a81d-c0024a179dbd service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:20.899559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f930e-087f-4716-9c09-518a19e29010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:20.900211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f930e-087f-4716-9c09-518a19e29010 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:20.900490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f930e-087f-4716-9c09-518a19e29010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:20.900762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f930e-087f-4716-9c09-518a19e29010 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:20.901410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f930e-087f-4716-9c09-518a19e29010 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:20.909550 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f930e-087f-4716-9c09-518a19e29010 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:20.917960 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1966/3936] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:15:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:15:20.971228 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1971/3937] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:15:20 2022] POST /identity/v3/projects => generated 367 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:20.974715 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5f8ef-5032-4437-a81d-c0024a179dbd service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:20.990645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5f8ef-5032-4437-a81d-c0024a179dbd service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:21.150699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0569a1-0ce9-414c-99a0-9c732730b23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:21.151328 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0569a1-0ce9-414c-99a0-9c732730b23a admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:21.151605 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0569a1-0ce9-414c-99a0-9c732730b23a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:21.151950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0569a1-0ce9-414c-99a0-9c732730b23a admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:21.154337 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0569a1-0ce9-414c-99a0-9c732730b23a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:21.158947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0569a1-0ce9-414c-99a0-9c732730b23a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:21.216903 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f930e-087f-4716-9c09-518a19e29010 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:21.225173 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1967/3938] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:15:20 2022] POST /identity/v3/users => generated 284 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:21.230298 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f930e-087f-4716-9c09-518a19e29010 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:21.237071 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76653c-fd4e-49f7-bc7c-12464c125fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:21.237881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76653c-fd4e-49f7-bc7c-12464c125fcc admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:21.238446 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76653c-fd4e-49f7-bc7c-12464c125fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:21.239476 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76653c-fd4e-49f7-bc7c-12464c125fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:21.240343 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f76653c-fd4e-49f7-bc7c-12464c125fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:21.242463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f76653c-fd4e-49f7-bc7c-12464c125fcc admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:21.258091 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1972/3939] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:15:21.261733 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0569a1-0ce9-414c-99a0-9c732730b23a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:21.280618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0569a1-0ce9-414c-99a0-9c732730b23a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:21.290353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13a43f-ea96-410b-b8bb-25db2a2bf7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:21.290353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13a43f-ea96-410b-b8bb-25db2a2bf7da admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:21.290730 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13a43f-ea96-410b-b8bb-25db2a2bf7da admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:21.291035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13a43f-ea96-410b-b8bb-25db2a2bf7da admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:21.291939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce13a43f-ea96-410b-b8bb-25db2a2bf7da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:21.302221 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce13a43f-ea96-410b-b8bb-25db2a2bf7da admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:21.303591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76653c-fd4e-49f7-bc7c-12464c125fcc admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:21.349283 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1968/3940] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:15:21.350215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13a43f-ea96-410b-b8bb-25db2a2bf7da admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:21.374767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13a43f-ea96-410b-b8bb-25db2a2bf7da admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:21.394806 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea3778-27e8-4854-82c0-20918a713685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:21.395565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea3778-27e8-4854-82c0-20918a713685 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:21.395833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea3778-27e8-4854-82c0-20918a713685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:21.396116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea3778-27e8-4854-82c0-20918a713685 admin admin] PATH_INFO: `/v3/projects/babac969d9464ca4bc431d4179f3f051/users/c3c84efdebbf49d78b4f016a5d41ce85/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:21.436113 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea3778-27e8-4854-82c0-20918a713685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=babac969d9464ca4bc431d4179f3f051, user_id=c3c84efdebbf49d78b4f016a5d41ce85, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:21.440552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea3778-27e8-4854-82c0-20918a713685 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:21.468806 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1969/3941] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:15:21 2022] PUT /identity/v3/projects/babac969d9464ca4bc431d4179f3f051/users/c3c84efdebbf49d78b4f016a5d41ce85/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:21.483017 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84156d0f-7c70-4788-a699-5db367313622 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:21.483288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84156d0f-7c70-4788-a699-5db367313622 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:21.483809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84156d0f-7c70-4788-a699-5db367313622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:21.509837 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:21.510827 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76653c-fd4e-49f7-bc7c-12464c125fcc admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:21.556256 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-84156d0f-7c70-4788-a699-5db367313622 None None] MFA Rules not processed for user `c3c84efdebbf49d78b4f016a5d41ce85`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:21.557875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-84156d0f-7c70-4788-a699-5db367313622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:21.641319 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1970/3942] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:15:21.645871 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84156d0f-7c70-4788-a699-5db367313622 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:21.654718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae560b-56f5-47da-9e11-8724490f32ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:21.655475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae560b-56f5-47da-9e11-8724490f32ee service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:21.655855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae560b-56f5-47da-9e11-8724490f32ee service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:21.656233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae560b-56f5-47da-9e11-8724490f32ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:21.658523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d1ae560b-56f5-47da-9e11-8724490f32ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:21.728241 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:21.745237 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84156d0f-7c70-4788-a699-5db367313622 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:21.751950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879e27d-1ce9-4cb5-8dd1-7e90252e4f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:21.752759 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae560b-56f5-47da-9e11-8724490f32ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:21.752977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879e27d-1ce9-4cb5-8dd1-7e90252e4f09 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:21.753198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879e27d-1ce9-4cb5-8dd1-7e90252e4f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:21.753497 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879e27d-1ce9-4cb5-8dd1-7e90252e4f09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:21.755107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae560b-56f5-47da-9e11-8724490f32ee service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:21.755319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4879e27d-1ce9-4cb5-8dd1-7e90252e4f09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:21.757679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4879e27d-1ce9-4cb5-8dd1-7e90252e4f09 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:21.767116 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1973/3943] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:15:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:15:21.820691 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1971/3944] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:15:21 2022] POST /identity/v3/projects => generated 369 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:15:21.824625 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae560b-56f5-47da-9e11-8724490f32ee service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:21.842765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae560b-56f5-47da-9e11-8724490f32ee service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:21.942746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4f4d5-0c55-47ef-bfbc-429bdbda0e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:21.943788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4f4d5-0c55-47ef-bfbc-429bdbda0e5d admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:21.944235 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4f4d5-0c55-47ef-bfbc-429bdbda0e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:21.944522 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4f4d5-0c55-47ef-bfbc-429bdbda0e5d admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:21.945228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e4f4d5-0c55-47ef-bfbc-429bdbda0e5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:21.948870 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e4f4d5-0c55-47ef-bfbc-429bdbda0e5d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:21.975398 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1974/3945] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:15:21 2022] POST /identity/v3/users => generated 291 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:21.979227 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879e27d-1ce9-4cb5-8dd1-7e90252e4f09 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:21.999006 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879e27d-1ce9-4cb5-8dd1-7e90252e4f09 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:22.008299 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52c1d9-32fe-4889-be41-3c70f3fe252a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:22.009657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52c1d9-32fe-4889-be41-3c70f3fe252a admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:22.010150 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52c1d9-32fe-4889-be41-3c70f3fe252a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:22.010571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52c1d9-32fe-4889-be41-3c70f3fe252a admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:22.011361 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52c1d9-32fe-4889-be41-3c70f3fe252a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:22.013226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52c1d9-32fe-4889-be41-3c70f3fe252a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:22.029096 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1972/3946] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:15:22.030263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4f4d5-0c55-47ef-bfbc-429bdbda0e5d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:22.042832 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4f4d5-0c55-47ef-bfbc-429bdbda0e5d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:22.048564 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f27499-0824-4421-8bf5-3fb4940bcb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:22.049371 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f27499-0824-4421-8bf5-3fb4940bcb03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:22.049757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f27499-0824-4421-8bf5-3fb4940bcb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:22.050101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f27499-0824-4421-8bf5-3fb4940bcb03 admin admin] PATH_INFO: `/v3/projects/31cf6a92cb134ce6bef486dfd394ae19/users/9be84a0850204c9795416a571a5ec268/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:22.069612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f27499-0824-4421-8bf5-3fb4940bcb03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31cf6a92cb134ce6bef486dfd394ae19, user_id=9be84a0850204c9795416a571a5ec268, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:22.072524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f27499-0824-4421-8bf5-3fb4940bcb03 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:22.100410 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1975/3947] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:15:22 2022] PUT /identity/v3/projects/31cf6a92cb134ce6bef486dfd394ae19/users/9be84a0850204c9795416a571a5ec268/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:22.102309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52c1d9-32fe-4889-be41-3c70f3fe252a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:22.114278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52c1d9-32fe-4889-be41-3c70f3fe252a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:22.246042 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1361e6a-cee8-4bc8-9544-08eefb6c2a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:22.246718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1361e6a-cee8-4bc8-9544-08eefb6c2a3e admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:22.246994 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1361e6a-cee8-4bc8-9544-08eefb6c2a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:22.247312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1361e6a-cee8-4bc8-9544-08eefb6c2a3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:22.249120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1361e6a-cee8-4bc8-9544-08eefb6c2a3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:22.257174 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1361e6a-cee8-4bc8-9544-08eefb6c2a3e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:22.284927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f27499-0824-4421-8bf5-3fb4940bcb03 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:22.287479 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1973/3948] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:15:22.301000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f27499-0824-4421-8bf5-3fb4940bcb03 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:22.315693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ceadb-47f9-4af4-a1ec-bb341b915c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:22.316367 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ceadb-47f9-4af4-a1ec-bb341b915c0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:22.316647 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ceadb-47f9-4af4-a1ec-bb341b915c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:22.316964 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ceadb-47f9-4af4-a1ec-bb341b915c0b admin admin] PATH_INFO: `/v3/projects/31cf6a92cb134ce6bef486dfd394ae19/users/9be84a0850204c9795416a571a5ec268/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:22.320001 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ceadb-47f9-4af4-a1ec-bb341b915c0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=31cf6a92cb134ce6bef486dfd394ae19, user_id=9be84a0850204c9795416a571a5ec268, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:22.322842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ceadb-47f9-4af4-a1ec-bb341b915c0b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:22.335572 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1976/3949] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:15:22 2022] PUT /identity/v3/projects/31cf6a92cb134ce6bef486dfd394ae19/users/9be84a0850204c9795416a571a5ec268/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:15:22.347351 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34bf4b-ed67-4a1d-9e0f-c662658f8cb0 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:22.347351 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34bf4b-ed67-4a1d-9e0f-c662658f8cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:22.347351 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34bf4b-ed67-4a1d-9e0f-c662658f8cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:22.364969 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:22.386487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-db34bf4b-ed67-4a1d-9e0f-c662658f8cb0 None None] MFA Rules not processed for user `9be84a0850204c9795416a571a5ec268`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:22.387761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-db34bf4b-ed67-4a1d-9e0f-c662658f8cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:22.493818 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1974/3950] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:22 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:22.498216 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ceadb-47f9-4af4-a1ec-bb341b915c0b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:22.645759 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ceadb-47f9-4af4-a1ec-bb341b915c0b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:22.650808 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f5bf7-f4a0-4e08-aab2-79c0c201ecdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:22.651411 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f5bf7-f4a0-4e08-aab2-79c0c201ecdb admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:22.651778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f5bf7-f4a0-4e08-aab2-79c0c201ecdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:22.652118 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f5bf7-f4a0-4e08-aab2-79c0c201ecdb admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:22.652911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f5bf7-f4a0-4e08-aab2-79c0c201ecdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:22.669085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f5bf7-f4a0-4e08-aab2-79c0c201ecdb admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:22.712338 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1977/3951] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:15:22 2022] POST /identity/v3/projects => generated 367 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:22.716069 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34bf4b-ed67-4a1d-9e0f-c662658f8cb0 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:22.731521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34bf4b-ed67-4a1d-9e0f-c662658f8cb0 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:22.802078 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173e002-76cf-46db-9bb0-6bab71119981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:22.802769 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173e002-76cf-46db-9bb0-6bab71119981 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:22.803110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173e002-76cf-46db-9bb0-6bab71119981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:22.803457 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173e002-76cf-46db-9bb0-6bab71119981 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:22.810166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173e002-76cf-46db-9bb0-6bab71119981 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:22.812315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173e002-76cf-46db-9bb0-6bab71119981 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:22.852489 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1975/3952] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:15:22 2022] POST /identity/v3/users => generated 284 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:22.856268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f5bf7-f4a0-4e08-aab2-79c0c201ecdb admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:22.867429 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f5bf7-f4a0-4e08-aab2-79c0c201ecdb admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:22.874150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe57b7-88d7-4b45-a844-4ab2d962c374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:22.875007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe57b7-88d7-4b45-a844-4ab2d962c374 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:22.875353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe57b7-88d7-4b45-a844-4ab2d962c374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:22.875692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe57b7-88d7-4b45-a844-4ab2d962c374 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:22.876397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe57b7-88d7-4b45-a844-4ab2d962c374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:22.878101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe57b7-88d7-4b45-a844-4ab2d962c374 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:22.892897 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1978/3953] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:15:22.897723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173e002-76cf-46db-9bb0-6bab71119981 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:22.908527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173e002-76cf-46db-9bb0-6bab71119981 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:22.913299 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09607976-7ae9-4a5b-aa72-888a731fa0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:22.914012 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09607976-7ae9-4a5b-aa72-888a731fa0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:22.914356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09607976-7ae9-4a5b-aa72-888a731fa0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:22.914690 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09607976-7ae9-4a5b-aa72-888a731fa0c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:22.915395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09607976-7ae9-4a5b-aa72-888a731fa0c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:22.917135 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09607976-7ae9-4a5b-aa72-888a731fa0c4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:22.939409 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1976/3954] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:15:22.940242 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe57b7-88d7-4b45-a844-4ab2d962c374 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:22.951290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe57b7-88d7-4b45-a844-4ab2d962c374 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:22.958060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7d9f8-292a-4251-9afe-57f8d0b3191b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:22.958799 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7d9f8-292a-4251-9afe-57f8d0b3191b admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:22.959147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7d9f8-292a-4251-9afe-57f8d0b3191b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:22.959490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7d9f8-292a-4251-9afe-57f8d0b3191b admin admin] PATH_INFO: `/v3/projects/9e20420801fe47419f0f76efa7050111/users/d339ec05ca6a4865b0623f3488fab25a/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:22.971538 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:22.975897 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf7d9f8-292a-4251-9afe-57f8d0b3191b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e20420801fe47419f0f76efa7050111, user_id=d339ec05ca6a4865b0623f3488fab25a, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:22.979063 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf7d9f8-292a-4251-9afe-57f8d0b3191b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:22.997158 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1979/3955] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:15:22 2022] PUT /identity/v3/projects/9e20420801fe47419f0f76efa7050111/users/d339ec05ca6a4865b0623f3488fab25a/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:15:23.008510 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49671ef-2d60-4ab0-96cc-d29692a7d979 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:23.008807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49671ef-2d60-4ab0-96cc-d29692a7d979 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:23.009063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49671ef-2d60-4ab0-96cc-d29692a7d979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:23.048465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a49671ef-2d60-4ab0-96cc-d29692a7d979 None None] MFA Rules not processed for user `d339ec05ca6a4865b0623f3488fab25a`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:23.049369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a49671ef-2d60-4ab0-96cc-d29692a7d979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:23.138621 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:23.148439 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1977/3956] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:23.150480 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7d9f8-292a-4251-9afe-57f8d0b3191b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:23.228009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7d9f8-292a-4251-9afe-57f8d0b3191b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:23.234307 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbc3d6-6508-4cfe-a40b-96827ae49724 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:23.235687 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbc3d6-6508-4cfe-a40b-96827ae49724 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:23.236044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbc3d6-6508-4cfe-a40b-96827ae49724 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:23.236385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbc3d6-6508-4cfe-a40b-96827ae49724 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:23.237380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcbc3d6-6508-4cfe-a40b-96827ae49724 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:23.239051 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-bdcbc3d6-6508-4cfe-a40b-96827ae49724 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:15:23.239051 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:15:23.239051 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:15:23.240038 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcbc3d6-6508-4cfe-a40b-96827ae49724 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:23.261482 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1980/3957] 10.222.0.30 () {60 vars in 1149 bytes} [Sun Sep 4 01:15:23 2022] POST /identity/v3/domains => generated 276 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:23.264188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49671ef-2d60-4ab0-96cc-d29692a7d979 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:23.276742 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49671ef-2d60-4ab0-96cc-d29692a7d979 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:23.351007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b0165-c841-48aa-9e94-dfb3ce166a7b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:23.351896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b0165-c841-48aa-9e94-dfb3ce166a7b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:23.352050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b0165-c841-48aa-9e94-dfb3ce166a7b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:23.352403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b0165-c841-48aa-9e94-dfb3ce166a7b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:23.353211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b0165-c841-48aa-9e94-dfb3ce166a7b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:23.354553 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-502b0165-c841-48aa-9e94-dfb3ce166a7b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:15:23.354553 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:15:23.354553 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:15:23.355488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b0165-c841-48aa-9e94-dfb3ce166a7b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:23.373481 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1978/3958] 10.222.0.30 () {60 vars in 1143 bytes} [Sun Sep 4 01:15:23 2022] POST /identity/v3/roles => generated 240 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:23.377712 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbc3d6-6508-4cfe-a40b-96827ae49724 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:23.389677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbc3d6-6508-4cfe-a40b-96827ae49724 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:23.409476 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0587d-ba39-462d-957c-4a2e036f7895 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:23.410346 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0587d-ba39-462d-957c-4a2e036f7895 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:23.411266 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0587d-ba39-462d-957c-4a2e036f7895 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:23.411551 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0587d-ba39-462d-957c-4a2e036f7895 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/domains/d4946669b9a347e68766c674573f4c40/users/d339ec05ca6a4865b0623f3488fab25a/roles/7c031068e05549f287954fbab3a9bb36` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:23.430352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf0587d-ba39-462d-957c-4a2e036f7895 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=d4946669b9a347e68766c674573f4c40, user_id=d339ec05ca6a4865b0623f3488fab25a, role_id=7c031068e05549f287954fbab3a9bb36)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:23.433352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf0587d-ba39-462d-957c-4a2e036f7895 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:23.452903 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1981/3959] 10.222.0.30 () {60 vars in 1480 bytes} [Sun Sep 4 01:15:23 2022] PUT /identity/v3/domains/d4946669b9a347e68766c674573f4c40/users/d339ec05ca6a4865b0623f3488fab25a/roles/7c031068e05549f287954fbab3a9bb36 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:23.457157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b0165-c841-48aa-9e94-dfb3ce166a7b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:23.470429 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b0165-c841-48aa-9e94-dfb3ce166a7b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:23.544783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70434b61-78d5-487a-a56a-5e4acc01ac83 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:23.545658 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70434b61-78d5-487a-a56a-5e4acc01ac83 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:23.546284 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70434b61-78d5-487a-a56a-5e4acc01ac83 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:23.547047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70434b61-78d5-487a-a56a-5e4acc01ac83 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:23.547956 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70434b61-78d5-487a-a56a-5e4acc01ac83 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:23.549342 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-70434b61-78d5-487a-a56a-5e4acc01ac83 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:15:23.549342 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:15:23.549342 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:15:23.550721 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70434b61-78d5-487a-a56a-5e4acc01ac83 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:23.576833 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1979/3960] 10.222.0.30 () {60 vars in 1149 bytes} [Sun Sep 4 01:15:23 2022] POST /identity/v3/domains => generated 277 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:23.577840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0587d-ba39-462d-957c-4a2e036f7895 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:23.589882 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0587d-ba39-462d-957c-4a2e036f7895 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:23.661485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254d1fb-a13a-46d1-b348-638070935f08 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:23.662023 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254d1fb-a13a-46d1-b348-638070935f08 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:23.662375 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254d1fb-a13a-46d1-b348-638070935f08 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:23.662719 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254d1fb-a13a-46d1-b348-638070935f08 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:23.663559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254d1fb-a13a-46d1-b348-638070935f08 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:23.664568 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-e254d1fb-a13a-46d1-b348-638070935f08 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:15:23.664568 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:15:23.664568 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:15:23.665842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254d1fb-a13a-46d1-b348-638070935f08 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:23.684972 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1982/3961] 10.222.0.30 () {60 vars in 1143 bytes} [Sun Sep 4 01:15:23 2022] POST /identity/v3/roles => generated 239 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:23.688828 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70434b61-78d5-487a-a56a-5e4acc01ac83 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:23.700162 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70434b61-78d5-487a-a56a-5e4acc01ac83 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:23.706602 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945920d-29e5-4231-8537-3610425ac441 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:23.707309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945920d-29e5-4231-8537-3610425ac441 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:23.708192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945920d-29e5-4231-8537-3610425ac441 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:23.708545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945920d-29e5-4231-8537-3610425ac441 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/groups` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:23.715432 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945920d-29e5-4231-8537-3610425ac441 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:23.717036 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-e945920d-29e5-4231-8537-3610425ac441 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:15:23.717036 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:15:23.717036 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:15:23.719914 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945920d-29e5-4231-8537-3610425ac441 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:23.757870 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1980/3962] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Sep 4 01:15:23 2022] POST /identity/v3/groups => generated 326 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:23.761676 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254d1fb-a13a-46d1-b348-638070935f08 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:23.772228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254d1fb-a13a-46d1-b348-638070935f08 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:23.778172 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8387a8-10f1-4926-8b22-20f1ce6a68bf tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:23.779167 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8387a8-10f1-4926-8b22-20f1ce6a68bf tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:23.779569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8387a8-10f1-4926-8b22-20f1ce6a68bf tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:23.779922 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8387a8-10f1-4926-8b22-20f1ce6a68bf tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/groups/fe30c8de77154fb89b411a2f83225b96/users/d339ec05ca6a4865b0623f3488fab25a` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:23.787587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8387a8-10f1-4926-8b22-20f1ce6a68bf tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=fe30c8de77154fb89b411a2f83225b96, user_id=d339ec05ca6a4865b0623f3488fab25a)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:23.788718 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-9d8387a8-10f1-4926-8b22-20f1ce6a68bf tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:15:23.788718 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:15:23.788718 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:15:23.790487 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8387a8-10f1-4926-8b22-20f1ce6a68bf tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:23.833705 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1983/3963] 10.222.0.30 () {60 vars in 1360 bytes} [Sun Sep 4 01:15:23 2022] PUT /identity/v3/groups/fe30c8de77154fb89b411a2f83225b96/users/d339ec05ca6a4865b0623f3488fab25a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:23.834898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945920d-29e5-4231-8537-3610425ac441 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:23.844903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945920d-29e5-4231-8537-3610425ac441 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:23.955188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbe8a9-b1f8-49ba-a5b8-d7f9ab5d9847 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:23.955866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbe8a9-b1f8-49ba-a5b8-d7f9ab5d9847 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:23.956147 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbe8a9-b1f8-49ba-a5b8-d7f9ab5d9847 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:23.956527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbe8a9-b1f8-49ba-a5b8-d7f9ab5d9847 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/domains/cf69d140e055429a9f219634a8192b27/groups/fe30c8de77154fb89b411a2f83225b96/roles/c60060e2ec70446998bb5868c26f567b` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:23.958963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adbe8a9-b1f8-49ba-a5b8-d7f9ab5d9847 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=cf69d140e055429a9f219634a8192b27, group_id=fe30c8de77154fb89b411a2f83225b96, role_id=c60060e2ec70446998bb5868c26f567b)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:23.961875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adbe8a9-b1f8-49ba-a5b8-d7f9ab5d9847 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:23.975973 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:24.000639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8387a8-10f1-4926-8b22-20f1ce6a68bf tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:24.011821 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1981/3964] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:15:23 2022] PUT /identity/v3/domains/cf69d140e055429a9f219634a8192b27/groups/fe30c8de77154fb89b411a2f83225b96/roles/c60060e2ec70446998bb5868c26f567b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:24.017499 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8387a8-10f1-4926-8b22-20f1ce6a68bf tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:24.065619 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:24.123690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046edd06-84ff-4963-a89a-1ffdd5556e69 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:24.124717 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046edd06-84ff-4963-a89a-1ffdd5556e69 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:24.125000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046edd06-84ff-4963-a89a-1ffdd5556e69 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:24.125279 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046edd06-84ff-4963-a89a-1ffdd5556e69 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:24.125977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046edd06-84ff-4963-a89a-1ffdd5556e69 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:24.127933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046edd06-84ff-4963-a89a-1ffdd5556e69 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:24.153030 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1984/3965] 10.222.0.30 () {60 vars in 1149 bytes} [Sun Sep 4 01:15:23 2022] POST /identity/v3/domains => generated 276 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:24.157470 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbe8a9-b1f8-49ba-a5b8-d7f9ab5d9847 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:24.170436 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbe8a9-b1f8-49ba-a5b8-d7f9ab5d9847 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:24.240870 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a40db7-edeb-4e46-af0c-a64b621bae2b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:24.241533 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a40db7-edeb-4e46-af0c-a64b621bae2b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:24.241910 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a40db7-edeb-4e46-af0c-a64b621bae2b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:24.242192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a40db7-edeb-4e46-af0c-a64b621bae2b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:24.243082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a40db7-edeb-4e46-af0c-a64b621bae2b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:24.245028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a40db7-edeb-4e46-af0c-a64b621bae2b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:24.282744 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1982/3966] 10.222.0.30 () {60 vars in 1143 bytes} [Sun Sep 4 01:15:24 2022] POST /identity/v3/roles => generated 239 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:24.283821 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046edd06-84ff-4963-a89a-1ffdd5556e69 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:24.295515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046edd06-84ff-4963-a89a-1ffdd5556e69 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:24.301760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2aa049-6b4f-4b3c-bfab-97e10e48ab57 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:24.302714 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2aa049-6b4f-4b3c-bfab-97e10e48ab57 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:24.303000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2aa049-6b4f-4b3c-bfab-97e10e48ab57 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:24.303410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2aa049-6b4f-4b3c-bfab-97e10e48ab57 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/domains/cc05cba6146840b49c15e431278beddf/users/d339ec05ca6a4865b0623f3488fab25a/roles/d60b61646d414dc39eb315016a824fb2` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:24.316581 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2aa049-6b4f-4b3c-bfab-97e10e48ab57 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=cc05cba6146840b49c15e431278beddf, user_id=d339ec05ca6a4865b0623f3488fab25a, role_id=d60b61646d414dc39eb315016a824fb2)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:24.319874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2aa049-6b4f-4b3c-bfab-97e10e48ab57 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:24.334973 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a40db7-edeb-4e46-af0c-a64b621bae2b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:24.336966 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-46a40db7-edeb-4e46-af0c-a64b621bae2b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:24.342100 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1985/3967] 10.222.0.30 () {60 vars in 1480 bytes} [Sun Sep 4 01:15:24 2022] PUT /identity/v3/domains/cc05cba6146840b49c15e431278beddf/users/d339ec05ca6a4865b0623f3488fab25a/roles/d60b61646d414dc39eb315016a824fb2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:24.345855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2aa049-6b4f-4b3c-bfab-97e10e48ab57 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:24.443601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2aa049-6b4f-4b3c-bfab-97e10e48ab57 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:24.473120 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9cebfe-8e29-4c30-85a8-0c2064ab5434 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:24.473788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cebfe-8e29-4c30-85a8-0c2064ab5434 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:24.474075 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cebfe-8e29-4c30-85a8-0c2064ab5434 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:24.474353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cebfe-8e29-4c30-85a8-0c2064ab5434 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:24.475041 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9cebfe-8e29-4c30-85a8-0c2064ab5434 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:24.476671 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9cebfe-8e29-4c30-85a8-0c2064ab5434 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:24.522398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a40db7-edeb-4e46-af0c-a64b621bae2b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:24.536048 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1986/3968] 10.222.0.30 () {60 vars in 1149 bytes} [Sun Sep 4 01:15:24 2022] POST /identity/v3/domains => generated 276 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:24.537221 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9cebfe-8e29-4c30-85a8-0c2064ab5434 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:24.643793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f82e2-8db4-4522-8999-a2a394c3fc34 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:24.644500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f82e2-8db4-4522-8999-a2a394c3fc34 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:24.644875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f82e2-8db4-4522-8999-a2a394c3fc34 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:24.645966 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f82e2-8db4-4522-8999-a2a394c3fc34 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:24.653020 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b80f82e2-8db4-4522-8999-a2a394c3fc34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:24.669481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f82e2-8db4-4522-8999-a2a394c3fc34 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:24.671246 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f82e2-8db4-4522-8999-a2a394c3fc34 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:24.679422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9cebfe-8e29-4c30-85a8-0c2064ab5434 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:24.686542 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530c7dd-f4ac-4ae4-a872-89fbf42e6c17 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:24.687507 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530c7dd-f4ac-4ae4-a872-89fbf42e6c17 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:24.688006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530c7dd-f4ac-4ae4-a872-89fbf42e6c17 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:24.688615 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530c7dd-f4ac-4ae4-a872-89fbf42e6c17 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:24.689583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530c7dd-f4ac-4ae4-a872-89fbf42e6c17 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:24.693940 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530c7dd-f4ac-4ae4-a872-89fbf42e6c17 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:24.698000 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1983/3969] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:15:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:15:24.735216 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1987/3970] 10.222.0.30 () {60 vars in 1143 bytes} [Sun Sep 4 01:15:24 2022] POST /identity/v3/roles => generated 239 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:15:24.740731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f82e2-8db4-4522-8999-a2a394c3fc34 service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:24.754219 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f82e2-8db4-4522-8999-a2a394c3fc34 service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:24.765909 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2444c72-d8c5-4942-a307-cdf4dbdf7efe tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:24.769061 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2444c72-d8c5-4942-a307-cdf4dbdf7efe tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:24.770198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2444c72-d8c5-4942-a307-cdf4dbdf7efe tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:24.771712 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2444c72-d8c5-4942-a307-cdf4dbdf7efe tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/groups` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:24.772584 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2444c72-d8c5-4942-a307-cdf4dbdf7efe tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:24.776617 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2444c72-d8c5-4942-a307-cdf4dbdf7efe tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:24.838146 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1984/3971] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Sep 4 01:15:24 2022] POST /identity/v3/groups => generated 325 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:24.843030 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530c7dd-f4ac-4ae4-a872-89fbf42e6c17 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:24.864899 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530c7dd-f4ac-4ae4-a872-89fbf42e6c17 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:24.871795 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d890fdf-48ea-4f26-b9e0-eaf35de234f0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:24.873166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d890fdf-48ea-4f26-b9e0-eaf35de234f0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:24.873669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d890fdf-48ea-4f26-b9e0-eaf35de234f0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:24.874042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d890fdf-48ea-4f26-b9e0-eaf35de234f0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/groups/46bca18a8df0461abe06455ccc182760/users/d339ec05ca6a4865b0623f3488fab25a` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:24.895681 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d890fdf-48ea-4f26-b9e0-eaf35de234f0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=46bca18a8df0461abe06455ccc182760, user_id=d339ec05ca6a4865b0623f3488fab25a)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:24.899030 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d890fdf-48ea-4f26-b9e0-eaf35de234f0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:24.992323 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1988/3972] 10.222.0.30 () {60 vars in 1360 bytes} [Sun Sep 4 01:15:24 2022] PUT /identity/v3/groups/46bca18a8df0461abe06455ccc182760/users/d339ec05ca6a4865b0623f3488fab25a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:25.005230 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2444c72-d8c5-4942-a307-cdf4dbdf7efe tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:25.015051 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:25.023143 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2444c72-d8c5-4942-a307-cdf4dbdf7efe tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:25.064528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b3612-4f08-41ea-a2d8-ab65f3ddcd2d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:25.065404 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b3612-4f08-41ea-a2d8-ab65f3ddcd2d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:25.065782 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b3612-4f08-41ea-a2d8-ab65f3ddcd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:25.081571 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:25.132528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c47b3612-4f08-41ea-a2d8-ab65f3ddcd2d None None] MFA Rules not processed for user `21f0adb3fe9f454b83e22dbdf526ee49`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:25.138148 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c47b3612-4f08-41ea-a2d8-ab65f3ddcd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:25.221706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f376108-64b0-4ad1-b9c7-085532544a93 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:25.225668 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f376108-64b0-4ad1-b9c7-085532544a93 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:25.226002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f376108-64b0-4ad1-b9c7-085532544a93 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:25.226366 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f376108-64b0-4ad1-b9c7-085532544a93 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/domains/990c1bd1c69a4c75a4fb97a53e4bcb90/groups/46bca18a8df0461abe06455ccc182760/roles/a4c5fcc7c36544f6a394dbb04d890689` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:25.244194 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f376108-64b0-4ad1-b9c7-085532544a93 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=990c1bd1c69a4c75a4fb97a53e4bcb90, group_id=46bca18a8df0461abe06455ccc182760, role_id=a4c5fcc7c36544f6a394dbb04d890689)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:25.248541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f376108-64b0-4ad1-b9c7-085532544a93 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:25.293489 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1985/3973] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:15:24 2022] PUT /identity/v3/domains/990c1bd1c69a4c75a4fb97a53e4bcb90/groups/46bca18a8df0461abe06455ccc182760/roles/a4c5fcc7c36544f6a394dbb04d890689 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:25.298308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f376108-64b0-4ad1-b9c7-085532544a93 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:25.311463 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1989/3974] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:15:25.314456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b3612-4f08-41ea-a2d8-ab65f3ddcd2d None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:25.502077 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f376108-64b0-4ad1-b9c7-085532544a93 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:25.508435 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7ed84-b3ad-4ab6-b65a-d76596831e34 tempest-TokensV3TestJSON-727675876 tempest-TokensV3TestJSON-727675876-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd339ec05ca6a4865b0623f3488fab25a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e20420801fe47419f0f76efa7050111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:25.510651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7ed84-b3ad-4ab6-b65a-d76596831e34 tempest-TokensV3TestJSON-727675876 tempest-TokensV3TestJSON-727675876-project] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:25.512359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7ed84-b3ad-4ab6-b65a-d76596831e34 tempest-TokensV3TestJSON-727675876 tempest-TokensV3TestJSON-727675876-project] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:25.513020 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7ed84-b3ad-4ab6-b65a-d76596831e34 tempest-TokensV3TestJSON-727675876 tempest-TokensV3TestJSON-727675876-project] PATH_INFO: `/v3/auth/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:25.513891 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b7ed84-b3ad-4ab6-b65a-d76596831e34 tempest-TokensV3TestJSON-727675876 tempest-TokensV3TestJSON-727675876-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:25.515125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b7ed84-b3ad-4ab6-b65a-d76596831e34 tempest-TokensV3TestJSON-727675876 tempest-TokensV3TestJSON-727675876-project] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:25.619796 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b3612-4f08-41ea-a2d8-ab65f3ddcd2d None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:25.622422 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1986/3975] 10.222.0.30 () {58 vars in 1143 bytes} [Sun Sep 4 01:15:25 2022] GET /identity/v3/auth/domains => generated 1173 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:15:25.626421 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7ed84-b3ad-4ab6-b65a-d76596831e34 tempest-TokensV3TestJSON-727675876 tempest-TokensV3TestJSON-727675876-project] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:25.641522 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:25.691400 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2bd413-a00b-439b-8860-eeafedaeaa6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:25.692228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bd413-a00b-439b-8860-eeafedaeaa6e service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:25.692357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bd413-a00b-439b-8860-eeafedaeaa6e service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:25.692601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bd413-a00b-439b-8860-eeafedaeaa6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:25.694315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6a2bd413-a00b-439b-8860-eeafedaeaa6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:25.701518 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7ed84-b3ad-4ab6-b65a-d76596831e34 tempest-TokensV3TestJSON-727675876 tempest-TokensV3TestJSON-727675876-project] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:25.706349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351fdfb-70f3-4315-baef-34e6924ce998 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:25.706932 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2bd413-a00b-439b-8860-eeafedaeaa6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:25.707720 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351fdfb-70f3-4315-baef-34e6924ce998 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:25.708103 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351fdfb-70f3-4315-baef-34e6924ce998 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:25.708450 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351fdfb-70f3-4315-baef-34e6924ce998 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/domains/990c1bd1c69a4c75a4fb97a53e4bcb90/groups/46bca18a8df0461abe06455ccc182760/roles/a4c5fcc7c36544f6a394dbb04d890689` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:25.709049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2bd413-a00b-439b-8860-eeafedaeaa6e service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:25.711650 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351fdfb-70f3-4315-baef-34e6924ce998 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=990c1bd1c69a4c75a4fb97a53e4bcb90, group_id=46bca18a8df0461abe06455ccc182760, role_id=a4c5fcc7c36544f6a394dbb04d890689)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:25.712747 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-1351fdfb-70f3-4315-baef-34e6924ce998 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:15:25.712747 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:15:25.712747 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:15:25.716304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351fdfb-70f3-4315-baef-34e6924ce998 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:25.720946 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1990/3976] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:15:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:15:25.722201 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1351fdfb-70f3-4315-baef-34e6924ce998 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invalidating the token cache because role a4c5fcc7c36544f6a394dbb04d890689 was removed from group 46bca18a8df0461abe06455ccc182760 on domain 990c1bd1c69a4c75a4fb97a53e4bcb90. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:15:25.722500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1351fdfb-70f3-4315-baef-34e6924ce998 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:25.723885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1351fdfb-70f3-4315-baef-34e6924ce998 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:25.743247 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1987/3977] 10.222.0.30 () {58 vars in 1467 bytes} [Sun Sep 4 01:15:25 2022] DELETE /identity/v3/domains/990c1bd1c69a4c75a4fb97a53e4bcb90/groups/46bca18a8df0461abe06455ccc182760/roles/a4c5fcc7c36544f6a394dbb04d890689 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:15:25.747617 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2bd413-a00b-439b-8860-eeafedaeaa6e service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:25.761275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2bd413-a00b-439b-8860-eeafedaeaa6e service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:25.794275 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:25.823650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e8e26-dae0-454f-b4c8-f103d0e88288 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:25.824304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e8e26-dae0-454f-b4c8-f103d0e88288 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:25.824585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e8e26-dae0-454f-b4c8-f103d0e88288 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:25.824858 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e8e26-dae0-454f-b4c8-f103d0e88288 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/groups/46bca18a8df0461abe06455ccc182760/users/d339ec05ca6a4865b0623f3488fab25a` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:25.826553 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e8e26-dae0-454f-b4c8-f103d0e88288 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=46bca18a8df0461abe06455ccc182760, user_id=d339ec05ca6a4865b0623f3488fab25a)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:25.827574 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-405e8e26-dae0-454f-b4c8-f103d0e88288 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:15:25.827574 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:15:25.827574 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:15:25.828778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e8e26-dae0-454f-b4c8-f103d0e88288 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:25.839934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-405e8e26-dae0-454f-b4c8-f103d0e88288 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd339ec05ca6a4865b0623f3488fab25a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:25.863182 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1991/3978] 10.222.0.30 () {58 vars in 1344 bytes} [Sun Sep 4 01:15:25 2022] DELETE /identity/v3/groups/46bca18a8df0461abe06455ccc182760/users/d339ec05ca6a4865b0623f3488fab25a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:25.863799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351fdfb-70f3-4315-baef-34e6924ce998 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:25.865236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1351fdfb-70f3-4315-baef-34e6924ce998 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:25.878719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351fdfb-70f3-4315-baef-34e6924ce998 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:25.948980 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d38f6a-14d2-40e4-9644-f297b3c5235f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:25.948980 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d38f6a-14d2-40e4-9644-f297b3c5235f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:25.948980 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d38f6a-14d2-40e4-9644-f297b3c5235f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:25.949328 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d38f6a-14d2-40e4-9644-f297b3c5235f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/groups/46bca18a8df0461abe06455ccc182760` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:25.950184 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d38f6a-14d2-40e4-9644-f297b3c5235f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:delete_group(group_id=46bca18a8df0461abe06455ccc182760)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:25.951329 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-e2d38f6a-14d2-40e4-9644-f297b3c5235f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:15:25.951329 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:15:25.951329 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:15:25.952529 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d38f6a-14d2-40e4-9644-f297b3c5235f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:26.020629 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1988/3979] 10.222.0.30 () {58 vars in 1227 bytes} [Sun Sep 4 01:15:25 2022] DELETE /identity/v3/groups/46bca18a8df0461abe06455ccc182760 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:26.024857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e8e26-dae0-454f-b4c8-f103d0e88288 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:26.042185 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e8e26-dae0-454f-b4c8-f103d0e88288 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:26.149389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ade83-c1b5-42bc-ba4e-c9034abc49c1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:26.150020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ade83-c1b5-42bc-ba4e-c9034abc49c1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:26.150297 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ade83-c1b5-42bc-ba4e-c9034abc49c1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:26.150667 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ade83-c1b5-42bc-ba4e-c9034abc49c1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/roles/a4c5fcc7c36544f6a394dbb04d890689` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:26.151964 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ade83-c1b5-42bc-ba4e-c9034abc49c1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a4c5fcc7c36544f6a394dbb04d890689)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:26.153171 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-fb4ade83-c1b5-42bc-ba4e-c9034abc49c1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:15:26.153171 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:15:26.153171 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:15:26.154538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ade83-c1b5-42bc-ba4e-c9034abc49c1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:26.210315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fb4ade83-c1b5-42bc-ba4e-c9034abc49c1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invalidating the token cache because role a4c5fcc7c36544f6a394dbb04d890689 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:15:26.210708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fb4ade83-c1b5-42bc-ba4e-c9034abc49c1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:26.211447 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fb4ade83-c1b5-42bc-ba4e-c9034abc49c1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:26.216436 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1992/3980] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:15:26 2022] DELETE /identity/v3/roles/a4c5fcc7c36544f6a394dbb04d890689 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:26.218405 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d38f6a-14d2-40e4-9644-f297b3c5235f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:26.219499 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e2d38f6a-14d2-40e4-9644-f297b3c5235f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:26.246581 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d38f6a-14d2-40e4-9644-f297b3c5235f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:26.415153 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb496d9-5e55-4764-9ce9-b98afe1fd63b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:26.415805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb496d9-5e55-4764-9ce9-b98afe1fd63b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:26.416085 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb496d9-5e55-4764-9ce9-b98afe1fd63b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:26.416414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb496d9-5e55-4764-9ce9-b98afe1fd63b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/domains/990c1bd1c69a4c75a4fb97a53e4bcb90` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:26.417996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb496d9-5e55-4764-9ce9-b98afe1fd63b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=990c1bd1c69a4c75a4fb97a53e4bcb90)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:26.419090 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-acb496d9-5e55-4764-9ce9-b98afe1fd63b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:15:26.419090 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:15:26.419090 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:15:26.420468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb496d9-5e55-4764-9ce9-b98afe1fd63b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:26.428605 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:26.490625 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-acb496d9-5e55-4764-9ce9-b98afe1fd63b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '990c1bd1c69a4c75a4fb97a53e4bcb90'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:26.505697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-acb496d9-5e55-4764-9ce9-b98afe1fd63b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '990c1bd1c69a4c75a4fb97a53e4bcb90'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:26.546109 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-acb496d9-5e55-4764-9ce9-b98afe1fd63b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '990c1bd1c69a4c75a4fb97a53e4bcb90'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:26.546961 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-acb496d9-5e55-4764-9ce9-b98afe1fd63b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '990c1bd1c69a4c75a4fb97a53e4bcb90'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:26.551523 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1989/3981] 10.222.0.30 () {60 vars in 1249 bytes} [Sun Sep 4 01:15:26 2022] PATCH /identity/v3/domains/990c1bd1c69a4c75a4fb97a53e4bcb90 => generated 277 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:15:26.556276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ade83-c1b5-42bc-ba4e-c9034abc49c1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:26.571664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ade83-c1b5-42bc-ba4e-c9034abc49c1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:26.769160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820835ce-1107-4448-86e5-fd5d7edf2e76 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:26.770729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820835ce-1107-4448-86e5-fd5d7edf2e76 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:26.771254 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820835ce-1107-4448-86e5-fd5d7edf2e76 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:26.773698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820835ce-1107-4448-86e5-fd5d7edf2e76 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/domains/990c1bd1c69a4c75a4fb97a53e4bcb90` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:26.808031 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820835ce-1107-4448-86e5-fd5d7edf2e76 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=990c1bd1c69a4c75a4fb97a53e4bcb90)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:26.809080 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-820835ce-1107-4448-86e5-fd5d7edf2e76 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:15:26.809080 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:15:26.809080 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:15:26.810600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820835ce-1107-4448-86e5-fd5d7edf2e76 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:26.839677 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:26.851941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-820835ce-1107-4448-86e5-fd5d7edf2e76 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '990c1bd1c69a4c75a4fb97a53e4bcb90'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:26.894405 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-820835ce-1107-4448-86e5-fd5d7edf2e76 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '990c1bd1c69a4c75a4fb97a53e4bcb90'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:27.000033 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-820835ce-1107-4448-86e5-fd5d7edf2e76 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '990c1bd1c69a4c75a4fb97a53e4bcb90', 'request_id': 'req-820835ce-1107-4448-86e5-fd5d7edf2e76'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:27.022048 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-820835ce-1107-4448-86e5-fd5d7edf2e76 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '990c1bd1c69a4c75a4fb97a53e4bcb90', 'request_id': 'req-820835ce-1107-4448-86e5-fd5d7edf2e76'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:27.029508 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-820835ce-1107-4448-86e5-fd5d7edf2e76 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '990c1bd1c69a4c75a4fb97a53e4bcb90', 'request_id': 'req-820835ce-1107-4448-86e5-fd5d7edf2e76'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:27.044666 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-820835ce-1107-4448-86e5-fd5d7edf2e76 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] The token cache is being invalidate because project 990c1bd1c69a4c75a4fb97a53e4bcb90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:15:27.045272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-820835ce-1107-4448-86e5-fd5d7edf2e76 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:27.049864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-820835ce-1107-4448-86e5-fd5d7edf2e76 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:27.064932 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-820835ce-1107-4448-86e5-fd5d7edf2e76 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '990c1bd1c69a4c75a4fb97a53e4bcb90', 'request_id': 'req-820835ce-1107-4448-86e5-fd5d7edf2e76'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:27.065744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-820835ce-1107-4448-86e5-fd5d7edf2e76 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '990c1bd1c69a4c75a4fb97a53e4bcb90', 'request_id': 'req-820835ce-1107-4448-86e5-fd5d7edf2e76'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:27.066393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-820835ce-1107-4448-86e5-fd5d7edf2e76 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '990c1bd1c69a4c75a4fb97a53e4bcb90', 'request_id': 'req-820835ce-1107-4448-86e5-fd5d7edf2e76'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:27.083012 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1993/3982] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:15:26 2022] DELETE /identity/v3/domains/990c1bd1c69a4c75a4fb97a53e4bcb90 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:27.086672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb496d9-5e55-4764-9ce9-b98afe1fd63b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:27.088882 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-acb496d9-5e55-4764-9ce9-b98afe1fd63b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:27.124150 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb496d9-5e55-4764-9ce9-b98afe1fd63b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:27.392776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865abc0a-4807-4011-a53e-e27fb2ca6435 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:27.393722 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865abc0a-4807-4011-a53e-e27fb2ca6435 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:27.393915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865abc0a-4807-4011-a53e-e27fb2ca6435 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:27.394187 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865abc0a-4807-4011-a53e-e27fb2ca6435 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/domains/cc05cba6146840b49c15e431278beddf/users/d339ec05ca6a4865b0623f3488fab25a/roles/d60b61646d414dc39eb315016a824fb2` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:27.404433 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865abc0a-4807-4011-a53e-e27fb2ca6435 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=cc05cba6146840b49c15e431278beddf, user_id=d339ec05ca6a4865b0623f3488fab25a, role_id=d60b61646d414dc39eb315016a824fb2)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:27.407340 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865abc0a-4807-4011-a53e-e27fb2ca6435 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:27.433556 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-865abc0a-4807-4011-a53e-e27fb2ca6435 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invalidating the token cache because role d60b61646d414dc39eb315016a824fb2 was removed from user d339ec05ca6a4865b0623f3488fab25a on domain cc05cba6146840b49c15e431278beddf. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:15:27.433862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-865abc0a-4807-4011-a53e-e27fb2ca6435 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:27.443838 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-865abc0a-4807-4011-a53e-e27fb2ca6435 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:27.491403 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1990/3983] 10.222.0.30 () {58 vars in 1464 bytes} [Sun Sep 4 01:15:27 2022] DELETE /identity/v3/domains/cc05cba6146840b49c15e431278beddf/users/d339ec05ca6a4865b0623f3488fab25a/roles/d60b61646d414dc39eb315016a824fb2 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:27.495652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820835ce-1107-4448-86e5-fd5d7edf2e76 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:27.497202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-820835ce-1107-4448-86e5-fd5d7edf2e76 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:27.543062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820835ce-1107-4448-86e5-fd5d7edf2e76 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:27.701565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c71500-9089-45d9-bc7a-4a3f78834e9c tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:27.702216 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c71500-9089-45d9-bc7a-4a3f78834e9c tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:27.702536 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c71500-9089-45d9-bc7a-4a3f78834e9c tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:27.703014 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c71500-9089-45d9-bc7a-4a3f78834e9c tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/roles/d60b61646d414dc39eb315016a824fb2` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:27.706045 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c71500-9089-45d9-bc7a-4a3f78834e9c tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d60b61646d414dc39eb315016a824fb2)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:27.710283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c71500-9089-45d9-bc7a-4a3f78834e9c tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:27.792168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-93c71500-9089-45d9-bc7a-4a3f78834e9c tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invalidating the token cache because role d60b61646d414dc39eb315016a824fb2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:15:27.792927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-93c71500-9089-45d9-bc7a-4a3f78834e9c tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:27.797387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-93c71500-9089-45d9-bc7a-4a3f78834e9c tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:27.804652 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1994/3984] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:15:27 2022] DELETE /identity/v3/roles/d60b61646d414dc39eb315016a824fb2 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:27.806189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865abc0a-4807-4011-a53e-e27fb2ca6435 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:27.808018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-865abc0a-4807-4011-a53e-e27fb2ca6435 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:27.845060 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865abc0a-4807-4011-a53e-e27fb2ca6435 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:27.992027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ce07d-d120-48bf-8d36-4539230620b9 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:27.992027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ce07d-d120-48bf-8d36-4539230620b9 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:27.992284 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ce07d-d120-48bf-8d36-4539230620b9 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:27.992563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ce07d-d120-48bf-8d36-4539230620b9 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/domains/cc05cba6146840b49c15e431278beddf` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:27.995824 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c71500-9089-45d9-bc7a-4a3f78834e9c tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:27.997517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-93c71500-9089-45d9-bc7a-4a3f78834e9c tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:28.009041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ce07d-d120-48bf-8d36-4539230620b9 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=cc05cba6146840b49c15e431278beddf)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:28.015527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ce07d-d120-48bf-8d36-4539230620b9 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:28.074084 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:28.103917 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-883ce07d-d120-48bf-8d36-4539230620b9 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'cc05cba6146840b49c15e431278beddf'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:28.106347 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-883ce07d-d120-48bf-8d36-4539230620b9 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'cc05cba6146840b49c15e431278beddf'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:28.147196 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c71500-9089-45d9-bc7a-4a3f78834e9c tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:28.227318 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-883ce07d-d120-48bf-8d36-4539230620b9 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'cc05cba6146840b49c15e431278beddf'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:28.233900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-883ce07d-d120-48bf-8d36-4539230620b9 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'cc05cba6146840b49c15e431278beddf'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:28.246211 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1991/3985] 10.222.0.30 () {60 vars in 1249 bytes} [Sun Sep 4 01:15:27 2022] PATCH /identity/v3/domains/cc05cba6146840b49c15e431278beddf => generated 277 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:15:28.251451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ce07d-d120-48bf-8d36-4539230620b9 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:28.260166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-883ce07d-d120-48bf-8d36-4539230620b9 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:28.277991 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cbb19-60b2-4350-baef-b9bb59355b16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:28.279068 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cbb19-60b2-4350-baef-b9bb59355b16 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:28.279625 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cbb19-60b2-4350-baef-b9bb59355b16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:28.280042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cbb19-60b2-4350-baef-b9bb59355b16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:28.282662 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4f8cbb19-60b2-4350-baef-b9bb59355b16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:28.334181 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:UPDATE=2,keystone:DELETE=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:28.526119 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8cbb19-60b2-4350-baef-b9bb59355b16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:28.527688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8cbb19-60b2-4350-baef-b9bb59355b16 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:28.539011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ce07d-d120-48bf-8d36-4539230620b9 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:28.553408 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc742c2b-a057-4f4a-a5ca-0a40f823ba6f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:28.554651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc742c2b-a057-4f4a-a5ca-0a40f823ba6f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:28.555159 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc742c2b-a057-4f4a-a5ca-0a40f823ba6f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:28.555909 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc742c2b-a057-4f4a-a5ca-0a40f823ba6f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/domains/cc05cba6146840b49c15e431278beddf` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:28.579765 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1995/3986] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:15:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:15:28.594364 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc742c2b-a057-4f4a-a5ca-0a40f823ba6f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=cc05cba6146840b49c15e431278beddf)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:28.595569 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-dc742c2b-a057-4f4a-a5ca-0a40f823ba6f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:15:28.595569 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:15:28.595569 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:15:28.596885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc742c2b-a057-4f4a-a5ca-0a40f823ba6f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:28.644708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dc742c2b-a057-4f4a-a5ca-0a40f823ba6f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'cc05cba6146840b49c15e431278beddf'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:28.666037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dc742c2b-a057-4f4a-a5ca-0a40f823ba6f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'cc05cba6146840b49c15e431278beddf'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:28.719154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dc742c2b-a057-4f4a-a5ca-0a40f823ba6f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc05cba6146840b49c15e431278beddf', 'request_id': 'req-dc742c2b-a057-4f4a-a5ca-0a40f823ba6f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:28.745067 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dc742c2b-a057-4f4a-a5ca-0a40f823ba6f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc05cba6146840b49c15e431278beddf', 'request_id': 'req-dc742c2b-a057-4f4a-a5ca-0a40f823ba6f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:28.752923 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dc742c2b-a057-4f4a-a5ca-0a40f823ba6f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc05cba6146840b49c15e431278beddf', 'request_id': 'req-dc742c2b-a057-4f4a-a5ca-0a40f823ba6f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:28.770317 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dc742c2b-a057-4f4a-a5ca-0a40f823ba6f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] The token cache is being invalidate because project cc05cba6146840b49c15e431278beddf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:15:28.770830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dc742c2b-a057-4f4a-a5ca-0a40f823ba6f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:28.771828 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dc742c2b-a057-4f4a-a5ca-0a40f823ba6f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:28.791411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dc742c2b-a057-4f4a-a5ca-0a40f823ba6f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'cc05cba6146840b49c15e431278beddf', 'request_id': 'req-dc742c2b-a057-4f4a-a5ca-0a40f823ba6f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:28.792909 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dc742c2b-a057-4f4a-a5ca-0a40f823ba6f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'cc05cba6146840b49c15e431278beddf', 'request_id': 'req-dc742c2b-a057-4f4a-a5ca-0a40f823ba6f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:28.793921 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dc742c2b-a057-4f4a-a5ca-0a40f823ba6f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'cc05cba6146840b49c15e431278beddf', 'request_id': 'req-dc742c2b-a057-4f4a-a5ca-0a40f823ba6f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:28.829635 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1992/3987] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:15:28 2022] DELETE /identity/v3/domains/cc05cba6146840b49c15e431278beddf => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:28.833632 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cbb19-60b2-4350-baef-b9bb59355b16 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:28.851282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cbb19-60b2-4350-baef-b9bb59355b16 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:28.963243 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce36e7-2f77-4096-b7aa-93f77ebf23a5 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:28.964284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce36e7-2f77-4096-b7aa-93f77ebf23a5 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:28.964835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce36e7-2f77-4096-b7aa-93f77ebf23a5 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:28.965270 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce36e7-2f77-4096-b7aa-93f77ebf23a5 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/domains/cf69d140e055429a9f219634a8192b27/groups/fe30c8de77154fb89b411a2f83225b96/roles/c60060e2ec70446998bb5868c26f567b` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:28.968751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce36e7-2f77-4096-b7aa-93f77ebf23a5 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=cf69d140e055429a9f219634a8192b27, group_id=fe30c8de77154fb89b411a2f83225b96, role_id=c60060e2ec70446998bb5868c26f567b)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:28.970107 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-ffce36e7-2f77-4096-b7aa-93f77ebf23a5 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:15:28.970107 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:15:28.970107 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:15:28.972455 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce36e7-2f77-4096-b7aa-93f77ebf23a5 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:28.981602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ffce36e7-2f77-4096-b7aa-93f77ebf23a5 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invalidating the token cache because role c60060e2ec70446998bb5868c26f567b was removed from group fe30c8de77154fb89b411a2f83225b96 on domain cf69d140e055429a9f219634a8192b27. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:15:28.982178 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ffce36e7-2f77-4096-b7aa-93f77ebf23a5 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:28.983390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ffce36e7-2f77-4096-b7aa-93f77ebf23a5 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:29.006019 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1996/3988] 10.222.0.30 () {58 vars in 1467 bytes} [Sun Sep 4 01:15:28 2022] DELETE /identity/v3/domains/cf69d140e055429a9f219634a8192b27/groups/fe30c8de77154fb89b411a2f83225b96/roles/c60060e2ec70446998bb5868c26f567b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:29.013848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc742c2b-a057-4f4a-a5ca-0a40f823ba6f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:29.016102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-dc742c2b-a057-4f4a-a5ca-0a40f823ba6f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:29.074167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc742c2b-a057-4f4a-a5ca-0a40f823ba6f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:29.226348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22784198-223a-4bca-9b39-ad4e2c9ede0a tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:29.227085 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22784198-223a-4bca-9b39-ad4e2c9ede0a tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:29.227311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22784198-223a-4bca-9b39-ad4e2c9ede0a tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:29.227595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22784198-223a-4bca-9b39-ad4e2c9ede0a tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/groups/fe30c8de77154fb89b411a2f83225b96/users/d339ec05ca6a4865b0623f3488fab25a` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:29.235739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22784198-223a-4bca-9b39-ad4e2c9ede0a tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=fe30c8de77154fb89b411a2f83225b96, user_id=d339ec05ca6a4865b0623f3488fab25a)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:29.237029 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-22784198-223a-4bca-9b39-ad4e2c9ede0a tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:15:29.237029 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:15:29.237029 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:15:29.238270 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22784198-223a-4bca-9b39-ad4e2c9ede0a tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:29.242697 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:29.275113 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-22784198-223a-4bca-9b39-ad4e2c9ede0a tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd339ec05ca6a4865b0623f3488fab25a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:29.301022 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1993/3989] 10.222.0.30 () {58 vars in 1344 bytes} [Sun Sep 4 01:15:29 2022] DELETE /identity/v3/groups/fe30c8de77154fb89b411a2f83225b96/users/d339ec05ca6a4865b0623f3488fab25a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:29.302304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce36e7-2f77-4096-b7aa-93f77ebf23a5 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:29.303864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ffce36e7-2f77-4096-b7aa-93f77ebf23a5 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:29.319865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce36e7-2f77-4096-b7aa-93f77ebf23a5 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:29.364607 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:29.450953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f4e5e-5394-4a07-8b78-37c1dff94088 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:29.451615 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f4e5e-5394-4a07-8b78-37c1dff94088 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:29.451904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f4e5e-5394-4a07-8b78-37c1dff94088 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:29.452172 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f4e5e-5394-4a07-8b78-37c1dff94088 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/groups/fe30c8de77154fb89b411a2f83225b96` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:29.462295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f4e5e-5394-4a07-8b78-37c1dff94088 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:delete_group(group_id=fe30c8de77154fb89b411a2f83225b96)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:29.463351 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-1f2f4e5e-5394-4a07-8b78-37c1dff94088 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:15:29.463351 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:15:29.463351 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:15:29.464566 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f4e5e-5394-4a07-8b78-37c1dff94088 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:29.603489 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1997/3990] 10.222.0.30 () {58 vars in 1227 bytes} [Sun Sep 4 01:15:29 2022] DELETE /identity/v3/groups/fe30c8de77154fb89b411a2f83225b96 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:29.607442 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22784198-223a-4bca-9b39-ad4e2c9ede0a tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:29.623840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22784198-223a-4bca-9b39-ad4e2c9ede0a tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:29.659921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cee84-63ef-4313-9185-7255b03865a1 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:29.660207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cee84-63ef-4313-9185-7255b03865a1 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:29.660518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cee84-63ef-4313-9185-7255b03865a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:29.742136 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ee0cee84-63ef-4313-9185-7255b03865a1 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:29.749711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ee0cee84-63ef-4313-9185-7255b03865a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:29.790603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77ac8c-0b4f-4652-9858-1cd508d307af tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:29.791250 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77ac8c-0b4f-4652-9858-1cd508d307af tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:29.791533 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77ac8c-0b4f-4652-9858-1cd508d307af tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:29.791806 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77ac8c-0b4f-4652-9858-1cd508d307af tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/roles/c60060e2ec70446998bb5868c26f567b` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:29.793216 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff77ac8c-0b4f-4652-9858-1cd508d307af tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c60060e2ec70446998bb5868c26f567b)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:29.794296 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-ff77ac8c-0b4f-4652-9858-1cd508d307af tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:15:29.794296 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:15:29.794296 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:15:29.795262 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff77ac8c-0b4f-4652-9858-1cd508d307af tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:29.827230 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1998/3991] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:15:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:29.837100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cee84-63ef-4313-9185-7255b03865a1 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:29.838793 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ee0cee84-63ef-4313-9185-7255b03865a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:29.843261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ff77ac8c-0b4f-4652-9858-1cd508d307af tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invalidating the token cache because role c60060e2ec70446998bb5868c26f567b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:15:29.843555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ff77ac8c-0b4f-4652-9858-1cd508d307af tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:29.844260 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ff77ac8c-0b4f-4652-9858-1cd508d307af tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:29.846510 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1994/3992] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:15:29 2022] DELETE /identity/v3/roles/c60060e2ec70446998bb5868c26f567b => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:29.852381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77ac8c-0b4f-4652-9858-1cd508d307af tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:29.852381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ff77ac8c-0b4f-4652-9858-1cd508d307af tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:29.943909 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77ac8c-0b4f-4652-9858-1cd508d307af tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:29.951031 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c79dc-cb98-4d8a-9769-e3bc0d2f36bc tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:29.951995 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c79dc-cb98-4d8a-9769-e3bc0d2f36bc tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:29.952445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c79dc-cb98-4d8a-9769-e3bc0d2f36bc tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:29.952728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c79dc-cb98-4d8a-9769-e3bc0d2f36bc tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/domains/cf69d140e055429a9f219634a8192b27` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:29.956823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c79dc-cb98-4d8a-9769-e3bc0d2f36bc tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=cf69d140e055429a9f219634a8192b27)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:29.960386 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c79dc-cb98-4d8a-9769-e3bc0d2f36bc tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:29.995456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cee84-63ef-4313-9185-7255b03865a1 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:30.017090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4f2c79dc-cb98-4d8a-9769-e3bc0d2f36bc tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'cf69d140e055429a9f219634a8192b27'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:30.017971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4f2c79dc-cb98-4d8a-9769-e3bc0d2f36bc tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'cf69d140e055429a9f219634a8192b27'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:30.040514 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:30.063004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4f2c79dc-cb98-4d8a-9769-e3bc0d2f36bc tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'cf69d140e055429a9f219634a8192b27'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:30.064992 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4f2c79dc-cb98-4d8a-9769-e3bc0d2f36bc tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'cf69d140e055429a9f219634a8192b27'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:30.073126 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1995/3993] 10.222.0.30 () {60 vars in 1249 bytes} [Sun Sep 4 01:15:29 2022] PATCH /identity/v3/domains/cf69d140e055429a9f219634a8192b27 => generated 278 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:15:30.074944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c79dc-cb98-4d8a-9769-e3bc0d2f36bc tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:30.080493 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4f2c79dc-cb98-4d8a-9769-e3bc0d2f36bc tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:30.117741 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:30.139068 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a6bef-de93-4f7d-8ce4-f26b4f8eb38c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:30.139885 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a6bef-de93-4f7d-8ce4-f26b4f8eb38c service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:30.140168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a6bef-de93-4f7d-8ce4-f26b4f8eb38c service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:30.140469 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a6bef-de93-4f7d-8ce4-f26b4f8eb38c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:30.146086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-286a6bef-de93-4f7d-8ce4-f26b4f8eb38c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:30.215450 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c79dc-cb98-4d8a-9769-e3bc0d2f36bc tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:30.226277 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc1d16-bdcf-46fa-ba6a-0e81ff3608c0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:30.227231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc1d16-bdcf-46fa-ba6a-0e81ff3608c0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:30.227801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc1d16-bdcf-46fa-ba6a-0e81ff3608c0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:30.227801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc1d16-bdcf-46fa-ba6a-0e81ff3608c0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/domains/cf69d140e055429a9f219634a8192b27` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:30.263220 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc1d16-bdcf-46fa-ba6a-0e81ff3608c0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=cf69d140e055429a9f219634a8192b27)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:30.265201 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc1d16-bdcf-46fa-ba6a-0e81ff3608c0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:30.265338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a6bef-de93-4f7d-8ce4-f26b4f8eb38c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:30.267067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a6bef-de93-4f7d-8ce4-f26b4f8eb38c service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:30.277136 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 1999/3994] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:15:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 04 01:15:30.318117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9ffc1d16-bdcf-46fa-ba6a-0e81ff3608c0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'cf69d140e055429a9f219634a8192b27'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:30.371627 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9ffc1d16-bdcf-46fa-ba6a-0e81ff3608c0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'cf69d140e055429a9f219634a8192b27'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:30.476171 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9ffc1d16-bdcf-46fa-ba6a-0e81ff3608c0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf69d140e055429a9f219634a8192b27', 'request_id': 'req-9ffc1d16-bdcf-46fa-ba6a-0e81ff3608c0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:30.494207 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9ffc1d16-bdcf-46fa-ba6a-0e81ff3608c0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf69d140e055429a9f219634a8192b27', 'request_id': 'req-9ffc1d16-bdcf-46fa-ba6a-0e81ff3608c0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:30.511420 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9ffc1d16-bdcf-46fa-ba6a-0e81ff3608c0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf69d140e055429a9f219634a8192b27', 'request_id': 'req-9ffc1d16-bdcf-46fa-ba6a-0e81ff3608c0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:30.539149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9ffc1d16-bdcf-46fa-ba6a-0e81ff3608c0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] The token cache is being invalidate because project cf69d140e055429a9f219634a8192b27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:15:30.539445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9ffc1d16-bdcf-46fa-ba6a-0e81ff3608c0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:30.546509 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9ffc1d16-bdcf-46fa-ba6a-0e81ff3608c0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:30.563091 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9ffc1d16-bdcf-46fa-ba6a-0e81ff3608c0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'cf69d140e055429a9f219634a8192b27', 'request_id': 'req-9ffc1d16-bdcf-46fa-ba6a-0e81ff3608c0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:30.564311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9ffc1d16-bdcf-46fa-ba6a-0e81ff3608c0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'cf69d140e055429a9f219634a8192b27', 'request_id': 'req-9ffc1d16-bdcf-46fa-ba6a-0e81ff3608c0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:30.565795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9ffc1d16-bdcf-46fa-ba6a-0e81ff3608c0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'cf69d140e055429a9f219634a8192b27', 'request_id': 'req-9ffc1d16-bdcf-46fa-ba6a-0e81ff3608c0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:30.586529 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1996/3995] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:15:30 2022] DELETE /identity/v3/domains/cf69d140e055429a9f219634a8192b27 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:30.587817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a6bef-de93-4f7d-8ce4-f26b4f8eb38c service swift] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:30.604423 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a6bef-de93-4f7d-8ce4-f26b4f8eb38c service swift] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:30.735142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2698c-eec2-4023-b3ad-936e57aeeb0f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:30.736368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2698c-eec2-4023-b3ad-936e57aeeb0f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:30.739661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2698c-eec2-4023-b3ad-936e57aeeb0f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:30.740157 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2698c-eec2-4023-b3ad-936e57aeeb0f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/domains/d4946669b9a347e68766c674573f4c40/users/d339ec05ca6a4865b0623f3488fab25a/roles/7c031068e05549f287954fbab3a9bb36` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:30.744355 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa2698c-eec2-4023-b3ad-936e57aeeb0f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=d4946669b9a347e68766c674573f4c40, user_id=d339ec05ca6a4865b0623f3488fab25a, role_id=7c031068e05549f287954fbab3a9bb36)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:30.752990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa2698c-eec2-4023-b3ad-936e57aeeb0f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:30.773874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-aaa2698c-eec2-4023-b3ad-936e57aeeb0f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invalidating the token cache because role 7c031068e05549f287954fbab3a9bb36 was removed from user d339ec05ca6a4865b0623f3488fab25a on domain d4946669b9a347e68766c674573f4c40. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:15:30.774565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-aaa2698c-eec2-4023-b3ad-936e57aeeb0f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:30.776041 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-aaa2698c-eec2-4023-b3ad-936e57aeeb0f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:30.816394 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2000/3996] 10.222.0.30 () {58 vars in 1464 bytes} [Sun Sep 4 01:15:30 2022] DELETE /identity/v3/domains/d4946669b9a347e68766c674573f4c40/users/d339ec05ca6a4865b0623f3488fab25a/roles/7c031068e05549f287954fbab3a9bb36 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:30.818372 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc1d16-bdcf-46fa-ba6a-0e81ff3608c0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:30.820000 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9ffc1d16-bdcf-46fa-ba6a-0e81ff3608c0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:30.853998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc1d16-bdcf-46fa-ba6a-0e81ff3608c0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:30.993533 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:31.031539 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f07942-a6bf-45bc-917b-e0a48b59ae22 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:31.032493 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f07942-a6bf-45bc-917b-e0a48b59ae22 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:31.032945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f07942-a6bf-45bc-917b-e0a48b59ae22 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:31.033385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f07942-a6bf-45bc-917b-e0a48b59ae22 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/roles/7c031068e05549f287954fbab3a9bb36` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:31.037027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f07942-a6bf-45bc-917b-e0a48b59ae22 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7c031068e05549f287954fbab3a9bb36)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:31.039457 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f07942-a6bf-45bc-917b-e0a48b59ae22 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:31.112383 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c5f07942-a6bf-45bc-917b-e0a48b59ae22 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invalidating the token cache because role 7c031068e05549f287954fbab3a9bb36 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:15:31.112938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c5f07942-a6bf-45bc-917b-e0a48b59ae22 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:31.114277 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c5f07942-a6bf-45bc-917b-e0a48b59ae22 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:31.119225 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1997/3997] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:15:30 2022] DELETE /identity/v3/roles/7c031068e05549f287954fbab3a9bb36 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:15:31.123762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2698c-eec2-4023-b3ad-936e57aeeb0f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:31.125318 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-aaa2698c-eec2-4023-b3ad-936e57aeeb0f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:31.153247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2698c-eec2-4023-b3ad-936e57aeeb0f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:31.287819 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:31.299988 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cce6c-8c5a-4906-990d-f7c49afb79e1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:31.300660 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cce6c-8c5a-4906-990d-f7c49afb79e1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:31.300982 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cce6c-8c5a-4906-990d-f7c49afb79e1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:31.301262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cce6c-8c5a-4906-990d-f7c49afb79e1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/domains/d4946669b9a347e68766c674573f4c40` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:31.306926 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3cce6c-8c5a-4906-990d-f7c49afb79e1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d4946669b9a347e68766c674573f4c40)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:31.308177 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-1a3cce6c-8c5a-4906-990d-f7c49afb79e1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:15:31.308177 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:15:31.308177 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:15:31.310028 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3cce6c-8c5a-4906-990d-f7c49afb79e1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:31.373061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1a3cce6c-8c5a-4906-990d-f7c49afb79e1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd4946669b9a347e68766c674573f4c40'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:31.374209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1a3cce6c-8c5a-4906-990d-f7c49afb79e1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd4946669b9a347e68766c674573f4c40'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:31.442399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1a3cce6c-8c5a-4906-990d-f7c49afb79e1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd4946669b9a347e68766c674573f4c40'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:31.443543 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1a3cce6c-8c5a-4906-990d-f7c49afb79e1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd4946669b9a347e68766c674573f4c40'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:31.451398 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2001/3998] 10.222.0.30 () {60 vars in 1249 bytes} [Sun Sep 4 01:15:31 2022] PATCH /identity/v3/domains/d4946669b9a347e68766c674573f4c40 => generated 277 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:15:31.459490 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f07942-a6bf-45bc-917b-e0a48b59ae22 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:31.461477 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c5f07942-a6bf-45bc-917b-e0a48b59ae22 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:31.491793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f07942-a6bf-45bc-917b-e0a48b59ae22 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:31.668708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6519b12-0973-4f2b-8907-210ac50ed98b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:31.669365 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6519b12-0973-4f2b-8907-210ac50ed98b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:31.669774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6519b12-0973-4f2b-8907-210ac50ed98b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:31.669977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6519b12-0973-4f2b-8907-210ac50ed98b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/domains/d4946669b9a347e68766c674573f4c40` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:31.696658 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6519b12-0973-4f2b-8907-210ac50ed98b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d4946669b9a347e68766c674573f4c40)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:31.698433 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6519b12-0973-4f2b-8907-210ac50ed98b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:31.758370 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e6519b12-0973-4f2b-8907-210ac50ed98b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd4946669b9a347e68766c674573f4c40'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:31.796901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e6519b12-0973-4f2b-8907-210ac50ed98b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd4946669b9a347e68766c674573f4c40'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:31.881997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e6519b12-0973-4f2b-8907-210ac50ed98b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4946669b9a347e68766c674573f4c40', 'request_id': 'req-e6519b12-0973-4f2b-8907-210ac50ed98b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:31.898886 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e6519b12-0973-4f2b-8907-210ac50ed98b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4946669b9a347e68766c674573f4c40', 'request_id': 'req-e6519b12-0973-4f2b-8907-210ac50ed98b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:31.911642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e6519b12-0973-4f2b-8907-210ac50ed98b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4946669b9a347e68766c674573f4c40', 'request_id': 'req-e6519b12-0973-4f2b-8907-210ac50ed98b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:31.943582 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e6519b12-0973-4f2b-8907-210ac50ed98b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] The token cache is being invalidate because project d4946669b9a347e68766c674573f4c40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:15:31.944021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e6519b12-0973-4f2b-8907-210ac50ed98b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:31.946700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e6519b12-0973-4f2b-8907-210ac50ed98b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:31.971292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e6519b12-0973-4f2b-8907-210ac50ed98b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd4946669b9a347e68766c674573f4c40', 'request_id': 'req-e6519b12-0973-4f2b-8907-210ac50ed98b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:31.975444 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e6519b12-0973-4f2b-8907-210ac50ed98b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd4946669b9a347e68766c674573f4c40', 'request_id': 'req-e6519b12-0973-4f2b-8907-210ac50ed98b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:31.978606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e6519b12-0973-4f2b-8907-210ac50ed98b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd4946669b9a347e68766c674573f4c40', 'request_id': 'req-e6519b12-0973-4f2b-8907-210ac50ed98b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:31.984877 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:32.014155 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1998/3999] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:15:31 2022] DELETE /identity/v3/domains/d4946669b9a347e68766c674573f4c40 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:32.021048 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cce6c-8c5a-4906-990d-f7c49afb79e1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:32.022889 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1a3cce6c-8c5a-4906-990d-f7c49afb79e1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:32.064029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cce6c-8c5a-4906-990d-f7c49afb79e1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:32.235498 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766c269-7957-4d6c-a84d-0a1b4a93e978 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:32.236362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766c269-7957-4d6c-a84d-0a1b4a93e978 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:32.237103 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766c269-7957-4d6c-a84d-0a1b4a93e978 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:32.237613 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766c269-7957-4d6c-a84d-0a1b4a93e978 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:32.238952 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9766c269-7957-4d6c-a84d-0a1b4a93e978 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:32.240687 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9766c269-7957-4d6c-a84d-0a1b4a93e978 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:32.262995 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2002/4000] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:15:32.265023 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6519b12-0973-4f2b-8907-210ac50ed98b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:32.266522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e6519b12-0973-4f2b-8907-210ac50ed98b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:32.294711 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6519b12-0973-4f2b-8907-210ac50ed98b tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:32.314001 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee676bd-3bc9-4fa7-876c-9358bbb278a4 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:32.316423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee676bd-3bc9-4fa7-876c-9358bbb278a4 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:32.316734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee676bd-3bc9-4fa7-876c-9358bbb278a4 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:32.317036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee676bd-3bc9-4fa7-876c-9358bbb278a4 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/projects/babac969d9464ca4bc431d4179f3f051/users/9be84a0850204c9795416a571a5ec268/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:32.327828 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee676bd-3bc9-4fa7-876c-9358bbb278a4 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:create_grant(project_id=babac969d9464ca4bc431d4179f3f051, user_id=9be84a0850204c9795416a571a5ec268, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:32.333019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee676bd-3bc9-4fa7-876c-9358bbb278a4 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:32.359696 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 1999/4001] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:15:32 2022] PUT /identity/v3/projects/babac969d9464ca4bc431d4179f3f051/users/9be84a0850204c9795416a571a5ec268/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:32.361552 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766c269-7957-4d6c-a84d-0a1b4a93e978 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:32.377733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766c269-7957-4d6c-a84d-0a1b4a93e978 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:32.506521 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264c0d9-b8d6-4d98-a0c8-e6b335fcf19f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:32.507308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264c0d9-b8d6-4d98-a0c8-e6b335fcf19f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:32.507715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264c0d9-b8d6-4d98-a0c8-e6b335fcf19f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:32.508093 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264c0d9-b8d6-4d98-a0c8-e6b335fcf19f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:32.508797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a264c0d9-b8d6-4d98-a0c8-e6b335fcf19f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:32.510163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a264c0d9-b8d6-4d98-a0c8-e6b335fcf19f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:32.632100 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2003/4002] 10.222.0.30 () {58 vars in 1146 bytes} [Sun Sep 4 01:15:32 2022] GET /identity/v3/auth/projects => generated 826 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:15:32.633915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee676bd-3bc9-4fa7-876c-9358bbb278a4 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:32.646831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee676bd-3bc9-4fa7-876c-9358bbb278a4 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:32.660015 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1153250-3d3f-4954-8b53-39957e20f51e tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:32.661656 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1153250-3d3f-4954-8b53-39957e20f51e tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:32.663572 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1153250-3d3f-4954-8b53-39957e20f51e tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:32.664866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1153250-3d3f-4954-8b53-39957e20f51e tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/projects/babac969d9464ca4bc431d4179f3f051/users/9be84a0850204c9795416a571a5ec268/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:32.669319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1153250-3d3f-4954-8b53-39957e20f51e tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=babac969d9464ca4bc431d4179f3f051, user_id=9be84a0850204c9795416a571a5ec268, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:32.674552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1153250-3d3f-4954-8b53-39957e20f51e tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:32.692369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a1153250-3d3f-4954-8b53-39957e20f51e tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invalidating the token cache because role d255b03c37d64371a148ec4e11be01d9 was removed from user 9be84a0850204c9795416a571a5ec268 on project babac969d9464ca4bc431d4179f3f051. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:15:32.694854 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a1153250-3d3f-4954-8b53-39957e20f51e tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:32.696578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a1153250-3d3f-4954-8b53-39957e20f51e tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:32.728892 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2000/4003] 10.222.0.30 () {58 vars in 1467 bytes} [Sun Sep 4 01:15:32 2022] DELETE /identity/v3/projects/babac969d9464ca4bc431d4179f3f051/users/9be84a0850204c9795416a571a5ec268/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:32.731543 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264c0d9-b8d6-4d98-a0c8-e6b335fcf19f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:32.733940 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a264c0d9-b8d6-4d98-a0c8-e6b335fcf19f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:32.773505 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264c0d9-b8d6-4d98-a0c8-e6b335fcf19f tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:32.828341 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:33.050245 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4e841-c798-4389-858c-212a20dc9815 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:33.054493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4e841-c798-4389-858c-212a20dc9815 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:33.058221 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4e841-c798-4389-858c-212a20dc9815 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:33.059196 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4e841-c798-4389-858c-212a20dc9815 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:33.062552 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4e841-c798-4389-858c-212a20dc9815 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:33.066022 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4e841-c798-4389-858c-212a20dc9815 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:33.177753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1153250-3d3f-4954-8b53-39957e20f51e tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:33.188937 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2004/4004] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:15:32 2022] POST /identity/v3/users => generated 323 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:33.190276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1153250-3d3f-4954-8b53-39957e20f51e tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:33.220255 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c89d08-c86d-4dfd-8438-10d295976ba1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:33.223817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c89d08-c86d-4dfd-8438-10d295976ba1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:33.225518 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c89d08-c86d-4dfd-8438-10d295976ba1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:33.227323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c89d08-c86d-4dfd-8438-10d295976ba1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:33.230826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c89d08-c86d-4dfd-8438-10d295976ba1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:33.242500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c89d08-c86d-4dfd-8438-10d295976ba1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:33.342072 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2001/4005] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:15:33 2022] POST /identity/v3/projects => generated 363 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:33.346114 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4e841-c798-4389-858c-212a20dc9815 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:33.377670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4e841-c798-4389-858c-212a20dc9815 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:33.522370 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125218a-ffb4-4f0f-b039-1b3de98bccf3 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:33.524092 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125218a-ffb4-4f0f-b039-1b3de98bccf3 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:33.525483 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125218a-ffb4-4f0f-b039-1b3de98bccf3 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:33.526578 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125218a-ffb4-4f0f-b039-1b3de98bccf3 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:33.527755 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125218a-ffb4-4f0f-b039-1b3de98bccf3 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:33.536010 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125218a-ffb4-4f0f-b039-1b3de98bccf3 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:33.615054 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2005/4006] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:15:33 2022] POST /identity/v3/projects => generated 363 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:15:33.619407 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c89d08-c86d-4dfd-8438-10d295976ba1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:33.635677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c89d08-c86d-4dfd-8438-10d295976ba1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:33.816402 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be6f9d-cd20-489d-a214-ce7852114c04 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:33.819402 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be6f9d-cd20-489d-a214-ce7852114c04 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:33.820821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be6f9d-cd20-489d-a214-ce7852114c04 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:33.821998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be6f9d-cd20-489d-a214-ce7852114c04 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:33.824501 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be6f9d-cd20-489d-a214-ce7852114c04 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:33.828468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be6f9d-cd20-489d-a214-ce7852114c04 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:33.873106 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2002/4007] 10.222.0.30 () {60 vars in 1143 bytes} [Sun Sep 4 01:15:33 2022] POST /identity/v3/roles => generated 239 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:15:33.874656 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125218a-ffb4-4f0f-b039-1b3de98bccf3 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:33.891238 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125218a-ffb4-4f0f-b039-1b3de98bccf3 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:33.913023 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3848a-33d1-46e5-8f3d-2865ed0a8c7c tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:33.913898 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3848a-33d1-46e5-8f3d-2865ed0a8c7c tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:33.914185 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3848a-33d1-46e5-8f3d-2865ed0a8c7c tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:33.914948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3848a-33d1-46e5-8f3d-2865ed0a8c7c tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/projects/371ba81a10f94390a60b82e4b0d11ef4/users/69c74aec0995400491c55b42f11269f2/roles/df61f6872fcc47fca3a821aca0045fd3` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:33.976276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3848a-33d1-46e5-8f3d-2865ed0a8c7c tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:create_grant(project_id=371ba81a10f94390a60b82e4b0d11ef4, user_id=69c74aec0995400491c55b42f11269f2, role_id=df61f6872fcc47fca3a821aca0045fd3)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:33.984453 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3848a-33d1-46e5-8f3d-2865ed0a8c7c tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:34.007896 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2006/4008] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:15:33 2022] PUT /identity/v3/projects/371ba81a10f94390a60b82e4b0d11ef4/users/69c74aec0995400491c55b42f11269f2/roles/df61f6872fcc47fca3a821aca0045fd3 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:34.011906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be6f9d-cd20-489d-a214-ce7852114c04 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:34.035196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be6f9d-cd20-489d-a214-ce7852114c04 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:34.211600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47946d5f-2e40-47bf-9bba-cd457153e822 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:34.212527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47946d5f-2e40-47bf-9bba-cd457153e822 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:34.213809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47946d5f-2e40-47bf-9bba-cd457153e822 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:34.214275 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47946d5f-2e40-47bf-9bba-cd457153e822 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/projects/132cf6b825714aafb38b781bb1ce839a/users/69c74aec0995400491c55b42f11269f2/roles/df61f6872fcc47fca3a821aca0045fd3` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:34.216988 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47946d5f-2e40-47bf-9bba-cd457153e822 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:create_grant(project_id=132cf6b825714aafb38b781bb1ce839a, user_id=69c74aec0995400491c55b42f11269f2, role_id=df61f6872fcc47fca3a821aca0045fd3)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:34.221054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47946d5f-2e40-47bf-9bba-cd457153e822 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:34.254811 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40b930-a6ef-41da-833b-cf7661c3ceb4 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:34.255462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40b930-a6ef-41da-833b-cf7661c3ceb4 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:34.255968 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40b930-a6ef-41da-833b-cf7661c3ceb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:34.259563 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2003/4009] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:15:34 2022] PUT /identity/v3/projects/132cf6b825714aafb38b781bb1ce839a/users/69c74aec0995400491c55b42f11269f2/roles/df61f6872fcc47fca3a821aca0045fd3 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:34.299467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-8c40b930-a6ef-41da-833b-cf7661c3ceb4 None None] MFA Rules not processed for user `69c74aec0995400491c55b42f11269f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:34.301889 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8c40b930-a6ef-41da-833b-cf7661c3ceb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:34.312002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2fdc1-e9b7-4357-9f8e-ba87c43f500b None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:34.312659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2fdc1-e9b7-4357-9f8e-ba87c43f500b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:34.313286 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2fdc1-e9b7-4357-9f8e-ba87c43f500b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:34.324945 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2007/4010] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:34 2022] POST /identity/v3/auth/tokens => generated 335 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 01:15:34.333093 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5bd2fdc1-e9b7-4357-9f8e-ba87c43f500b None None] MFA Rules not processed for user `69c74aec0995400491c55b42f11269f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:34.336488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5bd2fdc1-e9b7-4357-9f8e-ba87c43f500b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:34.411114 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:34.493143 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2004/4011] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:34 2022] POST /identity/v3/auth/tokens => generated 3225 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Sep 04 01:15:34.499519 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40b930-a6ef-41da-833b-cf7661c3ceb4 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:34.635261 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:34.647405 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40b930-a6ef-41da-833b-cf7661c3ceb4 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:34.658204 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2704383-4240-4e2d-9bd6-5b417edc3d36 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:34.658990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2704383-4240-4e2d-9bd6-5b417edc3d36 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:34.660930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2704383-4240-4e2d-9bd6-5b417edc3d36 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:34.661337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2704383-4240-4e2d-9bd6-5b417edc3d36 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:34.682719 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2704383-4240-4e2d-9bd6-5b417edc3d36 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:34.685172 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2704383-4240-4e2d-9bd6-5b417edc3d36 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:34.721247 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2008/4012] 10.222.0.30 () {56 vars in 1308 bytes} [Sun Sep 4 01:15:34 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:34.725979 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b6f24-c34e-4d9a-854e-76107f62eb0f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:34.726452 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b6f24-c34e-4d9a-854e-76107f62eb0f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:34.727430 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b6f24-c34e-4d9a-854e-76107f62eb0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:34.755800 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e57b6f24-c34e-4d9a-854e-76107f62eb0f None None] MFA Rules not processed for user `69c74aec0995400491c55b42f11269f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:34.757190 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e57b6f24-c34e-4d9a-854e-76107f62eb0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:34.958098 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2005/4013] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:34 2022] POST /identity/v3/auth/tokens => generated 3225 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Sep 04 01:15:34.962214 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2704383-4240-4e2d-9bd6-5b417edc3d36 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:34.977649 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2704383-4240-4e2d-9bd6-5b417edc3d36 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:34.983457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93385f-40b6-488e-bb7c-94a3aba7559c tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:34.984362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93385f-40b6-488e-bb7c-94a3aba7559c tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:34.984742 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93385f-40b6-488e-bb7c-94a3aba7559c tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:34.985117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93385f-40b6-488e-bb7c-94a3aba7559c tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/roles/df61f6872fcc47fca3a821aca0045fd3` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:34.994958 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d93385f-40b6-488e-bb7c-94a3aba7559c tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:delete_role(role_id=df61f6872fcc47fca3a821aca0045fd3)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:34.999339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d93385f-40b6-488e-bb7c-94a3aba7559c tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:35.087608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2d93385f-40b6-488e-bb7c-94a3aba7559c tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invalidating the token cache because role df61f6872fcc47fca3a821aca0045fd3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:15:35.088105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2d93385f-40b6-488e-bb7c-94a3aba7559c tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:35.088991 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2d93385f-40b6-488e-bb7c-94a3aba7559c tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:35.098647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b6f24-c34e-4d9a-854e-76107f62eb0f None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:35.100807 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2009/4014] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:15:34 2022] DELETE /identity/v3/roles/df61f6872fcc47fca3a821aca0045fd3 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:35.122318 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b6f24-c34e-4d9a-854e-76107f62eb0f None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:35.242254 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c979c-1080-438c-b733-b2da766c6fb1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:35.243208 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c979c-1080-438c-b733-b2da766c6fb1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:35.243812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c979c-1080-438c-b733-b2da766c6fb1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:35.244171 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c979c-1080-438c-b733-b2da766c6fb1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/projects/132cf6b825714aafb38b781bb1ce839a` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:35.246412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c979c-1080-438c-b733-b2da766c6fb1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:delete_project(project_id=132cf6b825714aafb38b781bb1ce839a)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:35.248766 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c979c-1080-438c-b733-b2da766c6fb1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:35.415373 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4a5c979c-1080-438c-b733-b2da766c6fb1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '132cf6b825714aafb38b781bb1ce839a', 'request_id': 'req-4a5c979c-1080-438c-b733-b2da766c6fb1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:35.441034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4a5c979c-1080-438c-b733-b2da766c6fb1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '132cf6b825714aafb38b781bb1ce839a', 'request_id': 'req-4a5c979c-1080-438c-b733-b2da766c6fb1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:35.469644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4a5c979c-1080-438c-b733-b2da766c6fb1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '132cf6b825714aafb38b781bb1ce839a', 'request_id': 'req-4a5c979c-1080-438c-b733-b2da766c6fb1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:35.492501 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4a5c979c-1080-438c-b733-b2da766c6fb1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] The token cache is being invalidate because project 132cf6b825714aafb38b781bb1ce839a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:15:35.492909 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4a5c979c-1080-438c-b733-b2da766c6fb1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:35.494174 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4a5c979c-1080-438c-b733-b2da766c6fb1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:35.501827 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93385f-40b6-488e-bb7c-94a3aba7559c tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:35.503641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2d93385f-40b6-488e-bb7c-94a3aba7559c tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:35.506128 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2006/4015] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:15:35 2022] DELETE /identity/v3/projects/132cf6b825714aafb38b781bb1ce839a => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:35.560029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93385f-40b6-488e-bb7c-94a3aba7559c tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:35.716492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9aaa9-2ef6-4f6b-a35e-a4fc1c0ac0e4 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:35.717394 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9aaa9-2ef6-4f6b-a35e-a4fc1c0ac0e4 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:35.717938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9aaa9-2ef6-4f6b-a35e-a4fc1c0ac0e4 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:35.718461 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9aaa9-2ef6-4f6b-a35e-a4fc1c0ac0e4 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/projects/132cf6b825714aafb38b781bb1ce839a` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:35.745416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a9aaa9-2ef6-4f6b-a35e-a4fc1c0ac0e4 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:delete_project(project_id=132cf6b825714aafb38b781bb1ce839a)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:35.750112 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a9aaa9-2ef6-4f6b-a35e-a4fc1c0ac0e4 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:35.780704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-00a9aaa9-2ef6-4f6b-a35e-a4fc1c0ac0e4 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Could not find project: 132cf6b825714aafb38b781bb1ce839a.: keystone.exception.ProjectNotFound: Could not find project: 132cf6b825714aafb38b781bb1ce839a. Sep 04 01:15:35.780704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:15:35.780704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:15:35.780704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:15:35.780704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:15:35.780704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:15:35.780704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:15:35.780704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:15:35.780704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:15:35.780704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:15:35.780704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:15:35.780704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:15:35.780704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Sep 04 01:15:35.780704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Sep 04 01:15:35.782123 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:15:35.782123 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:15:35.782123 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Sep 04 01:15:35.782123 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Sep 04 01:15:35.782123 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 01:15:35.782123 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 01:15:35.782123 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 01:15:35.782123 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 01:15:35.782123 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 132cf6b825714aafb38b781bb1ce839a. Sep 04 01:15:35.782123 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:15:35.783584 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2010/4016] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:15:35 2022] DELETE /identity/v3/projects/132cf6b825714aafb38b781bb1ce839a => generated 113 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:15:35.788050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c979c-1080-438c-b733-b2da766c6fb1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:35.793529 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4a5c979c-1080-438c-b733-b2da766c6fb1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:35.845301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c979c-1080-438c-b733-b2da766c6fb1 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:35.871198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011e7ca-61b1-4595-b51f-1ecf7468e92a tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:35.872111 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011e7ca-61b1-4595-b51f-1ecf7468e92a tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:35.872826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011e7ca-61b1-4595-b51f-1ecf7468e92a tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:35.873378 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011e7ca-61b1-4595-b51f-1ecf7468e92a tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/projects/371ba81a10f94390a60b82e4b0d11ef4` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:35.874801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9011e7ca-61b1-4595-b51f-1ecf7468e92a tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:delete_project(project_id=371ba81a10f94390a60b82e4b0d11ef4)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:35.877036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9011e7ca-61b1-4595-b51f-1ecf7468e92a tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:35.879471 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:36.030054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9011e7ca-61b1-4595-b51f-1ecf7468e92a tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '371ba81a10f94390a60b82e4b0d11ef4', 'request_id': 'req-9011e7ca-61b1-4595-b51f-1ecf7468e92a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:36.049220 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9011e7ca-61b1-4595-b51f-1ecf7468e92a tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '371ba81a10f94390a60b82e4b0d11ef4', 'request_id': 'req-9011e7ca-61b1-4595-b51f-1ecf7468e92a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:36.072096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9011e7ca-61b1-4595-b51f-1ecf7468e92a tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '371ba81a10f94390a60b82e4b0d11ef4', 'request_id': 'req-9011e7ca-61b1-4595-b51f-1ecf7468e92a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:36.125540 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9011e7ca-61b1-4595-b51f-1ecf7468e92a tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] The token cache is being invalidate because project 371ba81a10f94390a60b82e4b0d11ef4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:15:36.126568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9011e7ca-61b1-4595-b51f-1ecf7468e92a tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:36.127935 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9011e7ca-61b1-4595-b51f-1ecf7468e92a tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:36.130813 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2007/4017] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:15:35 2022] DELETE /identity/v3/projects/371ba81a10f94390a60b82e4b0d11ef4 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:36.135391 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9aaa9-2ef6-4f6b-a35e-a4fc1c0ac0e4 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:36.137505 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-00a9aaa9-2ef6-4f6b-a35e-a4fc1c0ac0e4 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:36.160271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9aaa9-2ef6-4f6b-a35e-a4fc1c0ac0e4 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:36.449517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd823e-3444-4a46-9963-977d0b69eab0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:36.450290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd823e-3444-4a46-9963-977d0b69eab0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:36.450581 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd823e-3444-4a46-9963-977d0b69eab0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:36.450864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd823e-3444-4a46-9963-977d0b69eab0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/users/69c74aec0995400491c55b42f11269f2` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:36.460235 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd823e-3444-4a46-9963-977d0b69eab0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorizing `identity:delete_user(user_id=69c74aec0995400491c55b42f11269f2)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:36.465536 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd823e-3444-4a46-9963-977d0b69eab0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:36.627382 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:36.675350 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-eafd823e-3444-4a46-9963-977d0b69eab0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69c74aec0995400491c55b42f11269f2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:36.679647 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-eafd823e-3444-4a46-9963-977d0b69eab0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69c74aec0995400491c55b42f11269f2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:36.716105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-eafd823e-3444-4a46-9963-977d0b69eab0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69c74aec0995400491c55b42f11269f2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:36.740894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-eafd823e-3444-4a46-9963-977d0b69eab0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69c74aec0995400491c55b42f11269f2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:36.741777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-eafd823e-3444-4a46-9963-977d0b69eab0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69c74aec0995400491c55b42f11269f2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:36.848772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011e7ca-61b1-4595-b51f-1ecf7468e92a tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:36.849370 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2011/4018] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:15:36 2022] DELETE /identity/v3/users/69c74aec0995400491c55b42f11269f2 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:36.851075 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011e7ca-61b1-4595-b51f-1ecf7468e92a tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:37.064776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80ade2-c9d2-4625-9090-cf82a32f903a tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:37.065942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80ade2-c9d2-4625-9090-cf82a32f903a tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:37.067147 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80ade2-c9d2-4625-9090-cf82a32f903a tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:37.067616 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80ade2-c9d2-4625-9090-cf82a32f903a tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/domains/990c1bd1c69a4c75a4fb97a53e4bcb90` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:37.098370 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80ade2-c9d2-4625-9090-cf82a32f903a tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 01:15:37.142010 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-5a80ade2-c9d2-4625-9090-cf82a32f903a tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Could not find domain: 990c1bd1c69a4c75a4fb97a53e4bcb90.: keystone.exception.DomainNotFound: Could not find domain: 990c1bd1c69a4c75a4fb97a53e4bcb90. Sep 04 01:15:37.142010 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:15:37.142010 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 04 01:15:37.142010 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 04 01:15:37.142010 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 01:15:37.142010 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 01:15:37.142010 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 01:15:37.142010 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 01:15:37.142010 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 990c1bd1c69a4c75a4fb97a53e4bcb90. Sep 04 01:15:37.142010 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:15:37.142010 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:15:37.142010 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:15:37.142010 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:15:37.142010 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:15:37.142010 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:15:37.142010 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:15:37.143487 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:15:37.143487 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:15:37.143487 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:15:37.143487 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:15:37.143487 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:15:37.143487 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:15:37.143487 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:15:37.143487 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 04 01:15:37.143487 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 04 01:15:37.143487 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 01:15:37.143487 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 01:15:37.143487 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 01:15:37.143487 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 01:15:37.143487 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:15:37.143487 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:15:37.143487 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 01:15:37.144835 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 01:15:37.144835 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 01:15:37.144835 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 01:15:37.144835 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 01:15:37.144835 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 01:15:37.144835 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 01:15:37.144835 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 01:15:37.144835 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 01:15:37.144835 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 01:15:37.144835 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 01:15:37.144835 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 01:15:37.144835 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 01:15:37.144835 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 01:15:37.144835 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 04 01:15:37.144835 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 01:15:37.144835 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 990c1bd1c69a4c75a4fb97a53e4bcb90. Sep 04 01:15:37.144835 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:15:37.151821 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2008/4019] 10.222.0.30 () {60 vars in 1249 bytes} [Sun Sep 4 01:15:36 2022] PATCH /identity/v3/domains/990c1bd1c69a4c75a4fb97a53e4bcb90 => generated 112 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:15:37.156537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd823e-3444-4a46-9963-977d0b69eab0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:37.158310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-eafd823e-3444-4a46-9963-977d0b69eab0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:37.185708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd823e-3444-4a46-9963-977d0b69eab0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:37.228424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c3653-44f5-4dab-8419-56f8ae435e67 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:37.229244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c3653-44f5-4dab-8419-56f8ae435e67 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:37.229556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c3653-44f5-4dab-8419-56f8ae435e67 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:37.229832 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c3653-44f5-4dab-8419-56f8ae435e67 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/domains/cc05cba6146840b49c15e431278beddf` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:37.274892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c3653-44f5-4dab-8419-56f8ae435e67 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 01:15:37.279955 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-165c3653-44f5-4dab-8419-56f8ae435e67 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Could not find domain: cc05cba6146840b49c15e431278beddf.: keystone.exception.DomainNotFound: Could not find domain: cc05cba6146840b49c15e431278beddf. Sep 04 01:15:37.279955 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:15:37.279955 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 04 01:15:37.279955 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 04 01:15:37.279955 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 01:15:37.279955 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 01:15:37.279955 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 01:15:37.279955 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 01:15:37.279955 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: cc05cba6146840b49c15e431278beddf. Sep 04 01:15:37.279955 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:15:37.279955 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:15:37.279955 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:15:37.279955 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:15:37.279955 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:15:37.279955 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:15:37.279955 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:15:37.281136 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:15:37.281136 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:15:37.281136 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:15:37.281136 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:15:37.281136 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:15:37.281136 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:15:37.281136 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:15:37.281136 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 04 01:15:37.281136 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 04 01:15:37.281136 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 01:15:37.281136 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 01:15:37.281136 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 01:15:37.281136 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 01:15:37.281136 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:15:37.281136 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:15:37.281136 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 01:15:37.282300 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 01:15:37.282300 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 01:15:37.282300 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 01:15:37.282300 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 01:15:37.282300 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 01:15:37.282300 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 01:15:37.282300 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 01:15:37.282300 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 01:15:37.282300 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 01:15:37.282300 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 01:15:37.282300 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 01:15:37.282300 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 01:15:37.282300 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 01:15:37.282300 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 04 01:15:37.282300 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 01:15:37.282300 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: cc05cba6146840b49c15e431278beddf. Sep 04 01:15:37.282300 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:15:37.285708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80ade2-c9d2-4625-9090-cf82a32f903a tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:37.308431 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2012/4020] 10.222.0.30 () {60 vars in 1249 bytes} [Sun Sep 4 01:15:37 2022] PATCH /identity/v3/domains/cc05cba6146840b49c15e431278beddf => generated 112 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:15:37.316874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80ade2-c9d2-4625-9090-cf82a32f903a tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:37.332531 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849218db-9d12-4d10-a37e-221c4f5adcb7 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:37.336734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849218db-9d12-4d10-a37e-221c4f5adcb7 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:37.337293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849218db-9d12-4d10-a37e-221c4f5adcb7 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:37.339522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849218db-9d12-4d10-a37e-221c4f5adcb7 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/domains/cf69d140e055429a9f219634a8192b27` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:37.372440 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849218db-9d12-4d10-a37e-221c4f5adcb7 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 01:15:37.393772 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-849218db-9d12-4d10-a37e-221c4f5adcb7 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Could not find domain: cf69d140e055429a9f219634a8192b27.: keystone.exception.DomainNotFound: Could not find domain: cf69d140e055429a9f219634a8192b27. Sep 04 01:15:37.393772 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:15:37.393772 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 04 01:15:37.393772 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 04 01:15:37.393772 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 01:15:37.393772 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 01:15:37.393772 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 01:15:37.393772 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 01:15:37.393772 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: cf69d140e055429a9f219634a8192b27. Sep 04 01:15:37.393772 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:15:37.393772 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:15:37.393772 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:15:37.393772 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:15:37.393772 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:15:37.393772 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:15:37.393772 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:15:37.395270 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:15:37.395270 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:15:37.395270 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:15:37.395270 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:15:37.395270 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:15:37.395270 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:15:37.395270 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:15:37.395270 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 04 01:15:37.395270 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 04 01:15:37.395270 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 01:15:37.395270 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 01:15:37.395270 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 01:15:37.395270 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 01:15:37.395270 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:15:37.395270 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:15:37.395270 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 01:15:37.396547 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 01:15:37.396547 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 01:15:37.396547 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 01:15:37.396547 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 01:15:37.396547 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 01:15:37.396547 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 01:15:37.396547 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 01:15:37.396547 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 01:15:37.396547 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 01:15:37.396547 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 01:15:37.396547 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 01:15:37.396547 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 01:15:37.396547 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 01:15:37.396547 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 04 01:15:37.396547 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 01:15:37.396547 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: cf69d140e055429a9f219634a8192b27. Sep 04 01:15:37.396547 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:15:37.402070 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2009/4021] 10.222.0.30 () {60 vars in 1249 bytes} [Sun Sep 4 01:15:37 2022] PATCH /identity/v3/domains/cf69d140e055429a9f219634a8192b27 => generated 112 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Sep 04 01:15:37.404564 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c3653-44f5-4dab-8419-56f8ae435e67 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:37.455912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c3653-44f5-4dab-8419-56f8ae435e67 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:37.480471 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc6589-ff96-4bdd-9dbd-d3ab4e8710b0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9be84a0850204c9795416a571a5ec268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31cf6a92cb134ce6bef486dfd394ae19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:37.483576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc6589-ff96-4bdd-9dbd-d3ab4e8710b0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:37.483904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc6589-ff96-4bdd-9dbd-d3ab4e8710b0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:37.485174 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc6589-ff96-4bdd-9dbd-d3ab4e8710b0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] PATH_INFO: `/v3/domains/d4946669b9a347e68766c674573f4c40` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:37.528140 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc6589-ff96-4bdd-9dbd-d3ab4e8710b0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 01:15:37.556933 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-a0bc6589-ff96-4bdd-9dbd-d3ab4e8710b0 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Could not find domain: d4946669b9a347e68766c674573f4c40.: keystone.exception.DomainNotFound: Could not find domain: d4946669b9a347e68766c674573f4c40. Sep 04 01:15:37.556933 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:15:37.556933 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 04 01:15:37.556933 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 04 01:15:37.556933 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 01:15:37.556933 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 01:15:37.556933 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 01:15:37.556933 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 01:15:37.556933 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d4946669b9a347e68766c674573f4c40. Sep 04 01:15:37.556933 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:15:37.556933 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:15:37.556933 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:15:37.556933 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:15:37.556933 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:15:37.556933 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:15:37.556933 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:15:37.558181 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:15:37.558181 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:15:37.558181 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:15:37.558181 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:15:37.558181 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:15:37.558181 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:15:37.558181 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:15:37.558181 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 04 01:15:37.558181 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 04 01:15:37.558181 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 01:15:37.558181 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 01:15:37.558181 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 01:15:37.558181 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 01:15:37.558181 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:15:37.558181 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:15:37.558181 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 01:15:37.559264 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 01:15:37.559264 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 01:15:37.559264 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 01:15:37.559264 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 01:15:37.559264 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 01:15:37.559264 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 01:15:37.559264 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 01:15:37.559264 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 01:15:37.559264 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 01:15:37.559264 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 01:15:37.559264 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 01:15:37.559264 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 01:15:37.559264 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 01:15:37.559264 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 04 01:15:37.559264 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 01:15:37.559264 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: d4946669b9a347e68766c674573f4c40. Sep 04 01:15:37.559264 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:15:37.567420 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2013/4022] 10.222.0.30 () {60 vars in 1249 bytes} [Sun Sep 4 01:15:37 2022] PATCH /identity/v3/domains/d4946669b9a347e68766c674573f4c40 => generated 112 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:15:37.571672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849218db-9d12-4d10-a37e-221c4f5adcb7 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:37.573652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-849218db-9d12-4d10-a37e-221c4f5adcb7 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:37.806774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849218db-9d12-4d10-a37e-221c4f5adcb7 tempest-TokensV3TestJSON-1742675235 tempest-TokensV3TestJSON-1742675235-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:37.817537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167f76d-b606-491c-bf84-d203621735bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:37.818235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167f76d-b606-491c-bf84-d203621735bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:37.818482 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167f76d-b606-491c-bf84-d203621735bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:37.818756 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167f76d-b606-491c-bf84-d203621735bc admin admin] PATH_INFO: `/v3/users/c3c84efdebbf49d78b4f016a5d41ce85` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:37.820142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167f76d-b606-491c-bf84-d203621735bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3c84efdebbf49d78b4f016a5d41ce85)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:37.822709 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167f76d-b606-491c-bf84-d203621735bc admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:37.885608 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:37.977234 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b167f76d-b606-491c-bf84-d203621735bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3c84efdebbf49d78b4f016a5d41ce85'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:37.978727 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b167f76d-b606-491c-bf84-d203621735bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3c84efdebbf49d78b4f016a5d41ce85'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:38.003305 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b167f76d-b606-491c-bf84-d203621735bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3c84efdebbf49d78b4f016a5d41ce85'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:38.038709 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b167f76d-b606-491c-bf84-d203621735bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3c84efdebbf49d78b4f016a5d41ce85'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:38.039593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b167f76d-b606-491c-bf84-d203621735bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3c84efdebbf49d78b4f016a5d41ce85'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:38.111043 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2010/4023] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:15:37 2022] DELETE /identity/v3/users/c3c84efdebbf49d78b4f016a5d41ce85 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:38.116372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ca5d8-e139-4374-a424-809af417bc9b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:38.117672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ca5d8-e139-4374-a424-809af417bc9b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:38.118212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ca5d8-e139-4374-a424-809af417bc9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:38.160767 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e03ca5d8-e139-4374-a424-809af417bc9b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:38.162282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e03ca5d8-e139-4374-a424-809af417bc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:38.406589 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2014/4024] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:38.471666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167f76d-b606-491c-bf84-d203621735bc admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:38.473388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b167f76d-b606-491c-bf84-d203621735bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:38.635458 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167f76d-b606-491c-bf84-d203621735bc admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:38.643227 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58efd9b-1c6d-498c-9e6d-c644840241db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:38.644102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58efd9b-1c6d-498c-9e6d-c644840241db service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:38.646171 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58efd9b-1c6d-498c-9e6d-c644840241db service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:38.646564 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58efd9b-1c6d-498c-9e6d-c644840241db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:38.698331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58efd9b-1c6d-498c-9e6d-c644840241db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:38.698331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58efd9b-1c6d-498c-9e6d-c644840241db service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:38.724082 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2011/4025] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:15:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:15:38.928515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04dd06-b81d-4497-8fc8-b60cb5e95761 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:38.928897 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04dd06-b81d-4497-8fc8-b60cb5e95761 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:38.929657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04dd06-b81d-4497-8fc8-b60cb5e95761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:38.982235 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-eb04dd06-b81d-4497-8fc8-b60cb5e95761 None None] MFA Rules not processed for user `5581a720105c400f8bee8ef53813288b`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:38.986357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-eb04dd06-b81d-4497-8fc8-b60cb5e95761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:39.146322 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2015/4026] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:15:40.223665 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58efd9b-1c6d-498c-9e6d-c644840241db service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:40.225292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b58efd9b-1c6d-498c-9e6d-c644840241db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:40.275496 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58efd9b-1c6d-498c-9e6d-c644840241db service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:40.294705 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627eb45-f412-46c6-8d71-d06fd0339982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:40.296923 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627eb45-f412-46c6-8d71-d06fd0339982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:40.297602 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627eb45-f412-46c6-8d71-d06fd0339982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:40.298012 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627eb45-f412-46c6-8d71-d06fd0339982 admin admin] PATH_INFO: `/v3/projects/babac969d9464ca4bc431d4179f3f051` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:40.303264 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627eb45-f412-46c6-8d71-d06fd0339982 admin admin] RBAC: Authorizing `identity:delete_project(project_id=babac969d9464ca4bc431d4179f3f051)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:40.307440 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627eb45-f412-46c6-8d71-d06fd0339982 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:40.536768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8627eb45-f412-46c6-8d71-d06fd0339982 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'babac969d9464ca4bc431d4179f3f051', 'request_id': 'req-8627eb45-f412-46c6-8d71-d06fd0339982'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:40.558093 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8627eb45-f412-46c6-8d71-d06fd0339982 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'babac969d9464ca4bc431d4179f3f051', 'request_id': 'req-8627eb45-f412-46c6-8d71-d06fd0339982'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:40.573954 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8627eb45-f412-46c6-8d71-d06fd0339982 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'babac969d9464ca4bc431d4179f3f051', 'request_id': 'req-8627eb45-f412-46c6-8d71-d06fd0339982'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:40.600265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8627eb45-f412-46c6-8d71-d06fd0339982 admin admin] The token cache is being invalidate because project babac969d9464ca4bc431d4179f3f051 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:15:40.600584 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8627eb45-f412-46c6-8d71-d06fd0339982 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:40.601920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8627eb45-f412-46c6-8d71-d06fd0339982 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:40.607544 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2012/4027] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:15:40 2022] DELETE /identity/v3/projects/babac969d9464ca4bc431d4179f3f051 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:40.612402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04dd06-b81d-4497-8fc8-b60cb5e95761 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:40.636003 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04dd06-b81d-4497-8fc8-b60cb5e95761 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:40.784127 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:40.832528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b10f6e-1db6-46ba-a841-4fc0ed19d2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:40.832528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b10f6e-1db6-46ba-a841-4fc0ed19d2ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:40.832528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b10f6e-1db6-46ba-a841-4fc0ed19d2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:40.832528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b10f6e-1db6-46ba-a841-4fc0ed19d2ee admin admin] PATH_INFO: `/v3/users/9be84a0850204c9795416a571a5ec268` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:40.836757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b10f6e-1db6-46ba-a841-4fc0ed19d2ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=9be84a0850204c9795416a571a5ec268)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:40.840750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b10f6e-1db6-46ba-a841-4fc0ed19d2ee admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:40.965229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-85b10f6e-1db6-46ba-a841-4fc0ed19d2ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9be84a0850204c9795416a571a5ec268'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:40.966490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-85b10f6e-1db6-46ba-a841-4fc0ed19d2ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9be84a0850204c9795416a571a5ec268'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:40.985244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-85b10f6e-1db6-46ba-a841-4fc0ed19d2ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9be84a0850204c9795416a571a5ec268'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:41.004654 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-85b10f6e-1db6-46ba-a841-4fc0ed19d2ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9be84a0850204c9795416a571a5ec268'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:41.005324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-85b10f6e-1db6-46ba-a841-4fc0ed19d2ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9be84a0850204c9795416a571a5ec268'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:41.050009 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2016/4028] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:15:40 2022] DELETE /identity/v3/users/9be84a0850204c9795416a571a5ec268 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:41.622834 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627eb45-f412-46c6-8d71-d06fd0339982 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:41.624474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8627eb45-f412-46c6-8d71-d06fd0339982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:41.655581 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627eb45-f412-46c6-8d71-d06fd0339982 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:41.703542 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:41.806597 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303e214-d774-4f52-8edc-400cbfbe2a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:41.808040 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303e214-d774-4f52-8edc-400cbfbe2a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:41.808432 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303e214-d774-4f52-8edc-400cbfbe2a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:41.808938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303e214-d774-4f52-8edc-400cbfbe2a2c admin admin] PATH_INFO: `/v3/projects/31cf6a92cb134ce6bef486dfd394ae19` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:41.810404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0303e214-d774-4f52-8edc-400cbfbe2a2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=31cf6a92cb134ce6bef486dfd394ae19)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:41.821307 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0303e214-d774-4f52-8edc-400cbfbe2a2c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:41.929355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0303e214-d774-4f52-8edc-400cbfbe2a2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31cf6a92cb134ce6bef486dfd394ae19', 'request_id': 'req-0303e214-d774-4f52-8edc-400cbfbe2a2c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:41.945527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0303e214-d774-4f52-8edc-400cbfbe2a2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31cf6a92cb134ce6bef486dfd394ae19', 'request_id': 'req-0303e214-d774-4f52-8edc-400cbfbe2a2c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:41.962090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0303e214-d774-4f52-8edc-400cbfbe2a2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31cf6a92cb134ce6bef486dfd394ae19', 'request_id': 'req-0303e214-d774-4f52-8edc-400cbfbe2a2c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:41.982972 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0303e214-d774-4f52-8edc-400cbfbe2a2c admin admin] The token cache is being invalidate because project 31cf6a92cb134ce6bef486dfd394ae19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:15:41.983796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0303e214-d774-4f52-8edc-400cbfbe2a2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:41.984693 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0303e214-d774-4f52-8edc-400cbfbe2a2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:41.989169 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2013/4029] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:15:41 2022] DELETE /identity/v3/projects/31cf6a92cb134ce6bef486dfd394ae19 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:41.993492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b10f6e-1db6-46ba-a841-4fc0ed19d2ee admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:41.996958 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-85b10f6e-1db6-46ba-a841-4fc0ed19d2ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:42.022999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b10f6e-1db6-46ba-a841-4fc0ed19d2ee admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:42.161935 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c654b63-6fd9-4f8e-acd9-03d924516f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:42.163124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c654b63-6fd9-4f8e-acd9-03d924516f1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:42.168713 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c654b63-6fd9-4f8e-acd9-03d924516f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:42.169369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c654b63-6fd9-4f8e-acd9-03d924516f1d admin admin] PATH_INFO: `/v3/users/d339ec05ca6a4865b0623f3488fab25a` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:42.171139 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c654b63-6fd9-4f8e-acd9-03d924516f1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d339ec05ca6a4865b0623f3488fab25a)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:42.174108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c654b63-6fd9-4f8e-acd9-03d924516f1d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:42.288288 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8c654b63-6fd9-4f8e-acd9-03d924516f1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd339ec05ca6a4865b0623f3488fab25a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:42.289532 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8c654b63-6fd9-4f8e-acd9-03d924516f1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd339ec05ca6a4865b0623f3488fab25a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:42.300072 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8c654b63-6fd9-4f8e-acd9-03d924516f1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd339ec05ca6a4865b0623f3488fab25a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:42.312704 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8c654b63-6fd9-4f8e-acd9-03d924516f1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd339ec05ca6a4865b0623f3488fab25a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:42.313727 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8c654b63-6fd9-4f8e-acd9-03d924516f1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd339ec05ca6a4865b0623f3488fab25a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:42.316466 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:42.348273 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2017/4030] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:15:41 2022] DELETE /identity/v3/users/d339ec05ca6a4865b0623f3488fab25a => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:43.617699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303e214-d774-4f52-8edc-400cbfbe2a2c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:43.619774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0303e214-d774-4f52-8edc-400cbfbe2a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:43.646333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c654b63-6fd9-4f8e-acd9-03d924516f1d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:43.648744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8c654b63-6fd9-4f8e-acd9-03d924516f1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:43.666180 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303e214-d774-4f52-8edc-400cbfbe2a2c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:43.912893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c654b63-6fd9-4f8e-acd9-03d924516f1d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:43.913708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e4865-af13-48da-8457-4546b47fc564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:43.914383 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e4865-af13-48da-8457-4546b47fc564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:43.914663 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e4865-af13-48da-8457-4546b47fc564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:43.914936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e4865-af13-48da-8457-4546b47fc564 admin admin] PATH_INFO: `/v3/projects/9e20420801fe47419f0f76efa7050111` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:43.916454 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e4865-af13-48da-8457-4546b47fc564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e20420801fe47419f0f76efa7050111)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:43.919726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031cb36-0332-4d82-918a-49fca9d5614d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:43.920607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031cb36-0332-4d82-918a-49fca9d5614d service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:43.920993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031cb36-0332-4d82-918a-49fca9d5614d service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:43.921367 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031cb36-0332-4d82-918a-49fca9d5614d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:43.922731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e4865-af13-48da-8457-4546b47fc564 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:43.923602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1031cb36-0332-4d82-918a-49fca9d5614d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:43.940800 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031cb36-0332-4d82-918a-49fca9d5614d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:43.943269 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031cb36-0332-4d82-918a-49fca9d5614d service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:43.960892 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2018/4031] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:15:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:15:43.962050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031cb36-0332-4d82-918a-49fca9d5614d service placement] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:43.963769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1031cb36-0332-4d82-918a-49fca9d5614d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:43.978313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031cb36-0332-4d82-918a-49fca9d5614d service placement] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:43.984014 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd1508-b2f2-4898-bd72-af1f02b7e065 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:43.984798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd1508-b2f2-4898-bd72-af1f02b7e065 service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:43.985184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd1508-b2f2-4898-bd72-af1f02b7e065 service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:43.985618 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd1508-b2f2-4898-bd72-af1f02b7e065 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:43.987872 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c4bd1508-b2f2-4898-bd72-af1f02b7e065 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:44.001364 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd1508-b2f2-4898-bd72-af1f02b7e065 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:44.003366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd1508-b2f2-4898-bd72-af1f02b7e065 service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:44.015895 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2019/4032] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:15:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:15:44.067765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-940e4865-af13-48da-8457-4546b47fc564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e20420801fe47419f0f76efa7050111', 'request_id': 'req-940e4865-af13-48da-8457-4546b47fc564'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:44.085933 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-940e4865-af13-48da-8457-4546b47fc564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e20420801fe47419f0f76efa7050111', 'request_id': 'req-940e4865-af13-48da-8457-4546b47fc564'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:44.090632 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:44.109074 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-940e4865-af13-48da-8457-4546b47fc564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e20420801fe47419f0f76efa7050111', 'request_id': 'req-940e4865-af13-48da-8457-4546b47fc564'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:44.132116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-940e4865-af13-48da-8457-4546b47fc564 admin admin] The token cache is being invalidate because project 9e20420801fe47419f0f76efa7050111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:15:44.132521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-940e4865-af13-48da-8457-4546b47fc564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:44.133972 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-940e4865-af13-48da-8457-4546b47fc564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:44.148074 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2014/4033] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:15:43 2022] DELETE /identity/v3/projects/9e20420801fe47419f0f76efa7050111 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:44.151249 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d128492-b288-4471-86e8-73c541cfbc70 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:44.152535 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d128492-b288-4471-86e8-73c541cfbc70 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:44.153331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d128492-b288-4471-86e8-73c541cfbc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:44.190610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95063324-8cb9-46de-a806-08d8d440a946 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:44.191788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95063324-8cb9-46de-a806-08d8d440a946 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:44.192183 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95063324-8cb9-46de-a806-08d8d440a946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:44.221698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-3d128492-b288-4471-86e8-73c541cfbc70 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:44.223634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3d128492-b288-4471-86e8-73c541cfbc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:44.234980 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-95063324-8cb9-46de-a806-08d8d440a946 None None] MFA Rules not processed for user `5581a720105c400f8bee8ef53813288b`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:44.238049 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-95063324-8cb9-46de-a806-08d8d440a946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:44.379688 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2015/4034] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:44.408469 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2020/4035] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:44.410623 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d7adc-8ac1-44d1-93c3-1737a5606986 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:44.410972 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d7adc-8ac1-44d1-93c3-1737a5606986 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:44.411347 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d7adc-8ac1-44d1-93c3-1737a5606986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:44.489390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-250d7adc-8ac1-44d1-93c3-1737a5606986 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:44.490895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-250d7adc-8ac1-44d1-93c3-1737a5606986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:44.512672 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2016/4036] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:44.516920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d128492-b288-4471-86e8-73c541cfbc70 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:44.544293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d128492-b288-4471-86e8-73c541cfbc70 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:44.559310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841695f-4d47-483b-b760-809887b0b543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:44.559942 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841695f-4d47-483b-b760-809887b0b543 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:44.560363 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841695f-4d47-483b-b760-809887b0b543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:44.560645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841695f-4d47-483b-b760-809887b0b543 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:44.561310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841695f-4d47-483b-b760-809887b0b543 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:15:44.561649 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841695f-4d47-483b-b760-809887b0b543 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:44.566702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841695f-4d47-483b-b760-809887b0b543 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:44.606261 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2021/4037] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:15:44.607679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d7adc-8ac1-44d1-93c3-1737a5606986 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:44.627738 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d7adc-8ac1-44d1-93c3-1737a5606986 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:44.641349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4790f3-de31-4e15-94fc-e6c253292fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:44.643449 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4790f3-de31-4e15-94fc-e6c253292fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:44.644873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4790f3-de31-4e15-94fc-e6c253292fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:44.647335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4790f3-de31-4e15-94fc-e6c253292fc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:44.648228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4790f3-de31-4e15-94fc-e6c253292fc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:44.651977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4790f3-de31-4e15-94fc-e6c253292fc4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:44.713289 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2017/4038] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:15:44 2022] POST /identity/v3/projects => generated 369 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:44.717422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841695f-4d47-483b-b760-809887b0b543 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:44.733009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841695f-4d47-483b-b760-809887b0b543 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:44.845685 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:44.879492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23ac92-56f5-4370-bb2a-396d6fbe3c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:44.880464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23ac92-56f5-4370-bb2a-396d6fbe3c95 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:44.881094 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23ac92-56f5-4370-bb2a-396d6fbe3c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:44.881606 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23ac92-56f5-4370-bb2a-396d6fbe3c95 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:44.882940 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23ac92-56f5-4370-bb2a-396d6fbe3c95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:44.885152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23ac92-56f5-4370-bb2a-396d6fbe3c95 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:44.922573 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2022/4039] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:15:44 2022] POST /identity/v3/users => generated 285 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:44.926504 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4790f3-de31-4e15-94fc-e6c253292fc4 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:44.939513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4790f3-de31-4e15-94fc-e6c253292fc4 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:44.948761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc832e4f-6ec3-41c1-b0aa-782722c0549b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:44.950071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc832e4f-6ec3-41c1-b0aa-782722c0549b admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:44.950631 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc832e4f-6ec3-41c1-b0aa-782722c0549b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:44.951150 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc832e4f-6ec3-41c1-b0aa-782722c0549b admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:44.952196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc832e4f-6ec3-41c1-b0aa-782722c0549b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:44.956296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc832e4f-6ec3-41c1-b0aa-782722c0549b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:44.970781 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2018/4040] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:15:44.974666 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23ac92-56f5-4370-bb2a-396d6fbe3c95 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:44.985402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23ac92-56f5-4370-bb2a-396d6fbe3c95 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:44.991216 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5421d755-514c-43da-8d24-a162444b9b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:44.991824 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5421d755-514c-43da-8d24-a162444b9b8e admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:44.992101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5421d755-514c-43da-8d24-a162444b9b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:44.992370 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5421d755-514c-43da-8d24-a162444b9b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:44.993140 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5421d755-514c-43da-8d24-a162444b9b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:44.994782 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5421d755-514c-43da-8d24-a162444b9b8e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:45.007779 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2023/4041] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:15:45.011901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc832e4f-6ec3-41c1-b0aa-782722c0549b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:45.024348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc832e4f-6ec3-41c1-b0aa-782722c0549b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:45.030056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6641ce7a-494b-4ddd-924e-c2102d711481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:45.031072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641ce7a-494b-4ddd-924e-c2102d711481 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:45.031470 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641ce7a-494b-4ddd-924e-c2102d711481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:45.031835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641ce7a-494b-4ddd-924e-c2102d711481 admin admin] PATH_INFO: `/v3/projects/7fda67accabd4aa79e9ae99a10f6f893/users/03503e57f9a54422b45cecdb45bbeb19/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:45.052278 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5421d755-514c-43da-8d24-a162444b9b8e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:45.054306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5421d755-514c-43da-8d24-a162444b9b8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:45.072890 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6641ce7a-494b-4ddd-924e-c2102d711481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fda67accabd4aa79e9ae99a10f6f893, user_id=03503e57f9a54422b45cecdb45bbeb19, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:45.077405 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6641ce7a-494b-4ddd-924e-c2102d711481 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:45.118573 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2019/4042] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:15:45 2022] PUT /identity/v3/projects/7fda67accabd4aa79e9ae99a10f6f893/users/03503e57f9a54422b45cecdb45bbeb19/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:15:45.128032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6641ce7a-494b-4ddd-924e-c2102d711481 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:45.137671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6641ce7a-494b-4ddd-924e-c2102d711481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:45.221822 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5421d755-514c-43da-8d24-a162444b9b8e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:45.292747 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6641ce7a-494b-4ddd-924e-c2102d711481 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:45.306395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455eef4-198d-40b1-ae80-15372982e6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:45.307209 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455eef4-198d-40b1-ae80-15372982e6d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:45.307494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455eef4-198d-40b1-ae80-15372982e6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:45.307772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455eef4-198d-40b1-ae80-15372982e6d0 admin admin] PATH_INFO: `/v3/users/5d072ddf52b9403eb9188d3f95bf9581` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:45.308929 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455eef4-198d-40b1-ae80-15372982e6d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d072ddf52b9403eb9188d3f95bf9581)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:45.311027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455eef4-198d-40b1-ae80-15372982e6d0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:45.359996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353cce9-82f6-47fb-bf15-3fee3a4a970f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:45.360760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353cce9-82f6-47fb-bf15-3fee3a4a970f service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:45.361140 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353cce9-82f6-47fb-bf15-3fee3a4a970f service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:45.361543 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353cce9-82f6-47fb-bf15-3fee3a4a970f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:45.366018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d353cce9-82f6-47fb-bf15-3fee3a4a970f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:45.383306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d353cce9-82f6-47fb-bf15-3fee3a4a970f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:45.385163 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:45.385749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d353cce9-82f6-47fb-bf15-3fee3a4a970f service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:45.403792 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2024/4043] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:15:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:15:45.406239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb79a6-f855-4246-9f0a-067b5afa5db8 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:45.406780 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb79a6-f855-4246-9f0a-067b5afa5db8 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:45.407282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb79a6-f855-4246-9f0a-067b5afa5db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:45.424072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f455eef4-198d-40b1-ae80-15372982e6d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d072ddf52b9403eb9188d3f95bf9581'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:45.426276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f455eef4-198d-40b1-ae80-15372982e6d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d072ddf52b9403eb9188d3f95bf9581'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:45.452415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f455eef4-198d-40b1-ae80-15372982e6d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d072ddf52b9403eb9188d3f95bf9581'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:45.480209 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f455eef4-198d-40b1-ae80-15372982e6d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d072ddf52b9403eb9188d3f95bf9581'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:45.481042 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f455eef4-198d-40b1-ae80-15372982e6d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d072ddf52b9403eb9188d3f95bf9581'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:45.499110 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-3fbb79a6-f855-4246-9f0a-067b5afa5db8 None None] MFA Rules not processed for user `03503e57f9a54422b45cecdb45bbeb19`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:45.501092 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3fbb79a6-f855-4246-9f0a-067b5afa5db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:45.525755 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2020/4044] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:15:45 2022] DELETE /identity/v3/users/5d072ddf52b9403eb9188d3f95bf9581 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:45.575381 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:45.641392 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2025/4045] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:45.642698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455eef4-198d-40b1-ae80-15372982e6d0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:45.734977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455eef4-198d-40b1-ae80-15372982e6d0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:45.741276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa9ba4-a41f-461b-927c-3767bce610ef tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03503e57f9a54422b45cecdb45bbeb19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fda67accabd4aa79e9ae99a10f6f893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:45.741637 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa9ba4-a41f-461b-927c-3767bce610ef tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:45.741970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa9ba4-a41f-461b-927c-3767bce610ef tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:45.742349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa9ba4-a41f-461b-927c-3767bce610ef tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] PATH_INFO: `/v3/users/03503e57f9a54422b45cecdb45bbeb19/application_credentials` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:45.743041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa9ba4-a41f-461b-927c-3767bce610ef tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] RBAC: Authorizing `identity:create_application_credential(user_id=03503e57f9a54422b45cecdb45bbeb19)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:45.744776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa9ba4-a41f-461b-927c-3767bce610ef tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:45.881841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb79a6-f855-4246-9f0a-067b5afa5db8 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:45.882452 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2021/4046] 10.222.0.30 () {60 vars in 1315 bytes} [Sun Sep 4 01:15:45 2022] POST /identity/v3/users/03503e57f9a54422b45cecdb45bbeb19/application_credentials => generated 918 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:45.892430 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb79a6-f855-4246-9f0a-067b5afa5db8 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:45.904702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e623a0a-23bc-477a-b897-37fbe1207bd2 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03503e57f9a54422b45cecdb45bbeb19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fda67accabd4aa79e9ae99a10f6f893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:45.905369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e623a0a-23bc-477a-b897-37fbe1207bd2 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:45.905680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e623a0a-23bc-477a-b897-37fbe1207bd2 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:45.906105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e623a0a-23bc-477a-b897-37fbe1207bd2 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] PATH_INFO: `/v3/users/03503e57f9a54422b45cecdb45bbeb19/access_rules/2afc5e72399344709fb3863a100024b8` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:45.911425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e623a0a-23bc-477a-b897-37fbe1207bd2 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] RBAC: Authorizing `identity:delete_access_rule(user_id=03503e57f9a54422b45cecdb45bbeb19, access_rule_id=2afc5e72399344709fb3863a100024b8)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:45.918365 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa9ba4-a41f-461b-927c-3767bce610ef tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:45.920286 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1faa9ba4-a41f-461b-927c-3767bce610ef tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:45.920510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e623a0a-23bc-477a-b897-37fbe1207bd2 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:45.996840 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:46.025378 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-6e623a0a-23bc-477a-b897-37fbe1207bd2 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Sep 04 01:15:46.025378 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:15:46.025378 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Sep 04 01:15:46.025378 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application session.delete(ref) Sep 04 01:15:46.025378 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 04 01:15:46.025378 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application next(self.gen) Sep 04 01:15:46.025378 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 04 01:15:46.025378 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application yield resource Sep 04 01:15:46.025378 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 04 01:15:46.025378 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application next(self.gen) Sep 04 01:15:46.025378 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 04 01:15:46.025378 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self.session.rollback() Sep 04 01:15:46.025378 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 04 01:15:46.025378 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self.force_reraise() Sep 04 01:15:46.025378 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 04 01:15:46.025378 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise self.value Sep 04 01:15:46.027093 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 04 01:15:46.027093 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 04 01:15:46.027093 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 04 01:15:46.027093 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application session.commit() Sep 04 01:15:46.027093 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 04 01:15:46.027093 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 04 01:15:46.027093 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 04 01:15:46.027093 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._prepare_impl() Sep 04 01:15:46.027093 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 04 01:15:46.027093 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self.session.flush() Sep 04 01:15:46.027093 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 04 01:15:46.027093 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._flush(objects) Sep 04 01:15:46.027093 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 04 01:15:46.027093 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 04 01:15:46.027093 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 04 01:15:46.027093 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application compat.raise_( Sep 04 01:15:46.028569 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 04 01:15:46.028569 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception Sep 04 01:15:46.028569 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 04 01:15:46.028569 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application flush_context.execute() Sep 04 01:15:46.028569 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 04 01:15:46.028569 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rec.execute(self) Sep 04 01:15:46.028569 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Sep 04 01:15:46.028569 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Sep 04 01:15:46.028569 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Sep 04 01:15:46.028569 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._synchronize( Sep 04 01:15:46.028569 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Sep 04 01:15:46.028569 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Sep 04 01:15:46.028569 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Sep 04 01:15:46.028569 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise AssertionError( Sep 04 01:15:46.028569 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Sep 04 01:15:46.028569 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:15:46.030005 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:15:46.030005 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:15:46.030005 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:15:46.030005 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:15:46.030005 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:15:46.030005 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:15:46.030005 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:15:46.030005 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:15:46.030005 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:15:46.030005 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:15:46.030005 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:15:46.030005 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:15:46.030005 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:15:46.030005 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Sep 04 01:15:46.030005 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Sep 04 01:15:46.030005 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:15:46.030005 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:15:46.031419 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Sep 04 01:15:46.031419 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Sep 04 01:15:46.031419 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Sep 04 01:15:46.031419 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Sep 04 01:15:46.031419 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Sep 04 01:15:46.031419 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:15:46.031419 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2026/4047] 10.222.0.30 () {58 vars in 1362 bytes} [Sun Sep 4 01:15:45 2022] DELETE /identity/v3/users/03503e57f9a54422b45cecdb45bbeb19/access_rules/2afc5e72399344709fb3863a100024b8 => generated 89 bytes in 149 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Sep 04 01:15:46.032930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e623a0a-23bc-477a-b897-37fbe1207bd2 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:46.047277 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e623a0a-23bc-477a-b897-37fbe1207bd2 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:46.058078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b6170-fc0a-4317-9c3a-97a2ac9e79d5 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03503e57f9a54422b45cecdb45bbeb19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fda67accabd4aa79e9ae99a10f6f893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:46.058733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b6170-fc0a-4317-9c3a-97a2ac9e79d5 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:46.059015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b6170-fc0a-4317-9c3a-97a2ac9e79d5 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:46.059290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b6170-fc0a-4317-9c3a-97a2ac9e79d5 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] PATH_INFO: `/v3/users/03503e57f9a54422b45cecdb45bbeb19/application_credentials/e5f4899bb90f4a648a5a44c7d225dc29` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:46.060373 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa9ba4-a41f-461b-927c-3767bce610ef tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:46.073204 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f57338-3c2c-4ba1-9a0b-2f3161598e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:46.073993 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f57338-3c2c-4ba1-9a0b-2f3161598e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:46.074403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f57338-3c2c-4ba1-9a0b-2f3161598e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:46.074688 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f57338-3c2c-4ba1-9a0b-2f3161598e84 admin admin] PATH_INFO: `/v3/users/fa6708d6eb5e4df58dec6b88c9968fd0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:46.077561 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f57338-3c2c-4ba1-9a0b-2f3161598e84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa6708d6eb5e4df58dec6b88c9968fd0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:46.079902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f57338-3c2c-4ba1-9a0b-2f3161598e84 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:46.102912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b6170-fc0a-4317-9c3a-97a2ac9e79d5 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] RBAC: Authorizing `identity:delete_application_credential(user_id=03503e57f9a54422b45cecdb45bbeb19, application_credential_id=e5f4899bb90f4a648a5a44c7d225dc29)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:46.104455 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b6170-fc0a-4317-9c3a-97a2ac9e79d5 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:46.163648 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2027/4048] 10.222.0.30 () {58 vars in 1395 bytes} [Sun Sep 4 01:15:46 2022] DELETE /identity/v3/users/03503e57f9a54422b45cecdb45bbeb19/application_credentials/e5f4899bb90f4a648a5a44c7d225dc29 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:15:46.171740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b6170-fc0a-4317-9c3a-97a2ac9e79d5 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:46.215113 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b6170-fc0a-4317-9c3a-97a2ac9e79d5 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:46.218668 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-70f57338-3c2c-4ba1-9a0b-2f3161598e84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa6708d6eb5e4df58dec6b88c9968fd0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:46.219434 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-70f57338-3c2c-4ba1-9a0b-2f3161598e84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa6708d6eb5e4df58dec6b88c9968fd0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:46.225835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9442e21-132e-4fb6-aa71-3cd198270464 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03503e57f9a54422b45cecdb45bbeb19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fda67accabd4aa79e9ae99a10f6f893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:46.226569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9442e21-132e-4fb6-aa71-3cd198270464 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:46.226879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9442e21-132e-4fb6-aa71-3cd198270464 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:46.227243 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9442e21-132e-4fb6-aa71-3cd198270464 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] PATH_INFO: `/v3/users/03503e57f9a54422b45cecdb45bbeb19/access_rules` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:46.228547 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9442e21-132e-4fb6-aa71-3cd198270464 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] RBAC: Authorizing `identity:list_access_rules(user_id=03503e57f9a54422b45cecdb45bbeb19)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:46.229105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-70f57338-3c2c-4ba1-9a0b-2f3161598e84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa6708d6eb5e4df58dec6b88c9968fd0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:46.230176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9442e21-132e-4fb6-aa71-3cd198270464 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:46.237474 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2028/4049] 10.222.0.30 () {58 vars in 1260 bytes} [Sun Sep 4 01:15:46 2022] GET /identity/v3/users/03503e57f9a54422b45cecdb45bbeb19/access_rules => generated 369 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:15:46.241521 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9442e21-132e-4fb6-aa71-3cd198270464 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:46.242081 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-70f57338-3c2c-4ba1-9a0b-2f3161598e84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa6708d6eb5e4df58dec6b88c9968fd0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:46.242970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-70f57338-3c2c-4ba1-9a0b-2f3161598e84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa6708d6eb5e4df58dec6b88c9968fd0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:46.244454 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e9442e21-132e-4fb6-aa71-3cd198270464 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:46.266548 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9442e21-132e-4fb6-aa71-3cd198270464 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:46.275433 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368cbe23-c51f-4b79-9882-d18a20e98739 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03503e57f9a54422b45cecdb45bbeb19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fda67accabd4aa79e9ae99a10f6f893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:46.276101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cbe23-c51f-4b79-9882-d18a20e98739 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:46.276386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cbe23-c51f-4b79-9882-d18a20e98739 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:46.276665 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cbe23-c51f-4b79-9882-d18a20e98739 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] PATH_INFO: `/v3/users/03503e57f9a54422b45cecdb45bbeb19/access_rules/2afc5e72399344709fb3863a100024b8` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:46.277870 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368cbe23-c51f-4b79-9882-d18a20e98739 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] RBAC: Authorizing `identity:delete_access_rule(user_id=03503e57f9a54422b45cecdb45bbeb19, access_rule_id=2afc5e72399344709fb3863a100024b8)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:46.279255 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368cbe23-c51f-4b79-9882-d18a20e98739 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:46.304850 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2022/4050] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:15:45 2022] DELETE /identity/v3/users/fa6708d6eb5e4df58dec6b88c9968fd0 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:46.310800 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2029/4051] 10.222.0.30 () {58 vars in 1362 bytes} [Sun Sep 4 01:15:46 2022] DELETE /identity/v3/users/03503e57f9a54422b45cecdb45bbeb19/access_rules/2afc5e72399344709fb3863a100024b8 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:46.315234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368cbe23-c51f-4b79-9882-d18a20e98739 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:46.319925 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f57338-3c2c-4ba1-9a0b-2f3161598e84 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:46.331207 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-70f57338-3c2c-4ba1-9a0b-2f3161598e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:46.348061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368cbe23-c51f-4b79-9882-d18a20e98739 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:46.444624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a92253-0da5-4fa3-b2ce-682fb7150a77 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03503e57f9a54422b45cecdb45bbeb19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fda67accabd4aa79e9ae99a10f6f893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:46.445413 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a92253-0da5-4fa3-b2ce-682fb7150a77 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:46.445828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a92253-0da5-4fa3-b2ce-682fb7150a77 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:46.446171 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a92253-0da5-4fa3-b2ce-682fb7150a77 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] PATH_INFO: `/v3/users/03503e57f9a54422b45cecdb45bbeb19/access_rules` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:46.452822 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a92253-0da5-4fa3-b2ce-682fb7150a77 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] RBAC: Authorizing `identity:list_access_rules(user_id=03503e57f9a54422b45cecdb45bbeb19)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:46.452822 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a92253-0da5-4fa3-b2ce-682fb7150a77 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:46.461004 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2030/4052] 10.222.0.30 () {58 vars in 1260 bytes} [Sun Sep 4 01:15:46 2022] GET /identity/v3/users/03503e57f9a54422b45cecdb45bbeb19/access_rules => generated 158 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:15:46.462034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a92253-0da5-4fa3-b2ce-682fb7150a77 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:46.473634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a92253-0da5-4fa3-b2ce-682fb7150a77 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:46.479506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e08cab-fff7-4806-b8c9-63987fb3cfa7 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03503e57f9a54422b45cecdb45bbeb19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fda67accabd4aa79e9ae99a10f6f893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:46.480335 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e08cab-fff7-4806-b8c9-63987fb3cfa7 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:46.480726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e08cab-fff7-4806-b8c9-63987fb3cfa7 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:46.481103 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e08cab-fff7-4806-b8c9-63987fb3cfa7 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] PATH_INFO: `/v3/users/03503e57f9a54422b45cecdb45bbeb19/application_credentials` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:46.482418 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e08cab-fff7-4806-b8c9-63987fb3cfa7 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] RBAC: Authorizing `identity:create_application_credential(user_id=03503e57f9a54422b45cecdb45bbeb19)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:46.483948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e08cab-fff7-4806-b8c9-63987fb3cfa7 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:46.510633 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f57338-3c2c-4ba1-9a0b-2f3161598e84 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:46.523864 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4dd37-fe7c-4dfb-949c-b6ac52fa2d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:46.524626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4dd37-fe7c-4dfb-949c-b6ac52fa2d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:46.524913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4dd37-fe7c-4dfb-949c-b6ac52fa2d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:46.525327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4dd37-fe7c-4dfb-949c-b6ac52fa2d0a admin admin] PATH_INFO: `/v3/projects/132b86c03e6f48b2a6fe59bb6b6df842` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:46.526544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a4dd37-fe7c-4dfb-949c-b6ac52fa2d0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=132b86c03e6f48b2a6fe59bb6b6df842)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:46.528481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a4dd37-fe7c-4dfb-949c-b6ac52fa2d0a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:46.590643 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2031/4053] 10.222.0.30 () {60 vars in 1315 bytes} [Sun Sep 4 01:15:46 2022] POST /identity/v3/users/03503e57f9a54422b45cecdb45bbeb19/application_credentials => generated 920 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:46.591646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e08cab-fff7-4806-b8c9-63987fb3cfa7 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:46.593770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e3e08cab-fff7-4806-b8c9-63987fb3cfa7 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:46.605830 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:46.612715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e08cab-fff7-4806-b8c9-63987fb3cfa7 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:46.634966 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a9a4dd37-fe7c-4dfb-949c-b6ac52fa2d0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '132b86c03e6f48b2a6fe59bb6b6df842', 'request_id': 'req-a9a4dd37-fe7c-4dfb-949c-b6ac52fa2d0a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:46.645585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a9a4dd37-fe7c-4dfb-949c-b6ac52fa2d0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '132b86c03e6f48b2a6fe59bb6b6df842', 'request_id': 'req-a9a4dd37-fe7c-4dfb-949c-b6ac52fa2d0a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:46.653369 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:46.654723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a9a4dd37-fe7c-4dfb-949c-b6ac52fa2d0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '132b86c03e6f48b2a6fe59bb6b6df842', 'request_id': 'req-a9a4dd37-fe7c-4dfb-949c-b6ac52fa2d0a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:46.670822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a9a4dd37-fe7c-4dfb-949c-b6ac52fa2d0a admin admin] The token cache is being invalidate because project 132b86c03e6f48b2a6fe59bb6b6df842 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:15:46.671239 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a9a4dd37-fe7c-4dfb-949c-b6ac52fa2d0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:46.672359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a9a4dd37-fe7c-4dfb-949c-b6ac52fa2d0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:46.674478 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2023/4054] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:15:46 2022] DELETE /identity/v3/projects/132b86c03e6f48b2a6fe59bb6b6df842 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:46.675263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4dd37-fe7c-4dfb-949c-b6ac52fa2d0a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:46.676858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a9a4dd37-fe7c-4dfb-949c-b6ac52fa2d0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:46.721629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2c497-cb9f-47e8-bedf-89751e3b7018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:46.722905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2c497-cb9f-47e8-bedf-89751e3b7018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:46.723262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2c497-cb9f-47e8-bedf-89751e3b7018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:46.723628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2c497-cb9f-47e8-bedf-89751e3b7018 admin admin] PATH_INFO: `/v3/projects/1b5081c2462f4de2aecf108561908a31` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:46.726284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd2c497-cb9f-47e8-bedf-89751e3b7018 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b5081c2462f4de2aecf108561908a31)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:46.729040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd2c497-cb9f-47e8-bedf-89751e3b7018 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:46.768092 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4dd37-fe7c-4dfb-949c-b6ac52fa2d0a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:46.773349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813da48-92f0-4c73-8b96-7f5594c2d691 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03503e57f9a54422b45cecdb45bbeb19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fda67accabd4aa79e9ae99a10f6f893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:46.774098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813da48-92f0-4c73-8b96-7f5594c2d691 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:46.774506 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813da48-92f0-4c73-8b96-7f5594c2d691 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:46.774851 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813da48-92f0-4c73-8b96-7f5594c2d691 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] PATH_INFO: `/v3/users/03503e57f9a54422b45cecdb45bbeb19/access_rules` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:46.776244 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813da48-92f0-4c73-8b96-7f5594c2d691 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] RBAC: Authorizing `identity:list_access_rules(user_id=03503e57f9a54422b45cecdb45bbeb19)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:46.777846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813da48-92f0-4c73-8b96-7f5594c2d691 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:46.785991 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2024/4055] 10.222.0.30 () {58 vars in 1260 bytes} [Sun Sep 4 01:15:46 2022] GET /identity/v3/users/03503e57f9a54422b45cecdb45bbeb19/access_rules => generated 369 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:15:46.785991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c58490-6be5-40cb-b59b-54df168422a3 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:46.785991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c58490-6be5-40cb-b59b-54df168422a3 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:46.785991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c58490-6be5-40cb-b59b-54df168422a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:46.808928 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9dd2c497-cb9f-47e8-bedf-89751e3b7018 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b5081c2462f4de2aecf108561908a31', 'request_id': 'req-9dd2c497-cb9f-47e8-bedf-89751e3b7018'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:46.815205 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-21c58490-6be5-40cb-b59b-54df168422a3 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:46.816907 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-21c58490-6be5-40cb-b59b-54df168422a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:46.820093 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9dd2c497-cb9f-47e8-bedf-89751e3b7018 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b5081c2462f4de2aecf108561908a31', 'request_id': 'req-9dd2c497-cb9f-47e8-bedf-89751e3b7018'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:46.827974 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9dd2c497-cb9f-47e8-bedf-89751e3b7018 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b5081c2462f4de2aecf108561908a31', 'request_id': 'req-9dd2c497-cb9f-47e8-bedf-89751e3b7018'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:46.842069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9dd2c497-cb9f-47e8-bedf-89751e3b7018 admin admin] The token cache is being invalidate because project 1b5081c2462f4de2aecf108561908a31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:15:46.842516 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9dd2c497-cb9f-47e8-bedf-89751e3b7018 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:46.843216 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9dd2c497-cb9f-47e8-bedf-89751e3b7018 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:46.845422 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2032/4056] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:15:46 2022] DELETE /identity/v3/projects/1b5081c2462f4de2aecf108561908a31 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:46.850427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2c497-cb9f-47e8-bedf-89751e3b7018 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:46.852038 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9dd2c497-cb9f-47e8-bedf-89751e3b7018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:46.932190 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2025/4057] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:46.934714 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ca877-2dc5-495e-8db9-d55a541ce063 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:46.934947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ca877-2dc5-495e-8db9-d55a541ce063 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:46.935230 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ca877-2dc5-495e-8db9-d55a541ce063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:46.939169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2c497-cb9f-47e8-bedf-89751e3b7018 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:46.946108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd0b8c-e4b5-4069-8106-ac406e0cd389 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03503e57f9a54422b45cecdb45bbeb19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fda67accabd4aa79e9ae99a10f6f893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:46.946875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd0b8c-e4b5-4069-8106-ac406e0cd389 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:46.947224 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd0b8c-e4b5-4069-8106-ac406e0cd389 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:46.947580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd0b8c-e4b5-4069-8106-ac406e0cd389 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] PATH_INFO: `/v3/users/03503e57f9a54422b45cecdb45bbeb19/application_credentials` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:46.948323 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd0b8c-e4b5-4069-8106-ac406e0cd389 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] RBAC: Authorizing `identity:create_application_credential(user_id=03503e57f9a54422b45cecdb45bbeb19)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:46.949593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd0b8c-e4b5-4069-8106-ac406e0cd389 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:46.962940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-0e9ca877-2dc5-495e-8db9-d55a541ce063 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:46.964180 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0e9ca877-2dc5-495e-8db9-d55a541ce063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:46.973101 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2026/4058] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:46.980445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade3fa6-977a-463b-983f-b4477a591fe3 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:46.980445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade3fa6-977a-463b-983f-b4477a591fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:46.980445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade3fa6-977a-463b-983f-b4477a591fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:47.003010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-2ade3fa6-977a-463b-983f-b4477a591fe3 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:47.004937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2ade3fa6-977a-463b-983f-b4477a591fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:47.015440 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:47.017478 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2027/4059] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:47.019022 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5157fb2-80d0-4a20-8f2b-ce335638e6ca None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:47.019907 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5157fb2-80d0-4a20-8f2b-ce335638e6ca None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:47.020304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5157fb2-80d0-4a20-8f2b-ce335638e6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:47.043153 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c5157fb2-80d0-4a20-8f2b-ce335638e6ca None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:47.044923 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c5157fb2-80d0-4a20-8f2b-ce335638e6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:47.055051 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2028/4060] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:47.055919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5157fb2-80d0-4a20-8f2b-ce335638e6ca None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:47.066571 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2033/4061] 10.222.0.30 () {60 vars in 1315 bytes} [Sun Sep 4 01:15:46 2022] POST /identity/v3/users/03503e57f9a54422b45cecdb45bbeb19/application_credentials => generated 921 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:47.068499 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd0b8c-e4b5-4069-8106-ac406e0cd389 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:47.079395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5157fb2-80d0-4a20-8f2b-ce335638e6ca None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:47.098555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd0b8c-e4b5-4069-8106-ac406e0cd389 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:47.101185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db19431-a16e-4256-be55-82902db137e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:47.101958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db19431-a16e-4256-be55-82902db137e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:47.102240 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db19431-a16e-4256-be55-82902db137e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:47.102512 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db19431-a16e-4256-be55-82902db137e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:47.103171 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db19431-a16e-4256-be55-82902db137e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:15:47.103478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db19431-a16e-4256-be55-82902db137e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:47.103650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b2842-0cd6-484e-bcab-3cd9c86d08e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:47.104238 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b2842-0cd6-484e-bcab-3cd9c86d08e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:47.104519 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b2842-0cd6-484e-bcab-3cd9c86d08e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:47.104791 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b2842-0cd6-484e-bcab-3cd9c86d08e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:47.105176 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db19431-a16e-4256-be55-82902db137e1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:47.105426 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b2842-0cd6-484e-bcab-3cd9c86d08e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:15:47.105759 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b2842-0cd6-484e-bcab-3cd9c86d08e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:47.107327 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b2842-0cd6-484e-bcab-3cd9c86d08e7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:47.121607 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2029/4062] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:15:47.121607 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db19431-a16e-4256-be55-82902db137e1 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:47.123182 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2034/4063] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:15:47.127168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b2842-0cd6-484e-bcab-3cd9c86d08e7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:47.135195 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db19431-a16e-4256-be55-82902db137e1 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:47.139588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b2842-0cd6-484e-bcab-3cd9c86d08e7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:47.139850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8535f-2803-4d3d-956f-1f42382e1669 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03503e57f9a54422b45cecdb45bbeb19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fda67accabd4aa79e9ae99a10f6f893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:47.140481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8535f-2803-4d3d-956f-1f42382e1669 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:47.140765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8535f-2803-4d3d-956f-1f42382e1669 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:47.141037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8535f-2803-4d3d-956f-1f42382e1669 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] PATH_INFO: `/v3/users/03503e57f9a54422b45cecdb45bbeb19/access_rules/9f7277b51e1e4f1ea145ed68c27e7f26` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:47.142686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8535f-2803-4d3d-956f-1f42382e1669 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] RBAC: Authorizing `identity:get_access_rule(user_id=03503e57f9a54422b45cecdb45bbeb19, access_rule_id=9f7277b51e1e4f1ea145ed68c27e7f26)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:47.144780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8535f-2803-4d3d-956f-1f42382e1669 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:47.145839 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555d08e-4bc7-48fa-9084-f3cb455bb340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:47.146439 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555d08e-4bc7-48fa-9084-f3cb455bb340 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:47.146720 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555d08e-4bc7-48fa-9084-f3cb455bb340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:47.146991 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555d08e-4bc7-48fa-9084-f3cb455bb340 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:47.147618 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555d08e-4bc7-48fa-9084-f3cb455bb340 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:47.149535 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555d08e-4bc7-48fa-9084-f3cb455bb340 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:47.151594 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2030/4064] 10.222.0.30 () {58 vars in 1359 bytes} [Sun Sep 4 01:15:47 2022] GET /identity/v3/users/03503e57f9a54422b45cecdb45bbeb19/access_rules/9f7277b51e1e4f1ea145ed68c27e7f26 => generated 229 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:15:47.152529 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8535f-2803-4d3d-956f-1f42382e1669 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:47.167180 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8535f-2803-4d3d-956f-1f42382e1669 tempest-AccessRulesV3Test-311901825 tempest-AccessRulesV3Test-311901825-project] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:47.172719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d922c-94fa-4e72-937a-7d0efd815459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:47.173330 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d922c-94fa-4e72-937a-7d0efd815459 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:47.173764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d922c-94fa-4e72-937a-7d0efd815459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:47.173991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d922c-94fa-4e72-937a-7d0efd815459 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:47.174760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d922c-94fa-4e72-937a-7d0efd815459 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:47.176711 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d922c-94fa-4e72-937a-7d0efd815459 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:47.182937 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2035/4065] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:15:47 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:47.184007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555d08e-4bc7-48fa-9084-f3cb455bb340 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:47.187109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5555d08e-4bc7-48fa-9084-f3cb455bb340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:47.214787 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2031/4066] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:15:47 2022] POST /identity/v3/projects => generated 381 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:47.214787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d922c-94fa-4e72-937a-7d0efd815459 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:47.248729 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:47.266827 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555d08e-4bc7-48fa-9084-f3cb455bb340 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:47.280597 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d922c-94fa-4e72-937a-7d0efd815459 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:47.286059 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660d8a1-57a1-43f5-9c41-48bea03fa3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:47.286625 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660d8a1-57a1-43f5-9c41-48bea03fa3bb admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:47.286908 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660d8a1-57a1-43f5-9c41-48bea03fa3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:47.287316 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660d8a1-57a1-43f5-9c41-48bea03fa3bb admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:47.287965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660d8a1-57a1-43f5-9c41-48bea03fa3bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:47.289995 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660d8a1-57a1-43f5-9c41-48bea03fa3bb admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:47.322032 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2032/4067] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:15:47 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:47.323171 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660d8a1-57a1-43f5-9c41-48bea03fa3bb admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:47.335807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660d8a1-57a1-43f5-9c41-48bea03fa3bb admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:47.341671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b419c-c8dd-4c3c-82a3-98c8a591cb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:47.342315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b419c-c8dd-4c3c-82a3-98c8a591cb79 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:47.342655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b419c-c8dd-4c3c-82a3-98c8a591cb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:47.342863 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b419c-c8dd-4c3c-82a3-98c8a591cb79 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:47.345508 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b419c-c8dd-4c3c-82a3-98c8a591cb79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:47.346928 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb04ad9-6113-4d7c-bc6f-227529d95696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:47.347861 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb04ad9-6113-4d7c-bc6f-227529d95696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:47.348330 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb04ad9-6113-4d7c-bc6f-227529d95696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:47.348499 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b419c-c8dd-4c3c-82a3-98c8a591cb79 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:47.349268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb04ad9-6113-4d7c-bc6f-227529d95696 admin admin] PATH_INFO: `/v3/users/03503e57f9a54422b45cecdb45bbeb19` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:47.350635 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb04ad9-6113-4d7c-bc6f-227529d95696 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03503e57f9a54422b45cecdb45bbeb19)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:47.352563 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb04ad9-6113-4d7c-bc6f-227529d95696 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:47.383134 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2033/4068] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:15:47 2022] POST /identity/v3/users => generated 291 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:47.384013 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b419c-c8dd-4c3c-82a3-98c8a591cb79 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:47.401541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b419c-c8dd-4c3c-82a3-98c8a591cb79 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:47.409495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c85a5-cb16-4779-8fb1-847ff875ce11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:47.410187 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c85a5-cb16-4779-8fb1-847ff875ce11 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:47.410647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c85a5-cb16-4779-8fb1-847ff875ce11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:47.410966 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c85a5-cb16-4779-8fb1-847ff875ce11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:47.412263 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:47.412610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c85a5-cb16-4779-8fb1-847ff875ce11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:47.415305 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c85a5-cb16-4779-8fb1-847ff875ce11 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:47.415880 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9eb04ad9-6113-4d7c-bc6f-227529d95696 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03503e57f9a54422b45cecdb45bbeb19'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:47.418381 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9eb04ad9-6113-4d7c-bc6f-227529d95696 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03503e57f9a54422b45cecdb45bbeb19'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:47.432093 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9eb04ad9-6113-4d7c-bc6f-227529d95696 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03503e57f9a54422b45cecdb45bbeb19'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:47.436704 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2034/4069] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:15:47.437760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c85a5-cb16-4779-8fb1-847ff875ce11 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:47.442860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d97c85a5-cb16-4779-8fb1-847ff875ce11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:47.461616 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c85a5-cb16-4779-8fb1-847ff875ce11 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:47.463969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9eb04ad9-6113-4d7c-bc6f-227529d95696 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03503e57f9a54422b45cecdb45bbeb19'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:47.465088 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9eb04ad9-6113-4d7c-bc6f-227529d95696 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03503e57f9a54422b45cecdb45bbeb19'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:47.468078 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aefc3d8-75ae-419d-a7d2-12a4bca34881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:47.468699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefc3d8-75ae-419d-a7d2-12a4bca34881 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:47.468976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefc3d8-75ae-419d-a7d2-12a4bca34881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:47.469248 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefc3d8-75ae-419d-a7d2-12a4bca34881 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:47.470228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aefc3d8-75ae-419d-a7d2-12a4bca34881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:47.472956 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aefc3d8-75ae-419d-a7d2-12a4bca34881 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:47.501486 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2035/4070] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:15:47.501486 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aefc3d8-75ae-419d-a7d2-12a4bca34881 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:47.504626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3aefc3d8-75ae-419d-a7d2-12a4bca34881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:47.523642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aefc3d8-75ae-419d-a7d2-12a4bca34881 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:47.530603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e67f5c-44f8-40a0-8551-731573a800b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:47.531185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e67f5c-44f8-40a0-8551-731573a800b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:47.531528 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e67f5c-44f8-40a0-8551-731573a800b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:47.531782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e67f5c-44f8-40a0-8551-731573a800b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:47.532602 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e67f5c-44f8-40a0-8551-731573a800b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:47.534301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e67f5c-44f8-40a0-8551-731573a800b8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:47.546032 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2036/4071] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:15:47.547020 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e67f5c-44f8-40a0-8551-731573a800b8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:47.552864 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2036/4072] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:15:47 2022] DELETE /identity/v3/users/03503e57f9a54422b45cecdb45bbeb19 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:47.552864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb04ad9-6113-4d7c-bc6f-227529d95696 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:47.558367 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e67f5c-44f8-40a0-8551-731573a800b8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:47.624849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcbf21e-f574-4388-8c69-e2a633a743d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:47.625566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbf21e-f574-4388-8c69-e2a633a743d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:47.625809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbf21e-f574-4388-8c69-e2a633a743d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:47.626043 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbf21e-f574-4388-8c69-e2a633a743d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:47.626979 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcbf21e-f574-4388-8c69-e2a633a743d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:47.629523 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcbf21e-f574-4388-8c69-e2a633a743d2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:47.632925 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb04ad9-6113-4d7c-bc6f-227529d95696 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:47.644662 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2037/4073] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:15:47.644848 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe095e1-46d5-45b5-82c7-001874db4423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:47.644848 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe095e1-46d5-45b5-82c7-001874db4423 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:47.644848 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe095e1-46d5-45b5-82c7-001874db4423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:47.644848 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe095e1-46d5-45b5-82c7-001874db4423 admin admin] PATH_INFO: `/v3/projects/bfc02324f0254fcca24d67b9eaec420c/users/e2b6385d98754118a9f5c414f1c00988/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:47.645234 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2289b-ecdb-468d-ba79-89c05abcdf45 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:47.645234 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2289b-ecdb-468d-ba79-89c05abcdf45 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:47.645234 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2289b-ecdb-468d-ba79-89c05abcdf45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:47.661074 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe095e1-46d5-45b5-82c7-001874db4423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfc02324f0254fcca24d67b9eaec420c, user_id=e2b6385d98754118a9f5c414f1c00988, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:47.663822 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe095e1-46d5-45b5-82c7-001874db4423 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:47.669458 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-7db2289b-ecdb-468d-ba79-89c05abcdf45 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:47.670785 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7db2289b-ecdb-468d-ba79-89c05abcdf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:47.680116 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2037/4074] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:15:47 2022] PUT /identity/v3/projects/bfc02324f0254fcca24d67b9eaec420c/users/e2b6385d98754118a9f5c414f1c00988/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:47.681295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe095e1-46d5-45b5-82c7-001874db4423 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:47.742345 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2038/4075] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:47.743685 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726ee19-af28-4492-b01b-3fb261f723af None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:47.743971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726ee19-af28-4492-b01b-3fb261f723af None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:47.744248 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726ee19-af28-4492-b01b-3fb261f723af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:47.752400 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe095e1-46d5-45b5-82c7-001874db4423 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:47.765511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80861ee5-7585-4023-ba51-46634ea2a69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:47.767464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80861ee5-7585-4023-ba51-46634ea2a69c admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:47.768171 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80861ee5-7585-4023-ba51-46634ea2a69c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:47.768171 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80861ee5-7585-4023-ba51-46634ea2a69c admin admin] PATH_INFO: `/v3/projects/c810047a72ca40cc988767f42a925105/users/4b1db60cab3d4cda97aebbebd7c2c89f/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:47.791090 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:47.812739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80861ee5-7585-4023-ba51-46634ea2a69c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c810047a72ca40cc988767f42a925105, user_id=4b1db60cab3d4cda97aebbebd7c2c89f, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:47.815508 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80861ee5-7585-4023-ba51-46634ea2a69c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:47.818164 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-7726ee19-af28-4492-b01b-3fb261f723af None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:47.823895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7726ee19-af28-4492-b01b-3fb261f723af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:47.841417 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2039/4076] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:47.843001 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726ee19-af28-4492-b01b-3fb261f723af None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:47.849783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7726ee19-af28-4492-b01b-3fb261f723af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:47.899669 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2038/4077] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:15:47 2022] PUT /identity/v3/projects/c810047a72ca40cc988767f42a925105/users/4b1db60cab3d4cda97aebbebd7c2c89f/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:47.899669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80861ee5-7585-4023-ba51-46634ea2a69c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:47.901339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-80861ee5-7585-4023-ba51-46634ea2a69c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:47.909410 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:47.917402 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726ee19-af28-4492-b01b-3fb261f723af None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:47.989153 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae3778-d204-4363-845c-6c887c00d87e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:47.990029 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae3778-d204-4363-845c-6c887c00d87e service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:47.990376 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae3778-d204-4363-845c-6c887c00d87e service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:47.990709 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae3778-d204-4363-845c-6c887c00d87e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:47.995273 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80861ee5-7585-4023-ba51-46634ea2a69c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:48.000974 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc45c3-26c0-4aea-8349-9ffc1a2ab363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:48.001770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc45c3-26c0-4aea-8349-9ffc1a2ab363 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:48.002135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc45c3-26c0-4aea-8349-9ffc1a2ab363 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:48.002561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc45c3-26c0-4aea-8349-9ffc1a2ab363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:48.077831 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc45c3-26c0-4aea-8349-9ffc1a2ab363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:48.079647 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc45c3-26c0-4aea-8349-9ffc1a2ab363 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:48.091494 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2039/4078] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:15:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:15:48.092904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4dc07e-542b-4386-9b64-86866a49c15b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:48.093555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4dc07e-542b-4386-9b64-86866a49c15b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:48.093932 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4dc07e-542b-4386-9b64-86866a49c15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:48.106187 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae3778-d204-4363-845c-6c887c00d87e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:48.107643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae3778-d204-4363-845c-6c887c00d87e service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:48.117913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-9e4dc07e-542b-4386-9b64-86866a49c15b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:48.119390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9e4dc07e-542b-4386-9b64-86866a49c15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:48.120341 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2040/4079] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:15:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:15:48.131987 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2040/4080] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:48.163308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae3778-d204-4363-845c-6c887c00d87e service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:48.165111 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a3ae3778-d204-4363-845c-6c887c00d87e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:48.185946 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae3778-d204-4363-845c-6c887c00d87e service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:48.199960 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991c9af-fdfa-45d6-be89-3bd4f7ef1125 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:48.203734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991c9af-fdfa-45d6-be89-3bd4f7ef1125 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:48.204300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991c9af-fdfa-45d6-be89-3bd4f7ef1125 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:48.205780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991c9af-fdfa-45d6-be89-3bd4f7ef1125 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:48.229730 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991c9af-fdfa-45d6-be89-3bd4f7ef1125 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:48.231346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991c9af-fdfa-45d6-be89-3bd4f7ef1125 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:48.253782 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2041/4081] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:15:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:15:49.222128 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4dc07e-542b-4386-9b64-86866a49c15b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:49.224901 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9e4dc07e-542b-4386-9b64-86866a49c15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:49.244345 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4dc07e-542b-4386-9b64-86866a49c15b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:49.249929 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef65bf-2415-4c8c-978f-1588a43d9842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:49.250565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef65bf-2415-4c8c-978f-1588a43d9842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:49.251315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef65bf-2415-4c8c-978f-1588a43d9842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:49.251315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef65bf-2415-4c8c-978f-1588a43d9842 admin admin] PATH_INFO: `/v3/projects/7fda67accabd4aa79e9ae99a10f6f893` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:49.252234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef65bf-2415-4c8c-978f-1588a43d9842 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fda67accabd4aa79e9ae99a10f6f893)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:49.254167 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef65bf-2415-4c8c-978f-1588a43d9842 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:49.309215 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c5ef65bf-2415-4c8c-978f-1588a43d9842 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fda67accabd4aa79e9ae99a10f6f893', 'request_id': 'req-c5ef65bf-2415-4c8c-978f-1588a43d9842'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:49.319613 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c5ef65bf-2415-4c8c-978f-1588a43d9842 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fda67accabd4aa79e9ae99a10f6f893', 'request_id': 'req-c5ef65bf-2415-4c8c-978f-1588a43d9842'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:49.327720 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c5ef65bf-2415-4c8c-978f-1588a43d9842 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fda67accabd4aa79e9ae99a10f6f893', 'request_id': 'req-c5ef65bf-2415-4c8c-978f-1588a43d9842'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:49.344911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c5ef65bf-2415-4c8c-978f-1588a43d9842 admin admin] The token cache is being invalidate because project 7fda67accabd4aa79e9ae99a10f6f893 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:15:49.345239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c5ef65bf-2415-4c8c-978f-1588a43d9842 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:49.346109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c5ef65bf-2415-4c8c-978f-1588a43d9842 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:49.348627 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2041/4082] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:15:49 2022] DELETE /identity/v3/projects/7fda67accabd4aa79e9ae99a10f6f893 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:49.354550 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee2b5b-4762-4afb-979a-bd8cd1ce1cd7 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:49.355089 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee2b5b-4762-4afb-979a-bd8cd1ce1cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:49.355089 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee2b5b-4762-4afb-979a-bd8cd1ce1cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:49.377347 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-08ee2b5b-4762-4afb-979a-bd8cd1ce1cd7 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:49.379484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-08ee2b5b-4762-4afb-979a-bd8cd1ce1cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:49.433826 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:49.463432 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2042/4083] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:49.471397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a90b44-da8b-4c60-afde-c5bc4357c736 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:49.471960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a90b44-da8b-4c60-afde-c5bc4357c736 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:49.472886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a90b44-da8b-4c60-afde-c5bc4357c736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:49.497809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077e3e4-4d6e-4eed-9189-d2e8dd837825 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:49.498563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077e3e4-4d6e-4eed-9189-d2e8dd837825 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:49.498563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077e3e4-4d6e-4eed-9189-d2e8dd837825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:49.522129 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e7a90b44-da8b-4c60-afde-c5bc4357c736 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:49.523701 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e7a90b44-da8b-4c60-afde-c5bc4357c736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:49.545202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-3077e3e4-4d6e-4eed-9189-d2e8dd837825 None None] MFA Rules not processed for user `e2b6385d98754118a9f5c414f1c00988`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:49.546460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3077e3e4-4d6e-4eed-9189-d2e8dd837825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:49.549534 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2042/4084] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:49.551712 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a90b44-da8b-4c60-afde-c5bc4357c736 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:49.565596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a90b44-da8b-4c60-afde-c5bc4357c736 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:49.573971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42e46c-5859-4961-866c-0ede2ed5121b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:49.574792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42e46c-5859-4961-866c-0ede2ed5121b admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:49.575480 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42e46c-5859-4961-866c-0ede2ed5121b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:49.575767 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42e46c-5859-4961-866c-0ede2ed5121b admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:49.576482 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42e46c-5859-4961-866c-0ede2ed5121b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:15:49.576921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42e46c-5859-4961-866c-0ede2ed5121b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:49.578976 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42e46c-5859-4961-866c-0ede2ed5121b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:49.603879 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2043/4085] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:15:49.604846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42e46c-5859-4961-866c-0ede2ed5121b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:49.632640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42e46c-5859-4961-866c-0ede2ed5121b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:49.638899 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd392721-903f-4267-a2d7-5b3f9fdcae24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:49.639604 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd392721-903f-4267-a2d7-5b3f9fdcae24 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:49.639971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd392721-903f-4267-a2d7-5b3f9fdcae24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:49.640308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd392721-903f-4267-a2d7-5b3f9fdcae24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:49.641016 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd392721-903f-4267-a2d7-5b3f9fdcae24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:49.643246 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd392721-903f-4267-a2d7-5b3f9fdcae24 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:49.665652 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:49.673492 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2043/4086] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:15:49.680308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba6fd3-3143-467d-8bcd-05523f013c39 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:49.680632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba6fd3-3143-467d-8bcd-05523f013c39 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:49.680950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba6fd3-3143-467d-8bcd-05523f013c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:49.707459 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2044/4087] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:15:49 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:49.709811 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd392721-903f-4267-a2d7-5b3f9fdcae24 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:49.714587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-42ba6fd3-3143-467d-8bcd-05523f013c39 None None] MFA Rules not processed for user `e2b6385d98754118a9f5c414f1c00988`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:49.716264 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-42ba6fd3-3143-467d-8bcd-05523f013c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:49.799102 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2044/4088] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:49.815815 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba6fd3-3143-467d-8bcd-05523f013c39 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:49.817378 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-42ba6fd3-3143-467d-8bcd-05523f013c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:49.827741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd392721-903f-4267-a2d7-5b3f9fdcae24 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:49.836149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d38633-5aef-4793-b467-4e98e3cdd010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:49.836887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d38633-5aef-4793-b467-4e98e3cdd010 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:49.837290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d38633-5aef-4793-b467-4e98e3cdd010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:49.837787 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d38633-5aef-4793-b467-4e98e3cdd010 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:49.839003 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d38633-5aef-4793-b467-4e98e3cdd010 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:49.844417 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d38633-5aef-4793-b467-4e98e3cdd010 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:49.892181 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2045/4089] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:15:49 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:49.893310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d38633-5aef-4793-b467-4e98e3cdd010 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:49.919309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d38633-5aef-4793-b467-4e98e3cdd010 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:49.930397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f4526-12a1-478d-812b-02f3c841b96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:49.931244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f4526-12a1-478d-812b-02f3c841b96a admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:49.931626 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f4526-12a1-478d-812b-02f3c841b96a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:49.932052 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f4526-12a1-478d-812b-02f3c841b96a admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:49.932974 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f4526-12a1-478d-812b-02f3c841b96a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:49.935123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f4526-12a1-478d-812b-02f3c841b96a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:49.958697 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2046/4090] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:15:49.961059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f4526-12a1-478d-812b-02f3c841b96a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:49.986381 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f4526-12a1-478d-812b-02f3c841b96a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:49.994339 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba6fd3-3143-467d-8bcd-05523f013c39 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:49.995282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf49339-580c-4e88-ae0c-ae0cd784daad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:49.995906 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf49339-580c-4e88-ae0c-ae0cd784daad admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:49.996185 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf49339-580c-4e88-ae0c-ae0cd784daad admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:49.996455 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf49339-580c-4e88-ae0c-ae0cd784daad admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:49.997098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf49339-580c-4e88-ae0c-ae0cd784daad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:49.999051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf49339-580c-4e88-ae0c-ae0cd784daad admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:50.004164 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885d0bc-bc1d-4120-afdb-70480e3c2df8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:50.004451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885d0bc-bc1d-4120-afdb-70480e3c2df8 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:50.005306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885d0bc-bc1d-4120-afdb-70480e3c2df8 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:50.005731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885d0bc-bc1d-4120-afdb-70480e3c2df8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:50.021081 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2047/4091] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:15:50.025177 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf49339-580c-4e88-ae0c-ae0cd784daad admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:50.037946 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885d0bc-bc1d-4120-afdb-70480e3c2df8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:50.040143 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885d0bc-bc1d-4120-afdb-70480e3c2df8 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:50.061694 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf49339-580c-4e88-ae0c-ae0cd784daad admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:50.072172 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8c5fd-dfed-43b6-b4a9-82a5a0de9dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:50.073046 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8c5fd-dfed-43b6-b4a9-82a5a0de9dbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:50.073182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8c5fd-dfed-43b6-b4a9-82a5a0de9dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:50.073400 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8c5fd-dfed-43b6-b4a9-82a5a0de9dbc admin admin] PATH_INFO: `/v3/projects/88e311c49b5945419059c120499f0dba/users/b64c99aa710047a6a75d7507c9d6aa8e/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:50.073993 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2045/4092] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:15:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:15:50.106694 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8c5fd-dfed-43b6-b4a9-82a5a0de9dbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=88e311c49b5945419059c120499f0dba, user_id=b64c99aa710047a6a75d7507c9d6aa8e, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:50.110019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8c5fd-dfed-43b6-b4a9-82a5a0de9dbc admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:50.133097 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2048/4093] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:15:50 2022] PUT /identity/v3/projects/88e311c49b5945419059c120499f0dba/users/b64c99aa710047a6a75d7507c9d6aa8e/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:50.145897 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1698114-54fe-40be-a669-2272373230ba None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:50.146301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1698114-54fe-40be-a669-2272373230ba None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:50.146779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1698114-54fe-40be-a669-2272373230ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:50.180655 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:50.207618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a1698114-54fe-40be-a669-2272373230ba None None] MFA Rules not processed for user `b64c99aa710047a6a75d7507c9d6aa8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:50.210484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a1698114-54fe-40be-a669-2272373230ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:50.370743 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2046/4094] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:50.372073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8c5fd-dfed-43b6-b4a9-82a5a0de9dbc admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:50.398064 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1698114-54fe-40be-a669-2272373230ba None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:50.399953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a1698114-54fe-40be-a669-2272373230ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:50.529504 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8c5fd-dfed-43b6-b4a9-82a5a0de9dbc admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:50.531016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1698114-54fe-40be-a669-2272373230ba None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:50.535441 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f418b8-3a04-4e8f-996f-b0f7c7b0cfcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:50.536325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f418b8-3a04-4e8f-996f-b0f7c7b0cfcb service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:50.536838 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f418b8-3a04-4e8f-996f-b0f7c7b0cfcb service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:50.537213 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f418b8-3a04-4e8f-996f-b0f7c7b0cfcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:50.539613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-39f418b8-3a04-4e8f-996f-b0f7c7b0cfcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:50.541556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7ffd9-930e-4228-9cc6-0a1c84867070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:50.542315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7ffd9-930e-4228-9cc6-0a1c84867070 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:50.542612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7ffd9-930e-4228-9cc6-0a1c84867070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:50.542891 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7ffd9-930e-4228-9cc6-0a1c84867070 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:50.545048 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7ffd9-930e-4228-9cc6-0a1c84867070 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:50.551334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7ffd9-930e-4228-9cc6-0a1c84867070 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:50.555189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f418b8-3a04-4e8f-996f-b0f7c7b0cfcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:50.557750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f418b8-3a04-4e8f-996f-b0f7c7b0cfcb service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:50.571014 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2047/4095] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:15:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:15:50.608576 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f418b8-3a04-4e8f-996f-b0f7c7b0cfcb service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:50.609044 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2049/4096] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:15:50 2022] POST /identity/v3/projects => generated 375 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:50.623697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f418b8-3a04-4e8f-996f-b0f7c7b0cfcb service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:50.728908 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dff49d-7e43-415d-b5d7-cfec1f6e2445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:50.730718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dff49d-7e43-415d-b5d7-cfec1f6e2445 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:50.731053 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dff49d-7e43-415d-b5d7-cfec1f6e2445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:50.732652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dff49d-7e43-415d-b5d7-cfec1f6e2445 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:50.733551 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dff49d-7e43-415d-b5d7-cfec1f6e2445 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:50.735849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dff49d-7e43-415d-b5d7-cfec1f6e2445 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:50.779118 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7ffd9-930e-4228-9cc6-0a1c84867070 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:50.789772 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2048/4097] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:15:50 2022] POST /identity/v3/users => generated 288 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:50.793817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7ffd9-930e-4228-9cc6-0a1c84867070 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:50.798166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dff49d-7e43-415d-b5d7-cfec1f6e2445 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:50.809832 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ffa0cc-ed87-4b09-99aa-c87189bc90f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:50.810470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffa0cc-ed87-4b09-99aa-c87189bc90f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:50.810752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffa0cc-ed87-4b09-99aa-c87189bc90f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:50.811025 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffa0cc-ed87-4b09-99aa-c87189bc90f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:50.811674 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ffa0cc-ed87-4b09-99aa-c87189bc90f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:50.813294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ffa0cc-ed87-4b09-99aa-c87189bc90f5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:50.840669 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2050/4098] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:15:50.843557 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ffa0cc-ed87-4b09-99aa-c87189bc90f5 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:50.864485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ffa0cc-ed87-4b09-99aa-c87189bc90f5 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:50.877245 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51b835-7db2-4c81-8a01-656e3460911e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:50.877897 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51b835-7db2-4c81-8a01-656e3460911e admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:50.878176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51b835-7db2-4c81-8a01-656e3460911e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:50.878492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51b835-7db2-4c81-8a01-656e3460911e admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:50.879138 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51b835-7db2-4c81-8a01-656e3460911e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:50.880757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51b835-7db2-4c81-8a01-656e3460911e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:50.882295 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:50.883095 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:50.905482 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2051/4099] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:15:50.910228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51b835-7db2-4c81-8a01-656e3460911e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:50.932183 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51b835-7db2-4c81-8a01-656e3460911e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:50.934284 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dff49d-7e43-415d-b5d7-cfec1f6e2445 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:50.942286 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a332b-7d65-4875-8e0b-eb30877c25df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:50.943398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a332b-7d65-4875-8e0b-eb30877c25df admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:50.943398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a332b-7d65-4875-8e0b-eb30877c25df admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:50.944440 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a332b-7d65-4875-8e0b-eb30877c25df admin admin] PATH_INFO: `/v3/projects/12dc949b43c047129db1db7433892a03/users/aeaf8c571b904bc19ca859ac421ed0f3/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:50.945626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b4ae9-23d4-4875-9387-f841c17d938d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:50.947791 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b4ae9-23d4-4875-9387-f841c17d938d service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:50.948801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b4ae9-23d4-4875-9387-f841c17d938d service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:50.949372 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b4ae9-23d4-4875-9387-f841c17d938d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:50.952265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5f3b4ae9-23d4-4875-9387-f841c17d938d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:50.979099 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a332b-7d65-4875-8e0b-eb30877c25df admin admin] RBAC: Authorizing `identity:create_grant(project_id=12dc949b43c047129db1db7433892a03, user_id=aeaf8c571b904bc19ca859ac421ed0f3, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:50.981878 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a332b-7d65-4875-8e0b-eb30877c25df admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:50.982635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b4ae9-23d4-4875-9387-f841c17d938d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:50.987428 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b4ae9-23d4-4875-9387-f841c17d938d service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:51.010556 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2049/4100] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:15:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:15:51.012710 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2052/4101] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:15:50 2022] PUT /identity/v3/projects/12dc949b43c047129db1db7433892a03/users/aeaf8c571b904bc19ca859ac421ed0f3/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:51.024835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8c0ee-47b9-42d1-b677-c23c1f2b1b1d None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:51.025118 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8c0ee-47b9-42d1-b677-c23c1f2b1b1d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:51.025391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8c0ee-47b9-42d1-b677-c23c1f2b1b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:51.059475 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-8ba8c0ee-47b9-42d1-b677-c23c1f2b1b1d None None] MFA Rules not processed for user `aeaf8c571b904bc19ca859ac421ed0f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:51.060836 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8ba8c0ee-47b9-42d1-b677-c23c1f2b1b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:51.167932 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2050/4102] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:51.175384 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a332b-7d65-4875-8e0b-eb30877c25df admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:51.177555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3b2a332b-7d65-4875-8e0b-eb30877c25df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:51.285713 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a332b-7d65-4875-8e0b-eb30877c25df admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:51.289953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff120c-07b4-448a-9455-6ae6f42dc5ab service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efcee9b21ea94b1b8e5c9c5acb35839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:51.291098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff120c-07b4-448a-9455-6ae6f42dc5ab service glance] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:51.291395 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff120c-07b4-448a-9455-6ae6f42dc5ab service glance] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:51.291672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff120c-07b4-448a-9455-6ae6f42dc5ab service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:51.481886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff120c-07b4-448a-9455-6ae6f42dc5ab service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:51.483345 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff120c-07b4-448a-9455-6ae6f42dc5ab service glance] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:51.494575 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2053/4103] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:15:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:15:51.671568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ffad0-06f5-4568-9a9e-79652dac0662 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:51.672599 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ffad0-06f5-4568-9a9e-79652dac0662 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:51.674292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ffad0-06f5-4568-9a9e-79652dac0662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:51.710738 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-547ffad0-06f5-4568-9a9e-79652dac0662 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:51.712183 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-547ffad0-06f5-4568-9a9e-79652dac0662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:51.834889 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2051/4104] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:15:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:51.848561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff120c-07b4-448a-9455-6ae6f42dc5ab service glance] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:51.850291 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-62ff120c-07b4-448a-9455-6ae6f42dc5ab service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:51.958436 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff120c-07b4-448a-9455-6ae6f42dc5ab service glance] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:51.970955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3e5c6-66f0-4ea6-97d4-abcef037f25f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:51.971648 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3e5c6-66f0-4ea6-97d4-abcef037f25f service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:51.971937 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3e5c6-66f0-4ea6-97d4-abcef037f25f service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:51.972774 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3e5c6-66f0-4ea6-97d4-abcef037f25f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:52.000807 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3e5c6-66f0-4ea6-97d4-abcef037f25f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:52.003303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3e5c6-66f0-4ea6-97d4-abcef037f25f service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:52.033399 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2054/4105] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:15:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:15:52.070468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ffad0-06f5-4568-9a9e-79652dac0662 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:52.072587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-547ffad0-06f5-4568-9a9e-79652dac0662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:52.236635 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:52.250509 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ffad0-06f5-4568-9a9e-79652dac0662 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:52.289182 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c3e2b-35fb-4467-8c3d-47d6d848a556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:52.289934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c3e2b-35fb-4467-8c3d-47d6d848a556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:52.290431 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c3e2b-35fb-4467-8c3d-47d6d848a556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:52.290774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c3e2b-35fb-4467-8c3d-47d6d848a556 admin admin] PATH_INFO: `/v3/users/e2b6385d98754118a9f5c414f1c00988` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:52.291998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c3e2b-35fb-4467-8c3d-47d6d848a556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2b6385d98754118a9f5c414f1c00988)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:52.295438 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c3e2b-35fb-4467-8c3d-47d6d848a556 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:52.378163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3e5c6-66f0-4ea6-97d4-abcef037f25f service swift] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:52.388428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-56d3e5c6-66f0-4ea6-97d4-abcef037f25f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:52.430124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3e5c6-66f0-4ea6-97d4-abcef037f25f service swift] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:52.446609 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6e1c3e2b-35fb-4467-8c3d-47d6d848a556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2b6385d98754118a9f5c414f1c00988'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:52.447202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c6c79-fc85-4dba-a731-a43a270c5de2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efcee9b21ea94b1b8e5c9c5acb35839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:52.447839 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c6c79-fc85-4dba-a731-a43a270c5de2 service glance] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:52.448121 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c6c79-fc85-4dba-a731-a43a270c5de2 service glance] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:52.448395 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c6c79-fc85-4dba-a731-a43a270c5de2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:52.448618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6e1c3e2b-35fb-4467-8c3d-47d6d848a556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2b6385d98754118a9f5c414f1c00988'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:52.460985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-eb5c6c79-fc85-4dba-a731-a43a270c5de2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:52.471171 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6e1c3e2b-35fb-4467-8c3d-47d6d848a556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2b6385d98754118a9f5c414f1c00988'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:52.496157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6e1c3e2b-35fb-4467-8c3d-47d6d848a556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2b6385d98754118a9f5c414f1c00988'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:52.497103 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6e1c3e2b-35fb-4467-8c3d-47d6d848a556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2b6385d98754118a9f5c414f1c00988'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:52.503005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c6c79-fc85-4dba-a731-a43a270c5de2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:52.506536 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c6c79-fc85-4dba-a731-a43a270c5de2 service glance] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:52.521550 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2055/4106] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:15:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:15:52.531720 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2052/4107] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:15:52 2022] DELETE /identity/v3/users/e2b6385d98754118a9f5c414f1c00988 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:52.685674 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9f27c-6b59-4b8a-9d3a-9de8bfe41090 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:52.686107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9f27c-6b59-4b8a-9d3a-9de8bfe41090 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:52.686496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9f27c-6b59-4b8a-9d3a-9de8bfe41090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:52.704564 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:52.738734 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-9ae9f27c-6b59-4b8a-9d3a-9de8bfe41090 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:52.740254 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9ae9f27c-6b59-4b8a-9d3a-9de8bfe41090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:52.866991 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2056/4108] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 01:15:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:52.883192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c3e2b-35fb-4467-8c3d-47d6d848a556 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:52.884637 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6e1c3e2b-35fb-4467-8c3d-47d6d848a556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:53.000654 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9f27c-6b59-4b8a-9d3a-9de8bfe41090 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:53.002526 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9ae9f27c-6b59-4b8a-9d3a-9de8bfe41090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:53.018410 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c3e2b-35fb-4467-8c3d-47d6d848a556 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:53.034131 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3d688-4d8a-46e6-bd70-3bee34789713 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:53.035444 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3d688-4d8a-46e6-bd70-3bee34789713 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:53.035729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3d688-4d8a-46e6-bd70-3bee34789713 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:53.035968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3d688-4d8a-46e6-bd70-3bee34789713 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:53.052080 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3d688-4d8a-46e6-bd70-3bee34789713 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:53.053719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3d688-4d8a-46e6-bd70-3bee34789713 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:53.074797 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2053/4109] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:15:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:15:53.179634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9f27c-6b59-4b8a-9d3a-9de8bfe41090 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:53.188119 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a9040-e0c2-4ab6-9846-9f36098ab1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:53.189067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a9040-e0c2-4ab6-9846-9f36098ab1c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:53.189477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a9040-e0c2-4ab6-9846-9f36098ab1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:53.189989 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a9040-e0c2-4ab6-9846-9f36098ab1c6 admin admin] PATH_INFO: `/v3/projects/bfc02324f0254fcca24d67b9eaec420c` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:53.192229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a9040-e0c2-4ab6-9846-9f36098ab1c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfc02324f0254fcca24d67b9eaec420c)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:53.194772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a9040-e0c2-4ab6-9846-9f36098ab1c6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:53.251952 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3d688-4d8a-46e6-bd70-3bee34789713 service swift] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:53.254145 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-22b3d688-4d8a-46e6-bd70-3bee34789713 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:53.274415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3d688-4d8a-46e6-bd70-3bee34789713 service swift] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:53.294738 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-db8a9040-e0c2-4ab6-9846-9f36098ab1c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfc02324f0254fcca24d67b9eaec420c', 'request_id': 'req-db8a9040-e0c2-4ab6-9846-9f36098ab1c6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:53.334705 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-db8a9040-e0c2-4ab6-9846-9f36098ab1c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfc02324f0254fcca24d67b9eaec420c', 'request_id': 'req-db8a9040-e0c2-4ab6-9846-9f36098ab1c6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:53.341971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf6216-58e5-44ac-b0b4-2b23d1267595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:53.342385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-db8a9040-e0c2-4ab6-9846-9f36098ab1c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfc02324f0254fcca24d67b9eaec420c', 'request_id': 'req-db8a9040-e0c2-4ab6-9846-9f36098ab1c6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:53.342972 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf6216-58e5-44ac-b0b4-2b23d1267595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:53.343392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf6216-58e5-44ac-b0b4-2b23d1267595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:53.343649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf6216-58e5-44ac-b0b4-2b23d1267595 admin admin] PATH_INFO: `/v3/users/b64c99aa710047a6a75d7507c9d6aa8e` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:53.344898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf6216-58e5-44ac-b0b4-2b23d1267595 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b64c99aa710047a6a75d7507c9d6aa8e)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:53.347129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf6216-58e5-44ac-b0b4-2b23d1267595 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:53.354233 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:53.356872 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-db8a9040-e0c2-4ab6-9846-9f36098ab1c6 admin admin] The token cache is being invalidate because project bfc02324f0254fcca24d67b9eaec420c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:15:53.357166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-db8a9040-e0c2-4ab6-9846-9f36098ab1c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:53.357856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-db8a9040-e0c2-4ab6-9846-9f36098ab1c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:53.359703 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2057/4110] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:15:52 2022] DELETE /identity/v3/projects/bfc02324f0254fcca24d67b9eaec420c => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:15:53.365187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5defbf-37f3-48c8-a195-82bbb1252044 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:53.365511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5defbf-37f3-48c8-a195-82bbb1252044 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:53.365792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5defbf-37f3-48c8-a195-82bbb1252044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:53.407925 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-eb5defbf-37f3-48c8-a195-82bbb1252044 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:53.411169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-eb5defbf-37f3-48c8-a195-82bbb1252044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:53.454357 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2058/4111] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:53.456221 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-adbf6216-58e5-44ac-b0b4-2b23d1267595 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b64c99aa710047a6a75d7507c9d6aa8e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:53.457651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-adbf6216-58e5-44ac-b0b4-2b23d1267595 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b64c99aa710047a6a75d7507c9d6aa8e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:53.462716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba04bb7-c0c5-412d-accc-0a4d6cd3a729 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:53.463869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba04bb7-c0c5-412d-accc-0a4d6cd3a729 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:53.464393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba04bb7-c0c5-412d-accc-0a4d6cd3a729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:53.474873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-adbf6216-58e5-44ac-b0b4-2b23d1267595 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b64c99aa710047a6a75d7507c9d6aa8e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:53.494768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-adbf6216-58e5-44ac-b0b4-2b23d1267595 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b64c99aa710047a6a75d7507c9d6aa8e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:53.496365 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-adbf6216-58e5-44ac-b0b4-2b23d1267595 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b64c99aa710047a6a75d7507c9d6aa8e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:53.496820 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-7ba04bb7-c0c5-412d-accc-0a4d6cd3a729 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:53.498412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7ba04bb7-c0c5-412d-accc-0a4d6cd3a729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:53.527668 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2054/4112] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:15:53 2022] DELETE /identity/v3/users/b64c99aa710047a6a75d7507c9d6aa8e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:53.530064 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ce6cb-7d68-4a77-bef4-767d8478f9f0 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:53.530464 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ce6cb-7d68-4a77-bef4-767d8478f9f0 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:53.530842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ce6cb-7d68-4a77-bef4-767d8478f9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:53.538008 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2059/4113] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:53.540502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba04bb7-c0c5-412d-accc-0a4d6cd3a729 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:53.557815 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b20ce6cb-7d68-4a77-bef4-767d8478f9f0 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:53.559598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba04bb7-c0c5-412d-accc-0a4d6cd3a729 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:53.561423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b20ce6cb-7d68-4a77-bef4-767d8478f9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:53.587627 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:53.653795 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b8e85-fe3c-46fc-8987-f081c832fead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:53.654454 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b8e85-fe3c-46fc-8987-f081c832fead admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:53.654735 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b8e85-fe3c-46fc-8987-f081c832fead admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:53.655010 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b8e85-fe3c-46fc-8987-f081c832fead admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:53.655671 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b8e85-fe3c-46fc-8987-f081c832fead admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:15:53.656012 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b8e85-fe3c-46fc-8987-f081c832fead admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:53.657653 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b8e85-fe3c-46fc-8987-f081c832fead admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:53.667355 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2055/4114] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:53.673822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ce6cb-7d68-4a77-bef4-767d8478f9f0 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:53.675522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b20ce6cb-7d68-4a77-bef4-767d8478f9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:53.680458 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2060/4115] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:15:53.681565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b8e85-fe3c-46fc-8987-f081c832fead admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:53.695959 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b8e85-fe3c-46fc-8987-f081c832fead admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:53.719938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da24d0f-f299-4158-9f10-c14872124acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:53.721100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da24d0f-f299-4158-9f10-c14872124acf admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:53.721643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da24d0f-f299-4158-9f10-c14872124acf admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:53.725704 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da24d0f-f299-4158-9f10-c14872124acf admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:53.726937 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da24d0f-f299-4158-9f10-c14872124acf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:53.729092 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da24d0f-f299-4158-9f10-c14872124acf admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:53.758937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ce6cb-7d68-4a77-bef4-767d8478f9f0 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:53.766942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9a747-9dca-42df-b279-229be01c954d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:53.767552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9a747-9dca-42df-b279-229be01c954d service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:53.767937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9a747-9dca-42df-b279-229be01c954d service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:53.768300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9a747-9dca-42df-b279-229be01c954d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:53.795224 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9a747-9dca-42df-b279-229be01c954d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:53.796954 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9a747-9dca-42df-b279-229be01c954d service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:53.811408 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2061/4116] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:15:53 2022] POST /identity/v3/projects => generated 361 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:53.817019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da24d0f-f299-4158-9f10-c14872124acf admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:53.841676 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2056/4117] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:15:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:15:53.912832 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da24d0f-f299-4158-9f10-c14872124acf admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:53.919857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4a256-5241-447a-aaf4-41aa0a545456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:53.920543 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4a256-5241-447a-aaf4-41aa0a545456 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:53.920822 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4a256-5241-447a-aaf4-41aa0a545456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:53.921094 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4a256-5241-447a-aaf4-41aa0a545456 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:53.921766 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae4a256-5241-447a-aaf4-41aa0a545456 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:53.925173 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae4a256-5241-447a-aaf4-41aa0a545456 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:53.955911 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2062/4118] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:15:53 2022] POST /identity/v3/users => generated 281 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:53.962758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9a747-9dca-42df-b279-229be01c954d service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:53.978882 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9a747-9dca-42df-b279-229be01c954d service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:53.986402 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6a405-0d97-40d4-80f2-f140aec4fd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:53.988827 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6a405-0d97-40d4-80f2-f140aec4fd29 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:53.989380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6a405-0d97-40d4-80f2-f140aec4fd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:53.990346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6a405-0d97-40d4-80f2-f140aec4fd29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:53.991129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6a405-0d97-40d4-80f2-f140aec4fd29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:53.992899 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6a405-0d97-40d4-80f2-f140aec4fd29 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:54.008794 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2057/4119] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:15:54.014330 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4a256-5241-447a-aaf4-41aa0a545456 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:54.027208 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4a256-5241-447a-aaf4-41aa0a545456 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:54.033980 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96a18b-befd-466d-9df0-52ddb282be63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:54.034857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96a18b-befd-466d-9df0-52ddb282be63 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:54.035386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96a18b-befd-466d-9df0-52ddb282be63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:54.035999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96a18b-befd-466d-9df0-52ddb282be63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:54.036721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96a18b-befd-466d-9df0-52ddb282be63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:54.039879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96a18b-befd-466d-9df0-52ddb282be63 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:54.054761 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2063/4120] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:15:54.060696 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6a405-0d97-40d4-80f2-f140aec4fd29 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:54.075799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6a405-0d97-40d4-80f2-f140aec4fd29 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:54.106679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45583e1-1ebb-4130-b516-2476e058c75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:54.107633 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45583e1-1ebb-4130-b516-2476e058c75a admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:54.108152 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45583e1-1ebb-4130-b516-2476e058c75a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:54.108646 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45583e1-1ebb-4130-b516-2476e058c75a admin admin] PATH_INFO: `/v3/projects/2f7e802518d141ef8a18fa59c76a931d/users/862d12a9b719494d8e53f0e37819ae26/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:54.140395 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:54.149121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45583e1-1ebb-4130-b516-2476e058c75a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f7e802518d141ef8a18fa59c76a931d, user_id=862d12a9b719494d8e53f0e37819ae26, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:54.158807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45583e1-1ebb-4130-b516-2476e058c75a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:54.192331 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2058/4121] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:15:54 2022] PUT /identity/v3/projects/2f7e802518d141ef8a18fa59c76a931d/users/862d12a9b719494d8e53f0e37819ae26/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:54.203489 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550453ef-8a8b-49a7-a98a-95d57e5f37c0 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:54.203794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550453ef-8a8b-49a7-a98a-95d57e5f37c0 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:54.204537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550453ef-8a8b-49a7-a98a-95d57e5f37c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:54.248875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-550453ef-8a8b-49a7-a98a-95d57e5f37c0 None None] MFA Rules not processed for user `862d12a9b719494d8e53f0e37819ae26`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:54.250196 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-550453ef-8a8b-49a7-a98a-95d57e5f37c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:54.344225 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2064/4122] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:54.494667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45583e1-1ebb-4130-b516-2476e058c75a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:54.566315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550453ef-8a8b-49a7-a98a-95d57e5f37c0 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:54.567759 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-550453ef-8a8b-49a7-a98a-95d57e5f37c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:54.591849 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:54.594158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45583e1-1ebb-4130-b516-2476e058c75a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:54.607441 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79ca4c-c567-41ad-a199-b5eeefe1f468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:54.608244 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79ca4c-c567-41ad-a199-b5eeefe1f468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:54.609588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79ca4c-c567-41ad-a199-b5eeefe1f468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:54.610016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79ca4c-c567-41ad-a199-b5eeefe1f468 admin admin] PATH_INFO: `/v3/users/862d12a9b719494d8e53f0e37819ae26` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:54.617538 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79ca4c-c567-41ad-a199-b5eeefe1f468 admin admin] RBAC: Authorizing `identity:delete_user(user_id=862d12a9b719494d8e53f0e37819ae26)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:54.619607 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79ca4c-c567-41ad-a199-b5eeefe1f468 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:54.725478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4f79ca4c-c567-41ad-a199-b5eeefe1f468 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '862d12a9b719494d8e53f0e37819ae26'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:54.727246 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4f79ca4c-c567-41ad-a199-b5eeefe1f468 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '862d12a9b719494d8e53f0e37819ae26'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:54.746807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4f79ca4c-c567-41ad-a199-b5eeefe1f468 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '862d12a9b719494d8e53f0e37819ae26'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:54.752245 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550453ef-8a8b-49a7-a98a-95d57e5f37c0 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:54.762692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6b85a-7445-49d8-8326-024958d93fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:54.764097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6b85a-7445-49d8-8326-024958d93fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:54.764471 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6b85a-7445-49d8-8326-024958d93fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:54.764857 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4f79ca4c-c567-41ad-a199-b5eeefe1f468 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '862d12a9b719494d8e53f0e37819ae26'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:54.764995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6b85a-7445-49d8-8326-024958d93fcd admin admin] PATH_INFO: `/v3/projects/88e311c49b5945419059c120499f0dba` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:54.766613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4f79ca4c-c567-41ad-a199-b5eeefe1f468 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '862d12a9b719494d8e53f0e37819ae26'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:54.767485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6b85a-7445-49d8-8326-024958d93fcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=88e311c49b5945419059c120499f0dba)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:54.771220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6b85a-7445-49d8-8326-024958d93fcd admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:54.827211 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2059/4123] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:15:54 2022] DELETE /identity/v3/users/862d12a9b719494d8e53f0e37819ae26 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:54.832706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb68873-d9f5-4df8-9f74-ccfbc310b022 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:54.833329 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb68873-d9f5-4df8-9f74-ccfbc310b022 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:54.833753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb68873-d9f5-4df8-9f74-ccfbc310b022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:54.868923 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-fbb68873-d9f5-4df8-9f74-ccfbc310b022 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:54.872773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-fbb68873-d9f5-4df8-9f74-ccfbc310b022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:54.876545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a3f6b85a-7445-49d8-8326-024958d93fcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88e311c49b5945419059c120499f0dba', 'request_id': 'req-a3f6b85a-7445-49d8-8326-024958d93fcd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:54.896965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a3f6b85a-7445-49d8-8326-024958d93fcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88e311c49b5945419059c120499f0dba', 'request_id': 'req-a3f6b85a-7445-49d8-8326-024958d93fcd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:54.904873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a3f6b85a-7445-49d8-8326-024958d93fcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88e311c49b5945419059c120499f0dba', 'request_id': 'req-a3f6b85a-7445-49d8-8326-024958d93fcd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:54.935447 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a3f6b85a-7445-49d8-8326-024958d93fcd admin admin] The token cache is being invalidate because project 88e311c49b5945419059c120499f0dba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:15:54.935860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a3f6b85a-7445-49d8-8326-024958d93fcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:54.936972 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a3f6b85a-7445-49d8-8326-024958d93fcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:54.940285 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2065/4124] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:15:54 2022] DELETE /identity/v3/projects/88e311c49b5945419059c120499f0dba => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:54.944584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6b85a-7445-49d8-8326-024958d93fcd admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:54.953644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a3f6b85a-7445-49d8-8326-024958d93fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:54.990819 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2060/4125] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:15:55.040033 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb68873-d9f5-4df8-9f74-ccfbc310b022 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:55.042263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-fbb68873-d9f5-4df8-9f74-ccfbc310b022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:55.075206 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:55.124398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6b85a-7445-49d8-8326-024958d93fcd admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:55.134745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad818084-f6de-4026-b0a2-0c6d008453ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:55.136536 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad818084-f6de-4026-b0a2-0c6d008453ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:55.136830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad818084-f6de-4026-b0a2-0c6d008453ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:55.137372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad818084-f6de-4026-b0a2-0c6d008453ff admin admin] PATH_INFO: `/v3/users/aeaf8c571b904bc19ca859ac421ed0f3` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:55.138665 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad818084-f6de-4026-b0a2-0c6d008453ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=aeaf8c571b904bc19ca859ac421ed0f3)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:55.143718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad818084-f6de-4026-b0a2-0c6d008453ff admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:55.177254 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb68873-d9f5-4df8-9f74-ccfbc310b022 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:55.189142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42952a-d6d7-42c0-a126-3e207c3d792c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:55.189802 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42952a-d6d7-42c0-a126-3e207c3d792c service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:55.190084 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42952a-d6d7-42c0-a126-3e207c3d792c service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:55.190356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42952a-d6d7-42c0-a126-3e207c3d792c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:55.212129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42952a-d6d7-42c0-a126-3e207c3d792c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:55.213614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42952a-d6d7-42c0-a126-3e207c3d792c service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:55.222203 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:55.242815 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2061/4126] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:15:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:15:55.249079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ad818084-f6de-4026-b0a2-0c6d008453ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aeaf8c571b904bc19ca859ac421ed0f3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:55.250657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ad818084-f6de-4026-b0a2-0c6d008453ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aeaf8c571b904bc19ca859ac421ed0f3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:55.261982 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ad818084-f6de-4026-b0a2-0c6d008453ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aeaf8c571b904bc19ca859ac421ed0f3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:55.275098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ad818084-f6de-4026-b0a2-0c6d008453ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aeaf8c571b904bc19ca859ac421ed0f3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:55.276169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ad818084-f6de-4026-b0a2-0c6d008453ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aeaf8c571b904bc19ca859ac421ed0f3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:55.310029 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2066/4127] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:15:54 2022] DELETE /identity/v3/users/aeaf8c571b904bc19ca859ac421ed0f3 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:56.167042 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42952a-d6d7-42c0-a126-3e207c3d792c service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:56.203011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42952a-d6d7-42c0-a126-3e207c3d792c service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:56.371253 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12bb3c-3fef-429b-9ff0-08cf6a7cff75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:56.372216 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12bb3c-3fef-429b-9ff0-08cf6a7cff75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:56.372779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12bb3c-3fef-429b-9ff0-08cf6a7cff75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:56.373056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12bb3c-3fef-429b-9ff0-08cf6a7cff75 admin admin] PATH_INFO: `/v3/projects/12dc949b43c047129db1db7433892a03` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:56.374291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12bb3c-3fef-429b-9ff0-08cf6a7cff75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12dc949b43c047129db1db7433892a03)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:56.376451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12bb3c-3fef-429b-9ff0-08cf6a7cff75 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:56.478826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ca12bb3c-3fef-429b-9ff0-08cf6a7cff75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12dc949b43c047129db1db7433892a03', 'request_id': 'req-ca12bb3c-3fef-429b-9ff0-08cf6a7cff75'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:56.499366 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ca12bb3c-3fef-429b-9ff0-08cf6a7cff75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12dc949b43c047129db1db7433892a03', 'request_id': 'req-ca12bb3c-3fef-429b-9ff0-08cf6a7cff75'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:56.511137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ca12bb3c-3fef-429b-9ff0-08cf6a7cff75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12dc949b43c047129db1db7433892a03', 'request_id': 'req-ca12bb3c-3fef-429b-9ff0-08cf6a7cff75'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:56.532409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ca12bb3c-3fef-429b-9ff0-08cf6a7cff75 admin admin] The token cache is being invalidate because project 12dc949b43c047129db1db7433892a03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:15:56.532978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ca12bb3c-3fef-429b-9ff0-08cf6a7cff75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:56.533949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ca12bb3c-3fef-429b-9ff0-08cf6a7cff75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:56.537131 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2062/4128] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:15:56 2022] DELETE /identity/v3/projects/12dc949b43c047129db1db7433892a03 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:56.542802 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fffc62-5b19-4f4d-b6d8-03959676ede2 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:56.543709 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fffc62-5b19-4f4d-b6d8-03959676ede2 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:56.544180 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fffc62-5b19-4f4d-b6d8-03959676ede2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:56.558023 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12bb3c-3fef-429b-9ff0-08cf6a7cff75 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:56.561769 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ca12bb3c-3fef-429b-9ff0-08cf6a7cff75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:56.596533 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-49fffc62-5b19-4f4d-b6d8-03959676ede2 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:56.600687 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-49fffc62-5b19-4f4d-b6d8-03959676ede2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:56.688801 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:56.711891 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12bb3c-3fef-429b-9ff0-08cf6a7cff75 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:56.718848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee6083-e763-44c6-baed-ebbb35c47335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:56.720145 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee6083-e763-44c6-baed-ebbb35c47335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:56.720814 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee6083-e763-44c6-baed-ebbb35c47335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:56.721397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee6083-e763-44c6-baed-ebbb35c47335 admin admin] PATH_INFO: `/v3/projects/2f7e802518d141ef8a18fa59c76a931d` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:56.723582 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee6083-e763-44c6-baed-ebbb35c47335 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f7e802518d141ef8a18fa59c76a931d)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:56.726388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee6083-e763-44c6-baed-ebbb35c47335 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:56.775454 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2067/4129] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:15:56.777889 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb939626-c366-465a-9a01-1d8188b2781c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:56.778177 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb939626-c366-465a-9a01-1d8188b2781c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:56.778448 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb939626-c366-465a-9a01-1d8188b2781c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:56.797498 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-64ee6083-e763-44c6-baed-ebbb35c47335 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f7e802518d141ef8a18fa59c76a931d', 'request_id': 'req-64ee6083-e763-44c6-baed-ebbb35c47335'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:56.813546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-64ee6083-e763-44c6-baed-ebbb35c47335 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f7e802518d141ef8a18fa59c76a931d', 'request_id': 'req-64ee6083-e763-44c6-baed-ebbb35c47335'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:56.823531 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-64ee6083-e763-44c6-baed-ebbb35c47335 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f7e802518d141ef8a18fa59c76a931d', 'request_id': 'req-64ee6083-e763-44c6-baed-ebbb35c47335'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:56.843575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-fb939626-c366-465a-9a01-1d8188b2781c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:56.844805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fb939626-c366-465a-9a01-1d8188b2781c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:56.846299 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-64ee6083-e763-44c6-baed-ebbb35c47335 admin admin] The token cache is being invalidate because project 2f7e802518d141ef8a18fa59c76a931d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:15:56.853623 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-64ee6083-e763-44c6-baed-ebbb35c47335 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:56.855562 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-64ee6083-e763-44c6-baed-ebbb35c47335 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:15:56.864940 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2063/4130] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:15:56 2022] DELETE /identity/v3/projects/2f7e802518d141ef8a18fa59c76a931d => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:56.867565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb1e00-8330-4062-86c7-220beff879d9 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:56.868019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb1e00-8330-4062-86c7-220beff879d9 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:56.868639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb1e00-8330-4062-86c7-220beff879d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:56.903635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-3ebb1e00-8330-4062-86c7-220beff879d9 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:56.905099 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3ebb1e00-8330-4062-86c7-220beff879d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:56.969763 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2068/4131] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:56.970704 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb939626-c366-465a-9a01-1d8188b2781c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:56.996120 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb939626-c366-465a-9a01-1d8188b2781c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:57.001859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5047b-1b9d-4ec5-b9d9-9cb258b5138b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:57.002652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5047b-1b9d-4ec5-b9d9-9cb258b5138b admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:57.002935 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5047b-1b9d-4ec5-b9d9-9cb258b5138b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:57.003206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5047b-1b9d-4ec5-b9d9-9cb258b5138b admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:57.004423 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5047b-1b9d-4ec5-b9d9-9cb258b5138b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:15:57.004729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5047b-1b9d-4ec5-b9d9-9cb258b5138b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:57.018606 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5047b-1b9d-4ec5-b9d9-9cb258b5138b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:57.034650 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2064/4132] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:57.037205 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2069/4133] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:15:57.039144 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb1e00-8330-4062-86c7-220beff879d9 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:57.042011 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24cd595-a835-41cd-9b75-7cf6b42d24cd None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:57.042302 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24cd595-a835-41cd-9b75-7cf6b42d24cd None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:57.042578 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24cd595-a835-41cd-9b75-7cf6b42d24cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:57.058260 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb1e00-8330-4062-86c7-220beff879d9 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:57.065611 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f50a3b-0edc-4956-a573-8c575a5222ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:57.067232 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f50a3b-0edc-4956-a573-8c575a5222ae admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:57.067861 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f50a3b-0edc-4956-a573-8c575a5222ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:57.068451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f50a3b-0edc-4956-a573-8c575a5222ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:57.069302 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f50a3b-0edc-4956-a573-8c575a5222ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:57.072444 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f50a3b-0edc-4956-a573-8c575a5222ae admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:57.085362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e24cd595-a835-41cd-9b75-7cf6b42d24cd None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:57.086612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e24cd595-a835-41cd-9b75-7cf6b42d24cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:57.106354 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2070/4134] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:15:57.110968 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24cd595-a835-41cd-9b75-7cf6b42d24cd None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:57.127242 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24cd595-a835-41cd-9b75-7cf6b42d24cd None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:57.131554 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2065/4135] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:15:57 2022] POST /identity/v3/projects => generated 371 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:57.140296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f50a3b-0edc-4956-a573-8c575a5222ae admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:57.199428 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:57.260119 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:57.265206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41278e5-a70c-4122-a47c-5c293cbfe76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:57.265766 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41278e5-a70c-4122-a47c-5c293cbfe76e admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:57.266433 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41278e5-a70c-4122-a47c-5c293cbfe76e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:57.266433 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41278e5-a70c-4122-a47c-5c293cbfe76e admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:57.266962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41278e5-a70c-4122-a47c-5c293cbfe76e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:15:57.267264 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41278e5-a70c-4122-a47c-5c293cbfe76e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:57.268919 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41278e5-a70c-4122-a47c-5c293cbfe76e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:57.287334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f50a3b-0edc-4956-a573-8c575a5222ae admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:57.299561 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2071/4136] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:15:57.304274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41278e5-a70c-4122-a47c-5c293cbfe76e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:57.304478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835025d4-a311-4bf2-aba6-460f2e35d290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:57.304940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835025d4-a311-4bf2-aba6-460f2e35d290 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:57.305223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835025d4-a311-4bf2-aba6-460f2e35d290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:57.305540 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835025d4-a311-4bf2-aba6-460f2e35d290 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:57.306188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835025d4-a311-4bf2-aba6-460f2e35d290 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:57.308127 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835025d4-a311-4bf2-aba6-460f2e35d290 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:57.320107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41278e5-a70c-4122-a47c-5c293cbfe76e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:57.325970 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f63451-d802-4afc-bc20-de76c430500d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:57.327026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f63451-d802-4afc-bc20-de76c430500d admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:57.327536 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f63451-d802-4afc-bc20-de76c430500d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:57.328220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f63451-d802-4afc-bc20-de76c430500d admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:57.330357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f63451-d802-4afc-bc20-de76c430500d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:57.333496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f63451-d802-4afc-bc20-de76c430500d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:57.334058 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2066/4137] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:15:57 2022] POST /identity/v3/users => generated 286 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:57.337979 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835025d4-a311-4bf2-aba6-460f2e35d290 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:57.350683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835025d4-a311-4bf2-aba6-460f2e35d290 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:57.356194 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecdb7fa-a17d-48cb-9439-acb0ccf54b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:57.356841 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdb7fa-a17d-48cb-9439-acb0ccf54b67 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:57.357171 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdb7fa-a17d-48cb-9439-acb0ccf54b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:57.357480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdb7fa-a17d-48cb-9439-acb0ccf54b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:57.358251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecdb7fa-a17d-48cb-9439-acb0ccf54b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:57.385636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecdb7fa-a17d-48cb-9439-acb0ccf54b67 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:57.416283 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2072/4138] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:15:57 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:57.416283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f63451-d802-4afc-bc20-de76c430500d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:57.416717 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2067/4139] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:15:57.417295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecdb7fa-a17d-48cb-9439-acb0ccf54b67 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:57.437621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecdb7fa-a17d-48cb-9439-acb0ccf54b67 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:57.575335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98716e41-1bb1-4415-b1ff-c4dec34a8559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:57.575962 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98716e41-1bb1-4415-b1ff-c4dec34a8559 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:57.576249 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98716e41-1bb1-4415-b1ff-c4dec34a8559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:57.576531 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98716e41-1bb1-4415-b1ff-c4dec34a8559 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:57.577177 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98716e41-1bb1-4415-b1ff-c4dec34a8559 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:57.578070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f63451-d802-4afc-bc20-de76c430500d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:57.579174 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98716e41-1bb1-4415-b1ff-c4dec34a8559 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:57.593067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8687104-e7d0-43c2-8221-ea461def42dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:57.594019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8687104-e7d0-43c2-8221-ea461def42dc admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:57.594597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8687104-e7d0-43c2-8221-ea461def42dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:57.595037 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8687104-e7d0-43c2-8221-ea461def42dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:57.596245 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8687104-e7d0-43c2-8221-ea461def42dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:57.600865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8687104-e7d0-43c2-8221-ea461def42dc admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:57.625613 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2068/4140] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:15:57 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:15:57.629733 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98716e41-1bb1-4415-b1ff-c4dec34a8559 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:57.631659 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2073/4141] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:15:57.635418 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8687104-e7d0-43c2-8221-ea461def42dc admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:57.660269 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8687104-e7d0-43c2-8221-ea461def42dc admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:57.668699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98716e41-1bb1-4415-b1ff-c4dec34a8559 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:57.672193 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ec3bb-9373-40d8-b76b-030ecb694574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:57.673085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ec3bb-9373-40d8-b76b-030ecb694574 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:57.673732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ec3bb-9373-40d8-b76b-030ecb694574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:57.674164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ec3bb-9373-40d8-b76b-030ecb694574 admin admin] PATH_INFO: `/v3/projects/4898ed470caf4ddd8d68c2631872c6ab/users/eab6175e4abc44b78312a155f8f2c59a/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:57.681100 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02edb981-96fc-42c7-a1de-7d17262a530a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:57.681970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edb981-96fc-42c7-a1de-7d17262a530a admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:57.682425 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edb981-96fc-42c7-a1de-7d17262a530a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:57.682801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edb981-96fc-42c7-a1de-7d17262a530a admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:57.683829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02edb981-96fc-42c7-a1de-7d17262a530a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:57.686073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02edb981-96fc-42c7-a1de-7d17262a530a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:57.702635 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2069/4142] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:15:57.743934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02edb981-96fc-42c7-a1de-7d17262a530a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:57.755313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ec3bb-9373-40d8-b76b-030ecb694574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4898ed470caf4ddd8d68c2631872c6ab, user_id=eab6175e4abc44b78312a155f8f2c59a, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:57.770562 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ec3bb-9373-40d8-b76b-030ecb694574 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:57.789662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02edb981-96fc-42c7-a1de-7d17262a530a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:57.814133 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2074/4143] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:15:57 2022] PUT /identity/v3/projects/4898ed470caf4ddd8d68c2631872c6ab/users/eab6175e4abc44b78312a155f8f2c59a/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:15:57.816669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde505bd-4d8d-4e94-818c-53bc948e2ed7 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:57.817132 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde505bd-4d8d-4e94-818c-53bc948e2ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:57.818821 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde505bd-4d8d-4e94-818c-53bc948e2ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:57.857947 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-bde505bd-4d8d-4e94-818c-53bc948e2ed7 None None] MFA Rules not processed for user `eab6175e4abc44b78312a155f8f2c59a`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:57.859469 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-bde505bd-4d8d-4e94-818c-53bc948e2ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:57.924185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaeb815-803f-4a45-b4ca-8ad79f57daf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:57.924823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaeb815-803f-4a45-b4ca-8ad79f57daf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:57.925152 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaeb815-803f-4a45-b4ca-8ad79f57daf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:57.925925 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaeb815-803f-4a45-b4ca-8ad79f57daf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:57.926437 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaeb815-803f-4a45-b4ca-8ad79f57daf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:57.929344 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaeb815-803f-4a45-b4ca-8ad79f57daf0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:57.952746 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2070/4144] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:15:57.958457 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaeb815-803f-4a45-b4ca-8ad79f57daf0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:57.968531 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaeb815-803f-4a45-b4ca-8ad79f57daf0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:57.974882 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5dabe5-5022-44f9-b505-cd29fa19e01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:57.975821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dabe5-5022-44f9-b505-cd29fa19e01e admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:57.976108 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dabe5-5022-44f9-b505-cd29fa19e01e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:57.976384 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dabe5-5022-44f9-b505-cd29fa19e01e admin admin] PATH_INFO: `/v3/projects/f9beb76200ba4f1fbefc4033581f993f/users/6da5161f966c4d61b0c30e78829e5e1d/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:58.001767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5dabe5-5022-44f9-b505-cd29fa19e01e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9beb76200ba4f1fbefc4033581f993f, user_id=6da5161f966c4d61b0c30e78829e5e1d, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:58.006869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5dabe5-5022-44f9-b505-cd29fa19e01e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:58.025085 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2075/4145] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:58.048676 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde505bd-4d8d-4e94-818c-53bc948e2ed7 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:58.050173 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-bde505bd-4d8d-4e94-818c-53bc948e2ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:58.063283 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2071/4146] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:15:57 2022] PUT /identity/v3/projects/f9beb76200ba4f1fbefc4033581f993f/users/6da5161f966c4d61b0c30e78829e5e1d/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:15:58.068484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67ab67-2bc8-47c1-9c8d-19d0dc694f0b None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:58.068653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67ab67-2bc8-47c1-9c8d-19d0dc694f0b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:58.068878 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67ab67-2bc8-47c1-9c8d-19d0dc694f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:58.084207 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:58.141562 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-df67ab67-2bc8-47c1-9c8d-19d0dc694f0b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:58.142888 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-df67ab67-2bc8-47c1-9c8d-19d0dc694f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:58.199071 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:58.207172 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde505bd-4d8d-4e94-818c-53bc948e2ed7 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:58.323803 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2072/4147] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:58.326019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bba0ea-8551-4fd1-82a8-843635d0af09 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:58.326309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bba0ea-8551-4fd1-82a8-843635d0af09 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:58.326589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bba0ea-8551-4fd1-82a8-843635d0af09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:58.347978 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b28d6-e7db-4d62-beb4-eccb1f542a49 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efcee9b21ea94b1b8e5c9c5acb35839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:58.348700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b28d6-e7db-4d62-beb4-eccb1f542a49 service glance] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:58.351366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b28d6-e7db-4d62-beb4-eccb1f542a49 service glance] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:58.351765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b28d6-e7db-4d62-beb4-eccb1f542a49 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:58.403193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-38bba0ea-8551-4fd1-82a8-843635d0af09 None None] MFA Rules not processed for user `4b1db60cab3d4cda97aebbebd7c2c89f`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:58.407702 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-38bba0ea-8551-4fd1-82a8-843635d0af09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:58.546595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b28d6-e7db-4d62-beb4-eccb1f542a49 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:58.548137 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b28d6-e7db-4d62-beb4-eccb1f542a49 service glance] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:58.574194 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2073/4148] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:58.574718 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2076/4149] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:15:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:15:58.575044 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bba0ea-8551-4fd1-82a8-843635d0af09 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:58.576324 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-38bba0ea-8551-4fd1-82a8-843635d0af09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:58.585229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccdd0b-e78e-4555-9722-54cec4112fea None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:58.585845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccdd0b-e78e-4555-9722-54cec4112fea None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:58.586050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccdd0b-e78e-4555-9722-54cec4112fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:58.634220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-72ccdd0b-e78e-4555-9722-54cec4112fea None None] MFA Rules not processed for user `4b1db60cab3d4cda97aebbebd7c2c89f`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:58.635489 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-72ccdd0b-e78e-4555-9722-54cec4112fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:58.661327 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2077/4150] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:15:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:15:58.750520 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bba0ea-8551-4fd1-82a8-843635d0af09 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:58.758351 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b247105-9288-46ee-83bd-e5b0a8d78881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:58.759774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b247105-9288-46ee-83bd-e5b0a8d78881 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:58.760316 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b247105-9288-46ee-83bd-e5b0a8d78881 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:58.760897 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b247105-9288-46ee-83bd-e5b0a8d78881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:58.780071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b247105-9288-46ee-83bd-e5b0a8d78881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:58.781833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b247105-9288-46ee-83bd-e5b0a8d78881 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:58.797628 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2074/4151] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:15:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:15:58.886753 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fae181-a1c1-4137-8a94-201cd6731e2a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:58.887667 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fae181-a1c1-4137-8a94-201cd6731e2a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:58.888299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fae181-a1c1-4137-8a94-201cd6731e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:58.929213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-10fae181-a1c1-4137-8a94-201cd6731e2a None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:58.932681 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-10fae181-a1c1-4137-8a94-201cd6731e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:58.967224 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b247105-9288-46ee-83bd-e5b0a8d78881 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:58.969046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6b247105-9288-46ee-83bd-e5b0a8d78881 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:59.102545 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2078/4152] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:15:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:59.122129 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:59.124795 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fae181-a1c1-4137-8a94-201cd6731e2a None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:59.126314 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-10fae181-a1c1-4137-8a94-201cd6731e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:59.162686 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:59.173786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b247105-9288-46ee-83bd-e5b0a8d78881 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:59.184737 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410ec40-b1d8-4004-b6a3-086ec368f154 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:59.187504 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410ec40-b1d8-4004-b6a3-086ec368f154 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:59.188228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410ec40-b1d8-4004-b6a3-086ec368f154 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:59.188857 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410ec40-b1d8-4004-b6a3-086ec368f154 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:59.208069 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410ec40-b1d8-4004-b6a3-086ec368f154 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:59.211443 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410ec40-b1d8-4004-b6a3-086ec368f154 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:59.224036 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2075/4153] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:15:58 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:15:59.264211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fae181-a1c1-4137-8a94-201cd6731e2a None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:59.274406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791ac09-02a1-4815-a31a-0cef8bf28a3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:59.276275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791ac09-02a1-4815-a31a-0cef8bf28a3e service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:59.276727 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791ac09-02a1-4815-a31a-0cef8bf28a3e service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:59.277833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791ac09-02a1-4815-a31a-0cef8bf28a3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:59.318699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791ac09-02a1-4815-a31a-0cef8bf28a3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:59.328980 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791ac09-02a1-4815-a31a-0cef8bf28a3e service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:59.365237 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2079/4154] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:15:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:15:59.759462 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a3668-c592-4865-9de6-a32f98dae1c4 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:59.760345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a3668-c592-4865-9de6-a32f98dae1c4 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:59.761416 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a3668-c592-4865-9de6-a32f98dae1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:59.799750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-8b9a3668-c592-4865-9de6-a32f98dae1c4 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:15:59.801995 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8b9a3668-c592-4865-9de6-a32f98dae1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:15:59.813296 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2076/4155] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:15:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:15:59.848515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791ac09-02a1-4815-a31a-0cef8bf28a3e service swift] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:15:59.860582 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791ac09-02a1-4815-a31a-0cef8bf28a3e service swift] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:15:59.867699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0fa50-1c3c-46f3-a1f6-d560f3f4e6c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:15:59.868532 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0fa50-1c3c-46f3-a1f6-d560f3f4e6c8 service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:15:59.868866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0fa50-1c3c-46f3-a1f6-d560f3f4e6c8 service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:15:59.869195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0fa50-1c3c-46f3-a1f6-d560f3f4e6c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:15:59.879115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b0fa50-1c3c-46f3-a1f6-d560f3f4e6c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:15:59.880733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b0fa50-1c3c-46f3-a1f6-d560f3f4e6c8 service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:15:59.889775 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2080/4156] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:15:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:16:00.171300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8e695-8fdd-4fae-a95f-657b4eede919 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:00.171300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8e695-8fdd-4fae-a95f-657b4eede919 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:00.171693 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8e695-8fdd-4fae-a95f-657b4eede919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:00.236872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-dff8e695-8fdd-4fae-a95f-657b4eede919 None None] MFA Rules not processed for user `d531146522f24a368a8c6ab482495776`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:16:00.239239 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-dff8e695-8fdd-4fae-a95f-657b4eede919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:16:00.375097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2baeca2-6d3d-457f-9d7f-75ce9eacdbbe None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:00.375454 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2baeca2-6d3d-457f-9d7f-75ce9eacdbbe None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:00.375720 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2baeca2-6d3d-457f-9d7f-75ce9eacdbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:00.432402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c2baeca2-6d3d-457f-9d7f-75ce9eacdbbe None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:16:00.435833 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2077/4157] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:16:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:16:00.464353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c2baeca2-6d3d-457f-9d7f-75ce9eacdbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:16:00.495941 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2081/4158] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:16:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:16:00.509201 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8e695-8fdd-4fae-a95f-657b4eede919 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:00.538546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8e695-8fdd-4fae-a95f-657b4eede919 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:00.553418 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad44982-869a-47fb-a8b3-a8661e682051 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:00.555660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad44982-869a-47fb-a8b3-a8661e682051 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:00.558903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad44982-869a-47fb-a8b3-a8661e682051 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:00.559810 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad44982-869a-47fb-a8b3-a8661e682051 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:00.598180 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad44982-869a-47fb-a8b3-a8661e682051 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:00.610168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad44982-869a-47fb-a8b3-a8661e682051 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:00.626950 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2078/4159] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:16:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:16:01.218909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a99c96-c767-485f-a260-c13b345c29ff None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:01.219879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a99c96-c767-485f-a260-c13b345c29ff None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:01.220556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a99c96-c767-485f-a260-c13b345c29ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:01.246525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-b1a99c96-c767-485f-a260-c13b345c29ff None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:16:01.247991 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b1a99c96-c767-485f-a260-c13b345c29ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:16:01.260478 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2082/4160] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:16:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:16:01.272792 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad44982-869a-47fb-a8b3-a8661e682051 service swift] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:01.290611 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad44982-869a-47fb-a8b3-a8661e682051 service swift] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:01.302843 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3cb3d-d65e-4e89-8c8e-21ef56ebde1e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:01.304597 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3cb3d-d65e-4e89-8c8e-21ef56ebde1e service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:01.305625 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3cb3d-d65e-4e89-8c8e-21ef56ebde1e service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:01.305625 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3cb3d-d65e-4e89-8c8e-21ef56ebde1e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:01.328084 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3cb3d-d65e-4e89-8c8e-21ef56ebde1e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:01.330181 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3cb3d-d65e-4e89-8c8e-21ef56ebde1e service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:01.345735 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2079/4161] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:16:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:16:01.882572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7293215-c6c3-4a14-9bc1-ebe24f92cace None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:01.882854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7293215-c6c3-4a14-9bc1-ebe24f92cace None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:01.883151 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7293215-c6c3-4a14-9bc1-ebe24f92cace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:01.971780 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-f7293215-c6c3-4a14-9bc1-ebe24f92cace None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:16:01.981582 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f7293215-c6c3-4a14-9bc1-ebe24f92cace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:16:02.011759 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2083/4162] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:16:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:16:02.026875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3cb3d-d65e-4e89-8c8e-21ef56ebde1e service swift] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:02.040182 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3cb3d-d65e-4e89-8c8e-21ef56ebde1e service swift] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:02.054805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb7e42-a54f-4ab9-828b-c1929d521365 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:02.056117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb7e42-a54f-4ab9-828b-c1929d521365 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:02.058316 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb7e42-a54f-4ab9-828b-c1929d521365 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:02.060688 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb7e42-a54f-4ab9-828b-c1929d521365 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:02.084056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb7e42-a54f-4ab9-828b-c1929d521365 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:02.086085 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb7e42-a54f-4ab9-828b-c1929d521365 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:02.110344 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2080/4163] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:16:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:16:02.784092 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76592087-6186-447c-9e96-8d8764f4ea39 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:02.785054 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76592087-6186-447c-9e96-8d8764f4ea39 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:02.785657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76592087-6186-447c-9e96-8d8764f4ea39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:02.847070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-76592087-6186-447c-9e96-8d8764f4ea39 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:16:02.848587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-76592087-6186-447c-9e96-8d8764f4ea39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:16:02.869836 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2084/4164] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:16:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:16:02.889995 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb7e42-a54f-4ab9-828b-c1929d521365 service swift] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:02.912781 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb7e42-a54f-4ab9-828b-c1929d521365 service swift] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:02.939218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1abad-02d8-437b-95a6-69e99e44c544 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:02.940966 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1abad-02d8-437b-95a6-69e99e44c544 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:02.941594 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1abad-02d8-437b-95a6-69e99e44c544 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:02.942118 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1abad-02d8-437b-95a6-69e99e44c544 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:02.956979 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1abad-02d8-437b-95a6-69e99e44c544 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:02.959218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1abad-02d8-437b-95a6-69e99e44c544 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:02.979637 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2081/4165] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:16:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:16:04.742527 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d43894-be9f-47cf-a5b7-04d3a014d3d2 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:04.743125 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d43894-be9f-47cf-a5b7-04d3a014d3d2 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:04.743125 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d43894-be9f-47cf-a5b7-04d3a014d3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:04.777764 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-f3d43894-be9f-47cf-a5b7-04d3a014d3d2 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:16:04.779009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f3d43894-be9f-47cf-a5b7-04d3a014d3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:16:04.826072 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2085/4166] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 01:16:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:16:04.839402 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1abad-02d8-437b-95a6-69e99e44c544 service swift] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:04.856112 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1abad-02d8-437b-95a6-69e99e44c544 service swift] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:04.886073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a666d5-f30a-4a71-ab03-f4186f0cf507 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:04.888763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a666d5-f30a-4a71-ab03-f4186f0cf507 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:04.892607 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a666d5-f30a-4a71-ab03-f4186f0cf507 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:04.893919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a666d5-f30a-4a71-ab03-f4186f0cf507 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:04.921309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a666d5-f30a-4a71-ab03-f4186f0cf507 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:04.925972 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a666d5-f30a-4a71-ab03-f4186f0cf507 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:04.957892 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2082/4167] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:16:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:16:05.265959 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc4cf0-a43f-4d4e-94fe-67c7b8502f36 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:05.266244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc4cf0-a43f-4d4e-94fe-67c7b8502f36 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:05.266586 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc4cf0-a43f-4d4e-94fe-67c7b8502f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:05.313667 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-afbc4cf0-a43f-4d4e-94fe-67c7b8502f36 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:16:05.314975 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-afbc4cf0-a43f-4d4e-94fe-67c7b8502f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:16:05.341882 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2086/4168] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 01:16:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:16:05.360912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a666d5-f30a-4a71-ab03-f4186f0cf507 service swift] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:05.380068 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a666d5-f30a-4a71-ab03-f4186f0cf507 service swift] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:05.410337 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6acdc1-8f28-40e6-9104-979c67d93955 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:05.411614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6acdc1-8f28-40e6-9104-979c67d93955 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:05.412080 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6acdc1-8f28-40e6-9104-979c67d93955 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:05.412693 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6acdc1-8f28-40e6-9104-979c67d93955 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:05.435022 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6acdc1-8f28-40e6-9104-979c67d93955 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:05.436830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6acdc1-8f28-40e6-9104-979c67d93955 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:05.469626 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2083/4169] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:16:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:16:05.718996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daccaa2-716c-468c-88ec-61dde76d4859 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:05.719854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daccaa2-716c-468c-88ec-61dde76d4859 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:05.720445 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daccaa2-716c-468c-88ec-61dde76d4859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:05.754894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-9daccaa2-716c-468c-88ec-61dde76d4859 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:16:05.756784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9daccaa2-716c-468c-88ec-61dde76d4859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:16:05.767884 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2087/4170] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 01:16:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:16:05.786855 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6acdc1-8f28-40e6-9104-979c67d93955 service swift] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:05.811086 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6acdc1-8f28-40e6-9104-979c67d93955 service swift] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:05.841474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0debf-dddc-4fac-8f29-dcfa47f52d33 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:05.843881 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0debf-dddc-4fac-8f29-dcfa47f52d33 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:05.844452 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0debf-dddc-4fac-8f29-dcfa47f52d33 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:05.844950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0debf-dddc-4fac-8f29-dcfa47f52d33 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:05.875112 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea0debf-dddc-4fac-8f29-dcfa47f52d33 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:05.878067 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea0debf-dddc-4fac-8f29-dcfa47f52d33 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:05.921670 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2084/4171] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:16:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:16:06.096538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6f81b-e4fc-45fd-ae2e-7a8b2fd48dfe None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:06.097760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6f81b-e4fc-45fd-ae2e-7a8b2fd48dfe None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:06.098032 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6f81b-e4fc-45fd-ae2e-7a8b2fd48dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:06.119698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-d6f6f81b-e4fc-45fd-ae2e-7a8b2fd48dfe None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:16:06.121164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d6f6f81b-e4fc-45fd-ae2e-7a8b2fd48dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:16:06.134648 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2088/4172] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 01:16:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:16:06.145585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0debf-dddc-4fac-8f29-dcfa47f52d33 service swift] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:06.160632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0debf-dddc-4fac-8f29-dcfa47f52d33 service swift] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:06.166671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b292b-4ea6-47ab-81fa-54e6c3d7e076 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:06.167563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b292b-4ea6-47ab-81fa-54e6c3d7e076 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:06.168042 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b292b-4ea6-47ab-81fa-54e6c3d7e076 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:06.168479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b292b-4ea6-47ab-81fa-54e6c3d7e076 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:06.181295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b292b-4ea6-47ab-81fa-54e6c3d7e076 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:06.183348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b292b-4ea6-47ab-81fa-54e6c3d7e076 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:06.192885 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2085/4173] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:16:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:16:06.407660 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a2273-8885-44de-9c5c-237dfd01d91e None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:06.410658 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a2273-8885-44de-9c5c-237dfd01d91e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:06.411152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a2273-8885-44de-9c5c-237dfd01d91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:06.459232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-719a2273-8885-44de-9c5c-237dfd01d91e None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:16:06.461893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-719a2273-8885-44de-9c5c-237dfd01d91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:16:06.480926 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2089/4174] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 01:16:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:16:06.493154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b292b-4ea6-47ab-81fa-54e6c3d7e076 service swift] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:06.504851 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b292b-4ea6-47ab-81fa-54e6c3d7e076 service swift] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:06.516544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7a1b9-0d52-4b52-a965-d65073b1b5c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:06.517625 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7a1b9-0d52-4b52-a965-d65073b1b5c1 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:06.518090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7a1b9-0d52-4b52-a965-d65073b1b5c1 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:06.518751 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7a1b9-0d52-4b52-a965-d65073b1b5c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:06.544969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d7a1b9-0d52-4b52-a965-d65073b1b5c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:06.547010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d7a1b9-0d52-4b52-a965-d65073b1b5c1 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:06.562440 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2086/4175] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:16:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:16:06.828182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcb883-aee9-4cce-a2fc-e54659ad0357 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:06.829797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcb883-aee9-4cce-a2fc-e54659ad0357 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:06.830259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcb883-aee9-4cce-a2fc-e54659ad0357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:06.885181 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-bcdcb883-aee9-4cce-a2fc-e54659ad0357 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:16:06.886505 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-bcdcb883-aee9-4cce-a2fc-e54659ad0357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:16:06.911165 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2090/4176] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 01:16:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:16:06.929366 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7a1b9-0d52-4b52-a965-d65073b1b5c1 service swift] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:06.952304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7a1b9-0d52-4b52-a965-d65073b1b5c1 service swift] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:06.966822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972cd3f4-574d-4cba-ad11-d7f774bcbb74 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:06.968473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cd3f4-574d-4cba-ad11-d7f774bcbb74 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:06.968784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cd3f4-574d-4cba-ad11-d7f774bcbb74 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:06.969036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cd3f4-574d-4cba-ad11-d7f774bcbb74 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:07.002636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972cd3f4-574d-4cba-ad11-d7f774bcbb74 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:07.004788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972cd3f4-574d-4cba-ad11-d7f774bcbb74 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:07.029535 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2087/4177] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:16:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:16:07.240358 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcb883-aee9-4cce-a2fc-e54659ad0357 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:07.260061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcb883-aee9-4cce-a2fc-e54659ad0357 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:07.277387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b079d-367f-4012-a4ee-fdefd70892d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:07.278342 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b079d-367f-4012-a4ee-fdefd70892d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:07.278876 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b079d-367f-4012-a4ee-fdefd70892d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:07.279260 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b079d-367f-4012-a4ee-fdefd70892d1 admin admin] PATH_INFO: `/v3/users/eab6175e4abc44b78312a155f8f2c59a` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:07.285206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b079d-367f-4012-a4ee-fdefd70892d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eab6175e4abc44b78312a155f8f2c59a)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:07.287739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b079d-367f-4012-a4ee-fdefd70892d1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:07.440982 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-456b079d-367f-4012-a4ee-fdefd70892d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eab6175e4abc44b78312a155f8f2c59a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:16:07.444047 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-456b079d-367f-4012-a4ee-fdefd70892d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eab6175e4abc44b78312a155f8f2c59a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:16:07.469354 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-456b079d-367f-4012-a4ee-fdefd70892d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eab6175e4abc44b78312a155f8f2c59a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:16:07.499391 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-456b079d-367f-4012-a4ee-fdefd70892d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eab6175e4abc44b78312a155f8f2c59a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:16:07.500473 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-456b079d-367f-4012-a4ee-fdefd70892d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eab6175e4abc44b78312a155f8f2c59a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:16:07.535107 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:16:07.540809 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2091/4178] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:16:07 2022] DELETE /identity/v3/users/eab6175e4abc44b78312a155f8f2c59a => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:16:07.545354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd487e-0c7a-44d6-9b85-aac038d7f1f3 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:07.545664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd487e-0c7a-44d6-9b85-aac038d7f1f3 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:07.546117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd487e-0c7a-44d6-9b85-aac038d7f1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:07.573343 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:16:07.584775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-07bd487e-0c7a-44d6-9b85-aac038d7f1f3 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:16:07.586358 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-07bd487e-0c7a-44d6-9b85-aac038d7f1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:16:07.754892 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2088/4179] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:16:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:16:07.845093 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b079d-367f-4012-a4ee-fdefd70892d1 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:07.848787 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-456b079d-367f-4012-a4ee-fdefd70892d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:16:07.926408 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b079d-367f-4012-a4ee-fdefd70892d1 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:07.935938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c7394-591f-4e2a-a8b5-2a696f0d6d85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:07.936968 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c7394-591f-4e2a-a8b5-2a696f0d6d85 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:07.937507 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c7394-591f-4e2a-a8b5-2a696f0d6d85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:07.937985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c7394-591f-4e2a-a8b5-2a696f0d6d85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:07.957701 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c7394-591f-4e2a-a8b5-2a696f0d6d85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:07.959611 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c7394-591f-4e2a-a8b5-2a696f0d6d85 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:08.004482 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2092/4180] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:16:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:16:09.619560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd487e-0c7a-44d6-9b85-aac038d7f1f3 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:09.622616 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-07bd487e-0c7a-44d6-9b85-aac038d7f1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:16:09.680154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd487e-0c7a-44d6-9b85-aac038d7f1f3 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:09.702583 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d88087-1a62-4f1b-8629-309ef17fbddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:09.702583 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d88087-1a62-4f1b-8629-309ef17fbddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:09.702583 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d88087-1a62-4f1b-8629-309ef17fbddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:09.702583 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d88087-1a62-4f1b-8629-309ef17fbddd admin admin] PATH_INFO: `/v3/projects/4898ed470caf4ddd8d68c2631872c6ab` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:09.717050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d88087-1a62-4f1b-8629-309ef17fbddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4898ed470caf4ddd8d68c2631872c6ab)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:09.724921 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d88087-1a62-4f1b-8629-309ef17fbddd admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:09.814817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a3d88087-1a62-4f1b-8629-309ef17fbddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4898ed470caf4ddd8d68c2631872c6ab', 'request_id': 'req-a3d88087-1a62-4f1b-8629-309ef17fbddd'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:16:09.827164 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a3d88087-1a62-4f1b-8629-309ef17fbddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4898ed470caf4ddd8d68c2631872c6ab', 'request_id': 'req-a3d88087-1a62-4f1b-8629-309ef17fbddd'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:16:09.861502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a3d88087-1a62-4f1b-8629-309ef17fbddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4898ed470caf4ddd8d68c2631872c6ab', 'request_id': 'req-a3d88087-1a62-4f1b-8629-309ef17fbddd'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:16:09.906653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a3d88087-1a62-4f1b-8629-309ef17fbddd admin admin] The token cache is being invalidate because project 4898ed470caf4ddd8d68c2631872c6ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:16:09.907386 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a3d88087-1a62-4f1b-8629-309ef17fbddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:16:09.910000 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a3d88087-1a62-4f1b-8629-309ef17fbddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:16:09.915683 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2089/4181] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:16:09 2022] DELETE /identity/v3/projects/4898ed470caf4ddd8d68c2631872c6ab => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:16:09.923309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37545f93-8159-4e1e-ab8e-204368ef643a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:09.923879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37545f93-8159-4e1e-ab8e-204368ef643a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:09.923879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37545f93-8159-4e1e-ab8e-204368ef643a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:09.997421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-37545f93-8159-4e1e-ab8e-204368ef643a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:16:09.999425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-37545f93-8159-4e1e-ab8e-204368ef643a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:16:10.210057 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2093/4182] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:16:10.219998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ab96a-e090-409e-ac84-476a190dcf4d None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:10.220311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ab96a-e090-409e-ac84-476a190dcf4d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:10.220756 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ab96a-e090-409e-ac84-476a190dcf4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:10.263763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c93ab96a-e090-409e-ac84-476a190dcf4d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:16:10.265461 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c93ab96a-e090-409e-ac84-476a190dcf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:16:10.292608 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2090/4183] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:16:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:16:10.297354 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37545f93-8159-4e1e-ab8e-204368ef643a None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:10.310985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37545f93-8159-4e1e-ab8e-204368ef643a None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:10.320610 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c7191-2230-461c-8957-eed11cb01df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:10.321538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c7191-2230-461c-8957-eed11cb01df0 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:10.321979 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c7191-2230-461c-8957-eed11cb01df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:10.322410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c7191-2230-461c-8957-eed11cb01df0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:10.323245 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c7191-2230-461c-8957-eed11cb01df0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:16:10.323707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c7191-2230-461c-8957-eed11cb01df0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:10.325503 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c7191-2230-461c-8957-eed11cb01df0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:10.351492 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2094/4184] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:16:10.352390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ab96a-e090-409e-ac84-476a190dcf4d None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:10.367888 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ab96a-e090-409e-ac84-476a190dcf4d None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:10.376624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50344c6f-f9ff-459e-9d5d-b5f19340fe17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:10.377203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50344c6f-f9ff-459e-9d5d-b5f19340fe17 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:10.377537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50344c6f-f9ff-459e-9d5d-b5f19340fe17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:10.377818 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50344c6f-f9ff-459e-9d5d-b5f19340fe17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:10.378742 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50344c6f-f9ff-459e-9d5d-b5f19340fe17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:10.381929 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50344c6f-f9ff-459e-9d5d-b5f19340fe17 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:10.429577 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2091/4185] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:16:10 2022] POST /identity/v3/projects => generated 357 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:16:10.433517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c7191-2230-461c-8957-eed11cb01df0 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:10.451841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c7191-2230-461c-8957-eed11cb01df0 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:10.564204 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae41189-70b4-4793-8dc9-54787ff5cd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:10.565265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae41189-70b4-4793-8dc9-54787ff5cd7b admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:10.565932 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae41189-70b4-4793-8dc9-54787ff5cd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:10.566372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae41189-70b4-4793-8dc9-54787ff5cd7b admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:10.567183 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae41189-70b4-4793-8dc9-54787ff5cd7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:10.569607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae41189-70b4-4793-8dc9-54787ff5cd7b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:10.600450 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2095/4186] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:16:10 2022] POST /identity/v3/users => generated 279 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:16:10.604026 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50344c6f-f9ff-459e-9d5d-b5f19340fe17 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:10.617368 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50344c6f-f9ff-459e-9d5d-b5f19340fe17 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:10.623560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e0818-fa66-4121-868f-1b827c8e3694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:10.625109 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e0818-fa66-4121-868f-1b827c8e3694 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:10.625685 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e0818-fa66-4121-868f-1b827c8e3694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:10.626187 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e0818-fa66-4121-868f-1b827c8e3694 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:10.627422 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e0818-fa66-4121-868f-1b827c8e3694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:10.629403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e0818-fa66-4121-868f-1b827c8e3694 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:10.643326 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2092/4187] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:16:10.647685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae41189-70b4-4793-8dc9-54787ff5cd7b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:10.663006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae41189-70b4-4793-8dc9-54787ff5cd7b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:10.677426 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e0015-9bc0-438b-be4c-d6eba7ace91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:10.680538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e0015-9bc0-438b-be4c-d6eba7ace91e admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:10.680963 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e0015-9bc0-438b-be4c-d6eba7ace91e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:10.681362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e0015-9bc0-438b-be4c-d6eba7ace91e admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:10.683043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e0015-9bc0-438b-be4c-d6eba7ace91e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:10.688496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e0015-9bc0-438b-be4c-d6eba7ace91e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:10.737809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e0818-fa66-4121-868f-1b827c8e3694 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:10.745955 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2096/4188] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:16:10.750807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e0818-fa66-4121-868f-1b827c8e3694 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:10.764149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d3e3f-8a8a-4692-912c-6e038e167584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:10.766768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d3e3f-8a8a-4692-912c-6e038e167584 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:10.767425 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d3e3f-8a8a-4692-912c-6e038e167584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:10.770019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d3e3f-8a8a-4692-912c-6e038e167584 admin admin] PATH_INFO: `/v3/projects/c4fa340a63054b9396db37ba831ac66c/users/a47cef0e296b408887660ad07e056920/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:10.809426 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d3e3f-8a8a-4692-912c-6e038e167584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4fa340a63054b9396db37ba831ac66c, user_id=a47cef0e296b408887660ad07e056920, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:10.813090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d3e3f-8a8a-4692-912c-6e038e167584 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:10.844653 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2093/4189] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:16:10 2022] PUT /identity/v3/projects/c4fa340a63054b9396db37ba831ac66c/users/a47cef0e296b408887660ad07e056920/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:16:10.860011 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2db722-45e1-4f3c-b78b-9aa34087a34d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:10.860340 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2db722-45e1-4f3c-b78b-9aa34087a34d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:10.860754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2db722-45e1-4f3c-b78b-9aa34087a34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:10.907739 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:16:10.934165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-5e2db722-45e1-4f3c-b78b-9aa34087a34d None None] MFA Rules not processed for user `a47cef0e296b408887660ad07e056920`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:16:10.935614 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5e2db722-45e1-4f3c-b78b-9aa34087a34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:16:11.023631 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2097/4190] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:16:10 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:16:11.027976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d3e3f-8a8a-4692-912c-6e038e167584 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:11.089890 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:16:11.149713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d3e3f-8a8a-4692-912c-6e038e167584 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:11.156713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915cd26e-158f-41b2-89c2-25e860bfad2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:11.157633 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915cd26e-158f-41b2-89c2-25e860bfad2e admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:11.158124 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915cd26e-158f-41b2-89c2-25e860bfad2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:11.158580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915cd26e-158f-41b2-89c2-25e860bfad2e admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:11.160121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915cd26e-158f-41b2-89c2-25e860bfad2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:11.162380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915cd26e-158f-41b2-89c2-25e860bfad2e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:11.212969 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2094/4191] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:16:11 2022] POST /identity/v3/projects => generated 355 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:16:11.214725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2db722-45e1-4f3c-b78b-9aa34087a34d None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:11.231867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2db722-45e1-4f3c-b78b-9aa34087a34d None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:11.418466 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91127f4-4570-4ff8-8514-eca40cbf2271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:11.423557 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91127f4-4570-4ff8-8514-eca40cbf2271 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:11.423796 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91127f4-4570-4ff8-8514-eca40cbf2271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:11.425266 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91127f4-4570-4ff8-8514-eca40cbf2271 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:11.427703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91127f4-4570-4ff8-8514-eca40cbf2271 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:11.429868 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91127f4-4570-4ff8-8514-eca40cbf2271 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:11.529661 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2098/4192] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:16:11 2022] POST /identity/v3/users => generated 284 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:16:11.531919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915cd26e-158f-41b2-89c2-25e860bfad2e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:11.551320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915cd26e-158f-41b2-89c2-25e860bfad2e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:11.577488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e3bc9-1e5f-4421-a52d-c5a4c62cf45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:11.578203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e3bc9-1e5f-4421-a52d-c5a4c62cf45a admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:11.578484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e3bc9-1e5f-4421-a52d-c5a4c62cf45a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:11.578753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e3bc9-1e5f-4421-a52d-c5a4c62cf45a admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:11.579421 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e3bc9-1e5f-4421-a52d-c5a4c62cf45a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:11.582099 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e3bc9-1e5f-4421-a52d-c5a4c62cf45a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:11.600924 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2095/4193] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:16:11.601833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91127f4-4570-4ff8-8514-eca40cbf2271 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:11.619021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91127f4-4570-4ff8-8514-eca40cbf2271 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:11.626911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff914a-480e-4df2-9f35-3a5b439c66ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:11.629329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff914a-480e-4df2-9f35-3a5b439c66ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:11.629720 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff914a-480e-4df2-9f35-3a5b439c66ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:11.630064 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff914a-480e-4df2-9f35-3a5b439c66ac admin admin] PATH_INFO: `/v3/projects/ab2d9991c7784cd1b40000f7bd0dff1c/users/c955e1030b9f405c8191fa698ddf4b79/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:11.662157 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff914a-480e-4df2-9f35-3a5b439c66ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab2d9991c7784cd1b40000f7bd0dff1c, user_id=c955e1030b9f405c8191fa698ddf4b79, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:11.665789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff914a-480e-4df2-9f35-3a5b439c66ac admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:11.716670 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2099/4194] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:16:11 2022] PUT /identity/v3/projects/ab2d9991c7784cd1b40000f7bd0dff1c/users/c955e1030b9f405c8191fa698ddf4b79/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:16:11.720727 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e3bc9-1e5f-4421-a52d-c5a4c62cf45a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:11.743466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e3bc9-1e5f-4421-a52d-c5a4c62cf45a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:11.874427 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6416f-6282-4bb6-b89d-419b1dfdb085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:11.874967 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6416f-6282-4bb6-b89d-419b1dfdb085 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:11.875443 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6416f-6282-4bb6-b89d-419b1dfdb085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:11.875820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6416f-6282-4bb6-b89d-419b1dfdb085 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:11.876655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6416f-6282-4bb6-b89d-419b1dfdb085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:11.879978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6416f-6282-4bb6-b89d-419b1dfdb085 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:11.896103 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2096/4195] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:16:11.900316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff914a-480e-4df2-9f35-3a5b439c66ac admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:11.915517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff914a-480e-4df2-9f35-3a5b439c66ac admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:11.931656 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6abf6d-380a-41c7-ac33-70d0d937fd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:11.932336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6abf6d-380a-41c7-ac33-70d0d937fd75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:11.932617 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6abf6d-380a-41c7-ac33-70d0d937fd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:11.932996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6abf6d-380a-41c7-ac33-70d0d937fd75 admin admin] PATH_INFO: `/v3/projects/ab2d9991c7784cd1b40000f7bd0dff1c/users/c955e1030b9f405c8191fa698ddf4b79/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:11.935126 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6abf6d-380a-41c7-ac33-70d0d937fd75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab2d9991c7784cd1b40000f7bd0dff1c, user_id=c955e1030b9f405c8191fa698ddf4b79, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:11.937949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6abf6d-380a-41c7-ac33-70d0d937fd75 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:11.950003 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2100/4196] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:16:11 2022] PUT /identity/v3/projects/ab2d9991c7784cd1b40000f7bd0dff1c/users/c955e1030b9f405c8191fa698ddf4b79/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:16:11.965950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2503eeb-9459-4dfc-9a8f-2e20c2e7f2ed None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:11.965950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2503eeb-9459-4dfc-9a8f-2e20c2e7f2ed None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:11.965950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2503eeb-9459-4dfc-9a8f-2e20c2e7f2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:11.995829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c2503eeb-9459-4dfc-9a8f-2e20c2e7f2ed None None] MFA Rules not processed for user `c955e1030b9f405c8191fa698ddf4b79`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:16:11.997917 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c2503eeb-9459-4dfc-9a8f-2e20c2e7f2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:16:12.083893 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2097/4197] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:16:11 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:16:12.084645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6abf6d-380a-41c7-ac33-70d0d937fd75 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:12.099336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6abf6d-380a-41c7-ac33-70d0d937fd75 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:12.104861 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f5492-0e5f-4627-bd2b-c1a4919f28c0 tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c955e1030b9f405c8191fa698ddf4b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2d9991c7784cd1b40000f7bd0dff1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:12.105667 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f5492-0e5f-4627-bd2b-c1a4919f28c0 tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:12.105993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f5492-0e5f-4627-bd2b-c1a4919f28c0 tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:12.106317 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f5492-0e5f-4627-bd2b-c1a4919f28c0 tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:12.107013 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f5492-0e5f-4627-bd2b-c1a4919f28c0 tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:16:12.107319 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f5492-0e5f-4627-bd2b-c1a4919f28c0 tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:12.109602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f5492-0e5f-4627-bd2b-c1a4919f28c0 tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:12.129495 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2101/4198] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:16:12.131455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2503eeb-9459-4dfc-9a8f-2e20c2e7f2ed None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:12.144507 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2503eeb-9459-4dfc-9a8f-2e20c2e7f2ed None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:12.150928 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5fa3d-f88f-4f46-a1a0-46239b33dc27 tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c955e1030b9f405c8191fa698ddf4b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2d9991c7784cd1b40000f7bd0dff1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:12.151487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5fa3d-f88f-4f46-a1a0-46239b33dc27 tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:12.151778 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5fa3d-f88f-4f46-a1a0-46239b33dc27 tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:12.152059 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5fa3d-f88f-4f46-a1a0-46239b33dc27 tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:12.152811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5fa3d-f88f-4f46-a1a0-46239b33dc27 tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:12.155415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5fa3d-f88f-4f46-a1a0-46239b33dc27 tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:12.186125 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:16:12.234459 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2098/4199] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:16:12 2022] POST /identity/v3/projects => generated 349 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:16:12.238326 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f5492-0e5f-4627-bd2b-c1a4919f28c0 tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:12.259132 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f5492-0e5f-4627-bd2b-c1a4919f28c0 tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:12.325031 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:16:12.353069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6092c9c-38f1-4ae8-9a04-c9e8dac51c3f tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c955e1030b9f405c8191fa698ddf4b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2d9991c7784cd1b40000f7bd0dff1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:12.353782 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6092c9c-38f1-4ae8-9a04-c9e8dac51c3f tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:12.354059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6092c9c-38f1-4ae8-9a04-c9e8dac51c3f tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:12.354328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6092c9c-38f1-4ae8-9a04-c9e8dac51c3f tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:12.354994 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6092c9c-38f1-4ae8-9a04-c9e8dac51c3f tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:16:12.355306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6092c9c-38f1-4ae8-9a04-c9e8dac51c3f tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:12.356994 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6092c9c-38f1-4ae8-9a04-c9e8dac51c3f tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:12.395858 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2102/4200] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:16:12.415328 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5fa3d-f88f-4f46-a1a0-46239b33dc27 tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:12.417401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-64b5fa3d-f88f-4f46-a1a0-46239b33dc27 tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:16:12.507393 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5fa3d-f88f-4f46-a1a0-46239b33dc27 tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:12.512423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4bce58-0001-4945-8017-0a9209ab4455 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:12.513280 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4bce58-0001-4945-8017-0a9209ab4455 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:12.513763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4bce58-0001-4945-8017-0a9209ab4455 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:12.514289 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4bce58-0001-4945-8017-0a9209ab4455 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:12.527857 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4bce58-0001-4945-8017-0a9209ab4455 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:12.529577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4bce58-0001-4945-8017-0a9209ab4455 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:12.541408 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2099/4201] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:16:12 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:16:12.713251 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6092c9c-38f1-4ae8-9a04-c9e8dac51c3f tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:12.725484 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6092c9c-38f1-4ae8-9a04-c9e8dac51c3f tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:12.730764 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f1f78-fb89-4404-8f53-211d8c8d5aa9 tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c955e1030b9f405c8191fa698ddf4b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2d9991c7784cd1b40000f7bd0dff1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:12.732109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f1f78-fb89-4404-8f53-211d8c8d5aa9 tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:12.732473 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f1f78-fb89-4404-8f53-211d8c8d5aa9 tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:12.732803 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f1f78-fb89-4404-8f53-211d8c8d5aa9 tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] PATH_INFO: `/v3/projects/2ed2d9462b054f938e804f54d5c0a544` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:12.734142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f1f78-fb89-4404-8f53-211d8c8d5aa9 tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2ed2d9462b054f938e804f54d5c0a544)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:12.736443 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f1f78-fb89-4404-8f53-211d8c8d5aa9 tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:12.791981 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-148f1f78-fb89-4404-8f53-211d8c8d5aa9 tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ed2d9462b054f938e804f54d5c0a544', 'request_id': 'req-148f1f78-fb89-4404-8f53-211d8c8d5aa9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:16:12.801670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-148f1f78-fb89-4404-8f53-211d8c8d5aa9 tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ed2d9462b054f938e804f54d5c0a544', 'request_id': 'req-148f1f78-fb89-4404-8f53-211d8c8d5aa9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:16:12.809808 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-148f1f78-fb89-4404-8f53-211d8c8d5aa9 tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ed2d9462b054f938e804f54d5c0a544', 'request_id': 'req-148f1f78-fb89-4404-8f53-211d8c8d5aa9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:16:12.824543 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-148f1f78-fb89-4404-8f53-211d8c8d5aa9 tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] The token cache is being invalidate because project 2ed2d9462b054f938e804f54d5c0a544 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:16:12.824543 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-148f1f78-fb89-4404-8f53-211d8c8d5aa9 tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:16:12.825882 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-148f1f78-fb89-4404-8f53-211d8c8d5aa9 tempest-QuotasTest-414895316 tempest-QuotasTest-414895316-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:16:12.830882 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2103/4202] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:16:12 2022] DELETE /identity/v3/projects/2ed2d9462b054f938e804f54d5c0a544 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:16:12.945289 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4bce58-0001-4945-8017-0a9209ab4455 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:13.044467 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4bce58-0001-4945-8017-0a9209ab4455 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:13.121686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2036711-e1ab-472d-ba7e-78124638e468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:13.122492 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2036711-e1ab-472d-ba7e-78124638e468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:13.122997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2036711-e1ab-472d-ba7e-78124638e468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:13.123368 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2036711-e1ab-472d-ba7e-78124638e468 admin admin] PATH_INFO: `/v3/users/a47cef0e296b408887660ad07e056920` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:13.124701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2036711-e1ab-472d-ba7e-78124638e468 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a47cef0e296b408887660ad07e056920)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:13.126893 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2036711-e1ab-472d-ba7e-78124638e468 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:13.216681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c2036711-e1ab-472d-ba7e-78124638e468 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a47cef0e296b408887660ad07e056920'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:16:13.218620 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c2036711-e1ab-472d-ba7e-78124638e468 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a47cef0e296b408887660ad07e056920'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:16:13.227535 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:16:13.233154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c2036711-e1ab-472d-ba7e-78124638e468 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a47cef0e296b408887660ad07e056920'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:16:13.257057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c2036711-e1ab-472d-ba7e-78124638e468 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a47cef0e296b408887660ad07e056920'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:16:13.257618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c2036711-e1ab-472d-ba7e-78124638e468 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a47cef0e296b408887660ad07e056920'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:16:13.298300 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2100/4203] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:16:12 2022] DELETE /identity/v3/users/a47cef0e296b408887660ad07e056920 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:16:13.303067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c7524-f337-4fe0-82bf-4146bbbc9597 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:13.303978 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c7524-f337-4fe0-82bf-4146bbbc9597 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:13.304353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c7524-f337-4fe0-82bf-4146bbbc9597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:13.356731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ef4c7524-f337-4fe0-82bf-4146bbbc9597 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:16:13.358424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ef4c7524-f337-4fe0-82bf-4146bbbc9597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:16:13.450422 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2104/4204] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:16:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:16:13.501083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2036711-e1ab-472d-ba7e-78124638e468 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:13.504023 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c2036711-e1ab-472d-ba7e-78124638e468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:16:13.607882 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2036711-e1ab-472d-ba7e-78124638e468 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:13.614749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0244de8-140b-4faa-8074-7b6098d95ac8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:13.618316 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0244de8-140b-4faa-8074-7b6098d95ac8 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:13.622294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0244de8-140b-4faa-8074-7b6098d95ac8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:13.624807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0244de8-140b-4faa-8074-7b6098d95ac8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:13.658549 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0244de8-140b-4faa-8074-7b6098d95ac8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:13.660155 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0244de8-140b-4faa-8074-7b6098d95ac8 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:13.674101 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2101/4205] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:16:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:16:14.927337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c7524-f337-4fe0-82bf-4146bbbc9597 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:14.929490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ef4c7524-f337-4fe0-82bf-4146bbbc9597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:16:14.947649 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c7524-f337-4fe0-82bf-4146bbbc9597 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:14.953749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7ad0b-7e5c-4d38-95f7-0b4b03447e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:14.981503 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7ad0b-7e5c-4d38-95f7-0b4b03447e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:14.982049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7ad0b-7e5c-4d38-95f7-0b4b03447e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:14.982383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7ad0b-7e5c-4d38-95f7-0b4b03447e7b admin admin] PATH_INFO: `/v3/projects/c4fa340a63054b9396db37ba831ac66c` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:14.986247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab7ad0b-7e5c-4d38-95f7-0b4b03447e7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4fa340a63054b9396db37ba831ac66c)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:14.992624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab7ad0b-7e5c-4d38-95f7-0b4b03447e7b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:15.104185 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8ab7ad0b-7e5c-4d38-95f7-0b4b03447e7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4fa340a63054b9396db37ba831ac66c', 'request_id': 'req-8ab7ad0b-7e5c-4d38-95f7-0b4b03447e7b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:16:15.107487 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:16:15.119113 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8ab7ad0b-7e5c-4d38-95f7-0b4b03447e7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4fa340a63054b9396db37ba831ac66c', 'request_id': 'req-8ab7ad0b-7e5c-4d38-95f7-0b4b03447e7b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:16:15.127471 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8ab7ad0b-7e5c-4d38-95f7-0b4b03447e7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4fa340a63054b9396db37ba831ac66c', 'request_id': 'req-8ab7ad0b-7e5c-4d38-95f7-0b4b03447e7b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:16:15.142744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8ab7ad0b-7e5c-4d38-95f7-0b4b03447e7b admin admin] The token cache is being invalidate because project c4fa340a63054b9396db37ba831ac66c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:16:15.142744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8ab7ad0b-7e5c-4d38-95f7-0b4b03447e7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:16:15.143964 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8ab7ad0b-7e5c-4d38-95f7-0b4b03447e7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:16:15.146081 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2105/4206] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:16:14 2022] DELETE /identity/v3/projects/c4fa340a63054b9396db37ba831ac66c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:16:15.150437 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0244de8-140b-4faa-8074-7b6098d95ac8 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:15.162852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0244de8-140b-4faa-8074-7b6098d95ac8 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:15.240547 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dfac49-d840-4f50-b348-d06f67d363dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:15.241180 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfac49-d840-4f50-b348-d06f67d363dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:15.241521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfac49-d840-4f50-b348-d06f67d363dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:15.241750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfac49-d840-4f50-b348-d06f67d363dc admin admin] PATH_INFO: `/v3/users/c955e1030b9f405c8191fa698ddf4b79` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:15.242897 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dfac49-d840-4f50-b348-d06f67d363dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c955e1030b9f405c8191fa698ddf4b79)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:15.244785 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dfac49-d840-4f50-b348-d06f67d363dc admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:15.301771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b6dfac49-d840-4f50-b348-d06f67d363dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c955e1030b9f405c8191fa698ddf4b79'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:16:15.302422 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b6dfac49-d840-4f50-b348-d06f67d363dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c955e1030b9f405c8191fa698ddf4b79'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:16:15.309593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b6dfac49-d840-4f50-b348-d06f67d363dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c955e1030b9f405c8191fa698ddf4b79'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:16:15.318219 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b6dfac49-d840-4f50-b348-d06f67d363dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c955e1030b9f405c8191fa698ddf4b79'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:16:15.318982 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b6dfac49-d840-4f50-b348-d06f67d363dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c955e1030b9f405c8191fa698ddf4b79'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:16:15.328023 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:16:15.344691 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2102/4207] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:16:15 2022] DELETE /identity/v3/users/c955e1030b9f405c8191fa698ddf4b79 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:16:15.945497 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7ad0b-7e5c-4d38-95f7-0b4b03447e7b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:15.947020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8ab7ad0b-7e5c-4d38-95f7-0b4b03447e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:16:15.976020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7ad0b-7e5c-4d38-95f7-0b4b03447e7b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:16.042212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486978b3-0e42-474d-b460-22ed08bee612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:16.042859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486978b3-0e42-474d-b460-22ed08bee612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:16.043285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486978b3-0e42-474d-b460-22ed08bee612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:16.043746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486978b3-0e42-474d-b460-22ed08bee612 admin admin] PATH_INFO: `/v3/projects/ab2d9991c7784cd1b40000f7bd0dff1c` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:16.044952 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486978b3-0e42-474d-b460-22ed08bee612 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab2d9991c7784cd1b40000f7bd0dff1c)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:16.047367 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486978b3-0e42-474d-b460-22ed08bee612 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:16.110897 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-486978b3-0e42-474d-b460-22ed08bee612 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab2d9991c7784cd1b40000f7bd0dff1c', 'request_id': 'req-486978b3-0e42-474d-b460-22ed08bee612'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:16:16.122251 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-486978b3-0e42-474d-b460-22ed08bee612 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab2d9991c7784cd1b40000f7bd0dff1c', 'request_id': 'req-486978b3-0e42-474d-b460-22ed08bee612'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:16:16.134135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-486978b3-0e42-474d-b460-22ed08bee612 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab2d9991c7784cd1b40000f7bd0dff1c', 'request_id': 'req-486978b3-0e42-474d-b460-22ed08bee612'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:16:16.172086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-486978b3-0e42-474d-b460-22ed08bee612 admin admin] The token cache is being invalidate because project ab2d9991c7784cd1b40000f7bd0dff1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:16:16.173308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-486978b3-0e42-474d-b460-22ed08bee612 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:16:16.177075 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-486978b3-0e42-474d-b460-22ed08bee612 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:16:16.181367 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2106/4208] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:16:15 2022] DELETE /identity/v3/projects/ab2d9991c7784cd1b40000f7bd0dff1c => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:16:16.188703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c377e9e-107a-4541-bb68-363d88c4907a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:16.189770 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c377e9e-107a-4541-bb68-363d88c4907a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:16.190278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c377e9e-107a-4541-bb68-363d88c4907a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:16.259638 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-6c377e9e-107a-4541-bb68-363d88c4907a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:16:16.265010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6c377e9e-107a-4541-bb68-363d88c4907a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:16:16.305987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2a0ed-7462-48a1-9437-7eff82b4ee7b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:16.308440 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2a0ed-7462-48a1-9437-7eff82b4ee7b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:16.308743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2a0ed-7462-48a1-9437-7eff82b4ee7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:16.391605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-f0c2a0ed-7462-48a1-9437-7eff82b4ee7b None None] MFA Rules not processed for user `6da5161f966c4d61b0c30e78829e5e1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:16:16.392874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f0c2a0ed-7462-48a1-9437-7eff82b4ee7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:16:16.417148 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2103/4209] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:16:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:16:16.435941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8a5a6-ba6a-4529-9cef-7f1c778c2364 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:16.444737 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8a5a6-ba6a-4529-9cef-7f1c778c2364 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:16.444737 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8a5a6-ba6a-4529-9cef-7f1c778c2364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:16.496191 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5bb8a5a6-ba6a-4529-9cef-7f1c778c2364 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:16:16.499401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5bb8a5a6-ba6a-4529-9cef-7f1c778c2364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:16:16.504092 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:16:16.523006 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2107/4210] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:16:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:16:16.524534 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2104/4211] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:16:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:16:16.532019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2a0ed-7462-48a1-9437-7eff82b4ee7b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:16.537909 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8a5a6-ba6a-4529-9cef-7f1c778c2364 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:16.544199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5bb8a5a6-ba6a-4529-9cef-7f1c778c2364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:16:16.548027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2a0ed-7462-48a1-9437-7eff82b4ee7b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:16.563451 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884e5e4-da41-4e3d-9c0a-b9d77d8dcd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:16.564403 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884e5e4-da41-4e3d-9c0a-b9d77d8dcd85 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:16.564783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884e5e4-da41-4e3d-9c0a-b9d77d8dcd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:16.565799 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884e5e4-da41-4e3d-9c0a-b9d77d8dcd85 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:16.566023 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884e5e4-da41-4e3d-9c0a-b9d77d8dcd85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:16:16.566776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884e5e4-da41-4e3d-9c0a-b9d77d8dcd85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:16.568650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884e5e4-da41-4e3d-9c0a-b9d77d8dcd85 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:16.598904 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2108/4212] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:16:16.602545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884e5e4-da41-4e3d-9c0a-b9d77d8dcd85 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:16.620525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884e5e4-da41-4e3d-9c0a-b9d77d8dcd85 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:16.638136 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ceb56f-5fd5-4ae8-b015-5eb47d889b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:16.639019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ceb56f-5fd5-4ae8-b015-5eb47d889b86 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:16.639302 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ceb56f-5fd5-4ae8-b015-5eb47d889b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:16.639568 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ceb56f-5fd5-4ae8-b015-5eb47d889b86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:16.640268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ceb56f-5fd5-4ae8-b015-5eb47d889b86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:16.644555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ceb56f-5fd5-4ae8-b015-5eb47d889b86 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:16.700263 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2109/4213] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:16:16 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:16:16.710536 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ceb56f-5fd5-4ae8-b015-5eb47d889b86 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:16.720394 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8a5a6-ba6a-4529-9cef-7f1c778c2364 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:16.859821 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ceb56f-5fd5-4ae8-b015-5eb47d889b86 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:16.867413 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a6114-304f-4e93-a71a-4f2be98d9907 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:16.867670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a6114-304f-4e93-a71a-4f2be98d9907 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:16.867832 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a6114-304f-4e93-a71a-4f2be98d9907 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:16.868105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a6114-304f-4e93-a71a-4f2be98d9907 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:16.872406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00297b-ad45-4a46-9f7c-4927729c1072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:16.872961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00297b-ad45-4a46-9f7c-4927729c1072 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:16.873238 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00297b-ad45-4a46-9f7c-4927729c1072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:16.873545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00297b-ad45-4a46-9f7c-4927729c1072 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:16.874513 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00297b-ad45-4a46-9f7c-4927729c1072 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:16.878353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00297b-ad45-4a46-9f7c-4927729c1072 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:16.905024 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:16:16.934392 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2110/4214] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:16:16 2022] POST /identity/v3/users => generated 287 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:16:16.936094 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00297b-ad45-4a46-9f7c-4927729c1072 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:16.949584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00297b-ad45-4a46-9f7c-4927729c1072 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:16.957320 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b8416a-4522-439a-b2fb-df27f06cd44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:16.958316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8416a-4522-439a-b2fb-df27f06cd44a admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:16.958864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8416a-4522-439a-b2fb-df27f06cd44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:16.959358 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8416a-4522-439a-b2fb-df27f06cd44a admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:16.960227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b8416a-4522-439a-b2fb-df27f06cd44a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:16.962647 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b8416a-4522-439a-b2fb-df27f06cd44a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:16.984952 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2111/4215] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:16:16.988881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b8416a-4522-439a-b2fb-df27f06cd44a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:16.992163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a6114-304f-4e93-a71a-4f2be98d9907 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:16.995729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a6114-304f-4e93-a71a-4f2be98d9907 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:17.009639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b8416a-4522-439a-b2fb-df27f06cd44a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:17.018152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e515f3-a26a-4a56-b584-b0596dfd878c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:17.019540 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2105/4216] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:16:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:16:17.021466 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e515f3-a26a-4a56-b584-b0596dfd878c admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:17.022157 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e515f3-a26a-4a56-b584-b0596dfd878c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:17.022653 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e515f3-a26a-4a56-b584-b0596dfd878c admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:17.024874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e515f3-a26a-4a56-b584-b0596dfd878c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:17.027999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e515f3-a26a-4a56-b584-b0596dfd878c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:17.045550 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2112/4217] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:16:17.046167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a6114-304f-4e93-a71a-4f2be98d9907 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:17.077399 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a6114-304f-4e93-a71a-4f2be98d9907 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:17.084948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ae880-c522-4f35-a96b-07eff6fb6b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:17.086240 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ae880-c522-4f35-a96b-07eff6fb6b2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:17.086529 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ae880-c522-4f35-a96b-07eff6fb6b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:17.086805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ae880-c522-4f35-a96b-07eff6fb6b2c admin admin] PATH_INFO: `/v3/projects/77104cc2596249759f889b99254dfd4b/users/67e3cf174c3345088e0d1a11ae0bf294/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:17.107850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ae880-c522-4f35-a96b-07eff6fb6b2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=77104cc2596249759f889b99254dfd4b, user_id=67e3cf174c3345088e0d1a11ae0bf294, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:17.111318 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ae880-c522-4f35-a96b-07eff6fb6b2c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:17.158016 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2106/4218] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:16:17 2022] PUT /identity/v3/projects/77104cc2596249759f889b99254dfd4b/users/67e3cf174c3345088e0d1a11ae0bf294/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:16:17.170711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd2184-5223-4029-97f8-8b047654da32 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:17.171439 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd2184-5223-4029-97f8-8b047654da32 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:17.172160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd2184-5223-4029-97f8-8b047654da32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:17.216850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e0cd2184-5223-4029-97f8-8b047654da32 None None] MFA Rules not processed for user `67e3cf174c3345088e0d1a11ae0bf294`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:16:17.218364 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e0cd2184-5223-4029-97f8-8b047654da32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:16:17.338379 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2113/4219] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:16:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:16:17.353948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ae880-c522-4f35-a96b-07eff6fb6b2c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:17.356524 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4d4ae880-c522-4f35-a96b-07eff6fb6b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:16:17.469660 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ce7b0-9d21-49fa-ba96-38bef4c2643c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:17.469955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ce7b0-9d21-49fa-ba96-38bef4c2643c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:17.470334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ce7b0-9d21-49fa-ba96-38bef4c2643c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:17.496655 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a75ce7b0-9d21-49fa-ba96-38bef4c2643c None None] MFA Rules not processed for user `5581a720105c400f8bee8ef53813288b`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:16:17.498270 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a75ce7b0-9d21-49fa-ba96-38bef4c2643c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:16:17.516610 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:16:17.524711 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ae880-c522-4f35-a96b-07eff6fb6b2c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:17.528870 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c4cd0-760f-453a-953f-8e8884e91177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:17.529546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c4cd0-760f-453a-953f-8e8884e91177 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:17.529849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c4cd0-760f-453a-953f-8e8884e91177 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:17.530119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c4cd0-760f-453a-953f-8e8884e91177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:17.551727 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c4cd0-760f-453a-953f-8e8884e91177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:17.553190 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c4cd0-760f-453a-953f-8e8884e91177 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:17.568529 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2107/4220] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:16:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:16:17.588550 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2114/4221] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:16:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:16:18.008663 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c4cd0-760f-453a-953f-8e8884e91177 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:18.012739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-485c4cd0-760f-453a-953f-8e8884e91177 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:16:18.032467 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c4cd0-760f-453a-953f-8e8884e91177 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:18.039832 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1dc0c-2fc7-4392-8242-59ed8db6f116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:18.040514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1dc0c-2fc7-4392-8242-59ed8db6f116 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:18.040863 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1dc0c-2fc7-4392-8242-59ed8db6f116 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:18.041139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1dc0c-2fc7-4392-8242-59ed8db6f116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:18.043562 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2fb1dc0c-2fc7-4392-8242-59ed8db6f116 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:16:18.060729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1dc0c-2fc7-4392-8242-59ed8db6f116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:18.062368 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1dc0c-2fc7-4392-8242-59ed8db6f116 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:18.083197 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2108/4222] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:16:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:16:20.019672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c3135-7e14-4176-8253-7010a5237b62 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:20.020275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c3135-7e14-4176-8253-7010a5237b62 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:20.020275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c3135-7e14-4176-8253-7010a5237b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:20.059786 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e61c3135-7e14-4176-8253-7010a5237b62 None None] MFA Rules not processed for user `6da5161f966c4d61b0c30e78829e5e1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:16:20.066337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e61c3135-7e14-4176-8253-7010a5237b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:16:20.180912 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2115/4223] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:16:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:16:26.052863 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407673d-12a2-4538-a90d-72f8decf0201 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:26.053817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407673d-12a2-4538-a90d-72f8decf0201 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:26.054277 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407673d-12a2-4538-a90d-72f8decf0201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:26.089175 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a407673d-12a2-4538-a90d-72f8decf0201 None None] MFA Rules not processed for user `d531146522f24a368a8c6ab482495776`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:16:26.091199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a407673d-12a2-4538-a90d-72f8decf0201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:16:26.206726 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2109/4224] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:16:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:16:26.728490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922f0b5-f648-4154-b295-a86e79edcb1f None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:26.728947 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922f0b5-f648-4154-b295-a86e79edcb1f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:26.728947 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922f0b5-f648-4154-b295-a86e79edcb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:26.753766 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-9922f0b5-f648-4154-b295-a86e79edcb1f None None] MFA Rules not processed for user `4b1db60cab3d4cda97aebbebd7c2c89f`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:16:26.755970 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9922f0b5-f648-4154-b295-a86e79edcb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:16:26.861936 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2116/4225] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:16:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:16:36.191203 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=85,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:16:36.847563 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=66 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:16:56.217151 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21bfa5-3a70-40f3-b876-d2bb1412a7fd None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:56.218013 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21bfa5-3a70-40f3-b876-d2bb1412a7fd None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:56.218013 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21bfa5-3a70-40f3-b876-d2bb1412a7fd None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:56.219989 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2110/4226] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:16:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:16:56.230449 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf25cf-85d4-40fb-9752-617356abb926 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:56.231268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf25cf-85d4-40fb-9752-617356abb926 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:56.231268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf25cf-85d4-40fb-9752-617356abb926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:56.285419 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-25bf25cf-85d4-40fb-9752-617356abb926 None None] MFA Rules not processed for user `2cdde7a212954a01a2591ad5ac30d049`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:16:56.289248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-25bf25cf-85d4-40fb-9752-617356abb926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:16:56.298883 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2117/4227] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:16:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:16:56.312989 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21bfa5-3a70-40f3-b876-d2bb1412a7fd None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:16:56.334897 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21bfa5-3a70-40f3-b876-d2bb1412a7fd None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:16:56.341403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee9757-f4c2-402d-bbf4-46607e9ce412 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:16:56.341403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee9757-f4c2-402d-bbf4-46607e9ce412 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:16:56.341403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee9757-f4c2-402d-bbf4-46607e9ce412 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:16:56.341403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee9757-f4c2-402d-bbf4-46607e9ce412 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:16:56.358370 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee9757-f4c2-402d-bbf4-46607e9ce412 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:16:56.359835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee9757-f4c2-402d-bbf4-46607e9ce412 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:16:56.380744 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2111/4228] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:16:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:17:04.001805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf25cf-85d4-40fb-9752-617356abb926 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:04.003945 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-25bf25cf-85d4-40fb-9752-617356abb926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:04.135303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf25cf-85d4-40fb-9752-617356abb926 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:04.142988 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6c1c5-f223-43fe-94ec-ae7f06bb412e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:04.144077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6c1c5-f223-43fe-94ec-ae7f06bb412e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:04.145068 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6c1c5-f223-43fe-94ec-ae7f06bb412e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:04.145361 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6c1c5-f223-43fe-94ec-ae7f06bb412e admin admin] PATH_INFO: `/v3/users/4b1db60cab3d4cda97aebbebd7c2c89f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:04.149165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e6c1c5-f223-43fe-94ec-ae7f06bb412e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b1db60cab3d4cda97aebbebd7c2c89f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:04.151838 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e6c1c5-f223-43fe-94ec-ae7f06bb412e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:04.227700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-97e6c1c5-f223-43fe-94ec-ae7f06bb412e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b1db60cab3d4cda97aebbebd7c2c89f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:04.228615 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-97e6c1c5-f223-43fe-94ec-ae7f06bb412e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b1db60cab3d4cda97aebbebd7c2c89f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:04.238587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-97e6c1c5-f223-43fe-94ec-ae7f06bb412e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b1db60cab3d4cda97aebbebd7c2c89f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:04.252780 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-97e6c1c5-f223-43fe-94ec-ae7f06bb412e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b1db60cab3d4cda97aebbebd7c2c89f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:04.255052 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-97e6c1c5-f223-43fe-94ec-ae7f06bb412e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b1db60cab3d4cda97aebbebd7c2c89f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:04.281998 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2118/4229] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:17:04 2022] DELETE /identity/v3/users/4b1db60cab3d4cda97aebbebd7c2c89f => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:17:04.880572 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee9757-f4c2-402d-bbf4-46607e9ce412 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:04.901789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee9757-f4c2-402d-bbf4-46607e9ce412 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:05.072011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcef8ec-6363-4768-9f9f-e2c2249fc281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:05.073173 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcef8ec-6363-4768-9f9f-e2c2249fc281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:05.073716 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcef8ec-6363-4768-9f9f-e2c2249fc281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:05.074217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcef8ec-6363-4768-9f9f-e2c2249fc281 admin admin] PATH_INFO: `/v3/projects/c810047a72ca40cc988767f42a925105` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:05.075655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcef8ec-6363-4768-9f9f-e2c2249fc281 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c810047a72ca40cc988767f42a925105)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:05.077858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcef8ec-6363-4768-9f9f-e2c2249fc281 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:05.154811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0bcef8ec-6363-4768-9f9f-e2c2249fc281 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c810047a72ca40cc988767f42a925105', 'request_id': 'req-0bcef8ec-6363-4768-9f9f-e2c2249fc281'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:05.166707 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0bcef8ec-6363-4768-9f9f-e2c2249fc281 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c810047a72ca40cc988767f42a925105', 'request_id': 'req-0bcef8ec-6363-4768-9f9f-e2c2249fc281'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:05.184945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0bcef8ec-6363-4768-9f9f-e2c2249fc281 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c810047a72ca40cc988767f42a925105', 'request_id': 'req-0bcef8ec-6363-4768-9f9f-e2c2249fc281'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:05.213535 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0bcef8ec-6363-4768-9f9f-e2c2249fc281 admin admin] The token cache is being invalidate because project c810047a72ca40cc988767f42a925105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:17:05.214239 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0bcef8ec-6363-4768-9f9f-e2c2249fc281 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:05.217175 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0bcef8ec-6363-4768-9f9f-e2c2249fc281 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:05.219135 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2112/4230] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:17:04 2022] DELETE /identity/v3/projects/c810047a72ca40cc988767f42a925105 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:17:05.225102 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb73b47-5006-4963-9736-3d89e910bd2e None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:05.225624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb73b47-5006-4963-9736-3d89e910bd2e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:05.225693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb73b47-5006-4963-9736-3d89e910bd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:05.276450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-1bb73b47-5006-4963-9736-3d89e910bd2e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:17:05.279063 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1bb73b47-5006-4963-9736-3d89e910bd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:05.518940 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:17:05.570139 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2119/4231] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:17:05.571443 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c867b92-55a7-4731-a0cf-d45f370f4681 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:05.572009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c867b92-55a7-4731-a0cf-d45f370f4681 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:05.572481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c867b92-55a7-4731-a0cf-d45f370f4681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:05.611434 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-3c867b92-55a7-4731-a0cf-d45f370f4681 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:17:05.613419 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3c867b92-55a7-4731-a0cf-d45f370f4681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:05.627185 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2113/4232] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:17:05.631654 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb73b47-5006-4963-9736-3d89e910bd2e None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:05.633125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a6740-4f7a-4239-99b2-16b3fe67763f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:05.633125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a6740-4f7a-4239-99b2-16b3fe67763f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:05.633125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a6740-4f7a-4239-99b2-16b3fe67763f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:05.648338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb73b47-5006-4963-9736-3d89e910bd2e None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:05.657209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c86ca-9204-456c-adf6-4041563f0c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:05.658125 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c86ca-9204-456c-adf6-4041563f0c49 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:05.658412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c86ca-9204-456c-adf6-4041563f0c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:05.658690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c86ca-9204-456c-adf6-4041563f0c49 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:05.660035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c86ca-9204-456c-adf6-4041563f0c49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:17:05.660598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c86ca-9204-456c-adf6-4041563f0c49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:05.662744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c86ca-9204-456c-adf6-4041563f0c49 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:05.672169 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-0d6a6740-4f7a-4239-99b2-16b3fe67763f None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:17:05.673545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0d6a6740-4f7a-4239-99b2-16b3fe67763f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:05.692489 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2120/4233] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:17:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:17:05.693578 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c86ca-9204-456c-adf6-4041563f0c49 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:05.707684 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c86ca-9204-456c-adf6-4041563f0c49 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:05.721716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ed528-f4ee-4f35-bbc2-8d4d92ccae98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:05.722513 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ed528-f4ee-4f35-bbc2-8d4d92ccae98 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:05.723561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ed528-f4ee-4f35-bbc2-8d4d92ccae98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:05.723757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ed528-f4ee-4f35-bbc2-8d4d92ccae98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:05.724412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ed528-f4ee-4f35-bbc2-8d4d92ccae98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:05.731932 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ed528-f4ee-4f35-bbc2-8d4d92ccae98 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:05.807551 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2121/4234] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:17:05 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:17:05.808663 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ed528-f4ee-4f35-bbc2-8d4d92ccae98 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:05.823670 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2114/4235] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:17:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:17:05.916005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a6740-4f7a-4239-99b2-16b3fe67763f None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:05.919792 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0d6a6740-4f7a-4239-99b2-16b3fe67763f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:05.950584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ed528-f4ee-4f35-bbc2-8d4d92ccae98 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:05.956193 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c2223-c56e-4edb-a702-2d98d54985c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:05.956985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c2223-c56e-4edb-a702-2d98d54985c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:05.957421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c2223-c56e-4edb-a702-2d98d54985c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:05.957870 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c2223-c56e-4edb-a702-2d98d54985c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:05.958676 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c2223-c56e-4edb-a702-2d98d54985c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:05.960781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c2223-c56e-4edb-a702-2d98d54985c1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:05.975119 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:17:05.995672 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2122/4236] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:17:05 2022] POST /identity/v3/users => generated 290 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:17:05.998676 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d63c58-ac4f-491d-a2de-948faddd11b4 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:06.000154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d63c58-ac4f-491d-a2de-948faddd11b4 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:06.000779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d63c58-ac4f-491d-a2de-948faddd11b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:06.069085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-09d63c58-ac4f-491d-a2de-948faddd11b4 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:17:06.072147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-09d63c58-ac4f-491d-a2de-948faddd11b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:06.119873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a6740-4f7a-4239-99b2-16b3fe67763f None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:06.190890 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2123/4237] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 01:17:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:17:06.191963 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d63c58-ac4f-491d-a2de-948faddd11b4 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:06.210021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d63c58-ac4f-491d-a2de-948faddd11b4 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:06.215478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae22d4-07d5-4551-8539-cde4ad0772cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:06.216085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae22d4-07d5-4551-8539-cde4ad0772cf admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:06.216368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae22d4-07d5-4551-8539-cde4ad0772cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:06.216642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae22d4-07d5-4551-8539-cde4ad0772cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:06.217412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae22d4-07d5-4551-8539-cde4ad0772cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:06.221276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae22d4-07d5-4551-8539-cde4ad0772cf admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:06.236777 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2124/4238] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:17:06.238009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae22d4-07d5-4551-8539-cde4ad0772cf admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:06.249053 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f25cca-727f-48f9-a2a2-5c60ca600f54 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:06.250085 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f25cca-727f-48f9-a2a2-5c60ca600f54 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:06.250558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f25cca-727f-48f9-a2a2-5c60ca600f54 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:06.251036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f25cca-727f-48f9-a2a2-5c60ca600f54 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:06.260922 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f25cca-727f-48f9-a2a2-5c60ca600f54 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:06.263044 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f25cca-727f-48f9-a2a2-5c60ca600f54 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:06.294120 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2115/4239] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:17:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:17:06.294842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f25cca-727f-48f9-a2a2-5c60ca600f54 service swift] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:06.334753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f25cca-727f-48f9-a2a2-5c60ca600f54 service swift] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:06.340782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369c6f2-c19d-4cff-8f87-9601723a6ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:06.342143 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369c6f2-c19d-4cff-8f87-9601723a6ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:06.342594 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369c6f2-c19d-4cff-8f87-9601723a6ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:06.343004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369c6f2-c19d-4cff-8f87-9601723a6ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:06.346050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369c6f2-c19d-4cff-8f87-9601723a6ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:06.349232 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369c6f2-c19d-4cff-8f87-9601723a6ae8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:06.351582 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:17:06.365736 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2116/4240] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:17:06.370067 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369c6f2-c19d-4cff-8f87-9601723a6ae8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:06.387869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369c6f2-c19d-4cff-8f87-9601723a6ae8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:06.401280 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3921c-eb3d-47bd-ac11-1d51722aaace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:06.402113 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3921c-eb3d-47bd-ac11-1d51722aaace admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:06.403541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3921c-eb3d-47bd-ac11-1d51722aaace admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:06.403949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3921c-eb3d-47bd-ac11-1d51722aaace admin admin] PATH_INFO: `/v3/projects/9b5441e8fb3a497cac2ef7ee1f668e30/users/db86ff7784ef472b8e586aacb4db8767/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:06.427751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae22d4-07d5-4551-8539-cde4ad0772cf admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:06.443734 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2eade-2c8d-4a2a-8222-d412cce8b3c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:06.446141 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2eade-2c8d-4a2a-8222-d412cce8b3c2 service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:06.446141 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2eade-2c8d-4a2a-8222-d412cce8b3c2 service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:06.446141 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2eade-2c8d-4a2a-8222-d412cce8b3c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:06.451101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3921c-eb3d-47bd-ac11-1d51722aaace admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b5441e8fb3a497cac2ef7ee1f668e30, user_id=db86ff7784ef472b8e586aacb4db8767, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:06.457945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3921c-eb3d-47bd-ac11-1d51722aaace admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:06.476573 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2eade-2c8d-4a2a-8222-d412cce8b3c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:06.479188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2eade-2c8d-4a2a-8222-d412cce8b3c2 service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:06.495149 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2117/4241] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:17:06 2022] PUT /identity/v3/projects/9b5441e8fb3a497cac2ef7ee1f668e30/users/db86ff7784ef472b8e586aacb4db8767/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:17:06.507879 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2203ea9-cc9c-47ef-bc85-0a1a409d745a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:06.508198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2203ea9-cc9c-47ef-bc85-0a1a409d745a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:06.508489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2203ea9-cc9c-47ef-bc85-0a1a409d745a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:06.523352 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2125/4242] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:17:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:17:06.585061 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d2203ea9-cc9c-47ef-bc85-0a1a409d745a None None] MFA Rules not processed for user `db86ff7784ef472b8e586aacb4db8767`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:17:06.590294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d2203ea9-cc9c-47ef-bc85-0a1a409d745a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:06.849873 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2118/4243] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:17:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:17:06.854760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27798431-ef86-4eb1-9aeb-4b2bd36e96fb None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:06.857095 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27798431-ef86-4eb1-9aeb-4b2bd36e96fb None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:06.871726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27798431-ef86-4eb1-9aeb-4b2bd36e96fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:06.915941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-27798431-ef86-4eb1-9aeb-4b2bd36e96fb None None] MFA Rules not processed for user `db86ff7784ef472b8e586aacb4db8767`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:17:06.918415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-27798431-ef86-4eb1-9aeb-4b2bd36e96fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:06.942799 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2126/4244] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:17:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:17:06.970160 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2203ea9-cc9c-47ef-bc85-0a1a409d745a None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:06.971882 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d2203ea9-cc9c-47ef-bc85-0a1a409d745a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:06.980835 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:17:07.287614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2203ea9-cc9c-47ef-bc85-0a1a409d745a None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:07.312907 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463648ab-1785-440b-b62f-009383a26ce4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:07.313585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463648ab-1785-440b-b62f-009383a26ce4 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:07.313919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463648ab-1785-440b-b62f-009383a26ce4 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:07.314196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463648ab-1785-440b-b62f-009383a26ce4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:07.350701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463648ab-1785-440b-b62f-009383a26ce4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:07.357706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463648ab-1785-440b-b62f-009383a26ce4 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:07.405040 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2119/4245] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:17:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:17:16.274860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f87b5-10ca-4689-9db2-df0e422d8208 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:16.276840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f87b5-10ca-4689-9db2-df0e422d8208 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:16.277726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f87b5-10ca-4689-9db2-df0e422d8208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:16.355568 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a82f87b5-10ca-4689-9db2-df0e422d8208 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:17:16.383853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a82f87b5-10ca-4689-9db2-df0e422d8208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:16.586094 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2127/4246] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:17:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:17:16.681863 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463648ab-1785-440b-b62f-009383a26ce4 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:16.807731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463648ab-1785-440b-b62f-009383a26ce4 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:16.817655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024c516-d723-4d49-bccb-dee8ef201f9f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:16.818403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024c516-d723-4d49-bccb-dee8ef201f9f service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:16.818786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024c516-d723-4d49-bccb-dee8ef201f9f service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:16.819166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024c516-d723-4d49-bccb-dee8ef201f9f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:16.834756 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5024c516-d723-4d49-bccb-dee8ef201f9f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:16.836761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5024c516-d723-4d49-bccb-dee8ef201f9f service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:16.848338 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2120/4247] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:17:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:17:20.249605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f87b5-10ca-4689-9db2-df0e422d8208 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:20.474644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f87b5-10ca-4689-9db2-df0e422d8208 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:20.488757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67bb6d-9206-4f25-b260-17992a2d41cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:20.489600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67bb6d-9206-4f25-b260-17992a2d41cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:20.490057 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67bb6d-9206-4f25-b260-17992a2d41cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:20.490348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67bb6d-9206-4f25-b260-17992a2d41cc admin admin] PATH_INFO: `/v3/users/db86ff7784ef472b8e586aacb4db8767` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:20.491510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67bb6d-9206-4f25-b260-17992a2d41cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=db86ff7784ef472b8e586aacb4db8767)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:20.493485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67bb6d-9206-4f25-b260-17992a2d41cc admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:20.635859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9a67bb6d-9206-4f25-b260-17992a2d41cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db86ff7784ef472b8e586aacb4db8767'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:20.636646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9a67bb6d-9206-4f25-b260-17992a2d41cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db86ff7784ef472b8e586aacb4db8767'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:20.651764 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9a67bb6d-9206-4f25-b260-17992a2d41cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db86ff7784ef472b8e586aacb4db8767'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:20.671951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9a67bb6d-9206-4f25-b260-17992a2d41cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db86ff7784ef472b8e586aacb4db8767'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:20.672911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9a67bb6d-9206-4f25-b260-17992a2d41cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db86ff7784ef472b8e586aacb4db8767'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:20.686835 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:17:20.697941 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2128/4248] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:17:20 2022] DELETE /identity/v3/users/db86ff7784ef472b8e586aacb4db8767 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:17:20.702320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7744485-8155-449c-b225-d3e68f489168 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:20.703130 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7744485-8155-449c-b225-d3e68f489168 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:20.703618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7744485-8155-449c-b225-d3e68f489168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:20.757167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e7744485-8155-449c-b225-d3e68f489168 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:17:20.762575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e7744485-8155-449c-b225-d3e68f489168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:20.959591 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2121/4249] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:17:21.009259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67bb6d-9206-4f25-b260-17992a2d41cc admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:21.010820 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9a67bb6d-9206-4f25-b260-17992a2d41cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:21.242175 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67bb6d-9206-4f25-b260-17992a2d41cc admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:21.250634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae1676-8c6b-4df8-9559-144a74743933 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:21.251459 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae1676-8c6b-4df8-9559-144a74743933 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:21.251843 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae1676-8c6b-4df8-9559-144a74743933 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:21.252218 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae1676-8c6b-4df8-9559-144a74743933 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:21.266304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae1676-8c6b-4df8-9559-144a74743933 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:21.268874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae1676-8c6b-4df8-9559-144a74743933 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:21.333796 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2129/4250] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:17:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:17:23.437870 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7744485-8155-449c-b225-d3e68f489168 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:23.441450 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e7744485-8155-449c-b225-d3e68f489168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:23.480143 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7744485-8155-449c-b225-d3e68f489168 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:23.498342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ccb2a7-dfd6-468f-9ae0-ac9b92b8b57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:23.499812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccb2a7-dfd6-468f-9ae0-ac9b92b8b57f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:23.505275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae1676-8c6b-4df8-9559-144a74743933 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:23.507006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7dae1676-8c6b-4df8-9559-144a74743933 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:23.508792 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccb2a7-dfd6-468f-9ae0-ac9b92b8b57f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:23.510787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccb2a7-dfd6-468f-9ae0-ac9b92b8b57f admin admin] PATH_INFO: `/v3/users/29e00b64247c492c99c32ad85827ddd7` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:23.514247 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ccb2a7-dfd6-468f-9ae0-ac9b92b8b57f admin admin] RBAC: Authorizing `identity:delete_user(user_id=29e00b64247c492c99c32ad85827ddd7)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:23.525490 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ccb2a7-dfd6-468f-9ae0-ac9b92b8b57f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:23.568885 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae1676-8c6b-4df8-9559-144a74743933 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:23.599221 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:17:23.607723 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03212e69-62fd-4563-964d-f1ee002ccd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:23.608388 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03212e69-62fd-4563-964d-f1ee002ccd85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:23.608673 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03212e69-62fd-4563-964d-f1ee002ccd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:23.613013 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03212e69-62fd-4563-964d-f1ee002ccd85 admin admin] PATH_INFO: `/v3/projects/9b5441e8fb3a497cac2ef7ee1f668e30` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:23.619888 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03212e69-62fd-4563-964d-f1ee002ccd85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b5441e8fb3a497cac2ef7ee1f668e30)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:23.633524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03212e69-62fd-4563-964d-f1ee002ccd85 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:23.727304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-01ccb2a7-dfd6-468f-9ae0-ac9b92b8b57f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29e00b64247c492c99c32ad85827ddd7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:23.728249 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-01ccb2a7-dfd6-468f-9ae0-ac9b92b8b57f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29e00b64247c492c99c32ad85827ddd7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:23.757596 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-01ccb2a7-dfd6-468f-9ae0-ac9b92b8b57f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29e00b64247c492c99c32ad85827ddd7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:23.776388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-01ccb2a7-dfd6-468f-9ae0-ac9b92b8b57f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29e00b64247c492c99c32ad85827ddd7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:23.779110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-01ccb2a7-dfd6-468f-9ae0-ac9b92b8b57f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29e00b64247c492c99c32ad85827ddd7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:23.823914 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2122/4251] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:17:23 2022] DELETE /identity/v3/users/29e00b64247c492c99c32ad85827ddd7 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:17:23.935171 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-03212e69-62fd-4563-964d-f1ee002ccd85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b5441e8fb3a497cac2ef7ee1f668e30', 'request_id': 'req-03212e69-62fd-4563-964d-f1ee002ccd85'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:23.955980 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-03212e69-62fd-4563-964d-f1ee002ccd85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b5441e8fb3a497cac2ef7ee1f668e30', 'request_id': 'req-03212e69-62fd-4563-964d-f1ee002ccd85'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:23.965852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-03212e69-62fd-4563-964d-f1ee002ccd85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b5441e8fb3a497cac2ef7ee1f668e30', 'request_id': 'req-03212e69-62fd-4563-964d-f1ee002ccd85'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:23.992990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-03212e69-62fd-4563-964d-f1ee002ccd85 admin admin] The token cache is being invalidate because project 9b5441e8fb3a497cac2ef7ee1f668e30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:17:23.993291 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-03212e69-62fd-4563-964d-f1ee002ccd85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:23.997836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-03212e69-62fd-4563-964d-f1ee002ccd85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:24.002453 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2130/4252] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:17:23 2022] DELETE /identity/v3/projects/9b5441e8fb3a497cac2ef7ee1f668e30 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:17:24.004630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea10fa-b55e-47f6-8ea6-3558bea0c677 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:24.005092 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea10fa-b55e-47f6-8ea6-3558bea0c677 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:24.005548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea10fa-b55e-47f6-8ea6-3558bea0c677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:24.059385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-beea10fa-b55e-47f6-8ea6-3558bea0c677 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:17:24.062749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-beea10fa-b55e-47f6-8ea6-3558bea0c677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:24.268316 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2123/4253] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:17:24.273839 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e532fda-685f-4186-ab7f-5b47cd54e625 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:24.274130 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e532fda-685f-4186-ab7f-5b47cd54e625 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:24.274415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e532fda-685f-4186-ab7f-5b47cd54e625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:24.360779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-7e532fda-685f-4186-ab7f-5b47cd54e625 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:17:24.415506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7e532fda-685f-4186-ab7f-5b47cd54e625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:24.490504 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2131/4254] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:17:24.490613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea10fa-b55e-47f6-8ea6-3558bea0c677 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:24.490613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea10fa-b55e-47f6-8ea6-3558bea0c677 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:24.493030 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a71031-b04c-46db-817e-54f603e0718a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:24.495676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a71031-b04c-46db-817e-54f603e0718a admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:24.495676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a71031-b04c-46db-817e-54f603e0718a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:24.495676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a71031-b04c-46db-817e-54f603e0718a admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:24.497089 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a71031-b04c-46db-817e-54f603e0718a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:17:24.497729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a71031-b04c-46db-817e-54f603e0718a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:24.503053 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a71031-b04c-46db-817e-54f603e0718a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:24.527896 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2124/4255] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:17:24.528833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e532fda-685f-4186-ab7f-5b47cd54e625 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:24.551036 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e532fda-685f-4186-ab7f-5b47cd54e625 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:24.560109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92792fbd-2e78-4c06-966f-01d06b348df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:24.561496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92792fbd-2e78-4c06-966f-01d06b348df3 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:24.561946 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92792fbd-2e78-4c06-966f-01d06b348df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:24.562360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92792fbd-2e78-4c06-966f-01d06b348df3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:24.563616 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92792fbd-2e78-4c06-966f-01d06b348df3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:24.595278 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92792fbd-2e78-4c06-966f-01d06b348df3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:24.693262 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a71031-b04c-46db-817e-54f603e0718a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:24.695674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-83a71031-b04c-46db-817e-54f603e0718a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:24.730453 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2132/4256] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:17:24 2022] POST /identity/v3/projects => generated 379 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:17:24.731544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92792fbd-2e78-4c06-966f-01d06b348df3 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:24.740254 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a71031-b04c-46db-817e-54f603e0718a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:24.850592 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:17:24.872676 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92792fbd-2e78-4c06-966f-01d06b348df3 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:24.892772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c31357-1420-46de-8e7a-2f88d6964c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:24.893794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c31357-1420-46de-8e7a-2f88d6964c89 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:24.894292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c31357-1420-46de-8e7a-2f88d6964c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:24.894746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c31357-1420-46de-8e7a-2f88d6964c89 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:24.895618 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c31357-1420-46de-8e7a-2f88d6964c89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:24.898146 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c31357-1420-46de-8e7a-2f88d6964c89 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:24.941921 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2133/4257] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:17:24 2022] POST /identity/v3/users => generated 290 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:17:24.945881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c31357-1420-46de-8e7a-2f88d6964c89 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:24.953790 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ceaa0c-090f-4397-bf4d-97cb42ca744c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:24.954293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ceaa0c-090f-4397-bf4d-97cb42ca744c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:24.954525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ceaa0c-090f-4397-bf4d-97cb42ca744c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:24.954801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ceaa0c-090f-4397-bf4d-97cb42ca744c admin admin] PATH_INFO: `/v3/projects/8881a3a48f104539b754874c6674562b` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:24.968785 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c31357-1420-46de-8e7a-2f88d6964c89 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:24.974345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ceaa0c-090f-4397-bf4d-97cb42ca744c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8881a3a48f104539b754874c6674562b)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:24.976331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ceaa0c-090f-4397-bf4d-97cb42ca744c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:24.981129 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8ad43-4586-4fb0-a0d7-e7c257b9846a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:24.981954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8ad43-4586-4fb0-a0d7-e7c257b9846a admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:24.982350 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8ad43-4586-4fb0-a0d7-e7c257b9846a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:24.982796 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8ad43-4586-4fb0-a0d7-e7c257b9846a admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:24.983605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8ad43-4586-4fb0-a0d7-e7c257b9846a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:24.986076 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8ad43-4586-4fb0-a0d7-e7c257b9846a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:25.017801 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2134/4258] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:17:25.019267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8ad43-4586-4fb0-a0d7-e7c257b9846a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:25.051936 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:17:25.054743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8ad43-4586-4fb0-a0d7-e7c257b9846a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:25.072584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea2431-0e36-41bf-a4a5-634fc6bb2776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:25.073489 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea2431-0e36-41bf-a4a5-634fc6bb2776 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:25.083192 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea2431-0e36-41bf-a4a5-634fc6bb2776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:25.085167 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea2431-0e36-41bf-a4a5-634fc6bb2776 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:25.087357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea2431-0e36-41bf-a4a5-634fc6bb2776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:25.091528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea2431-0e36-41bf-a4a5-634fc6bb2776 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:25.122325 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2135/4259] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:17:25.126471 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea2431-0e36-41bf-a4a5-634fc6bb2776 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:25.158508 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea2431-0e36-41bf-a4a5-634fc6bb2776 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:25.167158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-85ceaa0c-090f-4397-bf4d-97cb42ca744c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8881a3a48f104539b754874c6674562b', 'request_id': 'req-85ceaa0c-090f-4397-bf4d-97cb42ca744c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:25.194974 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-85ceaa0c-090f-4397-bf4d-97cb42ca744c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8881a3a48f104539b754874c6674562b', 'request_id': 'req-85ceaa0c-090f-4397-bf4d-97cb42ca744c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:25.202629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-85ceaa0c-090f-4397-bf4d-97cb42ca744c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8881a3a48f104539b754874c6674562b', 'request_id': 'req-85ceaa0c-090f-4397-bf4d-97cb42ca744c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:25.256001 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-85ceaa0c-090f-4397-bf4d-97cb42ca744c admin admin] The token cache is being invalidate because project 8881a3a48f104539b754874c6674562b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:17:25.256548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-85ceaa0c-090f-4397-bf4d-97cb42ca744c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:25.260539 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-85ceaa0c-090f-4397-bf4d-97cb42ca744c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:25.263310 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2125/4260] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:17:24 2022] DELETE /identity/v3/projects/8881a3a48f104539b754874c6674562b => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:17:25.270081 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c8e6c-b488-41b1-8b5c-5c5bb8860685 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:25.270374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c8e6c-b488-41b1-8b5c-5c5bb8860685 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:25.270638 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c8e6c-b488-41b1-8b5c-5c5bb8860685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:25.324155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85816d9-0895-43b2-86d8-377070442e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:25.324155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85816d9-0895-43b2-86d8-377070442e9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:25.324155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85816d9-0895-43b2-86d8-377070442e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:25.324155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85816d9-0895-43b2-86d8-377070442e9a admin admin] PATH_INFO: `/v3/projects/924b0864b8b2482996a2c9481f92375e/users/f9ea3c6cb63a4e7bb7f81a2dcffc0e55/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:25.340104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b99c8e6c-b488-41b1-8b5c-5c5bb8860685 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:17:25.341362 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b99c8e6c-b488-41b1-8b5c-5c5bb8860685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:25.352890 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85816d9-0895-43b2-86d8-377070442e9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=924b0864b8b2482996a2c9481f92375e, user_id=f9ea3c6cb63a4e7bb7f81a2dcffc0e55, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:25.355880 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85816d9-0895-43b2-86d8-377070442e9a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:25.367917 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2126/4261] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:17:25.375710 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a9129-121a-4b8f-8fff-5a7156d42c44 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:25.376169 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a9129-121a-4b8f-8fff-5a7156d42c44 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:25.376477 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a9129-121a-4b8f-8fff-5a7156d42c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:25.394977 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2136/4262] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:17:25 2022] PUT /identity/v3/projects/924b0864b8b2482996a2c9481f92375e/users/f9ea3c6cb63a4e7bb7f81a2dcffc0e55/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:17:25.397411 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679bf38-ccc4-4794-a12a-443869950645 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:25.397916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679bf38-ccc4-4794-a12a-443869950645 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:25.399172 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679bf38-ccc4-4794-a12a-443869950645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:25.423764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-516a9129-121a-4b8f-8fff-5a7156d42c44 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:17:25.425202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-516a9129-121a-4b8f-8fff-5a7156d42c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:25.466572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-9679bf38-ccc4-4794-a12a-443869950645 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:17:25.467965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9679bf38-ccc4-4794-a12a-443869950645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:25.599565 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2127/4263] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:17:25.604142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a9129-121a-4b8f-8fff-5a7156d42c44 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:25.609891 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2137/4264] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:17:25.620452 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679bf38-ccc4-4794-a12a-443869950645 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:25.621402 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a9129-121a-4b8f-8fff-5a7156d42c44 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:25.622428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9679bf38-ccc4-4794-a12a-443869950645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:25.656284 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb09a4-bb43-4506-b09c-55c3c7717b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:25.657017 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb09a4-bb43-4506-b09c-55c3c7717b51 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:25.657297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb09a4-bb43-4506-b09c-55c3c7717b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:25.657643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb09a4-bb43-4506-b09c-55c3c7717b51 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:25.658305 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb09a4-bb43-4506-b09c-55c3c7717b51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:17:25.658603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb09a4-bb43-4506-b09c-55c3c7717b51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:25.660217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb09a4-bb43-4506-b09c-55c3c7717b51 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:25.689793 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2128/4265] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:17:25.691503 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb09a4-bb43-4506-b09c-55c3c7717b51 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:25.714058 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb09a4-bb43-4506-b09c-55c3c7717b51 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:25.729369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a97ef9-5c53-4f79-88cb-fea60435d040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:25.730406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a97ef9-5c53-4f79-88cb-fea60435d040 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:25.731872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a97ef9-5c53-4f79-88cb-fea60435d040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:25.732489 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:17:25.733678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a97ef9-5c53-4f79-88cb-fea60435d040 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:25.738852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a97ef9-5c53-4f79-88cb-fea60435d040 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:25.743046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a97ef9-5c53-4f79-88cb-fea60435d040 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:25.760382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679bf38-ccc4-4794-a12a-443869950645 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:25.773146 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06326b-7c5e-496b-9ff5-7c409b1638f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:25.774176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06326b-7c5e-496b-9ff5-7c409b1638f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:25.774688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06326b-7c5e-496b-9ff5-7c409b1638f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:25.775675 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06326b-7c5e-496b-9ff5-7c409b1638f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:25.803664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e06326b-7c5e-496b-9ff5-7c409b1638f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:25.807984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e06326b-7c5e-496b-9ff5-7c409b1638f2 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:25.812389 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2129/4266] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:17:25 2022] POST /identity/v3/projects => generated 367 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:17:25.816556 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a97ef9-5c53-4f79-88cb-fea60435d040 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:25.839689 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2138/4267] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:17:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:17:25.973684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a97ef9-5c53-4f79-88cb-fea60435d040 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:25.979776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f641b9-5792-4140-aead-cde856041bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:25.981019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f641b9-5792-4140-aead-cde856041bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:25.981205 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f641b9-5792-4140-aead-cde856041bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:25.981615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f641b9-5792-4140-aead-cde856041bd2 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:25.982441 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f641b9-5792-4140-aead-cde856041bd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:25.984746 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f641b9-5792-4140-aead-cde856041bd2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:26.000174 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:17:26.028241 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06326b-7c5e-496b-9ff5-7c409b1638f2 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:26.047436 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2130/4268] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:17:25 2022] POST /identity/v3/users => generated 284 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:17:26.053961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06326b-7c5e-496b-9ff5-7c409b1638f2 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:26.067671 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0f429-2035-4610-b632-b895e3a642f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:26.068682 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0f429-2035-4610-b632-b895e3a642f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:26.069037 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0f429-2035-4610-b632-b895e3a642f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:26.069336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0f429-2035-4610-b632-b895e3a642f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:26.072074 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af0f429-2035-4610-b632-b895e3a642f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:26.074653 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af0f429-2035-4610-b632-b895e3a642f5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:26.099647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f641b9-5792-4140-aead-cde856041bd2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:26.108330 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2139/4269] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:17:26.116211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f641b9-5792-4140-aead-cde856041bd2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:26.122819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91eedf7-b34d-4abf-b4a5-618698f50045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:26.123589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91eedf7-b34d-4abf-b4a5-618698f50045 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:26.124132 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91eedf7-b34d-4abf-b4a5-618698f50045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:26.124714 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91eedf7-b34d-4abf-b4a5-618698f50045 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:26.126312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91eedf7-b34d-4abf-b4a5-618698f50045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:26.128361 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91eedf7-b34d-4abf-b4a5-618698f50045 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:26.150321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0f429-2035-4610-b632-b895e3a642f5 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:26.157904 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2131/4270] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:17:26.165488 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0f429-2035-4610-b632-b895e3a642f5 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:26.173708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90e140-604a-4510-9bc7-d2478e55988a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:26.175033 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90e140-604a-4510-9bc7-d2478e55988a admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:26.175584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90e140-604a-4510-9bc7-d2478e55988a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:26.175970 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90e140-604a-4510-9bc7-d2478e55988a admin admin] PATH_INFO: `/v3/projects/ebe2a571e67b4b139db648e294d78896/users/2343ac40e81c4cda8ac38f66fd16b99c/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:26.218918 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90e140-604a-4510-9bc7-d2478e55988a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebe2a571e67b4b139db648e294d78896, user_id=2343ac40e81c4cda8ac38f66fd16b99c, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:26.223565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90e140-604a-4510-9bc7-d2478e55988a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:26.259200 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16650fa-c4e7-45f2-80b8-4b3efe50c3e3 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:26.259869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16650fa-c4e7-45f2-80b8-4b3efe50c3e3 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:26.260356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16650fa-c4e7-45f2-80b8-4b3efe50c3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:26.266016 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2140/4271] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:17:26 2022] PUT /identity/v3/projects/ebe2a571e67b4b139db648e294d78896/users/2343ac40e81c4cda8ac38f66fd16b99c/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:17:26.294106 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-f16650fa-c4e7-45f2-80b8-4b3efe50c3e3 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:17:26.296360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f16650fa-c4e7-45f2-80b8-4b3efe50c3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:26.396685 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2132/4272] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:17:26.548829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90e140-604a-4510-9bc7-d2478e55988a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:26.552875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7a90e140-604a-4510-9bc7-d2478e55988a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:26.696283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90e140-604a-4510-9bc7-d2478e55988a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:26.705463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb41e4-55f6-42e0-bf56-faffd096b9af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:26.708961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb41e4-55f6-42e0-bf56-faffd096b9af service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:26.709250 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb41e4-55f6-42e0-bf56-faffd096b9af service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:26.710020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb41e4-55f6-42e0-bf56-faffd096b9af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:26.744807 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb41e4-55f6-42e0-bf56-faffd096b9af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:26.751654 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb41e4-55f6-42e0-bf56-faffd096b9af service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:26.791838 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2141/4273] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:17:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:17:36.382171 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=34 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:17:36.768986 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=47,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:17:42.080260 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ca8a0-5220-44e1-a3f4-0fba314c4df6 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:42.080739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ca8a0-5220-44e1-a3f4-0fba314c4df6 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:42.080823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ca8a0-5220-44e1-a3f4-0fba314c4df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:42.152469 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-608ca8a0-5220-44e1-a3f4-0fba314c4df6 None None] MFA Rules not processed for user `f9ea3c6cb63a4e7bb7f81a2dcffc0e55`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:17:42.153717 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-608ca8a0-5220-44e1-a3f4-0fba314c4df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:42.253481 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2133/4274] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:17:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:17:42.260596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c799ef-25f8-4479-9d39-1901f9ccf861 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:42.261071 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c799ef-25f8-4479-9d39-1901f9ccf861 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:42.261166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c799ef-25f8-4479-9d39-1901f9ccf861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:42.294122 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-23c799ef-25f8-4479-9d39-1901f9ccf861 None None] MFA Rules not processed for user `f9ea3c6cb63a4e7bb7f81a2dcffc0e55`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:17:42.295609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-23c799ef-25f8-4479-9d39-1901f9ccf861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:42.321289 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2142/4275] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:17:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:17:42.339843 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ca8a0-5220-44e1-a3f4-0fba314c4df6 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:42.344479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-608ca8a0-5220-44e1-a3f4-0fba314c4df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:42.520027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ca8a0-5220-44e1-a3f4-0fba314c4df6 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:42.538732 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55e58c-b862-4561-948a-e52cad39f67d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:42.539409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55e58c-b862-4561-948a-e52cad39f67d service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:42.539690 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55e58c-b862-4561-948a-e52cad39f67d service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:42.540432 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55e58c-b862-4561-948a-e52cad39f67d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:42.560201 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55e58c-b862-4561-948a-e52cad39f67d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:42.561997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55e58c-b862-4561-948a-e52cad39f67d service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:42.601645 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2134/4276] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:17:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:17:42.922126 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c799ef-25f8-4479-9d39-1901f9ccf861 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:42.938669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c799ef-25f8-4479-9d39-1901f9ccf861 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:42.943383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb25b0-b432-4172-a7ec-b281d6fadf9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:42.944242 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb25b0-b432-4172-a7ec-b281d6fadf9c service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:42.944622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb25b0-b432-4172-a7ec-b281d6fadf9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:42.944990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb25b0-b432-4172-a7ec-b281d6fadf9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:42.947140 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f1fb25b0-b432-4172-a7ec-b281d6fadf9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:42.960546 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb25b0-b432-4172-a7ec-b281d6fadf9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:42.962592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb25b0-b432-4172-a7ec-b281d6fadf9c service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:42.987612 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2143/4277] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:17:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:17:44.400071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55e58c-b862-4561-948a-e52cad39f67d service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:44.401915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5a55e58c-b862-4561-948a-e52cad39f67d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:44.437309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55e58c-b862-4561-948a-e52cad39f67d service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:44.476342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd41e057-545c-4785-87ff-84f9bf293f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:44.477101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41e057-545c-4785-87ff-84f9bf293f4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:44.477843 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41e057-545c-4785-87ff-84f9bf293f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:44.478438 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41e057-545c-4785-87ff-84f9bf293f4c admin admin] PATH_INFO: `/v3/users/21f0adb3fe9f454b83e22dbdf526ee49` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:44.479848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd41e057-545c-4785-87ff-84f9bf293f4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=21f0adb3fe9f454b83e22dbdf526ee49)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:44.483307 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd41e057-545c-4785-87ff-84f9bf293f4c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:44.597459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-fd41e057-545c-4785-87ff-84f9bf293f4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21f0adb3fe9f454b83e22dbdf526ee49'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:44.598141 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-fd41e057-545c-4785-87ff-84f9bf293f4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21f0adb3fe9f454b83e22dbdf526ee49'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:44.608754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-fd41e057-545c-4785-87ff-84f9bf293f4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21f0adb3fe9f454b83e22dbdf526ee49'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:44.620099 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-fd41e057-545c-4785-87ff-84f9bf293f4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21f0adb3fe9f454b83e22dbdf526ee49'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:44.620966 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-fd41e057-545c-4785-87ff-84f9bf293f4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21f0adb3fe9f454b83e22dbdf526ee49'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:44.631847 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:17:44.652123 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2135/4278] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:17:44 2022] DELETE /identity/v3/users/21f0adb3fe9f454b83e22dbdf526ee49 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:17:45.245117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb25b0-b432-4172-a7ec-b281d6fadf9c service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:45.261543 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb25b0-b432-4172-a7ec-b281d6fadf9c service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:45.356452 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f66d08-76a3-44d8-ab7e-a08d6f282ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:45.357669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f66d08-76a3-44d8-ab7e-a08d6f282ee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:45.358090 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f66d08-76a3-44d8-ab7e-a08d6f282ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:45.358532 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f66d08-76a3-44d8-ab7e-a08d6f282ee9 admin admin] PATH_INFO: `/v3/projects/d83f423f59844458a82413b3e71e7366` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:45.359929 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f66d08-76a3-44d8-ab7e-a08d6f282ee9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d83f423f59844458a82413b3e71e7366)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:45.362415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f66d08-76a3-44d8-ab7e-a08d6f282ee9 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:45.425138 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e3d1c-053c-4741-b349-b8caf61dddd2 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:45.425640 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e3d1c-053c-4741-b349-b8caf61dddd2 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:45.425785 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e3d1c-053c-4741-b349-b8caf61dddd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:45.441305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-44f66d08-76a3-44d8-ab7e-a08d6f282ee9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd83f423f59844458a82413b3e71e7366', 'request_id': 'req-44f66d08-76a3-44d8-ab7e-a08d6f282ee9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:45.453157 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-44f66d08-76a3-44d8-ab7e-a08d6f282ee9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd83f423f59844458a82413b3e71e7366', 'request_id': 'req-44f66d08-76a3-44d8-ab7e-a08d6f282ee9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:45.464643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-44f66d08-76a3-44d8-ab7e-a08d6f282ee9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd83f423f59844458a82413b3e71e7366', 'request_id': 'req-44f66d08-76a3-44d8-ab7e-a08d6f282ee9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:45.467175 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5f3e3d1c-053c-4741-b349-b8caf61dddd2 None None] MFA Rules not processed for user `2343ac40e81c4cda8ac38f66fd16b99c`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:17:45.469567 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5f3e3d1c-053c-4741-b349-b8caf61dddd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:45.480157 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-44f66d08-76a3-44d8-ab7e-a08d6f282ee9 admin admin] The token cache is being invalidate because project d83f423f59844458a82413b3e71e7366 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:17:45.480459 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-44f66d08-76a3-44d8-ab7e-a08d6f282ee9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:45.481168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-44f66d08-76a3-44d8-ab7e-a08d6f282ee9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:45.488399 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2144/4279] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:17:45 2022] DELETE /identity/v3/projects/d83f423f59844458a82413b3e71e7366 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:17:45.489862 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f66d08-76a3-44d8-ab7e-a08d6f282ee9 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:45.491740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-44f66d08-76a3-44d8-ab7e-a08d6f282ee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:45.584669 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2136/4280] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:17:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:17:45.592149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e3d1c-053c-4741-b349-b8caf61dddd2 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:45.594091 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5f3e3d1c-053c-4741-b349-b8caf61dddd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:45.615226 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f66d08-76a3-44d8-ab7e-a08d6f282ee9 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:45.622773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee52a40-ed57-4c3b-8fb7-ae4ab26e564c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:45.624703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee52a40-ed57-4c3b-8fb7-ae4ab26e564c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:45.626349 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee52a40-ed57-4c3b-8fb7-ae4ab26e564c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:45.626771 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee52a40-ed57-4c3b-8fb7-ae4ab26e564c admin admin] PATH_INFO: `/v3/users/832547e11ed64c46bcd1eaf2de197e43` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:45.642910 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee52a40-ed57-4c3b-8fb7-ae4ab26e564c admin admin] RBAC: Authorizing `identity:delete_user(user_id=832547e11ed64c46bcd1eaf2de197e43)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:45.645657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee52a40-ed57-4c3b-8fb7-ae4ab26e564c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:45.664925 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:17:45.731191 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-eee52a40-ed57-4c3b-8fb7-ae4ab26e564c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '832547e11ed64c46bcd1eaf2de197e43'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:45.732053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-eee52a40-ed57-4c3b-8fb7-ae4ab26e564c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '832547e11ed64c46bcd1eaf2de197e43'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:45.743190 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-eee52a40-ed57-4c3b-8fb7-ae4ab26e564c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '832547e11ed64c46bcd1eaf2de197e43'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:45.752396 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e3d1c-053c-4741-b349-b8caf61dddd2 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:45.760262 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9a8c9-a6e2-4362-b971-23d48a6b1019 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:45.760484 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-eee52a40-ed57-4c3b-8fb7-ae4ab26e564c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '832547e11ed64c46bcd1eaf2de197e43'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:45.761248 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9a8c9-a6e2-4362-b971-23d48a6b1019 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:45.761393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-eee52a40-ed57-4c3b-8fb7-ae4ab26e564c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '832547e11ed64c46bcd1eaf2de197e43'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:45.763297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9a8c9-a6e2-4362-b971-23d48a6b1019 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:45.763750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9a8c9-a6e2-4362-b971-23d48a6b1019 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:45.772227 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d4c9a8c9-a6e2-4362-b971-23d48a6b1019 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:45.794697 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2145/4281] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:17:45 2022] DELETE /identity/v3/users/832547e11ed64c46bcd1eaf2de197e43 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:17:45.802927 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9a8c9-a6e2-4362-b971-23d48a6b1019 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:45.805794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9a8c9-a6e2-4362-b971-23d48a6b1019 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:45.817292 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2137/4282] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:17:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:17:46.282478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee52a40-ed57-4c3b-8fb7-ae4ab26e564c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:46.284996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-eee52a40-ed57-4c3b-8fb7-ae4ab26e564c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:46.437227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee52a40-ed57-4c3b-8fb7-ae4ab26e564c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:46.451469 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb66b7-6d0c-4e67-857e-b37a4d0aacc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:46.452242 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb66b7-6d0c-4e67-857e-b37a4d0aacc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:46.452635 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb66b7-6d0c-4e67-857e-b37a4d0aacc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:46.458980 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb66b7-6d0c-4e67-857e-b37a4d0aacc5 admin admin] PATH_INFO: `/v3/projects/28bceed415a7436b8f33f459898cc272` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:46.460766 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb66b7-6d0c-4e67-857e-b37a4d0aacc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28bceed415a7436b8f33f459898cc272)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:46.462866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb66b7-6d0c-4e67-857e-b37a4d0aacc5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:46.602011 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-81cb66b7-6d0c-4e67-857e-b37a4d0aacc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28bceed415a7436b8f33f459898cc272', 'request_id': 'req-81cb66b7-6d0c-4e67-857e-b37a4d0aacc5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:46.624949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-81cb66b7-6d0c-4e67-857e-b37a4d0aacc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28bceed415a7436b8f33f459898cc272', 'request_id': 'req-81cb66b7-6d0c-4e67-857e-b37a4d0aacc5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:46.634755 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-81cb66b7-6d0c-4e67-857e-b37a4d0aacc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28bceed415a7436b8f33f459898cc272', 'request_id': 'req-81cb66b7-6d0c-4e67-857e-b37a4d0aacc5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:46.652925 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-81cb66b7-6d0c-4e67-857e-b37a4d0aacc5 admin admin] The token cache is being invalidate because project 28bceed415a7436b8f33f459898cc272 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:17:46.653546 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-81cb66b7-6d0c-4e67-857e-b37a4d0aacc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:46.655964 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-81cb66b7-6d0c-4e67-857e-b37a4d0aacc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:17:46.663682 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2146/4283] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:17:46 2022] DELETE /identity/v3/projects/28bceed415a7436b8f33f459898cc272 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:17:46.665646 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e56cd5-e610-4ac6-a7b2-84df55b79328 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:46.666248 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e56cd5-e610-4ac6-a7b2-84df55b79328 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:46.666248 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e56cd5-e610-4ac6-a7b2-84df55b79328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:46.734433 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-25e56cd5-e610-4ac6-a7b2-84df55b79328 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:17:46.735788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-25e56cd5-e610-4ac6-a7b2-84df55b79328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:46.892104 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2138/4284] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:17:46.995144 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49716a42-47f3-4ad5-bcc3-85940f9f9895 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:46.995444 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49716a42-47f3-4ad5-bcc3-85940f9f9895 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:46.995810 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49716a42-47f3-4ad5-bcc3-85940f9f9895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:47.037593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-49716a42-47f3-4ad5-bcc3-85940f9f9895 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:17:47.039679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-49716a42-47f3-4ad5-bcc3-85940f9f9895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:47.067024 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2147/4285] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:17:47.070541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e56cd5-e610-4ac6-a7b2-84df55b79328 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:47.076063 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:17:47.084849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e56cd5-e610-4ac6-a7b2-84df55b79328 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:47.091832 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d15d2a-1ac0-4c1f-bc3b-ebf32cc0c3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:47.092793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d15d2a-1ac0-4c1f-bc3b-ebf32cc0c3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:47.093299 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d15d2a-1ac0-4c1f-bc3b-ebf32cc0c3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:47.093860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d15d2a-1ac0-4c1f-bc3b-ebf32cc0c3d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:47.095382 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d15d2a-1ac0-4c1f-bc3b-ebf32cc0c3d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:17:47.095902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d15d2a-1ac0-4c1f-bc3b-ebf32cc0c3d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:47.100295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d15d2a-1ac0-4c1f-bc3b-ebf32cc0c3d3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:47.119431 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2139/4286] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:17:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:17:47.120276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49716a42-47f3-4ad5-bcc3-85940f9f9895 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:47.132859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49716a42-47f3-4ad5-bcc3-85940f9f9895 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:47.141531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8300931-f576-4030-a1ea-1725fd85302f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:47.142303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8300931-f576-4030-a1ea-1725fd85302f admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:47.142588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8300931-f576-4030-a1ea-1725fd85302f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:47.142894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8300931-f576-4030-a1ea-1725fd85302f admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:47.143582 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8300931-f576-4030-a1ea-1725fd85302f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:47.146375 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8300931-f576-4030-a1ea-1725fd85302f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:47.159538 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:17:47.209960 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2148/4287] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:17:47 2022] POST /identity/v3/projects => generated 373 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:17:47.211550 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d15d2a-1ac0-4c1f-bc3b-ebf32cc0c3d3 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:47.227037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d15d2a-1ac0-4c1f-bc3b-ebf32cc0c3d3 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:47.345721 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57596fe4-782a-481f-9341-c6dc498dfc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:47.346563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57596fe4-782a-481f-9341-c6dc498dfc7b admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:47.347037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57596fe4-782a-481f-9341-c6dc498dfc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:47.347537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57596fe4-782a-481f-9341-c6dc498dfc7b admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:47.348284 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57596fe4-782a-481f-9341-c6dc498dfc7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:47.351402 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57596fe4-782a-481f-9341-c6dc498dfc7b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:47.401835 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2140/4288] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:17:47 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:17:47.407078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8300931-f576-4030-a1ea-1725fd85302f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:47.429989 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8300931-f576-4030-a1ea-1725fd85302f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:47.436718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f8d69-6bef-4e33-8bce-b6060b956557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:47.437406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f8d69-6bef-4e33-8bce-b6060b956557 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:47.438565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f8d69-6bef-4e33-8bce-b6060b956557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:47.438843 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f8d69-6bef-4e33-8bce-b6060b956557 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:47.439495 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f8d69-6bef-4e33-8bce-b6060b956557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:47.441312 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f8d69-6bef-4e33-8bce-b6060b956557 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:47.469028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57596fe4-782a-481f-9341-c6dc498dfc7b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:47.470075 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2149/4289] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:17:47.492123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57596fe4-782a-481f-9341-c6dc498dfc7b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:47.509496 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d6683-7b8c-461f-a82d-9d60236d9c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:47.510564 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d6683-7b8c-461f-a82d-9d60236d9c5e admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:47.512103 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d6683-7b8c-461f-a82d-9d60236d9c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:47.512397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d6683-7b8c-461f-a82d-9d60236d9c5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:47.514466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d6683-7b8c-461f-a82d-9d60236d9c5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:47.517732 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d6683-7b8c-461f-a82d-9d60236d9c5e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:47.551983 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2141/4290] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:17:47.558322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f8d69-6bef-4e33-8bce-b6060b956557 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:47.585601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f8d69-6bef-4e33-8bce-b6060b956557 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:47.616999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd34f1-0c58-4a94-a813-0d74f0c3b886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:47.618027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd34f1-0c58-4a94-a813-0d74f0c3b886 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:47.618027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd34f1-0c58-4a94-a813-0d74f0c3b886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:47.618027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd34f1-0c58-4a94-a813-0d74f0c3b886 admin admin] PATH_INFO: `/v3/projects/ef80be282e704a6bbba0e81c3c3c4b64/users/5e4b9abafee24ca397a7155e2b683511/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:47.639322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd34f1-0c58-4a94-a813-0d74f0c3b886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef80be282e704a6bbba0e81c3c3c4b64, user_id=5e4b9abafee24ca397a7155e2b683511, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:47.642299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd34f1-0c58-4a94-a813-0d74f0c3b886 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:47.672958 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2150/4291] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:17:47 2022] PUT /identity/v3/projects/ef80be282e704a6bbba0e81c3c3c4b64/users/5e4b9abafee24ca397a7155e2b683511/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:17:47.674366 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51038125-3326-47cb-b1c5-213f62f92fd9 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:47.676064 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51038125-3326-47cb-b1c5-213f62f92fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:47.676064 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51038125-3326-47cb-b1c5-213f62f92fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:47.736614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-51038125-3326-47cb-b1c5-213f62f92fd9 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:17:47.739248 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-51038125-3326-47cb-b1c5-213f62f92fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:47.816500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6cdc7-2694-479a-9250-5f86d5106833 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:47.816925 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6cdc7-2694-479a-9250-5f86d5106833 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:47.817298 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6cdc7-2694-479a-9250-5f86d5106833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:47.858027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-6cd6cdc7-2694-479a-9250-5f86d5106833 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:17:47.860877 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6cd6cdc7-2694-479a-9250-5f86d5106833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:47.958962 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2142/4292] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:17:47.989658 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51038125-3326-47cb-b1c5-213f62f92fd9 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:47.991329 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-51038125-3326-47cb-b1c5-213f62f92fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:48.063231 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2151/4293] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 01:17:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:17:48.064461 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6cdc7-2694-479a-9250-5f86d5106833 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:17:48.071396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6cd6cdc7-2694-479a-9250-5f86d5106833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:48.123709 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51038125-3326-47cb-b1c5-213f62f92fd9 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:48.132087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6871c794-9cfa-4ea6-a856-875c6d85439d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:48.133279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871c794-9cfa-4ea6-a856-875c6d85439d service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:48.133635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871c794-9cfa-4ea6-a856-875c6d85439d service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:48.137118 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871c794-9cfa-4ea6-a856-875c6d85439d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:48.163140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6871c794-9cfa-4ea6-a856-875c6d85439d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:48.169654 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6871c794-9cfa-4ea6-a856-875c6d85439d service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:48.190655 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6cdc7-2694-479a-9250-5f86d5106833 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:17:48.194409 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2143/4294] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:17:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:17:48.198681 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd09b53-187e-4e3a-85f7-f59914c7cae4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:17:48.199471 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd09b53-187e-4e3a-85f7-f59914c7cae4 service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:48.202604 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd09b53-187e-4e3a-85f7-f59914c7cae4 service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:48.202818 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd09b53-187e-4e3a-85f7-f59914c7cae4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:48.224309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd09b53-187e-4e3a-85f7-f59914c7cae4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:17:48.226838 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd09b53-187e-4e3a-85f7-f59914c7cae4 service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:17:48.260717 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2152/4295] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:17:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:17:49.035454 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f419d73-fc34-46d4-8011-26380a89bbc0 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:49.035966 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f419d73-fc34-46d4-8011-26380a89bbc0 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:49.036038 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f419d73-fc34-46d4-8011-26380a89bbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:49.059424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-7f419d73-fc34-46d4-8011-26380a89bbc0 None None] MFA Rules not processed for user `2343ac40e81c4cda8ac38f66fd16b99c`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:17:49.060666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7f419d73-fc34-46d4-8011-26380a89bbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:49.068544 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:17:49.143489 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2144/4296] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:17:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:17:52.047790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d5379-ec7f-46e4-9c97-1281c14c1fc8 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:17:52.048309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d5379-ec7f-46e4-9c97-1281c14c1fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:17:52.048309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d5379-ec7f-46e4-9c97-1281c14c1fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:17:52.099421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-072d5379-ec7f-46e4-9c97-1281c14c1fc8 None None] MFA Rules not processed for user `5581a720105c400f8bee8ef53813288b`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:17:52.100678 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-072d5379-ec7f-46e4-9c97-1281c14c1fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:17:52.227794 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:17:52.265730 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2153/4297] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:17:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:17:59.132994 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=20 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:02.251928 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:03.380188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b1ee1-f043-471a-8cf2-1a3a1895cb98 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:03.380802 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b1ee1-f043-471a-8cf2-1a3a1895cb98 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:03.381220 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b1ee1-f043-471a-8cf2-1a3a1895cb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:03.521645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c27b1ee1-f043-471a-8cf2-1a3a1895cb98 None None] MFA Rules not processed for user `5e4b9abafee24ca397a7155e2b683511`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:18:03.523381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c27b1ee1-f043-471a-8cf2-1a3a1895cb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:03.711727 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2145/4298] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:18:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:18:03.944344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d5379-ec7f-46e4-9c97-1281c14c1fc8 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:03.946512 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-072d5379-ec7f-46e4-9c97-1281c14c1fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:04.255702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d5379-ec7f-46e4-9c97-1281c14c1fc8 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:04.279445 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f263641-20e1-4223-80ac-b5f055418973 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:04.280294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f263641-20e1-4223-80ac-b5f055418973 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:04.281143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f263641-20e1-4223-80ac-b5f055418973 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:04.281539 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f263641-20e1-4223-80ac-b5f055418973 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:04.308127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f263641-20e1-4223-80ac-b5f055418973 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:04.309844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f263641-20e1-4223-80ac-b5f055418973 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:04.339566 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2154/4299] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:18:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:18:09.714996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caaa09b-9a42-40d7-8590-6d1843b26ba2 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:09.715462 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caaa09b-9a42-40d7-8590-6d1843b26ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:09.715653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caaa09b-9a42-40d7-8590-6d1843b26ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:09.784461 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-2caaa09b-9a42-40d7-8590-6d1843b26ba2 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:18:09.785756 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2caaa09b-9a42-40d7-8590-6d1843b26ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:09.802704 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2146/4300] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 01:18:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:18:09.828838 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f263641-20e1-4223-80ac-b5f055418973 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:09.846798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f263641-20e1-4223-80ac-b5f055418973 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:09.853269 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21099ae-b6d5-45c5-be84-16cad4d26dfd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:09.854091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21099ae-b6d5-45c5-be84-16cad4d26dfd service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:09.855606 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21099ae-b6d5-45c5-be84-16cad4d26dfd service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:09.856045 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21099ae-b6d5-45c5-be84-16cad4d26dfd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:09.870591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21099ae-b6d5-45c5-be84-16cad4d26dfd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:09.872558 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21099ae-b6d5-45c5-be84-16cad4d26dfd service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:09.885036 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2155/4301] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:18:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:18:11.969743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caaa09b-9a42-40d7-8590-6d1843b26ba2 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:11.971754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2caaa09b-9a42-40d7-8590-6d1843b26ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:12.209424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caaa09b-9a42-40d7-8590-6d1843b26ba2 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:12.252877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b122a-41b1-405a-82a7-595040d4b45d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:12.253972 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b122a-41b1-405a-82a7-595040d4b45d service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:12.254230 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b122a-41b1-405a-82a7-595040d4b45d service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:12.254553 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b122a-41b1-405a-82a7-595040d4b45d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:12.258882 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bb5b122a-41b1-405a-82a7-595040d4b45d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:12.283337 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b122a-41b1-405a-82a7-595040d4b45d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:12.285849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b122a-41b1-405a-82a7-595040d4b45d service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:12.298631 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2147/4302] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:18:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:18:16.331646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21099ae-b6d5-45c5-be84-16cad4d26dfd service swift] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:16.333078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a21099ae-b6d5-45c5-be84-16cad4d26dfd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:16.368732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21099ae-b6d5-45c5-be84-16cad4d26dfd service swift] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:16.378510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588e0e9-4a1e-4ea1-803d-5b97b73ab121 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:16.379366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588e0e9-4a1e-4ea1-803d-5b97b73ab121 service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:16.379832 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588e0e9-4a1e-4ea1-803d-5b97b73ab121 service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:16.380244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588e0e9-4a1e-4ea1-803d-5b97b73ab121 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:16.382171 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b588e0e9-4a1e-4ea1-803d-5b97b73ab121 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:16.396851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b588e0e9-4a1e-4ea1-803d-5b97b73ab121 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:16.398867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b588e0e9-4a1e-4ea1-803d-5b97b73ab121 service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:16.456455 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2156/4303] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:18:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:18:21.163010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b122a-41b1-405a-82a7-595040d4b45d service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:21.165096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bb5b122a-41b1-405a-82a7-595040d4b45d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:21.187329 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b122a-41b1-405a-82a7-595040d4b45d service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:21.193689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c65349-e3af-4ad3-bd99-d8791363c1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:21.194431 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c65349-e3af-4ad3-bd99-d8791363c1c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:21.194953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c65349-e3af-4ad3-bd99-d8791363c1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:21.195438 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c65349-e3af-4ad3-bd99-d8791363c1c4 admin admin] PATH_INFO: `/v3/users/f9ea3c6cb63a4e7bb7f81a2dcffc0e55` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:21.196806 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c65349-e3af-4ad3-bd99-d8791363c1c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9ea3c6cb63a4e7bb7f81a2dcffc0e55)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:21.199237 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c65349-e3af-4ad3-bd99-d8791363c1c4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:21.221307 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:21.285822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-45c65349-e3af-4ad3-bd99-d8791363c1c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9ea3c6cb63a4e7bb7f81a2dcffc0e55'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:21.286730 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-45c65349-e3af-4ad3-bd99-d8791363c1c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9ea3c6cb63a4e7bb7f81a2dcffc0e55'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:21.295617 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-45c65349-e3af-4ad3-bd99-d8791363c1c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9ea3c6cb63a4e7bb7f81a2dcffc0e55'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:21.317138 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-45c65349-e3af-4ad3-bd99-d8791363c1c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9ea3c6cb63a4e7bb7f81a2dcffc0e55'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:21.317918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-45c65349-e3af-4ad3-bd99-d8791363c1c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9ea3c6cb63a4e7bb7f81a2dcffc0e55'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:21.342723 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2148/4304] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:18:21 2022] DELETE /identity/v3/users/f9ea3c6cb63a4e7bb7f81a2dcffc0e55 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:18:21.774726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588e0e9-4a1e-4ea1-803d-5b97b73ab121 service placement] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:21.791304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588e0e9-4a1e-4ea1-803d-5b97b73ab121 service placement] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:22.060681 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839767e-122e-4cd4-8efd-5d539c27976e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:22.061417 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839767e-122e-4cd4-8efd-5d539c27976e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:22.062213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839767e-122e-4cd4-8efd-5d539c27976e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:22.062490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839767e-122e-4cd4-8efd-5d539c27976e admin admin] PATH_INFO: `/v3/projects/924b0864b8b2482996a2c9481f92375e` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:22.068955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839767e-122e-4cd4-8efd-5d539c27976e admin admin] RBAC: Authorizing `identity:delete_project(project_id=924b0864b8b2482996a2c9481f92375e)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:22.078086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839767e-122e-4cd4-8efd-5d539c27976e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:22.127170 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:22.236444 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8839767e-122e-4cd4-8efd-5d539c27976e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '924b0864b8b2482996a2c9481f92375e', 'request_id': 'req-8839767e-122e-4cd4-8efd-5d539c27976e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:22.248459 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8839767e-122e-4cd4-8efd-5d539c27976e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '924b0864b8b2482996a2c9481f92375e', 'request_id': 'req-8839767e-122e-4cd4-8efd-5d539c27976e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:22.262293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8839767e-122e-4cd4-8efd-5d539c27976e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '924b0864b8b2482996a2c9481f92375e', 'request_id': 'req-8839767e-122e-4cd4-8efd-5d539c27976e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:22.333336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8839767e-122e-4cd4-8efd-5d539c27976e admin admin] The token cache is being invalidate because project 924b0864b8b2482996a2c9481f92375e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:18:22.336651 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8839767e-122e-4cd4-8efd-5d539c27976e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:22.339017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8839767e-122e-4cd4-8efd-5d539c27976e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:22.346010 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2157/4305] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:18:21 2022] DELETE /identity/v3/projects/924b0864b8b2482996a2c9481f92375e => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:18:22.350352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ca03d-3bfd-4bd2-aa48-cfc2ae3d2dfc None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:22.350844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ca03d-3bfd-4bd2-aa48-cfc2ae3d2dfc None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:22.351668 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ca03d-3bfd-4bd2-aa48-cfc2ae3d2dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:22.410597 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-2b0ca03d-3bfd-4bd2-aa48-cfc2ae3d2dfc None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:18:22.412113 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2b0ca03d-3bfd-4bd2-aa48-cfc2ae3d2dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:22.513024 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2149/4306] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:18:22.522452 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb365a9-643e-4b00-826d-6b20b11ee883 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:22.523058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb365a9-643e-4b00-826d-6b20b11ee883 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:22.523432 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb365a9-643e-4b00-826d-6b20b11ee883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:22.588779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-2cb365a9-643e-4b00-826d-6b20b11ee883 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:18:22.590893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2cb365a9-643e-4b00-826d-6b20b11ee883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:22.632518 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2158/4307] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:18:22.633330 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ca03d-3bfd-4bd2-aa48-cfc2ae3d2dfc None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:22.653151 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ca03d-3bfd-4bd2-aa48-cfc2ae3d2dfc None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:22.658601 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbbdf0c-93e7-4885-ad62-d1896bcc1553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:22.659214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbdf0c-93e7-4885-ad62-d1896bcc1553 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:22.659508 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbdf0c-93e7-4885-ad62-d1896bcc1553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:22.659781 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbdf0c-93e7-4885-ad62-d1896bcc1553 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:22.660441 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbbdf0c-93e7-4885-ad62-d1896bcc1553 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:18:22.660804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbbdf0c-93e7-4885-ad62-d1896bcc1553 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:22.663016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbbdf0c-93e7-4885-ad62-d1896bcc1553 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:22.687926 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2150/4308] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:18:22.698990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb365a9-643e-4b00-826d-6b20b11ee883 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:22.710493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb365a9-643e-4b00-826d-6b20b11ee883 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:22.715416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7949bd-d11f-414c-88b6-c66be10cc0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:22.716324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7949bd-d11f-414c-88b6-c66be10cc0cf admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:22.716821 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7949bd-d11f-414c-88b6-c66be10cc0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:22.717331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7949bd-d11f-414c-88b6-c66be10cc0cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:22.720048 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7949bd-d11f-414c-88b6-c66be10cc0cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:22.722816 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7949bd-d11f-414c-88b6-c66be10cc0cf admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:22.762499 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2159/4309] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:18:22 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:18:22.767307 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbbdf0c-93e7-4885-ad62-d1896bcc1553 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:22.778988 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbbdf0c-93e7-4885-ad62-d1896bcc1553 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:22.856550 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb0070-49c4-42a5-94b4-24c190111896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:22.857280 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb0070-49c4-42a5-94b4-24c190111896 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:22.857602 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb0070-49c4-42a5-94b4-24c190111896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:22.857910 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb0070-49c4-42a5-94b4-24c190111896 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:22.858676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb0070-49c4-42a5-94b4-24c190111896 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:22.860713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb0070-49c4-42a5-94b4-24c190111896 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:22.894287 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:22.905633 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2151/4310] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:18:22 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:18:22.912936 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7949bd-d11f-414c-88b6-c66be10cc0cf admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:22.928450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7949bd-d11f-414c-88b6-c66be10cc0cf admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:22.934707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b388c-d05f-47c8-af89-5895136fbde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:22.936775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b388c-d05f-47c8-af89-5895136fbde5 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:22.938183 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b388c-d05f-47c8-af89-5895136fbde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:22.938666 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b388c-d05f-47c8-af89-5895136fbde5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:22.939495 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b388c-d05f-47c8-af89-5895136fbde5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:22.941292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b388c-d05f-47c8-af89-5895136fbde5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:22.963552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb0070-49c4-42a5-94b4-24c190111896 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:22.963832 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2160/4311] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:18:22.975942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb0070-49c4-42a5-94b4-24c190111896 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:22.982123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887151fe-6eca-4655-abfd-533e5c1a6bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:22.983020 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887151fe-6eca-4655-abfd-533e5c1a6bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:22.983664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887151fe-6eca-4655-abfd-533e5c1a6bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:22.984139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887151fe-6eca-4655-abfd-533e5c1a6bb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:22.985092 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887151fe-6eca-4655-abfd-533e5c1a6bb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:22.988451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887151fe-6eca-4655-abfd-533e5c1a6bb3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:23.010612 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2152/4312] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:18:23.012808 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b388c-d05f-47c8-af89-5895136fbde5 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:23.027205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b388c-d05f-47c8-af89-5895136fbde5 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:23.033832 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20661d-031e-4437-8108-861ae5d5c825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:23.034704 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20661d-031e-4437-8108-861ae5d5c825 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:23.035118 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20661d-031e-4437-8108-861ae5d5c825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:23.036105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20661d-031e-4437-8108-861ae5d5c825 admin admin] PATH_INFO: `/v3/projects/88c2d59a703841a9b33e7026ea307cf6/users/68ed4d195cad4eaea0ba098435f549cc/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:23.086169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f20661d-031e-4437-8108-861ae5d5c825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c2d59a703841a9b33e7026ea307cf6, user_id=68ed4d195cad4eaea0ba098435f549cc, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:23.092886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f20661d-031e-4437-8108-861ae5d5c825 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:23.128069 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2161/4313] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:18:23 2022] PUT /identity/v3/projects/88c2d59a703841a9b33e7026ea307cf6/users/68ed4d195cad4eaea0ba098435f549cc/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:18:23.129908 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd89f4a-47e9-471f-91ce-0f87e8f2c6f8 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:23.130378 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd89f4a-47e9-471f-91ce-0f87e8f2c6f8 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:23.130738 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd89f4a-47e9-471f-91ce-0f87e8f2c6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:23.171453 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-ffd89f4a-47e9-471f-91ce-0f87e8f2c6f8 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:18:23.173186 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ffd89f4a-47e9-471f-91ce-0f87e8f2c6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:23.295458 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2153/4314] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:18:23.336100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20661d-031e-4437-8108-861ae5d5c825 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:23.338894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9f20661d-031e-4437-8108-861ae5d5c825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:23.474835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20661d-031e-4437-8108-861ae5d5c825 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:23.478676 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83037c6c-246a-4c5f-9750-26883ee2ee31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:23.479292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83037c6c-246a-4c5f-9750-26883ee2ee31 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:23.479577 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83037c6c-246a-4c5f-9750-26883ee2ee31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:23.479844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83037c6c-246a-4c5f-9750-26883ee2ee31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:23.496177 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83037c6c-246a-4c5f-9750-26883ee2ee31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:23.497691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83037c6c-246a-4c5f-9750-26883ee2ee31 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:23.517632 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2162/4315] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:18:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:18:24.419877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd89f4a-47e9-471f-91ce-0f87e8f2c6f8 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:24.422992 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ffd89f4a-47e9-471f-91ce-0f87e8f2c6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:24.450363 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd89f4a-47e9-471f-91ce-0f87e8f2c6f8 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:24.460465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b09ffe-3b2a-4dc4-a1c7-74846f7fb511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:24.461300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b09ffe-3b2a-4dc4-a1c7-74846f7fb511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:24.461674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b09ffe-3b2a-4dc4-a1c7-74846f7fb511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:24.461959 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b09ffe-3b2a-4dc4-a1c7-74846f7fb511 admin admin] PATH_INFO: `/v3/users/5e4b9abafee24ca397a7155e2b683511` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:24.464737 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b09ffe-3b2a-4dc4-a1c7-74846f7fb511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e4b9abafee24ca397a7155e2b683511)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:24.466796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b09ffe-3b2a-4dc4-a1c7-74846f7fb511 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:24.559243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a4b09ffe-3b2a-4dc4-a1c7-74846f7fb511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e4b9abafee24ca397a7155e2b683511'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:24.560243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a4b09ffe-3b2a-4dc4-a1c7-74846f7fb511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e4b9abafee24ca397a7155e2b683511'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:24.570876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a4b09ffe-3b2a-4dc4-a1c7-74846f7fb511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e4b9abafee24ca397a7155e2b683511'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:24.588578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a4b09ffe-3b2a-4dc4-a1c7-74846f7fb511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e4b9abafee24ca397a7155e2b683511'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:24.589597 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a4b09ffe-3b2a-4dc4-a1c7-74846f7fb511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e4b9abafee24ca397a7155e2b683511'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:24.632844 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2154/4316] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:18:24 2022] DELETE /identity/v3/users/5e4b9abafee24ca397a7155e2b683511 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:18:25.004699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83037c6c-246a-4c5f-9750-26883ee2ee31 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:25.028509 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83037c6c-246a-4c5f-9750-26883ee2ee31 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:25.076644 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:25.106557 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84355fe-0b6c-491e-8d74-07ffa312af59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:25.107208 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84355fe-0b6c-491e-8d74-07ffa312af59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:25.107494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84355fe-0b6c-491e-8d74-07ffa312af59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:25.107773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84355fe-0b6c-491e-8d74-07ffa312af59 admin admin] PATH_INFO: `/v3/projects/ef80be282e704a6bbba0e81c3c3c4b64` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:25.109614 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84355fe-0b6c-491e-8d74-07ffa312af59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef80be282e704a6bbba0e81c3c3c4b64)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:25.112024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84355fe-0b6c-491e-8d74-07ffa312af59 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:25.201450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b84355fe-0b6c-491e-8d74-07ffa312af59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef80be282e704a6bbba0e81c3c3c4b64', 'request_id': 'req-b84355fe-0b6c-491e-8d74-07ffa312af59'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:25.222867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b84355fe-0b6c-491e-8d74-07ffa312af59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef80be282e704a6bbba0e81c3c3c4b64', 'request_id': 'req-b84355fe-0b6c-491e-8d74-07ffa312af59'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:25.230806 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b84355fe-0b6c-491e-8d74-07ffa312af59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef80be282e704a6bbba0e81c3c3c4b64', 'request_id': 'req-b84355fe-0b6c-491e-8d74-07ffa312af59'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:25.248228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b84355fe-0b6c-491e-8d74-07ffa312af59 admin admin] The token cache is being invalidate because project ef80be282e704a6bbba0e81c3c3c4b64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:18:25.248662 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b84355fe-0b6c-491e-8d74-07ffa312af59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:25.250087 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b84355fe-0b6c-491e-8d74-07ffa312af59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:25.252209 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2163/4317] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:18:25 2022] DELETE /identity/v3/projects/ef80be282e704a6bbba0e81c3c3c4b64 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:18:25.256807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ea0c8-fac4-4536-ae3f-fbdaa964ad2d None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:25.257585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ea0c8-fac4-4536-ae3f-fbdaa964ad2d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:25.258076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ea0c8-fac4-4536-ae3f-fbdaa964ad2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:25.283025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-259ea0c8-fac4-4536-ae3f-fbdaa964ad2d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:18:25.285473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-259ea0c8-fac4-4536-ae3f-fbdaa964ad2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:25.358285 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:25.371913 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2155/4318] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:18:25.380318 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c66b33-d669-4a5f-a226-b971c8b7793d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:25.380561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c66b33-d669-4a5f-a226-b971c8b7793d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:25.380836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c66b33-d669-4a5f-a226-b971c8b7793d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:25.416870 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-01c66b33-d669-4a5f-a226-b971c8b7793d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:18:25.418283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-01c66b33-d669-4a5f-a226-b971c8b7793d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:25.441210 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2164/4319] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:18:25.444376 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ea0c8-fac4-4536-ae3f-fbdaa964ad2d None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:25.456757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ea0c8-fac4-4536-ae3f-fbdaa964ad2d None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:25.464292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631fc3e4-83c3-4e17-a871-52f90ab206c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:25.465091 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fc3e4-83c3-4e17-a871-52f90ab206c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:25.465495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fc3e4-83c3-4e17-a871-52f90ab206c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:25.466025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fc3e4-83c3-4e17-a871-52f90ab206c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:25.467374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631fc3e4-83c3-4e17-a871-52f90ab206c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:18:25.468103 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631fc3e4-83c3-4e17-a871-52f90ab206c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:25.469976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631fc3e4-83c3-4e17-a871-52f90ab206c8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:25.489640 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2156/4320] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:18:25.490475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c66b33-d669-4a5f-a226-b971c8b7793d None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:25.501905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c66b33-d669-4a5f-a226-b971c8b7793d None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:25.507833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6499d6-3e6c-4847-af42-5fce83eef688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:25.509043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6499d6-3e6c-4847-af42-5fce83eef688 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:25.509374 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6499d6-3e6c-4847-af42-5fce83eef688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:25.509692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6499d6-3e6c-4847-af42-5fce83eef688 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:25.510541 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6499d6-3e6c-4847-af42-5fce83eef688 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:25.512633 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6499d6-3e6c-4847-af42-5fce83eef688 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:25.562992 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2165/4321] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:18:25 2022] POST /identity/v3/projects => generated 371 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:18:25.564759 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631fc3e4-83c3-4e17-a871-52f90ab206c8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:25.586477 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631fc3e4-83c3-4e17-a871-52f90ab206c8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:25.740191 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594ae02-7dc5-4851-a826-457b5031210e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:25.740689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594ae02-7dc5-4851-a826-457b5031210e admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:25.741025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594ae02-7dc5-4851-a826-457b5031210e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:25.741303 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594ae02-7dc5-4851-a826-457b5031210e admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:25.742129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5594ae02-7dc5-4851-a826-457b5031210e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:25.750649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5594ae02-7dc5-4851-a826-457b5031210e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:25.814601 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2157/4322] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:18:25 2022] POST /identity/v3/users => generated 286 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:18:25.815652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6499d6-3e6c-4847-af42-5fce83eef688 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:25.844668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6499d6-3e6c-4847-af42-5fce83eef688 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:25.881754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315198b-0fc1-433f-8de8-65408c2d49db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:25.882425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315198b-0fc1-433f-8de8-65408c2d49db admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:25.882680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315198b-0fc1-433f-8de8-65408c2d49db admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:25.883142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315198b-0fc1-433f-8de8-65408c2d49db admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:25.883813 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315198b-0fc1-433f-8de8-65408c2d49db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:25.887538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315198b-0fc1-433f-8de8-65408c2d49db admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:25.912661 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594ae02-7dc5-4851-a826-457b5031210e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:25.918313 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2166/4323] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:18:25.924945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594ae02-7dc5-4851-a826-457b5031210e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:25.930444 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4fec3-c4da-4353-95db-a1493501a776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:25.931085 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4fec3-c4da-4353-95db-a1493501a776 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:25.931363 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4fec3-c4da-4353-95db-a1493501a776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:25.931845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4fec3-c4da-4353-95db-a1493501a776 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:25.932657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4fec3-c4da-4353-95db-a1493501a776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:25.934528 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4fec3-c4da-4353-95db-a1493501a776 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:25.963684 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315198b-0fc1-433f-8de8-65408c2d49db admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:25.971613 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2158/4324] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:18:25.976258 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315198b-0fc1-433f-8de8-65408c2d49db admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:25.985623 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c0509-7940-4d37-9d16-0a133de23b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:25.986677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c0509-7940-4d37-9d16-0a133de23b12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:25.987285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c0509-7940-4d37-9d16-0a133de23b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:25.987769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c0509-7940-4d37-9d16-0a133de23b12 admin admin] PATH_INFO: `/v3/projects/5d4e9cfcf8bf419b9da77579c8adca6a/users/89201091a55a4cc49f6900d9137c212f/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:26.007220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c0509-7940-4d37-9d16-0a133de23b12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d4e9cfcf8bf419b9da77579c8adca6a, user_id=89201091a55a4cc49f6900d9137c212f, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:26.011293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c0509-7940-4d37-9d16-0a133de23b12 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:26.043146 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2167/4325] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:18:25 2022] PUT /identity/v3/projects/5d4e9cfcf8bf419b9da77579c8adca6a/users/89201091a55a4cc49f6900d9137c212f/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:18:26.043340 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ca94d-8636-4dd1-ad82-66cbacb530a1 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:26.043524 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ca94d-8636-4dd1-ad82-66cbacb530a1 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:26.043970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ca94d-8636-4dd1-ad82-66cbacb530a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:26.109253 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-315ca94d-8636-4dd1-ad82-66cbacb530a1 None None] MFA Rules not processed for user `89201091a55a4cc49f6900d9137c212f`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:18:26.110578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-315ca94d-8636-4dd1-ad82-66cbacb530a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:26.212072 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2159/4326] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:18:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:18:26.256912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c0509-7940-4d37-9d16-0a133de23b12 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:26.259158 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e44c0509-7940-4d37-9d16-0a133de23b12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:26.387197 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:26.393601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c0509-7940-4d37-9d16-0a133de23b12 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:26.401262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d4830-1c05-4cb5-ad76-ade49e6a5ea7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:26.402392 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d4830-1c05-4cb5-ad76-ade49e6a5ea7 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:26.402904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d4830-1c05-4cb5-ad76-ade49e6a5ea7 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:26.403494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d4830-1c05-4cb5-ad76-ade49e6a5ea7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:26.415230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d4830-1c05-4cb5-ad76-ade49e6a5ea7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:26.418862 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d4830-1c05-4cb5-ad76-ade49e6a5ea7 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:26.431769 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2168/4327] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:18:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:18:27.606505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ca94d-8636-4dd1-ad82-66cbacb530a1 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:27.759660 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:27.771226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ca94d-8636-4dd1-ad82-66cbacb530a1 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:27.779041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69166862-6df5-4645-a0f9-571005eea8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:27.782334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69166862-6df5-4645-a0f9-571005eea8e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:27.783174 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69166862-6df5-4645-a0f9-571005eea8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:27.783174 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69166862-6df5-4645-a0f9-571005eea8e3 admin admin] PATH_INFO: `/v3/users/89201091a55a4cc49f6900d9137c212f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:27.784511 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69166862-6df5-4645-a0f9-571005eea8e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89201091a55a4cc49f6900d9137c212f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:27.788335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69166862-6df5-4645-a0f9-571005eea8e3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:27.904615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-69166862-6df5-4645-a0f9-571005eea8e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89201091a55a4cc49f6900d9137c212f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:27.910493 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-69166862-6df5-4645-a0f9-571005eea8e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89201091a55a4cc49f6900d9137c212f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:27.946340 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-69166862-6df5-4645-a0f9-571005eea8e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89201091a55a4cc49f6900d9137c212f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:27.964093 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-69166862-6df5-4645-a0f9-571005eea8e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89201091a55a4cc49f6900d9137c212f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:27.967279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-69166862-6df5-4645-a0f9-571005eea8e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89201091a55a4cc49f6900d9137c212f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:28.032000 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2160/4328] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:18:27 2022] DELETE /identity/v3/users/89201091a55a4cc49f6900d9137c212f => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:18:28.036124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8130e1b-b304-4b15-b64c-0a6ce8a717a7 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:28.036950 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8130e1b-b304-4b15-b64c-0a6ce8a717a7 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:28.037417 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8130e1b-b304-4b15-b64c-0a6ce8a717a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:28.072137 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c8130e1b-b304-4b15-b64c-0a6ce8a717a7 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:18:28.073842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c8130e1b-b304-4b15-b64c-0a6ce8a717a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:28.187153 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2169/4329] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:18:28.228534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69166862-6df5-4645-a0f9-571005eea8e3 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:28.230053 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-69166862-6df5-4645-a0f9-571005eea8e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:28.378651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69166862-6df5-4645-a0f9-571005eea8e3 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:28.385621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686582ca-2b01-48e6-9ea0-fe88ac8625da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:28.386957 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686582ca-2b01-48e6-9ea0-fe88ac8625da service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:28.387467 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686582ca-2b01-48e6-9ea0-fe88ac8625da service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:28.387959 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686582ca-2b01-48e6-9ea0-fe88ac8625da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:28.402040 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686582ca-2b01-48e6-9ea0-fe88ac8625da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:28.404165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686582ca-2b01-48e6-9ea0-fe88ac8625da service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:28.428673 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2161/4330] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:18:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:18:29.126646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8130e1b-b304-4b15-b64c-0a6ce8a717a7 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:29.128198 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c8130e1b-b304-4b15-b64c-0a6ce8a717a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:29.147644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8130e1b-b304-4b15-b64c-0a6ce8a717a7 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:29.158758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b5c7a-02f5-4181-9550-ba2da79aa4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:29.161273 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b5c7a-02f5-4181-9550-ba2da79aa4d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:29.162489 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b5c7a-02f5-4181-9550-ba2da79aa4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:29.163600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b5c7a-02f5-4181-9550-ba2da79aa4d9 admin admin] PATH_INFO: `/v3/projects/5d4e9cfcf8bf419b9da77579c8adca6a` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:29.170300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b5c7a-02f5-4181-9550-ba2da79aa4d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d4e9cfcf8bf419b9da77579c8adca6a)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:29.179883 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b5c7a-02f5-4181-9550-ba2da79aa4d9 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:29.317186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-526b5c7a-02f5-4181-9550-ba2da79aa4d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d4e9cfcf8bf419b9da77579c8adca6a', 'request_id': 'req-526b5c7a-02f5-4181-9550-ba2da79aa4d9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:29.345229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-526b5c7a-02f5-4181-9550-ba2da79aa4d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d4e9cfcf8bf419b9da77579c8adca6a', 'request_id': 'req-526b5c7a-02f5-4181-9550-ba2da79aa4d9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:29.369342 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-526b5c7a-02f5-4181-9550-ba2da79aa4d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d4e9cfcf8bf419b9da77579c8adca6a', 'request_id': 'req-526b5c7a-02f5-4181-9550-ba2da79aa4d9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:29.404025 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-526b5c7a-02f5-4181-9550-ba2da79aa4d9 admin admin] The token cache is being invalidate because project 5d4e9cfcf8bf419b9da77579c8adca6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:18:29.404487 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-526b5c7a-02f5-4181-9550-ba2da79aa4d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:29.406002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-526b5c7a-02f5-4181-9550-ba2da79aa4d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:29.408728 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2170/4331] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:18:29 2022] DELETE /identity/v3/projects/5d4e9cfcf8bf419b9da77579c8adca6a => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:18:29.413365 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcbb73-62a7-4cce-b4eb-cf9255683929 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:29.413912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcbb73-62a7-4cce-b4eb-cf9255683929 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:29.413991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcbb73-62a7-4cce-b4eb-cf9255683929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:29.436158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-25dcbb73-62a7-4cce-b4eb-cf9255683929 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:18:29.437575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-25dcbb73-62a7-4cce-b4eb-cf9255683929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:29.521030 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2162/4332] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:18:29.529720 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4adef-32ca-4d0d-9e55-e57ea2ca03ab None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:29.530622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4adef-32ca-4d0d-9e55-e57ea2ca03ab None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:29.530916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4adef-32ca-4d0d-9e55-e57ea2ca03ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:29.560127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-b6a4adef-32ca-4d0d-9e55-e57ea2ca03ab None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:18:29.563233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b6a4adef-32ca-4d0d-9e55-e57ea2ca03ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:29.579435 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2171/4333] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:18:29.580630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcbb73-62a7-4cce-b4eb-cf9255683929 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:29.593834 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcbb73-62a7-4cce-b4eb-cf9255683929 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:29.599734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08d52b8-9a7d-46c5-9667-32726e5a6246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:29.601276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d52b8-9a7d-46c5-9667-32726e5a6246 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:29.601674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d52b8-9a7d-46c5-9667-32726e5a6246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:29.601899 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d52b8-9a7d-46c5-9667-32726e5a6246 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:29.602850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08d52b8-9a7d-46c5-9667-32726e5a6246 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:18:29.603295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08d52b8-9a7d-46c5-9667-32726e5a6246 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:29.605264 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08d52b8-9a7d-46c5-9667-32726e5a6246 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:29.620918 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2163/4334] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:18:29.625906 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4adef-32ca-4d0d-9e55-e57ea2ca03ab None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:29.640875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4adef-32ca-4d0d-9e55-e57ea2ca03ab None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:29.646646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565dad29-adf5-4bc2-84a6-7e2570dcf246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:29.647284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565dad29-adf5-4bc2-84a6-7e2570dcf246 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:29.647559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565dad29-adf5-4bc2-84a6-7e2570dcf246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:29.647829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565dad29-adf5-4bc2-84a6-7e2570dcf246 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:29.648701 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565dad29-adf5-4bc2-84a6-7e2570dcf246 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:29.651335 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565dad29-adf5-4bc2-84a6-7e2570dcf246 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:29.689149 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2172/4335] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:18:29 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:18:29.689600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08d52b8-9a7d-46c5-9667-32726e5a6246 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:29.698281 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:29.703645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08d52b8-9a7d-46c5-9667-32726e5a6246 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:29.803683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d079b19-6530-450e-9543-ca9c0cc384f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:29.806129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d079b19-6530-450e-9543-ca9c0cc384f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:29.806742 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d079b19-6530-450e-9543-ca9c0cc384f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:29.807489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d079b19-6530-450e-9543-ca9c0cc384f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:29.808463 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d079b19-6530-450e-9543-ca9c0cc384f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:29.812335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d079b19-6530-450e-9543-ca9c0cc384f8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:29.853755 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2164/4336] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:18:29 2022] POST /identity/v3/users => generated 290 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:18:29.858192 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565dad29-adf5-4bc2-84a6-7e2570dcf246 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:29.879160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565dad29-adf5-4bc2-84a6-7e2570dcf246 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:29.897668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c5fed-0cad-40c7-8972-9270d867ae7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:29.898504 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c5fed-0cad-40c7-8972-9270d867ae7d admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:29.898959 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c5fed-0cad-40c7-8972-9270d867ae7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:29.899404 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c5fed-0cad-40c7-8972-9270d867ae7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:29.900220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c5fed-0cad-40c7-8972-9270d867ae7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:29.909496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c5fed-0cad-40c7-8972-9270d867ae7d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:29.943688 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2173/4337] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:18:29.948335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d079b19-6530-450e-9543-ca9c0cc384f8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:29.959775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d079b19-6530-450e-9543-ca9c0cc384f8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:29.965178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94fc83-ef23-4a8a-ae43-a7b7898ada45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:29.965833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94fc83-ef23-4a8a-ae43-a7b7898ada45 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:29.966121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94fc83-ef23-4a8a-ae43-a7b7898ada45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:29.966389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94fc83-ef23-4a8a-ae43-a7b7898ada45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:29.967040 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94fc83-ef23-4a8a-ae43-a7b7898ada45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:29.968718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94fc83-ef23-4a8a-ae43-a7b7898ada45 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:29.981070 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2165/4338] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:18:29.985602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c5fed-0cad-40c7-8972-9270d867ae7d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:30.011811 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c5fed-0cad-40c7-8972-9270d867ae7d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:30.018033 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a0786-95bb-40e5-b315-0de1602f885c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:30.018992 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a0786-95bb-40e5-b315-0de1602f885c admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:30.019690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a0786-95bb-40e5-b315-0de1602f885c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:30.020159 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a0786-95bb-40e5-b315-0de1602f885c admin admin] PATH_INFO: `/v3/projects/d55147c802484bc7bafdaa417d0373d8/users/801ea22245104e7da6366b14379adad3/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:30.039672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a0786-95bb-40e5-b315-0de1602f885c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d55147c802484bc7bafdaa417d0373d8, user_id=801ea22245104e7da6366b14379adad3, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:30.043523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a0786-95bb-40e5-b315-0de1602f885c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:30.078691 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2174/4339] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:18:29 2022] PUT /identity/v3/projects/d55147c802484bc7bafdaa417d0373d8/users/801ea22245104e7da6366b14379adad3/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:18:30.080959 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b27b74-5f64-4ebb-9b09-37c7068a1114 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:30.081278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b27b74-5f64-4ebb-9b09-37c7068a1114 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:30.081564 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b27b74-5f64-4ebb-9b09-37c7068a1114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:30.110345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-34b27b74-5f64-4ebb-9b09-37c7068a1114 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:18:30.111721 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-34b27b74-5f64-4ebb-9b09-37c7068a1114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:30.257789 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2166/4340] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:18:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:18:30.301484 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a0786-95bb-40e5-b315-0de1602f885c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:30.304096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ad5a0786-95bb-40e5-b315-0de1602f885c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:30.320646 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:30.428624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a0786-95bb-40e5-b315-0de1602f885c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:30.436659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae136a-04d9-4aa6-8528-b9407d9e9dfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:30.437525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae136a-04d9-4aa6-8528-b9407d9e9dfe service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:30.438843 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae136a-04d9-4aa6-8528-b9407d9e9dfe service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:30.439415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae136a-04d9-4aa6-8528-b9407d9e9dfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:30.486806 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae136a-04d9-4aa6-8528-b9407d9e9dfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:30.489309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae136a-04d9-4aa6-8528-b9407d9e9dfe service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:30.517761 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2175/4341] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:18:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:18:33.018568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d5abf-4123-4374-9847-5056a4f9e431 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:33.019028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d5abf-4123-4374-9847-5056a4f9e431 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:33.019425 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d5abf-4123-4374-9847-5056a4f9e431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:33.066588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-334d5abf-4123-4374-9847-5056a4f9e431 None None] MFA Rules not processed for user `68ed4d195cad4eaea0ba098435f549cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:18:33.068003 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-334d5abf-4123-4374-9847-5056a4f9e431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:33.236057 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2167/4342] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:18:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:18:39.582498 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76fc52-4908-43a8-b853-00d963ae4264 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:39.584496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76fc52-4908-43a8-b853-00d963ae4264 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:39.584908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76fc52-4908-43a8-b853-00d963ae4264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:39.632939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-cb76fc52-4908-43a8-b853-00d963ae4264 None None] MFA Rules not processed for user `801ea22245104e7da6366b14379adad3`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:18:39.634609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-cb76fc52-4908-43a8-b853-00d963ae4264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:39.767141 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2176/4343] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:18:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:18:39.768462 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d5abf-4123-4374-9847-5056a4f9e431 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:39.796110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d5abf-4123-4374-9847-5056a4f9e431 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:39.804199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085937c3-82e4-46c1-87bf-9945c3c06ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:39.805024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085937c3-82e4-46c1-87bf-9945c3c06ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:39.806689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085937c3-82e4-46c1-87bf-9945c3c06ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:39.807172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085937c3-82e4-46c1-87bf-9945c3c06ed2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:39.807978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085937c3-82e4-46c1-87bf-9945c3c06ed2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:39.815974 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085937c3-82e4-46c1-87bf-9945c3c06ed2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:39.836401 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:39.901752 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2168/4344] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:18:39 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:18:39.906701 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76fc52-4908-43a8-b853-00d963ae4264 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:39.925086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76fc52-4908-43a8-b853-00d963ae4264 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:40.069214 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb3420-ba16-4222-b82d-1a9908f9a8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:40.069879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb3420-ba16-4222-b82d-1a9908f9a8e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:40.070445 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb3420-ba16-4222-b82d-1a9908f9a8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:40.070729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb3420-ba16-4222-b82d-1a9908f9a8e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:40.072326 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fb3420-ba16-4222-b82d-1a9908f9a8e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:40.076114 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fb3420-ba16-4222-b82d-1a9908f9a8e9 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:40.128548 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2177/4345] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:18:39 2022] POST /identity/v3/users => generated 296 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:18:40.132578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085937c3-82e4-46c1-87bf-9945c3c06ed2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:40.197187 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085937c3-82e4-46c1-87bf-9945c3c06ed2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:40.235876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb22ec6-9755-44e2-a0fb-84ced7736e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:40.236602 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb22ec6-9755-44e2-a0fb-84ced7736e36 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:40.236983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb22ec6-9755-44e2-a0fb-84ced7736e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:40.237332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb22ec6-9755-44e2-a0fb-84ced7736e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:40.238353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb22ec6-9755-44e2-a0fb-84ced7736e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:40.244071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb22ec6-9755-44e2-a0fb-84ced7736e36 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:40.266448 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2169/4346] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:18:40.267418 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb3420-ba16-4222-b82d-1a9908f9a8e9 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:40.281803 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb3420-ba16-4222-b82d-1a9908f9a8e9 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:40.306674 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8dd22-30c3-41a1-819d-8fa58b59448c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:40.307369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8dd22-30c3-41a1-819d-8fa58b59448c admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:40.307650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8dd22-30c3-41a1-819d-8fa58b59448c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:40.307921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8dd22-30c3-41a1-819d-8fa58b59448c admin admin] PATH_INFO: `/v3/projects/6fd683c4aec640359c8348ee6bb9a385/users/bbd00e21b41b4dc5b56ccff0127b76af/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:40.352957 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8dd22-30c3-41a1-819d-8fa58b59448c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fd683c4aec640359c8348ee6bb9a385, user_id=bbd00e21b41b4dc5b56ccff0127b76af, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:40.356075 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8dd22-30c3-41a1-819d-8fa58b59448c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:40.388698 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2178/4347] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:18:40 2022] PUT /identity/v3/projects/6fd683c4aec640359c8348ee6bb9a385/users/bbd00e21b41b4dc5b56ccff0127b76af/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:18:40.392711 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb22ec6-9755-44e2-a0fb-84ced7736e36 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:40.431287 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb22ec6-9755-44e2-a0fb-84ced7736e36 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:40.598815 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854df77-5ae4-41c1-a5c6-87391e1c00cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:40.602299 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854df77-5ae4-41c1-a5c6-87391e1c00cf admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:40.602426 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8dd22-30c3-41a1-819d-8fa58b59448c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:40.602892 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854df77-5ae4-41c1-a5c6-87391e1c00cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:40.603216 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854df77-5ae4-41c1-a5c6-87391e1c00cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:40.604075 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854df77-5ae4-41c1-a5c6-87391e1c00cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:40.604463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a5f8dd22-30c3-41a1-819d-8fa58b59448c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:40.609034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854df77-5ae4-41c1-a5c6-87391e1c00cf admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:40.633192 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2170/4348] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:18:40.641227 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854df77-5ae4-41c1-a5c6-87391e1c00cf admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:40.642776 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:40.676193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854df77-5ae4-41c1-a5c6-87391e1c00cf admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:40.689630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b7f05-7337-4685-a2ae-ba6d0f47bc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:40.691696 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b7f05-7337-4685-a2ae-ba6d0f47bc5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:40.691696 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b7f05-7337-4685-a2ae-ba6d0f47bc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:40.692698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b7f05-7337-4685-a2ae-ba6d0f47bc5d admin admin] PATH_INFO: `/v3/projects/6fd683c4aec640359c8348ee6bb9a385/users/bbd00e21b41b4dc5b56ccff0127b76af/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:40.696542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b7f05-7337-4685-a2ae-ba6d0f47bc5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fd683c4aec640359c8348ee6bb9a385, user_id=bbd00e21b41b4dc5b56ccff0127b76af, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:40.703602 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b7f05-7337-4685-a2ae-ba6d0f47bc5d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:40.739205 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2171/4349] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:18:40 2022] PUT /identity/v3/projects/6fd683c4aec640359c8348ee6bb9a385/users/bbd00e21b41b4dc5b56ccff0127b76af/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:18:40.786775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8dd22-30c3-41a1-819d-8fa58b59448c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:40.902549 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12866b3-ffbf-45e2-ad78-453bb5352434 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:40.903244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12866b3-ffbf-45e2-ad78-453bb5352434 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:40.903531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12866b3-ffbf-45e2-ad78-453bb5352434 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:40.903808 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12866b3-ffbf-45e2-ad78-453bb5352434 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:40.908038 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f12866b3-ffbf-45e2-ad78-453bb5352434 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:41.008959 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12866b3-ffbf-45e2-ad78-453bb5352434 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:41.010698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12866b3-ffbf-45e2-ad78-453bb5352434 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:41.025859 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2179/4350] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:18:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:18:42.640668 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b7f05-7337-4685-a2ae-ba6d0f47bc5d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:42.643131 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ac8b7f05-7337-4685-a2ae-ba6d0f47bc5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:42.665309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12866b3-ffbf-45e2-ad78-453bb5352434 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:42.666758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f12866b3-ffbf-45e2-ad78-453bb5352434 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:42.819009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b7f05-7337-4685-a2ae-ba6d0f47bc5d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:42.822020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12866b3-ffbf-45e2-ad78-453bb5352434 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:42.835564 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c9933-4845-4af9-acd7-d1c30221f7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:42.836860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c9933-4845-4af9-acd7-d1c30221f7ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:42.838492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c9933-4845-4af9-acd7-d1c30221f7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:42.839491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25471850-116d-4186-aa18-6e75d06e8457 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:42.839995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c9933-4845-4af9-acd7-d1c30221f7ce admin admin] PATH_INFO: `/v3/users/68ed4d195cad4eaea0ba098435f549cc` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:42.844050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c9933-4845-4af9-acd7-d1c30221f7ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=68ed4d195cad4eaea0ba098435f549cc)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:42.844206 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25471850-116d-4186-aa18-6e75d06e8457 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:42.845578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25471850-116d-4186-aa18-6e75d06e8457 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:42.846139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25471850-116d-4186-aa18-6e75d06e8457 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:42.851485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c9933-4845-4af9-acd7-d1c30221f7ce admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:42.854639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-25471850-116d-4186-aa18-6e75d06e8457 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:42.871354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25471850-116d-4186-aa18-6e75d06e8457 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:42.873304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25471850-116d-4186-aa18-6e75d06e8457 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:42.886499 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2172/4351] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:18:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:18:42.970333 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:42.976204 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fd1c9933-4845-4af9-acd7-d1c30221f7ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68ed4d195cad4eaea0ba098435f549cc'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:42.977282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fd1c9933-4845-4af9-acd7-d1c30221f7ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68ed4d195cad4eaea0ba098435f549cc'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:42.987687 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fd1c9933-4845-4af9-acd7-d1c30221f7ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68ed4d195cad4eaea0ba098435f549cc'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:43.006374 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fd1c9933-4845-4af9-acd7-d1c30221f7ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68ed4d195cad4eaea0ba098435f549cc'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:43.007319 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fd1c9933-4845-4af9-acd7-d1c30221f7ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68ed4d195cad4eaea0ba098435f549cc'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:43.052240 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2180/4352] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:18:42 2022] DELETE /identity/v3/users/68ed4d195cad4eaea0ba098435f549cc => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:18:43.305399 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25471850-116d-4186-aa18-6e75d06e8457 service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:43.320495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25471850-116d-4186-aa18-6e75d06e8457 service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:43.382545 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:43.395915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6ed2f-1120-46c4-b4bb-f975a37d68e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:43.396666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6ed2f-1120-46c4-b4bb-f975a37d68e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:43.396955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6ed2f-1120-46c4-b4bb-f975a37d68e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:43.397232 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6ed2f-1120-46c4-b4bb-f975a37d68e1 admin admin] PATH_INFO: `/v3/projects/88c2d59a703841a9b33e7026ea307cf6` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:43.398752 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea6ed2f-1120-46c4-b4bb-f975a37d68e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88c2d59a703841a9b33e7026ea307cf6)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:43.401202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea6ed2f-1120-46c4-b4bb-f975a37d68e1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:43.485886 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5ea6ed2f-1120-46c4-b4bb-f975a37d68e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88c2d59a703841a9b33e7026ea307cf6', 'request_id': 'req-5ea6ed2f-1120-46c4-b4bb-f975a37d68e1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:43.496676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5ea6ed2f-1120-46c4-b4bb-f975a37d68e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88c2d59a703841a9b33e7026ea307cf6', 'request_id': 'req-5ea6ed2f-1120-46c4-b4bb-f975a37d68e1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:43.508349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5ea6ed2f-1120-46c4-b4bb-f975a37d68e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88c2d59a703841a9b33e7026ea307cf6', 'request_id': 'req-5ea6ed2f-1120-46c4-b4bb-f975a37d68e1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:43.521913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5ea6ed2f-1120-46c4-b4bb-f975a37d68e1 admin admin] The token cache is being invalidate because project 88c2d59a703841a9b33e7026ea307cf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:18:43.522545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5ea6ed2f-1120-46c4-b4bb-f975a37d68e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:43.524562 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5ea6ed2f-1120-46c4-b4bb-f975a37d68e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:43.526718 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2173/4353] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:18:43 2022] DELETE /identity/v3/projects/88c2d59a703841a9b33e7026ea307cf6 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:18:43.536601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de913c8f-191f-4b7c-9b91-b57b88aff434 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:43.537022 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de913c8f-191f-4b7c-9b91-b57b88aff434 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:43.538856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de913c8f-191f-4b7c-9b91-b57b88aff434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:43.642703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-de913c8f-191f-4b7c-9b91-b57b88aff434 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:18:43.643935 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-de913c8f-191f-4b7c-9b91-b57b88aff434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:43.719819 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2181/4354] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:18:43.727975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917762e5-076a-40e4-ba01-feff17e572c6 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:43.728447 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917762e5-076a-40e4-ba01-feff17e572c6 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:43.728542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917762e5-076a-40e4-ba01-feff17e572c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:43.751885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-917762e5-076a-40e4-ba01-feff17e572c6 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:18:43.753378 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-917762e5-076a-40e4-ba01-feff17e572c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:43.762201 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2174/4355] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:18:43.767279 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de913c8f-191f-4b7c-9b91-b57b88aff434 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:43.786879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de913c8f-191f-4b7c-9b91-b57b88aff434 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:43.791754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de0e8e-12fb-42d5-a5e1-c5abfdd4e057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:43.792343 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de0e8e-12fb-42d5-a5e1-c5abfdd4e057 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:43.792617 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de0e8e-12fb-42d5-a5e1-c5abfdd4e057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:43.792956 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de0e8e-12fb-42d5-a5e1-c5abfdd4e057 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:43.793639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de0e8e-12fb-42d5-a5e1-c5abfdd4e057 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:18:43.793938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de0e8e-12fb-42d5-a5e1-c5abfdd4e057 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:43.796180 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de0e8e-12fb-42d5-a5e1-c5abfdd4e057 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:43.813785 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2182/4356] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:18:43.814968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917762e5-076a-40e4-ba01-feff17e572c6 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:43.826168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917762e5-076a-40e4-ba01-feff17e572c6 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:43.832193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebdb61-e9dd-46c8-ade5-f1dca270bbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:43.833352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebdb61-e9dd-46c8-ade5-f1dca270bbc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:43.833740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebdb61-e9dd-46c8-ade5-f1dca270bbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:43.834085 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebdb61-e9dd-46c8-ade5-f1dca270bbc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:43.834799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebdb61-e9dd-46c8-ade5-f1dca270bbc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:43.836805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebdb61-e9dd-46c8-ade5-f1dca270bbc2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:43.877249 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2175/4357] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:18:43 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:18:43.879096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de0e8e-12fb-42d5-a5e1-c5abfdd4e057 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:43.893390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de0e8e-12fb-42d5-a5e1-c5abfdd4e057 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:43.987464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765e240-5a1f-4e9b-a3a5-48f5101ed653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:43.989031 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765e240-5a1f-4e9b-a3a5-48f5101ed653 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:43.989410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765e240-5a1f-4e9b-a3a5-48f5101ed653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:43.990392 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765e240-5a1f-4e9b-a3a5-48f5101ed653 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:43.990659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765e240-5a1f-4e9b-a3a5-48f5101ed653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:43.992763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765e240-5a1f-4e9b-a3a5-48f5101ed653 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:44.020451 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2183/4358] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:18:43 2022] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:18:44.024569 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebdb61-e9dd-46c8-ade5-f1dca270bbc2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:44.077201 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebdb61-e9dd-46c8-ade5-f1dca270bbc2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:44.094046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55e83c-e3a9-42d4-a74b-75d6dddf99fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:44.095681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55e83c-e3a9-42d4-a74b-75d6dddf99fc admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:44.098372 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55e83c-e3a9-42d4-a74b-75d6dddf99fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:44.098906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55e83c-e3a9-42d4-a74b-75d6dddf99fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:44.104516 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55e83c-e3a9-42d4-a74b-75d6dddf99fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:44.108873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55e83c-e3a9-42d4-a74b-75d6dddf99fc admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:44.145275 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2176/4359] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:18:44.150127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765e240-5a1f-4e9b-a3a5-48f5101ed653 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:44.176479 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765e240-5a1f-4e9b-a3a5-48f5101ed653 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:44.203297 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fec35-0298-44ea-bc3e-74b4af1a3fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:44.203864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fec35-0298-44ea-bc3e-74b4af1a3fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:44.204152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fec35-0298-44ea-bc3e-74b4af1a3fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:44.205600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fec35-0298-44ea-bc3e-74b4af1a3fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:44.206266 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727fec35-0298-44ea-bc3e-74b4af1a3fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:44.212180 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727fec35-0298-44ea-bc3e-74b4af1a3fe5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:44.242924 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2184/4360] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:18:44.243866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55e83c-e3a9-42d4-a74b-75d6dddf99fc admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:44.262091 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55e83c-e3a9-42d4-a74b-75d6dddf99fc admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:44.273041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61fc65d-a1dd-4658-9c6f-de729678a089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:44.273739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fc65d-a1dd-4658-9c6f-de729678a089 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:44.274519 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fc65d-a1dd-4658-9c6f-de729678a089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:44.274799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fc65d-a1dd-4658-9c6f-de729678a089 admin admin] PATH_INFO: `/v3/projects/31ba1cab20f242ada3445ef99c95821a/users/f01fcf63a8a5421987a3f3bcadcb0b5e/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:44.301805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61fc65d-a1dd-4658-9c6f-de729678a089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31ba1cab20f242ada3445ef99c95821a, user_id=f01fcf63a8a5421987a3f3bcadcb0b5e, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:44.305779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61fc65d-a1dd-4658-9c6f-de729678a089 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:44.339004 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2177/4361] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:18:44 2022] PUT /identity/v3/projects/31ba1cab20f242ada3445ef99c95821a/users/f01fcf63a8a5421987a3f3bcadcb0b5e/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:18:44.353324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9d271-a6a0-40ed-b84a-17179afba3e6 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:44.353753 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9d271-a6a0-40ed-b84a-17179afba3e6 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:44.354140 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9d271-a6a0-40ed-b84a-17179afba3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:44.370071 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:44.421078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-77d9d271-a6a0-40ed-b84a-17179afba3e6 None None] MFA Rules not processed for user `f01fcf63a8a5421987a3f3bcadcb0b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:18:44.422481 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-77d9d271-a6a0-40ed-b84a-17179afba3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:44.693597 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61fc65d-a1dd-4658-9c6f-de729678a089 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:44.694583 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2185/4362] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:18:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:18:44.861030 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61fc65d-a1dd-4658-9c6f-de729678a089 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:44.878238 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3525025-c98d-4b0b-8e8b-b83d97c9a101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:44.879336 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3525025-c98d-4b0b-8e8b-b83d97c9a101 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:44.879766 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3525025-c98d-4b0b-8e8b-b83d97c9a101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:44.880207 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3525025-c98d-4b0b-8e8b-b83d97c9a101 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:44.881167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3525025-c98d-4b0b-8e8b-b83d97c9a101 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:44.887537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3525025-c98d-4b0b-8e8b-b83d97c9a101 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:44.972200 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2178/4363] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:18:44 2022] POST /identity/v3/projects => generated 373 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:18:44.976886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9d271-a6a0-40ed-b84a-17179afba3e6 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:44.996306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9d271-a6a0-40ed-b84a-17179afba3e6 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:45.147254 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e6065-f63b-42cd-9c2e-6ccee1042207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:45.148508 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e6065-f63b-42cd-9c2e-6ccee1042207 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:45.150948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e6065-f63b-42cd-9c2e-6ccee1042207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:45.151531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e6065-f63b-42cd-9c2e-6ccee1042207 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:45.154066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e6065-f63b-42cd-9c2e-6ccee1042207 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:45.157591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e6065-f63b-42cd-9c2e-6ccee1042207 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:45.215698 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2186/4364] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:18:44 2022] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:18:45.217825 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3525025-c98d-4b0b-8e8b-b83d97c9a101 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:45.227646 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:45.234356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3525025-c98d-4b0b-8e8b-b83d97c9a101 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:45.252029 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585730ed-ff67-4030-9d3a-21efe52dfa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:45.253010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585730ed-ff67-4030-9d3a-21efe52dfa1d admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:45.253361 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585730ed-ff67-4030-9d3a-21efe52dfa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:45.253668 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585730ed-ff67-4030-9d3a-21efe52dfa1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:45.254326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585730ed-ff67-4030-9d3a-21efe52dfa1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:45.255958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585730ed-ff67-4030-9d3a-21efe52dfa1d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:45.280029 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2179/4365] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:18:45.282762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e6065-f63b-42cd-9c2e-6ccee1042207 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:45.296953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e6065-f63b-42cd-9c2e-6ccee1042207 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:45.309317 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237de562-f448-4b16-9253-45a896a92fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:45.310259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237de562-f448-4b16-9253-45a896a92fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:45.311754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237de562-f448-4b16-9253-45a896a92fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:45.312109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237de562-f448-4b16-9253-45a896a92fe4 admin admin] PATH_INFO: `/v3/projects/18c040092af542f88000d78957da2a0d/users/8538796885e141519c0574f412fb945d/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:45.352274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237de562-f448-4b16-9253-45a896a92fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18c040092af542f88000d78957da2a0d, user_id=8538796885e141519c0574f412fb945d, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:45.355639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237de562-f448-4b16-9253-45a896a92fe4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:45.394429 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2187/4366] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:18:45 2022] PUT /identity/v3/projects/18c040092af542f88000d78957da2a0d/users/8538796885e141519c0574f412fb945d/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:18:45.396523 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585730ed-ff67-4030-9d3a-21efe52dfa1d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:45.415178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585730ed-ff67-4030-9d3a-21efe52dfa1d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:45.563702 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515ee0f-d125-45db-b098-3ac45a61f242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:45.564386 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515ee0f-d125-45db-b098-3ac45a61f242 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:45.564669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515ee0f-d125-45db-b098-3ac45a61f242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:45.564948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515ee0f-d125-45db-b098-3ac45a61f242 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:45.565701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515ee0f-d125-45db-b098-3ac45a61f242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:45.567378 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515ee0f-d125-45db-b098-3ac45a61f242 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:45.579096 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2180/4367] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:18:45.583930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237de562-f448-4b16-9253-45a896a92fe4 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:45.595945 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237de562-f448-4b16-9253-45a896a92fe4 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:45.602732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a8d68-b9b0-4868-b425-42e88baa7ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:45.603583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a8d68-b9b0-4868-b425-42e88baa7ad4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:45.603871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a8d68-b9b0-4868-b425-42e88baa7ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:45.604149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a8d68-b9b0-4868-b425-42e88baa7ad4 admin admin] PATH_INFO: `/v3/projects/18c040092af542f88000d78957da2a0d/users/8538796885e141519c0574f412fb945d/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:45.606358 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a8d68-b9b0-4868-b425-42e88baa7ad4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18c040092af542f88000d78957da2a0d, user_id=8538796885e141519c0574f412fb945d, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:45.610830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a8d68-b9b0-4868-b425-42e88baa7ad4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:45.638931 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2188/4368] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:18:45 2022] PUT /identity/v3/projects/18c040092af542f88000d78957da2a0d/users/8538796885e141519c0574f412fb945d/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:18:45.644410 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1eddb0-5e99-424a-84d8-fd059cf043d2 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:45.644752 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1eddb0-5e99-424a-84d8-fd059cf043d2 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:45.645035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1eddb0-5e99-424a-84d8-fd059cf043d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:45.684847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-0d1eddb0-5e99-424a-84d8-fd059cf043d2 None None] MFA Rules not processed for user `8538796885e141519c0574f412fb945d`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:18:45.686571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0d1eddb0-5e99-424a-84d8-fd059cf043d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:45.828663 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2181/4369] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:18:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:18:45.833222 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a8d68-b9b0-4868-b425-42e88baa7ad4 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:45.863272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a8d68-b9b0-4868-b425-42e88baa7ad4 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:45.905908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e43318-b056-47e3-9400-1938fae325c6 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:45.906760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e43318-b056-47e3-9400-1938fae325c6 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:45.908683 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e43318-b056-47e3-9400-1938fae325c6 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:45.909174 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e43318-b056-47e3-9400-1938fae325c6 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:45.910085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e43318-b056-47e3-9400-1938fae325c6 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:45.915139 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e43318-b056-47e3-9400-1938fae325c6 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:45.948521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1eddb0-5e99-424a-84d8-fd059cf043d2 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:45.950706 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2189/4370] 10.222.0.30 () {60 vars in 1149 bytes} [Sun Sep 4 01:18:45 2022] POST /identity/v3/domains => generated 276 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:18:45.961821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1eddb0-5e99-424a-84d8-fd059cf043d2 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:46.104489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936183ab-2ad0-4978-93ed-985f761e2e36 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:46.105122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936183ab-2ad0-4978-93ed-985f761e2e36 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:46.105401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936183ab-2ad0-4978-93ed-985f761e2e36 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:46.105699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936183ab-2ad0-4978-93ed-985f761e2e36 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:46.106801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936183ab-2ad0-4978-93ed-985f761e2e36 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:46.112724 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936183ab-2ad0-4978-93ed-985f761e2e36 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:46.164261 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:46.201924 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2182/4371] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:18:45 2022] POST /identity/v3/projects => generated 402 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:18:46.206163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e43318-b056-47e3-9400-1938fae325c6 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:46.230514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e43318-b056-47e3-9400-1938fae325c6 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:46.278529 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:46.338298 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6dbb1-4f23-49df-a245-97b62cd9240a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:46.339168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6dbb1-4f23-49df-a245-97b62cd9240a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:46.340451 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6dbb1-4f23-49df-a245-97b62cd9240a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:46.342300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6dbb1-4f23-49df-a245-97b62cd9240a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/groups` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:46.344202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6dbb1-4f23-49df-a245-97b62cd9240a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:46.350625 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-e4e6dbb1-4f23-49df-a245-97b62cd9240a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:18:46.350625 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:18:46.350625 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:18:46.352079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6dbb1-4f23-49df-a245-97b62cd9240a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:46.393552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936183ab-2ad0-4978-93ed-985f761e2e36 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:46.395905 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2190/4372] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Sep 4 01:18:46 2022] POST /identity/v3/groups => generated 302 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:18:46.409459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936183ab-2ad0-4978-93ed-985f761e2e36 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:46.425956 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946c6db-5e58-4421-811b-92b60da318a4 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:46.426190 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946c6db-5e58-4421-811b-92b60da318a4 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:46.428446 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946c6db-5e58-4421-811b-92b60da318a4 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:46.429548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946c6db-5e58-4421-811b-92b60da318a4 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:46.429548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946c6db-5e58-4421-811b-92b60da318a4 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:46.438651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946c6db-5e58-4421-811b-92b60da318a4 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:46.493099 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2183/4373] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:18:46 2022] POST /identity/v3/users => generated 445 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:18:46.500668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6dbb1-4f23-49df-a245-97b62cd9240a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:46.517810 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6dbb1-4f23-49df-a245-97b62cd9240a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:46.534557 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ac10b-4348-4a2d-86fa-1713a438de35 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:46.535225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ac10b-4348-4a2d-86fa-1713a438de35 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:46.535511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ac10b-4348-4a2d-86fa-1713a438de35 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:46.535792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ac10b-4348-4a2d-86fa-1713a438de35 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:46.537060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706ac10b-4348-4a2d-86fa-1713a438de35 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:46.538174 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706ac10b-4348-4a2d-86fa-1713a438de35 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:46.606794 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2191/4374] 10.222.0.30 () {60 vars in 1143 bytes} [Sun Sep 4 01:18:46 2022] POST /identity/v3/roles => generated 239 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:18:46.607875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946c6db-5e58-4421-811b-92b60da318a4 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:46.625753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946c6db-5e58-4421-811b-92b60da318a4 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:46.635926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced443bb-3a20-4409-b648-85ee37699893 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:46.636649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced443bb-3a20-4409-b648-85ee37699893 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:46.636929 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced443bb-3a20-4409-b648-85ee37699893 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:46.637206 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced443bb-3a20-4409-b648-85ee37699893 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/4f4efbcfa0e9461b93201bc3a32867e2/groups/4f8885a9720e4a5ab66f0d8bd7f92ae0/roles/d4fd50c1bcd8467f9964be5427b0a28b/inherited_to_projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:46.651652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced443bb-3a20-4409-b648-85ee37699893 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4f4efbcfa0e9461b93201bc3a32867e2, group_id=4f8885a9720e4a5ab66f0d8bd7f92ae0, role_id=d4fd50c1bcd8467f9964be5427b0a28b)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:46.661677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced443bb-3a20-4409-b648-85ee37699893 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:46.699121 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2184/4375] 10.222.0.30 () {60 vars in 1585 bytes} [Sun Sep 4 01:18:46 2022] PUT /identity/v3/OS-INHERIT/projects/4f4efbcfa0e9461b93201bc3a32867e2/groups/4f8885a9720e4a5ab66f0d8bd7f92ae0/roles/d4fd50c1bcd8467f9964be5427b0a28b/inherited_to_projects => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:18:46.699598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ac10b-4348-4a2d-86fa-1713a438de35 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:46.713643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ac10b-4348-4a2d-86fa-1713a438de35 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:46.844175 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb3476-d0b4-4cdb-80f6-ed043b368dc4 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:46.845248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb3476-d0b4-4cdb-80f6-ed043b368dc4 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:46.845872 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb3476-d0b4-4cdb-80f6-ed043b368dc4 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:46.846338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb3476-d0b4-4cdb-80f6-ed043b368dc4 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/4f4efbcfa0e9461b93201bc3a32867e2/groups/4f8885a9720e4a5ab66f0d8bd7f92ae0/roles/d4fd50c1bcd8467f9964be5427b0a28b/inherited_to_projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:46.850803 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb3476-d0b4-4cdb-80f6-ed043b368dc4 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:check_grant(project_id=4f4efbcfa0e9461b93201bc3a32867e2, group_id=4f8885a9720e4a5ab66f0d8bd7f92ae0, role_id=d4fd50c1bcd8467f9964be5427b0a28b)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:46.856621 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-c3eb3476-d0b4-4cdb-80f6-ed043b368dc4 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:18:46.856621 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:18:46.856621 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:18:46.861247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb3476-d0b4-4cdb-80f6-ed043b368dc4 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:46.882492 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2192/4376] 10.222.0.30 () {58 vars in 1567 bytes} [Sun Sep 4 01:18:46 2022] HEAD /identity/v3/OS-INHERIT/projects/4f4efbcfa0e9461b93201bc3a32867e2/groups/4f8885a9720e4a5ab66f0d8bd7f92ae0/roles/d4fd50c1bcd8467f9964be5427b0a28b/inherited_to_projects => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:18:46.886708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced443bb-3a20-4409-b648-85ee37699893 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:46.901998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced443bb-3a20-4409-b648-85ee37699893 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:46.918027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2e924-6f47-4a9c-b0d2-d9c08d1984ec tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:46.918830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2e924-6f47-4a9c-b0d2-d9c08d1984ec tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:46.919215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2e924-6f47-4a9c-b0d2-d9c08d1984ec tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:46.919582 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2e924-6f47-4a9c-b0d2-d9c08d1984ec tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/4f4efbcfa0e9461b93201bc3a32867e2/groups/4f8885a9720e4a5ab66f0d8bd7f92ae0/roles/d4fd50c1bcd8467f9964be5427b0a28b/inherited_to_projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:46.922647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2e924-6f47-4a9c-b0d2-d9c08d1984ec tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=4f4efbcfa0e9461b93201bc3a32867e2, group_id=4f8885a9720e4a5ab66f0d8bd7f92ae0, role_id=d4fd50c1bcd8467f9964be5427b0a28b)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:46.926725 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2e924-6f47-4a9c-b0d2-d9c08d1984ec tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:46.940760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6ca2e924-6f47-4a9c-b0d2-d9c08d1984ec tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invalidating the token cache because role d4fd50c1bcd8467f9964be5427b0a28b was removed from group 4f8885a9720e4a5ab66f0d8bd7f92ae0 on project 4f4efbcfa0e9461b93201bc3a32867e2. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:18:46.942831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6ca2e924-6f47-4a9c-b0d2-d9c08d1984ec tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:46.944717 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6ca2e924-6f47-4a9c-b0d2-d9c08d1984ec tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:46.975914 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2185/4377] 10.222.0.30 () {58 vars in 1569 bytes} [Sun Sep 4 01:18:46 2022] DELETE /identity/v3/OS-INHERIT/projects/4f4efbcfa0e9461b93201bc3a32867e2/groups/4f8885a9720e4a5ab66f0d8bd7f92ae0/roles/d4fd50c1bcd8467f9964be5427b0a28b/inherited_to_projects => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:18:46.983324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb3476-d0b4-4cdb-80f6-ed043b368dc4 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:46.985842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c3eb3476-d0b4-4cdb-80f6-ed043b368dc4 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:47.004868 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb3476-d0b4-4cdb-80f6-ed043b368dc4 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:47.088781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff660b1b-7374-488f-82cd-064cfca784e8 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:47.090939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff660b1b-7374-488f-82cd-064cfca784e8 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:47.094178 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff660b1b-7374-488f-82cd-064cfca784e8 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:47.094676 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff660b1b-7374-488f-82cd-064cfca784e8 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/roles/d4fd50c1bcd8467f9964be5427b0a28b` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:47.101623 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff660b1b-7374-488f-82cd-064cfca784e8 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d4fd50c1bcd8467f9964be5427b0a28b)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:47.106765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff660b1b-7374-488f-82cd-064cfca784e8 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:47.188911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ff660b1b-7374-488f-82cd-064cfca784e8 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invalidating the token cache because role d4fd50c1bcd8467f9964be5427b0a28b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:18:47.189231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ff660b1b-7374-488f-82cd-064cfca784e8 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:47.191420 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ff660b1b-7374-488f-82cd-064cfca784e8 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:47.203627 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2193/4378] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:18:46 2022] DELETE /identity/v3/roles/d4fd50c1bcd8467f9964be5427b0a28b => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:18:47.205647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2e924-6f47-4a9c-b0d2-d9c08d1984ec tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:47.242595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2e924-6f47-4a9c-b0d2-d9c08d1984ec tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:47.361646 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08772a-92f6-4865-82a9-8f79cfd21a6d tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:47.362287 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08772a-92f6-4865-82a9-8f79cfd21a6d tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:47.362575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08772a-92f6-4865-82a9-8f79cfd21a6d tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:47.362856 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08772a-92f6-4865-82a9-8f79cfd21a6d tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:47.363814 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e08772a-92f6-4865-82a9-8f79cfd21a6d tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:47.365643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e08772a-92f6-4865-82a9-8f79cfd21a6d tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:47.414007 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2186/4379] 10.222.0.30 () {60 vars in 1143 bytes} [Sun Sep 4 01:18:47 2022] POST /identity/v3/roles => generated 239 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:18:47.417986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff660b1b-7374-488f-82cd-064cfca784e8 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:47.419461 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ff660b1b-7374-488f-82cd-064cfca784e8 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:47.435302 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff660b1b-7374-488f-82cd-064cfca784e8 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:47.449498 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52614fb6-2a2e-458e-bf9f-fd73f25ea679 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:47.450516 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52614fb6-2a2e-458e-bf9f-fd73f25ea679 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:47.450968 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52614fb6-2a2e-458e-bf9f-fd73f25ea679 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:47.451970 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52614fb6-2a2e-458e-bf9f-fd73f25ea679 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/4f4efbcfa0e9461b93201bc3a32867e2/users/d15d42841b5f47c2937b968ed877b270/roles/b6f35004c476456eab4c3b0549f45b97/inherited_to_projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:47.485108 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:47.489359 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52614fb6-2a2e-458e-bf9f-fd73f25ea679 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4f4efbcfa0e9461b93201bc3a32867e2, user_id=d15d42841b5f47c2937b968ed877b270, role_id=b6f35004c476456eab4c3b0549f45b97)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:47.494418 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52614fb6-2a2e-458e-bf9f-fd73f25ea679 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:47.529153 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2194/4380] 10.222.0.30 () {60 vars in 1582 bytes} [Sun Sep 4 01:18:47 2022] PUT /identity/v3/OS-INHERIT/projects/4f4efbcfa0e9461b93201bc3a32867e2/users/d15d42841b5f47c2937b968ed877b270/roles/b6f35004c476456eab4c3b0549f45b97/inherited_to_projects => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:18:47.534998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08772a-92f6-4865-82a9-8f79cfd21a6d tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:47.548216 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08772a-92f6-4865-82a9-8f79cfd21a6d tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:47.697026 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f13a2-4aec-42c3-aa25-37f1020c8501 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:47.697798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f13a2-4aec-42c3-aa25-37f1020c8501 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:47.698120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f13a2-4aec-42c3-aa25-37f1020c8501 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:47.698406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f13a2-4aec-42c3-aa25-37f1020c8501 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/4f4efbcfa0e9461b93201bc3a32867e2/users/d15d42841b5f47c2937b968ed877b270/roles/b6f35004c476456eab4c3b0549f45b97/inherited_to_projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:47.701200 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f13a2-4aec-42c3-aa25-37f1020c8501 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:check_grant(project_id=4f4efbcfa0e9461b93201bc3a32867e2, user_id=d15d42841b5f47c2937b968ed877b270, role_id=b6f35004c476456eab4c3b0549f45b97)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:47.704763 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-9e9f13a2-4aec-42c3-aa25-37f1020c8501 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:18:47.704763 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:18:47.704763 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:18:47.707025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f13a2-4aec-42c3-aa25-37f1020c8501 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:47.718472 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2187/4381] 10.222.0.30 () {58 vars in 1564 bytes} [Sun Sep 4 01:18:47 2022] HEAD /identity/v3/OS-INHERIT/projects/4f4efbcfa0e9461b93201bc3a32867e2/users/d15d42841b5f47c2937b968ed877b270/roles/b6f35004c476456eab4c3b0549f45b97/inherited_to_projects => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:18:47.719633 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52614fb6-2a2e-458e-bf9f-fd73f25ea679 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:47.736700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52614fb6-2a2e-458e-bf9f-fd73f25ea679 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:47.742657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb17612-c4a6-4089-8a88-43fa3d26c4a8 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:47.743953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb17612-c4a6-4089-8a88-43fa3d26c4a8 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:47.744290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb17612-c4a6-4089-8a88-43fa3d26c4a8 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:47.744789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb17612-c4a6-4089-8a88-43fa3d26c4a8 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/4f4efbcfa0e9461b93201bc3a32867e2/users/d15d42841b5f47c2937b968ed877b270/roles/b6f35004c476456eab4c3b0549f45b97/inherited_to_projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:47.747907 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb17612-c4a6-4089-8a88-43fa3d26c4a8 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=4f4efbcfa0e9461b93201bc3a32867e2, user_id=d15d42841b5f47c2937b968ed877b270, role_id=b6f35004c476456eab4c3b0549f45b97)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:47.758510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb17612-c4a6-4089-8a88-43fa3d26c4a8 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:47.766973 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-afb17612-c4a6-4089-8a88-43fa3d26c4a8 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invalidating the token cache because role b6f35004c476456eab4c3b0549f45b97 was removed from user d15d42841b5f47c2937b968ed877b270 on project 4f4efbcfa0e9461b93201bc3a32867e2. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:18:47.768855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-afb17612-c4a6-4089-8a88-43fa3d26c4a8 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:47.770338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-afb17612-c4a6-4089-8a88-43fa3d26c4a8 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:47.797415 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2195/4382] 10.222.0.30 () {58 vars in 1566 bytes} [Sun Sep 4 01:18:47 2022] DELETE /identity/v3/OS-INHERIT/projects/4f4efbcfa0e9461b93201bc3a32867e2/users/d15d42841b5f47c2937b968ed877b270/roles/b6f35004c476456eab4c3b0549f45b97/inherited_to_projects => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:18:47.799546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f13a2-4aec-42c3-aa25-37f1020c8501 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:47.802753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9e9f13a2-4aec-42c3-aa25-37f1020c8501 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:47.827522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f13a2-4aec-42c3-aa25-37f1020c8501 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:47.881958 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:47.892531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb17612-c4a6-4089-8a88-43fa3d26c4a8 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:47.894117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-afb17612-c4a6-4089-8a88-43fa3d26c4a8 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:47.952331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d64092-ebb9-4621-b221-d63776cc9239 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:47.952998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d64092-ebb9-4621-b221-d63776cc9239 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:47.953264 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d64092-ebb9-4621-b221-d63776cc9239 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:47.953564 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d64092-ebb9-4621-b221-d63776cc9239 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/roles/b6f35004c476456eab4c3b0549f45b97` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:47.962305 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d64092-ebb9-4621-b221-d63776cc9239 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b6f35004c476456eab4c3b0549f45b97)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:47.963856 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d64092-ebb9-4621-b221-d63776cc9239 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:48.028851 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-81d64092-ebb9-4621-b221-d63776cc9239 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invalidating the token cache because role b6f35004c476456eab4c3b0549f45b97 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:18:48.029740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-81d64092-ebb9-4621-b221-d63776cc9239 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:48.031363 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-81d64092-ebb9-4621-b221-d63776cc9239 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:48.038342 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2188/4383] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:18:47 2022] DELETE /identity/v3/roles/b6f35004c476456eab4c3b0549f45b97 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:18:48.043826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d64092-ebb9-4621-b221-d63776cc9239 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:48.046178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-81d64092-ebb9-4621-b221-d63776cc9239 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:48.054278 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb17612-c4a6-4089-8a88-43fa3d26c4a8 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:48.184004 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7feb12-b340-4a3b-928e-cfc4407e7751 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:48.184958 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7feb12-b340-4a3b-928e-cfc4407e7751 service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:48.186062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7feb12-b340-4a3b-928e-cfc4407e7751 service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:48.186442 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7feb12-b340-4a3b-928e-cfc4407e7751 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:48.188502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7a7feb12-b340-4a3b-928e-cfc4407e7751 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:48.209794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7feb12-b340-4a3b-928e-cfc4407e7751 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:48.211867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7feb12-b340-4a3b-928e-cfc4407e7751 service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:48.229296 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2196/4384] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:18:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:18:48.233069 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d64092-ebb9-4621-b221-d63776cc9239 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:48.239945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e0cb0-21b1-496a-b15d-68ba77766f7e tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:48.241732 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e0cb0-21b1-496a-b15d-68ba77766f7e tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:48.242801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e0cb0-21b1-496a-b15d-68ba77766f7e tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:48.243957 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e0cb0-21b1-496a-b15d-68ba77766f7e tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:48.244598 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e0cb0-21b1-496a-b15d-68ba77766f7e tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:48.247441 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e0cb0-21b1-496a-b15d-68ba77766f7e tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:48.271290 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2189/4385] 10.222.0.30 () {60 vars in 1143 bytes} [Sun Sep 4 01:18:48 2022] POST /identity/v3/roles => generated 239 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:18:48.275502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7feb12-b340-4a3b-928e-cfc4407e7751 service placement] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:48.297576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7feb12-b340-4a3b-928e-cfc4407e7751 service placement] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:48.302874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3436afa-db16-42f6-9721-67c3845ad39f tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:48.303838 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3436afa-db16-42f6-9721-67c3845ad39f tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:48.304197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3436afa-db16-42f6-9721-67c3845ad39f tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:48.304657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3436afa-db16-42f6-9721-67c3845ad39f tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/44657700d99e43babfdf7b6efe742ae5/groups/4f8885a9720e4a5ab66f0d8bd7f92ae0/roles/08bbcd22589a4bbfb3a7cfbbd6880e1b/inherited_to_projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:48.307750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3436afa-db16-42f6-9721-67c3845ad39f tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=44657700d99e43babfdf7b6efe742ae5, group_id=4f8885a9720e4a5ab66f0d8bd7f92ae0, role_id=08bbcd22589a4bbfb3a7cfbbd6880e1b)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:48.311740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3436afa-db16-42f6-9721-67c3845ad39f tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:48.336839 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2197/4386] 10.222.0.30 () {60 vars in 1582 bytes} [Sun Sep 4 01:18:48 2022] PUT /identity/v3/OS-INHERIT/domains/44657700d99e43babfdf7b6efe742ae5/groups/4f8885a9720e4a5ab66f0d8bd7f92ae0/roles/08bbcd22589a4bbfb3a7cfbbd6880e1b/inherited_to_projects => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:18:48.342329 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e0cb0-21b1-496a-b15d-68ba77766f7e tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:48.358565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e0cb0-21b1-496a-b15d-68ba77766f7e tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:48.407464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3436afa-db16-42f6-9721-67c3845ad39f tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:48.409248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f3436afa-db16-42f6-9721-67c3845ad39f tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:48.518636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb67075-e165-4dab-8b76-95981c721965 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:48.526823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb67075-e165-4dab-8b76-95981c721965 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:48.528243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb67075-e165-4dab-8b76-95981c721965 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:48.528545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb67075-e165-4dab-8b76-95981c721965 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/44657700d99e43babfdf7b6efe742ae5/groups/4f8885a9720e4a5ab66f0d8bd7f92ae0/roles/inherited_to_projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:48.532908 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb67075-e165-4dab-8b76-95981c721965 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=44657700d99e43babfdf7b6efe742ae5, group_id=4f8885a9720e4a5ab66f0d8bd7f92ae0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:48.533999 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-4bb67075-e165-4dab-8b76-95981c721965 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:18:48.533999 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:18:48.533999 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:18:48.536432 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb67075-e165-4dab-8b76-95981c721965 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:48.561829 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2190/4387] 10.222.0.30 () {58 vars in 1464 bytes} [Sun Sep 4 01:18:48 2022] GET /identity/v3/OS-INHERIT/domains/44657700d99e43babfdf7b6efe742ae5/groups/4f8885a9720e4a5ab66f0d8bd7f92ae0/roles/inherited_to_projects => generated 447 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:18:48.566333 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:48.567764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb67075-e165-4dab-8b76-95981c721965 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:48.582713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb67075-e165-4dab-8b76-95981c721965 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:48.591231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be1a4a-0eda-45cb-b604-c53739919a47 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:48.592406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be1a4a-0eda-45cb-b604-c53739919a47 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:48.592801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be1a4a-0eda-45cb-b604-c53739919a47 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:48.593126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be1a4a-0eda-45cb-b604-c53739919a47 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/44657700d99e43babfdf7b6efe742ae5/groups/4f8885a9720e4a5ab66f0d8bd7f92ae0/roles/08bbcd22589a4bbfb3a7cfbbd6880e1b/inherited_to_projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:48.596106 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be1a4a-0eda-45cb-b604-c53739919a47 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=44657700d99e43babfdf7b6efe742ae5, group_id=4f8885a9720e4a5ab66f0d8bd7f92ae0, role_id=08bbcd22589a4bbfb3a7cfbbd6880e1b)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:48.612739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be1a4a-0eda-45cb-b604-c53739919a47 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:48.629667 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2191/4388] 10.222.0.30 () {58 vars in 1564 bytes} [Sun Sep 4 01:18:48 2022] HEAD /identity/v3/OS-INHERIT/domains/44657700d99e43babfdf7b6efe742ae5/groups/4f8885a9720e4a5ab66f0d8bd7f92ae0/roles/08bbcd22589a4bbfb3a7cfbbd6880e1b/inherited_to_projects => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:18:48.635870 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be1a4a-0eda-45cb-b604-c53739919a47 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:48.649309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3436afa-db16-42f6-9721-67c3845ad39f tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:48.650084 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be1a4a-0eda-45cb-b604-c53739919a47 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:48.659257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ea8a9-07bc-4973-a16f-4dd6f98532dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:48.660215 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ea8a9-07bc-4973-a16f-4dd6f98532dc service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:48.660523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ea8a9-07bc-4973-a16f-4dd6f98532dc service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:48.661248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ea8a9-07bc-4973-a16f-4dd6f98532dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:48.662125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6659e-6488-420b-a79c-82e6e52dedeb tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:48.662703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7e6ea8a9-07bc-4973-a16f-4dd6f98532dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:48.662874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6659e-6488-420b-a79c-82e6e52dedeb tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:48.663328 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6659e-6488-420b-a79c-82e6e52dedeb tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:48.664404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6659e-6488-420b-a79c-82e6e52dedeb tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/44657700d99e43babfdf7b6efe742ae5/groups/4f8885a9720e4a5ab66f0d8bd7f92ae0/roles/08bbcd22589a4bbfb3a7cfbbd6880e1b/inherited_to_projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:48.668746 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab6659e-6488-420b-a79c-82e6e52dedeb tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=44657700d99e43babfdf7b6efe742ae5, group_id=4f8885a9720e4a5ab66f0d8bd7f92ae0, role_id=08bbcd22589a4bbfb3a7cfbbd6880e1b)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:48.671607 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab6659e-6488-420b-a79c-82e6e52dedeb tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:48.678708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dab6659e-6488-420b-a79c-82e6e52dedeb tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invalidating the token cache because role 08bbcd22589a4bbfb3a7cfbbd6880e1b was removed from group 4f8885a9720e4a5ab66f0d8bd7f92ae0 on domain 44657700d99e43babfdf7b6efe742ae5. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:18:48.679072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dab6659e-6488-420b-a79c-82e6e52dedeb tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:48.679962 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dab6659e-6488-420b-a79c-82e6e52dedeb tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:48.687191 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:48.711957 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2192/4389] 10.222.0.30 () {58 vars in 1566 bytes} [Sun Sep 4 01:18:48 2022] DELETE /identity/v3/OS-INHERIT/domains/44657700d99e43babfdf7b6efe742ae5/groups/4f8885a9720e4a5ab66f0d8bd7f92ae0/roles/08bbcd22589a4bbfb3a7cfbbd6880e1b/inherited_to_projects => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:18:48.713902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6659e-6488-420b-a79c-82e6e52dedeb tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:48.715668 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-dab6659e-6488-420b-a79c-82e6e52dedeb tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:48.784725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ea8a9-07bc-4973-a16f-4dd6f98532dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:48.787286 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ea8a9-07bc-4973-a16f-4dd6f98532dc service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:48.800956 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2198/4390] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:18:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:18:48.844512 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6659e-6488-420b-a79c-82e6e52dedeb tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:48.854026 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072d7da-d8e0-4a59-bfda-21661eb9a71b tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:48.854689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072d7da-d8e0-4a59-bfda-21661eb9a71b tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:48.854969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072d7da-d8e0-4a59-bfda-21661eb9a71b tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:48.856385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072d7da-d8e0-4a59-bfda-21661eb9a71b tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/roles/08bbcd22589a4bbfb3a7cfbbd6880e1b` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:48.858618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072d7da-d8e0-4a59-bfda-21661eb9a71b tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:delete_role(role_id=08bbcd22589a4bbfb3a7cfbbd6880e1b)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:48.860261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072d7da-d8e0-4a59-bfda-21661eb9a71b tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:48.953746 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8072d7da-d8e0-4a59-bfda-21661eb9a71b tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invalidating the token cache because role 08bbcd22589a4bbfb3a7cfbbd6880e1b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:18:48.954665 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8072d7da-d8e0-4a59-bfda-21661eb9a71b tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:48.956771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8072d7da-d8e0-4a59-bfda-21661eb9a71b tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:48.961028 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2193/4391] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:18:48 2022] DELETE /identity/v3/roles/08bbcd22589a4bbfb3a7cfbbd6880e1b => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:18:48.968544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ea8a9-07bc-4973-a16f-4dd6f98532dc service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:48.989092 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ea8a9-07bc-4973-a16f-4dd6f98532dc service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:49.184200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29583108-46bb-49d5-88a5-b23f2d598d79 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:49.184873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29583108-46bb-49d5-88a5-b23f2d598d79 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:49.185207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29583108-46bb-49d5-88a5-b23f2d598d79 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:49.186134 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29583108-46bb-49d5-88a5-b23f2d598d79 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:49.187331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29583108-46bb-49d5-88a5-b23f2d598d79 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:49.191833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29583108-46bb-49d5-88a5-b23f2d598d79 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:49.234364 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2199/4392] 10.222.0.30 () {60 vars in 1143 bytes} [Sun Sep 4 01:18:48 2022] POST /identity/v3/roles => generated 239 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:18:49.240472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072d7da-d8e0-4a59-bfda-21661eb9a71b tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:49.242279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8072d7da-d8e0-4a59-bfda-21661eb9a71b tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:49.272115 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072d7da-d8e0-4a59-bfda-21661eb9a71b tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:49.279710 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404cee5-4aed-40c4-886c-7c17b9827f48 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:49.280476 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404cee5-4aed-40c4-886c-7c17b9827f48 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:49.280674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404cee5-4aed-40c4-886c-7c17b9827f48 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:49.280952 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404cee5-4aed-40c4-886c-7c17b9827f48 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/44657700d99e43babfdf7b6efe742ae5/users/d15d42841b5f47c2937b968ed877b270/roles/f4c601a7538f489fb5082c3a05bf0ea9/inherited_to_projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:49.283213 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0404cee5-4aed-40c4-886c-7c17b9827f48 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=44657700d99e43babfdf7b6efe742ae5, user_id=d15d42841b5f47c2937b968ed877b270, role_id=f4c601a7538f489fb5082c3a05bf0ea9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:49.286317 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0404cee5-4aed-40c4-886c-7c17b9827f48 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:49.315765 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2194/4393] 10.222.0.30 () {60 vars in 1579 bytes} [Sun Sep 4 01:18:49 2022] PUT /identity/v3/OS-INHERIT/domains/44657700d99e43babfdf7b6efe742ae5/users/d15d42841b5f47c2937b968ed877b270/roles/f4c601a7538f489fb5082c3a05bf0ea9/inherited_to_projects => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:18:49.321553 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29583108-46bb-49d5-88a5-b23f2d598d79 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:49.339145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29583108-46bb-49d5-88a5-b23f2d598d79 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:49.456351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b9aa91-690e-4778-9ecf-932eb7a68e4f tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:49.457050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9aa91-690e-4778-9ecf-932eb7a68e4f tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:49.459364 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9aa91-690e-4778-9ecf-932eb7a68e4f tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:49.460707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9aa91-690e-4778-9ecf-932eb7a68e4f tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/44657700d99e43babfdf7b6efe742ae5/users/d15d42841b5f47c2937b968ed877b270/roles/inherited_to_projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:49.466316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b9aa91-690e-4778-9ecf-932eb7a68e4f tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=44657700d99e43babfdf7b6efe742ae5, user_id=d15d42841b5f47c2937b968ed877b270)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:49.469552 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-e4b9aa91-690e-4778-9ecf-932eb7a68e4f tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:18:49.469552 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:18:49.469552 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:18:49.472996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b9aa91-690e-4778-9ecf-932eb7a68e4f tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:49.497798 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:49.511645 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2200/4394] 10.222.0.30 () {58 vars in 1461 bytes} [Sun Sep 4 01:18:49 2022] GET /identity/v3/OS-INHERIT/domains/44657700d99e43babfdf7b6efe742ae5/users/d15d42841b5f47c2937b968ed877b270/roles/inherited_to_projects => generated 446 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:18:49.517642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404cee5-4aed-40c4-886c-7c17b9827f48 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:49.552578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404cee5-4aed-40c4-886c-7c17b9827f48 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:49.560882 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c1a7c-6692-4017-b5e2-060127cd6151 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:49.561758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c1a7c-6692-4017-b5e2-060127cd6151 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:49.562046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c1a7c-6692-4017-b5e2-060127cd6151 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:49.562642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c1a7c-6692-4017-b5e2-060127cd6151 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/44657700d99e43babfdf7b6efe742ae5/users/d15d42841b5f47c2937b968ed877b270/roles/f4c601a7538f489fb5082c3a05bf0ea9/inherited_to_projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:49.564956 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c1a7c-6692-4017-b5e2-060127cd6151 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=44657700d99e43babfdf7b6efe742ae5, user_id=d15d42841b5f47c2937b968ed877b270, role_id=f4c601a7538f489fb5082c3a05bf0ea9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:49.568778 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c1a7c-6692-4017-b5e2-060127cd6151 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:49.579604 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2195/4395] 10.222.0.30 () {58 vars in 1561 bytes} [Sun Sep 4 01:18:49 2022] HEAD /identity/v3/OS-INHERIT/domains/44657700d99e43babfdf7b6efe742ae5/users/d15d42841b5f47c2937b968ed877b270/roles/f4c601a7538f489fb5082c3a05bf0ea9/inherited_to_projects => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:18:49.580863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b9aa91-690e-4778-9ecf-932eb7a68e4f tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:49.591304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b9aa91-690e-4778-9ecf-932eb7a68e4f tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:49.602179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f2fdb-0435-4067-a124-4e3524435779 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:49.603357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f2fdb-0435-4067-a124-4e3524435779 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:49.603357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f2fdb-0435-4067-a124-4e3524435779 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:49.603568 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f2fdb-0435-4067-a124-4e3524435779 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/44657700d99e43babfdf7b6efe742ae5/users/d15d42841b5f47c2937b968ed877b270/roles/f4c601a7538f489fb5082c3a05bf0ea9/inherited_to_projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:49.607165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f2fdb-0435-4067-a124-4e3524435779 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=44657700d99e43babfdf7b6efe742ae5, user_id=d15d42841b5f47c2937b968ed877b270, role_id=f4c601a7538f489fb5082c3a05bf0ea9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:49.610414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f2fdb-0435-4067-a124-4e3524435779 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:49.617031 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d76f2fdb-0435-4067-a124-4e3524435779 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invalidating the token cache because role f4c601a7538f489fb5082c3a05bf0ea9 was removed from user d15d42841b5f47c2937b968ed877b270 on domain 44657700d99e43babfdf7b6efe742ae5. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:18:49.617330 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d76f2fdb-0435-4067-a124-4e3524435779 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:49.618238 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d76f2fdb-0435-4067-a124-4e3524435779 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:49.648592 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2201/4396] 10.222.0.30 () {58 vars in 1563 bytes} [Sun Sep 4 01:18:49 2022] DELETE /identity/v3/OS-INHERIT/domains/44657700d99e43babfdf7b6efe742ae5/users/d15d42841b5f47c2937b968ed877b270/roles/f4c601a7538f489fb5082c3a05bf0ea9/inherited_to_projects => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:18:49.653097 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c1a7c-6692-4017-b5e2-060127cd6151 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:49.662138 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0f6c1a7c-6692-4017-b5e2-060127cd6151 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:49.679614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c1a7c-6692-4017-b5e2-060127cd6151 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:49.804943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8891c8-1a53-4632-a3b6-128b83a3f3f2 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:49.805624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8891c8-1a53-4632-a3b6-128b83a3f3f2 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:49.805912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8891c8-1a53-4632-a3b6-128b83a3f3f2 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:49.806340 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8891c8-1a53-4632-a3b6-128b83a3f3f2 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/roles/f4c601a7538f489fb5082c3a05bf0ea9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:49.807965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8891c8-1a53-4632-a3b6-128b83a3f3f2 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f4c601a7538f489fb5082c3a05bf0ea9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:49.810322 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8891c8-1a53-4632-a3b6-128b83a3f3f2 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:49.919998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8c8891c8-1a53-4632-a3b6-128b83a3f3f2 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invalidating the token cache because role f4c601a7538f489fb5082c3a05bf0ea9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:18:49.919998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8c8891c8-1a53-4632-a3b6-128b83a3f3f2 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:49.921386 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8c8891c8-1a53-4632-a3b6-128b83a3f3f2 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:49.927329 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2196/4397] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:18:49 2022] DELETE /identity/v3/roles/f4c601a7538f489fb5082c3a05bf0ea9 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:18:49.928505 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f2fdb-0435-4067-a124-4e3524435779 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:49.953672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f2fdb-0435-4067-a124-4e3524435779 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:50.112142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c51ec-e9e6-4a0c-831c-c420cc70c44b tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:50.112922 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c51ec-e9e6-4a0c-831c-c420cc70c44b tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:50.113479 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c51ec-e9e6-4a0c-831c-c420cc70c44b tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:50.113765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c51ec-e9e6-4a0c-831c-c420cc70c44b tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:50.114464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c51ec-e9e6-4a0c-831c-c420cc70c44b tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:50.116082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c51ec-e9e6-4a0c-831c-c420cc70c44b tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:50.175508 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2202/4398] 10.222.0.30 () {60 vars in 1143 bytes} [Sun Sep 4 01:18:49 2022] POST /identity/v3/roles => generated 239 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:18:50.176660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8891c8-1a53-4632-a3b6-128b83a3f3f2 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:50.178184 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8c8891c8-1a53-4632-a3b6-128b83a3f3f2 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:50.221661 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:50.233898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8891c8-1a53-4632-a3b6-128b83a3f3f2 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:50.253292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc557ac-5f7e-4b75-9861-a5e0aed6d87b tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:50.254053 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc557ac-5f7e-4b75-9861-a5e0aed6d87b tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:50.254270 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc557ac-5f7e-4b75-9861-a5e0aed6d87b tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:50.254638 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc557ac-5f7e-4b75-9861-a5e0aed6d87b tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:50.255937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc557ac-5f7e-4b75-9861-a5e0aed6d87b tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:50.269939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc557ac-5f7e-4b75-9861-a5e0aed6d87b tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:50.325218 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0c01f-aac7-4e2e-b1e0-cd7052a38d67 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:50.325528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0c01f-aac7-4e2e-b1e0-cd7052a38d67 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:50.325713 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0c01f-aac7-4e2e-b1e0-cd7052a38d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:50.377289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-0fa0c01f-aac7-4e2e-b1e0-cd7052a38d67 None None] MFA Rules not processed for user `5581a720105c400f8bee8ef53813288b`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:18:50.378722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0fa0c01f-aac7-4e2e-b1e0-cd7052a38d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:50.379687 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2197/4399] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:18:50 2022] POST /identity/v3/projects => generated 408 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:18:50.384338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc557ac-5f7e-4b75-9861-a5e0aed6d87b tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:50.562993 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc557ac-5f7e-4b75-9861-a5e0aed6d87b tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:50.579627 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b9e5c-6cd2-4af9-8960-dd09f3c8a93c tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:50.581369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b9e5c-6cd2-4af9-8960-dd09f3c8a93c tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:50.583971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b9e5c-6cd2-4af9-8960-dd09f3c8a93c tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:50.584514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b9e5c-6cd2-4af9-8960-dd09f3c8a93c tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/44657700d99e43babfdf7b6efe742ae5/users/d15d42841b5f47c2937b968ed877b270/roles/bdb5ef66da2549aa96ff3d5011e40daa/inherited_to_projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:50.589579 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71b9e5c-6cd2-4af9-8960-dd09f3c8a93c tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=44657700d99e43babfdf7b6efe742ae5, user_id=d15d42841b5f47c2937b968ed877b270, role_id=bdb5ef66da2549aa96ff3d5011e40daa)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:50.594401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71b9e5c-6cd2-4af9-8960-dd09f3c8a93c tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:50.595441 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2203/4400] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:18:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:18:50.624376 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2198/4401] 10.222.0.30 () {60 vars in 1579 bytes} [Sun Sep 4 01:18:50 2022] PUT /identity/v3/OS-INHERIT/domains/44657700d99e43babfdf7b6efe742ae5/users/d15d42841b5f47c2937b968ed877b270/roles/bdb5ef66da2549aa96ff3d5011e40daa/inherited_to_projects => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:18:50.629048 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0c01f-aac7-4e2e-b1e0-cd7052a38d67 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:50.652668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0c01f-aac7-4e2e-b1e0-cd7052a38d67 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:50.770787 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30116261-8e9c-4c5c-9f8e-f29e398e50dc tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:50.771124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30116261-8e9c-4c5c-9f8e-f29e398e50dc tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:50.771827 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30116261-8e9c-4c5c-9f8e-f29e398e50dc tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:50.771827 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30116261-8e9c-4c5c-9f8e-f29e398e50dc tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:50.772404 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30116261-8e9c-4c5c-9f8e-f29e398e50dc tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Adding query filter params (scope.project.id=4f4efbcfa0e9461b93201bc3a32867e2, user.id=d15d42841b5f47c2937b968ed877b270) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:18:50.772751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30116261-8e9c-4c5c-9f8e-f29e398e50dc tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:50.774222 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-30116261-8e9c-4c5c-9f8e-f29e398e50dc tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:18:50.774222 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:18:50.774222 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:18:50.775377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30116261-8e9c-4c5c-9f8e-f29e398e50dc tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:50.811471 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:50.852150 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b9e5c-6cd2-4af9-8960-dd09f3c8a93c tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:50.861017 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2204/4402] 10.222.0.30 () {58 vars in 1356 bytes} [Sun Sep 4 01:18:50 2022] GET /identity/v3/role_assignments?scope.project.id=4f4efbcfa0e9461b93201bc3a32867e2&user.id=d15d42841b5f47c2937b968ed877b270&effective => generated 648 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:18:50.872365 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b9e5c-6cd2-4af9-8960-dd09f3c8a93c tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:50.882983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8174f-9435-4fb5-a515-9799008817c7 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:50.883742 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8174f-9435-4fb5-a515-9799008817c7 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:50.884090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8174f-9435-4fb5-a515-9799008817c7 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:50.884620 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8174f-9435-4fb5-a515-9799008817c7 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:50.885465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8174f-9435-4fb5-a515-9799008817c7 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Adding query filter params (scope.project.id=c448d33565b44652aab941777a504844, user.id=d15d42841b5f47c2937b968ed877b270) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:18:50.886307 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8174f-9435-4fb5-a515-9799008817c7 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:50.889705 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-37c8174f-9435-4fb5-a515-9799008817c7 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:18:50.889705 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:18:50.889705 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:18:50.893079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8174f-9435-4fb5-a515-9799008817c7 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:50.956479 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30116261-8e9c-4c5c-9f8e-f29e398e50dc tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:50.958737 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-30116261-8e9c-4c5c-9f8e-f29e398e50dc tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:51.087312 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2199/4403] 10.222.0.30 () {58 vars in 1356 bytes} [Sun Sep 4 01:18:50 2022] GET /identity/v3/role_assignments?scope.project.id=c448d33565b44652aab941777a504844&user.id=d15d42841b5f47c2937b968ed877b270&effective => generated 648 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:18:51.091114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8174f-9435-4fb5-a515-9799008817c7 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:51.125582 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8174f-9435-4fb5-a515-9799008817c7 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:51.142819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd314527-1ebe-4278-8beb-3129cf0391d4 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:51.143605 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd314527-1ebe-4278-8beb-3129cf0391d4 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:51.143890 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd314527-1ebe-4278-8beb-3129cf0391d4 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:51.144165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd314527-1ebe-4278-8beb-3129cf0391d4 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/44657700d99e43babfdf7b6efe742ae5/users/d15d42841b5f47c2937b968ed877b270/roles/bdb5ef66da2549aa96ff3d5011e40daa/inherited_to_projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:51.151173 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd314527-1ebe-4278-8beb-3129cf0391d4 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=44657700d99e43babfdf7b6efe742ae5, user_id=d15d42841b5f47c2937b968ed877b270, role_id=bdb5ef66da2549aa96ff3d5011e40daa)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:51.160918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd314527-1ebe-4278-8beb-3129cf0391d4 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:51.178830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30116261-8e9c-4c5c-9f8e-f29e398e50dc tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:51.181660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-fd314527-1ebe-4278-8beb-3129cf0391d4 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invalidating the token cache because role bdb5ef66da2549aa96ff3d5011e40daa was removed from user d15d42841b5f47c2937b968ed877b270 on domain 44657700d99e43babfdf7b6efe742ae5. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:18:51.182779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-fd314527-1ebe-4278-8beb-3129cf0391d4 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:51.185385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-fd314527-1ebe-4278-8beb-3129cf0391d4 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:51.186431 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a874c-7722-48a2-a50f-4548cfa30181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:51.187725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a874c-7722-48a2-a50f-4548cfa30181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:51.188007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a874c-7722-48a2-a50f-4548cfa30181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:51.188279 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a874c-7722-48a2-a50f-4548cfa30181 admin admin] PATH_INFO: `/v3/users/d531146522f24a368a8c6ab482495776` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:51.191300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a874c-7722-48a2-a50f-4548cfa30181 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d531146522f24a368a8c6ab482495776)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:51.194263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a874c-7722-48a2-a50f-4548cfa30181 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:51.232700 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2200/4404] 10.222.0.30 () {58 vars in 1563 bytes} [Sun Sep 4 01:18:51 2022] DELETE /identity/v3/OS-INHERIT/domains/44657700d99e43babfdf7b6efe742ae5/users/d15d42841b5f47c2937b968ed877b270/roles/bdb5ef66da2549aa96ff3d5011e40daa/inherited_to_projects => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:18:51.237851 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd314527-1ebe-4278-8beb-3129cf0391d4 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:51.240427 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-fd314527-1ebe-4278-8beb-3129cf0391d4 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:51.292360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0f0a874c-7722-48a2-a50f-4548cfa30181 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd531146522f24a368a8c6ab482495776'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:51.293389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0f0a874c-7722-48a2-a50f-4548cfa30181 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd531146522f24a368a8c6ab482495776'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:51.306370 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0f0a874c-7722-48a2-a50f-4548cfa30181 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd531146522f24a368a8c6ab482495776'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:51.317299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0f0a874c-7722-48a2-a50f-4548cfa30181 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd531146522f24a368a8c6ab482495776'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:51.318318 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0f0a874c-7722-48a2-a50f-4548cfa30181 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd531146522f24a368a8c6ab482495776'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:51.361392 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2205/4405] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:18:50 2022] DELETE /identity/v3/users/d531146522f24a368a8c6ab482495776 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:18:51.406356 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:51.411978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd314527-1ebe-4278-8beb-3129cf0391d4 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:51.502674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f8bbe-3242-44f9-86bb-2eeab7c80508 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:51.503723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f8bbe-3242-44f9-86bb-2eeab7c80508 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:51.504599 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f8bbe-3242-44f9-86bb-2eeab7c80508 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:51.505084 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f8bbe-3242-44f9-86bb-2eeab7c80508 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:51.506286 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f8bbe-3242-44f9-86bb-2eeab7c80508 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Adding query filter params (scope.project.id=4f4efbcfa0e9461b93201bc3a32867e2, user.id=d15d42841b5f47c2937b968ed877b270) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:18:51.506939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f8bbe-3242-44f9-86bb-2eeab7c80508 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:51.522121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f8bbe-3242-44f9-86bb-2eeab7c80508 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:51.591296 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2201/4406] 10.222.0.30 () {58 vars in 1356 bytes} [Sun Sep 4 01:18:51 2022] GET /identity/v3/role_assignments?scope.project.id=4f4efbcfa0e9461b93201bc3a32867e2&user.id=d15d42841b5f47c2937b968ed877b270&effective => generated 228 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:18:51.596156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a874c-7722-48a2-a50f-4548cfa30181 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:51.598504 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0f0a874c-7722-48a2-a50f-4548cfa30181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:51.614576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a874c-7722-48a2-a50f-4548cfa30181 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:51.621221 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f635437-e98a-4803-a126-5d012245185a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:51.622213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f635437-e98a-4803-a126-5d012245185a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:51.622700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f635437-e98a-4803-a126-5d012245185a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:51.623194 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f635437-e98a-4803-a126-5d012245185a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:51.624109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f635437-e98a-4803-a126-5d012245185a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Adding query filter params (scope.project.id=c448d33565b44652aab941777a504844, user.id=d15d42841b5f47c2937b968ed877b270) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:18:51.624608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f635437-e98a-4803-a126-5d012245185a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:51.630165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f635437-e98a-4803-a126-5d012245185a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:51.730355 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2206/4407] 10.222.0.30 () {58 vars in 1356 bytes} [Sun Sep 4 01:18:51 2022] GET /identity/v3/role_assignments?scope.project.id=c448d33565b44652aab941777a504844&user.id=d15d42841b5f47c2937b968ed877b270&effective => generated 228 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:18:51.734728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f8bbe-3242-44f9-86bb-2eeab7c80508 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:51.751911 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f8bbe-3242-44f9-86bb-2eeab7c80508 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:51.758225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4df08-6562-4c63-b842-64de6976478a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:51.759455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4df08-6562-4c63-b842-64de6976478a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:51.760056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4df08-6562-4c63-b842-64de6976478a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:51.760413 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4df08-6562-4c63-b842-64de6976478a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/projects/c448d33565b44652aab941777a504844` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:51.767849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea4df08-6562-4c63-b842-64de6976478a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c448d33565b44652aab941777a504844)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:51.770896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea4df08-6562-4c63-b842-64de6976478a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:51.876666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5ea4df08-6562-4c63-b842-64de6976478a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c448d33565b44652aab941777a504844', 'request_id': 'req-5ea4df08-6562-4c63-b842-64de6976478a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:51.913851 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5ea4df08-6562-4c63-b842-64de6976478a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c448d33565b44652aab941777a504844', 'request_id': 'req-5ea4df08-6562-4c63-b842-64de6976478a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:51.940666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5ea4df08-6562-4c63-b842-64de6976478a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c448d33565b44652aab941777a504844', 'request_id': 'req-5ea4df08-6562-4c63-b842-64de6976478a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:51.967787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5ea4df08-6562-4c63-b842-64de6976478a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] The token cache is being invalidate because project c448d33565b44652aab941777a504844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:18:51.968087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5ea4df08-6562-4c63-b842-64de6976478a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:51.968768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5ea4df08-6562-4c63-b842-64de6976478a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:51.974959 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2202/4408] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:18:51 2022] DELETE /identity/v3/projects/c448d33565b44652aab941777a504844 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:18:51.975828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f635437-e98a-4803-a126-5d012245185a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:51.979699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0f635437-e98a-4803-a126-5d012245185a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:51.994949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f635437-e98a-4803-a126-5d012245185a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:52.000045 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:52.102965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd42616-5e64-4528-9ba3-b8833013b236 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:52.103386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd42616-5e64-4528-9ba3-b8833013b236 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:52.103849 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd42616-5e64-4528-9ba3-b8833013b236 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:52.104230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd42616-5e64-4528-9ba3-b8833013b236 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/roles/bdb5ef66da2549aa96ff3d5011e40daa` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:52.107017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd42616-5e64-4528-9ba3-b8833013b236 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:delete_role(role_id=bdb5ef66da2549aa96ff3d5011e40daa)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:52.111249 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd42616-5e64-4528-9ba3-b8833013b236 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:52.246701 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3bd42616-5e64-4528-9ba3-b8833013b236 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invalidating the token cache because role bdb5ef66da2549aa96ff3d5011e40daa has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:18:52.247000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3bd42616-5e64-4528-9ba3-b8833013b236 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:52.247726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3bd42616-5e64-4528-9ba3-b8833013b236 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:52.252942 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2207/4409] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:18:51 2022] DELETE /identity/v3/roles/bdb5ef66da2549aa96ff3d5011e40daa => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:18:52.261000 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4df08-6562-4c63-b842-64de6976478a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:52.280149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd42616-5e64-4528-9ba3-b8833013b236 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:52.282398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3bd42616-5e64-4528-9ba3-b8833013b236 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:52.294480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4df08-6562-4c63-b842-64de6976478a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:52.419265 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:52.483384 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573cd67c-9f71-4561-b5c4-70f8a2d23f31 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:52.488352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cd67c-9f71-4561-b5c4-70f8a2d23f31 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:52.488943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cd67c-9f71-4561-b5c4-70f8a2d23f31 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:52.490934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cd67c-9f71-4561-b5c4-70f8a2d23f31 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:52.491783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573cd67c-9f71-4561-b5c4-70f8a2d23f31 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:52.501468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573cd67c-9f71-4561-b5c4-70f8a2d23f31 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:52.510697 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd42616-5e64-4528-9ba3-b8833013b236 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:52.518343 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fd323-1d00-4fc5-92a6-dd58b00854d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:52.519337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fd323-1d00-4fc5-92a6-dd58b00854d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:52.519631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fd323-1d00-4fc5-92a6-dd58b00854d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:52.538055 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fd323-1d00-4fc5-92a6-dd58b00854d3 admin admin] PATH_INFO: `/v3/projects/c28196b63fb94716951abfca405e5687` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:52.547256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93fd323-1d00-4fc5-92a6-dd58b00854d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c28196b63fb94716951abfca405e5687)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:52.554854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93fd323-1d00-4fc5-92a6-dd58b00854d3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:52.567228 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2203/4410] 10.222.0.30 () {60 vars in 1143 bytes} [Sun Sep 4 01:18:52 2022] POST /identity/v3/roles => generated 240 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:18:52.568819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573cd67c-9f71-4561-b5c4-70f8a2d23f31 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:52.579264 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-573cd67c-9f71-4561-b5c4-70f8a2d23f31 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:52.625464 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573cd67c-9f71-4561-b5c4-70f8a2d23f31 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:52.643138 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21368768-e901-4291-b8ee-e192f70e5071 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:52.643780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21368768-e901-4291-b8ee-e192f70e5071 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:52.644954 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21368768-e901-4291-b8ee-e192f70e5071 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:52.644954 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21368768-e901-4291-b8ee-e192f70e5071 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:52.644954 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21368768-e901-4291-b8ee-e192f70e5071 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:52.646963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21368768-e901-4291-b8ee-e192f70e5071 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:52.666481 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e93fd323-1d00-4fc5-92a6-dd58b00854d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c28196b63fb94716951abfca405e5687', 'request_id': 'req-e93fd323-1d00-4fc5-92a6-dd58b00854d3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:52.687613 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e93fd323-1d00-4fc5-92a6-dd58b00854d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c28196b63fb94716951abfca405e5687', 'request_id': 'req-e93fd323-1d00-4fc5-92a6-dd58b00854d3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:52.695314 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e93fd323-1d00-4fc5-92a6-dd58b00854d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c28196b63fb94716951abfca405e5687', 'request_id': 'req-e93fd323-1d00-4fc5-92a6-dd58b00854d3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:52.718506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e93fd323-1d00-4fc5-92a6-dd58b00854d3 admin admin] The token cache is being invalidate because project c28196b63fb94716951abfca405e5687 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:18:52.719864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e93fd323-1d00-4fc5-92a6-dd58b00854d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:52.721510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e93fd323-1d00-4fc5-92a6-dd58b00854d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:52.724825 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2204/4411] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:18:52 2022] POST /identity/v3/projects => generated 409 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:18:52.725277 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2208/4412] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:18:52 2022] DELETE /identity/v3/projects/c28196b63fb94716951abfca405e5687 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:18:52.732839 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21368768-e901-4291-b8ee-e192f70e5071 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:52.734771 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900da3c-7fe2-467b-8caf-9c514fb3bb7a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:52.734931 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-21368768-e901-4291-b8ee-e192f70e5071 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:52.735255 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900da3c-7fe2-467b-8caf-9c514fb3bb7a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:52.735653 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900da3c-7fe2-467b-8caf-9c514fb3bb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:52.755832 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:52.783385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c900da3c-7fe2-467b-8caf-9c514fb3bb7a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:18:52.787576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c900da3c-7fe2-467b-8caf-9c514fb3bb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:52.938422 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21368768-e901-4291-b8ee-e192f70e5071 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:52.951300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335e666-2895-4a10-8abb-a9dffc85acf2 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:52.953507 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335e666-2895-4a10-8abb-a9dffc85acf2 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:52.955039 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335e666-2895-4a10-8abb-a9dffc85acf2 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:52.956327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335e666-2895-4a10-8abb-a9dffc85acf2 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/4f4efbcfa0e9461b93201bc3a32867e2/users/d15d42841b5f47c2937b968ed877b270/roles/45c97f167680434985a561e44379b15e/inherited_to_projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:52.961927 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2335e666-2895-4a10-8abb-a9dffc85acf2 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4f4efbcfa0e9461b93201bc3a32867e2, user_id=d15d42841b5f47c2937b968ed877b270, role_id=45c97f167680434985a561e44379b15e)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:52.968602 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2335e666-2895-4a10-8abb-a9dffc85acf2 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:52.979287 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2209/4413] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:18:52.982870 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75a91d-aa52-469a-9423-c58c197335c0 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:52.983234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75a91d-aa52-469a-9423-c58c197335c0 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:52.983789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75a91d-aa52-469a-9423-c58c197335c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:53.018159 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2205/4414] 10.222.0.30 () {60 vars in 1582 bytes} [Sun Sep 4 01:18:52 2022] PUT /identity/v3/OS-INHERIT/projects/4f4efbcfa0e9461b93201bc3a32867e2/users/d15d42841b5f47c2937b968ed877b270/roles/45c97f167680434985a561e44379b15e/inherited_to_projects => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:18:53.019489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335e666-2895-4a10-8abb-a9dffc85acf2 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:53.042262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-6b75a91d-aa52-469a-9423-c58c197335c0 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:18:53.044508 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6b75a91d-aa52-469a-9423-c58c197335c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:53.187145 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335e666-2895-4a10-8abb-a9dffc85acf2 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:53.199415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a675a7f-0f40-4cfd-a670-8a4f2f43334b tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:53.201181 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a675a7f-0f40-4cfd-a670-8a4f2f43334b tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:53.201899 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a675a7f-0f40-4cfd-a670-8a4f2f43334b tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:53.202460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a675a7f-0f40-4cfd-a670-8a4f2f43334b tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:53.203329 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a675a7f-0f40-4cfd-a670-8a4f2f43334b tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Adding query filter params (scope.project.id=914b9b4ba14947a58efc600a61f1f1b6, user.id=d15d42841b5f47c2937b968ed877b270) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:18:53.205014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a675a7f-0f40-4cfd-a670-8a4f2f43334b tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:53.219062 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a675a7f-0f40-4cfd-a670-8a4f2f43334b tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:53.228416 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2210/4415] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:18:53.231592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75a91d-aa52-469a-9423-c58c197335c0 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:53.249417 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75a91d-aa52-469a-9423-c58c197335c0 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:53.270995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26da2f5-4ece-439a-a940-44f355cf60b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:53.273516 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26da2f5-4ece-439a-a940-44f355cf60b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:53.273807 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26da2f5-4ece-439a-a940-44f355cf60b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:53.274098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26da2f5-4ece-439a-a940-44f355cf60b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:53.286623 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26da2f5-4ece-439a-a940-44f355cf60b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:18:53.289624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26da2f5-4ece-439a-a940-44f355cf60b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:53.291432 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26da2f5-4ece-439a-a940-44f355cf60b9 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:53.327215 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2211/4416] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:18:53.329526 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26da2f5-4ece-439a-a940-44f355cf60b9 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:53.343954 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2206/4417] 10.222.0.30 () {58 vars in 1356 bytes} [Sun Sep 4 01:18:53 2022] GET /identity/v3/role_assignments?scope.project.id=914b9b4ba14947a58efc600a61f1f1b6&user.id=d15d42841b5f47c2937b968ed877b270&effective => generated 649 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:18:53.346551 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a675a7f-0f40-4cfd-a670-8a4f2f43334b tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:53.355479 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26da2f5-4ece-439a-a940-44f355cf60b9 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:53.358783 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:53.368302 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f981ce-77d4-42b2-a0a3-b8ccba2ceb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:53.369877 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f981ce-77d4-42b2-a0a3-b8ccba2ceb4f admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:53.371073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f981ce-77d4-42b2-a0a3-b8ccba2ceb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:53.371457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f981ce-77d4-42b2-a0a3-b8ccba2ceb4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:53.372085 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a675a7f-0f40-4cfd-a670-8a4f2f43334b tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:53.373155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f981ce-77d4-42b2-a0a3-b8ccba2ceb4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:53.378207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f981ce-77d4-42b2-a0a3-b8ccba2ceb4f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:53.386651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839baee-eacf-4fdb-8345-ca1d04f03966 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:53.387795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839baee-eacf-4fdb-8345-ca1d04f03966 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:53.388188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839baee-eacf-4fdb-8345-ca1d04f03966 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:53.389339 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839baee-eacf-4fdb-8345-ca1d04f03966 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/4f4efbcfa0e9461b93201bc3a32867e2/users/d15d42841b5f47c2937b968ed877b270/roles/45c97f167680434985a561e44379b15e/inherited_to_projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:53.398086 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9839baee-eacf-4fdb-8345-ca1d04f03966 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=4f4efbcfa0e9461b93201bc3a32867e2, user_id=d15d42841b5f47c2937b968ed877b270, role_id=45c97f167680434985a561e44379b15e)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:53.401285 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9839baee-eacf-4fdb-8345-ca1d04f03966 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:53.408533 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9839baee-eacf-4fdb-8345-ca1d04f03966 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invalidating the token cache because role 45c97f167680434985a561e44379b15e was removed from user d15d42841b5f47c2937b968ed877b270 on project 4f4efbcfa0e9461b93201bc3a32867e2. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:18:53.408997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9839baee-eacf-4fdb-8345-ca1d04f03966 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:53.410285 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9839baee-eacf-4fdb-8345-ca1d04f03966 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:53.443947 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2207/4418] 10.222.0.30 () {58 vars in 1566 bytes} [Sun Sep 4 01:18:53 2022] DELETE /identity/v3/OS-INHERIT/projects/4f4efbcfa0e9461b93201bc3a32867e2/users/d15d42841b5f47c2937b968ed877b270/roles/45c97f167680434985a561e44379b15e/inherited_to_projects => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:18:53.448647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839baee-eacf-4fdb-8345-ca1d04f03966 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:53.452787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9839baee-eacf-4fdb-8345-ca1d04f03966 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:53.470893 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2212/4419] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:18:53 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:18:53.476108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f981ce-77d4-42b2-a0a3-b8ccba2ceb4f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:53.481123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f3f981ce-77d4-42b2-a0a3-b8ccba2ceb4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:53.615525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f981ce-77d4-42b2-a0a3-b8ccba2ceb4f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:53.637010 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925798c-9243-48f1-b599-eb4809a7d3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:53.637608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925798c-9243-48f1-b599-eb4809a7d3b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:53.637875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925798c-9243-48f1-b599-eb4809a7d3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:53.638147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925798c-9243-48f1-b599-eb4809a7d3b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:53.639458 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8925798c-9243-48f1-b599-eb4809a7d3b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:53.641401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8925798c-9243-48f1-b599-eb4809a7d3b0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:53.656257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839baee-eacf-4fdb-8345-ca1d04f03966 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:53.698431 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:53.709490 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2213/4420] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:18:53 2022] POST /identity/v3/users => generated 287 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:18:53.711714 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925798c-9243-48f1-b599-eb4809a7d3b0 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:53.733487 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925798c-9243-48f1-b599-eb4809a7d3b0 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:53.741652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3aa350-20b2-4f94-9f58-7613667f36a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:53.743118 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3aa350-20b2-4f94-9f58-7613667f36a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:53.743629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3aa350-20b2-4f94-9f58-7613667f36a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:53.744012 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3aa350-20b2-4f94-9f58-7613667f36a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:53.745057 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3aa350-20b2-4f94-9f58-7613667f36a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:53.748701 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3aa350-20b2-4f94-9f58-7613667f36a5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:53.760349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e5fa5-30db-4d82-ba33-00e98354ac5a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:53.760993 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e5fa5-30db-4d82-ba33-00e98354ac5a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:53.761301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e5fa5-30db-4d82-ba33-00e98354ac5a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:53.761610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e5fa5-30db-4d82-ba33-00e98354ac5a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:53.762664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e5fa5-30db-4d82-ba33-00e98354ac5a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Adding query filter params (scope.project.id=914b9b4ba14947a58efc600a61f1f1b6, user.id=d15d42841b5f47c2937b968ed877b270) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:18:53.773254 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e5fa5-30db-4d82-ba33-00e98354ac5a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:53.781592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e5fa5-30db-4d82-ba33-00e98354ac5a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:53.784541 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2214/4421] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:18:53 2022] GET /identity/v3/roles => generated 1651 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:18:53.786367 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3aa350-20b2-4f94-9f58-7613667f36a5 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:53.808029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3aa350-20b2-4f94-9f58-7613667f36a5 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:53.817986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678aa6b-4dc6-4af1-9987-9dc88e66a94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:53.818985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678aa6b-4dc6-4af1-9987-9dc88e66a94a admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:53.819646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678aa6b-4dc6-4af1-9987-9dc88e66a94a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:53.819931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678aa6b-4dc6-4af1-9987-9dc88e66a94a admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:53.822501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b678aa6b-4dc6-4af1-9987-9dc88e66a94a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:53.824152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b678aa6b-4dc6-4af1-9987-9dc88e66a94a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:53.850591 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2215/4422] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:18:53 2022] GET /identity/v3/roles => generated 1651 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:18:53.854576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678aa6b-4dc6-4af1-9987-9dc88e66a94a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:53.865026 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2208/4423] 10.222.0.30 () {58 vars in 1356 bytes} [Sun Sep 4 01:18:53 2022] GET /identity/v3/role_assignments?scope.project.id=914b9b4ba14947a58efc600a61f1f1b6&user.id=d15d42841b5f47c2937b968ed877b270&effective => generated 228 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:18:53.869211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e5fa5-30db-4d82-ba33-00e98354ac5a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:53.875692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678aa6b-4dc6-4af1-9987-9dc88e66a94a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:53.881252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea415c-ac95-42b8-9962-1f0253d36695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:53.881971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea415c-ac95-42b8-9962-1f0253d36695 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:53.882340 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea415c-ac95-42b8-9962-1f0253d36695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:53.882652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea415c-ac95-42b8-9962-1f0253d36695 admin admin] PATH_INFO: `/v3/projects/bef2021fa90b4a93a05daa41bf26fe15/users/c5e369e011cd480baefb5823a833564a/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:53.891683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e5fa5-30db-4d82-ba33-00e98354ac5a tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:53.902352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b7c92-a740-4c3a-af1a-dd0c8be6193c tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:53.904965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b7c92-a740-4c3a-af1a-dd0c8be6193c tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:53.906392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b7c92-a740-4c3a-af1a-dd0c8be6193c tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:53.907108 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b7c92-a740-4c3a-af1a-dd0c8be6193c tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/projects/914b9b4ba14947a58efc600a61f1f1b6` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:53.911397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b7c92-a740-4c3a-af1a-dd0c8be6193c tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:delete_project(project_id=914b9b4ba14947a58efc600a61f1f1b6)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:53.914595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b7c92-a740-4c3a-af1a-dd0c8be6193c tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:53.922113 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea415c-ac95-42b8-9962-1f0253d36695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bef2021fa90b4a93a05daa41bf26fe15, user_id=c5e369e011cd480baefb5823a833564a, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:53.927936 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea415c-ac95-42b8-9962-1f0253d36695 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:53.959049 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2216/4424] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:18:53 2022] PUT /identity/v3/projects/bef2021fa90b4a93a05daa41bf26fe15/users/c5e369e011cd480baefb5823a833564a/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:18:53.964095 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1f6e6-5023-4ab6-8487-9d1d6ad979c2 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:53.964379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1f6e6-5023-4ab6-8487-9d1d6ad979c2 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:53.964655 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1f6e6-5023-4ab6-8487-9d1d6ad979c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:54.003551 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ecf1f6e6-5023-4ab6-8487-9d1d6ad979c2 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:18:54.006812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ecf1f6e6-5023-4ab6-8487-9d1d6ad979c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:54.043614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9b8b7c92-a740-4c3a-af1a-dd0c8be6193c tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '914b9b4ba14947a58efc600a61f1f1b6', 'request_id': 'req-9b8b7c92-a740-4c3a-af1a-dd0c8be6193c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:54.046537 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:54.060204 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9b8b7c92-a740-4c3a-af1a-dd0c8be6193c tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '914b9b4ba14947a58efc600a61f1f1b6', 'request_id': 'req-9b8b7c92-a740-4c3a-af1a-dd0c8be6193c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:54.068218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9b8b7c92-a740-4c3a-af1a-dd0c8be6193c tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '914b9b4ba14947a58efc600a61f1f1b6', 'request_id': 'req-9b8b7c92-a740-4c3a-af1a-dd0c8be6193c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:54.090981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9b8b7c92-a740-4c3a-af1a-dd0c8be6193c tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] The token cache is being invalidate because project 914b9b4ba14947a58efc600a61f1f1b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:18:54.091289 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9b8b7c92-a740-4c3a-af1a-dd0c8be6193c tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:54.093903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9b8b7c92-a740-4c3a-af1a-dd0c8be6193c tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:54.098198 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2209/4425] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:18:53 2022] DELETE /identity/v3/projects/914b9b4ba14947a58efc600a61f1f1b6 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:18:54.102209 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b7c92-a740-4c3a-af1a-dd0c8be6193c tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:54.114623 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9b8b7c92-a740-4c3a-af1a-dd0c8be6193c tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:54.161774 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2217/4426] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:18:54.257987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b7c92-a740-4c3a-af1a-dd0c8be6193c tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:54.265419 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702f9b2-9cc5-44f8-ac81-93c3dac593d1 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:54.266176 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702f9b2-9cc5-44f8-ac81-93c3dac593d1 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:54.266459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702f9b2-9cc5-44f8-ac81-93c3dac593d1 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:54.266738 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702f9b2-9cc5-44f8-ac81-93c3dac593d1 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/roles/45c97f167680434985a561e44379b15e` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:54.268304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9702f9b2-9cc5-44f8-ac81-93c3dac593d1 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:delete_role(role_id=45c97f167680434985a561e44379b15e)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:54.270023 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9702f9b2-9cc5-44f8-ac81-93c3dac593d1 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:54.313875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9702f9b2-9cc5-44f8-ac81-93c3dac593d1 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invalidating the token cache because role 45c97f167680434985a561e44379b15e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:18:54.314610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9702f9b2-9cc5-44f8-ac81-93c3dac593d1 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:54.314818 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9702f9b2-9cc5-44f8-ac81-93c3dac593d1 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:54.320773 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2210/4427] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:18:54 2022] DELETE /identity/v3/roles/45c97f167680434985a561e44379b15e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:18:54.326294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1f6e6-5023-4ab6-8487-9d1d6ad979c2 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:54.327984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ecf1f6e6-5023-4ab6-8487-9d1d6ad979c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:54.337845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702f9b2-9cc5-44f8-ac81-93c3dac593d1 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:54.347149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9702f9b2-9cc5-44f8-ac81-93c3dac593d1 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:54.503058 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702f9b2-9cc5-44f8-ac81-93c3dac593d1 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:54.508052 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a4bd4-32b4-483c-b8f9-8ef38f2197dc tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:54.508871 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a4bd4-32b4-483c-b8f9-8ef38f2197dc tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:54.509230 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a4bd4-32b4-483c-b8f9-8ef38f2197dc tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:54.509596 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a4bd4-32b4-483c-b8f9-8ef38f2197dc tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/users/d15d42841b5f47c2937b968ed877b270` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:54.510835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a4bd4-32b4-483c-b8f9-8ef38f2197dc tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d15d42841b5f47c2937b968ed877b270)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:54.512110 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1f6e6-5023-4ab6-8487-9d1d6ad979c2 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:54.513057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a4bd4-32b4-483c-b8f9-8ef38f2197dc tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:54.577978 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:54.591978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-725a4bd4-32b4-483c-b8f9-8ef38f2197dc tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd15d42841b5f47c2937b968ed877b270'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:54.594186 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-725a4bd4-32b4-483c-b8f9-8ef38f2197dc tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd15d42841b5f47c2937b968ed877b270'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:54.601510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebdbcf-93ce-4198-9989-a49ae54c53a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:54.603370 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebdbcf-93ce-4198-9989-a49ae54c53a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:54.603984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebdbcf-93ce-4198-9989-a49ae54c53a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:54.605698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebdbcf-93ce-4198-9989-a49ae54c53a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:54.610166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4cebdbcf-93ce-4198-9989-a49ae54c53a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:54.611920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-725a4bd4-32b4-483c-b8f9-8ef38f2197dc tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd15d42841b5f47c2937b968ed877b270'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:54.619707 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:54.639654 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-725a4bd4-32b4-483c-b8f9-8ef38f2197dc tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd15d42841b5f47c2937b968ed877b270'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:54.640304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-725a4bd4-32b4-483c-b8f9-8ef38f2197dc tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd15d42841b5f47c2937b968ed877b270'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:54.672889 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2211/4428] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:18:54 2022] DELETE /identity/v3/users/d15d42841b5f47c2937b968ed877b270 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:18:54.677610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a4bd4-32b4-483c-b8f9-8ef38f2197dc tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:54.681203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-725a4bd4-32b4-483c-b8f9-8ef38f2197dc tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:54.787410 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a4bd4-32b4-483c-b8f9-8ef38f2197dc tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:54.795446 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cebdbcf-93ce-4198-9989-a49ae54c53a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:54.796430 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dadeac-6b60-463f-80c8-2980a8f6defb tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:54.796788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cebdbcf-93ce-4198-9989-a49ae54c53a4 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:54.798384 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dadeac-6b60-463f-80c8-2980a8f6defb tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:54.798872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dadeac-6b60-463f-80c8-2980a8f6defb tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:54.803267 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dadeac-6b60-463f-80c8-2980a8f6defb tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/groups/4f8885a9720e4a5ab66f0d8bd7f92ae0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:54.805595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dadeac-6b60-463f-80c8-2980a8f6defb tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:delete_group(group_id=4f8885a9720e4a5ab66f0d8bd7f92ae0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:54.808480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dadeac-6b60-463f-80c8-2980a8f6defb tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:54.822041 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2218/4429] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:18:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:18:54.919910 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2212/4430] 10.222.0.30 () {58 vars in 1227 bytes} [Sun Sep 4 01:18:54 2022] DELETE /identity/v3/groups/4f8885a9720e4a5ab66f0d8bd7f92ae0 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:18:54.924341 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebdbcf-93ce-4198-9989-a49ae54c53a4 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:54.944661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebdbcf-93ce-4198-9989-a49ae54c53a4 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:55.074308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b311e4-aa7f-4e5d-958b-a9dc928b0dff tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:55.074969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b311e4-aa7f-4e5d-958b-a9dc928b0dff tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:55.075252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b311e4-aa7f-4e5d-958b-a9dc928b0dff tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:55.075528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b311e4-aa7f-4e5d-958b-a9dc928b0dff tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/projects/4f4efbcfa0e9461b93201bc3a32867e2` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:55.077847 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b311e4-aa7f-4e5d-958b-a9dc928b0dff tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4f4efbcfa0e9461b93201bc3a32867e2)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:55.080837 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b311e4-aa7f-4e5d-958b-a9dc928b0dff tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:55.167229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488b59f-4649-4400-869b-a464223084f5 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:55.171124 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488b59f-4649-4400-869b-a464223084f5 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:55.171452 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488b59f-4649-4400-869b-a464223084f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:55.182872 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-91b311e4-aa7f-4e5d-958b-a9dc928b0dff tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f4efbcfa0e9461b93201bc3a32867e2', 'request_id': 'req-91b311e4-aa7f-4e5d-958b-a9dc928b0dff'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:55.208154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-91b311e4-aa7f-4e5d-958b-a9dc928b0dff tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f4efbcfa0e9461b93201bc3a32867e2', 'request_id': 'req-91b311e4-aa7f-4e5d-958b-a9dc928b0dff'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:55.226919 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-91b311e4-aa7f-4e5d-958b-a9dc928b0dff tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f4efbcfa0e9461b93201bc3a32867e2', 'request_id': 'req-91b311e4-aa7f-4e5d-958b-a9dc928b0dff'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:55.253731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-91b311e4-aa7f-4e5d-958b-a9dc928b0dff tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] The token cache is being invalidate because project 4f4efbcfa0e9461b93201bc3a32867e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:18:55.268222 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-91b311e4-aa7f-4e5d-958b-a9dc928b0dff tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:55.269243 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-91b311e4-aa7f-4e5d-958b-a9dc928b0dff tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:55.274226 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2219/4431] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:18:54 2022] DELETE /identity/v3/projects/4f4efbcfa0e9461b93201bc3a32867e2 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:18:55.275404 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b311e4-aa7f-4e5d-958b-a9dc928b0dff tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:55.278007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-91b311e4-aa7f-4e5d-958b-a9dc928b0dff tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:55.292159 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-2488b59f-4649-4400-869b-a464223084f5 None None] MFA Rules not processed for user `bbd00e21b41b4dc5b56ccff0127b76af`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:18:55.296402 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2488b59f-4649-4400-869b-a464223084f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:55.354416 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:55.410269 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b311e4-aa7f-4e5d-958b-a9dc928b0dff tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:55.411405 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:55.416946 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2213/4432] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:18:55 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:18:55.426308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51ce01-e431-45df-9c2b-0eb4699b8005 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:55.427022 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51ce01-e431-45df-9c2b-0eb4699b8005 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:55.427306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51ce01-e431-45df-9c2b-0eb4699b8005 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:55.427581 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51ce01-e431-45df-9c2b-0eb4699b8005 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/domains/44657700d99e43babfdf7b6efe742ae5` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:55.429171 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b51ce01-e431-45df-9c2b-0eb4699b8005 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=44657700d99e43babfdf7b6efe742ae5)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:55.431295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b51ce01-e431-45df-9c2b-0eb4699b8005 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:55.432593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488b59f-4649-4400-869b-a464223084f5 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:55.435570 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2488b59f-4649-4400-869b-a464223084f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:55.477956 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4b51ce01-e431-45df-9c2b-0eb4699b8005 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '44657700d99e43babfdf7b6efe742ae5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:55.480563 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4b51ce01-e431-45df-9c2b-0eb4699b8005 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '44657700d99e43babfdf7b6efe742ae5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:55.539798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4b51ce01-e431-45df-9c2b-0eb4699b8005 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '44657700d99e43babfdf7b6efe742ae5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:55.540627 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4b51ce01-e431-45df-9c2b-0eb4699b8005 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '44657700d99e43babfdf7b6efe742ae5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:55.545489 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2220/4433] 10.222.0.30 () {60 vars in 1249 bytes} [Sun Sep 4 01:18:55 2022] PATCH /identity/v3/domains/44657700d99e43babfdf7b6efe742ae5 => generated 277 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:18:55.551009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51ce01-e431-45df-9c2b-0eb4699b8005 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:55.552718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4b51ce01-e431-45df-9c2b-0eb4699b8005 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:55.639270 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488b59f-4649-4400-869b-a464223084f5 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:55.684531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51ce01-e431-45df-9c2b-0eb4699b8005 tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:55.706890 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b047dbf7-3c71-4125-9031-c302f836c2ea tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8538796885e141519c0574f412fb945d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18c040092af542f88000d78957da2a0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:55.711457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047dbf7-3c71-4125-9031-c302f836c2ea tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:55.721455 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047dbf7-3c71-4125-9031-c302f836c2ea tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:55.722122 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047dbf7-3c71-4125-9031-c302f836c2ea tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] PATH_INFO: `/v3/domains/44657700d99e43babfdf7b6efe742ae5` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:55.743606 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b047dbf7-3c71-4125-9031-c302f836c2ea tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=44657700d99e43babfdf7b6efe742ae5)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:55.746216 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b047dbf7-3c71-4125-9031-c302f836c2ea tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:55.790610 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b047dbf7-3c71-4125-9031-c302f836c2ea tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '44657700d99e43babfdf7b6efe742ae5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:55.793824 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d53ff1-2218-49d9-b69a-107157d4ce61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:55.796831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d53ff1-2218-49d9-b69a-107157d4ce61 service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:55.797172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d53ff1-2218-49d9-b69a-107157d4ce61 service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:55.798436 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d53ff1-2218-49d9-b69a-107157d4ce61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:55.806958 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b047dbf7-3c71-4125-9031-c302f836c2ea tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '44657700d99e43babfdf7b6efe742ae5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:55.807526 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-61d53ff1-2218-49d9-b69a-107157d4ce61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:55.897103 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b047dbf7-3c71-4125-9031-c302f836c2ea tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44657700d99e43babfdf7b6efe742ae5', 'request_id': 'req-b047dbf7-3c71-4125-9031-c302f836c2ea'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:55.924951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b047dbf7-3c71-4125-9031-c302f836c2ea tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44657700d99e43babfdf7b6efe742ae5', 'request_id': 'req-b047dbf7-3c71-4125-9031-c302f836c2ea'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:55.937391 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b047dbf7-3c71-4125-9031-c302f836c2ea tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44657700d99e43babfdf7b6efe742ae5', 'request_id': 'req-b047dbf7-3c71-4125-9031-c302f836c2ea'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:55.939907 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:55.963217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b047dbf7-3c71-4125-9031-c302f836c2ea tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] The token cache is being invalidate because project 44657700d99e43babfdf7b6efe742ae5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:18:55.965363 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b047dbf7-3c71-4125-9031-c302f836c2ea tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:55.970277 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b047dbf7-3c71-4125-9031-c302f836c2ea tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:55.978546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d53ff1-2218-49d9-b69a-107157d4ce61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:55.980443 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d53ff1-2218-49d9-b69a-107157d4ce61 service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:55.994747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b047dbf7-3c71-4125-9031-c302f836c2ea tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '44657700d99e43babfdf7b6efe742ae5', 'request_id': 'req-b047dbf7-3c71-4125-9031-c302f836c2ea'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:55.995783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b047dbf7-3c71-4125-9031-c302f836c2ea tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '44657700d99e43babfdf7b6efe742ae5', 'request_id': 'req-b047dbf7-3c71-4125-9031-c302f836c2ea'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:55.996828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b047dbf7-3c71-4125-9031-c302f836c2ea tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '44657700d99e43babfdf7b6efe742ae5', 'request_id': 'req-b047dbf7-3c71-4125-9031-c302f836c2ea'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:56.016529 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2221/4434] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:18:55 2022] DELETE /identity/v3/domains/44657700d99e43babfdf7b6efe742ae5 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:18:56.019739 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2214/4435] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:18:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:18:56.023679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b047dbf7-3c71-4125-9031-c302f836c2ea tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:56.031695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b047dbf7-3c71-4125-9031-c302f836c2ea tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:56.169712 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b047dbf7-3c71-4125-9031-c302f836c2ea tempest-InheritsV3TestJSON-1982352040 tempest-InheritsV3TestJSON-1982352040-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:56.180624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff612a9-0ce5-4cea-9e44-17f1e84cc822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:56.181661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff612a9-0ce5-4cea-9e44-17f1e84cc822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:56.182044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff612a9-0ce5-4cea-9e44-17f1e84cc822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:56.182383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff612a9-0ce5-4cea-9e44-17f1e84cc822 admin admin] PATH_INFO: `/v3/users/f01fcf63a8a5421987a3f3bcadcb0b5e` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:56.188274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff612a9-0ce5-4cea-9e44-17f1e84cc822 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f01fcf63a8a5421987a3f3bcadcb0b5e)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:56.190449 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff612a9-0ce5-4cea-9e44-17f1e84cc822 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:56.375434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8ff612a9-0ce5-4cea-9e44-17f1e84cc822 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f01fcf63a8a5421987a3f3bcadcb0b5e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:56.380760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8ff612a9-0ce5-4cea-9e44-17f1e84cc822 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f01fcf63a8a5421987a3f3bcadcb0b5e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:56.418268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8ff612a9-0ce5-4cea-9e44-17f1e84cc822 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f01fcf63a8a5421987a3f3bcadcb0b5e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:56.446302 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8ff612a9-0ce5-4cea-9e44-17f1e84cc822 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f01fcf63a8a5421987a3f3bcadcb0b5e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:56.447930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8ff612a9-0ce5-4cea-9e44-17f1e84cc822 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f01fcf63a8a5421987a3f3bcadcb0b5e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:56.506558 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2222/4436] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:18:56 2022] DELETE /identity/v3/users/f01fcf63a8a5421987a3f3bcadcb0b5e => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:18:56.510797 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d7f61-4160-4226-bdf7-ee6a9da6f7be None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:56.511557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d7f61-4160-4226-bdf7-ee6a9da6f7be None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:56.511941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d7f61-4160-4226-bdf7-ee6a9da6f7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:56.574448 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-392d7f61-4160-4226-bdf7-ee6a9da6f7be None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:18:56.578011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-392d7f61-4160-4226-bdf7-ee6a9da6f7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:56.726703 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:56.788141 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2215/4437] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:18:56.888956 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff612a9-0ce5-4cea-9e44-17f1e84cc822 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:56.890903 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8ff612a9-0ce5-4cea-9e44-17f1e84cc822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:57.048835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff612a9-0ce5-4cea-9e44-17f1e84cc822 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:57.055292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30402f-c599-4bcc-801e-ebb110218c2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:57.057635 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30402f-c599-4bcc-801e-ebb110218c2e service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:57.057928 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30402f-c599-4bcc-801e-ebb110218c2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:57.058337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30402f-c599-4bcc-801e-ebb110218c2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:57.074835 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:57.080411 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d30402f-c599-4bcc-801e-ebb110218c2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:57.081934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d30402f-c599-4bcc-801e-ebb110218c2e service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:57.115017 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2223/4438] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:18:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:18:58.467960 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d7f61-4160-4226-bdf7-ee6a9da6f7be None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:58.469552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-392d7f61-4160-4226-bdf7-ee6a9da6f7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:58.675007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d7f61-4160-4226-bdf7-ee6a9da6f7be None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:58.691677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9b00b-4b8f-4975-bc59-2855278c8f4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:58.692331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9b00b-4b8f-4975-bc59-2855278c8f4d service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:58.692719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9b00b-4b8f-4975-bc59-2855278c8f4d service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:58.693054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9b00b-4b8f-4975-bc59-2855278c8f4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:58.695064 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-82b9b00b-4b8f-4975-bc59-2855278c8f4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:58.838245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b9b00b-4b8f-4975-bc59-2855278c8f4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:58.841096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b9b00b-4b8f-4975-bc59-2855278c8f4d service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:58.872928 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2216/4439] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:18:58 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:18:59.433343 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30402f-c599-4bcc-801e-ebb110218c2e service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:59.434768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4d30402f-c599-4bcc-801e-ebb110218c2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:18:59.460534 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30402f-c599-4bcc-801e-ebb110218c2e service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:59.474454 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d11971-a413-4371-a9d2-0f44b72fcefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:59.475525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d11971-a413-4371-a9d2-0f44b72fcefe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:59.476248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d11971-a413-4371-a9d2-0f44b72fcefe admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:59.476248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d11971-a413-4371-a9d2-0f44b72fcefe admin admin] PATH_INFO: `/v3/projects/31ba1cab20f242ada3445ef99c95821a` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:59.477487 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d11971-a413-4371-a9d2-0f44b72fcefe admin admin] RBAC: Authorizing `identity:delete_project(project_id=31ba1cab20f242ada3445ef99c95821a)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:59.481656 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d11971-a413-4371-a9d2-0f44b72fcefe admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:59.627254 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d5d11971-a413-4371-a9d2-0f44b72fcefe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31ba1cab20f242ada3445ef99c95821a', 'request_id': 'req-d5d11971-a413-4371-a9d2-0f44b72fcefe'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:59.641150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d5d11971-a413-4371-a9d2-0f44b72fcefe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31ba1cab20f242ada3445ef99c95821a', 'request_id': 'req-d5d11971-a413-4371-a9d2-0f44b72fcefe'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:59.649804 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d5d11971-a413-4371-a9d2-0f44b72fcefe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31ba1cab20f242ada3445ef99c95821a', 'request_id': 'req-d5d11971-a413-4371-a9d2-0f44b72fcefe'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:59.678275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d5d11971-a413-4371-a9d2-0f44b72fcefe admin admin] The token cache is being invalidate because project 31ba1cab20f242ada3445ef99c95821a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:18:59.678564 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d5d11971-a413-4371-a9d2-0f44b72fcefe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:59.679239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d5d11971-a413-4371-a9d2-0f44b72fcefe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:59.693635 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2224/4440] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:18:59 2022] DELETE /identity/v3/projects/31ba1cab20f242ada3445ef99c95821a => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:18:59.697816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9b00b-4b8f-4975-bc59-2855278c8f4d service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:18:59.712797 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9b00b-4b8f-4975-bc59-2855278c8f4d service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:18:59.839992 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4137c-0301-4191-84d6-b2f7876ac75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:18:59.840645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4137c-0301-4191-84d6-b2f7876ac75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:18:59.840923 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4137c-0301-4191-84d6-b2f7876ac75f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:18:59.841194 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4137c-0301-4191-84d6-b2f7876ac75f admin admin] PATH_INFO: `/v3/users/8538796885e141519c0574f412fb945d` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:18:59.843515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4137c-0301-4191-84d6-b2f7876ac75f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8538796885e141519c0574f412fb945d)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:18:59.845515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4137c-0301-4191-84d6-b2f7876ac75f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:18:59.894278 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:59.958316 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0ee4137c-0301-4191-84d6-b2f7876ac75f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8538796885e141519c0574f412fb945d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:59.965930 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0ee4137c-0301-4191-84d6-b2f7876ac75f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8538796885e141519c0574f412fb945d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:59.974490 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0ee4137c-0301-4191-84d6-b2f7876ac75f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8538796885e141519c0574f412fb945d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:59.995424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0ee4137c-0301-4191-84d6-b2f7876ac75f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8538796885e141519c0574f412fb945d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:18:59.996098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0ee4137c-0301-4191-84d6-b2f7876ac75f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8538796885e141519c0574f412fb945d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:00.032505 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2217/4441] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:18:59 2022] DELETE /identity/v3/users/8538796885e141519c0574f412fb945d => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:00.918194 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d11971-a413-4371-a9d2-0f44b72fcefe admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:00.920797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d5d11971-a413-4371-a9d2-0f44b72fcefe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:00.939666 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d11971-a413-4371-a9d2-0f44b72fcefe admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:01.068002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524bb2a-1d5d-4a9b-922e-e576f3c4d31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:01.068663 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524bb2a-1d5d-4a9b-922e-e576f3c4d31f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:01.070789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524bb2a-1d5d-4a9b-922e-e576f3c4d31f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:01.071088 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524bb2a-1d5d-4a9b-922e-e576f3c4d31f admin admin] PATH_INFO: `/v3/projects/18c040092af542f88000d78957da2a0d` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:01.074313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524bb2a-1d5d-4a9b-922e-e576f3c4d31f admin admin] RBAC: Authorizing `identity:delete_project(project_id=18c040092af542f88000d78957da2a0d)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:01.081059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524bb2a-1d5d-4a9b-922e-e576f3c4d31f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:01.232511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1524bb2a-1d5d-4a9b-922e-e576f3c4d31f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18c040092af542f88000d78957da2a0d', 'request_id': 'req-1524bb2a-1d5d-4a9b-922e-e576f3c4d31f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:01.249876 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1524bb2a-1d5d-4a9b-922e-e576f3c4d31f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18c040092af542f88000d78957da2a0d', 'request_id': 'req-1524bb2a-1d5d-4a9b-922e-e576f3c4d31f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:01.258033 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1524bb2a-1d5d-4a9b-922e-e576f3c4d31f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18c040092af542f88000d78957da2a0d', 'request_id': 'req-1524bb2a-1d5d-4a9b-922e-e576f3c4d31f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:01.281772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1524bb2a-1d5d-4a9b-922e-e576f3c4d31f admin admin] The token cache is being invalidate because project 18c040092af542f88000d78957da2a0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:19:01.282063 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1524bb2a-1d5d-4a9b-922e-e576f3c4d31f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:01.288661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1524bb2a-1d5d-4a9b-922e-e576f3c4d31f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:01.293539 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2225/4442] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:19:00 2022] DELETE /identity/v3/projects/18c040092af542f88000d78957da2a0d => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:01.294978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4ee59-7add-4101-aed6-d7af4c1e3d0e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:01.296240 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4ee59-7add-4101-aed6-d7af4c1e3d0e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:01.296714 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4ee59-7add-4101-aed6-d7af4c1e3d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:01.348659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-3ea4ee59-7add-4101-aed6-d7af4c1e3d0e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:01.352372 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3ea4ee59-7add-4101-aed6-d7af4c1e3d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:01.575451 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2218/4443] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:19:01.583460 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451df1b-1b8b-407d-b4d2-a60c2d27c43b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:01.583733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451df1b-1b8b-407d-b4d2-a60c2d27c43b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:01.584007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451df1b-1b8b-407d-b4d2-a60c2d27c43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:01.626212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-5451df1b-1b8b-407d-b4d2-a60c2d27c43b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:01.627465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5451df1b-1b8b-407d-b4d2-a60c2d27c43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:01.645675 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2226/4444] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:19:01.650183 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4ee59-7add-4101-aed6-d7af4c1e3d0e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:01.680056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4ee59-7add-4101-aed6-d7af4c1e3d0e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:01.708417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79e82f-3155-45ff-a0a1-9097f803a8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:01.709056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79e82f-3155-45ff-a0a1-9097f803a8c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:01.709335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79e82f-3155-45ff-a0a1-9097f803a8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:01.709635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79e82f-3155-45ff-a0a1-9097f803a8c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:01.710386 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be79e82f-3155-45ff-a0a1-9097f803a8c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:19:01.730438 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be79e82f-3155-45ff-a0a1-9097f803a8c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:01.739229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be79e82f-3155-45ff-a0a1-9097f803a8c6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:01.770431 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2219/4445] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:19:01.772575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451df1b-1b8b-407d-b4d2-a60c2d27c43b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:01.777881 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:01.790065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451df1b-1b8b-407d-b4d2-a60c2d27c43b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:01.805000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc7877-3ed0-4014-9c8b-14cc886177dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:01.809800 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc7877-3ed0-4014-9c8b-14cc886177dd admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:01.810681 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc7877-3ed0-4014-9c8b-14cc886177dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:01.811085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc7877-3ed0-4014-9c8b-14cc886177dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:01.817139 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc7877-3ed0-4014-9c8b-14cc886177dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:01.820778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc7877-3ed0-4014-9c8b-14cc886177dd admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:01.899973 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2227/4446] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:19:01 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:19:01.904482 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79e82f-3155-45ff-a0a1-9097f803a8c6 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:01.928941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79e82f-3155-45ff-a0a1-9097f803a8c6 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:02.096823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59f8a1-5185-41dd-939d-88f81e86dc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:02.097554 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59f8a1-5185-41dd-939d-88f81e86dc28 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:02.097749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59f8a1-5185-41dd-939d-88f81e86dc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:02.098183 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59f8a1-5185-41dd-939d-88f81e86dc28 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:02.098652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59f8a1-5185-41dd-939d-88f81e86dc28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:02.100611 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59f8a1-5185-41dd-939d-88f81e86dc28 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:02.143233 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2220/4447] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:19:01 2022] POST /identity/v3/users => generated 288 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:19:02.147920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc7877-3ed0-4014-9c8b-14cc886177dd admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:02.170206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc7877-3ed0-4014-9c8b-14cc886177dd admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:02.185719 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd849f-3c7a-4e26-9b28-dfea4e2e12ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:02.192520 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd849f-3c7a-4e26-9b28-dfea4e2e12ee admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:02.192983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd849f-3c7a-4e26-9b28-dfea4e2e12ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:02.193269 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd849f-3c7a-4e26-9b28-dfea4e2e12ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:02.194020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd849f-3c7a-4e26-9b28-dfea4e2e12ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:02.201061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd849f-3c7a-4e26-9b28-dfea4e2e12ee admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:02.224673 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2228/4448] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:19:02.228259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59f8a1-5185-41dd-939d-88f81e86dc28 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:02.250653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59f8a1-5185-41dd-939d-88f81e86dc28 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:02.271919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179b6ce-322e-4fc2-abe3-566a4515b96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:02.272559 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179b6ce-322e-4fc2-abe3-566a4515b96c admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:02.272847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179b6ce-322e-4fc2-abe3-566a4515b96c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:02.273121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179b6ce-322e-4fc2-abe3-566a4515b96c admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:02.273838 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179b6ce-322e-4fc2-abe3-566a4515b96c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:02.275433 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179b6ce-322e-4fc2-abe3-566a4515b96c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:02.307597 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2221/4449] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:19:02.311272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd849f-3c7a-4e26-9b28-dfea4e2e12ee admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:02.329116 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd849f-3c7a-4e26-9b28-dfea4e2e12ee admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:02.337410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81cdad-f362-41a1-8742-237dd62918ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:02.338253 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81cdad-f362-41a1-8742-237dd62918ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:02.339069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81cdad-f362-41a1-8742-237dd62918ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:02.339936 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81cdad-f362-41a1-8742-237dd62918ff admin admin] PATH_INFO: `/v3/projects/e63bbada84484f4997d8f0548e4c35db/users/f3efe1eefed54624a0c2e902a5c6d03f/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:02.423431 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81cdad-f362-41a1-8742-237dd62918ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=e63bbada84484f4997d8f0548e4c35db, user_id=f3efe1eefed54624a0c2e902a5c6d03f, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:02.451724 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81cdad-f362-41a1-8742-237dd62918ff admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:02.497362 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2229/4450] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:19:02 2022] PUT /identity/v3/projects/e63bbada84484f4997d8f0548e4c35db/users/f3efe1eefed54624a0c2e902a5c6d03f/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:19:02.511575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11523d6-1a54-4ca9-a17b-f96586a10032 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:02.512005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11523d6-1a54-4ca9-a17b-f96586a10032 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:02.512101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11523d6-1a54-4ca9-a17b-f96586a10032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:02.536979 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:02.590457 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b11523d6-1a54-4ca9-a17b-f96586a10032 None None] MFA Rules not processed for user `f3efe1eefed54624a0c2e902a5c6d03f`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:02.592544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b11523d6-1a54-4ca9-a17b-f96586a10032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:02.841024 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2222/4451] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:19:02.846101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81cdad-f362-41a1-8742-237dd62918ff admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:02.864743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81cdad-f362-41a1-8742-237dd62918ff admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:02.870795 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6df3d-5096-4dc5-a157-503d4f03bbdb tempest-IdentityCatalogTest-1508737813 tempest-IdentityCatalogTest-1508737813-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3efe1eefed54624a0c2e902a5c6d03f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63bbada84484f4997d8f0548e4c35db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:02.871737 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6df3d-5096-4dc5-a157-503d4f03bbdb tempest-IdentityCatalogTest-1508737813 tempest-IdentityCatalogTest-1508737813-project] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:02.872026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6df3d-5096-4dc5-a157-503d4f03bbdb tempest-IdentityCatalogTest-1508737813 tempest-IdentityCatalogTest-1508737813-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:02.872304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6df3d-5096-4dc5-a157-503d4f03bbdb tempest-IdentityCatalogTest-1508737813 tempest-IdentityCatalogTest-1508737813-project] PATH_INFO: `/v3/auth/catalog` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:02.872943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6df3d-5096-4dc5-a157-503d4f03bbdb tempest-IdentityCatalogTest-1508737813 tempest-IdentityCatalogTest-1508737813-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:02.875597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6df3d-5096-4dc5-a157-503d4f03bbdb tempest-IdentityCatalogTest-1508737813 tempest-IdentityCatalogTest-1508737813-project] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:02.882161 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2230/4452] 10.222.0.30 () {58 vars in 1143 bytes} [Sun Sep 4 01:19:02 2022] GET /identity/v3/auth/catalog => generated 2658 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:19:02.885710 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11523d6-1a54-4ca9-a17b-f96586a10032 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:03.049376 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11523d6-1a54-4ca9-a17b-f96586a10032 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:03.055069 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c70dc9-e366-410c-817f-13d1d1458fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:03.055934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c70dc9-e366-410c-817f-13d1d1458fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:03.057648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c70dc9-e366-410c-817f-13d1d1458fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:03.058188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c70dc9-e366-410c-817f-13d1d1458fd7 admin admin] PATH_INFO: `/v3/users/f3efe1eefed54624a0c2e902a5c6d03f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:03.059859 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c70dc9-e366-410c-817f-13d1d1458fd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3efe1eefed54624a0c2e902a5c6d03f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:03.062614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c70dc9-e366-410c-817f-13d1d1458fd7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:03.190701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-45c70dc9-e366-410c-817f-13d1d1458fd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3efe1eefed54624a0c2e902a5c6d03f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:03.192300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-45c70dc9-e366-410c-817f-13d1d1458fd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3efe1eefed54624a0c2e902a5c6d03f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:03.211734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-45c70dc9-e366-410c-817f-13d1d1458fd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3efe1eefed54624a0c2e902a5c6d03f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:03.231509 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-45c70dc9-e366-410c-817f-13d1d1458fd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3efe1eefed54624a0c2e902a5c6d03f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:03.232831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-45c70dc9-e366-410c-817f-13d1d1458fd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3efe1eefed54624a0c2e902a5c6d03f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:03.278529 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2223/4453] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:19:02 2022] DELETE /identity/v3/users/f3efe1eefed54624a0c2e902a5c6d03f => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:03.285941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8920e-7ba3-48ac-ac68-3c049f3f1698 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:03.286487 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8920e-7ba3-48ac-ac68-3c049f3f1698 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:03.286487 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8920e-7ba3-48ac-ac68-3c049f3f1698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:03.316305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-aca8920e-7ba3-48ac-ac68-3c049f3f1698 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:03.318615 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-aca8920e-7ba3-48ac-ac68-3c049f3f1698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:03.408576 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2231/4454] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:19:03.490845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c70dc9-e366-410c-817f-13d1d1458fd7 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:03.492961 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-45c70dc9-e366-410c-817f-13d1d1458fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:03.517513 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:03.592053 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c70dc9-e366-410c-817f-13d1d1458fd7 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:03.596911 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c017dca-2b4d-440f-8545-782beadb161c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:03.597714 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c017dca-2b4d-440f-8545-782beadb161c service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:03.598325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c017dca-2b4d-440f-8545-782beadb161c service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:03.598710 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c017dca-2b4d-440f-8545-782beadb161c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:03.625877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c017dca-2b4d-440f-8545-782beadb161c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:03.627759 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c017dca-2b4d-440f-8545-782beadb161c service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:03.652033 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2224/4455] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:19:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:19:05.049200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca8920e-7ba3-48ac-ac68-3c049f3f1698 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:05.051308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-aca8920e-7ba3-48ac-ac68-3c049f3f1698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:05.100335 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca8920e-7ba3-48ac-ac68-3c049f3f1698 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:05.119831 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4b56f-016e-417e-a3f2-1ac1c13fbf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:05.120506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4b56f-016e-417e-a3f2-1ac1c13fbf50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:05.120799 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4b56f-016e-417e-a3f2-1ac1c13fbf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:05.121077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4b56f-016e-417e-a3f2-1ac1c13fbf50 admin admin] PATH_INFO: `/v3/projects/e63bbada84484f4997d8f0548e4c35db` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:05.122461 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4b56f-016e-417e-a3f2-1ac1c13fbf50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e63bbada84484f4997d8f0548e4c35db)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:05.124397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4b56f-016e-417e-a3f2-1ac1c13fbf50 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:05.249894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2cc4b56f-016e-417e-a3f2-1ac1c13fbf50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e63bbada84484f4997d8f0548e4c35db', 'request_id': 'req-2cc4b56f-016e-417e-a3f2-1ac1c13fbf50'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:05.272447 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2cc4b56f-016e-417e-a3f2-1ac1c13fbf50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e63bbada84484f4997d8f0548e4c35db', 'request_id': 'req-2cc4b56f-016e-417e-a3f2-1ac1c13fbf50'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:05.285040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2cc4b56f-016e-417e-a3f2-1ac1c13fbf50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e63bbada84484f4997d8f0548e4c35db', 'request_id': 'req-2cc4b56f-016e-417e-a3f2-1ac1c13fbf50'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:05.326348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2cc4b56f-016e-417e-a3f2-1ac1c13fbf50 admin admin] The token cache is being invalidate because project e63bbada84484f4997d8f0548e4c35db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:19:05.327493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2cc4b56f-016e-417e-a3f2-1ac1c13fbf50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:05.328796 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2cc4b56f-016e-417e-a3f2-1ac1c13fbf50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:05.336681 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2232/4456] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:19:05 2022] DELETE /identity/v3/projects/e63bbada84484f4997d8f0548e4c35db => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:05.342040 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c19d3-783b-41ec-8b90-d89e47c48b4e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:05.342524 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c19d3-783b-41ec-8b90-d89e47c48b4e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:05.342799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c19d3-783b-41ec-8b90-d89e47c48b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:05.430265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-270c19d3-783b-41ec-8b90-d89e47c48b4e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:05.432021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-270c19d3-783b-41ec-8b90-d89e47c48b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:05.536007 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2225/4457] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:19:05.536136 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fcd056-fada-4b1f-9653-21563e82023c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:05.536304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fcd056-fada-4b1f-9653-21563e82023c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:05.536645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fcd056-fada-4b1f-9653-21563e82023c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:05.569617 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-22fcd056-fada-4b1f-9653-21563e82023c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:05.571690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-22fcd056-fada-4b1f-9653-21563e82023c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:05.598763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c19d3-783b-41ec-8b90-d89e47c48b4e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:05.608160 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2233/4458] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:19:05.611549 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c19d3-783b-41ec-8b90-d89e47c48b4e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:05.624047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d33d52-08d5-4a54-a2da-1be8f2928deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:05.624686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d33d52-08d5-4a54-a2da-1be8f2928deb admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:05.624967 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d33d52-08d5-4a54-a2da-1be8f2928deb admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:05.625240 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d33d52-08d5-4a54-a2da-1be8f2928deb admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:05.627142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d33d52-08d5-4a54-a2da-1be8f2928deb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:19:05.627852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d33d52-08d5-4a54-a2da-1be8f2928deb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:05.630515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d33d52-08d5-4a54-a2da-1be8f2928deb admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:05.651047 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2226/4459] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:19:05.652177 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fcd056-fada-4b1f-9653-21563e82023c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:05.672682 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fcd056-fada-4b1f-9653-21563e82023c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:05.693206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35776d0f-6f76-4547-9bd8-fdb02b46f97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:05.694267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35776d0f-6f76-4547-9bd8-fdb02b46f97e admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:05.694555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35776d0f-6f76-4547-9bd8-fdb02b46f97e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:05.694835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35776d0f-6f76-4547-9bd8-fdb02b46f97e admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:05.695511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35776d0f-6f76-4547-9bd8-fdb02b46f97e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:05.697507 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35776d0f-6f76-4547-9bd8-fdb02b46f97e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:05.754405 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:05.789845 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2234/4460] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:19:05 2022] POST /identity/v3/projects => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:19:05.791059 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d33d52-08d5-4a54-a2da-1be8f2928deb admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:05.807310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d33d52-08d5-4a54-a2da-1be8f2928deb admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:05.941697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873e8a9-944d-4c51-8fc4-d66c0090d277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:05.943063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873e8a9-944d-4c51-8fc4-d66c0090d277 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:05.943550 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873e8a9-944d-4c51-8fc4-d66c0090d277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:05.944007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873e8a9-944d-4c51-8fc4-d66c0090d277 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:05.944912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0873e8a9-944d-4c51-8fc4-d66c0090d277 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:05.947575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0873e8a9-944d-4c51-8fc4-d66c0090d277 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:05.993029 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2227/4461] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:19:05 2022] POST /identity/v3/users => generated 286 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:19:05.997198 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35776d0f-6f76-4547-9bd8-fdb02b46f97e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:06.014605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35776d0f-6f76-4547-9bd8-fdb02b46f97e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:06.031749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf38cc9-796c-4a85-a5eb-a92018b23ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:06.032730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf38cc9-796c-4a85-a5eb-a92018b23ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:06.033076 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf38cc9-796c-4a85-a5eb-a92018b23ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:06.033459 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf38cc9-796c-4a85-a5eb-a92018b23ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:06.042721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf38cc9-796c-4a85-a5eb-a92018b23ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:06.045651 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf38cc9-796c-4a85-a5eb-a92018b23ab9 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:06.078307 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2235/4462] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:19:06.082533 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873e8a9-944d-4c51-8fc4-d66c0090d277 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:06.117170 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873e8a9-944d-4c51-8fc4-d66c0090d277 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:06.126274 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfd48a-051a-43f9-84ce-0c62b6b633d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:06.127305 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfd48a-051a-43f9-84ce-0c62b6b633d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:06.127673 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfd48a-051a-43f9-84ce-0c62b6b633d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:06.128016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfd48a-051a-43f9-84ce-0c62b6b633d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:06.128746 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfd48a-051a-43f9-84ce-0c62b6b633d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:06.130485 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfd48a-051a-43f9-84ce-0c62b6b633d6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:06.150269 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2228/4463] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:19:06.154913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf38cc9-796c-4a85-a5eb-a92018b23ab9 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:06.166843 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf38cc9-796c-4a85-a5eb-a92018b23ab9 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:06.202787 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e6612-e269-4abb-b916-fad4d1cf126d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:06.203743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e6612-e269-4abb-b916-fad4d1cf126d admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:06.204354 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e6612-e269-4abb-b916-fad4d1cf126d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:06.204837 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e6612-e269-4abb-b916-fad4d1cf126d admin admin] PATH_INFO: `/v3/projects/4b117f6b674c402698c6af5eb229c553/users/b3ec9da88a2046b1be748ef5f2f2fba6/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:06.260193 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e6612-e269-4abb-b916-fad4d1cf126d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b117f6b674c402698c6af5eb229c553, user_id=b3ec9da88a2046b1be748ef5f2f2fba6, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:06.265283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e6612-e269-4abb-b916-fad4d1cf126d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:06.302860 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2236/4464] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:19:06 2022] PUT /identity/v3/projects/4b117f6b674c402698c6af5eb229c553/users/b3ec9da88a2046b1be748ef5f2f2fba6/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:06.304010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f78a53-d4f7-4d9f-ac33-b60f6bb4b8aa None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:06.304397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f78a53-d4f7-4d9f-ac33-b60f6bb4b8aa None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:06.304858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f78a53-d4f7-4d9f-ac33-b60f6bb4b8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:06.369093 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-10f78a53-d4f7-4d9f-ac33-b60f6bb4b8aa None None] MFA Rules not processed for user `b3ec9da88a2046b1be748ef5f2f2fba6`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:06.371531 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-10f78a53-d4f7-4d9f-ac33-b60f6bb4b8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:06.383666 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:06.480496 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2229/4465] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:19:06.482376 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e6612-e269-4abb-b916-fad4d1cf126d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:06.495299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e6612-e269-4abb-b916-fad4d1cf126d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:06.506853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a98097-7ee7-47ea-ba9d-172e5380ea2a tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3ec9da88a2046b1be748ef5f2f2fba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b117f6b674c402698c6af5eb229c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:06.507520 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a98097-7ee7-47ea-ba9d-172e5380ea2a tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:06.507807 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a98097-7ee7-47ea-ba9d-172e5380ea2a tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:06.508081 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a98097-7ee7-47ea-ba9d-172e5380ea2a tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] PATH_INFO: `/v3/users/b3ec9da88a2046b1be748ef5f2f2fba6/credentials/OS-EC2` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:06.508715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a98097-7ee7-47ea-ba9d-172e5380ea2a tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=b3ec9da88a2046b1be748ef5f2f2fba6)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:06.510277 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a98097-7ee7-47ea-ba9d-172e5380ea2a tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:06.560704 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2237/4466] 10.222.0.30 () {60 vars in 1299 bytes} [Sun Sep 4 01:19:06 2022] POST /identity/v3/users/b3ec9da88a2046b1be748ef5f2f2fba6/credentials/OS-EC2 => generated 367 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:19:06.562174 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f78a53-d4f7-4d9f-ac33-b60f6bb4b8aa None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:06.588778 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f78a53-d4f7-4d9f-ac33-b60f6bb4b8aa None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:06.594148 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630759f-ea91-42ea-8047-818f1717bbe2 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3ec9da88a2046b1be748ef5f2f2fba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b117f6b674c402698c6af5eb229c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:06.594741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630759f-ea91-42ea-8047-818f1717bbe2 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:06.595669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630759f-ea91-42ea-8047-818f1717bbe2 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:06.595669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630759f-ea91-42ea-8047-818f1717bbe2 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] PATH_INFO: `/v3/users/b3ec9da88a2046b1be748ef5f2f2fba6/credentials/OS-EC2/7d523ff35a1c456ba7486cd3ce8fd38f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:06.598173 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a630759f-ea91-42ea-8047-818f1717bbe2 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=b3ec9da88a2046b1be748ef5f2f2fba6, credential_id=7d523ff35a1c456ba7486cd3ce8fd38f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:06.599808 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a630759f-ea91-42ea-8047-818f1717bbe2 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:06.634522 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2230/4467] 10.222.0.30 () {58 vars in 1380 bytes} [Sun Sep 4 01:19:06 2022] DELETE /identity/v3/users/b3ec9da88a2046b1be748ef5f2f2fba6/credentials/OS-EC2/7d523ff35a1c456ba7486cd3ce8fd38f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:06.635689 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a98097-7ee7-47ea-ba9d-172e5380ea2a tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:06.650707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a98097-7ee7-47ea-ba9d-172e5380ea2a tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:06.673026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0baa65e-1197-4255-992c-f9a176714094 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3ec9da88a2046b1be748ef5f2f2fba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b117f6b674c402698c6af5eb229c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:06.673769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0baa65e-1197-4255-992c-f9a176714094 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:06.674055 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0baa65e-1197-4255-992c-f9a176714094 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:06.674331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0baa65e-1197-4255-992c-f9a176714094 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] PATH_INFO: `/v3/users/b3ec9da88a2046b1be748ef5f2f2fba6/credentials/OS-EC2` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:06.677934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0baa65e-1197-4255-992c-f9a176714094 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=b3ec9da88a2046b1be748ef5f2f2fba6)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:06.681941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0baa65e-1197-4255-992c-f9a176714094 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:06.709747 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2238/4468] 10.222.0.30 () {60 vars in 1299 bytes} [Sun Sep 4 01:19:06 2022] POST /identity/v3/users/b3ec9da88a2046b1be748ef5f2f2fba6/credentials/OS-EC2 => generated 367 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:19:06.715354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630759f-ea91-42ea-8047-818f1717bbe2 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:06.729553 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630759f-ea91-42ea-8047-818f1717bbe2 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:06.740313 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099dcde1-acf4-4a00-a51e-4c9380eaf203 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3ec9da88a2046b1be748ef5f2f2fba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b117f6b674c402698c6af5eb229c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:06.742121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099dcde1-acf4-4a00-a51e-4c9380eaf203 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:06.743051 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099dcde1-acf4-4a00-a51e-4c9380eaf203 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:06.743703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099dcde1-acf4-4a00-a51e-4c9380eaf203 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] PATH_INFO: `/v3/users/b3ec9da88a2046b1be748ef5f2f2fba6/credentials/OS-EC2/2526d138192d47abb122638bbdda7f99` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:06.746845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099dcde1-acf4-4a00-a51e-4c9380eaf203 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=b3ec9da88a2046b1be748ef5f2f2fba6, credential_id=2526d138192d47abb122638bbdda7f99)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:06.750053 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099dcde1-acf4-4a00-a51e-4c9380eaf203 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:06.788917 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2231/4469] 10.222.0.30 () {58 vars in 1380 bytes} [Sun Sep 4 01:19:06 2022] DELETE /identity/v3/users/b3ec9da88a2046b1be748ef5f2f2fba6/credentials/OS-EC2/2526d138192d47abb122638bbdda7f99 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:06.793629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0baa65e-1197-4255-992c-f9a176714094 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:06.808585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0baa65e-1197-4255-992c-f9a176714094 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:06.813346 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817b8c5-958e-4637-9c3e-f57c96bf3bf1 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3ec9da88a2046b1be748ef5f2f2fba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b117f6b674c402698c6af5eb229c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:06.815326 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817b8c5-958e-4637-9c3e-f57c96bf3bf1 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:06.815677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817b8c5-958e-4637-9c3e-f57c96bf3bf1 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:06.818572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817b8c5-958e-4637-9c3e-f57c96bf3bf1 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] PATH_INFO: `/v3/users/b3ec9da88a2046b1be748ef5f2f2fba6/credentials/OS-EC2/2526d138192d47abb122638bbdda7f99` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:06.872098 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-2817b8c5-958e-4637-9c3e-f57c96bf3bf1 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] Could not find credential: 8e9e2c37c215eba1c9951d6c3f49550f5b5bb92ce95db1c40fcdc5afa216cc77.: keystone.exception.CredentialNotFound: Could not find credential: 8e9e2c37c215eba1c9951d6c3f49550f5b5bb92ce95db1c40fcdc5afa216cc77. Sep 04 01:19:06.872098 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:19:06.872098 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:19:06.872098 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:19:06.872098 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:19:06.872098 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:19:06.872098 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:19:06.872098 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:19:06.872098 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:19:06.872098 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:19:06.872098 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:19:06.872098 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:19:06.872098 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Sep 04 01:19:06.872098 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Sep 04 01:19:06.873142 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Sep 04 01:19:06.873142 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Sep 04 01:19:06.873142 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Sep 04 01:19:06.873142 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Sep 04 01:19:06.873142 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:19:06.873142 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:19:06.873142 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Sep 04 01:19:06.873142 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Sep 04 01:19:06.873142 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 01:19:06.873142 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 01:19:06.873142 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 01:19:06.873142 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 01:19:06.873142 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 01:19:06.873142 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 01:19:06.873142 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 01:19:06.873142 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 01:19:06.874249 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 01:19:06.874249 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 01:19:06.874249 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 01:19:06.874249 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 01:19:06.874249 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 01:19:06.874249 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 01:19:06.874249 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Sep 04 01:19:06.874249 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Sep 04 01:19:06.874249 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Sep 04 01:19:06.874249 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Sep 04 01:19:06.874249 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Sep 04 01:19:06.874249 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Sep 04 01:19:06.874249 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: 8e9e2c37c215eba1c9951d6c3f49550f5b5bb92ce95db1c40fcdc5afa216cc77. Sep 04 01:19:06.874249 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:19:06.882124 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099dcde1-acf4-4a00-a51e-4c9380eaf203 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:06.883853 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2239/4470] 10.222.0.30 () {58 vars in 1377 bytes} [Sun Sep 4 01:19:06 2022] GET /identity/v3/users/b3ec9da88a2046b1be748ef5f2f2fba6/credentials/OS-EC2/2526d138192d47abb122638bbdda7f99 => generated 148 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:19:06.896470 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099dcde1-acf4-4a00-a51e-4c9380eaf203 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:06.905165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e34a1-72b3-4d97-9594-7caacc348d00 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3ec9da88a2046b1be748ef5f2f2fba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b117f6b674c402698c6af5eb229c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:06.907215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e34a1-72b3-4d97-9594-7caacc348d00 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:06.907572 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e34a1-72b3-4d97-9594-7caacc348d00 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:06.907922 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e34a1-72b3-4d97-9594-7caacc348d00 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] PATH_INFO: `/v3/users/b3ec9da88a2046b1be748ef5f2f2fba6/credentials/OS-EC2` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:06.908896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e34a1-72b3-4d97-9594-7caacc348d00 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=b3ec9da88a2046b1be748ef5f2f2fba6)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:06.913379 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e34a1-72b3-4d97-9594-7caacc348d00 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:06.964943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817b8c5-958e-4637-9c3e-f57c96bf3bf1 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:06.965498 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2232/4471] 10.222.0.30 () {60 vars in 1299 bytes} [Sun Sep 4 01:19:06 2022] POST /identity/v3/users/b3ec9da88a2046b1be748ef5f2f2fba6/credentials/OS-EC2 => generated 367 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:19:06.978079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817b8c5-958e-4637-9c3e-f57c96bf3bf1 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:07.005221 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e4c1f3-4145-42fd-a2a6-38ac491ddc5e tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3ec9da88a2046b1be748ef5f2f2fba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b117f6b674c402698c6af5eb229c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:07.008531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4c1f3-4145-42fd-a2a6-38ac491ddc5e tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:07.009652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4c1f3-4145-42fd-a2a6-38ac491ddc5e tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:07.009942 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4c1f3-4145-42fd-a2a6-38ac491ddc5e tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] PATH_INFO: `/v3/users/b3ec9da88a2046b1be748ef5f2f2fba6/credentials/OS-EC2` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:07.027161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e4c1f3-4145-42fd-a2a6-38ac491ddc5e tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=b3ec9da88a2046b1be748ef5f2f2fba6)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:07.029359 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e4c1f3-4145-42fd-a2a6-38ac491ddc5e tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:07.067642 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2240/4472] 10.222.0.30 () {60 vars in 1299 bytes} [Sun Sep 4 01:19:06 2022] POST /identity/v3/users/b3ec9da88a2046b1be748ef5f2f2fba6/credentials/OS-EC2 => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:19:07.072065 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e34a1-72b3-4d97-9594-7caacc348d00 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:07.090475 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e34a1-72b3-4d97-9594-7caacc348d00 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:07.099369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81038313-e945-436c-ae8b-71c7a7f0c6c3 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3ec9da88a2046b1be748ef5f2f2fba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b117f6b674c402698c6af5eb229c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:07.100040 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81038313-e945-436c-ae8b-71c7a7f0c6c3 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:07.101997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81038313-e945-436c-ae8b-71c7a7f0c6c3 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:07.102260 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81038313-e945-436c-ae8b-71c7a7f0c6c3 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] PATH_INFO: `/v3/users/b3ec9da88a2046b1be748ef5f2f2fba6/credentials/OS-EC2` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:07.103603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81038313-e945-436c-ae8b-71c7a7f0c6c3 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=b3ec9da88a2046b1be748ef5f2f2fba6)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:07.105260 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81038313-e945-436c-ae8b-71c7a7f0c6c3 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:07.144674 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2233/4473] 10.222.0.30 () {58 vars in 1278 bytes} [Sun Sep 4 01:19:07 2022] GET /identity/v3/users/b3ec9da88a2046b1be748ef5f2f2fba6/credentials/OS-EC2 => generated 865 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:19:07.149179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e4c1f3-4145-42fd-a2a6-38ac491ddc5e tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:07.169893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e4c1f3-4145-42fd-a2a6-38ac491ddc5e tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:07.189993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3254db-82a9-4cb6-80a2-cbe4256c3793 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3ec9da88a2046b1be748ef5f2f2fba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b117f6b674c402698c6af5eb229c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:07.191612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3254db-82a9-4cb6-80a2-cbe4256c3793 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:07.194375 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3254db-82a9-4cb6-80a2-cbe4256c3793 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:07.195969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3254db-82a9-4cb6-80a2-cbe4256c3793 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] PATH_INFO: `/v3/users/b3ec9da88a2046b1be748ef5f2f2fba6/credentials/OS-EC2/6cb4de16181d495fb76b8a9b81b4a253` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:07.206802 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3254db-82a9-4cb6-80a2-cbe4256c3793 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=b3ec9da88a2046b1be748ef5f2f2fba6, credential_id=6cb4de16181d495fb76b8a9b81b4a253)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:07.218092 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3254db-82a9-4cb6-80a2-cbe4256c3793 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:07.291157 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2241/4474] 10.222.0.30 () {58 vars in 1380 bytes} [Sun Sep 4 01:19:07 2022] DELETE /identity/v3/users/b3ec9da88a2046b1be748ef5f2f2fba6/credentials/OS-EC2/6cb4de16181d495fb76b8a9b81b4a253 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:19:07.297097 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81038313-e945-436c-ae8b-71c7a7f0c6c3 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:07.311238 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81038313-e945-436c-ae8b-71c7a7f0c6c3 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:07.317843 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24951241-5e12-4fb3-8a33-6bdb8ae6341f tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3ec9da88a2046b1be748ef5f2f2fba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b117f6b674c402698c6af5eb229c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:07.319174 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24951241-5e12-4fb3-8a33-6bdb8ae6341f tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:07.320060 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24951241-5e12-4fb3-8a33-6bdb8ae6341f tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:07.320784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24951241-5e12-4fb3-8a33-6bdb8ae6341f tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] PATH_INFO: `/v3/users/b3ec9da88a2046b1be748ef5f2f2fba6/credentials/OS-EC2/f3b6cd2d597c4d2aa706616cc0bb57df` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:07.324328 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24951241-5e12-4fb3-8a33-6bdb8ae6341f tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=b3ec9da88a2046b1be748ef5f2f2fba6, credential_id=f3b6cd2d597c4d2aa706616cc0bb57df)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:07.327506 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24951241-5e12-4fb3-8a33-6bdb8ae6341f tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:07.354046 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2234/4475] 10.222.0.30 () {58 vars in 1380 bytes} [Sun Sep 4 01:19:07 2022] DELETE /identity/v3/users/b3ec9da88a2046b1be748ef5f2f2fba6/credentials/OS-EC2/f3b6cd2d597c4d2aa706616cc0bb57df => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:07.360761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3254db-82a9-4cb6-80a2-cbe4256c3793 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:07.381916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3254db-82a9-4cb6-80a2-cbe4256c3793 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:07.390080 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee5819-2d9a-43ec-b181-cfa485f60d0b tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3ec9da88a2046b1be748ef5f2f2fba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b117f6b674c402698c6af5eb229c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:07.391740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee5819-2d9a-43ec-b181-cfa485f60d0b tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:07.392500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee5819-2d9a-43ec-b181-cfa485f60d0b tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:07.393088 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee5819-2d9a-43ec-b181-cfa485f60d0b tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] PATH_INFO: `/v3/users/b3ec9da88a2046b1be748ef5f2f2fba6/credentials/OS-EC2` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:07.394206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee5819-2d9a-43ec-b181-cfa485f60d0b tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=b3ec9da88a2046b1be748ef5f2f2fba6)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:07.396371 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee5819-2d9a-43ec-b181-cfa485f60d0b tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:07.430311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24951241-5e12-4fb3-8a33-6bdb8ae6341f tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:07.443408 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2242/4476] 10.222.0.30 () {60 vars in 1299 bytes} [Sun Sep 4 01:19:07 2022] POST /identity/v3/users/b3ec9da88a2046b1be748ef5f2f2fba6/credentials/OS-EC2 => generated 367 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:19:07.446894 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24951241-5e12-4fb3-8a33-6bdb8ae6341f tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:07.459941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b1d22-b752-42af-902c-4c12dfc13af9 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3ec9da88a2046b1be748ef5f2f2fba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b117f6b674c402698c6af5eb229c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:07.461711 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b1d22-b752-42af-902c-4c12dfc13af9 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:07.462882 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b1d22-b752-42af-902c-4c12dfc13af9 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:07.463558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b1d22-b752-42af-902c-4c12dfc13af9 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] PATH_INFO: `/v3/users/b3ec9da88a2046b1be748ef5f2f2fba6/credentials/OS-EC2/15736ec053c94839b4352407f8e30ef4` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:07.466550 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b1d22-b752-42af-902c-4c12dfc13af9 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=b3ec9da88a2046b1be748ef5f2f2fba6, credential_id=15736ec053c94839b4352407f8e30ef4)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:07.469125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b1d22-b752-42af-902c-4c12dfc13af9 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:07.481581 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2235/4477] 10.222.0.30 () {58 vars in 1377 bytes} [Sun Sep 4 01:19:07 2022] GET /identity/v3/users/b3ec9da88a2046b1be748ef5f2f2fba6/credentials/OS-EC2/15736ec053c94839b4352407f8e30ef4 => generated 367 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:19:07.483899 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee5819-2d9a-43ec-b181-cfa485f60d0b tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:07.496730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee5819-2d9a-43ec-b181-cfa485f60d0b tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:07.504100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cb671-f195-4739-8b1d-648419947105 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3ec9da88a2046b1be748ef5f2f2fba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b117f6b674c402698c6af5eb229c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:07.505318 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cb671-f195-4739-8b1d-648419947105 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:07.506571 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cb671-f195-4739-8b1d-648419947105 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:07.507063 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cb671-f195-4739-8b1d-648419947105 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] PATH_INFO: `/v3/users/b3ec9da88a2046b1be748ef5f2f2fba6/credentials/OS-EC2/15736ec053c94839b4352407f8e30ef4` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:07.512272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76cb671-f195-4739-8b1d-648419947105 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=b3ec9da88a2046b1be748ef5f2f2fba6, credential_id=15736ec053c94839b4352407f8e30ef4)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:07.515266 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76cb671-f195-4739-8b1d-648419947105 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:07.540113 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2243/4478] 10.222.0.30 () {58 vars in 1380 bytes} [Sun Sep 4 01:19:07 2022] DELETE /identity/v3/users/b3ec9da88a2046b1be748ef5f2f2fba6/credentials/OS-EC2/15736ec053c94839b4352407f8e30ef4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:07.547938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b1d22-b752-42af-902c-4c12dfc13af9 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:07.663795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b1d22-b752-42af-902c-4c12dfc13af9 tempest-EC2CredentialsTest-252413245 tempest-EC2CredentialsTest-252413245-project] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:07.672573 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1f34f-d21e-462d-a21c-82c769835d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:07.673427 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1f34f-d21e-462d-a21c-82c769835d75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:07.673874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1f34f-d21e-462d-a21c-82c769835d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:07.674282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1f34f-d21e-462d-a21c-82c769835d75 admin admin] PATH_INFO: `/v3/users/b3ec9da88a2046b1be748ef5f2f2fba6` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:07.677236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c1f34f-d21e-462d-a21c-82c769835d75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3ec9da88a2046b1be748ef5f2f2fba6)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:07.679673 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c1f34f-d21e-462d-a21c-82c769835d75 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:07.771828 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:07.790768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-06c1f34f-d21e-462d-a21c-82c769835d75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3ec9da88a2046b1be748ef5f2f2fba6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:07.793898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-06c1f34f-d21e-462d-a21c-82c769835d75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3ec9da88a2046b1be748ef5f2f2fba6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:07.821561 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-06c1f34f-d21e-462d-a21c-82c769835d75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3ec9da88a2046b1be748ef5f2f2fba6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:07.847521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-06c1f34f-d21e-462d-a21c-82c769835d75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3ec9da88a2046b1be748ef5f2f2fba6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:07.848470 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-06c1f34f-d21e-462d-a21c-82c769835d75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3ec9da88a2046b1be748ef5f2f2fba6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:07.905872 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2236/4479] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:19:07 2022] DELETE /identity/v3/users/b3ec9da88a2046b1be748ef5f2f2fba6 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:07.908875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24005149-3901-41cc-a3ef-32705e4d0b06 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:07.909165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24005149-3901-41cc-a3ef-32705e4d0b06 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:07.909627 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24005149-3901-41cc-a3ef-32705e4d0b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:07.948986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-24005149-3901-41cc-a3ef-32705e4d0b06 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:07.956054 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-24005149-3901-41cc-a3ef-32705e4d0b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:08.244939 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2244/4480] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:19:08.260024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1f34f-d21e-462d-a21c-82c769835d75 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:08.261768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-06c1f34f-d21e-462d-a21c-82c769835d75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:08.429874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1f34f-d21e-462d-a21c-82c769835d75 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:08.447376 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfe23f-f15e-4fad-bd38-8fdcbe872bcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:08.448152 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfe23f-f15e-4fad-bd38-8fdcbe872bcf service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:08.448429 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfe23f-f15e-4fad-bd38-8fdcbe872bcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:08.448727 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfe23f-f15e-4fad-bd38-8fdcbe872bcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:08.470703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cfe23f-f15e-4fad-bd38-8fdcbe872bcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:08.472159 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cfe23f-f15e-4fad-bd38-8fdcbe872bcf service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:08.489866 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2237/4481] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:19:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:19:10.578554 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24005149-3901-41cc-a3ef-32705e4d0b06 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:10.581860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-24005149-3901-41cc-a3ef-32705e4d0b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:10.621572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24005149-3901-41cc-a3ef-32705e4d0b06 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:10.632613 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df4e80-5a98-47b1-9b27-f75b47fb7fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:10.633277 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df4e80-5a98-47b1-9b27-f75b47fb7fbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:10.633594 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df4e80-5a98-47b1-9b27-f75b47fb7fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:10.642609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df4e80-5a98-47b1-9b27-f75b47fb7fbe admin admin] PATH_INFO: `/v3/projects/4b117f6b674c402698c6af5eb229c553` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:10.651065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df4e80-5a98-47b1-9b27-f75b47fb7fbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b117f6b674c402698c6af5eb229c553)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:10.660314 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df4e80-5a98-47b1-9b27-f75b47fb7fbe admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:10.742128 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:10.796876 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-34df4e80-5a98-47b1-9b27-f75b47fb7fbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b117f6b674c402698c6af5eb229c553', 'request_id': 'req-34df4e80-5a98-47b1-9b27-f75b47fb7fbe'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:10.819124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-34df4e80-5a98-47b1-9b27-f75b47fb7fbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b117f6b674c402698c6af5eb229c553', 'request_id': 'req-34df4e80-5a98-47b1-9b27-f75b47fb7fbe'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:10.834597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-34df4e80-5a98-47b1-9b27-f75b47fb7fbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b117f6b674c402698c6af5eb229c553', 'request_id': 'req-34df4e80-5a98-47b1-9b27-f75b47fb7fbe'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:10.866319 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-34df4e80-5a98-47b1-9b27-f75b47fb7fbe admin admin] The token cache is being invalidate because project 4b117f6b674c402698c6af5eb229c553 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:19:10.866835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-34df4e80-5a98-47b1-9b27-f75b47fb7fbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:10.867580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-34df4e80-5a98-47b1-9b27-f75b47fb7fbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:10.873833 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2245/4482] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:19:10 2022] DELETE /identity/v3/projects/4b117f6b674c402698c6af5eb229c553 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:10.875738 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a4a66-c583-4e99-900b-23dad70f2b06 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:10.876185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a4a66-c583-4e99-900b-23dad70f2b06 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:10.876630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a4a66-c583-4e99-900b-23dad70f2b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:10.935916 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-0d9a4a66-c583-4e99-900b-23dad70f2b06 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:10.937527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0d9a4a66-c583-4e99-900b-23dad70f2b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:11.137892 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2238/4483] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:19:11.142848 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a30a7c-430b-442b-94a1-f97e615e11e8 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:11.143347 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a30a7c-430b-442b-94a1-f97e615e11e8 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:11.143786 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a30a7c-430b-442b-94a1-f97e615e11e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:11.191581 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-80a30a7c-430b-442b-94a1-f97e615e11e8 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:11.194515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-80a30a7c-430b-442b-94a1-f97e615e11e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:11.218310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a4a66-c583-4e99-900b-23dad70f2b06 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:11.218551 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2246/4484] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:19:11.229755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a4a66-c583-4e99-900b-23dad70f2b06 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:11.236636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f0633-e545-4a71-8324-a604a63d8607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:11.237272 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f0633-e545-4a71-8324-a604a63d8607 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:11.237636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f0633-e545-4a71-8324-a604a63d8607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:11.237918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f0633-e545-4a71-8324-a604a63d8607 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:11.239080 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f0633-e545-4a71-8324-a604a63d8607 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:19:11.254185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f0633-e545-4a71-8324-a604a63d8607 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:11.256289 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f0633-e545-4a71-8324-a604a63d8607 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:11.286126 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2239/4485] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:19:11.289570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a30a7c-430b-442b-94a1-f97e615e11e8 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:11.315318 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a30a7c-430b-442b-94a1-f97e615e11e8 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:11.334253 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dfb782-2913-4868-871e-14f573784726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:11.337253 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfb782-2913-4868-871e-14f573784726 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:11.337719 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfb782-2913-4868-871e-14f573784726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:11.338541 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfb782-2913-4868-871e-14f573784726 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:11.341418 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dfb782-2913-4868-871e-14f573784726 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:11.349652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dfb782-2913-4868-871e-14f573784726 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:11.398568 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2247/4486] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:19:11 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:19:11.402458 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f0633-e545-4a71-8324-a604a63d8607 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:11.422471 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f0633-e545-4a71-8324-a604a63d8607 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:11.523163 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:11.571399 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b3d5b-c850-4b9a-9888-f7c16ec4c286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:11.572383 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b3d5b-c850-4b9a-9888-f7c16ec4c286 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:11.573804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b3d5b-c850-4b9a-9888-f7c16ec4c286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:11.574870 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b3d5b-c850-4b9a-9888-f7c16ec4c286 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:11.576308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b3d5b-c850-4b9a-9888-f7c16ec4c286 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:11.578622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b3d5b-c850-4b9a-9888-f7c16ec4c286 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:11.620527 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2240/4487] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:19:11 2022] POST /identity/v3/users => generated 300 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:19:11.624277 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dfb782-2913-4868-871e-14f573784726 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:11.655145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dfb782-2913-4868-871e-14f573784726 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:11.722663 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20d56e-398c-4f85-9dd5-be08d7062277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:11.724404 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20d56e-398c-4f85-9dd5-be08d7062277 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:11.724999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20d56e-398c-4f85-9dd5-be08d7062277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:11.726957 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20d56e-398c-4f85-9dd5-be08d7062277 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:11.728867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20d56e-398c-4f85-9dd5-be08d7062277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:11.737161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20d56e-398c-4f85-9dd5-be08d7062277 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:11.756982 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2248/4488] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:19:11.761497 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b3d5b-c850-4b9a-9888-f7c16ec4c286 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:11.796343 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b3d5b-c850-4b9a-9888-f7c16ec4c286 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:11.804490 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84af01-b7a7-4ead-9206-40029bc4b30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:11.805319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84af01-b7a7-4ead-9206-40029bc4b30b admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:11.805749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84af01-b7a7-4ead-9206-40029bc4b30b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:11.806299 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84af01-b7a7-4ead-9206-40029bc4b30b admin admin] PATH_INFO: `/v3/projects/4f0c695ae6f2410c905f09d12b896f17/users/98f0571a81894af48a71f3d92936a676/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:11.840845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84af01-b7a7-4ead-9206-40029bc4b30b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f0c695ae6f2410c905f09d12b896f17, user_id=98f0571a81894af48a71f3d92936a676, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:11.845167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84af01-b7a7-4ead-9206-40029bc4b30b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:11.881679 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2241/4489] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:19:11 2022] PUT /identity/v3/projects/4f0c695ae6f2410c905f09d12b896f17/users/98f0571a81894af48a71f3d92936a676/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:11.886337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20d56e-398c-4f85-9dd5-be08d7062277 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:11.900479 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20d56e-398c-4f85-9dd5-be08d7062277 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:12.028174 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88755ef-151d-465c-85de-4ddc11d8116c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:12.032579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88755ef-151d-465c-85de-4ddc11d8116c admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:12.032996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88755ef-151d-465c-85de-4ddc11d8116c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:12.033414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88755ef-151d-465c-85de-4ddc11d8116c admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:12.035702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88755ef-151d-465c-85de-4ddc11d8116c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:12.042691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88755ef-151d-465c-85de-4ddc11d8116c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:12.065248 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2249/4490] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:19:12.067360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84af01-b7a7-4ead-9206-40029bc4b30b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:12.085846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84af01-b7a7-4ead-9206-40029bc4b30b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:12.100281 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bdc5f7-6a65-48c2-b28b-2d2ed2c35229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:12.101196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdc5f7-6a65-48c2-b28b-2d2ed2c35229 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:12.101613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdc5f7-6a65-48c2-b28b-2d2ed2c35229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:12.102123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdc5f7-6a65-48c2-b28b-2d2ed2c35229 admin admin] PATH_INFO: `/v3/projects/4f0c695ae6f2410c905f09d12b896f17/users/98f0571a81894af48a71f3d92936a676/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:12.114486 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bdc5f7-6a65-48c2-b28b-2d2ed2c35229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f0c695ae6f2410c905f09d12b896f17, user_id=98f0571a81894af48a71f3d92936a676, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:12.124058 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bdc5f7-6a65-48c2-b28b-2d2ed2c35229 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:12.163107 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2242/4491] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:19:12 2022] PUT /identity/v3/projects/4f0c695ae6f2410c905f09d12b896f17/users/98f0571a81894af48a71f3d92936a676/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:12.173473 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e16ff-4b6f-406d-a1bc-841c047b1e40 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:12.175231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e16ff-4b6f-406d-a1bc-841c047b1e40 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:12.175976 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e16ff-4b6f-406d-a1bc-841c047b1e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:12.273637 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ae3e16ff-4b6f-406d-a1bc-841c047b1e40 None None] MFA Rules not processed for user `98f0571a81894af48a71f3d92936a676`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:12.275020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ae3e16ff-4b6f-406d-a1bc-841c047b1e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:12.477329 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:12.500519 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2250/4492] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:12 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:19:12.501614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bdc5f7-6a65-48c2-b28b-2d2ed2c35229 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:12.723579 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bdc5f7-6a65-48c2-b28b-2d2ed2c35229 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:12.734487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735caa99-bedf-455f-adc7-7ae01a8bf463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:12.735115 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735caa99-bedf-455f-adc7-7ae01a8bf463 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:12.735392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735caa99-bedf-455f-adc7-7ae01a8bf463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:12.735664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735caa99-bedf-455f-adc7-7ae01a8bf463 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:12.737748 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735caa99-bedf-455f-adc7-7ae01a8bf463 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:12.740679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735caa99-bedf-455f-adc7-7ae01a8bf463 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:12.841208 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2243/4493] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:19:12 2022] POST /identity/v3/projects => generated 387 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:19:12.849476 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e16ff-4b6f-406d-a1bc-841c047b1e40 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:12.861674 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e16ff-4b6f-406d-a1bc-841c047b1e40 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:13.051317 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a0312-1d96-4d30-9cc4-043a37eaca14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:13.051951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a0312-1d96-4d30-9cc4-043a37eaca14 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:13.052230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a0312-1d96-4d30-9cc4-043a37eaca14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:13.052577 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a0312-1d96-4d30-9cc4-043a37eaca14 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:13.053313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a0312-1d96-4d30-9cc4-043a37eaca14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:13.067795 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a0312-1d96-4d30-9cc4-043a37eaca14 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:13.132494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735caa99-bedf-455f-adc7-7ae01a8bf463 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:13.138690 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2251/4494] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:19:12 2022] POST /identity/v3/users => generated 294 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:19:13.152665 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735caa99-bedf-455f-adc7-7ae01a8bf463 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:13.162304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc037a1-8677-4a0c-9cb6-1df36daaea8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:13.163244 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc037a1-8677-4a0c-9cb6-1df36daaea8d admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:13.163676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc037a1-8677-4a0c-9cb6-1df36daaea8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:13.164096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc037a1-8677-4a0c-9cb6-1df36daaea8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:13.164929 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc037a1-8677-4a0c-9cb6-1df36daaea8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:13.166647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc037a1-8677-4a0c-9cb6-1df36daaea8d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:13.188742 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2244/4495] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:19:13.193804 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a0312-1d96-4d30-9cc4-043a37eaca14 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:13.210471 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a0312-1d96-4d30-9cc4-043a37eaca14 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:13.219817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08558c-65a9-40d5-9fa2-2c611772fd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:13.220450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08558c-65a9-40d5-9fa2-2c611772fd05 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:13.220736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08558c-65a9-40d5-9fa2-2c611772fd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:13.221011 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08558c-65a9-40d5-9fa2-2c611772fd05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:13.221679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da08558c-65a9-40d5-9fa2-2c611772fd05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:13.223293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da08558c-65a9-40d5-9fa2-2c611772fd05 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:13.272215 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2252/4496] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:19:13.275261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc037a1-8677-4a0c-9cb6-1df36daaea8d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:13.299735 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc037a1-8677-4a0c-9cb6-1df36daaea8d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:13.319494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611b98a-d997-48cb-b2c5-bde8b1da9f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:13.320467 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611b98a-d997-48cb-b2c5-bde8b1da9f43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:13.320908 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611b98a-d997-48cb-b2c5-bde8b1da9f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:13.321350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611b98a-d997-48cb-b2c5-bde8b1da9f43 admin admin] PATH_INFO: `/v3/projects/cb09a78c52ac48b3a28ccd85705350a0/users/dcd9fcb618b24dd98b2de4f4529f6776/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:13.378141 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611b98a-d997-48cb-b2c5-bde8b1da9f43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb09a78c52ac48b3a28ccd85705350a0, user_id=dcd9fcb618b24dd98b2de4f4529f6776, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:13.381517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611b98a-d997-48cb-b2c5-bde8b1da9f43 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:13.423063 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2245/4497] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:19:13 2022] PUT /identity/v3/projects/cb09a78c52ac48b3a28ccd85705350a0/users/dcd9fcb618b24dd98b2de4f4529f6776/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:13.434920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d98d80-bd10-4b4e-abec-9212e14c6e01 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:13.435590 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d98d80-bd10-4b4e-abec-9212e14c6e01 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:13.435974 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d98d80-bd10-4b4e-abec-9212e14c6e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:13.542811 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c9d98d80-bd10-4b4e-abec-9212e14c6e01 None None] MFA Rules not processed for user `dcd9fcb618b24dd98b2de4f4529f6776`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:13.544224 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c9d98d80-bd10-4b4e-abec-9212e14c6e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:13.713998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611b98a-d997-48cb-b2c5-bde8b1da9f43 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:13.716569 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b611b98a-d997-48cb-b2c5-bde8b1da9f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:13.731303 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2253/4498] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:19:13.777118 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d98d80-bd10-4b4e-abec-9212e14c6e01 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:13.779457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c9d98d80-bd10-4b4e-abec-9212e14c6e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:13.906058 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:13.959532 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611b98a-d997-48cb-b2c5-bde8b1da9f43 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:13.973115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d98d80-bd10-4b4e-abec-9212e14c6e01 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:13.978582 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2796e8-d5a6-4204-9b49-f850862c233d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:13.979373 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2796e8-d5a6-4204-9b49-f850862c233d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:13.979771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2796e8-d5a6-4204-9b49-f850862c233d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:13.980516 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2796e8-d5a6-4204-9b49-f850862c233d admin admin] PATH_INFO: `/v3/users/2343ac40e81c4cda8ac38f66fd16b99c` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:13.985048 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d7777-34f1-4f36-853f-d312006ef8ef service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efcee9b21ea94b1b8e5c9c5acb35839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:13.985253 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2796e8-d5a6-4204-9b49-f850862c233d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2343ac40e81c4cda8ac38f66fd16b99c)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:13.985979 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d7777-34f1-4f36-853f-d312006ef8ef service glance] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:13.988648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2796e8-d5a6-4204-9b49-f850862c233d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:13.989176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d7777-34f1-4f36-853f-d312006ef8ef service glance] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:13.991583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d7777-34f1-4f36-853f-d312006ef8ef service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:14.045824 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:14.135390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6f2796e8-d5a6-4204-9b49-f850862c233d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2343ac40e81c4cda8ac38f66fd16b99c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:14.137666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6f2796e8-d5a6-4204-9b49-f850862c233d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2343ac40e81c4cda8ac38f66fd16b99c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:14.165371 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6f2796e8-d5a6-4204-9b49-f850862c233d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2343ac40e81c4cda8ac38f66fd16b99c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:14.194031 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6f2796e8-d5a6-4204-9b49-f850862c233d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2343ac40e81c4cda8ac38f66fd16b99c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:14.194788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6f2796e8-d5a6-4204-9b49-f850862c233d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2343ac40e81c4cda8ac38f66fd16b99c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:14.209362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89d7777-34f1-4f36-853f-d312006ef8ef service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:14.213990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89d7777-34f1-4f36-853f-d312006ef8ef service glance] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:14.250518 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2246/4499] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:19:13 2022] DELETE /identity/v3/users/2343ac40e81c4cda8ac38f66fd16b99c => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:14.261141 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2254/4500] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:19:13 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:19:15.018688 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2796e8-d5a6-4204-9b49-f850862c233d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:15.020896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6f2796e8-d5a6-4204-9b49-f850862c233d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:15.229518 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2796e8-d5a6-4204-9b49-f850862c233d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:15.235022 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182026cd-7d2c-42ec-a106-d0e3e94848d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:15.236045 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182026cd-7d2c-42ec-a106-d0e3e94848d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:15.236485 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182026cd-7d2c-42ec-a106-d0e3e94848d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:15.236922 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182026cd-7d2c-42ec-a106-d0e3e94848d7 admin admin] PATH_INFO: `/v3/users/98f0571a81894af48a71f3d92936a676` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:15.238709 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182026cd-7d2c-42ec-a106-d0e3e94848d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98f0571a81894af48a71f3d92936a676)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:15.244975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182026cd-7d2c-42ec-a106-d0e3e94848d7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:15.362473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-182026cd-7d2c-42ec-a106-d0e3e94848d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98f0571a81894af48a71f3d92936a676'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:15.363040 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-182026cd-7d2c-42ec-a106-d0e3e94848d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98f0571a81894af48a71f3d92936a676'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:15.375154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-182026cd-7d2c-42ec-a106-d0e3e94848d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98f0571a81894af48a71f3d92936a676'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:15.400009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-182026cd-7d2c-42ec-a106-d0e3e94848d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98f0571a81894af48a71f3d92936a676'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:15.400622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-182026cd-7d2c-42ec-a106-d0e3e94848d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98f0571a81894af48a71f3d92936a676'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:15.417102 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:15.448644 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2247/4501] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:19:15 2022] DELETE /identity/v3/users/98f0571a81894af48a71f3d92936a676 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:15.453734 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6972c-459e-422c-93bf-0eaf9dff53b9 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:15.454212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6972c-459e-422c-93bf-0eaf9dff53b9 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:15.454313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6972c-459e-422c-93bf-0eaf9dff53b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:15.524780 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-b7f6972c-459e-422c-93bf-0eaf9dff53b9 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:15.530597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b7f6972c-459e-422c-93bf-0eaf9dff53b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:15.836503 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2255/4502] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:19:15.944678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182026cd-7d2c-42ec-a106-d0e3e94848d7 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:15.947041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-182026cd-7d2c-42ec-a106-d0e3e94848d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:16.196362 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182026cd-7d2c-42ec-a106-d0e3e94848d7 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:16.209667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265c16f-3bc2-4876-80f8-e9fc74214b94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:16.211505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265c16f-3bc2-4876-80f8-e9fc74214b94 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:16.211951 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265c16f-3bc2-4876-80f8-e9fc74214b94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:16.215444 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265c16f-3bc2-4876-80f8-e9fc74214b94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:16.258619 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265c16f-3bc2-4876-80f8-e9fc74214b94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:16.267143 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265c16f-3bc2-4876-80f8-e9fc74214b94 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:16.299372 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2248/4503] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:19:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:19:16.299564 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6972c-459e-422c-93bf-0eaf9dff53b9 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:16.301160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b7f6972c-459e-422c-93bf-0eaf9dff53b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:16.334122 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6972c-459e-422c-93bf-0eaf9dff53b9 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:16.345670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc31996-4a38-48b1-8735-57790f298d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:16.346332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc31996-4a38-48b1-8735-57790f298d27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:16.346627 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc31996-4a38-48b1-8735-57790f298d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:16.346883 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc31996-4a38-48b1-8735-57790f298d27 admin admin] PATH_INFO: `/v3/projects/ebe2a571e67b4b139db648e294d78896` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:16.348317 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc31996-4a38-48b1-8735-57790f298d27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebe2a571e67b4b139db648e294d78896)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:16.358102 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc31996-4a38-48b1-8735-57790f298d27 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:16.520398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ddc31996-4a38-48b1-8735-57790f298d27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebe2a571e67b4b139db648e294d78896', 'request_id': 'req-ddc31996-4a38-48b1-8735-57790f298d27'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:16.558514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ddc31996-4a38-48b1-8735-57790f298d27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebe2a571e67b4b139db648e294d78896', 'request_id': 'req-ddc31996-4a38-48b1-8735-57790f298d27'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:16.568400 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ddc31996-4a38-48b1-8735-57790f298d27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebe2a571e67b4b139db648e294d78896', 'request_id': 'req-ddc31996-4a38-48b1-8735-57790f298d27'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:16.613419 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ddc31996-4a38-48b1-8735-57790f298d27 admin admin] The token cache is being invalidate because project ebe2a571e67b4b139db648e294d78896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:19:16.618225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ddc31996-4a38-48b1-8735-57790f298d27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:16.627434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ddc31996-4a38-48b1-8735-57790f298d27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:16.633481 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2256/4504] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:19:16 2022] DELETE /identity/v3/projects/ebe2a571e67b4b139db648e294d78896 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:16.636623 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8fad0-0c14-490b-8d76-4ae8378afce4 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:16.637252 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8fad0-0c14-490b-8d76-4ae8378afce4 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:16.638639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8fad0-0c14-490b-8d76-4ae8378afce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:16.691395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-dbe8fad0-0c14-490b-8d76-4ae8378afce4 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:16.691395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-dbe8fad0-0c14-490b-8d76-4ae8378afce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:16.745546 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9cfb3-95e2-46b4-871b-e82129c2754d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:16.745857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9cfb3-95e2-46b4-871b-e82129c2754d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:16.746262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9cfb3-95e2-46b4-871b-e82129c2754d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:16.835716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-14a9cfb3-95e2-46b4-871b-e82129c2754d None None] MFA Rules not processed for user `c5e369e011cd480baefb5823a833564a`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:16.838023 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-14a9cfb3-95e2-46b4-871b-e82129c2754d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:16.899698 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2249/4505] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:19:16.907720 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827976b-f961-4320-985d-400f7c5f2202 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:16.908010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827976b-f961-4320-985d-400f7c5f2202 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:16.908280 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827976b-f961-4320-985d-400f7c5f2202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:16.910359 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:16.952897 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-1827976b-f961-4320-985d-400f7c5f2202 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:16.954219 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1827976b-f961-4320-985d-400f7c5f2202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:16.968702 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2250/4506] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:19:16.969649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827976b-f961-4320-985d-400f7c5f2202 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:16.982328 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827976b-f961-4320-985d-400f7c5f2202 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:16.991587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dadc61-3a83-429d-a20e-b05c6a00aee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:16.992455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dadc61-3a83-429d-a20e-b05c6a00aee3 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:16.993267 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dadc61-3a83-429d-a20e-b05c6a00aee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:16.994219 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dadc61-3a83-429d-a20e-b05c6a00aee3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:16.994337 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dadc61-3a83-429d-a20e-b05c6a00aee3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:19:16.994724 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dadc61-3a83-429d-a20e-b05c6a00aee3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:16.998496 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dadc61-3a83-429d-a20e-b05c6a00aee3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:17.016358 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2251/4507] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:19:17.024128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dadc61-3a83-429d-a20e-b05c6a00aee3 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:17.039161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dadc61-3a83-429d-a20e-b05c6a00aee3 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:17.047648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a906f2-2949-47ab-ac36-2444a9644513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:17.048345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a906f2-2949-47ab-ac36-2444a9644513 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:17.048627 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a906f2-2949-47ab-ac36-2444a9644513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:17.048900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a906f2-2949-47ab-ac36-2444a9644513 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:17.049577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a906f2-2949-47ab-ac36-2444a9644513 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:17.051968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a906f2-2949-47ab-ac36-2444a9644513 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:17.079261 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2257/4508] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:19:17.092436 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6936b-9694-4cae-989d-0a435ef6a2e7 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:17.093858 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6936b-9694-4cae-989d-0a435ef6a2e7 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:17.095618 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6936b-9694-4cae-989d-0a435ef6a2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:17.121463 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2252/4509] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:19:17 2022] POST /identity/v3/projects => generated 397 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:19:17.123426 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a906f2-2949-47ab-ac36-2444a9644513 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:17.172054 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-3ca6936b-9694-4cae-989d-0a435ef6a2e7 None None] MFA Rules not processed for user `c5e369e011cd480baefb5823a833564a`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:17.177657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3ca6936b-9694-4cae-989d-0a435ef6a2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:17.274448 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:17.310695 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a906f2-2949-47ab-ac36-2444a9644513 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:17.321968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c2f23-48f7-4a75-aa6c-a78b8f4ea65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:17.323371 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c2f23-48f7-4a75-aa6c-a78b8f4ea65f admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:17.323668 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c2f23-48f7-4a75-aa6c-a78b8f4ea65f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:17.323948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c2f23-48f7-4a75-aa6c-a78b8f4ea65f admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:17.324602 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c2f23-48f7-4a75-aa6c-a78b8f4ea65f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:17.327838 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c2f23-48f7-4a75-aa6c-a78b8f4ea65f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:17.333133 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2258/4510] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:19:17.346394 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6936b-9694-4cae-989d-0a435ef6a2e7 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:17.347953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3ca6936b-9694-4cae-989d-0a435ef6a2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:17.409095 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2253/4511] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:19:17 2022] POST /identity/v3/users => generated 299 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:19:17.413228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c2f23-48f7-4a75-aa6c-a78b8f4ea65f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:17.453175 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c2f23-48f7-4a75-aa6c-a78b8f4ea65f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:17.474044 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea2951-b1a6-413f-ab0c-0603df112fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:17.475014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea2951-b1a6-413f-ab0c-0603df112fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:17.475441 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea2951-b1a6-413f-ab0c-0603df112fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:17.475882 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea2951-b1a6-413f-ab0c-0603df112fb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:17.476837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea2951-b1a6-413f-ab0c-0603df112fb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:17.480363 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea2951-b1a6-413f-ab0c-0603df112fb0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:17.485855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6936b-9694-4cae-989d-0a435ef6a2e7 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:17.506601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f42859f-e94d-4bdf-9e3a-3f15a086d793 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:17.510567 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42859f-e94d-4bdf-9e3a-3f15a086d793 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:17.510878 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42859f-e94d-4bdf-9e3a-3f15a086d793 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:17.513280 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42859f-e94d-4bdf-9e3a-3f15a086d793 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:17.523329 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2254/4512] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:19:17.525048 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea2951-b1a6-413f-ab0c-0603df112fb0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:17.540710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f42859f-e94d-4bdf-9e3a-3f15a086d793 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:17.542432 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f42859f-e94d-4bdf-9e3a-3f15a086d793 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:17.551399 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea2951-b1a6-413f-ab0c-0603df112fb0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:17.569846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b8fef-33c2-4674-b5d0-3359322ff2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:17.571011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b8fef-33c2-4674-b5d0-3359322ff2a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:17.571011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b8fef-33c2-4674-b5d0-3359322ff2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:17.571011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b8fef-33c2-4674-b5d0-3359322ff2a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:17.576445 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2259/4513] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:19:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:19:17.576903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b8fef-33c2-4674-b5d0-3359322ff2a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:17.580695 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b8fef-33c2-4674-b5d0-3359322ff2a0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:17.618863 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2255/4514] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:19:17.623545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f42859f-e94d-4bdf-9e3a-3f15a086d793 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:17.650337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f42859f-e94d-4bdf-9e3a-3f15a086d793 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:17.658006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d894f-72bf-4eed-992e-9458dd6be7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:17.658940 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d894f-72bf-4eed-992e-9458dd6be7e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:17.659790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d894f-72bf-4eed-992e-9458dd6be7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:17.659966 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d894f-72bf-4eed-992e-9458dd6be7e5 admin admin] PATH_INFO: `/v3/projects/3e227d1ec36042b89d797fb099a8d6fe/users/58c0074bfe4d476da60c210af6408203/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:17.683142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d894f-72bf-4eed-992e-9458dd6be7e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e227d1ec36042b89d797fb099a8d6fe, user_id=58c0074bfe4d476da60c210af6408203, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:17.686322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d894f-72bf-4eed-992e-9458dd6be7e5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:17.746128 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2260/4515] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:19:17 2022] PUT /identity/v3/projects/3e227d1ec36042b89d797fb099a8d6fe/users/58c0074bfe4d476da60c210af6408203/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:17.748002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871a5c7-0886-4612-8787-91898ca1225c None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:17.748502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871a5c7-0886-4612-8787-91898ca1225c None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:17.748967 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871a5c7-0886-4612-8787-91898ca1225c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:17.777345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-1871a5c7-0886-4612-8787-91898ca1225c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:17.779634 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1871a5c7-0886-4612-8787-91898ca1225c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:17.868458 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2256/4516] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:19:17.913757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d894f-72bf-4eed-992e-9458dd6be7e5 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:17.918084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d71d894f-72bf-4eed-992e-9458dd6be7e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:18.022311 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:18.060066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d894f-72bf-4eed-992e-9458dd6be7e5 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:18.064442 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed8615-2b1e-44dd-b561-9c1df5733a76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:18.066350 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed8615-2b1e-44dd-b561-9c1df5733a76 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:18.066650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed8615-2b1e-44dd-b561-9c1df5733a76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:18.074321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed8615-2b1e-44dd-b561-9c1df5733a76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:18.089185 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed8615-2b1e-44dd-b561-9c1df5733a76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:18.092700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed8615-2b1e-44dd-b561-9c1df5733a76 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:18.127145 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2261/4517] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:19:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:19:18.730161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871a5c7-0886-4612-8787-91898ca1225c None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:18.732756 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1871a5c7-0886-4612-8787-91898ca1225c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:18.773236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871a5c7-0886-4612-8787-91898ca1225c None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:18.799090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5bfda-a8f6-4125-a463-c45fed5cf1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:18.799760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5bfda-a8f6-4125-a463-c45fed5cf1e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:18.800042 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5bfda-a8f6-4125-a463-c45fed5cf1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:18.800314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5bfda-a8f6-4125-a463-c45fed5cf1e0 admin admin] PATH_INFO: `/v3/projects/4f0c695ae6f2410c905f09d12b896f17` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:18.804251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5bfda-a8f6-4125-a463-c45fed5cf1e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f0c695ae6f2410c905f09d12b896f17)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:18.806310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5bfda-a8f6-4125-a463-c45fed5cf1e0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:18.930640 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4cd5bfda-a8f6-4125-a463-c45fed5cf1e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f0c695ae6f2410c905f09d12b896f17', 'request_id': 'req-4cd5bfda-a8f6-4125-a463-c45fed5cf1e0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:18.960475 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4cd5bfda-a8f6-4125-a463-c45fed5cf1e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f0c695ae6f2410c905f09d12b896f17', 'request_id': 'req-4cd5bfda-a8f6-4125-a463-c45fed5cf1e0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:18.969620 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4cd5bfda-a8f6-4125-a463-c45fed5cf1e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f0c695ae6f2410c905f09d12b896f17', 'request_id': 'req-4cd5bfda-a8f6-4125-a463-c45fed5cf1e0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:19.007905 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4cd5bfda-a8f6-4125-a463-c45fed5cf1e0 admin admin] The token cache is being invalidate because project 4f0c695ae6f2410c905f09d12b896f17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:19:19.011113 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4cd5bfda-a8f6-4125-a463-c45fed5cf1e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:19.015989 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4cd5bfda-a8f6-4125-a463-c45fed5cf1e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:19.020697 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2257/4518] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:19:18 2022] DELETE /identity/v3/projects/4f0c695ae6f2410c905f09d12b896f17 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:19.022929 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed8615-2b1e-44dd-b561-9c1df5733a76 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:19.037558 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed8615-2b1e-44dd-b561-9c1df5733a76 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:19.212308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08b410-f91e-4eeb-b9e0-a542fb89310a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:19.212308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08b410-f91e-4eeb-b9e0-a542fb89310a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:19.212563 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08b410-f91e-4eeb-b9e0-a542fb89310a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:19.212819 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08b410-f91e-4eeb-b9e0-a542fb89310a admin admin] PATH_INFO: `/v3/users/dcd9fcb618b24dd98b2de4f4529f6776` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:19.219012 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08b410-f91e-4eeb-b9e0-a542fb89310a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcd9fcb618b24dd98b2de4f4529f6776)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:19.224619 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08b410-f91e-4eeb-b9e0-a542fb89310a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:19.335730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5c08b410-f91e-4eeb-b9e0-a542fb89310a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcd9fcb618b24dd98b2de4f4529f6776'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:19.336816 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5c08b410-f91e-4eeb-b9e0-a542fb89310a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcd9fcb618b24dd98b2de4f4529f6776'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:19.348474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5c08b410-f91e-4eeb-b9e0-a542fb89310a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcd9fcb618b24dd98b2de4f4529f6776'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:19.377537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5c08b410-f91e-4eeb-b9e0-a542fb89310a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcd9fcb618b24dd98b2de4f4529f6776'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:19.379052 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5c08b410-f91e-4eeb-b9e0-a542fb89310a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcd9fcb618b24dd98b2de4f4529f6776'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:19.415230 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2262/4519] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:19:19 2022] DELETE /identity/v3/users/dcd9fcb618b24dd98b2de4f4529f6776 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:20.815089 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5bfda-a8f6-4125-a463-c45fed5cf1e0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:20.816956 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4cd5bfda-a8f6-4125-a463-c45fed5cf1e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:20.851858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5bfda-a8f6-4125-a463-c45fed5cf1e0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:21.000525 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:21.062056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fbc91c-5810-495f-bceb-7adc92c8890d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:21.064130 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbc91c-5810-495f-bceb-7adc92c8890d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:21.065590 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbc91c-5810-495f-bceb-7adc92c8890d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:21.066114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbc91c-5810-495f-bceb-7adc92c8890d admin admin] PATH_INFO: `/v3/projects/cb09a78c52ac48b3a28ccd85705350a0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:21.068376 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fbc91c-5810-495f-bceb-7adc92c8890d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb09a78c52ac48b3a28ccd85705350a0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:21.071293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fbc91c-5810-495f-bceb-7adc92c8890d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:21.280015 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-83fbc91c-5810-495f-bceb-7adc92c8890d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb09a78c52ac48b3a28ccd85705350a0', 'request_id': 'req-83fbc91c-5810-495f-bceb-7adc92c8890d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:21.298866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-83fbc91c-5810-495f-bceb-7adc92c8890d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb09a78c52ac48b3a28ccd85705350a0', 'request_id': 'req-83fbc91c-5810-495f-bceb-7adc92c8890d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:21.312974 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-83fbc91c-5810-495f-bceb-7adc92c8890d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb09a78c52ac48b3a28ccd85705350a0', 'request_id': 'req-83fbc91c-5810-495f-bceb-7adc92c8890d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:21.364138 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-83fbc91c-5810-495f-bceb-7adc92c8890d admin admin] The token cache is being invalidate because project cb09a78c52ac48b3a28ccd85705350a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:19:21.364923 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-83fbc91c-5810-495f-bceb-7adc92c8890d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:21.374027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-83fbc91c-5810-495f-bceb-7adc92c8890d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:21.376352 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2258/4520] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:19:20 2022] DELETE /identity/v3/projects/cb09a78c52ac48b3a28ccd85705350a0 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:21.385139 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe7fe1-c34e-4acf-b43a-08a62d057198 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:21.385630 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe7fe1-c34e-4acf-b43a-08a62d057198 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:21.385730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe7fe1-c34e-4acf-b43a-08a62d057198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:21.462959 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-bebe7fe1-c34e-4acf-b43a-08a62d057198 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:21.476966 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-bebe7fe1-c34e-4acf-b43a-08a62d057198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:21.626208 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:21.665469 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2263/4521] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:19:21.666534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f83bca-dab0-4de0-8ff0-b63d5d025006 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:21.666822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f83bca-dab0-4de0-8ff0-b63d5d025006 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:21.667097 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f83bca-dab0-4de0-8ff0-b63d5d025006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:21.726762 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-00f83bca-dab0-4de0-8ff0-b63d5d025006 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:21.728009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-00f83bca-dab0-4de0-8ff0-b63d5d025006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:21.764934 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2259/4522] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:19:21.769964 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe7fe1-c34e-4acf-b43a-08a62d057198 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:21.789661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe7fe1-c34e-4acf-b43a-08a62d057198 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:21.815976 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8909104-b8c9-4623-9995-0da688becacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:21.816865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8909104-b8c9-4623-9995-0da688becacd admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:21.817325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8909104-b8c9-4623-9995-0da688becacd admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:21.818686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8909104-b8c9-4623-9995-0da688becacd admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:21.819806 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8909104-b8c9-4623-9995-0da688becacd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:19:21.820262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8909104-b8c9-4623-9995-0da688becacd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:21.823965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8909104-b8c9-4623-9995-0da688becacd admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:21.875305 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2264/4523] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:19:21.879485 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f83bca-dab0-4de0-8ff0-b63d5d025006 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:21.897459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f83bca-dab0-4de0-8ff0-b63d5d025006 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:21.917040 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb6239-461c-4394-bffb-13920a27bebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:21.919129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb6239-461c-4394-bffb-13920a27bebf admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:21.924743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb6239-461c-4394-bffb-13920a27bebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:21.925021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb6239-461c-4394-bffb-13920a27bebf admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:21.925944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb6239-461c-4394-bffb-13920a27bebf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:21.927695 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb6239-461c-4394-bffb-13920a27bebf admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:22.024330 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2260/4524] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:19:21 2022] POST /identity/v3/projects => generated 361 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:19:22.025669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8909104-b8c9-4623-9995-0da688becacd admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:22.047323 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8909104-b8c9-4623-9995-0da688becacd admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:22.317225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20479219-db71-456e-9f2a-b0d969e43a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:22.335053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20479219-db71-456e-9f2a-b0d969e43a30 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:22.338711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20479219-db71-456e-9f2a-b0d969e43a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:22.339042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20479219-db71-456e-9f2a-b0d969e43a30 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:22.346286 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20479219-db71-456e-9f2a-b0d969e43a30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:22.356112 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20479219-db71-456e-9f2a-b0d969e43a30 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:22.463281 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb6239-461c-4394-bffb-13920a27bebf admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:22.477585 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2265/4525] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:19:22 2022] POST /identity/v3/users => generated 281 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:19:22.515469 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb6239-461c-4394-bffb-13920a27bebf admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:22.535398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b328a09-215e-47c5-a853-7f8e62d5fa2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:22.543786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b328a09-215e-47c5-a853-7f8e62d5fa2d admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:22.546233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b328a09-215e-47c5-a853-7f8e62d5fa2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:22.546796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b328a09-215e-47c5-a853-7f8e62d5fa2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:22.547812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b328a09-215e-47c5-a853-7f8e62d5fa2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:22.578487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b328a09-215e-47c5-a853-7f8e62d5fa2d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:22.675287 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2261/4526] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:19:22.677306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20479219-db71-456e-9f2a-b0d969e43a30 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:22.703822 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20479219-db71-456e-9f2a-b0d969e43a30 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:22.731717 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28025a13-929f-40e9-b29d-3e8415250a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:22.736438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28025a13-929f-40e9-b29d-3e8415250a22 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:22.739556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28025a13-929f-40e9-b29d-3e8415250a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:22.740015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28025a13-929f-40e9-b29d-3e8415250a22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:22.741010 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28025a13-929f-40e9-b29d-3e8415250a22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:22.753352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28025a13-929f-40e9-b29d-3e8415250a22 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:22.771028 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2266/4527] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:19:22.774518 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b328a09-215e-47c5-a853-7f8e62d5fa2d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:22.799848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b328a09-215e-47c5-a853-7f8e62d5fa2d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:22.820053 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5e068-216b-4e0b-b35f-b5fa3f820f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:22.821767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5e068-216b-4e0b-b35f-b5fa3f820f92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:22.822212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5e068-216b-4e0b-b35f-b5fa3f820f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:22.822823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5e068-216b-4e0b-b35f-b5fa3f820f92 admin admin] PATH_INFO: `/v3/projects/33bfcf2e9eb946068cb559151c36509d/users/38970f9bc5444f629475bdc554d5645a/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:22.881688 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5e068-216b-4e0b-b35f-b5fa3f820f92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33bfcf2e9eb946068cb559151c36509d, user_id=38970f9bc5444f629475bdc554d5645a, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:22.886959 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5e068-216b-4e0b-b35f-b5fa3f820f92 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:22.934776 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2262/4528] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:19:22 2022] PUT /identity/v3/projects/33bfcf2e9eb946068cb559151c36509d/users/38970f9bc5444f629475bdc554d5645a/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:22.946510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0982de-7bd8-450e-a7e9-adbe23690d94 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:22.946797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0982de-7bd8-450e-a7e9-adbe23690d94 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:22.947067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0982de-7bd8-450e-a7e9-adbe23690d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:23.050559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-cc0982de-7bd8-450e-a7e9-adbe23690d94 None None] MFA Rules not processed for user `38970f9bc5444f629475bdc554d5645a`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:23.052077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-cc0982de-7bd8-450e-a7e9-adbe23690d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:23.282015 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2267/4529] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:19:23.295217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5e068-216b-4e0b-b35f-b5fa3f820f92 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:23.601123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5e068-216b-4e0b-b35f-b5fa3f820f92 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:23.619789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561776f5-7c4d-49de-b2f9-8542ec984eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:23.625689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561776f5-7c4d-49de-b2f9-8542ec984eac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:23.626280 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561776f5-7c4d-49de-b2f9-8542ec984eac admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:23.626772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561776f5-7c4d-49de-b2f9-8542ec984eac admin admin] PATH_INFO: `/v3/users/38970f9bc5444f629475bdc554d5645a` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:23.630974 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561776f5-7c4d-49de-b2f9-8542ec984eac admin admin] RBAC: Authorizing `identity:delete_user(user_id=38970f9bc5444f629475bdc554d5645a)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:23.643014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561776f5-7c4d-49de-b2f9-8542ec984eac admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:23.661992 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:23.767782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-561776f5-7c4d-49de-b2f9-8542ec984eac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38970f9bc5444f629475bdc554d5645a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:23.769119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-561776f5-7c4d-49de-b2f9-8542ec984eac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38970f9bc5444f629475bdc554d5645a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:23.784847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-561776f5-7c4d-49de-b2f9-8542ec984eac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38970f9bc5444f629475bdc554d5645a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:23.808960 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-561776f5-7c4d-49de-b2f9-8542ec984eac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38970f9bc5444f629475bdc554d5645a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:23.810423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-561776f5-7c4d-49de-b2f9-8542ec984eac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38970f9bc5444f629475bdc554d5645a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:23.856251 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2263/4530] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:19:23 2022] DELETE /identity/v3/users/38970f9bc5444f629475bdc554d5645a => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:23.861995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c515dad-83ec-44f8-8703-ba73158bfc71 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:23.862512 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c515dad-83ec-44f8-8703-ba73158bfc71 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:23.862512 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c515dad-83ec-44f8-8703-ba73158bfc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:23.901816 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-8c515dad-83ec-44f8-8703-ba73158bfc71 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:23.903061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8c515dad-83ec-44f8-8703-ba73158bfc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:24.011064 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:24.068390 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2268/4531] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:19:24.234325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561776f5-7c4d-49de-b2f9-8542ec984eac admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:24.236708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-561776f5-7c4d-49de-b2f9-8542ec984eac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:24.425669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561776f5-7c4d-49de-b2f9-8542ec984eac admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:24.441027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73691c2-007f-4deb-a6de-d02496a8ab71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:24.442083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73691c2-007f-4deb-a6de-d02496a8ab71 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:24.442600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73691c2-007f-4deb-a6de-d02496a8ab71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:24.443084 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73691c2-007f-4deb-a6de-d02496a8ab71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:24.470584 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73691c2-007f-4deb-a6de-d02496a8ab71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:24.472225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73691c2-007f-4deb-a6de-d02496a8ab71 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:24.505528 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2264/4532] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:19:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:19:27.406854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c515dad-83ec-44f8-8703-ba73158bfc71 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:27.409026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8c515dad-83ec-44f8-8703-ba73158bfc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:27.439903 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c515dad-83ec-44f8-8703-ba73158bfc71 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:27.475758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e43f62-9af2-4b80-8260-be19955ced6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:27.476678 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e43f62-9af2-4b80-8260-be19955ced6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:27.478667 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e43f62-9af2-4b80-8260-be19955ced6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:27.479376 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e43f62-9af2-4b80-8260-be19955ced6d admin admin] PATH_INFO: `/v3/projects/33bfcf2e9eb946068cb559151c36509d` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:27.490950 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e43f62-9af2-4b80-8260-be19955ced6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=33bfcf2e9eb946068cb559151c36509d)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:27.500716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e43f62-9af2-4b80-8260-be19955ced6d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:27.634009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-06e43f62-9af2-4b80-8260-be19955ced6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33bfcf2e9eb946068cb559151c36509d', 'request_id': 'req-06e43f62-9af2-4b80-8260-be19955ced6d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:27.655330 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-06e43f62-9af2-4b80-8260-be19955ced6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33bfcf2e9eb946068cb559151c36509d', 'request_id': 'req-06e43f62-9af2-4b80-8260-be19955ced6d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:27.662391 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-06e43f62-9af2-4b80-8260-be19955ced6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33bfcf2e9eb946068cb559151c36509d', 'request_id': 'req-06e43f62-9af2-4b80-8260-be19955ced6d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:27.686070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-06e43f62-9af2-4b80-8260-be19955ced6d admin admin] The token cache is being invalidate because project 33bfcf2e9eb946068cb559151c36509d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:19:27.686497 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-06e43f62-9af2-4b80-8260-be19955ced6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:27.690574 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-06e43f62-9af2-4b80-8260-be19955ced6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:27.697312 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2269/4533] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:19:27 2022] DELETE /identity/v3/projects/33bfcf2e9eb946068cb559151c36509d => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:27.702593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77e573-3f30-40a4-9be5-fce1c24fe240 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:27.703033 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77e573-3f30-40a4-9be5-fce1c24fe240 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:27.703195 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77e573-3f30-40a4-9be5-fce1c24fe240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:27.766968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-3d77e573-3f30-40a4-9be5-fce1c24fe240 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:27.775647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3d77e573-3f30-40a4-9be5-fce1c24fe240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:28.039805 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2265/4534] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:19:28.045634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0015cd-1a79-448d-9378-253c0fdf0559 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:28.046309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0015cd-1a79-448d-9378-253c0fdf0559 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:28.046829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0015cd-1a79-448d-9378-253c0fdf0559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:28.088447 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-2f0015cd-1a79-448d-9378-253c0fdf0559 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:28.091276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2f0015cd-1a79-448d-9378-253c0fdf0559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:28.116130 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d77e573-3f30-40a4-9be5-fce1c24fe240 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:28.126010 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2270/4535] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:19:28.129355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d77e573-3f30-40a4-9be5-fce1c24fe240 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:28.139832 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2f51d-d4c7-4d1e-b1bb-77782ec5bd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:28.140804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2f51d-d4c7-4d1e-b1bb-77782ec5bd19 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:28.141305 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2f51d-d4c7-4d1e-b1bb-77782ec5bd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:28.142360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2f51d-d4c7-4d1e-b1bb-77782ec5bd19 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:28.143296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f2f51d-d4c7-4d1e-b1bb-77782ec5bd19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:19:28.149859 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f2f51d-d4c7-4d1e-b1bb-77782ec5bd19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:28.151883 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f2f51d-d4c7-4d1e-b1bb-77782ec5bd19 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:28.196125 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2266/4536] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:19:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:19:28.197338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0015cd-1a79-448d-9378-253c0fdf0559 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:28.207833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0015cd-1a79-448d-9378-253c0fdf0559 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:28.222655 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b329f-f79d-4f49-ab33-253b6ea479d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:28.223403 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b329f-f79d-4f49-ab33-253b6ea479d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:28.225331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b329f-f79d-4f49-ab33-253b6ea479d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:28.225645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b329f-f79d-4f49-ab33-253b6ea479d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:28.226388 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b329f-f79d-4f49-ab33-253b6ea479d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:28.228430 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b329f-f79d-4f49-ab33-253b6ea479d0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:28.311951 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2271/4537] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:19:28 2022] POST /identity/v3/projects => generated 397 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:19:28.315646 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2f51d-d4c7-4d1e-b1bb-77782ec5bd19 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:28.331200 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2f51d-d4c7-4d1e-b1bb-77782ec5bd19 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:28.384207 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:28.490011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9589519-17be-46c0-83da-db948cf47dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:28.491033 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9589519-17be-46c0-83da-db948cf47dbf admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:28.491483 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9589519-17be-46c0-83da-db948cf47dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:28.491963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9589519-17be-46c0-83da-db948cf47dbf admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:28.493139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9589519-17be-46c0-83da-db948cf47dbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:28.496117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9589519-17be-46c0-83da-db948cf47dbf admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:28.535810 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2267/4538] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:19:28 2022] POST /identity/v3/users => generated 299 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:19:28.542913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b329f-f79d-4f49-ab33-253b6ea479d0 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:28.570704 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b329f-f79d-4f49-ab33-253b6ea479d0 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:28.596183 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ace2aa-c2c3-4d29-8659-43dddfc7143f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:28.596831 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ace2aa-c2c3-4d29-8659-43dddfc7143f admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:28.597114 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ace2aa-c2c3-4d29-8659-43dddfc7143f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:28.597506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ace2aa-c2c3-4d29-8659-43dddfc7143f admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:28.603153 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ace2aa-c2c3-4d29-8659-43dddfc7143f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:28.607726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ace2aa-c2c3-4d29-8659-43dddfc7143f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:28.663512 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2272/4539] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:19:28.677396 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9589519-17be-46c0-83da-db948cf47dbf admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:28.725926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9589519-17be-46c0-83da-db948cf47dbf admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:28.749402 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050b983-e135-4c62-9eec-dcaa5b3669a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:28.756817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050b983-e135-4c62-9eec-dcaa5b3669a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:28.773546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050b983-e135-4c62-9eec-dcaa5b3669a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:28.773546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050b983-e135-4c62-9eec-dcaa5b3669a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:28.773546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5050b983-e135-4c62-9eec-dcaa5b3669a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:28.773546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5050b983-e135-4c62-9eec-dcaa5b3669a2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:28.826969 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2268/4540] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:19:28.830815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ace2aa-c2c3-4d29-8659-43dddfc7143f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:28.853311 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ace2aa-c2c3-4d29-8659-43dddfc7143f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:28.871546 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b2b2d-1244-459e-bf21-122174754739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:28.872851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b2b2d-1244-459e-bf21-122174754739 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:28.873253 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b2b2d-1244-459e-bf21-122174754739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:28.873656 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b2b2d-1244-459e-bf21-122174754739 admin admin] PATH_INFO: `/v3/projects/9316de81a7ae4066a550c11ca1512ab9/users/e75a782247794ccfbe1f35682f9da42d/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:28.914098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b2b2d-1244-459e-bf21-122174754739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9316de81a7ae4066a550c11ca1512ab9, user_id=e75a782247794ccfbe1f35682f9da42d, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:28.918163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b2b2d-1244-459e-bf21-122174754739 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:28.968611 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2273/4541] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:19:28 2022] PUT /identity/v3/projects/9316de81a7ae4066a550c11ca1512ab9/users/e75a782247794ccfbe1f35682f9da42d/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:28.970536 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc076d-e4d9-4f6a-8fbc-00877a6588cf None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:28.970980 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc076d-e4d9-4f6a-8fbc-00877a6588cf None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:28.971537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc076d-e4d9-4f6a-8fbc-00877a6588cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:29.052175 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-2ffc076d-e4d9-4f6a-8fbc-00877a6588cf None None] MFA Rules not processed for user `e75a782247794ccfbe1f35682f9da42d`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:29.054111 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2ffc076d-e4d9-4f6a-8fbc-00877a6588cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:29.272589 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2269/4542] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:28 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:19:29.278859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b2b2d-1244-459e-bf21-122174754739 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:29.468260 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b2b2d-1244-459e-bf21-122174754739 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:29.483200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8385e-aef2-4228-b50b-32cbe3b8e8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:29.484171 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8385e-aef2-4228-b50b-32cbe3b8e8ec admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:29.487258 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8385e-aef2-4228-b50b-32cbe3b8e8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:29.487809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8385e-aef2-4228-b50b-32cbe3b8e8ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:29.489743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b8385e-aef2-4228-b50b-32cbe3b8e8ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:29.502111 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b8385e-aef2-4228-b50b-32cbe3b8e8ec admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:29.547203 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:29.587241 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2274/4543] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:19:29 2022] POST /identity/v3/projects => generated 399 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:19:29.588042 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc076d-e4d9-4f6a-8fbc-00877a6588cf None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:29.625631 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc076d-e4d9-4f6a-8fbc-00877a6588cf None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:29.844634 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c76485-4431-4c50-a6a5-82dce0c3e200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:29.845314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c76485-4431-4c50-a6a5-82dce0c3e200 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:29.846525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c76485-4431-4c50-a6a5-82dce0c3e200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:29.849296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c76485-4431-4c50-a6a5-82dce0c3e200 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:29.850092 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c76485-4431-4c50-a6a5-82dce0c3e200 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:29.865777 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c76485-4431-4c50-a6a5-82dce0c3e200 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:29.948788 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2270/4544] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:19:29 2022] POST /identity/v3/users => generated 306 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:19:29.953101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8385e-aef2-4228-b50b-32cbe3b8e8ec admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:29.965184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8385e-aef2-4228-b50b-32cbe3b8e8ec admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:29.999678 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99657d-bfc1-4ee4-9dec-47e18b7300ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:30.000391 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99657d-bfc1-4ee4-9dec-47e18b7300ba admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:30.000946 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99657d-bfc1-4ee4-9dec-47e18b7300ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:30.001493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99657d-bfc1-4ee4-9dec-47e18b7300ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:30.002441 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99657d-bfc1-4ee4-9dec-47e18b7300ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:30.004288 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99657d-bfc1-4ee4-9dec-47e18b7300ba admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:30.049805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c76485-4431-4c50-a6a5-82dce0c3e200 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:30.050678 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2275/4545] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:19:30.069013 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c76485-4431-4c50-a6a5-82dce0c3e200 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:30.086095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5447025-ced5-4713-a314-54ab4bc81150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:30.088122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5447025-ced5-4713-a314-54ab4bc81150 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:30.088432 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5447025-ced5-4713-a314-54ab4bc81150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:30.088840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5447025-ced5-4713-a314-54ab4bc81150 admin admin] PATH_INFO: `/v3/projects/fe3a0493ffd244a08c6606d7e4212e13/users/843679b5e11a4f438574475b437f06e6/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:30.145019 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:30.160013 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5447025-ced5-4713-a314-54ab4bc81150 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe3a0493ffd244a08c6606d7e4212e13, user_id=843679b5e11a4f438574475b437f06e6, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:30.173418 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5447025-ced5-4713-a314-54ab4bc81150 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:30.220148 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2271/4546] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:19:30 2022] PUT /identity/v3/projects/fe3a0493ffd244a08c6606d7e4212e13/users/843679b5e11a4f438574475b437f06e6/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:30.224137 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99657d-bfc1-4ee4-9dec-47e18b7300ba admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:30.236178 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99657d-bfc1-4ee4-9dec-47e18b7300ba admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:30.534755 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a11f95-35e0-4fde-af91-30984569f410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:30.535770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a11f95-35e0-4fde-af91-30984569f410 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:30.536299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a11f95-35e0-4fde-af91-30984569f410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:30.536818 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a11f95-35e0-4fde-af91-30984569f410 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:30.544670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a11f95-35e0-4fde-af91-30984569f410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:30.547520 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a11f95-35e0-4fde-af91-30984569f410 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:30.603622 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2276/4547] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:19:30.604871 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5447025-ced5-4713-a314-54ab4bc81150 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:30.628445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5447025-ced5-4713-a314-54ab4bc81150 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:30.648761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3416a15-8320-4430-b82a-0471d2f5d3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:30.649483 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3416a15-8320-4430-b82a-0471d2f5d3e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:30.649771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3416a15-8320-4430-b82a-0471d2f5d3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:30.650046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3416a15-8320-4430-b82a-0471d2f5d3e5 admin admin] PATH_INFO: `/v3/projects/fe3a0493ffd244a08c6606d7e4212e13/users/843679b5e11a4f438574475b437f06e6/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:30.656464 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3416a15-8320-4430-b82a-0471d2f5d3e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe3a0493ffd244a08c6606d7e4212e13, user_id=843679b5e11a4f438574475b437f06e6, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:30.669252 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3416a15-8320-4430-b82a-0471d2f5d3e5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:30.703912 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2272/4548] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:19:30 2022] PUT /identity/v3/projects/fe3a0493ffd244a08c6606d7e4212e13/users/843679b5e11a4f438574475b437f06e6/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:30.714412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756804a2-e014-407f-93b6-ea9eec5270e4 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:30.715221 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756804a2-e014-407f-93b6-ea9eec5270e4 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:30.716198 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756804a2-e014-407f-93b6-ea9eec5270e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:30.793293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-756804a2-e014-407f-93b6-ea9eec5270e4 None None] MFA Rules not processed for user `843679b5e11a4f438574475b437f06e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:30.797394 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-756804a2-e014-407f-93b6-ea9eec5270e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:30.977870 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2277/4549] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:30 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:19:31.043261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3416a15-8320-4430-b82a-0471d2f5d3e5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:31.045309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d3416a15-8320-4430-b82a-0471d2f5d3e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:31.187964 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3416a15-8320-4430-b82a-0471d2f5d3e5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:31.200779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9881696-a43e-4d52-8ffb-1acd9b0d2ae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:31.203788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9881696-a43e-4d52-8ffb-1acd9b0d2ae8 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:31.204139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9881696-a43e-4d52-8ffb-1acd9b0d2ae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:31.204341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9881696-a43e-4d52-8ffb-1acd9b0d2ae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:31.348851 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9881696-a43e-4d52-8ffb-1acd9b0d2ae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:31.350453 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9881696-a43e-4d52-8ffb-1acd9b0d2ae8 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:31.383751 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2273/4550] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:19:31 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:19:33.868282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756804a2-e014-407f-93b6-ea9eec5270e4 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:33.869975 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-756804a2-e014-407f-93b6-ea9eec5270e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:34.053167 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:34.076449 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756804a2-e014-407f-93b6-ea9eec5270e4 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:34.097692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bcf712-6dc7-4398-88cb-7798482f5794 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:34.098707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcf712-6dc7-4398-88cb-7798482f5794 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:34.099193 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcf712-6dc7-4398-88cb-7798482f5794 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:34.099649 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcf712-6dc7-4398-88cb-7798482f5794 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:34.118144 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bcf712-6dc7-4398-88cb-7798482f5794 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:34.120038 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bcf712-6dc7-4398-88cb-7798482f5794 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:34.146381 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2278/4551] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:19:33 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:19:35.974410 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680f7b6-6016-41c3-b135-e5f6c8208cf1 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:35.974910 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680f7b6-6016-41c3-b135-e5f6c8208cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:35.975498 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680f7b6-6016-41c3-b135-e5f6c8208cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:36.056594 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5680f7b6-6016-41c3-b135-e5f6c8208cf1 None None] MFA Rules not processed for user `58c0074bfe4d476da60c210af6408203`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:36.057855 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5680f7b6-6016-41c3-b135-e5f6c8208cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:36.284683 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2274/4552] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:35 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:19:36.286450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1ffce-522c-44ba-b1fd-534d840b012c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:36.286917 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1ffce-522c-44ba-b1fd-534d840b012c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:36.287034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1ffce-522c-44ba-b1fd-534d840b012c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:36.342153 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-90a1ffce-522c-44ba-b1fd-534d840b012c None None] MFA Rules not processed for user `58c0074bfe4d476da60c210af6408203`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:36.346841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-90a1ffce-522c-44ba-b1fd-534d840b012c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:36.368200 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2279/4553] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:36 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:19:36.381863 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680f7b6-6016-41c3-b135-e5f6c8208cf1 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:36.409984 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680f7b6-6016-41c3-b135-e5f6c8208cf1 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:36.445231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009a44e-b7ab-4ce9-bedc-3e42819ffb85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:36.445939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009a44e-b7ab-4ce9-bedc-3e42819ffb85 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:36.446237 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009a44e-b7ab-4ce9-bedc-3e42819ffb85 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:36.446545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009a44e-b7ab-4ce9-bedc-3e42819ffb85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:36.475475 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009a44e-b7ab-4ce9-bedc-3e42819ffb85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:36.477215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009a44e-b7ab-4ce9-bedc-3e42819ffb85 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:36.515611 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2275/4554] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:19:36 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:19:38.240049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1ffce-522c-44ba-b1fd-534d840b012c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:38.254714 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1ffce-522c-44ba-b1fd-534d840b012c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:38.267185 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff89a3-dcb2-4fb9-8686-0d3af1b03097 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:38.268176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff89a3-dcb2-4fb9-8686-0d3af1b03097 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:38.268805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff89a3-dcb2-4fb9-8686-0d3af1b03097 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:38.269764 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff89a3-dcb2-4fb9-8686-0d3af1b03097 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:38.282368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-73ff89a3-dcb2-4fb9-8686-0d3af1b03097 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:38.598698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff89a3-dcb2-4fb9-8686-0d3af1b03097 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:38.600191 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff89a3-dcb2-4fb9-8686-0d3af1b03097 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:38.628655 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2280/4555] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:19:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:19:46.495572 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:47.950090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009a44e-b7ab-4ce9-bedc-3e42819ffb85 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:47.952405 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1009a44e-b7ab-4ce9-bedc-3e42819ffb85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:47.974945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009a44e-b7ab-4ce9-bedc-3e42819ffb85 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:47.985234 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e1f8e-6893-491b-81ec-f08b8ae48d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:47.987548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e1f8e-6893-491b-81ec-f08b8ae48d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:47.987895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e1f8e-6893-491b-81ec-f08b8ae48d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:47.989035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e1f8e-6893-491b-81ec-f08b8ae48d3d admin admin] PATH_INFO: `/v3/users/5581a720105c400f8bee8ef53813288b` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:47.991798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e1f8e-6893-491b-81ec-f08b8ae48d3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5581a720105c400f8bee8ef53813288b)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:47.994031 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e1f8e-6893-491b-81ec-f08b8ae48d3d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:48.099419 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3a7e1f8e-6893-491b-81ec-f08b8ae48d3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5581a720105c400f8bee8ef53813288b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:48.100407 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3a7e1f8e-6893-491b-81ec-f08b8ae48d3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5581a720105c400f8bee8ef53813288b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:48.110625 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3a7e1f8e-6893-491b-81ec-f08b8ae48d3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5581a720105c400f8bee8ef53813288b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:48.149697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3a7e1f8e-6893-491b-81ec-f08b8ae48d3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5581a720105c400f8bee8ef53813288b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:48.150427 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3a7e1f8e-6893-491b-81ec-f08b8ae48d3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5581a720105c400f8bee8ef53813288b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:48.205253 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2276/4556] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:19:47 2022] DELETE /identity/v3/users/5581a720105c400f8bee8ef53813288b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:48.535628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff89a3-dcb2-4fb9-8686-0d3af1b03097 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:48.549582 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff89a3-dcb2-4fb9-8686-0d3af1b03097 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:48.669685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52af06-20aa-400a-a423-92a2ad0ecf7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:48.670660 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52af06-20aa-400a-a423-92a2ad0ecf7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:48.671258 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52af06-20aa-400a-a423-92a2ad0ecf7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:48.671715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52af06-20aa-400a-a423-92a2ad0ecf7f admin admin] PATH_INFO: `/v3/projects/66be3897d2bb460c93cf661260c102a4` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:48.673272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52af06-20aa-400a-a423-92a2ad0ecf7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=66be3897d2bb460c93cf661260c102a4)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:48.676187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52af06-20aa-400a-a423-92a2ad0ecf7f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:48.748432 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2d52af06-20aa-400a-a423-92a2ad0ecf7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66be3897d2bb460c93cf661260c102a4', 'request_id': 'req-2d52af06-20aa-400a-a423-92a2ad0ecf7f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:48.776519 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2d52af06-20aa-400a-a423-92a2ad0ecf7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66be3897d2bb460c93cf661260c102a4', 'request_id': 'req-2d52af06-20aa-400a-a423-92a2ad0ecf7f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:48.790071 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2d52af06-20aa-400a-a423-92a2ad0ecf7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66be3897d2bb460c93cf661260c102a4', 'request_id': 'req-2d52af06-20aa-400a-a423-92a2ad0ecf7f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:48.809815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2d52af06-20aa-400a-a423-92a2ad0ecf7f admin admin] The token cache is being invalidate because project 66be3897d2bb460c93cf661260c102a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:19:48.810324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2d52af06-20aa-400a-a423-92a2ad0ecf7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:48.811450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2d52af06-20aa-400a-a423-92a2ad0ecf7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:48.814583 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2281/4557] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:19:48 2022] DELETE /identity/v3/projects/66be3897d2bb460c93cf661260c102a4 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:48.825689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfe2c1-b06d-46a4-af63-8714db21010f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:48.826451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfe2c1-b06d-46a4-af63-8714db21010f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:48.826783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfe2c1-b06d-46a4-af63-8714db21010f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:48.866278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-28cfe2c1-b06d-46a4-af63-8714db21010f None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:48.867853 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-28cfe2c1-b06d-46a4-af63-8714db21010f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:49.008255 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2277/4558] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:19:49.009736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3687fc1-c786-406e-ab99-ae8f9f631913 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:49.010117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3687fc1-c786-406e-ab99-ae8f9f631913 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:49.010266 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3687fc1-c786-406e-ab99-ae8f9f631913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:49.035034 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:49.051170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-f3687fc1-c786-406e-ab99-ae8f9f631913 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:49.052515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f3687fc1-c786-406e-ab99-ae8f9f631913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:49.072285 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2282/4559] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:19:49.077448 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfe2c1-b06d-46a4-af63-8714db21010f None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:49.089524 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfe2c1-b06d-46a4-af63-8714db21010f None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:49.104845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c5a74-d490-4b8c-8e7f-4771e43dfff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:49.105822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c5a74-d490-4b8c-8e7f-4771e43dfff5 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:49.106335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c5a74-d490-4b8c-8e7f-4771e43dfff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:49.107623 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c5a74-d490-4b8c-8e7f-4771e43dfff5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:49.108518 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c5a74-d490-4b8c-8e7f-4771e43dfff5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:19:49.111205 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c5a74-d490-4b8c-8e7f-4771e43dfff5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:49.113486 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c5a74-d490-4b8c-8e7f-4771e43dfff5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:49.145670 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2278/4560] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:19:49.146623 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3687fc1-c786-406e-ab99-ae8f9f631913 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:49.157528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3687fc1-c786-406e-ab99-ae8f9f631913 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:49.169636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17612a-f227-440f-845d-3a24baa0a0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:49.170661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17612a-f227-440f-845d-3a24baa0a0a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:49.171856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17612a-f227-440f-845d-3a24baa0a0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:49.172359 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17612a-f227-440f-845d-3a24baa0a0a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:49.173255 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a17612a-f227-440f-845d-3a24baa0a0a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:49.175863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a17612a-f227-440f-845d-3a24baa0a0a3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:49.227378 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2283/4561] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:19:49 2022] POST /identity/v3/projects => generated 375 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:19:49.230884 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c5a74-d490-4b8c-8e7f-4771e43dfff5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:49.243897 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c5a74-d490-4b8c-8e7f-4771e43dfff5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:49.389108 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc889496-893c-4d7c-86a5-cfa2bedd42b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:49.389669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc889496-893c-4d7c-86a5-cfa2bedd42b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:49.389948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc889496-893c-4d7c-86a5-cfa2bedd42b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:49.390222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc889496-893c-4d7c-86a5-cfa2bedd42b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:49.390867 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc889496-893c-4d7c-86a5-cfa2bedd42b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:49.394565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc889496-893c-4d7c-86a5-cfa2bedd42b2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:49.408701 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:49.444004 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2279/4562] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:19:49 2022] POST /identity/v3/users => generated 288 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:19:49.447933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17612a-f227-440f-845d-3a24baa0a0a3 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:49.469676 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17612a-f227-440f-845d-3a24baa0a0a3 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:49.474847 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28514bd-b69c-4d10-8483-a91db6cb1c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:49.475599 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28514bd-b69c-4d10-8483-a91db6cb1c21 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:49.479881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28514bd-b69c-4d10-8483-a91db6cb1c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:49.481378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28514bd-b69c-4d10-8483-a91db6cb1c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:49.481679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28514bd-b69c-4d10-8483-a91db6cb1c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:49.492491 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28514bd-b69c-4d10-8483-a91db6cb1c21 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:49.505296 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2284/4563] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:19:49.509415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc889496-893c-4d7c-86a5-cfa2bedd42b2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:49.525758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc889496-893c-4d7c-86a5-cfa2bedd42b2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:49.542645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e314a6d-c7fb-4a0c-8304-94c8a96b2971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:49.543805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e314a6d-c7fb-4a0c-8304-94c8a96b2971 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:49.544085 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e314a6d-c7fb-4a0c-8304-94c8a96b2971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:49.544505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e314a6d-c7fb-4a0c-8304-94c8a96b2971 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:49.545235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e314a6d-c7fb-4a0c-8304-94c8a96b2971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:49.549771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e314a6d-c7fb-4a0c-8304-94c8a96b2971 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:49.586702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28514bd-b69c-4d10-8483-a91db6cb1c21 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:49.600982 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2280/4564] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:19:49.611103 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28514bd-b69c-4d10-8483-a91db6cb1c21 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:49.624537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214388cf-64a6-4a36-9672-8edb0ba6bc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:49.625892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214388cf-64a6-4a36-9672-8edb0ba6bc23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:49.626527 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214388cf-64a6-4a36-9672-8edb0ba6bc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:49.627022 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214388cf-64a6-4a36-9672-8edb0ba6bc23 admin admin] PATH_INFO: `/v3/projects/dd822fe9e72449d79e6572f0b4e6baff/users/9e49a64205f841019632429ff820747f/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:49.719199 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214388cf-64a6-4a36-9672-8edb0ba6bc23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd822fe9e72449d79e6572f0b4e6baff, user_id=9e49a64205f841019632429ff820747f, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:49.722579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214388cf-64a6-4a36-9672-8edb0ba6bc23 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:49.754878 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2285/4565] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:19:49 2022] PUT /identity/v3/projects/dd822fe9e72449d79e6572f0b4e6baff/users/9e49a64205f841019632429ff820747f/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:19:49.766831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e21d7e-0b10-46c9-baa2-71591e4e7fd0 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:49.767106 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e21d7e-0b10-46c9-baa2-71591e4e7fd0 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:49.767375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e21d7e-0b10-46c9-baa2-71591e4e7fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:49.820928 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-02e21d7e-0b10-46c9-baa2-71591e4e7fd0 None None] MFA Rules not processed for user `9e49a64205f841019632429ff820747f`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:49.822639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-02e21d7e-0b10-46c9-baa2-71591e4e7fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:49.944256 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2281/4566] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:19:49.944531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214388cf-64a6-4a36-9672-8edb0ba6bc23 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:50.151095 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214388cf-64a6-4a36-9672-8edb0ba6bc23 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:50.159527 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ac0e1-c13a-4312-9458-5c30cf241d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:50.160499 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ac0e1-c13a-4312-9458-5c30cf241d43 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:50.161025 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ac0e1-c13a-4312-9458-5c30cf241d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:50.161592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ac0e1-c13a-4312-9458-5c30cf241d43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:50.162452 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ac0e1-c13a-4312-9458-5c30cf241d43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:50.165424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ac0e1-c13a-4312-9458-5c30cf241d43 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:50.266707 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2286/4567] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:19:49 2022] POST /identity/v3/projects => generated 375 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:19:50.270869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e21d7e-0b10-46c9-baa2-71591e4e7fd0 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:50.305870 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e21d7e-0b10-46c9-baa2-71591e4e7fd0 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:50.499737 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08b362-256f-4ece-ab9b-f75e04635552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:50.500412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08b362-256f-4ece-ab9b-f75e04635552 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:50.500697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08b362-256f-4ece-ab9b-f75e04635552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:50.500975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08b362-256f-4ece-ab9b-f75e04635552 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:50.501653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f08b362-256f-4ece-ab9b-f75e04635552 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:50.503675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f08b362-256f-4ece-ab9b-f75e04635552 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:50.546831 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2282/4568] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:19:50 2022] POST /identity/v3/users => generated 294 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:19:50.548062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ac0e1-c13a-4312-9458-5c30cf241d43 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:50.567624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ac0e1-c13a-4312-9458-5c30cf241d43 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:50.581289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160cec4e-f2b0-4207-a5e7-0a7c3e27b69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:50.581979 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cec4e-f2b0-4207-a5e7-0a7c3e27b69d admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:50.582465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cec4e-f2b0-4207-a5e7-0a7c3e27b69d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:50.582741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cec4e-f2b0-4207-a5e7-0a7c3e27b69d admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:50.584547 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160cec4e-f2b0-4207-a5e7-0a7c3e27b69d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:50.588740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160cec4e-f2b0-4207-a5e7-0a7c3e27b69d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:50.608992 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2287/4569] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:19:50.610264 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08b362-256f-4ece-ab9b-f75e04635552 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:50.626499 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08b362-256f-4ece-ab9b-f75e04635552 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:50.633714 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425d0c7-8a25-4fa0-a738-b7c01ab18aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:50.634688 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425d0c7-8a25-4fa0-a738-b7c01ab18aff admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:50.635197 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425d0c7-8a25-4fa0-a738-b7c01ab18aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:50.635677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425d0c7-8a25-4fa0-a738-b7c01ab18aff admin admin] PATH_INFO: `/v3/projects/971639f5191f4757ada76c26136da98f/users/0665bdbd67974081aace8c2da7e892d0/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:50.670588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6425d0c7-8a25-4fa0-a738-b7c01ab18aff admin admin] RBAC: Authorizing `identity:create_grant(project_id=971639f5191f4757ada76c26136da98f, user_id=0665bdbd67974081aace8c2da7e892d0, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:50.673526 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6425d0c7-8a25-4fa0-a738-b7c01ab18aff admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:50.698253 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2283/4570] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:19:50 2022] PUT /identity/v3/projects/971639f5191f4757ada76c26136da98f/users/0665bdbd67974081aace8c2da7e892d0/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:50.702843 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160cec4e-f2b0-4207-a5e7-0a7c3e27b69d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:50.717613 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160cec4e-f2b0-4207-a5e7-0a7c3e27b69d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:50.872655 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eab5ce-0115-4122-908b-17cd2ff1b764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:50.873375 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eab5ce-0115-4122-908b-17cd2ff1b764 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:50.873894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eab5ce-0115-4122-908b-17cd2ff1b764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:50.874240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eab5ce-0115-4122-908b-17cd2ff1b764 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:50.875545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eab5ce-0115-4122-908b-17cd2ff1b764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:50.877463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eab5ce-0115-4122-908b-17cd2ff1b764 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:50.889362 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2288/4571] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:19:50.893950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425d0c7-8a25-4fa0-a738-b7c01ab18aff admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:50.906061 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425d0c7-8a25-4fa0-a738-b7c01ab18aff admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:50.911982 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033c4f4-a4b0-4679-a1a5-ac2c54e62bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:50.912737 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033c4f4-a4b0-4679-a1a5-ac2c54e62bb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:50.913084 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033c4f4-a4b0-4679-a1a5-ac2c54e62bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:50.913423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033c4f4-a4b0-4679-a1a5-ac2c54e62bb5 admin admin] PATH_INFO: `/v3/projects/971639f5191f4757ada76c26136da98f/users/0665bdbd67974081aace8c2da7e892d0/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:50.915701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033c4f4-a4b0-4679-a1a5-ac2c54e62bb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=971639f5191f4757ada76c26136da98f, user_id=0665bdbd67974081aace8c2da7e892d0, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:50.918699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033c4f4-a4b0-4679-a1a5-ac2c54e62bb5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:50.936134 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2284/4572] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:19:50 2022] PUT /identity/v3/projects/971639f5191f4757ada76c26136da98f/users/0665bdbd67974081aace8c2da7e892d0/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:50.950756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4de8d-4235-4e73-b937-eb910c82dcce None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:50.951181 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4de8d-4235-4e73-b937-eb910c82dcce None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:50.951525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4de8d-4235-4e73-b937-eb910c82dcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:50.992239 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:50.997165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-57c4de8d-4235-4e73-b937-eb910c82dcce None None] MFA Rules not processed for user `0665bdbd67974081aace8c2da7e892d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:51.001130 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-57c4de8d-4235-4e73-b937-eb910c82dcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:51.163960 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2289/4573] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:19:51.169154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033c4f4-a4b0-4679-a1a5-ac2c54e62bb5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:51.183271 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033c4f4-a4b0-4679-a1a5-ac2c54e62bb5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:51.193964 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926a2a0-c269-4936-8e2a-6bc37274568e tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0665bdbd67974081aace8c2da7e892d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971639f5191f4757ada76c26136da98f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:51.194859 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926a2a0-c269-4936-8e2a-6bc37274568e tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:51.195149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926a2a0-c269-4936-8e2a-6bc37274568e tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:51.195422 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926a2a0-c269-4936-8e2a-6bc37274568e tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:51.196206 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b926a2a0-c269-4936-8e2a-6bc37274568e tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:51.198244 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b926a2a0-c269-4936-8e2a-6bc37274568e tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:51.231216 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:INSERT=9,keystone:SELECT=91 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:51.252614 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2285/4574] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:19:51 2022] POST /identity/v3/projects => generated 350 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:19:51.256845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4de8d-4235-4e73-b937-eb910c82dcce None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:51.273587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4de8d-4235-4e73-b937-eb910c82dcce None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:51.365885 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2225034-3799-4427-aaf1-8510df458f6e tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0665bdbd67974081aace8c2da7e892d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971639f5191f4757ada76c26136da98f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:51.366773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2225034-3799-4427-aaf1-8510df458f6e tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:51.367233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2225034-3799-4427-aaf1-8510df458f6e tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:51.367680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2225034-3799-4427-aaf1-8510df458f6e tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:51.368478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2225034-3799-4427-aaf1-8510df458f6e tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:51.370567 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2225034-3799-4427-aaf1-8510df458f6e tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:51.420272 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2290/4575] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:19:51 2022] POST /identity/v3/projects => generated 350 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:19:51.424615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926a2a0-c269-4936-8e2a-6bc37274568e tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:51.440267 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926a2a0-c269-4936-8e2a-6bc37274568e tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:51.597873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd22327-add9-4809-8285-9b4fe8164261 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0665bdbd67974081aace8c2da7e892d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971639f5191f4757ada76c26136da98f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:51.598670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd22327-add9-4809-8285-9b4fe8164261 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:51.599016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd22327-add9-4809-8285-9b4fe8164261 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:51.599361 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd22327-add9-4809-8285-9b4fe8164261 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] PATH_INFO: `/v3/users/9e49a64205f841019632429ff820747f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:51.602043 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd22327-add9-4809-8285-9b4fe8164261 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: Authorizing `identity:get_user(user_id=9e49a64205f841019632429ff820747f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:51.608585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd22327-add9-4809-8285-9b4fe8164261 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:51.623689 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2286/4576] 10.222.0.30 () {58 vars in 1221 bytes} [Sun Sep 4 01:19:51 2022] GET /identity/v3/users/9e49a64205f841019632429ff820747f => generated 288 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:19:51.625426 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2225034-3799-4427-aaf1-8510df458f6e tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:51.658358 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2225034-3799-4427-aaf1-8510df458f6e tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:51.672286 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c52983-cde6-46c2-b843-145442f61f11 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0665bdbd67974081aace8c2da7e892d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971639f5191f4757ada76c26136da98f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:51.674120 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c52983-cde6-46c2-b843-145442f61f11 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:51.676437 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c52983-cde6-46c2-b843-145442f61f11 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:51.676748 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c52983-cde6-46c2-b843-145442f61f11 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:51.678522 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c52983-cde6-46c2-b843-145442f61f11 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:51.685075 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c52983-cde6-46c2-b843-145442f61f11 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:51.721544 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2291/4577] 10.222.0.30 () {60 vars in 1162 bytes} [Sun Sep 4 01:19:51 2022] POST /identity/v3/credentials => generated 430 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:19:51.726073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd22327-add9-4809-8285-9b4fe8164261 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:51.742353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd22327-add9-4809-8285-9b4fe8164261 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:51.756524 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c782e-ce5f-4803-beb3-8f6bba0a6b8f tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0665bdbd67974081aace8c2da7e892d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971639f5191f4757ada76c26136da98f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:51.757466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c782e-ce5f-4803-beb3-8f6bba0a6b8f tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:51.757777 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c782e-ce5f-4803-beb3-8f6bba0a6b8f tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:51.758036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c782e-ce5f-4803-beb3-8f6bba0a6b8f tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] PATH_INFO: `/v3/credentials/94e8a234258463b34d9870e7110f71c1e50a4e27eede09894e4d48783da86664` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:51.769026 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c782e-ce5f-4803-beb3-8f6bba0a6b8f tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=94e8a234258463b34d9870e7110f71c1e50a4e27eede09894e4d48783da86664)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:51.769026 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c782e-ce5f-4803-beb3-8f6bba0a6b8f tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:51.775699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c782e-ce5f-4803-beb3-8f6bba0a6b8f tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=94e8a234258463b34d9870e7110f71c1e50a4e27eede09894e4d48783da86664)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:51.779826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c782e-ce5f-4803-beb3-8f6bba0a6b8f tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:51.805064 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2287/4578] 10.222.0.30 () {60 vars in 1358 bytes} [Sun Sep 4 01:19:51 2022] PATCH /identity/v3/credentials/94e8a234258463b34d9870e7110f71c1e50a4e27eede09894e4d48783da86664 => generated 436 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:19:51.809261 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c52983-cde6-46c2-b843-145442f61f11 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:51.822238 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c52983-cde6-46c2-b843-145442f61f11 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:51.834518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f974a2-46ac-4340-adb4-afb218ad45bd tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0665bdbd67974081aace8c2da7e892d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971639f5191f4757ada76c26136da98f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:51.835322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f974a2-46ac-4340-adb4-afb218ad45bd tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:51.835598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f974a2-46ac-4340-adb4-afb218ad45bd tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:51.835873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f974a2-46ac-4340-adb4-afb218ad45bd tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] PATH_INFO: `/v3/credentials/94e8a234258463b34d9870e7110f71c1e50a4e27eede09894e4d48783da86664` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:51.841964 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f974a2-46ac-4340-adb4-afb218ad45bd tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=94e8a234258463b34d9870e7110f71c1e50a4e27eede09894e4d48783da86664)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:51.843738 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f974a2-46ac-4340-adb4-afb218ad45bd tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:51.849948 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2292/4579] 10.222.0.30 () {58 vars in 1335 bytes} [Sun Sep 4 01:19:51 2022] GET /identity/v3/credentials/94e8a234258463b34d9870e7110f71c1e50a4e27eede09894e4d48783da86664 => generated 436 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:19:51.854083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c782e-ce5f-4803-beb3-8f6bba0a6b8f tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:51.869009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c782e-ce5f-4803-beb3-8f6bba0a6b8f tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:51.881528 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f8aec-89fc-4e3e-bb57-4b961e2a3df4 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0665bdbd67974081aace8c2da7e892d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971639f5191f4757ada76c26136da98f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:51.882137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f8aec-89fc-4e3e-bb57-4b961e2a3df4 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:51.882421 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f8aec-89fc-4e3e-bb57-4b961e2a3df4 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:51.882696 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f8aec-89fc-4e3e-bb57-4b961e2a3df4 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] PATH_INFO: `/v3/credentials/94e8a234258463b34d9870e7110f71c1e50a4e27eede09894e4d48783da86664` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:51.886332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f8aec-89fc-4e3e-bb57-4b961e2a3df4 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=94e8a234258463b34d9870e7110f71c1e50a4e27eede09894e4d48783da86664)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:51.888653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f8aec-89fc-4e3e-bb57-4b961e2a3df4 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:51.924265 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2288/4580] 10.222.0.30 () {58 vars in 1338 bytes} [Sun Sep 4 01:19:51 2022] DELETE /identity/v3/credentials/94e8a234258463b34d9870e7110f71c1e50a4e27eede09894e4d48783da86664 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:19:51.929222 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f974a2-46ac-4340-adb4-afb218ad45bd tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:51.943552 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f974a2-46ac-4340-adb4-afb218ad45bd tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:51.957519 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f5bf5-c162-4292-847f-35ea8092ba19 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0665bdbd67974081aace8c2da7e892d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971639f5191f4757ada76c26136da98f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:51.958152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f5bf5-c162-4292-847f-35ea8092ba19 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:51.958450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f5bf5-c162-4292-847f-35ea8092ba19 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:51.958928 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f5bf5-c162-4292-847f-35ea8092ba19 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:51.959342 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f5bf5-c162-4292-847f-35ea8092ba19 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:51.961733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f5bf5-c162-4292-847f-35ea8092ba19 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:52.001783 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2293/4581] 10.222.0.30 () {60 vars in 1162 bytes} [Sun Sep 4 01:19:51 2022] POST /identity/v3/credentials => generated 430 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:19:52.002914 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f8aec-89fc-4e3e-bb57-4b961e2a3df4 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:52.017241 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f8aec-89fc-4e3e-bb57-4b961e2a3df4 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:52.034664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bc57f-3eb7-4a46-afaa-063b7d36e4d7 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0665bdbd67974081aace8c2da7e892d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971639f5191f4757ada76c26136da98f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:52.035303 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bc57f-3eb7-4a46-afaa-063b7d36e4d7 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:52.035587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bc57f-3eb7-4a46-afaa-063b7d36e4d7 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:52.035863 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bc57f-3eb7-4a46-afaa-063b7d36e4d7 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:52.036519 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6bc57f-3eb7-4a46-afaa-063b7d36e4d7 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:52.038456 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6bc57f-3eb7-4a46-afaa-063b7d36e4d7 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:52.079347 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2289/4582] 10.222.0.30 () {60 vars in 1162 bytes} [Sun Sep 4 01:19:52 2022] POST /identity/v3/credentials => generated 429 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:19:52.082087 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f5bf5-c162-4292-847f-35ea8092ba19 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:52.118526 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f5bf5-c162-4292-847f-35ea8092ba19 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:52.141524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c57ce-86a0-4bb1-8fe5-489218f67ce1 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0665bdbd67974081aace8c2da7e892d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971639f5191f4757ada76c26136da98f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:52.150032 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c57ce-86a0-4bb1-8fe5-489218f67ce1 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:52.150552 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c57ce-86a0-4bb1-8fe5-489218f67ce1 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:52.151045 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c57ce-86a0-4bb1-8fe5-489218f67ce1 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:52.151900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c57ce-86a0-4bb1-8fe5-489218f67ce1 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:52.153798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c57ce-86a0-4bb1-8fe5-489218f67ce1 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:52.187907 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c57ce-86a0-4bb1-8fe5-489218f67ce1 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:52.196317 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c57ce-86a0-4bb1-8fe5-489218f67ce1 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:52.209648 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c57ce-86a0-4bb1-8fe5-489218f67ce1 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:52.211447 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c57ce-86a0-4bb1-8fe5-489218f67ce1 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:52.217776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bc57f-3eb7-4a46-afaa-063b7d36e4d7 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:52.234220 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bc57f-3eb7-4a46-afaa-063b7d36e4d7 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:52.234978 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2294/4583] 10.222.0.30 () {58 vars in 1140 bytes} [Sun Sep 4 01:19:52 2022] GET /identity/v3/credentials => generated 944 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:19:52.248811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d40ea-b499-4c71-8b7d-11665428b0d4 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0665bdbd67974081aace8c2da7e892d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971639f5191f4757ada76c26136da98f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:52.249761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d40ea-b499-4c71-8b7d-11665428b0d4 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:52.252996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d40ea-b499-4c71-8b7d-11665428b0d4 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:52.260127 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d40ea-b499-4c71-8b7d-11665428b0d4 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] PATH_INFO: `/v3/credentials/e826f68835961f3abda3cdc6e157be9171a101886d895d91a82bb5c6bf888daf` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:52.269122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d40ea-b499-4c71-8b7d-11665428b0d4 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=e826f68835961f3abda3cdc6e157be9171a101886d895d91a82bb5c6bf888daf)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:52.270976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d40ea-b499-4c71-8b7d-11665428b0d4 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:52.306644 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2290/4584] 10.222.0.30 () {58 vars in 1338 bytes} [Sun Sep 4 01:19:52 2022] DELETE /identity/v3/credentials/e826f68835961f3abda3cdc6e157be9171a101886d895d91a82bb5c6bf888daf => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:19:52.311898 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c57ce-86a0-4bb1-8fe5-489218f67ce1 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:52.326883 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c57ce-86a0-4bb1-8fe5-489218f67ce1 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:52.343879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3efaf-adfd-43e4-9916-8ef8582986e3 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0665bdbd67974081aace8c2da7e892d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971639f5191f4757ada76c26136da98f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:52.344667 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3efaf-adfd-43e4-9916-8ef8582986e3 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:52.345024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3efaf-adfd-43e4-9916-8ef8582986e3 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:52.345374 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3efaf-adfd-43e4-9916-8ef8582986e3 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] PATH_INFO: `/v3/credentials/85265e9316f2601f98f0522f9b3c94f27d3a30914364c64413024a1ff9ec83e6` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:52.347971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda3efaf-adfd-43e4-9916-8ef8582986e3 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=85265e9316f2601f98f0522f9b3c94f27d3a30914364c64413024a1ff9ec83e6)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:52.350923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda3efaf-adfd-43e4-9916-8ef8582986e3 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:52.397651 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2295/4585] 10.222.0.30 () {58 vars in 1338 bytes} [Sun Sep 4 01:19:52 2022] DELETE /identity/v3/credentials/85265e9316f2601f98f0522f9b3c94f27d3a30914364c64413024a1ff9ec83e6 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:52.399296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d40ea-b499-4c71-8b7d-11665428b0d4 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:52.440934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d40ea-b499-4c71-8b7d-11665428b0d4 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:52.472240 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa7e61-5ddc-4ff7-8700-c3091883faba tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0665bdbd67974081aace8c2da7e892d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971639f5191f4757ada76c26136da98f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:52.472917 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa7e61-5ddc-4ff7-8700-c3091883faba tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:52.475424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa7e61-5ddc-4ff7-8700-c3091883faba tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:52.475720 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa7e61-5ddc-4ff7-8700-c3091883faba tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] PATH_INFO: `/v3/projects/578f36d1049b4998971dd20d2fb4f355` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:52.478542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa7e61-5ddc-4ff7-8700-c3091883faba tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: Authorizing `identity:delete_project(project_id=578f36d1049b4998971dd20d2fb4f355)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:52.482608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa7e61-5ddc-4ff7-8700-c3091883faba tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:52.628342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-00aa7e61-5ddc-4ff7-8700-c3091883faba tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '578f36d1049b4998971dd20d2fb4f355', 'request_id': 'req-00aa7e61-5ddc-4ff7-8700-c3091883faba'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:52.651767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-00aa7e61-5ddc-4ff7-8700-c3091883faba tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '578f36d1049b4998971dd20d2fb4f355', 'request_id': 'req-00aa7e61-5ddc-4ff7-8700-c3091883faba'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:52.660130 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-00aa7e61-5ddc-4ff7-8700-c3091883faba tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '578f36d1049b4998971dd20d2fb4f355', 'request_id': 'req-00aa7e61-5ddc-4ff7-8700-c3091883faba'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:52.691530 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-00aa7e61-5ddc-4ff7-8700-c3091883faba tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] The token cache is being invalidate because project 578f36d1049b4998971dd20d2fb4f355 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:19:52.691828 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-00aa7e61-5ddc-4ff7-8700-c3091883faba tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:52.695469 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-00aa7e61-5ddc-4ff7-8700-c3091883faba tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:52.702140 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2291/4586] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:19:52 2022] DELETE /identity/v3/projects/578f36d1049b4998971dd20d2fb4f355 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:52.704284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3efaf-adfd-43e4-9916-8ef8582986e3 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:52.708408 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-eda3efaf-adfd-43e4-9916-8ef8582986e3 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:52.739115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3efaf-adfd-43e4-9916-8ef8582986e3 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:52.834150 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:52.949051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8785da-65ee-4c8f-8f63-4c99621ac199 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0665bdbd67974081aace8c2da7e892d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971639f5191f4757ada76c26136da98f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:52.953057 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8785da-65ee-4c8f-8f63-4c99621ac199 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:52.953653 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8785da-65ee-4c8f-8f63-4c99621ac199 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:52.954318 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8785da-65ee-4c8f-8f63-4c99621ac199 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] PATH_INFO: `/v3/projects/bb97966e5998450ba5c4dc32418e46f8` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:52.959478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8785da-65ee-4c8f-8f63-4c99621ac199 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bb97966e5998450ba5c4dc32418e46f8)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:52.971747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8785da-65ee-4c8f-8f63-4c99621ac199 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:53.092196 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7d8785da-65ee-4c8f-8f63-4c99621ac199 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb97966e5998450ba5c4dc32418e46f8', 'request_id': 'req-7d8785da-65ee-4c8f-8f63-4c99621ac199'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:53.112510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7d8785da-65ee-4c8f-8f63-4c99621ac199 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb97966e5998450ba5c4dc32418e46f8', 'request_id': 'req-7d8785da-65ee-4c8f-8f63-4c99621ac199'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:53.121860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7d8785da-65ee-4c8f-8f63-4c99621ac199 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb97966e5998450ba5c4dc32418e46f8', 'request_id': 'req-7d8785da-65ee-4c8f-8f63-4c99621ac199'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:53.149200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7d8785da-65ee-4c8f-8f63-4c99621ac199 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] The token cache is being invalidate because project bb97966e5998450ba5c4dc32418e46f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:19:53.149542 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7d8785da-65ee-4c8f-8f63-4c99621ac199 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:53.150861 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7d8785da-65ee-4c8f-8f63-4c99621ac199 tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:53.158054 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2296/4587] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:19:52 2022] DELETE /identity/v3/projects/bb97966e5998450ba5c4dc32418e46f8 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:53.159326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa7e61-5ddc-4ff7-8700-c3091883faba tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:53.161388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-00aa7e61-5ddc-4ff7-8700-c3091883faba tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:53.235461 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:53.285396 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa7e61-5ddc-4ff7-8700-c3091883faba tempest-CredentialsTestJSON-1428303112 tempest-CredentialsTestJSON-1428303112-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:53.379348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd5c1c-3e19-4f21-8927-61965f149898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:53.380775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd5c1c-3e19-4f21-8927-61965f149898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:53.380775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd5c1c-3e19-4f21-8927-61965f149898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:53.380775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd5c1c-3e19-4f21-8927-61965f149898 admin admin] PATH_INFO: `/v3/users/9e49a64205f841019632429ff820747f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:53.381908 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd5c1c-3e19-4f21-8927-61965f149898 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e49a64205f841019632429ff820747f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:53.386784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd5c1c-3e19-4f21-8927-61965f149898 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:53.498891 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d7cd5c1c-3e19-4f21-8927-61965f149898 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e49a64205f841019632429ff820747f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:53.501950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d7cd5c1c-3e19-4f21-8927-61965f149898 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e49a64205f841019632429ff820747f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:53.524125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d7cd5c1c-3e19-4f21-8927-61965f149898 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e49a64205f841019632429ff820747f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:53.546241 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d7cd5c1c-3e19-4f21-8927-61965f149898 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e49a64205f841019632429ff820747f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:53.547531 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d7cd5c1c-3e19-4f21-8927-61965f149898 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e49a64205f841019632429ff820747f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:53.597038 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f6949-7fa6-4c8e-b7e1-2daaf250c9da None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:53.597326 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f6949-7fa6-4c8e-b7e1-2daaf250c9da None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:53.597684 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f6949-7fa6-4c8e-b7e1-2daaf250c9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:53.600803 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2292/4588] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:19:53 2022] DELETE /identity/v3/users/9e49a64205f841019632429ff820747f => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:53.632950 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-722f6949-7fa6-4c8e-b7e1-2daaf250c9da None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:53.639074 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-722f6949-7fa6-4c8e-b7e1-2daaf250c9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:53.768658 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2297/4589] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:19:53.808122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd5c1c-3e19-4f21-8927-61965f149898 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:53.809974 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d7cd5c1c-3e19-4f21-8927-61965f149898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:53.928595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd5c1c-3e19-4f21-8927-61965f149898 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:53.932479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24d47e-0cd1-4575-b6f1-24db67c248ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:53.933678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24d47e-0cd1-4575-b6f1-24db67c248ad service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:53.934055 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24d47e-0cd1-4575-b6f1-24db67c248ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:53.934410 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24d47e-0cd1-4575-b6f1-24db67c248ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:53.944466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24d47e-0cd1-4575-b6f1-24db67c248ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:53.946074 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24d47e-0cd1-4575-b6f1-24db67c248ad service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:53.950464 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:53.959050 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2293/4590] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:19:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:19:55.600574 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f6949-7fa6-4c8e-b7e1-2daaf250c9da None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:55.604375 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-722f6949-7fa6-4c8e-b7e1-2daaf250c9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:55.627708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f6949-7fa6-4c8e-b7e1-2daaf250c9da None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:55.664859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2892dd6-50d0-4148-b93c-97b1942f6a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:55.666104 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2892dd6-50d0-4148-b93c-97b1942f6a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:55.666679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2892dd6-50d0-4148-b93c-97b1942f6a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:55.667163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2892dd6-50d0-4148-b93c-97b1942f6a50 admin admin] PATH_INFO: `/v3/projects/dd822fe9e72449d79e6572f0b4e6baff` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:55.669888 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2892dd6-50d0-4148-b93c-97b1942f6a50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd822fe9e72449d79e6572f0b4e6baff)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:55.672580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2892dd6-50d0-4148-b93c-97b1942f6a50 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:55.782842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b2892dd6-50d0-4148-b93c-97b1942f6a50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd822fe9e72449d79e6572f0b4e6baff', 'request_id': 'req-b2892dd6-50d0-4148-b93c-97b1942f6a50'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:55.789329 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:55.804632 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b2892dd6-50d0-4148-b93c-97b1942f6a50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd822fe9e72449d79e6572f0b4e6baff', 'request_id': 'req-b2892dd6-50d0-4148-b93c-97b1942f6a50'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:55.818835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b2892dd6-50d0-4148-b93c-97b1942f6a50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd822fe9e72449d79e6572f0b4e6baff', 'request_id': 'req-b2892dd6-50d0-4148-b93c-97b1942f6a50'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:55.839227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b2892dd6-50d0-4148-b93c-97b1942f6a50 admin admin] The token cache is being invalidate because project dd822fe9e72449d79e6572f0b4e6baff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:19:55.841508 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b2892dd6-50d0-4148-b93c-97b1942f6a50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:55.842502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b2892dd6-50d0-4148-b93c-97b1942f6a50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:55.844877 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2298/4591] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:19:55 2022] DELETE /identity/v3/projects/dd822fe9e72449d79e6572f0b4e6baff => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:55.849591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24d47e-0cd1-4575-b6f1-24db67c248ad service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:55.868217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24d47e-0cd1-4575-b6f1-24db67c248ad service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:55.966003 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15469946-3401-4560-a941-d3c5f3074992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:55.968545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15469946-3401-4560-a941-d3c5f3074992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:55.969114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15469946-3401-4560-a941-d3c5f3074992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:55.969706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15469946-3401-4560-a941-d3c5f3074992 admin admin] PATH_INFO: `/v3/users/0665bdbd67974081aace8c2da7e892d0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:55.971797 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15469946-3401-4560-a941-d3c5f3074992 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0665bdbd67974081aace8c2da7e892d0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:55.975105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15469946-3401-4560-a941-d3c5f3074992 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:56.051741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-15469946-3401-4560-a941-d3c5f3074992 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0665bdbd67974081aace8c2da7e892d0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:56.052664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-15469946-3401-4560-a941-d3c5f3074992 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0665bdbd67974081aace8c2da7e892d0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:56.064662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-15469946-3401-4560-a941-d3c5f3074992 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0665bdbd67974081aace8c2da7e892d0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:56.075725 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-15469946-3401-4560-a941-d3c5f3074992 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0665bdbd67974081aace8c2da7e892d0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:56.077558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-15469946-3401-4560-a941-d3c5f3074992 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0665bdbd67974081aace8c2da7e892d0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:56.165501 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2294/4592] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:19:55 2022] DELETE /identity/v3/users/0665bdbd67974081aace8c2da7e892d0 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:57.088303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2892dd6-50d0-4148-b93c-97b1942f6a50 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:57.091393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b2892dd6-50d0-4148-b93c-97b1942f6a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:57.125580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2892dd6-50d0-4148-b93c-97b1942f6a50 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:57.138141 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15469946-3401-4560-a941-d3c5f3074992 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:57.139708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-15469946-3401-4560-a941-d3c5f3074992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:57.260220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4ec64-c843-444c-b4af-1e6916100090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:57.261320 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4ec64-c843-444c-b4af-1e6916100090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:57.261785 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4ec64-c843-444c-b4af-1e6916100090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:57.262576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4ec64-c843-444c-b4af-1e6916100090 admin admin] PATH_INFO: `/v3/users/e75a782247794ccfbe1f35682f9da42d` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:57.264399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4ec64-c843-444c-b4af-1e6916100090 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e75a782247794ccfbe1f35682f9da42d)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:57.269839 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4ec64-c843-444c-b4af-1e6916100090 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:57.290718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15469946-3401-4560-a941-d3c5f3074992 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:57.307048 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20befff6-0cd0-4e72-b7fb-a47e52a6e824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:57.307706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20befff6-0cd0-4e72-b7fb-a47e52a6e824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:57.307984 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20befff6-0cd0-4e72-b7fb-a47e52a6e824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:57.308952 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20befff6-0cd0-4e72-b7fb-a47e52a6e824 admin admin] PATH_INFO: `/v3/projects/971639f5191f4757ada76c26136da98f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:57.313083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20befff6-0cd0-4e72-b7fb-a47e52a6e824 admin admin] RBAC: Authorizing `identity:delete_project(project_id=971639f5191f4757ada76c26136da98f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:57.328202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20befff6-0cd0-4e72-b7fb-a47e52a6e824 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:57.388135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0aa4ec64-c843-444c-b4af-1e6916100090 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e75a782247794ccfbe1f35682f9da42d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:57.389500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0aa4ec64-c843-444c-b4af-1e6916100090 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e75a782247794ccfbe1f35682f9da42d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:57.390408 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:57.405673 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0aa4ec64-c843-444c-b4af-1e6916100090 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e75a782247794ccfbe1f35682f9da42d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:57.431352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0aa4ec64-c843-444c-b4af-1e6916100090 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e75a782247794ccfbe1f35682f9da42d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:57.433721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0aa4ec64-c843-444c-b4af-1e6916100090 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e75a782247794ccfbe1f35682f9da42d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:57.448389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-20befff6-0cd0-4e72-b7fb-a47e52a6e824 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '971639f5191f4757ada76c26136da98f', 'request_id': 'req-20befff6-0cd0-4e72-b7fb-a47e52a6e824'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:57.469332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-20befff6-0cd0-4e72-b7fb-a47e52a6e824 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '971639f5191f4757ada76c26136da98f', 'request_id': 'req-20befff6-0cd0-4e72-b7fb-a47e52a6e824'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:57.482667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-20befff6-0cd0-4e72-b7fb-a47e52a6e824 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '971639f5191f4757ada76c26136da98f', 'request_id': 'req-20befff6-0cd0-4e72-b7fb-a47e52a6e824'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:57.485881 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2299/4593] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:19:57 2022] DELETE /identity/v3/users/e75a782247794ccfbe1f35682f9da42d => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:57.489796 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505b21e-4f8f-48a5-9e07-a8f5cb7860ee None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:57.490087 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505b21e-4f8f-48a5-9e07-a8f5cb7860ee None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:57.490369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505b21e-4f8f-48a5-9e07-a8f5cb7860ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:57.502865 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-20befff6-0cd0-4e72-b7fb-a47e52a6e824 admin admin] The token cache is being invalidate because project 971639f5191f4757ada76c26136da98f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:19:57.503226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-20befff6-0cd0-4e72-b7fb-a47e52a6e824 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:57.505152 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-20befff6-0cd0-4e72-b7fb-a47e52a6e824 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:57.511228 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2295/4594] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:19:57 2022] DELETE /identity/v3/projects/971639f5191f4757ada76c26136da98f => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:57.516375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207dc5d-1a02-45d4-bbcc-a1a854ad1504 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:57.516766 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207dc5d-1a02-45d4-bbcc-a1a854ad1504 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:57.517180 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207dc5d-1a02-45d4-bbcc-a1a854ad1504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:57.528560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c505b21e-4f8f-48a5-9e07-a8f5cb7860ee None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:57.529815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c505b21e-4f8f-48a5-9e07-a8f5cb7860ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:57.551831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c207dc5d-1a02-45d4-bbcc-a1a854ad1504 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:57.554142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c207dc5d-1a02-45d4-bbcc-a1a854ad1504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:57.637680 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2300/4595] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:19:57.684634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505b21e-4f8f-48a5-9e07-a8f5cb7860ee None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:57.686688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c505b21e-4f8f-48a5-9e07-a8f5cb7860ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:57.702543 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:57.744381 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2296/4596] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:19:57.753789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a8e49-d0f1-499e-b2bf-897ea4c41c31 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:57.754137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a8e49-d0f1-499e-b2bf-897ea4c41c31 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:57.754341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a8e49-d0f1-499e-b2bf-897ea4c41c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:57.815283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5d7a8e49-d0f1-499e-b2bf-897ea4c41c31 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:57.817353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5d7a8e49-d0f1-499e-b2bf-897ea4c41c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:57.840945 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2297/4597] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:19:57.843004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a8e49-d0f1-499e-b2bf-897ea4c41c31 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:57.860122 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505b21e-4f8f-48a5-9e07-a8f5cb7860ee None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:57.867816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a8e49-d0f1-499e-b2bf-897ea4c41c31 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:57.871247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120eff32-175f-4545-83b2-ecb0b050706e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:57.871948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120eff32-175f-4545-83b2-ecb0b050706e service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:57.874520 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120eff32-175f-4545-83b2-ecb0b050706e service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:57.874817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120eff32-175f-4545-83b2-ecb0b050706e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:57.880396 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576e766-5738-4278-a17d-9b440c47e0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:57.881603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576e766-5738-4278-a17d-9b440c47e0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:57.883677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576e766-5738-4278-a17d-9b440c47e0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:57.883805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576e766-5738-4278-a17d-9b440c47e0a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:57.885378 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9576e766-5738-4278-a17d-9b440c47e0a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:19:57.885720 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9576e766-5738-4278-a17d-9b440c47e0a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:57.888906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9576e766-5738-4278-a17d-9b440c47e0a9 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:57.907089 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120eff32-175f-4545-83b2-ecb0b050706e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:57.908837 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120eff32-175f-4545-83b2-ecb0b050706e service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:57.925664 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2298/4598] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:19:57.928991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576e766-5738-4278-a17d-9b440c47e0a9 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:57.930342 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2301/4599] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:19:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:19:57.944214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576e766-5738-4278-a17d-9b440c47e0a9 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:57.951090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc52bc7e-6179-40b5-8051-c58e877be79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:57.951830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52bc7e-6179-40b5-8051-c58e877be79b admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:57.952212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52bc7e-6179-40b5-8051-c58e877be79b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:57.952595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52bc7e-6179-40b5-8051-c58e877be79b admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:57.953328 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc52bc7e-6179-40b5-8051-c58e877be79b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:57.955392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc52bc7e-6179-40b5-8051-c58e877be79b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:58.017488 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2299/4600] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:19:57 2022] POST /identity/v3/projects => generated 373 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:19:58.020590 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120eff32-175f-4545-83b2-ecb0b050706e service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:58.033307 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120eff32-175f-4545-83b2-ecb0b050706e service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:58.121205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cff6cc-8a12-42c3-a520-f5129429ace8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:58.122023 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cff6cc-8a12-42c3-a520-f5129429ace8 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:58.122403 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cff6cc-8a12-42c3-a520-f5129429ace8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:58.122877 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cff6cc-8a12-42c3-a520-f5129429ace8 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:58.123622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cff6cc-8a12-42c3-a520-f5129429ace8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:58.126760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cff6cc-8a12-42c3-a520-f5129429ace8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:58.160731 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2302/4601] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:19:58 2022] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:19:58.162733 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc52bc7e-6179-40b5-8051-c58e877be79b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:58.180424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc52bc7e-6179-40b5-8051-c58e877be79b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:58.186159 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d898b8-9d31-42ab-a206-23d7e4cbe732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:58.186928 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d898b8-9d31-42ab-a206-23d7e4cbe732 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:58.187340 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d898b8-9d31-42ab-a206-23d7e4cbe732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:58.187712 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d898b8-9d31-42ab-a206-23d7e4cbe732 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:58.188468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d898b8-9d31-42ab-a206-23d7e4cbe732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:58.190706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d898b8-9d31-42ab-a206-23d7e4cbe732 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:58.205010 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2300/4602] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:19:58.208876 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cff6cc-8a12-42c3-a520-f5129429ace8 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:58.220619 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cff6cc-8a12-42c3-a520-f5129429ace8 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:58.227446 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c37af-8ef8-4ce1-9a3e-12de29149d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:58.228224 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c37af-8ef8-4ce1-9a3e-12de29149d7e admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:58.228879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c37af-8ef8-4ce1-9a3e-12de29149d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:58.229270 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c37af-8ef8-4ce1-9a3e-12de29149d7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:58.230700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c37af-8ef8-4ce1-9a3e-12de29149d7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:58.232950 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c37af-8ef8-4ce1-9a3e-12de29149d7e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:58.251031 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2303/4603] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:19:58.252336 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d898b8-9d31-42ab-a206-23d7e4cbe732 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:58.265651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d898b8-9d31-42ab-a206-23d7e4cbe732 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:58.271996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca29aa5-174e-41cb-802c-c40cfaa9aab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:58.272975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca29aa5-174e-41cb-802c-c40cfaa9aab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:58.273826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca29aa5-174e-41cb-802c-c40cfaa9aab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:58.274226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca29aa5-174e-41cb-802c-c40cfaa9aab8 admin admin] PATH_INFO: `/v3/projects/565cbee261c64e789aa6d06685ca7585/users/c5a177169e324920982a898c0a5d9f23/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:58.290892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c37af-8ef8-4ce1-9a3e-12de29149d7e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:58.293395 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ef0c37af-8ef8-4ce1-9a3e-12de29149d7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:58.317224 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca29aa5-174e-41cb-802c-c40cfaa9aab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=565cbee261c64e789aa6d06685ca7585, user_id=c5a177169e324920982a898c0a5d9f23, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:58.322312 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c37af-8ef8-4ce1-9a3e-12de29149d7e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:58.323292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca29aa5-174e-41cb-802c-c40cfaa9aab8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:58.332275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0179288-a785-44a9-b3b6-b36ee96c47a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:58.332965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0179288-a785-44a9-b3b6-b36ee96c47a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:58.333291 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0179288-a785-44a9-b3b6-b36ee96c47a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:58.333611 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0179288-a785-44a9-b3b6-b36ee96c47a2 admin admin] PATH_INFO: `/v3/projects/9316de81a7ae4066a550c11ca1512ab9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:58.337160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0179288-a785-44a9-b3b6-b36ee96c47a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9316de81a7ae4066a550c11ca1512ab9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:58.337160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0179288-a785-44a9-b3b6-b36ee96c47a2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:58.358143 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2301/4604] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:19:58 2022] PUT /identity/v3/projects/565cbee261c64e789aa6d06685ca7585/users/c5a177169e324920982a898c0a5d9f23/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:58.359715 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487abbe-09a9-4f03-a846-3640fd926407 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:58.359995 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487abbe-09a9-4f03-a846-3640fd926407 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:58.360277 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487abbe-09a9-4f03-a846-3640fd926407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:58.414089 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-9487abbe-09a9-4f03-a846-3640fd926407 None None] MFA Rules not processed for user `c5a177169e324920982a898c0a5d9f23`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:58.419183 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9487abbe-09a9-4f03-a846-3640fd926407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:58.461773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b0179288-a785-44a9-b3b6-b36ee96c47a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9316de81a7ae4066a550c11ca1512ab9', 'request_id': 'req-b0179288-a785-44a9-b3b6-b36ee96c47a2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:58.480531 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:58.486143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b0179288-a785-44a9-b3b6-b36ee96c47a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9316de81a7ae4066a550c11ca1512ab9', 'request_id': 'req-b0179288-a785-44a9-b3b6-b36ee96c47a2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:58.501153 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b0179288-a785-44a9-b3b6-b36ee96c47a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9316de81a7ae4066a550c11ca1512ab9', 'request_id': 'req-b0179288-a785-44a9-b3b6-b36ee96c47a2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:58.523865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b0179288-a785-44a9-b3b6-b36ee96c47a2 admin admin] The token cache is being invalidate because project 9316de81a7ae4066a550c11ca1512ab9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:19:58.524173 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b0179288-a785-44a9-b3b6-b36ee96c47a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:58.524941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b0179288-a785-44a9-b3b6-b36ee96c47a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:58.527621 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2304/4605] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:19:58 2022] DELETE /identity/v3/projects/9316de81a7ae4066a550c11ca1512ab9 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:58.532007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0179288-a785-44a9-b3b6-b36ee96c47a2 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:58.534595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b0179288-a785-44a9-b3b6-b36ee96c47a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:58.548991 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:58.578235 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2302/4606] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:19:58.582483 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9487abbe-09a9-4f03-a846-3640fd926407 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:58.585206 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9487abbe-09a9-4f03-a846-3640fd926407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:58.696126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9487abbe-09a9-4f03-a846-3640fd926407 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:58.703331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca7f04-7f4e-4b61-94bc-5bc95a25d94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:58.703946 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca7f04-7f4e-4b61-94bc-5bc95a25d94f admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:58.704357 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca7f04-7f4e-4b61-94bc-5bc95a25d94f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:58.704632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca7f04-7f4e-4b61-94bc-5bc95a25d94f admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:58.704937 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0179288-a785-44a9-b3b6-b36ee96c47a2 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:58.705280 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca7f04-7f4e-4b61-94bc-5bc95a25d94f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:58.707474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca7f04-7f4e-4b61-94bc-5bc95a25d94f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:58.710807 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe7816-ac8e-4191-b669-fef7d3af7dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:58.711556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe7816-ac8e-4191-b669-fef7d3af7dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:58.711970 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe7816-ac8e-4191-b669-fef7d3af7dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:58.712468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe7816-ac8e-4191-b669-fef7d3af7dca admin admin] PATH_INFO: `/v3/users/843679b5e11a4f438574475b437f06e6` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:58.714116 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe7816-ac8e-4191-b669-fef7d3af7dca admin admin] RBAC: Authorizing `identity:delete_user(user_id=843679b5e11a4f438574475b437f06e6)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:58.717467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe7816-ac8e-4191-b669-fef7d3af7dca admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:58.751208 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2303/4607] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:19:58 2022] POST /identity/v3/projects => generated 373 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:19:58.757348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca7f04-7f4e-4b61-94bc-5bc95a25d94f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:58.784991 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6bbe7816-ac8e-4191-b669-fef7d3af7dca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '843679b5e11a4f438574475b437f06e6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:58.786104 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6bbe7816-ac8e-4191-b669-fef7d3af7dca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '843679b5e11a4f438574475b437f06e6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:58.795221 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6bbe7816-ac8e-4191-b669-fef7d3af7dca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '843679b5e11a4f438574475b437f06e6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:58.810989 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6bbe7816-ac8e-4191-b669-fef7d3af7dca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '843679b5e11a4f438574475b437f06e6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:58.812746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6bbe7816-ac8e-4191-b669-fef7d3af7dca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '843679b5e11a4f438574475b437f06e6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:58.842826 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2305/4608] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:19:58 2022] DELETE /identity/v3/users/843679b5e11a4f438574475b437f06e6 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:58.865776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca7f04-7f4e-4b61-94bc-5bc95a25d94f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:58.952614 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:58.969597 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5c1b2-167e-454e-a2d7-b2f6956c3502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:58.970355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5c1b2-167e-454e-a2d7-b2f6956c3502 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:58.970698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5c1b2-167e-454e-a2d7-b2f6956c3502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:58.975228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5c1b2-167e-454e-a2d7-b2f6956c3502 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:58.976165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5c1b2-167e-454e-a2d7-b2f6956c3502 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:58.978219 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5c1b2-167e-454e-a2d7-b2f6956c3502 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:59.041777 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2304/4609] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:19:58 2022] POST /identity/v3/users => generated 293 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:19:59.044432 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe7816-ac8e-4191-b669-fef7d3af7dca admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:59.046093 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6bbe7816-ac8e-4191-b669-fef7d3af7dca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:59.062780 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe7816-ac8e-4191-b669-fef7d3af7dca admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:59.068303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7d5af-2215-4fe7-bbba-87802dfaa225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:59.068941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7d5af-2215-4fe7-bbba-87802dfaa225 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:59.069226 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7d5af-2215-4fe7-bbba-87802dfaa225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:59.069806 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7d5af-2215-4fe7-bbba-87802dfaa225 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:59.070470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7d5af-2215-4fe7-bbba-87802dfaa225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:59.072087 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7d5af-2215-4fe7-bbba-87802dfaa225 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:59.089305 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2306/4610] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:19:59.093531 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5c1b2-167e-454e-a2d7-b2f6956c3502 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:59.115226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5c1b2-167e-454e-a2d7-b2f6956c3502 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:59.122041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b0b33-99da-45a9-9966-8c77afc56717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:59.123311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b0b33-99da-45a9-9966-8c77afc56717 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:59.123750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b0b33-99da-45a9-9966-8c77afc56717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:59.124179 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b0b33-99da-45a9-9966-8c77afc56717 admin admin] PATH_INFO: `/v3/projects/5225bb4a208949c3b6c2452d63258189/users/80283912a6734370b1fe96717d7940da/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:59.159280 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b0b33-99da-45a9-9966-8c77afc56717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5225bb4a208949c3b6c2452d63258189, user_id=80283912a6734370b1fe96717d7940da, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:59.162931 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b0b33-99da-45a9-9966-8c77afc56717 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:59.192151 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7d5af-2215-4fe7-bbba-87802dfaa225 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:59.201985 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2305/4611] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:19:59 2022] PUT /identity/v3/projects/5225bb4a208949c3b6c2452d63258189/users/80283912a6734370b1fe96717d7940da/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:59.205621 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7d5af-2215-4fe7-bbba-87802dfaa225 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:59.300147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26912a-87a3-426e-9fe4-af7948cdd5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:59.300761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26912a-87a3-426e-9fe4-af7948cdd5cf admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:59.301044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26912a-87a3-426e-9fe4-af7948cdd5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:59.302727 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26912a-87a3-426e-9fe4-af7948cdd5cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:59.302727 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c26912a-87a3-426e-9fe4-af7948cdd5cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:59.303741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c26912a-87a3-426e-9fe4-af7948cdd5cf admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:59.315798 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2307/4612] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:19:59.319934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b0b33-99da-45a9-9966-8c77afc56717 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:59.332072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b0b33-99da-45a9-9966-8c77afc56717 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:59.338179 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87cbe6-42a9-4093-9b4c-2e26ee9d59a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:59.339033 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87cbe6-42a9-4093-9b4c-2e26ee9d59a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:59.339686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87cbe6-42a9-4093-9b4c-2e26ee9d59a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:59.340242 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87cbe6-42a9-4093-9b4c-2e26ee9d59a5 admin admin] PATH_INFO: `/v3/projects/5225bb4a208949c3b6c2452d63258189/users/80283912a6734370b1fe96717d7940da/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:59.343689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87cbe6-42a9-4093-9b4c-2e26ee9d59a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5225bb4a208949c3b6c2452d63258189, user_id=80283912a6734370b1fe96717d7940da, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:59.346881 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87cbe6-42a9-4093-9b4c-2e26ee9d59a5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:59.360530 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2306/4613] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:19:59 2022] PUT /identity/v3/projects/5225bb4a208949c3b6c2452d63258189/users/80283912a6734370b1fe96717d7940da/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:19:59.373569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9770d80-6b81-4457-b46d-f93b4c17f166 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:59.374219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9770d80-6b81-4457-b46d-f93b4c17f166 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:59.374219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9770d80-6b81-4457-b46d-f93b4c17f166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:59.408568 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:59.421647 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-d9770d80-6b81-4457-b46d-f93b4c17f166 None None] MFA Rules not processed for user `80283912a6734370b1fe96717d7940da`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:59.423212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87cbe6-42a9-4093-9b4c-2e26ee9d59a5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:59.424796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7f87cbe6-42a9-4093-9b4c-2e26ee9d59a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:59.440788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d9770d80-6b81-4457-b46d-f93b4c17f166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:59.532446 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87cbe6-42a9-4093-9b4c-2e26ee9d59a5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:59.538135 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b14987-3248-4b11-901b-acf63c3f3aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:59.538895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b14987-3248-4b11-901b-acf63c3f3aa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:59.539277 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b14987-3248-4b11-901b-acf63c3f3aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:59.539653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b14987-3248-4b11-901b-acf63c3f3aa1 admin admin] PATH_INFO: `/v3/projects/fe3a0493ffd244a08c6606d7e4212e13` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:59.540991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b14987-3248-4b11-901b-acf63c3f3aa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe3a0493ffd244a08c6606d7e4212e13)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:59.543650 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b14987-3248-4b11-901b-acf63c3f3aa1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:59.588334 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2308/4614] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:19:59.594442 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9770d80-6b81-4457-b46d-f93b4c17f166 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:59.604572 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-55b14987-3248-4b11-901b-acf63c3f3aa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe3a0493ffd244a08c6606d7e4212e13', 'request_id': 'req-55b14987-3248-4b11-901b-acf63c3f3aa1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:59.605873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9770d80-6b81-4457-b46d-f93b4c17f166 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:59.617930 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-55b14987-3248-4b11-901b-acf63c3f3aa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe3a0493ffd244a08c6606d7e4212e13', 'request_id': 'req-55b14987-3248-4b11-901b-acf63c3f3aa1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:59.628587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-55b14987-3248-4b11-901b-acf63c3f3aa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe3a0493ffd244a08c6606d7e4212e13', 'request_id': 'req-55b14987-3248-4b11-901b-acf63c3f3aa1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:59.648059 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-55b14987-3248-4b11-901b-acf63c3f3aa1 admin admin] The token cache is being invalidate because project fe3a0493ffd244a08c6606d7e4212e13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:19:59.648517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-55b14987-3248-4b11-901b-acf63c3f3aa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:59.649470 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-55b14987-3248-4b11-901b-acf63c3f3aa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:19:59.651465 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2307/4615] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:19:59 2022] DELETE /identity/v3/projects/fe3a0493ffd244a08c6606d7e4212e13 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:19:59.656763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53173573-94cc-42a2-b4ac-41e950ac56d5 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:59.657141 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53173573-94cc-42a2-b4ac-41e950ac56d5 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:59.657721 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53173573-94cc-42a2-b4ac-41e950ac56d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:59.687779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-53173573-94cc-42a2-b4ac-41e950ac56d5 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:59.689190 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-53173573-94cc-42a2-b4ac-41e950ac56d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:59.695278 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f63e1b-25dc-4ab3-8474-fb8e7b785bd5 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80283912a6734370b1fe96717d7940da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5225bb4a208949c3b6c2452d63258189', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:59.696226 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f63e1b-25dc-4ab3-8474-fb8e7b785bd5 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:59.696558 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f63e1b-25dc-4ab3-8474-fb8e7b785bd5 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:59.696839 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f63e1b-25dc-4ab3-8474-fb8e7b785bd5 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] PATH_INFO: `/v3/services` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:59.697629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f63e1b-25dc-4ab3-8474-fb8e7b785bd5 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:59.698783 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-73f63e1b-25dc-4ab3-8474-fb8e7b785bd5 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:19:59.698783 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:19:59.698783 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:19:59.699788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f63e1b-25dc-4ab3-8474-fb8e7b785bd5 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:59.728766 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2309/4616] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:19:59 2022] POST /identity/v3/services => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:19:59.729921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f63e1b-25dc-4ab3-8474-fb8e7b785bd5 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:59.732560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-73f63e1b-25dc-4ab3-8474-fb8e7b785bd5 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:59.733812 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:59.774988 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f63e1b-25dc-4ab3-8474-fb8e7b785bd5 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:59.785642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c97d7-b812-4d46-9a7b-b504021eb590 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80283912a6734370b1fe96717d7940da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5225bb4a208949c3b6c2452d63258189', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:59.786271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c97d7-b812-4d46-9a7b-b504021eb590 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:59.786550 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c97d7-b812-4d46-9a7b-b504021eb590 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:59.786829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c97d7-b812-4d46-9a7b-b504021eb590 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:59.787669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c97d7-b812-4d46-9a7b-b504021eb590 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:59.789952 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-a29c97d7-b812-4d46-9a7b-b504021eb590 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:19:59.789952 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:19:59.789952 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:19:59.790858 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c97d7-b812-4d46-9a7b-b504021eb590 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:59.791369 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2308/4617] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:19:59.803219 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1823ab-5bce-4c25-af20-f1788ee659e9 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:59.803798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1823ab-5bce-4c25-af20-f1788ee659e9 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:59.804141 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1823ab-5bce-4c25-af20-f1788ee659e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:59.806744 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2310/4618] 10.222.0.30 () {60 vars in 1213 bytes} [Sun Sep 4 01:19:59 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 332 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:19:59.812644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c97d7-b812-4d46-9a7b-b504021eb590 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:59.828048 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-bc1823ab-5bce-4c25-af20-f1788ee659e9 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:19:59.829278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bc1823ab-5bce-4c25-af20-f1788ee659e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:19:59.831078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c97d7-b812-4d46-9a7b-b504021eb590 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:59.836718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6720b57-2647-4eb0-991c-ee0c53ac5a13 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80283912a6734370b1fe96717d7940da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5225bb4a208949c3b6c2452d63258189', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:59.837829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6720b57-2647-4eb0-991c-ee0c53ac5a13 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:59.838405 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6720b57-2647-4eb0-991c-ee0c53ac5a13 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:59.842395 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2309/4619] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:19:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:19:59.842534 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6720b57-2647-4eb0-991c-ee0c53ac5a13 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] PATH_INFO: `/v3/services` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:59.842534 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6720b57-2647-4eb0-991c-ee0c53ac5a13 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:59.844116 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6720b57-2647-4eb0-991c-ee0c53ac5a13 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:59.846432 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1823ab-5bce-4c25-af20-f1788ee659e9 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:59.863690 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1823ab-5bce-4c25-af20-f1788ee659e9 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:59.868815 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2311/4620] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:19:59 2022] POST /identity/v3/services => generated 288 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:19:59.872853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6720b57-2647-4eb0-991c-ee0c53ac5a13 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:59.896693 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda012a-6fcc-4dc9-b6d3-d96f82b77f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:59.898439 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda012a-6fcc-4dc9-b6d3-d96f82b77f31 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:59.899290 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda012a-6fcc-4dc9-b6d3-d96f82b77f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:59.899768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda012a-6fcc-4dc9-b6d3-d96f82b77f31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:59.899888 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6720b57-2647-4eb0-991c-ee0c53ac5a13 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:59.900943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda012a-6fcc-4dc9-b6d3-d96f82b77f31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:19:59.901631 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda012a-6fcc-4dc9-b6d3-d96f82b77f31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:59.904359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda012a-6fcc-4dc9-b6d3-d96f82b77f31 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:59.905363 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa220c54-9077-4d7e-9016-b98a67a23c7c tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80283912a6734370b1fe96717d7940da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5225bb4a208949c3b6c2452d63258189', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:59.906017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa220c54-9077-4d7e-9016-b98a67a23c7c tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:59.906444 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa220c54-9077-4d7e-9016-b98a67a23c7c tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:59.906726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa220c54-9077-4d7e-9016-b98a67a23c7c tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:59.907389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa220c54-9077-4d7e-9016-b98a67a23c7c tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:59.909000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa220c54-9077-4d7e-9016-b98a67a23c7c tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:59.923344 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2312/4621] 10.222.0.30 () {60 vars in 1213 bytes} [Sun Sep 4 01:19:59 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 331 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:19:59.927759 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2310/4622] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:19:59.928070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa220c54-9077-4d7e-9016-b98a67a23c7c tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:59.929941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda012a-6fcc-4dc9-b6d3-d96f82b77f31 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:59.941586 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda012a-6fcc-4dc9-b6d3-d96f82b77f31 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:59.945453 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa220c54-9077-4d7e-9016-b98a67a23c7c tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:19:59.961824 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a147f-113a-46d6-b09f-e5e349cd874f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:59.962452 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a147f-113a-46d6-b09f-e5e349cd874f admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:59.962705 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697007df-9c19-4814-97c2-ef7744b98e60 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80283912a6734370b1fe96717d7940da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5225bb4a208949c3b6c2452d63258189', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:19:59.962858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a147f-113a-46d6-b09f-e5e349cd874f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:59.963036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a147f-113a-46d6-b09f-e5e349cd874f admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:59.963332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697007df-9c19-4814-97c2-ef7744b98e60 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:19:59.963613 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697007df-9c19-4814-97c2-ef7744b98e60 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:19:59.963725 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a147f-113a-46d6-b09f-e5e349cd874f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:59.963934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697007df-9c19-4814-97c2-ef7744b98e60 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:19:59.965037 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697007df-9c19-4814-97c2-ef7744b98e60 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:19:59.966085 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-697007df-9c19-4814-97c2-ef7744b98e60 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:19:59.966085 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:19:59.966085 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:19:59.966317 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a147f-113a-46d6-b09f-e5e349cd874f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:59.966965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697007df-9c19-4814-97c2-ef7744b98e60 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:19:59.975510 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2313/4623] 10.222.0.30 () {58 vars in 1191 bytes} [Sun Sep 4 01:19:59 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 761 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:19:59.979709 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697007df-9c19-4814-97c2-ef7744b98e60 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:19:59.993616 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697007df-9c19-4814-97c2-ef7744b98e60 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:00.000155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649db24-04e3-4b37-a2ba-0176d6566478 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80283912a6734370b1fe96717d7940da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5225bb4a208949c3b6c2452d63258189', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:00.000904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649db24-04e3-4b37-a2ba-0176d6566478 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:00.001608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649db24-04e3-4b37-a2ba-0176d6566478 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:00.001984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649db24-04e3-4b37-a2ba-0176d6566478 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/5257d604b47e4dbc9ffa3ca0c9bfc2b4` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:00.003101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4649db24-04e3-4b37-a2ba-0176d6566478 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=5257d604b47e4dbc9ffa3ca0c9bfc2b4)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:00.004082 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-4649db24-04e3-4b37-a2ba-0176d6566478 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:00.004082 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:20:00.004082 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:20:00.005212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4649db24-04e3-4b37-a2ba-0176d6566478 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:00.017603 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2314/4624] 10.222.0.30 () {58 vars in 1290 bytes} [Sun Sep 4 01:19:59 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/5257d604b47e4dbc9ffa3ca0c9bfc2b4 => generated 331 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:20:00.018600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649db24-04e3-4b37-a2ba-0176d6566478 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:00.020439 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2311/4625] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:19:59 2022] POST /identity/v3/projects => generated 387 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:00.025718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a147f-113a-46d6-b09f-e5e349cd874f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:00.034263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649db24-04e3-4b37-a2ba-0176d6566478 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:00.062789 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:00.133737 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a23a7-c019-49f8-a289-b566ac15712f tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80283912a6734370b1fe96717d7940da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5225bb4a208949c3b6c2452d63258189', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:00.134884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a23a7-c019-49f8-a289-b566ac15712f tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:00.134884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a23a7-c019-49f8-a289-b566ac15712f tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:00.135926 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a23a7-c019-49f8-a289-b566ac15712f tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/5257d604b47e4dbc9ffa3ca0c9bfc2b4` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:00.137199 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a23a7-c019-49f8-a289-b566ac15712f tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=5257d604b47e4dbc9ffa3ca0c9bfc2b4)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:00.138700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a147f-113a-46d6-b09f-e5e349cd874f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:00.139212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a23a7-c019-49f8-a289-b566ac15712f tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:00.146772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187925d0-a5a9-4e12-ba3e-68b24c5bcc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:00.147640 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187925d0-a5a9-4e12-ba3e-68b24c5bcc08 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:00.148086 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187925d0-a5a9-4e12-ba3e-68b24c5bcc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:00.148507 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187925d0-a5a9-4e12-ba3e-68b24c5bcc08 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:00.152390 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2315/4626] 10.222.0.30 () {58 vars in 1291 bytes} [Sun Sep 4 01:20:00 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/5257d604b47e4dbc9ffa3ca0c9bfc2b4 => generated 0 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Sep 04 01:20:00.152932 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187925d0-a5a9-4e12-ba3e-68b24c5bcc08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:00.155630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187925d0-a5a9-4e12-ba3e-68b24c5bcc08 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:00.160438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a23a7-c019-49f8-a289-b566ac15712f tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:00.194265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a23a7-c019-49f8-a289-b566ac15712f tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:00.208586 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2312/4627] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:20:00 2022] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:00.212428 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187925d0-a5a9-4e12-ba3e-68b24c5bcc08 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:00.222366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fec6a-e4d5-4140-930a-4559cb9bebc5 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80283912a6734370b1fe96717d7940da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5225bb4a208949c3b6c2452d63258189', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:00.224410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fec6a-e4d5-4140-930a-4559cb9bebc5 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:00.225050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fec6a-e4d5-4140-930a-4559cb9bebc5 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:00.227916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fec6a-e4d5-4140-930a-4559cb9bebc5 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/5257d604b47e4dbc9ffa3ca0c9bfc2b4` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:00.228846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fec6a-e4d5-4140-930a-4559cb9bebc5 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=5257d604b47e4dbc9ffa3ca0c9bfc2b4)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:00.232149 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-3c2fec6a-e4d5-4140-930a-4559cb9bebc5 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:00.232149 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:20:00.232149 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:20:00.235065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fec6a-e4d5-4140-930a-4559cb9bebc5 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:00.255188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187925d0-a5a9-4e12-ba3e-68b24c5bcc08 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:00.256027 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2316/4628] 10.222.0.30 () {58 vars in 1293 bytes} [Sun Sep 4 01:20:00 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/5257d604b47e4dbc9ffa3ca0c9bfc2b4 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:00.260129 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fec6a-e4d5-4140-930a-4559cb9bebc5 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:00.273956 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a004f-45fc-44b2-b2dc-39f2d24601be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:00.274781 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a004f-45fc-44b2-b2dc-39f2d24601be admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:00.275732 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a004f-45fc-44b2-b2dc-39f2d24601be admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:00.275996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fec6a-e4d5-4140-930a-4559cb9bebc5 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:00.280684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a004f-45fc-44b2-b2dc-39f2d24601be admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:00.280684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a004f-45fc-44b2-b2dc-39f2d24601be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:00.286696 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c69cba1-2637-4f3a-8d3a-973beffdceac tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80283912a6734370b1fe96717d7940da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5225bb4a208949c3b6c2452d63258189', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:00.287608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69cba1-2637-4f3a-8d3a-973beffdceac tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:00.287749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69cba1-2637-4f3a-8d3a-973beffdceac tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:00.288173 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69cba1-2637-4f3a-8d3a-973beffdceac tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:00.288867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c69cba1-2637-4f3a-8d3a-973beffdceac tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:00.290778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c69cba1-2637-4f3a-8d3a-973beffdceac tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:00.291673 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a004f-45fc-44b2-b2dc-39f2d24601be admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:00.298265 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2317/4629] 10.222.0.30 () {58 vars in 1191 bytes} [Sun Sep 4 01:20:00 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 449 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:20:00.302292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c69cba1-2637-4f3a-8d3a-973beffdceac tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:00.315851 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2313/4630] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:20:00.317038 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a004f-45fc-44b2-b2dc-39f2d24601be admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:00.319404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3a7a004f-45fc-44b2-b2dc-39f2d24601be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:00.329246 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c69cba1-2637-4f3a-8d3a-973beffdceac tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:00.334520 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a004f-45fc-44b2-b2dc-39f2d24601be admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:00.339981 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e3120-a807-446d-a207-c140ecccf47c tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80283912a6734370b1fe96717d7940da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5225bb4a208949c3b6c2452d63258189', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:00.341089 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e3120-a807-446d-a207-c140ecccf47c tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:00.341376 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e3120-a807-446d-a207-c140ecccf47c tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:00.341735 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e3120-a807-446d-a207-c140ecccf47c tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/5257d604b47e4dbc9ffa3ca0c9bfc2b4` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:00.342457 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa02257-178a-403b-8948-2a52f60f6b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:00.342768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e3120-a807-446d-a207-c140ecccf47c tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=5257d604b47e4dbc9ffa3ca0c9bfc2b4)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:00.343360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa02257-178a-403b-8948-2a52f60f6b6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:00.343815 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa02257-178a-403b-8948-2a52f60f6b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:00.344188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa02257-178a-403b-8948-2a52f60f6b6c admin admin] PATH_INFO: `/v3/users/67e3cf174c3345088e0d1a11ae0bf294` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:00.345357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e3120-a807-446d-a207-c140ecccf47c tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:00.352624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa02257-178a-403b-8948-2a52f60f6b6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=67e3cf174c3345088e0d1a11ae0bf294)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:00.354098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa02257-178a-403b-8948-2a52f60f6b6c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:00.371502 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-ad2e3120-a807-446d-a207-c140ecccf47c tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] Could not find Endpoint Group: 5257d604b47e4dbc9ffa3ca0c9bfc2b4.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 5257d604b47e4dbc9ffa3ca0c9bfc2b4. Sep 04 01:20:00.371502 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:20:00.371502 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:20:00.371502 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:20:00.371502 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:20:00.371502 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:20:00.371502 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:20:00.371502 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:20:00.371502 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:20:00.371502 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:20:00.371502 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:20:00.371502 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:20:00.371502 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Sep 04 01:20:00.371502 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Sep 04 01:20:00.372632 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Sep 04 01:20:00.372632 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Sep 04 01:20:00.372632 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Sep 04 01:20:00.372632 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Sep 04 01:20:00.372632 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 5257d604b47e4dbc9ffa3ca0c9bfc2b4. Sep 04 01:20:00.372632 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:20:00.374832 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2318/4631] 10.222.0.30 () {58 vars in 1293 bytes} [Sun Sep 4 01:20:00 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/5257d604b47e4dbc9ffa3ca0c9bfc2b4 => generated 120 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:20:00.375688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e3120-a807-446d-a207-c140ecccf47c tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:00.398545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e3120-a807-446d-a207-c140ecccf47c tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:00.410214 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b5304-e3da-4e6f-abf2-e9c928b9488a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:00.411010 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b5304-e3da-4e6f-abf2-e9c928b9488a admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:00.411357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b5304-e3da-4e6f-abf2-e9c928b9488a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:00.411698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b5304-e3da-4e6f-abf2-e9c928b9488a admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:00.412404 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b5304-e3da-4e6f-abf2-e9c928b9488a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:00.414425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b5304-e3da-4e6f-abf2-e9c928b9488a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:00.424887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5aa02257-178a-403b-8948-2a52f60f6b6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67e3cf174c3345088e0d1a11ae0bf294'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:00.425827 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5aa02257-178a-403b-8948-2a52f60f6b6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67e3cf174c3345088e0d1a11ae0bf294'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:00.430818 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2319/4632] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:20:00.431682 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:00.433672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b5304-e3da-4e6f-abf2-e9c928b9488a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:00.437791 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b71b5304-e3da-4e6f-abf2-e9c928b9488a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:00.438942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5aa02257-178a-403b-8948-2a52f60f6b6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67e3cf174c3345088e0d1a11ae0bf294'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:00.456862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5aa02257-178a-403b-8948-2a52f60f6b6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67e3cf174c3345088e0d1a11ae0bf294'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:00.458704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5aa02257-178a-403b-8948-2a52f60f6b6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67e3cf174c3345088e0d1a11ae0bf294'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:00.472578 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b5304-e3da-4e6f-abf2-e9c928b9488a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:00.482554 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5506f-6762-4f4d-a167-eb07e2da75fb tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80283912a6734370b1fe96717d7940da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5225bb4a208949c3b6c2452d63258189', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:00.483201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5506f-6762-4f4d-a167-eb07e2da75fb tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:00.483912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5506f-6762-4f4d-a167-eb07e2da75fb tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:00.484921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5506f-6762-4f4d-a167-eb07e2da75fb tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] PATH_INFO: `/v3/services/c56ea2d8cea44bbf9d810663fdb420ae` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:00.485697 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5506f-6762-4f4d-a167-eb07e2da75fb tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorizing `identity:delete_service(service_id=c56ea2d8cea44bbf9d810663fdb420ae)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:00.487028 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-49c5506f-6762-4f4d-a167-eb07e2da75fb tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:00.487028 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:20:00.487028 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:20:00.488087 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5506f-6762-4f4d-a167-eb07e2da75fb tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:00.494978 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2314/4633] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:20:00 2022] DELETE /identity/v3/users/67e3cf174c3345088e0d1a11ae0bf294 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:00.496663 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa02257-178a-403b-8948-2a52f60f6b6c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:00.498409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5aa02257-178a-403b-8948-2a52f60f6b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:00.532713 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2320/4634] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:20:00 2022] DELETE /identity/v3/services/c56ea2d8cea44bbf9d810663fdb420ae => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:00.538316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd11fab-8846-4de2-8ade-aa13217a2765 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:00.538602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd11fab-8846-4de2-8ade-aa13217a2765 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:00.538987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd11fab-8846-4de2-8ade-aa13217a2765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:00.566627 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-8bd11fab-8846-4de2-8ade-aa13217a2765 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:00.568218 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8bd11fab-8846-4de2-8ade-aa13217a2765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:00.610965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa02257-178a-403b-8948-2a52f60f6b6c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:00.643073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033187e5-37c0-48e8-897b-36589f6a7012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:00.643739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033187e5-37c0-48e8-897b-36589f6a7012 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:00.644018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033187e5-37c0-48e8-897b-36589f6a7012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:00.644298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033187e5-37c0-48e8-897b-36589f6a7012 admin admin] PATH_INFO: `/v3/projects/90a75f0c45a04136a9b802211902b918/users/b9c9d301ba5041048f72484964f5dd96/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:00.666209 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033187e5-37c0-48e8-897b-36589f6a7012 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90a75f0c45a04136a9b802211902b918, user_id=b9c9d301ba5041048f72484964f5dd96, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:00.670450 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033187e5-37c0-48e8-897b-36589f6a7012 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:00.685188 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2321/4635] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:00.689408 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd11fab-8846-4de2-8ade-aa13217a2765 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:00.720521 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2315/4636] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:20:00 2022] PUT /identity/v3/projects/90a75f0c45a04136a9b802211902b918/users/b9c9d301ba5041048f72484964f5dd96/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:00.722369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033187e5-37c0-48e8-897b-36589f6a7012 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:00.732500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-033187e5-37c0-48e8-897b-36589f6a7012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:00.821959 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:00.846008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033187e5-37c0-48e8-897b-36589f6a7012 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:00.846731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd11fab-8846-4de2-8ade-aa13217a2765 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:00.872689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56b612-0294-484f-97c6-1f69f87102b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:00.873644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56b612-0294-484f-97c6-1f69f87102b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:00.874308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56b612-0294-484f-97c6-1f69f87102b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:00.874969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56b612-0294-484f-97c6-1f69f87102b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:00.943171 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7498cb0-9443-443b-872c-2b2dec359179 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80283912a6734370b1fe96717d7940da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5225bb4a208949c3b6c2452d63258189', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:00.943838 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7498cb0-9443-443b-872c-2b2dec359179 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:00.944124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7498cb0-9443-443b-872c-2b2dec359179 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:00.944422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7498cb0-9443-443b-872c-2b2dec359179 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] PATH_INFO: `/v3/services` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:00.945074 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7498cb0-9443-443b-872c-2b2dec359179 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:00.946750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7498cb0-9443-443b-872c-2b2dec359179 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:00.990732 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2322/4637] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:20:00 2022] POST /identity/v3/services => generated 288 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:00.990732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c22e48-8057-464b-b4ff-c7f57c44b3e4 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:00.990732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c22e48-8057-464b-b4ff-c7f57c44b3e4 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:00.990732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c22e48-8057-464b-b4ff-c7f57c44b3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:00.994439 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:01.023400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56b612-0294-484f-97c6-1f69f87102b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:01.025246 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56b612-0294-484f-97c6-1f69f87102b5 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:01.027824 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-90c22e48-8057-464b-b4ff-c7f57c44b3e4 None None] MFA Rules not processed for user `b9c9d301ba5041048f72484964f5dd96`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:01.029456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-90c22e48-8057-464b-b4ff-c7f57c44b3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:01.044330 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2316/4638] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:20:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:20:01.045142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56b612-0294-484f-97c6-1f69f87102b5 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:01.069664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56b612-0294-484f-97c6-1f69f87102b5 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:01.102710 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb42666-a259-4fd8-995e-22eb624beef4 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80283912a6734370b1fe96717d7940da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5225bb4a208949c3b6c2452d63258189', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:01.104366 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb42666-a259-4fd8-995e-22eb624beef4 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:01.105891 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb42666-a259-4fd8-995e-22eb624beef4 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:01.106829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb42666-a259-4fd8-995e-22eb624beef4 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:01.108122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb42666-a259-4fd8-995e-22eb624beef4 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:01.113128 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-ddb42666-a259-4fd8-995e-22eb624beef4 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:01.113128 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:20:01.113128 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:20:01.116938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb42666-a259-4fd8-995e-22eb624beef4 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:01.118114 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2323/4639] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:00 2022] POST /identity/v3/auth/tokens => generated 3531 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:01.135343 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2317/4640] 10.222.0.30 () {60 vars in 1213 bytes} [Sun Sep 4 01:20:01 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 332 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:01.137765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c22e48-8057-464b-b4ff-c7f57c44b3e4 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:01.150255 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c22e48-8057-464b-b4ff-c7f57c44b3e4 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:01.157572 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb42666-a259-4fd8-995e-22eb624beef4 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:01.169182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9554df-e199-4f67-8784-36504178a4ba tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80283912a6734370b1fe96717d7940da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5225bb4a208949c3b6c2452d63258189', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:01.170347 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9554df-e199-4f67-8784-36504178a4ba tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:01.170347 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9554df-e199-4f67-8784-36504178a4ba tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:01.172384 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9554df-e199-4f67-8784-36504178a4ba tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] PATH_INFO: `/v3/services` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:01.173118 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9554df-e199-4f67-8784-36504178a4ba tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:01.176346 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9554df-e199-4f67-8784-36504178a4ba tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:01.190920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb42666-a259-4fd8-995e-22eb624beef4 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:01.201629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837d28b-84a1-4a82-a515-58462993bbf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:01.202564 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837d28b-84a1-4a82-a515-58462993bbf6 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:01.202947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837d28b-84a1-4a82-a515-58462993bbf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:01.203319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837d28b-84a1-4a82-a515-58462993bbf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:01.205477 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2324/4641] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:20:01 2022] POST /identity/v3/services => generated 288 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:01.210311 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9554df-e199-4f67-8784-36504178a4ba tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:01.223875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2837d28b-84a1-4a82-a515-58462993bbf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:01.225837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2837d28b-84a1-4a82-a515-58462993bbf6 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:01.235445 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9554df-e199-4f67-8784-36504178a4ba tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:01.245280 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2318/4642] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:20:01 2022] GET /identity/v3/auth/tokens => generated 3531 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:20:01.247593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f321c-6067-4861-830f-f1b43d86c943 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80283912a6734370b1fe96717d7940da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5225bb4a208949c3b6c2452d63258189', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:01.248308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f321c-6067-4861-830f-f1b43d86c943 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:01.248658 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f321c-6067-4861-830f-f1b43d86c943 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:01.249004 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f321c-6067-4861-830f-f1b43d86c943 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/89a22fbdf4d24328bd2420857762dc73` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:01.249787 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f321c-6067-4861-830f-f1b43d86c943 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=89a22fbdf4d24328bd2420857762dc73)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:01.251193 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-e86f321c-6067-4861-830f-f1b43d86c943 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:01.251193 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:20:01.251193 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:20:01.251920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f321c-6067-4861-830f-f1b43d86c943 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:01.268365 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2325/4643] 10.222.0.30 () {60 vars in 1313 bytes} [Sun Sep 4 01:20:01 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/89a22fbdf4d24328bd2420857762dc73 => generated 336 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:20:01.271493 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837d28b-84a1-4a82-a515-58462993bbf6 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:01.289345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837d28b-84a1-4a82-a515-58462993bbf6 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:01.297713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9a36f-b558-46b2-b517-bd9a7d91263f tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80283912a6734370b1fe96717d7940da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5225bb4a208949c3b6c2452d63258189', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:01.299064 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9a36f-b558-46b2-b517-bd9a7d91263f tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:01.299171 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9a36f-b558-46b2-b517-bd9a7d91263f tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:01.299544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9a36f-b558-46b2-b517-bd9a7d91263f tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] PATH_INFO: `/v3/services/341130e7ff944ad28fca2a61cf35b5c0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:01.300196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb9a36f-b558-46b2-b517-bd9a7d91263f tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorizing `identity:delete_service(service_id=341130e7ff944ad28fca2a61cf35b5c0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:01.301910 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-2fb9a36f-b558-46b2-b517-bd9a7d91263f tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:01.301910 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:20:01.301910 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:20:01.304405 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb9a36f-b558-46b2-b517-bd9a7d91263f tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:01.355943 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2319/4644] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:20:01 2022] DELETE /identity/v3/services/341130e7ff944ad28fca2a61cf35b5c0 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:01.357543 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f321c-6067-4861-830f-f1b43d86c943 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:01.371103 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f321c-6067-4861-830f-f1b43d86c943 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:01.391619 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffb5fb-a41f-4b8a-a20a-12cbae289196 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80283912a6734370b1fe96717d7940da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5225bb4a208949c3b6c2452d63258189', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:01.392632 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffb5fb-a41f-4b8a-a20a-12cbae289196 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:01.393395 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffb5fb-a41f-4b8a-a20a-12cbae289196 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:01.393693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffb5fb-a41f-4b8a-a20a-12cbae289196 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/89a22fbdf4d24328bd2420857762dc73` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:01.394968 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ffb5fb-a41f-4b8a-a20a-12cbae289196 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=89a22fbdf4d24328bd2420857762dc73)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:01.396812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ffb5fb-a41f-4b8a-a20a-12cbae289196 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:01.398777 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624d252-f71e-4a3e-90df-5a0d31582d1c None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:01.399131 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624d252-f71e-4a3e-90df-5a0d31582d1c None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:01.399478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624d252-f71e-4a3e-90df-5a0d31582d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:01.429587 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2326/4645] 10.222.0.30 () {58 vars in 1293 bytes} [Sun Sep 4 01:20:01 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/89a22fbdf4d24328bd2420857762dc73 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:01.433891 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffb5fb-a41f-4b8a-a20a-12cbae289196 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:01.463664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-8624d252-f71e-4a3e-90df-5a0d31582d1c None None] MFA Rules not processed for user `801ea22245104e7da6366b14379adad3`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:01.465730 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8624d252-f71e-4a3e-90df-5a0d31582d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:01.477896 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffb5fb-a41f-4b8a-a20a-12cbae289196 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:01.488927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb868ca-daf7-49a5-938e-8601e4d916b2 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80283912a6734370b1fe96717d7940da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5225bb4a208949c3b6c2452d63258189', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:01.489628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb868ca-daf7-49a5-938e-8601e4d916b2 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:01.490223 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb868ca-daf7-49a5-938e-8601e4d916b2 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:01.490338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb868ca-daf7-49a5-938e-8601e4d916b2 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] PATH_INFO: `/v3/services/79663dbf5e4b4384aca257d118bfbbb5` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:01.491610 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb868ca-daf7-49a5-938e-8601e4d916b2 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorizing `identity:delete_service(service_id=79663dbf5e4b4384aca257d118bfbbb5)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:01.496296 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb868ca-daf7-49a5-938e-8601e4d916b2 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:01.527125 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:01.537479 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2327/4646] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:20:01 2022] DELETE /identity/v3/services/79663dbf5e4b4384aca257d118bfbbb5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:01.543156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb868ca-daf7-49a5-938e-8601e4d916b2 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:01.593949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb868ca-daf7-49a5-938e-8601e4d916b2 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:01.601685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6e1c7-a1a0-4b21-bc33-0d1614ae9b99 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80283912a6734370b1fe96717d7940da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5225bb4a208949c3b6c2452d63258189', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:01.602830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6e1c7-a1a0-4b21-bc33-0d1614ae9b99 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:01.603219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6e1c7-a1a0-4b21-bc33-0d1614ae9b99 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:01.603575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6e1c7-a1a0-4b21-bc33-0d1614ae9b99 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/fab771b20abd44399a1bad0fd8ec1938` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:01.604322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b6e1c7-a1a0-4b21-bc33-0d1614ae9b99 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=fab771b20abd44399a1bad0fd8ec1938)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:01.606862 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b6e1c7-a1a0-4b21-bc33-0d1614ae9b99 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:01.632186 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2320/4647] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:01 2022] POST /identity/v3/auth/tokens => generated 3389 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:20:01.633003 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2328/4648] 10.222.0.30 () {58 vars in 1293 bytes} [Sun Sep 4 01:20:01 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/fab771b20abd44399a1bad0fd8ec1938 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:01.637398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624d252-f71e-4a3e-90df-5a0d31582d1c None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:01.642785 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f635f-8d0b-4811-abdf-c68c6659060f None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:01.643495 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f635f-8d0b-4811-abdf-c68c6659060f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:01.644055 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f635f-8d0b-4811-abdf-c68c6659060f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:01.651490 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624d252-f71e-4a3e-90df-5a0d31582d1c None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:01.659439 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf2864-b524-4cde-bfb1-4cf32a58c593 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80283912a6734370b1fe96717d7940da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5225bb4a208949c3b6c2452d63258189', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:01.660924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf2864-b524-4cde-bfb1-4cf32a58c593 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:01.661231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf2864-b524-4cde-bfb1-4cf32a58c593 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:01.661705 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf2864-b524-4cde-bfb1-4cf32a58c593 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] PATH_INFO: `/v3/services/d495a8f5787d40569dcde70dc3169430` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:01.662830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf2864-b524-4cde-bfb1-4cf32a58c593 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorizing `identity:delete_service(service_id=d495a8f5787d40569dcde70dc3169430)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:01.664659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf2864-b524-4cde-bfb1-4cf32a58c593 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:01.701584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-6e6f635f-8d0b-4811-abdf-c68c6659060f None None] MFA Rules not processed for user `801ea22245104e7da6366b14379adad3`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:01.703296 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6e6f635f-8d0b-4811-abdf-c68c6659060f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:01.707120 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2321/4649] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:20:01 2022] DELETE /identity/v3/services/d495a8f5787d40569dcde70dc3169430 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:01.711236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf2864-b524-4cde-bfb1-4cf32a58c593 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:01.712967 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-facf2864-b524-4cde-bfb1-4cf32a58c593 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:01.743404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf2864-b524-4cde-bfb1-4cf32a58c593 tempest-EndPointGroupsTest-1374794605 tempest-EndPointGroupsTest-1374794605-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:01.749320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fba9f-b47a-412f-8de8-5d955dbeafc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:01.750100 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fba9f-b47a-412f-8de8-5d955dbeafc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:01.750443 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fba9f-b47a-412f-8de8-5d955dbeafc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:01.750780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fba9f-b47a-412f-8de8-5d955dbeafc0 admin admin] PATH_INFO: `/v3/users/c5a177169e324920982a898c0a5d9f23` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:01.751175 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2329/4650] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:01.752075 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8fba9f-b47a-412f-8de8-5d955dbeafc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5a177169e324920982a898c0a5d9f23)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:01.754210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8fba9f-b47a-412f-8de8-5d955dbeafc0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:01.824906 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:01.861187 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6f8fba9f-b47a-412f-8de8-5d955dbeafc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5a177169e324920982a898c0a5d9f23'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:01.878524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f635f-8d0b-4811-abdf-c68c6659060f None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:01.880139 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6e6f635f-8d0b-4811-abdf-c68c6659060f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:01.884558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6f8fba9f-b47a-412f-8de8-5d955dbeafc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5a177169e324920982a898c0a5d9f23'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:01.914131 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f635f-8d0b-4811-abdf-c68c6659060f None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:01.914952 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6f8fba9f-b47a-412f-8de8-5d955dbeafc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5a177169e324920982a898c0a5d9f23'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:01.923854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc4f46-8009-4116-9f13-9ec8958b0a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:01.925002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc4f46-8009-4116-9f13-9ec8958b0a32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:01.925479 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc4f46-8009-4116-9f13-9ec8958b0a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:01.926096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc4f46-8009-4116-9f13-9ec8958b0a32 admin admin] PATH_INFO: `/v3/projects/77104cc2596249759f889b99254dfd4b` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:01.927643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc4f46-8009-4116-9f13-9ec8958b0a32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77104cc2596249759f889b99254dfd4b)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:01.930049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc4f46-8009-4116-9f13-9ec8958b0a32 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:01.935442 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6f8fba9f-b47a-412f-8de8-5d955dbeafc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5a177169e324920982a898c0a5d9f23'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:01.936456 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6f8fba9f-b47a-412f-8de8-5d955dbeafc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5a177169e324920982a898c0a5d9f23'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:01.975584 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2322/4651] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:20:01 2022] DELETE /identity/v3/users/c5a177169e324920982a898c0a5d9f23 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:20:01.983250 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18326f1-70f0-4538-b9fc-c4a5e1bbf192 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:01.983643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18326f1-70f0-4538-b9fc-c4a5e1bbf192 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:01.984200 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18326f1-70f0-4538-b9fc-c4a5e1bbf192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:02.010387 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-f18326f1-70f0-4538-b9fc-c4a5e1bbf192 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:02.012101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f18326f1-70f0-4538-b9fc-c4a5e1bbf192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:02.025615 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c2fc4f46-8009-4116-9f13-9ec8958b0a32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77104cc2596249759f889b99254dfd4b', 'request_id': 'req-c2fc4f46-8009-4116-9f13-9ec8958b0a32'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:02.049388 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c2fc4f46-8009-4116-9f13-9ec8958b0a32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77104cc2596249759f889b99254dfd4b', 'request_id': 'req-c2fc4f46-8009-4116-9f13-9ec8958b0a32'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:02.058368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c2fc4f46-8009-4116-9f13-9ec8958b0a32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77104cc2596249759f889b99254dfd4b', 'request_id': 'req-c2fc4f46-8009-4116-9f13-9ec8958b0a32'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:02.081893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c2fc4f46-8009-4116-9f13-9ec8958b0a32 admin admin] The token cache is being invalidate because project 77104cc2596249759f889b99254dfd4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:02.083097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c2fc4f46-8009-4116-9f13-9ec8958b0a32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:02.084381 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c2fc4f46-8009-4116-9f13-9ec8958b0a32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:02.086274 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2330/4652] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:20:01 2022] DELETE /identity/v3/projects/77104cc2596249759f889b99254dfd4b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:02.091556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926d027-c6dc-4c6f-9d16-af4b3aeb4d17 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:02.092060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926d027-c6dc-4c6f-9d16-af4b3aeb4d17 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:02.092596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926d027-c6dc-4c6f-9d16-af4b3aeb4d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:02.155316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-9926d027-c6dc-4c6f-9d16-af4b3aeb4d17 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:02.157796 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2323/4653] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:02.159921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9926d027-c6dc-4c6f-9d16-af4b3aeb4d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:02.191652 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2331/4654] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:02.193198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494e69a-90b8-44d5-b837-302f59bbc126 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:02.193320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494e69a-90b8-44d5-b837-302f59bbc126 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:02.193610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494e69a-90b8-44d5-b837-302f59bbc126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:02.197541 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926d027-c6dc-4c6f-9d16-af4b3aeb4d17 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:02.202893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9926d027-c6dc-4c6f-9d16-af4b3aeb4d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:02.253648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e494e69a-90b8-44d5-b837-302f59bbc126 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:02.259812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e494e69a-90b8-44d5-b837-302f59bbc126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:02.285180 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2324/4655] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:02.290644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494e69a-90b8-44d5-b837-302f59bbc126 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:02.314791 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494e69a-90b8-44d5-b837-302f59bbc126 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:02.327734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a980d-96a4-4be0-b594-cb7dee725c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:02.328848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a980d-96a4-4be0-b594-cb7dee725c34 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:02.332467 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a980d-96a4-4be0-b594-cb7dee725c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:02.332467 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a980d-96a4-4be0-b594-cb7dee725c34 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:02.332819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a980d-96a4-4be0-b594-cb7dee725c34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:20:02.333763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a980d-96a4-4be0-b594-cb7dee725c34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:02.339112 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a980d-96a4-4be0-b594-cb7dee725c34 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:02.369649 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2325/4656] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:20:02.372720 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a980d-96a4-4be0-b594-cb7dee725c34 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:02.374297 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926d027-c6dc-4c6f-9d16-af4b3aeb4d17 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:02.387770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff406c3-c014-4036-ae00-5c374cb2ab9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:02.388752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff406c3-c014-4036-ae00-5c374cb2ab9c service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:02.391396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff406c3-c014-4036-ae00-5c374cb2ab9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:02.391889 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff406c3-c014-4036-ae00-5c374cb2ab9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:02.400130 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a980d-96a4-4be0-b594-cb7dee725c34 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:02.411194 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff406c3-c014-4036-ae00-5c374cb2ab9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:02.413164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff406c3-c014-4036-ae00-5c374cb2ab9c service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:02.419411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd7abe-68c0-4085-a6d1-e3f111bb543e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:02.422447 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd7abe-68c0-4085-a6d1-e3f111bb543e admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:02.422917 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd7abe-68c0-4085-a6d1-e3f111bb543e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:02.423795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd7abe-68c0-4085-a6d1-e3f111bb543e admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:02.426952 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd7abe-68c0-4085-a6d1-e3f111bb543e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:02.429800 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2332/4657] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:20:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:20:02.433729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd7abe-68c0-4085-a6d1-e3f111bb543e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:02.500571 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2326/4658] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:20:02 2022] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:02.502123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff406c3-c014-4036-ae00-5c374cb2ab9c service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:02.518510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff406c3-c014-4036-ae00-5c374cb2ab9c service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:02.562791 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:02.600542 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af226ea8-54dd-49bf-a54b-9e0decb21d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:02.601415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af226ea8-54dd-49bf-a54b-9e0decb21d03 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:02.601870 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af226ea8-54dd-49bf-a54b-9e0decb21d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:02.602349 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af226ea8-54dd-49bf-a54b-9e0decb21d03 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:02.603127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af226ea8-54dd-49bf-a54b-9e0decb21d03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:02.606024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af226ea8-54dd-49bf-a54b-9e0decb21d03 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:02.636797 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2333/4659] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:20:02 2022] POST /identity/v3/users => generated 286 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:02.640564 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd7abe-68c0-4085-a6d1-e3f111bb543e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:02.652648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd7abe-68c0-4085-a6d1-e3f111bb543e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:02.658644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252faf09-9d8e-4dc0-b4f6-faa099a7fa3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:02.659139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252faf09-9d8e-4dc0-b4f6-faa099a7fa3c admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:02.659359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252faf09-9d8e-4dc0-b4f6-faa099a7fa3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:02.659656 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252faf09-9d8e-4dc0-b4f6-faa099a7fa3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:02.660709 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252faf09-9d8e-4dc0-b4f6-faa099a7fa3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:02.673298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252faf09-9d8e-4dc0-b4f6-faa099a7fa3c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:02.690174 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2327/4660] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:20:02.694464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af226ea8-54dd-49bf-a54b-9e0decb21d03 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:02.708282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af226ea8-54dd-49bf-a54b-9e0decb21d03 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:02.725853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894e479-100b-4ee0-b27d-02801f7bda0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:02.727116 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894e479-100b-4ee0-b27d-02801f7bda0e admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:02.727512 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894e479-100b-4ee0-b27d-02801f7bda0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:02.727893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894e479-100b-4ee0-b27d-02801f7bda0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:02.728725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894e479-100b-4ee0-b27d-02801f7bda0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:02.731761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894e479-100b-4ee0-b27d-02801f7bda0e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:02.774433 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2334/4661] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:20:02.783640 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252faf09-9d8e-4dc0-b4f6-faa099a7fa3c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:02.797515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252faf09-9d8e-4dc0-b4f6-faa099a7fa3c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:02.803356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3385e-82f3-4100-acb4-73c902d2171b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:02.804494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3385e-82f3-4100-acb4-73c902d2171b admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:02.804916 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3385e-82f3-4100-acb4-73c902d2171b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:02.805364 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3385e-82f3-4100-acb4-73c902d2171b admin admin] PATH_INFO: `/v3/projects/5c32fcd87ae043b2b2602b40943ab8ee/users/bbc84b6123184e7da0e7349972694526/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:02.829345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a3385e-82f3-4100-acb4-73c902d2171b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c32fcd87ae043b2b2602b40943ab8ee, user_id=bbc84b6123184e7da0e7349972694526, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:02.832571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a3385e-82f3-4100-acb4-73c902d2171b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:02.868165 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2328/4662] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:20:02 2022] PUT /identity/v3/projects/5c32fcd87ae043b2b2602b40943ab8ee/users/bbc84b6123184e7da0e7349972694526/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:20:02.869885 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49e07c-e234-4abf-9197-6ceda7e851c1 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:02.870172 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49e07c-e234-4abf-9197-6ceda7e851c1 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:02.870485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49e07c-e234-4abf-9197-6ceda7e851c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:02.931880 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-7f49e07c-e234-4abf-9197-6ceda7e851c1 None None] MFA Rules not processed for user `bbc84b6123184e7da0e7349972694526`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:02.933218 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7f49e07c-e234-4abf-9197-6ceda7e851c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:03.046751 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2335/4663] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:20:03.063744 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3385e-82f3-4100-acb4-73c902d2171b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:03.076001 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-61a3385e-82f3-4100-acb4-73c902d2171b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:03.132273 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49e07c-e234-4abf-9197-6ceda7e851c1 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:03.151838 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:03.207163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3385e-82f3-4100-acb4-73c902d2171b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:03.224474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73581d9e-f6d0-4ade-a059-543fda24abf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:03.224474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73581d9e-f6d0-4ade-a059-543fda24abf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:03.224474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73581d9e-f6d0-4ade-a059-543fda24abf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:03.224474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73581d9e-f6d0-4ade-a059-543fda24abf4 admin admin] PATH_INFO: `/v3/users/c5e369e011cd480baefb5823a833564a` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:03.226456 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73581d9e-f6d0-4ade-a059-543fda24abf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5e369e011cd480baefb5823a833564a)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:03.230826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73581d9e-f6d0-4ade-a059-543fda24abf4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:03.252802 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49e07c-e234-4abf-9197-6ceda7e851c1 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:03.269203 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39c748-3c58-48c5-bda0-3e9150a8c6d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:03.269203 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39c748-3c58-48c5-bda0-3e9150a8c6d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:03.269203 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39c748-3c58-48c5-bda0-3e9150a8c6d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:03.269583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39c748-3c58-48c5-bda0-3e9150a8c6d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:03.283087 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39c748-3c58-48c5-bda0-3e9150a8c6d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:03.285912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39c748-3c58-48c5-bda0-3e9150a8c6d3 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:03.308812 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2336/4664] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:20:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:20:03.407566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-73581d9e-f6d0-4ade-a059-543fda24abf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5e369e011cd480baefb5823a833564a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:03.410611 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-73581d9e-f6d0-4ade-a059-543fda24abf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5e369e011cd480baefb5823a833564a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:03.429178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-73581d9e-f6d0-4ade-a059-543fda24abf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5e369e011cd480baefb5823a833564a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:03.453956 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-73581d9e-f6d0-4ade-a059-543fda24abf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5e369e011cd480baefb5823a833564a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:03.456175 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-73581d9e-f6d0-4ade-a059-543fda24abf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5e369e011cd480baefb5823a833564a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:03.497107 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2329/4665] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:20:03 2022] DELETE /identity/v3/users/c5e369e011cd480baefb5823a833564a => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:03.620449 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39c748-3c58-48c5-bda0-3e9150a8c6d3 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:03.622481 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-dc39c748-3c58-48c5-bda0-3e9150a8c6d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:03.646952 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39c748-3c58-48c5-bda0-3e9150a8c6d3 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:03.682635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73581d9e-f6d0-4ade-a059-543fda24abf4 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:03.690369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-73581d9e-f6d0-4ade-a059-543fda24abf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:03.748775 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:03.778579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e505a-8703-45cd-a55d-885a10aa1d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:03.779462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e505a-8703-45cd-a55d-885a10aa1d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:03.779941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e505a-8703-45cd-a55d-885a10aa1d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:03.780357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e505a-8703-45cd-a55d-885a10aa1d03 admin admin] PATH_INFO: `/v3/projects/565cbee261c64e789aa6d06685ca7585` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:03.781566 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e505a-8703-45cd-a55d-885a10aa1d03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=565cbee261c64e789aa6d06685ca7585)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:03.784132 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e505a-8703-45cd-a55d-885a10aa1d03 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:03.784753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73581d9e-f6d0-4ade-a059-543fda24abf4 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:03.791942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a30a49-ad2b-4107-8c78-cf086fb95c15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:03.793022 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a30a49-ad2b-4107-8c78-cf086fb95c15 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:03.793513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a30a49-ad2b-4107-8c78-cf086fb95c15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:03.794820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a30a49-ad2b-4107-8c78-cf086fb95c15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:03.798771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-96a30a49-ad2b-4107-8c78-cf086fb95c15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:03.855649 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-869e505a-8703-45cd-a55d-885a10aa1d03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '565cbee261c64e789aa6d06685ca7585', 'request_id': 'req-869e505a-8703-45cd-a55d-885a10aa1d03'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:03.867872 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-869e505a-8703-45cd-a55d-885a10aa1d03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '565cbee261c64e789aa6d06685ca7585', 'request_id': 'req-869e505a-8703-45cd-a55d-885a10aa1d03'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:03.877423 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-869e505a-8703-45cd-a55d-885a10aa1d03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '565cbee261c64e789aa6d06685ca7585', 'request_id': 'req-869e505a-8703-45cd-a55d-885a10aa1d03'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:03.903710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-869e505a-8703-45cd-a55d-885a10aa1d03 admin admin] The token cache is being invalidate because project 565cbee261c64e789aa6d06685ca7585 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:03.904258 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-869e505a-8703-45cd-a55d-885a10aa1d03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:03.905586 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-869e505a-8703-45cd-a55d-885a10aa1d03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:03.908031 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2337/4666] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:20:03 2022] DELETE /identity/v3/projects/565cbee261c64e789aa6d06685ca7585 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:03.911921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e505a-8703-45cd-a55d-885a10aa1d03 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:03.913798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-869e505a-8703-45cd-a55d-885a10aa1d03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:03.933536 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a30a49-ad2b-4107-8c78-cf086fb95c15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:03.940139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a30a49-ad2b-4107-8c78-cf086fb95c15 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:03.950051 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:04.012386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e505a-8703-45cd-a55d-885a10aa1d03 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:04.020294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f957a0f-abad-42a3-9218-a293bb664733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:04.020294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f957a0f-abad-42a3-9218-a293bb664733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:04.020294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f957a0f-abad-42a3-9218-a293bb664733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:04.020294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f957a0f-abad-42a3-9218-a293bb664733 admin admin] PATH_INFO: `/v3/users/80283912a6734370b1fe96717d7940da` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:04.020684 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2330/4667] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:20:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:20:04.021035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f957a0f-abad-42a3-9218-a293bb664733 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80283912a6734370b1fe96717d7940da)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:04.021615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a30a49-ad2b-4107-8c78-cf086fb95c15 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:04.025979 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f957a0f-abad-42a3-9218-a293bb664733 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:04.032229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-96a30a49-ad2b-4107-8c78-cf086fb95c15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:04.059262 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a30a49-ad2b-4107-8c78-cf086fb95c15 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:04.156652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7f957a0f-abad-42a3-9218-a293bb664733 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80283912a6734370b1fe96717d7940da'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:04.157846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7f957a0f-abad-42a3-9218-a293bb664733 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80283912a6734370b1fe96717d7940da'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:04.177242 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7f957a0f-abad-42a3-9218-a293bb664733 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80283912a6734370b1fe96717d7940da'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:04.200769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7f957a0f-abad-42a3-9218-a293bb664733 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80283912a6734370b1fe96717d7940da'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:04.201616 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7f957a0f-abad-42a3-9218-a293bb664733 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80283912a6734370b1fe96717d7940da'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:04.207654 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1901d-1465-4403-aee4-7d52fb83f9e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:04.208942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1901d-1465-4403-aee4-7d52fb83f9e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:04.208942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1901d-1465-4403-aee4-7d52fb83f9e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:04.208942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1901d-1465-4403-aee4-7d52fb83f9e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:04.213226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-30d1901d-1465-4403-aee4-7d52fb83f9e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:04.219717 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:04.238490 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2338/4668] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:20:03 2022] DELETE /identity/v3/users/80283912a6734370b1fe96717d7940da => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:20:04.239841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f957a0f-abad-42a3-9218-a293bb664733 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:04.242897 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7f957a0f-abad-42a3-9218-a293bb664733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:04.358626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1901d-1465-4403-aee4-7d52fb83f9e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:04.360094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1901d-1465-4403-aee4-7d52fb83f9e4 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:04.372410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f957a0f-abad-42a3-9218-a293bb664733 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:04.379333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d184f-550a-4806-a2d3-1cde9807d41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:04.381518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d184f-550a-4806-a2d3-1cde9807d41b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:04.381643 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2331/4669] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:20:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:20:04.381728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d184f-550a-4806-a2d3-1cde9807d41b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:04.381728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d184f-550a-4806-a2d3-1cde9807d41b admin admin] PATH_INFO: `/v3/projects/bef2021fa90b4a93a05daa41bf26fe15` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:04.382050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d184f-550a-4806-a2d3-1cde9807d41b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bef2021fa90b4a93a05daa41bf26fe15)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:04.384211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d184f-550a-4806-a2d3-1cde9807d41b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:04.469148 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f03d184f-550a-4806-a2d3-1cde9807d41b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bef2021fa90b4a93a05daa41bf26fe15', 'request_id': 'req-f03d184f-550a-4806-a2d3-1cde9807d41b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:04.478291 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f03d184f-550a-4806-a2d3-1cde9807d41b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bef2021fa90b4a93a05daa41bf26fe15', 'request_id': 'req-f03d184f-550a-4806-a2d3-1cde9807d41b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:04.489725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f03d184f-550a-4806-a2d3-1cde9807d41b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bef2021fa90b4a93a05daa41bf26fe15', 'request_id': 'req-f03d184f-550a-4806-a2d3-1cde9807d41b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:04.502211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f03d184f-550a-4806-a2d3-1cde9807d41b admin admin] The token cache is being invalidate because project bef2021fa90b4a93a05daa41bf26fe15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:04.502623 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f03d184f-550a-4806-a2d3-1cde9807d41b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:04.503417 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f03d184f-550a-4806-a2d3-1cde9807d41b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:04.505158 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2339/4670] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:20:04 2022] DELETE /identity/v3/projects/bef2021fa90b4a93a05daa41bf26fe15 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:04.514359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04201628-37f6-4b75-aef7-b1f808527139 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:04.514846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04201628-37f6-4b75-aef7-b1f808527139 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:04.514846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04201628-37f6-4b75-aef7-b1f808527139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:04.553488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-04201628-37f6-4b75-aef7-b1f808527139 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:04.555155 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-04201628-37f6-4b75-aef7-b1f808527139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:04.674449 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2332/4671] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:04.683864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5dc4a-af12-4847-9b82-7541a6be502e None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:04.684381 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5dc4a-af12-4847-9b82-7541a6be502e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:04.684581 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5dc4a-af12-4847-9b82-7541a6be502e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:04.718349 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-b7c5dc4a-af12-4847-9b82-7541a6be502e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:04.721623 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b7c5dc4a-af12-4847-9b82-7541a6be502e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:04.737524 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04201628-37f6-4b75-aef7-b1f808527139 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:04.749917 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2340/4672] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:20:04.751504 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04201628-37f6-4b75-aef7-b1f808527139 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:04.757735 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e78499-8433-47a2-87a7-23ad901d96a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:04.762964 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e78499-8433-47a2-87a7-23ad901d96a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:04.763492 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e78499-8433-47a2-87a7-23ad901d96a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:04.763978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e78499-8433-47a2-87a7-23ad901d96a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:04.764874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e78499-8433-47a2-87a7-23ad901d96a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:20:04.765390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e78499-8433-47a2-87a7-23ad901d96a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:04.767988 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e78499-8433-47a2-87a7-23ad901d96a3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:04.791498 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5dc4a-af12-4847-9b82-7541a6be502e None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:04.798670 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2333/4673] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:20:04.805760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5dc4a-af12-4847-9b82-7541a6be502e None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:04.812539 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a3b14-951d-4be0-b3dc-0ee0b036fbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:04.813599 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a3b14-951d-4be0-b3dc-0ee0b036fbcb admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:04.814328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a3b14-951d-4be0-b3dc-0ee0b036fbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:04.818028 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a3b14-951d-4be0-b3dc-0ee0b036fbcb admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:04.818951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a3b14-951d-4be0-b3dc-0ee0b036fbcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:04.822636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a3b14-951d-4be0-b3dc-0ee0b036fbcb admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:04.909162 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2341/4674] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:20:04 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:04.911136 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e78499-8433-47a2-87a7-23ad901d96a3 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:04.937345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e78499-8433-47a2-87a7-23ad901d96a3 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:04.965624 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:05.070565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31cc03-2a81-4800-b13f-8e4502d73b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:05.071196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31cc03-2a81-4800-b13f-8e4502d73b55 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:05.071477 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31cc03-2a81-4800-b13f-8e4502d73b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:05.071842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31cc03-2a81-4800-b13f-8e4502d73b55 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:05.072490 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31cc03-2a81-4800-b13f-8e4502d73b55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:05.075792 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31cc03-2a81-4800-b13f-8e4502d73b55 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:05.107898 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2334/4675] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:20:04 2022] POST /identity/v3/users => generated 286 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:05.112191 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a3b14-951d-4be0-b3dc-0ee0b036fbcb admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:05.127462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a3b14-951d-4be0-b3dc-0ee0b036fbcb admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:05.138435 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2d9b5-9c01-4926-9fe1-a2b6dac31a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:05.151419 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2d9b5-9c01-4926-9fe1-a2b6dac31a1e admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:05.151511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2d9b5-9c01-4926-9fe1-a2b6dac31a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:05.151853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2d9b5-9c01-4926-9fe1-a2b6dac31a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:05.156519 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2d9b5-9c01-4926-9fe1-a2b6dac31a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:05.161327 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2d9b5-9c01-4926-9fe1-a2b6dac31a1e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:05.208695 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2342/4676] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:20:05.212468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31cc03-2a81-4800-b13f-8e4502d73b55 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:05.228468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31cc03-2a81-4800-b13f-8e4502d73b55 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:05.254394 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18322ba1-5157-4b0a-a15d-1f87434b60cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:05.255967 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18322ba1-5157-4b0a-a15d-1f87434b60cf admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:05.256437 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18322ba1-5157-4b0a-a15d-1f87434b60cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:05.257033 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18322ba1-5157-4b0a-a15d-1f87434b60cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:05.257924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18322ba1-5157-4b0a-a15d-1f87434b60cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:05.263460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18322ba1-5157-4b0a-a15d-1f87434b60cf admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:05.304350 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2335/4677] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:20:05.309229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2d9b5-9c01-4926-9fe1-a2b6dac31a1e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:05.321945 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2d9b5-9c01-4926-9fe1-a2b6dac31a1e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:05.352772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f38bfe-d45b-46ba-97ca-11e98ab0df03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:05.354111 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f38bfe-d45b-46ba-97ca-11e98ab0df03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:05.354111 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f38bfe-d45b-46ba-97ca-11e98ab0df03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:05.354111 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f38bfe-d45b-46ba-97ca-11e98ab0df03 admin admin] PATH_INFO: `/v3/projects/1b70ef92fb734a1283d410056e6169b9/users/3cf055f323154b16b36cb8347b3fbb97/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:05.386584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f38bfe-d45b-46ba-97ca-11e98ab0df03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b70ef92fb734a1283d410056e6169b9, user_id=3cf055f323154b16b36cb8347b3fbb97, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:05.389473 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f38bfe-d45b-46ba-97ca-11e98ab0df03 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:05.430552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18322ba1-5157-4b0a-a15d-1f87434b60cf admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:05.433573 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2343/4678] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:20:05 2022] PUT /identity/v3/projects/1b70ef92fb734a1283d410056e6169b9/users/3cf055f323154b16b36cb8347b3fbb97/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:05.443787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-18322ba1-5157-4b0a-a15d-1f87434b60cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:05.445660 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64053c36-1e98-43b4-984f-e350b6d6bf9e None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:05.445660 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64053c36-1e98-43b4-984f-e350b6d6bf9e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:05.445660 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64053c36-1e98-43b4-984f-e350b6d6bf9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:05.469345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18322ba1-5157-4b0a-a15d-1f87434b60cf admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:05.571451 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-64053c36-1e98-43b4-984f-e350b6d6bf9e None None] MFA Rules not processed for user `3cf055f323154b16b36cb8347b3fbb97`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:05.572780 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-64053c36-1e98-43b4-984f-e350b6d6bf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:05.604380 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:05.701143 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1b769-1e90-4ea0-afc4-997f383c08c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:05.702137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1b769-1e90-4ea0-afc4-997f383c08c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:05.705466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1b769-1e90-4ea0-afc4-997f383c08c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:05.705466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1b769-1e90-4ea0-afc4-997f383c08c7 admin admin] PATH_INFO: `/v3/users/bbc84b6123184e7da0e7349972694526` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:05.705466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef1b769-1e90-4ea0-afc4-997f383c08c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbc84b6123184e7da0e7349972694526)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:05.705823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef1b769-1e90-4ea0-afc4-997f383c08c7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:05.718958 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2344/4679] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:20:05.730804 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f3c16-a8cc-4e3f-a456-c39eb816eb8f None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:05.731395 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f3c16-a8cc-4e3f-a456-c39eb816eb8f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:05.731857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f3c16-a8cc-4e3f-a456-c39eb816eb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:05.789463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-0d5f3c16-a8cc-4e3f-a456-c39eb816eb8f None None] MFA Rules not processed for user `3cf055f323154b16b36cb8347b3fbb97`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:05.793305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0d5f3c16-a8cc-4e3f-a456-c39eb816eb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:05.804090 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2345/4680] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:05.814048 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cef1b769-1e90-4ea0-afc4-997f383c08c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbc84b6123184e7da0e7349972694526'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:05.814876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cef1b769-1e90-4ea0-afc4-997f383c08c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbc84b6123184e7da0e7349972694526'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:05.824721 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cef1b769-1e90-4ea0-afc4-997f383c08c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbc84b6123184e7da0e7349972694526'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:05.843081 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cef1b769-1e90-4ea0-afc4-997f383c08c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbc84b6123184e7da0e7349972694526'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:05.843845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cef1b769-1e90-4ea0-afc4-997f383c08c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbc84b6123184e7da0e7349972694526'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:05.889673 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2336/4681] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:20:05 2022] DELETE /identity/v3/users/bbc84b6123184e7da0e7349972694526 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:20:05.902179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e337f-39c2-4a65-b4cd-98072657a5bc None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:05.902179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e337f-39c2-4a65-b4cd-98072657a5bc None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:05.902179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e337f-39c2-4a65-b4cd-98072657a5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:05.930449 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-751e337f-39c2-4a65-b4cd-98072657a5bc None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:05.930449 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-751e337f-39c2-4a65-b4cd-98072657a5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:06.020436 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2346/4682] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:06.048476 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1b769-1e90-4ea0-afc4-997f383c08c7 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:06.051072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-cef1b769-1e90-4ea0-afc4-997f383c08c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:06.076716 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:06.187143 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1b769-1e90-4ea0-afc4-997f383c08c7 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:06.193089 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed697131-426a-4605-8588-ac8d69dadfb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:06.194617 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed697131-426a-4605-8588-ac8d69dadfb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:06.195079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed697131-426a-4605-8588-ac8d69dadfb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:06.196138 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed697131-426a-4605-8588-ac8d69dadfb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:06.212728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed697131-426a-4605-8588-ac8d69dadfb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:06.215757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed697131-426a-4605-8588-ac8d69dadfb7 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:06.243606 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2337/4683] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:20:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:20:06.292543 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e337f-39c2-4a65-b4cd-98072657a5bc None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:06.295250 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-751e337f-39c2-4a65-b4cd-98072657a5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:06.312348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e337f-39c2-4a65-b4cd-98072657a5bc None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:06.319919 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c796c1-36e3-4736-a862-28e9d51c8856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:06.320983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c796c1-36e3-4736-a862-28e9d51c8856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:06.321612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c796c1-36e3-4736-a862-28e9d51c8856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:06.322062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c796c1-36e3-4736-a862-28e9d51c8856 admin admin] PATH_INFO: `/v3/projects/5225bb4a208949c3b6c2452d63258189` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:06.324685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c796c1-36e3-4736-a862-28e9d51c8856 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5225bb4a208949c3b6c2452d63258189)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:06.328390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c796c1-36e3-4736-a862-28e9d51c8856 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:06.329865 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed697131-426a-4605-8588-ac8d69dadfb7 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:06.331316 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ed697131-426a-4605-8588-ac8d69dadfb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:06.443184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f8c796c1-36e3-4736-a862-28e9d51c8856 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5225bb4a208949c3b6c2452d63258189', 'request_id': 'req-f8c796c1-36e3-4736-a862-28e9d51c8856'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:06.473122 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f8c796c1-36e3-4736-a862-28e9d51c8856 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5225bb4a208949c3b6c2452d63258189', 'request_id': 'req-f8c796c1-36e3-4736-a862-28e9d51c8856'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:06.494288 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f8c796c1-36e3-4736-a862-28e9d51c8856 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5225bb4a208949c3b6c2452d63258189', 'request_id': 'req-f8c796c1-36e3-4736-a862-28e9d51c8856'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:06.499497 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed697131-426a-4605-8588-ac8d69dadfb7 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:06.526975 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f8c796c1-36e3-4736-a862-28e9d51c8856 admin admin] The token cache is being invalidate because project 5225bb4a208949c3b6c2452d63258189 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:06.527425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f8c796c1-36e3-4736-a862-28e9d51c8856 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:06.528313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f8c796c1-36e3-4736-a862-28e9d51c8856 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:06.534275 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2347/4684] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:20:06 2022] DELETE /identity/v3/projects/5225bb4a208949c3b6c2452d63258189 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:06.536063 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0283b-4396-4eb7-8be1-1a60d43e404a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:06.536367 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0283b-4396-4eb7-8be1-1a60d43e404a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:06.536731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0283b-4396-4eb7-8be1-1a60d43e404a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:06.562052 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-7ed0283b-4396-4eb7-8be1-1a60d43e404a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:06.563215 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7ed0283b-4396-4eb7-8be1-1a60d43e404a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:06.635189 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:06.684538 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70adfabd-cffe-434d-85da-d26dd9387366 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:06.686724 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adfabd-cffe-434d-85da-d26dd9387366 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:06.687236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adfabd-cffe-434d-85da-d26dd9387366 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:06.687609 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adfabd-cffe-434d-85da-d26dd9387366 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:06.691405 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-70adfabd-cffe-434d-85da-d26dd9387366 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:06.734599 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2348/4685] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:06.747400 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2331f-264a-44b3-b9ef-46cb83527302 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:06.747850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2331f-264a-44b3-b9ef-46cb83527302 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:06.748225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2331f-264a-44b3-b9ef-46cb83527302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:06.800061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-bfe2331f-264a-44b3-b9ef-46cb83527302 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:06.802706 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-bfe2331f-264a-44b3-b9ef-46cb83527302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:06.820022 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2349/4686] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:06.823006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2331f-264a-44b3-b9ef-46cb83527302 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:06.835117 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:06.838529 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2331f-264a-44b3-b9ef-46cb83527302 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:06.846296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70adfabd-cffe-434d-85da-d26dd9387366 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:06.847926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70adfabd-cffe-434d-85da-d26dd9387366 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:06.855769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f25b10e-13bb-46af-b2de-cedec81a18ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:06.855769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25b10e-13bb-46af-b2de-cedec81a18ea admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:06.855769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25b10e-13bb-46af-b2de-cedec81a18ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:06.856128 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25b10e-13bb-46af-b2de-cedec81a18ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:06.856968 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f25b10e-13bb-46af-b2de-cedec81a18ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:20:06.856968 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f25b10e-13bb-46af-b2de-cedec81a18ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:06.860604 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f25b10e-13bb-46af-b2de-cedec81a18ea admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:06.871514 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2338/4687] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:20:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:20:06.878873 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2350/4688] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:20:06.883634 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70adfabd-cffe-434d-85da-d26dd9387366 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:06.896569 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70adfabd-cffe-434d-85da-d26dd9387366 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:06.908381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e61c26-830e-4709-9084-6f7078fbc7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:06.909536 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e61c26-830e-4709-9084-6f7078fbc7f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:06.910076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e61c26-830e-4709-9084-6f7078fbc7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:06.910509 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e61c26-830e-4709-9084-6f7078fbc7f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:06.911325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e61c26-830e-4709-9084-6f7078fbc7f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:06.913882 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e61c26-830e-4709-9084-6f7078fbc7f7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:06.975970 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2339/4689] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:20:06 2022] POST /identity/v3/projects => generated 367 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:20:06.978894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f25b10e-13bb-46af-b2de-cedec81a18ea admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:06.995095 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f25b10e-13bb-46af-b2de-cedec81a18ea admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:07.121181 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce8c8f-7201-4354-ae85-110c9bbf9b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:07.121790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce8c8f-7201-4354-ae85-110c9bbf9b0f admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:07.122068 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce8c8f-7201-4354-ae85-110c9bbf9b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:07.122344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce8c8f-7201-4354-ae85-110c9bbf9b0f admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:07.123075 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce8c8f-7201-4354-ae85-110c9bbf9b0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:07.125649 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce8c8f-7201-4354-ae85-110c9bbf9b0f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:07.170116 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2351/4690] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:20:06 2022] POST /identity/v3/users => generated 284 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:07.174287 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e61c26-830e-4709-9084-6f7078fbc7f7 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:07.196013 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e61c26-830e-4709-9084-6f7078fbc7f7 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:07.211480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad935b5a-b1b1-4712-90d7-ce3b2c436869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:07.211480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad935b5a-b1b1-4712-90d7-ce3b2c436869 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:07.215502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad935b5a-b1b1-4712-90d7-ce3b2c436869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:07.216042 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad935b5a-b1b1-4712-90d7-ce3b2c436869 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:07.217905 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad935b5a-b1b1-4712-90d7-ce3b2c436869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:07.223155 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad935b5a-b1b1-4712-90d7-ce3b2c436869 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:07.256515 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2340/4691] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:20:07.260372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce8c8f-7201-4354-ae85-110c9bbf9b0f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:07.275586 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce8c8f-7201-4354-ae85-110c9bbf9b0f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:07.283293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8269ab3-a9f0-4394-ac41-57c412f2ea5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:07.284190 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8269ab3-a9f0-4394-ac41-57c412f2ea5e admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:07.284701 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8269ab3-a9f0-4394-ac41-57c412f2ea5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:07.285178 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8269ab3-a9f0-4394-ac41-57c412f2ea5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:07.286120 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8269ab3-a9f0-4394-ac41-57c412f2ea5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:07.288432 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8269ab3-a9f0-4394-ac41-57c412f2ea5e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:07.307545 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2352/4692] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:20:07.313326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad935b5a-b1b1-4712-90d7-ce3b2c436869 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:07.324342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad935b5a-b1b1-4712-90d7-ce3b2c436869 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:07.333235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c4ab8-5069-4655-9c4f-e7c542afe3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:07.333946 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c4ab8-5069-4655-9c4f-e7c542afe3d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:07.334231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c4ab8-5069-4655-9c4f-e7c542afe3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:07.334506 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c4ab8-5069-4655-9c4f-e7c542afe3d0 admin admin] PATH_INFO: `/v3/projects/8553c8762b044d15a400eeed575ecbe5/users/39fdc740d3844f11b508524dba1838bb/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:07.375748 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c4ab8-5069-4655-9c4f-e7c542afe3d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8553c8762b044d15a400eeed575ecbe5, user_id=39fdc740d3844f11b508524dba1838bb, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:07.378387 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c4ab8-5069-4655-9c4f-e7c542afe3d0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:07.379043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ace790-ad41-420a-bb72-1e4940f8d18e None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:07.379331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ace790-ad41-420a-bb72-1e4940f8d18e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:07.379634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ace790-ad41-420a-bb72-1e4940f8d18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:07.412349 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-84ace790-ad41-420a-bb72-1e4940f8d18e None None] MFA Rules not processed for user `3cf055f323154b16b36cb8347b3fbb97`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:07.414189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-84ace790-ad41-420a-bb72-1e4940f8d18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:07.415518 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2341/4693] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:20:07 2022] PUT /identity/v3/projects/8553c8762b044d15a400eeed575ecbe5/users/39fdc740d3844f11b508524dba1838bb/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:07.427418 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4211f5-78de-4ab0-97e6-0cd08e2e7f4c None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:07.427714 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4211f5-78de-4ab0-97e6-0cd08e2e7f4c None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:07.427995 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4211f5-78de-4ab0-97e6-0cd08e2e7f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:07.514514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-2f4211f5-78de-4ab0-97e6-0cd08e2e7f4c None None] MFA Rules not processed for user `39fdc740d3844f11b508524dba1838bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:07.518230 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2f4211f5-78de-4ab0-97e6-0cd08e2e7f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:07.523016 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2353/4694] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:07.672180 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2342/4695] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:07.676247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ace790-ad41-420a-bb72-1e4940f8d18e None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:07.767014 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:07.878438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ace790-ad41-420a-bb72-1e4940f8d18e None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:07.891521 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf7e77-79ec-4d67-b72a-f19bb3258dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:07.893649 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf7e77-79ec-4d67-b72a-f19bb3258dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:07.895446 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf7e77-79ec-4d67-b72a-f19bb3258dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:07.895755 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf7e77-79ec-4d67-b72a-f19bb3258dd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:07.897281 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf7e77-79ec-4d67-b72a-f19bb3258dd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:07.904826 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf7e77-79ec-4d67-b72a-f19bb3258dd0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:07.985474 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2354/4696] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:20:07 2022] POST /identity/v3/projects => generated 365 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:07.987334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4211f5-78de-4ab0-97e6-0cd08e2e7f4c None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:08.007774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4211f5-78de-4ab0-97e6-0cd08e2e7f4c None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:08.183914 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989caa4-fec0-4b3c-97d5-051d52dce198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:08.186085 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989caa4-fec0-4b3c-97d5-051d52dce198 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:08.188957 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989caa4-fec0-4b3c-97d5-051d52dce198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:08.191150 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989caa4-fec0-4b3c-97d5-051d52dce198 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:08.191937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989caa4-fec0-4b3c-97d5-051d52dce198 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:08.197042 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989caa4-fec0-4b3c-97d5-051d52dce198 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:08.241065 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2343/4697] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:20:07 2022] POST /identity/v3/users => generated 289 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:08.245738 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf7e77-79ec-4d67-b72a-f19bb3258dd0 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:08.259262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf7e77-79ec-4d67-b72a-f19bb3258dd0 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:08.264603 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715b6d1-ff74-4570-bd5a-78b4350e5e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:08.265220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715b6d1-ff74-4570-bd5a-78b4350e5e34 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:08.265522 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715b6d1-ff74-4570-bd5a-78b4350e5e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:08.265796 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715b6d1-ff74-4570-bd5a-78b4350e5e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:08.266440 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715b6d1-ff74-4570-bd5a-78b4350e5e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:08.268111 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715b6d1-ff74-4570-bd5a-78b4350e5e34 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:08.324275 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2355/4698] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:20:08.329600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989caa4-fec0-4b3c-97d5-051d52dce198 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:08.342003 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989caa4-fec0-4b3c-97d5-051d52dce198 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:08.348945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a652484-c4f2-49e0-ad3b-5a672af44bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:08.350546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a652484-c4f2-49e0-ad3b-5a672af44bec admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:08.373328 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a652484-c4f2-49e0-ad3b-5a672af44bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:08.381390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a652484-c4f2-49e0-ad3b-5a672af44bec admin admin] PATH_INFO: `/v3/projects/4b80d27db7684d03ac6a8afdf1f69adf/users/3165f85499fd40e4b6e74bdd3c8e895a/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:08.420872 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:08.430872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a652484-c4f2-49e0-ad3b-5a672af44bec admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b80d27db7684d03ac6a8afdf1f69adf, user_id=3165f85499fd40e4b6e74bdd3c8e895a, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:08.478312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a652484-c4f2-49e0-ad3b-5a672af44bec admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:08.516297 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2344/4699] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:20:08 2022] PUT /identity/v3/projects/4b80d27db7684d03ac6a8afdf1f69adf/users/3165f85499fd40e4b6e74bdd3c8e895a/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:08.520121 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715b6d1-ff74-4570-bd5a-78b4350e5e34 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:08.532551 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715b6d1-ff74-4570-bd5a-78b4350e5e34 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:08.713089 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7a0ae-eb2a-41ea-961a-ba8d84544827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:08.714596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7a0ae-eb2a-41ea-961a-ba8d84544827 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:08.715467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7a0ae-eb2a-41ea-961a-ba8d84544827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:08.717190 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7a0ae-eb2a-41ea-961a-ba8d84544827 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:08.718050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7a0ae-eb2a-41ea-961a-ba8d84544827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:08.722994 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7a0ae-eb2a-41ea-961a-ba8d84544827 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:08.752982 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2356/4700] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:20:08.757469 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a652484-c4f2-49e0-ad3b-5a672af44bec admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:08.774964 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a652484-c4f2-49e0-ad3b-5a672af44bec admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:08.799389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bca75-633a-4e1e-b2da-0bf871eb7b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:08.801902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bca75-633a-4e1e-b2da-0bf871eb7b7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:08.802962 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bca75-633a-4e1e-b2da-0bf871eb7b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:08.806225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bca75-633a-4e1e-b2da-0bf871eb7b7d admin admin] PATH_INFO: `/v3/projects/4b80d27db7684d03ac6a8afdf1f69adf/users/3165f85499fd40e4b6e74bdd3c8e895a/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:08.809343 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64bca75-633a-4e1e-b2da-0bf871eb7b7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b80d27db7684d03ac6a8afdf1f69adf, user_id=3165f85499fd40e4b6e74bdd3c8e895a, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:08.813261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64bca75-633a-4e1e-b2da-0bf871eb7b7d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:08.857504 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2345/4701] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:20:08 2022] PUT /identity/v3/projects/4b80d27db7684d03ac6a8afdf1f69adf/users/3165f85499fd40e4b6e74bdd3c8e895a/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:08.862129 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb97126-2562-4787-a229-8c2d6ededb55 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:08.863053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb97126-2562-4787-a229-8c2d6ededb55 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:08.863778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb97126-2562-4787-a229-8c2d6ededb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:08.924827 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-1eb97126-2562-4787-a229-8c2d6ededb55 None None] MFA Rules not processed for user `3165f85499fd40e4b6e74bdd3c8e895a`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:08.927007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1eb97126-2562-4787-a229-8c2d6ededb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:09.010295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bca75-633a-4e1e-b2da-0bf871eb7b7d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:09.013826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d64bca75-633a-4e1e-b2da-0bf871eb7b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:09.157964 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2357/4702] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:09.163957 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb97126-2562-4787-a229-8c2d6ededb55 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:09.195642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb97126-2562-4787-a229-8c2d6ededb55 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:09.201273 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bca75-633a-4e1e-b2da-0bf871eb7b7d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:09.207672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6e4d0-f2b1-46cc-84f9-c021ff2aa802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:09.208777 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6e4d0-f2b1-46cc-84f9-c021ff2aa802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:09.209059 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6e4d0-f2b1-46cc-84f9-c021ff2aa802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:09.210067 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6e4d0-f2b1-46cc-84f9-c021ff2aa802 admin admin] PATH_INFO: `/v3/projects/5c32fcd87ae043b2b2602b40943ab8ee` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:09.210381 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef83750-faa2-4105-8e40-3afc334dea7d tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3165f85499fd40e4b6e74bdd3c8e895a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b80d27db7684d03ac6a8afdf1f69adf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:09.211403 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef83750-faa2-4105-8e40-3afc334dea7d tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:09.211527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac6e4d0-f2b1-46cc-84f9-c021ff2aa802 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c32fcd87ae043b2b2602b40943ab8ee)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:09.211621 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef83750-faa2-4105-8e40-3afc334dea7d tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:09.212960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef83750-faa2-4105-8e40-3afc334dea7d tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] PATH_INFO: `/v3/policies` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:09.213934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac6e4d0-f2b1-46cc-84f9-c021ff2aa802 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:09.216277 n-d-master-1 devstack@keystone.service[81824]: WARNING oslo_log.versionutils [None req-6ef83750-faa2-4105-8e40-3afc334dea7d tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Sep 04 01:20:09.216821 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef83750-faa2-4105-8e40-3afc334dea7d tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:09.219455 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-6ef83750-faa2-4105-8e40-3afc334dea7d tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:09.219455 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:20:09.219455 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:20:09.225269 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef83750-faa2-4105-8e40-3afc334dea7d tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:09.269326 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2358/4703] 10.222.0.30 () {60 vars in 1152 bytes} [Sun Sep 4 01:20:09 2022] POST /identity/v3/policies => generated 230 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:09.276549 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef83750-faa2-4105-8e40-3afc334dea7d tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:09.295046 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef83750-faa2-4105-8e40-3afc334dea7d tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:09.306957 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:09.322057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-eac6e4d0-f2b1-46cc-84f9-c021ff2aa802 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c32fcd87ae043b2b2602b40943ab8ee', 'request_id': 'req-eac6e4d0-f2b1-46cc-84f9-c021ff2aa802'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:09.344505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-eac6e4d0-f2b1-46cc-84f9-c021ff2aa802 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c32fcd87ae043b2b2602b40943ab8ee', 'request_id': 'req-eac6e4d0-f2b1-46cc-84f9-c021ff2aa802'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:09.352994 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-eac6e4d0-f2b1-46cc-84f9-c021ff2aa802 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c32fcd87ae043b2b2602b40943ab8ee', 'request_id': 'req-eac6e4d0-f2b1-46cc-84f9-c021ff2aa802'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:09.375034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f82b7-41b6-428a-b46b-d57db09475b9 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3165f85499fd40e4b6e74bdd3c8e895a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b80d27db7684d03ac6a8afdf1f69adf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:09.375358 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f82b7-41b6-428a-b46b-d57db09475b9 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:09.375640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f82b7-41b6-428a-b46b-d57db09475b9 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:09.375922 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f82b7-41b6-428a-b46b-d57db09475b9 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] PATH_INFO: `/v3/policies/9f8d94cec42b4eeebccbbf6732ef5035` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:09.376984 n-d-master-1 devstack@keystone.service[81824]: WARNING oslo_log.versionutils [None req-ea7f82b7-41b6-428a-b46b-d57db09475b9 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Sep 04 01:20:09.377622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7f82b7-41b6-428a-b46b-d57db09475b9 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=9f8d94cec42b4eeebccbbf6732ef5035)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:09.378871 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-ea7f82b7-41b6-428a-b46b-d57db09475b9 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:09.378871 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:20:09.378871 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:20:09.381011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-eac6e4d0-f2b1-46cc-84f9-c021ff2aa802 admin admin] The token cache is being invalidate because project 5c32fcd87ae043b2b2602b40943ab8ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:09.381309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-eac6e4d0-f2b1-46cc-84f9-c021ff2aa802 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:09.381954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7f82b7-41b6-428a-b46b-d57db09475b9 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:09.383849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-eac6e4d0-f2b1-46cc-84f9-c021ff2aa802 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:09.391942 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2346/4704] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:20:09 2022] DELETE /identity/v3/projects/5c32fcd87ae043b2b2602b40943ab8ee => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:09.396676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fbaba-21ce-4a22-8a07-02aefb274681 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:09.396998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fbaba-21ce-4a22-8a07-02aefb274681 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:09.397268 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fbaba-21ce-4a22-8a07-02aefb274681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:09.436824 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2359/4705] 10.222.0.30 () {60 vars in 1252 bytes} [Sun Sep 4 01:20:09 2022] PATCH /identity/v3/policies/9f8d94cec42b4eeebccbbf6732ef5035 => generated 237 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:20:09.448741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-535fbaba-21ce-4a22-8a07-02aefb274681 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:09.457321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-535fbaba-21ce-4a22-8a07-02aefb274681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:09.459107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f82b7-41b6-428a-b46b-d57db09475b9 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:09.462038 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ea7f82b7-41b6-428a-b46b-d57db09475b9 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:09.479079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f82b7-41b6-428a-b46b-d57db09475b9 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:09.485222 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057d0d9-9655-4bf7-ba3d-924791553f21 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3165f85499fd40e4b6e74bdd3c8e895a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b80d27db7684d03ac6a8afdf1f69adf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:09.485837 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057d0d9-9655-4bf7-ba3d-924791553f21 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:09.486002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057d0d9-9655-4bf7-ba3d-924791553f21 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:09.486326 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057d0d9-9655-4bf7-ba3d-924791553f21 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] PATH_INFO: `/v3/policies/9f8d94cec42b4eeebccbbf6732ef5035` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:09.487165 n-d-master-1 devstack@keystone.service[81824]: WARNING oslo_log.versionutils [None req-3057d0d9-9655-4bf7-ba3d-924791553f21 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Sep 04 01:20:09.487801 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057d0d9-9655-4bf7-ba3d-924791553f21 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=9f8d94cec42b4eeebccbbf6732ef5035)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:09.489560 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-3057d0d9-9655-4bf7-ba3d-924791553f21 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:09.489560 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:20:09.489560 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:20:09.490568 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057d0d9-9655-4bf7-ba3d-924791553f21 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:09.517278 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2360/4706] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:20:09 2022] GET /identity/v3/policies/9f8d94cec42b4eeebccbbf6732ef5035 => generated 237 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:20:09.519293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057d0d9-9655-4bf7-ba3d-924791553f21 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:09.536285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057d0d9-9655-4bf7-ba3d-924791553f21 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:09.544442 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e68ba-af24-4306-ab7a-2d8a300ffa17 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3165f85499fd40e4b6e74bdd3c8e895a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b80d27db7684d03ac6a8afdf1f69adf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:09.545312 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e68ba-af24-4306-ab7a-2d8a300ffa17 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:09.545841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e68ba-af24-4306-ab7a-2d8a300ffa17 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:09.546282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e68ba-af24-4306-ab7a-2d8a300ffa17 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] PATH_INFO: `/v3/policies/9f8d94cec42b4eeebccbbf6732ef5035` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:09.547571 n-d-master-1 devstack@keystone.service[81824]: WARNING oslo_log.versionutils [None req-fd5e68ba-af24-4306-ab7a-2d8a300ffa17 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Sep 04 01:20:09.548480 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e68ba-af24-4306-ab7a-2d8a300ffa17 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=9f8d94cec42b4eeebccbbf6732ef5035)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:09.550018 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-fd5e68ba-af24-4306-ab7a-2d8a300ffa17 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:09.550018 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:20:09.550018 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:20:09.551263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e68ba-af24-4306-ab7a-2d8a300ffa17 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:09.587339 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2361/4707] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:20:09 2022] DELETE /identity/v3/policies/9f8d94cec42b4eeebccbbf6732ef5035 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:09.588918 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e68ba-af24-4306-ab7a-2d8a300ffa17 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:09.616199 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e68ba-af24-4306-ab7a-2d8a300ffa17 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:09.623122 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97dc80-88cb-4fd8-a316-33f141286d66 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3165f85499fd40e4b6e74bdd3c8e895a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b80d27db7684d03ac6a8afdf1f69adf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:09.624123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97dc80-88cb-4fd8-a316-33f141286d66 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:09.624600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97dc80-88cb-4fd8-a316-33f141286d66 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:09.625055 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97dc80-88cb-4fd8-a316-33f141286d66 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] PATH_INFO: `/v3/policies` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:09.626571 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f97dc80-88cb-4fd8-a316-33f141286d66 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:09.629625 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f97dc80-88cb-4fd8-a316-33f141286d66 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:09.665114 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2362/4708] 10.222.0.30 () {60 vars in 1152 bytes} [Sun Sep 4 01:20:09 2022] POST /identity/v3/policies => generated 227 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:09.667132 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97dc80-88cb-4fd8-a316-33f141286d66 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:09.693749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97dc80-88cb-4fd8-a316-33f141286d66 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:09.694828 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2347/4709] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:09.699645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06308102-eeab-46e0-a0a0-ff47f10a00a4 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:09.699942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06308102-eeab-46e0-a0a0-ff47f10a00a4 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:09.702329 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06308102-eeab-46e0-a0a0-ff47f10a00a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:09.707248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1e565-19b6-4938-bc7b-7835120bd4b9 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3165f85499fd40e4b6e74bdd3c8e895a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b80d27db7684d03ac6a8afdf1f69adf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:09.708570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1e565-19b6-4938-bc7b-7835120bd4b9 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:09.709342 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1e565-19b6-4938-bc7b-7835120bd4b9 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:09.709728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1e565-19b6-4938-bc7b-7835120bd4b9 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] PATH_INFO: `/v3/policies` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:09.713587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e1e565-19b6-4938-bc7b-7835120bd4b9 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:09.718946 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e1e565-19b6-4938-bc7b-7835120bd4b9 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:09.738563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-06308102-eeab-46e0-a0a0-ff47f10a00a4 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:09.740354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-06308102-eeab-46e0-a0a0-ff47f10a00a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:09.751449 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2348/4710] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:09.756578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06308102-eeab-46e0-a0a0-ff47f10a00a4 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:09.758817 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2363/4711] 10.222.0.30 () {60 vars in 1152 bytes} [Sun Sep 4 01:20:09 2022] POST /identity/v3/policies => generated 229 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:09.762821 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:09.768223 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1e565-19b6-4938-bc7b-7835120bd4b9 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:09.770901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06308102-eeab-46e0-a0a0-ff47f10a00a4 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:09.781244 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582bfab-867d-4e33-9900-063b6683593f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:09.782243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582bfab-867d-4e33-9900-063b6683593f admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:09.782680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582bfab-867d-4e33-9900-063b6683593f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:09.783407 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582bfab-867d-4e33-9900-063b6683593f admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:09.784254 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1582bfab-867d-4e33-9900-063b6683593f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:20:09.785525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1582bfab-867d-4e33-9900-063b6683593f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:09.788380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1582bfab-867d-4e33-9900-063b6683593f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:09.808375 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1e565-19b6-4938-bc7b-7835120bd4b9 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:09.808793 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2349/4712] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:20:09.815739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582bfab-867d-4e33-9900-063b6683593f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:09.820826 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f27ae-6209-4fce-98fa-265a34017893 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3165f85499fd40e4b6e74bdd3c8e895a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b80d27db7684d03ac6a8afdf1f69adf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:09.823734 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f27ae-6209-4fce-98fa-265a34017893 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:09.824183 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f27ae-6209-4fce-98fa-265a34017893 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:09.824635 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f27ae-6209-4fce-98fa-265a34017893 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] PATH_INFO: `/v3/policies` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:09.825968 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f27ae-6209-4fce-98fa-265a34017893 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:09.830445 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f27ae-6209-4fce-98fa-265a34017893 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:09.838512 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582bfab-867d-4e33-9900-063b6683593f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:09.848022 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691ee25-4c9b-43c3-b698-3f4581884d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:09.849219 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691ee25-4c9b-43c3-b698-3f4581884d72 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:09.849945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691ee25-4c9b-43c3-b698-3f4581884d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:09.850475 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691ee25-4c9b-43c3-b698-3f4581884d72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:09.851478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691ee25-4c9b-43c3-b698-3f4581884d72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:09.864757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691ee25-4c9b-43c3-b698-3f4581884d72 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:09.874946 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2364/4713] 10.222.0.30 () {60 vars in 1152 bytes} [Sun Sep 4 01:20:09 2022] POST /identity/v3/policies => generated 228 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:09.878548 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f27ae-6209-4fce-98fa-265a34017893 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:09.904700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f27ae-6209-4fce-98fa-265a34017893 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:09.916426 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36176f15-cdae-4433-bb4a-8cefcc909438 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3165f85499fd40e4b6e74bdd3c8e895a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b80d27db7684d03ac6a8afdf1f69adf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:09.918261 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36176f15-cdae-4433-bb4a-8cefcc909438 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:09.918541 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36176f15-cdae-4433-bb4a-8cefcc909438 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:09.918812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36176f15-cdae-4433-bb4a-8cefcc909438 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] PATH_INFO: `/v3/policies` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:09.926750 n-d-master-1 devstack@keystone.service[81824]: WARNING oslo_log.versionutils [None req-36176f15-cdae-4433-bb4a-8cefcc909438 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Sep 04 01:20:09.928083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36176f15-cdae-4433-bb4a-8cefcc909438 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:09.934103 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-36176f15-cdae-4433-bb4a-8cefcc909438 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:09.934103 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:20:09.934103 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:20:09.935022 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36176f15-cdae-4433-bb4a-8cefcc909438 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:09.939981 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2350/4714] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:20:09 2022] POST /identity/v3/projects => generated 393 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:09.943522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691ee25-4c9b-43c3-b698-3f4581884d72 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:09.975547 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2365/4715] 10.222.0.30 () {58 vars in 1131 bytes} [Sun Sep 4 01:20:09 2022] GET /identity/v3/policies => generated 760 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:20:09.980944 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36176f15-cdae-4433-bb4a-8cefcc909438 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:10.005100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36176f15-cdae-4433-bb4a-8cefcc909438 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:10.104039 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691ee25-4c9b-43c3-b698-3f4581884d72 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:10.118513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009d11d-07a7-4d22-8a51-284859735511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:10.119151 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009d11d-07a7-4d22-8a51-284859735511 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:10.119433 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009d11d-07a7-4d22-8a51-284859735511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:10.119731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009d11d-07a7-4d22-8a51-284859735511 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:10.122032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4009d11d-07a7-4d22-8a51-284859735511 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:10.124125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4009d11d-07a7-4d22-8a51-284859735511 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:10.161646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b6f68-7a63-4535-aecc-d5b375a897e6 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3165f85499fd40e4b6e74bdd3c8e895a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b80d27db7684d03ac6a8afdf1f69adf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:10.163208 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b6f68-7a63-4535-aecc-d5b375a897e6 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:10.163668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b6f68-7a63-4535-aecc-d5b375a897e6 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:10.164219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b6f68-7a63-4535-aecc-d5b375a897e6 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] PATH_INFO: `/v3/policies/58b07c19fa9349efa086b21f96e9dac0` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:10.165975 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b6f68-7a63-4535-aecc-d5b375a897e6 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=58b07c19fa9349efa086b21f96e9dac0)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:10.169202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b6f68-7a63-4535-aecc-d5b375a897e6 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:10.176427 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2351/4716] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:20:09 2022] POST /identity/v3/users => generated 297 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:10.181009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009d11d-07a7-4d22-8a51-284859735511 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:10.210341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009d11d-07a7-4d22-8a51-284859735511 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:10.212377 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2366/4717] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:20:09 2022] DELETE /identity/v3/policies/58b07c19fa9349efa086b21f96e9dac0 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:20:10.216837 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b6f68-7a63-4535-aecc-d5b375a897e6 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:10.226343 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db734e-3e42-4b5d-9964-61e22976cd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:10.227865 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db734e-3e42-4b5d-9964-61e22976cd8f admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:10.228323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db734e-3e42-4b5d-9964-61e22976cd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:10.228740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db734e-3e42-4b5d-9964-61e22976cd8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:10.230719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db734e-3e42-4b5d-9964-61e22976cd8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:10.236762 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db734e-3e42-4b5d-9964-61e22976cd8f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:10.248079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b6f68-7a63-4535-aecc-d5b375a897e6 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:10.263612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc08835-a5b4-43dc-ab5b-03c7c3dde32c tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3165f85499fd40e4b6e74bdd3c8e895a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b80d27db7684d03ac6a8afdf1f69adf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:10.265070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc08835-a5b4-43dc-ab5b-03c7c3dde32c tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:10.265747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc08835-a5b4-43dc-ab5b-03c7c3dde32c tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:10.266172 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc08835-a5b4-43dc-ab5b-03c7c3dde32c tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] PATH_INFO: `/v3/policies/7b6629784df946fbb8dd84dd1acc7d40` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:10.267412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc08835-a5b4-43dc-ab5b-03c7c3dde32c tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=7b6629784df946fbb8dd84dd1acc7d40)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:10.268811 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2352/4718] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:20:10.271070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc08835-a5b4-43dc-ab5b-03c7c3dde32c tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:10.273154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db734e-3e42-4b5d-9964-61e22976cd8f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:10.308548 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2367/4719] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:20:10 2022] DELETE /identity/v3/policies/7b6629784df946fbb8dd84dd1acc7d40 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:10.310270 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db734e-3e42-4b5d-9964-61e22976cd8f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:10.317325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc08835-a5b4-43dc-ab5b-03c7c3dde32c tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:10.318599 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3fcd65-c8d5-493f-866e-81fcd1f526d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:10.319461 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3fcd65-c8d5-493f-866e-81fcd1f526d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:10.320299 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3fcd65-c8d5-493f-866e-81fcd1f526d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:10.320985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3fcd65-c8d5-493f-866e-81fcd1f526d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:10.321861 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3fcd65-c8d5-493f-866e-81fcd1f526d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:10.323738 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3fcd65-c8d5-493f-866e-81fcd1f526d5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:10.339228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc08835-a5b4-43dc-ab5b-03c7c3dde32c tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:10.340826 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2353/4720] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:20:10.344845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3fcd65-c8d5-493f-866e-81fcd1f526d5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:10.352164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66895d94-8da5-4d76-baf1-6465efcc0a75 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3165f85499fd40e4b6e74bdd3c8e895a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b80d27db7684d03ac6a8afdf1f69adf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:10.352816 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66895d94-8da5-4d76-baf1-6465efcc0a75 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:10.353097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66895d94-8da5-4d76-baf1-6465efcc0a75 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:10.353372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66895d94-8da5-4d76-baf1-6465efcc0a75 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] PATH_INFO: `/v3/policies/3612134df4d74758a70eacb436357958` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:10.354465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66895d94-8da5-4d76-baf1-6465efcc0a75 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=3612134df4d74758a70eacb436357958)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:10.356831 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66895d94-8da5-4d76-baf1-6465efcc0a75 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:10.362493 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3fcd65-c8d5-493f-866e-81fcd1f526d5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:10.366050 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=93,keystone:UPDATE=1,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:10.373343 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465791a-698b-486b-a96a-2fb07ddf7cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:10.375927 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465791a-698b-486b-a96a-2fb07ddf7cc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:10.376406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465791a-698b-486b-a96a-2fb07ddf7cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:10.376832 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465791a-698b-486b-a96a-2fb07ddf7cc6 admin admin] PATH_INFO: `/v3/projects/db0aea35475d48999796a64e11bc533f/users/e419ce6cbb6845d698cf684c3bd9c49f/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:10.391875 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2368/4721] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:20:10 2022] DELETE /identity/v3/policies/3612134df4d74758a70eacb436357958 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:10.393076 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66895d94-8da5-4d76-baf1-6465efcc0a75 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:10.399495 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-66895d94-8da5-4d76-baf1-6465efcc0a75 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:10.413959 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465791a-698b-486b-a96a-2fb07ddf7cc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db0aea35475d48999796a64e11bc533f, user_id=e419ce6cbb6845d698cf684c3bd9c49f, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:10.418587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465791a-698b-486b-a96a-2fb07ddf7cc6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:10.427447 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66895d94-8da5-4d76-baf1-6465efcc0a75 tempest-PoliciesTestJSON-64910385 tempest-PoliciesTestJSON-64910385-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:10.441154 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2354/4722] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:20:10 2022] PUT /identity/v3/projects/db0aea35475d48999796a64e11bc533f/users/e419ce6cbb6845d698cf684c3bd9c49f/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:10.451577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a1ba1-dd48-47de-a951-13e1123b0548 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:10.451883 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a1ba1-dd48-47de-a951-13e1123b0548 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:10.452156 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a1ba1-dd48-47de-a951-13e1123b0548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:10.460056 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a960371-ef70-4168-b9a3-e25ee5d47cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:10.460693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a960371-ef70-4168-b9a3-e25ee5d47cc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:10.460972 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a960371-ef70-4168-b9a3-e25ee5d47cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:10.461244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a960371-ef70-4168-b9a3-e25ee5d47cc0 admin admin] PATH_INFO: `/v3/users/39fdc740d3844f11b508524dba1838bb` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:10.462653 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a960371-ef70-4168-b9a3-e25ee5d47cc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39fdc740d3844f11b508524dba1838bb)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:10.464589 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a960371-ef70-4168-b9a3-e25ee5d47cc0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:10.501377 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-291a1ba1-dd48-47de-a951-13e1123b0548 None None] MFA Rules not processed for user `e419ce6cbb6845d698cf684c3bd9c49f`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:10.503532 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-291a1ba1-dd48-47de-a951-13e1123b0548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:10.563369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1a960371-ef70-4168-b9a3-e25ee5d47cc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39fdc740d3844f11b508524dba1838bb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:10.564165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1a960371-ef70-4168-b9a3-e25ee5d47cc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39fdc740d3844f11b508524dba1838bb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:10.599579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1a960371-ef70-4168-b9a3-e25ee5d47cc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39fdc740d3844f11b508524dba1838bb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:10.627852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1a960371-ef70-4168-b9a3-e25ee5d47cc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39fdc740d3844f11b508524dba1838bb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:10.628964 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1a960371-ef70-4168-b9a3-e25ee5d47cc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39fdc740d3844f11b508524dba1838bb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:10.680265 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2369/4723] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:20:10 2022] DELETE /identity/v3/users/39fdc740d3844f11b508524dba1838bb => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:10.684937 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed31df-599f-483f-83c6-b946d483ade4 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:10.685227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed31df-599f-483f-83c6-b946d483ade4 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:10.685838 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed31df-599f-483f-83c6-b946d483ade4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:10.709981 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e0ed31df-599f-483f-83c6-b946d483ade4 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:10.711559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e0ed31df-599f-483f-83c6-b946d483ade4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:10.723975 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:10.752319 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2355/4724] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:20:10.801727 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a1ba1-dd48-47de-a951-13e1123b0548 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:10.803540 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-291a1ba1-dd48-47de-a951-13e1123b0548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:10.880312 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2370/4725] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:10.892837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a1ba1-dd48-47de-a951-13e1123b0548 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:10.924846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed31df-599f-483f-83c6-b946d483ade4 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:11.045685 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43c3ac-6bc9-4ded-9ee0-bb5ef6080c73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:11.046314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43c3ac-6bc9-4ded-9ee0-bb5ef6080c73 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:11.046591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43c3ac-6bc9-4ded-9ee0-bb5ef6080c73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:11.047391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43c3ac-6bc9-4ded-9ee0-bb5ef6080c73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:11.084444 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed31df-599f-483f-83c6-b946d483ade4 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:11.096099 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efa323-cd35-4c48-a682-7b493b64676b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:11.097146 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efa323-cd35-4c48-a682-7b493b64676b service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:11.099189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efa323-cd35-4c48-a682-7b493b64676b service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:11.099880 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efa323-cd35-4c48-a682-7b493b64676b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:11.129799 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7efa323-cd35-4c48-a682-7b493b64676b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:11.131567 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7efa323-cd35-4c48-a682-7b493b64676b service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:11.178963 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2371/4726] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:20:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:20:11.189283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43c3ac-6bc9-4ded-9ee0-bb5ef6080c73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:11.190676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43c3ac-6bc9-4ded-9ee0-bb5ef6080c73 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:11.212543 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2356/4727] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:20:10 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:20:12.623906 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efa323-cd35-4c48-a682-7b493b64676b service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:12.633663 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efa323-cd35-4c48-a682-7b493b64676b service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:12.649607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d52e42-eac4-4a97-b63f-bf9d6a48ba5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:12.649607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d52e42-eac4-4a97-b63f-bf9d6a48ba5d service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:12.649607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d52e42-eac4-4a97-b63f-bf9d6a48ba5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:12.649607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d52e42-eac4-4a97-b63f-bf9d6a48ba5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:12.653672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-50d52e42-eac4-4a97-b63f-bf9d6a48ba5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:12.665375 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:12.752372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d52e42-eac4-4a97-b63f-bf9d6a48ba5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:12.753992 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d52e42-eac4-4a97-b63f-bf9d6a48ba5d service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:12.771542 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2372/4728] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:20:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:20:12.902220 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43c3ac-6bc9-4ded-9ee0-bb5ef6080c73 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:12.903804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2f43c3ac-6bc9-4ded-9ee0-bb5ef6080c73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:12.926365 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43c3ac-6bc9-4ded-9ee0-bb5ef6080c73 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:12.934342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b1257-2463-49e1-8a65-093f9b7fbe5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:12.935145 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b1257-2463-49e1-8a65-093f9b7fbe5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:12.935536 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b1257-2463-49e1-8a65-093f9b7fbe5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:12.935885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b1257-2463-49e1-8a65-093f9b7fbe5c admin admin] PATH_INFO: `/v3/projects/8553c8762b044d15a400eeed575ecbe5` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:12.937409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b1257-2463-49e1-8a65-093f9b7fbe5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8553c8762b044d15a400eeed575ecbe5)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:12.939573 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b1257-2463-49e1-8a65-093f9b7fbe5c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:13.028359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-348b1257-2463-49e1-8a65-093f9b7fbe5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8553c8762b044d15a400eeed575ecbe5', 'request_id': 'req-348b1257-2463-49e1-8a65-093f9b7fbe5c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:13.044382 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-348b1257-2463-49e1-8a65-093f9b7fbe5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8553c8762b044d15a400eeed575ecbe5', 'request_id': 'req-348b1257-2463-49e1-8a65-093f9b7fbe5c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:13.065332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-348b1257-2463-49e1-8a65-093f9b7fbe5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8553c8762b044d15a400eeed575ecbe5', 'request_id': 'req-348b1257-2463-49e1-8a65-093f9b7fbe5c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:13.068258 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:13.086682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-348b1257-2463-49e1-8a65-093f9b7fbe5c admin admin] The token cache is being invalidate because project 8553c8762b044d15a400eeed575ecbe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:13.087285 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-348b1257-2463-49e1-8a65-093f9b7fbe5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:13.088287 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-348b1257-2463-49e1-8a65-093f9b7fbe5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:13.092530 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2357/4729] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:20:12 2022] DELETE /identity/v3/projects/8553c8762b044d15a400eeed575ecbe5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:13.096246 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d52e42-eac4-4a97-b63f-bf9d6a48ba5d service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:13.115369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d52e42-eac4-4a97-b63f-bf9d6a48ba5d service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:13.288219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee94aa-790b-45a6-a209-2bf780c562e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:13.289144 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee94aa-790b-45a6-a209-2bf780c562e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:13.291428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee94aa-790b-45a6-a209-2bf780c562e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:13.293026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee94aa-790b-45a6-a209-2bf780c562e6 admin admin] PATH_INFO: `/v3/users/3165f85499fd40e4b6e74bdd3c8e895a` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:13.296558 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee94aa-790b-45a6-a209-2bf780c562e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3165f85499fd40e4b6e74bdd3c8e895a)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:13.299605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee94aa-790b-45a6-a209-2bf780c562e6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:13.383231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-27ee94aa-790b-45a6-a209-2bf780c562e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3165f85499fd40e4b6e74bdd3c8e895a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:13.384137 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-27ee94aa-790b-45a6-a209-2bf780c562e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3165f85499fd40e4b6e74bdd3c8e895a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:13.403837 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-27ee94aa-790b-45a6-a209-2bf780c562e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3165f85499fd40e4b6e74bdd3c8e895a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:13.421399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-27ee94aa-790b-45a6-a209-2bf780c562e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3165f85499fd40e4b6e74bdd3c8e895a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:13.423212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-27ee94aa-790b-45a6-a209-2bf780c562e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3165f85499fd40e4b6e74bdd3c8e895a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:13.485324 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2373/4730] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:20:13 2022] DELETE /identity/v3/users/3165f85499fd40e4b6e74bdd3c8e895a => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:15.012066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b1257-2463-49e1-8a65-093f9b7fbe5c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:15.013683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-348b1257-2463-49e1-8a65-093f9b7fbe5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:15.052977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b1257-2463-49e1-8a65-093f9b7fbe5c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:15.202252 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f5fd1-641f-48a9-81f3-3445694fc940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:15.203159 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f5fd1-641f-48a9-81f3-3445694fc940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:15.203694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f5fd1-641f-48a9-81f3-3445694fc940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:15.205883 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f5fd1-641f-48a9-81f3-3445694fc940 admin admin] PATH_INFO: `/v3/projects/4b80d27db7684d03ac6a8afdf1f69adf` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:15.208776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f5fd1-641f-48a9-81f3-3445694fc940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b80d27db7684d03ac6a8afdf1f69adf)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:15.212854 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f5fd1-641f-48a9-81f3-3445694fc940 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:15.363095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-709f5fd1-641f-48a9-81f3-3445694fc940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b80d27db7684d03ac6a8afdf1f69adf', 'request_id': 'req-709f5fd1-641f-48a9-81f3-3445694fc940'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:15.377871 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-709f5fd1-641f-48a9-81f3-3445694fc940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b80d27db7684d03ac6a8afdf1f69adf', 'request_id': 'req-709f5fd1-641f-48a9-81f3-3445694fc940'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:15.391983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-709f5fd1-641f-48a9-81f3-3445694fc940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b80d27db7684d03ac6a8afdf1f69adf', 'request_id': 'req-709f5fd1-641f-48a9-81f3-3445694fc940'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:15.426873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-709f5fd1-641f-48a9-81f3-3445694fc940 admin admin] The token cache is being invalidate because project 4b80d27db7684d03ac6a8afdf1f69adf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:15.427498 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-709f5fd1-641f-48a9-81f3-3445694fc940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:15.430094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-709f5fd1-641f-48a9-81f3-3445694fc940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:15.449132 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2358/4731] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:20:15 2022] DELETE /identity/v3/projects/4b80d27db7684d03ac6a8afdf1f69adf => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:15.450748 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad727a-30bc-4db2-98b1-9c189af10dc8 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:15.451170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad727a-30bc-4db2-98b1-9c189af10dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:15.451317 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad727a-30bc-4db2-98b1-9c189af10dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:15.539845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-7cad727a-30bc-4db2-98b1-9c189af10dc8 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:15.540014 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7cad727a-30bc-4db2-98b1-9c189af10dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:15.600123 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:15.794593 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2374/4732] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:15.802163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad26dd5-bd2f-4a7e-b2b3-47d77dcb68ed None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:15.802452 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad26dd5-bd2f-4a7e-b2b3-47d77dcb68ed None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:15.802736 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad26dd5-bd2f-4a7e-b2b3-47d77dcb68ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:15.886494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-1ad26dd5-bd2f-4a7e-b2b3-47d77dcb68ed None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:15.887805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1ad26dd5-bd2f-4a7e-b2b3-47d77dcb68ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:15.926079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad727a-30bc-4db2-98b1-9c189af10dc8 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:15.938967 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2359/4733] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:15.954188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad727a-30bc-4db2-98b1-9c189af10dc8 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:15.974880 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde98371-f4dc-4a67-9da7-f048bc5eb1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:15.975522 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde98371-f4dc-4a67-9da7-f048bc5eb1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:15.975807 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde98371-f4dc-4a67-9da7-f048bc5eb1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:15.976087 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde98371-f4dc-4a67-9da7-f048bc5eb1e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:15.976756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde98371-f4dc-4a67-9da7-f048bc5eb1e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:20:15.977082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde98371-f4dc-4a67-9da7-f048bc5eb1e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:15.978820 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde98371-f4dc-4a67-9da7-f048bc5eb1e8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:16.006168 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2375/4734] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:20:16.011343 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad26dd5-bd2f-4a7e-b2b3-47d77dcb68ed None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:16.024458 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad26dd5-bd2f-4a7e-b2b3-47d77dcb68ed None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:16.034515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5547bb3-c150-4f9f-882c-2547d94fc72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:16.035576 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5547bb3-c150-4f9f-882c-2547d94fc72a admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:16.036267 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5547bb3-c150-4f9f-882c-2547d94fc72a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:16.036364 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5547bb3-c150-4f9f-882c-2547d94fc72a admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:16.037297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5547bb3-c150-4f9f-882c-2547d94fc72a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:16.041410 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5547bb3-c150-4f9f-882c-2547d94fc72a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:16.200477 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2360/4735] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:20:16 2022] POST /identity/v3/projects => generated 365 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:16.207169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde98371-f4dc-4a67-9da7-f048bc5eb1e8 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:16.233918 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde98371-f4dc-4a67-9da7-f048bc5eb1e8 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:16.413825 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35102674-ae42-4658-b42a-12b6557bd0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:16.414470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35102674-ae42-4658-b42a-12b6557bd0f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:16.414943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35102674-ae42-4658-b42a-12b6557bd0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:16.416386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35102674-ae42-4658-b42a-12b6557bd0f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:16.418219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35102674-ae42-4658-b42a-12b6557bd0f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:16.420245 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35102674-ae42-4658-b42a-12b6557bd0f9 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:16.463713 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2376/4736] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:20:16 2022] POST /identity/v3/users => generated 283 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:16.468725 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5547bb3-c150-4f9f-882c-2547d94fc72a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:16.488018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5547bb3-c150-4f9f-882c-2547d94fc72a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:16.506217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5a6db-d8aa-4aec-b7cc-be18402eb17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:16.506979 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5a6db-d8aa-4aec-b7cc-be18402eb17e admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:16.507333 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5a6db-d8aa-4aec-b7cc-be18402eb17e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:16.507698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5a6db-d8aa-4aec-b7cc-be18402eb17e admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:16.508494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5a6db-d8aa-4aec-b7cc-be18402eb17e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:16.515061 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5a6db-d8aa-4aec-b7cc-be18402eb17e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:16.548924 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2361/4737] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:20:16.553355 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35102674-ae42-4658-b42a-12b6557bd0f9 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:16.570387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35102674-ae42-4658-b42a-12b6557bd0f9 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:16.588632 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91194624-3c90-416d-959a-9744d17fb060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:16.589848 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91194624-3c90-416d-959a-9744d17fb060 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:16.590135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91194624-3c90-416d-959a-9744d17fb060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:16.590412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91194624-3c90-416d-959a-9744d17fb060 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:16.591073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91194624-3c90-416d-959a-9744d17fb060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:16.592745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91194624-3c90-416d-959a-9744d17fb060 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:16.636541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5a6db-d8aa-4aec-b7cc-be18402eb17e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:16.640315 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2377/4738] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:20:16.652368 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5a6db-d8aa-4aec-b7cc-be18402eb17e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:16.676590 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9c3d8-933a-4bae-b51f-2e5b51d15c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:16.677354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9c3d8-933a-4bae-b51f-2e5b51d15c02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:16.681848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9c3d8-933a-4bae-b51f-2e5b51d15c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:16.682272 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9c3d8-933a-4bae-b51f-2e5b51d15c02 admin admin] PATH_INFO: `/v3/projects/6b74932d5d0549fc83ad167eb3284f85/users/e15677bf13ef42fdb59034ffd09330bb/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:16.739060 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9c3d8-933a-4bae-b51f-2e5b51d15c02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b74932d5d0549fc83ad167eb3284f85, user_id=e15677bf13ef42fdb59034ffd09330bb, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:16.741945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9c3d8-933a-4bae-b51f-2e5b51d15c02 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:16.801147 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2362/4739] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:20:16 2022] PUT /identity/v3/projects/6b74932d5d0549fc83ad167eb3284f85/users/e15677bf13ef42fdb59034ffd09330bb/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:20:16.813362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c721e-c36a-45fe-b356-91b79498a891 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:16.813755 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c721e-c36a-45fe-b356-91b79498a891 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:16.814110 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c721e-c36a-45fe-b356-91b79498a891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:16.896652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-9b5c721e-c36a-45fe-b356-91b79498a891 None None] MFA Rules not processed for user `e15677bf13ef42fdb59034ffd09330bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:16.898088 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9b5c721e-c36a-45fe-b356-91b79498a891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:17.094877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9c3d8-933a-4bae-b51f-2e5b51d15c02 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:17.099698 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2378/4740] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:17.114939 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:17.270018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9c3d8-933a-4bae-b51f-2e5b51d15c02 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:17.279690 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7ea1a-a582-4201-a521-9ebc3290f7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:17.280329 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7ea1a-a582-4201-a521-9ebc3290f7e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:17.280609 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7ea1a-a582-4201-a521-9ebc3290f7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:17.281111 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7ea1a-a582-4201-a521-9ebc3290f7e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:17.281542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7ea1a-a582-4201-a521-9ebc3290f7e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:17.283672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7ea1a-a582-4201-a521-9ebc3290f7e3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:17.379839 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2363/4741] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:20:17 2022] POST /identity/v3/projects => generated 367 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:17.384123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c721e-c36a-45fe-b356-91b79498a891 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:17.415229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c721e-c36a-45fe-b356-91b79498a891 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:17.437065 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:17.643233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8601c0-9cf0-48db-99c6-882fe481ce2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:17.645898 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8601c0-9cf0-48db-99c6-882fe481ce2c admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:17.647347 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8601c0-9cf0-48db-99c6-882fe481ce2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:17.650374 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8601c0-9cf0-48db-99c6-882fe481ce2c admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:17.651595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8601c0-9cf0-48db-99c6-882fe481ce2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:17.663033 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8601c0-9cf0-48db-99c6-882fe481ce2c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:17.782932 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2379/4742] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:20:17 2022] POST /identity/v3/users => generated 290 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:17.789525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7ea1a-a582-4201-a521-9ebc3290f7e3 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:17.847986 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7ea1a-a582-4201-a521-9ebc3290f7e3 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:17.861538 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7df0b3-8bcc-4160-a873-6d99ee164bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:17.862176 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7df0b3-8bcc-4160-a873-6d99ee164bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:17.862465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7df0b3-8bcc-4160-a873-6d99ee164bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:17.862741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7df0b3-8bcc-4160-a873-6d99ee164bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:17.863651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7df0b3-8bcc-4160-a873-6d99ee164bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:17.865279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7df0b3-8bcc-4160-a873-6d99ee164bf0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:17.937064 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2364/4743] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:20:17.941065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8601c0-9cf0-48db-99c6-882fe481ce2c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:17.959145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8601c0-9cf0-48db-99c6-882fe481ce2c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:17.980591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d4cdf-dec9-42fa-b949-c46878eab6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:17.983739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d4cdf-dec9-42fa-b949-c46878eab6c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:17.984212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d4cdf-dec9-42fa-b949-c46878eab6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:17.989211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d4cdf-dec9-42fa-b949-c46878eab6c3 admin admin] PATH_INFO: `/v3/projects/54782bda17ca47bb8f7c5e8ec928491c/users/30b0ee5f936b4ff0a902a97e221e35ab/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:18.077523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d4cdf-dec9-42fa-b949-c46878eab6c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54782bda17ca47bb8f7c5e8ec928491c, user_id=30b0ee5f936b4ff0a902a97e221e35ab, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:18.089817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d4cdf-dec9-42fa-b949-c46878eab6c3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:18.141781 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2380/4744] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:20:17 2022] PUT /identity/v3/projects/54782bda17ca47bb8f7c5e8ec928491c/users/30b0ee5f936b4ff0a902a97e221e35ab/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:18.145885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7df0b3-8bcc-4160-a873-6d99ee164bf0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:18.165796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7df0b3-8bcc-4160-a873-6d99ee164bf0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:18.358576 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f3b5a2-9286-41dc-a151-3e1250ba14f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:18.359235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3b5a2-9286-41dc-a151-3e1250ba14f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:18.359818 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3b5a2-9286-41dc-a151-3e1250ba14f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:18.361277 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3b5a2-9286-41dc-a151-3e1250ba14f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:18.361976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f3b5a2-9286-41dc-a151-3e1250ba14f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:18.367530 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f3b5a2-9286-41dc-a151-3e1250ba14f3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:18.395736 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2365/4745] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:20:18.399706 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d4cdf-dec9-42fa-b949-c46878eab6c3 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:18.427421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d4cdf-dec9-42fa-b949-c46878eab6c3 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:18.444427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af039c-890c-48be-b11b-bf6d6889150e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:18.447487 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af039c-890c-48be-b11b-bf6d6889150e admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:18.449001 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af039c-890c-48be-b11b-bf6d6889150e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:18.449959 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af039c-890c-48be-b11b-bf6d6889150e admin admin] PATH_INFO: `/v3/projects/54782bda17ca47bb8f7c5e8ec928491c/users/30b0ee5f936b4ff0a902a97e221e35ab/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:18.456459 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af039c-890c-48be-b11b-bf6d6889150e admin admin] RBAC: Authorizing `identity:create_grant(project_id=54782bda17ca47bb8f7c5e8ec928491c, user_id=30b0ee5f936b4ff0a902a97e221e35ab, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:18.465065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af039c-890c-48be-b11b-bf6d6889150e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:18.517900 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2381/4746] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:20:18 2022] PUT /identity/v3/projects/54782bda17ca47bb8f7c5e8ec928491c/users/30b0ee5f936b4ff0a902a97e221e35ab/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:18.529626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b669c8-9c18-4987-b487-0f5fb6d21e55 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:18.529916 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b669c8-9c18-4987-b487-0f5fb6d21e55 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:18.530199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b669c8-9c18-4987-b487-0f5fb6d21e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:18.591240 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a3b669c8-9c18-4987-b487-0f5fb6d21e55 None None] MFA Rules not processed for user `30b0ee5f936b4ff0a902a97e221e35ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:18.592481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a3b669c8-9c18-4987-b487-0f5fb6d21e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:18.803593 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2366/4747] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:18.808128 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af039c-890c-48be-b11b-bf6d6889150e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:18.828437 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af039c-890c-48be-b11b-bf6d6889150e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:18.846295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c39b1-0efc-47e7-b780-979adfea1a95 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:18.847214 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c39b1-0efc-47e7-b780-979adfea1a95 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:18.847521 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c39b1-0efc-47e7-b780-979adfea1a95 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:18.847807 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c39b1-0efc-47e7-b780-979adfea1a95 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:18.848616 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c39b1-0efc-47e7-b780-979adfea1a95 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:18.850773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c39b1-0efc-47e7-b780-979adfea1a95 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:18.979273 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2382/4748] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:20:18 2022] POST /identity/v3/projects => generated 359 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:20:18.983310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b669c8-9c18-4987-b487-0f5fb6d21e55 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:19.008240 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b669c8-9c18-4987-b487-0f5fb6d21e55 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:19.019614 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:19.122362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c39b1-0efc-47e7-b780-979adfea1a95 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:19.124570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-dd9c39b1-0efc-47e7-b780-979adfea1a95 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:19.211338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d0fc9-5e1a-498b-8978-d76b55ad4009 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:19.212000 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d0fc9-5e1a-498b-8978-d76b55ad4009 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:19.212878 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d0fc9-5e1a-498b-8978-d76b55ad4009 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:19.213374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d0fc9-5e1a-498b-8978-d76b55ad4009 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:19.216780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d0fc9-5e1a-498b-8978-d76b55ad4009 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:19.219247 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d0fc9-5e1a-498b-8978-d76b55ad4009 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:19.270998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c39b1-0efc-47e7-b780-979adfea1a95 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:19.280368 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2367/4749] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:20:18 2022] POST /identity/v3/users => generated 413 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:19.282781 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d0fc9-5e1a-498b-8978-d76b55ad4009 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:19.282966 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c0b71-9401-4984-86d4-8dcfb4518838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:19.283693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c0b71-9401-4984-86d4-8dcfb4518838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:19.283975 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c0b71-9401-4984-86d4-8dcfb4518838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:19.284253 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c0b71-9401-4984-86d4-8dcfb4518838 admin admin] PATH_INFO: `/v3/users/58c0074bfe4d476da60c210af6408203` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:19.285698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c0b71-9401-4984-86d4-8dcfb4518838 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58c0074bfe4d476da60c210af6408203)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:19.287970 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c0b71-9401-4984-86d4-8dcfb4518838 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:19.303001 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d0fc9-5e1a-498b-8978-d76b55ad4009 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:19.309833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0da08a-6f71-47f3-a4b4-74a4db557560 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:19.310511 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0da08a-6f71-47f3-a4b4-74a4db557560 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:19.310765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0da08a-6f71-47f3-a4b4-74a4db557560 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:19.311658 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0da08a-6f71-47f3-a4b4-74a4db557560 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/users/074ddad74a6a4212ab9ed2762aa24840` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:19.328723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0da08a-6f71-47f3-a4b4-74a4db557560 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:get_user(user_id=074ddad74a6a4212ab9ed2762aa24840)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:19.331679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0da08a-6f71-47f3-a4b4-74a4db557560 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:19.334209 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2368/4750] 10.222.0.30 () {58 vars in 1221 bytes} [Sun Sep 4 01:20:19 2022] GET /identity/v3/users/074ddad74a6a4212ab9ed2762aa24840 => generated 413 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:20:19.337968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0da08a-6f71-47f3-a4b4-74a4db557560 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:19.357932 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0da08a-6f71-47f3-a4b4-74a4db557560 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:19.365883 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e605bb-55f4-428a-af6a-36c42e4773b0 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:19.371101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e605bb-55f4-428a-af6a-36c42e4773b0 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:19.377029 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e605bb-55f4-428a-af6a-36c42e4773b0 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:19.378547 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e605bb-55f4-428a-af6a-36c42e4773b0 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/users/074ddad74a6a4212ab9ed2762aa24840` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:19.381634 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=88,keystone:INSERT=6,keystone:DELETE=6 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:19.389806 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e605bb-55f4-428a-af6a-36c42e4773b0 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:delete_user(user_id=074ddad74a6a4212ab9ed2762aa24840)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:19.393790 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e605bb-55f4-428a-af6a-36c42e4773b0 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:19.399207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-522c0b71-9401-4984-86d4-8dcfb4518838 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58c0074bfe4d476da60c210af6408203'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:19.401051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-522c0b71-9401-4984-86d4-8dcfb4518838 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58c0074bfe4d476da60c210af6408203'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:19.422161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-522c0b71-9401-4984-86d4-8dcfb4518838 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58c0074bfe4d476da60c210af6408203'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:19.443666 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-522c0b71-9401-4984-86d4-8dcfb4518838 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58c0074bfe4d476da60c210af6408203'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:19.444444 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-522c0b71-9401-4984-86d4-8dcfb4518838 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58c0074bfe4d476da60c210af6408203'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:19.492645 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2383/4751] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:20:19 2022] DELETE /identity/v3/users/58c0074bfe4d476da60c210af6408203 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:19.528011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-81e605bb-55f4-428a-af6a-36c42e4773b0 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '074ddad74a6a4212ab9ed2762aa24840'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:19.531217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-81e605bb-55f4-428a-af6a-36c42e4773b0 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '074ddad74a6a4212ab9ed2762aa24840'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:19.564126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-81e605bb-55f4-428a-af6a-36c42e4773b0 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '074ddad74a6a4212ab9ed2762aa24840'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:19.589721 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-81e605bb-55f4-428a-af6a-36c42e4773b0 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '074ddad74a6a4212ab9ed2762aa24840'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:19.590439 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-81e605bb-55f4-428a-af6a-36c42e4773b0 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '074ddad74a6a4212ab9ed2762aa24840'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:19.646427 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2369/4752] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:20:19 2022] DELETE /identity/v3/users/074ddad74a6a4212ab9ed2762aa24840 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:19.646765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c0b71-9401-4984-86d4-8dcfb4518838 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:19.648074 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-522c0b71-9401-4984-86d4-8dcfb4518838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:19.856350 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c0b71-9401-4984-86d4-8dcfb4518838 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:19.976168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7e374-c843-405c-b6ad-4a416185f38e tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:19.977268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7e374-c843-405c-b6ad-4a416185f38e tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:19.977716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7e374-c843-405c-b6ad-4a416185f38e tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:19.978154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7e374-c843-405c-b6ad-4a416185f38e tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/projects/9fd3b23b575a4994929d7e7198d87eae` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:19.979485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a7e374-c843-405c-b6ad-4a416185f38e tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9fd3b23b575a4994929d7e7198d87eae)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:19.982502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a7e374-c843-405c-b6ad-4a416185f38e tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:20.076154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-44a7e374-c843-405c-b6ad-4a416185f38e tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fd3b23b575a4994929d7e7198d87eae', 'request_id': 'req-44a7e374-c843-405c-b6ad-4a416185f38e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:20.097817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-44a7e374-c843-405c-b6ad-4a416185f38e tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fd3b23b575a4994929d7e7198d87eae', 'request_id': 'req-44a7e374-c843-405c-b6ad-4a416185f38e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:20.106582 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-44a7e374-c843-405c-b6ad-4a416185f38e tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fd3b23b575a4994929d7e7198d87eae', 'request_id': 'req-44a7e374-c843-405c-b6ad-4a416185f38e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:20.109780 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:20.156084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-44a7e374-c843-405c-b6ad-4a416185f38e tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] The token cache is being invalidate because project 9fd3b23b575a4994929d7e7198d87eae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:20.165818 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-44a7e374-c843-405c-b6ad-4a416185f38e tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:20.168707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-44a7e374-c843-405c-b6ad-4a416185f38e tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:20.175832 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2384/4753] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:20:19 2022] DELETE /identity/v3/projects/9fd3b23b575a4994929d7e7198d87eae => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:20.180660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e605bb-55f4-428a-af6a-36c42e4773b0 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:20.184332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-81e605bb-55f4-428a-af6a-36c42e4773b0 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:20.211503 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e605bb-55f4-428a-af6a-36c42e4773b0 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:20.375537 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:20.398131 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3402a65-8cb8-41c2-b0ac-76e98bed59ee tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:20.399769 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3402a65-8cb8-41c2-b0ac-76e98bed59ee tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:20.400288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3402a65-8cb8-41c2-b0ac-76e98bed59ee tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:20.402092 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3402a65-8cb8-41c2-b0ac-76e98bed59ee tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:20.403562 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3402a65-8cb8-41c2-b0ac-76e98bed59ee tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:20.405628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3402a65-8cb8-41c2-b0ac-76e98bed59ee tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:20.444851 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2370/4754] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:20:20 2022] POST /identity/v3/projects => generated 348 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:20.446321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7e374-c843-405c-b6ad-4a416185f38e tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:20.448144 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-44a7e374-c843-405c-b6ad-4a416185f38e tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:20.491006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7e374-c843-405c-b6ad-4a416185f38e tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:20.726689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3402a65-8cb8-41c2-b0ac-76e98bed59ee tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:20.729591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c3402a65-8cb8-41c2-b0ac-76e98bed59ee tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:20.776978 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f631b8a-42ae-4fb6-aae8-d4709f3022e0 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:20.779017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f631b8a-42ae-4fb6-aae8-d4709f3022e0 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:20.779316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f631b8a-42ae-4fb6-aae8-d4709f3022e0 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:20.779596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f631b8a-42ae-4fb6-aae8-d4709f3022e0 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:20.786470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f631b8a-42ae-4fb6-aae8-d4709f3022e0 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:20:20.786862 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f631b8a-42ae-4fb6-aae8-d4709f3022e0 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:20.794381 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-1f631b8a-42ae-4fb6-aae8-d4709f3022e0 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:20.794381 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:20:20.794381 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:20:20.796065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f631b8a-42ae-4fb6-aae8-d4709f3022e0 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:20.859559 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2385/4755] 10.222.0.30 () {58 vars in 1160 bytes} [Sun Sep 4 01:20:20 2022] GET /identity/v3/projects?is_domain=True => generated 1020 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:20:20.869370 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f631b8a-42ae-4fb6-aae8-d4709f3022e0 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:20.910224 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f631b8a-42ae-4fb6-aae8-d4709f3022e0 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:20.926943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3402a65-8cb8-41c2-b0ac-76e98bed59ee tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:20.940178 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e7eae-6ec2-4d42-a3ed-d5f9b30ec05b tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:20.940375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b05cb2-3a30-461e-b1a6-804e1ce47619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:20.940823 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e7eae-6ec2-4d42-a3ed-d5f9b30ec05b tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:20.940937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b05cb2-3a30-461e-b1a6-804e1ce47619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:20.941128 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e7eae-6ec2-4d42-a3ed-d5f9b30ec05b tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:20.941235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b05cb2-3a30-461e-b1a6-804e1ce47619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:20.941422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e7eae-6ec2-4d42-a3ed-d5f9b30ec05b tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:20.941577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b05cb2-3a30-461e-b1a6-804e1ce47619 admin admin] PATH_INFO: `/v3/projects/3e227d1ec36042b89d797fb099a8d6fe` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:20.946268 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b05cb2-3a30-461e-b1a6-804e1ce47619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e227d1ec36042b89d797fb099a8d6fe)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:20.947087 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e7eae-6ec2-4d42-a3ed-d5f9b30ec05b tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:20.949347 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e7eae-6ec2-4d42-a3ed-d5f9b30ec05b tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:20.950561 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b05cb2-3a30-461e-b1a6-804e1ce47619 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:21.005503 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2386/4756] 10.222.0.30 () {58 vars in 1128 bytes} [Sun Sep 4 01:20:20 2022] GET /identity/v3/domains => generated 829 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:20:21.009412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e7eae-6ec2-4d42-a3ed-d5f9b30ec05b tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:21.040348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e7eae-6ec2-4d42-a3ed-d5f9b30ec05b tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:21.063916 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-06b05cb2-3a30-461e-b1a6-804e1ce47619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e227d1ec36042b89d797fb099a8d6fe', 'request_id': 'req-06b05cb2-3a30-461e-b1a6-804e1ce47619'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:21.110129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-06b05cb2-3a30-461e-b1a6-804e1ce47619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e227d1ec36042b89d797fb099a8d6fe', 'request_id': 'req-06b05cb2-3a30-461e-b1a6-804e1ce47619'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:21.131980 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-06b05cb2-3a30-461e-b1a6-804e1ce47619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e227d1ec36042b89d797fb099a8d6fe', 'request_id': 'req-06b05cb2-3a30-461e-b1a6-804e1ce47619'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:21.177574 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-06b05cb2-3a30-461e-b1a6-804e1ce47619 admin admin] The token cache is being invalidate because project 3e227d1ec36042b89d797fb099a8d6fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:21.178754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-06b05cb2-3a30-461e-b1a6-804e1ce47619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:21.180681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-06b05cb2-3a30-461e-b1a6-804e1ce47619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:21.184868 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c14d7-b52c-411a-9df4-2462fef9784e tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:21.187524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c14d7-b52c-411a-9df4-2462fef9784e tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:21.187831 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c14d7-b52c-411a-9df4-2462fef9784e tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:21.188113 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c14d7-b52c-411a-9df4-2462fef9784e tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/projects/1dc6fcdcfd7a4ffbb8229df2c4f22823` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:21.188226 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2371/4757] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:20:20 2022] DELETE /identity/v3/projects/3e227d1ec36042b89d797fb099a8d6fe => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:21.192968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a51804-1de1-4fd2-8fbc-334984d17b29 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:21.194971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a51804-1de1-4fd2-8fbc-334984d17b29 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:21.196504 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a51804-1de1-4fd2-8fbc-334984d17b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:21.197663 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c14d7-b52c-411a-9df4-2462fef9784e tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:update_project(project_id=1dc6fcdcfd7a4ffbb8229df2c4f22823)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:21.199372 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-0d8c14d7-b52c-411a-9df4-2462fef9784e tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:21.199372 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:20:21.199372 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:20:21.200391 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c14d7-b52c-411a-9df4-2462fef9784e tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:21.218165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0d8c14d7-b52c-411a-9df4-2462fef9784e tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1dc6fcdcfd7a4ffbb8229df2c4f22823'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:21.218925 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0d8c14d7-b52c-411a-9df4-2462fef9784e tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1dc6fcdcfd7a4ffbb8229df2c4f22823'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:21.270381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-22a51804-1de1-4fd2-8fbc-334984d17b29 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:21.273797 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-22a51804-1de1-4fd2-8fbc-334984d17b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:21.287863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0d8c14d7-b52c-411a-9df4-2462fef9784e tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1dc6fcdcfd7a4ffbb8229df2c4f22823'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:21.288220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0d8c14d7-b52c-411a-9df4-2462fef9784e tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1dc6fcdcfd7a4ffbb8229df2c4f22823'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:21.291566 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2387/4758] 10.222.0.30 () {60 vars in 1252 bytes} [Sun Sep 4 01:20:21 2022] PATCH /identity/v3/projects/1dc6fcdcfd7a4ffbb8229df2c4f22823 => generated 362 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:20:21.296064 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c14d7-b52c-411a-9df4-2462fef9784e tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:21.301018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0d8c14d7-b52c-411a-9df4-2462fef9784e tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:21.394261 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:21.424775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c14d7-b52c-411a-9df4-2462fef9784e tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:21.432186 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2372/4759] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:21.434300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fe2e2-eace-451f-ba04-657dfe6adec2 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:21.434592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fe2e2-eace-451f-ba04-657dfe6adec2 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:21.434868 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fe2e2-eace-451f-ba04-657dfe6adec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:21.442187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3d0c3-750b-4f34-99bc-e623697ac826 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:21.442605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3d0c3-750b-4f34-99bc-e623697ac826 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:21.443179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3d0c3-750b-4f34-99bc-e623697ac826 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:21.443464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3d0c3-750b-4f34-99bc-e623697ac826 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/projects/1dc6fcdcfd7a4ffbb8229df2c4f22823` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:21.474959 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3d0c3-750b-4f34-99bc-e623697ac826 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1dc6fcdcfd7a4ffbb8229df2c4f22823)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:21.480214 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3d0c3-750b-4f34-99bc-e623697ac826 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:21.525900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-9b1fe2e2-eace-451f-ba04-657dfe6adec2 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:21.536011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9b1fe2e2-eace-451f-ba04-657dfe6adec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:21.570419 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2373/4760] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:21.571332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-69e3d0c3-750b-4f34-99bc-e623697ac826 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1dc6fcdcfd7a4ffbb8229df2c4f22823'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:21.571463 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fe2e2-eace-451f-ba04-657dfe6adec2 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:21.586621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fe2e2-eace-451f-ba04-657dfe6adec2 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:21.593876 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-69e3d0c3-750b-4f34-99bc-e623697ac826 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1dc6fcdcfd7a4ffbb8229df2c4f22823'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:21.618319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59d61d-19f0-4c0b-9f20-7064cf95d316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:21.619007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59d61d-19f0-4c0b-9f20-7064cf95d316 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:21.619295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59d61d-19f0-4c0b-9f20-7064cf95d316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:21.619555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59d61d-19f0-4c0b-9f20-7064cf95d316 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:21.622628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59d61d-19f0-4c0b-9f20-7064cf95d316 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:20:21.622976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59d61d-19f0-4c0b-9f20-7064cf95d316 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:21.632362 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59d61d-19f0-4c0b-9f20-7064cf95d316 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:21.660769 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:21.674176 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2374/4761] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:20:21.678881 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59d61d-19f0-4c0b-9f20-7064cf95d316 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:21.697400 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-69e3d0c3-750b-4f34-99bc-e623697ac826 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dc6fcdcfd7a4ffbb8229df2c4f22823', 'request_id': 'req-69e3d0c3-750b-4f34-99bc-e623697ac826'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:21.717635 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-69e3d0c3-750b-4f34-99bc-e623697ac826 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dc6fcdcfd7a4ffbb8229df2c4f22823', 'request_id': 'req-69e3d0c3-750b-4f34-99bc-e623697ac826'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:21.721151 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59d61d-19f0-4c0b-9f20-7064cf95d316 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:21.740382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-69e3d0c3-750b-4f34-99bc-e623697ac826 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dc6fcdcfd7a4ffbb8229df2c4f22823', 'request_id': 'req-69e3d0c3-750b-4f34-99bc-e623697ac826'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:21.761459 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-69e3d0c3-750b-4f34-99bc-e623697ac826 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] The token cache is being invalidate because project 1dc6fcdcfd7a4ffbb8229df2c4f22823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:21.762288 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-69e3d0c3-750b-4f34-99bc-e623697ac826 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:21.763201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-69e3d0c3-750b-4f34-99bc-e623697ac826 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:21.777903 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-69e3d0c3-750b-4f34-99bc-e623697ac826 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1dc6fcdcfd7a4ffbb8229df2c4f22823', 'request_id': 'req-69e3d0c3-750b-4f34-99bc-e623697ac826'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:21.779060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-69e3d0c3-750b-4f34-99bc-e623697ac826 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1dc6fcdcfd7a4ffbb8229df2c4f22823', 'request_id': 'req-69e3d0c3-750b-4f34-99bc-e623697ac826'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:21.780085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-69e3d0c3-750b-4f34-99bc-e623697ac826 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1dc6fcdcfd7a4ffbb8229df2c4f22823', 'request_id': 'req-69e3d0c3-750b-4f34-99bc-e623697ac826'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:21.793562 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2388/4762] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:20:21 2022] DELETE /identity/v3/projects/1dc6fcdcfd7a4ffbb8229df2c4f22823 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:21.798643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3d0c3-750b-4f34-99bc-e623697ac826 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:21.800545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-69e3d0c3-750b-4f34-99bc-e623697ac826 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:21.845936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437a3ec-ee08-4c52-9ef3-042d3ea44cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:21.846857 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437a3ec-ee08-4c52-9ef3-042d3ea44cc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:21.846857 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437a3ec-ee08-4c52-9ef3-042d3ea44cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:21.847163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437a3ec-ee08-4c52-9ef3-042d3ea44cc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:21.850927 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7437a3ec-ee08-4c52-9ef3-042d3ea44cc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:21.855807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7437a3ec-ee08-4c52-9ef3-042d3ea44cc2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:21.932886 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2375/4763] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:20:21 2022] POST /identity/v3/projects => generated 375 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:21.935167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437a3ec-ee08-4c52-9ef3-042d3ea44cc2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:21.942964 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3d0c3-750b-4f34-99bc-e623697ac826 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:21.943661 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7437a3ec-ee08-4c52-9ef3-042d3ea44cc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:22.004275 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:22.066201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb4cbf-98e2-4e46-a90a-31114ea52b62 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:22.067831 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb4cbf-98e2-4e46-a90a-31114ea52b62 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:22.072166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb4cbf-98e2-4e46-a90a-31114ea52b62 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:22.073212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb4cbf-98e2-4e46-a90a-31114ea52b62 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:22.074191 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb4cbf-98e2-4e46-a90a-31114ea52b62 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:22.076512 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb4cbf-98e2-4e46-a90a-31114ea52b62 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:22.100792 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437a3ec-ee08-4c52-9ef3-042d3ea44cc2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:22.107161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba5592-3636-4554-be62-eb0ff05fd701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:22.108000 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba5592-3636-4554-be62-eb0ff05fd701 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:22.108291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba5592-3636-4554-be62-eb0ff05fd701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:22.108609 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba5592-3636-4554-be62-eb0ff05fd701 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:22.109535 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba5592-3636-4554-be62-eb0ff05fd701 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:22.111764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba5592-3636-4554-be62-eb0ff05fd701 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:22.153183 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2376/4764] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:20:21 2022] POST /identity/v3/users => generated 288 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:22.158627 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba5592-3636-4554-be62-eb0ff05fd701 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:22.167803 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2389/4765] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:20:21 2022] POST /identity/v3/projects => generated 359 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:22.172234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb4cbf-98e2-4e46-a90a-31114ea52b62 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:22.187168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba5592-3636-4554-be62-eb0ff05fd701 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:22.306459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dac974-8275-4f47-be0e-e28575e3218a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:22.307110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dac974-8275-4f47-be0e-e28575e3218a admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:22.307110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dac974-8275-4f47-be0e-e28575e3218a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:22.307345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dac974-8275-4f47-be0e-e28575e3218a admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:22.308198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dac974-8275-4f47-be0e-e28575e3218a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:22.308819 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb4cbf-98e2-4e46-a90a-31114ea52b62 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:22.309841 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dac974-8275-4f47-be0e-e28575e3218a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:22.314623 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657939d3-0df8-41eb-9c4d-e3ec439b09ad tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:22.315619 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657939d3-0df8-41eb-9c4d-e3ec439b09ad tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:22.317763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657939d3-0df8-41eb-9c4d-e3ec439b09ad tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:22.329571 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657939d3-0df8-41eb-9c4d-e3ec439b09ad tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/projects/13a4d851b7614b48a07e2a8daa6a3c10` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:22.333288 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657939d3-0df8-41eb-9c4d-e3ec439b09ad tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:get_project(project_id=13a4d851b7614b48a07e2a8daa6a3c10)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:22.335466 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2377/4766] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:20:22.337401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657939d3-0df8-41eb-9c4d-e3ec439b09ad tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:22.341672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dac974-8275-4f47-be0e-e28575e3218a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:22.348392 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2390/4767] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:20:22 2022] GET /identity/v3/projects/13a4d851b7614b48a07e2a8daa6a3c10 => generated 359 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:20:22.350653 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657939d3-0df8-41eb-9c4d-e3ec439b09ad tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:22.370653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dac974-8275-4f47-be0e-e28575e3218a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:22.374749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657939d3-0df8-41eb-9c4d-e3ec439b09ad tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:22.382591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518eb79-f12b-401b-9a70-da106a7470c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:22.383227 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518eb79-f12b-401b-9a70-da106a7470c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:22.383510 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518eb79-f12b-401b-9a70-da106a7470c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:22.383781 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518eb79-f12b-401b-9a70-da106a7470c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:22.384356 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46adc833-344c-4968-a87c-38e1fd507a2c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:22.384515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4518eb79-f12b-401b-9a70-da106a7470c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:22.387165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46adc833-344c-4968-a87c-38e1fd507a2c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:22.387575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46adc833-344c-4968-a87c-38e1fd507a2c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:22.388086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46adc833-344c-4968-a87c-38e1fd507a2c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/projects/13a4d851b7614b48a07e2a8daa6a3c10` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:22.389538 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4518eb79-f12b-401b-9a70-da106a7470c4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:22.396827 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:22.402905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46adc833-344c-4968-a87c-38e1fd507a2c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:delete_project(project_id=13a4d851b7614b48a07e2a8daa6a3c10)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:22.413338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46adc833-344c-4968-a87c-38e1fd507a2c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:22.418097 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2378/4768] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:20:22.420434 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518eb79-f12b-401b-9a70-da106a7470c4 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:22.443110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518eb79-f12b-401b-9a70-da106a7470c4 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:22.462414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361c502-233e-49e5-9ff8-6daaf8de64b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:22.463119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361c502-233e-49e5-9ff8-6daaf8de64b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:22.463400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361c502-233e-49e5-9ff8-6daaf8de64b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:22.469150 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361c502-233e-49e5-9ff8-6daaf8de64b0 admin admin] PATH_INFO: `/v3/projects/21bb617ad8c047d2923ee668cf394370/users/ffecd714d4dc4c05a908dd59d7ba912c/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:22.512049 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361c502-233e-49e5-9ff8-6daaf8de64b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21bb617ad8c047d2923ee668cf394370, user_id=ffecd714d4dc4c05a908dd59d7ba912c, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:22.518876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361c502-233e-49e5-9ff8-6daaf8de64b0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:22.547181 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-46adc833-344c-4968-a87c-38e1fd507a2c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13a4d851b7614b48a07e2a8daa6a3c10', 'request_id': 'req-46adc833-344c-4968-a87c-38e1fd507a2c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:22.559401 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2379/4769] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:20:22 2022] PUT /identity/v3/projects/21bb617ad8c047d2923ee668cf394370/users/ffecd714d4dc4c05a908dd59d7ba912c/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:22.563591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675a51b-40c6-4e0e-bf6c-48d3308396ba None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:22.564825 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675a51b-40c6-4e0e-bf6c-48d3308396ba None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:22.565765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675a51b-40c6-4e0e-bf6c-48d3308396ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:22.574972 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-46adc833-344c-4968-a87c-38e1fd507a2c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13a4d851b7614b48a07e2a8daa6a3c10', 'request_id': 'req-46adc833-344c-4968-a87c-38e1fd507a2c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:22.585043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-46adc833-344c-4968-a87c-38e1fd507a2c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13a4d851b7614b48a07e2a8daa6a3c10', 'request_id': 'req-46adc833-344c-4968-a87c-38e1fd507a2c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:22.612637 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-46adc833-344c-4968-a87c-38e1fd507a2c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] The token cache is being invalidate because project 13a4d851b7614b48a07e2a8daa6a3c10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:22.612925 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-46adc833-344c-4968-a87c-38e1fd507a2c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:22.614023 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-46adc833-344c-4968-a87c-38e1fd507a2c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:22.621813 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2391/4770] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:20:22 2022] DELETE /identity/v3/projects/13a4d851b7614b48a07e2a8daa6a3c10 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:22.623846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46adc833-344c-4968-a87c-38e1fd507a2c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:22.628217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-46adc833-344c-4968-a87c-38e1fd507a2c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:22.629535 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5675a51b-40c6-4e0e-bf6c-48d3308396ba None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:22.632330 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5675a51b-40c6-4e0e-bf6c-48d3308396ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:22.821947 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2380/4771] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:22.834608 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:22.874746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46adc833-344c-4968-a87c-38e1fd507a2c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:23.106919 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c1193-5120-4570-9799-e8ad9612f381 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:23.107600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c1193-5120-4570-9799-e8ad9612f381 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:23.108254 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c1193-5120-4570-9799-e8ad9612f381 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:23.108254 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c1193-5120-4570-9799-e8ad9612f381 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:23.108816 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c1193-5120-4570-9799-e8ad9612f381 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:23.110729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c1193-5120-4570-9799-e8ad9612f381 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:23.179957 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675a51b-40c6-4e0e-bf6c-48d3308396ba None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:23.181658 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5675a51b-40c6-4e0e-bf6c-48d3308396ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:23.206924 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2392/4772] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:20:22 2022] POST /identity/v3/projects => generated 360 bytes in 581 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:23.208254 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c1193-5120-4570-9799-e8ad9612f381 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:23.363196 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c1193-5120-4570-9799-e8ad9612f381 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:23.365294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675a51b-40c6-4e0e-bf6c-48d3308396ba None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:23.384244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d993602-aecf-4795-a744-dc0e515bf235 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:23.387994 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d993602-aecf-4795-a744-dc0e515bf235 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:23.388297 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d993602-aecf-4795-a744-dc0e515bf235 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:23.388570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d993602-aecf-4795-a744-dc0e515bf235 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/projects/0e92923e733c45afadbe72cbad3b70b6` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:23.396700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d993602-aecf-4795-a744-dc0e515bf235 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:get_project(project_id=0e92923e733c45afadbe72cbad3b70b6)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:23.400364 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d993602-aecf-4795-a744-dc0e515bf235 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:23.408534 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2393/4773] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:20:23 2022] GET /identity/v3/projects/0e92923e733c45afadbe72cbad3b70b6 => generated 360 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:20:23.412696 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d993602-aecf-4795-a744-dc0e515bf235 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:23.439399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d993602-aecf-4795-a744-dc0e515bf235 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:23.459115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc030f32-a15e-4d5d-bd1e-b8384472880a tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:23.459763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc030f32-a15e-4d5d-bd1e-b8384472880a tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:23.460045 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc030f32-a15e-4d5d-bd1e-b8384472880a tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:23.460322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc030f32-a15e-4d5d-bd1e-b8384472880a tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/projects/0e92923e733c45afadbe72cbad3b70b6` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:23.461575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc030f32-a15e-4d5d-bd1e-b8384472880a tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0e92923e733c45afadbe72cbad3b70b6)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:23.463788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc030f32-a15e-4d5d-bd1e-b8384472880a tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:23.482145 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6643d-4a5b-4372-b3db-cb043d41bcaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:23.483214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6643d-4a5b-4372-b3db-cb043d41bcaa service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:23.483680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6643d-4a5b-4372-b3db-cb043d41bcaa service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:23.484119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6643d-4a5b-4372-b3db-cb043d41bcaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:23.555409 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:23.602912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd6643d-4a5b-4372-b3db-cb043d41bcaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:23.605722 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd6643d-4a5b-4372-b3db-cb043d41bcaa service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:23.606659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bc030f32-a15e-4d5d-bd1e-b8384472880a tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e92923e733c45afadbe72cbad3b70b6', 'request_id': 'req-bc030f32-a15e-4d5d-bd1e-b8384472880a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:23.620411 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2381/4774] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:20:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:20:23.624615 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bc030f32-a15e-4d5d-bd1e-b8384472880a tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e92923e733c45afadbe72cbad3b70b6', 'request_id': 'req-bc030f32-a15e-4d5d-bd1e-b8384472880a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:23.632935 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bc030f32-a15e-4d5d-bd1e-b8384472880a tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e92923e733c45afadbe72cbad3b70b6', 'request_id': 'req-bc030f32-a15e-4d5d-bd1e-b8384472880a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:23.647226 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bc030f32-a15e-4d5d-bd1e-b8384472880a tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] The token cache is being invalidate because project 0e92923e733c45afadbe72cbad3b70b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:23.647778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bc030f32-a15e-4d5d-bd1e-b8384472880a tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:23.648754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bc030f32-a15e-4d5d-bd1e-b8384472880a tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:23.651120 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2394/4775] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:20:23 2022] DELETE /identity/v3/projects/0e92923e733c45afadbe72cbad3b70b6 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:20:23.655825 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6643d-4a5b-4372-b3db-cb043d41bcaa service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:23.669300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6643d-4a5b-4372-b3db-cb043d41bcaa service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:23.747630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de18337-c1f6-4c06-8cbf-995c7129485e tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:23.748293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de18337-c1f6-4c06-8cbf-995c7129485e tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:23.748660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de18337-c1f6-4c06-8cbf-995c7129485e tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:23.749002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de18337-c1f6-4c06-8cbf-995c7129485e tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:23.749791 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de18337-c1f6-4c06-8cbf-995c7129485e tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:23.752769 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de18337-c1f6-4c06-8cbf-995c7129485e tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:23.815764 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2382/4776] 10.222.0.30 () {60 vars in 1152 bytes} [Sun Sep 4 01:20:23 2022] POST /identity/v3/projects => generated 347 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:23.819983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc030f32-a15e-4d5d-bd1e-b8384472880a tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:23.821881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-bc030f32-a15e-4d5d-bd1e-b8384472880a tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:23.831300 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:23.836409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc030f32-a15e-4d5d-bd1e-b8384472880a tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:23.909976 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884e1a5-c474-4a9e-919f-6099899e6d25 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:23.910939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884e1a5-c474-4a9e-919f-6099899e6d25 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:23.911378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884e1a5-c474-4a9e-919f-6099899e6d25 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:23.911889 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884e1a5-c474-4a9e-919f-6099899e6d25 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/projects/b5a360be99774049a0ca05c48a79f316` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:23.913418 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e884e1a5-c474-4a9e-919f-6099899e6d25 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:get_project(project_id=b5a360be99774049a0ca05c48a79f316)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:23.915815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e884e1a5-c474-4a9e-919f-6099899e6d25 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:23.918690 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2395/4777] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:20:23 2022] GET /identity/v3/projects/b5a360be99774049a0ca05c48a79f316 => generated 347 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:20:23.922856 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de18337-c1f6-4c06-8cbf-995c7129485e tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:23.936271 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de18337-c1f6-4c06-8cbf-995c7129485e tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:23.942585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823110e1-4f5d-45f4-8100-819cc0028707 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:23.943210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823110e1-4f5d-45f4-8100-819cc0028707 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:23.943600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823110e1-4f5d-45f4-8100-819cc0028707 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:23.943981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823110e1-4f5d-45f4-8100-819cc0028707 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/projects/b5a360be99774049a0ca05c48a79f316` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:23.945651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823110e1-4f5d-45f4-8100-819cc0028707 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b5a360be99774049a0ca05c48a79f316)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:23.948534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823110e1-4f5d-45f4-8100-819cc0028707 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:24.010594 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-823110e1-4f5d-45f4-8100-819cc0028707 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5a360be99774049a0ca05c48a79f316', 'request_id': 'req-823110e1-4f5d-45f4-8100-819cc0028707'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:24.025483 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-823110e1-4f5d-45f4-8100-819cc0028707 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5a360be99774049a0ca05c48a79f316', 'request_id': 'req-823110e1-4f5d-45f4-8100-819cc0028707'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:24.036409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-823110e1-4f5d-45f4-8100-819cc0028707 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5a360be99774049a0ca05c48a79f316', 'request_id': 'req-823110e1-4f5d-45f4-8100-819cc0028707'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:24.054945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-823110e1-4f5d-45f4-8100-819cc0028707 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] The token cache is being invalidate because project b5a360be99774049a0ca05c48a79f316 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:24.055156 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-823110e1-4f5d-45f4-8100-819cc0028707 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:24.057887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-823110e1-4f5d-45f4-8100-819cc0028707 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:24.063990 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2383/4778] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:20:23 2022] DELETE /identity/v3/projects/b5a360be99774049a0ca05c48a79f316 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:24.065144 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884e1a5-c474-4a9e-919f-6099899e6d25 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:24.067037 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e884e1a5-c474-4a9e-919f-6099899e6d25 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:24.085328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884e1a5-c474-4a9e-919f-6099899e6d25 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:24.190599 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af8332-414f-4b7c-b0ee-936bbdedfd7a tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:24.191574 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af8332-414f-4b7c-b0ee-936bbdedfd7a tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:24.191926 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af8332-414f-4b7c-b0ee-936bbdedfd7a tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:24.192391 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af8332-414f-4b7c-b0ee-936bbdedfd7a tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:24.193473 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af8332-414f-4b7c-b0ee-936bbdedfd7a tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:24.195224 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af8332-414f-4b7c-b0ee-936bbdedfd7a tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:24.220054 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2396/4779] 10.222.0.30 () {60 vars in 1149 bytes} [Sun Sep 4 01:20:24 2022] POST /identity/v3/domains => generated 276 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:20:24.221406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823110e1-4f5d-45f4-8100-819cc0028707 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:24.233676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823110e1-4f5d-45f4-8100-819cc0028707 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:24.285882 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:24.302034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47263c0-b0ad-423f-9788-6779b3a96b30 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:24.302744 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47263c0-b0ad-423f-9788-6779b3a96b30 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:24.303076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47263c0-b0ad-423f-9788-6779b3a96b30 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:24.303421 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47263c0-b0ad-423f-9788-6779b3a96b30 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:24.304118 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47263c0-b0ad-423f-9788-6779b3a96b30 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:24.306235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47263c0-b0ad-423f-9788-6779b3a96b30 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:24.347858 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2384/4780] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:20:24 2022] POST /identity/v3/projects => generated 404 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:24.351815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af8332-414f-4b7c-b0ee-936bbdedfd7a tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:24.363942 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af8332-414f-4b7c-b0ee-936bbdedfd7a tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:24.427014 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27434a76-1bbe-4ba8-86de-18f092b26f81 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:24.427689 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27434a76-1bbe-4ba8-86de-18f092b26f81 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:24.428001 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27434a76-1bbe-4ba8-86de-18f092b26f81 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:24.428279 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27434a76-1bbe-4ba8-86de-18f092b26f81 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/projects/f3b6edaef8aa463f8ae047c8e04b2fc4` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:24.429768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27434a76-1bbe-4ba8-86de-18f092b26f81 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:get_project(project_id=f3b6edaef8aa463f8ae047c8e04b2fc4)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:24.432375 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27434a76-1bbe-4ba8-86de-18f092b26f81 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:24.434970 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2397/4781] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:20:24 2022] GET /identity/v3/projects/f3b6edaef8aa463f8ae047c8e04b2fc4 => generated 404 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:20:24.445353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47263c0-b0ad-423f-9788-6779b3a96b30 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:24.452295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47263c0-b0ad-423f-9788-6779b3a96b30 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:24.457542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c1ec7-a963-400d-89f2-49af6360769f tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:24.458682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c1ec7-a963-400d-89f2-49af6360769f tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:24.458682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c1ec7-a963-400d-89f2-49af6360769f tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:24.458848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c1ec7-a963-400d-89f2-49af6360769f tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/projects/f3b6edaef8aa463f8ae047c8e04b2fc4` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:24.461134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c1ec7-a963-400d-89f2-49af6360769f tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f3b6edaef8aa463f8ae047c8e04b2fc4)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:24.463077 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c1ec7-a963-400d-89f2-49af6360769f tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:24.517007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0c8c1ec7-a963-400d-89f2-49af6360769f tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3b6edaef8aa463f8ae047c8e04b2fc4', 'request_id': 'req-0c8c1ec7-a963-400d-89f2-49af6360769f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:24.527065 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0c8c1ec7-a963-400d-89f2-49af6360769f tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3b6edaef8aa463f8ae047c8e04b2fc4', 'request_id': 'req-0c8c1ec7-a963-400d-89f2-49af6360769f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:24.536346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0c8c1ec7-a963-400d-89f2-49af6360769f tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3b6edaef8aa463f8ae047c8e04b2fc4', 'request_id': 'req-0c8c1ec7-a963-400d-89f2-49af6360769f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:24.549024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0c8c1ec7-a963-400d-89f2-49af6360769f tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] The token cache is being invalidate because project f3b6edaef8aa463f8ae047c8e04b2fc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:24.550439 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0c8c1ec7-a963-400d-89f2-49af6360769f tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:24.550439 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0c8c1ec7-a963-400d-89f2-49af6360769f tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:24.552343 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2385/4782] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:20:24 2022] DELETE /identity/v3/projects/f3b6edaef8aa463f8ae047c8e04b2fc4 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:20:24.556635 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27434a76-1bbe-4ba8-86de-18f092b26f81 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:24.559672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-27434a76-1bbe-4ba8-86de-18f092b26f81 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:24.574698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27434a76-1bbe-4ba8-86de-18f092b26f81 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:24.644285 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:24.668047 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f3b30-3f38-48a9-8366-bbb40c493e6d tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:24.668708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f3b30-3f38-48a9-8366-bbb40c493e6d tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:24.668990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f3b30-3f38-48a9-8366-bbb40c493e6d tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:24.669263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f3b30-3f38-48a9-8366-bbb40c493e6d tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/domains/077707cd42bf4693ae5d9628f8d35d75` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:24.670679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f3b30-3f38-48a9-8366-bbb40c493e6d tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=077707cd42bf4693ae5d9628f8d35d75)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:24.672380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f3b30-3f38-48a9-8366-bbb40c493e6d tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:24.697622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-667f3b30-3f38-48a9-8366-bbb40c493e6d tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '077707cd42bf4693ae5d9628f8d35d75'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:24.698918 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-667f3b30-3f38-48a9-8366-bbb40c493e6d tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '077707cd42bf4693ae5d9628f8d35d75'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:24.733992 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-667f3b30-3f38-48a9-8366-bbb40c493e6d tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '077707cd42bf4693ae5d9628f8d35d75'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:24.734690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-667f3b30-3f38-48a9-8366-bbb40c493e6d tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '077707cd42bf4693ae5d9628f8d35d75'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:24.741609 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2398/4783] 10.222.0.30 () {60 vars in 1249 bytes} [Sun Sep 4 01:20:24 2022] PATCH /identity/v3/domains/077707cd42bf4693ae5d9628f8d35d75 => generated 277 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:20:24.744010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c1ec7-a963-400d-89f2-49af6360769f tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:24.755657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c1ec7-a963-400d-89f2-49af6360769f tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:24.833043 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5375ba-78bc-462d-9570-26ef52a801f8 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:24.833880 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5375ba-78bc-462d-9570-26ef52a801f8 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:24.834237 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5375ba-78bc-462d-9570-26ef52a801f8 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:24.834594 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5375ba-78bc-462d-9570-26ef52a801f8 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/domains/077707cd42bf4693ae5d9628f8d35d75` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:24.861825 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5375ba-78bc-462d-9570-26ef52a801f8 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=077707cd42bf4693ae5d9628f8d35d75)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:24.864784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5375ba-78bc-462d-9570-26ef52a801f8 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:24.906622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ee5375ba-78bc-462d-9570-26ef52a801f8 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '077707cd42bf4693ae5d9628f8d35d75'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:24.960788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ee5375ba-78bc-462d-9570-26ef52a801f8 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '077707cd42bf4693ae5d9628f8d35d75'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:25.003747 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:25.079454 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ee5375ba-78bc-462d-9570-26ef52a801f8 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '077707cd42bf4693ae5d9628f8d35d75', 'request_id': 'req-ee5375ba-78bc-462d-9570-26ef52a801f8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:25.102602 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ee5375ba-78bc-462d-9570-26ef52a801f8 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '077707cd42bf4693ae5d9628f8d35d75', 'request_id': 'req-ee5375ba-78bc-462d-9570-26ef52a801f8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:25.111378 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ee5375ba-78bc-462d-9570-26ef52a801f8 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '077707cd42bf4693ae5d9628f8d35d75', 'request_id': 'req-ee5375ba-78bc-462d-9570-26ef52a801f8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:25.146423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ee5375ba-78bc-462d-9570-26ef52a801f8 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] The token cache is being invalidate because project 077707cd42bf4693ae5d9628f8d35d75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:25.146844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ee5375ba-78bc-462d-9570-26ef52a801f8 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:25.148470 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ee5375ba-78bc-462d-9570-26ef52a801f8 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:25.187947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ee5375ba-78bc-462d-9570-26ef52a801f8 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '077707cd42bf4693ae5d9628f8d35d75', 'request_id': 'req-ee5375ba-78bc-462d-9570-26ef52a801f8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:25.192667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ee5375ba-78bc-462d-9570-26ef52a801f8 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '077707cd42bf4693ae5d9628f8d35d75', 'request_id': 'req-ee5375ba-78bc-462d-9570-26ef52a801f8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:25.195571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ee5375ba-78bc-462d-9570-26ef52a801f8 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '077707cd42bf4693ae5d9628f8d35d75', 'request_id': 'req-ee5375ba-78bc-462d-9570-26ef52a801f8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:25.226512 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2386/4784] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:20:24 2022] DELETE /identity/v3/domains/077707cd42bf4693ae5d9628f8d35d75 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:25.230632 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f3b30-3f38-48a9-8366-bbb40c493e6d tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:25.232965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-667f3b30-3f38-48a9-8366-bbb40c493e6d tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:25.273688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f3b30-3f38-48a9-8366-bbb40c493e6d tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:25.468181 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2b85c-eb6f-459d-915a-c35b040aea88 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:25.468989 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2b85c-eb6f-459d-915a-c35b040aea88 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:25.469312 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2b85c-eb6f-459d-915a-c35b040aea88 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:25.469621 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2b85c-eb6f-459d-915a-c35b040aea88 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:25.470312 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2b85c-eb6f-459d-915a-c35b040aea88 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:25.472779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2b85c-eb6f-459d-915a-c35b040aea88 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:25.523628 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2399/4785] 10.222.0.30 () {60 vars in 1149 bytes} [Sun Sep 4 01:20:25 2022] POST /identity/v3/domains => generated 275 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:25.528370 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5375ba-78bc-462d-9570-26ef52a801f8 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:25.530950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ee5375ba-78bc-462d-9570-26ef52a801f8 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:25.554854 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5375ba-78bc-462d-9570-26ef52a801f8 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:25.680501 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226eb6e-9b18-42ac-9772-2cdf842a4144 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:25.681219 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226eb6e-9b18-42ac-9772-2cdf842a4144 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:25.681535 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226eb6e-9b18-42ac-9772-2cdf842a4144 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:25.681817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226eb6e-9b18-42ac-9772-2cdf842a4144 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:25.683026 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226eb6e-9b18-42ac-9772-2cdf842a4144 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:25.685112 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226eb6e-9b18-42ac-9772-2cdf842a4144 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:25.786476 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2387/4786] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:20:25 2022] POST /identity/v3/projects => generated 409 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:25.789100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2b85c-eb6f-459d-915a-c35b040aea88 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:25.814008 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2b85c-eb6f-459d-915a-c35b040aea88 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:25.958727 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d31e5b-f87a-40ee-a64a-2375797f7e0c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:25.959515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d31e5b-f87a-40ee-a64a-2375797f7e0c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:25.959973 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d31e5b-f87a-40ee-a64a-2375797f7e0c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:25.960395 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d31e5b-f87a-40ee-a64a-2375797f7e0c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:25.961214 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d31e5b-f87a-40ee-a64a-2375797f7e0c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:25.967095 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d31e5b-f87a-40ee-a64a-2375797f7e0c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:26.031984 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2400/4787] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:20:25 2022] POST /identity/v3/projects => generated 403 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:20:26.039657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226eb6e-9b18-42ac-9772-2cdf842a4144 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:26.057362 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226eb6e-9b18-42ac-9772-2cdf842a4144 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:26.204439 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619bb31-f2aa-40dc-b0d8-af781014c6a2 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:26.205255 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619bb31-f2aa-40dc-b0d8-af781014c6a2 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:26.205682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619bb31-f2aa-40dc-b0d8-af781014c6a2 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:26.206062 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619bb31-f2aa-40dc-b0d8-af781014c6a2 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/projects/12067e1c2beb4db6b3833d8ef1245498` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:26.207424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619bb31-f2aa-40dc-b0d8-af781014c6a2 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:delete_project(project_id=12067e1c2beb4db6b3833d8ef1245498)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:26.209562 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619bb31-f2aa-40dc-b0d8-af781014c6a2 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:26.215102 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:26.329295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2619bb31-f2aa-40dc-b0d8-af781014c6a2 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12067e1c2beb4db6b3833d8ef1245498', 'request_id': 'req-2619bb31-f2aa-40dc-b0d8-af781014c6a2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:26.347670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2619bb31-f2aa-40dc-b0d8-af781014c6a2 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12067e1c2beb4db6b3833d8ef1245498', 'request_id': 'req-2619bb31-f2aa-40dc-b0d8-af781014c6a2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:26.358440 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2619bb31-f2aa-40dc-b0d8-af781014c6a2 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12067e1c2beb4db6b3833d8ef1245498', 'request_id': 'req-2619bb31-f2aa-40dc-b0d8-af781014c6a2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:26.392276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2619bb31-f2aa-40dc-b0d8-af781014c6a2 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] The token cache is being invalidate because project 12067e1c2beb4db6b3833d8ef1245498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:26.392743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2619bb31-f2aa-40dc-b0d8-af781014c6a2 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:26.399713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2619bb31-f2aa-40dc-b0d8-af781014c6a2 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:26.407946 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2388/4788] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:20:26 2022] DELETE /identity/v3/projects/12067e1c2beb4db6b3833d8ef1245498 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:26.409774 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d31e5b-f87a-40ee-a64a-2375797f7e0c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:26.412502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-59d31e5b-f87a-40ee-a64a-2375797f7e0c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:26.437970 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d31e5b-f87a-40ee-a64a-2375797f7e0c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:26.473225 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:26.545552 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588a260-7f27-4086-8136-eb0540ef301c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:26.547330 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588a260-7f27-4086-8136-eb0540ef301c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:26.547843 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588a260-7f27-4086-8136-eb0540ef301c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:26.548354 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588a260-7f27-4086-8136-eb0540ef301c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/projects/47fa5b30500b4b40b6918ee73b66e467` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:26.549844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1588a260-7f27-4086-8136-eb0540ef301c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:delete_project(project_id=47fa5b30500b4b40b6918ee73b66e467)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:26.552040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1588a260-7f27-4086-8136-eb0540ef301c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:26.669616 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1588a260-7f27-4086-8136-eb0540ef301c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47fa5b30500b4b40b6918ee73b66e467', 'request_id': 'req-1588a260-7f27-4086-8136-eb0540ef301c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:26.699812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1588a260-7f27-4086-8136-eb0540ef301c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47fa5b30500b4b40b6918ee73b66e467', 'request_id': 'req-1588a260-7f27-4086-8136-eb0540ef301c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:26.722370 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1588a260-7f27-4086-8136-eb0540ef301c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47fa5b30500b4b40b6918ee73b66e467', 'request_id': 'req-1588a260-7f27-4086-8136-eb0540ef301c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:26.742267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1588a260-7f27-4086-8136-eb0540ef301c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] The token cache is being invalidate because project 47fa5b30500b4b40b6918ee73b66e467 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:26.742711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1588a260-7f27-4086-8136-eb0540ef301c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:26.743769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1588a260-7f27-4086-8136-eb0540ef301c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:26.746200 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2401/4789] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:20:26 2022] DELETE /identity/v3/projects/47fa5b30500b4b40b6918ee73b66e467 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:26.751192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619bb31-f2aa-40dc-b0d8-af781014c6a2 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:26.767489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619bb31-f2aa-40dc-b0d8-af781014c6a2 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:26.847308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151d26f-340d-4a6c-8030-4e715ba57447 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:26.848153 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151d26f-340d-4a6c-8030-4e715ba57447 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:26.848481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151d26f-340d-4a6c-8030-4e715ba57447 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:26.848865 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151d26f-340d-4a6c-8030-4e715ba57447 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/domains/094ba569e6b44a81b6e786a3fd49cdf5` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:26.850491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151d26f-340d-4a6c-8030-4e715ba57447 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=094ba569e6b44a81b6e786a3fd49cdf5)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:26.852396 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151d26f-340d-4a6c-8030-4e715ba57447 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:26.915764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8151d26f-340d-4a6c-8030-4e715ba57447 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '094ba569e6b44a81b6e786a3fd49cdf5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:26.919477 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8151d26f-340d-4a6c-8030-4e715ba57447 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '094ba569e6b44a81b6e786a3fd49cdf5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:26.996355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8151d26f-340d-4a6c-8030-4e715ba57447 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '094ba569e6b44a81b6e786a3fd49cdf5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:26.998381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8151d26f-340d-4a6c-8030-4e715ba57447 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '094ba569e6b44a81b6e786a3fd49cdf5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:27.006592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588a260-7f27-4086-8136-eb0540ef301c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:27.008062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1588a260-7f27-4086-8136-eb0540ef301c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:27.021966 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2389/4790] 10.222.0.30 () {60 vars in 1249 bytes} [Sun Sep 4 01:20:26 2022] PATCH /identity/v3/domains/094ba569e6b44a81b6e786a3fd49cdf5 => generated 276 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:20:27.037905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588a260-7f27-4086-8136-eb0540ef301c tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:27.246311 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a76923-e889-41f7-a69e-e12d6b867497 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:27.246993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a76923-e889-41f7-a69e-e12d6b867497 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:27.247287 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a76923-e889-41f7-a69e-e12d6b867497 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:27.247577 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a76923-e889-41f7-a69e-e12d6b867497 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/domains/094ba569e6b44a81b6e786a3fd49cdf5` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:27.287369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a76923-e889-41f7-a69e-e12d6b867497 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=094ba569e6b44a81b6e786a3fd49cdf5)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:27.289061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a76923-e889-41f7-a69e-e12d6b867497 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:27.346165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-95a76923-e889-41f7-a69e-e12d6b867497 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '094ba569e6b44a81b6e786a3fd49cdf5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:27.370705 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-95a76923-e889-41f7-a69e-e12d6b867497 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '094ba569e6b44a81b6e786a3fd49cdf5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:27.423047 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:27.491308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-95a76923-e889-41f7-a69e-e12d6b867497 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '094ba569e6b44a81b6e786a3fd49cdf5', 'request_id': 'req-95a76923-e889-41f7-a69e-e12d6b867497'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:27.511067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-95a76923-e889-41f7-a69e-e12d6b867497 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '094ba569e6b44a81b6e786a3fd49cdf5', 'request_id': 'req-95a76923-e889-41f7-a69e-e12d6b867497'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:27.519153 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-95a76923-e889-41f7-a69e-e12d6b867497 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '094ba569e6b44a81b6e786a3fd49cdf5', 'request_id': 'req-95a76923-e889-41f7-a69e-e12d6b867497'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:27.538387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-95a76923-e889-41f7-a69e-e12d6b867497 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] The token cache is being invalidate because project 094ba569e6b44a81b6e786a3fd49cdf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:27.538749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-95a76923-e889-41f7-a69e-e12d6b867497 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:27.539645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-95a76923-e889-41f7-a69e-e12d6b867497 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:27.553161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-95a76923-e889-41f7-a69e-e12d6b867497 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '094ba569e6b44a81b6e786a3fd49cdf5', 'request_id': 'req-95a76923-e889-41f7-a69e-e12d6b867497'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:27.554248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-95a76923-e889-41f7-a69e-e12d6b867497 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '094ba569e6b44a81b6e786a3fd49cdf5', 'request_id': 'req-95a76923-e889-41f7-a69e-e12d6b867497'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:27.555096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-95a76923-e889-41f7-a69e-e12d6b867497 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '094ba569e6b44a81b6e786a3fd49cdf5', 'request_id': 'req-95a76923-e889-41f7-a69e-e12d6b867497'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:27.569544 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2402/4791] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:20:27 2022] DELETE /identity/v3/domains/094ba569e6b44a81b6e786a3fd49cdf5 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:20:27.574983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151d26f-340d-4a6c-8030-4e715ba57447 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:27.576740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8151d26f-340d-4a6c-8030-4e715ba57447 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:27.596760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151d26f-340d-4a6c-8030-4e715ba57447 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:27.672163 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:27.680909 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a0c15-bb77-424b-9e06-b01f839c74dc tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:27.681965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a0c15-bb77-424b-9e06-b01f839c74dc tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:27.682910 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a0c15-bb77-424b-9e06-b01f839c74dc tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:27.683355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a0c15-bb77-424b-9e06-b01f839c74dc tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:27.684170 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a0c15-bb77-424b-9e06-b01f839c74dc tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:27.686548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a0c15-bb77-424b-9e06-b01f839c74dc tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:27.773747 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2390/4792] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:20:27 2022] POST /identity/v3/projects => generated 378 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:27.776566 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a76923-e889-41f7-a69e-e12d6b867497 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:27.778345 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-95a76923-e889-41f7-a69e-e12d6b867497 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:27.807663 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a76923-e889-41f7-a69e-e12d6b867497 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:27.945209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d8179-ff4d-46ca-9c90-ddd23aadfd93 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:27.946214 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d8179-ff4d-46ca-9c90-ddd23aadfd93 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:27.946595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d8179-ff4d-46ca-9c90-ddd23aadfd93 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:27.947132 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d8179-ff4d-46ca-9c90-ddd23aadfd93 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/projects/96490300879f46c89eeecc6ad02ee68f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:27.948564 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d8179-ff4d-46ca-9c90-ddd23aadfd93 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:get_project(project_id=96490300879f46c89eeecc6ad02ee68f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:27.951140 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d8179-ff4d-46ca-9c90-ddd23aadfd93 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:27.954175 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2403/4793] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:20:27 2022] GET /identity/v3/projects/96490300879f46c89eeecc6ad02ee68f => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:20:27.958448 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a0c15-bb77-424b-9e06-b01f839c74dc tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:27.978978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a0c15-bb77-424b-9e06-b01f839c74dc tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:28.019646 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efec04-62b8-4147-98a6-3c29388fdc1b tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:28.020240 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efec04-62b8-4147-98a6-3c29388fdc1b tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:28.020520 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efec04-62b8-4147-98a6-3c29388fdc1b tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:28.020795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efec04-62b8-4147-98a6-3c29388fdc1b tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:28.021490 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82efec04-62b8-4147-98a6-3c29388fdc1b tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:28.028731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82efec04-62b8-4147-98a6-3c29388fdc1b tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:28.082155 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2391/4794] 10.222.0.30 () {58 vars in 1131 bytes} [Sun Sep 4 01:20:27 2022] GET /identity/v3/projects => generated 6954 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:20:28.083725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d8179-ff4d-46ca-9c90-ddd23aadfd93 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:28.102231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d8179-ff4d-46ca-9c90-ddd23aadfd93 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:28.108732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ee6f7-4590-4d80-9bbf-eb026cc37479 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:28.109817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ee6f7-4590-4d80-9bbf-eb026cc37479 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:28.110205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ee6f7-4590-4d80-9bbf-eb026cc37479 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:28.110576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ee6f7-4590-4d80-9bbf-eb026cc37479 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/projects/96490300879f46c89eeecc6ad02ee68f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:28.115887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ee6f7-4590-4d80-9bbf-eb026cc37479 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:delete_project(project_id=96490300879f46c89eeecc6ad02ee68f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:28.118184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ee6f7-4590-4d80-9bbf-eb026cc37479 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:28.245347 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3b3ee6f7-4590-4d80-9bbf-eb026cc37479 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96490300879f46c89eeecc6ad02ee68f', 'request_id': 'req-3b3ee6f7-4590-4d80-9bbf-eb026cc37479'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:28.282284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3b3ee6f7-4590-4d80-9bbf-eb026cc37479 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96490300879f46c89eeecc6ad02ee68f', 'request_id': 'req-3b3ee6f7-4590-4d80-9bbf-eb026cc37479'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:28.297615 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3b3ee6f7-4590-4d80-9bbf-eb026cc37479 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96490300879f46c89eeecc6ad02ee68f', 'request_id': 'req-3b3ee6f7-4590-4d80-9bbf-eb026cc37479'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:28.333091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3b3ee6f7-4590-4d80-9bbf-eb026cc37479 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] The token cache is being invalidate because project 96490300879f46c89eeecc6ad02ee68f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:28.333393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3b3ee6f7-4590-4d80-9bbf-eb026cc37479 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:28.334367 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3b3ee6f7-4590-4d80-9bbf-eb026cc37479 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:28.339825 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2404/4795] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:20:28 2022] DELETE /identity/v3/projects/96490300879f46c89eeecc6ad02ee68f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:28.344604 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efec04-62b8-4147-98a6-3c29388fdc1b tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:28.346597 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-82efec04-62b8-4147-98a6-3c29388fdc1b tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:28.364633 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ee6f7-4590-4d80-9bbf-eb026cc37479 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:28.366185 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3b3ee6f7-4590-4d80-9bbf-eb026cc37479 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:28.384632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efec04-62b8-4147-98a6-3c29388fdc1b tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:28.396985 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:28.554794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ee6f7-4590-4d80-9bbf-eb026cc37479 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:28.566915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45bdce-98d6-4604-a589-ba788866637f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:28.567491 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45bdce-98d6-4604-a589-ba788866637f service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:28.567771 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45bdce-98d6-4604-a589-ba788866637f service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:28.568062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45bdce-98d6-4604-a589-ba788866637f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:28.571616 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ff45bdce-98d6-4604-a589-ba788866637f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:28.579108 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140508e-5bf4-4af6-81b1-41021e74e79b tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:28.579771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140508e-5bf4-4af6-81b1-41021e74e79b tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:28.580057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140508e-5bf4-4af6-81b1-41021e74e79b tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:28.580334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140508e-5bf4-4af6-81b1-41021e74e79b tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:28.580975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140508e-5bf4-4af6-81b1-41021e74e79b tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:28.582899 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140508e-5bf4-4af6-81b1-41021e74e79b tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:28.655821 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2392/4796] 10.222.0.30 () {60 vars in 1152 bytes} [Sun Sep 4 01:20:28 2022] POST /identity/v3/projects => generated 346 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:28.659288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140508e-5bf4-4af6-81b1-41021e74e79b tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:28.723355 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45bdce-98d6-4604-a589-ba788866637f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:28.724961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45bdce-98d6-4604-a589-ba788866637f service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:28.752361 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2405/4797] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:20:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:20:28.781796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140508e-5bf4-4af6-81b1-41021e74e79b tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:28.787047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8e5b1-de1b-4e38-adb3-e03d3469f867 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:28.788080 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8e5b1-de1b-4e38-adb3-e03d3469f867 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:28.788567 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8e5b1-de1b-4e38-adb3-e03d3469f867 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:28.788915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8e5b1-de1b-4e38-adb3-e03d3469f867 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/projects/f7354e345a2348d482c7a1de4524eab0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:28.790363 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8e5b1-de1b-4e38-adb3-e03d3469f867 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:update_project(project_id=f7354e345a2348d482c7a1de4524eab0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:28.791737 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-d6c8e5b1-de1b-4e38-adb3-e03d3469f867 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:28.791737 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:20:28.791737 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:20:28.793159 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8e5b1-de1b-4e38-adb3-e03d3469f867 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:28.861165 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2393/4798] 10.222.0.30 () {60 vars in 1252 bytes} [Sun Sep 4 01:20:28 2022] PATCH /identity/v3/projects/f7354e345a2348d482c7a1de4524eab0 => generated 361 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:20:28.865329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45bdce-98d6-4604-a589-ba788866637f service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:28.879871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45bdce-98d6-4604-a589-ba788866637f service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:28.885175 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e117e-5dad-4337-aecf-3d4b619c1ab5 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:28.886127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e117e-5dad-4337-aecf-3d4b619c1ab5 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:28.886643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e117e-5dad-4337-aecf-3d4b619c1ab5 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:28.887024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e117e-5dad-4337-aecf-3d4b619c1ab5 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/projects/f7354e345a2348d482c7a1de4524eab0` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:28.900928 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e117e-5dad-4337-aecf-3d4b619c1ab5 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:get_project(project_id=f7354e345a2348d482c7a1de4524eab0)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:28.903420 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e117e-5dad-4337-aecf-3d4b619c1ab5 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:28.905658 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2406/4799] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:20:28 2022] GET /identity/v3/projects/f7354e345a2348d482c7a1de4524eab0 => generated 348 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:20:28.909422 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8e5b1-de1b-4e38-adb3-e03d3469f867 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:28.922522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8e5b1-de1b-4e38-adb3-e03d3469f867 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:28.928102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca591ee-c6e6-41c9-b2a8-6bf53e76bc10 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:28.928901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca591ee-c6e6-41c9-b2a8-6bf53e76bc10 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:28.929330 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca591ee-c6e6-41c9-b2a8-6bf53e76bc10 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:28.929746 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca591ee-c6e6-41c9-b2a8-6bf53e76bc10 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/projects/f7354e345a2348d482c7a1de4524eab0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:28.932009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca591ee-c6e6-41c9-b2a8-6bf53e76bc10 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f7354e345a2348d482c7a1de4524eab0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:28.934733 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca591ee-c6e6-41c9-b2a8-6bf53e76bc10 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:28.963004 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e117e-5dad-4337-aecf-3d4b619c1ab5 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:28.965130 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-864e117e-5dad-4337-aecf-3d4b619c1ab5 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:29.004625 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:29.039262 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0ca591ee-c6e6-41c9-b2a8-6bf53e76bc10 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7354e345a2348d482c7a1de4524eab0', 'request_id': 'req-0ca591ee-c6e6-41c9-b2a8-6bf53e76bc10'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:29.067374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0ca591ee-c6e6-41c9-b2a8-6bf53e76bc10 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7354e345a2348d482c7a1de4524eab0', 'request_id': 'req-0ca591ee-c6e6-41c9-b2a8-6bf53e76bc10'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:29.074557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0ca591ee-c6e6-41c9-b2a8-6bf53e76bc10 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7354e345a2348d482c7a1de4524eab0', 'request_id': 'req-0ca591ee-c6e6-41c9-b2a8-6bf53e76bc10'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:29.096095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0ca591ee-c6e6-41c9-b2a8-6bf53e76bc10 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] The token cache is being invalidate because project f7354e345a2348d482c7a1de4524eab0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:29.096543 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0ca591ee-c6e6-41c9-b2a8-6bf53e76bc10 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:29.099779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0ca591ee-c6e6-41c9-b2a8-6bf53e76bc10 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:29.102332 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2394/4800] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:20:28 2022] DELETE /identity/v3/projects/f7354e345a2348d482c7a1de4524eab0 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:20:29.107803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca591ee-c6e6-41c9-b2a8-6bf53e76bc10 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:29.110815 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0ca591ee-c6e6-41c9-b2a8-6bf53e76bc10 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:29.112714 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e117e-5dad-4337-aecf-3d4b619c1ab5 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:29.277116 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:29.289101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ff6b5-2882-4639-b53e-ede9433444a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:29.289893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ff6b5-2882-4639-b53e-ede9433444a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:29.290632 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ff6b5-2882-4639-b53e-ede9433444a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:29.290996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ff6b5-2882-4639-b53e-ede9433444a7 admin admin] PATH_INFO: `/v3/users/e419ce6cbb6845d698cf684c3bd9c49f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:29.293840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ff6b5-2882-4639-b53e-ede9433444a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e419ce6cbb6845d698cf684c3bd9c49f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:29.301936 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ff6b5-2882-4639-b53e-ede9433444a7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:29.307583 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca591ee-c6e6-41c9-b2a8-6bf53e76bc10 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:29.320357 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9f751-4517-441f-b815-66115c88a76f tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:29.320910 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9f751-4517-441f-b815-66115c88a76f tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:29.321196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9f751-4517-441f-b815-66115c88a76f tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:29.321496 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9f751-4517-441f-b815-66115c88a76f tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:29.322152 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9f751-4517-441f-b815-66115c88a76f tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:29.324092 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9f751-4517-441f-b815-66115c88a76f tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:29.365512 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2395/4801] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:20:29 2022] POST /identity/v3/projects => generated 360 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:29.366802 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9f751-4517-441f-b815-66115c88a76f tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:29.373153 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b18ff6b5-2882-4639-b53e-ede9433444a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e419ce6cbb6845d698cf684c3bd9c49f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:29.374398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b18ff6b5-2882-4639-b53e-ede9433444a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e419ce6cbb6845d698cf684c3bd9c49f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:29.384252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b18ff6b5-2882-4639-b53e-ede9433444a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e419ce6cbb6845d698cf684c3bd9c49f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:29.395285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b18ff6b5-2882-4639-b53e-ede9433444a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e419ce6cbb6845d698cf684c3bd9c49f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:29.396270 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b18ff6b5-2882-4639-b53e-ede9433444a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e419ce6cbb6845d698cf684c3bd9c49f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:29.435853 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2407/4802] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:20:28 2022] DELETE /identity/v3/users/e419ce6cbb6845d698cf684c3bd9c49f => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:20:29.443091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b89ca5-bdb6-4a95-97c6-facdaaef140c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:29.443091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b89ca5-bdb6-4a95-97c6-facdaaef140c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:29.443091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b89ca5-bdb6-4a95-97c6-facdaaef140c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:29.468918 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-d4b89ca5-bdb6-4a95-97c6-facdaaef140c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:29.470295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d4b89ca5-bdb6-4a95-97c6-facdaaef140c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:29.470549 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9f751-4517-441f-b815-66115c88a76f tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:29.565558 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:29.572511 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2408/4803] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:29.584493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b89ca5-bdb6-4a95-97c6-facdaaef140c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:29.591806 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d4b89ca5-bdb6-4a95-97c6-facdaaef140c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:29.600391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ecfdb-c097-4f58-bdfd-67a0af0f16ef tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:29.601062 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ecfdb-c097-4f58-bdfd-67a0af0f16ef tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:29.601398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ecfdb-c097-4f58-bdfd-67a0af0f16ef tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:29.601712 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ecfdb-c097-4f58-bdfd-67a0af0f16ef tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/projects/8637cc4341124a3b93c3e33d8b44a223` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:29.602975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ecfdb-c097-4f58-bdfd-67a0af0f16ef tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:update_project(project_id=8637cc4341124a3b93c3e33d8b44a223)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:29.606338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ecfdb-c097-4f58-bdfd-67a0af0f16ef tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:29.684240 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2396/4804] 10.222.0.30 () {60 vars in 1252 bytes} [Sun Sep 4 01:20:29 2022] PATCH /identity/v3/projects/8637cc4341124a3b93c3e33d8b44a223 => generated 372 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:20:29.687998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ecfdb-c097-4f58-bdfd-67a0af0f16ef tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:29.691320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2e1ecfdb-c097-4f58-bdfd-67a0af0f16ef tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:29.706038 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ecfdb-c097-4f58-bdfd-67a0af0f16ef tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:29.711737 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a7df5-5d18-4f92-b111-659d8a0b2aaf tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:29.712517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a7df5-5d18-4f92-b111-659d8a0b2aaf tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:29.712803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a7df5-5d18-4f92-b111-659d8a0b2aaf tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:29.713077 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a7df5-5d18-4f92-b111-659d8a0b2aaf tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/projects/8637cc4341124a3b93c3e33d8b44a223` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:29.723825 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b89ca5-bdb6-4a95-97c6-facdaaef140c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:29.726266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a7df5-5d18-4f92-b111-659d8a0b2aaf tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:get_project(project_id=8637cc4341124a3b93c3e33d8b44a223)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:29.728743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a7df5-5d18-4f92-b111-659d8a0b2aaf tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:29.733708 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2397/4805] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:20:29 2022] GET /identity/v3/projects/8637cc4341124a3b93c3e33d8b44a223 => generated 359 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:20:29.735324 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a7df5-5d18-4f92-b111-659d8a0b2aaf tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:29.737286 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc00394-c1ed-4c62-8365-46485e9366b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:29.738202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc00394-c1ed-4c62-8365-46485e9366b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:29.739075 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc00394-c1ed-4c62-8365-46485e9366b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:29.739554 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc00394-c1ed-4c62-8365-46485e9366b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:29.750889 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc00394-c1ed-4c62-8365-46485e9366b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:29.752587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a7df5-5d18-4f92-b111-659d8a0b2aaf tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:29.753107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc00394-c1ed-4c62-8365-46485e9366b6 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:29.759278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83f322-25c0-43cc-921a-5edb7a0a6f47 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:29.760926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83f322-25c0-43cc-921a-5edb7a0a6f47 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:29.761218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83f322-25c0-43cc-921a-5edb7a0a6f47 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:29.761571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83f322-25c0-43cc-921a-5edb7a0a6f47 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/projects/8637cc4341124a3b93c3e33d8b44a223` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:29.762959 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83f322-25c0-43cc-921a-5edb7a0a6f47 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8637cc4341124a3b93c3e33d8b44a223)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:29.764949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83f322-25c0-43cc-921a-5edb7a0a6f47 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:29.769543 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2409/4806] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:20:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:20:29.822189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9a83f322-25c0-43cc-921a-5edb7a0a6f47 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8637cc4341124a3b93c3e33d8b44a223', 'request_id': 'req-9a83f322-25c0-43cc-921a-5edb7a0a6f47'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:29.833448 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9a83f322-25c0-43cc-921a-5edb7a0a6f47 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8637cc4341124a3b93c3e33d8b44a223', 'request_id': 'req-9a83f322-25c0-43cc-921a-5edb7a0a6f47'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:29.841151 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9a83f322-25c0-43cc-921a-5edb7a0a6f47 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8637cc4341124a3b93c3e33d8b44a223', 'request_id': 'req-9a83f322-25c0-43cc-921a-5edb7a0a6f47'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:29.858910 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9a83f322-25c0-43cc-921a-5edb7a0a6f47 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] The token cache is being invalidate because project 8637cc4341124a3b93c3e33d8b44a223 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:29.859211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9a83f322-25c0-43cc-921a-5edb7a0a6f47 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:29.860045 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9a83f322-25c0-43cc-921a-5edb7a0a6f47 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:29.866799 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2398/4807] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:20:29 2022] DELETE /identity/v3/projects/8637cc4341124a3b93c3e33d8b44a223 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:20:29.867342 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc00394-c1ed-4c62-8365-46485e9366b6 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:29.882623 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc00394-c1ed-4c62-8365-46485e9366b6 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:29.909469 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:30.010937 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9d671-2383-49c7-bb29-00ed34e79158 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:30.011611 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9d671-2383-49c7-bb29-00ed34e79158 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:30.011886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9d671-2383-49c7-bb29-00ed34e79158 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:30.012163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9d671-2383-49c7-bb29-00ed34e79158 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:30.012823 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc9d671-2383-49c7-bb29-00ed34e79158 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:30.014739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc9d671-2383-49c7-bb29-00ed34e79158 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:30.059953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83f322-25c0-43cc-921a-5edb7a0a6f47 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:30.063771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9a83f322-25c0-43cc-921a-5edb7a0a6f47 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:30.091523 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2410/4808] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:20:29 2022] POST /identity/v3/projects => generated 354 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:20:30.095318 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9d671-2383-49c7-bb29-00ed34e79158 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:30.097258 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3bc9d671-2383-49c7-bb29-00ed34e79158 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:30.196790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9d671-2383-49c7-bb29-00ed34e79158 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:30.202522 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97af18a-3917-4df0-9d5a-08c96cf51938 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:30.203387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97af18a-3917-4df0-9d5a-08c96cf51938 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:30.203674 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97af18a-3917-4df0-9d5a-08c96cf51938 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:30.203949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83f322-25c0-43cc-921a-5edb7a0a6f47 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:30.204067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97af18a-3917-4df0-9d5a-08c96cf51938 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/projects/6d03faf149e94744bb9b6ad3c150a087` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:30.205277 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97af18a-3917-4df0-9d5a-08c96cf51938 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:update_project(project_id=6d03faf149e94744bb9b6ad3c150a087)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:30.207399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97af18a-3917-4df0-9d5a-08c96cf51938 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:30.253817 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:30.283407 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2411/4809] 10.222.0.30 () {60 vars in 1252 bytes} [Sun Sep 4 01:20:30 2022] PATCH /identity/v3/projects/6d03faf149e94744bb9b6ad3c150a087 => generated 367 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:20:30.291363 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97af18a-3917-4df0-9d5a-08c96cf51938 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:30.310534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727ff0f-09bf-4286-aa2c-4afa4e1fa8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:30.310916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97af18a-3917-4df0-9d5a-08c96cf51938 tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:30.311809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727ff0f-09bf-4286-aa2c-4afa4e1fa8ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:30.312413 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727ff0f-09bf-4286-aa2c-4afa4e1fa8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:30.314646 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727ff0f-09bf-4286-aa2c-4afa4e1fa8ba admin admin] PATH_INFO: `/v3/projects/db0aea35475d48999796a64e11bc533f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:30.316229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727ff0f-09bf-4286-aa2c-4afa4e1fa8ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=db0aea35475d48999796a64e11bc533f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:30.318774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727ff0f-09bf-4286-aa2c-4afa4e1fa8ba admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:30.324267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252718b-2c36-4ebf-bdd7-99cd2118c1fd tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:30.325140 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252718b-2c36-4ebf-bdd7-99cd2118c1fd tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:30.325428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252718b-2c36-4ebf-bdd7-99cd2118c1fd tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:30.325725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252718b-2c36-4ebf-bdd7-99cd2118c1fd tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/projects/6d03faf149e94744bb9b6ad3c150a087` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:30.359563 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252718b-2c36-4ebf-bdd7-99cd2118c1fd tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:get_project(project_id=6d03faf149e94744bb9b6ad3c150a087)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:30.364722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252718b-2c36-4ebf-bdd7-99cd2118c1fd tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:30.375246 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2412/4810] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:20:30 2022] GET /identity/v3/projects/6d03faf149e94744bb9b6ad3c150a087 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:20:30.376602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252718b-2c36-4ebf-bdd7-99cd2118c1fd tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:30.395153 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252718b-2c36-4ebf-bdd7-99cd2118c1fd tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:30.410627 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936df9be-2742-4f65-9dea-f7b93e54198a tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:30.411406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936df9be-2742-4f65-9dea-f7b93e54198a tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:30.411588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936df9be-2742-4f65-9dea-f7b93e54198a tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:30.411859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936df9be-2742-4f65-9dea-f7b93e54198a tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/projects/6d03faf149e94744bb9b6ad3c150a087` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:30.413048 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936df9be-2742-4f65-9dea-f7b93e54198a tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6d03faf149e94744bb9b6ad3c150a087)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:30.415046 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936df9be-2742-4f65-9dea-f7b93e54198a tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:30.434150 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3727ff0f-09bf-4286-aa2c-4afa4e1fa8ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db0aea35475d48999796a64e11bc533f', 'request_id': 'req-3727ff0f-09bf-4286-aa2c-4afa4e1fa8ba'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:30.465413 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3727ff0f-09bf-4286-aa2c-4afa4e1fa8ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db0aea35475d48999796a64e11bc533f', 'request_id': 'req-3727ff0f-09bf-4286-aa2c-4afa4e1fa8ba'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:30.479395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3727ff0f-09bf-4286-aa2c-4afa4e1fa8ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db0aea35475d48999796a64e11bc533f', 'request_id': 'req-3727ff0f-09bf-4286-aa2c-4afa4e1fa8ba'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:30.496349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3727ff0f-09bf-4286-aa2c-4afa4e1fa8ba admin admin] The token cache is being invalidate because project db0aea35475d48999796a64e11bc533f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:30.497790 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3727ff0f-09bf-4286-aa2c-4afa4e1fa8ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:30.501631 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3727ff0f-09bf-4286-aa2c-4afa4e1fa8ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:30.506487 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2399/4811] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:20:30 2022] DELETE /identity/v3/projects/db0aea35475d48999796a64e11bc533f => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:20:30.515174 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e892b0-fc76-4948-ad93-a8fa9972ea8d None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:30.515776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e892b0-fc76-4948-ad93-a8fa9972ea8d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:30.516255 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e892b0-fc76-4948-ad93-a8fa9972ea8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:30.544295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-92e892b0-fc76-4948-ad93-a8fa9972ea8d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:30.547529 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-92e892b0-fc76-4948-ad93-a8fa9972ea8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:30.551860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-936df9be-2742-4f65-9dea-f7b93e54198a tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d03faf149e94744bb9b6ad3c150a087', 'request_id': 'req-936df9be-2742-4f65-9dea-f7b93e54198a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:30.572288 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-936df9be-2742-4f65-9dea-f7b93e54198a tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d03faf149e94744bb9b6ad3c150a087', 'request_id': 'req-936df9be-2742-4f65-9dea-f7b93e54198a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:30.582446 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-936df9be-2742-4f65-9dea-f7b93e54198a tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d03faf149e94744bb9b6ad3c150a087', 'request_id': 'req-936df9be-2742-4f65-9dea-f7b93e54198a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:30.584951 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:UPDATE=1,keystone:DELETE=7 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:30.617711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-936df9be-2742-4f65-9dea-f7b93e54198a tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] The token cache is being invalidate because project 6d03faf149e94744bb9b6ad3c150a087 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:30.618084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-936df9be-2742-4f65-9dea-f7b93e54198a tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:30.618834 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-936df9be-2742-4f65-9dea-f7b93e54198a tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:30.625693 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2413/4812] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:20:30 2022] DELETE /identity/v3/projects/6d03faf149e94744bb9b6ad3c150a087 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:30.626823 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936df9be-2742-4f65-9dea-f7b93e54198a tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:30.629284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-936df9be-2742-4f65-9dea-f7b93e54198a tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:30.661552 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2400/4813] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:30.663619 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4a6a0-c18f-4170-8624-c4946716441f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:30.664050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4a6a0-c18f-4170-8624-c4946716441f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:30.664503 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4a6a0-c18f-4170-8624-c4946716441f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:30.691545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-6fb4a6a0-c18f-4170-8624-c4946716441f None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:30.693606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6fb4a6a0-c18f-4170-8624-c4946716441f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:30.707033 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2401/4814] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:30.708228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb4a6a0-c18f-4170-8624-c4946716441f None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:30.719145 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb4a6a0-c18f-4170-8624-c4946716441f None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:30.724231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936df9be-2742-4f65-9dea-f7b93e54198a tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:30.725289 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98a8f0-a7d9-4308-ad47-f2e33fa3c2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:30.726320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98a8f0-a7d9-4308-ad47-f2e33fa3c2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:30.726555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98a8f0-a7d9-4308-ad47-f2e33fa3c2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:30.726889 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98a8f0-a7d9-4308-ad47-f2e33fa3c2b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:30.727624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98a8f0-a7d9-4308-ad47-f2e33fa3c2b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:20:30.727934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98a8f0-a7d9-4308-ad47-f2e33fa3c2b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:30.730660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98a8f0-a7d9-4308-ad47-f2e33fa3c2b6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:30.733833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cef848-e244-4858-b989-71e7c70a2f2b tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:30.735071 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cef848-e244-4858-b989-71e7c70a2f2b tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:30.736508 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cef848-e244-4858-b989-71e7c70a2f2b tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:30.737616 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cef848-e244-4858-b989-71e7c70a2f2b tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/domains/094ba569e6b44a81b6e786a3fd49cdf5` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:30.748022 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cef848-e244-4858-b989-71e7c70a2f2b tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 01:20:30.748687 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2402/4815] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:20:30.754347 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98a8f0-a7d9-4308-ad47-f2e33fa3c2b6 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:30.757048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-b6cef848-e244-4858-b989-71e7c70a2f2b tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Could not find domain: 094ba569e6b44a81b6e786a3fd49cdf5.: keystone.exception.DomainNotFound: Could not find domain: 094ba569e6b44a81b6e786a3fd49cdf5. Sep 04 01:20:30.757048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:20:30.757048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 04 01:20:30.757048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 04 01:20:30.757048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 01:20:30.757048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 01:20:30.757048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 01:20:30.757048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 01:20:30.757048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 094ba569e6b44a81b6e786a3fd49cdf5. Sep 04 01:20:30.757048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:20:30.757048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:20:30.757048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:20:30.757048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:20:30.757048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:20:30.757048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:20:30.757048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:20:30.758140 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:20:30.758140 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:20:30.758140 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:20:30.758140 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:20:30.758140 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:20:30.758140 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:20:30.758140 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:20:30.758140 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 04 01:20:30.758140 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 04 01:20:30.758140 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 01:20:30.758140 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 01:20:30.758140 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 01:20:30.758140 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 01:20:30.758140 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:20:30.758140 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:20:30.758140 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 01:20:30.759063 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 01:20:30.759063 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 01:20:30.759063 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 01:20:30.759063 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 01:20:30.759063 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 01:20:30.759063 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 01:20:30.759063 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 01:20:30.759063 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 01:20:30.759063 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 01:20:30.759063 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 01:20:30.759063 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 01:20:30.759063 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 01:20:30.759063 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 01:20:30.759063 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 04 01:20:30.759063 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 01:20:30.759063 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 094ba569e6b44a81b6e786a3fd49cdf5. Sep 04 01:20:30.759063 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:20:30.764027 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2414/4816] 10.222.0.30 () {60 vars in 1249 bytes} [Sun Sep 4 01:20:30 2022] PATCH /identity/v3/domains/094ba569e6b44a81b6e786a3fd49cdf5 => generated 112 bytes in 137 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:20:30.768129 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cef848-e244-4858-b989-71e7c70a2f2b tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:30.774634 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98a8f0-a7d9-4308-ad47-f2e33fa3c2b6 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:30.781630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067d2c1-4fca-45ad-b817-928c701c9cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:30.782438 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067d2c1-4fca-45ad-b817-928c701c9cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:30.783408 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067d2c1-4fca-45ad-b817-928c701c9cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:30.783786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067d2c1-4fca-45ad-b817-928c701c9cb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:30.784953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5067d2c1-4fca-45ad-b817-928c701c9cb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:30.785874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cef848-e244-4858-b989-71e7c70a2f2b tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:30.787189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5067d2c1-4fca-45ad-b817-928c701c9cb5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:30.793918 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d5457-6bc5-42ec-8f98-98fcd448dd5d tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30b0ee5f936b4ff0a902a97e221e35ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54782bda17ca47bb8f7c5e8ec928491c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:30.794846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d5457-6bc5-42ec-8f98-98fcd448dd5d tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:30.795315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d5457-6bc5-42ec-8f98-98fcd448dd5d tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:30.795901 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d5457-6bc5-42ec-8f98-98fcd448dd5d tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] PATH_INFO: `/v3/domains/077707cd42bf4693ae5d9628f8d35d75` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:30.805405 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d5457-6bc5-42ec-8f98-98fcd448dd5d tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 01:20:30.813235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-a78d5457-6bc5-42ec-8f98-98fcd448dd5d tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Could not find domain: 077707cd42bf4693ae5d9628f8d35d75.: keystone.exception.DomainNotFound: Could not find domain: 077707cd42bf4693ae5d9628f8d35d75. Sep 04 01:20:30.813235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:20:30.813235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 04 01:20:30.813235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 04 01:20:30.813235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 01:20:30.813235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 01:20:30.813235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 01:20:30.813235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 01:20:30.813235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 077707cd42bf4693ae5d9628f8d35d75. Sep 04 01:20:30.813235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:20:30.813235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:20:30.813235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:20:30.813235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:20:30.813235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:20:30.813235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:20:30.813235 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:20:30.814722 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:20:30.814722 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:20:30.814722 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:20:30.814722 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:20:30.814722 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:20:30.814722 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:20:30.814722 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:20:30.814722 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 04 01:20:30.814722 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 04 01:20:30.814722 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 01:20:30.814722 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 01:20:30.814722 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 01:20:30.814722 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 01:20:30.814722 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:20:30.814722 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:20:30.814722 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 01:20:30.816177 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 01:20:30.816177 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 01:20:30.816177 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 01:20:30.816177 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 01:20:30.816177 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 01:20:30.816177 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 01:20:30.816177 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 01:20:30.816177 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 01:20:30.816177 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 01:20:30.816177 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 01:20:30.816177 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 01:20:30.816177 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 01:20:30.816177 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 01:20:30.816177 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 04 01:20:30.816177 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 01:20:30.816177 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 077707cd42bf4693ae5d9628f8d35d75. Sep 04 01:20:30.816177 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:20:30.820001 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2415/4817] 10.222.0.30 () {60 vars in 1249 bytes} [Sun Sep 4 01:20:30 2022] PATCH /identity/v3/domains/077707cd42bf4693ae5d9628f8d35d75 => generated 112 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:20:30.823862 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d5457-6bc5-42ec-8f98-98fcd448dd5d tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:30.826051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a78d5457-6bc5-42ec-8f98-98fcd448dd5d tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:30.832762 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2403/4818] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:20:30 2022] POST /identity/v3/projects => generated 369 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:30.837636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067d2c1-4fca-45ad-b817-928c701c9cb5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:30.848079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d5457-6bc5-42ec-8f98-98fcd448dd5d tempest-ProjectsTestJSON-631895445 tempest-ProjectsTestJSON-631895445-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:30.865460 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:30.943492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6540caa-45f6-4358-9985-1b5a86c347e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:30.944393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6540caa-45f6-4358-9985-1b5a86c347e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:30.944627 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6540caa-45f6-4358-9985-1b5a86c347e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:30.944996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6540caa-45f6-4358-9985-1b5a86c347e9 admin admin] PATH_INFO: `/v3/users/e15677bf13ef42fdb59034ffd09330bb` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:30.946340 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6540caa-45f6-4358-9985-1b5a86c347e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e15677bf13ef42fdb59034ffd09330bb)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:30.948857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6540caa-45f6-4358-9985-1b5a86c347e9 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:30.959921 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067d2c1-4fca-45ad-b817-928c701c9cb5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:30.978341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83d908-3e21-4676-9735-481a79d9427f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:30.979587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83d908-3e21-4676-9735-481a79d9427f admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:30.979935 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83d908-3e21-4676-9735-481a79d9427f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:30.980274 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83d908-3e21-4676-9735-481a79d9427f admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:30.981088 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd83d908-3e21-4676-9735-481a79d9427f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:30.984156 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd83d908-3e21-4676-9735-481a79d9427f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:31.040825 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d6540caa-45f6-4358-9985-1b5a86c347e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e15677bf13ef42fdb59034ffd09330bb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:31.042443 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d6540caa-45f6-4358-9985-1b5a86c347e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e15677bf13ef42fdb59034ffd09330bb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:31.043721 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2404/4819] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:20:30 2022] POST /identity/v3/users => generated 285 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:31.045056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83d908-3e21-4676-9735-481a79d9427f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:31.048460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-fd83d908-3e21-4676-9735-481a79d9427f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:31.055936 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d6540caa-45f6-4358-9985-1b5a86c347e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e15677bf13ef42fdb59034ffd09330bb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:31.067102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83d908-3e21-4676-9735-481a79d9427f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:31.070575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d6540caa-45f6-4358-9985-1b5a86c347e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e15677bf13ef42fdb59034ffd09330bb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:31.071708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d6540caa-45f6-4358-9985-1b5a86c347e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e15677bf13ef42fdb59034ffd09330bb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:31.074415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010d1e9-a544-4917-8e67-4f2136d85ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:31.075243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010d1e9-a544-4917-8e67-4f2136d85ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:31.075562 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010d1e9-a544-4917-8e67-4f2136d85ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:31.075836 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010d1e9-a544-4917-8e67-4f2136d85ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:31.076486 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010d1e9-a544-4917-8e67-4f2136d85ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:31.078246 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010d1e9-a544-4917-8e67-4f2136d85ed6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:31.099799 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2405/4820] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:20:31.104988 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010d1e9-a544-4917-8e67-4f2136d85ed6 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:31.111694 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2416/4821] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:20:30 2022] DELETE /identity/v3/users/e15677bf13ef42fdb59034ffd09330bb => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:20:31.116361 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50ff2a-2b7e-4763-9cc8-ece8cdb51172 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:31.116774 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50ff2a-2b7e-4763-9cc8-ece8cdb51172 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:31.117946 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50ff2a-2b7e-4763-9cc8-ece8cdb51172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:31.126178 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:31.127260 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010d1e9-a544-4917-8e67-4f2136d85ed6 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:31.151861 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-8a50ff2a-2b7e-4763-9cc8-ece8cdb51172 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:31.153255 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8a50ff2a-2b7e-4763-9cc8-ece8cdb51172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:31.214952 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83ca24-f65b-4e57-82d6-dd9fec606b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:31.215571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83ca24-f65b-4e57-82d6-dd9fec606b3f admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:31.215852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83ca24-f65b-4e57-82d6-dd9fec606b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:31.216127 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83ca24-f65b-4e57-82d6-dd9fec606b3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:31.217404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83ca24-f65b-4e57-82d6-dd9fec606b3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:31.219689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83ca24-f65b-4e57-82d6-dd9fec606b3f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:31.239660 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2406/4822] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:20:31.240657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83ca24-f65b-4e57-82d6-dd9fec606b3f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:31.289622 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2417/4823] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:20:31.290125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83ca24-f65b-4e57-82d6-dd9fec606b3f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:31.295904 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30864d10-e799-4e67-925a-061bc98ff021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:31.296754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30864d10-e799-4e67-925a-061bc98ff021 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:31.297258 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30864d10-e799-4e67-925a-061bc98ff021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:31.297963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30864d10-e799-4e67-925a-061bc98ff021 admin admin] PATH_INFO: `/v3/projects/973f43c30f1b454c81041027cd767564/users/c2c44588d537401ebfbb9cb40c318b9f/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:31.300833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50ff2a-2b7e-4763-9cc8-ece8cdb51172 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:31.303386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8a50ff2a-2b7e-4763-9cc8-ece8cdb51172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:31.319543 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30864d10-e799-4e67-925a-061bc98ff021 admin admin] RBAC: Authorizing `identity:create_grant(project_id=973f43c30f1b454c81041027cd767564, user_id=c2c44588d537401ebfbb9cb40c318b9f, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:31.324592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30864d10-e799-4e67-925a-061bc98ff021 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:31.353828 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2407/4824] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:20:31 2022] PUT /identity/v3/projects/973f43c30f1b454c81041027cd767564/users/c2c44588d537401ebfbb9cb40c318b9f/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:31.360907 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d268bf-73ec-47b4-a612-0f81d4c3e801 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:31.361782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d268bf-73ec-47b4-a612-0f81d4c3e801 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:31.362234 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d268bf-73ec-47b4-a612-0f81d4c3e801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:31.391569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50ff2a-2b7e-4763-9cc8-ece8cdb51172 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:31.415218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-17d268bf-73ec-47b4-a612-0f81d4c3e801 None None] MFA Rules not processed for user `c2c44588d537401ebfbb9cb40c318b9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:31.417335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-17d268bf-73ec-47b4-a612-0f81d4c3e801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:31.476053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335803fc-6245-4476-ac0e-20dcc62e0286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:31.476669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335803fc-6245-4476-ac0e-20dcc62e0286 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:31.476952 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335803fc-6245-4476-ac0e-20dcc62e0286 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:31.477230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335803fc-6245-4476-ac0e-20dcc62e0286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:31.540685 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:31.548368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335803fc-6245-4476-ac0e-20dcc62e0286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:31.551248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335803fc-6245-4476-ac0e-20dcc62e0286 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:31.564548 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2418/4825] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:20:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:20:31.568081 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2408/4826] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:20:31.579735 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335803fc-6245-4476-ac0e-20dcc62e0286 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:31.590368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335803fc-6245-4476-ac0e-20dcc62e0286 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:31.603926 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb087d-515e-4d55-9319-7d955694384c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:31.605147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb087d-515e-4d55-9319-7d955694384c service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:31.605652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb087d-515e-4d55-9319-7d955694384c service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:31.606116 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb087d-515e-4d55-9319-7d955694384c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:31.622483 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:31.625167 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb087d-515e-4d55-9319-7d955694384c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:31.626849 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb087d-515e-4d55-9319-7d955694384c service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:31.639322 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2419/4827] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:20:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:20:33.845634 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d268bf-73ec-47b4-a612-0f81d4c3e801 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:33.847354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-17d268bf-73ec-47b4-a612-0f81d4c3e801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:33.874796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d268bf-73ec-47b4-a612-0f81d4c3e801 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:33.885292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b8b25-85af-45ca-ad9c-6fc402473c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:33.886509 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b8b25-85af-45ca-ad9c-6fc402473c7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:33.886509 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b8b25-85af-45ca-ad9c-6fc402473c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:33.886793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b8b25-85af-45ca-ad9c-6fc402473c7b admin admin] PATH_INFO: `/v3/projects/6b74932d5d0549fc83ad167eb3284f85` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:33.890142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b8b25-85af-45ca-ad9c-6fc402473c7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b74932d5d0549fc83ad167eb3284f85)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:33.892468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b8b25-85af-45ca-ad9c-6fc402473c7b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:33.985135 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a41b8b25-85af-45ca-ad9c-6fc402473c7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b74932d5d0549fc83ad167eb3284f85', 'request_id': 'req-a41b8b25-85af-45ca-ad9c-6fc402473c7b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:34.009097 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a41b8b25-85af-45ca-ad9c-6fc402473c7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b74932d5d0549fc83ad167eb3284f85', 'request_id': 'req-a41b8b25-85af-45ca-ad9c-6fc402473c7b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:34.033869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a41b8b25-85af-45ca-ad9c-6fc402473c7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b74932d5d0549fc83ad167eb3284f85', 'request_id': 'req-a41b8b25-85af-45ca-ad9c-6fc402473c7b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:34.065599 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a41b8b25-85af-45ca-ad9c-6fc402473c7b admin admin] The token cache is being invalidate because project 6b74932d5d0549fc83ad167eb3284f85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:34.065886 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a41b8b25-85af-45ca-ad9c-6fc402473c7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:34.067402 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a41b8b25-85af-45ca-ad9c-6fc402473c7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:34.073724 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2409/4828] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:20:33 2022] DELETE /identity/v3/projects/6b74932d5d0549fc83ad167eb3284f85 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:34.074115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb087d-515e-4d55-9319-7d955694384c service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:34.106689 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb087d-515e-4d55-9319-7d955694384c service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:34.239349 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db30ed8-652a-42b6-8e74-3600e87cd3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:34.240009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db30ed8-652a-42b6-8e74-3600e87cd3c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:34.240281 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db30ed8-652a-42b6-8e74-3600e87cd3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:34.240559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db30ed8-652a-42b6-8e74-3600e87cd3c9 admin admin] PATH_INFO: `/v3/users/30b0ee5f936b4ff0a902a97e221e35ab` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:34.241775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db30ed8-652a-42b6-8e74-3600e87cd3c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30b0ee5f936b4ff0a902a97e221e35ab)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:34.243766 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db30ed8-652a-42b6-8e74-3600e87cd3c9 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:34.350853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4db30ed8-652a-42b6-8e74-3600e87cd3c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30b0ee5f936b4ff0a902a97e221e35ab'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:34.354206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4db30ed8-652a-42b6-8e74-3600e87cd3c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30b0ee5f936b4ff0a902a97e221e35ab'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:34.367869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4db30ed8-652a-42b6-8e74-3600e87cd3c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30b0ee5f936b4ff0a902a97e221e35ab'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:34.397949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4db30ed8-652a-42b6-8e74-3600e87cd3c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30b0ee5f936b4ff0a902a97e221e35ab'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:34.401911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4db30ed8-652a-42b6-8e74-3600e87cd3c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30b0ee5f936b4ff0a902a97e221e35ab'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:34.441505 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2420/4829] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:20:34 2022] DELETE /identity/v3/users/30b0ee5f936b4ff0a902a97e221e35ab => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:35.539645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b8b25-85af-45ca-ad9c-6fc402473c7b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:35.541764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a41b8b25-85af-45ca-ad9c-6fc402473c7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:35.568151 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b8b25-85af-45ca-ad9c-6fc402473c7b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:35.707010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf425b41-41b3-421a-834b-2ea591294557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:35.707915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf425b41-41b3-421a-834b-2ea591294557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:35.708344 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf425b41-41b3-421a-834b-2ea591294557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:35.708756 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf425b41-41b3-421a-834b-2ea591294557 admin admin] PATH_INFO: `/v3/users/b9c9d301ba5041048f72484964f5dd96` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:35.711383 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf425b41-41b3-421a-834b-2ea591294557 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9c9d301ba5041048f72484964f5dd96)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:35.715629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf425b41-41b3-421a-834b-2ea591294557 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:35.808399 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cf425b41-41b3-421a-834b-2ea591294557 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9c9d301ba5041048f72484964f5dd96'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:35.809481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cf425b41-41b3-421a-834b-2ea591294557 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9c9d301ba5041048f72484964f5dd96'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:35.828504 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cf425b41-41b3-421a-834b-2ea591294557 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9c9d301ba5041048f72484964f5dd96'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:35.844822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cf425b41-41b3-421a-834b-2ea591294557 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9c9d301ba5041048f72484964f5dd96'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:35.845868 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cf425b41-41b3-421a-834b-2ea591294557 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9c9d301ba5041048f72484964f5dd96'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:35.868243 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:35.881052 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2410/4830] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:20:35 2022] DELETE /identity/v3/users/b9c9d301ba5041048f72484964f5dd96 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:35.889916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2ae1d-aee0-43f2-8e8a-4de40d470251 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:35.893252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2ae1d-aee0-43f2-8e8a-4de40d470251 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:35.893252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2ae1d-aee0-43f2-8e8a-4de40d470251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:35.930063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf425b41-41b3-421a-834b-2ea591294557 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:35.931854 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-cf425b41-41b3-421a-834b-2ea591294557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:35.952360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ace2ae1d-aee0-43f2-8e8a-4de40d470251 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:35.953621 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ace2ae1d-aee0-43f2-8e8a-4de40d470251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:36.102948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf425b41-41b3-421a-834b-2ea591294557 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:36.113075 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd97db4-8116-43f9-89d6-efd6b6142b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:36.114816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd97db4-8116-43f9-89d6-efd6b6142b44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:36.115478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd97db4-8116-43f9-89d6-efd6b6142b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:36.115985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd97db4-8116-43f9-89d6-efd6b6142b44 admin admin] PATH_INFO: `/v3/projects/54782bda17ca47bb8f7c5e8ec928491c` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:36.117576 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd97db4-8116-43f9-89d6-efd6b6142b44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54782bda17ca47bb8f7c5e8ec928491c)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:36.120695 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd97db4-8116-43f9-89d6-efd6b6142b44 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:36.141536 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2421/4831] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:36.248654 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2ae1d-aee0-43f2-8e8a-4de40d470251 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:36.250534 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ace2ae1d-aee0-43f2-8e8a-4de40d470251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:36.258291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1dd97db4-8116-43f9-89d6-efd6b6142b44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54782bda17ca47bb8f7c5e8ec928491c', 'request_id': 'req-1dd97db4-8116-43f9-89d6-efd6b6142b44'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:36.284019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1dd97db4-8116-43f9-89d6-efd6b6142b44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54782bda17ca47bb8f7c5e8ec928491c', 'request_id': 'req-1dd97db4-8116-43f9-89d6-efd6b6142b44'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:36.292562 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:36.302429 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1dd97db4-8116-43f9-89d6-efd6b6142b44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54782bda17ca47bb8f7c5e8ec928491c', 'request_id': 'req-1dd97db4-8116-43f9-89d6-efd6b6142b44'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:36.340361 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1dd97db4-8116-43f9-89d6-efd6b6142b44 admin admin] The token cache is being invalidate because project 54782bda17ca47bb8f7c5e8ec928491c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:36.340506 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1dd97db4-8116-43f9-89d6-efd6b6142b44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:36.343622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1dd97db4-8116-43f9-89d6-efd6b6142b44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:36.350661 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2411/4832] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:20:35 2022] DELETE /identity/v3/projects/54782bda17ca47bb8f7c5e8ec928491c => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:36.354914 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be36f60-1a2e-46a2-8d6c-cc59f80ef17a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:36.355452 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be36f60-1a2e-46a2-8d6c-cc59f80ef17a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:36.355690 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be36f60-1a2e-46a2-8d6c-cc59f80ef17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:36.397257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2ae1d-aee0-43f2-8e8a-4de40d470251 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:36.410353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-3be36f60-1a2e-46a2-8d6c-cc59f80ef17a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:36.414222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3be36f60-1a2e-46a2-8d6c-cc59f80ef17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:36.530657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897356f-b0e4-4c91-88bb-b3fd40f48a58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:36.531247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897356f-b0e4-4c91-88bb-b3fd40f48a58 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:36.531561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897356f-b0e4-4c91-88bb-b3fd40f48a58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:36.531885 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897356f-b0e4-4c91-88bb-b3fd40f48a58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:36.535545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1897356f-b0e4-4c91-88bb-b3fd40f48a58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:36.538774 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2412/4833] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:36.547617 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb3bb8-c1f3-44af-b581-02949e1b8728 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:36.548241 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb3bb8-c1f3-44af-b581-02949e1b8728 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:36.548241 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb3bb8-c1f3-44af-b581-02949e1b8728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:36.578658 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1897356f-b0e4-4c91-88bb-b3fd40f48a58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:36.582460 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1897356f-b0e4-4c91-88bb-b3fd40f48a58 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:36.590162 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-1dcb3bb8-c1f3-44af-b581-02949e1b8728 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:36.591455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1dcb3bb8-c1f3-44af-b581-02949e1b8728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:36.602923 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2413/4834] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:20:36.607526 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb3bb8-c1f3-44af-b581-02949e1b8728 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:36.618202 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2422/4835] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:20:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:20:36.620598 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb3bb8-c1f3-44af-b581-02949e1b8728 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:36.626117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d4110-1926-4845-a7ec-bf07daa358d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:36.627083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d4110-1926-4845-a7ec-bf07daa358d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:36.627208 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d4110-1926-4845-a7ec-bf07daa358d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:36.627775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d4110-1926-4845-a7ec-bf07daa358d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:36.628460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d4110-1926-4845-a7ec-bf07daa358d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:20:36.628999 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d4110-1926-4845-a7ec-bf07daa358d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:36.632179 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d4110-1926-4845-a7ec-bf07daa358d3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:36.648589 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2414/4836] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:20:36.653680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897356f-b0e4-4c91-88bb-b3fd40f48a58 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:36.676163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897356f-b0e4-4c91-88bb-b3fd40f48a58 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:36.681204 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ea508-dc13-4727-9380-022c63812e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:36.683384 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ea508-dc13-4727-9380-022c63812e84 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:36.683700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ea508-dc13-4727-9380-022c63812e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:36.684048 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ea508-dc13-4727-9380-022c63812e84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:36.684755 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ea508-dc13-4727-9380-022c63812e84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:36.686857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ea508-dc13-4727-9380-022c63812e84 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:36.729802 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2423/4837] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:20:36 2022] POST /identity/v3/projects => generated 367 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:36.734468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d4110-1926-4845-a7ec-bf07daa358d3 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:36.768654 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d4110-1926-4845-a7ec-bf07daa358d3 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:36.781352 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:36.879559 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e6ab4-0e19-4d39-975b-50c8f4313111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:36.880185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e6ab4-0e19-4d39-975b-50c8f4313111 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:36.880463 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e6ab4-0e19-4d39-975b-50c8f4313111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:36.880736 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e6ab4-0e19-4d39-975b-50c8f4313111 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:36.881831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56e6ab4-0e19-4d39-975b-50c8f4313111 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:36.884560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56e6ab4-0e19-4d39-975b-50c8f4313111 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:36.918661 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2415/4838] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:20:36 2022] POST /identity/v3/users => generated 284 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:36.919544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ea508-dc13-4727-9380-022c63812e84 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:36.936133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ea508-dc13-4727-9380-022c63812e84 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:36.941731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9ff72-d311-4410-a96b-a132a938dce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:36.943062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9ff72-d311-4410-a96b-a132a938dce9 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:36.943592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9ff72-d311-4410-a96b-a132a938dce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:36.944118 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9ff72-d311-4410-a96b-a132a938dce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:36.945059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9ff72-d311-4410-a96b-a132a938dce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:36.947202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9ff72-d311-4410-a96b-a132a938dce9 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:36.963607 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2424/4839] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:20:36.967832 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e6ab4-0e19-4d39-975b-50c8f4313111 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:36.981011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e6ab4-0e19-4d39-975b-50c8f4313111 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:36.987718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfec7b9-1030-4c27-b652-703c73997cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:36.989055 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfec7b9-1030-4c27-b652-703c73997cce admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:36.989794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfec7b9-1030-4c27-b652-703c73997cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:36.990276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfec7b9-1030-4c27-b652-703c73997cce admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:36.992653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfec7b9-1030-4c27-b652-703c73997cce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:37.003788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfec7b9-1030-4c27-b652-703c73997cce admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:37.027958 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2416/4840] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:20:37.031881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9ff72-d311-4410-a96b-a132a938dce9 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:37.046416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9ff72-d311-4410-a96b-a132a938dce9 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:37.052400 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa00a7-d562-438a-95ce-670e5878d56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:37.053549 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa00a7-d562-438a-95ce-670e5878d56d admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:37.054180 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa00a7-d562-438a-95ce-670e5878d56d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:37.054834 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa00a7-d562-438a-95ce-670e5878d56d admin admin] PATH_INFO: `/v3/projects/15db31cd82a1462b90be4ddb8baf58a9/users/f1eb657c8150446cbb0bb924b0ae99e1/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:37.073389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa00a7-d562-438a-95ce-670e5878d56d admin admin] RBAC: Authorizing `identity:create_grant(project_id=15db31cd82a1462b90be4ddb8baf58a9, user_id=f1eb657c8150446cbb0bb924b0ae99e1, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:37.076256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa00a7-d562-438a-95ce-670e5878d56d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:37.093732 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2425/4841] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:20:37 2022] PUT /identity/v3/projects/15db31cd82a1462b90be4ddb8baf58a9/users/f1eb657c8150446cbb0bb924b0ae99e1/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:20:37.108061 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ae738-4a60-4ce3-97bd-b55e178e9100 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:37.108061 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ae738-4a60-4ce3-97bd-b55e178e9100 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:37.108378 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ae738-4a60-4ce3-97bd-b55e178e9100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:37.141536 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-773ae738-4a60-4ce3-97bd-b55e178e9100 None None] MFA Rules not processed for user `f1eb657c8150446cbb0bb924b0ae99e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:37.142849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-773ae738-4a60-4ce3-97bd-b55e178e9100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:37.255467 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2417/4842] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:37.262286 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa00a7-d562-438a-95ce-670e5878d56d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:37.400662 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa00a7-d562-438a-95ce-670e5878d56d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:37.416877 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e5671-dcaf-4fcd-84d8-22f9ce5f1a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:37.417975 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e5671-dcaf-4fcd-84d8-22f9ce5f1a15 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:37.418496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e5671-dcaf-4fcd-84d8-22f9ce5f1a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:37.419208 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e5671-dcaf-4fcd-84d8-22f9ce5f1a15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:37.420087 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e5671-dcaf-4fcd-84d8-22f9ce5f1a15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:37.424796 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e5671-dcaf-4fcd-84d8-22f9ce5f1a15 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:37.488595 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2426/4843] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:20:37 2022] POST /identity/v3/projects => generated 367 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:37.492469 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ae738-4a60-4ce3-97bd-b55e178e9100 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:37.508653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ae738-4a60-4ce3-97bd-b55e178e9100 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:37.641425 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ff7d5-8bce-44f7-9d52-b04437f3fec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:37.644438 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ff7d5-8bce-44f7-9d52-b04437f3fec5 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:37.645260 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ff7d5-8bce-44f7-9d52-b04437f3fec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:37.647998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ff7d5-8bce-44f7-9d52-b04437f3fec5 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:37.648709 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ff7d5-8bce-44f7-9d52-b04437f3fec5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:37.673189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ff7d5-8bce-44f7-9d52-b04437f3fec5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:37.718806 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2418/4844] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:20:37 2022] POST /identity/v3/users => generated 290 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:37.722610 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e5671-dcaf-4fcd-84d8-22f9ce5f1a15 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:37.729088 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:37.736422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e5671-dcaf-4fcd-84d8-22f9ce5f1a15 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:37.755445 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968e496-7e43-431f-821f-bb611e61ffba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:37.756078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968e496-7e43-431f-821f-bb611e61ffba admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:37.756366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968e496-7e43-431f-821f-bb611e61ffba admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:37.756647 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968e496-7e43-431f-821f-bb611e61ffba admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:37.757301 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968e496-7e43-431f-821f-bb611e61ffba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:37.758951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968e496-7e43-431f-821f-bb611e61ffba admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:37.785009 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2427/4845] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:20:37.789346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ff7d5-8bce-44f7-9d52-b04437f3fec5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:37.804797 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ff7d5-8bce-44f7-9d52-b04437f3fec5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:37.819567 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf192d0e-0ec7-4f35-a610-34312b3d49f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:37.820455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf192d0e-0ec7-4f35-a610-34312b3d49f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:37.820850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf192d0e-0ec7-4f35-a610-34312b3d49f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:37.824958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf192d0e-0ec7-4f35-a610-34312b3d49f6 admin admin] PATH_INFO: `/v3/projects/60d607a733bf407285e513b1ddbaf8c5/users/c00265b6a78e479db8110141a595adba/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:37.831116 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:37.873465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf192d0e-0ec7-4f35-a610-34312b3d49f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60d607a733bf407285e513b1ddbaf8c5, user_id=c00265b6a78e479db8110141a595adba, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:37.877502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf192d0e-0ec7-4f35-a610-34312b3d49f6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:37.936161 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2419/4846] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:20:37 2022] PUT /identity/v3/projects/60d607a733bf407285e513b1ddbaf8c5/users/c00265b6a78e479db8110141a595adba/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:37.937105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968e496-7e43-431f-821f-bb611e61ffba admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:37.948572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968e496-7e43-431f-821f-bb611e61ffba admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:38.065126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf192d0e-0ec7-4f35-a610-34312b3d49f6 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:38.067182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfacac77-b109-487f-af59-86b9fd49e85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:38.067870 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacac77-b109-487f-af59-86b9fd49e85a admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:38.068082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-cf192d0e-0ec7-4f35-a610-34312b3d49f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:38.068205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacac77-b109-487f-af59-86b9fd49e85a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:38.068435 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacac77-b109-487f-af59-86b9fd49e85a admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:38.069079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfacac77-b109-487f-af59-86b9fd49e85a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:38.071428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfacac77-b109-487f-af59-86b9fd49e85a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:38.104886 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2428/4847] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:20:38.109568 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfacac77-b109-487f-af59-86b9fd49e85a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:38.122335 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfacac77-b109-487f-af59-86b9fd49e85a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:38.127854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf4815-cfd0-4b08-a3ae-98e57b89cea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:38.128597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf4815-cfd0-4b08-a3ae-98e57b89cea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:38.129106 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf4815-cfd0-4b08-a3ae-98e57b89cea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:38.129754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf4815-cfd0-4b08-a3ae-98e57b89cea5 admin admin] PATH_INFO: `/v3/projects/60d607a733bf407285e513b1ddbaf8c5/users/c00265b6a78e479db8110141a595adba/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:38.132241 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf4815-cfd0-4b08-a3ae-98e57b89cea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60d607a733bf407285e513b1ddbaf8c5, user_id=c00265b6a78e479db8110141a595adba, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:38.135739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf4815-cfd0-4b08-a3ae-98e57b89cea5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:38.165833 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2429/4848] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:20:38 2022] PUT /identity/v3/projects/60d607a733bf407285e513b1ddbaf8c5/users/c00265b6a78e479db8110141a595adba/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:20:38.176542 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32e0d8-d323-4ca4-8062-bb06aaf6d851 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:38.176831 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32e0d8-d323-4ca4-8062-bb06aaf6d851 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:38.177198 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32e0d8-d323-4ca4-8062-bb06aaf6d851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:38.225802 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-cc32e0d8-d323-4ca4-8062-bb06aaf6d851 None None] MFA Rules not processed for user `c00265b6a78e479db8110141a595adba`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:38.227004 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-cc32e0d8-d323-4ca4-8062-bb06aaf6d851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:38.300175 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf192d0e-0ec7-4f35-a610-34312b3d49f6 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:38.416728 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2430/4849] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:38.421773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32e0d8-d323-4ca4-8062-bb06aaf6d851 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:38.424420 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-cc32e0d8-d323-4ca4-8062-bb06aaf6d851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:38.477879 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6bf07-b147-4551-a39e-37a143818c0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:38.484526 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6bf07-b147-4551-a39e-37a143818c0f service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:38.484526 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6bf07-b147-4551-a39e-37a143818c0f service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:38.491122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6bf07-b147-4551-a39e-37a143818c0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:38.512283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-61f6bf07-b147-4551-a39e-37a143818c0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:38.591190 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6bf07-b147-4551-a39e-37a143818c0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:38.596066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6bf07-b147-4551-a39e-37a143818c0f service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:38.596858 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32e0d8-d323-4ca4-8062-bb06aaf6d851 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:38.607921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a26801-7db5-41de-8b0c-b2c691fcbc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:38.653365 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a26801-7db5-41de-8b0c-b2c691fcbc2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:38.653990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a26801-7db5-41de-8b0c-b2c691fcbc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:38.654665 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a26801-7db5-41de-8b0c-b2c691fcbc2d admin admin] PATH_INFO: `/v3/projects/90a75f0c45a04136a9b802211902b918` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:38.656827 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a26801-7db5-41de-8b0c-b2c691fcbc2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=90a75f0c45a04136a9b802211902b918)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:38.659393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a26801-7db5-41de-8b0c-b2c691fcbc2d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:38.663028 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:38.687855 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2420/4850] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:20:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:20:38.688886 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6bf07-b147-4551-a39e-37a143818c0f service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:38.731176 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6bf07-b147-4551-a39e-37a143818c0f service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:38.750223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b914d1b-57a2-4a18-a694-4ecfe072d7eb tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:38.750858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b914d1b-57a2-4a18-a694-4ecfe072d7eb tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:38.751139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b914d1b-57a2-4a18-a694-4ecfe072d7eb tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:38.751410 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b914d1b-57a2-4a18-a694-4ecfe072d7eb tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:38.752089 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b914d1b-57a2-4a18-a694-4ecfe072d7eb tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:38.756860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b914d1b-57a2-4a18-a694-4ecfe072d7eb tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:38.772684 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-30a26801-7db5-41de-8b0c-b2c691fcbc2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90a75f0c45a04136a9b802211902b918', 'request_id': 'req-30a26801-7db5-41de-8b0c-b2c691fcbc2d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:38.802336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-30a26801-7db5-41de-8b0c-b2c691fcbc2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90a75f0c45a04136a9b802211902b918', 'request_id': 'req-30a26801-7db5-41de-8b0c-b2c691fcbc2d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:38.803747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-30a26801-7db5-41de-8b0c-b2c691fcbc2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90a75f0c45a04136a9b802211902b918', 'request_id': 'req-30a26801-7db5-41de-8b0c-b2c691fcbc2d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:38.817213 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2421/4851] 10.222.0.30 () {60 vars in 1143 bytes} [Sun Sep 4 01:20:38 2022] POST /identity/v3/roles => generated 235 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:38.821110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b914d1b-57a2-4a18-a694-4ecfe072d7eb tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:38.836095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b914d1b-57a2-4a18-a694-4ecfe072d7eb tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:38.856653 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-30a26801-7db5-41de-8b0c-b2c691fcbc2d admin admin] The token cache is being invalidate because project 90a75f0c45a04136a9b802211902b918 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:38.857993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-30a26801-7db5-41de-8b0c-b2c691fcbc2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:38.859221 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-30a26801-7db5-41de-8b0c-b2c691fcbc2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:38.865803 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2431/4852] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:20:38 2022] DELETE /identity/v3/projects/90a75f0c45a04136a9b802211902b918 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:38.871986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc90e7e-aabb-4d64-8a5e-0189b212f77c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:38.871986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc90e7e-aabb-4d64-8a5e-0189b212f77c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:38.872265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc90e7e-aabb-4d64-8a5e-0189b212f77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:38.927467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-4fc90e7e-aabb-4d64-8a5e-0189b212f77c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:38.928969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4fc90e7e-aabb-4d64-8a5e-0189b212f77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:38.958111 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:38.972589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa04701-287b-4ace-9bc7-361b148601c6 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:38.973370 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa04701-287b-4ace-9bc7-361b148601c6 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:38.973706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa04701-287b-4ace-9bc7-361b148601c6 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:38.973986 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa04701-287b-4ace-9bc7-361b148601c6 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:38.974848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa04701-287b-4ace-9bc7-361b148601c6 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:38.979104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa04701-287b-4ace-9bc7-361b148601c6 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:39.019303 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2432/4853] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:39.023704 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2422/4854] 10.222.0.30 () {60 vars in 1143 bytes} [Sun Sep 4 01:20:38 2022] POST /identity/v3/roles => generated 235 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:39.025287 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc90e7e-aabb-4d64-8a5e-0189b212f77c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:39.027979 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4fc90e7e-aabb-4d64-8a5e-0189b212f77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:39.028388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c3a37-9840-468b-8690-01e64d249d11 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:39.028740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c3a37-9840-468b-8690-01e64d249d11 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:39.029123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c3a37-9840-468b-8690-01e64d249d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:39.060439 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a83c3a37-9840-468b-8690-01e64d249d11 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:39.061813 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a83c3a37-9840-468b-8690-01e64d249d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:39.062154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc90e7e-aabb-4d64-8a5e-0189b212f77c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:39.072320 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2423/4855] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:39.073908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36d7ed-1c4b-434d-b758-354d2453f5db tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:39.074754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36d7ed-1c4b-434d-b758-354d2453f5db tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:39.075041 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36d7ed-1c4b-434d-b758-354d2453f5db tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:39.075614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c3a37-9840-468b-8690-01e64d249d11 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:39.078149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36d7ed-1c4b-434d-b758-354d2453f5db tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:39.078298 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36d7ed-1c4b-434d-b758-354d2453f5db tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:39.080283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36d7ed-1c4b-434d-b758-354d2453f5db tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:39.100556 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c3a37-9840-468b-8690-01e64d249d11 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:39.101241 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2433/4856] 10.222.0.30 () {60 vars in 1143 bytes} [Sun Sep 4 01:20:39 2022] POST /identity/v3/roles => generated 235 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:39.110226 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36d7ed-1c4b-434d-b758-354d2453f5db tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:39.119561 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3110b0-f106-403b-bd79-5fba0ddcf3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:39.120418 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3110b0-f106-403b-bd79-5fba0ddcf3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:39.120815 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3110b0-f106-403b-bd79-5fba0ddcf3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:39.121172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3110b0-f106-403b-bd79-5fba0ddcf3d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:39.122087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3110b0-f106-403b-bd79-5fba0ddcf3d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:20:39.124286 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36d7ed-1c4b-434d-b758-354d2453f5db tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:39.124758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3110b0-f106-403b-bd79-5fba0ddcf3d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:39.126575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3110b0-f106-403b-bd79-5fba0ddcf3d5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:39.130524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32361a98-6ffb-466f-8831-543361cf2973 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:39.131687 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32361a98-6ffb-466f-8831-543361cf2973 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:39.132139 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32361a98-6ffb-466f-8831-543361cf2973 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:39.132879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32361a98-6ffb-466f-8831-543361cf2973 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:39.133856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32361a98-6ffb-466f-8831-543361cf2973 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:39.135739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32361a98-6ffb-466f-8831-543361cf2973 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:39.163651 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2424/4857] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:20:39.169642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3110b0-f106-403b-bd79-5fba0ddcf3d5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:39.175084 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2434/4858] 10.222.0.30 () {60 vars in 1149 bytes} [Sun Sep 4 01:20:39 2022] POST /identity/v3/domains => generated 276 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:39.176259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32361a98-6ffb-466f-8831-543361cf2973 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:39.183478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3110b0-f106-403b-bd79-5fba0ddcf3d5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:39.330708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad4026-98fc-45db-8aee-c5e65a8cb923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:39.331639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad4026-98fc-45db-8aee-c5e65a8cb923 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:39.331997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad4026-98fc-45db-8aee-c5e65a8cb923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:39.332395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad4026-98fc-45db-8aee-c5e65a8cb923 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:39.333121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad4026-98fc-45db-8aee-c5e65a8cb923 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:39.335235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad4026-98fc-45db-8aee-c5e65a8cb923 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:39.347739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32361a98-6ffb-466f-8831-543361cf2973 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:39.353187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966935c4-856b-4688-9a79-e69eabbfe7ef tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:39.354491 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966935c4-856b-4688-9a79-e69eabbfe7ef tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:39.354778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966935c4-856b-4688-9a79-e69eabbfe7ef tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:39.355061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966935c4-856b-4688-9a79-e69eabbfe7ef tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:39.355712 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966935c4-856b-4688-9a79-e69eabbfe7ef tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:39.358719 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966935c4-856b-4688-9a79-e69eabbfe7ef tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:39.390871 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:39.394928 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2425/4859] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:20:39 2022] POST /identity/v3/projects => generated 383 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:20:39.399087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad4026-98fc-45db-8aee-c5e65a8cb923 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:39.480632 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2435/4860] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:20:39 2022] POST /identity/v3/projects => generated 399 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:39.488586 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966935c4-856b-4688-9a79-e69eabbfe7ef tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:39.606335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad4026-98fc-45db-8aee-c5e65a8cb923 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:39.711818 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966935c4-856b-4688-9a79-e69eabbfe7ef tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:39.728588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb3b9e-a110-4e14-8388-c94f47508745 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:39.730330 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb3b9e-a110-4e14-8388-c94f47508745 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:39.730493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb3b9e-a110-4e14-8388-c94f47508745 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:39.730694 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb3b9e-a110-4e14-8388-c94f47508745 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/groups` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:39.732225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb3b9e-a110-4e14-8388-c94f47508745 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:39.734388 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb3b9e-a110-4e14-8388-c94f47508745 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:39.784294 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2436/4861] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Sep 4 01:20:39 2022] POST /identity/v3/groups => generated 300 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:39.786466 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb3b9e-a110-4e14-8388-c94f47508745 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:39.819107 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d14260-dde1-4065-9a82-31256d1bc23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:39.820354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d14260-dde1-4065-9a82-31256d1bc23e admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:39.820992 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d14260-dde1-4065-9a82-31256d1bc23e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:39.830028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d14260-dde1-4065-9a82-31256d1bc23e admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:39.830751 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d14260-dde1-4065-9a82-31256d1bc23e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:39.832788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d14260-dde1-4065-9a82-31256d1bc23e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:39.839250 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb3b9e-a110-4e14-8388-c94f47508745 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:39.867959 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c1abe-cf8b-48a7-9bf2-4c7ec3fc17ec tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:39.868801 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c1abe-cf8b-48a7-9bf2-4c7ec3fc17ec tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:39.869835 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:39.870602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c1abe-cf8b-48a7-9bf2-4c7ec3fc17ec tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:39.871064 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c1abe-cf8b-48a7-9bf2-4c7ec3fc17ec tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:39.871912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c1abe-cf8b-48a7-9bf2-4c7ec3fc17ec tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:39.874198 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c1abe-cf8b-48a7-9bf2-4c7ec3fc17ec tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:39.905896 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2426/4862] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:20:39 2022] POST /identity/v3/users => generated 292 bytes in 507 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:39.909402 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d14260-dde1-4065-9a82-31256d1bc23e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:39.915627 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2437/4863] 10.222.0.30 () {60 vars in 1143 bytes} [Sun Sep 4 01:20:39 2022] POST /identity/v3/roles => generated 235 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:39.920287 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c1abe-cf8b-48a7-9bf2-4c7ec3fc17ec tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:39.927686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d14260-dde1-4065-9a82-31256d1bc23e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:39.947132 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf663ac-906d-4a32-8e87-dfc4295f04fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:39.948682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf663ac-906d-4a32-8e87-dfc4295f04fa admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:39.948987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf663ac-906d-4a32-8e87-dfc4295f04fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:39.949489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf663ac-906d-4a32-8e87-dfc4295f04fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:39.949992 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c1abe-cf8b-48a7-9bf2-4c7ec3fc17ec tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:39.950248 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf663ac-906d-4a32-8e87-dfc4295f04fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:39.951924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf663ac-906d-4a32-8e87-dfc4295f04fa admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:39.965571 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99907c80-7552-4fd8-86e8-05f77b072ddf tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:39.966472 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99907c80-7552-4fd8-86e8-05f77b072ddf tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:39.967101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99907c80-7552-4fd8-86e8-05f77b072ddf tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:39.967655 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99907c80-7552-4fd8-86e8-05f77b072ddf tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:39.968555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99907c80-7552-4fd8-86e8-05f77b072ddf tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:39.971934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99907c80-7552-4fd8-86e8-05f77b072ddf tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:39.987580 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2427/4864] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:20:39 2022] GET /identity/v3/roles => generated 2324 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:20:39.988857 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf663ac-906d-4a32-8e87-dfc4295f04fa admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:40.014866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf663ac-906d-4a32-8e87-dfc4295f04fa admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:40.022413 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2438/4865] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:20:39 2022] POST /identity/v3/users => generated 442 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:40.027210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99907c80-7552-4fd8-86e8-05f77b072ddf tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:40.030524 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd421d66-5e58-43de-948d-143c3e08be11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:40.031167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd421d66-5e58-43de-948d-143c3e08be11 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:40.031449 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd421d66-5e58-43de-948d-143c3e08be11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:40.031723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd421d66-5e58-43de-948d-143c3e08be11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:40.032375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd421d66-5e58-43de-948d-143c3e08be11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:40.034074 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd421d66-5e58-43de-948d-143c3e08be11 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:40.053344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99907c80-7552-4fd8-86e8-05f77b072ddf tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:40.062630 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2428/4866] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:20:39 2022] GET /identity/v3/roles => generated 2324 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:20:40.068127 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd421d66-5e58-43de-948d-143c3e08be11 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:40.076130 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c706163-b0e3-4fd8-87e0-cdd0d53c3ae1 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:40.076835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c706163-b0e3-4fd8-87e0-cdd0d53c3ae1 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:40.077128 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c706163-b0e3-4fd8-87e0-cdd0d53c3ae1 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:40.079404 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c706163-b0e3-4fd8-87e0-cdd0d53c3ae1 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:40.080938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c706163-b0e3-4fd8-87e0-cdd0d53c3ae1 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:40.084572 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-2c706163-b0e3-4fd8-87e0-cdd0d53c3ae1 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:40.084572 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:20:40.084572 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:20:40.086739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c706163-b0e3-4fd8-87e0-cdd0d53c3ae1 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:40.093701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd421d66-5e58-43de-948d-143c3e08be11 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:40.105069 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbdd3f-2580-41c5-bca9-d954475f7cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:40.105985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbdd3f-2580-41c5-bca9-d954475f7cc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:40.106289 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbdd3f-2580-41c5-bca9-d954475f7cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:40.106583 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbdd3f-2580-41c5-bca9-d954475f7cc0 admin admin] PATH_INFO: `/v3/projects/afe363157a1c483e9b2ba5300a8ab39a/users/da39799202f64ad09830b862d4803b48/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:40.142138 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2439/4867] 10.222.0.30 () {60 vars in 1143 bytes} [Sun Sep 4 01:20:40 2022] POST /identity/v3/roles => generated 270 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:40.144708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c706163-b0e3-4fd8-87e0-cdd0d53c3ae1 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:40.145845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dbdd3f-2580-41c5-bca9-d954475f7cc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afe363157a1c483e9b2ba5300a8ab39a, user_id=da39799202f64ad09830b862d4803b48, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:40.148553 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dbdd3f-2580-41c5-bca9-d954475f7cc0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:40.184455 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c706163-b0e3-4fd8-87e0-cdd0d53c3ae1 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:40.192261 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2429/4868] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:20:40 2022] PUT /identity/v3/projects/afe363157a1c483e9b2ba5300a8ab39a/users/da39799202f64ad09830b862d4803b48/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:40.206719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8b598-d8df-4eec-916a-d6793837a551 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:40.207334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8b598-d8df-4eec-916a-d6793837a551 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:40.207617 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8b598-d8df-4eec-916a-d6793837a551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:40.279501 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c2a8b598-d8df-4eec-916a-d6793837a551 None None] MFA Rules not processed for user `da39799202f64ad09830b862d4803b48`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:40.281762 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c2a8b598-d8df-4eec-916a-d6793837a551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:40.360589 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba010b2-73b4-4c3a-9b50-693d88c6601b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:40.361290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba010b2-73b4-4c3a-9b50-693d88c6601b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:40.367915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba010b2-73b4-4c3a-9b50-693d88c6601b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:40.368437 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba010b2-73b4-4c3a-9b50-693d88c6601b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/projects/369271e332a447f59cff39b1511717c7/users/afec73c7d52145c6b2ae7935f36dc95e/roles/dbd043964b2c4b8a811d10e8cfb727bf` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:40.405928 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba010b2-73b4-4c3a-9b50-693d88c6601b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:create_grant(project_id=369271e332a447f59cff39b1511717c7, user_id=afec73c7d52145c6b2ae7935f36dc95e, role_id=dbd043964b2c4b8a811d10e8cfb727bf)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:40.408632 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba010b2-73b4-4c3a-9b50-693d88c6601b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:40.424838 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2430/4869] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:20:40.446995 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2440/4870] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:20:40 2022] PUT /identity/v3/projects/369271e332a447f59cff39b1511717c7/users/afec73c7d52145c6b2ae7935f36dc95e/roles/dbd043964b2c4b8a811d10e8cfb727bf => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:40.453194 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8b598-d8df-4eec-916a-d6793837a551 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:40.468521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8b598-d8df-4eec-916a-d6793837a551 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:40.525873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba010b2-73b4-4c3a-9b50-693d88c6601b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:40.527917 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5ba010b2-73b4-4c3a-9b50-693d88c6601b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:40.568277 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:40.630526 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab031e0d-8d50-442e-bf50-6b1fdf094ab0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:40.631274 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab031e0d-8d50-442e-bf50-6b1fdf094ab0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:40.631274 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab031e0d-8d50-442e-bf50-6b1fdf094ab0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:40.631521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab031e0d-8d50-442e-bf50-6b1fdf094ab0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:40.632414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab031e0d-8d50-442e-bf50-6b1fdf094ab0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Adding query filter params (scope.project.id=369271e332a447f59cff39b1511717c7, user.id=afec73c7d52145c6b2ae7935f36dc95e) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:20:40.632544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab031e0d-8d50-442e-bf50-6b1fdf094ab0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:40.634441 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab031e0d-8d50-442e-bf50-6b1fdf094ab0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:40.682688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba010b2-73b4-4c3a-9b50-693d88c6601b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:40.697841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b97ca4-38a1-4cb4-b152-09c7ea4c572b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:40.698485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b97ca4-38a1-4cb4-b152-09c7ea4c572b service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:40.698765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b97ca4-38a1-4cb4-b152-09c7ea4c572b service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:40.699041 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b97ca4-38a1-4cb4-b152-09c7ea4c572b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:40.729516 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:40.760342 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2431/4871] 10.222.0.30 () {58 vars in 1356 bytes} [Sun Sep 4 01:20:40 2022] GET /identity/v3/role_assignments?scope.project.id=369271e332a447f59cff39b1511717c7&user.id=afec73c7d52145c6b2ae7935f36dc95e&effective => generated 228 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:20:40.762000 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab031e0d-8d50-442e-bf50-6b1fdf094ab0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:40.786004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab031e0d-8d50-442e-bf50-6b1fdf094ab0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:40.802508 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1822806-2ea6-4d04-8e73-258da5c360ff tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:40.803518 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1822806-2ea6-4d04-8e73-258da5c360ff tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:40.803518 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1822806-2ea6-4d04-8e73-258da5c360ff tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:40.803741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1822806-2ea6-4d04-8e73-258da5c360ff tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/projects/369271e332a447f59cff39b1511717c7/users/afec73c7d52145c6b2ae7935f36dc95e/roles/dbd043964b2c4b8a811d10e8cfb727bf` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:40.808545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1822806-2ea6-4d04-8e73-258da5c360ff tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=369271e332a447f59cff39b1511717c7, user_id=afec73c7d52145c6b2ae7935f36dc95e, role_id=dbd043964b2c4b8a811d10e8cfb727bf)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:40.812380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1822806-2ea6-4d04-8e73-258da5c360ff tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:40.829070 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a1822806-2ea6-4d04-8e73-258da5c360ff tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invalidating the token cache because role dbd043964b2c4b8a811d10e8cfb727bf was removed from user afec73c7d52145c6b2ae7935f36dc95e on project 369271e332a447f59cff39b1511717c7. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:40.829756 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a1822806-2ea6-4d04-8e73-258da5c360ff tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:40.830838 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a1822806-2ea6-4d04-8e73-258da5c360ff tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:40.859927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b97ca4-38a1-4cb4-b152-09c7ea4c572b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:40.862905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b97ca4-38a1-4cb4-b152-09c7ea4c572b service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:40.877402 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2432/4872] 10.222.0.30 () {58 vars in 1467 bytes} [Sun Sep 4 01:20:40 2022] DELETE /identity/v3/projects/369271e332a447f59cff39b1511717c7/users/afec73c7d52145c6b2ae7935f36dc95e/roles/dbd043964b2c4b8a811d10e8cfb727bf => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:40.881905 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1822806-2ea6-4d04-8e73-258da5c360ff tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:40.886412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a1822806-2ea6-4d04-8e73-258da5c360ff tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:40.896233 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2441/4873] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:20:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:20:40.976353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1822806-2ea6-4d04-8e73-258da5c360ff tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:40.985160 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab765a1-3c13-4526-9c43-ee6d557cb0e5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:40.986027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab765a1-3c13-4526-9c43-ee6d557cb0e5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:40.986321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab765a1-3c13-4526-9c43-ee6d557cb0e5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:40.986603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab765a1-3c13-4526-9c43-ee6d557cb0e5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/dbd043964b2c4b8a811d10e8cfb727bf` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:40.988004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab765a1-3c13-4526-9c43-ee6d557cb0e5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=dbd043964b2c4b8a811d10e8cfb727bf)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:40.989298 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-cab765a1-3c13-4526-9c43-ee6d557cb0e5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:40.989298 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:20:40.989298 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:20:40.990233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab765a1-3c13-4526-9c43-ee6d557cb0e5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:41.036478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cab765a1-3c13-4526-9c43-ee6d557cb0e5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invalidating the token cache because role dbd043964b2c4b8a811d10e8cfb727bf has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:41.037113 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cab765a1-3c13-4526-9c43-ee6d557cb0e5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:41.037872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cab765a1-3c13-4526-9c43-ee6d557cb0e5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:41.040023 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2433/4874] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:20:40 2022] DELETE /identity/v3/roles/dbd043964b2c4b8a811d10e8cfb727bf => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:41.045206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b97ca4-38a1-4cb4-b152-09c7ea4c572b service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:41.063779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b97ca4-38a1-4cb4-b152-09c7ea4c572b service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:41.138372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fd013-0180-4c53-a451-7cba876bb10e tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:41.139234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fd013-0180-4c53-a451-7cba876bb10e tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:41.139552 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fd013-0180-4c53-a451-7cba876bb10e tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:41.141785 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fd013-0180-4c53-a451-7cba876bb10e tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/projects/369271e332a447f59cff39b1511717c7/users/afec73c7d52145c6b2ae7935f36dc95e/roles/f67996c7900c4b618a2efaf0031e5939` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:41.144154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1fd013-0180-4c53-a451-7cba876bb10e tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:create_grant(project_id=369271e332a447f59cff39b1511717c7, user_id=afec73c7d52145c6b2ae7935f36dc95e, role_id=f67996c7900c4b618a2efaf0031e5939)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:41.147457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1fd013-0180-4c53-a451-7cba876bb10e tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:41.199338 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2442/4875] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:20:41 2022] PUT /identity/v3/projects/369271e332a447f59cff39b1511717c7/users/afec73c7d52145c6b2ae7935f36dc95e/roles/f67996c7900c4b618a2efaf0031e5939 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:20:41.203835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab765a1-3c13-4526-9c43-ee6d557cb0e5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:41.205416 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-cab765a1-3c13-4526-9c43-ee6d557cb0e5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:41.230659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab765a1-3c13-4526-9c43-ee6d557cb0e5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:41.320489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9a7b1-806e-48d8-a907-d6e3937a2844 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:41.321371 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9a7b1-806e-48d8-a907-d6e3937a2844 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:41.321918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9a7b1-806e-48d8-a907-d6e3937a2844 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:41.322897 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9a7b1-806e-48d8-a907-d6e3937a2844 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/f67996c7900c4b618a2efaf0031e5939/implies/141866535f78410bb51eb40dd91ed1b6` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:41.325817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9a7b1-806e-48d8-a907-d6e3937a2844 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=f67996c7900c4b618a2efaf0031e5939, implied_role_id=141866535f78410bb51eb40dd91ed1b6)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:41.326947 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-bbe9a7b1-806e-48d8-a907-d6e3937a2844 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:41.326947 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:20:41.326947 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:20:41.329680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9a7b1-806e-48d8-a907-d6e3937a2844 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:41.386942 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2434/4876] 10.222.0.30 () {60 vars in 1363 bytes} [Sun Sep 4 01:20:41 2022] PUT /identity/v3/roles/f67996c7900c4b618a2efaf0031e5939/implies/141866535f78410bb51eb40dd91ed1b6 => generated 521 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:41.388253 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fd013-0180-4c53-a451-7cba876bb10e tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:41.412392 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fd013-0180-4c53-a451-7cba876bb10e tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:41.568790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f375ad-2f51-4e2e-9cec-01e1521bf657 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:41.569315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f375ad-2f51-4e2e-9cec-01e1521bf657 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:41.569851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f375ad-2f51-4e2e-9cec-01e1521bf657 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:41.570231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f375ad-2f51-4e2e-9cec-01e1521bf657 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:41.571490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f375ad-2f51-4e2e-9cec-01e1521bf657 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Adding query filter params (scope.project.id=369271e332a447f59cff39b1511717c7, user.id=afec73c7d52145c6b2ae7935f36dc95e) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:20:41.571490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f375ad-2f51-4e2e-9cec-01e1521bf657 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:41.575487 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f375ad-2f51-4e2e-9cec-01e1521bf657 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:41.581661 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:41.723878 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2443/4877] 10.222.0.30 () {58 vars in 1356 bytes} [Sun Sep 4 01:20:41 2022] GET /identity/v3/role_assignments?scope.project.id=369271e332a447f59cff39b1511717c7&user.id=afec73c7d52145c6b2ae7935f36dc95e&effective => generated 1061 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:20:41.726273 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9a7b1-806e-48d8-a907-d6e3937a2844 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:41.743860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9a7b1-806e-48d8-a907-d6e3937a2844 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:41.767585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a2f74-77f9-4bd8-a76e-2d126931d37a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:41.770642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a2f74-77f9-4bd8-a76e-2d126931d37a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:41.771059 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a2f74-77f9-4bd8-a76e-2d126931d37a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:41.771590 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a2f74-77f9-4bd8-a76e-2d126931d37a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/f67996c7900c4b618a2efaf0031e5939/implies/141866535f78410bb51eb40dd91ed1b6` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:41.783501 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a2f74-77f9-4bd8-a76e-2d126931d37a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=f67996c7900c4b618a2efaf0031e5939, implied_role_id=141866535f78410bb51eb40dd91ed1b6)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:41.789920 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-702a2f74-77f9-4bd8-a76e-2d126931d37a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:41.789920 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:20:41.789920 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:20:41.793550 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a2f74-77f9-4bd8-a76e-2d126931d37a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:41.842403 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2435/4878] 10.222.0.30 () {58 vars in 1347 bytes} [Sun Sep 4 01:20:41 2022] DELETE /identity/v3/roles/f67996c7900c4b618a2efaf0031e5939/implies/141866535f78410bb51eb40dd91ed1b6 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:41.845061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f375ad-2f51-4e2e-9cec-01e1521bf657 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:41.864580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f375ad-2f51-4e2e-9cec-01e1521bf657 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:42.053588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d2c0e-0cb6-4e37-a999-7cfa70aaa775 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:42.056733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d2c0e-0cb6-4e37-a999-7cfa70aaa775 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:42.056903 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d2c0e-0cb6-4e37-a999-7cfa70aaa775 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:42.057969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d2c0e-0cb6-4e37-a999-7cfa70aaa775 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:42.060426 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d2c0e-0cb6-4e37-a999-7cfa70aaa775 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Adding query filter params (scope.project.id=369271e332a447f59cff39b1511717c7, user.id=afec73c7d52145c6b2ae7935f36dc95e) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:20:42.063024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d2c0e-0cb6-4e37-a999-7cfa70aaa775 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:42.084156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d2c0e-0cb6-4e37-a999-7cfa70aaa775 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:42.239524 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2444/4879] 10.222.0.30 () {58 vars in 1356 bytes} [Sun Sep 4 01:20:41 2022] GET /identity/v3/role_assignments?scope.project.id=369271e332a447f59cff39b1511717c7&user.id=afec73c7d52145c6b2ae7935f36dc95e&effective => generated 577 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:20:42.243785 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a2f74-77f9-4bd8-a76e-2d126931d37a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:42.271037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a2f74-77f9-4bd8-a76e-2d126931d37a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:42.279024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f0f2d-a6c2-4dcf-b742-01ffd149dc6e tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:42.279709 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f0f2d-a6c2-4dcf-b742-01ffd149dc6e tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:42.279996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f0f2d-a6c2-4dcf-b742-01ffd149dc6e tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:42.280333 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f0f2d-a6c2-4dcf-b742-01ffd149dc6e tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/f67996c7900c4b618a2efaf0031e5939/implies/141866535f78410bb51eb40dd91ed1b6` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:42.282008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f0f2d-a6c2-4dcf-b742-01ffd149dc6e tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=f67996c7900c4b618a2efaf0031e5939, implied_role_id=141866535f78410bb51eb40dd91ed1b6)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:42.285663 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f0f2d-a6c2-4dcf-b742-01ffd149dc6e tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:42.290953 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:42.367345 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-957f0f2d-a6c2-4dcf-b742-01ffd149dc6e tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] f67996c7900c4b618a2efaf0031e5939 does not imply 141866535f78410bb51eb40dd91ed1b6.: keystone.exception.ImpliedRoleNotFound: f67996c7900c4b618a2efaf0031e5939 does not imply 141866535f78410bb51eb40dd91ed1b6. Sep 04 01:20:42.367345 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:20:42.367345 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Sep 04 01:20:42.367345 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = query.one() Sep 04 01:20:42.367345 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Sep 04 01:20:42.367345 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._iter().one() Sep 04 01:20:42.367345 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Sep 04 01:20:42.367345 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._only_one_row( Sep 04 01:20:42.367345 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Sep 04 01:20:42.367345 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exc.NoResultFound( Sep 04 01:20:42.367345 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Sep 04 01:20:42.367345 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:20:42.367345 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:20:42.367345 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:20:42.367345 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:20:42.367345 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:20:42.368627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:20:42.368627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:20:42.368627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:20:42.368627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:20:42.368627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:20:42.368627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:20:42.368627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:20:42.368627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:20:42.368627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:20:42.368627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Sep 04 01:20:42.368627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Sep 04 01:20:42.368627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:20:42.368627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:20:42.368627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Sep 04 01:20:42.368627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Sep 04 01:20:42.368627 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Sep 04 01:20:42.369776 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Sep 04 01:20:42.369776 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Sep 04 01:20:42.369776 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Sep 04 01:20:42.369776 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: f67996c7900c4b618a2efaf0031e5939 does not imply 141866535f78410bb51eb40dd91ed1b6. Sep 04 01:20:42.369776 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:20:42.374003 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d2c0e-0cb6-4e37-a999-7cfa70aaa775 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:42.375623 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2436/4880] 10.222.0.30 () {58 vars in 1347 bytes} [Sun Sep 4 01:20:42 2022] DELETE /identity/v3/roles/f67996c7900c4b618a2efaf0031e5939/implies/141866535f78410bb51eb40dd91ed1b6 => generated 137 bytes in 132 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:20:42.424090 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d2c0e-0cb6-4e37-a999-7cfa70aaa775 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:42.429511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e34fc-4631-4c0a-8128-ef92c5160a90 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:42.430408 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e34fc-4631-4c0a-8128-ef92c5160a90 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:42.430848 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e34fc-4631-4c0a-8128-ef92c5160a90 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:42.431281 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e34fc-4631-4c0a-8128-ef92c5160a90 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/projects/369271e332a447f59cff39b1511717c7/users/afec73c7d52145c6b2ae7935f36dc95e/roles/f67996c7900c4b618a2efaf0031e5939` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:42.434016 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e34fc-4631-4c0a-8128-ef92c5160a90 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=369271e332a447f59cff39b1511717c7, user_id=afec73c7d52145c6b2ae7935f36dc95e, role_id=f67996c7900c4b618a2efaf0031e5939)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:42.440678 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e34fc-4631-4c0a-8128-ef92c5160a90 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:42.453119 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b22e34fc-4631-4c0a-8128-ef92c5160a90 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invalidating the token cache because role f67996c7900c4b618a2efaf0031e5939 was removed from user afec73c7d52145c6b2ae7935f36dc95e on project 369271e332a447f59cff39b1511717c7. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:42.453645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b22e34fc-4631-4c0a-8128-ef92c5160a90 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:42.454580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b22e34fc-4631-4c0a-8128-ef92c5160a90 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:42.487517 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2445/4881] 10.222.0.30 () {58 vars in 1467 bytes} [Sun Sep 4 01:20:42 2022] DELETE /identity/v3/projects/369271e332a447f59cff39b1511717c7/users/afec73c7d52145c6b2ae7935f36dc95e/roles/f67996c7900c4b618a2efaf0031e5939 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:42.493142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f0f2d-a6c2-4dcf-b742-01ffd149dc6e tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:42.495972 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-957f0f2d-a6c2-4dcf-b742-01ffd149dc6e tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:42.532331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f0f2d-a6c2-4dcf-b742-01ffd149dc6e tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:42.677052 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0307f4-4c84-415b-a5dd-acf983d87f87 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:42.678029 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0307f4-4c84-415b-a5dd-acf983d87f87 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:42.678733 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0307f4-4c84-415b-a5dd-acf983d87f87 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:42.679083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0307f4-4c84-415b-a5dd-acf983d87f87 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:42.679891 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0307f4-4c84-415b-a5dd-acf983d87f87 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:42.681298 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-8b0307f4-4c84-415b-a5dd-acf983d87f87 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:42.681298 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:20:42.681298 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:20:42.682666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0307f4-4c84-415b-a5dd-acf983d87f87 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:42.707247 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2437/4882] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:20:42 2022] POST /identity/v3/roles => generated 271 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:42.711295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e34fc-4631-4c0a-8128-ef92c5160a90 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:42.725307 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e34fc-4631-4c0a-8128-ef92c5160a90 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:42.754903 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e9f6b-85d8-4794-aaf9-d09a1615da49 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:42.755957 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e9f6b-85d8-4794-aaf9-d09a1615da49 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:42.756387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e9f6b-85d8-4794-aaf9-d09a1615da49 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:42.756820 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e9f6b-85d8-4794-aaf9-d09a1615da49 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:42.757932 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e9f6b-85d8-4794-aaf9-d09a1615da49 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Adding query filter params (domain_id=009614487f63473dbee82cfecdf5effa) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:20:42.758392 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e9f6b-85d8-4794-aaf9-d09a1615da49 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:42.759631 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-991e9f6b-85d8-4794-aaf9-d09a1615da49 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:42.759631 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:20:42.759631 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:20:42.761351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e9f6b-85d8-4794-aaf9-d09a1615da49 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:42.782276 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2446/4883] 10.222.0.30 () {58 vars in 1207 bytes} [Sun Sep 4 01:20:42 2022] GET /identity/v3/roles?domain_id=009614487f63473dbee82cfecdf5effa => generated 408 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:20:42.786785 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0307f4-4c84-415b-a5dd-acf983d87f87 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:42.802439 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0307f4-4c84-415b-a5dd-acf983d87f87 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:42.832900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec8b40-516d-4df4-b400-313b1670c663 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:42.833917 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec8b40-516d-4df4-b400-313b1670c663 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:42.834356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec8b40-516d-4df4-b400-313b1670c663 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:42.834804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec8b40-516d-4df4-b400-313b1670c663 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/cb39df555103463d9057626bb96c939f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:42.837408 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec8b40-516d-4df4-b400-313b1670c663 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=cb39df555103463d9057626bb96c939f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:42.839163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec8b40-516d-4df4-b400-313b1670c663 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:42.929979 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-90ec8b40-516d-4df4-b400-313b1670c663 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invalidating the token cache because role cb39df555103463d9057626bb96c939f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:42.930689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-90ec8b40-516d-4df4-b400-313b1670c663 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:42.930965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-90ec8b40-516d-4df4-b400-313b1670c663 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:42.933481 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2438/4884] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:20:42 2022] DELETE /identity/v3/roles/cb39df555103463d9057626bb96c939f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:42.937792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e9f6b-85d8-4794-aaf9-d09a1615da49 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:42.940480 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-991e9f6b-85d8-4794-aaf9-d09a1615da49 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:42.979363 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e9f6b-85d8-4794-aaf9-d09a1615da49 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:43.058573 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:43.076472 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3b947-6ef6-4aa9-a819-58fd7e4f957a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:43.077114 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3b947-6ef6-4aa9-a819-58fd7e4f957a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:43.077850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3b947-6ef6-4aa9-a819-58fd7e4f957a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:43.078129 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3b947-6ef6-4aa9-a819-58fd7e4f957a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:43.078811 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3b947-6ef6-4aa9-a819-58fd7e4f957a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Adding query filter params (domain_id=009614487f63473dbee82cfecdf5effa) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:20:43.079121 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3b947-6ef6-4aa9-a819-58fd7e4f957a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:43.080868 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3b947-6ef6-4aa9-a819-58fd7e4f957a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:43.092474 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2447/4885] 10.222.0.30 () {58 vars in 1207 bytes} [Sun Sep 4 01:20:42 2022] GET /identity/v3/roles?domain_id=009614487f63473dbee82cfecdf5effa => generated 148 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:20:43.096989 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec8b40-516d-4df4-b400-313b1670c663 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:43.120360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec8b40-516d-4df4-b400-313b1670c663 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:43.127701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4810cc-12ef-4d54-9003-62b9cd9fcf67 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:43.128529 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4810cc-12ef-4d54-9003-62b9cd9fcf67 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:43.128816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4810cc-12ef-4d54-9003-62b9cd9fcf67 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:43.129091 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4810cc-12ef-4d54-9003-62b9cd9fcf67 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/cb39df555103463d9057626bb96c939f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:43.145973 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4810cc-12ef-4d54-9003-62b9cd9fcf67 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 01:20:43.151823 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-3d4810cc-12ef-4d54-9003-62b9cd9fcf67 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Could not find role: cb39df555103463d9057626bb96c939f.: keystone.exception.RoleNotFound: Could not find role: cb39df555103463d9057626bb96c939f. Sep 04 01:20:43.151823 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:20:43.151823 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:20:43.151823 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:20:43.151823 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:20:43.151823 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:20:43.151823 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:20:43.151823 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:20:43.151823 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:20:43.151823 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:20:43.151823 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:20:43.151823 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:20:43.151823 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Sep 04 01:20:43.151823 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Sep 04 01:20:43.152763 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 01:20:43.152763 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 01:20:43.152763 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 01:20:43.152763 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 01:20:43.152763 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:20:43.152763 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:20:43.152763 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 01:20:43.152763 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 01:20:43.152763 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 01:20:43.152763 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 01:20:43.152763 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 01:20:43.152763 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 01:20:43.152763 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 01:20:43.152763 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 01:20:43.152763 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 01:20:43.152763 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 01:20:43.153822 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 01:20:43.153822 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 01:20:43.153822 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 01:20:43.153822 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 01:20:43.153822 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 04 01:20:43.153822 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 04 01:20:43.153822 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 04 01:20:43.153822 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 04 01:20:43.153822 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 04 01:20:43.153822 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 01:20:43.153822 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: cb39df555103463d9057626bb96c939f. Sep 04 01:20:43.153822 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:20:43.153822 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2439/4886] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:20:43 2022] DELETE /identity/v3/roles/cb39df555103463d9057626bb96c939f => generated 110 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:20:43.160032 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3b947-6ef6-4aa9-a819-58fd7e4f957a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:43.175575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3b947-6ef6-4aa9-a819-58fd7e4f957a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:43.184101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae44c6e-b485-49d6-a7c3-50553a9e2e08 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:43.184803 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae44c6e-b485-49d6-a7c3-50553a9e2e08 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:43.185086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae44c6e-b485-49d6-a7c3-50553a9e2e08 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:43.185360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae44c6e-b485-49d6-a7c3-50553a9e2e08 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/domains/009614487f63473dbee82cfecdf5effa/groups/9dcc5acebe7742d69710d72b87c4744a/roles/c6104e77f1104fadac1ee071661d7100` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:43.213344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae44c6e-b485-49d6-a7c3-50553a9e2e08 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=009614487f63473dbee82cfecdf5effa, group_id=9dcc5acebe7742d69710d72b87c4744a, role_id=c6104e77f1104fadac1ee071661d7100)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:43.216129 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae44c6e-b485-49d6-a7c3-50553a9e2e08 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:43.255116 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2448/4887] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:20:43 2022] PUT /identity/v3/domains/009614487f63473dbee82cfecdf5effa/groups/9dcc5acebe7742d69710d72b87c4744a/roles/c6104e77f1104fadac1ee071661d7100 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:43.259256 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4810cc-12ef-4d54-9003-62b9cd9fcf67 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:43.284597 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4810cc-12ef-4d54-9003-62b9cd9fcf67 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:43.460445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25bdd56-9011-4799-8de4-2308a8c8d6ac tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:43.461330 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bdd56-9011-4799-8de4-2308a8c8d6ac tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:43.461793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bdd56-9011-4799-8de4-2308a8c8d6ac tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:43.462371 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bdd56-9011-4799-8de4-2308a8c8d6ac tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/domains/009614487f63473dbee82cfecdf5effa/groups/9dcc5acebe7742d69710d72b87c4744a/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:43.464588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25bdd56-9011-4799-8de4-2308a8c8d6ac tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=009614487f63473dbee82cfecdf5effa, group_id=9dcc5acebe7742d69710d72b87c4744a)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:43.468263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25bdd56-9011-4799-8de4-2308a8c8d6ac tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:43.490912 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2440/4888] 10.222.0.30 () {58 vars in 1365 bytes} [Sun Sep 4 01:20:43 2022] GET /identity/v3/domains/009614487f63473dbee82cfecdf5effa/groups/9dcc5acebe7742d69710d72b87c4744a/roles => generated 410 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:20:43.491891 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae44c6e-b485-49d6-a7c3-50553a9e2e08 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:43.520051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae44c6e-b485-49d6-a7c3-50553a9e2e08 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:43.533426 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e338e4-bde6-414b-ba00-0ac5ff0dc8e6 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:43.534319 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e338e4-bde6-414b-ba00-0ac5ff0dc8e6 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:43.534618 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e338e4-bde6-414b-ba00-0ac5ff0dc8e6 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:43.534900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e338e4-bde6-414b-ba00-0ac5ff0dc8e6 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/domains/009614487f63473dbee82cfecdf5effa/groups/9dcc5acebe7742d69710d72b87c4744a/roles/c6104e77f1104fadac1ee071661d7100` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:43.537830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e338e4-bde6-414b-ba00-0ac5ff0dc8e6 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=009614487f63473dbee82cfecdf5effa, group_id=9dcc5acebe7742d69710d72b87c4744a, role_id=c6104e77f1104fadac1ee071661d7100)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:43.540590 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e338e4-bde6-414b-ba00-0ac5ff0dc8e6 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:43.572270 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2449/4889] 10.222.0.30 () {58 vars in 1465 bytes} [Sun Sep 4 01:20:43 2022] HEAD /identity/v3/domains/009614487f63473dbee82cfecdf5effa/groups/9dcc5acebe7742d69710d72b87c4744a/roles/c6104e77f1104fadac1ee071661d7100 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:43.576356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25bdd56-9011-4799-8de4-2308a8c8d6ac tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:43.591069 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25bdd56-9011-4799-8de4-2308a8c8d6ac tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:43.598703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7e35d-2da7-41d9-a645-2279aee808e2 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:43.599534 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7e35d-2da7-41d9-a645-2279aee808e2 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:43.600008 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7e35d-2da7-41d9-a645-2279aee808e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:43.607828 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06608cde-e801-4f6e-a820-d300d203d3f3 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:43.611563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06608cde-e801-4f6e-a820-d300d203d3f3 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:43.612975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06608cde-e801-4f6e-a820-d300d203d3f3 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:43.613792 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06608cde-e801-4f6e-a820-d300d203d3f3 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/domains/009614487f63473dbee82cfecdf5effa/groups/9dcc5acebe7742d69710d72b87c4744a/roles/c6104e77f1104fadac1ee071661d7100` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:43.623381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06608cde-e801-4f6e-a820-d300d203d3f3 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=009614487f63473dbee82cfecdf5effa, group_id=9dcc5acebe7742d69710d72b87c4744a, role_id=c6104e77f1104fadac1ee071661d7100)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:43.635005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06608cde-e801-4f6e-a820-d300d203d3f3 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:43.650753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-06608cde-e801-4f6e-a820-d300d203d3f3 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invalidating the token cache because role c6104e77f1104fadac1ee071661d7100 was removed from group 9dcc5acebe7742d69710d72b87c4744a on domain 009614487f63473dbee82cfecdf5effa. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:43.652009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-06608cde-e801-4f6e-a820-d300d203d3f3 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:43.655380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-06608cde-e801-4f6e-a820-d300d203d3f3 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:43.667840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-4ed7e35d-2da7-41d9-a645-2279aee808e2 None None] MFA Rules not processed for user `ffecd714d4dc4c05a908dd59d7ba912c`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:43.669271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4ed7e35d-2da7-41d9-a645-2279aee808e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:43.687466 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2441/4890] 10.222.0.30 () {58 vars in 1467 bytes} [Sun Sep 4 01:20:43 2022] DELETE /identity/v3/domains/009614487f63473dbee82cfecdf5effa/groups/9dcc5acebe7742d69710d72b87c4744a/roles/c6104e77f1104fadac1ee071661d7100 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:43.688900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06608cde-e801-4f6e-a820-d300d203d3f3 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:43.690423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-06608cde-e801-4f6e-a820-d300d203d3f3 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:43.709510 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:43.813565 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2450/4891] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:43.816390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06608cde-e801-4f6e-a820-d300d203d3f3 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:43.823432 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75146338-be4e-47dd-ab1e-3eb7ba9186ed None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:43.824861 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75146338-be4e-47dd-ab1e-3eb7ba9186ed None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:43.825550 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75146338-be4e-47dd-ab1e-3eb7ba9186ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:43.827840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2aa691-8f67-4305-8cec-3261a82ec8d8 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:43.828711 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2aa691-8f67-4305-8cec-3261a82ec8d8 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:43.829727 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2aa691-8f67-4305-8cec-3261a82ec8d8 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:43.830158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2aa691-8f67-4305-8cec-3261a82ec8d8 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/projects/369271e332a447f59cff39b1511717c7/groups/9dcc5acebe7742d69710d72b87c4744a/roles/c6104e77f1104fadac1ee071661d7100` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:43.832655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2aa691-8f67-4305-8cec-3261a82ec8d8 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:create_grant(project_id=369271e332a447f59cff39b1511717c7, group_id=9dcc5acebe7742d69710d72b87c4744a, role_id=c6104e77f1104fadac1ee071661d7100)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:43.835956 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2aa691-8f67-4305-8cec-3261a82ec8d8 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:43.864900 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2442/4892] 10.222.0.30 () {60 vars in 1486 bytes} [Sun Sep 4 01:20:43 2022] PUT /identity/v3/projects/369271e332a447f59cff39b1511717c7/groups/9dcc5acebe7742d69710d72b87c4744a/roles/c6104e77f1104fadac1ee071661d7100 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:43.867366 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2aa691-8f67-4305-8cec-3261a82ec8d8 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:43.877381 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-75146338-be4e-47dd-ab1e-3eb7ba9186ed None None] MFA Rules not processed for user `ffecd714d4dc4c05a908dd59d7ba912c`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:43.882055 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-75146338-be4e-47dd-ab1e-3eb7ba9186ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:43.974166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2aa691-8f67-4305-8cec-3261a82ec8d8 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:43.985245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbae36-813f-4c8a-af9e-6d5a65320741 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:43.986580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbae36-813f-4c8a-af9e-6d5a65320741 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:43.989087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbae36-813f-4c8a-af9e-6d5a65320741 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:43.989557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbae36-813f-4c8a-af9e-6d5a65320741 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/projects/369271e332a447f59cff39b1511717c7/groups/9dcc5acebe7742d69710d72b87c4744a/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:43.993374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fbae36-813f-4c8a-af9e-6d5a65320741 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:list_grants(project_id=369271e332a447f59cff39b1511717c7, group_id=9dcc5acebe7742d69710d72b87c4744a)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:43.999818 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fbae36-813f-4c8a-af9e-6d5a65320741 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:44.029385 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2443/4893] 10.222.0.30 () {58 vars in 1368 bytes} [Sun Sep 4 01:20:43 2022] GET /identity/v3/projects/369271e332a447f59cff39b1511717c7/groups/9dcc5acebe7742d69710d72b87c4744a/roles => generated 411 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:20:44.034154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbae36-813f-4c8a-af9e-6d5a65320741 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:44.037824 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2451/4894] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:44.046259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75146338-be4e-47dd-ab1e-3eb7ba9186ed None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:44.048028 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-75146338-be4e-47dd-ab1e-3eb7ba9186ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:44.059030 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbae36-813f-4c8a-af9e-6d5a65320741 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:44.074610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882037c-0aee-4b84-9575-a607d6c7f8f6 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:44.076554 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882037c-0aee-4b84-9575-a607d6c7f8f6 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:44.076681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882037c-0aee-4b84-9575-a607d6c7f8f6 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:44.076949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882037c-0aee-4b84-9575-a607d6c7f8f6 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/groups/9dcc5acebe7742d69710d72b87c4744a/users/afec73c7d52145c6b2ae7935f36dc95e` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:44.080785 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0882037c-0aee-4b84-9575-a607d6c7f8f6 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=9dcc5acebe7742d69710d72b87c4744a, user_id=afec73c7d52145c6b2ae7935f36dc95e)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:44.082167 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-0882037c-0aee-4b84-9575-a607d6c7f8f6 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:44.082167 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:20:44.082167 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:20:44.083545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0882037c-0aee-4b84-9575-a607d6c7f8f6 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:44.121321 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2444/4895] 10.222.0.30 () {60 vars in 1360 bytes} [Sun Sep 4 01:20:44 2022] PUT /identity/v3/groups/9dcc5acebe7742d69710d72b87c4744a/users/afec73c7d52145c6b2ae7935f36dc95e => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:44.126308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bc297-a305-4ee6-9524-749685e1cf79 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:44.126754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bc297-a305-4ee6-9524-749685e1cf79 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:44.127036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bc297-a305-4ee6-9524-749685e1cf79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:44.163307 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:44.212205 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-802bc297-a305-4ee6-9524-749685e1cf79 None None] MFA Rules not processed for user `afec73c7d52145c6b2ae7935f36dc95e`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:44.214149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-802bc297-a305-4ee6-9524-749685e1cf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:44.218284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75146338-be4e-47dd-ab1e-3eb7ba9186ed None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:44.311023 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:44.374441 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05a4e6-80f2-45b2-8bb9-9d73073f305c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:44.375575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05a4e6-80f2-45b2-8bb9-9d73073f305c service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:44.375860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05a4e6-80f2-45b2-8bb9-9d73073f305c service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:44.376963 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05a4e6-80f2-45b2-8bb9-9d73073f305c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:44.380248 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2445/4896] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:44 2022] POST /identity/v3/auth/tokens => generated 3265 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:44.385148 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802bc297-a305-4ee6-9524-749685e1cf79 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:44.492689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802bc297-a305-4ee6-9524-749685e1cf79 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:44.507968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d7db8-4448-4bef-9dab-2c1d50ece069 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:44.511261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d7db8-4448-4bef-9dab-2c1d50ece069 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:44.511553 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d7db8-4448-4bef-9dab-2c1d50ece069 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:44.511860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d7db8-4448-4bef-9dab-2c1d50ece069 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/projects/369271e332a447f59cff39b1511717c7/groups/9dcc5acebe7742d69710d72b87c4744a/roles/c6104e77f1104fadac1ee071661d7100` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:44.514498 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d7db8-4448-4bef-9dab-2c1d50ece069 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:check_grant(project_id=369271e332a447f59cff39b1511717c7, group_id=9dcc5acebe7742d69710d72b87c4744a, role_id=c6104e77f1104fadac1ee071661d7100)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:44.517177 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d7db8-4448-4bef-9dab-2c1d50ece069 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:44.520201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05a4e6-80f2-45b2-8bb9-9d73073f305c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:44.525064 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05a4e6-80f2-45b2-8bb9-9d73073f305c service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:44.526608 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2446/4897] 10.222.0.30 () {58 vars in 1468 bytes} [Sun Sep 4 01:20:44 2022] HEAD /identity/v3/projects/369271e332a447f59cff39b1511717c7/groups/9dcc5acebe7742d69710d72b87c4744a/roles/c6104e77f1104fadac1ee071661d7100 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:44.535835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d7db8-4448-4bef-9dab-2c1d50ece069 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:44.546836 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2452/4898] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:20:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:20:44.563465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d7db8-4448-4bef-9dab-2c1d50ece069 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:44.593523 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31f230-ee4a-4729-b61a-d873dc6c1671 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:44.596414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31f230-ee4a-4729-b61a-d873dc6c1671 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:44.599375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31f230-ee4a-4729-b61a-d873dc6c1671 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:44.600539 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31f230-ee4a-4729-b61a-d873dc6c1671 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/projects/369271e332a447f59cff39b1511717c7/groups/9dcc5acebe7742d69710d72b87c4744a/roles/c6104e77f1104fadac1ee071661d7100` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:44.610815 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31f230-ee4a-4729-b61a-d873dc6c1671 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=369271e332a447f59cff39b1511717c7, group_id=9dcc5acebe7742d69710d72b87c4744a, role_id=c6104e77f1104fadac1ee071661d7100)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:44.629352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31f230-ee4a-4729-b61a-d873dc6c1671 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:44.658364 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6d31f230-ee4a-4729-b61a-d873dc6c1671 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invalidating the token cache because role c6104e77f1104fadac1ee071661d7100 was removed from group 9dcc5acebe7742d69710d72b87c4744a on project 369271e332a447f59cff39b1511717c7. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:44.660063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6d31f230-ee4a-4729-b61a-d873dc6c1671 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:44.664284 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6d31f230-ee4a-4729-b61a-d873dc6c1671 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:44.722850 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2447/4899] 10.222.0.30 () {58 vars in 1470 bytes} [Sun Sep 4 01:20:44 2022] DELETE /identity/v3/projects/369271e332a447f59cff39b1511717c7/groups/9dcc5acebe7742d69710d72b87c4744a/roles/c6104e77f1104fadac1ee071661d7100 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:44.723528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05a4e6-80f2-45b2-8bb9-9d73073f305c service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:44.741202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05a4e6-80f2-45b2-8bb9-9d73073f305c service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:44.958513 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f611d-cafd-4073-8e6e-ba472caa1b78 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:44.959567 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f611d-cafd-4073-8e6e-ba472caa1b78 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:44.967506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f611d-cafd-4073-8e6e-ba472caa1b78 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:44.968353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f611d-cafd-4073-8e6e-ba472caa1b78 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/groups/9dcc5acebe7742d69710d72b87c4744a/users/afec73c7d52145c6b2ae7935f36dc95e` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:44.971778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f611d-cafd-4073-8e6e-ba472caa1b78 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=9dcc5acebe7742d69710d72b87c4744a, user_id=afec73c7d52145c6b2ae7935f36dc95e)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:44.974370 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f611d-cafd-4073-8e6e-ba472caa1b78 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:44.991833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-061f611d-cafd-4073-8e6e-ba472caa1b78 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'afec73c7d52145c6b2ae7935f36dc95e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:45.020657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31f230-ee4a-4729-b61a-d873dc6c1671 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:45.021513 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2453/4900] 10.222.0.30 () {58 vars in 1344 bytes} [Sun Sep 4 01:20:44 2022] DELETE /identity/v3/groups/9dcc5acebe7742d69710d72b87c4744a/users/afec73c7d52145c6b2ae7935f36dc95e => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:20:45.022628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6d31f230-ee4a-4729-b61a-d873dc6c1671 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:45.072068 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31f230-ee4a-4729-b61a-d873dc6c1671 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:45.220581 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb6049-2ae6-4cb8-84cd-e54c606f878f tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:45.223505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb6049-2ae6-4cb8-84cd-e54c606f878f tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:45.223981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb6049-2ae6-4cb8-84cd-e54c606f878f tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:45.224459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb6049-2ae6-4cb8-84cd-e54c606f878f tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/system/groups/9dcc5acebe7742d69710d72b87c4744a/roles/c6104e77f1104fadac1ee071661d7100` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:45.226548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb6049-2ae6-4cb8-84cd-e54c606f878f tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=9dcc5acebe7742d69710d72b87c4744a, role_id=c6104e77f1104fadac1ee071661d7100)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:45.234619 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-55eb6049-2ae6-4cb8-84cd-e54c606f878f tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:45.234619 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:20:45.234619 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:20:45.236840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb6049-2ae6-4cb8-84cd-e54c606f878f tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:45.261995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f611d-cafd-4073-8e6e-ba472caa1b78 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:45.263096 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2448/4901] 10.222.0.30 () {60 vars in 1381 bytes} [Sun Sep 4 01:20:45 2022] PUT /identity/v3/system/groups/9dcc5acebe7742d69710d72b87c4744a/roles/c6104e77f1104fadac1ee071661d7100 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:45.283402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f611d-cafd-4073-8e6e-ba472caa1b78 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:45.298295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18199e-7f0f-4a49-b2ee-c5c3b88dc3af tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:45.298972 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18199e-7f0f-4a49-b2ee-c5c3b88dc3af tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:45.299250 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18199e-7f0f-4a49-b2ee-c5c3b88dc3af tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:45.299522 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18199e-7f0f-4a49-b2ee-c5c3b88dc3af tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/system/groups/9dcc5acebe7742d69710d72b87c4744a/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:45.300779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18199e-7f0f-4a49-b2ee-c5c3b88dc3af tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=9dcc5acebe7742d69710d72b87c4744a)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:45.301838 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-1a18199e-7f0f-4a49-b2ee-c5c3b88dc3af tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:45.301838 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:20:45.301838 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:20:45.302728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18199e-7f0f-4a49-b2ee-c5c3b88dc3af tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:45.319234 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:45.328990 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2454/4902] 10.222.0.30 () {58 vars in 1263 bytes} [Sun Sep 4 01:20:45 2022] GET /identity/v3/system/groups/9dcc5acebe7742d69710d72b87c4744a/roles => generated 376 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:20:45.332531 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb6049-2ae6-4cb8-84cd-e54c606f878f tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:45.347627 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb6049-2ae6-4cb8-84cd-e54c606f878f tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:45.352765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e47e8-74ac-457c-bf33-54ae2896d5e3 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:45.354226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e47e8-74ac-457c-bf33-54ae2896d5e3 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:45.354511 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e47e8-74ac-457c-bf33-54ae2896d5e3 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:45.355311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e47e8-74ac-457c-bf33-54ae2896d5e3 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/system/groups/9dcc5acebe7742d69710d72b87c4744a/roles/c6104e77f1104fadac1ee071661d7100` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:45.357335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e47e8-74ac-457c-bf33-54ae2896d5e3 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=9dcc5acebe7742d69710d72b87c4744a, role_id=c6104e77f1104fadac1ee071661d7100)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:45.358865 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-535e47e8-74ac-457c-bf33-54ae2896d5e3 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:45.358865 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:20:45.358865 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:20:45.359769 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e47e8-74ac-457c-bf33-54ae2896d5e3 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:45.373189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18199e-7f0f-4a49-b2ee-c5c3b88dc3af tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:45.391242 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2449/4903] 10.222.0.30 () {58 vars in 1363 bytes} [Sun Sep 4 01:20:45 2022] HEAD /identity/v3/system/groups/9dcc5acebe7742d69710d72b87c4744a/roles/c6104e77f1104fadac1ee071661d7100 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:45.391996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18199e-7f0f-4a49-b2ee-c5c3b88dc3af tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:45.404895 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc479d-5199-4f85-b61f-d7d77c742402 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:45.405805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc479d-5199-4f85-b61f-d7d77c742402 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:45.406154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc479d-5199-4f85-b61f-d7d77c742402 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:45.406496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc479d-5199-4f85-b61f-d7d77c742402 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/system/groups/9dcc5acebe7742d69710d72b87c4744a/roles/c6104e77f1104fadac1ee071661d7100` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:45.409227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc479d-5199-4f85-b61f-d7d77c742402 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=9dcc5acebe7742d69710d72b87c4744a, role_id=c6104e77f1104fadac1ee071661d7100)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:45.419777 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-8ccc479d-5199-4f85-b61f-d7d77c742402 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:45.419777 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:20:45.419777 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:20:45.421101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc479d-5199-4f85-b61f-d7d77c742402 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:45.458251 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2455/4904] 10.222.0.30 () {58 vars in 1365 bytes} [Sun Sep 4 01:20:45 2022] DELETE /identity/v3/system/groups/9dcc5acebe7742d69710d72b87c4744a/roles/c6104e77f1104fadac1ee071661d7100 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:45.464932 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e47e8-74ac-457c-bf33-54ae2896d5e3 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:45.479123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e47e8-74ac-457c-bf33-54ae2896d5e3 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:45.486969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67b2a5-f459-492a-8214-2afa0ae1349a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:45.487711 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67b2a5-f459-492a-8214-2afa0ae1349a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:45.487999 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67b2a5-f459-492a-8214-2afa0ae1349a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:45.488616 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67b2a5-f459-492a-8214-2afa0ae1349a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/domains/009614487f63473dbee82cfecdf5effa/users/afec73c7d52145c6b2ae7935f36dc95e/roles/c6104e77f1104fadac1ee071661d7100` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:45.491818 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67b2a5-f459-492a-8214-2afa0ae1349a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=009614487f63473dbee82cfecdf5effa, user_id=afec73c7d52145c6b2ae7935f36dc95e, role_id=c6104e77f1104fadac1ee071661d7100)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:45.495584 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67b2a5-f459-492a-8214-2afa0ae1349a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:45.531422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc479d-5199-4f85-b61f-d7d77c742402 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:45.533741 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2450/4905] 10.222.0.30 () {60 vars in 1480 bytes} [Sun Sep 4 01:20:45 2022] PUT /identity/v3/domains/009614487f63473dbee82cfecdf5effa/users/afec73c7d52145c6b2ae7935f36dc95e/roles/c6104e77f1104fadac1ee071661d7100 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:45.545565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc479d-5199-4f85-b61f-d7d77c742402 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:45.693838 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa869a8-4f53-44ca-b0ba-dc840bb08c06 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:45.694629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa869a8-4f53-44ca-b0ba-dc840bb08c06 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:45.695098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa869a8-4f53-44ca-b0ba-dc840bb08c06 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:45.695466 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa869a8-4f53-44ca-b0ba-dc840bb08c06 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/domains/009614487f63473dbee82cfecdf5effa/users/afec73c7d52145c6b2ae7935f36dc95e/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:45.698406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa869a8-4f53-44ca-b0ba-dc840bb08c06 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=009614487f63473dbee82cfecdf5effa, user_id=afec73c7d52145c6b2ae7935f36dc95e)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:45.701319 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa869a8-4f53-44ca-b0ba-dc840bb08c06 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:45.736604 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2456/4906] 10.222.0.30 () {58 vars in 1362 bytes} [Sun Sep 4 01:20:45 2022] GET /identity/v3/domains/009614487f63473dbee82cfecdf5effa/users/afec73c7d52145c6b2ae7935f36dc95e/roles => generated 409 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:20:45.737911 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67b2a5-f459-492a-8214-2afa0ae1349a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:45.752056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67b2a5-f459-492a-8214-2afa0ae1349a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:45.769178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97847d20-d009-423a-bdfe-78f8d6e2af37 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:45.769896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97847d20-d009-423a-bdfe-78f8d6e2af37 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:45.770180 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97847d20-d009-423a-bdfe-78f8d6e2af37 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:45.770454 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97847d20-d009-423a-bdfe-78f8d6e2af37 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/domains/009614487f63473dbee82cfecdf5effa/users/afec73c7d52145c6b2ae7935f36dc95e/roles/c6104e77f1104fadac1ee071661d7100` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:45.772744 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97847d20-d009-423a-bdfe-78f8d6e2af37 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=009614487f63473dbee82cfecdf5effa, user_id=afec73c7d52145c6b2ae7935f36dc95e, role_id=c6104e77f1104fadac1ee071661d7100)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:45.775723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97847d20-d009-423a-bdfe-78f8d6e2af37 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:45.801220 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2451/4907] 10.222.0.30 () {58 vars in 1462 bytes} [Sun Sep 4 01:20:45 2022] HEAD /identity/v3/domains/009614487f63473dbee82cfecdf5effa/users/afec73c7d52145c6b2ae7935f36dc95e/roles/c6104e77f1104fadac1ee071661d7100 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:45.802580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa869a8-4f53-44ca-b0ba-dc840bb08c06 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:45.821325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa869a8-4f53-44ca-b0ba-dc840bb08c06 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:45.837149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108defac-c6d7-4953-bfd2-39d115be112a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:45.838209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108defac-c6d7-4953-bfd2-39d115be112a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:45.838699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108defac-c6d7-4953-bfd2-39d115be112a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:45.839082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108defac-c6d7-4953-bfd2-39d115be112a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/domains/009614487f63473dbee82cfecdf5effa/users/afec73c7d52145c6b2ae7935f36dc95e/roles/c6104e77f1104fadac1ee071661d7100` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:45.842088 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108defac-c6d7-4953-bfd2-39d115be112a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=009614487f63473dbee82cfecdf5effa, user_id=afec73c7d52145c6b2ae7935f36dc95e, role_id=c6104e77f1104fadac1ee071661d7100)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:45.844862 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108defac-c6d7-4953-bfd2-39d115be112a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:45.861870 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-108defac-c6d7-4953-bfd2-39d115be112a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invalidating the token cache because role c6104e77f1104fadac1ee071661d7100 was removed from user afec73c7d52145c6b2ae7935f36dc95e on domain 009614487f63473dbee82cfecdf5effa. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:45.862199 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-108defac-c6d7-4953-bfd2-39d115be112a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:45.863067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-108defac-c6d7-4953-bfd2-39d115be112a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:45.900212 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2457/4908] 10.222.0.30 () {58 vars in 1464 bytes} [Sun Sep 4 01:20:45 2022] DELETE /identity/v3/domains/009614487f63473dbee82cfecdf5effa/users/afec73c7d52145c6b2ae7935f36dc95e/roles/c6104e77f1104fadac1ee071661d7100 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:45.901528 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97847d20-d009-423a-bdfe-78f8d6e2af37 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:45.903702 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-97847d20-d009-423a-bdfe-78f8d6e2af37 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:45.928297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97847d20-d009-423a-bdfe-78f8d6e2af37 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:45.965411 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:46.042998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5889cf-c48c-4f5c-a821-1d9ce1ce75eb tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:46.043744 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5889cf-c48c-4f5c-a821-1d9ce1ce75eb tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:46.044051 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5889cf-c48c-4f5c-a821-1d9ce1ce75eb tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:46.044234 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5889cf-c48c-4f5c-a821-1d9ce1ce75eb tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/projects/369271e332a447f59cff39b1511717c7/users/afec73c7d52145c6b2ae7935f36dc95e/roles/c6104e77f1104fadac1ee071661d7100` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:46.046526 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5889cf-c48c-4f5c-a821-1d9ce1ce75eb tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:create_grant(project_id=369271e332a447f59cff39b1511717c7, user_id=afec73c7d52145c6b2ae7935f36dc95e, role_id=c6104e77f1104fadac1ee071661d7100)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:46.049209 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5889cf-c48c-4f5c-a821-1d9ce1ce75eb tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:46.086923 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2452/4909] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:20:45 2022] PUT /identity/v3/projects/369271e332a447f59cff39b1511717c7/users/afec73c7d52145c6b2ae7935f36dc95e/roles/c6104e77f1104fadac1ee071661d7100 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:46.091129 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108defac-c6d7-4953-bfd2-39d115be112a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:46.105795 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108defac-c6d7-4953-bfd2-39d115be112a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:46.152944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5889cf-c48c-4f5c-a821-1d9ce1ce75eb tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:46.154963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5c5889cf-c48c-4f5c-a821-1d9ce1ce75eb tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:46.231268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092a74a-5d53-4c21-984e-74a1e6ea444a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:46.232138 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092a74a-5d53-4c21-984e-74a1e6ea444a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:46.232425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092a74a-5d53-4c21-984e-74a1e6ea444a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:46.232703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092a74a-5d53-4c21-984e-74a1e6ea444a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/projects/369271e332a447f59cff39b1511717c7/users/afec73c7d52145c6b2ae7935f36dc95e/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:46.238154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092a74a-5d53-4c21-984e-74a1e6ea444a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:list_grants(project_id=369271e332a447f59cff39b1511717c7, user_id=afec73c7d52145c6b2ae7935f36dc95e)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:46.241557 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092a74a-5d53-4c21-984e-74a1e6ea444a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:46.271427 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2458/4910] 10.222.0.30 () {58 vars in 1365 bytes} [Sun Sep 4 01:20:46 2022] GET /identity/v3/projects/369271e332a447f59cff39b1511717c7/users/afec73c7d52145c6b2ae7935f36dc95e/roles => generated 410 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:20:46.273025 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092a74a-5d53-4c21-984e-74a1e6ea444a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:46.278369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1092a74a-5d53-4c21-984e-74a1e6ea444a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:46.372132 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:46.382679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5889cf-c48c-4f5c-a821-1d9ce1ce75eb tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:46.395025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2342894-bdf8-44cd-b25a-cf7229206fb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:46.395820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2342894-bdf8-44cd-b25a-cf7229206fb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:46.396207 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2342894-bdf8-44cd-b25a-cf7229206fb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:46.396610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2342894-bdf8-44cd-b25a-cf7229206fb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:46.402221 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e2342894-bdf8-44cd-b25a-cf7229206fb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:46.411803 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092a74a-5d53-4c21-984e-74a1e6ea444a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:46.428736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724ac49-d2e8-4555-9865-7446731cdeb2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:46.429693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724ac49-d2e8-4555-9865-7446731cdeb2 service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:46.429999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724ac49-d2e8-4555-9865-7446731cdeb2 service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:46.430273 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724ac49-d2e8-4555-9865-7446731cdeb2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:46.436781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a724ac49-d2e8-4555-9865-7446731cdeb2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:46.445626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2342894-bdf8-44cd-b25a-cf7229206fb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:46.445626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2342894-bdf8-44cd-b25a-cf7229206fb9 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:46.473034 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2453/4911] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:20:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:20:46.474100 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2342894-bdf8-44cd-b25a-cf7229206fb9 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:46.488945 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724ac49-d2e8-4555-9865-7446731cdeb2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:46.491528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724ac49-d2e8-4555-9865-7446731cdeb2 service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:46.504057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2342894-bdf8-44cd-b25a-cf7229206fb9 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:46.515775 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2459/4912] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:20:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:20:46.519231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc9f31-131c-41ab-8f80-48a431d68113 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:46.520043 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc9f31-131c-41ab-8f80-48a431d68113 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:46.520430 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc9f31-131c-41ab-8f80-48a431d68113 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:46.520813 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc9f31-131c-41ab-8f80-48a431d68113 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/projects/369271e332a447f59cff39b1511717c7/users/afec73c7d52145c6b2ae7935f36dc95e/roles/c6104e77f1104fadac1ee071661d7100` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:46.521721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724ac49-d2e8-4555-9865-7446731cdeb2 service placement] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:46.528014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc9f31-131c-41ab-8f80-48a431d68113 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:check_grant(project_id=369271e332a447f59cff39b1511717c7, user_id=afec73c7d52145c6b2ae7935f36dc95e, role_id=c6104e77f1104fadac1ee071661d7100)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:46.530647 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a724ac49-d2e8-4555-9865-7446731cdeb2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:46.533876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc9f31-131c-41ab-8f80-48a431d68113 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:46.552504 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2454/4913] 10.222.0.30 () {58 vars in 1465 bytes} [Sun Sep 4 01:20:46 2022] HEAD /identity/v3/projects/369271e332a447f59cff39b1511717c7/users/afec73c7d52145c6b2ae7935f36dc95e/roles/c6104e77f1104fadac1ee071661d7100 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:46.557067 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc9f31-131c-41ab-8f80-48a431d68113 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:46.559632 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724ac49-d2e8-4555-9865-7446731cdeb2 service placement] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:46.579583 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc9f31-131c-41ab-8f80-48a431d68113 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:46.586325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220e812-fb4e-4dca-bd9c-9515838dd842 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:46.586957 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220e812-fb4e-4dca-bd9c-9515838dd842 service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:46.587237 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220e812-fb4e-4dca-bd9c-9515838dd842 service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:46.587509 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220e812-fb4e-4dca-bd9c-9515838dd842 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:46.594883 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9910ad-df65-4f03-aa0c-553e0b38c99a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:46.595895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9910ad-df65-4f03-aa0c-553e0b38c99a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:46.596274 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9910ad-df65-4f03-aa0c-553e0b38c99a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:46.596674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9910ad-df65-4f03-aa0c-553e0b38c99a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/projects/369271e332a447f59cff39b1511717c7/users/afec73c7d52145c6b2ae7935f36dc95e/roles/c6104e77f1104fadac1ee071661d7100` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:46.602600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3220e812-fb4e-4dca-bd9c-9515838dd842 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:46.602762 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9910ad-df65-4f03-aa0c-553e0b38c99a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=369271e332a447f59cff39b1511717c7, user_id=afec73c7d52145c6b2ae7935f36dc95e, role_id=c6104e77f1104fadac1ee071661d7100)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:46.605726 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9910ad-df65-4f03-aa0c-553e0b38c99a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:46.626489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5e9910ad-df65-4f03-aa0c-553e0b38c99a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invalidating the token cache because role c6104e77f1104fadac1ee071661d7100 was removed from user afec73c7d52145c6b2ae7935f36dc95e on project 369271e332a447f59cff39b1511717c7. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:46.626928 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5e9910ad-df65-4f03-aa0c-553e0b38c99a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:46.627765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5e9910ad-df65-4f03-aa0c-553e0b38c99a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:46.649292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3220e812-fb4e-4dca-bd9c-9515838dd842 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:46.653697 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3220e812-fb4e-4dca-bd9c-9515838dd842 service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:46.658099 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2455/4914] 10.222.0.30 () {58 vars in 1467 bytes} [Sun Sep 4 01:20:46 2022] DELETE /identity/v3/projects/369271e332a447f59cff39b1511717c7/users/afec73c7d52145c6b2ae7935f36dc95e/roles/c6104e77f1104fadac1ee071661d7100 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:20:46.662903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9910ad-df65-4f03-aa0c-553e0b38c99a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:46.665156 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5e9910ad-df65-4f03-aa0c-553e0b38c99a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:46.671839 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2460/4915] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:20:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:20:46.814241 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9910ad-df65-4f03-aa0c-553e0b38c99a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:46.828597 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326289d-2f03-42db-8a53-aabe8d81ed71 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:46.829394 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326289d-2f03-42db-8a53-aabe8d81ed71 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:46.829870 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326289d-2f03-42db-8a53-aabe8d81ed71 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:46.830226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326289d-2f03-42db-8a53-aabe8d81ed71 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/system/users/afec73c7d52145c6b2ae7935f36dc95e/roles/c6104e77f1104fadac1ee071661d7100` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:46.834105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2326289d-2f03-42db-8a53-aabe8d81ed71 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=afec73c7d52145c6b2ae7935f36dc95e, role_id=c6104e77f1104fadac1ee071661d7100)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:46.835250 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-2326289d-2f03-42db-8a53-aabe8d81ed71 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:46.835250 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:20:46.835250 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:20:46.836424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2326289d-2f03-42db-8a53-aabe8d81ed71 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:46.859376 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2456/4916] 10.222.0.30 () {60 vars in 1378 bytes} [Sun Sep 4 01:20:46 2022] PUT /identity/v3/system/users/afec73c7d52145c6b2ae7935f36dc95e/roles/c6104e77f1104fadac1ee071661d7100 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:20:46.860802 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220e812-fb4e-4dca-bd9c-9515838dd842 service placement] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:46.895829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220e812-fb4e-4dca-bd9c-9515838dd842 service placement] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:46.913076 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912469dc-d685-4de4-a3ba-c0284891c6ae tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:46.917157 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912469dc-d685-4de4-a3ba-c0284891c6ae tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:46.919186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912469dc-d685-4de4-a3ba-c0284891c6ae tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:46.919186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912469dc-d685-4de4-a3ba-c0284891c6ae tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/system/users/afec73c7d52145c6b2ae7935f36dc95e/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:46.924450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912469dc-d685-4de4-a3ba-c0284891c6ae tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=afec73c7d52145c6b2ae7935f36dc95e)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:46.928764 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-912469dc-d685-4de4-a3ba-c0284891c6ae tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:46.928764 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:20:46.928764 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:20:46.930865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912469dc-d685-4de4-a3ba-c0284891c6ae tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:46.974218 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2461/4917] 10.222.0.30 () {58 vars in 1260 bytes} [Sun Sep 4 01:20:46 2022] GET /identity/v3/system/users/afec73c7d52145c6b2ae7935f36dc95e/roles => generated 375 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:20:46.978013 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326289d-2f03-42db-8a53-aabe8d81ed71 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:46.992532 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326289d-2f03-42db-8a53-aabe8d81ed71 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:47.014086 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9373a-a1fc-4cbf-8f08-f204ae891961 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:47.020505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9373a-a1fc-4cbf-8f08-f204ae891961 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:47.022763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9373a-a1fc-4cbf-8f08-f204ae891961 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:47.023655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9373a-a1fc-4cbf-8f08-f204ae891961 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/system/users/afec73c7d52145c6b2ae7935f36dc95e/roles/c6104e77f1104fadac1ee071661d7100` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:47.033973 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf9373a-a1fc-4cbf-8f08-f204ae891961 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=afec73c7d52145c6b2ae7935f36dc95e, role_id=c6104e77f1104fadac1ee071661d7100)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:47.040535 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-ccf9373a-a1fc-4cbf-8f08-f204ae891961 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:47.040535 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:20:47.040535 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:20:47.046133 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf9373a-a1fc-4cbf-8f08-f204ae891961 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:47.065944 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2457/4918] 10.222.0.30 () {58 vars in 1360 bytes} [Sun Sep 4 01:20:46 2022] HEAD /identity/v3/system/users/afec73c7d52145c6b2ae7935f36dc95e/roles/c6104e77f1104fadac1ee071661d7100 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:47.069860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912469dc-d685-4de4-a3ba-c0284891c6ae tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:47.085686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912469dc-d685-4de4-a3ba-c0284891c6ae tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:47.098311 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca419ec0-bc84-4589-bcdd-f5c75a67a244 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:47.098955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca419ec0-bc84-4589-bcdd-f5c75a67a244 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:47.099234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca419ec0-bc84-4589-bcdd-f5c75a67a244 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:47.099507 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca419ec0-bc84-4589-bcdd-f5c75a67a244 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/system/users/afec73c7d52145c6b2ae7935f36dc95e/roles/c6104e77f1104fadac1ee071661d7100` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:47.101205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca419ec0-bc84-4589-bcdd-f5c75a67a244 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=afec73c7d52145c6b2ae7935f36dc95e, role_id=c6104e77f1104fadac1ee071661d7100)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:47.102480 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-ca419ec0-bc84-4589-bcdd-f5c75a67a244 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:47.102480 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:20:47.102480 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:20:47.103402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca419ec0-bc84-4589-bcdd-f5c75a67a244 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:47.119186 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2462/4919] 10.222.0.30 () {58 vars in 1362 bytes} [Sun Sep 4 01:20:47 2022] DELETE /identity/v3/system/users/afec73c7d52145c6b2ae7935f36dc95e/roles/c6104e77f1104fadac1ee071661d7100 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:47.124145 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9373a-a1fc-4cbf-8f08-f204ae891961 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:47.137150 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9373a-a1fc-4cbf-8f08-f204ae891961 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:47.149944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fccaf-ff93-4d8b-892d-5e233a15b6b4 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:47.151345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fccaf-ff93-4d8b-892d-5e233a15b6b4 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:47.151739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fccaf-ff93-4d8b-892d-5e233a15b6b4 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:47.152032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fccaf-ff93-4d8b-892d-5e233a15b6b4 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:47.152717 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62fccaf-ff93-4d8b-892d-5e233a15b6b4 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:47.157731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62fccaf-ff93-4d8b-892d-5e233a15b6b4 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:47.198944 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2458/4920] 10.222.0.30 () {60 vars in 1143 bytes} [Sun Sep 4 01:20:47 2022] POST /identity/v3/roles => generated 269 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:47.203061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca419ec0-bc84-4589-bcdd-f5c75a67a244 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:47.218162 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca419ec0-bc84-4589-bcdd-f5c75a67a244 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:47.244611 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd8b9a-3c59-4312-ae15-8ee1bc42bfe9 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:47.245710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd8b9a-3c59-4312-ae15-8ee1bc42bfe9 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:47.245998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd8b9a-3c59-4312-ae15-8ee1bc42bfe9 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:47.246274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd8b9a-3c59-4312-ae15-8ee1bc42bfe9 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:47.246969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd8b9a-3c59-4312-ae15-8ee1bc42bfe9 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:47.248582 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd8b9a-3c59-4312-ae15-8ee1bc42bfe9 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:47.294170 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2463/4921] 10.222.0.30 () {60 vars in 1143 bytes} [Sun Sep 4 01:20:47 2022] POST /identity/v3/roles => generated 270 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:47.295045 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fccaf-ff93-4d8b-892d-5e233a15b6b4 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:47.305719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fccaf-ff93-4d8b-892d-5e233a15b6b4 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:47.323094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec600253-d5f0-4421-93fe-db7360c09aa3 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:47.323770 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec600253-d5f0-4421-93fe-db7360c09aa3 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:47.324059 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec600253-d5f0-4421-93fe-db7360c09aa3 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:47.324322 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec600253-d5f0-4421-93fe-db7360c09aa3 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/3995c73b71fe486cb1dd76ea2eadfa10/implies/9de369fa00d949ce9c35dbd2cf7b4f4a` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:47.335982 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec600253-d5f0-4421-93fe-db7360c09aa3 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=3995c73b71fe486cb1dd76ea2eadfa10, implied_role_id=9de369fa00d949ce9c35dbd2cf7b4f4a)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:47.341271 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec600253-d5f0-4421-93fe-db7360c09aa3 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:47.345740 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:47.415236 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd8b9a-3c59-4312-ae15-8ee1bc42bfe9 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:47.427453 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2459/4922] 10.222.0.30 () {60 vars in 1363 bytes} [Sun Sep 4 01:20:47 2022] PUT /identity/v3/roles/3995c73b71fe486cb1dd76ea2eadfa10/implies/9de369fa00d949ce9c35dbd2cf7b4f4a => generated 530 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:20:47.432971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd8b9a-3c59-4312-ae15-8ee1bc42bfe9 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:47.681407 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac031699-bbf9-4f67-819f-ba3fd9dffe98 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:47.686249 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac031699-bbf9-4f67-819f-ba3fd9dffe98 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:47.686832 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac031699-bbf9-4f67-819f-ba3fd9dffe98 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:47.690437 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac031699-bbf9-4f67-819f-ba3fd9dffe98 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:47.693493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac031699-bbf9-4f67-819f-ba3fd9dffe98 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:47.701467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac031699-bbf9-4f67-819f-ba3fd9dffe98 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:47.763027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec600253-d5f0-4421-93fe-db7360c09aa3 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:47.769156 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2464/4923] 10.222.0.30 () {60 vars in 1149 bytes} [Sun Sep 4 01:20:47 2022] POST /identity/v3/domains => generated 275 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:47.780085 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec600253-d5f0-4421-93fe-db7360c09aa3 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:47.884000 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24d6ea-0b5e-49f9-8713-a5f1c54fa61d tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:47.885606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24d6ea-0b5e-49f9-8713-a5f1c54fa61d tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:47.886171 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24d6ea-0b5e-49f9-8713-a5f1c54fa61d tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:47.886558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24d6ea-0b5e-49f9-8713-a5f1c54fa61d tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:47.887836 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af24d6ea-0b5e-49f9-8713-a5f1c54fa61d tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:47.890201 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af24d6ea-0b5e-49f9-8713-a5f1c54fa61d tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:47.916398 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2460/4924] 10.222.0.30 () {60 vars in 1143 bytes} [Sun Sep 4 01:20:47 2022] POST /identity/v3/roles => generated 270 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:20:47.921223 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac031699-bbf9-4f67-819f-ba3fd9dffe98 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:47.944722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac031699-bbf9-4f67-819f-ba3fd9dffe98 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:47.951831 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b6b00-1689-4dec-a4b3-2898b839e35b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:47.954528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b6b00-1689-4dec-a4b3-2898b839e35b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:47.954933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b6b00-1689-4dec-a4b3-2898b839e35b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:47.956016 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b6b00-1689-4dec-a4b3-2898b839e35b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/3995c73b71fe486cb1dd76ea2eadfa10/implies/a9143475c88a469bb0d74d2a016df2b5` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:47.960233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b6b00-1689-4dec-a4b3-2898b839e35b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=3995c73b71fe486cb1dd76ea2eadfa10, implied_role_id=a9143475c88a469bb0d74d2a016df2b5)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:47.961885 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-bd0b6b00-1689-4dec-a4b3-2898b839e35b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:47.961885 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:20:47.961885 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:20:47.964352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b6b00-1689-4dec-a4b3-2898b839e35b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:48.042175 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24d6ea-0b5e-49f9-8713-a5f1c54fa61d tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:48.044024 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2465/4925] 10.222.0.30 () {60 vars in 1363 bytes} [Sun Sep 4 01:20:47 2022] PUT /identity/v3/roles/3995c73b71fe486cb1dd76ea2eadfa10/implies/a9143475c88a469bb0d74d2a016df2b5 => generated 530 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:48.067921 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24d6ea-0b5e-49f9-8713-a5f1c54fa61d tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:48.175183 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2279d28-3762-402c-82ad-44455b6638b0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:48.176320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2279d28-3762-402c-82ad-44455b6638b0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:48.176749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2279d28-3762-402c-82ad-44455b6638b0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:48.176871 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2279d28-3762-402c-82ad-44455b6638b0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/3995c73b71fe486cb1dd76ea2eadfa10/implies/c6104e77f1104fadac1ee071661d7100` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:48.178899 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2279d28-3762-402c-82ad-44455b6638b0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=3995c73b71fe486cb1dd76ea2eadfa10, implied_role_id=c6104e77f1104fadac1ee071661d7100)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:48.181454 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2279d28-3762-402c-82ad-44455b6638b0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:48.224994 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2461/4926] 10.222.0.30 () {60 vars in 1363 bytes} [Sun Sep 4 01:20:48 2022] PUT /identity/v3/roles/3995c73b71fe486cb1dd76ea2eadfa10/implies/c6104e77f1104fadac1ee071661d7100 => generated 525 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:20:48.229817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b6b00-1689-4dec-a4b3-2898b839e35b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:48.248555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b6b00-1689-4dec-a4b3-2898b839e35b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:48.372108 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:48.390476 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27988ee4-d6fc-4d07-84c1-429712f4710a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:48.405410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27988ee4-d6fc-4d07-84c1-429712f4710a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:48.406056 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27988ee4-d6fc-4d07-84c1-429712f4710a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:48.406775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27988ee4-d6fc-4d07-84c1-429712f4710a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/c6104e77f1104fadac1ee071661d7100/implies/3995c73b71fe486cb1dd76ea2eadfa10` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:48.414316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27988ee4-d6fc-4d07-84c1-429712f4710a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c6104e77f1104fadac1ee071661d7100, implied_role_id=3995c73b71fe486cb1dd76ea2eadfa10)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:48.417071 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27988ee4-d6fc-4d07-84c1-429712f4710a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:48.477821 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-27988ee4-d6fc-4d07-84c1-429712f4710a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] 3995c73b71fe486cb1dd76ea2eadfa10 cannot be an implied roles.: keystone.exception.InvalidImpliedRole: 3995c73b71fe486cb1dd76ea2eadfa10 cannot be an implied roles. Sep 04 01:20:48.477821 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:20:48.477821 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:20:48.477821 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:20:48.477821 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:20:48.477821 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:20:48.477821 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:20:48.477821 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:20:48.477821 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:20:48.477821 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:20:48.477821 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:20:48.477821 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:20:48.477821 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Sep 04 01:20:48.477821 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Sep 04 01:20:48.478934 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:20:48.478934 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:20:48.478934 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Sep 04 01:20:48.478934 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Sep 04 01:20:48.478934 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: 3995c73b71fe486cb1dd76ea2eadfa10 cannot be an implied roles. Sep 04 01:20:48.478934 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:20:48.505099 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2279d28-3762-402c-82ad-44455b6638b0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:48.514466 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2466/4927] 10.222.0.30 () {60 vars in 1363 bytes} [Sun Sep 4 01:20:48 2022] PUT /identity/v3/roles/c6104e77f1104fadac1ee071661d7100/implies/3995c73b71fe486cb1dd76ea2eadfa10 => generated 116 bytes in 286 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Sep 04 01:20:48.529990 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2279d28-3762-402c-82ad-44455b6638b0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:48.546956 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbe8be-dced-4860-bc4e-1f71e656c033 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:48.547943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbe8be-dced-4860-bc4e-1f71e656c033 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:48.552953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbe8be-dced-4860-bc4e-1f71e656c033 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:48.555647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbe8be-dced-4860-bc4e-1f71e656c033 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/3995c73b71fe486cb1dd76ea2eadfa10/implies/c6104e77f1104fadac1ee071661d7100` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:48.558805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddbe8be-dced-4860-bc4e-1f71e656c033 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=3995c73b71fe486cb1dd76ea2eadfa10, implied_role_id=c6104e77f1104fadac1ee071661d7100)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:48.561079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddbe8be-dced-4860-bc4e-1f71e656c033 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:48.586643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27988ee4-d6fc-4d07-84c1-429712f4710a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:48.589198 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2462/4928] 10.222.0.30 () {58 vars in 1347 bytes} [Sun Sep 4 01:20:48 2022] DELETE /identity/v3/roles/3995c73b71fe486cb1dd76ea2eadfa10/implies/c6104e77f1104fadac1ee071661d7100 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:20:48.602107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27988ee4-d6fc-4d07-84c1-429712f4710a tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:48.685126 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7c10a-8e47-4dd6-a70f-2aaa42735246 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:48.685948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7c10a-8e47-4dd6-a70f-2aaa42735246 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:48.686396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7c10a-8e47-4dd6-a70f-2aaa42735246 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:48.686801 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7c10a-8e47-4dd6-a70f-2aaa42735246 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/3995c73b71fe486cb1dd76ea2eadfa10/implies/a9143475c88a469bb0d74d2a016df2b5` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:48.688647 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7c10a-8e47-4dd6-a70f-2aaa42735246 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=3995c73b71fe486cb1dd76ea2eadfa10, implied_role_id=a9143475c88a469bb0d74d2a016df2b5)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:48.689810 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-a7f7c10a-8e47-4dd6-a70f-2aaa42735246 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:48.689810 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:20:48.689810 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:20:48.691008 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7c10a-8e47-4dd6-a70f-2aaa42735246 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:48.719111 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbe8be-dced-4860-bc4e-1f71e656c033 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:48.719866 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2467/4929] 10.222.0.30 () {58 vars in 1347 bytes} [Sun Sep 4 01:20:48 2022] DELETE /identity/v3/roles/3995c73b71fe486cb1dd76ea2eadfa10/implies/a9143475c88a469bb0d74d2a016df2b5 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:48.733581 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbe8be-dced-4860-bc4e-1f71e656c033 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:48.789387 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:48.814275 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba477a81-52ac-4554-becb-f359d5343954 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:48.815253 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba477a81-52ac-4554-becb-f359d5343954 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:48.815983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba477a81-52ac-4554-becb-f359d5343954 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:48.815983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba477a81-52ac-4554-becb-f359d5343954 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/a9143475c88a469bb0d74d2a016df2b5` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:48.818157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba477a81-52ac-4554-becb-f359d5343954 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=a9143475c88a469bb0d74d2a016df2b5)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:48.820316 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba477a81-52ac-4554-becb-f359d5343954 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:48.953567 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ba477a81-52ac-4554-becb-f359d5343954 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invalidating the token cache because role a9143475c88a469bb0d74d2a016df2b5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:48.953567 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ba477a81-52ac-4554-becb-f359d5343954 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:48.955979 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ba477a81-52ac-4554-becb-f359d5343954 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:48.960206 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2463/4930] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:20:48 2022] DELETE /identity/v3/roles/a9143475c88a469bb0d74d2a016df2b5 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:20:48.964769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7c10a-8e47-4dd6-a70f-2aaa42735246 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:48.966539 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a7f7c10a-8e47-4dd6-a70f-2aaa42735246 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:48.981348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7c10a-8e47-4dd6-a70f-2aaa42735246 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:49.128795 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11ded3-df3b-41a4-a25f-3453988dde92 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:49.129987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11ded3-df3b-41a4-a25f-3453988dde92 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:49.130430 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11ded3-df3b-41a4-a25f-3453988dde92 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:49.130860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11ded3-df3b-41a4-a25f-3453988dde92 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/domains/d94934c7016f47629f1fa832cbd93589` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:49.169019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11ded3-df3b-41a4-a25f-3453988dde92 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d94934c7016f47629f1fa832cbd93589)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:49.198581 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11ded3-df3b-41a4-a25f-3453988dde92 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:49.263493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-cc11ded3-df3b-41a4-a25f-3453988dde92 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd94934c7016f47629f1fa832cbd93589'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:49.273997 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-cc11ded3-df3b-41a4-a25f-3453988dde92 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd94934c7016f47629f1fa832cbd93589'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:49.320908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-cc11ded3-df3b-41a4-a25f-3453988dde92 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd94934c7016f47629f1fa832cbd93589'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:49.328396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-cc11ded3-df3b-41a4-a25f-3453988dde92 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd94934c7016f47629f1fa832cbd93589'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:49.342289 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2468/4931] 10.222.0.30 () {60 vars in 1249 bytes} [Sun Sep 4 01:20:48 2022] PATCH /identity/v3/domains/d94934c7016f47629f1fa832cbd93589 => generated 276 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:20:49.345110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba477a81-52ac-4554-becb-f359d5343954 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:49.363197 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba477a81-52ac-4554-becb-f359d5343954 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:49.503739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56463c51-2025-4762-8c08-2867710ffb21 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:49.504577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56463c51-2025-4762-8c08-2867710ffb21 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:49.504970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56463c51-2025-4762-8c08-2867710ffb21 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:49.505710 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56463c51-2025-4762-8c08-2867710ffb21 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/domains/d94934c7016f47629f1fa832cbd93589` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:49.531166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56463c51-2025-4762-8c08-2867710ffb21 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d94934c7016f47629f1fa832cbd93589)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:49.532906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56463c51-2025-4762-8c08-2867710ffb21 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:49.595783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-56463c51-2025-4762-8c08-2867710ffb21 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd94934c7016f47629f1fa832cbd93589'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:49.629170 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-56463c51-2025-4762-8c08-2867710ffb21 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd94934c7016f47629f1fa832cbd93589'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:49.697014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-56463c51-2025-4762-8c08-2867710ffb21 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd94934c7016f47629f1fa832cbd93589', 'request_id': 'req-56463c51-2025-4762-8c08-2867710ffb21'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:49.713320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-56463c51-2025-4762-8c08-2867710ffb21 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd94934c7016f47629f1fa832cbd93589', 'request_id': 'req-56463c51-2025-4762-8c08-2867710ffb21'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:49.720704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-56463c51-2025-4762-8c08-2867710ffb21 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd94934c7016f47629f1fa832cbd93589', 'request_id': 'req-56463c51-2025-4762-8c08-2867710ffb21'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:49.736189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-56463c51-2025-4762-8c08-2867710ffb21 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] The token cache is being invalidate because project d94934c7016f47629f1fa832cbd93589 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:49.736656 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-56463c51-2025-4762-8c08-2867710ffb21 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:49.737473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-56463c51-2025-4762-8c08-2867710ffb21 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:49.745820 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:49.748650 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-56463c51-2025-4762-8c08-2867710ffb21 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd94934c7016f47629f1fa832cbd93589', 'request_id': 'req-56463c51-2025-4762-8c08-2867710ffb21'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:49.749680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-56463c51-2025-4762-8c08-2867710ffb21 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd94934c7016f47629f1fa832cbd93589', 'request_id': 'req-56463c51-2025-4762-8c08-2867710ffb21'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:49.761863 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-56463c51-2025-4762-8c08-2867710ffb21 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd94934c7016f47629f1fa832cbd93589', 'request_id': 'req-56463c51-2025-4762-8c08-2867710ffb21'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:49.761863 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2464/4932] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:20:49 2022] DELETE /identity/v3/domains/d94934c7016f47629f1fa832cbd93589 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:49.765109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11ded3-df3b-41a4-a25f-3453988dde92 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:49.783408 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-cc11ded3-df3b-41a4-a25f-3453988dde92 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:49.814311 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11ded3-df3b-41a4-a25f-3453988dde92 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:49.876027 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:49.930240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661b536-b275-4aae-86fa-663c9301362b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:49.930869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661b536-b275-4aae-86fa-663c9301362b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:49.931297 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661b536-b275-4aae-86fa-663c9301362b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:49.931581 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661b536-b275-4aae-86fa-663c9301362b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/3995c73b71fe486cb1dd76ea2eadfa10/implies/9de369fa00d949ce9c35dbd2cf7b4f4a` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:49.933835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661b536-b275-4aae-86fa-663c9301362b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=3995c73b71fe486cb1dd76ea2eadfa10, implied_role_id=9de369fa00d949ce9c35dbd2cf7b4f4a)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:49.935531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661b536-b275-4aae-86fa-663c9301362b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:49.952610 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2469/4933] 10.222.0.30 () {58 vars in 1347 bytes} [Sun Sep 4 01:20:49 2022] DELETE /identity/v3/roles/3995c73b71fe486cb1dd76ea2eadfa10/implies/9de369fa00d949ce9c35dbd2cf7b4f4a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:49.956122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56463c51-2025-4762-8c08-2867710ffb21 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:49.958402 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-56463c51-2025-4762-8c08-2867710ffb21 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:49.979243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56463c51-2025-4762-8c08-2867710ffb21 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:50.085767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcef1dc-943c-4998-8a03-bc943ebf5ce5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:50.086587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcef1dc-943c-4998-8a03-bc943ebf5ce5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:50.088120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcef1dc-943c-4998-8a03-bc943ebf5ce5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:50.088991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcef1dc-943c-4998-8a03-bc943ebf5ce5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/9de369fa00d949ce9c35dbd2cf7b4f4a` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:50.090559 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcef1dc-943c-4998-8a03-bc943ebf5ce5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=9de369fa00d949ce9c35dbd2cf7b4f4a)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:50.092502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcef1dc-943c-4998-8a03-bc943ebf5ce5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:50.157531 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ebcef1dc-943c-4998-8a03-bc943ebf5ce5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invalidating the token cache because role 9de369fa00d949ce9c35dbd2cf7b4f4a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:50.157911 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ebcef1dc-943c-4998-8a03-bc943ebf5ce5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:50.163693 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ebcef1dc-943c-4998-8a03-bc943ebf5ce5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:50.169340 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2465/4934] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:20:49 2022] DELETE /identity/v3/roles/9de369fa00d949ce9c35dbd2cf7b4f4a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:50.171393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661b536-b275-4aae-86fa-663c9301362b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:50.173475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9661b536-b275-4aae-86fa-663c9301362b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:50.195486 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661b536-b275-4aae-86fa-663c9301362b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:50.309890 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc27e1-6bc9-40e1-96da-db16952aa095 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:50.311547 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc27e1-6bc9-40e1-96da-db16952aa095 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:50.312069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc27e1-6bc9-40e1-96da-db16952aa095 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:50.312524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc27e1-6bc9-40e1-96da-db16952aa095 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/3995c73b71fe486cb1dd76ea2eadfa10` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:50.314070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc27e1-6bc9-40e1-96da-db16952aa095 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=3995c73b71fe486cb1dd76ea2eadfa10)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:50.315431 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-73bc27e1-6bc9-40e1-96da-db16952aa095 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:50.315431 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:20:50.315431 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:20:50.317638 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc27e1-6bc9-40e1-96da-db16952aa095 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:50.385955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-73bc27e1-6bc9-40e1-96da-db16952aa095 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invalidating the token cache because role 3995c73b71fe486cb1dd76ea2eadfa10 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:50.386440 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-73bc27e1-6bc9-40e1-96da-db16952aa095 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:50.387454 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-73bc27e1-6bc9-40e1-96da-db16952aa095 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:50.390285 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2470/4935] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:20:50 2022] DELETE /identity/v3/roles/3995c73b71fe486cb1dd76ea2eadfa10 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:20:50.396231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcef1dc-943c-4998-8a03-bc943ebf5ce5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:50.411166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcef1dc-943c-4998-8a03-bc943ebf5ce5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:50.495057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c611f-b550-47b2-9c1b-70e639e0cd56 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:50.496912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c611f-b550-47b2-9c1b-70e639e0cd56 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:50.497201 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c611f-b550-47b2-9c1b-70e639e0cd56 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:50.497509 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c611f-b550-47b2-9c1b-70e639e0cd56 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/f67996c7900c4b618a2efaf0031e5939/implies/141866535f78410bb51eb40dd91ed1b6` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:50.499724 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c611f-b550-47b2-9c1b-70e639e0cd56 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=f67996c7900c4b618a2efaf0031e5939, implied_role_id=141866535f78410bb51eb40dd91ed1b6)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:50.501656 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c611f-b550-47b2-9c1b-70e639e0cd56 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:50.541401 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2466/4936] 10.222.0.30 () {60 vars in 1363 bytes} [Sun Sep 4 01:20:50 2022] PUT /identity/v3/roles/f67996c7900c4b618a2efaf0031e5939/implies/141866535f78410bb51eb40dd91ed1b6 => generated 521 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:50.545228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc27e1-6bc9-40e1-96da-db16952aa095 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:50.546835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-73bc27e1-6bc9-40e1-96da-db16952aa095 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:50.566908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc27e1-6bc9-40e1-96da-db16952aa095 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:50.657155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a16c0f-b21c-4995-951b-1b9e5b5ec7b0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:50.658036 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a16c0f-b21c-4995-951b-1b9e5b5ec7b0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:50.658317 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a16c0f-b21c-4995-951b-1b9e5b5ec7b0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:50.658592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a16c0f-b21c-4995-951b-1b9e5b5ec7b0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/f67996c7900c4b618a2efaf0031e5939/implies/141866535f78410bb51eb40dd91ed1b6` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:50.660399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a16c0f-b21c-4995-951b-1b9e5b5ec7b0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=f67996c7900c4b618a2efaf0031e5939, implied_role_id=141866535f78410bb51eb40dd91ed1b6)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:50.661485 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-d9a16c0f-b21c-4995-951b-1b9e5b5ec7b0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:50.661485 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:20:50.661485 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:20:50.662754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a16c0f-b21c-4995-951b-1b9e5b5ec7b0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:50.663653 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a16c0f-b21c-4995-951b-1b9e5b5ec7b0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=f67996c7900c4b618a2efaf0031e5939, implied_role_id=141866535f78410bb51eb40dd91ed1b6)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:50.664532 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-d9a16c0f-b21c-4995-951b-1b9e5b5ec7b0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:50.664532 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:20:50.664532 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:20:50.666145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a16c0f-b21c-4995-951b-1b9e5b5ec7b0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:50.672603 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2471/4937] 10.222.0.30 () {58 vars in 1345 bytes} [Sun Sep 4 01:20:50 2022] HEAD /identity/v3/roles/f67996c7900c4b618a2efaf0031e5939/implies/141866535f78410bb51eb40dd91ed1b6 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:50.676920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c611f-b550-47b2-9c1b-70e639e0cd56 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:50.709077 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c611f-b550-47b2-9c1b-70e639e0cd56 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:50.716311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21057aff-3251-4e7b-bb5f-4cdf00819d19 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:50.717668 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21057aff-3251-4e7b-bb5f-4cdf00819d19 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:50.718427 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21057aff-3251-4e7b-bb5f-4cdf00819d19 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:50.719149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21057aff-3251-4e7b-bb5f-4cdf00819d19 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/f67996c7900c4b618a2efaf0031e5939/implies/141866535f78410bb51eb40dd91ed1b6` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:50.721621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21057aff-3251-4e7b-bb5f-4cdf00819d19 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=f67996c7900c4b618a2efaf0031e5939, implied_role_id=141866535f78410bb51eb40dd91ed1b6)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:50.722887 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-21057aff-3251-4e7b-bb5f-4cdf00819d19 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:50.722887 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:20:50.722887 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:20:50.724054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21057aff-3251-4e7b-bb5f-4cdf00819d19 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:50.731191 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2467/4938] 10.222.0.30 () {58 vars in 1344 bytes} [Sun Sep 4 01:20:50 2022] GET /identity/v3/roles/f67996c7900c4b618a2efaf0031e5939/implies/141866535f78410bb51eb40dd91ed1b6 => generated 521 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:20:50.735538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a16c0f-b21c-4995-951b-1b9e5b5ec7b0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:50.749840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a16c0f-b21c-4995-951b-1b9e5b5ec7b0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:50.761344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4215094-3ca5-4831-8f2a-e37aaf0a22fa tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:50.761344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4215094-3ca5-4831-8f2a-e37aaf0a22fa tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:50.761344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4215094-3ca5-4831-8f2a-e37aaf0a22fa tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:50.761890 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4215094-3ca5-4831-8f2a-e37aaf0a22fa tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/f67996c7900c4b618a2efaf0031e5939/implies/141866535f78410bb51eb40dd91ed1b6` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:50.763757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4215094-3ca5-4831-8f2a-e37aaf0a22fa tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=f67996c7900c4b618a2efaf0031e5939, implied_role_id=141866535f78410bb51eb40dd91ed1b6)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:50.766140 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4215094-3ca5-4831-8f2a-e37aaf0a22fa tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:50.781490 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2472/4939] 10.222.0.30 () {58 vars in 1347 bytes} [Sun Sep 4 01:20:50 2022] DELETE /identity/v3/roles/f67996c7900c4b618a2efaf0031e5939/implies/141866535f78410bb51eb40dd91ed1b6 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:20:50.784612 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21057aff-3251-4e7b-bb5f-4cdf00819d19 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:50.802676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21057aff-3251-4e7b-bb5f-4cdf00819d19 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:50.835531 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:50.878344 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c479a-02b6-4d6d-8a96-7f599e5f1e21 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:50.878344 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c479a-02b6-4d6d-8a96-7f599e5f1e21 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:50.878344 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c479a-02b6-4d6d-8a96-7f599e5f1e21 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:50.878702 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c479a-02b6-4d6d-8a96-7f599e5f1e21 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/f67996c7900c4b618a2efaf0031e5939/implies/141866535f78410bb51eb40dd91ed1b6` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:50.880117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c479a-02b6-4d6d-8a96-7f599e5f1e21 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=f67996c7900c4b618a2efaf0031e5939, implied_role_id=141866535f78410bb51eb40dd91ed1b6)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:50.881675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c479a-02b6-4d6d-8a96-7f599e5f1e21 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:50.894203 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-8c2c479a-02b6-4d6d-8a96-7f599e5f1e21 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] f67996c7900c4b618a2efaf0031e5939 does not imply 141866535f78410bb51eb40dd91ed1b6.: keystone.exception.ImpliedRoleNotFound: f67996c7900c4b618a2efaf0031e5939 does not imply 141866535f78410bb51eb40dd91ed1b6. Sep 04 01:20:50.894203 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:20:50.894203 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Sep 04 01:20:50.894203 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = query.one() Sep 04 01:20:50.894203 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Sep 04 01:20:50.894203 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._iter().one() Sep 04 01:20:50.894203 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Sep 04 01:20:50.894203 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._only_one_row( Sep 04 01:20:50.894203 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Sep 04 01:20:50.894203 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exc.NoResultFound( Sep 04 01:20:50.894203 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Sep 04 01:20:50.894203 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:20:50.894203 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:20:50.894203 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:20:50.894203 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:20:50.894203 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:20:50.895609 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:20:50.895609 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:20:50.895609 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:20:50.895609 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:20:50.895609 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:20:50.895609 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:20:50.895609 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:20:50.895609 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:20:50.895609 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:20:50.895609 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Sep 04 01:20:50.895609 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Sep 04 01:20:50.895609 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Sep 04 01:20:50.895609 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Sep 04 01:20:50.895609 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Sep 04 01:20:50.895609 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Sep 04 01:20:50.895609 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Sep 04 01:20:50.896672 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Sep 04 01:20:50.896672 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: f67996c7900c4b618a2efaf0031e5939 does not imply 141866535f78410bb51eb40dd91ed1b6. Sep 04 01:20:50.896672 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:20:50.896672 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2468/4940] 10.222.0.30 () {58 vars in 1344 bytes} [Sun Sep 4 01:20:50 2022] GET /identity/v3/roles/f67996c7900c4b618a2efaf0031e5939/implies/141866535f78410bb51eb40dd91ed1b6 => generated 137 bytes in 112 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:20:50.901124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4215094-3ca5-4831-8f2a-e37aaf0a22fa tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:50.914626 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4215094-3ca5-4831-8f2a-e37aaf0a22fa tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:50.921538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5458c4-40d1-4999-a40d-182ee2b34969 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:50.922623 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5458c4-40d1-4999-a40d-182ee2b34969 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:50.923428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5458c4-40d1-4999-a40d-182ee2b34969 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:50.923428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5458c4-40d1-4999-a40d-182ee2b34969 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/f67996c7900c4b618a2efaf0031e5939/implies/141866535f78410bb51eb40dd91ed1b6` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:50.925393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5458c4-40d1-4999-a40d-182ee2b34969 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=f67996c7900c4b618a2efaf0031e5939, implied_role_id=141866535f78410bb51eb40dd91ed1b6)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:50.927185 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5458c4-40d1-4999-a40d-182ee2b34969 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:50.932983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c479a-02b6-4d6d-8a96-7f599e5f1e21 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:50.934810 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8c2c479a-02b6-4d6d-8a96-7f599e5f1e21 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:50.939584 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-cb5458c4-40d1-4999-a40d-182ee2b34969 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] f67996c7900c4b618a2efaf0031e5939 does not imply 141866535f78410bb51eb40dd91ed1b6.: keystone.exception.ImpliedRoleNotFound: f67996c7900c4b618a2efaf0031e5939 does not imply 141866535f78410bb51eb40dd91ed1b6. Sep 04 01:20:50.939584 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:20:50.939584 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Sep 04 01:20:50.939584 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = query.one() Sep 04 01:20:50.939584 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Sep 04 01:20:50.939584 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._iter().one() Sep 04 01:20:50.939584 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Sep 04 01:20:50.939584 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._only_one_row( Sep 04 01:20:50.939584 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Sep 04 01:20:50.939584 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exc.NoResultFound( Sep 04 01:20:50.939584 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Sep 04 01:20:50.939584 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:20:50.939584 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:20:50.939584 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:20:50.939584 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:20:50.939584 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:20:50.940811 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:20:50.940811 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:20:50.940811 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:20:50.940811 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:20:50.940811 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:20:50.940811 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:20:50.940811 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:20:50.940811 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:20:50.940811 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:20:50.940811 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Sep 04 01:20:50.940811 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Sep 04 01:20:50.940811 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:20:50.940811 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:20:50.940811 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Sep 04 01:20:50.940811 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Sep 04 01:20:50.940811 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Sep 04 01:20:50.941975 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Sep 04 01:20:50.941975 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Sep 04 01:20:50.941975 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Sep 04 01:20:50.941975 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: f67996c7900c4b618a2efaf0031e5939 does not imply 141866535f78410bb51eb40dd91ed1b6. Sep 04 01:20:50.941975 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:20:50.950670 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2473/4941] 10.222.0.30 () {58 vars in 1347 bytes} [Sun Sep 4 01:20:50 2022] DELETE /identity/v3/roles/f67996c7900c4b618a2efaf0031e5939/implies/141866535f78410bb51eb40dd91ed1b6 => generated 137 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:20:50.951723 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5458c4-40d1-4999-a40d-182ee2b34969 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:50.963605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5458c4-40d1-4999-a40d-182ee2b34969 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:50.979922 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624fd5ef-956c-4c35-899e-47930ffff0e4 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:50.990405 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fd5ef-956c-4c35-899e-47930ffff0e4 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:50.990873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fd5ef-956c-4c35-899e-47930ffff0e4 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:50.992467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fd5ef-956c-4c35-899e-47930ffff0e4 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/f67996c7900c4b618a2efaf0031e5939/implies/141866535f78410bb51eb40dd91ed1b6` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:50.997237 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624fd5ef-956c-4c35-899e-47930ffff0e4 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=f67996c7900c4b618a2efaf0031e5939, implied_role_id=141866535f78410bb51eb40dd91ed1b6)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:51.000587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624fd5ef-956c-4c35-899e-47930ffff0e4 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:51.019705 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:51.057004 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2474/4942] 10.222.0.30 () {60 vars in 1363 bytes} [Sun Sep 4 01:20:50 2022] PUT /identity/v3/roles/f67996c7900c4b618a2efaf0031e5939/implies/141866535f78410bb51eb40dd91ed1b6 => generated 521 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:51.062006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624fd5ef-956c-4c35-899e-47930ffff0e4 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:51.077322 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c479a-02b6-4d6d-8a96-7f599e5f1e21 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:51.160633 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b129fc-f4b3-4e5b-b43d-00907be0f74b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:51.161415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b129fc-f4b3-4e5b-b43d-00907be0f74b service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:51.163178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b129fc-f4b3-4e5b-b43d-00907be0f74b service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:51.163568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b129fc-f4b3-4e5b-b43d-00907be0f74b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:51.166298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e2b129fc-f4b3-4e5b-b43d-00907be0f74b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:51.167640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624fd5ef-956c-4c35-899e-47930ffff0e4 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:51.175790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f854ea-a1e7-480d-a196-7e36d0f609d0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:51.178654 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f854ea-a1e7-480d-a196-7e36d0f609d0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:51.179634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f854ea-a1e7-480d-a196-7e36d0f609d0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:51.180224 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f854ea-a1e7-480d-a196-7e36d0f609d0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/f67996c7900c4b618a2efaf0031e5939/implies/e93a51f968034bf5b67dd49936898293` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:51.182513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b129fc-f4b3-4e5b-b43d-00907be0f74b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:51.184238 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f854ea-a1e7-480d-a196-7e36d0f609d0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=f67996c7900c4b618a2efaf0031e5939, implied_role_id=e93a51f968034bf5b67dd49936898293)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:51.184594 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b129fc-f4b3-4e5b-b43d-00907be0f74b service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:51.187475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f854ea-a1e7-480d-a196-7e36d0f609d0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:51.201422 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2469/4943] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:20:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:20:51.240897 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2475/4944] 10.222.0.30 () {60 vars in 1363 bytes} [Sun Sep 4 01:20:51 2022] PUT /identity/v3/roles/f67996c7900c4b618a2efaf0031e5939/implies/e93a51f968034bf5b67dd49936898293 => generated 521 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:51.242115 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b129fc-f4b3-4e5b-b43d-00907be0f74b service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:51.256598 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b129fc-f4b3-4e5b-b43d-00907be0f74b service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:51.364646 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99714165-e543-4f32-8954-7b2f112f335d tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:51.366336 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99714165-e543-4f32-8954-7b2f112f335d tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:51.367171 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99714165-e543-4f32-8954-7b2f112f335d tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:51.367454 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99714165-e543-4f32-8954-7b2f112f335d tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/e93a51f968034bf5b67dd49936898293/implies/c6104e77f1104fadac1ee071661d7100` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:51.371838 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99714165-e543-4f32-8954-7b2f112f335d tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e93a51f968034bf5b67dd49936898293, implied_role_id=c6104e77f1104fadac1ee071661d7100)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:51.375878 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99714165-e543-4f32-8954-7b2f112f335d tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:51.430190 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2470/4945] 10.222.0.30 () {60 vars in 1363 bytes} [Sun Sep 4 01:20:51 2022] PUT /identity/v3/roles/e93a51f968034bf5b67dd49936898293/implies/c6104e77f1104fadac1ee071661d7100 => generated 521 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:20:51.434832 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f854ea-a1e7-480d-a196-7e36d0f609d0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:51.453690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f854ea-a1e7-480d-a196-7e36d0f609d0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:51.537187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680f9f9-2390-477a-b77d-221fd7f0ae9e tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:51.538425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680f9f9-2390-477a-b77d-221fd7f0ae9e tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:51.538969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680f9f9-2390-477a-b77d-221fd7f0ae9e tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:51.539465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680f9f9-2390-477a-b77d-221fd7f0ae9e tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:51.540447 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680f9f9-2390-477a-b77d-221fd7f0ae9e tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:51.541804 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-6680f9f9-2390-477a-b77d-221fd7f0ae9e tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:51.541804 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:20:51.541804 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:20:51.543466 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680f9f9-2390-477a-b77d-221fd7f0ae9e tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:51.570249 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2476/4946] 10.222.0.30 () {58 vars in 1152 bytes} [Sun Sep 4 01:20:51 2022] GET /identity/v3/role_inferences => generated 1608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:20:51.570678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99714165-e543-4f32-8954-7b2f112f335d tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:51.582721 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:51.590378 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99714165-e543-4f32-8954-7b2f112f335d tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:51.615180 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d00c3d-ba75-4b31-b9e6-15113bd10a05 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:51.615864 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d00c3d-ba75-4b31-b9e6-15113bd10a05 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:51.616177 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d00c3d-ba75-4b31-b9e6-15113bd10a05 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:51.616462 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d00c3d-ba75-4b31-b9e6-15113bd10a05 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/e93a51f968034bf5b67dd49936898293/implies/c6104e77f1104fadac1ee071661d7100` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:51.631655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d00c3d-ba75-4b31-b9e6-15113bd10a05 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e93a51f968034bf5b67dd49936898293, implied_role_id=c6104e77f1104fadac1ee071661d7100)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:51.633357 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d00c3d-ba75-4b31-b9e6-15113bd10a05 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:51.656347 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2471/4947] 10.222.0.30 () {58 vars in 1347 bytes} [Sun Sep 4 01:20:51 2022] DELETE /identity/v3/roles/e93a51f968034bf5b67dd49936898293/implies/c6104e77f1104fadac1ee071661d7100 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:51.660716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680f9f9-2390-477a-b77d-221fd7f0ae9e tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:51.675513 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680f9f9-2390-477a-b77d-221fd7f0ae9e tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:51.761755 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492c939-2004-4266-a5f5-b8c161f53e20 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:51.762613 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492c939-2004-4266-a5f5-b8c161f53e20 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:51.763001 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492c939-2004-4266-a5f5-b8c161f53e20 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:51.763570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492c939-2004-4266-a5f5-b8c161f53e20 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/f67996c7900c4b618a2efaf0031e5939/implies/e93a51f968034bf5b67dd49936898293` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:51.765450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8492c939-2004-4266-a5f5-b8c161f53e20 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=f67996c7900c4b618a2efaf0031e5939, implied_role_id=e93a51f968034bf5b67dd49936898293)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:51.767969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8492c939-2004-4266-a5f5-b8c161f53e20 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:51.771019 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:51.794327 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2477/4948] 10.222.0.30 () {58 vars in 1347 bytes} [Sun Sep 4 01:20:51 2022] DELETE /identity/v3/roles/f67996c7900c4b618a2efaf0031e5939/implies/e93a51f968034bf5b67dd49936898293 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:51.796005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d00c3d-ba75-4b31-b9e6-15113bd10a05 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:51.825257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d00c3d-ba75-4b31-b9e6-15113bd10a05 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:51.976365 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c015e8-d719-4d1c-a8dc-11c2712b64ea tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:51.977072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c015e8-d719-4d1c-a8dc-11c2712b64ea tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:51.977423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c015e8-d719-4d1c-a8dc-11c2712b64ea tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:51.977687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c015e8-d719-4d1c-a8dc-11c2712b64ea tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/f67996c7900c4b618a2efaf0031e5939/implies/141866535f78410bb51eb40dd91ed1b6` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:51.983921 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c015e8-d719-4d1c-a8dc-11c2712b64ea tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=f67996c7900c4b618a2efaf0031e5939, implied_role_id=141866535f78410bb51eb40dd91ed1b6)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:51.985506 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c015e8-d719-4d1c-a8dc-11c2712b64ea tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:52.005163 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2472/4949] 10.222.0.30 () {58 vars in 1347 bytes} [Sun Sep 4 01:20:51 2022] DELETE /identity/v3/roles/f67996c7900c4b618a2efaf0031e5939/implies/141866535f78410bb51eb40dd91ed1b6 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:20:52.006987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492c939-2004-4266-a5f5-b8c161f53e20 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:52.035902 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492c939-2004-4266-a5f5-b8c161f53e20 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:52.184102 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6055ab-e0e9-413e-a736-94bf9cccc862 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:52.190041 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6055ab-e0e9-413e-a736-94bf9cccc862 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:52.191784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6055ab-e0e9-413e-a736-94bf9cccc862 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:52.192240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6055ab-e0e9-413e-a736-94bf9cccc862 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:52.193095 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6055ab-e0e9-413e-a736-94bf9cccc862 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:52.195250 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6055ab-e0e9-413e-a736-94bf9cccc862 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:52.228668 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2478/4950] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:20:52 2022] GET /identity/v3/roles => generated 2324 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:20:52.231114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c015e8-d719-4d1c-a8dc-11c2712b64ea tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:52.251177 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c015e8-d719-4d1c-a8dc-11c2712b64ea tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:52.258544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a473f0-6d2e-4abb-ab23-25285d134640 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:52.259308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a473f0-6d2e-4abb-ab23-25285d134640 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:52.259601 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a473f0-6d2e-4abb-ab23-25285d134640 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:52.259908 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a473f0-6d2e-4abb-ab23-25285d134640 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:52.260681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a473f0-6d2e-4abb-ab23-25285d134640 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:52.262487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a473f0-6d2e-4abb-ab23-25285d134640 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:52.288816 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2473/4951] 10.222.0.30 () {60 vars in 1143 bytes} [Sun Sep 4 01:20:52 2022] POST /identity/v3/roles => generated 234 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:52.291150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6055ab-e0e9-413e-a736-94bf9cccc862 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:52.305934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6055ab-e0e9-413e-a736-94bf9cccc862 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:52.312718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645da63e-bad8-476d-8881-7f88edd09c01 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:52.313367 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645da63e-bad8-476d-8881-7f88edd09c01 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:52.313697 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645da63e-bad8-476d-8881-7f88edd09c01 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:52.314149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645da63e-bad8-476d-8881-7f88edd09c01 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/b85057af02414da9a0219d53e06f1132` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:52.316244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645da63e-bad8-476d-8881-7f88edd09c01 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:update_role(role_id=b85057af02414da9a0219d53e06f1132)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:52.317290 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-645da63e-bad8-476d-8881-7f88edd09c01 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:52.317290 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:20:52.317290 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:20:52.318226 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645da63e-bad8-476d-8881-7f88edd09c01 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:52.363820 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2479/4952] 10.222.0.30 () {60 vars in 1243 bytes} [Sun Sep 4 01:20:52 2022] PATCH /identity/v3/roles/b85057af02414da9a0219d53e06f1132 => generated 238 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:20:52.364285 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a473f0-6d2e-4abb-ab23-25285d134640 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:52.385242 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a473f0-6d2e-4abb-ab23-25285d134640 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:52.403673 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841a133-e01b-482e-979f-9505f690a845 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:52.404357 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841a133-e01b-482e-979f-9505f690a845 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:52.404650 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841a133-e01b-482e-979f-9505f690a845 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:52.404926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841a133-e01b-482e-979f-9505f690a845 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/b85057af02414da9a0219d53e06f1132` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:52.417583 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841a133-e01b-482e-979f-9505f690a845 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:get_role(role_id=b85057af02414da9a0219d53e06f1132)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:52.418948 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-f841a133-e01b-482e-979f-9505f690a845 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:52.418948 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:20:52.418948 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:20:52.419850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841a133-e01b-482e-979f-9505f690a845 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:52.422064 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2474/4953] 10.222.0.30 () {58 vars in 1221 bytes} [Sun Sep 4 01:20:52 2022] GET /identity/v3/roles/b85057af02414da9a0219d53e06f1132 => generated 238 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:20:52.426097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645da63e-bad8-476d-8881-7f88edd09c01 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:52.452565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645da63e-bad8-476d-8881-7f88edd09c01 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:52.488095 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750ba42-b036-471d-8f7b-86260038c7a5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:52.490106 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750ba42-b036-471d-8f7b-86260038c7a5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:52.490397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750ba42-b036-471d-8f7b-86260038c7a5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:52.490680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750ba42-b036-471d-8f7b-86260038c7a5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:52.491355 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9750ba42-b036-471d-8f7b-86260038c7a5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:52.493008 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9750ba42-b036-471d-8f7b-86260038c7a5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:52.530332 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2480/4954] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:20:52 2022] GET /identity/v3/roles => generated 2553 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:20:52.534231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841a133-e01b-482e-979f-9505f690a845 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:52.547370 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841a133-e01b-482e-979f-9505f690a845 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:52.567229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f02e4-ad40-4025-ba0b-7b4f199d31df tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:52.569277 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f02e4-ad40-4025-ba0b-7b4f199d31df tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:52.569623 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f02e4-ad40-4025-ba0b-7b4f199d31df tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:52.570063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f02e4-ad40-4025-ba0b-7b4f199d31df tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/b85057af02414da9a0219d53e06f1132` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:52.571708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f02e4-ad40-4025-ba0b-7b4f199d31df tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b85057af02414da9a0219d53e06f1132)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:52.573583 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f02e4-ad40-4025-ba0b-7b4f199d31df tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:52.614447 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750ba42-b036-471d-8f7b-86260038c7a5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:52.618340 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9750ba42-b036-471d-8f7b-86260038c7a5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:52.633808 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-140f02e4-ad40-4025-ba0b-7b4f199d31df tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invalidating the token cache because role b85057af02414da9a0219d53e06f1132 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:52.634702 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-140f02e4-ad40-4025-ba0b-7b4f199d31df tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:52.635649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-140f02e4-ad40-4025-ba0b-7b4f199d31df tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:52.639737 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2475/4955] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:20:52 2022] DELETE /identity/v3/roles/b85057af02414da9a0219d53e06f1132 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:52.645859 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f02e4-ad40-4025-ba0b-7b4f199d31df tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:52.650890 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-140f02e4-ad40-4025-ba0b-7b4f199d31df tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:52.776353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f02e4-ad40-4025-ba0b-7b4f199d31df tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:52.782338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182bc284-df96-4fd3-a08c-a5fa28b2a6d9 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:52.783360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182bc284-df96-4fd3-a08c-a5fa28b2a6d9 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:52.783753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182bc284-df96-4fd3-a08c-a5fa28b2a6d9 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:52.784222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182bc284-df96-4fd3-a08c-a5fa28b2a6d9 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/f67996c7900c4b618a2efaf0031e5939/implies/141866535f78410bb51eb40dd91ed1b6` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:52.786557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182bc284-df96-4fd3-a08c-a5fa28b2a6d9 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=f67996c7900c4b618a2efaf0031e5939, implied_role_id=141866535f78410bb51eb40dd91ed1b6)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:52.792276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750ba42-b036-471d-8f7b-86260038c7a5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:52.795360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182bc284-df96-4fd3-a08c-a5fa28b2a6d9 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:52.846853 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2476/4956] 10.222.0.30 () {60 vars in 1363 bytes} [Sun Sep 4 01:20:52 2022] PUT /identity/v3/roles/f67996c7900c4b618a2efaf0031e5939/implies/141866535f78410bb51eb40dd91ed1b6 => generated 521 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:52.850968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182bc284-df96-4fd3-a08c-a5fa28b2a6d9 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:52.886457 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:52.961665 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:UPDATE=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:53.007864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2ed41-bf60-44a4-88a4-7f8f9ab2a0cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:53.008583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2ed41-bf60-44a4-88a4-7f8f9ab2a0cc service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:53.011353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2ed41-bf60-44a4-88a4-7f8f9ab2a0cc service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:53.011782 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2ed41-bf60-44a4-88a4-7f8f9ab2a0cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:53.018687 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4ea2ed41-bf60-44a4-88a4-7f8f9ab2a0cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:53.033604 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182bc284-df96-4fd3-a08c-a5fa28b2a6d9 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:53.040459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4514bf9-df6b-48b7-8ac7-ed2b1a1e22c3 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:53.044364 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4514bf9-df6b-48b7-8ac7-ed2b1a1e22c3 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:53.045021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4514bf9-df6b-48b7-8ac7-ed2b1a1e22c3 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:53.045568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4514bf9-df6b-48b7-8ac7-ed2b1a1e22c3 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/f67996c7900c4b618a2efaf0031e5939/implies/e93a51f968034bf5b67dd49936898293` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:53.046633 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea2ed41-bf60-44a4-88a4-7f8f9ab2a0cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:53.048354 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea2ed41-bf60-44a4-88a4-7f8f9ab2a0cc service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:53.048713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4514bf9-df6b-48b7-8ac7-ed2b1a1e22c3 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=f67996c7900c4b618a2efaf0031e5939, implied_role_id=e93a51f968034bf5b67dd49936898293)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:53.051464 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4514bf9-df6b-48b7-8ac7-ed2b1a1e22c3 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:53.076533 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2481/4957] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:20:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:20:53.097706 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2477/4958] 10.222.0.30 () {60 vars in 1363 bytes} [Sun Sep 4 01:20:52 2022] PUT /identity/v3/roles/f67996c7900c4b618a2efaf0031e5939/implies/e93a51f968034bf5b67dd49936898293 => generated 521 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:53.101693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2ed41-bf60-44a4-88a4-7f8f9ab2a0cc service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:53.120587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2ed41-bf60-44a4-88a4-7f8f9ab2a0cc service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:53.226705 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c85034-0b21-4c2e-92de-8cee8fd59bff tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:53.227480 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c85034-0b21-4c2e-92de-8cee8fd59bff tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:53.227771 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c85034-0b21-4c2e-92de-8cee8fd59bff tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:53.228654 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c85034-0b21-4c2e-92de-8cee8fd59bff tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/e93a51f968034bf5b67dd49936898293/implies/c6104e77f1104fadac1ee071661d7100` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:53.230759 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c85034-0b21-4c2e-92de-8cee8fd59bff tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e93a51f968034bf5b67dd49936898293, implied_role_id=c6104e77f1104fadac1ee071661d7100)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:53.232536 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c85034-0b21-4c2e-92de-8cee8fd59bff tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:53.274163 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2482/4959] 10.222.0.30 () {60 vars in 1363 bytes} [Sun Sep 4 01:20:53 2022] PUT /identity/v3/roles/e93a51f968034bf5b67dd49936898293/implies/c6104e77f1104fadac1ee071661d7100 => generated 521 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:20:53.275383 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4514bf9-df6b-48b7-8ac7-ed2b1a1e22c3 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:53.289635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4514bf9-df6b-48b7-8ac7-ed2b1a1e22c3 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:53.383072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089bf88d-b02a-4605-8898-9f59666af124 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:53.383742 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bf88d-b02a-4605-8898-9f59666af124 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:53.384593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bf88d-b02a-4605-8898-9f59666af124 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:53.385400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bf88d-b02a-4605-8898-9f59666af124 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/e93a51f968034bf5b67dd49936898293/implies` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:53.386711 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089bf88d-b02a-4605-8898-9f59666af124 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=e93a51f968034bf5b67dd49936898293)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:53.388259 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-089bf88d-b02a-4605-8898-9f59666af124 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:53.388259 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:20:53.388259 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:20:53.389279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089bf88d-b02a-4605-8898-9f59666af124 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:53.399305 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2478/4960] 10.222.0.30 () {58 vars in 1245 bytes} [Sun Sep 4 01:20:53 2022] GET /identity/v3/roles/e93a51f968034bf5b67dd49936898293/implies => generated 490 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:20:53.404738 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c85034-0b21-4c2e-92de-8cee8fd59bff tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:53.420885 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c85034-0b21-4c2e-92de-8cee8fd59bff tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:53.428703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32476dd-5d92-4fda-84e2-28b0954d5651 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:53.429544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32476dd-5d92-4fda-84e2-28b0954d5651 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:53.429835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32476dd-5d92-4fda-84e2-28b0954d5651 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:53.430111 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32476dd-5d92-4fda-84e2-28b0954d5651 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/f67996c7900c4b618a2efaf0031e5939/implies` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:53.432923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32476dd-5d92-4fda-84e2-28b0954d5651 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=f67996c7900c4b618a2efaf0031e5939)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:53.437480 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-e32476dd-5d92-4fda-84e2-28b0954d5651 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:20:53.437480 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:20:53.437480 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:20:53.438397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32476dd-5d92-4fda-84e2-28b0954d5651 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:53.458285 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2483/4961] 10.222.0.30 () {58 vars in 1245 bytes} [Sun Sep 4 01:20:53 2022] GET /identity/v3/roles/f67996c7900c4b618a2efaf0031e5939/implies => generated 661 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:20:53.459694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089bf88d-b02a-4605-8898-9f59666af124 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:53.479688 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089bf88d-b02a-4605-8898-9f59666af124 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:53.490326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44daea21-6e48-4083-aaf0-d80c169bb66b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:53.491238 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44daea21-6e48-4083-aaf0-d80c169bb66b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:53.491527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44daea21-6e48-4083-aaf0-d80c169bb66b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:53.491807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44daea21-6e48-4083-aaf0-d80c169bb66b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/e93a51f968034bf5b67dd49936898293/implies/c6104e77f1104fadac1ee071661d7100` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:53.494686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44daea21-6e48-4083-aaf0-d80c169bb66b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e93a51f968034bf5b67dd49936898293, implied_role_id=c6104e77f1104fadac1ee071661d7100)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:53.496581 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44daea21-6e48-4083-aaf0-d80c169bb66b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:53.510898 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2479/4962] 10.222.0.30 () {58 vars in 1347 bytes} [Sun Sep 4 01:20:53 2022] DELETE /identity/v3/roles/e93a51f968034bf5b67dd49936898293/implies/c6104e77f1104fadac1ee071661d7100 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:53.515922 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32476dd-5d92-4fda-84e2-28b0954d5651 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:53.531334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32476dd-5d92-4fda-84e2-28b0954d5651 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:53.632471 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62afef1-b798-4475-858c-18e33a17c87f tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:53.633018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62afef1-b798-4475-858c-18e33a17c87f tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:53.633285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62afef1-b798-4475-858c-18e33a17c87f tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:53.633742 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62afef1-b798-4475-858c-18e33a17c87f tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/f67996c7900c4b618a2efaf0031e5939/implies/e93a51f968034bf5b67dd49936898293` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:53.636246 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62afef1-b798-4475-858c-18e33a17c87f tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=f67996c7900c4b618a2efaf0031e5939, implied_role_id=e93a51f968034bf5b67dd49936898293)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:53.638331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62afef1-b798-4475-858c-18e33a17c87f tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:53.651758 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2484/4963] 10.222.0.30 () {58 vars in 1347 bytes} [Sun Sep 4 01:20:53 2022] DELETE /identity/v3/roles/f67996c7900c4b618a2efaf0031e5939/implies/e93a51f968034bf5b67dd49936898293 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:20:53.655747 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44daea21-6e48-4083-aaf0-d80c169bb66b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:53.672367 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44daea21-6e48-4083-aaf0-d80c169bb66b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:53.783886 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f4bb8-bbbc-4f39-a1c1-1f689fc09b78 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:53.785181 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f4bb8-bbbc-4f39-a1c1-1f689fc09b78 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:53.785539 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f4bb8-bbbc-4f39-a1c1-1f689fc09b78 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:53.785957 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f4bb8-bbbc-4f39-a1c1-1f689fc09b78 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/f67996c7900c4b618a2efaf0031e5939/implies/141866535f78410bb51eb40dd91ed1b6` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:53.789092 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f4bb8-bbbc-4f39-a1c1-1f689fc09b78 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=f67996c7900c4b618a2efaf0031e5939, implied_role_id=141866535f78410bb51eb40dd91ed1b6)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:53.790724 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f4bb8-bbbc-4f39-a1c1-1f689fc09b78 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:53.808368 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2480/4964] 10.222.0.30 () {58 vars in 1347 bytes} [Sun Sep 4 01:20:53 2022] DELETE /identity/v3/roles/f67996c7900c4b618a2efaf0031e5939/implies/141866535f78410bb51eb40dd91ed1b6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:53.814388 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62afef1-b798-4475-858c-18e33a17c87f tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:53.831285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62afef1-b798-4475-858c-18e33a17c87f tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:53.908043 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:53.936362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf149e-e4ca-4298-b8db-f4b544caa3b7 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:53.936362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf149e-e4ca-4298-b8db-f4b544caa3b7 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:53.936362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf149e-e4ca-4298-b8db-f4b544caa3b7 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:53.936692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf149e-e4ca-4298-b8db-f4b544caa3b7 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/domains/d94934c7016f47629f1fa832cbd93589` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:53.944507 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf149e-e4ca-4298-b8db-f4b544caa3b7 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 01:20:53.950639 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-cdbf149e-e4ca-4298-b8db-f4b544caa3b7 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Could not find domain: d94934c7016f47629f1fa832cbd93589.: keystone.exception.DomainNotFound: Could not find domain: d94934c7016f47629f1fa832cbd93589. Sep 04 01:20:53.950639 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:20:53.950639 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 04 01:20:53.950639 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 04 01:20:53.950639 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 01:20:53.950639 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 01:20:53.950639 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 01:20:53.950639 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 01:20:53.950639 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d94934c7016f47629f1fa832cbd93589. Sep 04 01:20:53.950639 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:20:53.950639 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:20:53.950639 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:20:53.950639 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:20:53.950639 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:20:53.950639 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:20:53.950639 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:20:53.951864 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:20:53.951864 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:20:53.951864 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:20:53.951864 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:20:53.951864 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:20:53.951864 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:20:53.951864 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:20:53.951864 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 04 01:20:53.951864 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 04 01:20:53.951864 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 01:20:53.951864 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 01:20:53.951864 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 01:20:53.951864 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 01:20:53.951864 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:20:53.951864 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:20:53.951864 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 01:20:53.952796 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 01:20:53.952796 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 01:20:53.952796 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 01:20:53.952796 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 01:20:53.952796 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 01:20:53.952796 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 01:20:53.952796 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 01:20:53.952796 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 01:20:53.952796 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 01:20:53.952796 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 01:20:53.952796 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 01:20:53.952796 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 01:20:53.952796 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 01:20:53.952796 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 04 01:20:53.952796 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 01:20:53.952796 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: d94934c7016f47629f1fa832cbd93589. Sep 04 01:20:53.952796 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:20:53.954901 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2485/4965] 10.222.0.30 () {60 vars in 1249 bytes} [Sun Sep 4 01:20:53 2022] PATCH /identity/v3/domains/d94934c7016f47629f1fa832cbd93589 => generated 112 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:20:53.956126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f4bb8-bbbc-4f39-a1c1-1f689fc09b78 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:53.991380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f4bb8-bbbc-4f39-a1c1-1f689fc09b78 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:54.017332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f63270-c2fc-42fc-9196-809281fb48b0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:54.018898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f63270-c2fc-42fc-9196-809281fb48b0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:54.020467 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f63270-c2fc-42fc-9196-809281fb48b0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:54.021815 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f63270-c2fc-42fc-9196-809281fb48b0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/users/afec73c7d52145c6b2ae7935f36dc95e` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:54.023907 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f63270-c2fc-42fc-9196-809281fb48b0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:delete_user(user_id=afec73c7d52145c6b2ae7935f36dc95e)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:54.029120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f63270-c2fc-42fc-9196-809281fb48b0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:54.032679 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:54.165848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-54f63270-c2fc-42fc-9196-809281fb48b0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afec73c7d52145c6b2ae7935f36dc95e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:54.167038 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-54f63270-c2fc-42fc-9196-809281fb48b0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afec73c7d52145c6b2ae7935f36dc95e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:54.191882 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-54f63270-c2fc-42fc-9196-809281fb48b0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afec73c7d52145c6b2ae7935f36dc95e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:54.215708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-54f63270-c2fc-42fc-9196-809281fb48b0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afec73c7d52145c6b2ae7935f36dc95e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:54.216349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-54f63270-c2fc-42fc-9196-809281fb48b0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afec73c7d52145c6b2ae7935f36dc95e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:54.254972 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2481/4966] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:20:53 2022] DELETE /identity/v3/users/afec73c7d52145c6b2ae7935f36dc95e => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:54.257128 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf149e-e4ca-4298-b8db-f4b544caa3b7 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:54.259465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-cdbf149e-e4ca-4298-b8db-f4b544caa3b7 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:54.301651 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf149e-e4ca-4298-b8db-f4b544caa3b7 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:54.479123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5e49e-a69a-4f2f-8e6c-cbd5564a82ca tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:54.483880 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5e49e-a69a-4f2f-8e6c-cbd5564a82ca tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:54.484071 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5e49e-a69a-4f2f-8e6c-cbd5564a82ca tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:54.484380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5e49e-a69a-4f2f-8e6c-cbd5564a82ca tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/c6104e77f1104fadac1ee071661d7100` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:54.486311 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5e49e-a69a-4f2f-8e6c-cbd5564a82ca tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c6104e77f1104fadac1ee071661d7100)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:54.487951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5e49e-a69a-4f2f-8e6c-cbd5564a82ca tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:54.541478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5bf5e49e-a69a-4f2f-8e6c-cbd5564a82ca tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invalidating the token cache because role c6104e77f1104fadac1ee071661d7100 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:54.541857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5bf5e49e-a69a-4f2f-8e6c-cbd5564a82ca tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:54.542720 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5bf5e49e-a69a-4f2f-8e6c-cbd5564a82ca tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:54.544730 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2486/4967] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:20:54 2022] DELETE /identity/v3/roles/c6104e77f1104fadac1ee071661d7100 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:54.549163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f63270-c2fc-42fc-9196-809281fb48b0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:54.561222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f63270-c2fc-42fc-9196-809281fb48b0 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:54.648452 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3abee-820e-4197-af3a-c0d7ca2e8dd5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:54.649206 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3abee-820e-4197-af3a-c0d7ca2e8dd5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:54.652239 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3abee-820e-4197-af3a-c0d7ca2e8dd5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:54.652239 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3abee-820e-4197-af3a-c0d7ca2e8dd5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/groups/9dcc5acebe7742d69710d72b87c4744a` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:54.690324 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3abee-820e-4197-af3a-c0d7ca2e8dd5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:delete_group(group_id=9dcc5acebe7742d69710d72b87c4744a)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:54.698171 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3abee-820e-4197-af3a-c0d7ca2e8dd5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:54.817880 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2482/4968] 10.222.0.30 () {58 vars in 1227 bytes} [Sun Sep 4 01:20:54 2022] DELETE /identity/v3/groups/9dcc5acebe7742d69710d72b87c4744a => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:54.819961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5e49e-a69a-4f2f-8e6c-cbd5564a82ca tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:54.822900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5bf5e49e-a69a-4f2f-8e6c-cbd5564a82ca tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:54.841033 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5e49e-a69a-4f2f-8e6c-cbd5564a82ca tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:54.961176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026ff9a-9866-4496-8e81-df3f43c6f6bd tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:54.962058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026ff9a-9866-4496-8e81-df3f43c6f6bd tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:54.962532 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026ff9a-9866-4496-8e81-df3f43c6f6bd tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:54.962993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026ff9a-9866-4496-8e81-df3f43c6f6bd tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/projects/369271e332a447f59cff39b1511717c7` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:54.966336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026ff9a-9866-4496-8e81-df3f43c6f6bd tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:delete_project(project_id=369271e332a447f59cff39b1511717c7)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:54.968348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026ff9a-9866-4496-8e81-df3f43c6f6bd tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:55.035678 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3026ff9a-9866-4496-8e81-df3f43c6f6bd tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '369271e332a447f59cff39b1511717c7', 'request_id': 'req-3026ff9a-9866-4496-8e81-df3f43c6f6bd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:55.059355 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3026ff9a-9866-4496-8e81-df3f43c6f6bd tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '369271e332a447f59cff39b1511717c7', 'request_id': 'req-3026ff9a-9866-4496-8e81-df3f43c6f6bd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:55.059637 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:55.067035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3026ff9a-9866-4496-8e81-df3f43c6f6bd tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '369271e332a447f59cff39b1511717c7', 'request_id': 'req-3026ff9a-9866-4496-8e81-df3f43c6f6bd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:55.107063 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3026ff9a-9866-4496-8e81-df3f43c6f6bd tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] The token cache is being invalidate because project 369271e332a447f59cff39b1511717c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:55.107358 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3026ff9a-9866-4496-8e81-df3f43c6f6bd tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:55.109315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3026ff9a-9866-4496-8e81-df3f43c6f6bd tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:55.116642 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2487/4969] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:20:54 2022] DELETE /identity/v3/projects/369271e332a447f59cff39b1511717c7 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:55.117973 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3abee-820e-4197-af3a-c0d7ca2e8dd5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:55.120668 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-07c3abee-820e-4197-af3a-c0d7ca2e8dd5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:55.152406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3abee-820e-4197-af3a-c0d7ca2e8dd5 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:55.234407 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:55.275615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5887a3d-c411-453d-b95f-73a7c8ed137b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:55.276761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5887a3d-c411-453d-b95f-73a7c8ed137b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:55.277913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5887a3d-c411-453d-b95f-73a7c8ed137b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:55.278202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5887a3d-c411-453d-b95f-73a7c8ed137b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/domains/009614487f63473dbee82cfecdf5effa` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:55.284608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5887a3d-c411-453d-b95f-73a7c8ed137b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=009614487f63473dbee82cfecdf5effa)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:55.286533 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5887a3d-c411-453d-b95f-73a7c8ed137b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:55.347338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b5887a3d-c411-453d-b95f-73a7c8ed137b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '009614487f63473dbee82cfecdf5effa'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:55.348299 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b5887a3d-c411-453d-b95f-73a7c8ed137b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '009614487f63473dbee82cfecdf5effa'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:55.458847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b5887a3d-c411-453d-b95f-73a7c8ed137b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '009614487f63473dbee82cfecdf5effa'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:55.459971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b5887a3d-c411-453d-b95f-73a7c8ed137b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '009614487f63473dbee82cfecdf5effa'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:55.464015 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2483/4970] 10.222.0.30 () {60 vars in 1249 bytes} [Sun Sep 4 01:20:55 2022] PATCH /identity/v3/domains/009614487f63473dbee82cfecdf5effa => generated 277 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:20:55.468749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026ff9a-9866-4496-8e81-df3f43c6f6bd tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:55.483763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026ff9a-9866-4496-8e81-df3f43c6f6bd tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:55.589667 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae376d2-5fb6-4f39-a6e6-afd89776fd23 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:55.590560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae376d2-5fb6-4f39-a6e6-afd89776fd23 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:55.591096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae376d2-5fb6-4f39-a6e6-afd89776fd23 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:55.591474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae376d2-5fb6-4f39-a6e6-afd89776fd23 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/domains/009614487f63473dbee82cfecdf5effa` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:55.604704 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae376d2-5fb6-4f39-a6e6-afd89776fd23 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=009614487f63473dbee82cfecdf5effa)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:55.614530 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae376d2-5fb6-4f39-a6e6-afd89776fd23 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:55.652516 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dae376d2-5fb6-4f39-a6e6-afd89776fd23 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '009614487f63473dbee82cfecdf5effa'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:55.666714 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dae376d2-5fb6-4f39-a6e6-afd89776fd23 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '009614487f63473dbee82cfecdf5effa'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:55.763815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dae376d2-5fb6-4f39-a6e6-afd89776fd23 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '009614487f63473dbee82cfecdf5effa', 'request_id': 'req-dae376d2-5fb6-4f39-a6e6-afd89776fd23'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:55.819863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dae376d2-5fb6-4f39-a6e6-afd89776fd23 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '009614487f63473dbee82cfecdf5effa', 'request_id': 'req-dae376d2-5fb6-4f39-a6e6-afd89776fd23'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:55.832706 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dae376d2-5fb6-4f39-a6e6-afd89776fd23 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '009614487f63473dbee82cfecdf5effa', 'request_id': 'req-dae376d2-5fb6-4f39-a6e6-afd89776fd23'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:55.857259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dae376d2-5fb6-4f39-a6e6-afd89776fd23 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] The token cache is being invalidate because project 009614487f63473dbee82cfecdf5effa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:55.857641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dae376d2-5fb6-4f39-a6e6-afd89776fd23 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:55.858267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dae376d2-5fb6-4f39-a6e6-afd89776fd23 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:55.870590 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dae376d2-5fb6-4f39-a6e6-afd89776fd23 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '009614487f63473dbee82cfecdf5effa', 'request_id': 'req-dae376d2-5fb6-4f39-a6e6-afd89776fd23'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:55.871337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dae376d2-5fb6-4f39-a6e6-afd89776fd23 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '009614487f63473dbee82cfecdf5effa', 'request_id': 'req-dae376d2-5fb6-4f39-a6e6-afd89776fd23'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:55.871986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dae376d2-5fb6-4f39-a6e6-afd89776fd23 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '009614487f63473dbee82cfecdf5effa', 'request_id': 'req-dae376d2-5fb6-4f39-a6e6-afd89776fd23'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:55.882129 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2488/4971] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:20:55 2022] DELETE /identity/v3/domains/009614487f63473dbee82cfecdf5effa => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:55.886448 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5887a3d-c411-453d-b95f-73a7c8ed137b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:55.888711 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b5887a3d-c411-453d-b95f-73a7c8ed137b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:55.906236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5887a3d-c411-453d-b95f-73a7c8ed137b tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:56.027969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9917619-f9e3-4ef1-94e1-58ab4e538e0d tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:56.028683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9917619-f9e3-4ef1-94e1-58ab4e538e0d tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:56.029013 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9917619-f9e3-4ef1-94e1-58ab4e538e0d tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:56.029346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9917619-f9e3-4ef1-94e1-58ab4e538e0d tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/e93a51f968034bf5b67dd49936898293` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:56.030896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9917619-f9e3-4ef1-94e1-58ab4e538e0d tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e93a51f968034bf5b67dd49936898293)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:56.032647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9917619-f9e3-4ef1-94e1-58ab4e538e0d tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:56.094902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b9917619-f9e3-4ef1-94e1-58ab4e538e0d tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invalidating the token cache because role e93a51f968034bf5b67dd49936898293 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:56.095331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b9917619-f9e3-4ef1-94e1-58ab4e538e0d tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:56.096307 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b9917619-f9e3-4ef1-94e1-58ab4e538e0d tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:56.102916 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2484/4972] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:20:55 2022] DELETE /identity/v3/roles/e93a51f968034bf5b67dd49936898293 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:20:56.104155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae376d2-5fb6-4f39-a6e6-afd89776fd23 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:56.105974 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-dae376d2-5fb6-4f39-a6e6-afd89776fd23 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:56.136138 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae376d2-5fb6-4f39-a6e6-afd89776fd23 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:56.163152 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:56.244034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d57371-35fb-40ac-b013-edfda3a40700 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:56.244705 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d57371-35fb-40ac-b013-edfda3a40700 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:56.244993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d57371-35fb-40ac-b013-edfda3a40700 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:56.245271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d57371-35fb-40ac-b013-edfda3a40700 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/141866535f78410bb51eb40dd91ed1b6` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:56.247125 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d57371-35fb-40ac-b013-edfda3a40700 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:delete_role(role_id=141866535f78410bb51eb40dd91ed1b6)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:56.248366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d57371-35fb-40ac-b013-edfda3a40700 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:56.321699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f1d57371-35fb-40ac-b013-edfda3a40700 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invalidating the token cache because role 141866535f78410bb51eb40dd91ed1b6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:56.321699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f1d57371-35fb-40ac-b013-edfda3a40700 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:56.323182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f1d57371-35fb-40ac-b013-edfda3a40700 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:56.327406 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2489/4973] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:20:56 2022] DELETE /identity/v3/roles/141866535f78410bb51eb40dd91ed1b6 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:56.331873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9917619-f9e3-4ef1-94e1-58ab4e538e0d tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:56.335582 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b9917619-f9e3-4ef1-94e1-58ab4e538e0d tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:56.386704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9917619-f9e3-4ef1-94e1-58ab4e538e0d tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:56.595744 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b003b-7c90-4b87-a338-74abec47d5cf tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00265b6a78e479db8110141a595adba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d607a733bf407285e513b1ddbaf8c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:56.596410 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b003b-7c90-4b87-a338-74abec47d5cf tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:56.596872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b003b-7c90-4b87-a338-74abec47d5cf tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:56.596987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b003b-7c90-4b87-a338-74abec47d5cf tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] PATH_INFO: `/v3/roles/f67996c7900c4b618a2efaf0031e5939` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:56.599766 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b003b-7c90-4b87-a338-74abec47d5cf tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f67996c7900c4b618a2efaf0031e5939)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:56.601320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b003b-7c90-4b87-a338-74abec47d5cf tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:56.617353 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:56.667121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a58b003b-7c90-4b87-a338-74abec47d5cf tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invalidating the token cache because role f67996c7900c4b618a2efaf0031e5939 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:56.667472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a58b003b-7c90-4b87-a338-74abec47d5cf tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:56.668161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a58b003b-7c90-4b87-a338-74abec47d5cf tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:56.673209 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2485/4974] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:20:56 2022] DELETE /identity/v3/roles/f67996c7900c4b618a2efaf0031e5939 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:56.674454 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d57371-35fb-40ac-b013-edfda3a40700 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:56.675954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f1d57371-35fb-40ac-b013-edfda3a40700 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:56.832777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d57371-35fb-40ac-b013-edfda3a40700 tempest-RolesV3TestJSON-1005132165 tempest-RolesV3TestJSON-1005132165-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:56.962334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa08645-f321-45ba-9f99-652a039d4db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:56.963364 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa08645-f321-45ba-9f99-652a039d4db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:56.963642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa08645-f321-45ba-9f99-652a039d4db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:56.963915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa08645-f321-45ba-9f99-652a039d4db7 admin admin] PATH_INFO: `/v3/users/f1eb657c8150446cbb0bb924b0ae99e1` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:56.967040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa08645-f321-45ba-9f99-652a039d4db7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1eb657c8150446cbb0bb924b0ae99e1)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:56.972722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa08645-f321-45ba-9f99-652a039d4db7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:57.081599 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:57.102718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3aa08645-f321-45ba-9f99-652a039d4db7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1eb657c8150446cbb0bb924b0ae99e1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:57.106176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3aa08645-f321-45ba-9f99-652a039d4db7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1eb657c8150446cbb0bb924b0ae99e1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:57.121568 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3aa08645-f321-45ba-9f99-652a039d4db7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1eb657c8150446cbb0bb924b0ae99e1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:57.133279 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3aa08645-f321-45ba-9f99-652a039d4db7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1eb657c8150446cbb0bb924b0ae99e1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:57.134259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3aa08645-f321-45ba-9f99-652a039d4db7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1eb657c8150446cbb0bb924b0ae99e1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:57.162921 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2490/4975] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:20:56 2022] DELETE /identity/v3/users/f1eb657c8150446cbb0bb924b0ae99e1 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:20:57.169528 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9a621-b31f-4c52-b7d7-f2b7494f40aa None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:57.170101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9a621-b31f-4c52-b7d7-f2b7494f40aa None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:57.170418 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9a621-b31f-4c52-b7d7-f2b7494f40aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:57.220892 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-dad9a621-b31f-4c52-b7d7-f2b7494f40aa None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:57.224054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-dad9a621-b31f-4c52-b7d7-f2b7494f40aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:57.251937 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa08645-f321-45ba-9f99-652a039d4db7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:57.254154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3aa08645-f321-45ba-9f99-652a039d4db7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:57.363131 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa08645-f321-45ba-9f99-652a039d4db7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:57.370214 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88370be-e368-49b9-8503-1e36bcc0ec15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:57.371243 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88370be-e368-49b9-8503-1e36bcc0ec15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:57.372015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88370be-e368-49b9-8503-1e36bcc0ec15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:57.372461 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88370be-e368-49b9-8503-1e36bcc0ec15 admin admin] PATH_INFO: `/v3/users/3cf055f323154b16b36cb8347b3fbb97` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:57.374752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88370be-e368-49b9-8503-1e36bcc0ec15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cf055f323154b16b36cb8347b3fbb97)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:57.378748 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88370be-e368-49b9-8503-1e36bcc0ec15 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:57.409853 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2486/4976] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:57.439901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9a621-b31f-4c52-b7d7-f2b7494f40aa None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:57.446418 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-dad9a621-b31f-4c52-b7d7-f2b7494f40aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:57.470553 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d88370be-e368-49b9-8503-1e36bcc0ec15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cf055f323154b16b36cb8347b3fbb97'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:57.471754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d88370be-e368-49b9-8503-1e36bcc0ec15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cf055f323154b16b36cb8347b3fbb97'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:57.491409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d88370be-e368-49b9-8503-1e36bcc0ec15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cf055f323154b16b36cb8347b3fbb97'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:57.514379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d88370be-e368-49b9-8503-1e36bcc0ec15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cf055f323154b16b36cb8347b3fbb97'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:57.515224 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d88370be-e368-49b9-8503-1e36bcc0ec15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cf055f323154b16b36cb8347b3fbb97'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:57.545903 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2491/4977] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:20:57 2022] DELETE /identity/v3/users/3cf055f323154b16b36cb8347b3fbb97 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:57.558796 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3c184-459b-42a0-b00e-4c2de61fc4ef None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:57.559362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3c184-459b-42a0-b00e-4c2de61fc4ef None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:57.560662 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3c184-459b-42a0-b00e-4c2de61fc4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:57.570318 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9a621-b31f-4c52-b7d7-f2b7494f40aa None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:57.606607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e4a3c184-459b-42a0-b00e-4c2de61fc4ef None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:57.608539 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e4a3c184-459b-42a0-b00e-4c2de61fc4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:57.668397 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:57.688506 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0af9de-4929-47aa-b49d-90e2a941a81f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:57.692282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0af9de-4929-47aa-b49d-90e2a941a81f service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:57.692559 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0af9de-4929-47aa-b49d-90e2a941a81f service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:57.693975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0af9de-4929-47aa-b49d-90e2a941a81f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:57.699721 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ff0af9de-4929-47aa-b49d-90e2a941a81f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:57.761126 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2492/4978] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:57.769511 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:57.776763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3c184-459b-42a0-b00e-4c2de61fc4ef None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:57.780774 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e4a3c184-459b-42a0-b00e-4c2de61fc4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:57.797337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3c184-459b-42a0-b00e-4c2de61fc4ef None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:57.797593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0af9de-4929-47aa-b49d-90e2a941a81f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:57.799501 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0af9de-4929-47aa-b49d-90e2a941a81f service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:57.802859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d8f44-49a0-4247-8738-39471445d226 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:57.803741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d8f44-49a0-4247-8738-39471445d226 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:57.804228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d8f44-49a0-4247-8738-39471445d226 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:57.804668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d8f44-49a0-4247-8738-39471445d226 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:57.815302 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2487/4979] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:20:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:20:57.836373 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d8f44-49a0-4247-8738-39471445d226 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:57.838840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d8f44-49a0-4247-8738-39471445d226 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:57.853163 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2493/4980] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:20:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:20:58.041185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0af9de-4929-47aa-b49d-90e2a941a81f service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:58.044202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ff0af9de-4929-47aa-b49d-90e2a941a81f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:58.067798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0af9de-4929-47aa-b49d-90e2a941a81f service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:58.082685 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0554eee-2764-4a9b-bb1e-542d51a2086c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:58.083356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0554eee-2764-4a9b-bb1e-542d51a2086c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:58.083632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0554eee-2764-4a9b-bb1e-542d51a2086c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:58.084335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0554eee-2764-4a9b-bb1e-542d51a2086c admin admin] PATH_INFO: `/v3/users/da8b6af4e9814647aa1334ca4f66c87c` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:58.088739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0554eee-2764-4a9b-bb1e-542d51a2086c admin admin] RBAC: Authorizing `identity:delete_user(user_id=da8b6af4e9814647aa1334ca4f66c87c)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:58.091308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0554eee-2764-4a9b-bb1e-542d51a2086c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:58.194296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b0554eee-2764-4a9b-bb1e-542d51a2086c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da8b6af4e9814647aa1334ca4f66c87c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:58.195073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b0554eee-2764-4a9b-bb1e-542d51a2086c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da8b6af4e9814647aa1334ca4f66c87c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:58.204601 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b0554eee-2764-4a9b-bb1e-542d51a2086c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da8b6af4e9814647aa1334ca4f66c87c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:58.222845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b0554eee-2764-4a9b-bb1e-542d51a2086c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da8b6af4e9814647aa1334ca4f66c87c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:58.224250 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b0554eee-2764-4a9b-bb1e-542d51a2086c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da8b6af4e9814647aa1334ca4f66c87c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:58.250173 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2488/4981] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:20:58 2022] DELETE /identity/v3/users/da8b6af4e9814647aa1334ca4f66c87c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:58.844068 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d8f44-49a0-4247-8738-39471445d226 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:58.846144 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-326d8f44-49a0-4247-8738-39471445d226 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:58.869516 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d8f44-49a0-4247-8738-39471445d226 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:58.958440 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0554eee-2764-4a9b-bb1e-542d51a2086c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:58.962930 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b0554eee-2764-4a9b-bb1e-542d51a2086c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:59.034074 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b777e0-b3eb-4b34-89ec-5add9dd572f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:59.035488 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b777e0-b3eb-4b34-89ec-5add9dd572f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:59.035869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b777e0-b3eb-4b34-89ec-5add9dd572f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:59.036245 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b777e0-b3eb-4b34-89ec-5add9dd572f4 admin admin] PATH_INFO: `/v3/projects/15db31cd82a1462b90be4ddb8baf58a9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:59.037725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b777e0-b3eb-4b34-89ec-5add9dd572f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15db31cd82a1462b90be4ddb8baf58a9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:59.039833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b777e0-b3eb-4b34-89ec-5add9dd572f4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:59.135235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0554eee-2764-4a9b-bb1e-542d51a2086c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:59.151017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e7b777e0-b3eb-4b34-89ec-5add9dd572f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15db31cd82a1462b90be4ddb8baf58a9', 'request_id': 'req-e7b777e0-b3eb-4b34-89ec-5add9dd572f4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:59.167420 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e7b777e0-b3eb-4b34-89ec-5add9dd572f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15db31cd82a1462b90be4ddb8baf58a9', 'request_id': 'req-e7b777e0-b3eb-4b34-89ec-5add9dd572f4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:59.185989 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e7b777e0-b3eb-4b34-89ec-5add9dd572f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15db31cd82a1462b90be4ddb8baf58a9', 'request_id': 'req-e7b777e0-b3eb-4b34-89ec-5add9dd572f4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:59.216089 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e7b777e0-b3eb-4b34-89ec-5add9dd572f4 admin admin] The token cache is being invalidate because project 15db31cd82a1462b90be4ddb8baf58a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:59.216378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e7b777e0-b3eb-4b34-89ec-5add9dd572f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:59.218139 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e7b777e0-b3eb-4b34-89ec-5add9dd572f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:59.222325 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2494/4982] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:20:58 2022] DELETE /identity/v3/projects/15db31cd82a1462b90be4ddb8baf58a9 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:59.224414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b777e0-b3eb-4b34-89ec-5add9dd572f4 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:59.227273 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e7b777e0-b3eb-4b34-89ec-5add9dd572f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:59.321386 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b06bf2-2f6f-4e88-9f1c-ee74b7bd056f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:59.322677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b06bf2-2f6f-4e88-9f1c-ee74b7bd056f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:59.322886 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b06bf2-2f6f-4e88-9f1c-ee74b7bd056f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:59.323343 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b06bf2-2f6f-4e88-9f1c-ee74b7bd056f admin admin] PATH_INFO: `/v3/projects/1b70ef92fb734a1283d410056e6169b9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:59.327240 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b06bf2-2f6f-4e88-9f1c-ee74b7bd056f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b70ef92fb734a1283d410056e6169b9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:59.330256 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b06bf2-2f6f-4e88-9f1c-ee74b7bd056f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:59.333788 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:59.348415 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:59.377960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b777e0-b3eb-4b34-89ec-5add9dd572f4 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:59.389400 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281c2a3-50d2-468b-b270-7af2bd60eaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:59.390065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281c2a3-50d2-468b-b270-7af2bd60eaed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:59.390348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281c2a3-50d2-468b-b270-7af2bd60eaed admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:59.390622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281c2a3-50d2-468b-b270-7af2bd60eaed admin admin] PATH_INFO: `/v3/users/c00265b6a78e479db8110141a595adba` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:59.392167 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4281c2a3-50d2-468b-b270-7af2bd60eaed admin admin] RBAC: Authorizing `identity:delete_user(user_id=c00265b6a78e479db8110141a595adba)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:59.395055 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4281c2a3-50d2-468b-b270-7af2bd60eaed admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:59.416809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f7b06bf2-2f6f-4e88-9f1c-ee74b7bd056f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b70ef92fb734a1283d410056e6169b9', 'request_id': 'req-f7b06bf2-2f6f-4e88-9f1c-ee74b7bd056f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:59.433517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f7b06bf2-2f6f-4e88-9f1c-ee74b7bd056f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b70ef92fb734a1283d410056e6169b9', 'request_id': 'req-f7b06bf2-2f6f-4e88-9f1c-ee74b7bd056f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:59.473257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f7b06bf2-2f6f-4e88-9f1c-ee74b7bd056f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b70ef92fb734a1283d410056e6169b9', 'request_id': 'req-f7b06bf2-2f6f-4e88-9f1c-ee74b7bd056f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:59.505366 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f7b06bf2-2f6f-4e88-9f1c-ee74b7bd056f admin admin] The token cache is being invalidate because project 1b70ef92fb734a1283d410056e6169b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:59.506139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f7b06bf2-2f6f-4e88-9f1c-ee74b7bd056f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:59.508256 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f7b06bf2-2f6f-4e88-9f1c-ee74b7bd056f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:59.511259 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2489/4983] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:20:58 2022] DELETE /identity/v3/projects/1b70ef92fb734a1283d410056e6169b9 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:59.513045 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b06bf2-2f6f-4e88-9f1c-ee74b7bd056f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:59.515907 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f7b06bf2-2f6f-4e88-9f1c-ee74b7bd056f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:59.527572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4281c2a3-50d2-468b-b270-7af2bd60eaed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c00265b6a78e479db8110141a595adba'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:59.528264 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4281c2a3-50d2-468b-b270-7af2bd60eaed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c00265b6a78e479db8110141a595adba'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:59.536988 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4281c2a3-50d2-468b-b270-7af2bd60eaed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c00265b6a78e479db8110141a595adba'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:59.568548 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4281c2a3-50d2-468b-b270-7af2bd60eaed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c00265b6a78e479db8110141a595adba'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:59.596828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4281c2a3-50d2-468b-b270-7af2bd60eaed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c00265b6a78e479db8110141a595adba'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:59.617884 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b06bf2-2f6f-4e88-9f1c-ee74b7bd056f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:59.633407 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a760a40-5127-4ea8-861f-73e3d9718dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:59.634401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a760a40-5127-4ea8-861f-73e3d9718dd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:59.635897 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a760a40-5127-4ea8-861f-73e3d9718dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:59.636023 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2495/4984] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:20:59 2022] DELETE /identity/v3/users/c00265b6a78e479db8110141a595adba => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:59.636223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a760a40-5127-4ea8-861f-73e3d9718dd7 admin admin] PATH_INFO: `/v3/projects/5040033c21324d80976b3d9f520a3d3b` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:59.637316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29dfc5-d3ad-4d1b-8dce-b0806c57f835 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:59.637658 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29dfc5-d3ad-4d1b-8dce-b0806c57f835 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:59.637937 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29dfc5-d3ad-4d1b-8dce-b0806c57f835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:59.639149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a760a40-5127-4ea8-861f-73e3d9718dd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5040033c21324d80976b3d9f520a3d3b)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:59.646967 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a760a40-5127-4ea8-861f-73e3d9718dd7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:59.696281 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-5f29dfc5-d3ad-4d1b-8dce-b0806c57f835 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:59.697948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5f29dfc5-d3ad-4d1b-8dce-b0806c57f835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:59.751655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7a760a40-5127-4ea8-861f-73e3d9718dd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5040033c21324d80976b3d9f520a3d3b', 'request_id': 'req-7a760a40-5127-4ea8-861f-73e3d9718dd7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:59.762791 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7a760a40-5127-4ea8-861f-73e3d9718dd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5040033c21324d80976b3d9f520a3d3b', 'request_id': 'req-7a760a40-5127-4ea8-861f-73e3d9718dd7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:59.772196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7a760a40-5127-4ea8-861f-73e3d9718dd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5040033c21324d80976b3d9f520a3d3b', 'request_id': 'req-7a760a40-5127-4ea8-861f-73e3d9718dd7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:59.786093 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2496/4985] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:59.795336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a73af1-01bc-4e65-ac7d-9b1c8168592b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:59.795638 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a73af1-01bc-4e65-ac7d-9b1c8168592b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:59.795890 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a73af1-01bc-4e65-ac7d-9b1c8168592b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:59.797884 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7a760a40-5127-4ea8-861f-73e3d9718dd7 admin admin] The token cache is being invalidate because project 5040033c21324d80976b3d9f520a3d3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:20:59.800256 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7a760a40-5127-4ea8-861f-73e3d9718dd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:59.801924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7a760a40-5127-4ea8-861f-73e3d9718dd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:20:59.805663 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2490/4986] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:20:59 2022] DELETE /identity/v3/projects/5040033c21324d80976b3d9f520a3d3b => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:20:59.809641 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a760a40-5127-4ea8-861f-73e3d9718dd7 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:59.811727 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7a760a40-5127-4ea8-861f-73e3d9718dd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:59.840933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-b0a73af1-01bc-4e65-ac7d-9b1c8168592b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:20:59.842685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b0a73af1-01bc-4e65-ac7d-9b1c8168592b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:20:59.866831 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:59.927163 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2497/4987] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:20:59.932129 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a73af1-01bc-4e65-ac7d-9b1c8168592b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:59.943104 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a73af1-01bc-4e65-ac7d-9b1c8168592b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:59.945336 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a760a40-5127-4ea8-861f-73e3d9718dd7 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:20:59.948771 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d42beb-1488-42dd-856c-1a370b81c355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:59.949375 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d42beb-1488-42dd-856c-1a370b81c355 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:59.949852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d42beb-1488-42dd-856c-1a370b81c355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:59.950126 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d42beb-1488-42dd-856c-1a370b81c355 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:59.951180 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d42beb-1488-42dd-856c-1a370b81c355 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:20:59.951486 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d42beb-1488-42dd-856c-1a370b81c355 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:59.952189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc903b-4fbe-424b-a413-a22b4a613bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:20:59.953253 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc903b-4fbe-424b-a413-a22b4a613bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:20:59.953668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d42beb-1488-42dd-856c-1a370b81c355 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:59.953798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc903b-4fbe-424b-a413-a22b4a613bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:20:59.954156 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc903b-4fbe-424b-a413-a22b4a613bbf admin admin] PATH_INFO: `/v3/users/cd0cea1d286a43e2bb10c5b15a497231` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:20:59.955518 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc903b-4fbe-424b-a413-a22b4a613bbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd0cea1d286a43e2bb10c5b15a497231)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:20:59.957771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc903b-4fbe-424b-a413-a22b4a613bbf admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:20:59.963851 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:59.970786 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2498/4988] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:20:59.978914 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d42beb-1488-42dd-856c-1a370b81c355 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:20:59.996457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d42beb-1488-42dd-856c-1a370b81c355 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:00.002895 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5db5c4-5266-4073-9373-b29ce1eaf022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:00.004000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5db5c4-5266-4073-9373-b29ce1eaf022 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:00.004596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5db5c4-5266-4073-9373-b29ce1eaf022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:00.005405 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5db5c4-5266-4073-9373-b29ce1eaf022 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:00.007438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5db5c4-5266-4073-9373-b29ce1eaf022 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:00.010744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5db5c4-5266-4073-9373-b29ce1eaf022 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:00.061380 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2499/4989] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:20:59 2022] POST /identity/v3/projects => generated 373 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:21:00.066186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5db5c4-5266-4073-9373-b29ce1eaf022 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:00.167959 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5db5c4-5266-4073-9373-b29ce1eaf022 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:00.175982 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8dc60-8faa-4c39-ae9f-f27310d488b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:00.177400 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8dc60-8faa-4c39-ae9f-f27310d488b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:00.177860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8dc60-8faa-4c39-ae9f-f27310d488b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:00.178396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8dc60-8faa-4c39-ae9f-f27310d488b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:00.179466 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8dc60-8faa-4c39-ae9f-f27310d488b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:00.182473 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8dc60-8faa-4c39-ae9f-f27310d488b5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:00.250773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-51cc903b-4fbe-424b-a413-a22b4a613bbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd0cea1d286a43e2bb10c5b15a497231'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:00.267603 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2500/4990] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:21:00 2022] POST /identity/v3/users => generated 287 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:21:00.270700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8dc60-8faa-4c39-ae9f-f27310d488b5 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:00.271934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-51cc903b-4fbe-424b-a413-a22b4a613bbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd0cea1d286a43e2bb10c5b15a497231'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:00.273740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-dbd8dc60-8faa-4c39-ae9f-f27310d488b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:00.291249 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8dc60-8faa-4c39-ae9f-f27310d488b5 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:00.292943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-51cc903b-4fbe-424b-a413-a22b4a613bbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd0cea1d286a43e2bb10c5b15a497231'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:00.298079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def907bf-50c5-4286-a868-9b71eb65573b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:00.299146 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def907bf-50c5-4286-a868-9b71eb65573b admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:00.299664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def907bf-50c5-4286-a868-9b71eb65573b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:00.300925 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def907bf-50c5-4286-a868-9b71eb65573b admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:00.303900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def907bf-50c5-4286-a868-9b71eb65573b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:00.304939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def907bf-50c5-4286-a868-9b71eb65573b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:00.307141 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-51cc903b-4fbe-424b-a413-a22b4a613bbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd0cea1d286a43e2bb10c5b15a497231'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:00.308009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-51cc903b-4fbe-424b-a413-a22b4a613bbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd0cea1d286a43e2bb10c5b15a497231'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:00.322644 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2501/4991] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:00.326863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def907bf-50c5-4286-a868-9b71eb65573b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:00.338931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def907bf-50c5-4286-a868-9b71eb65573b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:00.344277 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472d7be-a313-45a8-9b13-4b838c824e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:00.344974 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472d7be-a313-45a8-9b13-4b838c824e3e admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:00.345459 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472d7be-a313-45a8-9b13-4b838c824e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:00.345826 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472d7be-a313-45a8-9b13-4b838c824e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:00.346650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5472d7be-a313-45a8-9b13-4b838c824e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:00.349961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5472d7be-a313-45a8-9b13-4b838c824e3e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:00.359066 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2491/4992] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:20:59 2022] DELETE /identity/v3/users/cd0cea1d286a43e2bb10c5b15a497231 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:00.373870 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2502/4993] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:00.378242 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc903b-4fbe-424b-a413-a22b4a613bbf admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:00.464250 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472d7be-a313-45a8-9b13-4b838c824e3e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:00.465635 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5472d7be-a313-45a8-9b13-4b838c824e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:00.484986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472d7be-a313-45a8-9b13-4b838c824e3e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:00.541545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc903b-4fbe-424b-a413-a22b4a613bbf admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:00.546972 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056426b4-9a7f-48b6-b959-14406e47d275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:00.547733 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056426b4-9a7f-48b6-b959-14406e47d275 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:00.548113 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056426b4-9a7f-48b6-b959-14406e47d275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:00.548930 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056426b4-9a7f-48b6-b959-14406e47d275 admin admin] PATH_INFO: `/v3/projects/8dc856435ae448039f7609e10d559e1c/users/ba251c2bc134469a9c03e7023cd75038/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:00.558781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70f0f4-5816-4e7e-aaa3-632502ec74b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:00.559424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70f0f4-5816-4e7e-aaa3-632502ec74b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:00.559706 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70f0f4-5816-4e7e-aaa3-632502ec74b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:00.560091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70f0f4-5816-4e7e-aaa3-632502ec74b3 admin admin] PATH_INFO: `/v3/projects/60d607a733bf407285e513b1ddbaf8c5` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:00.561267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf70f0f4-5816-4e7e-aaa3-632502ec74b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60d607a733bf407285e513b1ddbaf8c5)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:00.563434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf70f0f4-5816-4e7e-aaa3-632502ec74b3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:00.569480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056426b4-9a7f-48b6-b959-14406e47d275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dc856435ae448039f7609e10d559e1c, user_id=ba251c2bc134469a9c03e7023cd75038, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:00.575508 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056426b4-9a7f-48b6-b959-14406e47d275 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:00.601255 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2492/4994] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:21:00 2022] PUT /identity/v3/projects/8dc856435ae448039f7609e10d559e1c/users/ba251c2bc134469a9c03e7023cd75038/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:00.602237 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056426b4-9a7f-48b6-b959-14406e47d275 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:00.611723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-056426b4-9a7f-48b6-b959-14406e47d275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:00.645828 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:00.662729 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:00.664634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bf70f0f4-5816-4e7e-aaa3-632502ec74b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60d607a733bf407285e513b1ddbaf8c5', 'request_id': 'req-bf70f0f4-5816-4e7e-aaa3-632502ec74b3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:00.694556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bf70f0f4-5816-4e7e-aaa3-632502ec74b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60d607a733bf407285e513b1ddbaf8c5', 'request_id': 'req-bf70f0f4-5816-4e7e-aaa3-632502ec74b3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:00.702911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bf70f0f4-5816-4e7e-aaa3-632502ec74b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60d607a733bf407285e513b1ddbaf8c5', 'request_id': 'req-bf70f0f4-5816-4e7e-aaa3-632502ec74b3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:00.727551 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bf70f0f4-5816-4e7e-aaa3-632502ec74b3 admin admin] The token cache is being invalidate because project 60d607a733bf407285e513b1ddbaf8c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:00.728376 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bf70f0f4-5816-4e7e-aaa3-632502ec74b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:00.729057 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bf70f0f4-5816-4e7e-aaa3-632502ec74b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:00.730363 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056426b4-9a7f-48b6-b959-14406e47d275 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:00.730940 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2503/4995] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:21:00 2022] DELETE /identity/v3/projects/60d607a733bf407285e513b1ddbaf8c5 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:21:00.732484 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9378a-7591-40b3-99aa-9dfd86e43480 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:00.732778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9378a-7591-40b3-99aa-9dfd86e43480 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:00.733054 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9378a-7591-40b3-99aa-9dfd86e43480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:00.778981 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-afa9378a-7591-40b3-99aa-9dfd86e43480 None None] MFA Rules not processed for user `ba251c2bc134469a9c03e7023cd75038`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:00.780869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-afa9378a-7591-40b3-99aa-9dfd86e43480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:00.803937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86826cb-92c6-48a9-9256-82cf6d7e3d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:00.806477 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86826cb-92c6-48a9-9256-82cf6d7e3d86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:00.808116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86826cb-92c6-48a9-9256-82cf6d7e3d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:00.808801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86826cb-92c6-48a9-9256-82cf6d7e3d86 admin admin] PATH_INFO: `/v3/users/da39799202f64ad09830b862d4803b48` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:00.810372 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86826cb-92c6-48a9-9256-82cf6d7e3d86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da39799202f64ad09830b862d4803b48)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:00.817847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86826cb-92c6-48a9-9256-82cf6d7e3d86 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:00.897641 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2504/4996] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:00.897641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa9378a-7591-40b3-99aa-9dfd86e43480 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:00.897641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-afa9378a-7591-40b3-99aa-9dfd86e43480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:00.914115 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c86826cb-92c6-48a9-9256-82cf6d7e3d86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da39799202f64ad09830b862d4803b48'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:00.915009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c86826cb-92c6-48a9-9256-82cf6d7e3d86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da39799202f64ad09830b862d4803b48'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:00.921763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa9378a-7591-40b3-99aa-9dfd86e43480 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:00.923992 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c86826cb-92c6-48a9-9256-82cf6d7e3d86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da39799202f64ad09830b862d4803b48'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:00.927691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09daa7-0809-4e7c-8065-f28048bba571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:00.929525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09daa7-0809-4e7c-8065-f28048bba571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:00.929924 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09daa7-0809-4e7c-8065-f28048bba571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:00.930157 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09daa7-0809-4e7c-8065-f28048bba571 admin admin] PATH_INFO: `/v3/projects/add0e68b486846e4884e034665e5b2c8` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:00.932758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09daa7-0809-4e7c-8065-f28048bba571 admin admin] RBAC: Authorizing `identity:delete_project(project_id=add0e68b486846e4884e034665e5b2c8)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:00.935734 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09daa7-0809-4e7c-8065-f28048bba571 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:00.936685 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c86826cb-92c6-48a9-9256-82cf6d7e3d86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da39799202f64ad09830b862d4803b48'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:00.938985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c86826cb-92c6-48a9-9256-82cf6d7e3d86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da39799202f64ad09830b862d4803b48'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:00.973210 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2493/4997] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:21:00 2022] DELETE /identity/v3/users/da39799202f64ad09830b862d4803b48 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:00.973210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b68200-5250-4e17-b1d7-86964dd2b0f0 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:00.973210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b68200-5250-4e17-b1d7-86964dd2b0f0 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:00.973210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b68200-5250-4e17-b1d7-86964dd2b0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:01.000352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-97b68200-5250-4e17-b1d7-86964dd2b0f0 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:01.001889 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-97b68200-5250-4e17-b1d7-86964dd2b0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:01.021944 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0b09daa7-0809-4e7c-8065-f28048bba571 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'add0e68b486846e4884e034665e5b2c8', 'request_id': 'req-0b09daa7-0809-4e7c-8065-f28048bba571'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:01.038467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0b09daa7-0809-4e7c-8065-f28048bba571 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'add0e68b486846e4884e034665e5b2c8', 'request_id': 'req-0b09daa7-0809-4e7c-8065-f28048bba571'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:01.047920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0b09daa7-0809-4e7c-8065-f28048bba571 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'add0e68b486846e4884e034665e5b2c8', 'request_id': 'req-0b09daa7-0809-4e7c-8065-f28048bba571'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:01.068269 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0b09daa7-0809-4e7c-8065-f28048bba571 admin admin] The token cache is being invalidate because project add0e68b486846e4884e034665e5b2c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:01.068953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0b09daa7-0809-4e7c-8065-f28048bba571 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:01.069896 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0b09daa7-0809-4e7c-8065-f28048bba571 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:01.077680 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2505/4998] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:21:00 2022] DELETE /identity/v3/projects/add0e68b486846e4884e034665e5b2c8 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:01.080141 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeec080-c8b1-4d50-a8d2-092d4b358f97 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:01.081252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeec080-c8b1-4d50-a8d2-092d4b358f97 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:01.081726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeec080-c8b1-4d50-a8d2-092d4b358f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:01.084695 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:01.112701 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2494/4999] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:01.115659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98e1e6-8e54-4dbc-933c-f3b4acaed7b7 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:01.116072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98e1e6-8e54-4dbc-933c-f3b4acaed7b7 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:01.116408 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98e1e6-8e54-4dbc-933c-f3b4acaed7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:01.131476 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-2eeec080-c8b1-4d50-a8d2-092d4b358f97 None None] MFA Rules not processed for user `ba251c2bc134469a9c03e7023cd75038`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:01.133235 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2eeec080-c8b1-4d50-a8d2-092d4b358f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:01.146541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-3c98e1e6-8e54-4dbc-933c-f3b4acaed7b7 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:01.146541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3c98e1e6-8e54-4dbc-933c-f3b4acaed7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:01.155973 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2495/5000] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:01.157467 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704dc4a-d9ba-49b2-8036-136a7dbf5ce0 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:01.157761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704dc4a-d9ba-49b2-8036-136a7dbf5ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:01.158166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704dc4a-d9ba-49b2-8036-136a7dbf5ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:01.211477 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:01.215236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-0704dc4a-d9ba-49b2-8036-136a7dbf5ce0 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:01.216434 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0704dc4a-d9ba-49b2-8036-136a7dbf5ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:01.237918 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2496/5001] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:01.239761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b2b53-3bfd-4e67-8bf4-0666112c418e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:01.240050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b2b53-3bfd-4e67-8bf4-0666112c418e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:01.240335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b2b53-3bfd-4e67-8bf4-0666112c418e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:01.249980 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2506/5002] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:01.253305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeec080-c8b1-4d50-a8d2-092d4b358f97 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:01.259303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2eeec080-c8b1-4d50-a8d2-092d4b358f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:01.283735 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-322b2b53-3bfd-4e67-8bf4-0666112c418e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:01.284959 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-322b2b53-3bfd-4e67-8bf4-0666112c418e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:01.314335 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2497/5003] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:01.314335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd62fb4-19f0-4253-89bc-2e1e8776a69f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:01.314657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd62fb4-19f0-4253-89bc-2e1e8776a69f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:01.314741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd62fb4-19f0-4253-89bc-2e1e8776a69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:01.354599 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-2cd62fb4-19f0-4253-89bc-2e1e8776a69f None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:01.356592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2cd62fb4-19f0-4253-89bc-2e1e8776a69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:01.371406 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2498/5004] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:01.377006 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd62fb4-19f0-4253-89bc-2e1e8776a69f None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:01.378801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2cd62fb4-19f0-4253-89bc-2e1e8776a69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:01.425875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeec080-c8b1-4d50-a8d2-092d4b358f97 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:01.434425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb3d0a-c2ce-4901-b534-3bfbcc35a10c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:01.435191 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb3d0a-c2ce-4901-b534-3bfbcc35a10c service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:01.435578 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb3d0a-c2ce-4901-b534-3bfbcc35a10c service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:01.435963 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb3d0a-c2ce-4901-b534-3bfbcc35a10c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:01.463198 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb3d0a-c2ce-4901-b534-3bfbcc35a10c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:01.466785 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb3d0a-c2ce-4901-b534-3bfbcc35a10c service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:01.492839 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2507/5005] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:21:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:21:01.495064 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd62fb4-19f0-4253-89bc-2e1e8776a69f None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:01.495861 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb3d0a-c2ce-4901-b534-3bfbcc35a10c service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:01.504141 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58abb1f-24e8-4de0-9826-f29e7f3deecc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:01.504979 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58abb1f-24e8-4de0-9826-f29e7f3deecc service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:01.505260 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58abb1f-24e8-4de0-9826-f29e7f3deecc service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:01.506505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58abb1f-24e8-4de0-9826-f29e7f3deecc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:01.509529 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b58abb1f-24e8-4de0-9826-f29e7f3deecc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:01.521856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb3d0a-c2ce-4901-b534-3bfbcc35a10c service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:01.528490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f395251-f4cb-4a7b-a8f6-1019769078cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:01.529347 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f395251-f4cb-4a7b-a8f6-1019769078cb admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:01.529749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f395251-f4cb-4a7b-a8f6-1019769078cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:01.530208 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f395251-f4cb-4a7b-a8f6-1019769078cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:01.531042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f395251-f4cb-4a7b-a8f6-1019769078cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:21:01.531446 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f395251-f4cb-4a7b-a8f6-1019769078cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:01.533160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f395251-f4cb-4a7b-a8f6-1019769078cb admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:01.538642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58abb1f-24e8-4de0-9826-f29e7f3deecc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:01.542806 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58abb1f-24e8-4de0-9826-f29e7f3deecc service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:01.552575 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2508/5006] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:21:01.554005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f395251-f4cb-4a7b-a8f6-1019769078cb admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:01.567430 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f395251-f4cb-4a7b-a8f6-1019769078cb admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:01.572587 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2499/5007] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:21:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:21:01.575025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58abb1f-24e8-4de0-9826-f29e7f3deecc service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:01.576730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e840e-a06b-4c64-913f-8e1ca017cc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:01.577699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e840e-a06b-4c64-913f-8e1ca017cc3a admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:01.578151 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b58abb1f-24e8-4de0-9826-f29e7f3deecc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:01.578522 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e840e-a06b-4c64-913f-8e1ca017cc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:01.579712 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e840e-a06b-4c64-913f-8e1ca017cc3a admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:01.580558 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e840e-a06b-4c64-913f-8e1ca017cc3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:21:01.581974 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e840e-a06b-4c64-913f-8e1ca017cc3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:01.584784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e840e-a06b-4c64-913f-8e1ca017cc3a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:01.616622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58abb1f-24e8-4de0-9826-f29e7f3deecc service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:01.626789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7791770-4f23-4538-a441-0b47f39b4ae4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:01.627548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7791770-4f23-4538-a441-0b47f39b4ae4 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:01.628983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7791770-4f23-4538-a441-0b47f39b4ae4 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:01.629338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7791770-4f23-4538-a441-0b47f39b4ae4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:01.632223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e7791770-4f23-4538-a441-0b47f39b4ae4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:01.638662 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2509/5008] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:21:01.644962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e840e-a06b-4c64-913f-8e1ca017cc3a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:01.650464 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7791770-4f23-4538-a441-0b47f39b4ae4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:01.654191 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7791770-4f23-4538-a441-0b47f39b4ae4 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:01.667112 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e840e-a06b-4c64-913f-8e1ca017cc3a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:01.683488 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb8cbe-b9e4-437e-a4f6-f7eb3af00db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:01.684769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb8cbe-b9e4-437e-a4f6-f7eb3af00db7 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:01.685178 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb8cbe-b9e4-437e-a4f6-f7eb3af00db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:01.685592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb8cbe-b9e4-437e-a4f6-f7eb3af00db7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:01.686559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb8cbe-b9e4-437e-a4f6-f7eb3af00db7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:01.689215 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb8cbe-b9e4-437e-a4f6-f7eb3af00db7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:01.702829 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2500/5009] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:21:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:21:01.703770 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7791770-4f23-4538-a441-0b47f39b4ae4 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:01.725512 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7791770-4f23-4538-a441-0b47f39b4ae4 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:01.741219 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553012b-be87-4e6f-aa2d-f1ae370d760b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:01.742267 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553012b-be87-4e6f-aa2d-f1ae370d760b admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:01.742780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553012b-be87-4e6f-aa2d-f1ae370d760b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:01.745343 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553012b-be87-4e6f-aa2d-f1ae370d760b admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:01.746542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2553012b-be87-4e6f-aa2d-f1ae370d760b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:01.752227 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2553012b-be87-4e6f-aa2d-f1ae370d760b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:01.759652 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2510/5010] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:21:01 2022] POST /identity/v3/projects => generated 369 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:01.760648 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb8cbe-b9e4-437e-a4f6-f7eb3af00db7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:01.820441 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2501/5011] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:21:01 2022] POST /identity/v3/projects => generated 393 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:01.826434 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553012b-be87-4e6f-aa2d-f1ae370d760b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:01.868956 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb8cbe-b9e4-437e-a4f6-f7eb3af00db7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:01.963271 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553012b-be87-4e6f-aa2d-f1ae370d760b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:01.974296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648bc95-bac5-4332-994c-47a84c4214b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:01.975195 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648bc95-bac5-4332-994c-47a84c4214b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:01.977369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648bc95-bac5-4332-994c-47a84c4214b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:01.978210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648bc95-bac5-4332-994c-47a84c4214b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:01.979856 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648bc95-bac5-4332-994c-47a84c4214b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:01.980029 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:02.010401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648bc95-bac5-4332-994c-47a84c4214b5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:02.037452 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf3fb7-98a4-4434-a7c5-51d50739dd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:02.038172 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf3fb7-98a4-4434-a7c5-51d50739dd0e admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:02.038526 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf3fb7-98a4-4434-a7c5-51d50739dd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:02.039509 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf3fb7-98a4-4434-a7c5-51d50739dd0e admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:02.039509 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf3fb7-98a4-4434-a7c5-51d50739dd0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:02.045359 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf3fb7-98a4-4434-a7c5-51d50739dd0e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:02.074959 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2502/5012] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:21:01 2022] POST /identity/v3/users => generated 297 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:02.078635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648bc95-bac5-4332-994c-47a84c4214b5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:02.092138 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:02.097331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648bc95-bac5-4332-994c-47a84c4214b5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:02.106730 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2511/5013] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:21:01 2022] POST /identity/v3/users => generated 285 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:02.113722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf3fb7-98a4-4434-a7c5-51d50739dd0e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:02.123289 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2460403-ed80-4963-a802-85a5d3fd395c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:02.124344 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2460403-ed80-4963-a802-85a5d3fd395c admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:02.125226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2460403-ed80-4963-a802-85a5d3fd395c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:02.125226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2460403-ed80-4963-a802-85a5d3fd395c admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:02.126898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2460403-ed80-4963-a802-85a5d3fd395c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:02.129145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf3fb7-98a4-4434-a7c5-51d50739dd0e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:02.133666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2460403-ed80-4963-a802-85a5d3fd395c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:02.139196 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16bed0-09d3-41ac-aa4e-6fb05dd0d0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:02.141063 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16bed0-09d3-41ac-aa4e-6fb05dd0d0e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:02.143197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16bed0-09d3-41ac-aa4e-6fb05dd0d0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:02.143197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16bed0-09d3-41ac-aa4e-6fb05dd0d0e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:02.146865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16bed0-09d3-41ac-aa4e-6fb05dd0d0e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:02.151015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16bed0-09d3-41ac-aa4e-6fb05dd0d0e3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:02.167985 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2503/5014] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:02.174574 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2460403-ed80-4963-a802-85a5d3fd395c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:02.194918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2460403-ed80-4963-a802-85a5d3fd395c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:02.200490 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2512/5015] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:02.202574 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16bed0-09d3-41ac-aa4e-6fb05dd0d0e3 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:02.204330 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38376894-b19a-4643-bb1a-11e82f085710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:02.205172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38376894-b19a-4643-bb1a-11e82f085710 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:02.205848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38376894-b19a-4643-bb1a-11e82f085710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:02.206441 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38376894-b19a-4643-bb1a-11e82f085710 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:02.207675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38376894-b19a-4643-bb1a-11e82f085710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:02.209666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38376894-b19a-4643-bb1a-11e82f085710 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:02.229704 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16bed0-09d3-41ac-aa4e-6fb05dd0d0e3 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:02.235543 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2504/5016] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:02.236488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38376894-b19a-4643-bb1a-11e82f085710 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:02.242145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428d5dd-cfab-476c-901c-9cfa969c0e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:02.243180 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428d5dd-cfab-476c-901c-9cfa969c0e03 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:02.244168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-38376894-b19a-4643-bb1a-11e82f085710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:02.245365 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428d5dd-cfab-476c-901c-9cfa969c0e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:02.247009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428d5dd-cfab-476c-901c-9cfa969c0e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:02.247881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4428d5dd-cfab-476c-901c-9cfa969c0e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:02.252817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4428d5dd-cfab-476c-901c-9cfa969c0e03 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:02.265548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38376894-b19a-4643-bb1a-11e82f085710 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:02.272009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ced806-2581-4b62-a2d9-76144ab326ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:02.272813 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ced806-2581-4b62-a2d9-76144ab326ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:02.273097 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ced806-2581-4b62-a2d9-76144ab326ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:02.273560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ced806-2581-4b62-a2d9-76144ab326ab admin admin] PATH_INFO: `/v3/projects/afe363157a1c483e9b2ba5300a8ab39a` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:02.276527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ced806-2581-4b62-a2d9-76144ab326ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=afe363157a1c483e9b2ba5300a8ab39a)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:02.282477 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ced806-2581-4b62-a2d9-76144ab326ab admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:02.290852 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2513/5017] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:02.293012 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428d5dd-cfab-476c-901c-9cfa969c0e03 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:02.324439 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428d5dd-cfab-476c-901c-9cfa969c0e03 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:02.353014 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36385c-a388-485a-867a-4af910104d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:02.354694 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36385c-a388-485a-867a-4af910104d57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:02.360276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36385c-a388-485a-867a-4af910104d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:02.363005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36385c-a388-485a-867a-4af910104d57 admin admin] PATH_INFO: `/v3/projects/236b31360354448d96e7af6b6c8e94bc/users/e3029c8759614a508f3b78b80c4ca0bc/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:02.385563 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac36385c-a388-485a-867a-4af910104d57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=236b31360354448d96e7af6b6c8e94bc, user_id=e3029c8759614a508f3b78b80c4ca0bc, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:02.393475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac36385c-a388-485a-867a-4af910104d57 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:02.421874 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2514/5018] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:21:02 2022] PUT /identity/v3/projects/236b31360354448d96e7af6b6c8e94bc/users/e3029c8759614a508f3b78b80c4ca0bc/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:02.424122 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36385c-a388-485a-867a-4af910104d57 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:02.424941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-80ced806-2581-4b62-a2d9-76144ab326ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afe363157a1c483e9b2ba5300a8ab39a', 'request_id': 'req-80ced806-2581-4b62-a2d9-76144ab326ab'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:02.465494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-80ced806-2581-4b62-a2d9-76144ab326ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afe363157a1c483e9b2ba5300a8ab39a', 'request_id': 'req-80ced806-2581-4b62-a2d9-76144ab326ab'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:02.483803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-80ced806-2581-4b62-a2d9-76144ab326ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afe363157a1c483e9b2ba5300a8ab39a', 'request_id': 'req-80ced806-2581-4b62-a2d9-76144ab326ab'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:02.520878 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36385c-a388-485a-867a-4af910104d57 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:02.523901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-80ced806-2581-4b62-a2d9-76144ab326ab admin admin] The token cache is being invalidate because project afe363157a1c483e9b2ba5300a8ab39a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:02.524604 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-80ced806-2581-4b62-a2d9-76144ab326ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:02.535203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-80ced806-2581-4b62-a2d9-76144ab326ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:02.538306 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2505/5019] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:21:02 2022] DELETE /identity/v3/projects/afe363157a1c483e9b2ba5300a8ab39a => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:02.549790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db42b1-6ed5-46a8-8be9-19fe81d27086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:02.550484 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db42b1-6ed5-46a8-8be9-19fe81d27086 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:02.550767 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db42b1-6ed5-46a8-8be9-19fe81d27086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:02.551044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db42b1-6ed5-46a8-8be9-19fe81d27086 admin admin] PATH_INFO: `/v3/projects/f4186c7d200743438d94dfc1cceb915f/users/235d03ded18f41728af86fb0d5e35216/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:02.551897 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89553d1-34d9-4d75-ad6f-5d656ef562da None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:02.552243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89553d1-34d9-4d75-ad6f-5d656ef562da None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:02.552514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89553d1-34d9-4d75-ad6f-5d656ef562da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:02.618670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db42b1-6ed5-46a8-8be9-19fe81d27086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4186c7d200743438d94dfc1cceb915f, user_id=235d03ded18f41728af86fb0d5e35216, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:02.624465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db42b1-6ed5-46a8-8be9-19fe81d27086 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:02.626798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e89553d1-34d9-4d75-ad6f-5d656ef562da None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:02.628289 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e89553d1-34d9-4d75-ad6f-5d656ef562da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:02.651711 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2506/5020] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:02.654491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fc266-51fa-439f-be86-3b459c8350f1 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:02.654784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fc266-51fa-439f-be86-3b459c8350f1 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:02.655058 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fc266-51fa-439f-be86-3b459c8350f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:02.667955 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2515/5021] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:21:02 2022] PUT /identity/v3/projects/f4186c7d200743438d94dfc1cceb915f/users/235d03ded18f41728af86fb0d5e35216/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:02.669496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f8860-4307-4732-90ce-8feaeec5c3c6 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:02.669796 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f8860-4307-4732-90ce-8feaeec5c3c6 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:02.670077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f8860-4307-4732-90ce-8feaeec5c3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:02.711058 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-0d8fc266-51fa-439f-be86-3b459c8350f1 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:02.713585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0d8fc266-51fa-439f-be86-3b459c8350f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:02.744321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-3a2f8860-4307-4732-90ce-8feaeec5c3c6 None None] MFA Rules not processed for user `235d03ded18f41728af86fb0d5e35216`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:02.746202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3a2f8860-4307-4732-90ce-8feaeec5c3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:02.844086 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2507/5022] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:02.845170 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fc266-51fa-439f-be86-3b459c8350f1 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:02.846986 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0d8fc266-51fa-439f-be86-3b459c8350f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:02.901576 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2516/5023] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:02.903156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b59d41-bc89-4aaf-9b62-09ad15ea60c8 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:02.903649 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b59d41-bc89-4aaf-9b62-09ad15ea60c8 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:02.904217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b59d41-bc89-4aaf-9b62-09ad15ea60c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:02.932298 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-05b59d41-bc89-4aaf-9b62-09ad15ea60c8 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:02.933907 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-05b59d41-bc89-4aaf-9b62-09ad15ea60c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:02.937887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fc266-51fa-439f-be86-3b459c8350f1 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:02.941916 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4be3c-c36b-4ae0-9f56-af15f35ec35e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:02.946268 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2517/5024] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:02.946268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b59d41-bc89-4aaf-9b62-09ad15ea60c8 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:02.946268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-05b59d41-bc89-4aaf-9b62-09ad15ea60c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:02.947989 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4be3c-c36b-4ae0-9f56-af15f35ec35e service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:02.948517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4be3c-c36b-4ae0-9f56-af15f35ec35e service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:02.949498 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4be3c-c36b-4ae0-9f56-af15f35ec35e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:02.953162 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:02.965112 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b59d41-bc89-4aaf-9b62-09ad15ea60c8 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:02.965747 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4be3c-c36b-4ae0-9f56-af15f35ec35e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:02.967245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4be3c-c36b-4ae0-9f56-af15f35ec35e service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:02.978113 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746016f-5505-4c35-9a50-e339194f8e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:02.978754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746016f-5505-4c35-9a50-e339194f8e6b admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:02.979033 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746016f-5505-4c35-9a50-e339194f8e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:02.979305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746016f-5505-4c35-9a50-e339194f8e6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:02.979953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746016f-5505-4c35-9a50-e339194f8e6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:02.980547 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2508/5025] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:21:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:21:02.981400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4be3c-c36b-4ae0-9f56-af15f35ec35e service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:02.983130 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746016f-5505-4c35-9a50-e339194f8e6b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:02.987372 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:02.997620 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4be3c-c36b-4ae0-9f56-af15f35ec35e service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:03.010513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a71030-ff21-4148-a0c1-01230325036f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:03.011757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a71030-ff21-4148-a0c1-01230325036f admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:03.012101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a71030-ff21-4148-a0c1-01230325036f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:03.012463 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a71030-ff21-4148-a0c1-01230325036f admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:03.014283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a71030-ff21-4148-a0c1-01230325036f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:21:03.014811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a71030-ff21-4148-a0c1-01230325036f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:03.018567 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a71030-ff21-4148-a0c1-01230325036f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:03.037604 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2518/5026] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:21:02 2022] POST /identity/v3/projects => generated 367 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:03.042794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746016f-5505-4c35-9a50-e339194f8e6b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:03.043003 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2509/5027] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:21:03.046993 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a71030-ff21-4148-a0c1-01230325036f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:03.063804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a71030-ff21-4148-a0c1-01230325036f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:03.145518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746016f-5505-4c35-9a50-e339194f8e6b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:03.156321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c4bb8-8db4-4c43-8d16-1ae92e25f8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:03.157206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c4bb8-8db4-4c43-8d16-1ae92e25f8ce admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:03.157518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c4bb8-8db4-4c43-8d16-1ae92e25f8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:03.157844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c4bb8-8db4-4c43-8d16-1ae92e25f8ce admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:03.158537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c4bb8-8db4-4c43-8d16-1ae92e25f8ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:03.161181 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c4bb8-8db4-4c43-8d16-1ae92e25f8ce admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:03.166211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf78c5-04c8-44c8-b6f7-3ad342712f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:03.167635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf78c5-04c8-44c8-b6f7-3ad342712f04 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:03.169099 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf78c5-04c8-44c8-b6f7-3ad342712f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:03.169397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf78c5-04c8-44c8-b6f7-3ad342712f04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:03.170083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf78c5-04c8-44c8-b6f7-3ad342712f04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:03.178543 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf78c5-04c8-44c8-b6f7-3ad342712f04 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:03.207540 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2519/5028] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:21:03 2022] POST /identity/v3/users => generated 290 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:03.211471 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c4bb8-8db4-4c43-8d16-1ae92e25f8ce admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:03.234504 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c4bb8-8db4-4c43-8d16-1ae92e25f8ce admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:03.258563 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2510/5029] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:21:03 2022] POST /identity/v3/projects => generated 375 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:03.258777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa1dbe-d306-4726-857a-505c92669fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:03.258777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa1dbe-d306-4726-857a-505c92669fba admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:03.258777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa1dbe-d306-4726-857a-505c92669fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:03.258777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa1dbe-d306-4726-857a-505c92669fba admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:03.259713 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa1dbe-d306-4726-857a-505c92669fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:03.260292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf78c5-04c8-44c8-b6f7-3ad342712f04 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:03.262211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa1dbe-d306-4726-857a-505c92669fba admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:03.308182 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2520/5030] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:03.309532 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa1dbe-d306-4726-857a-505c92669fba admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:03.347829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa1dbe-d306-4726-857a-505c92669fba admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:03.395692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf78c5-04c8-44c8-b6f7-3ad342712f04 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:03.403019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0f2a9-372e-4df5-a22f-ff95dd3db9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:03.403702 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0f2a9-372e-4df5-a22f-ff95dd3db9a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:03.404072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0f2a9-372e-4df5-a22f-ff95dd3db9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:03.404351 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0f2a9-372e-4df5-a22f-ff95dd3db9a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:03.405066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b0f2a9-372e-4df5-a22f-ff95dd3db9a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:03.408692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b0f2a9-372e-4df5-a22f-ff95dd3db9a0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:03.470920 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2511/5031] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:21:03 2022] POST /identity/v3/users => generated 288 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:03.471922 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0f2a9-372e-4df5-a22f-ff95dd3db9a0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:03.486270 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0f2a9-372e-4df5-a22f-ff95dd3db9a0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:03.503846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5359ecf-5022-409f-bdf9-8fefa3451949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:03.504476 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5359ecf-5022-409f-bdf9-8fefa3451949 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:03.504758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5359ecf-5022-409f-bdf9-8fefa3451949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:03.505023 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5359ecf-5022-409f-bdf9-8fefa3451949 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:03.505696 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5359ecf-5022-409f-bdf9-8fefa3451949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:03.507296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5359ecf-5022-409f-bdf9-8fefa3451949 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:03.523928 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282701e-9485-4b79-a1b4-ec06ede457d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:03.524401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282701e-9485-4b79-a1b4-ec06ede457d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:03.524715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282701e-9485-4b79-a1b4-ec06ede457d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:03.525040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282701e-9485-4b79-a1b4-ec06ede457d1 admin admin] PATH_INFO: `/v3/projects/543b489cbe5c4fba8fd5e5504b339d29/users/eff86e31de984534a6ca4e8d4e2444b1/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:03.554351 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2512/5032] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:03.559180 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5359ecf-5022-409f-bdf9-8fefa3451949 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:03.576223 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282701e-9485-4b79-a1b4-ec06ede457d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=543b489cbe5c4fba8fd5e5504b339d29, user_id=eff86e31de984534a6ca4e8d4e2444b1, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:03.579353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282701e-9485-4b79-a1b4-ec06ede457d1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:03.580577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5359ecf-5022-409f-bdf9-8fefa3451949 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:03.592979 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f55ed7-40b2-4d8b-9200-65ace00b1ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:03.595890 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f55ed7-40b2-4d8b-9200-65ace00b1ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:03.596290 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f55ed7-40b2-4d8b-9200-65ace00b1ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:03.597995 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f55ed7-40b2-4d8b-9200-65ace00b1ab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:03.599698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f55ed7-40b2-4d8b-9200-65ace00b1ab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:03.605580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f55ed7-40b2-4d8b-9200-65ace00b1ab0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:03.611713 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2521/5033] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:21:03 2022] PUT /identity/v3/projects/543b489cbe5c4fba8fd5e5504b339d29/users/eff86e31de984534a6ca4e8d4e2444b1/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:03.615668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282701e-9485-4b79-a1b4-ec06ede457d1 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:03.628090 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2513/5034] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:03.633162 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f55ed7-40b2-4d8b-9200-65ace00b1ab0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:03.666985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f55ed7-40b2-4d8b-9200-65ace00b1ab0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:03.715534 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:03.759848 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282701e-9485-4b79-a1b4-ec06ede457d1 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:03.778033 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347cdf5-3095-4db7-a128-91d0dcbbee02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:03.778670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347cdf5-3095-4db7-a128-91d0dcbbee02 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:03.779347 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347cdf5-3095-4db7-a128-91d0dcbbee02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:03.779632 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347cdf5-3095-4db7-a128-91d0dcbbee02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:03.780285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6347cdf5-3095-4db7-a128-91d0dcbbee02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:03.781982 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6347cdf5-3095-4db7-a128-91d0dcbbee02 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:03.800029 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2522/5035] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:03.804180 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347cdf5-3095-4db7-a128-91d0dcbbee02 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:03.810546 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:03.819738 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347cdf5-3095-4db7-a128-91d0dcbbee02 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:03.827652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ec908-27fa-4f5b-be1c-db675982d840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:03.828688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ec908-27fa-4f5b-be1c-db675982d840 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:03.829128 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ec908-27fa-4f5b-be1c-db675982d840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:03.829741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ec908-27fa-4f5b-be1c-db675982d840 admin admin] PATH_INFO: `/v3/projects/543b489cbe5c4fba8fd5e5504b339d29/users/eff86e31de984534a6ca4e8d4e2444b1/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:03.855366 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dce0b0-5ede-44b9-85b6-c8da27d445d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:03.856113 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dce0b0-5ede-44b9-85b6-c8da27d445d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:03.856575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dce0b0-5ede-44b9-85b6-c8da27d445d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:03.857004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dce0b0-5ede-44b9-85b6-c8da27d445d5 admin admin] PATH_INFO: `/v3/projects/a5d14384422244438a5a127101ac2823/users/b7ef54acb7474d39b8d0734f56a0bb47/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:03.859961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ec908-27fa-4f5b-be1c-db675982d840 admin admin] RBAC: Authorizing `identity:create_grant(project_id=543b489cbe5c4fba8fd5e5504b339d29, user_id=eff86e31de984534a6ca4e8d4e2444b1, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:03.873371 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ec908-27fa-4f5b-be1c-db675982d840 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:03.890804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dce0b0-5ede-44b9-85b6-c8da27d445d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5d14384422244438a5a127101ac2823, user_id=b7ef54acb7474d39b8d0734f56a0bb47, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:03.896583 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dce0b0-5ede-44b9-85b6-c8da27d445d5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:03.914007 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2523/5036] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:21:03 2022] PUT /identity/v3/projects/543b489cbe5c4fba8fd5e5504b339d29/users/eff86e31de984534a6ca4e8d4e2444b1/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:21:03.925284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3dd58-72d2-4893-9d6f-b2c77f69d1f1 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:03.925783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3dd58-72d2-4893-9d6f-b2c77f69d1f1 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:03.926061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3dd58-72d2-4893-9d6f-b2c77f69d1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:03.931501 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2514/5037] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:21:03 2022] PUT /identity/v3/projects/a5d14384422244438a5a127101ac2823/users/b7ef54acb7474d39b8d0734f56a0bb47/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:03.942766 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413a793-11c8-4371-bba5-4593ec5bce6a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:03.943217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413a793-11c8-4371-bba5-4593ec5bce6a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:03.943570 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413a793-11c8-4371-bba5-4593ec5bce6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:03.983175 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-5bb3dd58-72d2-4893-9d6f-b2c77f69d1f1 None None] MFA Rules not processed for user `eff86e31de984534a6ca4e8d4e2444b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:03.985061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5bb3dd58-72d2-4893-9d6f-b2c77f69d1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:04.020953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c413a793-11c8-4371-bba5-4593ec5bce6a None None] MFA Rules not processed for user `b7ef54acb7474d39b8d0734f56a0bb47`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:04.024935 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c413a793-11c8-4371-bba5-4593ec5bce6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:04.120531 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2524/5038] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:03 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:04.125631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3dd58-72d2-4893-9d6f-b2c77f69d1f1 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:04.139170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3dd58-72d2-4893-9d6f-b2c77f69d1f1 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:04.147067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab3e22-f482-4290-a63d-d8d2bffa69f4 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:04.148003 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab3e22-f482-4290-a63d-d8d2bffa69f4 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:04.148446 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab3e22-f482-4290-a63d-d8d2bffa69f4 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:04.150825 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab3e22-f482-4290-a63d-d8d2bffa69f4 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:04.151240 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2515/5039] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:04.151878 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab3e22-f482-4290-a63d-d8d2bffa69f4 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:04.153923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab3e22-f482-4290-a63d-d8d2bffa69f4 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:04.187225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413a793-11c8-4371-bba5-4593ec5bce6a None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:04.189748 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c413a793-11c8-4371-bba5-4593ec5bce6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:04.193502 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2525/5040] 10.222.0.30 () {60 vars in 1152 bytes} [Sun Sep 4 01:21:04 2022] POST /identity/v3/projects => generated 328 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:04.196108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab3e22-f482-4290-a63d-d8d2bffa69f4 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:04.285187 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413a793-11c8-4371-bba5-4593ec5bce6a None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:04.289677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab3e22-f482-4290-a63d-d8d2bffa69f4 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:04.298272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba1f6e-c0c2-4f8d-884f-abd47c503713 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:04.299210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba1f6e-c0c2-4f8d-884f-abd47c503713 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:04.299939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba1f6e-c0c2-4f8d-884f-abd47c503713 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:04.299939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba1f6e-c0c2-4f8d-884f-abd47c503713 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:04.301397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba1f6e-c0c2-4f8d-884f-abd47c503713 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:04.306734 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba1f6e-c0c2-4f8d-884f-abd47c503713 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:04.345013 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2526/5041] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:21:04 2022] POST /identity/v3/users => generated 413 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:21:04.347673 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba1f6e-c0c2-4f8d-884f-abd47c503713 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:04.361217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba1f6e-c0c2-4f8d-884f-abd47c503713 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:04.368004 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170e329-e952-4770-85b7-4b64f04da510 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:04.384209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170e329-e952-4770-85b7-4b64f04da510 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:04.384579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170e329-e952-4770-85b7-4b64f04da510 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:04.385953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170e329-e952-4770-85b7-4b64f04da510 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:04.388509 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170e329-e952-4770-85b7-4b64f04da510 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:04.389735 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b909703-0ed7-487a-9c59-6a0cf7f1ec9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:04.390371 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b909703-0ed7-487a-9c59-6a0cf7f1ec9e service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:04.390671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b909703-0ed7-487a-9c59-6a0cf7f1ec9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:04.391105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b909703-0ed7-487a-9c59-6a0cf7f1ec9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:04.393280 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170e329-e952-4770-85b7-4b64f04da510 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:04.423918 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2527/5042] 10.222.0.30 () {60 vars in 1143 bytes} [Sun Sep 4 01:21:04 2022] POST /identity/v3/roles => generated 244 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:04.426045 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170e329-e952-4770-85b7-4b64f04da510 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:04.435980 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:04.446829 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:04.449024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170e329-e952-4770-85b7-4b64f04da510 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:04.460070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918acb8-28fc-455f-8abc-571466caa117 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:04.460750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918acb8-28fc-455f-8abc-571466caa117 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:04.461037 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918acb8-28fc-455f-8abc-571466caa117 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:04.461315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918acb8-28fc-455f-8abc-571466caa117 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:04.462068 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918acb8-28fc-455f-8abc-571466caa117 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:04.463807 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918acb8-28fc-455f-8abc-571466caa117 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:04.487499 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2528/5043] 10.222.0.30 () {60 vars in 1143 bytes} [Sun Sep 4 01:21:04 2022] POST /identity/v3/roles => generated 247 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:04.489004 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918acb8-28fc-455f-8abc-571466caa117 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:04.507477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918acb8-28fc-455f-8abc-571466caa117 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:04.512806 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b909703-0ed7-487a-9c59-6a0cf7f1ec9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:04.514739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b909703-0ed7-487a-9c59-6a0cf7f1ec9e service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:04.527336 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2516/5044] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:21:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:21:04.529018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de2e71-d036-45cb-b7d2-b1b673d01f4f tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:04.530076 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de2e71-d036-45cb-b7d2-b1b673d01f4f tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:04.530511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de2e71-d036-45cb-b7d2-b1b673d01f4f tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:04.531266 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de2e71-d036-45cb-b7d2-b1b673d01f4f tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/projects/c23eec8c2dc7435aa10f724034d77259/users/35f95780bc48421d8342eae098a8ac69/roles/72d017a951964c3c829301c95cd4e4b7` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:04.552330 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b909703-0ed7-487a-9c59-6a0cf7f1ec9e service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:04.561522 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de2e71-d036-45cb-b7d2-b1b673d01f4f tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c23eec8c2dc7435aa10f724034d77259, user_id=35f95780bc48421d8342eae098a8ac69, role_id=72d017a951964c3c829301c95cd4e4b7)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:04.565015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de2e71-d036-45cb-b7d2-b1b673d01f4f tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:04.588737 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2529/5045] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:21:04 2022] PUT /identity/v3/projects/c23eec8c2dc7435aa10f724034d77259/users/35f95780bc48421d8342eae098a8ac69/roles/72d017a951964c3c829301c95cd4e4b7 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:04.593080 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de2e71-d036-45cb-b7d2-b1b673d01f4f tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:04.740102 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de2e71-d036-45cb-b7d2-b1b673d01f4f tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:04.740960 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b909703-0ed7-487a-9c59-6a0cf7f1ec9e service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:04.763328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5186b6-9e1e-4815-8c78-c785ac544895 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:04.763930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5186b6-9e1e-4815-8c78-c785ac544895 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:04.764241 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5186b6-9e1e-4815-8c78-c785ac544895 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:04.764513 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5186b6-9e1e-4815-8c78-c785ac544895 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/projects/c23eec8c2dc7435aa10f724034d77259/users/35f95780bc48421d8342eae098a8ac69/roles/8ad0531471f34594abd3fdf41e032cf6` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:04.767029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5186b6-9e1e-4815-8c78-c785ac544895 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c23eec8c2dc7435aa10f724034d77259, user_id=35f95780bc48421d8342eae098a8ac69, role_id=8ad0531471f34594abd3fdf41e032cf6)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:04.769758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5186b6-9e1e-4815-8c78-c785ac544895 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:04.815437 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2530/5046] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:21:04 2022] PUT /identity/v3/projects/c23eec8c2dc7435aa10f724034d77259/users/35f95780bc48421d8342eae098a8ac69/roles/8ad0531471f34594abd3fdf41e032cf6 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:21:04.819456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5186b6-9e1e-4815-8c78-c785ac544895 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:04.826546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40003f-1859-49c9-9cee-4b55933ea837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:04.827373 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40003f-1859-49c9-9cee-4b55933ea837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:04.827876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40003f-1859-49c9-9cee-4b55933ea837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:04.828166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40003f-1859-49c9-9cee-4b55933ea837 admin admin] PATH_INFO: `/v3/users/b7ef54acb7474d39b8d0734f56a0bb47` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:04.830975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e40003f-1859-49c9-9cee-4b55933ea837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7ef54acb7474d39b8d0734f56a0bb47)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:04.833113 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e40003f-1859-49c9-9cee-4b55933ea837 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:04.976693 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6e40003f-1859-49c9-9cee-4b55933ea837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7ef54acb7474d39b8d0734f56a0bb47'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:04.981898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6e40003f-1859-49c9-9cee-4b55933ea837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7ef54acb7474d39b8d0734f56a0bb47'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:05.005101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6e40003f-1859-49c9-9cee-4b55933ea837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7ef54acb7474d39b8d0734f56a0bb47'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:05.027338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6e40003f-1859-49c9-9cee-4b55933ea837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7ef54acb7474d39b8d0734f56a0bb47'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:05.027984 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6e40003f-1859-49c9-9cee-4b55933ea837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7ef54acb7474d39b8d0734f56a0bb47'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:05.030527 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5186b6-9e1e-4815-8c78-c785ac544895 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:05.040888 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:05.043977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5adabd-01b0-4df9-a3e4-296ffb9cd3cd tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:05.044711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5adabd-01b0-4df9-a3e4-296ffb9cd3cd tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:05.045251 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5adabd-01b0-4df9-a3e4-296ffb9cd3cd tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:05.045842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5adabd-01b0-4df9-a3e4-296ffb9cd3cd tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:05.046600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5adabd-01b0-4df9-a3e4-296ffb9cd3cd tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:05.048452 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-aa5adabd-01b0-4df9-a3e4-296ffb9cd3cd tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:21:05.048452 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:21:05.048452 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:21:05.051336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5adabd-01b0-4df9-a3e4-296ffb9cd3cd tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:05.061195 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2517/5047] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:21:04 2022] DELETE /identity/v3/users/b7ef54acb7474d39b8d0734f56a0bb47 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:21:05.065684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f67d4-0af8-48be-a988-3c93d48afc1f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:05.066473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f67d4-0af8-48be-a988-3c93d48afc1f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:05.067099 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f67d4-0af8-48be-a988-3c93d48afc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:05.096799 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2531/5048] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:04 2022] GET /identity/v3/users => generated 8047 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:21:05.101722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c2f46-af61-47ce-993f-2ef8086d8bc8 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:05.102130 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c2f46-af61-47ce-993f-2ef8086d8bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:05.103247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c2f46-af61-47ce-993f-2ef8086d8bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:05.105130 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c35f67d4-0af8-48be-a988-3c93d48afc1f None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:05.106426 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c35f67d4-0af8-48be-a988-3c93d48afc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:05.150609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-978c2f46-af61-47ce-993f-2ef8086d8bc8 None None] MFA Rules not processed for user `35f95780bc48421d8342eae098a8ac69`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:05.151989 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-978c2f46-af61-47ce-993f-2ef8086d8bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:05.203421 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2518/5049] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:21:05.204981 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:05.216726 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f67d4-0af8-48be-a988-3c93d48afc1f None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:05.218601 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c35f67d4-0af8-48be-a988-3c93d48afc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:05.236301 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2532/5050] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:05 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:21:05.248400 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49ad8b-8a1f-48cd-90c0-be5ee5f90202 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:05.248836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49ad8b-8a1f-48cd-90c0-be5ee5f90202 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:05.249398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49ad8b-8a1f-48cd-90c0-be5ee5f90202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:05.270345 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-9d49ad8b-8a1f-48cd-90c0-be5ee5f90202 None None] MFA Rules not processed for user `35f95780bc48421d8342eae098a8ac69`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:05.271865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9d49ad8b-8a1f-48cd-90c0-be5ee5f90202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:05.281554 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2533/5051] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:05 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:21:05.285336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49ad8b-8a1f-48cd-90c0-be5ee5f90202 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:05.296938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f67d4-0af8-48be-a988-3c93d48afc1f None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:05.300878 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b5282-0cf7-49d2-9f0d-d695c4c227ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:05.301537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b5282-0cf7-49d2-9f0d-d695c4c227ea service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:05.301820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b5282-0cf7-49d2-9f0d-d695c4c227ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:05.302248 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b5282-0cf7-49d2-9f0d-d695c4c227ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:05.303720 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49ad8b-8a1f-48cd-90c0-be5ee5f90202 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:05.308766 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f478f-e895-47ae-b698-c8aae6041dce tempest-TrustsV3TestJSON-436786379 tempest-user-170828462] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f95780bc48421d8342eae098a8ac69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c23eec8c2dc7435aa10f724034d77259', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1065428028', 'tempest-DelegatedRole-2140732476'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:05.309584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f478f-e895-47ae-b698-c8aae6041dce tempest-TrustsV3TestJSON-436786379 tempest-user-170828462] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:05.310162 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f478f-e895-47ae-b698-c8aae6041dce tempest-TrustsV3TestJSON-436786379 tempest-user-170828462] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:05.310321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f478f-e895-47ae-b698-c8aae6041dce tempest-TrustsV3TestJSON-436786379 tempest-user-170828462] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:05.311328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f478f-e895-47ae-b698-c8aae6041dce tempest-TrustsV3TestJSON-436786379 tempest-user-170828462] RBAC: Authorizing `identity:create_trust()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:05.312626 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f478f-e895-47ae-b698-c8aae6041dce tempest-TrustsV3TestJSON-436786379 tempest-user-170828462] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:05.313346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b5282-0cf7-49d2-9f0d-d695c4c227ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:05.315036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b5282-0cf7-49d2-9f0d-d695c4c227ea service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:05.340854 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2519/5052] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:21:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:21:05.423374 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2534/5053] 10.222.0.30 () {60 vars in 1174 bytes} [Sun Sep 4 01:21:05 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:05.427954 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b5282-0cf7-49d2-9f0d-d695c4c227ea service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:05.429401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-932b5282-0cf7-49d2-9f0d-d695c4c227ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:05.520883 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b5282-0cf7-49d2-9f0d-d695c4c227ea service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:05.526187 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b523c-ef92-417b-902d-05ed4f712a42 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:05.526972 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b523c-ef92-417b-902d-05ed4f712a42 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:05.527254 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b523c-ef92-417b-902d-05ed4f712a42 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:05.527525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b523c-ef92-417b-902d-05ed4f712a42 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:05.528165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b523c-ef92-417b-902d-05ed4f712a42 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:05.529175 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-ef6b523c-ef92-417b-902d-05ed4f712a42 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:21:05.529175 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:21:05.529175 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:21:05.530379 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b523c-ef92-417b-902d-05ed4f712a42 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:05.538093 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2520/5054] 10.222.0.30 () {58 vars in 1155 bytes} [Sun Sep 4 01:21:05 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:21:05.542715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f478f-e895-47ae-b698-c8aae6041dce tempest-TrustsV3TestJSON-436786379 tempest-user-170828462] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:05.552682 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f478f-e895-47ae-b698-c8aae6041dce tempest-TrustsV3TestJSON-436786379 tempest-user-170828462] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:05.557210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5982e-8948-4ab1-a553-5811a2c4ec8f tempest-TrustsV3TestJSON-436786379 tempest-user-170828462] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f95780bc48421d8342eae098a8ac69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c23eec8c2dc7435aa10f724034d77259', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1065428028', 'tempest-DelegatedRole-2140732476'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:05.558293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5982e-8948-4ab1-a553-5811a2c4ec8f tempest-TrustsV3TestJSON-436786379 tempest-user-170828462] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:05.558293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5982e-8948-4ab1-a553-5811a2c4ec8f tempest-TrustsV3TestJSON-436786379 tempest-user-170828462] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:05.558507 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5982e-8948-4ab1-a553-5811a2c4ec8f tempest-TrustsV3TestJSON-436786379 tempest-user-170828462] PATH_INFO: `/v3/OS-TRUST/trusts/1064ed15e3584db8a907c09b6d04772f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:05.570730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5982e-8948-4ab1-a553-5811a2c4ec8f tempest-TrustsV3TestJSON-436786379 tempest-user-170828462] RBAC: Authorizing `identity:delete_trust(trust_id=1064ed15e3584db8a907c09b6d04772f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:05.572761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5982e-8948-4ab1-a553-5811a2c4ec8f tempest-TrustsV3TestJSON-436786379 tempest-user-170828462] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:05.607236 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-16a5982e-8948-4ab1-a553-5811a2c4ec8f tempest-TrustsV3TestJSON-436786379 tempest-user-170828462] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '1064ed15e3584db8a907c09b6d04772f', 'request_id': 'req-16a5982e-8948-4ab1-a553-5811a2c4ec8f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:05.624997 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-16a5982e-8948-4ab1-a553-5811a2c4ec8f tempest-TrustsV3TestJSON-436786379 tempest-user-170828462] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '1064ed15e3584db8a907c09b6d04772f', 'request_id': 'req-16a5982e-8948-4ab1-a553-5811a2c4ec8f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:05.625741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-16a5982e-8948-4ab1-a553-5811a2c4ec8f tempest-TrustsV3TestJSON-436786379 tempest-user-170828462] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '1064ed15e3584db8a907c09b6d04772f', 'request_id': 'req-16a5982e-8948-4ab1-a553-5811a2c4ec8f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:05.642937 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2535/5055] 10.222.0.30 () {58 vars in 1254 bytes} [Sun Sep 4 01:21:05 2022] DELETE /identity/v3/OS-TRUST/trusts/1064ed15e3584db8a907c09b6d04772f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:05.646841 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b523c-ef92-417b-902d-05ed4f712a42 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:05.648773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ef6b523c-ef92-417b-902d-05ed4f712a42 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:05.673346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b523c-ef92-417b-902d-05ed4f712a42 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:05.681489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68ff9b-a756-4dbb-a1e6-215a46cfe163 tempest-TrustsV3TestJSON-436786379 tempest-user-170828462] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f95780bc48421d8342eae098a8ac69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c23eec8c2dc7435aa10f724034d77259', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1065428028', 'tempest-DelegatedRole-2140732476'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:05.682927 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68ff9b-a756-4dbb-a1e6-215a46cfe163 tempest-TrustsV3TestJSON-436786379 tempest-user-170828462] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:05.683342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68ff9b-a756-4dbb-a1e6-215a46cfe163 tempest-TrustsV3TestJSON-436786379 tempest-user-170828462] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:05.683720 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68ff9b-a756-4dbb-a1e6-215a46cfe163 tempest-TrustsV3TestJSON-436786379 tempest-user-170828462] PATH_INFO: `/v3/OS-TRUST/trusts/1064ed15e3584db8a907c09b6d04772f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:05.724887 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-7c68ff9b-a756-4dbb-a1e6-215a46cfe163 tempest-TrustsV3TestJSON-436786379 tempest-user-170828462] Could not find trust: 1064ed15e3584db8a907c09b6d04772f.: keystone.exception.TrustNotFound: Could not find trust: 1064ed15e3584db8a907c09b6d04772f. Sep 04 01:21:05.724887 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:21:05.724887 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:21:05.724887 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:21:05.724887 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:21:05.724887 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:21:05.724887 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:21:05.724887 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:21:05.724887 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:21:05.724887 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:21:05.724887 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:21:05.724887 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:21:05.724887 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Sep 04 01:21:05.724887 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Sep 04 01:21:05.724887 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Sep 04 01:21:05.726156 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Sep 04 01:21:05.726156 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Sep 04 01:21:05.726156 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Sep 04 01:21:05.726156 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Sep 04 01:21:05.726156 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Sep 04 01:21:05.726156 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:21:05.726156 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:21:05.726156 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Sep 04 01:21:05.726156 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Sep 04 01:21:05.726156 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Sep 04 01:21:05.726156 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Sep 04 01:21:05.726156 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 1064ed15e3584db8a907c09b6d04772f. Sep 04 01:21:05.726156 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:21:05.728588 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2521/5056] 10.222.0.30 () {58 vars in 1251 bytes} [Sun Sep 4 01:21:05 2022] GET /identity/v3/OS-TRUST/trusts/1064ed15e3584db8a907c09b6d04772f => generated 111 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Sep 04 01:21:05.733315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5982e-8948-4ab1-a553-5811a2c4ec8f tempest-TrustsV3TestJSON-436786379 tempest-user-170828462] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:05.737205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-16a5982e-8948-4ab1-a553-5811a2c4ec8f tempest-TrustsV3TestJSON-436786379 tempest-user-170828462] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:05.757146 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5982e-8948-4ab1-a553-5811a2c4ec8f tempest-TrustsV3TestJSON-436786379 tempest-user-170828462] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:05.763923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809aaa2-4a70-4475-ba39-345c19901966 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:05.764756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809aaa2-4a70-4475-ba39-345c19901966 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:05.765039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809aaa2-4a70-4475-ba39-345c19901966 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:05.765952 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809aaa2-4a70-4475-ba39-345c19901966 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/roles/8ad0531471f34594abd3fdf41e032cf6` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:05.769211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809aaa2-4a70-4475-ba39-345c19901966 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8ad0531471f34594abd3fdf41e032cf6)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:05.771572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809aaa2-4a70-4475-ba39-345c19901966 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:05.833718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4809aaa2-4a70-4475-ba39-345c19901966 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invalidating the token cache because role 8ad0531471f34594abd3fdf41e032cf6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:05.834149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4809aaa2-4a70-4475-ba39-345c19901966 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:05.834984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4809aaa2-4a70-4475-ba39-345c19901966 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:05.842866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68ff9b-a756-4dbb-a1e6-215a46cfe163 tempest-TrustsV3TestJSON-436786379 tempest-user-170828462] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:05.844321 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2536/5057] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:21:05 2022] DELETE /identity/v3/roles/8ad0531471f34594abd3fdf41e032cf6 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:05.845998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7c68ff9b-a756-4dbb-a1e6-215a46cfe163 tempest-TrustsV3TestJSON-436786379 tempest-user-170828462] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:05.865187 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68ff9b-a756-4dbb-a1e6-215a46cfe163 tempest-TrustsV3TestJSON-436786379 tempest-user-170828462] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:05.895261 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:05.958437 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3cd68e-bdb2-43c8-a676-141b562c2861 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:05.959087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3cd68e-bdb2-43c8-a676-141b562c2861 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:05.959786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3cd68e-bdb2-43c8-a676-141b562c2861 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:05.959786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3cd68e-bdb2-43c8-a676-141b562c2861 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/roles/72d017a951964c3c829301c95cd4e4b7` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:05.961065 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3cd68e-bdb2-43c8-a676-141b562c2861 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:delete_role(role_id=72d017a951964c3c829301c95cd4e4b7)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:05.963345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3cd68e-bdb2-43c8-a676-141b562c2861 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:06.035836 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dc3cd68e-bdb2-43c8-a676-141b562c2861 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invalidating the token cache because role 72d017a951964c3c829301c95cd4e4b7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:06.035836 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dc3cd68e-bdb2-43c8-a676-141b562c2861 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:06.037227 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dc3cd68e-bdb2-43c8-a676-141b562c2861 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:06.042513 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2522/5058] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:21:05 2022] DELETE /identity/v3/roles/72d017a951964c3c829301c95cd4e4b7 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:06.043671 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809aaa2-4a70-4475-ba39-345c19901966 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:06.054140 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809aaa2-4a70-4475-ba39-345c19901966 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:06.135328 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:06.177677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff2b23-b7b5-41a1-9a22-f6d7591c48cf tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:06.178837 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff2b23-b7b5-41a1-9a22-f6d7591c48cf tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:06.178837 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff2b23-b7b5-41a1-9a22-f6d7591c48cf tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:06.179265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff2b23-b7b5-41a1-9a22-f6d7591c48cf tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/users/35f95780bc48421d8342eae098a8ac69` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:06.182843 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff2b23-b7b5-41a1-9a22-f6d7591c48cf tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:delete_user(user_id=35f95780bc48421d8342eae098a8ac69)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:06.185938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff2b23-b7b5-41a1-9a22-f6d7591c48cf tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:06.278990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2cff2b23-b7b5-41a1-9a22-f6d7591c48cf tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35f95780bc48421d8342eae098a8ac69'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:06.279692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2cff2b23-b7b5-41a1-9a22-f6d7591c48cf tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35f95780bc48421d8342eae098a8ac69'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:06.295422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2cff2b23-b7b5-41a1-9a22-f6d7591c48cf tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35f95780bc48421d8342eae098a8ac69'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:06.318063 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2cff2b23-b7b5-41a1-9a22-f6d7591c48cf tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35f95780bc48421d8342eae098a8ac69'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:06.319104 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2cff2b23-b7b5-41a1-9a22-f6d7591c48cf tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35f95780bc48421d8342eae098a8ac69'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:06.366734 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2537/5059] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:21:06 2022] DELETE /identity/v3/users/35f95780bc48421d8342eae098a8ac69 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:06.374924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3cd68e-bdb2-43c8-a676-141b562c2861 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:06.376765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-dc3cd68e-bdb2-43c8-a676-141b562c2861 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:06.392271 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3cd68e-bdb2-43c8-a676-141b562c2861 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:06.487710 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b898a2-264d-4fa8-bc83-41879fa54888 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:06.488995 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b898a2-264d-4fa8-bc83-41879fa54888 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:06.489497 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b898a2-264d-4fa8-bc83-41879fa54888 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:06.489928 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b898a2-264d-4fa8-bc83-41879fa54888 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/projects/c23eec8c2dc7435aa10f724034d77259` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:06.491385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b898a2-264d-4fa8-bc83-41879fa54888 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c23eec8c2dc7435aa10f724034d77259)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:06.494223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b898a2-264d-4fa8-bc83-41879fa54888 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:06.568941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-86b898a2-264d-4fa8-bc83-41879fa54888 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c23eec8c2dc7435aa10f724034d77259', 'request_id': 'req-86b898a2-264d-4fa8-bc83-41879fa54888'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:06.584049 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-86b898a2-264d-4fa8-bc83-41879fa54888 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c23eec8c2dc7435aa10f724034d77259', 'request_id': 'req-86b898a2-264d-4fa8-bc83-41879fa54888'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:06.596848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-86b898a2-264d-4fa8-bc83-41879fa54888 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c23eec8c2dc7435aa10f724034d77259', 'request_id': 'req-86b898a2-264d-4fa8-bc83-41879fa54888'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:06.612758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-86b898a2-264d-4fa8-bc83-41879fa54888 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] The token cache is being invalidate because project c23eec8c2dc7435aa10f724034d77259 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:06.613992 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-86b898a2-264d-4fa8-bc83-41879fa54888 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:06.614344 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-86b898a2-264d-4fa8-bc83-41879fa54888 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:06.616896 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2523/5060] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:21:06 2022] DELETE /identity/v3/projects/c23eec8c2dc7435aa10f724034d77259 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:06.623519 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff2b23-b7b5-41a1-9a22-f6d7591c48cf tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:06.625019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2cff2b23-b7b5-41a1-9a22-f6d7591c48cf tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:06.644736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff2b23-b7b5-41a1-9a22-f6d7591c48cf tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:06.745561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c075db-b0df-4789-a97f-005ab985ec88 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:06.746450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c075db-b0df-4789-a97f-005ab985ec88 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:06.747057 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c075db-b0df-4789-a97f-005ab985ec88 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:06.748143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c075db-b0df-4789-a97f-005ab985ec88 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:06.749187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c075db-b0df-4789-a97f-005ab985ec88 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:06.751956 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c075db-b0df-4789-a97f-005ab985ec88 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:06.818885 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2538/5061] 10.222.0.30 () {60 vars in 1152 bytes} [Sun Sep 4 01:21:06 2022] POST /identity/v3/projects => generated 329 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:06.822726 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b898a2-264d-4fa8-bc83-41879fa54888 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:06.824285 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-86b898a2-264d-4fa8-bc83-41879fa54888 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:06.855548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b898a2-264d-4fa8-bc83-41879fa54888 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:06.874760 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:06.954764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf8e8c-e577-4508-a898-f13503bec246 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:06.955157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf8e8c-e577-4508-a898-f13503bec246 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:06.955577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf8e8c-e577-4508-a898-f13503bec246 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:06.955750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf8e8c-e577-4508-a898-f13503bec246 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:06.956438 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf8e8c-e577-4508-a898-f13503bec246 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:06.958738 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf8e8c-e577-4508-a898-f13503bec246 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:06.998967 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2524/5062] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:21:06 2022] POST /identity/v3/users => generated 413 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:21:07.000618 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c075db-b0df-4789-a97f-005ab985ec88 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:07.017708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c075db-b0df-4789-a97f-005ab985ec88 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:07.033082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a10173-06da-4db0-a213-8e93853cc3b6 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:07.033984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a10173-06da-4db0-a213-8e93853cc3b6 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:07.034380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a10173-06da-4db0-a213-8e93853cc3b6 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:07.034763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a10173-06da-4db0-a213-8e93853cc3b6 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:07.035762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a10173-06da-4db0-a213-8e93853cc3b6 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:07.037850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a10173-06da-4db0-a213-8e93853cc3b6 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:07.063972 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2539/5063] 10.222.0.30 () {60 vars in 1143 bytes} [Sun Sep 4 01:21:06 2022] POST /identity/v3/roles => generated 243 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:07.067294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf8e8c-e577-4508-a898-f13503bec246 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:07.080534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf8e8c-e577-4508-a898-f13503bec246 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:07.086400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180a602-b601-40d8-9cb5-2c7f7f3585e1 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:07.087653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180a602-b601-40d8-9cb5-2c7f7f3585e1 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:07.088010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180a602-b601-40d8-9cb5-2c7f7f3585e1 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:07.088366 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180a602-b601-40d8-9cb5-2c7f7f3585e1 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:07.089124 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b180a602-b601-40d8-9cb5-2c7f7f3585e1 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:07.092187 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b180a602-b601-40d8-9cb5-2c7f7f3585e1 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:07.115972 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2525/5064] 10.222.0.30 () {60 vars in 1143 bytes} [Sun Sep 4 01:21:07 2022] POST /identity/v3/roles => generated 247 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:07.119733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a10173-06da-4db0-a213-8e93853cc3b6 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:07.133608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a10173-06da-4db0-a213-8e93853cc3b6 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:07.140795 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5e4a0-2950-430c-b916-86bbe81686b9 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:07.142241 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5e4a0-2950-430c-b916-86bbe81686b9 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:07.142520 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5e4a0-2950-430c-b916-86bbe81686b9 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:07.142807 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5e4a0-2950-430c-b916-86bbe81686b9 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/projects/22014b4f9d6c4e8ca00c8b4361241e6c/users/a5b4e96d0ee343d28a6f7b5e08a523dc/roles/730cd912923e4f22adfe1c9acec1aeba` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:07.240859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5e4a0-2950-430c-b916-86bbe81686b9 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:create_grant(project_id=22014b4f9d6c4e8ca00c8b4361241e6c, user_id=a5b4e96d0ee343d28a6f7b5e08a523dc, role_id=730cd912923e4f22adfe1c9acec1aeba)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:07.244021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5e4a0-2950-430c-b916-86bbe81686b9 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:07.273382 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2540/5065] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:21:07 2022] PUT /identity/v3/projects/22014b4f9d6c4e8ca00c8b4361241e6c/users/a5b4e96d0ee343d28a6f7b5e08a523dc/roles/730cd912923e4f22adfe1c9acec1aeba => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:07.278428 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180a602-b601-40d8-9cb5-2c7f7f3585e1 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:07.293712 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180a602-b601-40d8-9cb5-2c7f7f3585e1 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:07.303499 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5e4a0-2950-430c-b916-86bbe81686b9 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:07.305643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a2d5e4a0-2950-430c-b916-86bbe81686b9 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:07.326330 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:07.471631 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b32786-fcf6-47fd-9f9c-2b6cb0407767 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:07.474163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b32786-fcf6-47fd-9f9c-2b6cb0407767 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:07.474560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b32786-fcf6-47fd-9f9c-2b6cb0407767 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:07.475648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b32786-fcf6-47fd-9f9c-2b6cb0407767 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/projects/22014b4f9d6c4e8ca00c8b4361241e6c/users/a5b4e96d0ee343d28a6f7b5e08a523dc/roles/87810b4a915d4fbab39ed9b0d004268b` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:07.478003 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5e4a0-2950-430c-b916-86bbe81686b9 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:07.481648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b32786-fcf6-47fd-9f9c-2b6cb0407767 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:create_grant(project_id=22014b4f9d6c4e8ca00c8b4361241e6c, user_id=a5b4e96d0ee343d28a6f7b5e08a523dc, role_id=87810b4a915d4fbab39ed9b0d004268b)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:07.489790 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b32786-fcf6-47fd-9f9c-2b6cb0407767 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:07.494018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74c098-c201-421b-a6b4-8ca3f476f237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:07.494859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74c098-c201-421b-a6b4-8ca3f476f237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:07.495243 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74c098-c201-421b-a6b4-8ca3f476f237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:07.495674 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74c098-c201-421b-a6b4-8ca3f476f237 admin admin] PATH_INFO: `/v3/projects/a5d14384422244438a5a127101ac2823` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:07.501044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74c098-c201-421b-a6b4-8ca3f476f237 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5d14384422244438a5a127101ac2823)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:07.503637 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74c098-c201-421b-a6b4-8ca3f476f237 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:07.525824 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2526/5066] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:21:07 2022] PUT /identity/v3/projects/22014b4f9d6c4e8ca00c8b4361241e6c/users/a5b4e96d0ee343d28a6f7b5e08a523dc/roles/87810b4a915d4fbab39ed9b0d004268b => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:07.529332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b32786-fcf6-47fd-9f9c-2b6cb0407767 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:07.694988 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9c74c098-c201-421b-a6b4-8ca3f476f237 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5d14384422244438a5a127101ac2823', 'request_id': 'req-9c74c098-c201-421b-a6b4-8ca3f476f237'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:07.736806 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9c74c098-c201-421b-a6b4-8ca3f476f237 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5d14384422244438a5a127101ac2823', 'request_id': 'req-9c74c098-c201-421b-a6b4-8ca3f476f237'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:07.754797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9c74c098-c201-421b-a6b4-8ca3f476f237 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5d14384422244438a5a127101ac2823', 'request_id': 'req-9c74c098-c201-421b-a6b4-8ca3f476f237'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:07.769871 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b32786-fcf6-47fd-9f9c-2b6cb0407767 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:07.787840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9c74c098-c201-421b-a6b4-8ca3f476f237 admin admin] The token cache is being invalidate because project a5d14384422244438a5a127101ac2823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:07.788124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9c74c098-c201-421b-a6b4-8ca3f476f237 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:07.794010 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9c74c098-c201-421b-a6b4-8ca3f476f237 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:07.798749 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2541/5067] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:21:07 2022] DELETE /identity/v3/projects/a5d14384422244438a5a127101ac2823 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:21:07.803532 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde4477-90be-4fe4-a342-2da41254747e None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:07.803819 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde4477-90be-4fe4-a342-2da41254747e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:07.804094 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde4477-90be-4fe4-a342-2da41254747e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:07.865388 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-7bde4477-90be-4fe4-a342-2da41254747e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:07.872084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7bde4477-90be-4fe4-a342-2da41254747e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:07.877897 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:07.942819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0a82f-2b13-44ba-82a3-1f3ec4d5f519 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:07.943670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0a82f-2b13-44ba-82a3-1f3ec4d5f519 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:07.944084 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0a82f-2b13-44ba-82a3-1f3ec4d5f519 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:07.944514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0a82f-2b13-44ba-82a3-1f3ec4d5f519 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:07.945336 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa0a82f-2b13-44ba-82a3-1f3ec4d5f519 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:07.946507 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-baa0a82f-2b13-44ba-82a3-1f3ec4d5f519 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:21:07.946507 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:21:07.946507 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:21:07.947941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa0a82f-2b13-44ba-82a3-1f3ec4d5f519 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:08.030372 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2527/5068] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:07 2022] GET /identity/v3/users => generated 8047 bytes in 498 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:08.032033 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd2f72-83b6-417b-b20c-59aa3dc528cc None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:08.032441 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd2f72-83b6-417b-b20c-59aa3dc528cc None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:08.032723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd2f72-83b6-417b-b20c-59aa3dc528cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:08.045319 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2542/5069] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:08.052803 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b99f8-665e-4143-bee4-98760d3dc693 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:08.053092 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b99f8-665e-4143-bee4-98760d3dc693 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:08.053367 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b99f8-665e-4143-bee4-98760d3dc693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:08.098407 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-1f5b99f8-665e-4143-bee4-98760d3dc693 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:08.099805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1f5b99f8-665e-4143-bee4-98760d3dc693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:08.109582 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b9fd2f72-83b6-417b-b20c-59aa3dc528cc None None] MFA Rules not processed for user `a5b4e96d0ee343d28a6f7b5e08a523dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:08.110977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b9fd2f72-83b6-417b-b20c-59aa3dc528cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:08.131615 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2543/5070] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:08.135730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b99f8-665e-4143-bee4-98760d3dc693 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:08.146748 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b99f8-665e-4143-bee4-98760d3dc693 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:08.161805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7c857-78dc-4b2b-8f0a-fd2c69af37d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:08.162462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7c857-78dc-4b2b-8f0a-fd2c69af37d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:08.162715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7c857-78dc-4b2b-8f0a-fd2c69af37d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:08.162989 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7c857-78dc-4b2b-8f0a-fd2c69af37d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:08.163700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7c857-78dc-4b2b-8f0a-fd2c69af37d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:21:08.163981 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7c857-78dc-4b2b-8f0a-fd2c69af37d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:08.166392 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7c857-78dc-4b2b-8f0a-fd2c69af37d7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:08.203980 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2544/5071] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:21:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:21:08.207914 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7c857-78dc-4b2b-8f0a-fd2c69af37d7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:08.223891 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7c857-78dc-4b2b-8f0a-fd2c69af37d7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:08.229541 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae87518-df93-4f98-b1a1-23ca45d8aaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:08.230162 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae87518-df93-4f98-b1a1-23ca45d8aaaa admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:08.230418 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae87518-df93-4f98-b1a1-23ca45d8aaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:08.230959 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae87518-df93-4f98-b1a1-23ca45d8aaaa admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:08.231770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae87518-df93-4f98-b1a1-23ca45d8aaaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:08.235923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae87518-df93-4f98-b1a1-23ca45d8aaaa admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:08.247707 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2528/5072] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:08 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:21:08.257607 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7dba7f-259d-4ad4-9a94-edce6c11cbad None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:08.258697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7dba7f-259d-4ad4-9a94-edce6c11cbad None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:08.259167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7dba7f-259d-4ad4-9a94-edce6c11cbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:08.284623 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:08.285615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-ae7dba7f-259d-4ad4-9a94-edce6c11cbad None None] MFA Rules not processed for user `a5b4e96d0ee343d28a6f7b5e08a523dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:08.287843 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ae7dba7f-259d-4ad4-9a94-edce6c11cbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:08.310621 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2545/5073] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:21:08 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:08.319179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae87518-df93-4f98-b1a1-23ca45d8aaaa admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:08.333265 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2529/5074] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:08 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:21:08.334297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7dba7f-259d-4ad4-9a94-edce6c11cbad None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:08.355570 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7dba7f-259d-4ad4-9a94-edce6c11cbad None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:08.496516 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fa092-928b-448c-b12a-6676ac2e6fbc tempest-TrustsV3TestJSON-1888943896 tempest-user-987741862] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b4e96d0ee343d28a6f7b5e08a523dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22014b4f9d6c4e8ca00c8b4361241e6c', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-192749937', 'tempest-NotDelegatedRole-1086509496'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:08.497149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fa092-928b-448c-b12a-6676ac2e6fbc tempest-TrustsV3TestJSON-1888943896 tempest-user-987741862] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:08.497428 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fa092-928b-448c-b12a-6676ac2e6fbc tempest-TrustsV3TestJSON-1888943896 tempest-user-987741862] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:08.497721 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fa092-928b-448c-b12a-6676ac2e6fbc tempest-TrustsV3TestJSON-1888943896 tempest-user-987741862] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:08.498401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713fa092-928b-448c-b12a-6676ac2e6fbc tempest-TrustsV3TestJSON-1888943896 tempest-user-987741862] RBAC: Authorizing `identity:create_trust()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:08.499590 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713fa092-928b-448c-b12a-6676ac2e6fbc tempest-TrustsV3TestJSON-1888943896 tempest-user-987741862] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:08.605957 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae87518-df93-4f98-b1a1-23ca45d8aaaa admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:08.610636 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:08.612850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87b720-89da-447a-8f8b-66ebdcf2dd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:08.614061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87b720-89da-447a-8f8b-66ebdcf2dd29 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:08.614599 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87b720-89da-447a-8f8b-66ebdcf2dd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:08.615021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87b720-89da-447a-8f8b-66ebdcf2dd29 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:08.615810 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce87b720-89da-447a-8f8b-66ebdcf2dd29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:08.618156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce87b720-89da-447a-8f8b-66ebdcf2dd29 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:08.641885 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2530/5075] 10.222.0.30 () {60 vars in 1174 bytes} [Sun Sep 4 01:21:08 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:08.645719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fa092-928b-448c-b12a-6676ac2e6fbc tempest-TrustsV3TestJSON-1888943896 tempest-user-987741862] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:08.661472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fa092-928b-448c-b12a-6676ac2e6fbc tempest-TrustsV3TestJSON-1888943896 tempest-user-987741862] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:08.663914 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2546/5076] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:21:08 2022] POST /identity/v3/users => generated 288 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:08.668161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87b720-89da-447a-8f8b-66ebdcf2dd29 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:08.669025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c162c-9d98-48fe-ba55-a82b3916f563 tempest-TrustsV3TestJSON-1888943896 tempest-user-987741862] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b4e96d0ee343d28a6f7b5e08a523dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22014b4f9d6c4e8ca00c8b4361241e6c', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-192749937', 'tempest-NotDelegatedRole-1086509496'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:08.669627 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c162c-9d98-48fe-ba55-a82b3916f563 tempest-TrustsV3TestJSON-1888943896 tempest-user-987741862] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:08.669972 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c162c-9d98-48fe-ba55-a82b3916f563 tempest-TrustsV3TestJSON-1888943896 tempest-user-987741862] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:08.670721 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c162c-9d98-48fe-ba55-a82b3916f563 tempest-TrustsV3TestJSON-1888943896 tempest-user-987741862] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:08.671044 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c162c-9d98-48fe-ba55-a82b3916f563 tempest-TrustsV3TestJSON-1888943896 tempest-user-987741862] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:08.672438 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c162c-9d98-48fe-ba55-a82b3916f563 tempest-TrustsV3TestJSON-1888943896 tempest-user-987741862] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:08.681507 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2531/5077] 10.222.0.30 () {58 vars in 1252 bytes} [Sun Sep 4 01:21:08 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=a5b4e96d0ee343d28a6f7b5e08a523dc => generated 611 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:21:08.683105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c162c-9d98-48fe-ba55-a82b3916f563 tempest-TrustsV3TestJSON-1888943896 tempest-user-987741862] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:08.684432 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87b720-89da-447a-8f8b-66ebdcf2dd29 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:08.694963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c162c-9d98-48fe-ba55-a82b3916f563 tempest-TrustsV3TestJSON-1888943896 tempest-user-987741862] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:08.700396 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b88d0-5cfd-4dc3-bb88-204bc85f6700 tempest-TrustsV3TestJSON-1888943896 tempest-user-987741862] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b4e96d0ee343d28a6f7b5e08a523dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22014b4f9d6c4e8ca00c8b4361241e6c', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-192749937', 'tempest-NotDelegatedRole-1086509496'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:08.701065 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b88d0-5cfd-4dc3-bb88-204bc85f6700 tempest-TrustsV3TestJSON-1888943896 tempest-user-987741862] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:08.701357 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b88d0-5cfd-4dc3-bb88-204bc85f6700 tempest-TrustsV3TestJSON-1888943896 tempest-user-987741862] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:08.701669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b88d0-5cfd-4dc3-bb88-204bc85f6700 tempest-TrustsV3TestJSON-1888943896 tempest-user-987741862] PATH_INFO: `/v3/OS-TRUST/trusts/609203dcfe5b40af8bf8e54e4d2b47be` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:08.710102 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e425a-cbc7-4f2d-b57b-a03222e5db7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:08.711046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b88d0-5cfd-4dc3-bb88-204bc85f6700 tempest-TrustsV3TestJSON-1888943896 tempest-user-987741862] RBAC: Authorizing `identity:delete_trust(trust_id=609203dcfe5b40af8bf8e54e4d2b47be)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:08.711368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e425a-cbc7-4f2d-b57b-a03222e5db7b admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:08.712949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e425a-cbc7-4f2d-b57b-a03222e5db7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:08.714054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b88d0-5cfd-4dc3-bb88-204bc85f6700 tempest-TrustsV3TestJSON-1888943896 tempest-user-987741862] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:08.718304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e425a-cbc7-4f2d-b57b-a03222e5db7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:08.720652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89e425a-cbc7-4f2d-b57b-a03222e5db7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:08.724232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89e425a-cbc7-4f2d-b57b-a03222e5db7b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:08.749630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a52b88d0-5cfd-4dc3-bb88-204bc85f6700 tempest-TrustsV3TestJSON-1888943896 tempest-user-987741862] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '609203dcfe5b40af8bf8e54e4d2b47be', 'request_id': 'req-a52b88d0-5cfd-4dc3-bb88-204bc85f6700'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:08.770770 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a52b88d0-5cfd-4dc3-bb88-204bc85f6700 tempest-TrustsV3TestJSON-1888943896 tempest-user-987741862] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '609203dcfe5b40af8bf8e54e4d2b47be', 'request_id': 'req-a52b88d0-5cfd-4dc3-bb88-204bc85f6700'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:08.771767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a52b88d0-5cfd-4dc3-bb88-204bc85f6700 tempest-TrustsV3TestJSON-1888943896 tempest-user-987741862] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '609203dcfe5b40af8bf8e54e4d2b47be', 'request_id': 'req-a52b88d0-5cfd-4dc3-bb88-204bc85f6700'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:08.771972 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2547/5078] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:08 2022] GET /identity/v3/roles => generated 1892 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:08.782553 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2532/5079] 10.222.0.30 () {58 vars in 1254 bytes} [Sun Sep 4 01:21:08 2022] DELETE /identity/v3/OS-TRUST/trusts/609203dcfe5b40af8bf8e54e4d2b47be => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:21:08.787489 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e425a-cbc7-4f2d-b57b-a03222e5db7b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:08.788237 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b88d0-5cfd-4dc3-bb88-204bc85f6700 tempest-TrustsV3TestJSON-1888943896 tempest-user-987741862] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:08.790870 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a52b88d0-5cfd-4dc3-bb88-204bc85f6700 tempest-TrustsV3TestJSON-1888943896 tempest-user-987741862] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:08.792792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c89e425a-cbc7-4f2d-b57b-a03222e5db7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:08.811721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e425a-cbc7-4f2d-b57b-a03222e5db7b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:08.817500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09eb1e2-2cd2-49fc-949a-74cf0baaa0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:08.818131 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09eb1e2-2cd2-49fc-949a-74cf0baaa0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:08.818413 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09eb1e2-2cd2-49fc-949a-74cf0baaa0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:08.818686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09eb1e2-2cd2-49fc-949a-74cf0baaa0a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:08.819100 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b88d0-5cfd-4dc3-bb88-204bc85f6700 tempest-TrustsV3TestJSON-1888943896 tempest-user-987741862] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:08.819501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09eb1e2-2cd2-49fc-949a-74cf0baaa0a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:08.822618 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09eb1e2-2cd2-49fc-949a-74cf0baaa0a2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:08.825379 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f64fb5-e017-4682-b003-0cba905b1ebb tempest-TrustsV3TestJSON-1888943896 tempest-user-987741862] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b4e96d0ee343d28a6f7b5e08a523dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22014b4f9d6c4e8ca00c8b4361241e6c', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-192749937', 'tempest-NotDelegatedRole-1086509496'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:08.826585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f64fb5-e017-4682-b003-0cba905b1ebb tempest-TrustsV3TestJSON-1888943896 tempest-user-987741862] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:08.827082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f64fb5-e017-4682-b003-0cba905b1ebb tempest-TrustsV3TestJSON-1888943896 tempest-user-987741862] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:08.828044 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f64fb5-e017-4682-b003-0cba905b1ebb tempest-TrustsV3TestJSON-1888943896 tempest-user-987741862] PATH_INFO: `/v3/OS-TRUST/trusts/609203dcfe5b40af8bf8e54e4d2b47be` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:08.839938 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2548/5080] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:08 2022] GET /identity/v3/roles => generated 1892 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:08.841279 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09eb1e2-2cd2-49fc-949a-74cf0baaa0a2 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:08.846208 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-c0f64fb5-e017-4682-b003-0cba905b1ebb tempest-TrustsV3TestJSON-1888943896 tempest-user-987741862] Could not find trust: 609203dcfe5b40af8bf8e54e4d2b47be.: keystone.exception.TrustNotFound: Could not find trust: 609203dcfe5b40af8bf8e54e4d2b47be. Sep 04 01:21:08.846208 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:21:08.846208 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:21:08.846208 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:21:08.846208 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:21:08.846208 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:21:08.846208 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:21:08.846208 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:21:08.846208 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:21:08.846208 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:21:08.846208 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:21:08.846208 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:21:08.846208 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Sep 04 01:21:08.846208 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Sep 04 01:21:08.846208 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Sep 04 01:21:08.847290 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Sep 04 01:21:08.847290 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Sep 04 01:21:08.847290 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Sep 04 01:21:08.847290 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Sep 04 01:21:08.847290 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Sep 04 01:21:08.847290 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:21:08.847290 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:21:08.847290 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Sep 04 01:21:08.847290 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Sep 04 01:21:08.847290 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Sep 04 01:21:08.847290 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Sep 04 01:21:08.847290 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 609203dcfe5b40af8bf8e54e4d2b47be. Sep 04 01:21:08.847290 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:21:08.853715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09eb1e2-2cd2-49fc-949a-74cf0baaa0a2 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:08.854658 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2533/5081] 10.222.0.30 () {58 vars in 1251 bytes} [Sun Sep 4 01:21:08 2022] GET /identity/v3/OS-TRUST/trusts/609203dcfe5b40af8bf8e54e4d2b47be => generated 111 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:21:08.856171 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f64fb5-e017-4682-b003-0cba905b1ebb tempest-TrustsV3TestJSON-1888943896 tempest-user-987741862] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:08.858630 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32994dc5-c8b8-40b6-ad55-4b0dac731034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:08.859310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32994dc5-c8b8-40b6-ad55-4b0dac731034 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:08.859743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32994dc5-c8b8-40b6-ad55-4b0dac731034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:08.860028 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32994dc5-c8b8-40b6-ad55-4b0dac731034 admin admin] PATH_INFO: `/v3/projects/195693fa5d7e4399b52f5760ea0efeef/users/7a5e38f3abe14adcbb8ef592313eedbf/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:08.860887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c0f64fb5-e017-4682-b003-0cba905b1ebb tempest-TrustsV3TestJSON-1888943896 tempest-user-987741862] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:08.879611 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32994dc5-c8b8-40b6-ad55-4b0dac731034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=195693fa5d7e4399b52f5760ea0efeef, user_id=7a5e38f3abe14adcbb8ef592313eedbf, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:08.882863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32994dc5-c8b8-40b6-ad55-4b0dac731034 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:08.905355 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2549/5082] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:21:08 2022] PUT /identity/v3/projects/195693fa5d7e4399b52f5760ea0efeef/users/7a5e38f3abe14adcbb8ef592313eedbf/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:08.916934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4dd05-1c68-4391-9dca-d25245383844 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:08.917251 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4dd05-1c68-4391-9dca-d25245383844 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:08.917779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4dd05-1c68-4391-9dca-d25245383844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:08.988783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-0cd4dd05-1c68-4391-9dca-d25245383844 None None] MFA Rules not processed for user `7a5e38f3abe14adcbb8ef592313eedbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:08.991830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0cd4dd05-1c68-4391-9dca-d25245383844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:09.041202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f64fb5-e017-4682-b003-0cba905b1ebb tempest-TrustsV3TestJSON-1888943896 tempest-user-987741862] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:09.205809 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2550/5083] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:09.217918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac5b59-802d-48e7-a021-5f7fde49f5d1 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:09.220502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac5b59-802d-48e7-a021-5f7fde49f5d1 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:09.221277 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac5b59-802d-48e7-a021-5f7fde49f5d1 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:09.222525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac5b59-802d-48e7-a021-5f7fde49f5d1 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/roles/87810b4a915d4fbab39ed9b0d004268b` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:09.226682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac5b59-802d-48e7-a021-5f7fde49f5d1 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:delete_role(role_id=87810b4a915d4fbab39ed9b0d004268b)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:09.234540 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac5b59-802d-48e7-a021-5f7fde49f5d1 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:09.284533 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4dd05-1c68-4391-9dca-d25245383844 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:09.286097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0cd4dd05-1c68-4391-9dca-d25245383844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:09.323933 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7dac5b59-802d-48e7-a021-5f7fde49f5d1 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invalidating the token cache because role 87810b4a915d4fbab39ed9b0d004268b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:09.324337 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7dac5b59-802d-48e7-a021-5f7fde49f5d1 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:09.325691 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7dac5b59-802d-48e7-a021-5f7fde49f5d1 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:09.330685 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2534/5084] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:21:08 2022] DELETE /identity/v3/roles/87810b4a915d4fbab39ed9b0d004268b => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:09.334896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac5b59-802d-48e7-a021-5f7fde49f5d1 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:09.337922 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7dac5b59-802d-48e7-a021-5f7fde49f5d1 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:09.344893 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:09.355810 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:09.414802 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4dd05-1c68-4391-9dca-d25245383844 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:09.498819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac5b59-802d-48e7-a021-5f7fde49f5d1 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:09.531176 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864460c-9481-48f6-bb8e-ce7077a1726e tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:09.532233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864460c-9481-48f6-bb8e-ce7077a1726e tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:09.532675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864460c-9481-48f6-bb8e-ce7077a1726e tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:09.533403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864460c-9481-48f6-bb8e-ce7077a1726e tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/roles/730cd912923e4f22adfe1c9acec1aeba` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:09.535849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4864460c-9481-48f6-bb8e-ce7077a1726e tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:delete_role(role_id=730cd912923e4f22adfe1c9acec1aeba)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:09.538638 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4864460c-9481-48f6-bb8e-ce7077a1726e tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:09.546787 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b496a-e698-4bbe-894c-6a3b60917d5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:09.547407 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b496a-e698-4bbe-894c-6a3b60917d5f service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:09.547690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b496a-e698-4bbe-894c-6a3b60917d5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:09.548020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b496a-e698-4bbe-894c-6a3b60917d5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:09.550724 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b72b496a-e698-4bbe-894c-6a3b60917d5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:09.593364 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4864460c-9481-48f6-bb8e-ce7077a1726e tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invalidating the token cache because role 730cd912923e4f22adfe1c9acec1aeba has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:09.593683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4864460c-9481-48f6-bb8e-ce7077a1726e tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:09.597505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4864460c-9481-48f6-bb8e-ce7077a1726e tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:09.598866 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2535/5085] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:21:09 2022] DELETE /identity/v3/roles/730cd912923e4f22adfe1c9acec1aeba => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:09.606083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864460c-9481-48f6-bb8e-ce7077a1726e tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:09.608722 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4864460c-9481-48f6-bb8e-ce7077a1726e tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:09.716090 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b496a-e698-4bbe-894c-6a3b60917d5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:09.718825 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b496a-e698-4bbe-894c-6a3b60917d5f service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:09.728275 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864460c-9481-48f6-bb8e-ce7077a1726e tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:09.733923 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5702b-37ab-4455-ac72-72a100b210df tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:09.734569 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5702b-37ab-4455-ac72-72a100b210df tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:09.734849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5702b-37ab-4455-ac72-72a100b210df tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:09.735129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5702b-37ab-4455-ac72-72a100b210df tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/users/a5b4e96d0ee343d28a6f7b5e08a523dc` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:09.736363 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5702b-37ab-4455-ac72-72a100b210df tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a5b4e96d0ee343d28a6f7b5e08a523dc)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:09.738270 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5702b-37ab-4455-ac72-72a100b210df tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:09.744384 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2551/5086] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:21:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:21:09.826279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ebe5702b-37ab-4455-ac72-72a100b210df tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5b4e96d0ee343d28a6f7b5e08a523dc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:09.827116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ebe5702b-37ab-4455-ac72-72a100b210df tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5b4e96d0ee343d28a6f7b5e08a523dc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:09.835954 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ebe5702b-37ab-4455-ac72-72a100b210df tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5b4e96d0ee343d28a6f7b5e08a523dc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:09.862128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ebe5702b-37ab-4455-ac72-72a100b210df tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5b4e96d0ee343d28a6f7b5e08a523dc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:09.862971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ebe5702b-37ab-4455-ac72-72a100b210df tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5b4e96d0ee343d28a6f7b5e08a523dc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:09.878015 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:09.906284 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2536/5087] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:21:09 2022] DELETE /identity/v3/users/a5b4e96d0ee343d28a6f7b5e08a523dc => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:09.910492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b496a-e698-4bbe-894c-6a3b60917d5f service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:09.938429 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b496a-e698-4bbe-894c-6a3b60917d5f service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:10.124516 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63995da4-3c7b-4662-a6ef-07233b8477a4 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:10.126488 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63995da4-3c7b-4662-a6ef-07233b8477a4 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:10.126784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63995da4-3c7b-4662-a6ef-07233b8477a4 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:10.127274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63995da4-3c7b-4662-a6ef-07233b8477a4 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/projects/22014b4f9d6c4e8ca00c8b4361241e6c` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:10.130745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63995da4-3c7b-4662-a6ef-07233b8477a4 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:delete_project(project_id=22014b4f9d6c4e8ca00c8b4361241e6c)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:10.138212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63995da4-3c7b-4662-a6ef-07233b8477a4 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:10.243183 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:10.263558 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-63995da4-3c7b-4662-a6ef-07233b8477a4 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22014b4f9d6c4e8ca00c8b4361241e6c', 'request_id': 'req-63995da4-3c7b-4662-a6ef-07233b8477a4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:10.287601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-63995da4-3c7b-4662-a6ef-07233b8477a4 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22014b4f9d6c4e8ca00c8b4361241e6c', 'request_id': 'req-63995da4-3c7b-4662-a6ef-07233b8477a4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:10.296530 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-63995da4-3c7b-4662-a6ef-07233b8477a4 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22014b4f9d6c4e8ca00c8b4361241e6c', 'request_id': 'req-63995da4-3c7b-4662-a6ef-07233b8477a4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:10.320667 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-63995da4-3c7b-4662-a6ef-07233b8477a4 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] The token cache is being invalidate because project 22014b4f9d6c4e8ca00c8b4361241e6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:10.320971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-63995da4-3c7b-4662-a6ef-07233b8477a4 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:10.323647 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-63995da4-3c7b-4662-a6ef-07233b8477a4 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:10.334601 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2552/5088] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:21:09 2022] DELETE /identity/v3/projects/22014b4f9d6c4e8ca00c8b4361241e6c => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:10.336771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5702b-37ab-4455-ac72-72a100b210df tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:10.339829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ebe5702b-37ab-4455-ac72-72a100b210df tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:10.369636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5702b-37ab-4455-ac72-72a100b210df tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:10.494476 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5eee8-16ee-41bb-8c07-1344a3eb65a2 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:10.495356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5eee8-16ee-41bb-8c07-1344a3eb65a2 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:10.495800 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5eee8-16ee-41bb-8c07-1344a3eb65a2 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:10.496245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5eee8-16ee-41bb-8c07-1344a3eb65a2 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:10.497048 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d5eee8-16ee-41bb-8c07-1344a3eb65a2 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:10.499403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d5eee8-16ee-41bb-8c07-1344a3eb65a2 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:10.554492 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2537/5089] 10.222.0.30 () {60 vars in 1152 bytes} [Sun Sep 4 01:21:10 2022] POST /identity/v3/projects => generated 328 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:10.558721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63995da4-3c7b-4662-a6ef-07233b8477a4 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:10.561493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-63995da4-3c7b-4662-a6ef-07233b8477a4 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:10.603380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63995da4-3c7b-4662-a6ef-07233b8477a4 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:10.774992 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a8daf-3600-4bbf-bcc5-9bd1b8c3e75a tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:10.775749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a8daf-3600-4bbf-bcc5-9bd1b8c3e75a tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:10.776137 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a8daf-3600-4bbf-bcc5-9bd1b8c3e75a tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:10.778736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a8daf-3600-4bbf-bcc5-9bd1b8c3e75a tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:10.780029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a8daf-3600-4bbf-bcc5-9bd1b8c3e75a tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:10.784747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a8daf-3600-4bbf-bcc5-9bd1b8c3e75a tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:10.847092 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2553/5090] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:21:10 2022] POST /identity/v3/users => generated 416 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:10.849840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5eee8-16ee-41bb-8c07-1344a3eb65a2 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:10.864650 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5eee8-16ee-41bb-8c07-1344a3eb65a2 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:10.887301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b4a68-d203-4ac0-8279-8760aa4814d8 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:10.887301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b4a68-d203-4ac0-8279-8760aa4814d8 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:10.887301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b4a68-d203-4ac0-8279-8760aa4814d8 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:10.887708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b4a68-d203-4ac0-8279-8760aa4814d8 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:10.891526 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b4a68-d203-4ac0-8279-8760aa4814d8 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:10.894106 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b4a68-d203-4ac0-8279-8760aa4814d8 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:10.944283 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2538/5091] 10.222.0.30 () {60 vars in 1143 bytes} [Sun Sep 4 01:21:10 2022] POST /identity/v3/roles => generated 244 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:10.948677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a8daf-3600-4bbf-bcc5-9bd1b8c3e75a tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:10.967304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a8daf-3600-4bbf-bcc5-9bd1b8c3e75a tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:10.974353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff88c4-a960-4019-be87-0efee7d92382 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:10.975351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff88c4-a960-4019-be87-0efee7d92382 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:10.976026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff88c4-a960-4019-be87-0efee7d92382 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:10.976026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff88c4-a960-4019-be87-0efee7d92382 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:10.976643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff88c4-a960-4019-be87-0efee7d92382 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:10.978974 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff88c4-a960-4019-be87-0efee7d92382 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:11.009509 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2554/5092] 10.222.0.30 () {60 vars in 1143 bytes} [Sun Sep 4 01:21:10 2022] POST /identity/v3/roles => generated 245 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:11.010766 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b4a68-d203-4ac0-8279-8760aa4814d8 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:11.024626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b4a68-d203-4ac0-8279-8760aa4814d8 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:11.032705 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63984001-10da-4d38-8cb1-df25c5c9fed2 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:11.034227 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63984001-10da-4d38-8cb1-df25c5c9fed2 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:11.034941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63984001-10da-4d38-8cb1-df25c5c9fed2 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:11.036288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63984001-10da-4d38-8cb1-df25c5c9fed2 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/projects/f69d19104d6a4dd7b1da4361202df6d3/users/fcc1f3694840401d8f211bc02f4baed9/roles/d0a8b4cce85043d78b798559e3763faa` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:11.062944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63984001-10da-4d38-8cb1-df25c5c9fed2 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f69d19104d6a4dd7b1da4361202df6d3, user_id=fcc1f3694840401d8f211bc02f4baed9, role_id=d0a8b4cce85043d78b798559e3763faa)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:11.067210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63984001-10da-4d38-8cb1-df25c5c9fed2 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:11.094658 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2539/5093] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:21:11 2022] PUT /identity/v3/projects/f69d19104d6a4dd7b1da4361202df6d3/users/fcc1f3694840401d8f211bc02f4baed9/roles/d0a8b4cce85043d78b798559e3763faa => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:11.096140 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff88c4-a960-4019-be87-0efee7d92382 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:11.112820 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff88c4-a960-4019-be87-0efee7d92382 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:11.292736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363ebe0-c45c-4a65-8756-b761b2d986f2 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:11.293671 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363ebe0-c45c-4a65-8756-b761b2d986f2 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:11.294243 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363ebe0-c45c-4a65-8756-b761b2d986f2 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:11.295968 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363ebe0-c45c-4a65-8756-b761b2d986f2 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/projects/f69d19104d6a4dd7b1da4361202df6d3/users/fcc1f3694840401d8f211bc02f4baed9/roles/92f3ad73bfdf4f949783cde6ec2faa46` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:11.301685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363ebe0-c45c-4a65-8756-b761b2d986f2 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f69d19104d6a4dd7b1da4361202df6d3, user_id=fcc1f3694840401d8f211bc02f4baed9, role_id=92f3ad73bfdf4f949783cde6ec2faa46)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:11.309241 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363ebe0-c45c-4a65-8756-b761b2d986f2 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:11.351151 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2555/5094] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:21:11 2022] PUT /identity/v3/projects/f69d19104d6a4dd7b1da4361202df6d3/users/fcc1f3694840401d8f211bc02f4baed9/roles/92f3ad73bfdf4f949783cde6ec2faa46 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:11.353743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63984001-10da-4d38-8cb1-df25c5c9fed2 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:11.369765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63984001-10da-4d38-8cb1-df25c5c9fed2 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:11.512757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda07afc-9f18-4c20-b8ca-6b2c3d0a43ee tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:11.513405 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda07afc-9f18-4c20-b8ca-6b2c3d0a43ee tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:11.513713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda07afc-9f18-4c20-b8ca-6b2c3d0a43ee tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:11.513986 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda07afc-9f18-4c20-b8ca-6b2c3d0a43ee tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:11.516897 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda07afc-9f18-4c20-b8ca-6b2c3d0a43ee tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:11.520542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda07afc-9f18-4c20-b8ca-6b2c3d0a43ee tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:11.583907 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6b277-db58-4996-94cd-4d6173fed3f4 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:11.584519 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6b277-db58-4996-94cd-4d6173fed3f4 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:11.585296 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6b277-db58-4996-94cd-4d6173fed3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:11.588340 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2540/5095] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:11 2022] GET /identity/v3/users => generated 8329 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:11.674943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-0ff6b277-db58-4996-94cd-4d6173fed3f4 None None] MFA Rules not processed for user `fcc1f3694840401d8f211bc02f4baed9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:11.676225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0ff6b277-db58-4996-94cd-4d6173fed3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:11.732831 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:11.838097 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2556/5096] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:11 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:11.847887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7183f2-65f0-4a60-a613-b9aa08e6b7f0 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:11.850018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7183f2-65f0-4a60-a613-b9aa08e6b7f0 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:11.850580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7183f2-65f0-4a60-a613-b9aa08e6b7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:11.913634 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-dd7183f2-65f0-4a60-a613-b9aa08e6b7f0 None None] MFA Rules not processed for user `fcc1f3694840401d8f211bc02f4baed9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:11.918151 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-dd7183f2-65f0-4a60-a613-b9aa08e6b7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:11.944136 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2541/5097] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:11 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:11.949250 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6b277-db58-4996-94cd-4d6173fed3f4 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:11.961385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6b277-db58-4996-94cd-4d6173fed3f4 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:11.967500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d71e1-5cb5-489b-8170-e0be1837610a tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcc1f3694840401d8f211bc02f4baed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f69d19104d6a4dd7b1da4361202df6d3', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1570940286', 'tempest-NotDelegatedRole-13263586'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:11.969018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d71e1-5cb5-489b-8170-e0be1837610a tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:11.969830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d71e1-5cb5-489b-8170-e0be1837610a tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:11.970643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d71e1-5cb5-489b-8170-e0be1837610a tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:11.971689 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d71e1-5cb5-489b-8170-e0be1837610a tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] RBAC: Authorizing `identity:create_trust()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:11.973639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d71e1-5cb5-489b-8170-e0be1837610a tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:12.078489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7183f2-65f0-4a60-a613-b9aa08e6b7f0 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:12.080177 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-dd7183f2-65f0-4a60-a613-b9aa08e6b7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:12.141490 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2557/5098] 10.222.0.30 () {60 vars in 1174 bytes} [Sun Sep 4 01:21:11 2022] POST /identity/v3/OS-TRUST/trusts => generated 859 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:12.147182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d71e1-5cb5-489b-8170-e0be1837610a tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:12.160883 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d71e1-5cb5-489b-8170-e0be1837610a tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:12.169974 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3e870-242f-4af1-bb81-035a00b6154a tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcc1f3694840401d8f211bc02f4baed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f69d19104d6a4dd7b1da4361202df6d3', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1570940286', 'tempest-NotDelegatedRole-13263586'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:12.171009 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:12.171298 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3e870-242f-4af1-bb81-035a00b6154a tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:12.171648 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3e870-242f-4af1-bb81-035a00b6154a tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:12.171935 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3e870-242f-4af1-bb81-035a00b6154a tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] PATH_INFO: `/v3/OS-TRUST/trusts/b8e41f02e3514ef2bb7d88d4f8f42dca` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:12.183711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3e870-242f-4af1-bb81-035a00b6154a tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] RBAC: Authorizing `identity:get_trust(trust_id=b8e41f02e3514ef2bb7d88d4f8f42dca)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:12.185882 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3e870-242f-4af1-bb81-035a00b6154a tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:12.200522 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2558/5099] 10.222.0.30 () {58 vars in 1251 bytes} [Sun Sep 4 01:21:12 2022] GET /identity/v3/OS-TRUST/trusts/b8e41f02e3514ef2bb7d88d4f8f42dca => generated 859 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:21:12.204631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3e870-242f-4af1-bb81-035a00b6154a tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:12.223007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7183f2-65f0-4a60-a613-b9aa08e6b7f0 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:12.224006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3e870-242f-4af1-bb81-035a00b6154a tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:12.228788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8ee6c-01b3-4c7a-84d9-e0b84aa8d8c0 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcc1f3694840401d8f211bc02f4baed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f69d19104d6a4dd7b1da4361202df6d3', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1570940286', 'tempest-NotDelegatedRole-13263586'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:12.229627 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19445b0-edd9-4ab1-9672-d5bc41869655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:12.229780 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8ee6c-01b3-4c7a-84d9-e0b84aa8d8c0 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:12.229916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8ee6c-01b3-4c7a-84d9-e0b84aa8d8c0 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:12.230223 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8ee6c-01b3-4c7a-84d9-e0b84aa8d8c0 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] PATH_INFO: `/v3/OS-TRUST/trusts/b8e41f02e3514ef2bb7d88d4f8f42dca/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:12.230354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19445b0-edd9-4ab1-9672-d5bc41869655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:12.230541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19445b0-edd9-4ab1-9672-d5bc41869655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:12.230816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19445b0-edd9-4ab1-9672-d5bc41869655 admin admin] PATH_INFO: `/v3/users/7a5e38f3abe14adcbb8ef592313eedbf` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:12.232261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19445b0-edd9-4ab1-9672-d5bc41869655 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a5e38f3abe14adcbb8ef592313eedbf)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:12.234312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19445b0-edd9-4ab1-9672-d5bc41869655 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:12.240106 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8ee6c-01b3-4c7a-84d9-e0b84aa8d8c0 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=b8e41f02e3514ef2bb7d88d4f8f42dca)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:12.244426 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8ee6c-01b3-4c7a-84d9-e0b84aa8d8c0 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:12.258090 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2559/5100] 10.222.0.30 () {58 vars in 1269 bytes} [Sun Sep 4 01:21:12 2022] GET /identity/v3/OS-TRUST/trusts/b8e41f02e3514ef2bb7d88d4f8f42dca/roles => generated 371 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:21:12.263333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8ee6c-01b3-4c7a-84d9-e0b84aa8d8c0 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:12.280574 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8ee6c-01b3-4c7a-84d9-e0b84aa8d8c0 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:12.296055 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdedb95-4ffe-4bcd-9831-f371cbc47bb1 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcc1f3694840401d8f211bc02f4baed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f69d19104d6a4dd7b1da4361202df6d3', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1570940286', 'tempest-NotDelegatedRole-13263586'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:12.296776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdedb95-4ffe-4bcd-9831-f371cbc47bb1 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:12.296993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdedb95-4ffe-4bcd-9831-f371cbc47bb1 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:12.297268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdedb95-4ffe-4bcd-9831-f371cbc47bb1 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] PATH_INFO: `/v3/OS-TRUST/trusts/b8e41f02e3514ef2bb7d88d4f8f42dca/roles/d0a8b4cce85043d78b798559e3763faa` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:12.308637 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdedb95-4ffe-4bcd-9831-f371cbc47bb1 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] RBAC: Authorizing `identity:get_role_for_trust(trust_id=b8e41f02e3514ef2bb7d88d4f8f42dca, role_id=d0a8b4cce85043d78b798559e3763faa)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:12.310749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdedb95-4ffe-4bcd-9831-f371cbc47bb1 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:12.324669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d19445b0-edd9-4ab1-9672-d5bc41869655 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a5e38f3abe14adcbb8ef592313eedbf'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:12.324669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d19445b0-edd9-4ab1-9672-d5bc41869655 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a5e38f3abe14adcbb8ef592313eedbf'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:12.325731 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2560/5101] 10.222.0.30 () {58 vars in 1368 bytes} [Sun Sep 4 01:21:12 2022] GET /identity/v3/OS-TRUST/trusts/b8e41f02e3514ef2bb7d88d4f8f42dca/roles/d0a8b4cce85043d78b798559e3763faa => generated 244 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:21:12.327381 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdedb95-4ffe-4bcd-9831-f371cbc47bb1 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:12.330854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5fdedb95-4ffe-4bcd-9831-f371cbc47bb1 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:12.333315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d19445b0-edd9-4ab1-9672-d5bc41869655 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a5e38f3abe14adcbb8ef592313eedbf'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:12.342818 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d19445b0-edd9-4ab1-9672-d5bc41869655 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a5e38f3abe14adcbb8ef592313eedbf'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:12.344243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d19445b0-edd9-4ab1-9672-d5bc41869655 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a5e38f3abe14adcbb8ef592313eedbf'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:12.348144 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdedb95-4ffe-4bcd-9831-f371cbc47bb1 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:12.354602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2415b5-73d6-40b3-b6d9-3ed4f00f2fb5 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcc1f3694840401d8f211bc02f4baed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f69d19104d6a4dd7b1da4361202df6d3', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1570940286', 'tempest-NotDelegatedRole-13263586'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:12.355846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2415b5-73d6-40b3-b6d9-3ed4f00f2fb5 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] REQUEST_METHOD: `HEAD` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:12.356285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2415b5-73d6-40b3-b6d9-3ed4f00f2fb5 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:12.357003 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2415b5-73d6-40b3-b6d9-3ed4f00f2fb5 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] PATH_INFO: `/v3/OS-TRUST/trusts/b8e41f02e3514ef2bb7d88d4f8f42dca/roles/d0a8b4cce85043d78b798559e3763faa` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:12.365325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2415b5-73d6-40b3-b6d9-3ed4f00f2fb5 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] RBAC: Authorizing `identity:get_role_for_trust(trust_id=b8e41f02e3514ef2bb7d88d4f8f42dca, role_id=d0a8b4cce85043d78b798559e3763faa)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:12.367262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2415b5-73d6-40b3-b6d9-3ed4f00f2fb5 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:12.374729 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2542/5102] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:21:12 2022] DELETE /identity/v3/users/7a5e38f3abe14adcbb8ef592313eedbf => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:12.376159 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b5075-ff74-4744-a9a9-95fa05c87dab None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:12.376336 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2561/5103] 10.222.0.30 () {58 vars in 1369 bytes} [Sun Sep 4 01:21:12 2022] HEAD /identity/v3/OS-TRUST/trusts/b8e41f02e3514ef2bb7d88d4f8f42dca/roles/d0a8b4cce85043d78b798559e3763faa => generated 0 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Sep 04 01:21:12.380910 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b5075-ff74-4744-a9a9-95fa05c87dab None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:12.380910 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b5075-ff74-4744-a9a9-95fa05c87dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:12.382362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2415b5-73d6-40b3-b6d9-3ed4f00f2fb5 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:12.402767 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2415b5-73d6-40b3-b6d9-3ed4f00f2fb5 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:12.403534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d19b5075-ff74-4744-a9a9-95fa05c87dab None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:12.404771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d19b5075-ff74-4744-a9a9-95fa05c87dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:12.471418 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:12.492404 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2543/5104] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:12.494367 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016c5cd-42c3-48d3-8521-e493ccd986f9 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcc1f3694840401d8f211bc02f4baed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f69d19104d6a4dd7b1da4361202df6d3', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1570940286', 'tempest-NotDelegatedRole-13263586'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:12.495205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016c5cd-42c3-48d3-8521-e493ccd986f9 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:12.495735 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016c5cd-42c3-48d3-8521-e493ccd986f9 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:12.496403 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016c5cd-42c3-48d3-8521-e493ccd986f9 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] PATH_INFO: `/v3/OS-TRUST/trusts/b8e41f02e3514ef2bb7d88d4f8f42dca/roles/92f3ad73bfdf4f949783cde6ec2faa46` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:12.506558 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b016c5cd-42c3-48d3-8521-e493ccd986f9 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] RBAC: Authorizing `identity:get_role_for_trust(trust_id=b8e41f02e3514ef2bb7d88d4f8f42dca, role_id=92f3ad73bfdf4f949783cde6ec2faa46)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:12.509263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b016c5cd-42c3-48d3-8521-e493ccd986f9 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:12.511438 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b5075-ff74-4744-a9a9-95fa05c87dab None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:12.514739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d19b5075-ff74-4744-a9a9-95fa05c87dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:12.525300 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-b016c5cd-42c3-48d3-8521-e493ccd986f9 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] Could not find role: 92f3ad73bfdf4f949783cde6ec2faa46.: keystone.exception.RoleNotFound: Could not find role: 92f3ad73bfdf4f949783cde6ec2faa46. Sep 04 01:21:12.525300 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:21:12.525300 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:21:12.525300 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:21:12.525300 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:21:12.525300 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:21:12.525300 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:21:12.525300 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:21:12.525300 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:21:12.525300 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:21:12.525300 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:21:12.525300 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:21:12.525300 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Sep 04 01:21:12.525300 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 01:21:12.525300 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 92f3ad73bfdf4f949783cde6ec2faa46. Sep 04 01:21:12.526412 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:21:12.526987 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2562/5105] 10.222.0.30 () {58 vars in 1368 bytes} [Sun Sep 4 01:21:12 2022] GET /identity/v3/OS-TRUST/trusts/b8e41f02e3514ef2bb7d88d4f8f42dca/roles/92f3ad73bfdf4f949783cde6ec2faa46 => generated 110 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:21:12.530734 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016c5cd-42c3-48d3-8521-e493ccd986f9 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:12.542787 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016c5cd-42c3-48d3-8521-e493ccd986f9 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:12.547891 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42895390-ba4a-41d9-8f61-45ff2ad7efff tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcc1f3694840401d8f211bc02f4baed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f69d19104d6a4dd7b1da4361202df6d3', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1570940286', 'tempest-NotDelegatedRole-13263586'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:12.548563 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42895390-ba4a-41d9-8f61-45ff2ad7efff tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] REQUEST_METHOD: `HEAD` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:12.548842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42895390-ba4a-41d9-8f61-45ff2ad7efff tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:12.549121 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42895390-ba4a-41d9-8f61-45ff2ad7efff tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] PATH_INFO: `/v3/OS-TRUST/trusts/b8e41f02e3514ef2bb7d88d4f8f42dca/roles/92f3ad73bfdf4f949783cde6ec2faa46` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:12.558031 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42895390-ba4a-41d9-8f61-45ff2ad7efff tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] RBAC: Authorizing `identity:get_role_for_trust(trust_id=b8e41f02e3514ef2bb7d88d4f8f42dca, role_id=92f3ad73bfdf4f949783cde6ec2faa46)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:12.559889 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42895390-ba4a-41d9-8f61-45ff2ad7efff tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:12.574488 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-42895390-ba4a-41d9-8f61-45ff2ad7efff tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] Could not find role: 92f3ad73bfdf4f949783cde6ec2faa46.: keystone.exception.RoleNotFound: Could not find role: 92f3ad73bfdf4f949783cde6ec2faa46. Sep 04 01:21:12.574488 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:21:12.574488 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:21:12.574488 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:21:12.574488 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:21:12.574488 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:21:12.574488 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:21:12.574488 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:21:12.574488 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:21:12.574488 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:21:12.574488 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:21:12.574488 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:21:12.574488 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Sep 04 01:21:12.574488 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 01:21:12.574488 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 92f3ad73bfdf4f949783cde6ec2faa46. Sep 04 01:21:12.575715 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:21:12.579407 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2563/5106] 10.222.0.30 () {58 vars in 1369 bytes} [Sun Sep 4 01:21:12 2022] HEAD /identity/v3/OS-TRUST/trusts/b8e41f02e3514ef2bb7d88d4f8f42dca/roles/92f3ad73bfdf4f949783cde6ec2faa46 => generated 0 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:21:12.580931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42895390-ba4a-41d9-8f61-45ff2ad7efff tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:12.586324 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:12.593128 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42895390-ba4a-41d9-8f61-45ff2ad7efff tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:12.601186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db63162-1053-43ed-b6ed-fdad36efa142 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcc1f3694840401d8f211bc02f4baed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f69d19104d6a4dd7b1da4361202df6d3', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1570940286', 'tempest-NotDelegatedRole-13263586'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:12.601857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db63162-1053-43ed-b6ed-fdad36efa142 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:12.602868 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db63162-1053-43ed-b6ed-fdad36efa142 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:12.603723 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db63162-1053-43ed-b6ed-fdad36efa142 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] PATH_INFO: `/v3/OS-TRUST/trusts/b8e41f02e3514ef2bb7d88d4f8f42dca` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:12.607500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b5075-ff74-4744-a9a9-95fa05c87dab None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:12.612605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db63162-1053-43ed-b6ed-fdad36efa142 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] RBAC: Authorizing `identity:delete_trust(trust_id=b8e41f02e3514ef2bb7d88d4f8f42dca)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:12.624664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db63162-1053-43ed-b6ed-fdad36efa142 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:12.632733 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5bc3e-8326-440f-ad32-275aeb66ea57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:12.633916 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5bc3e-8326-440f-ad32-275aeb66ea57 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:12.633916 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5bc3e-8326-440f-ad32-275aeb66ea57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:12.635758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5bc3e-8326-440f-ad32-275aeb66ea57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:12.658110 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9db63162-1053-43ed-b6ed-fdad36efa142 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'b8e41f02e3514ef2bb7d88d4f8f42dca', 'request_id': 'req-9db63162-1053-43ed-b6ed-fdad36efa142'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:12.667119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c5bc3e-8326-440f-ad32-275aeb66ea57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:12.670100 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c5bc3e-8326-440f-ad32-275aeb66ea57 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:12.683238 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2544/5107] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:21:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:21:12.685775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9db63162-1053-43ed-b6ed-fdad36efa142 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'b8e41f02e3514ef2bb7d88d4f8f42dca', 'request_id': 'req-9db63162-1053-43ed-b6ed-fdad36efa142'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:12.686482 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9db63162-1053-43ed-b6ed-fdad36efa142 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'b8e41f02e3514ef2bb7d88d4f8f42dca', 'request_id': 'req-9db63162-1053-43ed-b6ed-fdad36efa142'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:12.697790 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2564/5108] 10.222.0.30 () {58 vars in 1254 bytes} [Sun Sep 4 01:21:12 2022] DELETE /identity/v3/OS-TRUST/trusts/b8e41f02e3514ef2bb7d88d4f8f42dca => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:21:12.702191 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5bc3e-8326-440f-ad32-275aeb66ea57 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:12.726986 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5bc3e-8326-440f-ad32-275aeb66ea57 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:12.732713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3354f9-c7a7-4c7e-9f29-b9fd12583b27 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcc1f3694840401d8f211bc02f4baed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f69d19104d6a4dd7b1da4361202df6d3', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1570940286', 'tempest-NotDelegatedRole-13263586'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:12.733367 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3354f9-c7a7-4c7e-9f29-b9fd12583b27 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:12.733703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3354f9-c7a7-4c7e-9f29-b9fd12583b27 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:12.733979 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3354f9-c7a7-4c7e-9f29-b9fd12583b27 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] PATH_INFO: `/v3/OS-TRUST/trusts/b8e41f02e3514ef2bb7d88d4f8f42dca` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:12.748696 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-eb3354f9-c7a7-4c7e-9f29-b9fd12583b27 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] Could not find trust: b8e41f02e3514ef2bb7d88d4f8f42dca.: keystone.exception.TrustNotFound: Could not find trust: b8e41f02e3514ef2bb7d88d4f8f42dca. Sep 04 01:21:12.748696 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:21:12.748696 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:21:12.748696 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:21:12.748696 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:21:12.748696 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:21:12.748696 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:21:12.748696 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:21:12.748696 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:21:12.748696 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:21:12.748696 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:21:12.748696 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:21:12.748696 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Sep 04 01:21:12.748696 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Sep 04 01:21:12.748696 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Sep 04 01:21:12.750089 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Sep 04 01:21:12.750089 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Sep 04 01:21:12.750089 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Sep 04 01:21:12.750089 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Sep 04 01:21:12.750089 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Sep 04 01:21:12.750089 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:21:12.750089 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:21:12.750089 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Sep 04 01:21:12.750089 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Sep 04 01:21:12.750089 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Sep 04 01:21:12.750089 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Sep 04 01:21:12.750089 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: b8e41f02e3514ef2bb7d88d4f8f42dca. Sep 04 01:21:12.750089 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:21:12.753302 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2545/5109] 10.222.0.30 () {58 vars in 1251 bytes} [Sun Sep 4 01:21:12 2022] GET /identity/v3/OS-TRUST/trusts/b8e41f02e3514ef2bb7d88d4f8f42dca => generated 111 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:21:12.757691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db63162-1053-43ed-b6ed-fdad36efa142 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:12.759774 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9db63162-1053-43ed-b6ed-fdad36efa142 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:12.884904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db63162-1053-43ed-b6ed-fdad36efa142 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:12.893831 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e0a08-530d-468e-b927-cbadac1fc74b tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:12.894766 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e0a08-530d-468e-b927-cbadac1fc74b tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:12.895858 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e0a08-530d-468e-b927-cbadac1fc74b tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:12.896377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e0a08-530d-468e-b927-cbadac1fc74b tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/roles/92f3ad73bfdf4f949783cde6ec2faa46` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:12.898165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e0a08-530d-468e-b927-cbadac1fc74b tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:delete_role(role_id=92f3ad73bfdf4f949783cde6ec2faa46)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:12.901788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e0a08-530d-468e-b927-cbadac1fc74b tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:12.964123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d68e0a08-530d-468e-b927-cbadac1fc74b tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invalidating the token cache because role 92f3ad73bfdf4f949783cde6ec2faa46 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:12.964979 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d68e0a08-530d-468e-b927-cbadac1fc74b tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:12.967289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d68e0a08-530d-468e-b927-cbadac1fc74b tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:12.969481 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2565/5110] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:21:12 2022] DELETE /identity/v3/roles/92f3ad73bfdf4f949783cde6ec2faa46 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:12.973898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3354f9-c7a7-4c7e-9f29-b9fd12583b27 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:12.977021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-eb3354f9-c7a7-4c7e-9f29-b9fd12583b27 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:13.008909 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3354f9-c7a7-4c7e-9f29-b9fd12583b27 tempest-TrustsV3TestJSON-564527324 tempest-user-1039894930] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:13.064449 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e0a08-530d-468e-b927-cbadac1fc74b tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:13.068687 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d68e0a08-530d-468e-b927-cbadac1fc74b tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:13.143466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b463b-8057-476d-888c-7473602d481c tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:13.147151 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b463b-8057-476d-888c-7473602d481c tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:13.147566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b463b-8057-476d-888c-7473602d481c tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:13.147947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b463b-8057-476d-888c-7473602d481c tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/roles/d0a8b4cce85043d78b798559e3763faa` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:13.150818 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b463b-8057-476d-888c-7473602d481c tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d0a8b4cce85043d78b798559e3763faa)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:13.153155 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b463b-8057-476d-888c-7473602d481c tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:13.189524 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:13.238832 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-951b463b-8057-476d-888c-7473602d481c tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invalidating the token cache because role d0a8b4cce85043d78b798559e3763faa has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:13.239138 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-951b463b-8057-476d-888c-7473602d481c tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:13.242624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e0a08-530d-468e-b927-cbadac1fc74b tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:13.243226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-951b463b-8057-476d-888c-7473602d481c tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:13.250519 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2546/5111] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:21:12 2022] DELETE /identity/v3/roles/d0a8b4cce85043d78b798559e3763faa => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:13.253473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b463b-8057-476d-888c-7473602d481c tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:13.256069 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-951b463b-8057-476d-888c-7473602d481c tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:13.373479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b463b-8057-476d-888c-7473602d481c tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:13.375079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076329f6-5b96-426a-80d5-464c2eb5d508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:13.375807 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076329f6-5b96-426a-80d5-464c2eb5d508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:13.376463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076329f6-5b96-426a-80d5-464c2eb5d508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:13.376806 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076329f6-5b96-426a-80d5-464c2eb5d508 admin admin] PATH_INFO: `/v3/projects/195693fa5d7e4399b52f5760ea0efeef` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:13.378063 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076329f6-5b96-426a-80d5-464c2eb5d508 admin admin] RBAC: Authorizing `identity:delete_project(project_id=195693fa5d7e4399b52f5760ea0efeef)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:13.380080 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076329f6-5b96-426a-80d5-464c2eb5d508 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:13.386097 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf626ec5-0d3a-4de9-b210-fd51cec14181 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:13.386997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf626ec5-0d3a-4de9-b210-fd51cec14181 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:13.387476 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf626ec5-0d3a-4de9-b210-fd51cec14181 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:13.387958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf626ec5-0d3a-4de9-b210-fd51cec14181 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/users/fcc1f3694840401d8f211bc02f4baed9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:13.389668 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf626ec5-0d3a-4de9-b210-fd51cec14181 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:delete_user(user_id=fcc1f3694840401d8f211bc02f4baed9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:13.391819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf626ec5-0d3a-4de9-b210-fd51cec14181 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:13.476437 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-076329f6-5b96-426a-80d5-464c2eb5d508 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '195693fa5d7e4399b52f5760ea0efeef', 'request_id': 'req-076329f6-5b96-426a-80d5-464c2eb5d508'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:13.482282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-bf626ec5-0d3a-4de9-b210-fd51cec14181 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcc1f3694840401d8f211bc02f4baed9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:13.483286 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-bf626ec5-0d3a-4de9-b210-fd51cec14181 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcc1f3694840401d8f211bc02f4baed9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:13.484879 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=10 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:13.490135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-076329f6-5b96-426a-80d5-464c2eb5d508 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '195693fa5d7e4399b52f5760ea0efeef', 'request_id': 'req-076329f6-5b96-426a-80d5-464c2eb5d508'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:13.494192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-bf626ec5-0d3a-4de9-b210-fd51cec14181 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcc1f3694840401d8f211bc02f4baed9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:13.511062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-076329f6-5b96-426a-80d5-464c2eb5d508 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '195693fa5d7e4399b52f5760ea0efeef', 'request_id': 'req-076329f6-5b96-426a-80d5-464c2eb5d508'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:13.512835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-bf626ec5-0d3a-4de9-b210-fd51cec14181 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcc1f3694840401d8f211bc02f4baed9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:13.514332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-bf626ec5-0d3a-4de9-b210-fd51cec14181 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcc1f3694840401d8f211bc02f4baed9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:13.523717 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-076329f6-5b96-426a-80d5-464c2eb5d508 admin admin] The token cache is being invalidate because project 195693fa5d7e4399b52f5760ea0efeef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:13.524183 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-076329f6-5b96-426a-80d5-464c2eb5d508 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:13.525166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-076329f6-5b96-426a-80d5-464c2eb5d508 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:13.530095 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2566/5112] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:21:13 2022] DELETE /identity/v3/projects/195693fa5d7e4399b52f5760ea0efeef => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:13.532904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c62ee6-9ce8-4c4d-a9a1-6f4ec4227ab6 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:13.533329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c62ee6-9ce8-4c4d-a9a1-6f4ec4227ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:13.533945 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c62ee6-9ce8-4c4d-a9a1-6f4ec4227ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:13.542392 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2547/5113] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:21:13 2022] DELETE /identity/v3/users/fcc1f3694840401d8f211bc02f4baed9 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:13.555062 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf626ec5-0d3a-4de9-b210-fd51cec14181 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:13.558545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bf626ec5-0d3a-4de9-b210-fd51cec14181 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:13.572397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-94c62ee6-9ce8-4c4d-a9a1-6f4ec4227ab6 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:13.573818 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-94c62ee6-9ce8-4c4d-a9a1-6f4ec4227ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:13.692851 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2567/5114] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:13.693309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf626ec5-0d3a-4de9-b210-fd51cec14181 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:13.695309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf8e9c-3268-4308-b3b2-8b0e0f1160d5 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:13.696869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf8e9c-3268-4308-b3b2-8b0e0f1160d5 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:13.697261 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf8e9c-3268-4308-b3b2-8b0e0f1160d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:13.698995 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43f612-aed4-4b4d-baf3-6124380ab027 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:13.699816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43f612-aed4-4b4d-baf3-6124380ab027 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:13.700369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43f612-aed4-4b4d-baf3-6124380ab027 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:13.701009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43f612-aed4-4b4d-baf3-6124380ab027 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/projects/f69d19104d6a4dd7b1da4361202df6d3` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:13.704039 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43f612-aed4-4b4d-baf3-6124380ab027 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f69d19104d6a4dd7b1da4361202df6d3)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:13.707281 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43f612-aed4-4b4d-baf3-6124380ab027 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:13.727505 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-bcaf8e9c-3268-4308-b3b2-8b0e0f1160d5 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:13.729348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-bcaf8e9c-3268-4308-b3b2-8b0e0f1160d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:13.745114 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2568/5115] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:21:13.747290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf8e9c-3268-4308-b3b2-8b0e0f1160d5 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:13.778351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf8e9c-3268-4308-b3b2-8b0e0f1160d5 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:13.785794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8859e-a357-44da-aac5-4a3b0239e484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:13.786663 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8859e-a357-44da-aac5-4a3b0239e484 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:13.788002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8859e-a357-44da-aac5-4a3b0239e484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:13.788002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8859e-a357-44da-aac5-4a3b0239e484 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:13.788002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8859e-a357-44da-aac5-4a3b0239e484 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:21:13.788711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8859e-a357-44da-aac5-4a3b0239e484 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:13.790740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8859e-a357-44da-aac5-4a3b0239e484 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:13.808770 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2569/5116] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:21:13.813910 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8859e-a357-44da-aac5-4a3b0239e484 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:13.819746 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:13.829343 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8859e-a357-44da-aac5-4a3b0239e484 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:13.853414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1c43f612-aed4-4b4d-baf3-6124380ab027 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f69d19104d6a4dd7b1da4361202df6d3', 'request_id': 'req-1c43f612-aed4-4b4d-baf3-6124380ab027'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:13.876567 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1c43f612-aed4-4b4d-baf3-6124380ab027 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f69d19104d6a4dd7b1da4361202df6d3', 'request_id': 'req-1c43f612-aed4-4b4d-baf3-6124380ab027'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:13.884375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1c43f612-aed4-4b4d-baf3-6124380ab027 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f69d19104d6a4dd7b1da4361202df6d3', 'request_id': 'req-1c43f612-aed4-4b4d-baf3-6124380ab027'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:13.915235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1c43f612-aed4-4b4d-baf3-6124380ab027 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] The token cache is being invalidate because project f69d19104d6a4dd7b1da4361202df6d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:13.915554 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1c43f612-aed4-4b4d-baf3-6124380ab027 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:13.916278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1c43f612-aed4-4b4d-baf3-6124380ab027 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:13.918269 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2548/5117] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:21:13 2022] DELETE /identity/v3/projects/f69d19104d6a4dd7b1da4361202df6d3 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:21:13.925533 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43f612-aed4-4b4d-baf3-6124380ab027 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:13.928201 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1c43f612-aed4-4b4d-baf3-6124380ab027 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:13.991525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d7ea9-c86d-4c4d-b270-ace15171949b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:13.992564 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d7ea9-c86d-4c4d-b270-ace15171949b admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:13.992983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d7ea9-c86d-4c4d-b270-ace15171949b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:13.993352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d7ea9-c86d-4c4d-b270-ace15171949b admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:13.996845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d7ea9-c86d-4c4d-b270-ace15171949b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:13.999678 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d7ea9-c86d-4c4d-b270-ace15171949b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:14.004370 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=10,keystone:UPDATE=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:14.023457 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43f612-aed4-4b4d-baf3-6124380ab027 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:14.032535 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89610781-355e-4177-971f-67d78dbc55c3 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:14.033261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89610781-355e-4177-971f-67d78dbc55c3 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:14.034700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89610781-355e-4177-971f-67d78dbc55c3 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:14.035385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89610781-355e-4177-971f-67d78dbc55c3 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:14.036632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89610781-355e-4177-971f-67d78dbc55c3 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:14.043772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89610781-355e-4177-971f-67d78dbc55c3 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:14.047783 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2570/5118] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:21:13 2022] POST /identity/v3/projects => generated 353 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:21:14.049394 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d7ea9-c86d-4c4d-b270-ace15171949b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:14.053200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fa8d7ea9-c86d-4c4d-b270-ace15171949b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:14.121184 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2549/5119] 10.222.0.30 () {60 vars in 1152 bytes} [Sun Sep 4 01:21:13 2022] POST /identity/v3/projects => generated 328 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:14.126196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89610781-355e-4177-971f-67d78dbc55c3 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:14.206620 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d7ea9-c86d-4c4d-b270-ace15171949b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:14.255109 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89610781-355e-4177-971f-67d78dbc55c3 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:14.264845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95920b99-2a4e-4ab0-a1eb-27ee300c2b61 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:14.265822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95920b99-2a4e-4ab0-a1eb-27ee300c2b61 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:14.266119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95920b99-2a4e-4ab0-a1eb-27ee300c2b61 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:14.266565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95920b99-2a4e-4ab0-a1eb-27ee300c2b61 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:14.268391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95920b99-2a4e-4ab0-a1eb-27ee300c2b61 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:14.271723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95920b99-2a4e-4ab0-a1eb-27ee300c2b61 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:14.321280 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2550/5120] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:21:14 2022] POST /identity/v3/users => generated 416 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:14.327701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95920b99-2a4e-4ab0-a1eb-27ee300c2b61 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:14.339368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3de01-ad79-42aa-b547-25b4ce16c879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:14.340190 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3de01-ad79-42aa-b547-25b4ce16c879 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:14.340659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3de01-ad79-42aa-b547-25b4ce16c879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:14.340976 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3de01-ad79-42aa-b547-25b4ce16c879 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:14.342093 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3de01-ad79-42aa-b547-25b4ce16c879 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:14.359322 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95920b99-2a4e-4ab0-a1eb-27ee300c2b61 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:14.362072 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3de01-ad79-42aa-b547-25b4ce16c879 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:14.371439 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9759582-0dc9-471e-aa4a-17da9f7b2002 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:14.373076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9759582-0dc9-471e-aa4a-17da9f7b2002 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:14.373365 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9759582-0dc9-471e-aa4a-17da9f7b2002 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:14.373669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9759582-0dc9-471e-aa4a-17da9f7b2002 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:14.379053 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9759582-0dc9-471e-aa4a-17da9f7b2002 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:14.380879 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9759582-0dc9-471e-aa4a-17da9f7b2002 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:14.411384 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2571/5121] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:21:14 2022] POST /identity/v3/users => generated 277 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:14.424084 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2551/5122] 10.222.0.30 () {60 vars in 1143 bytes} [Sun Sep 4 01:21:14 2022] POST /identity/v3/roles => generated 244 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:14.424471 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3de01-ad79-42aa-b547-25b4ce16c879 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:14.429208 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9759582-0dc9-471e-aa4a-17da9f7b2002 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:14.446326 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3de01-ad79-42aa-b547-25b4ce16c879 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:14.453151 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64edd0f7-06d5-444b-9093-b7ee6f757c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:14.455543 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9759582-0dc9-471e-aa4a-17da9f7b2002 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:14.455712 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edd0f7-06d5-444b-9093-b7ee6f757c91 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:14.456006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edd0f7-06d5-444b-9093-b7ee6f757c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:14.456731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edd0f7-06d5-444b-9093-b7ee6f757c91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:14.456928 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64edd0f7-06d5-444b-9093-b7ee6f757c91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:14.458621 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64edd0f7-06d5-444b-9093-b7ee6f757c91 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:14.469291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a432c-a7bf-482a-93e8-53af2c853cb2 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:14.470172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a432c-a7bf-482a-93e8-53af2c853cb2 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:14.472254 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a432c-a7bf-482a-93e8-53af2c853cb2 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:14.472650 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a432c-a7bf-482a-93e8-53af2c853cb2 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:14.473703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a432c-a7bf-482a-93e8-53af2c853cb2 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:14.480378 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a432c-a7bf-482a-93e8-53af2c853cb2 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:14.491411 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2572/5123] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:14 2022] GET /identity/v3/roles => generated 1655 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:14.493563 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64edd0f7-06d5-444b-9093-b7ee6f757c91 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:14.512001 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2552/5124] 10.222.0.30 () {60 vars in 1143 bytes} [Sun Sep 4 01:21:14 2022] POST /identity/v3/roles => generated 246 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:14.515945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a432c-a7bf-482a-93e8-53af2c853cb2 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:14.519813 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64edd0f7-06d5-444b-9093-b7ee6f757c91 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:14.537069 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a432c-a7bf-482a-93e8-53af2c853cb2 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:14.538680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155993a3-d4fe-4438-9eb0-3bb7fff0b1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:14.539576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155993a3-d4fe-4438-9eb0-3bb7fff0b1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:14.540462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155993a3-d4fe-4438-9eb0-3bb7fff0b1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:14.543057 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155993a3-d4fe-4438-9eb0-3bb7fff0b1e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:14.543769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155993a3-d4fe-4438-9eb0-3bb7fff0b1e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:14.545414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155993a3-d4fe-4438-9eb0-3bb7fff0b1e1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:14.547106 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7595a42-de87-45e0-8bac-62a318c531b3 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:14.547993 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7595a42-de87-45e0-8bac-62a318c531b3 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:14.554334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7595a42-de87-45e0-8bac-62a318c531b3 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:14.555687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7595a42-de87-45e0-8bac-62a318c531b3 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/projects/179632329f75458abe84be15a2a55ebf/users/413a2df16f594c62a9ff1afe3af8e4a3/roles/825b38b8a606430d87fc65d6de43d914` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:14.564019 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2573/5125] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:14 2022] GET /identity/v3/roles => generated 1892 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:14.576820 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155993a3-d4fe-4438-9eb0-3bb7fff0b1e1 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:14.582986 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:14.593966 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7595a42-de87-45e0-8bac-62a318c531b3 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:create_grant(project_id=179632329f75458abe84be15a2a55ebf, user_id=413a2df16f594c62a9ff1afe3af8e4a3, role_id=825b38b8a606430d87fc65d6de43d914)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:14.594186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155993a3-d4fe-4438-9eb0-3bb7fff0b1e1 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:14.602037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7595a42-de87-45e0-8bac-62a318c531b3 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:14.605124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849717c1-1fef-4ac0-aaf8-10fe638358ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:14.605845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849717c1-1fef-4ac0-aaf8-10fe638358ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:14.606127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849717c1-1fef-4ac0-aaf8-10fe638358ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:14.606403 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849717c1-1fef-4ac0-aaf8-10fe638358ba admin admin] PATH_INFO: `/v3/projects/4f0884eb349f4c72b55a0f1aa14b151b/users/c1eee4122e8a447fa98792ad5a629c5e/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:14.635141 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2553/5126] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:21:14 2022] PUT /identity/v3/projects/179632329f75458abe84be15a2a55ebf/users/413a2df16f594c62a9ff1afe3af8e4a3/roles/825b38b8a606430d87fc65d6de43d914 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:21:14.636375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7595a42-de87-45e0-8bac-62a318c531b3 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:14.642331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849717c1-1fef-4ac0-aaf8-10fe638358ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f0884eb349f4c72b55a0f1aa14b151b, user_id=c1eee4122e8a447fa98792ad5a629c5e, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:14.645986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849717c1-1fef-4ac0-aaf8-10fe638358ba admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:14.671761 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2574/5127] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:21:14 2022] PUT /identity/v3/projects/4f0884eb349f4c72b55a0f1aa14b151b/users/c1eee4122e8a447fa98792ad5a629c5e/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:14.682618 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73506d51-cb77-4669-8829-dbf2a1b2d12f None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:14.683468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73506d51-cb77-4669-8829-dbf2a1b2d12f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:14.686531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73506d51-cb77-4669-8829-dbf2a1b2d12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:14.753189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-73506d51-cb77-4669-8829-dbf2a1b2d12f None None] MFA Rules not processed for user `c1eee4122e8a447fa98792ad5a629c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:14.756880 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-73506d51-cb77-4669-8829-dbf2a1b2d12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:14.771119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7595a42-de87-45e0-8bac-62a318c531b3 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:14.805846 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:14.886237 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b9de3-3287-4566-b674-73a3ea58806b tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:14.887732 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b9de3-3287-4566-b674-73a3ea58806b tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:14.888453 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b9de3-3287-4566-b674-73a3ea58806b tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:14.889010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b9de3-3287-4566-b674-73a3ea58806b tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/projects/179632329f75458abe84be15a2a55ebf/users/413a2df16f594c62a9ff1afe3af8e4a3/roles/e1c553f6dfb34266b78d87fe384e20b9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:14.893187 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b9de3-3287-4566-b674-73a3ea58806b tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:create_grant(project_id=179632329f75458abe84be15a2a55ebf, user_id=413a2df16f594c62a9ff1afe3af8e4a3, role_id=e1c553f6dfb34266b78d87fe384e20b9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:14.903084 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b9de3-3287-4566-b674-73a3ea58806b tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:14.917742 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2575/5128] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:14 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:14.925109 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2554/5129] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:21:14 2022] PUT /identity/v3/projects/179632329f75458abe84be15a2a55ebf/users/413a2df16f594c62a9ff1afe3af8e4a3/roles/e1c553f6dfb34266b78d87fe384e20b9 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:21:14.928795 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73506d51-cb77-4669-8829-dbf2a1b2d12f None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:14.942141 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73506d51-cb77-4669-8829-dbf2a1b2d12f None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:14.950787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b9de3-3287-4566-b674-73a3ea58806b tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:14.952999 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-de5b9de3-3287-4566-b674-73a3ea58806b tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:15.048445 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4c170-4480-4bd8-a493-518bc85f11a7 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:15.049662 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4c170-4480-4bd8-a493-518bc85f11a7 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:15.050006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4c170-4480-4bd8-a493-518bc85f11a7 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:15.050228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4c170-4480-4bd8-a493-518bc85f11a7 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:15.052326 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4c170-4480-4bd8-a493-518bc85f11a7 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:15.057886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4c170-4480-4bd8-a493-518bc85f11a7 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:15.078818 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b9de3-3287-4566-b674-73a3ea58806b tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:15.089816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c754a4-f5db-4b8c-b13e-01cb14ef221f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:15.090447 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c754a4-f5db-4b8c-b13e-01cb14ef221f service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:15.090729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c754a4-f5db-4b8c-b13e-01cb14ef221f service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:15.091003 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c754a4-f5db-4b8c-b13e-01cb14ef221f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:15.135286 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2576/5130] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:14 2022] GET /identity/v3/users => generated 8318 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:15.137769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8db218-26f5-4a4a-9e46-03700580f77d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:15.138051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8db218-26f5-4a4a-9e46-03700580f77d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:15.138321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8db218-26f5-4a4a-9e46-03700580f77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:15.206975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c754a4-f5db-4b8c-b13e-01cb14ef221f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:15.209276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c754a4-f5db-4b8c-b13e-01cb14ef221f service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:15.224952 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2555/5131] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:21:14 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:21:15.238143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-8e8db218-26f5-4a4a-9e46-03700580f77d None None] MFA Rules not processed for user `413a2df16f594c62a9ff1afe3af8e4a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:15.239796 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8e8db218-26f5-4a4a-9e46-03700580f77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:15.313144 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95678276-52d7-4990-8b1c-f3b0106980e3 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:15.313535 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95678276-52d7-4990-8b1c-f3b0106980e3 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:15.313786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95678276-52d7-4990-8b1c-f3b0106980e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:15.326081 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:15.383318 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2577/5132] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:15 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:21:15.386138 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-95678276-52d7-4990-8b1c-f3b0106980e3 None None] MFA Rules not processed for user `e3029c8759614a508f3b78b80c4ca0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:15.386272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c486d30-1520-4a43-9a75-1cc6a945414d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:15.386375 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c486d30-1520-4a43-9a75-1cc6a945414d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:15.386625 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c486d30-1520-4a43-9a75-1cc6a945414d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:15.391120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-95678276-52d7-4990-8b1c-f3b0106980e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:15.450815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-0c486d30-1520-4a43-9a75-1cc6a945414d None None] MFA Rules not processed for user `413a2df16f594c62a9ff1afe3af8e4a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:15.452000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0c486d30-1520-4a43-9a75-1cc6a945414d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:15.473775 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2578/5133] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:15 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:15.483002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c486d30-1520-4a43-9a75-1cc6a945414d None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:15.501027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c486d30-1520-4a43-9a75-1cc6a945414d None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:15.510999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebadee6-ad24-471d-bafb-7de71ed42d4b tempest-TrustsV3TestJSON-660378742 tempest-user-1867526329] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413a2df16f594c62a9ff1afe3af8e4a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '179632329f75458abe84be15a2a55ebf', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-2125227586', 'tempest-NotDelegatedRole-639842389'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:15.511632 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebadee6-ad24-471d-bafb-7de71ed42d4b tempest-TrustsV3TestJSON-660378742 tempest-user-1867526329] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:15.511913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebadee6-ad24-471d-bafb-7de71ed42d4b tempest-TrustsV3TestJSON-660378742 tempest-user-1867526329] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:15.512186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebadee6-ad24-471d-bafb-7de71ed42d4b tempest-TrustsV3TestJSON-660378742 tempest-user-1867526329] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:15.512863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebadee6-ad24-471d-bafb-7de71ed42d4b tempest-TrustsV3TestJSON-660378742 tempest-user-1867526329] RBAC: Authorizing `identity:create_trust()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:15.514111 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebadee6-ad24-471d-bafb-7de71ed42d4b tempest-TrustsV3TestJSON-660378742 tempest-user-1867526329] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:15.565928 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2556/5134] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:15 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:15.576636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130845e4-7fd9-42a3-8555-5cf40a852efe None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:15.576887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130845e4-7fd9-42a3-8555-5cf40a852efe None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:15.577164 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130845e4-7fd9-42a3-8555-5cf40a852efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:15.588267 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:15.614708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-130845e4-7fd9-42a3-8555-5cf40a852efe None None] MFA Rules not processed for user `e3029c8759614a508f3b78b80c4ca0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:15.615934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-130845e4-7fd9-42a3-8555-5cf40a852efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:15.635730 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2557/5135] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:15 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:21:15.645338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130845e4-7fd9-42a3-8555-5cf40a852efe None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:15.646995 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-130845e4-7fd9-42a3-8555-5cf40a852efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:15.683993 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-3ebadee6-ad24-471d-bafb-7de71ed42d4b tempest-TrustsV3TestJSON-660378742 tempest-user-1867526329] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 04 01:21:15.683993 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:21:15.683993 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Sep 04 01:21:15.683993 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Sep 04 01:21:15.683993 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Sep 04 01:21:15.683993 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Sep 04 01:21:15.683993 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Sep 04 01:21:15.683993 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:21:15.683993 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:21:15.683993 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:21:15.683993 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:21:15.683993 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Sep 04 01:21:15.683993 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Sep 04 01:21:15.683993 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Sep 04 01:21:15.685178 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise ValueError(str(e)) Sep 04 01:21:15.685178 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Sep 04 01:21:15.685178 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:21:15.685178 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:21:15.685178 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:21:15.685178 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:21:15.685178 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:21:15.685178 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:21:15.685178 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:21:15.685178 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:21:15.685178 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:21:15.685178 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:21:15.685178 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:21:15.685178 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:21:15.685178 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:21:15.685178 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:21:15.685178 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Sep 04 01:21:15.685178 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Sep 04 01:21:15.686412 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Sep 04 01:21:15.686412 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Sep 04 01:21:15.686412 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Sep 04 01:21:15.686412 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Sep 04 01:21:15.686412 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 04 01:21:15.686412 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:21:15.686412 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2579/5136] 10.222.0.30 () {60 vars in 1174 bytes} [Sun Sep 4 01:21:15 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 200 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 04 01:21:15.686944 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebadee6-ad24-471d-bafb-7de71ed42d4b tempest-TrustsV3TestJSON-660378742 tempest-user-1867526329] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:15.719830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebadee6-ad24-471d-bafb-7de71ed42d4b tempest-TrustsV3TestJSON-660378742 tempest-user-1867526329] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:15.733950 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a62290-17cc-484c-a4a0-fa2b49c1dccd tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:15.734658 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a62290-17cc-484c-a4a0-fa2b49c1dccd tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:15.735312 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a62290-17cc-484c-a4a0-fa2b49c1dccd tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:15.736518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a62290-17cc-484c-a4a0-fa2b49c1dccd tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/roles/e1c553f6dfb34266b78d87fe384e20b9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:15.740722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a62290-17cc-484c-a4a0-fa2b49c1dccd tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e1c553f6dfb34266b78d87fe384e20b9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:15.745703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a62290-17cc-484c-a4a0-fa2b49c1dccd tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:15.859508 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-91a62290-17cc-484c-a4a0-fa2b49c1dccd tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invalidating the token cache because role e1c553f6dfb34266b78d87fe384e20b9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:15.859963 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-91a62290-17cc-484c-a4a0-fa2b49c1dccd tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:15.861397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-91a62290-17cc-484c-a4a0-fa2b49c1dccd tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:15.863549 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2580/5137] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:21:15 2022] DELETE /identity/v3/roles/e1c553f6dfb34266b78d87fe384e20b9 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:15.868764 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a62290-17cc-484c-a4a0-fa2b49c1dccd tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:15.870573 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-91a62290-17cc-484c-a4a0-fa2b49c1dccd tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:15.890700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130845e4-7fd9-42a3-8555-5cf40a852efe None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:16.032117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a62290-17cc-484c-a4a0-fa2b49c1dccd tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:16.046724 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba1451-73e8-4da2-b3be-a1b8dbebb8f9 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:16.047407 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba1451-73e8-4da2-b3be-a1b8dbebb8f9 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:16.047697 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba1451-73e8-4da2-b3be-a1b8dbebb8f9 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:16.047980 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba1451-73e8-4da2-b3be-a1b8dbebb8f9 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/roles/825b38b8a606430d87fc65d6de43d914` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:16.058837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463c24c-de57-4feb-a61a-f02476d42ad4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:16.059216 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdba1451-73e8-4da2-b3be-a1b8dbebb8f9 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:delete_role(role_id=825b38b8a606430d87fc65d6de43d914)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:16.059607 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463c24c-de57-4feb-a61a-f02476d42ad4 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:16.059989 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463c24c-de57-4feb-a61a-f02476d42ad4 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:16.060191 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463c24c-de57-4feb-a61a-f02476d42ad4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:16.062227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdba1451-73e8-4da2-b3be-a1b8dbebb8f9 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:16.063352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6463c24c-de57-4feb-a61a-f02476d42ad4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:16.167574 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-cdba1451-73e8-4da2-b3be-a1b8dbebb8f9 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invalidating the token cache because role 825b38b8a606430d87fc65d6de43d914 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:16.168077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-cdba1451-73e8-4da2-b3be-a1b8dbebb8f9 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:16.169188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-cdba1451-73e8-4da2-b3be-a1b8dbebb8f9 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:16.178554 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2581/5138] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:21:15 2022] DELETE /identity/v3/roles/825b38b8a606430d87fc65d6de43d914 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:16.180258 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba1451-73e8-4da2-b3be-a1b8dbebb8f9 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:16.183992 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-cdba1451-73e8-4da2-b3be-a1b8dbebb8f9 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:16.208588 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:16.264846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6463c24c-de57-4feb-a61a-f02476d42ad4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:16.275304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6463c24c-de57-4feb-a61a-f02476d42ad4 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:16.301421 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2558/5139] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:21:15 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:21:16.357141 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba1451-73e8-4da2-b3be-a1b8dbebb8f9 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:16.372960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc01683-5a10-4f69-844a-491005808539 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:16.373898 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc01683-5a10-4f69-844a-491005808539 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:16.374340 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc01683-5a10-4f69-844a-491005808539 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:16.374949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc01683-5a10-4f69-844a-491005808539 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/users/413a2df16f594c62a9ff1afe3af8e4a3` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:16.376449 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc01683-5a10-4f69-844a-491005808539 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:delete_user(user_id=413a2df16f594c62a9ff1afe3af8e4a3)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:16.378625 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc01683-5a10-4f69-844a-491005808539 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:16.464806 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6cc01683-5a10-4f69-844a-491005808539 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '413a2df16f594c62a9ff1afe3af8e4a3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:16.465548 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6cc01683-5a10-4f69-844a-491005808539 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '413a2df16f594c62a9ff1afe3af8e4a3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:16.477654 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6cc01683-5a10-4f69-844a-491005808539 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '413a2df16f594c62a9ff1afe3af8e4a3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:16.494705 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6cc01683-5a10-4f69-844a-491005808539 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '413a2df16f594c62a9ff1afe3af8e4a3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:16.496128 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6cc01683-5a10-4f69-844a-491005808539 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '413a2df16f594c62a9ff1afe3af8e4a3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:16.582048 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2582/5140] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:21:16 2022] DELETE /identity/v3/users/413a2df16f594c62a9ff1afe3af8e4a3 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:16.589860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463c24c-de57-4feb-a61a-f02476d42ad4 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:16.612681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463c24c-de57-4feb-a61a-f02476d42ad4 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:16.696788 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:16.785270 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d123f7-76be-4fc2-bb42-4de9d595c6eb tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:16.786575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d123f7-76be-4fc2-bb42-4de9d595c6eb tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:16.786970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d123f7-76be-4fc2-bb42-4de9d595c6eb tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:16.787348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d123f7-76be-4fc2-bb42-4de9d595c6eb tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/projects/179632329f75458abe84be15a2a55ebf` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:16.788737 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d123f7-76be-4fc2-bb42-4de9d595c6eb tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:delete_project(project_id=179632329f75458abe84be15a2a55ebf)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:16.790910 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d123f7-76be-4fc2-bb42-4de9d595c6eb tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:16.864870 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-50d123f7-76be-4fc2-bb42-4de9d595c6eb tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '179632329f75458abe84be15a2a55ebf', 'request_id': 'req-50d123f7-76be-4fc2-bb42-4de9d595c6eb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:16.885775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-50d123f7-76be-4fc2-bb42-4de9d595c6eb tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '179632329f75458abe84be15a2a55ebf', 'request_id': 'req-50d123f7-76be-4fc2-bb42-4de9d595c6eb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:16.896610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-50d123f7-76be-4fc2-bb42-4de9d595c6eb tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '179632329f75458abe84be15a2a55ebf', 'request_id': 'req-50d123f7-76be-4fc2-bb42-4de9d595c6eb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:16.919539 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-50d123f7-76be-4fc2-bb42-4de9d595c6eb tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] The token cache is being invalidate because project 179632329f75458abe84be15a2a55ebf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:16.919909 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-50d123f7-76be-4fc2-bb42-4de9d595c6eb tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:16.920784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-50d123f7-76be-4fc2-bb42-4de9d595c6eb tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:16.930087 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc01683-5a10-4f69-844a-491005808539 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:16.931773 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2559/5141] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:21:16 2022] DELETE /identity/v3/projects/179632329f75458abe84be15a2a55ebf => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:16.932790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6cc01683-5a10-4f69-844a-491005808539 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:16.954332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc01683-5a10-4f69-844a-491005808539 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:17.112759 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834ad75-754f-47cc-9084-a93792d35c73 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:17.116041 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834ad75-754f-47cc-9084-a93792d35c73 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:17.116336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834ad75-754f-47cc-9084-a93792d35c73 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:17.116618 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834ad75-754f-47cc-9084-a93792d35c73 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:17.118421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834ad75-754f-47cc-9084-a93792d35c73 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:17.125934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834ad75-754f-47cc-9084-a93792d35c73 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:17.220360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d123f7-76be-4fc2-bb42-4de9d595c6eb tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:17.223403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-50d123f7-76be-4fc2-bb42-4de9d595c6eb tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:17.246918 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2583/5142] 10.222.0.30 () {60 vars in 1152 bytes} [Sun Sep 4 01:21:16 2022] POST /identity/v3/projects => generated 328 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:17.306207 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d123f7-76be-4fc2-bb42-4de9d595c6eb tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:17.424601 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a9bf0-83d8-4682-8d84-3f8346406cdc tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:17.425374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a9bf0-83d8-4682-8d84-3f8346406cdc tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:17.425792 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a9bf0-83d8-4682-8d84-3f8346406cdc tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:17.426171 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a9bf0-83d8-4682-8d84-3f8346406cdc tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:17.426978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a9bf0-83d8-4682-8d84-3f8346406cdc tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:17.431850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a9bf0-83d8-4682-8d84-3f8346406cdc tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:17.504638 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2560/5143] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:21:17 2022] POST /identity/v3/users => generated 413 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:17.511029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834ad75-754f-47cc-9084-a93792d35c73 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:17.529136 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834ad75-754f-47cc-9084-a93792d35c73 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:17.547845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6385552-010a-4dfa-ac86-93b968c3890e tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:17.550143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6385552-010a-4dfa-ac86-93b968c3890e tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:17.553178 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6385552-010a-4dfa-ac86-93b968c3890e tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:17.555241 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6385552-010a-4dfa-ac86-93b968c3890e tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:17.556843 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6385552-010a-4dfa-ac86-93b968c3890e tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:17.565833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6385552-010a-4dfa-ac86-93b968c3890e tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:17.588913 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:17.612645 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2584/5144] 10.222.0.30 () {60 vars in 1143 bytes} [Sun Sep 4 01:21:17 2022] POST /identity/v3/roles => generated 244 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:17.618458 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a9bf0-83d8-4682-8d84-3f8346406cdc tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:17.649740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a9bf0-83d8-4682-8d84-3f8346406cdc tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:17.668186 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e57367-dbf2-43e0-8122-7349dad1bd7c tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:17.668833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e57367-dbf2-43e0-8122-7349dad1bd7c tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:17.669121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e57367-dbf2-43e0-8122-7349dad1bd7c tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:17.669398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e57367-dbf2-43e0-8122-7349dad1bd7c tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:17.670112 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e57367-dbf2-43e0-8122-7349dad1bd7c tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:17.672950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e57367-dbf2-43e0-8122-7349dad1bd7c tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:17.726484 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2561/5145] 10.222.0.30 () {60 vars in 1143 bytes} [Sun Sep 4 01:21:17 2022] POST /identity/v3/roles => generated 247 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:21:17.729890 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6385552-010a-4dfa-ac86-93b968c3890e tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:17.760937 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6385552-010a-4dfa-ac86-93b968c3890e tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:17.781871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7192e-53d6-4893-b397-0d10183db7cf tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:17.782585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7192e-53d6-4893-b397-0d10183db7cf tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:17.782867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7192e-53d6-4893-b397-0d10183db7cf tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:17.783143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7192e-53d6-4893-b397-0d10183db7cf tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/projects/a6627d7e936748f3845bcc5fe60a8cc7/users/feca049f94214bdb9cf1e973ea083630/roles/007c3057018b44e2947ee4afcae5de22` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:17.859970 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7192e-53d6-4893-b397-0d10183db7cf tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a6627d7e936748f3845bcc5fe60a8cc7, user_id=feca049f94214bdb9cf1e973ea083630, role_id=007c3057018b44e2947ee4afcae5de22)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:17.870930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7192e-53d6-4893-b397-0d10183db7cf tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:17.899778 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2585/5146] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:21:17 2022] PUT /identity/v3/projects/a6627d7e936748f3845bcc5fe60a8cc7/users/feca049f94214bdb9cf1e973ea083630/roles/007c3057018b44e2947ee4afcae5de22 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:17.906765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e57367-dbf2-43e0-8122-7349dad1bd7c tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:17.954517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e57367-dbf2-43e0-8122-7349dad1bd7c tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:18.081419 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:18.147115 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ee5de-b6f8-4b85-9dc2-71b3781833f6 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:18.148193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ee5de-b6f8-4b85-9dc2-71b3781833f6 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:18.149953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ee5de-b6f8-4b85-9dc2-71b3781833f6 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:18.150358 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ee5de-b6f8-4b85-9dc2-71b3781833f6 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/projects/a6627d7e936748f3845bcc5fe60a8cc7/users/feca049f94214bdb9cf1e973ea083630/roles/5bc27e7291d04e3c8083139f88723842` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:18.158792 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ee5de-b6f8-4b85-9dc2-71b3781833f6 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a6627d7e936748f3845bcc5fe60a8cc7, user_id=feca049f94214bdb9cf1e973ea083630, role_id=5bc27e7291d04e3c8083139f88723842)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:18.162190 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ee5de-b6f8-4b85-9dc2-71b3781833f6 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:18.205399 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2562/5147] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:21:17 2022] PUT /identity/v3/projects/a6627d7e936748f3845bcc5fe60a8cc7/users/feca049f94214bdb9cf1e973ea083630/roles/5bc27e7291d04e3c8083139f88723842 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:18.217169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7192e-53d6-4893-b397-0d10183db7cf tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:18.239148 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7192e-53d6-4893-b397-0d10183db7cf tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:18.382873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8f7c0-be88-42de-b5a5-e96cc3e0a610 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:18.383560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8f7c0-be88-42de-b5a5-e96cc3e0a610 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:18.383849 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8f7c0-be88-42de-b5a5-e96cc3e0a610 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:18.384121 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8f7c0-be88-42de-b5a5-e96cc3e0a610 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:18.385116 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8f7c0-be88-42de-b5a5-e96cc3e0a610 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:18.386907 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8f7c0-be88-42de-b5a5-e96cc3e0a610 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:18.436356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5762f3-469e-44b5-b75d-b8c3551518cd None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:18.436906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5762f3-469e-44b5-b75d-b8c3551518cd None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:18.436906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5762f3-469e-44b5-b75d-b8c3551518cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:18.442220 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2586/5148] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:18 2022] GET /identity/v3/users => generated 8315 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:18.504829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-de5762f3-469e-44b5-b75d-b8c3551518cd None None] MFA Rules not processed for user `feca049f94214bdb9cf1e973ea083630`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:18.507268 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-de5762f3-469e-44b5-b75d-b8c3551518cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:18.656251 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3dc82-ae62-4b33-ac2f-40118b77a512 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:18.656809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3dc82-ae62-4b33-ac2f-40118b77a512 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:18.656809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3dc82-ae62-4b33-ac2f-40118b77a512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:18.660606 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2563/5149] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:18 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:18.708526 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c2a3dc82-ae62-4b33-ac2f-40118b77a512 None None] MFA Rules not processed for user `feca049f94214bdb9cf1e973ea083630`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:18.710414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c2a3dc82-ae62-4b33-ac2f-40118b77a512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:18.733894 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2587/5150] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:18 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:18.738915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5762f3-469e-44b5-b75d-b8c3551518cd None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:18.754951 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5762f3-469e-44b5-b75d-b8c3551518cd None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:18.771167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4b0ec-a9f5-4367-b292-f7f8e84f687b tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'feca049f94214bdb9cf1e973ea083630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6627d7e936748f3845bcc5fe60a8cc7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1409895230', 'tempest-NotDelegatedRole-1313387878'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:18.773311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4b0ec-a9f5-4367-b292-f7f8e84f687b tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:18.777161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4b0ec-a9f5-4367-b292-f7f8e84f687b tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:18.777983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4b0ec-a9f5-4367-b292-f7f8e84f687b tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:18.780555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef4b0ec-a9f5-4367-b292-f7f8e84f687b tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] RBAC: Authorizing `identity:create_trust()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:18.783275 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef4b0ec-a9f5-4367-b292-f7f8e84f687b tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:18.978535 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2564/5151] 10.222.0.30 () {60 vars in 1174 bytes} [Sun Sep 4 01:21:18 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:18.979851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3dc82-ae62-4b33-ac2f-40118b77a512 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:18.990476 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3dc82-ae62-4b33-ac2f-40118b77a512 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:19.013975 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc26224-56ab-4072-9d6e-a49d8b0d3948 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'feca049f94214bdb9cf1e973ea083630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6627d7e936748f3845bcc5fe60a8cc7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1409895230', 'tempest-NotDelegatedRole-1313387878'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:19.014640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc26224-56ab-4072-9d6e-a49d8b0d3948 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:19.014922 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc26224-56ab-4072-9d6e-a49d8b0d3948 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:19.015197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc26224-56ab-4072-9d6e-a49d8b0d3948 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] PATH_INFO: `/v3/OS-TRUST/trusts/d217026bdc984bef8fa0a8bc6c77a3c8` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:19.039412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc26224-56ab-4072-9d6e-a49d8b0d3948 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] RBAC: Authorizing `identity:get_trust(trust_id=d217026bdc984bef8fa0a8bc6c77a3c8)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:19.041837 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc26224-56ab-4072-9d6e-a49d8b0d3948 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:19.076729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4b0ec-a9f5-4367-b292-f7f8e84f687b tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:19.077208 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2588/5152] 10.222.0.30 () {58 vars in 1251 bytes} [Sun Sep 4 01:21:18 2022] GET /identity/v3/OS-TRUST/trusts/d217026bdc984bef8fa0a8bc6c77a3c8 => generated 834 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:21:19.092861 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4b0ec-a9f5-4367-b292-f7f8e84f687b tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:19.105698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056c32a-772a-477b-babb-58481c9dcc96 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'feca049f94214bdb9cf1e973ea083630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6627d7e936748f3845bcc5fe60a8cc7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1409895230', 'tempest-NotDelegatedRole-1313387878'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:19.106097 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056c32a-772a-477b-babb-58481c9dcc96 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:19.106882 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056c32a-772a-477b-babb-58481c9dcc96 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:19.109937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056c32a-772a-477b-babb-58481c9dcc96 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] PATH_INFO: `/v3/OS-TRUST/trusts/d217026bdc984bef8fa0a8bc6c77a3c8/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:19.127319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056c32a-772a-477b-babb-58481c9dcc96 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=d217026bdc984bef8fa0a8bc6c77a3c8)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:19.134073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056c32a-772a-477b-babb-58481c9dcc96 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:19.160143 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2565/5153] 10.222.0.30 () {58 vars in 1269 bytes} [Sun Sep 4 01:21:19 2022] GET /identity/v3/OS-TRUST/trusts/d217026bdc984bef8fa0a8bc6c77a3c8/roles => generated 371 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:21:19.162199 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc26224-56ab-4072-9d6e-a49d8b0d3948 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:19.193160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc26224-56ab-4072-9d6e-a49d8b0d3948 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:19.206042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed164c-91a3-43d2-bc80-0cb6ab975b41 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'feca049f94214bdb9cf1e973ea083630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6627d7e936748f3845bcc5fe60a8cc7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1409895230', 'tempest-NotDelegatedRole-1313387878'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:19.207001 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed164c-91a3-43d2-bc80-0cb6ab975b41 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:19.207427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed164c-91a3-43d2-bc80-0cb6ab975b41 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:19.207869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed164c-91a3-43d2-bc80-0cb6ab975b41 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] PATH_INFO: `/v3/OS-TRUST/trusts/d217026bdc984bef8fa0a8bc6c77a3c8/roles/007c3057018b44e2947ee4afcae5de22` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:19.225215 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed164c-91a3-43d2-bc80-0cb6ab975b41 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] RBAC: Authorizing `identity:get_role_for_trust(trust_id=d217026bdc984bef8fa0a8bc6c77a3c8, role_id=007c3057018b44e2947ee4afcae5de22)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:19.226651 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed164c-91a3-43d2-bc80-0cb6ab975b41 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:19.284078 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2589/5154] 10.222.0.30 () {58 vars in 1368 bytes} [Sun Sep 4 01:21:19 2022] GET /identity/v3/OS-TRUST/trusts/d217026bdc984bef8fa0a8bc6c77a3c8/roles/007c3057018b44e2947ee4afcae5de22 => generated 244 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:21:19.289257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056c32a-772a-477b-babb-58481c9dcc96 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:19.305901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056c32a-772a-477b-babb-58481c9dcc96 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:19.336358 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9649370-1223-46da-83ab-6b477e52880f tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'feca049f94214bdb9cf1e973ea083630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6627d7e936748f3845bcc5fe60a8cc7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1409895230', 'tempest-NotDelegatedRole-1313387878'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:19.337469 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9649370-1223-46da-83ab-6b477e52880f tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] REQUEST_METHOD: `HEAD` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:19.337754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9649370-1223-46da-83ab-6b477e52880f tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:19.338023 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9649370-1223-46da-83ab-6b477e52880f tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] PATH_INFO: `/v3/OS-TRUST/trusts/d217026bdc984bef8fa0a8bc6c77a3c8/roles/007c3057018b44e2947ee4afcae5de22` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:19.359533 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9649370-1223-46da-83ab-6b477e52880f tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] RBAC: Authorizing `identity:get_role_for_trust(trust_id=d217026bdc984bef8fa0a8bc6c77a3c8, role_id=007c3057018b44e2947ee4afcae5de22)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:19.365141 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9649370-1223-46da-83ab-6b477e52880f tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:19.384181 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2566/5155] 10.222.0.30 () {58 vars in 1369 bytes} [Sun Sep 4 01:21:19 2022] HEAD /identity/v3/OS-TRUST/trusts/d217026bdc984bef8fa0a8bc6c77a3c8/roles/007c3057018b44e2947ee4afcae5de22 => generated 0 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Sep 04 01:21:19.388207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed164c-91a3-43d2-bc80-0cb6ab975b41 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:19.403959 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed164c-91a3-43d2-bc80-0cb6ab975b41 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:19.420927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98757af-556d-4788-b997-ddc16197181e tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'feca049f94214bdb9cf1e973ea083630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6627d7e936748f3845bcc5fe60a8cc7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1409895230', 'tempest-NotDelegatedRole-1313387878'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:19.423660 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98757af-556d-4788-b997-ddc16197181e tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:19.424233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98757af-556d-4788-b997-ddc16197181e tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:19.425386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98757af-556d-4788-b997-ddc16197181e tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] PATH_INFO: `/v3/OS-TRUST/trusts/d217026bdc984bef8fa0a8bc6c77a3c8/roles/5bc27e7291d04e3c8083139f88723842` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:19.437383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98757af-556d-4788-b997-ddc16197181e tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] RBAC: Authorizing `identity:get_role_for_trust(trust_id=d217026bdc984bef8fa0a8bc6c77a3c8, role_id=5bc27e7291d04e3c8083139f88723842)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:19.466288 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98757af-556d-4788-b997-ddc16197181e tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:19.495040 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-c98757af-556d-4788-b997-ddc16197181e tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] Could not find role: 5bc27e7291d04e3c8083139f88723842.: keystone.exception.RoleNotFound: Could not find role: 5bc27e7291d04e3c8083139f88723842. Sep 04 01:21:19.495040 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:21:19.495040 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:21:19.495040 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:21:19.495040 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:21:19.495040 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:21:19.495040 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:21:19.495040 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:21:19.495040 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:21:19.495040 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:21:19.495040 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:21:19.495040 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:21:19.495040 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Sep 04 01:21:19.495040 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 01:21:19.495040 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 5bc27e7291d04e3c8083139f88723842. Sep 04 01:21:19.496354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:21:19.501038 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2590/5156] 10.222.0.30 () {58 vars in 1368 bytes} [Sun Sep 4 01:21:19 2022] GET /identity/v3/OS-TRUST/trusts/d217026bdc984bef8fa0a8bc6c77a3c8/roles/5bc27e7291d04e3c8083139f88723842 => generated 110 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:21:19.505119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9649370-1223-46da-83ab-6b477e52880f tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:19.524278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9649370-1223-46da-83ab-6b477e52880f tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:19.536355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6978a6b-aa62-41b7-a952-4fa480d48e3d tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'feca049f94214bdb9cf1e973ea083630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6627d7e936748f3845bcc5fe60a8cc7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1409895230', 'tempest-NotDelegatedRole-1313387878'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:19.539252 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6978a6b-aa62-41b7-a952-4fa480d48e3d tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] REQUEST_METHOD: `HEAD` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:19.539819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6978a6b-aa62-41b7-a952-4fa480d48e3d tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:19.540248 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6978a6b-aa62-41b7-a952-4fa480d48e3d tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] PATH_INFO: `/v3/OS-TRUST/trusts/d217026bdc984bef8fa0a8bc6c77a3c8/roles/5bc27e7291d04e3c8083139f88723842` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:19.543992 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:19.556387 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6978a6b-aa62-41b7-a952-4fa480d48e3d tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] RBAC: Authorizing `identity:get_role_for_trust(trust_id=d217026bdc984bef8fa0a8bc6c77a3c8, role_id=5bc27e7291d04e3c8083139f88723842)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:19.559908 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6978a6b-aa62-41b7-a952-4fa480d48e3d tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:19.586044 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-c6978a6b-aa62-41b7-a952-4fa480d48e3d tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] Could not find role: 5bc27e7291d04e3c8083139f88723842.: keystone.exception.RoleNotFound: Could not find role: 5bc27e7291d04e3c8083139f88723842. Sep 04 01:21:19.586044 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:21:19.586044 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:21:19.586044 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:21:19.586044 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:21:19.586044 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:21:19.586044 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:21:19.586044 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:21:19.586044 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:21:19.586044 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:21:19.586044 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:21:19.586044 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:21:19.586044 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Sep 04 01:21:19.586044 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 01:21:19.586044 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 5bc27e7291d04e3c8083139f88723842. Sep 04 01:21:19.587674 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:21:19.587954 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2567/5157] 10.222.0.30 () {58 vars in 1369 bytes} [Sun Sep 4 01:21:19 2022] HEAD /identity/v3/OS-TRUST/trusts/d217026bdc984bef8fa0a8bc6c77a3c8/roles/5bc27e7291d04e3c8083139f88723842 => generated 0 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Sep 04 01:21:19.592076 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98757af-556d-4788-b997-ddc16197181e tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:19.618450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98757af-556d-4788-b997-ddc16197181e tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:19.632963 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f1a36-c899-490e-bbb6-4938434bfed3 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'feca049f94214bdb9cf1e973ea083630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6627d7e936748f3845bcc5fe60a8cc7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1409895230', 'tempest-NotDelegatedRole-1313387878'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:19.637807 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f1a36-c899-490e-bbb6-4938434bfed3 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:19.638240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f1a36-c899-490e-bbb6-4938434bfed3 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:19.640361 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f1a36-c899-490e-bbb6-4938434bfed3 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] PATH_INFO: `/v3/OS-TRUST/trusts/d217026bdc984bef8fa0a8bc6c77a3c8` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:19.682198 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f1a36-c899-490e-bbb6-4938434bfed3 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] RBAC: Authorizing `identity:delete_trust(trust_id=d217026bdc984bef8fa0a8bc6c77a3c8)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:19.688572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f1a36-c899-490e-bbb6-4938434bfed3 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:19.752414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87057a55-7c02-41f1-b99c-46a7e13ca466 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:19.752893 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87057a55-7c02-41f1-b99c-46a7e13ca466 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:19.753393 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87057a55-7c02-41f1-b99c-46a7e13ca466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:19.765597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-752f1a36-c899-490e-bbb6-4938434bfed3 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'd217026bdc984bef8fa0a8bc6c77a3c8', 'request_id': 'req-752f1a36-c899-490e-bbb6-4938434bfed3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:19.785121 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-752f1a36-c899-490e-bbb6-4938434bfed3 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'd217026bdc984bef8fa0a8bc6c77a3c8', 'request_id': 'req-752f1a36-c899-490e-bbb6-4938434bfed3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:19.787864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-752f1a36-c899-490e-bbb6-4938434bfed3 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'd217026bdc984bef8fa0a8bc6c77a3c8', 'request_id': 'req-752f1a36-c899-490e-bbb6-4938434bfed3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:19.801010 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2591/5158] 10.222.0.30 () {58 vars in 1254 bytes} [Sun Sep 4 01:21:19 2022] DELETE /identity/v3/OS-TRUST/trusts/d217026bdc984bef8fa0a8bc6c77a3c8 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:19.802397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f1a36-c899-490e-bbb6-4938434bfed3 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:19.804466 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-752f1a36-c899-490e-bbb6-4938434bfed3 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:19.823635 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f1a36-c899-490e-bbb6-4938434bfed3 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:19.837937 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f58e6-42fe-44a2-9501-03e9bb3439f6 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'feca049f94214bdb9cf1e973ea083630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6627d7e936748f3845bcc5fe60a8cc7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1409895230', 'tempest-NotDelegatedRole-1313387878'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:19.839638 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f58e6-42fe-44a2-9501-03e9bb3439f6 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:19.840286 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f58e6-42fe-44a2-9501-03e9bb3439f6 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:19.842347 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f58e6-42fe-44a2-9501-03e9bb3439f6 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] PATH_INFO: `/v3/OS-TRUST/trusts/d217026bdc984bef8fa0a8bc6c77a3c8` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:19.850232 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-87057a55-7c02-41f1-b99c-46a7e13ca466 None None] MFA Rules not processed for user `6da5161f966c4d61b0c30e78829e5e1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:19.853034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-87057a55-7c02-41f1-b99c-46a7e13ca466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:19.859725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-a24f58e6-42fe-44a2-9501-03e9bb3439f6 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] Could not find trust: d217026bdc984bef8fa0a8bc6c77a3c8.: keystone.exception.TrustNotFound: Could not find trust: d217026bdc984bef8fa0a8bc6c77a3c8. Sep 04 01:21:19.859725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:21:19.859725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:21:19.859725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:21:19.859725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:21:19.859725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:21:19.859725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:21:19.859725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:21:19.859725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:21:19.859725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:21:19.859725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:21:19.859725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:21:19.859725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Sep 04 01:21:19.859725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Sep 04 01:21:19.859725 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Sep 04 01:21:19.860965 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Sep 04 01:21:19.860965 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Sep 04 01:21:19.860965 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Sep 04 01:21:19.860965 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Sep 04 01:21:19.860965 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Sep 04 01:21:19.860965 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:21:19.860965 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:21:19.860965 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Sep 04 01:21:19.860965 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Sep 04 01:21:19.860965 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Sep 04 01:21:19.860965 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Sep 04 01:21:19.860965 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: d217026bdc984bef8fa0a8bc6c77a3c8. Sep 04 01:21:19.860965 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:21:19.872779 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2592/5159] 10.222.0.30 () {58 vars in 1251 bytes} [Sun Sep 4 01:21:19 2022] GET /identity/v3/OS-TRUST/trusts/d217026bdc984bef8fa0a8bc6c77a3c8 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Sep 04 01:21:19.874490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f58e6-42fe-44a2-9501-03e9bb3439f6 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:19.879550 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a24f58e6-42fe-44a2-9501-03e9bb3439f6 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:19.905218 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f58e6-42fe-44a2-9501-03e9bb3439f6 tempest-TrustsV3TestJSON-223839324 tempest-user-857541137] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:19.912146 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a58c29-ad67-4db5-baaa-e25027a61d22 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:19.913205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a58c29-ad67-4db5-baaa-e25027a61d22 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:19.913775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a58c29-ad67-4db5-baaa-e25027a61d22 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:19.915274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a58c29-ad67-4db5-baaa-e25027a61d22 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/roles/5bc27e7291d04e3c8083139f88723842` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:19.917167 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a58c29-ad67-4db5-baaa-e25027a61d22 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5bc27e7291d04e3c8083139f88723842)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:19.919339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a58c29-ad67-4db5-baaa-e25027a61d22 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:19.960306 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:20.038415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d4a58c29-ad67-4db5-baaa-e25027a61d22 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invalidating the token cache because role 5bc27e7291d04e3c8083139f88723842 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:20.038711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d4a58c29-ad67-4db5-baaa-e25027a61d22 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:20.042143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d4a58c29-ad67-4db5-baaa-e25027a61d22 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:20.049952 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2593/5160] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:21:19 2022] DELETE /identity/v3/roles/5bc27e7291d04e3c8083139f88723842 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:20.053397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a58c29-ad67-4db5-baaa-e25027a61d22 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:20.059621 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d4a58c29-ad67-4db5-baaa-e25027a61d22 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:20.188622 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2568/5161] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:20.205851 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87057a55-7c02-41f1-b99c-46a7e13ca466 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:20.207320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-87057a55-7c02-41f1-b99c-46a7e13ca466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:20.299329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a58c29-ad67-4db5-baaa-e25027a61d22 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:20.315927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3cd2f-eea9-4939-bab6-0edec4cd0e48 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:20.316728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3cd2f-eea9-4939-bab6-0edec4cd0e48 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:20.317066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3cd2f-eea9-4939-bab6-0edec4cd0e48 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:20.317412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3cd2f-eea9-4939-bab6-0edec4cd0e48 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/roles/007c3057018b44e2947ee4afcae5de22` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:20.321845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac3cd2f-eea9-4939-bab6-0edec4cd0e48 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:delete_role(role_id=007c3057018b44e2947ee4afcae5de22)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:20.325632 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac3cd2f-eea9-4939-bab6-0edec4cd0e48 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:20.406660 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-cac3cd2f-eea9-4939-bab6-0edec4cd0e48 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invalidating the token cache because role 007c3057018b44e2947ee4afcae5de22 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:20.407064 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-cac3cd2f-eea9-4939-bab6-0edec4cd0e48 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:20.407949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-cac3cd2f-eea9-4939-bab6-0edec4cd0e48 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:20.413768 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2594/5162] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:21:20 2022] DELETE /identity/v3/roles/007c3057018b44e2947ee4afcae5de22 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:20.415353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3cd2f-eea9-4939-bab6-0edec4cd0e48 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:20.416818 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-cac3cd2f-eea9-4939-bab6-0edec4cd0e48 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:20.470077 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87057a55-7c02-41f1-b99c-46a7e13ca466 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:20.615193 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3cd2f-eea9-4939-bab6-0edec4cd0e48 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:20.635351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1413a-97a9-494f-91b4-647eae59a650 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:20.636017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1413a-97a9-494f-91b4-647eae59a650 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:20.636308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1413a-97a9-494f-91b4-647eae59a650 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:20.636597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1413a-97a9-494f-91b4-647eae59a650 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/users/feca049f94214bdb9cf1e973ea083630` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:20.646622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1413a-97a9-494f-91b4-647eae59a650 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:delete_user(user_id=feca049f94214bdb9cf1e973ea083630)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:20.658800 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1413a-97a9-494f-91b4-647eae59a650 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:20.697369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69570eb-57f7-4525-acbd-570d21d9d26b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:20.699274 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69570eb-57f7-4525-acbd-570d21d9d26b service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:20.699634 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69570eb-57f7-4525-acbd-570d21d9d26b service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:20.699819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69570eb-57f7-4525-acbd-570d21d9d26b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:20.709854 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c69570eb-57f7-4525-acbd-570d21d9d26b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:20.795603 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:20.816462 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=11 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:20.818785 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8cc1413a-97a9-494f-91b4-647eae59a650 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'feca049f94214bdb9cf1e973ea083630'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:20.820000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8cc1413a-97a9-494f-91b4-647eae59a650 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'feca049f94214bdb9cf1e973ea083630'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:20.847581 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8cc1413a-97a9-494f-91b4-647eae59a650 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'feca049f94214bdb9cf1e973ea083630'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:20.875486 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8cc1413a-97a9-494f-91b4-647eae59a650 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'feca049f94214bdb9cf1e973ea083630'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:20.878009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8cc1413a-97a9-494f-91b4-647eae59a650 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'feca049f94214bdb9cf1e973ea083630'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:20.907630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69570eb-57f7-4525-acbd-570d21d9d26b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:20.912223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69570eb-57f7-4525-acbd-570d21d9d26b service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:20.966435 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2595/5164] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:21:20 2022] DELETE /identity/v3/users/feca049f94214bdb9cf1e973ea083630 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:20.968461 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1413a-97a9-494f-91b4-647eae59a650 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:20.973601 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2569/5164] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:21:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 756 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:21:20.974628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69570eb-57f7-4525-acbd-570d21d9d26b service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:20.975378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8cc1413a-97a9-494f-91b4-647eae59a650 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:20.999509 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69570eb-57f7-4525-acbd-570d21d9d26b service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:21.110185 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1413a-97a9-494f-91b4-647eae59a650 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:21.127694 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3123d-8c8e-4100-aba1-9130245b7430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:21.128325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3123d-8c8e-4100-aba1-9130245b7430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:21.128684 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3123d-8c8e-4100-aba1-9130245b7430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:21.129084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3123d-8c8e-4100-aba1-9130245b7430 admin admin] PATH_INFO: `/v3/users/c1eee4122e8a447fa98792ad5a629c5e` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:21.130449 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3123d-8c8e-4100-aba1-9130245b7430 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1eee4122e8a447fa98792ad5a629c5e)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:21.132513 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3123d-8c8e-4100-aba1-9130245b7430 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:21.164411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d252e-2cac-44dd-9fe3-1352ab67b406 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:21.165317 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d252e-2cac-44dd-9fe3-1352ab67b406 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:21.165854 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d252e-2cac-44dd-9fe3-1352ab67b406 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:21.166277 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d252e-2cac-44dd-9fe3-1352ab67b406 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/projects/a6627d7e936748f3845bcc5fe60a8cc7` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:21.168137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d252e-2cac-44dd-9fe3-1352ab67b406 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a6627d7e936748f3845bcc5fe60a8cc7)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:21.170816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d252e-2cac-44dd-9fe3-1352ab67b406 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:21.241042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1fd3123d-8c8e-4100-aba1-9130245b7430 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1eee4122e8a447fa98792ad5a629c5e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:21.242055 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1fd3123d-8c8e-4100-aba1-9130245b7430 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1eee4122e8a447fa98792ad5a629c5e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:21.259303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1fd3123d-8c8e-4100-aba1-9130245b7430 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1eee4122e8a447fa98792ad5a629c5e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:21.277264 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1fd3123d-8c8e-4100-aba1-9130245b7430 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1eee4122e8a447fa98792ad5a629c5e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:21.277749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4e3d252e-2cac-44dd-9fe3-1352ab67b406 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6627d7e936748f3845bcc5fe60a8cc7', 'request_id': 'req-4e3d252e-2cac-44dd-9fe3-1352ab67b406'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:21.278912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1fd3123d-8c8e-4100-aba1-9130245b7430 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1eee4122e8a447fa98792ad5a629c5e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:21.295764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4e3d252e-2cac-44dd-9fe3-1352ab67b406 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6627d7e936748f3845bcc5fe60a8cc7', 'request_id': 'req-4e3d252e-2cac-44dd-9fe3-1352ab67b406'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:21.303821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4e3d252e-2cac-44dd-9fe3-1352ab67b406 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6627d7e936748f3845bcc5fe60a8cc7', 'request_id': 'req-4e3d252e-2cac-44dd-9fe3-1352ab67b406'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:21.322506 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2596/5165] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:21:20 2022] DELETE /identity/v3/users/c1eee4122e8a447fa98792ad5a629c5e => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:21.326425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4759bb9-0309-40c7-b0f1-1383ba8a5ee5 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:21.326854 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4e3d252e-2cac-44dd-9fe3-1352ab67b406 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] The token cache is being invalidate because project a6627d7e936748f3845bcc5fe60a8cc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:21.327272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4759bb9-0309-40c7-b0f1-1383ba8a5ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:21.327484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4e3d252e-2cac-44dd-9fe3-1352ab67b406 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:21.328626 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4759bb9-0309-40c7-b0f1-1383ba8a5ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:21.330356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4e3d252e-2cac-44dd-9fe3-1352ab67b406 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:21.332164 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2570/5166] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:21:20 2022] DELETE /identity/v3/projects/a6627d7e936748f3845bcc5fe60a8cc7 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:21.340591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d252e-2cac-44dd-9fe3-1352ab67b406 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:21.342045 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4e3d252e-2cac-44dd-9fe3-1352ab67b406 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:21.367441 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-b4759bb9-0309-40c7-b0f1-1383ba8a5ee5 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:21.370654 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b4759bb9-0309-40c7-b0f1-1383ba8a5ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:21.427631 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:21.434097 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:21.468494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d252e-2cac-44dd-9fe3-1352ab67b406 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:21.479625 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2597/5167] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:21.516324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4759bb9-0309-40c7-b0f1-1383ba8a5ee5 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:21.520335 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b4759bb9-0309-40c7-b0f1-1383ba8a5ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:21.640918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abffa1aa-3f94-4d23-86d5-89a36b8f7ef7 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:21.642432 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffa1aa-3f94-4d23-86d5-89a36b8f7ef7 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:21.642714 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffa1aa-3f94-4d23-86d5-89a36b8f7ef7 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:21.642992 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffa1aa-3f94-4d23-86d5-89a36b8f7ef7 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:21.645175 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abffa1aa-3f94-4d23-86d5-89a36b8f7ef7 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:21.651905 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abffa1aa-3f94-4d23-86d5-89a36b8f7ef7 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:21.671786 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4759bb9-0309-40c7-b0f1-1383ba8a5ee5 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:21.682248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba9c56-5a93-4ce6-bbe9-04a05344a835 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:21.683168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba9c56-5a93-4ce6-bbe9-04a05344a835 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:21.683596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba9c56-5a93-4ce6-bbe9-04a05344a835 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:21.684740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba9c56-5a93-4ce6-bbe9-04a05344a835 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:21.708406 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2571/5168] 10.222.0.30 () {60 vars in 1152 bytes} [Sun Sep 4 01:21:21 2022] POST /identity/v3/projects => generated 328 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:21.710254 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba9c56-5a93-4ce6-bbe9-04a05344a835 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:21.713116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abffa1aa-3f94-4d23-86d5-89a36b8f7ef7 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:21.717075 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba9c56-5a93-4ce6-bbe9-04a05344a835 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:21.744603 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2598/5169] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:21:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:21:21.856833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abffa1aa-3f94-4d23-86d5-89a36b8f7ef7 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:21.872475 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742d6c5-f1f4-4cf0-a113-8b610135f909 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:21.873337 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742d6c5-f1f4-4cf0-a113-8b610135f909 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:21.873746 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742d6c5-f1f4-4cf0-a113-8b610135f909 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:21.875324 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742d6c5-f1f4-4cf0-a113-8b610135f909 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:21.876957 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742d6c5-f1f4-4cf0-a113-8b610135f909 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:21.884168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742d6c5-f1f4-4cf0-a113-8b610135f909 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:21.954243 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2572/5170] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:21:21 2022] POST /identity/v3/users => generated 416 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:21.958961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba9c56-5a93-4ce6-bbe9-04a05344a835 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:21.978926 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba9c56-5a93-4ce6-bbe9-04a05344a835 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:21.989805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535af295-508d-4b76-867c-7ed33718bfe5 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:21.991855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535af295-508d-4b76-867c-7ed33718bfe5 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:21.992303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535af295-508d-4b76-867c-7ed33718bfe5 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:21.992636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535af295-508d-4b76-867c-7ed33718bfe5 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:21.995038 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535af295-508d-4b76-867c-7ed33718bfe5 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:21.997667 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535af295-508d-4b76-867c-7ed33718bfe5 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:22.043074 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2599/5171] 10.222.0.30 () {60 vars in 1143 bytes} [Sun Sep 4 01:21:21 2022] POST /identity/v3/roles => generated 244 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:22.046522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742d6c5-f1f4-4cf0-a113-8b610135f909 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:22.062731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742d6c5-f1f4-4cf0-a113-8b610135f909 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:22.078691 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a463dde-5113-4b7a-ade5-8e8026f2705f tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:22.078691 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a463dde-5113-4b7a-ade5-8e8026f2705f tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:22.078992 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a463dde-5113-4b7a-ade5-8e8026f2705f tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:22.079335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a463dde-5113-4b7a-ade5-8e8026f2705f tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:22.080055 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a463dde-5113-4b7a-ade5-8e8026f2705f tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:22.081772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a463dde-5113-4b7a-ade5-8e8026f2705f tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:22.119912 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2573/5172] 10.222.0.30 () {60 vars in 1143 bytes} [Sun Sep 4 01:21:22 2022] POST /identity/v3/roles => generated 247 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:22.121646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535af295-508d-4b76-867c-7ed33718bfe5 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:22.135943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535af295-508d-4b76-867c-7ed33718bfe5 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:22.141574 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed892817-16d4-43d8-9c3a-2483dee0e0a8 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:22.142668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed892817-16d4-43d8-9c3a-2483dee0e0a8 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:22.143070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed892817-16d4-43d8-9c3a-2483dee0e0a8 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:22.143438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed892817-16d4-43d8-9c3a-2483dee0e0a8 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/projects/b7baf73636624f119f1abf1d458b26cf/users/10abf6ec1ac84ebcb0fac8424863ab1b/roles/85f3150af9904913a1fe56a9f0bb3315` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:22.172828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed892817-16d4-43d8-9c3a-2483dee0e0a8 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b7baf73636624f119f1abf1d458b26cf, user_id=10abf6ec1ac84ebcb0fac8424863ab1b, role_id=85f3150af9904913a1fe56a9f0bb3315)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:22.178780 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed892817-16d4-43d8-9c3a-2483dee0e0a8 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:22.213229 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2600/5173] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:21:22 2022] PUT /identity/v3/projects/b7baf73636624f119f1abf1d458b26cf/users/10abf6ec1ac84ebcb0fac8424863ab1b/roles/85f3150af9904913a1fe56a9f0bb3315 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:22.215008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a463dde-5113-4b7a-ade5-8e8026f2705f tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:22.235000 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a463dde-5113-4b7a-ade5-8e8026f2705f tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:22.355075 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c9204-95ab-4b90-b442-37162b5881cc tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:22.356122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c9204-95ab-4b90-b442-37162b5881cc tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:22.358898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c9204-95ab-4b90-b442-37162b5881cc tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:22.360215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c9204-95ab-4b90-b442-37162b5881cc tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/projects/b7baf73636624f119f1abf1d458b26cf/users/10abf6ec1ac84ebcb0fac8424863ab1b/roles/b0ec43fc5feb428ea6d1284ecda5f0ac` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:22.367626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c9204-95ab-4b90-b442-37162b5881cc tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b7baf73636624f119f1abf1d458b26cf, user_id=10abf6ec1ac84ebcb0fac8424863ab1b, role_id=b0ec43fc5feb428ea6d1284ecda5f0ac)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:22.378718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c9204-95ab-4b90-b442-37162b5881cc tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:22.387165 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:22.417047 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2574/5174] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:21:22 2022] PUT /identity/v3/projects/b7baf73636624f119f1abf1d458b26cf/users/10abf6ec1ac84ebcb0fac8424863ab1b/roles/b0ec43fc5feb428ea6d1284ecda5f0ac => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:22.420135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed892817-16d4-43d8-9c3a-2483dee0e0a8 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:22.465348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c9204-95ab-4b90-b442-37162b5881cc tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:22.470486 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-219c9204-95ab-4b90-b442-37162b5881cc tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:22.476004 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed892817-16d4-43d8-9c3a-2483dee0e0a8 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:22.650833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bdc8e5-7f82-422f-a201-56e958f434bd tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:22.653098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdc8e5-7f82-422f-a201-56e958f434bd tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:22.653662 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdc8e5-7f82-422f-a201-56e958f434bd tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:22.654214 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdc8e5-7f82-422f-a201-56e958f434bd tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:22.655260 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bdc8e5-7f82-422f-a201-56e958f434bd tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:22.657467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bdc8e5-7f82-422f-a201-56e958f434bd tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:22.658687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c9204-95ab-4b90-b442-37162b5881cc tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:22.666254 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3e13d-74fa-4477-8905-33309714c639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:22.666779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3e13d-74fa-4477-8905-33309714c639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:22.667592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3e13d-74fa-4477-8905-33309714c639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:22.667592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3e13d-74fa-4477-8905-33309714c639 admin admin] PATH_INFO: `/v3/projects/4f0884eb349f4c72b55a0f1aa14b151b` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:22.670928 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3e13d-74fa-4477-8905-33309714c639 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f0884eb349f4c72b55a0f1aa14b151b)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:22.673672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3e13d-74fa-4477-8905-33309714c639 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:22.719115 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2601/5175] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:22 2022] GET /identity/v3/users => generated 8050 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:22.721822 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301086a2-7727-473c-be41-73e7bce980e9 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:22.722008 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301086a2-7727-473c-be41-73e7bce980e9 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:22.722867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301086a2-7727-473c-be41-73e7bce980e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:22.744074 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-79e3e13d-74fa-4477-8905-33309714c639 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f0884eb349f4c72b55a0f1aa14b151b', 'request_id': 'req-79e3e13d-74fa-4477-8905-33309714c639'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:22.763951 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-79e3e13d-74fa-4477-8905-33309714c639 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f0884eb349f4c72b55a0f1aa14b151b', 'request_id': 'req-79e3e13d-74fa-4477-8905-33309714c639'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:22.778896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-79e3e13d-74fa-4477-8905-33309714c639 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f0884eb349f4c72b55a0f1aa14b151b', 'request_id': 'req-79e3e13d-74fa-4477-8905-33309714c639'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:22.796254 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-79e3e13d-74fa-4477-8905-33309714c639 admin admin] The token cache is being invalidate because project 4f0884eb349f4c72b55a0f1aa14b151b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:22.796729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-79e3e13d-74fa-4477-8905-33309714c639 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:22.797832 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-79e3e13d-74fa-4477-8905-33309714c639 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:22.799944 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2575/5176] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:21:22 2022] DELETE /identity/v3/projects/4f0884eb349f4c72b55a0f1aa14b151b => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:22.805238 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05c6f0-3d73-4da8-9d0b-945cc7196a5b None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:22.805970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05c6f0-3d73-4da8-9d0b-945cc7196a5b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:22.806302 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05c6f0-3d73-4da8-9d0b-945cc7196a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:22.839073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-0f05c6f0-3d73-4da8-9d0b-945cc7196a5b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:22.841474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-301086a2-7727-473c-be41-73e7bce980e9 None None] MFA Rules not processed for user `10abf6ec1ac84ebcb0fac8424863ab1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:22.846736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-301086a2-7727-473c-be41-73e7bce980e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:22.851593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0f05c6f0-3d73-4da8-9d0b-945cc7196a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:22.911343 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:22.965732 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2576/5177] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:21:22.973119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c537bd-5e7c-4d41-9929-dc762e57158a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:22.973119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c537bd-5e7c-4d41-9929-dc762e57158a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:22.973942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c537bd-5e7c-4d41-9929-dc762e57158a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:22.996957 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2602/5178] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:22 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:23.007923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967f0c6-81d3-4261-887c-a71817636c50 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:23.008913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967f0c6-81d3-4261-887c-a71817636c50 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:23.009285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967f0c6-81d3-4261-887c-a71817636c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:23.017960 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e9c537bd-5e7c-4d41-9929-dc762e57158a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:23.020198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e9c537bd-5e7c-4d41-9929-dc762e57158a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:23.042387 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2577/5179] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:21:23.048976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c537bd-5e7c-4d41-9929-dc762e57158a None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:23.054552 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e967f0c6-81d3-4261-887c-a71817636c50 None None] MFA Rules not processed for user `10abf6ec1ac84ebcb0fac8424863ab1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:23.056027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e967f0c6-81d3-4261-887c-a71817636c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:23.066929 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c537bd-5e7c-4d41-9929-dc762e57158a None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:23.074880 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d792b66-9cb3-481a-ada9-9a90d9062bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:23.075510 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d792b66-9cb3-481a-ada9-9a90d9062bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:23.075811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d792b66-9cb3-481a-ada9-9a90d9062bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:23.075931 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2603/5180] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:23 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:21:23.076073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d792b66-9cb3-481a-ada9-9a90d9062bc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:23.076736 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d792b66-9cb3-481a-ada9-9a90d9062bc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:21:23.077062 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d792b66-9cb3-481a-ada9-9a90d9062bc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:23.078177 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967f0c6-81d3-4261-887c-a71817636c50 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:23.080689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d792b66-9cb3-481a-ada9-9a90d9062bc9 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:23.093420 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967f0c6-81d3-4261-887c-a71817636c50 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:23.098474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cbf06-9789-43d1-863f-14250560fb80 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10abf6ec1ac84ebcb0fac8424863ab1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7baf73636624f119f1abf1d458b26cf', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1904447396', 'tempest-DelegatedRole-1462165626'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:23.099099 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cbf06-9789-43d1-863f-14250560fb80 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:23.099382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cbf06-9789-43d1-863f-14250560fb80 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:23.099656 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cbf06-9789-43d1-863f-14250560fb80 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:23.100342 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6cbf06-9789-43d1-863f-14250560fb80 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] RBAC: Authorizing `identity:create_trust()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:23.101537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6cbf06-9789-43d1-863f-14250560fb80 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:23.128695 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2578/5181] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:21:23.134928 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d792b66-9cb3-481a-ada9-9a90d9062bc9 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:23.143997 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:23.149474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d792b66-9cb3-481a-ada9-9a90d9062bc9 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:23.167885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f389be-abf1-43ca-9a63-7d5fa6d5b642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:23.168518 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f389be-abf1-43ca-9a63-7d5fa6d5b642 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:23.168804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f389be-abf1-43ca-9a63-7d5fa6d5b642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:23.169072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f389be-abf1-43ca-9a63-7d5fa6d5b642 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:23.169746 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f389be-abf1-43ca-9a63-7d5fa6d5b642 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:23.171668 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f389be-abf1-43ca-9a63-7d5fa6d5b642 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:23.209858 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2604/5182] 10.222.0.30 () {60 vars in 1174 bytes} [Sun Sep 4 01:21:23 2022] POST /identity/v3/OS-TRUST/trusts => generated 835 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:23.213525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cbf06-9789-43d1-863f-14250560fb80 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:23.223168 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2579/5183] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:21:23 2022] POST /identity/v3/projects => generated 405 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:21:23.227938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f389be-abf1-43ca-9a63-7d5fa6d5b642 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:23.235581 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cbf06-9789-43d1-863f-14250560fb80 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:23.341763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f389be-abf1-43ca-9a63-7d5fa6d5b642 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:23.353552 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0b760-d826-477c-baec-9eaaf13bd5a5 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10abf6ec1ac84ebcb0fac8424863ab1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7baf73636624f119f1abf1d458b26cf', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1904447396', 'tempest-DelegatedRole-1462165626'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:23.354650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0b760-d826-477c-baec-9eaaf13bd5a5 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:23.355692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0b760-d826-477c-baec-9eaaf13bd5a5 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:23.356217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0b760-d826-477c-baec-9eaaf13bd5a5 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] PATH_INFO: `/v3/OS-TRUST/trusts/981f4fa094e64befb02a9258db609e43` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:23.360350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf8fcd-82ec-4f74-8aea-5e503e854def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:23.361171 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf8fcd-82ec-4f74-8aea-5e503e854def admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:23.361495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf8fcd-82ec-4f74-8aea-5e503e854def admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:23.361758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf8fcd-82ec-4f74-8aea-5e503e854def admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:23.362420 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf8fcd-82ec-4f74-8aea-5e503e854def admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:23.367932 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f0b760-d826-477c-baec-9eaaf13bd5a5 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] RBAC: Authorizing `identity:get_trust(trust_id=981f4fa094e64befb02a9258db609e43)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:23.369692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf8fcd-82ec-4f74-8aea-5e503e854def admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:23.370054 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f0b760-d826-477c-baec-9eaaf13bd5a5 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:23.383053 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2605/5184] 10.222.0.30 () {58 vars in 1251 bytes} [Sun Sep 4 01:21:23 2022] GET /identity/v3/OS-TRUST/trusts/981f4fa094e64befb02a9258db609e43 => generated 835 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:21:23.386971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0b760-d826-477c-baec-9eaaf13bd5a5 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:23.408172 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0b760-d826-477c-baec-9eaaf13bd5a5 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:23.416561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a520dbc-b6fd-45ab-9f69-630001422618 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10abf6ec1ac84ebcb0fac8424863ab1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7baf73636624f119f1abf1d458b26cf', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1904447396', 'tempest-DelegatedRole-1462165626'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:23.417357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a520dbc-b6fd-45ab-9f69-630001422618 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:23.417680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a520dbc-b6fd-45ab-9f69-630001422618 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:23.418099 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a520dbc-b6fd-45ab-9f69-630001422618 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] PATH_INFO: `/v3/OS-TRUST/trusts/981f4fa094e64befb02a9258db609e43/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:23.420371 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2580/5185] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:21:23 2022] POST /identity/v3/users => generated 303 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:23.425175 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf8fcd-82ec-4f74-8aea-5e503e854def admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:23.437136 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a520dbc-b6fd-45ab-9f69-630001422618 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=981f4fa094e64befb02a9258db609e43)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:23.454750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a520dbc-b6fd-45ab-9f69-630001422618 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:23.477629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf8fcd-82ec-4f74-8aea-5e503e854def admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:23.481155 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815aebec-26ec-433a-b803-f08fd52d8f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:23.481961 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815aebec-26ec-433a-b803-f08fd52d8f06 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:23.482091 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815aebec-26ec-433a-b803-f08fd52d8f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:23.482341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815aebec-26ec-433a-b803-f08fd52d8f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:23.482991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815aebec-26ec-433a-b803-f08fd52d8f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:23.484610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815aebec-26ec-433a-b803-f08fd52d8f06 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:23.485854 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2606/5186] 10.222.0.30 () {58 vars in 1269 bytes} [Sun Sep 4 01:21:23 2022] GET /identity/v3/OS-TRUST/trusts/981f4fa094e64befb02a9258db609e43/roles => generated 371 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:21:23.490760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a520dbc-b6fd-45ab-9f69-630001422618 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:23.501911 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2581/5187] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:23 2022] GET /identity/v3/roles => generated 1893 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:23.505670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815aebec-26ec-433a-b803-f08fd52d8f06 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:23.527698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a520dbc-b6fd-45ab-9f69-630001422618 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:23.531879 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815aebec-26ec-433a-b803-f08fd52d8f06 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:23.535635 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b40ffe-e412-4447-a087-12baec17c8fe tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10abf6ec1ac84ebcb0fac8424863ab1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7baf73636624f119f1abf1d458b26cf', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1904447396', 'tempest-DelegatedRole-1462165626'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:23.536518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b40ffe-e412-4447-a087-12baec17c8fe tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:23.536801 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b40ffe-e412-4447-a087-12baec17c8fe tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:23.540182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b40ffe-e412-4447-a087-12baec17c8fe tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] PATH_INFO: `/v3/OS-TRUST/trusts/981f4fa094e64befb02a9258db609e43/roles/85f3150af9904913a1fe56a9f0bb3315` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:23.548956 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b40ffe-e412-4447-a087-12baec17c8fe tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] RBAC: Authorizing `identity:get_role_for_trust(trust_id=981f4fa094e64befb02a9258db609e43, role_id=85f3150af9904913a1fe56a9f0bb3315)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:23.550510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b40ffe-e412-4447-a087-12baec17c8fe tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:23.557272 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850ad36-621c-4e44-ae2b-09966ff7cf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:23.558200 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850ad36-621c-4e44-ae2b-09966ff7cf2f admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:23.559204 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850ad36-621c-4e44-ae2b-09966ff7cf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:23.559807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850ad36-621c-4e44-ae2b-09966ff7cf2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:23.561514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850ad36-621c-4e44-ae2b-09966ff7cf2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:23.563507 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850ad36-621c-4e44-ae2b-09966ff7cf2f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:23.564035 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2607/5188] 10.222.0.30 () {58 vars in 1368 bytes} [Sun Sep 4 01:21:23 2022] GET /identity/v3/OS-TRUST/trusts/981f4fa094e64befb02a9258db609e43/roles/85f3150af9904913a1fe56a9f0bb3315 => generated 244 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:21:23.568969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b40ffe-e412-4447-a087-12baec17c8fe tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:23.578922 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2582/5189] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:23 2022] GET /identity/v3/roles => generated 1893 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:23.583234 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850ad36-621c-4e44-ae2b-09966ff7cf2f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:23.597693 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850ad36-621c-4e44-ae2b-09966ff7cf2f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:23.612221 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b40ffe-e412-4447-a087-12baec17c8fe tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:23.617998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d480a9-8c20-4cb5-939b-0f817d33b789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:23.619993 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d480a9-8c20-4cb5-939b-0f817d33b789 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:23.622043 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d480a9-8c20-4cb5-939b-0f817d33b789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:23.622486 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d480a9-8c20-4cb5-939b-0f817d33b789 admin admin] PATH_INFO: `/v3/projects/1c61ffcf7dd4482bba378c6cc7e1d99e/users/3214acf95145444ba3475ced751a8d69/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:23.625928 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f272d9a-e8b9-45e3-83d2-5047f4ac7a62 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10abf6ec1ac84ebcb0fac8424863ab1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7baf73636624f119f1abf1d458b26cf', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1904447396', 'tempest-DelegatedRole-1462165626'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:23.626601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f272d9a-e8b9-45e3-83d2-5047f4ac7a62 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] REQUEST_METHOD: `HEAD` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:23.626876 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f272d9a-e8b9-45e3-83d2-5047f4ac7a62 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:23.627145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f272d9a-e8b9-45e3-83d2-5047f4ac7a62 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] PATH_INFO: `/v3/OS-TRUST/trusts/981f4fa094e64befb02a9258db609e43/roles/85f3150af9904913a1fe56a9f0bb3315` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:23.634424 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:23.640447 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f272d9a-e8b9-45e3-83d2-5047f4ac7a62 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] RBAC: Authorizing `identity:get_role_for_trust(trust_id=981f4fa094e64befb02a9258db609e43, role_id=85f3150af9904913a1fe56a9f0bb3315)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:23.642197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f272d9a-e8b9-45e3-83d2-5047f4ac7a62 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:23.657234 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2608/5190] 10.222.0.30 () {58 vars in 1369 bytes} [Sun Sep 4 01:21:23 2022] HEAD /identity/v3/OS-TRUST/trusts/981f4fa094e64befb02a9258db609e43/roles/85f3150af9904913a1fe56a9f0bb3315 => generated 0 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Sep 04 01:21:23.661975 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f272d9a-e8b9-45e3-83d2-5047f4ac7a62 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:23.678024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d480a9-8c20-4cb5-939b-0f817d33b789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c61ffcf7dd4482bba378c6cc7e1d99e, user_id=3214acf95145444ba3475ced751a8d69, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:23.680740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d480a9-8c20-4cb5-939b-0f817d33b789 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:23.680869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f272d9a-e8b9-45e3-83d2-5047f4ac7a62 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:23.727351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354a44c-70b1-4dd0-95a7-773aba253fec tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10abf6ec1ac84ebcb0fac8424863ab1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7baf73636624f119f1abf1d458b26cf', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1904447396', 'tempest-DelegatedRole-1462165626'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:23.728026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354a44c-70b1-4dd0-95a7-773aba253fec tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:23.736773 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2583/5191] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:21:23 2022] PUT /identity/v3/projects/1c61ffcf7dd4482bba378c6cc7e1d99e/users/3214acf95145444ba3475ced751a8d69/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:23.776603 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354a44c-70b1-4dd0-95a7-773aba253fec tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:23.777327 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354a44c-70b1-4dd0-95a7-773aba253fec tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] PATH_INFO: `/v3/OS-TRUST/trusts/981f4fa094e64befb02a9258db609e43/roles/b0ec43fc5feb428ea6d1284ecda5f0ac` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:23.800547 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354a44c-70b1-4dd0-95a7-773aba253fec tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] RBAC: Authorizing `identity:get_role_for_trust(trust_id=981f4fa094e64befb02a9258db609e43, role_id=b0ec43fc5feb428ea6d1284ecda5f0ac)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:23.802363 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354a44c-70b1-4dd0-95a7-773aba253fec tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:23.830750 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-4354a44c-70b1-4dd0-95a7-773aba253fec tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] Could not find role: b0ec43fc5feb428ea6d1284ecda5f0ac.: keystone.exception.RoleNotFound: Could not find role: b0ec43fc5feb428ea6d1284ecda5f0ac. Sep 04 01:21:23.830750 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:21:23.830750 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:21:23.830750 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:21:23.830750 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:21:23.830750 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:21:23.830750 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:21:23.830750 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:21:23.830750 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:21:23.830750 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:21:23.830750 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:21:23.830750 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:21:23.830750 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Sep 04 01:21:23.830750 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 01:21:23.830750 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: b0ec43fc5feb428ea6d1284ecda5f0ac. Sep 04 01:21:23.831877 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:21:23.832345 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2609/5192] 10.222.0.30 () {58 vars in 1368 bytes} [Sun Sep 4 01:21:23 2022] GET /identity/v3/OS-TRUST/trusts/981f4fa094e64befb02a9258db609e43/roles/b0ec43fc5feb428ea6d1284ecda5f0ac => generated 110 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:21:23.836375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d480a9-8c20-4cb5-939b-0f817d33b789 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:23.884139 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccee19-0462-49e0-ad29-cc0082e20a8b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:23.884485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccee19-0462-49e0-ad29-cc0082e20a8b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:23.884950 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccee19-0462-49e0-ad29-cc0082e20a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:23.937026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e0ccee19-0462-49e0-ad29-cc0082e20a8b None None] MFA Rules not processed for user `3214acf95145444ba3475ced751a8d69`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:23.938309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e0ccee19-0462-49e0-ad29-cc0082e20a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:24.009244 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d480a9-8c20-4cb5-939b-0f817d33b789 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:24.015645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894cff9a-d6ff-4bc4-af23-07a8f386341a tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10abf6ec1ac84ebcb0fac8424863ab1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7baf73636624f119f1abf1d458b26cf', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1904447396', 'tempest-DelegatedRole-1462165626'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:24.016309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cff9a-d6ff-4bc4-af23-07a8f386341a tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] REQUEST_METHOD: `HEAD` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:24.016591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cff9a-d6ff-4bc4-af23-07a8f386341a tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:24.016865 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cff9a-d6ff-4bc4-af23-07a8f386341a tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] PATH_INFO: `/v3/OS-TRUST/trusts/981f4fa094e64befb02a9258db609e43/roles/b0ec43fc5feb428ea6d1284ecda5f0ac` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:24.058162 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894cff9a-d6ff-4bc4-af23-07a8f386341a tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] RBAC: Authorizing `identity:get_role_for_trust(trust_id=981f4fa094e64befb02a9258db609e43, role_id=b0ec43fc5feb428ea6d1284ecda5f0ac)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:24.059647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894cff9a-d6ff-4bc4-af23-07a8f386341a tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:24.075605 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-894cff9a-d6ff-4bc4-af23-07a8f386341a tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] Could not find role: b0ec43fc5feb428ea6d1284ecda5f0ac.: keystone.exception.RoleNotFound: Could not find role: b0ec43fc5feb428ea6d1284ecda5f0ac. Sep 04 01:21:24.075605 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:21:24.075605 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:21:24.075605 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:21:24.075605 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:21:24.075605 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:21:24.075605 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:21:24.075605 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:21:24.075605 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:21:24.075605 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:21:24.075605 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:21:24.075605 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:21:24.075605 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Sep 04 01:21:24.075605 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 04 01:21:24.075605 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: b0ec43fc5feb428ea6d1284ecda5f0ac. Sep 04 01:21:24.076724 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:21:24.082764 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2584/5193] 10.222.0.30 () {58 vars in 1369 bytes} [Sun Sep 4 01:21:23 2022] HEAD /identity/v3/OS-TRUST/trusts/981f4fa094e64befb02a9258db609e43/roles/b0ec43fc5feb428ea6d1284ecda5f0ac => generated 0 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Sep 04 01:21:24.083680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894cff9a-d6ff-4bc4-af23-07a8f386341a tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:24.095104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894cff9a-d6ff-4bc4-af23-07a8f386341a tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:24.100260 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b3d69-acdf-405f-ae06-ac07dfb55d33 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10abf6ec1ac84ebcb0fac8424863ab1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7baf73636624f119f1abf1d458b26cf', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1904447396', 'tempest-DelegatedRole-1462165626'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:24.100921 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b3d69-acdf-405f-ae06-ac07dfb55d33 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:24.101348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b3d69-acdf-405f-ae06-ac07dfb55d33 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:24.101573 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b3d69-acdf-405f-ae06-ac07dfb55d33 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] PATH_INFO: `/v3/OS-TRUST/trusts/981f4fa094e64befb02a9258db609e43` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:24.109971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b3d69-acdf-405f-ae06-ac07dfb55d33 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] RBAC: Authorizing `identity:delete_trust(trust_id=981f4fa094e64befb02a9258db609e43)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:24.111483 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b3d69-acdf-405f-ae06-ac07dfb55d33 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:24.120169 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:24.137986 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c48b3d69-acdf-405f-ae06-ac07dfb55d33 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '981f4fa094e64befb02a9258db609e43', 'request_id': 'req-c48b3d69-acdf-405f-ae06-ac07dfb55d33'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:24.151296 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2610/5194] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:23 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:24.158568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c48b3d69-acdf-405f-ae06-ac07dfb55d33 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '981f4fa094e64befb02a9258db609e43', 'request_id': 'req-c48b3d69-acdf-405f-ae06-ac07dfb55d33'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:24.159450 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c48b3d69-acdf-405f-ae06-ac07dfb55d33 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '981f4fa094e64befb02a9258db609e43', 'request_id': 'req-c48b3d69-acdf-405f-ae06-ac07dfb55d33'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:24.161961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ccee19-0462-49e0-ad29-cc0082e20a8b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:24.172712 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2585/5195] 10.222.0.30 () {58 vars in 1254 bytes} [Sun Sep 4 01:21:24 2022] DELETE /identity/v3/OS-TRUST/trusts/981f4fa094e64befb02a9258db609e43 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:24.178611 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b3d69-acdf-405f-ae06-ac07dfb55d33 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:24.186491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c48b3d69-acdf-405f-ae06-ac07dfb55d33 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:24.222022 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b3d69-acdf-405f-ae06-ac07dfb55d33 tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:24.235874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7aec4-3017-42a3-bdef-962961d98c6a tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10abf6ec1ac84ebcb0fac8424863ab1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7baf73636624f119f1abf1d458b26cf', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1904447396', 'tempest-DelegatedRole-1462165626'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:24.236532 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7aec4-3017-42a3-bdef-962961d98c6a tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:24.236873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7aec4-3017-42a3-bdef-962961d98c6a tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:24.237151 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7aec4-3017-42a3-bdef-962961d98c6a tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] PATH_INFO: `/v3/OS-TRUST/trusts/981f4fa094e64befb02a9258db609e43` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:24.259010 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-c0c7aec4-3017-42a3-bdef-962961d98c6a tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] Could not find trust: 981f4fa094e64befb02a9258db609e43.: keystone.exception.TrustNotFound: Could not find trust: 981f4fa094e64befb02a9258db609e43. Sep 04 01:21:24.259010 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:21:24.259010 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:21:24.259010 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:21:24.259010 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:21:24.259010 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:21:24.259010 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:21:24.259010 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:21:24.259010 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:21:24.259010 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:21:24.259010 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:21:24.259010 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:21:24.259010 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Sep 04 01:21:24.259010 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Sep 04 01:21:24.259010 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Sep 04 01:21:24.260108 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Sep 04 01:21:24.260108 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Sep 04 01:21:24.260108 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Sep 04 01:21:24.260108 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Sep 04 01:21:24.260108 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Sep 04 01:21:24.260108 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:21:24.260108 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:21:24.260108 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Sep 04 01:21:24.260108 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Sep 04 01:21:24.260108 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Sep 04 01:21:24.260108 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Sep 04 01:21:24.260108 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 981f4fa094e64befb02a9258db609e43. Sep 04 01:21:24.260108 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:21:24.269636 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2586/5196] 10.222.0.30 () {58 vars in 1251 bytes} [Sun Sep 4 01:21:24 2022] GET /identity/v3/OS-TRUST/trusts/981f4fa094e64befb02a9258db609e43 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:21:24.270710 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7aec4-3017-42a3-bdef-962961d98c6a tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:24.275417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c0c7aec4-3017-42a3-bdef-962961d98c6a tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:24.318652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ccee19-0462-49e0-ad29-cc0082e20a8b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:24.324390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcee04-cacf-4840-aa10-4f9543d7f265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:24.325008 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcee04-cacf-4840-aa10-4f9543d7f265 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:24.325291 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcee04-cacf-4840-aa10-4f9543d7f265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:24.325602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcee04-cacf-4840-aa10-4f9543d7f265 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:24.330407 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcee04-cacf-4840-aa10-4f9543d7f265 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:24.332524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcee04-cacf-4840-aa10-4f9543d7f265 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:24.369577 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2611/5197] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:21:24 2022] POST /identity/v3/projects => generated 405 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:24.373270 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcee04-cacf-4840-aa10-4f9543d7f265 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:24.375928 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b4fcee04-cacf-4840-aa10-4f9543d7f265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:24.380090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7aec4-3017-42a3-bdef-962961d98c6a tempest-TrustsV3TestJSON-261319708 tempest-user-1524945539] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:24.432348 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:24.449999 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15621fbb-c78a-4b38-b342-266fcabe25a0 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:24.450687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15621fbb-c78a-4b38-b342-266fcabe25a0 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:24.451047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15621fbb-c78a-4b38-b342-266fcabe25a0 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:24.451325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15621fbb-c78a-4b38-b342-266fcabe25a0 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/roles/b0ec43fc5feb428ea6d1284ecda5f0ac` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:24.453265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15621fbb-c78a-4b38-b342-266fcabe25a0 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b0ec43fc5feb428ea6d1284ecda5f0ac)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:24.454932 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15621fbb-c78a-4b38-b342-266fcabe25a0 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:24.457937 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcee04-cacf-4840-aa10-4f9543d7f265 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:24.464804 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2ba48-f948-4ce7-a1fa-6312e7a5877e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:24.465427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2ba48-f948-4ce7-a1fa-6312e7a5877e admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:24.465794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2ba48-f948-4ce7-a1fa-6312e7a5877e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:24.466000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2ba48-f948-4ce7-a1fa-6312e7a5877e admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:24.467296 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2ba48-f948-4ce7-a1fa-6312e7a5877e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:24.469108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2ba48-f948-4ce7-a1fa-6312e7a5877e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:24.500967 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2612/5198] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:21:24 2022] POST /identity/v3/users => generated 309 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:21:24.504801 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2ba48-f948-4ce7-a1fa-6312e7a5877e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:24.507122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-15621fbb-c78a-4b38-b342-266fcabe25a0 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invalidating the token cache because role b0ec43fc5feb428ea6d1284ecda5f0ac has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:24.507420 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-15621fbb-c78a-4b38-b342-266fcabe25a0 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:24.508728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-15621fbb-c78a-4b38-b342-266fcabe25a0 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:24.510999 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2587/5199] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:21:24 2022] DELETE /identity/v3/roles/b0ec43fc5feb428ea6d1284ecda5f0ac => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:24.514992 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15621fbb-c78a-4b38-b342-266fcabe25a0 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:24.516309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-15621fbb-c78a-4b38-b342-266fcabe25a0 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:24.519248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2ba48-f948-4ce7-a1fa-6312e7a5877e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:24.568910 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:24.594758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2efee-4f17-46c5-8008-700fba7df410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:24.595441 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2efee-4f17-46c5-8008-700fba7df410 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:24.595729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2efee-4f17-46c5-8008-700fba7df410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:24.596080 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2efee-4f17-46c5-8008-700fba7df410 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:24.596798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2efee-4f17-46c5-8008-700fba7df410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:24.598079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15621fbb-c78a-4b38-b342-266fcabe25a0 tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:24.598634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2efee-4f17-46c5-8008-700fba7df410 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:24.603965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376cc84-8690-404b-a53c-979d3365131b tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:24.604834 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376cc84-8690-404b-a53c-979d3365131b tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:24.605291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376cc84-8690-404b-a53c-979d3365131b tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:24.605845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376cc84-8690-404b-a53c-979d3365131b tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/roles/85f3150af9904913a1fe56a9f0bb3315` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:24.607432 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0376cc84-8690-404b-a53c-979d3365131b tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:delete_role(role_id=85f3150af9904913a1fe56a9f0bb3315)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:24.609835 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2613/5200] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:24 2022] GET /identity/v3/roles => generated 1655 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:24.610101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0376cc84-8690-404b-a53c-979d3365131b tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:24.614487 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2efee-4f17-46c5-8008-700fba7df410 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:24.616276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d7e2efee-4f17-46c5-8008-700fba7df410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:24.630533 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2efee-4f17-46c5-8008-700fba7df410 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:24.636181 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f3ce6-bc95-40f8-9394-9a10d0544359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:24.636843 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f3ce6-bc95-40f8-9394-9a10d0544359 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:24.637126 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f3ce6-bc95-40f8-9394-9a10d0544359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:24.637405 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f3ce6-bc95-40f8-9394-9a10d0544359 admin admin] PATH_INFO: `/v3/projects/8ea32418ab294be09fe1f88e05114cd1/users/f45f1c7b403a4ddb89f84a8319d8c249/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:24.665557 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f3ce6-bc95-40f8-9394-9a10d0544359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ea32418ab294be09fe1f88e05114cd1, user_id=f45f1c7b403a4ddb89f84a8319d8c249, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:24.669613 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f3ce6-bc95-40f8-9394-9a10d0544359 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:24.673886 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0376cc84-8690-404b-a53c-979d3365131b tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invalidating the token cache because role 85f3150af9904913a1fe56a9f0bb3315 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:24.674192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0376cc84-8690-404b-a53c-979d3365131b tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:24.674938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0376cc84-8690-404b-a53c-979d3365131b tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:24.677043 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2588/5201] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:21:24 2022] DELETE /identity/v3/roles/85f3150af9904913a1fe56a9f0bb3315 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:24.681255 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376cc84-8690-404b-a53c-979d3365131b tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:24.682922 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0376cc84-8690-404b-a53c-979d3365131b tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:24.689458 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2614/5202] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:21:24 2022] PUT /identity/v3/projects/8ea32418ab294be09fe1f88e05114cd1/users/f45f1c7b403a4ddb89f84a8319d8c249/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:24.693325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f3ce6-bc95-40f8-9394-9a10d0544359 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:24.696848 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-982f3ce6-bc95-40f8-9394-9a10d0544359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:24.775263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f3ce6-bc95-40f8-9394-9a10d0544359 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:24.780389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20971c7-aa7e-4483-bafd-b377deaa8199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:24.781275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20971c7-aa7e-4483-bafd-b377deaa8199 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:24.782724 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20971c7-aa7e-4483-bafd-b377deaa8199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:24.782724 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20971c7-aa7e-4483-bafd-b377deaa8199 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:24.782724 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20971c7-aa7e-4483-bafd-b377deaa8199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:24.784240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20971c7-aa7e-4483-bafd-b377deaa8199 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:24.786941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376cc84-8690-404b-a53c-979d3365131b tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:24.796867 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2615/5203] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:24.811167 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20971c7-aa7e-4483-bafd-b377deaa8199 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:24.835192 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20971c7-aa7e-4483-bafd-b377deaa8199 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:24.849340 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476237b-1cbd-40ed-adc7-d1c32f51d793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:24.850051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476237b-1cbd-40ed-adc7-d1c32f51d793 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:24.850340 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476237b-1cbd-40ed-adc7-d1c32f51d793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:24.851720 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476237b-1cbd-40ed-adc7-d1c32f51d793 admin admin] PATH_INFO: `/v3/projects/8ea32418ab294be09fe1f88e05114cd1/users/f45f1c7b403a4ddb89f84a8319d8c249/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:24.854218 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476237b-1cbd-40ed-adc7-d1c32f51d793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ea32418ab294be09fe1f88e05114cd1, user_id=f45f1c7b403a4ddb89f84a8319d8c249, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:24.857013 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476237b-1cbd-40ed-adc7-d1c32f51d793 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:24.877575 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2616/5204] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:21:24 2022] PUT /identity/v3/projects/8ea32418ab294be09fe1f88e05114cd1/users/f45f1c7b403a4ddb89f84a8319d8c249/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:21:24.884501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad5064-1e15-4616-b923-24e751104769 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:24.885272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad5064-1e15-4616-b923-24e751104769 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:24.885272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad5064-1e15-4616-b923-24e751104769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:24.895547 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ecfb7-fd3e-4b08-82fa-c6ba7000d4df tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:24.897689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ecfb7-fd3e-4b08-82fa-c6ba7000d4df tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:24.898004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ecfb7-fd3e-4b08-82fa-c6ba7000d4df tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:24.898291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ecfb7-fd3e-4b08-82fa-c6ba7000d4df tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/users/10abf6ec1ac84ebcb0fac8424863ab1b` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:24.899698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ecfb7-fd3e-4b08-82fa-c6ba7000d4df tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:delete_user(user_id=10abf6ec1ac84ebcb0fac8424863ab1b)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:24.903098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ecfb7-fd3e-4b08-82fa-c6ba7000d4df tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:24.918519 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-0cad5064-1e15-4616-b923-24e751104769 None None] MFA Rules not processed for user `f45f1c7b403a4ddb89f84a8319d8c249`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:24.919780 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0cad5064-1e15-4616-b923-24e751104769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:24.945344 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:24.973516 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-705ecfb7-fd3e-4b08-82fa-c6ba7000d4df tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10abf6ec1ac84ebcb0fac8424863ab1b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:24.974996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-705ecfb7-fd3e-4b08-82fa-c6ba7000d4df tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10abf6ec1ac84ebcb0fac8424863ab1b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:24.997502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-705ecfb7-fd3e-4b08-82fa-c6ba7000d4df tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10abf6ec1ac84ebcb0fac8424863ab1b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:24.997502 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:25.005812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-705ecfb7-fd3e-4b08-82fa-c6ba7000d4df tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10abf6ec1ac84ebcb0fac8424863ab1b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:25.007701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-705ecfb7-fd3e-4b08-82fa-c6ba7000d4df tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10abf6ec1ac84ebcb0fac8424863ab1b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:25.015487 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2617/5205] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:24 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:21:25.028035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad5064-1e15-4616-b923-24e751104769 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:25.029512 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0cad5064-1e15-4616-b923-24e751104769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:25.035038 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2589/5206] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:21:24 2022] DELETE /identity/v3/users/10abf6ec1ac84ebcb0fac8424863ab1b => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:21:25.040127 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ecfb7-fd3e-4b08-82fa-c6ba7000d4df tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:25.041922 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-705ecfb7-fd3e-4b08-82fa-c6ba7000d4df tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:25.128245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ecfb7-fd3e-4b08-82fa-c6ba7000d4df tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:25.132887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad5064-1e15-4616-b923-24e751104769 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:25.134658 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214998e-2d86-4e58-b45b-2567ff83b4ad tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eff86e31de984534a6ca4e8d4e2444b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '543b489cbe5c4fba8fd5e5504b339d29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:25.136193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214998e-2d86-4e58-b45b-2567ff83b4ad tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:25.136729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214998e-2d86-4e58-b45b-2567ff83b4ad tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:25.137224 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214998e-2d86-4e58-b45b-2567ff83b4ad tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] PATH_INFO: `/v3/projects/b7baf73636624f119f1abf1d458b26cf` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:25.138693 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214998e-2d86-4e58-b45b-2567ff83b4ad tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b7baf73636624f119f1abf1d458b26cf)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:25.141291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214998e-2d86-4e58-b45b-2567ff83b4ad tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:25.213785 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e033b5-abe7-4f25-8aa6-1d9235e404d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:25.215238 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e033b5-abe7-4f25-8aa6-1d9235e404d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:25.215913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e033b5-abe7-4f25-8aa6-1d9235e404d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:25.216490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e033b5-abe7-4f25-8aa6-1d9235e404d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:25.226536 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0214998e-2d86-4e58-b45b-2567ff83b4ad tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7baf73636624f119f1abf1d458b26cf', 'request_id': 'req-0214998e-2d86-4e58-b45b-2567ff83b4ad'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:25.246062 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0214998e-2d86-4e58-b45b-2567ff83b4ad tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7baf73636624f119f1abf1d458b26cf', 'request_id': 'req-0214998e-2d86-4e58-b45b-2567ff83b4ad'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:25.255981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0214998e-2d86-4e58-b45b-2567ff83b4ad tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7baf73636624f119f1abf1d458b26cf', 'request_id': 'req-0214998e-2d86-4e58-b45b-2567ff83b4ad'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:25.272073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0214998e-2d86-4e58-b45b-2567ff83b4ad tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] The token cache is being invalidate because project b7baf73636624f119f1abf1d458b26cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:25.276262 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0214998e-2d86-4e58-b45b-2567ff83b4ad tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:25.282817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0214998e-2d86-4e58-b45b-2567ff83b4ad tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:25.291060 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2590/5207] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:21:25 2022] DELETE /identity/v3/projects/b7baf73636624f119f1abf1d458b26cf => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:25.291060 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214998e-2d86-4e58-b45b-2567ff83b4ad tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:25.294073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0214998e-2d86-4e58-b45b-2567ff83b4ad tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:25.364476 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e033b5-abe7-4f25-8aa6-1d9235e404d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:25.366529 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e033b5-abe7-4f25-8aa6-1d9235e404d5 service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:25.399677 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2618/5208] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:21:25 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:21:25.403807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214998e-2d86-4e58-b45b-2567ff83b4ad tempest-TrustsV3TestJSON-907179269 tempest-TrustsV3TestJSON-907179269-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:25.409317 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9948e5-15fc-450d-88e3-d29d0f82fa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:25.410221 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9948e5-15fc-450d-88e3-d29d0f82fa92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:25.410341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9948e5-15fc-450d-88e3-d29d0f82fa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:25.410558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9948e5-15fc-450d-88e3-d29d0f82fa92 admin admin] PATH_INFO: `/v3/users/235d03ded18f41728af86fb0d5e35216` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:25.412076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9948e5-15fc-450d-88e3-d29d0f82fa92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=235d03ded18f41728af86fb0d5e35216)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:25.415546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9948e5-15fc-450d-88e3-d29d0f82fa92 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:25.421734 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:25.531138 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-aa9948e5-15fc-450d-88e3-d29d0f82fa92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '235d03ded18f41728af86fb0d5e35216'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:25.532988 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-aa9948e5-15fc-450d-88e3-d29d0f82fa92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '235d03ded18f41728af86fb0d5e35216'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:25.578297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-aa9948e5-15fc-450d-88e3-d29d0f82fa92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '235d03ded18f41728af86fb0d5e35216'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:25.601503 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e033b5-abe7-4f25-8aa6-1d9235e404d5 service cinder] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:25.605014 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-35e033b5-abe7-4f25-8aa6-1d9235e404d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:25.605908 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-aa9948e5-15fc-450d-88e3-d29d0f82fa92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '235d03ded18f41728af86fb0d5e35216'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:25.606621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-aa9948e5-15fc-450d-88e3-d29d0f82fa92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '235d03ded18f41728af86fb0d5e35216'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:25.629997 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:25.637362 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2591/5209] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:21:25 2022] DELETE /identity/v3/users/235d03ded18f41728af86fb0d5e35216 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:25.641809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac376d-482f-441b-b911-f0a828efaf88 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:25.642102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac376d-482f-441b-b911-f0a828efaf88 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:25.642602 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac376d-482f-441b-b911-f0a828efaf88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:25.670865 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-1cac376d-482f-441b-b911-f0a828efaf88 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:25.672499 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1cac376d-482f-441b-b911-f0a828efaf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:25.698803 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e033b5-abe7-4f25-8aa6-1d9235e404d5 service cinder] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:25.781743 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2592/5210] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:21:25.781909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc14c8-6548-4282-9a27-f5575a8b42e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:25.781909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc14c8-6548-4282-9a27-f5575a8b42e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:25.781909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc14c8-6548-4282-9a27-f5575a8b42e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:25.781909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc14c8-6548-4282-9a27-f5575a8b42e8 admin admin] PATH_INFO: `/v3/users/3214acf95145444ba3475ced751a8d69` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:25.782230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc14c8-6548-4282-9a27-f5575a8b42e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3214acf95145444ba3475ced751a8d69)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:25.783961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc14c8-6548-4282-9a27-f5575a8b42e8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:25.792249 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac376d-482f-441b-b911-f0a828efaf88 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:25.794028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1cac376d-482f-441b-b911-f0a828efaf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:25.864523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9dbc14c8-6548-4282-9a27-f5575a8b42e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3214acf95145444ba3475ced751a8d69'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:25.865346 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9dbc14c8-6548-4282-9a27-f5575a8b42e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3214acf95145444ba3475ced751a8d69'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:25.877910 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9dbc14c8-6548-4282-9a27-f5575a8b42e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3214acf95145444ba3475ced751a8d69'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:25.888693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9dbc14c8-6548-4282-9a27-f5575a8b42e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3214acf95145444ba3475ced751a8d69'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:25.890862 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9dbc14c8-6548-4282-9a27-f5575a8b42e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3214acf95145444ba3475ced751a8d69'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:25.904678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac376d-482f-441b-b911-f0a828efaf88 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:25.915920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580adf46-f2c5-4fbb-9ccd-8476aaeee98a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:25.916543 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580adf46-f2c5-4fbb-9ccd-8476aaeee98a service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:25.916822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580adf46-f2c5-4fbb-9ccd-8476aaeee98a service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:25.917092 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580adf46-f2c5-4fbb-9ccd-8476aaeee98a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:25.919697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-580adf46-f2c5-4fbb-9ccd-8476aaeee98a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:25.926871 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2619/5211] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:21:25 2022] DELETE /identity/v3/users/3214acf95145444ba3475ced751a8d69 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:25.931461 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848f0d6-448b-4d43-be1f-1048968c8209 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:25.932198 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848f0d6-448b-4d43-be1f-1048968c8209 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:25.933572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848f0d6-448b-4d43-be1f-1048968c8209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:25.941003 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580adf46-f2c5-4fbb-9ccd-8476aaeee98a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:25.944263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580adf46-f2c5-4fbb-9ccd-8476aaeee98a service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:25.957069 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2593/5212] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:21:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:21:25.965736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-6848f0d6-448b-4d43-be1f-1048968c8209 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:25.968384 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6848f0d6-448b-4d43-be1f-1048968c8209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:26.029616 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:26.096647 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2620/5213] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:21:26.109677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580adf46-f2c5-4fbb-9ccd-8476aaeee98a service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:26.112339 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-580adf46-f2c5-4fbb-9ccd-8476aaeee98a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:26.134146 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580adf46-f2c5-4fbb-9ccd-8476aaeee98a service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:26.173677 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:26.255449 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00426a-083a-45cd-9bf3-81f2c07eaa30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:26.256137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00426a-083a-45cd-9bf3-81f2c07eaa30 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:26.256361 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00426a-083a-45cd-9bf3-81f2c07eaa30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:26.256733 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00426a-083a-45cd-9bf3-81f2c07eaa30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:26.274092 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00426a-083a-45cd-9bf3-81f2c07eaa30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:26.275555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00426a-083a-45cd-9bf3-81f2c07eaa30 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:26.295867 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2594/5214] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:21:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:21:27.067683 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848f0d6-448b-4d43-be1f-1048968c8209 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:27.069787 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6848f0d6-448b-4d43-be1f-1048968c8209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:27.084341 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848f0d6-448b-4d43-be1f-1048968c8209 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:27.089882 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f38d1-751a-4f1c-89db-9fc6451ca661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:27.090607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f38d1-751a-4f1c-89db-9fc6451ca661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:27.090954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f38d1-751a-4f1c-89db-9fc6451ca661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:27.091296 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f38d1-751a-4f1c-89db-9fc6451ca661 admin admin] PATH_INFO: `/v3/projects/f4186c7d200743438d94dfc1cceb915f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:27.092675 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f38d1-751a-4f1c-89db-9fc6451ca661 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4186c7d200743438d94dfc1cceb915f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:27.094735 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f38d1-751a-4f1c-89db-9fc6451ca661 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:27.181727 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-558f38d1-751a-4f1c-89db-9fc6451ca661 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4186c7d200743438d94dfc1cceb915f', 'request_id': 'req-558f38d1-751a-4f1c-89db-9fc6451ca661'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:27.188203 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-558f38d1-751a-4f1c-89db-9fc6451ca661 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4186c7d200743438d94dfc1cceb915f', 'request_id': 'req-558f38d1-751a-4f1c-89db-9fc6451ca661'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:27.192951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-558f38d1-751a-4f1c-89db-9fc6451ca661 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4186c7d200743438d94dfc1cceb915f', 'request_id': 'req-558f38d1-751a-4f1c-89db-9fc6451ca661'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:27.209193 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-558f38d1-751a-4f1c-89db-9fc6451ca661 admin admin] The token cache is being invalidate because project f4186c7d200743438d94dfc1cceb915f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:27.209510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-558f38d1-751a-4f1c-89db-9fc6451ca661 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:27.210590 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-558f38d1-751a-4f1c-89db-9fc6451ca661 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:27.213471 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2621/5215] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:21:27 2022] DELETE /identity/v3/projects/f4186c7d200743438d94dfc1cceb915f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:27.217138 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00426a-083a-45cd-9bf3-81f2c07eaa30 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:27.228631 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00426a-083a-45cd-9bf3-81f2c07eaa30 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:27.294802 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee12a1-3cce-4987-9982-0261b4efe52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:27.296038 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee12a1-3cce-4987-9982-0261b4efe52f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:27.296320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee12a1-3cce-4987-9982-0261b4efe52f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:27.296642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee12a1-3cce-4987-9982-0261b4efe52f admin admin] PATH_INFO: `/v3/users/eff86e31de984534a6ca4e8d4e2444b1` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:27.297823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee12a1-3cce-4987-9982-0261b4efe52f admin admin] RBAC: Authorizing `identity:delete_user(user_id=eff86e31de984534a6ca4e8d4e2444b1)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:27.299749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee12a1-3cce-4987-9982-0261b4efe52f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:27.374607 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-46ee12a1-3cce-4987-9982-0261b4efe52f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eff86e31de984534a6ca4e8d4e2444b1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:27.375542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-46ee12a1-3cce-4987-9982-0261b4efe52f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eff86e31de984534a6ca4e8d4e2444b1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:27.385002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-46ee12a1-3cce-4987-9982-0261b4efe52f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eff86e31de984534a6ca4e8d4e2444b1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:27.394773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-46ee12a1-3cce-4987-9982-0261b4efe52f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eff86e31de984534a6ca4e8d4e2444b1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:27.395979 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-46ee12a1-3cce-4987-9982-0261b4efe52f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eff86e31de984534a6ca4e8d4e2444b1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:27.460824 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2595/5216] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:21:27 2022] DELETE /identity/v3/users/eff86e31de984534a6ca4e8d4e2444b1 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:21:27.466835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f38d1-751a-4f1c-89db-9fc6451ca661 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:27.469240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-558f38d1-751a-4f1c-89db-9fc6451ca661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:27.487071 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f38d1-751a-4f1c-89db-9fc6451ca661 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:27.606593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bda16-3c7d-4953-b1aa-11e8d20e650a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:27.607869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bda16-3c7d-4953-b1aa-11e8d20e650a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:27.609993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bda16-3c7d-4953-b1aa-11e8d20e650a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:27.610662 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bda16-3c7d-4953-b1aa-11e8d20e650a admin admin] PATH_INFO: `/v3/projects/1c61ffcf7dd4482bba378c6cc7e1d99e` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:27.612488 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7bda16-3c7d-4953-b1aa-11e8d20e650a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c61ffcf7dd4482bba378c6cc7e1d99e)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:27.615205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7bda16-3c7d-4953-b1aa-11e8d20e650a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:27.714044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9a7bda16-3c7d-4953-b1aa-11e8d20e650a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c61ffcf7dd4482bba378c6cc7e1d99e', 'request_id': 'req-9a7bda16-3c7d-4953-b1aa-11e8d20e650a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:27.729873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9a7bda16-3c7d-4953-b1aa-11e8d20e650a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c61ffcf7dd4482bba378c6cc7e1d99e', 'request_id': 'req-9a7bda16-3c7d-4953-b1aa-11e8d20e650a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:27.741348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9a7bda16-3c7d-4953-b1aa-11e8d20e650a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c61ffcf7dd4482bba378c6cc7e1d99e', 'request_id': 'req-9a7bda16-3c7d-4953-b1aa-11e8d20e650a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:27.745601 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:27.769225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9a7bda16-3c7d-4953-b1aa-11e8d20e650a admin admin] The token cache is being invalidate because project 1c61ffcf7dd4482bba378c6cc7e1d99e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:27.771340 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9a7bda16-3c7d-4953-b1aa-11e8d20e650a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:27.772319 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9a7bda16-3c7d-4953-b1aa-11e8d20e650a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:27.779380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee12a1-3cce-4987-9982-0261b4efe52f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:27.779757 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2622/5217] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:21:27 2022] DELETE /identity/v3/projects/1c61ffcf7dd4482bba378c6cc7e1d99e => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:27.781589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-46ee12a1-3cce-4987-9982-0261b4efe52f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:27.797921 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee12a1-3cce-4987-9982-0261b4efe52f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:27.889051 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:27.917041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edde889-256b-46da-b939-cd4ccb250f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:27.918167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edde889-256b-46da-b939-cd4ccb250f62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:27.918167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edde889-256b-46da-b939-cd4ccb250f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:27.918378 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edde889-256b-46da-b939-cd4ccb250f62 admin admin] PATH_INFO: `/v3/users/f45f1c7b403a4ddb89f84a8319d8c249` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:27.919454 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edde889-256b-46da-b939-cd4ccb250f62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f45f1c7b403a4ddb89f84a8319d8c249)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:27.921459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edde889-256b-46da-b939-cd4ccb250f62 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:27.983300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5edde889-256b-46da-b939-cd4ccb250f62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f45f1c7b403a4ddb89f84a8319d8c249'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:27.984143 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5edde889-256b-46da-b939-cd4ccb250f62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f45f1c7b403a4ddb89f84a8319d8c249'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:27.998354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5edde889-256b-46da-b939-cd4ccb250f62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f45f1c7b403a4ddb89f84a8319d8c249'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:28.010850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5edde889-256b-46da-b939-cd4ccb250f62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f45f1c7b403a4ddb89f84a8319d8c249'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:28.011627 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5edde889-256b-46da-b939-cd4ccb250f62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f45f1c7b403a4ddb89f84a8319d8c249'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:28.036882 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2596/5218] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:21:27 2022] DELETE /identity/v3/users/f45f1c7b403a4ddb89f84a8319d8c249 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:21:28.674535 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bda16-3c7d-4953-b1aa-11e8d20e650a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:28.676356 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9a7bda16-3c7d-4953-b1aa-11e8d20e650a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:28.703304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bda16-3c7d-4953-b1aa-11e8d20e650a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:28.804266 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88048ece-91ce-4870-9cf9-5d588b59da3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:28.804980 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88048ece-91ce-4870-9cf9-5d588b59da3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:28.805265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88048ece-91ce-4870-9cf9-5d588b59da3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:28.805880 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88048ece-91ce-4870-9cf9-5d588b59da3a admin admin] PATH_INFO: `/v3/projects/543b489cbe5c4fba8fd5e5504b339d29` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:28.807544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88048ece-91ce-4870-9cf9-5d588b59da3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=543b489cbe5c4fba8fd5e5504b339d29)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:28.809758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88048ece-91ce-4870-9cf9-5d588b59da3a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:28.869522 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-88048ece-91ce-4870-9cf9-5d588b59da3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '543b489cbe5c4fba8fd5e5504b339d29', 'request_id': 'req-88048ece-91ce-4870-9cf9-5d588b59da3a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:28.880701 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-88048ece-91ce-4870-9cf9-5d588b59da3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '543b489cbe5c4fba8fd5e5504b339d29', 'request_id': 'req-88048ece-91ce-4870-9cf9-5d588b59da3a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:28.894182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-88048ece-91ce-4870-9cf9-5d588b59da3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '543b489cbe5c4fba8fd5e5504b339d29', 'request_id': 'req-88048ece-91ce-4870-9cf9-5d588b59da3a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:28.911074 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-88048ece-91ce-4870-9cf9-5d588b59da3a admin admin] The token cache is being invalidate because project 543b489cbe5c4fba8fd5e5504b339d29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:28.911463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-88048ece-91ce-4870-9cf9-5d588b59da3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:28.912207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-88048ece-91ce-4870-9cf9-5d588b59da3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:28.914261 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2623/5219] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:21:28 2022] DELETE /identity/v3/projects/543b489cbe5c4fba8fd5e5504b339d29 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:28.919891 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc926d-a65a-4eee-b2a9-eabce2f4aff2 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:28.920356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc926d-a65a-4eee-b2a9-eabce2f4aff2 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:28.920442 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc926d-a65a-4eee-b2a9-eabce2f4aff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:28.931688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88048ece-91ce-4870-9cf9-5d588b59da3a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:28.932783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-88048ece-91ce-4870-9cf9-5d588b59da3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:28.950991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-7ffc926d-a65a-4eee-b2a9-eabce2f4aff2 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:28.952607 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7ffc926d-a65a-4eee-b2a9-eabce2f4aff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:29.035090 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2597/5220] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:29.042772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59238e6f-0610-4ebe-bab3-4da4d9d82e00 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:29.042990 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59238e6f-0610-4ebe-bab3-4da4d9d82e00 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:29.043279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59238e6f-0610-4ebe-bab3-4da4d9d82e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:29.079301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-59238e6f-0610-4ebe-bab3-4da4d9d82e00 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:29.082244 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-59238e6f-0610-4ebe-bab3-4da4d9d82e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:29.089195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88048ece-91ce-4870-9cf9-5d588b59da3a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:29.098943 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2598/5221] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:29.100117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fcf2ab-64b0-4620-86c1-9f8352e3ee0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:29.101355 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcf2ab-64b0-4620-86c1-9f8352e3ee0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:29.101712 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcf2ab-64b0-4620-86c1-9f8352e3ee0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:29.102013 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcf2ab-64b0-4620-86c1-9f8352e3ee0c admin admin] PATH_INFO: `/v3/projects/8ea32418ab294be09fe1f88e05114cd1` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:29.103257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59238e6f-0610-4ebe-bab3-4da4d9d82e00 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:29.104137 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fcf2ab-64b0-4620-86c1-9f8352e3ee0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ea32418ab294be09fe1f88e05114cd1)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:29.106794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fcf2ab-64b0-4620-86c1-9f8352e3ee0c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:29.120550 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59238e6f-0610-4ebe-bab3-4da4d9d82e00 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:29.155297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42817e5a-c231-4326-a622-8c6ea5cf64c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:29.156088 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42817e5a-c231-4326-a622-8c6ea5cf64c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:29.156374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42817e5a-c231-4326-a622-8c6ea5cf64c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:29.156649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42817e5a-c231-4326-a622-8c6ea5cf64c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:29.157317 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42817e5a-c231-4326-a622-8c6ea5cf64c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:21:29.157655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42817e5a-c231-4326-a622-8c6ea5cf64c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:29.159537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42817e5a-c231-4326-a622-8c6ea5cf64c5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:29.168660 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:29.187604 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2599/5222] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:21:29.192542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42817e5a-c231-4326-a622-8c6ea5cf64c5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:29.205768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-10fcf2ab-64b0-4620-86c1-9f8352e3ee0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ea32418ab294be09fe1f88e05114cd1', 'request_id': 'req-10fcf2ab-64b0-4620-86c1-9f8352e3ee0c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:29.209634 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42817e5a-c231-4326-a622-8c6ea5cf64c5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:29.216255 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-10fcf2ab-64b0-4620-86c1-9f8352e3ee0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ea32418ab294be09fe1f88e05114cd1', 'request_id': 'req-10fcf2ab-64b0-4620-86c1-9f8352e3ee0c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:29.224640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-10fcf2ab-64b0-4620-86c1-9f8352e3ee0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ea32418ab294be09fe1f88e05114cd1', 'request_id': 'req-10fcf2ab-64b0-4620-86c1-9f8352e3ee0c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:29.240598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-10fcf2ab-64b0-4620-86c1-9f8352e3ee0c admin admin] The token cache is being invalidate because project 8ea32418ab294be09fe1f88e05114cd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:29.240950 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-10fcf2ab-64b0-4620-86c1-9f8352e3ee0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:29.241725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-10fcf2ab-64b0-4620-86c1-9f8352e3ee0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:29.244747 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2624/5223] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:21:28 2022] DELETE /identity/v3/projects/8ea32418ab294be09fe1f88e05114cd1 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:29.258541 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11496c92-ce27-44c8-ad22-e19ab3177c84 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:29.259293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11496c92-ce27-44c8-ad22-e19ab3177c84 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:29.259871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11496c92-ce27-44c8-ad22-e19ab3177c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:29.278928 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:29.293547 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-11496c92-ce27-44c8-ad22-e19ab3177c84 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:29.294687 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-11496c92-ce27-44c8-ad22-e19ab3177c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:29.311578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e9143-76cb-42f6-943f-6b1a65651168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:29.313018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e9143-76cb-42f6-943f-6b1a65651168 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:29.313739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e9143-76cb-42f6-943f-6b1a65651168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:29.314231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e9143-76cb-42f6-943f-6b1a65651168 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:29.315222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e9143-76cb-42f6-943f-6b1a65651168 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:29.319969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e9143-76cb-42f6-943f-6b1a65651168 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:29.377677 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2600/5224] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:21:29 2022] POST /identity/v3/projects => generated 391 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:29.382751 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e9143-76cb-42f6-943f-6b1a65651168 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:29.385519 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8e7e9143-76cb-42f6-943f-6b1a65651168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:29.425906 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2625/5225] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:29.434418 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9345211-1765-4859-bd02-1480f9a1d2e6 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:29.434846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9345211-1765-4859-bd02-1480f9a1d2e6 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:29.436153 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9345211-1765-4859-bd02-1480f9a1d2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:29.463541 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-d9345211-1765-4859-bd02-1480f9a1d2e6 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:29.465401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d9345211-1765-4859-bd02-1480f9a1d2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:29.499613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e9143-76cb-42f6-943f-6b1a65651168 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:29.504983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e30f3-d54b-4dd1-b09e-1df08cb9e416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:29.505634 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e30f3-d54b-4dd1-b09e-1df08cb9e416 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:29.505918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e30f3-d54b-4dd1-b09e-1df08cb9e416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:29.506316 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e30f3-d54b-4dd1-b09e-1df08cb9e416 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:29.507054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e30f3-d54b-4dd1-b09e-1df08cb9e416 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:29.509687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e30f3-d54b-4dd1-b09e-1df08cb9e416 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:29.551870 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2626/5226] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:21:29.557615 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9345211-1765-4859-bd02-1480f9a1d2e6 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:29.560986 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2601/5227] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:21:29 2022] POST /identity/v3/users => generated 296 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:29.562409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e30f3-d54b-4dd1-b09e-1df08cb9e416 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:29.572898 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9345211-1765-4859-bd02-1480f9a1d2e6 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:29.575949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e30f3-d54b-4dd1-b09e-1df08cb9e416 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:29.581247 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797cb5c-4c24-41c4-aeb5-8727075122c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:29.582098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797cb5c-4c24-41c4-aeb5-8727075122c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:29.582381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797cb5c-4c24-41c4-aeb5-8727075122c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:29.582654 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797cb5c-4c24-41c4-aeb5-8727075122c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:29.583302 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797cb5c-4c24-41c4-aeb5-8727075122c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:29.585089 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797cb5c-4c24-41c4-aeb5-8727075122c5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:29.590228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4041e9-827f-48d9-abf4-dd73850f2174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:29.591187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4041e9-827f-48d9-abf4-dd73850f2174 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:29.592387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4041e9-827f-48d9-abf4-dd73850f2174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:29.593680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4041e9-827f-48d9-abf4-dd73850f2174 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:29.594726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4041e9-827f-48d9-abf4-dd73850f2174 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:21:29.595239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4041e9-827f-48d9-abf4-dd73850f2174 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:29.597296 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4041e9-827f-48d9-abf4-dd73850f2174 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:29.601304 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2602/5228] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:29.602822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797cb5c-4c24-41c4-aeb5-8727075122c5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:29.614824 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797cb5c-4c24-41c4-aeb5-8727075122c5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:29.621621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d272c39-aa08-4380-8712-54b0672f0d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:29.622236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d272c39-aa08-4380-8712-54b0672f0d6b admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:29.622569 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d272c39-aa08-4380-8712-54b0672f0d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:29.622844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d272c39-aa08-4380-8712-54b0672f0d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:29.626850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d272c39-aa08-4380-8712-54b0672f0d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:29.626850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d272c39-aa08-4380-8712-54b0672f0d6b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:29.629543 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2627/5229] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:21:29.630729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4041e9-827f-48d9-abf4-dd73850f2174 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:29.641897 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2603/5230] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:29.642366 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d272c39-aa08-4380-8712-54b0672f0d6b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:29.651446 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4041e9-827f-48d9-abf4-dd73850f2174 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:29.654609 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d272c39-aa08-4380-8712-54b0672f0d6b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:29.661421 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0fcede-82f4-4e97-97ef-13a9213fc557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:29.662195 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fcede-82f4-4e97-97ef-13a9213fc557 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:29.662551 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fcede-82f4-4e97-97ef-13a9213fc557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:29.663263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fcede-82f4-4e97-97ef-13a9213fc557 admin admin] PATH_INFO: `/v3/projects/7948369cbcb44ec1a9e93c3b53079387/users/bec2eb8caa3644c7bb3a2da66b51b1a8/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:29.663402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5236d5-e5da-43a1-8d19-4f49ca23c98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:29.663985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5236d5-e5da-43a1-8d19-4f49ca23c98b admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:29.664865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5236d5-e5da-43a1-8d19-4f49ca23c98b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:29.665713 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5236d5-e5da-43a1-8d19-4f49ca23c98b admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:29.666910 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5236d5-e5da-43a1-8d19-4f49ca23c98b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:29.668715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5236d5-e5da-43a1-8d19-4f49ca23c98b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:29.684708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0fcede-82f4-4e97-97ef-13a9213fc557 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7948369cbcb44ec1a9e93c3b53079387, user_id=bec2eb8caa3644c7bb3a2da66b51b1a8, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:29.688786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0fcede-82f4-4e97-97ef-13a9213fc557 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:29.709127 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2628/5231] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:21:29 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:29.709680 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2604/5232] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:21:29 2022] PUT /identity/v3/projects/7948369cbcb44ec1a9e93c3b53079387/users/bec2eb8caa3644c7bb3a2da66b51b1a8/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:29.710703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5236d5-e5da-43a1-8d19-4f49ca23c98b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:29.718891 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7e369-7ae0-4af6-bd62-23b45df02c4a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:29.719172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7e369-7ae0-4af6-bd62-23b45df02c4a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:29.719447 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7e369-7ae0-4af6-bd62-23b45df02c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:29.749172 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:29.775782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b0f7e369-7ae0-4af6-bd62-23b45df02c4a None None] MFA Rules not processed for user `bec2eb8caa3644c7bb3a2da66b51b1a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:29.777343 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b0f7e369-7ae0-4af6-bd62-23b45df02c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:29.817851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5236d5-e5da-43a1-8d19-4f49ca23c98b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:29.824874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a0083-9e48-4d98-ba8c-43ffded81601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:29.825751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a0083-9e48-4d98-ba8c-43ffded81601 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:29.826135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a0083-9e48-4d98-ba8c-43ffded81601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:29.826512 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a0083-9e48-4d98-ba8c-43ffded81601 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:29.827745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212a0083-9e48-4d98-ba8c-43ffded81601 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:29.829402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212a0083-9e48-4d98-ba8c-43ffded81601 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:29.861696 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2629/5233] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:21:29 2022] POST /identity/v3/users => generated 287 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:21:29.866925 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a0083-9e48-4d98-ba8c-43ffded81601 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:29.877551 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2605/5234] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:29.878485 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7e369-7ae0-4af6-bd62-23b45df02c4a None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:29.888511 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7e369-7ae0-4af6-bd62-23b45df02c4a None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:29.890443 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a0083-9e48-4d98-ba8c-43ffded81601 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:29.893768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd810e62-b13e-4a5f-a533-24e388667edc tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bec2eb8caa3644c7bb3a2da66b51b1a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7948369cbcb44ec1a9e93c3b53079387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:29.894461 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd810e62-b13e-4a5f-a533-24e388667edc tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:29.894754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd810e62-b13e-4a5f-a533-24e388667edc tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:29.895021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd810e62-b13e-4a5f-a533-24e388667edc tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] PATH_INFO: `/v3/users/bec2eb8caa3644c7bb3a2da66b51b1a8/application_credentials` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:29.895929 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd810e62-b13e-4a5f-a533-24e388667edc tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: Authorizing `identity:create_application_credential(user_id=bec2eb8caa3644c7bb3a2da66b51b1a8)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:29.896615 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a6b6e-d57d-4e1e-b74a-627d134db3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:29.897139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd810e62-b13e-4a5f-a533-24e388667edc tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:29.897511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a6b6e-d57d-4e1e-b74a-627d134db3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:29.898001 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a6b6e-d57d-4e1e-b74a-627d134db3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:29.898378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a6b6e-d57d-4e1e-b74a-627d134db3e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:29.899528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a6b6e-d57d-4e1e-b74a-627d134db3e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:29.901276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a6b6e-d57d-4e1e-b74a-627d134db3e6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:29.902283 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:29.920393 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2630/5235] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:29.922170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a6b6e-d57d-4e1e-b74a-627d134db3e6 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:29.935233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a6b6e-d57d-4e1e-b74a-627d134db3e6 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:29.942547 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2616e1c-6d0e-468a-97ef-d0777223a6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:29.943339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2616e1c-6d0e-468a-97ef-d0777223a6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:29.944059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2616e1c-6d0e-468a-97ef-d0777223a6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:29.944059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2616e1c-6d0e-468a-97ef-d0777223a6f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:29.944790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2616e1c-6d0e-468a-97ef-d0777223a6f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:29.947403 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2616e1c-6d0e-468a-97ef-d0777223a6f5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:29.965539 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2631/5236] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:29.967537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2616e1c-6d0e-468a-97ef-d0777223a6f5 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:30.009737 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2606/5237] 10.222.0.30 () {60 vars in 1314 bytes} [Sun Sep 4 01:21:29 2022] POST /identity/v3/users/bec2eb8caa3644c7bb3a2da66b51b1a8/application_credentials => generated 789 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:30.010711 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd810e62-b13e-4a5f-a533-24e388667edc tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:30.013607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2616e1c-6d0e-468a-97ef-d0777223a6f5 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:30.030491 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841037ab-9879-45b0-8760-eabdd9671501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:30.031625 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841037ab-9879-45b0-8760-eabdd9671501 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:30.032106 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841037ab-9879-45b0-8760-eabdd9671501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:30.033199 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841037ab-9879-45b0-8760-eabdd9671501 admin admin] PATH_INFO: `/v3/projects/7c41ad7dfbc0495895bc0461c9310940/users/e45404b70e5543ed9af440b1aefef5ca/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:30.040708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd810e62-b13e-4a5f-a533-24e388667edc tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:30.045399 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51efc28-7e05-472c-8519-2c6f38f0dca5 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bec2eb8caa3644c7bb3a2da66b51b1a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7948369cbcb44ec1a9e93c3b53079387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:30.046117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51efc28-7e05-472c-8519-2c6f38f0dca5 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:30.046396 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51efc28-7e05-472c-8519-2c6f38f0dca5 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:30.046673 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51efc28-7e05-472c-8519-2c6f38f0dca5 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] PATH_INFO: `/v3/users/bec2eb8caa3644c7bb3a2da66b51b1a8/application_credentials/f4133c09a242498ca55718e763b6f002` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:30.060073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841037ab-9879-45b0-8760-eabdd9671501 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c41ad7dfbc0495895bc0461c9310940, user_id=e45404b70e5543ed9af440b1aefef5ca, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:30.061747 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51efc28-7e05-472c-8519-2c6f38f0dca5 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: Authorizing `identity:get_application_credential(user_id=bec2eb8caa3644c7bb3a2da66b51b1a8, application_credential_id=f4133c09a242498ca55718e763b6f002)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:30.063888 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841037ab-9879-45b0-8760-eabdd9671501 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:30.064010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51efc28-7e05-472c-8519-2c6f38f0dca5 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:30.071975 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2607/5238] 10.222.0.30 () {58 vars in 1392 bytes} [Sun Sep 4 01:21:30 2022] GET /identity/v3/users/bec2eb8caa3644c7bb3a2da66b51b1a8/application_credentials/f4133c09a242498ca55718e763b6f002 => generated 689 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:21:30.073587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355195d5-17a2-42eb-877b-39e9ac034cec None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:30.073881 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355195d5-17a2-42eb-877b-39e9ac034cec None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:30.074149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355195d5-17a2-42eb-877b-39e9ac034cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:30.098102 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2632/5239] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:21:29 2022] PUT /identity/v3/projects/7c41ad7dfbc0495895bc0461c9310940/users/e45404b70e5543ed9af440b1aefef5ca/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:21:30.099761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edb62a-7292-4b69-a4d0-712713398b70 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:30.100049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edb62a-7292-4b69-a4d0-712713398b70 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:30.100319 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edb62a-7292-4b69-a4d0-712713398b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:30.102269 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-355195d5-17a2-42eb-877b-39e9ac034cec None None] MFA Rules not processed for user `bec2eb8caa3644c7bb3a2da66b51b1a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:30.103914 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-355195d5-17a2-42eb-877b-39e9ac034cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:30.131681 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-11edb62a-7292-4b69-a4d0-712713398b70 None None] MFA Rules not processed for user `e45404b70e5543ed9af440b1aefef5ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:30.134637 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-11edb62a-7292-4b69-a4d0-712713398b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:30.237258 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2633/5240] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:30.241186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11edb62a-7292-4b69-a4d0-712713398b70 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:30.254583 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2608/5241] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:30 2022] POST /identity/v3/auth/tokens => generated 3425 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Sep 04 01:21:30.255530 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355195d5-17a2-42eb-877b-39e9ac034cec None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:30.319267 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:30.341036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355195d5-17a2-42eb-877b-39e9ac034cec None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:30.346119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3077b-defb-4399-9947-54e8abc4d213 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bec2eb8caa3644c7bb3a2da66b51b1a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7948369cbcb44ec1a9e93c3b53079387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:30.347088 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3077b-defb-4399-9947-54e8abc4d213 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:30.347571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3077b-defb-4399-9947-54e8abc4d213 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:30.348014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3077b-defb-4399-9947-54e8abc4d213 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] PATH_INFO: `/v3/users/bec2eb8caa3644c7bb3a2da66b51b1a8/application_credentials/f4133c09a242498ca55718e763b6f002` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:30.349701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3077b-defb-4399-9947-54e8abc4d213 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: Authorizing `identity:delete_application_credential(user_id=bec2eb8caa3644c7bb3a2da66b51b1a8, application_credential_id=f4133c09a242498ca55718e763b6f002)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:30.354668 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3077b-defb-4399-9947-54e8abc4d213 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:30.376693 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:30.386827 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11edb62a-7292-4b69-a4d0-712713398b70 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:30.393027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163caf56-bb30-4b75-9a6a-088b1ed28467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:30.393864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163caf56-bb30-4b75-9a6a-088b1ed28467 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:30.394001 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163caf56-bb30-4b75-9a6a-088b1ed28467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:30.394771 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163caf56-bb30-4b75-9a6a-088b1ed28467 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:30.395137 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163caf56-bb30-4b75-9a6a-088b1ed28467 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:30.397802 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163caf56-bb30-4b75-9a6a-088b1ed28467 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:30.413388 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2609/5242] 10.222.0.30 () {58 vars in 1395 bytes} [Sun Sep 4 01:21:30 2022] DELETE /identity/v3/users/bec2eb8caa3644c7bb3a2da66b51b1a8/application_credentials/f4133c09a242498ca55718e763b6f002 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:30.423579 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3077b-defb-4399-9947-54e8abc4d213 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:30.447939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3077b-defb-4399-9947-54e8abc4d213 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:30.460542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2954c07-c3d1-4375-bf45-02d6362bca40 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bec2eb8caa3644c7bb3a2da66b51b1a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7948369cbcb44ec1a9e93c3b53079387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:30.463628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2954c07-c3d1-4375-bf45-02d6362bca40 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:30.464036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2954c07-c3d1-4375-bf45-02d6362bca40 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:30.464551 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2954c07-c3d1-4375-bf45-02d6362bca40 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] PATH_INFO: `/v3/users/bec2eb8caa3644c7bb3a2da66b51b1a8/application_credentials` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:30.466970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2954c07-c3d1-4375-bf45-02d6362bca40 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: Authorizing `identity:create_application_credential(user_id=bec2eb8caa3644c7bb3a2da66b51b1a8)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:30.468258 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2954c07-c3d1-4375-bf45-02d6362bca40 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:30.497912 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2634/5243] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:21:30 2022] POST /identity/v3/projects => generated 371 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:30.501964 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163caf56-bb30-4b75-9a6a-088b1ed28467 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:30.668751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163caf56-bb30-4b75-9a6a-088b1ed28467 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:30.686913 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2610/5244] 10.222.0.30 () {60 vars in 1315 bytes} [Sun Sep 4 01:21:30 2022] POST /identity/v3/users/bec2eb8caa3644c7bb3a2da66b51b1a8/application_credentials => generated 921 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:30.687893 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2954c07-c3d1-4375-bf45-02d6362bca40 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:30.691114 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c831daf-4639-4aeb-b003-23a76878fc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:30.693035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c831daf-4639-4aeb-b003-23a76878fc55 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:30.693501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c831daf-4639-4aeb-b003-23a76878fc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:30.695126 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c831daf-4639-4aeb-b003-23a76878fc55 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:30.699335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2954c07-c3d1-4375-bf45-02d6362bca40 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:30.699556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c831daf-4639-4aeb-b003-23a76878fc55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:30.703909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c831daf-4639-4aeb-b003-23a76878fc55 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:30.788670 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2635/5245] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:21:30 2022] POST /identity/v3/users => generated 292 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:21:30.790503 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c831daf-4639-4aeb-b003-23a76878fc55 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:30.797212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0790d76b-0eff-47b6-8d1b-9330aa6dc638 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bec2eb8caa3644c7bb3a2da66b51b1a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7948369cbcb44ec1a9e93c3b53079387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:30.798423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790d76b-0eff-47b6-8d1b-9330aa6dc638 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:30.799437 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790d76b-0eff-47b6-8d1b-9330aa6dc638 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:30.799942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790d76b-0eff-47b6-8d1b-9330aa6dc638 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] PATH_INFO: `/v3/users/bec2eb8caa3644c7bb3a2da66b51b1a8/application_credentials/e6ac85cd37e44360b8ad7965a40566b8` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:30.805945 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c831daf-4639-4aeb-b003-23a76878fc55 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:30.812351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9b46e-fdcd-4b3f-b83c-a8f7569bb490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:30.813074 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9b46e-fdcd-4b3f-b83c-a8f7569bb490 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:30.813361 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9b46e-fdcd-4b3f-b83c-a8f7569bb490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:30.815863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9b46e-fdcd-4b3f-b83c-a8f7569bb490 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:30.815863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc9b46e-fdcd-4b3f-b83c-a8f7569bb490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:30.816860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc9b46e-fdcd-4b3f-b83c-a8f7569bb490 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:30.827931 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0790d76b-0eff-47b6-8d1b-9330aa6dc638 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: Authorizing `identity:delete_application_credential(user_id=bec2eb8caa3644c7bb3a2da66b51b1a8, application_credential_id=e6ac85cd37e44360b8ad7965a40566b8)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:30.832751 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2636/5246] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:21:30.833840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0790d76b-0eff-47b6-8d1b-9330aa6dc638 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:30.835312 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9b46e-fdcd-4b3f-b83c-a8f7569bb490 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:30.853817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9b46e-fdcd-4b3f-b83c-a8f7569bb490 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:30.861186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e130e-0866-4c37-a086-6f46e616c5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:30.862043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e130e-0866-4c37-a086-6f46e616c5ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:30.862425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e130e-0866-4c37-a086-6f46e616c5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:30.862802 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e130e-0866-4c37-a086-6f46e616c5ff admin admin] PATH_INFO: `/v3/projects/e76cbf853de5408d83dbb3fbe5d811ea/users/7ec4e2b916174b01bc4a521187ac207f/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:30.875548 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2611/5247] 10.222.0.30 () {58 vars in 1395 bytes} [Sun Sep 4 01:21:30 2022] DELETE /identity/v3/users/bec2eb8caa3644c7bb3a2da66b51b1a8/application_credentials/e6ac85cd37e44360b8ad7965a40566b8 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:30.881350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0790d76b-0eff-47b6-8d1b-9330aa6dc638 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:30.892440 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e130e-0866-4c37-a086-6f46e616c5ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76cbf853de5408d83dbb3fbe5d811ea, user_id=7ec4e2b916174b01bc4a521187ac207f, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:30.896473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0790d76b-0eff-47b6-8d1b-9330aa6dc638 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:30.896626 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e130e-0866-4c37-a086-6f46e616c5ff admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:30.902886 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af371b93-d901-4b25-9e53-ebb48bc6242d tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bec2eb8caa3644c7bb3a2da66b51b1a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7948369cbcb44ec1a9e93c3b53079387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:30.903877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af371b93-d901-4b25-9e53-ebb48bc6242d tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:30.904564 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af371b93-d901-4b25-9e53-ebb48bc6242d tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:30.905155 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af371b93-d901-4b25-9e53-ebb48bc6242d tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] PATH_INFO: `/v3/users/bec2eb8caa3644c7bb3a2da66b51b1a8/application_credentials` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:30.906824 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af371b93-d901-4b25-9e53-ebb48bc6242d tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: Authorizing `identity:create_application_credential(user_id=bec2eb8caa3644c7bb3a2da66b51b1a8)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:30.908274 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af371b93-d901-4b25-9e53-ebb48bc6242d tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:30.927036 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2637/5248] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:21:30 2022] PUT /identity/v3/projects/e76cbf853de5408d83dbb3fbe5d811ea/users/7ec4e2b916174b01bc4a521187ac207f/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:21:30.933582 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e130e-0866-4c37-a086-6f46e616c5ff admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:30.984204 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:31.064475 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2612/5249] 10.222.0.30 () {60 vars in 1315 bytes} [Sun Sep 4 01:21:30 2022] POST /identity/v3/users/bec2eb8caa3644c7bb3a2da66b51b1a8/application_credentials => generated 813 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:31.068363 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af371b93-d901-4b25-9e53-ebb48bc6242d tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:31.090693 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af371b93-d901-4b25-9e53-ebb48bc6242d tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:31.096113 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e130e-0866-4c37-a086-6f46e616c5ff admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:31.103230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d60001-1197-4fd6-a4e0-4f29ae55291f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:31.104157 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d60001-1197-4fd6-a4e0-4f29ae55291f admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:31.104628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d60001-1197-4fd6-a4e0-4f29ae55291f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:31.105088 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d60001-1197-4fd6-a4e0-4f29ae55291f admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:31.105989 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d60001-1197-4fd6-a4e0-4f29ae55291f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:31.108046 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d60001-1197-4fd6-a4e0-4f29ae55291f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:31.121985 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2638/5250] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:31.126004 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d60001-1197-4fd6-a4e0-4f29ae55291f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:31.141272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d60001-1197-4fd6-a4e0-4f29ae55291f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:31.147318 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51d272-7b12-48ee-b62b-43b93911971f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:31.148158 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51d272-7b12-48ee-b62b-43b93911971f admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:31.149201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51d272-7b12-48ee-b62b-43b93911971f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:31.149746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51d272-7b12-48ee-b62b-43b93911971f admin admin] PATH_INFO: `/v3/projects/e76cbf853de5408d83dbb3fbe5d811ea/users/7ec4e2b916174b01bc4a521187ac207f/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:31.152146 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a51d272-7b12-48ee-b62b-43b93911971f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76cbf853de5408d83dbb3fbe5d811ea, user_id=7ec4e2b916174b01bc4a521187ac207f, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:31.155272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a51d272-7b12-48ee-b62b-43b93911971f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:31.178514 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2639/5251] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:21:31 2022] PUT /identity/v3/projects/e76cbf853de5408d83dbb3fbe5d811ea/users/7ec4e2b916174b01bc4a521187ac207f/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:21:31.180581 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29f7aa-8cdc-45bd-819a-ee39f1bc83d4 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:31.180977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29f7aa-8cdc-45bd-819a-ee39f1bc83d4 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:31.181615 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29f7aa-8cdc-45bd-819a-ee39f1bc83d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:31.207187 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eeee96-a3db-4965-bdb7-0e21e5b19e19 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bec2eb8caa3644c7bb3a2da66b51b1a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7948369cbcb44ec1a9e93c3b53079387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:31.208033 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eeee96-a3db-4965-bdb7-0e21e5b19e19 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:31.208600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eeee96-a3db-4965-bdb7-0e21e5b19e19 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:31.212538 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eeee96-a3db-4965-bdb7-0e21e5b19e19 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] PATH_INFO: `/v3/users/bec2eb8caa3644c7bb3a2da66b51b1a8/application_credentials/2c132451878246dd96384b8be302cc77` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:31.231225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eeee96-a3db-4965-bdb7-0e21e5b19e19 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: Authorizing `identity:delete_application_credential(user_id=bec2eb8caa3644c7bb3a2da66b51b1a8, application_credential_id=2c132451878246dd96384b8be302cc77)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:31.233158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eeee96-a3db-4965-bdb7-0e21e5b19e19 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:31.239315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-4c29f7aa-8cdc-45bd-819a-ee39f1bc83d4 None None] MFA Rules not processed for user `7ec4e2b916174b01bc4a521187ac207f`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:31.241281 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4c29f7aa-8cdc-45bd-819a-ee39f1bc83d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:31.253037 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:31.260780 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2613/5252] 10.222.0.30 () {58 vars in 1395 bytes} [Sun Sep 4 01:21:31 2022] DELETE /identity/v3/users/bec2eb8caa3644c7bb3a2da66b51b1a8/application_credentials/2c132451878246dd96384b8be302cc77 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:31.266400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eeee96-a3db-4965-bdb7-0e21e5b19e19 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:31.284535 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eeee96-a3db-4965-bdb7-0e21e5b19e19 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:31.360190 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2640/5253] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:31 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:21:31.367805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29f7aa-8cdc-45bd-819a-ee39f1bc83d4 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:31.369499 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4c29f7aa-8cdc-45bd-819a-ee39f1bc83d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:31.401710 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff5c2f-9401-452a-9e0c-54ccd5863823 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bec2eb8caa3644c7bb3a2da66b51b1a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7948369cbcb44ec1a9e93c3b53079387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:31.402789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff5c2f-9401-452a-9e0c-54ccd5863823 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:31.403279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff5c2f-9401-452a-9e0c-54ccd5863823 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:31.403857 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff5c2f-9401-452a-9e0c-54ccd5863823 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] PATH_INFO: `/v3/users/bec2eb8caa3644c7bb3a2da66b51b1a8/application_credentials` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:31.405015 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cff5c2f-9401-452a-9e0c-54ccd5863823 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: Authorizing `identity:create_application_credential(user_id=bec2eb8caa3644c7bb3a2da66b51b1a8)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:31.406424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cff5c2f-9401-452a-9e0c-54ccd5863823 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:31.455336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29f7aa-8cdc-45bd-819a-ee39f1bc83d4 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:31.463465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d12d2-214f-4633-843f-d711a41879a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:31.465380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d12d2-214f-4633-843f-d711a41879a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:31.465380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d12d2-214f-4633-843f-d711a41879a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:31.469382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d12d2-214f-4633-843f-d711a41879a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:31.492859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d12d2-214f-4633-843f-d711a41879a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:31.494891 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d12d2-214f-4633-843f-d711a41879a3 service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:31.505893 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:31.518926 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2614/5254] 10.222.0.30 () {60 vars in 1314 bytes} [Sun Sep 4 01:21:31 2022] POST /identity/v3/users/bec2eb8caa3644c7bb3a2da66b51b1a8/application_credentials => generated 788 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:31.520384 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff5c2f-9401-452a-9e0c-54ccd5863823 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:31.527750 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2641/5255] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:21:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:21:31.535955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff5c2f-9401-452a-9e0c-54ccd5863823 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:31.543320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1bdd6-2abb-44d7-acb5-e523d1a1ab39 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bec2eb8caa3644c7bb3a2da66b51b1a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7948369cbcb44ec1a9e93c3b53079387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:31.544297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1bdd6-2abb-44d7-acb5-e523d1a1ab39 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:31.544852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1bdd6-2abb-44d7-acb5-e523d1a1ab39 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:31.545234 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1bdd6-2abb-44d7-acb5-e523d1a1ab39 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] PATH_INFO: `/v3/users/bec2eb8caa3644c7bb3a2da66b51b1a8/application_credentials` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:31.546506 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1bdd6-2abb-44d7-acb5-e523d1a1ab39 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: Authorizing `identity:create_application_credential(user_id=bec2eb8caa3644c7bb3a2da66b51b1a8)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:31.548971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1bdd6-2abb-44d7-acb5-e523d1a1ab39 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:31.666791 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2615/5256] 10.222.0.30 () {60 vars in 1314 bytes} [Sun Sep 4 01:21:31 2022] POST /identity/v3/users/bec2eb8caa3644c7bb3a2da66b51b1a8/application_credentials => generated 789 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:31.670738 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d12d2-214f-4633-843f-d711a41879a3 service cinder] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:31.704682 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d12d2-214f-4633-843f-d711a41879a3 service cinder] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:31.717289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0975e3f-fb49-4e47-b6e0-6d99208d4575 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bec2eb8caa3644c7bb3a2da66b51b1a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7948369cbcb44ec1a9e93c3b53079387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:31.717996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0975e3f-fb49-4e47-b6e0-6d99208d4575 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:31.718281 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0975e3f-fb49-4e47-b6e0-6d99208d4575 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:31.718560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0975e3f-fb49-4e47-b6e0-6d99208d4575 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] PATH_INFO: `/v3/users/bec2eb8caa3644c7bb3a2da66b51b1a8/application_credentials` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:31.720215 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0975e3f-fb49-4e47-b6e0-6d99208d4575 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: Authorizing `identity:list_application_credentials(user_id=bec2eb8caa3644c7bb3a2da66b51b1a8)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:31.723177 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1bdd6-2abb-44d7-acb5-e523d1a1ab39 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:31.723445 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0975e3f-fb49-4e47-b6e0-6d99208d4575 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:31.741701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1bdd6-2abb-44d7-acb5-e523d1a1ab39 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:31.752336 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366dde7-2225-4354-b71e-71522de04139 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:31.753691 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366dde7-2225-4354-b71e-71522de04139 service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:31.754501 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366dde7-2225-4354-b71e-71522de04139 service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:31.754996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366dde7-2225-4354-b71e-71522de04139 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:31.759014 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2642/5257] 10.222.0.30 () {58 vars in 1293 bytes} [Sun Sep 4 01:21:31 2022] GET /identity/v3/users/bec2eb8caa3644c7bb3a2da66b51b1a8/application_credentials => generated 1501 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:31.766167 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0975e3f-fb49-4e47-b6e0-6d99208d4575 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:31.792717 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0975e3f-fb49-4e47-b6e0-6d99208d4575 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:31.800918 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03f334-7d79-4ac9-8f39-8e0d99b75c1c tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bec2eb8caa3644c7bb3a2da66b51b1a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7948369cbcb44ec1a9e93c3b53079387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:31.802025 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03f334-7d79-4ac9-8f39-8e0d99b75c1c tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:31.802528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03f334-7d79-4ac9-8f39-8e0d99b75c1c tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:31.803005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03f334-7d79-4ac9-8f39-8e0d99b75c1c tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] PATH_INFO: `/v3/users/bec2eb8caa3644c7bb3a2da66b51b1a8/application_credentials/6045c5955444451aad53faeb8f715e7a` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:31.821645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03f334-7d79-4ac9-8f39-8e0d99b75c1c tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: Authorizing `identity:delete_application_credential(user_id=bec2eb8caa3644c7bb3a2da66b51b1a8, application_credential_id=6045c5955444451aad53faeb8f715e7a)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:31.823352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03f334-7d79-4ac9-8f39-8e0d99b75c1c tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:31.862776 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2643/5258] 10.222.0.30 () {58 vars in 1395 bytes} [Sun Sep 4 01:21:31 2022] DELETE /identity/v3/users/bec2eb8caa3644c7bb3a2da66b51b1a8/application_credentials/6045c5955444451aad53faeb8f715e7a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:31.864560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03f334-7d79-4ac9-8f39-8e0d99b75c1c tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:31.877557 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03f334-7d79-4ac9-8f39-8e0d99b75c1c tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:31.877728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366dde7-2225-4354-b71e-71522de04139 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:31.879320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366dde7-2225-4354-b71e-71522de04139 service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:31.882181 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633aa6bc-3a30-48c8-a51e-0e41bd31a1b1 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bec2eb8caa3644c7bb3a2da66b51b1a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7948369cbcb44ec1a9e93c3b53079387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:31.882998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633aa6bc-3a30-48c8-a51e-0e41bd31a1b1 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:31.883501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633aa6bc-3a30-48c8-a51e-0e41bd31a1b1 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:31.883791 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633aa6bc-3a30-48c8-a51e-0e41bd31a1b1 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] PATH_INFO: `/v3/users/bec2eb8caa3644c7bb3a2da66b51b1a8/application_credentials/3974171df35a4cc68f4a10133aa0e413` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:31.895081 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633aa6bc-3a30-48c8-a51e-0e41bd31a1b1 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: Authorizing `identity:delete_application_credential(user_id=bec2eb8caa3644c7bb3a2da66b51b1a8, application_credential_id=3974171df35a4cc68f4a10133aa0e413)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:31.896798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633aa6bc-3a30-48c8-a51e-0e41bd31a1b1 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:31.910166 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2616/5259] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:21:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:21:31.947249 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2644/5260] 10.222.0.30 () {58 vars in 1395 bytes} [Sun Sep 4 01:21:31 2022] DELETE /identity/v3/users/bec2eb8caa3644c7bb3a2da66b51b1a8/application_credentials/3974171df35a4cc68f4a10133aa0e413 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:31.952208 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366dde7-2225-4354-b71e-71522de04139 service cinder] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:31.970772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366dde7-2225-4354-b71e-71522de04139 service cinder] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:31.975350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94dadd2-3f15-43b0-85a0-e30a2e8e9831 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bec2eb8caa3644c7bb3a2da66b51b1a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7948369cbcb44ec1a9e93c3b53079387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:31.976002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94dadd2-3f15-43b0-85a0-e30a2e8e9831 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:31.976287 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94dadd2-3f15-43b0-85a0-e30a2e8e9831 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:31.977691 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94dadd2-3f15-43b0-85a0-e30a2e8e9831 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] PATH_INFO: `/v3/users/bec2eb8caa3644c7bb3a2da66b51b1a8/application_credentials` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:31.978534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94dadd2-3f15-43b0-85a0-e30a2e8e9831 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: Authorizing `identity:create_application_credential(user_id=bec2eb8caa3644c7bb3a2da66b51b1a8)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:31.979701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94dadd2-3f15-43b0-85a0-e30a2e8e9831 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:32.081733 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2617/5261] 10.222.0.30 () {60 vars in 1314 bytes} [Sun Sep 4 01:21:31 2022] POST /identity/v3/users/bec2eb8caa3644c7bb3a2da66b51b1a8/application_credentials => generated 789 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:32.082951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633aa6bc-3a30-48c8-a51e-0e41bd31a1b1 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:32.092919 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633aa6bc-3a30-48c8-a51e-0e41bd31a1b1 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:32.106143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b0f81-c331-4053-bca4-b0274e177c93 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bec2eb8caa3644c7bb3a2da66b51b1a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7948369cbcb44ec1a9e93c3b53079387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:32.106723 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b0f81-c331-4053-bca4-b0274e177c93 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:32.107000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b0f81-c331-4053-bca4-b0274e177c93 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:32.107279 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b0f81-c331-4053-bca4-b0274e177c93 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] PATH_INFO: `/v3/users/bec2eb8caa3644c7bb3a2da66b51b1a8/application_credentials` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:32.107954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b0f81-c331-4053-bca4-b0274e177c93 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: Authorizing `identity:create_application_credential(user_id=bec2eb8caa3644c7bb3a2da66b51b1a8)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:32.111905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b0f81-c331-4053-bca4-b0274e177c93 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:32.206063 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:32.328008 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2645/5262] 10.222.0.30 () {60 vars in 1314 bytes} [Sun Sep 4 01:21:32 2022] POST /identity/v3/users/bec2eb8caa3644c7bb3a2da66b51b1a8/application_credentials => generated 789 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:32.332266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94dadd2-3f15-43b0-85a0-e30a2e8e9831 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:32.369044 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94dadd2-3f15-43b0-85a0-e30a2e8e9831 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:32.376030 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acffe78-3008-47c1-a9ba-79453e469e45 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bec2eb8caa3644c7bb3a2da66b51b1a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7948369cbcb44ec1a9e93c3b53079387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:32.377422 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acffe78-3008-47c1-a9ba-79453e469e45 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:32.378615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acffe78-3008-47c1-a9ba-79453e469e45 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:32.379387 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acffe78-3008-47c1-a9ba-79453e469e45 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] PATH_INFO: `/v3/users/bec2eb8caa3644c7bb3a2da66b51b1a8/application_credentials` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:32.380430 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acffe78-3008-47c1-a9ba-79453e469e45 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: Adding query filter params (name=tempest-application_credential-2145953430) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:21:32.381089 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acffe78-3008-47c1-a9ba-79453e469e45 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: Authorizing `identity:list_application_credentials(user_id=bec2eb8caa3644c7bb3a2da66b51b1a8)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:32.383322 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acffe78-3008-47c1-a9ba-79453e469e45 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:32.411764 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2618/5263] 10.222.0.30 () {58 vars in 1386 bytes} [Sun Sep 4 01:21:32 2022] GET /identity/v3/users/bec2eb8caa3644c7bb3a2da66b51b1a8/application_credentials?name=tempest-application_credential-2145953430 => generated 887 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:21:32.413866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b0f81-c331-4053-bca4-b0274e177c93 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:32.426293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b0f81-c331-4053-bca4-b0274e177c93 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:32.433191 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a78736-68cd-4664-b515-69fdef9a7e87 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bec2eb8caa3644c7bb3a2da66b51b1a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7948369cbcb44ec1a9e93c3b53079387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:32.434091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a78736-68cd-4664-b515-69fdef9a7e87 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:32.435311 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a78736-68cd-4664-b515-69fdef9a7e87 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:32.435794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a78736-68cd-4664-b515-69fdef9a7e87 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] PATH_INFO: `/v3/users/bec2eb8caa3644c7bb3a2da66b51b1a8/application_credentials/873a6bffd6d54d1cbe49e6f26dc16579` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:32.451370 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a78736-68cd-4664-b515-69fdef9a7e87 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: Authorizing `identity:delete_application_credential(user_id=bec2eb8caa3644c7bb3a2da66b51b1a8, application_credential_id=873a6bffd6d54d1cbe49e6f26dc16579)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:32.453302 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a78736-68cd-4664-b515-69fdef9a7e87 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:32.489074 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2646/5264] 10.222.0.30 () {58 vars in 1395 bytes} [Sun Sep 4 01:21:32 2022] DELETE /identity/v3/users/bec2eb8caa3644c7bb3a2da66b51b1a8/application_credentials/873a6bffd6d54d1cbe49e6f26dc16579 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:32.490070 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acffe78-3008-47c1-a9ba-79453e469e45 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:32.519597 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acffe78-3008-47c1-a9ba-79453e469e45 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:32.531099 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d6862-305f-477e-bfda-2c55362adc49 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bec2eb8caa3644c7bb3a2da66b51b1a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7948369cbcb44ec1a9e93c3b53079387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:32.531659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d6862-305f-477e-bfda-2c55362adc49 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:32.531943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d6862-305f-477e-bfda-2c55362adc49 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:32.532222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d6862-305f-477e-bfda-2c55362adc49 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] PATH_INFO: `/v3/users/bec2eb8caa3644c7bb3a2da66b51b1a8/application_credentials/a675796bc3cf4bb4a2200884edc5ad8e` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:32.542545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d6862-305f-477e-bfda-2c55362adc49 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: Authorizing `identity:delete_application_credential(user_id=bec2eb8caa3644c7bb3a2da66b51b1a8, application_credential_id=a675796bc3cf4bb4a2200884edc5ad8e)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:32.544148 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d6862-305f-477e-bfda-2c55362adc49 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:32.547692 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:32.569670 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2619/5265] 10.222.0.30 () {58 vars in 1395 bytes} [Sun Sep 4 01:21:32 2022] DELETE /identity/v3/users/bec2eb8caa3644c7bb3a2da66b51b1a8/application_credentials/a675796bc3cf4bb4a2200884edc5ad8e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:32.575868 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a78736-68cd-4664-b515-69fdef9a7e87 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:32.676350 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a78736-68cd-4664-b515-69fdef9a7e87 tempest-ApplicationCredentialsV3Test-521583299 tempest-ApplicationCredentialsV3Test-521583299-project] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:32.683869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d9881-bf56-4328-ae56-adbbba2e3bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:32.684521 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d9881-bf56-4328-ae56-adbbba2e3bc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:32.685702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d9881-bf56-4328-ae56-adbbba2e3bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:32.686034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d9881-bf56-4328-ae56-adbbba2e3bc3 admin admin] PATH_INFO: `/v3/users/bec2eb8caa3644c7bb3a2da66b51b1a8` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:32.687273 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d9881-bf56-4328-ae56-adbbba2e3bc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bec2eb8caa3644c7bb3a2da66b51b1a8)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:32.689391 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d9881-bf56-4328-ae56-adbbba2e3bc3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:32.752349 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-522d9881-bf56-4328-ae56-adbbba2e3bc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bec2eb8caa3644c7bb3a2da66b51b1a8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:32.753048 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-522d9881-bf56-4328-ae56-adbbba2e3bc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bec2eb8caa3644c7bb3a2da66b51b1a8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:32.760428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-522d9881-bf56-4328-ae56-adbbba2e3bc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bec2eb8caa3644c7bb3a2da66b51b1a8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:32.768354 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-522d9881-bf56-4328-ae56-adbbba2e3bc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bec2eb8caa3644c7bb3a2da66b51b1a8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:32.769137 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-522d9881-bf56-4328-ae56-adbbba2e3bc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bec2eb8caa3644c7bb3a2da66b51b1a8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:32.801554 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2647/5266] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:21:32 2022] DELETE /identity/v3/users/bec2eb8caa3644c7bb3a2da66b51b1a8 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:32.805924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799abff4-2b1e-4f58-b1d5-6da3a70cde4c None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:32.806212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799abff4-2b1e-4f58-b1d5-6da3a70cde4c None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:32.806491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799abff4-2b1e-4f58-b1d5-6da3a70cde4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:32.830786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-799abff4-2b1e-4f58-b1d5-6da3a70cde4c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:32.832224 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-799abff4-2b1e-4f58-b1d5-6da3a70cde4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:32.949784 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2620/5267] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:32.957703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d9881-bf56-4328-ae56-adbbba2e3bc3 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:32.959788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-522d9881-bf56-4328-ae56-adbbba2e3bc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:32.984248 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=85,keystone:INSERT=3,keystone:DELETE=12 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:33.045911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d9881-bf56-4328-ae56-adbbba2e3bc3 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:33.049622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11a577-b400-492d-b1b1-a16a81fd3971 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:33.050245 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11a577-b400-492d-b1b1-a16a81fd3971 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:33.050527 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11a577-b400-492d-b1b1-a16a81fd3971 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:33.050802 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11a577-b400-492d-b1b1-a16a81fd3971 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:33.062647 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11a577-b400-492d-b1b1-a16a81fd3971 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:33.064512 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11a577-b400-492d-b1b1-a16a81fd3971 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:33.075350 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2648/5268] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:21:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:21:33.678631 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799abff4-2b1e-4f58-b1d5-6da3a70cde4c None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:33.680752 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-799abff4-2b1e-4f58-b1d5-6da3a70cde4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:33.694143 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799abff4-2b1e-4f58-b1d5-6da3a70cde4c None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:33.720895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d3007-8948-4715-beb0-3be343d1ff54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:33.721648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d3007-8948-4715-beb0-3be343d1ff54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:33.721936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d3007-8948-4715-beb0-3be343d1ff54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:33.722238 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d3007-8948-4715-beb0-3be343d1ff54 admin admin] PATH_INFO: `/v3/projects/7948369cbcb44ec1a9e93c3b53079387` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:33.723632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d3007-8948-4715-beb0-3be343d1ff54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7948369cbcb44ec1a9e93c3b53079387)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:33.725591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d3007-8948-4715-beb0-3be343d1ff54 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:33.855366 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f42d3007-8948-4715-beb0-3be343d1ff54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7948369cbcb44ec1a9e93c3b53079387', 'request_id': 'req-f42d3007-8948-4715-beb0-3be343d1ff54'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:33.878772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f42d3007-8948-4715-beb0-3be343d1ff54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7948369cbcb44ec1a9e93c3b53079387', 'request_id': 'req-f42d3007-8948-4715-beb0-3be343d1ff54'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:33.887564 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f42d3007-8948-4715-beb0-3be343d1ff54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7948369cbcb44ec1a9e93c3b53079387', 'request_id': 'req-f42d3007-8948-4715-beb0-3be343d1ff54'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:33.910313 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f42d3007-8948-4715-beb0-3be343d1ff54 admin admin] The token cache is being invalidate because project 7948369cbcb44ec1a9e93c3b53079387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:33.910967 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f42d3007-8948-4715-beb0-3be343d1ff54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:33.912242 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f42d3007-8948-4715-beb0-3be343d1ff54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:33.915253 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2621/5269] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:21:33 2022] DELETE /identity/v3/projects/7948369cbcb44ec1a9e93c3b53079387 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:33.920757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabc887-c853-49b4-a4ba-f6d1676e6250 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:33.922184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabc887-c853-49b4-a4ba-f6d1676e6250 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:33.922549 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabc887-c853-49b4-a4ba-f6d1676e6250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:33.958219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-7cabc887-c853-49b4-a4ba-f6d1676e6250 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:33.962994 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7cabc887-c853-49b4-a4ba-f6d1676e6250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:34.117485 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2649/5270] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:34.123682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff228a-367e-4961-8aa8-13eee639f4bc None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:34.124029 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff228a-367e-4961-8aa8-13eee639f4bc None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:34.124313 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff228a-367e-4961-8aa8-13eee639f4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:34.178839 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a4ff228a-367e-4961-8aa8-13eee639f4bc None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:34.183990 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a4ff228a-367e-4961-8aa8-13eee639f4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:34.211018 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2622/5271] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:34.212721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabc887-c853-49b4-a4ba-f6d1676e6250 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:34.226759 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabc887-c853-49b4-a4ba-f6d1676e6250 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:34.233945 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7fc4e-1c79-4a34-b8b1-587b0ac79eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:34.235388 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7fc4e-1c79-4a34-b8b1-587b0ac79eca admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:34.235684 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7fc4e-1c79-4a34-b8b1-587b0ac79eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:34.236890 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7fc4e-1c79-4a34-b8b1-587b0ac79eca admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:34.237540 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7fc4e-1c79-4a34-b8b1-587b0ac79eca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:21:34.237855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7fc4e-1c79-4a34-b8b1-587b0ac79eca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:34.240183 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7fc4e-1c79-4a34-b8b1-587b0ac79eca admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:34.263215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff228a-367e-4961-8aa8-13eee639f4bc None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:34.273049 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2650/5272] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:21:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:21:34.276225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff228a-367e-4961-8aa8-13eee639f4bc None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:34.282185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8429f4-ac97-4a64-85f7-d9421f930797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:34.283086 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8429f4-ac97-4a64-85f7-d9421f930797 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:34.283375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8429f4-ac97-4a64-85f7-d9421f930797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:34.283650 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8429f4-ac97-4a64-85f7-d9421f930797 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:34.284290 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8429f4-ac97-4a64-85f7-d9421f930797 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:34.286517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8429f4-ac97-4a64-85f7-d9421f930797 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:34.328558 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2623/5273] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:21:34 2022] POST /identity/v3/projects => generated 379 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:34.332894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7fc4e-1c79-4a34-b8b1-587b0ac79eca admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:34.345252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7fc4e-1c79-4a34-b8b1-587b0ac79eca admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:34.442197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144121f-7f67-45e0-b5b6-b0dbe4500451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:34.442933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144121f-7f67-45e0-b5b6-b0dbe4500451 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:34.443314 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144121f-7f67-45e0-b5b6-b0dbe4500451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:34.443690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144121f-7f67-45e0-b5b6-b0dbe4500451 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:34.444438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144121f-7f67-45e0-b5b6-b0dbe4500451 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:34.446550 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144121f-7f67-45e0-b5b6-b0dbe4500451 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:34.483628 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2651/5274] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:21:34 2022] POST /identity/v3/users => generated 290 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:21:34.488050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8429f4-ac97-4a64-85f7-d9421f930797 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:34.502306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8429f4-ac97-4a64-85f7-d9421f930797 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:34.508125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cd380-d849-4a2d-91af-35158e76fa4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:34.508843 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cd380-d849-4a2d-91af-35158e76fa4f admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:34.509218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cd380-d849-4a2d-91af-35158e76fa4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:34.510236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cd380-d849-4a2d-91af-35158e76fa4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:34.510989 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731cd380-d849-4a2d-91af-35158e76fa4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:34.512687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731cd380-d849-4a2d-91af-35158e76fa4f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:34.527598 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2624/5275] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:21:34.531693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144121f-7f67-45e0-b5b6-b0dbe4500451 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:34.544068 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144121f-7f67-45e0-b5b6-b0dbe4500451 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:34.557161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989427b1-ff9e-46c9-8b14-e06cdd3e7738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:34.557869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989427b1-ff9e-46c9-8b14-e06cdd3e7738 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:34.558146 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989427b1-ff9e-46c9-8b14-e06cdd3e7738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:34.558422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989427b1-ff9e-46c9-8b14-e06cdd3e7738 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:34.559086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989427b1-ff9e-46c9-8b14-e06cdd3e7738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:34.561123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989427b1-ff9e-46c9-8b14-e06cdd3e7738 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:34.573538 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2652/5276] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:34.577137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cd380-d849-4a2d-91af-35158e76fa4f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:34.588821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cd380-d849-4a2d-91af-35158e76fa4f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:34.594032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de10805-0e91-481d-a735-34c8b49009ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:34.594768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de10805-0e91-481d-a735-34c8b49009ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:34.594982 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de10805-0e91-481d-a735-34c8b49009ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:34.595260 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de10805-0e91-481d-a735-34c8b49009ca admin admin] PATH_INFO: `/v3/projects/e43823b54d534e72a479e2b4ee7bbf81/users/4b57755b5bc3437aa1ddedb3842c7aa5/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:34.619786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de10805-0e91-481d-a735-34c8b49009ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=e43823b54d534e72a479e2b4ee7bbf81, user_id=4b57755b5bc3437aa1ddedb3842c7aa5, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:34.624303 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de10805-0e91-481d-a735-34c8b49009ca admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:34.673939 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2625/5277] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:21:34 2022] PUT /identity/v3/projects/e43823b54d534e72a479e2b4ee7bbf81/users/4b57755b5bc3437aa1ddedb3842c7aa5/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:34.764856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b89186-31a5-4b5d-b354-5f5a12cdb9eb None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:34.765274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b89186-31a5-4b5d-b354-5f5a12cdb9eb None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:34.765411 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b89186-31a5-4b5d-b354-5f5a12cdb9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:34.845035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c6b89186-31a5-4b5d-b354-5f5a12cdb9eb None None] MFA Rules not processed for user `4b57755b5bc3437aa1ddedb3842c7aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:34.846636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c6b89186-31a5-4b5d-b354-5f5a12cdb9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:34.855418 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:34.948404 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2653/5278] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:34.949271 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de10805-0e91-481d-a735-34c8b49009ca admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:34.987375 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:35.050338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de10805-0e91-481d-a735-34c8b49009ca admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:35.055747 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279b21e-bfc9-48cf-a82a-6f4eac8e8588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:35.056412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279b21e-bfc9-48cf-a82a-6f4eac8e8588 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:35.056701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279b21e-bfc9-48cf-a82a-6f4eac8e8588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:35.057163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279b21e-bfc9-48cf-a82a-6f4eac8e8588 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:35.057648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279b21e-bfc9-48cf-a82a-6f4eac8e8588 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:35.059557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279b21e-bfc9-48cf-a82a-6f4eac8e8588 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:35.114374 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2626/5279] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:21:34 2022] POST /identity/v3/projects => generated 379 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:35.116068 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b89186-31a5-4b5d-b354-5f5a12cdb9eb None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:35.129113 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b89186-31a5-4b5d-b354-5f5a12cdb9eb None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:35.204375 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2fe68f-c761-45f8-aff1-aa228b86a315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:35.205012 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fe68f-c761-45f8-aff1-aa228b86a315 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:35.205294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fe68f-c761-45f8-aff1-aa228b86a315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:35.205610 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fe68f-c761-45f8-aff1-aa228b86a315 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:35.206452 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2fe68f-c761-45f8-aff1-aa228b86a315 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:35.208446 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2fe68f-c761-45f8-aff1-aa228b86a315 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:35.241471 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2654/5280] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:21:35 2022] POST /identity/v3/users => generated 290 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:35.245304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279b21e-bfc9-48cf-a82a-6f4eac8e8588 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:35.261671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279b21e-bfc9-48cf-a82a-6f4eac8e8588 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:35.271121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6d95e-566b-4f99-a8ca-c7c20b8379fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:35.272414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6d95e-566b-4f99-a8ca-c7c20b8379fb admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:35.272955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6d95e-566b-4f99-a8ca-c7c20b8379fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:35.273631 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6d95e-566b-4f99-a8ca-c7c20b8379fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:35.274296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd6d95e-566b-4f99-a8ca-c7c20b8379fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:35.277151 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd6d95e-566b-4f99-a8ca-c7c20b8379fb admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:35.292364 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2627/5281] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:35.293679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2fe68f-c761-45f8-aff1-aa228b86a315 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:35.304196 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2fe68f-c761-45f8-aff1-aa228b86a315 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:35.310068 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586601f-76eb-4970-b8a2-8b9c55a0c914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:35.310680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586601f-76eb-4970-b8a2-8b9c55a0c914 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:35.310961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586601f-76eb-4970-b8a2-8b9c55a0c914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:35.311233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586601f-76eb-4970-b8a2-8b9c55a0c914 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:35.311873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586601f-76eb-4970-b8a2-8b9c55a0c914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:35.314879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586601f-76eb-4970-b8a2-8b9c55a0c914 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:35.333365 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2655/5282] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:35.333543 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6d95e-566b-4f99-a8ca-c7c20b8379fb admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:35.346716 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6d95e-566b-4f99-a8ca-c7c20b8379fb admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:35.353291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c341b05-064e-474d-9949-941bee451b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:35.354123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c341b05-064e-474d-9949-941bee451b34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:35.354400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c341b05-064e-474d-9949-941bee451b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:35.354668 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c341b05-064e-474d-9949-941bee451b34 admin admin] PATH_INFO: `/v3/projects/fa462f4d3eb84484b542d62973087b15/users/d78877f4e9a4445c98769bdd37c079f6/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:35.383804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c341b05-064e-474d-9949-941bee451b34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa462f4d3eb84484b542d62973087b15, user_id=d78877f4e9a4445c98769bdd37c079f6, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:35.388220 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c341b05-064e-474d-9949-941bee451b34 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:35.420931 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2628/5283] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:21:35 2022] PUT /identity/v3/projects/fa462f4d3eb84484b542d62973087b15/users/d78877f4e9a4445c98769bdd37c079f6/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:21:35.427400 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646f158-c1f6-48a3-be50-300875fd47e4 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:35.427902 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646f158-c1f6-48a3-be50-300875fd47e4 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:35.428344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646f158-c1f6-48a3-be50-300875fd47e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:35.473761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-7646f158-c1f6-48a3-be50-300875fd47e4 None None] MFA Rules not processed for user `d78877f4e9a4445c98769bdd37c079f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:35.475276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7646f158-c1f6-48a3-be50-300875fd47e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:35.578559 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2656/5284] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:35.579613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c341b05-064e-474d-9949-941bee451b34 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:35.666699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c341b05-064e-474d-9949-941bee451b34 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:35.671941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacd93c-1542-4b67-a116-f0118e6e0b0f tempest-IdentityV3ProjectsTest-568098493 tempest-IdentityV3ProjectsTest-568098493-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b57755b5bc3437aa1ddedb3842c7aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e43823b54d534e72a479e2b4ee7bbf81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:35.672860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacd93c-1542-4b67-a116-f0118e6e0b0f tempest-IdentityV3ProjectsTest-568098493 tempest-IdentityV3ProjectsTest-568098493-project] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:35.674049 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacd93c-1542-4b67-a116-f0118e6e0b0f tempest-IdentityV3ProjectsTest-568098493 tempest-IdentityV3ProjectsTest-568098493-project] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:35.675352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacd93c-1542-4b67-a116-f0118e6e0b0f tempest-IdentityV3ProjectsTest-568098493 tempest-IdentityV3ProjectsTest-568098493-project] PATH_INFO: `/v3/users/4b57755b5bc3437aa1ddedb3842c7aa5/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:35.677525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aacd93c-1542-4b67-a116-f0118e6e0b0f tempest-IdentityV3ProjectsTest-568098493 tempest-IdentityV3ProjectsTest-568098493-project] RBAC: Authorizing `identity:list_user_projects(user_id=4b57755b5bc3437aa1ddedb3842c7aa5)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:35.680248 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aacd93c-1542-4b67-a116-f0118e6e0b0f tempest-IdentityV3ProjectsTest-568098493 tempest-IdentityV3ProjectsTest-568098493-project] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:35.786814 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b3428-75d4-449f-b673-43ee41d64876 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:35.787106 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b3428-75d4-449f-b673-43ee41d64876 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:35.787798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b3428-75d4-449f-b673-43ee41d64876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:35.792704 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2629/5285] 10.222.0.30 () {58 vars in 1248 bytes} [Sun Sep 4 01:21:35 2022] GET /identity/v3/users/4b57755b5bc3437aa1ddedb3842c7aa5/projects => generated 515 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:21:35.816027 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:35.833365 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-3a1b3428-75d4-449f-b673-43ee41d64876 None None] MFA Rules not processed for user `4b57755b5bc3437aa1ddedb3842c7aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:35.835380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3a1b3428-75d4-449f-b673-43ee41d64876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:35.843738 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2657/5286] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:21:35.848005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996ff8c-5c59-4ada-ab21-af21d001f515 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:35.848385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996ff8c-5c59-4ada-ab21-af21d001f515 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:35.848643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996ff8c-5c59-4ada-ab21-af21d001f515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:35.874374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-7996ff8c-5c59-4ada-ab21-af21d001f515 None None] MFA Rules not processed for user `4b57755b5bc3437aa1ddedb3842c7aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:35.876550 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7996ff8c-5c59-4ada-ab21-af21d001f515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:35.910610 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:35.946869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.models.token_model [None req-7996ff8c-5c59-4ada-ab21-af21d001f515 None None] User 4b57755b5bc3437aa1ddedb3842c7aa5 has no access to project fa462f4d3eb84484b542d62973087b15 {{(pid=81825) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Sep 04 01:21:35.952115 n-d-master-1 devstack@keystone.service[81825]: WARNING keystone.server.flask.application [None req-7996ff8c-5c59-4ada-ab21-af21d001f515 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.30: keystone.exception.Unauthorized: The request you have made requires authentication. Sep 04 01:21:35.953089 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2630/5287] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:35 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 106 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Sep 04 01:21:35.959204 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b3428-75d4-449f-b673-43ee41d64876 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:36.062486 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b3428-75d4-449f-b673-43ee41d64876 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:36.068129 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641ec76-dc4a-4e35-9519-0eb66ace4359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:36.068783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641ec76-dc4a-4e35-9519-0eb66ace4359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:36.069067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641ec76-dc4a-4e35-9519-0eb66ace4359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:36.069878 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641ec76-dc4a-4e35-9519-0eb66ace4359 admin admin] PATH_INFO: `/v3/users/4b57755b5bc3437aa1ddedb3842c7aa5` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:36.071411 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8641ec76-dc4a-4e35-9519-0eb66ace4359 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b57755b5bc3437aa1ddedb3842c7aa5)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:36.075227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8641ec76-dc4a-4e35-9519-0eb66ace4359 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:36.162607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8641ec76-dc4a-4e35-9519-0eb66ace4359 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b57755b5bc3437aa1ddedb3842c7aa5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:36.165853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8641ec76-dc4a-4e35-9519-0eb66ace4359 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b57755b5bc3437aa1ddedb3842c7aa5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:36.182513 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8641ec76-dc4a-4e35-9519-0eb66ace4359 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b57755b5bc3437aa1ddedb3842c7aa5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:36.204454 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8641ec76-dc4a-4e35-9519-0eb66ace4359 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b57755b5bc3437aa1ddedb3842c7aa5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:36.205188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8641ec76-dc4a-4e35-9519-0eb66ace4359 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b57755b5bc3437aa1ddedb3842c7aa5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:36.246524 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2658/5288] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:21:35 2022] DELETE /identity/v3/users/4b57755b5bc3437aa1ddedb3842c7aa5 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:36.251030 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d7efd-5c9d-45c2-a13d-3e5c95da4375 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:36.251796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d7efd-5c9d-45c2-a13d-3e5c95da4375 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:36.252334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d7efd-5c9d-45c2-a13d-3e5c95da4375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:36.305873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-120d7efd-5c9d-45c2-a13d-3e5c95da4375 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:36.307274 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-120d7efd-5c9d-45c2-a13d-3e5c95da4375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:36.437383 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2631/5289] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:36.527586 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641ec76-dc4a-4e35-9519-0eb66ace4359 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:36.530853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8641ec76-dc4a-4e35-9519-0eb66ace4359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:36.636085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641ec76-dc4a-4e35-9519-0eb66ace4359 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:36.650352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47870228-c943-4f60-b22b-3dac5b18b83d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:36.651264 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47870228-c943-4f60-b22b-3dac5b18b83d service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:36.651742 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47870228-c943-4f60-b22b-3dac5b18b83d service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:36.652189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47870228-c943-4f60-b22b-3dac5b18b83d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:36.665598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47870228-c943-4f60-b22b-3dac5b18b83d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:36.667499 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47870228-c943-4f60-b22b-3dac5b18b83d service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:36.680140 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2659/5290] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:21:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:21:38.385192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d7efd-5c9d-45c2-a13d-3e5c95da4375 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:38.386752 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-120d7efd-5c9d-45c2-a13d-3e5c95da4375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:38.410031 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d7efd-5c9d-45c2-a13d-3e5c95da4375 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:38.444458 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c56380-5fe1-44c9-b030-f7363442e7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:38.450044 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c56380-5fe1-44c9-b030-f7363442e7a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:38.450245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c56380-5fe1-44c9-b030-f7363442e7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:38.450545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c56380-5fe1-44c9-b030-f7363442e7a3 admin admin] PATH_INFO: `/v3/projects/e43823b54d534e72a479e2b4ee7bbf81` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:38.454797 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c56380-5fe1-44c9-b030-f7363442e7a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e43823b54d534e72a479e2b4ee7bbf81)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:38.462784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c56380-5fe1-44c9-b030-f7363442e7a3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:38.581288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-70c56380-5fe1-44c9-b030-f7363442e7a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e43823b54d534e72a479e2b4ee7bbf81', 'request_id': 'req-70c56380-5fe1-44c9-b030-f7363442e7a3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:38.594928 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-70c56380-5fe1-44c9-b030-f7363442e7a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e43823b54d534e72a479e2b4ee7bbf81', 'request_id': 'req-70c56380-5fe1-44c9-b030-f7363442e7a3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:38.616465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-70c56380-5fe1-44c9-b030-f7363442e7a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e43823b54d534e72a479e2b4ee7bbf81', 'request_id': 'req-70c56380-5fe1-44c9-b030-f7363442e7a3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:38.640452 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-70c56380-5fe1-44c9-b030-f7363442e7a3 admin admin] The token cache is being invalidate because project e43823b54d534e72a479e2b4ee7bbf81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:38.641392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-70c56380-5fe1-44c9-b030-f7363442e7a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:38.641787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-70c56380-5fe1-44c9-b030-f7363442e7a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:38.644023 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2632/5291] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:21:38 2022] DELETE /identity/v3/projects/e43823b54d534e72a479e2b4ee7bbf81 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:38.647978 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47870228-c943-4f60-b22b-3dac5b18b83d service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:38.658663 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47870228-c943-4f60-b22b-3dac5b18b83d service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:38.703921 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:38.795914 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c9e5b-5808-472a-9e7a-083b6aef7c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:38.796868 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c9e5b-5808-472a-9e7a-083b6aef7c9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:38.797328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c9e5b-5808-472a-9e7a-083b6aef7c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:38.799175 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c9e5b-5808-472a-9e7a-083b6aef7c9a admin admin] PATH_INFO: `/v3/users/d78877f4e9a4445c98769bdd37c079f6` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:38.801658 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c9e5b-5808-472a-9e7a-083b6aef7c9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d78877f4e9a4445c98769bdd37c079f6)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:38.804712 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c9e5b-5808-472a-9e7a-083b6aef7c9a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:38.915318 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d72c9e5b-5808-472a-9e7a-083b6aef7c9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd78877f4e9a4445c98769bdd37c079f6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:38.916555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d72c9e5b-5808-472a-9e7a-083b6aef7c9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd78877f4e9a4445c98769bdd37c079f6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:38.929106 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d72c9e5b-5808-472a-9e7a-083b6aef7c9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd78877f4e9a4445c98769bdd37c079f6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:38.953202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d72c9e5b-5808-472a-9e7a-083b6aef7c9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd78877f4e9a4445c98769bdd37c079f6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:38.955421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d72c9e5b-5808-472a-9e7a-083b6aef7c9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd78877f4e9a4445c98769bdd37c079f6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:38.986916 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2660/5292] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:21:38 2022] DELETE /identity/v3/users/d78877f4e9a4445c98769bdd37c079f6 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:39.816667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c56380-5fe1-44c9-b030-f7363442e7a3 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:39.818297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-70c56380-5fe1-44c9-b030-f7363442e7a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:39.855705 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c56380-5fe1-44c9-b030-f7363442e7a3 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:39.958842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be4220-6a04-485b-bec7-902ec0527f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:39.960297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be4220-6a04-485b-bec7-902ec0527f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:39.961175 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be4220-6a04-485b-bec7-902ec0527f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:39.961697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be4220-6a04-485b-bec7-902ec0527f98 admin admin] PATH_INFO: `/v3/projects/fa462f4d3eb84484b542d62973087b15` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:39.963301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be4220-6a04-485b-bec7-902ec0527f98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa462f4d3eb84484b542d62973087b15)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:39.966123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be4220-6a04-485b-bec7-902ec0527f98 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:39.992617 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:40.108071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e4be4220-6a04-485b-bec7-902ec0527f98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa462f4d3eb84484b542d62973087b15', 'request_id': 'req-e4be4220-6a04-485b-bec7-902ec0527f98'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:40.140093 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e4be4220-6a04-485b-bec7-902ec0527f98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa462f4d3eb84484b542d62973087b15', 'request_id': 'req-e4be4220-6a04-485b-bec7-902ec0527f98'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:40.148460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e4be4220-6a04-485b-bec7-902ec0527f98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa462f4d3eb84484b542d62973087b15', 'request_id': 'req-e4be4220-6a04-485b-bec7-902ec0527f98'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:40.166830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e4be4220-6a04-485b-bec7-902ec0527f98 admin admin] The token cache is being invalidate because project fa462f4d3eb84484b542d62973087b15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:40.167383 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e4be4220-6a04-485b-bec7-902ec0527f98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:40.168843 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e4be4220-6a04-485b-bec7-902ec0527f98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:40.174777 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2633/5293] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:21:39 2022] DELETE /identity/v3/projects/fa462f4d3eb84484b542d62973087b15 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:40.176272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363461f8-b80d-4d65-aa1e-892bb8d673b5 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:40.176730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363461f8-b80d-4d65-aa1e-892bb8d673b5 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:40.176813 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363461f8-b80d-4d65-aa1e-892bb8d673b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:40.214435 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-363461f8-b80d-4d65-aa1e-892bb8d673b5 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:40.215917 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-363461f8-b80d-4d65-aa1e-892bb8d673b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:40.365961 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2661/5294] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:40.379251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9e643-e9f3-437a-bfdb-302d2a14d7e5 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:40.380674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9e643-e9f3-437a-bfdb-302d2a14d7e5 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:40.380674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9e643-e9f3-437a-bfdb-302d2a14d7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:40.412151 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-86a9e643-e9f3-437a-bfdb-302d2a14d7e5 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:40.416873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-86a9e643-e9f3-437a-bfdb-302d2a14d7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:40.470565 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2634/5295] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:40.475074 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363461f8-b80d-4d65-aa1e-892bb8d673b5 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:40.487147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363461f8-b80d-4d65-aa1e-892bb8d673b5 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:40.495649 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23de07b-f16d-4276-b604-ec236c91d6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:40.497328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23de07b-f16d-4276-b604-ec236c91d6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:40.497916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23de07b-f16d-4276-b604-ec236c91d6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:40.498414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23de07b-f16d-4276-b604-ec236c91d6a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:40.499263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23de07b-f16d-4276-b604-ec236c91d6a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:21:40.499838 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23de07b-f16d-4276-b604-ec236c91d6a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:40.501993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23de07b-f16d-4276-b604-ec236c91d6a9 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:40.538016 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2662/5296] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:21:40.542745 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9e643-e9f3-437a-bfdb-302d2a14d7e5 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:40.553185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9e643-e9f3-437a-bfdb-302d2a14d7e5 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:40.559764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0340f-678e-4644-98f6-d1d838866b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:40.560365 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0340f-678e-4644-98f6-d1d838866b9e admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:40.560646 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0340f-678e-4644-98f6-d1d838866b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:40.560921 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0340f-678e-4644-98f6-d1d838866b9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:40.561665 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab0340f-678e-4644-98f6-d1d838866b9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:40.565556 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab0340f-678e-4644-98f6-d1d838866b9e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:40.613695 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2635/5297] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:21:40 2022] POST /identity/v3/projects => generated 397 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:40.617113 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23de07b-f16d-4276-b604-ec236c91d6a9 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:40.639179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23de07b-f16d-4276-b604-ec236c91d6a9 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:40.690988 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:40.762314 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8ff48-1e79-4832-8750-771c590eedca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:40.763127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8ff48-1e79-4832-8750-771c590eedca admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:40.763509 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8ff48-1e79-4832-8750-771c590eedca admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:40.763888 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8ff48-1e79-4832-8750-771c590eedca admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:40.764642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c8ff48-1e79-4832-8750-771c590eedca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:40.766727 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c8ff48-1e79-4832-8750-771c590eedca admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:40.779251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee89d8-50b8-4cf9-9a6b-d581e5985b96 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:40.779683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee89d8-50b8-4cf9-9a6b-d581e5985b96 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:40.780058 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee89d8-50b8-4cf9-9a6b-d581e5985b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:40.815531 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-14ee89d8-50b8-4cf9-9a6b-d581e5985b96 None None] MFA Rules not processed for user `ffecd714d4dc4c05a908dd59d7ba912c`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:40.818706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-14ee89d8-50b8-4cf9-9a6b-d581e5985b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:40.819315 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2663/5298] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:21:40 2022] POST /identity/v3/users => generated 305 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:40.822830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8ff48-1e79-4832-8750-771c590eedca admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:40.840316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8ff48-1e79-4832-8750-771c590eedca admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:40.850502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b452c-94fb-457f-816e-bddfb183798d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:40.851991 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b452c-94fb-457f-816e-bddfb183798d admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:40.852371 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b452c-94fb-457f-816e-bddfb183798d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:40.852745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b452c-94fb-457f-816e-bddfb183798d admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:40.853529 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b452c-94fb-457f-816e-bddfb183798d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:40.870115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b452c-94fb-457f-816e-bddfb183798d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:40.881480 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2664/5299] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:21:40.886731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b452c-94fb-457f-816e-bddfb183798d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:40.907282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b452c-94fb-457f-816e-bddfb183798d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:40.915808 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80262f2e-1aa1-4819-8382-7ab112003aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:40.916621 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80262f2e-1aa1-4819-8382-7ab112003aec admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:40.917005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80262f2e-1aa1-4819-8382-7ab112003aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:40.917376 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80262f2e-1aa1-4819-8382-7ab112003aec admin admin] PATH_INFO: `/v3/projects/1f7557c0897b48389553ea0a0f605df8/users/890c5516179849dd840a68aaa0fefa91/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:40.943151 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80262f2e-1aa1-4819-8382-7ab112003aec admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f7557c0897b48389553ea0a0f605df8, user_id=890c5516179849dd840a68aaa0fefa91, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:40.946776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80262f2e-1aa1-4819-8382-7ab112003aec admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:40.953894 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2636/5300] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:21:40.970388 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2665/5301] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:21:40 2022] PUT /identity/v3/projects/1f7557c0897b48389553ea0a0f605df8/users/890c5516179849dd840a68aaa0fefa91/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:21:40.976472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee89d8-50b8-4cf9-9a6b-d581e5985b96 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:41.009530 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee89d8-50b8-4cf9-9a6b-d581e5985b96 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:41.110613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3716b-bc44-4309-a592-4acbcd192af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:41.111541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3716b-bc44-4309-a592-4acbcd192af1 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:41.112071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3716b-bc44-4309-a592-4acbcd192af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:41.112504 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3716b-bc44-4309-a592-4acbcd192af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:41.113790 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc3716b-bc44-4309-a592-4acbcd192af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:41.115942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc3716b-bc44-4309-a592-4acbcd192af1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:41.129881 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2637/5302] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:41.134399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80262f2e-1aa1-4819-8382-7ab112003aec admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:41.150636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80262f2e-1aa1-4819-8382-7ab112003aec admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:41.156030 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67078be1-e7a9-4411-9730-45533c10727c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:41.156808 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67078be1-e7a9-4411-9730-45533c10727c admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:41.157191 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67078be1-e7a9-4411-9730-45533c10727c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:41.157599 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67078be1-e7a9-4411-9730-45533c10727c admin admin] PATH_INFO: `/v3/projects/1f7557c0897b48389553ea0a0f605df8/users/890c5516179849dd840a68aaa0fefa91/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:41.160006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67078be1-e7a9-4411-9730-45533c10727c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f7557c0897b48389553ea0a0f605df8, user_id=890c5516179849dd840a68aaa0fefa91, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:41.173499 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67078be1-e7a9-4411-9730-45533c10727c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:41.198620 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2666/5303] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:21:41 2022] PUT /identity/v3/projects/1f7557c0897b48389553ea0a0f605df8/users/890c5516179849dd840a68aaa0fefa91/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:41.226757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a094f06-0b50-446f-8c8f-65a61a732415 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:41.227047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a094f06-0b50-446f-8c8f-65a61a732415 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:41.227321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a094f06-0b50-446f-8c8f-65a61a732415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:41.249330 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:41.285210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-7a094f06-0b50-446f-8c8f-65a61a732415 None None] MFA Rules not processed for user `890c5516179849dd840a68aaa0fefa91`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:41.286939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7a094f06-0b50-446f-8c8f-65a61a732415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:41.420651 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2638/5304] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:41 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:41.422569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67078be1-e7a9-4411-9730-45533c10727c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:41.514393 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a094f06-0b50-446f-8c8f-65a61a732415 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:41.516265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7a094f06-0b50-446f-8c8f-65a61a732415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:41.560299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67078be1-e7a9-4411-9730-45533c10727c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:41.594510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5fa009-499b-4ef6-aa79-d436f68744d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:41.596283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fa009-499b-4ef6-aa79-d436f68744d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:41.596944 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fa009-499b-4ef6-aa79-d436f68744d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:41.597239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fa009-499b-4ef6-aa79-d436f68744d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:41.602323 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5fa009-499b-4ef6-aa79-d436f68744d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:41.616290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5fa009-499b-4ef6-aa79-d436f68744d4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:41.676336 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a094f06-0b50-446f-8c8f-65a61a732415 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:41.682942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305d408-ed29-4bfe-aa49-acff6c9efd37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:41.683774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305d408-ed29-4bfe-aa49-acff6c9efd37 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:41.684204 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305d408-ed29-4bfe-aa49-acff6c9efd37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:41.684575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305d408-ed29-4bfe-aa49-acff6c9efd37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:41.686645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4305d408-ed29-4bfe-aa49-acff6c9efd37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:41.691381 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2667/5305] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:21:41 2022] POST /identity/v3/projects => generated 397 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:41.694430 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5fa009-499b-4ef6-aa79-d436f68744d4 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:41.725212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4305d408-ed29-4bfe-aa49-acff6c9efd37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:41.733607 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4305d408-ed29-4bfe-aa49-acff6c9efd37 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:41.753334 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2639/5306] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:21:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:21:41.857703 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:41.867231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5fa009-499b-4ef6-aa79-d436f68744d4 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:41.880091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf7cc3-940a-46d7-9b38-d198fd5ff1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:41.881333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf7cc3-940a-46d7-9b38-d198fd5ff1a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:41.881884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf7cc3-940a-46d7-9b38-d198fd5ff1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:41.882322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf7cc3-940a-46d7-9b38-d198fd5ff1a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:41.883653 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf7cc3-940a-46d7-9b38-d198fd5ff1a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:41.885872 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf7cc3-940a-46d7-9b38-d198fd5ff1a4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:41.918437 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2668/5307] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:21:41 2022] POST /identity/v3/users => generated 299 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:41.919195 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305d408-ed29-4bfe-aa49-acff6c9efd37 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:41.951485 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305d408-ed29-4bfe-aa49-acff6c9efd37 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:41.975721 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074df8a-4c98-4123-a864-9269a99d4f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:41.977166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074df8a-4c98-4123-a864-9269a99d4f54 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:41.977593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074df8a-4c98-4123-a864-9269a99d4f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:41.978144 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074df8a-4c98-4123-a864-9269a99d4f54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:41.979338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074df8a-4c98-4123-a864-9269a99d4f54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:41.999488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074df8a-4c98-4123-a864-9269a99d4f54 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:42.025543 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf7cc3-940a-46d7-9b38-d198fd5ff1a4 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:42.026224 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2640/5308] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:42.044854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf7cc3-940a-46d7-9b38-d198fd5ff1a4 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:42.058252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5abcfa-077e-4e60-bfe4-883c9c16b5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:42.058892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5abcfa-077e-4e60-bfe4-883c9c16b5cb admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:42.059174 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5abcfa-077e-4e60-bfe4-883c9c16b5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:42.059452 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5abcfa-077e-4e60-bfe4-883c9c16b5cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:42.060172 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5abcfa-077e-4e60-bfe4-883c9c16b5cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:42.095777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5abcfa-077e-4e60-bfe4-883c9c16b5cb admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:42.120635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074df8a-4c98-4123-a864-9269a99d4f54 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:42.120781 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2669/5309] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:42.149209 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074df8a-4c98-4123-a864-9269a99d4f54 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:42.169188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a700fa-512a-4c4c-8e23-3564c76e2f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:42.173896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a700fa-512a-4c4c-8e23-3564c76e2f3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:42.176682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a700fa-512a-4c4c-8e23-3564c76e2f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:42.178841 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a700fa-512a-4c4c-8e23-3564c76e2f3a admin admin] PATH_INFO: `/v3/projects/1e5af16d81784ac4a8289ccae055d045/users/9afb8d71d9f44dc1a4de0b00d421ff50/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:42.220426 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a700fa-512a-4c4c-8e23-3564c76e2f3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e5af16d81784ac4a8289ccae055d045, user_id=9afb8d71d9f44dc1a4de0b00d421ff50, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:42.227925 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a700fa-512a-4c4c-8e23-3564c76e2f3a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:42.261388 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2641/5310] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:21:42 2022] PUT /identity/v3/projects/1e5af16d81784ac4a8289ccae055d045/users/9afb8d71d9f44dc1a4de0b00d421ff50/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:42.273602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a54a5-e0ec-4a42-9429-caf695804010 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:42.274196 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a54a5-e0ec-4a42-9429-caf695804010 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:42.274196 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a54a5-e0ec-4a42-9429-caf695804010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:42.320018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-b18a54a5-e0ec-4a42-9429-caf695804010 None None] MFA Rules not processed for user `9afb8d71d9f44dc1a4de0b00d421ff50`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:42.322106 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b18a54a5-e0ec-4a42-9429-caf695804010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:42.495865 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2670/5311] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:42 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:42.501148 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a700fa-512a-4c4c-8e23-3564c76e2f3a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:42.502991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-45a700fa-512a-4c4c-8e23-3564c76e2f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:42.598531 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:42.625822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a700fa-512a-4c4c-8e23-3564c76e2f3a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:42.630185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31a8a3-984f-4292-9422-eebc9cf3564c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efcee9b21ea94b1b8e5c9c5acb35839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:42.631188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31a8a3-984f-4292-9422-eebc9cf3564c service glance] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:42.631660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31a8a3-984f-4292-9422-eebc9cf3564c service glance] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:42.632120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31a8a3-984f-4292-9422-eebc9cf3564c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:42.800003 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31a8a3-984f-4292-9422-eebc9cf3564c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:42.805039 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31a8a3-984f-4292-9422-eebc9cf3564c service glance] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:42.838639 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2642/5312] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:21:42 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:21:43.690930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a54a5-e0ec-4a42-9429-caf695804010 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:43.692893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b18a54a5-e0ec-4a42-9429-caf695804010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:43.822626 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a54a5-e0ec-4a42-9429-caf695804010 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:43.830492 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31a8a3-984f-4292-9422-eebc9cf3564c service glance] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:43.845937 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84dd291-b888-453c-b124-c1a0fad97649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:43.846592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dd291-b888-453c-b124-c1a0fad97649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:43.846874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dd291-b888-453c-b124-c1a0fad97649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:43.847153 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dd291-b888-453c-b124-c1a0fad97649 admin admin] PATH_INFO: `/v3/users/ba251c2bc134469a9c03e7023cd75038` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:43.849744 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31a8a3-984f-4292-9422-eebc9cf3564c service glance] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:43.852351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84dd291-b888-453c-b124-c1a0fad97649 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba251c2bc134469a9c03e7023cd75038)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:43.858413 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84dd291-b888-453c-b124-c1a0fad97649 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:43.866286 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672bb691-772a-4fad-888d-9f96999f481c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:43.868339 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bb691-772a-4fad-888d-9f96999f481c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:43.868339 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bb691-772a-4fad-888d-9f96999f481c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:43.868339 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bb691-772a-4fad-888d-9f96999f481c admin admin] PATH_INFO: `/v3/users/890c5516179849dd840a68aaa0fefa91` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:43.869337 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672bb691-772a-4fad-888d-9f96999f481c admin admin] RBAC: Authorizing `identity:delete_user(user_id=890c5516179849dd840a68aaa0fefa91)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:43.873063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672bb691-772a-4fad-888d-9f96999f481c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:43.963950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-672bb691-772a-4fad-888d-9f96999f481c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '890c5516179849dd840a68aaa0fefa91'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:43.964675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-672bb691-772a-4fad-888d-9f96999f481c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '890c5516179849dd840a68aaa0fefa91'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:43.983944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-672bb691-772a-4fad-888d-9f96999f481c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '890c5516179849dd840a68aaa0fefa91'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:44.001594 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-672bb691-772a-4fad-888d-9f96999f481c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '890c5516179849dd840a68aaa0fefa91'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:44.002921 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-672bb691-772a-4fad-888d-9f96999f481c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '890c5516179849dd840a68aaa0fefa91'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:44.039700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e84dd291-b888-453c-b124-c1a0fad97649 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba251c2bc134469a9c03e7023cd75038'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:44.040567 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e84dd291-b888-453c-b124-c1a0fad97649 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba251c2bc134469a9c03e7023cd75038'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:44.051531 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2643/5313] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:21:43 2022] DELETE /identity/v3/users/890c5516179849dd840a68aaa0fefa91 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:21:44.057021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cc4d7-6dc0-48b4-b56f-b8e74a9fbf14 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:44.058215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cc4d7-6dc0-48b4-b56f-b8e74a9fbf14 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:44.058406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cc4d7-6dc0-48b4-b56f-b8e74a9fbf14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:44.066165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e84dd291-b888-453c-b124-c1a0fad97649 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba251c2bc134469a9c03e7023cd75038'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:44.091073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e84dd291-b888-453c-b124-c1a0fad97649 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba251c2bc134469a9c03e7023cd75038'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:44.091902 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e84dd291-b888-453c-b124-c1a0fad97649 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba251c2bc134469a9c03e7023cd75038'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:44.099342 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:44.125312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-4f6cc4d7-6dc0-48b4-b56f-b8e74a9fbf14 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:44.126591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4f6cc4d7-6dc0-48b4-b56f-b8e74a9fbf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:44.146539 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2671/5314] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:21:43 2022] DELETE /identity/v3/users/ba251c2bc134469a9c03e7023cd75038 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:44.152199 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946fa8f-5bd2-4838-af03-6aae08ba0afa None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:44.152903 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946fa8f-5bd2-4838-af03-6aae08ba0afa None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:44.153184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946fa8f-5bd2-4838-af03-6aae08ba0afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:44.255507 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-3946fa8f-5bd2-4838-af03-6aae08ba0afa None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:44.257136 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3946fa8f-5bd2-4838-af03-6aae08ba0afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:44.322531 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2644/5315] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:44.338873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cc4d7-6dc0-48b4-b56f-b8e74a9fbf14 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:44.340811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4f6cc4d7-6dc0-48b4-b56f-b8e74a9fbf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:44.348566 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:44.388940 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2672/5316] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:21:44.427962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946fa8f-5bd2-4838-af03-6aae08ba0afa None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:44.431237 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3946fa8f-5bd2-4838-af03-6aae08ba0afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:44.494000 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cc4d7-6dc0-48b4-b56f-b8e74a9fbf14 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:44.586348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946fa8f-5bd2-4838-af03-6aae08ba0afa None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:44.592717 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952916fe-82b9-45bd-a764-ca174ae81e87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:44.593623 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952916fe-82b9-45bd-a764-ca174ae81e87 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:44.594047 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952916fe-82b9-45bd-a764-ca174ae81e87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:44.594539 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952916fe-82b9-45bd-a764-ca174ae81e87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:44.620219 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398aef9-86fa-4163-9a9a-cacc321ff7d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:44.620845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398aef9-86fa-4163-9a9a-cacc321ff7d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:44.621128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398aef9-86fa-4163-9a9a-cacc321ff7d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:44.621401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398aef9-86fa-4163-9a9a-cacc321ff7d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:44.627784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952916fe-82b9-45bd-a764-ca174ae81e87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:44.632093 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952916fe-82b9-45bd-a764-ca174ae81e87 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:44.643324 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f398aef9-86fa-4163-9a9a-cacc321ff7d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:44.645177 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f398aef9-86fa-4163-9a9a-cacc321ff7d6 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:44.665761 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2673/5317] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:21:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:21:44.689784 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2645/5318] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:21:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:21:45.061249 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952916fe-82b9-45bd-a764-ca174ae81e87 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:45.061711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-952916fe-82b9-45bd-a764-ca174ae81e87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:45.109274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952916fe-82b9-45bd-a764-ca174ae81e87 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:45.127896 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47abb07-c7f1-4da4-a567-50e19ea416a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:45.128547 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47abb07-c7f1-4da4-a567-50e19ea416a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:45.128827 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47abb07-c7f1-4da4-a567-50e19ea416a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:45.129099 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47abb07-c7f1-4da4-a567-50e19ea416a4 admin admin] PATH_INFO: `/v3/users/c2c44588d537401ebfbb9cb40c318b9f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:45.134586 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47abb07-c7f1-4da4-a567-50e19ea416a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2c44588d537401ebfbb9cb40c318b9f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:45.137563 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47abb07-c7f1-4da4-a567-50e19ea416a4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:45.228852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e47abb07-c7f1-4da4-a567-50e19ea416a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2c44588d537401ebfbb9cb40c318b9f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:45.235158 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e47abb07-c7f1-4da4-a567-50e19ea416a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2c44588d537401ebfbb9cb40c318b9f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:45.260901 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e47abb07-c7f1-4da4-a567-50e19ea416a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2c44588d537401ebfbb9cb40c318b9f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:45.277402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e47abb07-c7f1-4da4-a567-50e19ea416a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2c44588d537401ebfbb9cb40c318b9f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:45.278142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e47abb07-c7f1-4da4-a567-50e19ea416a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2c44588d537401ebfbb9cb40c318b9f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:45.302081 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:45.315464 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2674/5319] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:21:45 2022] DELETE /identity/v3/users/c2c44588d537401ebfbb9cb40c318b9f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:45.321187 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596d06e-1f62-414a-8aac-b0d2fb81777b None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:45.321855 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596d06e-1f62-414a-8aac-b0d2fb81777b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:45.321855 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596d06e-1f62-414a-8aac-b0d2fb81777b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:45.342308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47abb07-c7f1-4da4-a567-50e19ea416a4 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:45.344042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e47abb07-c7f1-4da4-a567-50e19ea416a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:45.363143 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-8596d06e-1f62-414a-8aac-b0d2fb81777b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:45.364782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8596d06e-1f62-414a-8aac-b0d2fb81777b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:45.524868 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2646/5320] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:45.532691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47abb07-c7f1-4da4-a567-50e19ea416a4 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:45.542161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596d06e-1f62-414a-8aac-b0d2fb81777b None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:45.544020 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8596d06e-1f62-414a-8aac-b0d2fb81777b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:45.558193 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c3092-bf90-48bf-a238-e3938a271e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:45.559476 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c3092-bf90-48bf-a238-e3938a271e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:45.560042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c3092-bf90-48bf-a238-e3938a271e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:45.560502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c3092-bf90-48bf-a238-e3938a271e3c admin admin] PATH_INFO: `/v3/projects/1f7557c0897b48389553ea0a0f605df8` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:45.562057 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c3092-bf90-48bf-a238-e3938a271e3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f7557c0897b48389553ea0a0f605df8)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:45.564666 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c3092-bf90-48bf-a238-e3938a271e3c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:45.656224 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-da3c3092-bf90-48bf-a238-e3938a271e3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f7557c0897b48389553ea0a0f605df8', 'request_id': 'req-da3c3092-bf90-48bf-a238-e3938a271e3c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:45.677065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-da3c3092-bf90-48bf-a238-e3938a271e3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f7557c0897b48389553ea0a0f605df8', 'request_id': 'req-da3c3092-bf90-48bf-a238-e3938a271e3c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:45.689720 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-da3c3092-bf90-48bf-a238-e3938a271e3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f7557c0897b48389553ea0a0f605df8', 'request_id': 'req-da3c3092-bf90-48bf-a238-e3938a271e3c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:45.720312 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-da3c3092-bf90-48bf-a238-e3938a271e3c admin admin] The token cache is being invalidate because project 1f7557c0897b48389553ea0a0f605df8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:45.720511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-da3c3092-bf90-48bf-a238-e3938a271e3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:45.722569 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596d06e-1f62-414a-8aac-b0d2fb81777b None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:45.723123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-da3c3092-bf90-48bf-a238-e3938a271e3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:45.729578 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2675/5321] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:21:45 2022] DELETE /identity/v3/projects/1f7557c0897b48389553ea0a0f605df8 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:21:45.729578 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c3092-bf90-48bf-a238-e3938a271e3c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:45.729578 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-da3c3092-bf90-48bf-a238-e3938a271e3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:45.757330 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:45.850568 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c3092-bf90-48bf-a238-e3938a271e3c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:45.861762 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b1329-ff4e-446d-90e9-fad3bb3af376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:45.862393 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b1329-ff4e-446d-90e9-fad3bb3af376 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:45.862659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b1329-ff4e-446d-90e9-fad3bb3af376 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:45.863076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b1329-ff4e-446d-90e9-fad3bb3af376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:45.865828 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-037b1329-ff4e-446d-90e9-fad3bb3af376 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:45.866664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0894754-a069-4e94-84b5-e3a2c4f5f292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:45.873048 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0894754-a069-4e94-84b5-e3a2c4f5f292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:45.874621 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0894754-a069-4e94-84b5-e3a2c4f5f292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:45.875808 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0894754-a069-4e94-84b5-e3a2c4f5f292 admin admin] PATH_INFO: `/v3/projects/8dc856435ae448039f7609e10d559e1c` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:45.878814 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0894754-a069-4e94-84b5-e3a2c4f5f292 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dc856435ae448039f7609e10d559e1c)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:45.881360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0894754-a069-4e94-84b5-e3a2c4f5f292 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:45.885955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b1329-ff4e-446d-90e9-fad3bb3af376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:45.887401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b1329-ff4e-446d-90e9-fad3bb3af376 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:45.900919 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2647/5322] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:21:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:21:45.911016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b1329-ff4e-446d-90e9-fad3bb3af376 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:45.917459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-037b1329-ff4e-446d-90e9-fad3bb3af376 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:45.944505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b1329-ff4e-446d-90e9-fad3bb3af376 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:45.966157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9e2b0-e222-4033-aac4-b395c6451554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:45.967125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9e2b0-e222-4033-aac4-b395c6451554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:45.967536 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9e2b0-e222-4033-aac4-b395c6451554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:45.967986 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9e2b0-e222-4033-aac4-b395c6451554 admin admin] PATH_INFO: `/v3/users/9afb8d71d9f44dc1a4de0b00d421ff50` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:45.970226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e9e2b0-e222-4033-aac4-b395c6451554 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9afb8d71d9f44dc1a4de0b00d421ff50)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:45.972685 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e9e2b0-e222-4033-aac4-b395c6451554 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:45.989806 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:46.037589 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b0894754-a069-4e94-84b5-e3a2c4f5f292 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dc856435ae448039f7609e10d559e1c', 'request_id': 'req-b0894754-a069-4e94-84b5-e3a2c4f5f292'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:46.053250 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b0894754-a069-4e94-84b5-e3a2c4f5f292 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dc856435ae448039f7609e10d559e1c', 'request_id': 'req-b0894754-a069-4e94-84b5-e3a2c4f5f292'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:46.066311 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b0894754-a069-4e94-84b5-e3a2c4f5f292 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dc856435ae448039f7609e10d559e1c', 'request_id': 'req-b0894754-a069-4e94-84b5-e3a2c4f5f292'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:46.083593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b0894754-a069-4e94-84b5-e3a2c4f5f292 admin admin] The token cache is being invalidate because project 8dc856435ae448039f7609e10d559e1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:46.083788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b0894754-a069-4e94-84b5-e3a2c4f5f292 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:46.084683 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b0894754-a069-4e94-84b5-e3a2c4f5f292 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:46.093660 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2676/5323] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:21:45 2022] DELETE /identity/v3/projects/8dc856435ae448039f7609e10d559e1c => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:21:46.095196 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fbc87-f08f-48c8-ac21-8a6aeacc665b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:46.097144 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fbc87-f08f-48c8-ac21-8a6aeacc665b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:46.097144 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fbc87-f08f-48c8-ac21-8a6aeacc665b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:46.099326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-76e9e2b0-e222-4033-aac4-b395c6451554 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9afb8d71d9f44dc1a4de0b00d421ff50'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:46.103403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-76e9e2b0-e222-4033-aac4-b395c6451554 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9afb8d71d9f44dc1a4de0b00d421ff50'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:46.135451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-76e9e2b0-e222-4033-aac4-b395c6451554 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9afb8d71d9f44dc1a4de0b00d421ff50'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:46.165597 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-76e9e2b0-e222-4033-aac4-b395c6451554 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9afb8d71d9f44dc1a4de0b00d421ff50'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:46.167233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-76e9e2b0-e222-4033-aac4-b395c6451554 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9afb8d71d9f44dc1a4de0b00d421ff50'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:46.169708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-bb5fbc87-f08f-48c8-ac21-8a6aeacc665b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:46.171101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-bb5fbc87-f08f-48c8-ac21-8a6aeacc665b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:46.217330 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2648/5324] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:21:45 2022] DELETE /identity/v3/users/9afb8d71d9f44dc1a4de0b00d421ff50 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:46.286388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9e2b0-e222-4033-aac4-b395c6451554 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:46.289249 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-76e9e2b0-e222-4033-aac4-b395c6451554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:46.345033 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2677/5325] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:46.345328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5d84f-7ecb-4fae-854f-080e2af5953b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:46.348931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5d84f-7ecb-4fae-854f-080e2af5953b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:46.349428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5d84f-7ecb-4fae-854f-080e2af5953b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:46.393359 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-35d5d84f-7ecb-4fae-854f-080e2af5953b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:46.394817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-35d5d84f-7ecb-4fae-854f-080e2af5953b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:46.444081 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9e2b0-e222-4033-aac4-b395c6451554 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:46.459900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db96b1e-6931-492f-83b3-9af4604dab84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:46.461421 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db96b1e-6931-492f-83b3-9af4604dab84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:46.463460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db96b1e-6931-492f-83b3-9af4604dab84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:46.465269 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db96b1e-6931-492f-83b3-9af4604dab84 admin admin] PATH_INFO: `/v3/projects/973f43c30f1b454c81041027cd767564` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:46.467670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db96b1e-6931-492f-83b3-9af4604dab84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=973f43c30f1b454c81041027cd767564)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:46.471568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db96b1e-6931-492f-83b3-9af4604dab84 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:46.505479 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2678/5326] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:46.511261 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5d84f-7ecb-4fae-854f-080e2af5953b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:46.532159 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5d84f-7ecb-4fae-854f-080e2af5953b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:46.544037 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501caf09-70b4-4238-bdbc-f00c713bf7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:46.544732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501caf09-70b4-4238-bdbc-f00c713bf7c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:46.545022 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501caf09-70b4-4238-bdbc-f00c713bf7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:46.545297 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501caf09-70b4-4238-bdbc-f00c713bf7c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:46.545994 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501caf09-70b4-4238-bdbc-f00c713bf7c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:21:46.546379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501caf09-70b4-4238-bdbc-f00c713bf7c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:46.549360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501caf09-70b4-4238-bdbc-f00c713bf7c7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:46.582273 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2679/5327] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:21:46.586989 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501caf09-70b4-4238-bdbc-f00c713bf7c7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:46.605486 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501caf09-70b4-4238-bdbc-f00c713bf7c7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:46.617590 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:46.643975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1db96b1e-6931-492f-83b3-9af4604dab84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '973f43c30f1b454c81041027cd767564', 'request_id': 'req-1db96b1e-6931-492f-83b3-9af4604dab84'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:46.664664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1db96b1e-6931-492f-83b3-9af4604dab84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '973f43c30f1b454c81041027cd767564', 'request_id': 'req-1db96b1e-6931-492f-83b3-9af4604dab84'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:46.679014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1db96b1e-6931-492f-83b3-9af4604dab84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '973f43c30f1b454c81041027cd767564', 'request_id': 'req-1db96b1e-6931-492f-83b3-9af4604dab84'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:46.706846 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:46.767344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa6a82-f8c3-4c06-8953-ff2ee718f4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:46.767980 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa6a82-f8c3-4c06-8953-ff2ee718f4f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:46.768260 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa6a82-f8c3-4c06-8953-ff2ee718f4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:46.768530 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa6a82-f8c3-4c06-8953-ff2ee718f4f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:46.772395 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa6a82-f8c3-4c06-8953-ff2ee718f4f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:46.775880 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa6a82-f8c3-4c06-8953-ff2ee718f4f7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:46.789997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1db96b1e-6931-492f-83b3-9af4604dab84 admin admin] The token cache is being invalidate because project 973f43c30f1b454c81041027cd767564 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:46.790792 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1db96b1e-6931-492f-83b3-9af4604dab84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:46.792361 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1db96b1e-6931-492f-83b3-9af4604dab84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:46.806661 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2649/5328] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:21:46 2022] DELETE /identity/v3/projects/973f43c30f1b454c81041027cd767564 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:46.812403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789abda-0d75-4221-aace-157e192265f5 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:46.812795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789abda-0d75-4221-aace-157e192265f5 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:46.813081 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789abda-0d75-4221-aace-157e192265f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:46.850196 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2680/5329] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:21:46 2022] POST /identity/v3/projects => generated 373 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:21:46.855400 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa6a82-f8c3-4c06-8953-ff2ee718f4f7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:46.857367 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a789abda-0d75-4221-aace-157e192265f5 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:46.859499 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a789abda-0d75-4221-aace-157e192265f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:46.865531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3faa6a82-f8c3-4c06-8953-ff2ee718f4f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:46.977934 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2650/5330] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:46.980153 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93419a7-9395-49b4-9895-ec9b7f0c01cf None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:46.980524 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93419a7-9395-49b4-9895-ec9b7f0c01cf None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:46.980876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93419a7-9395-49b4-9895-ec9b7f0c01cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:47.024712 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e93419a7-9395-49b4-9895-ec9b7f0c01cf None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:47.026900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e93419a7-9395-49b4-9895-ec9b7f0c01cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:47.048634 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2651/5331] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:47.049736 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93419a7-9395-49b4-9895-ec9b7f0c01cf None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:47.062940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93419a7-9395-49b4-9895-ec9b7f0c01cf None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:47.075161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654ee09-e731-4555-9b99-b278ac61b430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:47.077444 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa6a82-f8c3-4c06-8953-ff2ee718f4f7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:47.077912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654ee09-e731-4555-9b99-b278ac61b430 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:47.077912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654ee09-e731-4555-9b99-b278ac61b430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:47.078076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654ee09-e731-4555-9b99-b278ac61b430 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:47.079567 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654ee09-e731-4555-9b99-b278ac61b430 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:21:47.079998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654ee09-e731-4555-9b99-b278ac61b430 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:47.081892 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654ee09-e731-4555-9b99-b278ac61b430 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:47.088439 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451e234-e4cf-467b-8c86-29bfe329e3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:47.091939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451e234-e4cf-467b-8c86-29bfe329e3ab admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:47.092303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451e234-e4cf-467b-8c86-29bfe329e3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:47.092654 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451e234-e4cf-467b-8c86-29bfe329e3ab admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:47.093365 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451e234-e4cf-467b-8c86-29bfe329e3ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:47.096177 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451e234-e4cf-467b-8c86-29bfe329e3ab admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:47.106344 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2652/5332] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:21:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:21:47.107260 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654ee09-e731-4555-9b99-b278ac61b430 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:47.132404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654ee09-e731-4555-9b99-b278ac61b430 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:47.134886 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2681/5333] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:21:46 2022] POST /identity/v3/users => generated 287 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:47.139863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451e234-e4cf-467b-8c86-29bfe329e3ab admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:47.145018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17cbf9-99da-4496-9a30-c465009bf03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:47.155283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17cbf9-99da-4496-9a30-c465009bf03f admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:47.158332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451e234-e4cf-467b-8c86-29bfe329e3ab admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:47.160340 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17cbf9-99da-4496-9a30-c465009bf03f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:47.160811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17cbf9-99da-4496-9a30-c465009bf03f admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:47.166926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17cbf9-99da-4496-9a30-c465009bf03f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:47.170783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19686845-a18a-42ca-8707-c78fe0127faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:47.171464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19686845-a18a-42ca-8707-c78fe0127faf admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:47.171872 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19686845-a18a-42ca-8707-c78fe0127faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:47.172143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19686845-a18a-42ca-8707-c78fe0127faf admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:47.172815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19686845-a18a-42ca-8707-c78fe0127faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:47.174540 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19686845-a18a-42ca-8707-c78fe0127faf admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:47.174681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17cbf9-99da-4496-9a30-c465009bf03f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:47.202428 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2682/5334] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:47.206738 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19686845-a18a-42ca-8707-c78fe0127faf admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:47.233212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19686845-a18a-42ca-8707-c78fe0127faf admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:47.241609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1b28a-5c08-4c46-8088-9e6ccb806b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:47.245190 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1b28a-5c08-4c46-8088-9e6ccb806b58 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:47.245628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1b28a-5c08-4c46-8088-9e6ccb806b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:47.246731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1b28a-5c08-4c46-8088-9e6ccb806b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:47.253004 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2653/5335] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:21:47 2022] POST /identity/v3/projects => generated 375 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:47.253173 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1b28a-5c08-4c46-8088-9e6ccb806b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:47.253940 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1b28a-5c08-4c46-8088-9e6ccb806b58 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:47.254314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17cbf9-99da-4496-9a30-c465009bf03f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:47.267533 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2683/5336] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:47.271559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1b28a-5c08-4c46-8088-9e6ccb806b58 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:47.312834 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1b28a-5c08-4c46-8088-9e6ccb806b58 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:47.363022 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17cbf9-99da-4496-9a30-c465009bf03f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:47.374880 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65170d7-66ba-4d07-bf1c-7925854a1502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:47.375519 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65170d7-66ba-4d07-bf1c-7925854a1502 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:47.376504 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65170d7-66ba-4d07-bf1c-7925854a1502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:47.376787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65170d7-66ba-4d07-bf1c-7925854a1502 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:47.377932 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65170d7-66ba-4d07-bf1c-7925854a1502 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:47.380076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65170d7-66ba-4d07-bf1c-7925854a1502 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:47.444603 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2654/5337] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:21:47 2022] POST /identity/v3/users => generated 288 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:47.451897 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65170d7-66ba-4d07-bf1c-7925854a1502 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:47.468449 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44712c27-3da0-405d-9648-93522740d1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:47.470732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44712c27-3da0-405d-9648-93522740d1d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:47.471012 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44712c27-3da0-405d-9648-93522740d1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:47.471285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44712c27-3da0-405d-9648-93522740d1d5 admin admin] PATH_INFO: `/v3/projects/a1fa40ebf8924600bcae62b344ee6c06/users/5b1d88857d424e42b5179b7e0d35373b/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:47.493912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65170d7-66ba-4d07-bf1c-7925854a1502 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:47.510770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44712c27-3da0-405d-9648-93522740d1d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1fa40ebf8924600bcae62b344ee6c06, user_id=5b1d88857d424e42b5179b7e0d35373b, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:47.518210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44712c27-3da0-405d-9648-93522740d1d5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:47.521949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc32aa0-bd51-4db8-9d49-19115eb28ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:47.527235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc32aa0-bd51-4db8-9d49-19115eb28ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:47.527663 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc32aa0-bd51-4db8-9d49-19115eb28ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:47.528211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc32aa0-bd51-4db8-9d49-19115eb28ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:47.529074 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc32aa0-bd51-4db8-9d49-19115eb28ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:47.545343 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc32aa0-bd51-4db8-9d49-19115eb28ca1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:47.560975 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:47.587404 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2655/5338] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:47.588513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc32aa0-bd51-4db8-9d49-19115eb28ca1 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:47.623602 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2684/5339] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:21:47 2022] PUT /identity/v3/projects/a1fa40ebf8924600bcae62b344ee6c06/users/5b1d88857d424e42b5179b7e0d35373b/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:47.639749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc32aa0-bd51-4db8-9d49-19115eb28ca1 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:47.642084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c34b2d-6453-4d68-8dd4-3e680fc5851e None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:47.642724 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c34b2d-6453-4d68-8dd4-3e680fc5851e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:47.643015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c34b2d-6453-4d68-8dd4-3e680fc5851e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:47.733719 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-98c34b2d-6453-4d68-8dd4-3e680fc5851e None None] MFA Rules not processed for user `5b1d88857d424e42b5179b7e0d35373b`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:47.738296 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-98c34b2d-6453-4d68-8dd4-3e680fc5851e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:47.764133 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:47.890421 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bec80-0693-4be0-a22f-eed8e17cc876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:47.908630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bec80-0693-4be0-a22f-eed8e17cc876 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:47.912414 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2685/5340] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:47.915175 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bec80-0693-4be0-a22f-eed8e17cc876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:47.915464 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bec80-0693-4be0-a22f-eed8e17cc876 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:47.916277 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4bec80-0693-4be0-a22f-eed8e17cc876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:47.917904 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4bec80-0693-4be0-a22f-eed8e17cc876 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:47.933464 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2656/5341] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:47.940885 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c34b2d-6453-4d68-8dd4-3e680fc5851e None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:47.950410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c34b2d-6453-4d68-8dd4-3e680fc5851e None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:47.962321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bec80-0693-4be0-a22f-eed8e17cc876 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:47.967798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7b4bec80-0693-4be0-a22f-eed8e17cc876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:47.968994 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a4d11-5416-4b73-83cc-257f534327b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:47.973691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a4d11-5416-4b73-83cc-257f534327b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:47.977845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a4d11-5416-4b73-83cc-257f534327b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:47.978144 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a4d11-5416-4b73-83cc-257f534327b8 admin admin] PATH_INFO: `/v3/projects/d27f6449bf4f4b71a953ba3748d64873/users/fc931004996446208e5b1afda099f81b/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:48.037044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a4d11-5416-4b73-83cc-257f534327b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d27f6449bf4f4b71a953ba3748d64873, user_id=fc931004996446208e5b1afda099f81b, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:48.043730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a4d11-5416-4b73-83cc-257f534327b8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:48.084203 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2686/5342] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:21:47 2022] PUT /identity/v3/projects/d27f6449bf4f4b71a953ba3748d64873/users/fc931004996446208e5b1afda099f81b/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:21:48.097414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416f82e-ac85-4697-bbc9-b60faf5aa144 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:48.097725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416f82e-ac85-4697-bbc9-b60faf5aa144 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:48.098263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416f82e-ac85-4697-bbc9-b60faf5aa144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:48.149168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bec80-0693-4be0-a22f-eed8e17cc876 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:48.169096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-d416f82e-ac85-4697-bbc9-b60faf5aa144 None None] MFA Rules not processed for user `fc931004996446208e5b1afda099f81b`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:48.171179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d416f82e-ac85-4697-bbc9-b60faf5aa144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:48.284678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1534fb-da2e-439d-9f3b-b8e863f2078b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:48.285664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1534fb-da2e-439d-9f3b-b8e863f2078b service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:48.285949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1534fb-da2e-439d-9f3b-b8e863f2078b service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:48.286291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1534fb-da2e-439d-9f3b-b8e863f2078b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:48.310971 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2687/5343] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:48.332253 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:48.368289 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1534fb-da2e-439d-9f3b-b8e863f2078b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:48.370189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1534fb-da2e-439d-9f3b-b8e863f2078b service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:48.390557 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2657/5344] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:21:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:21:48.396084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416f82e-ac85-4697-bbc9-b60faf5aa144 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:48.397947 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d416f82e-ac85-4697-bbc9-b60faf5aa144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:48.406123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1534fb-da2e-439d-9f3b-b8e863f2078b service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:48.409812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-be1534fb-da2e-439d-9f3b-b8e863f2078b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:48.569624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416f82e-ac85-4697-bbc9-b60faf5aa144 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:48.581089 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70777290-6c97-4f85-a9b7-20b341b7a2f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:48.583631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70777290-6c97-4f85-a9b7-20b341b7a2f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:48.583631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70777290-6c97-4f85-a9b7-20b341b7a2f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:48.583631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70777290-6c97-4f85-a9b7-20b341b7a2f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:48.607237 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70777290-6c97-4f85-a9b7-20b341b7a2f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:48.612917 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70777290-6c97-4f85-a9b7-20b341b7a2f0 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:48.621223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1534fb-da2e-439d-9f3b-b8e863f2078b service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:48.636892 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c683d8d-1dd5-4653-821f-92945421274d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:48.637888 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c683d8d-1dd5-4653-821f-92945421274d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:48.638406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c683d8d-1dd5-4653-821f-92945421274d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:48.640103 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c683d8d-1dd5-4653-821f-92945421274d admin admin] PATH_INFO: `/v3/projects/1e5af16d81784ac4a8289ccae055d045` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:48.644003 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c683d8d-1dd5-4653-821f-92945421274d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e5af16d81784ac4a8289ccae055d045)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:48.648627 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c683d8d-1dd5-4653-821f-92945421274d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:48.649608 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2688/5345] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:21:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:21:48.750972 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2c683d8d-1dd5-4653-821f-92945421274d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e5af16d81784ac4a8289ccae055d045', 'request_id': 'req-2c683d8d-1dd5-4653-821f-92945421274d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:48.811992 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2c683d8d-1dd5-4653-821f-92945421274d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e5af16d81784ac4a8289ccae055d045', 'request_id': 'req-2c683d8d-1dd5-4653-821f-92945421274d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:48.819090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2c683d8d-1dd5-4653-821f-92945421274d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e5af16d81784ac4a8289ccae055d045', 'request_id': 'req-2c683d8d-1dd5-4653-821f-92945421274d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:48.847589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2c683d8d-1dd5-4653-821f-92945421274d admin admin] The token cache is being invalidate because project 1e5af16d81784ac4a8289ccae055d045 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:48.848119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2c683d8d-1dd5-4653-821f-92945421274d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:48.850754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2c683d8d-1dd5-4653-821f-92945421274d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:48.856468 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2658/5346] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:21:48 2022] DELETE /identity/v3/projects/1e5af16d81784ac4a8289ccae055d045 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:48.862352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9266480-30c1-4d58-8fd1-646ffc69cbf4 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:48.862879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9266480-30c1-4d58-8fd1-646ffc69cbf4 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:48.863594 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9266480-30c1-4d58-8fd1-646ffc69cbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:48.919647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c683d8d-1dd5-4653-821f-92945421274d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:48.919647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2c683d8d-1dd5-4653-821f-92945421274d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:48.921272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-d9266480-30c1-4d58-8fd1-646ffc69cbf4 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:48.932316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d9266480-30c1-4d58-8fd1-646ffc69cbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:48.978129 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:49.149143 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2689/5347] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:49.158279 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e053b80-e8d0-40bb-93db-608fcf22a9e9 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:49.158490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e053b80-e8d0-40bb-93db-608fcf22a9e9 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:49.158774 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e053b80-e8d0-40bb-93db-608fcf22a9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:49.212359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c683d8d-1dd5-4653-821f-92945421274d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:49.216515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-6e053b80-e8d0-40bb-93db-608fcf22a9e9 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:49.219278 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6e053b80-e8d0-40bb-93db-608fcf22a9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:49.231840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab0ac0-cb6e-493c-8157-14c2f2a048f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:49.236404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab0ac0-cb6e-493c-8157-14c2f2a048f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:49.236871 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab0ac0-cb6e-493c-8157-14c2f2a048f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:49.237247 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab0ac0-cb6e-493c-8157-14c2f2a048f8 admin admin] PATH_INFO: `/v3/users/5b1d88857d424e42b5179b7e0d35373b` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:49.246881 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab0ac0-cb6e-493c-8157-14c2f2a048f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b1d88857d424e42b5179b7e0d35373b)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:49.259158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab0ac0-cb6e-493c-8157-14c2f2a048f8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:49.264156 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:49.285000 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2690/5348] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:49.290532 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e053b80-e8d0-40bb-93db-608fcf22a9e9 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:49.312190 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e053b80-e8d0-40bb-93db-608fcf22a9e9 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:49.333695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177c0e0-18a0-417f-bef9-d1be831235e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:49.334564 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177c0e0-18a0-417f-bef9-d1be831235e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:49.337281 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177c0e0-18a0-417f-bef9-d1be831235e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:49.337281 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177c0e0-18a0-417f-bef9-d1be831235e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:49.338145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0177c0e0-18a0-417f-bef9-d1be831235e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:21:49.340756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0177c0e0-18a0-417f-bef9-d1be831235e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:49.342554 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0177c0e0-18a0-417f-bef9-d1be831235e0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:49.375273 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2691/5349] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:21:49.376377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177c0e0-18a0-417f-bef9-d1be831235e0 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:49.397129 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177c0e0-18a0-417f-bef9-d1be831235e0 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:49.415079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ae8cd-e3bf-4f87-8879-52fa8eb51c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:49.418516 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ae8cd-e3bf-4f87-8879-52fa8eb51c98 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:49.418516 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ae8cd-e3bf-4f87-8879-52fa8eb51c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:49.418516 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ae8cd-e3bf-4f87-8879-52fa8eb51c98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:49.418516 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ae8cd-e3bf-4f87-8879-52fa8eb51c98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:49.418944 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ae8cd-e3bf-4f87-8879-52fa8eb51c98 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:49.432229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-98ab0ac0-cb6e-493c-8157-14c2f2a048f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b1d88857d424e42b5179b7e0d35373b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:49.433254 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-98ab0ac0-cb6e-493c-8157-14c2f2a048f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b1d88857d424e42b5179b7e0d35373b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:49.445148 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-98ab0ac0-cb6e-493c-8157-14c2f2a048f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b1d88857d424e42b5179b7e0d35373b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:49.472604 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-98ab0ac0-cb6e-493c-8157-14c2f2a048f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b1d88857d424e42b5179b7e0d35373b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:49.473259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-98ab0ac0-cb6e-493c-8157-14c2f2a048f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b1d88857d424e42b5179b7e0d35373b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:49.508534 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2692/5350] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:21:49 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:49.509539 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ae8cd-e3bf-4f87-8879-52fa8eb51c98 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:49.516857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7c0ae8cd-e3bf-4f87-8879-52fa8eb51c98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:49.566460 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2659/5351] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:21:48 2022] DELETE /identity/v3/users/5b1d88857d424e42b5179b7e0d35373b => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:21:49.572571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40565f-c02f-4122-b12d-b2ef1a1d42a0 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:49.572896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40565f-c02f-4122-b12d-b2ef1a1d42a0 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:49.573148 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40565f-c02f-4122-b12d-b2ef1a1d42a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:49.634799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-ff40565f-c02f-4122-b12d-b2ef1a1d42a0 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:49.636486 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ff40565f-c02f-4122-b12d-b2ef1a1d42a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:49.728591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ae8cd-e3bf-4f87-8879-52fa8eb51c98 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:49.810915 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2660/5352] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:49.876658 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40565f-c02f-4122-b12d-b2ef1a1d42a0 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:49.878548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ff40565f-c02f-4122-b12d-b2ef1a1d42a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:49.964746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217864fa-3567-4da4-8b8e-889bd6b3df1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:49.965385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217864fa-3567-4da4-8b8e-889bd6b3df1d admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:49.965779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217864fa-3567-4da4-8b8e-889bd6b3df1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:49.966083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217864fa-3567-4da4-8b8e-889bd6b3df1d admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:49.966734 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217864fa-3567-4da4-8b8e-889bd6b3df1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:49.979663 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217864fa-3567-4da4-8b8e-889bd6b3df1d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:50.055125 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2693/5353] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:21:49 2022] POST /identity/v3/users => generated 294 bytes in 543 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:50.060126 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217864fa-3567-4da4-8b8e-889bd6b3df1d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:50.086702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217864fa-3567-4da4-8b8e-889bd6b3df1d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:50.105359 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd458f8d-6dc7-46ff-bdeb-9e2a3d7dc370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:50.105359 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd458f8d-6dc7-46ff-bdeb-9e2a3d7dc370 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:50.105359 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd458f8d-6dc7-46ff-bdeb-9e2a3d7dc370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:50.105359 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd458f8d-6dc7-46ff-bdeb-9e2a3d7dc370 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:50.105764 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd458f8d-6dc7-46ff-bdeb-9e2a3d7dc370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:50.108617 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd458f8d-6dc7-46ff-bdeb-9e2a3d7dc370 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:50.140543 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2694/5354] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:21:50.141593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd458f8d-6dc7-46ff-bdeb-9e2a3d7dc370 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:50.161643 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:50.163194 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40565f-c02f-4122-b12d-b2ef1a1d42a0 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:50.172866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd458f8d-6dc7-46ff-bdeb-9e2a3d7dc370 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:50.178874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83fe2d-2b61-46cc-aed4-d3dcd15b1a4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:50.180389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83fe2d-2b61-46cc-aed4-d3dcd15b1a4a service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:50.184232 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83fe2d-2b61-46cc-aed4-d3dcd15b1a4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:50.186412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83fe2d-2b61-46cc-aed4-d3dcd15b1a4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:50.193403 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299fd099-bce5-4300-a9c5-a1b6fe6a70ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:50.194108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fd099-bce5-4300-a9c5-a1b6fe6a70ca admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:50.195272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fd099-bce5-4300-a9c5-a1b6fe6a70ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:50.198696 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fd099-bce5-4300-a9c5-a1b6fe6a70ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:50.198696 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299fd099-bce5-4300-a9c5-a1b6fe6a70ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:50.201092 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299fd099-bce5-4300-a9c5-a1b6fe6a70ca admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:50.238012 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b83fe2d-2b61-46cc-aed4-d3dcd15b1a4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:50.249397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b83fe2d-2b61-46cc-aed4-d3dcd15b1a4a service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:50.270887 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2695/5355] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:50.273204 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299fd099-bce5-4300-a9c5-a1b6fe6a70ca admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:50.285793 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2661/5356] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:21:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:21:50.305298 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299fd099-bce5-4300-a9c5-a1b6fe6a70ca admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:50.312801 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb2bd5-9f25-4ae1-907a-02c27821fc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:50.313706 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb2bd5-9f25-4ae1-907a-02c27821fc52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:50.313881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb2bd5-9f25-4ae1-907a-02c27821fc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:50.314035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb2bd5-9f25-4ae1-907a-02c27821fc52 admin admin] PATH_INFO: `/v3/projects/3026b9ef01534d3b872429b200fc349d/users/f23406801b2c41d89c846ed1e493a480/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:50.351907 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb2bd5-9f25-4ae1-907a-02c27821fc52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3026b9ef01534d3b872429b200fc349d, user_id=f23406801b2c41d89c846ed1e493a480, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:50.357302 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb2bd5-9f25-4ae1-907a-02c27821fc52 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:50.387554 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2696/5357] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:21:50 2022] PUT /identity/v3/projects/3026b9ef01534d3b872429b200fc349d/users/f23406801b2c41d89c846ed1e493a480/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:50.399068 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd91f4f-6bae-4860-adf8-0caf40031c6a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:50.399815 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd91f4f-6bae-4860-adf8-0caf40031c6a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:50.400734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd91f4f-6bae-4860-adf8-0caf40031c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:50.485411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-0bd91f4f-6bae-4860-adf8-0caf40031c6a None None] MFA Rules not processed for user `f23406801b2c41d89c846ed1e493a480`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:50.486738 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0bd91f4f-6bae-4860-adf8-0caf40031c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:50.514780 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:50.643534 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2662/5358] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:50.657564 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb2bd5-9f25-4ae1-907a-02c27821fc52 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:50.659598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2ceb2bd5-9f25-4ae1-907a-02c27821fc52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:50.899496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb2bd5-9f25-4ae1-907a-02c27821fc52 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:50.911607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81027788-4d00-4265-a8b9-bba26c541368 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efcee9b21ea94b1b8e5c9c5acb35839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:50.912364 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81027788-4d00-4265-a8b9-bba26c541368 service glance] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:50.912531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81027788-4d00-4265-a8b9-bba26c541368 service glance] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:50.912776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81027788-4d00-4265-a8b9-bba26c541368 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:50.937169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81027788-4d00-4265-a8b9-bba26c541368 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:50.938905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81027788-4d00-4265-a8b9-bba26c541368 service glance] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:50.963937 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2697/5359] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:21:50 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:21:51.260577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3773a-a56a-407b-86ae-4e2c3f37188d None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:51.261127 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3773a-a56a-407b-86ae-4e2c3f37188d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:51.261603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3773a-a56a-407b-86ae-4e2c3f37188d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:51.387356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-59c3773a-a56a-407b-86ae-4e2c3f37188d None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:51.388485 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-59c3773a-a56a-407b-86ae-4e2c3f37188d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:51.587931 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2663/5360] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:21:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:21:51.660631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81027788-4d00-4265-a8b9-bba26c541368 service glance] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:51.662120 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-81027788-4d00-4265-a8b9-bba26c541368 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:51.751030 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c3773a-a56a-407b-86ae-4e2c3f37188d None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:51.752556 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-59c3773a-a56a-407b-86ae-4e2c3f37188d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:51.896555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81027788-4d00-4265-a8b9-bba26c541368 service glance] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:51.910832 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79f3fe-4159-4530-a5f7-34a353be26b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:51.911072 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79f3fe-4159-4530-a5f7-34a353be26b4 service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:51.911195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79f3fe-4159-4530-a5f7-34a353be26b4 service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:51.911426 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79f3fe-4159-4530-a5f7-34a353be26b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:51.922674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c3773a-a56a-407b-86ae-4e2c3f37188d None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:51.933667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd047e5a-00a8-4e41-b93f-d370e2824e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:51.934741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd047e5a-00a8-4e41-b93f-d370e2824e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:51.935137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd047e5a-00a8-4e41-b93f-d370e2824e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:51.935696 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd047e5a-00a8-4e41-b93f-d370e2824e72 admin admin] PATH_INFO: `/v3/projects/a1fa40ebf8924600bcae62b344ee6c06` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:51.937544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd047e5a-00a8-4e41-b93f-d370e2824e72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1fa40ebf8924600bcae62b344ee6c06)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:51.944811 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79f3fe-4159-4530-a5f7-34a353be26b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:51.946160 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd047e5a-00a8-4e41-b93f-d370e2824e72 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:51.947219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79f3fe-4159-4530-a5f7-34a353be26b4 service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:51.966630 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2698/5361] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:21:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:21:52.031511 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:52.068980 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-bd047e5a-00a8-4e41-b93f-d370e2824e72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1fa40ebf8924600bcae62b344ee6c06', 'request_id': 'req-bd047e5a-00a8-4e41-b93f-d370e2824e72'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:52.083004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-bd047e5a-00a8-4e41-b93f-d370e2824e72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1fa40ebf8924600bcae62b344ee6c06', 'request_id': 'req-bd047e5a-00a8-4e41-b93f-d370e2824e72'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:52.096768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-bd047e5a-00a8-4e41-b93f-d370e2824e72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1fa40ebf8924600bcae62b344ee6c06', 'request_id': 'req-bd047e5a-00a8-4e41-b93f-d370e2824e72'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:52.137682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-bd047e5a-00a8-4e41-b93f-d370e2824e72 admin admin] The token cache is being invalidate because project a1fa40ebf8924600bcae62b344ee6c06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:52.138532 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-bd047e5a-00a8-4e41-b93f-d370e2824e72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:52.141323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-bd047e5a-00a8-4e41-b93f-d370e2824e72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:52.151549 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2664/5362] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:21:51 2022] DELETE /identity/v3/projects/a1fa40ebf8924600bcae62b344ee6c06 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:21:52.153971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be4832-8e48-4876-a744-0b0b5b180aad None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:52.154561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be4832-8e48-4876-a744-0b0b5b180aad None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:52.154873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be4832-8e48-4876-a744-0b0b5b180aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:52.189762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-97be4832-8e48-4876-a744-0b0b5b180aad None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:52.191250 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-97be4832-8e48-4876-a744-0b0b5b180aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:52.300597 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:52.353851 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2699/5363] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:52.363185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e28a7-d08c-48dc-9fe2-1e509859688a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:52.363733 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e28a7-d08c-48dc-9fe2-1e509859688a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:52.364014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e28a7-d08c-48dc-9fe2-1e509859688a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:52.447409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-db1e28a7-d08c-48dc-9fe2-1e509859688a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:52.448906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-db1e28a7-d08c-48dc-9fe2-1e509859688a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:52.471346 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2665/5364] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:52.475210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be4832-8e48-4876-a744-0b0b5b180aad None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:52.497952 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be4832-8e48-4876-a744-0b0b5b180aad None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:52.511101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446e1cd-e39b-42a0-a9ac-897c0e59985e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:52.511828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446e1cd-e39b-42a0-a9ac-897c0e59985e admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:52.512209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446e1cd-e39b-42a0-a9ac-897c0e59985e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:52.512599 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446e1cd-e39b-42a0-a9ac-897c0e59985e admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:52.518665 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446e1cd-e39b-42a0-a9ac-897c0e59985e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:21:52.519194 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446e1cd-e39b-42a0-a9ac-897c0e59985e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:52.521181 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446e1cd-e39b-42a0-a9ac-897c0e59985e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:52.548982 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2700/5365] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:21:52.549552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e28a7-d08c-48dc-9fe2-1e509859688a None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:52.565872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e28a7-d08c-48dc-9fe2-1e509859688a None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:52.581956 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94181533-3243-4fa9-aad1-2fc391940d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:52.583677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94181533-3243-4fa9-aad1-2fc391940d59 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:52.584196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94181533-3243-4fa9-aad1-2fc391940d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:52.584661 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94181533-3243-4fa9-aad1-2fc391940d59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:52.588894 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94181533-3243-4fa9-aad1-2fc391940d59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:52.600566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94181533-3243-4fa9-aad1-2fc391940d59 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:52.696722 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2666/5366] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:21:52 2022] POST /identity/v3/projects => generated 387 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:21:52.700466 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446e1cd-e39b-42a0-a9ac-897c0e59985e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:52.714407 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446e1cd-e39b-42a0-a9ac-897c0e59985e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:52.719539 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e3bcb-9c83-40a7-a106-1c375305d5e5 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:52.720091 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e3bcb-9c83-40a7-a106-1c375305d5e5 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:52.720574 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e3bcb-9c83-40a7-a106-1c375305d5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:52.757938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c10e3bcb-9c83-40a7-a106-1c375305d5e5 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:52.759178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c10e3bcb-9c83-40a7-a106-1c375305d5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:52.832386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17f25a-3cda-4c66-b2c3-74304c6ba453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:52.832989 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17f25a-3cda-4c66-b2c3-74304c6ba453 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:52.833541 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17f25a-3cda-4c66-b2c3-74304c6ba453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:52.834064 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17f25a-3cda-4c66-b2c3-74304c6ba453 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:52.834977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17f25a-3cda-4c66-b2c3-74304c6ba453 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:52.837475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17f25a-3cda-4c66-b2c3-74304c6ba453 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:52.864494 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2701/5367] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:21:52 2022] POST /identity/v3/users => generated 294 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:52.880519 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17f25a-3cda-4c66-b2c3-74304c6ba453 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:52.881951 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2667/5368] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:21:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:21:52.894426 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e3bcb-9c83-40a7-a106-1c375305d5e5 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:52.896640 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c10e3bcb-9c83-40a7-a106-1c375305d5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:52.901263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17f25a-3cda-4c66-b2c3-74304c6ba453 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:52.908124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956adaed-658c-40c4-9f37-dda605e4d030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:52.908983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956adaed-658c-40c4-9f37-dda605e4d030 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:52.909474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956adaed-658c-40c4-9f37-dda605e4d030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:52.910469 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956adaed-658c-40c4-9f37-dda605e4d030 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:52.911664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956adaed-658c-40c4-9f37-dda605e4d030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:52.914593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956adaed-658c-40c4-9f37-dda605e4d030 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:52.944995 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2702/5369] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:52.946781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956adaed-658c-40c4-9f37-dda605e4d030 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:52.970683 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956adaed-658c-40c4-9f37-dda605e4d030 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:52.986474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef95438-ba83-47dd-a8ab-c3464794ee6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:52.988053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef95438-ba83-47dd-a8ab-c3464794ee6b admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:52.988686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e3bcb-9c83-40a7-a106-1c375305d5e5 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:52.988904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef95438-ba83-47dd-a8ab-c3464794ee6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:52.989182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef95438-ba83-47dd-a8ab-c3464794ee6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:52.989876 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef95438-ba83-47dd-a8ab-c3464794ee6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:52.995548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01474a-ca10-447a-ba96-590422104415 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:52.995797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef95438-ba83-47dd-a8ab-c3464794ee6b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:52.996577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01474a-ca10-447a-ba96-590422104415 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:52.997018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01474a-ca10-447a-ba96-590422104415 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:52.997507 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01474a-ca10-447a-ba96-590422104415 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:53.008086 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01474a-ca10-447a-ba96-590422104415 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:53.009917 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01474a-ca10-447a-ba96-590422104415 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:53.019280 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2668/5370] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:21:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 04 01:21:53.024721 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2703/5371] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:53.029034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01474a-ca10-447a-ba96-590422104415 service swift] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:53.048864 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01474a-ca10-447a-ba96-590422104415 service swift] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:53.055845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7c2ee-be69-4869-9d48-39a5b5d575f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:53.056578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7c2ee-be69-4869-9d48-39a5b5d575f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:53.056853 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7c2ee-be69-4869-9d48-39a5b5d575f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:53.057128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7c2ee-be69-4869-9d48-39a5b5d575f5 admin admin] PATH_INFO: `/v3/projects/cdfe664ab6e842728f30249d9c09bcd8/users/57d9bccfc0204a7abc48bf80b4f59f06/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:53.085722 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7c2ee-be69-4869-9d48-39a5b5d575f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdfe664ab6e842728f30249d9c09bcd8, user_id=57d9bccfc0204a7abc48bf80b4f59f06, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:53.088577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7c2ee-be69-4869-9d48-39a5b5d575f5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:53.114738 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:53.121589 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2669/5372] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:21:53 2022] PUT /identity/v3/projects/cdfe664ab6e842728f30249d9c09bcd8/users/57d9bccfc0204a7abc48bf80b4f59f06/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:53.132289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb0010-148a-454b-ad20-22f747dce28a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:53.132636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb0010-148a-454b-ad20-22f747dce28a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:53.133006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb0010-148a-454b-ad20-22f747dce28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:53.214090 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-25fb0010-148a-454b-ad20-22f747dce28a None None] MFA Rules not processed for user `57d9bccfc0204a7abc48bf80b4f59f06`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:53.215589 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-25fb0010-148a-454b-ad20-22f747dce28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:53.405142 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2704/5373] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:53.411209 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7c2ee-be69-4869-9d48-39a5b5d575f5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:53.581830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7c2ee-be69-4869-9d48-39a5b5d575f5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:53.598599 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec91028-f9bc-4942-a9fa-d1070f0c1733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:53.599652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec91028-f9bc-4942-a9fa-d1070f0c1733 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:53.600092 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec91028-f9bc-4942-a9fa-d1070f0c1733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:53.600530 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec91028-f9bc-4942-a9fa-d1070f0c1733 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:53.602071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec91028-f9bc-4942-a9fa-d1070f0c1733 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:53.607095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec91028-f9bc-4942-a9fa-d1070f0c1733 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:53.662319 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2670/5374] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:21:53 2022] POST /identity/v3/projects => generated 389 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:53.666114 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb0010-148a-454b-ad20-22f747dce28a None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:53.680589 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb0010-148a-454b-ad20-22f747dce28a None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:53.709922 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:53.735453 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00e515-cc98-4206-9d23-3ceb877d8eda None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:53.735741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00e515-cc98-4206-9d23-3ceb877d8eda None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:53.736022 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00e515-cc98-4206-9d23-3ceb877d8eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:53.761002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87213de7-5e18-4f20-809e-bb9cf046b3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:53.761669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87213de7-5e18-4f20-809e-bb9cf046b3ec admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:53.762154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87213de7-5e18-4f20-809e-bb9cf046b3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:53.762599 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87213de7-5e18-4f20-809e-bb9cf046b3ec admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:53.763435 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87213de7-5e18-4f20-809e-bb9cf046b3ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:53.766099 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87213de7-5e18-4f20-809e-bb9cf046b3ec admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:53.768703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-9e00e515-cc98-4206-9d23-3ceb877d8eda None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:53.770433 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9e00e515-cc98-4206-9d23-3ceb877d8eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:53.798179 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2705/5375] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:21:53 2022] POST /identity/v3/users => generated 301 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:21:53.801827 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87213de7-5e18-4f20-809e-bb9cf046b3ec admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:53.819114 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87213de7-5e18-4f20-809e-bb9cf046b3ec admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:53.844797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55e815-751a-4734-98db-979b2e31ec02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:53.846022 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55e815-751a-4734-98db-979b2e31ec02 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:53.846308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55e815-751a-4734-98db-979b2e31ec02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:53.846588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55e815-751a-4734-98db-979b2e31ec02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:53.847844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55e815-751a-4734-98db-979b2e31ec02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:53.849568 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55e815-751a-4734-98db-979b2e31ec02 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:53.862976 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2706/5376] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:21:53.867328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55e815-751a-4734-98db-979b2e31ec02 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:53.880348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55e815-751a-4734-98db-979b2e31ec02 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:53.889311 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4f045-cedb-4cbb-b24a-432d19ccd9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:53.890444 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4f045-cedb-4cbb-b24a-432d19ccd9a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:53.890920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4f045-cedb-4cbb-b24a-432d19ccd9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:53.891361 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4f045-cedb-4cbb-b24a-432d19ccd9a5 admin admin] PATH_INFO: `/v3/projects/f48a5c790986432e9876e7576315be50/users/a8ab14aa46584361885fcd1c038591b2/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:53.911741 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2671/5377] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:21:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:53.914249 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00e515-cc98-4206-9d23-3ceb877d8eda None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:53.916948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4f045-cedb-4cbb-b24a-432d19ccd9a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f48a5c790986432e9876e7576315be50, user_id=a8ab14aa46584361885fcd1c038591b2, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:53.920365 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4f045-cedb-4cbb-b24a-432d19ccd9a5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:53.952431 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2707/5378] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:21:53 2022] PUT /identity/v3/projects/f48a5c790986432e9876e7576315be50/users/a8ab14aa46584361885fcd1c038591b2/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:21:53.956734 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4f045-cedb-4cbb-b24a-432d19ccd9a5 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:54.065393 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00e515-cc98-4206-9d23-3ceb877d8eda None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:54.119462 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:54.172057 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4f045-cedb-4cbb-b24a-432d19ccd9a5 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:54.198407 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0c40e-497e-476f-a372-541456799c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:54.199301 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0c40e-497e-476f-a372-541456799c17 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:54.199852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0c40e-497e-476f-a372-541456799c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:54.200846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0c40e-497e-476f-a372-541456799c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:54.202289 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d323e-5eff-4034-b8bd-c41419a5a59e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:54.202976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d323e-5eff-4034-b8bd-c41419a5a59e service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:54.203226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d323e-5eff-4034-b8bd-c41419a5a59e service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:54.203506 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d323e-5eff-4034-b8bd-c41419a5a59e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:54.218700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b0c40e-497e-476f-a372-541456799c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:54.220855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b0c40e-497e-476f-a372-541456799c17 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:54.246837 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2708/5379] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:21:54.247916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0c40e-497e-476f-a372-541456799c17 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:54.271379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0c40e-497e-476f-a372-541456799c17 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:54.285252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaae4d7-de1d-489a-92b7-65cd7f8c7f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:54.287193 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaae4d7-de1d-489a-92b7-65cd7f8c7f92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:54.288021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaae4d7-de1d-489a-92b7-65cd7f8c7f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:54.288021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaae4d7-de1d-489a-92b7-65cd7f8c7f92 admin admin] PATH_INFO: `/v3/projects/f48a5c790986432e9876e7576315be50/users/a8ab14aa46584361885fcd1c038591b2/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:54.294790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaae4d7-de1d-489a-92b7-65cd7f8c7f92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f48a5c790986432e9876e7576315be50, user_id=a8ab14aa46584361885fcd1c038591b2, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:54.303183 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaae4d7-de1d-489a-92b7-65cd7f8c7f92 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:54.336016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d323e-5eff-4034-b8bd-c41419a5a59e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:54.337660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d323e-5eff-4034-b8bd-c41419a5a59e service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:54.345192 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2709/5380] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:21:54 2022] PUT /identity/v3/projects/f48a5c790986432e9876e7576315be50/users/a8ab14aa46584361885fcd1c038591b2/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:54.348369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc7fee-d4b7-45ab-a280-6d4a5ad2ef95 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:54.348369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc7fee-d4b7-45ab-a280-6d4a5ad2ef95 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:54.348369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc7fee-d4b7-45ab-a280-6d4a5ad2ef95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:54.353024 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2672/5381] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:21:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:21:54.457259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-0cbc7fee-d4b7-45ab-a280-6d4a5ad2ef95 None None] MFA Rules not processed for user `a8ab14aa46584361885fcd1c038591b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:54.458880 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0cbc7fee-d4b7-45ab-a280-6d4a5ad2ef95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:54.576668 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:54.620914 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2710/5382] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:54 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:54.625617 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d323e-5eff-4034-b8bd-c41419a5a59e service swift] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:54.768832 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d323e-5eff-4034-b8bd-c41419a5a59e service swift] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:54.775764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e949c-7da6-4687-b0f6-7827b339162c tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ab14aa46584361885fcd1c038591b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f48a5c790986432e9876e7576315be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:54.776466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e949c-7da6-4687-b0f6-7827b339162c tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:54.777902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e949c-7da6-4687-b0f6-7827b339162c tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:54.778194 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e949c-7da6-4687-b0f6-7827b339162c tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] PATH_INFO: `/v3/projects/cdfe664ab6e842728f30249d9c09bcd8` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:54.779374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e949c-7da6-4687-b0f6-7827b339162c tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: Authorizing `identity:get_project(project_id=cdfe664ab6e842728f30249d9c09bcd8)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:54.781530 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e949c-7da6-4687-b0f6-7827b339162c tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:54.783482 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2673/5383] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:21:54 2022] GET /identity/v3/projects/cdfe664ab6e842728f30249d9c09bcd8 => generated 387 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:21:54.787424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc7fee-d4b7-45ab-a280-6d4a5ad2ef95 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:54.798795 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc7fee-d4b7-45ab-a280-6d4a5ad2ef95 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:54.804935 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c1d52-9205-4bd7-8a6e-8589d89cf5d1 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ab14aa46584361885fcd1c038591b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f48a5c790986432e9876e7576315be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:54.805708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c1d52-9205-4bd7-8a6e-8589d89cf5d1 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:54.806077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c1d52-9205-4bd7-8a6e-8589d89cf5d1 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:54.806468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c1d52-9205-4bd7-8a6e-8589d89cf5d1 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:54.808129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2cfbe-1c42-4164-ad6d-4efae2b22294 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:54.808680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2cfbe-1c42-4164-ad6d-4efae2b22294 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:54.809015 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2cfbe-1c42-4164-ad6d-4efae2b22294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:54.813625 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c1d52-9205-4bd7-8a6e-8589d89cf5d1 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:54.820523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c1d52-9205-4bd7-8a6e-8589d89cf5d1 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:54.844402 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c0e2cfbe-1c42-4164-ad6d-4efae2b22294 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:54.846933 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c0e2cfbe-1c42-4164-ad6d-4efae2b22294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:54.875419 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2711/5384] 10.222.0.30 () {60 vars in 1152 bytes} [Sun Sep 4 01:21:54 2022] POST /identity/v3/projects => generated 339 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:21:54.876662 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c1d52-9205-4bd7-8a6e-8589d89cf5d1 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:54.984828 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2674/5385] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:21:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:55.000192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e2cfbe-1c42-4164-ad6d-4efae2b22294 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:55.013755 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c1d52-9205-4bd7-8a6e-8589d89cf5d1 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:55.020160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf38b8a-c9f3-4cf1-84f9-f703fb4958c5 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ab14aa46584361885fcd1c038591b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f48a5c790986432e9876e7576315be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:55.020803 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf38b8a-c9f3-4cf1-84f9-f703fb4958c5 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:55.021091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf38b8a-c9f3-4cf1-84f9-f703fb4958c5 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:55.021531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf38b8a-c9f3-4cf1-84f9-f703fb4958c5 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:55.023747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf38b8a-c9f3-4cf1-84f9-f703fb4958c5 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:55.026449 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf38b8a-c9f3-4cf1-84f9-f703fb4958c5 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:55.046148 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:55.073321 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2712/5386] 10.222.0.30 () {58 vars in 1131 bytes} [Sun Sep 4 01:21:54 2022] GET /identity/v3/projects => generated 6933 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:55.078314 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf38b8a-c9f3-4cf1-84f9-f703fb4958c5 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:55.097916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf38b8a-c9f3-4cf1-84f9-f703fb4958c5 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:55.108029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b110cb-f1a3-40e3-b7b9-048fd90546a3 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ab14aa46584361885fcd1c038591b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f48a5c790986432e9876e7576315be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:55.109067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b110cb-f1a3-40e3-b7b9-048fd90546a3 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:55.109463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b110cb-f1a3-40e3-b7b9-048fd90546a3 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:55.109925 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b110cb-f1a3-40e3-b7b9-048fd90546a3 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] PATH_INFO: `/v3/projects/cdfe664ab6e842728f30249d9c09bcd8` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:55.111540 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b110cb-f1a3-40e3-b7b9-048fd90546a3 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: Authorizing `identity:get_project(project_id=cdfe664ab6e842728f30249d9c09bcd8)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:55.117189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b110cb-f1a3-40e3-b7b9-048fd90546a3 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:55.120536 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2713/5387] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:21:55 2022] GET /identity/v3/projects/cdfe664ab6e842728f30249d9c09bcd8 => generated 387 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:21:55.124729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b110cb-f1a3-40e3-b7b9-048fd90546a3 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:55.154643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b110cb-f1a3-40e3-b7b9-048fd90546a3 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:55.172597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028c8b6-cc05-484c-8168-870e04f46595 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ab14aa46584361885fcd1c038591b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f48a5c790986432e9876e7576315be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:55.174609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028c8b6-cc05-484c-8168-870e04f46595 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:55.177083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028c8b6-cc05-484c-8168-870e04f46595 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:55.178543 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028c8b6-cc05-484c-8168-870e04f46595 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] PATH_INFO: `/v3/projects/883ce18d0ec24a478a0eca1505a9477f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:55.184924 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028c8b6-cc05-484c-8168-870e04f46595 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: Authorizing `identity:get_project(project_id=883ce18d0ec24a478a0eca1505a9477f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:55.193886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028c8b6-cc05-484c-8168-870e04f46595 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:55.201640 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e2cfbe-1c42-4164-ad6d-4efae2b22294 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:55.203890 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2714/5388] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:21:55 2022] GET /identity/v3/projects/883ce18d0ec24a478a0eca1505a9477f => generated 339 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:21:55.209326 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028c8b6-cc05-484c-8168-870e04f46595 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:55.243153 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028c8b6-cc05-484c-8168-870e04f46595 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:55.261974 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8791f53-c04c-4e68-9281-cefc5db31340 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ab14aa46584361885fcd1c038591b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f48a5c790986432e9876e7576315be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:55.265084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8791f53-c04c-4e68-9281-cefc5db31340 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:55.265084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8791f53-c04c-4e68-9281-cefc5db31340 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:55.265084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8791f53-c04c-4e68-9281-cefc5db31340 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:55.265765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8791f53-c04c-4e68-9281-cefc5db31340 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:55.267655 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8791f53-c04c-4e68-9281-cefc5db31340 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:55.329112 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2715/5389] 10.222.0.30 () {58 vars in 1131 bytes} [Sun Sep 4 01:21:55 2022] GET /identity/v3/projects => generated 6933 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:55.334172 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8791f53-c04c-4e68-9281-cefc5db31340 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:55.355441 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8791f53-c04c-4e68-9281-cefc5db31340 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:55.368764 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f96df-a4ba-47a2-8b77-5558c4179c04 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ab14aa46584361885fcd1c038591b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f48a5c790986432e9876e7576315be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:55.369500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f96df-a4ba-47a2-8b77-5558c4179c04 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:55.369864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f96df-a4ba-47a2-8b77-5558c4179c04 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:55.370137 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f96df-a4ba-47a2-8b77-5558c4179c04 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:55.370832 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f96df-a4ba-47a2-8b77-5558c4179c04 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:21:55.371141 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f96df-a4ba-47a2-8b77-5558c4179c04 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:55.378738 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f96df-a4ba-47a2-8b77-5558c4179c04 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:55.443049 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe38fd-2eb8-499c-a697-f8ad8167a5d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:55.443724 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe38fd-2eb8-499c-a697-f8ad8167a5d1 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:55.444028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe38fd-2eb8-499c-a697-f8ad8167a5d1 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:55.446199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe38fd-2eb8-499c-a697-f8ad8167a5d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:55.487448 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2716/5390] 10.222.0.30 () {58 vars in 1166 bytes} [Sun Sep 4 01:21:55 2022] GET /identity/v3/projects?domain_id=default => generated 6602 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:55.492219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f96df-a4ba-47a2-8b77-5558c4179c04 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:55.510952 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f96df-a4ba-47a2-8b77-5558c4179c04 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:55.530017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb333f9a-62be-4be1-9160-bc43ea3ffa66 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ab14aa46584361885fcd1c038591b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f48a5c790986432e9876e7576315be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:55.530655 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb333f9a-62be-4be1-9160-bc43ea3ffa66 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:55.530947 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb333f9a-62be-4be1-9160-bc43ea3ffa66 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:55.531568 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb333f9a-62be-4be1-9160-bc43ea3ffa66 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:55.532256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb333f9a-62be-4be1-9160-bc43ea3ffa66 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:55.541657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb333f9a-62be-4be1-9160-bc43ea3ffa66 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:55.585881 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2717/5391] 10.222.0.30 () {58 vars in 1131 bytes} [Sun Sep 4 01:21:55 2022] GET /identity/v3/projects => generated 6933 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:55.589039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb333f9a-62be-4be1-9160-bc43ea3ffa66 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:55.609133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb333f9a-62be-4be1-9160-bc43ea3ffa66 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:55.615962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd2610-a4e6-47f1-bed5-6bfe9edd60fc tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ab14aa46584361885fcd1c038591b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f48a5c790986432e9876e7576315be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:55.616228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd2610-a4e6-47f1-bed5-6bfe9edd60fc tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:55.616700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd2610-a4e6-47f1-bed5-6bfe9edd60fc tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:55.617073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd2610-a4e6-47f1-bed5-6bfe9edd60fc tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:55.618037 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd2610-a4e6-47f1-bed5-6bfe9edd60fc tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:21:55.618439 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd2610-a4e6-47f1-bed5-6bfe9edd60fc tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:55.621992 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd2610-a4e6-47f1-bed5-6bfe9edd60fc tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:55.636732 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe38fd-2eb8-499c-a697-f8ad8167a5d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:55.644089 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe38fd-2eb8-499c-a697-f8ad8167a5d1 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:55.662699 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2718/5392] 10.222.0.30 () {58 vars in 1166 bytes} [Sun Sep 4 01:21:55 2022] GET /identity/v3/projects?domain_id=default => generated 6602 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:21:55.669777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd2610-a4e6-47f1-bed5-6bfe9edd60fc tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:55.673295 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2675/5393] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:21:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:21:55.687462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd2610-a4e6-47f1-bed5-6bfe9edd60fc tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:55.721838 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc9077-fc53-4aac-9dcd-f34b5409d085 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ab14aa46584361885fcd1c038591b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f48a5c790986432e9876e7576315be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:55.722772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc9077-fc53-4aac-9dcd-f34b5409d085 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:55.723141 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc9077-fc53-4aac-9dcd-f34b5409d085 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:55.723486 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc9077-fc53-4aac-9dcd-f34b5409d085 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:55.726646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc9077-fc53-4aac-9dcd-f34b5409d085 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:55.730756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc9077-fc53-4aac-9dcd-f34b5409d085 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:55.781677 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2719/5394] 10.222.0.30 () {58 vars in 1131 bytes} [Sun Sep 4 01:21:55 2022] GET /identity/v3/projects => generated 6933 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:21:55.786669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe38fd-2eb8-499c-a697-f8ad8167a5d1 service swift] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:55.806488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe38fd-2eb8-499c-a697-f8ad8167a5d1 service swift] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:55.820721 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86921d49-ed77-47ab-ad62-831cf756b458 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ab14aa46584361885fcd1c038591b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f48a5c790986432e9876e7576315be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:55.822721 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86921d49-ed77-47ab-ad62-831cf756b458 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:55.823270 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86921d49-ed77-47ab-ad62-831cf756b458 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:55.823778 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86921d49-ed77-47ab-ad62-831cf756b458 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:55.824707 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86921d49-ed77-47ab-ad62-831cf756b458 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-545132424) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:21:55.825403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86921d49-ed77-47ab-ad62-831cf756b458 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:55.828830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86921d49-ed77-47ab-ad62-831cf756b458 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:55.866755 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2676/5395] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:21:55 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-545132424 => generated 534 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:21:55.871777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc9077-fc53-4aac-9dcd-f34b5409d085 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:55.902377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc9077-fc53-4aac-9dcd-f34b5409d085 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:55.914290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600b9e1-e20e-4496-a7bc-d929e558234b tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ab14aa46584361885fcd1c038591b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f48a5c790986432e9876e7576315be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:55.915368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600b9e1-e20e-4496-a7bc-d929e558234b tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:55.915839 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600b9e1-e20e-4496-a7bc-d929e558234b tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:55.916342 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600b9e1-e20e-4496-a7bc-d929e558234b tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] PATH_INFO: `/v3/projects/883ce18d0ec24a478a0eca1505a9477f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:55.917884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600b9e1-e20e-4496-a7bc-d929e558234b tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: Authorizing `identity:delete_project(project_id=883ce18d0ec24a478a0eca1505a9477f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:55.923846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600b9e1-e20e-4496-a7bc-d929e558234b tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:56.019974 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:56.049851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e600b9e1-e20e-4496-a7bc-d929e558234b tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '883ce18d0ec24a478a0eca1505a9477f', 'request_id': 'req-e600b9e1-e20e-4496-a7bc-d929e558234b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:56.083308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e600b9e1-e20e-4496-a7bc-d929e558234b tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '883ce18d0ec24a478a0eca1505a9477f', 'request_id': 'req-e600b9e1-e20e-4496-a7bc-d929e558234b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:56.104336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e600b9e1-e20e-4496-a7bc-d929e558234b tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '883ce18d0ec24a478a0eca1505a9477f', 'request_id': 'req-e600b9e1-e20e-4496-a7bc-d929e558234b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:56.162334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e600b9e1-e20e-4496-a7bc-d929e558234b tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] The token cache is being invalidate because project 883ce18d0ec24a478a0eca1505a9477f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:56.162681 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e600b9e1-e20e-4496-a7bc-d929e558234b tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:56.166028 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e600b9e1-e20e-4496-a7bc-d929e558234b tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:56.172509 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2720/5396] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:21:55 2022] DELETE /identity/v3/projects/883ce18d0ec24a478a0eca1505a9477f => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:56.177929 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86921d49-ed77-47ab-ad62-831cf756b458 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:56.183043 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-86921d49-ed77-47ab-ad62-831cf756b458 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:56.316448 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:56.363947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86921d49-ed77-47ab-ad62-831cf756b458 tempest-ListProjectsStaticTestJSON-1460039231 tempest-ListProjectsStaticTestJSON-1460039231-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:56.364526 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e4c62-1408-42b5-9514-e7fdd1ce12f1 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:56.365120 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e4c62-1408-42b5-9514-e7fdd1ce12f1 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:56.367034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e4c62-1408-42b5-9514-e7fdd1ce12f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:56.399974 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-6b6e4c62-1408-42b5-9514-e7fdd1ce12f1 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:56.401957 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6b6e4c62-1408-42b5-9514-e7fdd1ce12f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:56.569694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa06ac5-51a6-40b4-a172-ceab8ad3b902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:56.570070 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa06ac5-51a6-40b4-a172-ceab8ad3b902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:56.570322 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa06ac5-51a6-40b4-a172-ceab8ad3b902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:56.591751 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa06ac5-51a6-40b4-a172-ceab8ad3b902 admin admin] PATH_INFO: `/v3/users/57d9bccfc0204a7abc48bf80b4f59f06` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:56.595140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa06ac5-51a6-40b4-a172-ceab8ad3b902 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57d9bccfc0204a7abc48bf80b4f59f06)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:56.597116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa06ac5-51a6-40b4-a172-ceab8ad3b902 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:56.664604 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2721/5397] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 01:21:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:56.665745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e4c62-1408-42b5-9514-e7fdd1ce12f1 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:56.667307 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6b6e4c62-1408-42b5-9514-e7fdd1ce12f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:56.744649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2fa06ac5-51a6-40b4-a172-ceab8ad3b902 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57d9bccfc0204a7abc48bf80b4f59f06'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:56.745558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2fa06ac5-51a6-40b4-a172-ceab8ad3b902 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57d9bccfc0204a7abc48bf80b4f59f06'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:56.756216 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2fa06ac5-51a6-40b4-a172-ceab8ad3b902 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57d9bccfc0204a7abc48bf80b4f59f06'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:56.775487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2fa06ac5-51a6-40b4-a172-ceab8ad3b902 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57d9bccfc0204a7abc48bf80b4f59f06'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:56.776350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2fa06ac5-51a6-40b4-a172-ceab8ad3b902 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57d9bccfc0204a7abc48bf80b4f59f06'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:56.857764 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e4c62-1408-42b5-9514-e7fdd1ce12f1 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:56.872442 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2677/5398] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:21:56 2022] DELETE /identity/v3/users/57d9bccfc0204a7abc48bf80b4f59f06 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:56.876557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c700866-b5e8-4d45-a0a1-40c655cc5510 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:56.876760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c700866-b5e8-4d45-a0a1-40c655cc5510 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:56.877002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c700866-b5e8-4d45-a0a1-40c655cc5510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:56.886090 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd696ba2-a796-45d8-a1a3-a6a83c9a162d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:56.888378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd696ba2-a796-45d8-a1a3-a6a83c9a162d service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:56.889245 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd696ba2-a796-45d8-a1a3-a6a83c9a162d service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:56.889929 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd696ba2-a796-45d8-a1a3-a6a83c9a162d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:56.893513 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-bd696ba2-a796-45d8-a1a3-a6a83c9a162d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:56.907853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd696ba2-a796-45d8-a1a3-a6a83c9a162d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:56.909794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd696ba2-a796-45d8-a1a3-a6a83c9a162d service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:56.920355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-2c700866-b5e8-4d45-a0a1-40c655cc5510 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:56.920845 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2722/5399] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:21:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:21:56.923429 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2c700866-b5e8-4d45-a0a1-40c655cc5510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:57.053592 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2678/5400] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:57.064305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd696ba2-a796-45d8-a1a3-a6a83c9a162d service swift] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:57.066649 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-bd696ba2-a796-45d8-a1a3-a6a83c9a162d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:57.174581 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd696ba2-a796-45d8-a1a3-a6a83c9a162d service swift] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:57.201700 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:57.241844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef77fa-b60e-4828-8258-61b237dd48c8 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:57.243252 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef77fa-b60e-4828-8258-61b237dd48c8 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:57.243610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef77fa-b60e-4828-8258-61b237dd48c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:57.280087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c3ef77fa-b60e-4828-8258-61b237dd48c8 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:57.281725 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c3ef77fa-b60e-4828-8258-61b237dd48c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:57.286429 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438615e0-8929-4956-80d5-1b38640ac4a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:57.287320 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438615e0-8929-4956-80d5-1b38640ac4a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:57.288361 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438615e0-8929-4956-80d5-1b38640ac4a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:57.288852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438615e0-8929-4956-80d5-1b38640ac4a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:57.310151 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:57.314839 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438615e0-8929-4956-80d5-1b38640ac4a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:57.317839 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438615e0-8929-4956-80d5-1b38640ac4a2 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:57.347494 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2723/5401] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:21:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:21:57.480139 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2679/5402] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 01:21:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:57.481392 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438615e0-8929-4956-80d5-1b38640ac4a2 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:57.483310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-438615e0-8929-4956-80d5-1b38640ac4a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:57.667420 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438615e0-8929-4956-80d5-1b38640ac4a2 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:57.682504 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0fe22-31f1-4da5-8190-1e516ef5bb03 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:57.683243 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0fe22-31f1-4da5-8190-1e516ef5bb03 service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:57.683599 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0fe22-31f1-4da5-8190-1e516ef5bb03 service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:57.684585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0fe22-31f1-4da5-8190-1e516ef5bb03 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:57.704188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0fe22-31f1-4da5-8190-1e516ef5bb03 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:57.707295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0fe22-31f1-4da5-8190-1e516ef5bb03 service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:57.729973 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2724/5403] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:21:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:21:57.937992 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef77fa-b60e-4828-8258-61b237dd48c8 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:57.939789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c3ef77fa-b60e-4828-8258-61b237dd48c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:58.009236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef77fa-b60e-4828-8258-61b237dd48c8 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:58.010550 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0fe22-31f1-4da5-8190-1e516ef5bb03 service swift] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:58.012531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d0c0fe22-31f1-4da5-8190-1e516ef5bb03 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:58.019035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d512dce-13c2-4a8c-a976-97353950781c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:58.027935 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d512dce-13c2-4a8c-a976-97353950781c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:58.028970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d512dce-13c2-4a8c-a976-97353950781c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:58.029363 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d512dce-13c2-4a8c-a976-97353950781c admin admin] PATH_INFO: `/v3/projects/cdfe664ab6e842728f30249d9c09bcd8` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:58.033114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d512dce-13c2-4a8c-a976-97353950781c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdfe664ab6e842728f30249d9c09bcd8)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:58.035726 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d512dce-13c2-4a8c-a976-97353950781c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:58.050059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0fe22-31f1-4da5-8190-1e516ef5bb03 service swift] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:58.074031 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3fac8f-cab3-4a54-a099-ec213ee0f64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:58.074783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fac8f-cab3-4a54-a099-ec213ee0f64d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:58.075255 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fac8f-cab3-4a54-a099-ec213ee0f64d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:58.075548 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fac8f-cab3-4a54-a099-ec213ee0f64d admin admin] PATH_INFO: `/v3/users/f23406801b2c41d89c846ed1e493a480` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:58.077761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3fac8f-cab3-4a54-a099-ec213ee0f64d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f23406801b2c41d89c846ed1e493a480)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:58.080412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3fac8f-cab3-4a54-a099-ec213ee0f64d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:58.145998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0d512dce-13c2-4a8c-a976-97353950781c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdfe664ab6e842728f30249d9c09bcd8', 'request_id': 'req-0d512dce-13c2-4a8c-a976-97353950781c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:58.167075 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0d512dce-13c2-4a8c-a976-97353950781c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdfe664ab6e842728f30249d9c09bcd8', 'request_id': 'req-0d512dce-13c2-4a8c-a976-97353950781c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:58.178310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0d512dce-13c2-4a8c-a976-97353950781c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdfe664ab6e842728f30249d9c09bcd8', 'request_id': 'req-0d512dce-13c2-4a8c-a976-97353950781c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:58.206021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fa3fac8f-cab3-4a54-a099-ec213ee0f64d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f23406801b2c41d89c846ed1e493a480'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:58.207529 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fa3fac8f-cab3-4a54-a099-ec213ee0f64d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f23406801b2c41d89c846ed1e493a480'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:58.217860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0d512dce-13c2-4a8c-a976-97353950781c admin admin] The token cache is being invalidate because project cdfe664ab6e842728f30249d9c09bcd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:58.219495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0d512dce-13c2-4a8c-a976-97353950781c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:58.224243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0d512dce-13c2-4a8c-a976-97353950781c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:58.229576 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2680/5404] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:21:57 2022] DELETE /identity/v3/projects/cdfe664ab6e842728f30249d9c09bcd8 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:58.230718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d512dce-13c2-4a8c-a976-97353950781c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:58.230895 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fa3fac8f-cab3-4a54-a099-ec213ee0f64d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f23406801b2c41d89c846ed1e493a480'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:58.234595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0d512dce-13c2-4a8c-a976-97353950781c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:58.251777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fa3fac8f-cab3-4a54-a099-ec213ee0f64d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f23406801b2c41d89c846ed1e493a480'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:58.253236 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fa3fac8f-cab3-4a54-a099-ec213ee0f64d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f23406801b2c41d89c846ed1e493a480'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:58.314325 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2725/5405] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:21:58 2022] DELETE /identity/v3/users/f23406801b2c41d89c846ed1e493a480 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:58.316108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933abf3-a073-4d79-9ea6-1b6e72d2e3ab None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:58.316398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933abf3-a073-4d79-9ea6-1b6e72d2e3ab None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:58.316677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933abf3-a073-4d79-9ea6-1b6e72d2e3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:58.352497 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a933abf3-a073-4d79-9ea6-1b6e72d2e3ab None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:21:58.354502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a933abf3-a073-4d79-9ea6-1b6e72d2e3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:58.401762 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:58.401994 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d512dce-13c2-4a8c-a976-97353950781c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:58.498954 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2726/5406] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:21:58.513659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933abf3-a073-4d79-9ea6-1b6e72d2e3ab None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:58.515327 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a933abf3-a073-4d79-9ea6-1b6e72d2e3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:21:58.550287 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:58.571945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18890d6f-ee9b-4af4-aea7-442a0b934411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:58.573067 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18890d6f-ee9b-4af4-aea7-442a0b934411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:58.573600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18890d6f-ee9b-4af4-aea7-442a0b934411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:58.574299 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18890d6f-ee9b-4af4-aea7-442a0b934411 admin admin] PATH_INFO: `/v3/users/a8ab14aa46584361885fcd1c038591b2` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:58.575722 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18890d6f-ee9b-4af4-aea7-442a0b934411 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8ab14aa46584361885fcd1c038591b2)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:58.578192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18890d6f-ee9b-4af4-aea7-442a0b934411 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:58.606910 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933abf3-a073-4d79-9ea6-1b6e72d2e3ab None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:58.613144 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13fc87-af8b-4b99-ab3b-a8a4057640f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:58.614057 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13fc87-af8b-4b99-ab3b-a8a4057640f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:58.614334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13fc87-af8b-4b99-ab3b-a8a4057640f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:58.614602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13fc87-af8b-4b99-ab3b-a8a4057640f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:58.626961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13fc87-af8b-4b99-ab3b-a8a4057640f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:58.630026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13fc87-af8b-4b99-ab3b-a8a4057640f2 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:58.644009 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2727/5407] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:21:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:21:58.690647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-18890d6f-ee9b-4af4-aea7-442a0b934411 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8ab14aa46584361885fcd1c038591b2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:58.691639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-18890d6f-ee9b-4af4-aea7-442a0b934411 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8ab14aa46584361885fcd1c038591b2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:58.702660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-18890d6f-ee9b-4af4-aea7-442a0b934411 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8ab14aa46584361885fcd1c038591b2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:58.725146 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-18890d6f-ee9b-4af4-aea7-442a0b934411 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8ab14aa46584361885fcd1c038591b2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:58.725913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-18890d6f-ee9b-4af4-aea7-442a0b934411 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8ab14aa46584361885fcd1c038591b2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:58.763930 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2681/5408] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:21:58 2022] DELETE /identity/v3/users/a8ab14aa46584361885fcd1c038591b2 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:59.581945 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13fc87-af8b-4b99-ab3b-a8a4057640f2 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:21:59.593755 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13fc87-af8b-4b99-ab3b-a8a4057640f2 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:21:59.792970 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53da2b2-ee9b-41f5-a0b9-fe4b511f99d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:21:59.793658 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53da2b2-ee9b-41f5-a0b9-fe4b511f99d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:59.793937 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53da2b2-ee9b-41f5-a0b9-fe4b511f99d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:59.794209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53da2b2-ee9b-41f5-a0b9-fe4b511f99d8 admin admin] PATH_INFO: `/v3/projects/f48a5c790986432e9876e7576315be50` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:21:59.797301 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53da2b2-ee9b-41f5-a0b9-fe4b511f99d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f48a5c790986432e9876e7576315be50)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:21:59.798673 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53da2b2-ee9b-41f5-a0b9-fe4b511f99d8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:21:59.923657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c53da2b2-ee9b-41f5-a0b9-fe4b511f99d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f48a5c790986432e9876e7576315be50', 'request_id': 'req-c53da2b2-ee9b-41f5-a0b9-fe4b511f99d8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:59.944457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c53da2b2-ee9b-41f5-a0b9-fe4b511f99d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f48a5c790986432e9876e7576315be50', 'request_id': 'req-c53da2b2-ee9b-41f5-a0b9-fe4b511f99d8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:59.952298 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c53da2b2-ee9b-41f5-a0b9-fe4b511f99d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f48a5c790986432e9876e7576315be50', 'request_id': 'req-c53da2b2-ee9b-41f5-a0b9-fe4b511f99d8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:59.968938 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:59.996506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c53da2b2-ee9b-41f5-a0b9-fe4b511f99d8 admin admin] The token cache is being invalidate because project f48a5c790986432e9876e7576315be50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:21:59.996506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c53da2b2-ee9b-41f5-a0b9-fe4b511f99d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:59.996506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c53da2b2-ee9b-41f5-a0b9-fe4b511f99d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:21:59.996506 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2728/5409] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:21:59 2022] DELETE /identity/v3/projects/f48a5c790986432e9876e7576315be50 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:21:59.997128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fafe0-0a79-4f5d-a8be-10e9765958e3 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:21:59.997128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fafe0-0a79-4f5d-a8be-10e9765958e3 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:21:59.997128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fafe0-0a79-4f5d-a8be-10e9765958e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:00.034539 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-244fafe0-0a79-4f5d-a8be-10e9765958e3 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:00.035779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-244fafe0-0a79-4f5d-a8be-10e9765958e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:00.194717 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2682/5410] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:00.200933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200af70-30c1-4ca3-8340-336c56709462 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:00.201211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200af70-30c1-4ca3-8340-336c56709462 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:00.201530 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200af70-30c1-4ca3-8340-336c56709462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:00.240339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-6200af70-30c1-4ca3-8340-336c56709462 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:00.242148 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6200af70-30c1-4ca3-8340-336c56709462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:00.251163 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2729/5411] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:00.255211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fafe0-0a79-4f5d-a8be-10e9765958e3 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:00.274014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fafe0-0a79-4f5d-a8be-10e9765958e3 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:00.289222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb5771-bb1d-4a23-93ea-631e909ca7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:00.291165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb5771-bb1d-4a23-93ea-631e909ca7e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:00.291165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb5771-bb1d-4a23-93ea-631e909ca7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:00.291165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb5771-bb1d-4a23-93ea-631e909ca7e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:00.291589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb5771-bb1d-4a23-93ea-631e909ca7e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:22:00.292211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb5771-bb1d-4a23-93ea-631e909ca7e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:00.293414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200af70-30c1-4ca3-8340-336c56709462 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:00.295081 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6200af70-30c1-4ca3-8340-336c56709462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:00.312345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb5771-bb1d-4a23-93ea-631e909ca7e2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:00.318788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200af70-30c1-4ca3-8340-336c56709462 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:00.330545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205d131-627e-43a5-a612-36b0db79364c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:00.331318 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205d131-627e-43a5-a612-36b0db79364c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:00.331689 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205d131-627e-43a5-a612-36b0db79364c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:00.332060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205d131-627e-43a5-a612-36b0db79364c admin admin] PATH_INFO: `/v3/projects/3026b9ef01534d3b872429b200fc349d` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:00.334274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205d131-627e-43a5-a612-36b0db79364c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3026b9ef01534d3b872429b200fc349d)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:00.336996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205d131-627e-43a5-a612-36b0db79364c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:00.342416 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2683/5412] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:22:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:22:00.343460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb5771-bb1d-4a23-93ea-631e909ca7e2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:00.365994 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb5771-bb1d-4a23-93ea-631e909ca7e2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:00.381657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40f4e3-17d3-470b-9ba4-6a32d4875933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:00.384582 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40f4e3-17d3-470b-9ba4-6a32d4875933 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:00.386333 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40f4e3-17d3-470b-9ba4-6a32d4875933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:00.387742 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40f4e3-17d3-470b-9ba4-6a32d4875933 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:00.390587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b40f4e3-17d3-470b-9ba4-6a32d4875933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:00.394323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b40f4e3-17d3-470b-9ba4-6a32d4875933 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:00.457578 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b205d131-627e-43a5-a612-36b0db79364c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3026b9ef01534d3b872429b200fc349d', 'request_id': 'req-b205d131-627e-43a5-a612-36b0db79364c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:00.462736 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2684/5413] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:22:00 2022] POST /identity/v3/projects => generated 397 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:00.463900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40f4e3-17d3-470b-9ba4-6a32d4875933 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:00.473966 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b205d131-627e-43a5-a612-36b0db79364c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3026b9ef01534d3b872429b200fc349d', 'request_id': 'req-b205d131-627e-43a5-a612-36b0db79364c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:00.494506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b205d131-627e-43a5-a612-36b0db79364c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3026b9ef01534d3b872429b200fc349d', 'request_id': 'req-b205d131-627e-43a5-a612-36b0db79364c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:00.531279 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b205d131-627e-43a5-a612-36b0db79364c admin admin] The token cache is being invalidate because project 3026b9ef01534d3b872429b200fc349d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:22:00.531584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b205d131-627e-43a5-a612-36b0db79364c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:00.534222 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b205d131-627e-43a5-a612-36b0db79364c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:00.552485 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2730/5414] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:22:00 2022] DELETE /identity/v3/projects/3026b9ef01534d3b872429b200fc349d => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:22:00.554090 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc8bde-424f-41e0-97f2-d2783a6fcf2c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:00.554382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc8bde-424f-41e0-97f2-d2783a6fcf2c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:00.554659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc8bde-424f-41e0-97f2-d2783a6fcf2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:00.639615 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:00.651868 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c3bc8bde-424f-41e0-97f2-d2783a6fcf2c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:00.666024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c3bc8bde-424f-41e0-97f2-d2783a6fcf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:00.699816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40f4e3-17d3-470b-9ba4-6a32d4875933 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:00.718360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b422ed9-052e-4575-bd3e-5e535dea69de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:00.719460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b422ed9-052e-4575-bd3e-5e535dea69de admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:00.719943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b422ed9-052e-4575-bd3e-5e535dea69de admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:00.721050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b422ed9-052e-4575-bd3e-5e535dea69de admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:00.721835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b422ed9-052e-4575-bd3e-5e535dea69de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:00.729357 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b422ed9-052e-4575-bd3e-5e535dea69de admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:00.785654 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2731/5415] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:00.787480 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2685/5416] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:22:00 2022] POST /identity/v3/users => generated 299 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:00.791491 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc8bde-424f-41e0-97f2-d2783a6fcf2c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:00.793755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1ee2f-e28f-41e5-b481-4042cd25a2f4 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:00.794636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c3bc8bde-424f-41e0-97f2-d2783a6fcf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:00.798282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1ee2f-e28f-41e5-b481-4042cd25a2f4 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:00.798631 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1ee2f-e28f-41e5-b481-4042cd25a2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:00.838358 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc8bde-424f-41e0-97f2-d2783a6fcf2c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:00.854837 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48566eda-6a29-437f-a46f-5fa4bf2a759c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:00.855788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48566eda-6a29-437f-a46f-5fa4bf2a759c admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:00.856057 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48566eda-6a29-437f-a46f-5fa4bf2a759c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:00.856414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48566eda-6a29-437f-a46f-5fa4bf2a759c admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:00.857187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48566eda-6a29-437f-a46f-5fa4bf2a759c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:00.860636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48566eda-6a29-437f-a46f-5fa4bf2a759c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:00.861241 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-68c1ee2f-e28f-41e5-b481-4042cd25a2f4 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:00.862645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-68c1ee2f-e28f-41e5-b481-4042cd25a2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:00.872207 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2686/5417] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:00.876752 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1ee2f-e28f-41e5-b481-4042cd25a2f4 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:00.887946 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2732/5418] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:00.889249 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48566eda-6a29-437f-a46f-5fa4bf2a759c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:00.898359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1ee2f-e28f-41e5-b481-4042cd25a2f4 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:00.909391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844e25f-b6b0-4d3f-bd7d-78062f474d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:00.918906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844e25f-b6b0-4d3f-bd7d-78062f474d01 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:00.919277 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844e25f-b6b0-4d3f-bd7d-78062f474d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:00.919515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844e25f-b6b0-4d3f-bd7d-78062f474d01 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:00.920201 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844e25f-b6b0-4d3f-bd7d-78062f474d01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:22:00.920506 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844e25f-b6b0-4d3f-bd7d-78062f474d01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:00.921530 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48566eda-6a29-437f-a46f-5fa4bf2a759c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:00.922427 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844e25f-b6b0-4d3f-bd7d-78062f474d01 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:00.935628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43791bdb-a00e-4a35-a0d1-b1158f4fca8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:00.936699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43791bdb-a00e-4a35-a0d1-b1158f4fca8f admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:00.938876 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43791bdb-a00e-4a35-a0d1-b1158f4fca8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:00.940556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43791bdb-a00e-4a35-a0d1-b1158f4fca8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:00.940556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43791bdb-a00e-4a35-a0d1-b1158f4fca8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:00.942545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43791bdb-a00e-4a35-a0d1-b1158f4fca8f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:00.950609 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2687/5419] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:22:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:22:00.951703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844e25f-b6b0-4d3f-bd7d-78062f474d01 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:00.957016 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2733/5420] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:00.961996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43791bdb-a00e-4a35-a0d1-b1158f4fca8f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:00.971208 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844e25f-b6b0-4d3f-bd7d-78062f474d01 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:00.974643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43791bdb-a00e-4a35-a0d1-b1158f4fca8f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:00.980753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb18d4-3ecc-4a04-8099-4f280533a2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:00.980949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a267f-df7f-4c05-a650-9ac2e60d814b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:00.981391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb18d4-3ecc-4a04-8099-4f280533a2d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:00.981695 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb18d4-3ecc-4a04-8099-4f280533a2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:00.981954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a267f-df7f-4c05-a650-9ac2e60d814b admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:00.982066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb18d4-3ecc-4a04-8099-4f280533a2d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:00.982243 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a267f-df7f-4c05-a650-9ac2e60d814b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:00.982513 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a267f-df7f-4c05-a650-9ac2e60d814b admin admin] PATH_INFO: `/v3/projects/0fd4ae8f68b1416399f522a1768d9c16/users/0b5df7fa794e429eaa957a0141a6bd84/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:00.986574 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb18d4-3ecc-4a04-8099-4f280533a2d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:00.991787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb18d4-3ecc-4a04-8099-4f280533a2d4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:01.026140 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a267f-df7f-4c05-a650-9ac2e60d814b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fd4ae8f68b1416399f522a1768d9c16, user_id=0b5df7fa794e429eaa957a0141a6bd84, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:01.036417 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a267f-df7f-4c05-a650-9ac2e60d814b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:01.063499 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2688/5422] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:22:00 2022] POST /identity/v3/projects => generated 391 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:22:01.071003 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2734/5422] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:22:00 2022] PUT /identity/v3/projects/0fd4ae8f68b1416399f522a1768d9c16/users/0b5df7fa794e429eaa957a0141a6bd84/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:01.071778 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb18d4-3ecc-4a04-8099-4f280533a2d4 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:01.072684 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed7aad-c84d-471e-a2b2-205e2c517101 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:01.072975 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed7aad-c84d-471e-a2b2-205e2c517101 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:01.073255 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed7aad-c84d-471e-a2b2-205e2c517101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:01.109080 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-b2ed7aad-c84d-471e-a2b2-205e2c517101 None None] MFA Rules not processed for user `0b5df7fa794e429eaa957a0141a6bd84`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:01.111039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b2ed7aad-c84d-471e-a2b2-205e2c517101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:01.131070 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:01.191406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb18d4-3ecc-4a04-8099-4f280533a2d4 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:01.199497 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086fe28-2324-4d83-8590-c9d828ea9e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:01.200283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086fe28-2324-4d83-8590-c9d828ea9e47 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:01.200565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086fe28-2324-4d83-8590-c9d828ea9e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:01.200915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086fe28-2324-4d83-8590-c9d828ea9e47 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:01.201648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086fe28-2324-4d83-8590-c9d828ea9e47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:01.203893 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086fe28-2324-4d83-8590-c9d828ea9e47 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:01.219561 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2735/5423] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:01 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:01.225983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed7aad-c84d-471e-a2b2-205e2c517101 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:01.254894 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2689/5424] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:22:01 2022] POST /identity/v3/users => generated 296 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:01.256449 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086fe28-2324-4d83-8590-c9d828ea9e47 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:01.259411 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed7aad-c84d-471e-a2b2-205e2c517101 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:01.272345 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b76ed-46ff-41b6-b1eb-dd0a191d70a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:01.272984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b76ed-46ff-41b6-b1eb-dd0a191d70a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:01.273269 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b76ed-46ff-41b6-b1eb-dd0a191d70a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:01.273601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b76ed-46ff-41b6-b1eb-dd0a191d70a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:01.274598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b76ed-46ff-41b6-b1eb-dd0a191d70a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:01.276259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b76ed-46ff-41b6-b1eb-dd0a191d70a5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:01.279756 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086fe28-2324-4d83-8590-c9d828ea9e47 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:01.293016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272667f-8201-4921-9ca7-bc97d74e72f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:01.295138 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272667f-8201-4921-9ca7-bc97d74e72f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:01.295518 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272667f-8201-4921-9ca7-bc97d74e72f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:01.297802 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272667f-8201-4921-9ca7-bc97d74e72f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:01.300772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5272667f-8201-4921-9ca7-bc97d74e72f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:01.303449 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5272667f-8201-4921-9ca7-bc97d74e72f1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:01.330650 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2690/5425] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:01.332541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272667f-8201-4921-9ca7-bc97d74e72f1 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:01.336070 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2736/5426] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:22:01 2022] POST /identity/v3/projects => generated 397 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:01.338712 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b76ed-46ff-41b6-b1eb-dd0a191d70a5 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:01.349098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272667f-8201-4921-9ca7-bc97d74e72f1 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:01.431447 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad34973-5925-4f6a-a3da-8caf9f7cf868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:01.432078 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad34973-5925-4f6a-a3da-8caf9f7cf868 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:01.432399 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad34973-5925-4f6a-a3da-8caf9f7cf868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:01.432628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad34973-5925-4f6a-a3da-8caf9f7cf868 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:01.433279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad34973-5925-4f6a-a3da-8caf9f7cf868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:01.435246 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad34973-5925-4f6a-a3da-8caf9f7cf868 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:01.479624 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:01.487931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b76ed-46ff-41b6-b1eb-dd0a191d70a5 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:01.494682 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2691/5427] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:01.495563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad34973-5925-4f6a-a3da-8caf9f7cf868 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:01.508136 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da0a03-8a24-4e7a-b478-eb4037bbe097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:01.509294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da0a03-8a24-4e7a-b478-eb4037bbe097 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:01.509816 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da0a03-8a24-4e7a-b478-eb4037bbe097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:01.510273 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da0a03-8a24-4e7a-b478-eb4037bbe097 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:01.511652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad34973-5925-4f6a-a3da-8caf9f7cf868 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:01.518571 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da0a03-8a24-4e7a-b478-eb4037bbe097 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:01.521114 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da0a03-8a24-4e7a-b478-eb4037bbe097 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:01.525251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a4176-a4f9-4cc5-97a8-dd1e5043ba0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:01.526087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a4176-a4f9-4cc5-97a8-dd1e5043ba0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:01.526377 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a4176-a4f9-4cc5-97a8-dd1e5043ba0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:01.526661 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a4176-a4f9-4cc5-97a8-dd1e5043ba0c admin admin] PATH_INFO: `/v3/projects/86273f4e776d4b7b800e4ce57764c5f0/users/6b3a542a69a94937a1cd4824482908e7/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:01.550938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a4176-a4f9-4cc5-97a8-dd1e5043ba0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=86273f4e776d4b7b800e4ce57764c5f0, user_id=6b3a542a69a94937a1cd4824482908e7, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:01.555259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a4176-a4f9-4cc5-97a8-dd1e5043ba0c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:01.577494 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2737/5428] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:22:01 2022] POST /identity/v3/users => generated 305 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:01.579958 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da0a03-8a24-4e7a-b478-eb4037bbe097 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:01.589889 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2692/5429] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:22:01 2022] PUT /identity/v3/projects/86273f4e776d4b7b800e4ce57764c5f0/users/6b3a542a69a94937a1cd4824482908e7/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:01.607284 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fa547-0f44-4511-98b3-8392158f384d None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:01.607858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fa547-0f44-4511-98b3-8392158f384d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:01.608137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fa547-0f44-4511-98b3-8392158f384d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:01.611850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da0a03-8a24-4e7a-b478-eb4037bbe097 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:01.651253 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d39fa547-0f44-4511-98b3-8392158f384d None None] MFA Rules not processed for user `6b3a542a69a94937a1cd4824482908e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:01.652256 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d39fa547-0f44-4511-98b3-8392158f384d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:01.765044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45a801-2ab7-4c42-8917-658404a27df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:01.765732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45a801-2ab7-4c42-8917-658404a27df0 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:01.765999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45a801-2ab7-4c42-8917-658404a27df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:01.766273 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45a801-2ab7-4c42-8917-658404a27df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:01.766924 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc45a801-2ab7-4c42-8917-658404a27df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:01.772108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc45a801-2ab7-4c42-8917-658404a27df0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:01.792955 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2693/5430] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:01.797467 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fa547-0f44-4511-98b3-8392158f384d None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:01.818493 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2738/5431] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:01.819522 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45a801-2ab7-4c42-8917-658404a27df0 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:01.821872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fa547-0f44-4511-98b3-8392158f384d None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:01.827699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb378f-c878-49a7-b339-6b062fc7565f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:01.828832 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb378f-c878-49a7-b339-6b062fc7565f admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:01.828984 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb378f-c878-49a7-b339-6b062fc7565f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:01.829324 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb378f-c878-49a7-b339-6b062fc7565f admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:01.830792 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb378f-c878-49a7-b339-6b062fc7565f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:01.833096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb378f-c878-49a7-b339-6b062fc7565f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:01.836609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45a801-2ab7-4c42-8917-658404a27df0 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:01.852831 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ca97a-5352-457e-981e-21772a9dbdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:01.854108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ca97a-5352-457e-981e-21772a9dbdce admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:01.854108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ca97a-5352-457e-981e-21772a9dbdce admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:01.854108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ca97a-5352-457e-981e-21772a9dbdce admin admin] PATH_INFO: `/v3/projects/6a0d95fffc4041689bbeac2530278d69/users/705c375157af4a12b976fb857cbb57d3/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:01.896724 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ca97a-5352-457e-981e-21772a9dbdce admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a0d95fffc4041689bbeac2530278d69, user_id=705c375157af4a12b976fb857cbb57d3, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:01.905224 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ca97a-5352-457e-981e-21772a9dbdce admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:01.915063 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2694/5432] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:22:01 2022] POST /identity/v3/projects => generated 391 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:01.916284 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb378f-c878-49a7-b339-6b062fc7565f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:01.931530 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:01.939130 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2739/5433] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:22:01 2022] PUT /identity/v3/projects/6a0d95fffc4041689bbeac2530278d69/users/705c375157af4a12b976fb857cbb57d3/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:01.943378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ca97a-5352-457e-981e-21772a9dbdce admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:02.016938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb378f-c878-49a7-b339-6b062fc7565f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:02.082035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ca97a-5352-457e-981e-21772a9dbdce admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:02.094594 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b872369-14ad-4b68-b63d-34a5a5cebf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:02.095270 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b872369-14ad-4b68-b63d-34a5a5cebf10 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:02.095570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b872369-14ad-4b68-b63d-34a5a5cebf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:02.095837 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b872369-14ad-4b68-b63d-34a5a5cebf10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:02.096546 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b872369-14ad-4b68-b63d-34a5a5cebf10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:02.098562 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b872369-14ad-4b68-b63d-34a5a5cebf10 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:02.115456 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2740/5434] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:02.115783 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:02.117360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b872369-14ad-4b68-b63d-34a5a5cebf10 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:02.128566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a89e2b-e33a-4356-a8e8-3608d8692862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:02.129510 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a89e2b-e33a-4356-a8e8-3608d8692862 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:02.130025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a89e2b-e33a-4356-a8e8-3608d8692862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:02.130310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a89e2b-e33a-4356-a8e8-3608d8692862 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:02.130946 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a89e2b-e33a-4356-a8e8-3608d8692862 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:02.134215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a89e2b-e33a-4356-a8e8-3608d8692862 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:02.136827 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b872369-14ad-4b68-b63d-34a5a5cebf10 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:02.142827 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ea177-bd6c-43e2-88d3-dced2715f6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:02.144280 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ea177-bd6c-43e2-88d3-dced2715f6b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:02.145182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ea177-bd6c-43e2-88d3-dced2715f6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:02.146790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ea177-bd6c-43e2-88d3-dced2715f6b4 admin admin] PATH_INFO: `/v3/projects/6a0d95fffc4041689bbeac2530278d69/users/705c375157af4a12b976fb857cbb57d3/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:02.152923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ea177-bd6c-43e2-88d3-dced2715f6b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a0d95fffc4041689bbeac2530278d69, user_id=705c375157af4a12b976fb857cbb57d3, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:02.156565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ea177-bd6c-43e2-88d3-dced2715f6b4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:02.176152 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2695/5435] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:22:01 2022] POST /identity/v3/users => generated 302 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:02.180940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a89e2b-e33a-4356-a8e8-3608d8692862 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:02.198098 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2741/5436] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:22:02 2022] PUT /identity/v3/projects/6a0d95fffc4041689bbeac2530278d69/users/705c375157af4a12b976fb857cbb57d3/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:02.201036 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9203f84-f465-4238-bb46-05563f60f12f None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:02.201320 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9203f84-f465-4238-bb46-05563f60f12f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:02.201643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9203f84-f465-4238-bb46-05563f60f12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:02.229939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a89e2b-e33a-4356-a8e8-3608d8692862 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:02.235383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-d9203f84-f465-4238-bb46-05563f60f12f None None] MFA Rules not processed for user `705c375157af4a12b976fb857cbb57d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:02.236708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d9203f84-f465-4238-bb46-05563f60f12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:02.316428 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2742/5437] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:02 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:02.322537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9203f84-f465-4238-bb46-05563f60f12f None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:02.390853 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632284f-ff83-4c30-af47-32dba9a9b9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:02.391542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632284f-ff83-4c30-af47-32dba9a9b9b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:02.391826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632284f-ff83-4c30-af47-32dba9a9b9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:02.392100 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632284f-ff83-4c30-af47-32dba9a9b9b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:02.393372 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b632284f-ff83-4c30-af47-32dba9a9b9b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:02.395078 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b632284f-ff83-4c30-af47-32dba9a9b9b7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:02.411277 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2696/5438] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:02.413171 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632284f-ff83-4c30-af47-32dba9a9b9b7 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:02.435874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632284f-ff83-4c30-af47-32dba9a9b9b7 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:02.438076 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9203f84-f465-4238-bb46-05563f60f12f None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:02.450681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c2b90-c0bb-4801-905f-4787e741c348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:02.451387 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c2b90-c0bb-4801-905f-4787e741c348 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:02.451626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c2b90-c0bb-4801-905f-4787e741c348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:02.451879 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c2b90-c0bb-4801-905f-4787e741c348 admin admin] PATH_INFO: `/v3/projects/a52377783544441494a00738deca797a/users/446b20309ffa4c3daf9e9a73e326fb17/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:02.457107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab71317-651c-486f-9dda-96448bcfc57a tempest-ProjectsNegativeStaticTestJSON-1246518202 tempest-ProjectsNegativeStaticTestJSON-1246518202-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b5df7fa794e429eaa957a0141a6bd84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fd4ae8f68b1416399f522a1768d9c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:02.457396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab71317-651c-486f-9dda-96448bcfc57a tempest-ProjectsNegativeStaticTestJSON-1246518202 tempest-ProjectsNegativeStaticTestJSON-1246518202-project] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:02.457786 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab71317-651c-486f-9dda-96448bcfc57a tempest-ProjectsNegativeStaticTestJSON-1246518202 tempest-ProjectsNegativeStaticTestJSON-1246518202-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:02.458080 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab71317-651c-486f-9dda-96448bcfc57a tempest-ProjectsNegativeStaticTestJSON-1246518202 tempest-ProjectsNegativeStaticTestJSON-1246518202-project] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:02.458854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab71317-651c-486f-9dda-96448bcfc57a tempest-ProjectsNegativeStaticTestJSON-1246518202 tempest-ProjectsNegativeStaticTestJSON-1246518202-project] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:02.469305 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-5ab71317-651c-486f-9dda-96448bcfc57a tempest-ProjectsNegativeStaticTestJSON-1246518202 tempest-ProjectsNegativeStaticTestJSON-1246518202-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Sep 04 01:22:02.469305 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:22:02.469305 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:22:02.469305 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:22:02.469305 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:22:02.469305 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:22:02.469305 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:22:02.469305 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:22:02.469305 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:22:02.469305 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:22:02.469305 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:22:02.469305 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:22:02.469305 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Sep 04 01:22:02.469305 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Sep 04 01:22:02.470409 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Sep 04 01:22:02.470409 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application enforcer_obj._enforce( Sep 04 01:22:02.470409 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Sep 04 01:22:02.470409 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Sep 04 01:22:02.470409 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 04 01:22:02.470409 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Sep 04 01:22:02.470409 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Sep 04 01:22:02.470409 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:22:02.472370 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2743/5439] 10.222.0.30 () {60 vars in 1152 bytes} [Sun Sep 4 01:22:02 2022] POST /identity/v3/projects => generated 136 bytes in 150 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Sep 04 01:22:02.479575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab71317-651c-486f-9dda-96448bcfc57a tempest-ProjectsNegativeStaticTestJSON-1246518202 tempest-ProjectsNegativeStaticTestJSON-1246518202-project] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:02.487545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c2b90-c0bb-4801-905f-4787e741c348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a52377783544441494a00738deca797a, user_id=446b20309ffa4c3daf9e9a73e326fb17, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:02.499028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c2b90-c0bb-4801-905f-4787e741c348 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:02.499243 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab71317-651c-486f-9dda-96448bcfc57a tempest-ProjectsNegativeStaticTestJSON-1246518202 tempest-ProjectsNegativeStaticTestJSON-1246518202-project] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:02.514020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912acb1-4998-4434-b7fe-0f7a4a8dd822 tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '705c375157af4a12b976fb857cbb57d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a0d95fffc4041689bbeac2530278d69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:02.514858 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912acb1-4998-4434-b7fe-0f7a4a8dd822 tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:02.515250 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912acb1-4998-4434-b7fe-0f7a4a8dd822 tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:02.515680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912acb1-4998-4434-b7fe-0f7a4a8dd822 tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:02.516398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912acb1-4998-4434-b7fe-0f7a4a8dd822 tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:02.525984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912acb1-4998-4434-b7fe-0f7a4a8dd822 tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:02.533680 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2697/5440] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:22:02 2022] PUT /identity/v3/projects/a52377783544441494a00738deca797a/users/446b20309ffa4c3daf9e9a73e326fb17/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:02.538425 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c2b90-c0bb-4801-905f-4787e741c348 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:02.552915 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-1912acb1-4998-4434-b7fe-0f7a4a8dd822 tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] Invalid input for field 'name': '' is too short Sep 04 01:22:02.552915 n-d-master-1 devstack@keystone.service[81824]: Failed validating 'minLength' in schema['properties']['name']: Sep 04 01:22:02.552915 n-d-master-1 devstack@keystone.service[81824]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 04 01:22:02.552915 n-d-master-1 devstack@keystone.service[81824]: On instance['name']: Sep 04 01:22:02.552915 n-d-master-1 devstack@keystone.service[81824]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Sep 04 01:22:02.552915 n-d-master-1 devstack@keystone.service[81824]: Failed validating 'minLength' in schema['properties']['name']: Sep 04 01:22:02.552915 n-d-master-1 devstack@keystone.service[81824]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 04 01:22:02.552915 n-d-master-1 devstack@keystone.service[81824]: On instance['name']: Sep 04 01:22:02.552915 n-d-master-1 devstack@keystone.service[81824]: '' Sep 04 01:22:02.552915 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:22:02.552915 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 04 01:22:02.552915 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 04 01:22:02.552915 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 04 01:22:02.552915 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise error Sep 04 01:22:02.552915 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Sep 04 01:22:02.552915 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:22:02.552915 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Sep 04 01:22:02.552915 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 04 01:22:02.552915 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:22:02.552915 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application On instance['name']: Sep 04 01:22:02.552915 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application '' Sep 04 01:22:02.552915 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:22:02.552915 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:22:02.555357 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:22:02.555357 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:22:02.555357 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:22:02.555357 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:22:02.555357 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:22:02.555357 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:22:02.555357 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:22:02.555357 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:22:02.555357 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:22:02.555357 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:22:02.555357 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:22:02.555357 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:22:02.555357 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Sep 04 01:22:02.555357 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Sep 04 01:22:02.555357 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 04 01:22:02.555357 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 04 01:22:02.555357 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 04 01:22:02.556411 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 04 01:22:02.556411 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Sep 04 01:22:02.556411 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:22:02.556411 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Sep 04 01:22:02.556411 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 04 01:22:02.556411 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:22:02.556411 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application On instance['name']: Sep 04 01:22:02.556411 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application '' Sep 04 01:22:02.556411 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:22:02.556411 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2744/5441] 10.222.0.30 () {60 vars in 1152 bytes} [Sun Sep 4 01:22:02 2022] POST /identity/v3/projects => generated 283 bytes in 77 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Sep 04 01:22:02.562050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912acb1-4998-4434-b7fe-0f7a4a8dd822 tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:02.582880 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912acb1-4998-4434-b7fe-0f7a4a8dd822 tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:02.594844 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:02.687595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c2b90-c0bb-4801-905f-4787e741c348 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:02.701920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620cc55-ad98-490c-829b-bb7d6d85052f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:02.702581 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620cc55-ad98-490c-829b-bb7d6d85052f admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:02.702906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620cc55-ad98-490c-829b-bb7d6d85052f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:02.703870 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620cc55-ad98-490c-829b-bb7d6d85052f admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:02.704555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620cc55-ad98-490c-829b-bb7d6d85052f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:02.706249 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620cc55-ad98-490c-829b-bb7d6d85052f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:02.728025 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2698/5442] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:02.730078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42d29c-a1d6-4999-bf38-743747464977 tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '705c375157af4a12b976fb857cbb57d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a0d95fffc4041689bbeac2530278d69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:02.730801 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42d29c-a1d6-4999-bf38-743747464977 tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:02.731348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42d29c-a1d6-4999-bf38-743747464977 tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:02.731748 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42d29c-a1d6-4999-bf38-743747464977 tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:02.732653 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42d29c-a1d6-4999-bf38-743747464977 tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:02.734902 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42d29c-a1d6-4999-bf38-743747464977 tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:02.736862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620cc55-ad98-490c-829b-bb7d6d85052f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:02.757090 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-3f42d29c-a1d6-4999-bf38-743747464977 tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 04 01:22:02.757090 n-d-master-1 devstack@keystone.service[81824]: Failed validating 'maxLength' in schema['properties']['name']: Sep 04 01:22:02.757090 n-d-master-1 devstack@keystone.service[81824]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 04 01:22:02.757090 n-d-master-1 devstack@keystone.service[81824]: On instance['name']: Sep 04 01:22:02.757090 n-d-master-1 devstack@keystone.service[81824]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 04 01:22:02.757090 n-d-master-1 devstack@keystone.service[81824]: Failed validating 'maxLength' in schema['properties']['name']: Sep 04 01:22:02.757090 n-d-master-1 devstack@keystone.service[81824]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 04 01:22:02.757090 n-d-master-1 devstack@keystone.service[81824]: On instance['name']: Sep 04 01:22:02.757090 n-d-master-1 devstack@keystone.service[81824]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 04 01:22:02.757090 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:22:02.757090 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 04 01:22:02.757090 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 04 01:22:02.757090 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 04 01:22:02.757090 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise error Sep 04 01:22:02.757090 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 04 01:22:02.757090 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:22:02.757090 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Sep 04 01:22:02.757090 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 04 01:22:02.758871 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:22:02.758871 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application On instance['name']: Sep 04 01:22:02.758871 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 04 01:22:02.758871 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:22:02.758871 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:22:02.758871 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:22:02.758871 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:22:02.758871 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:22:02.758871 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:22:02.758871 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:22:02.758871 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:22:02.758871 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:22:02.758871 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:22:02.758871 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:22:02.758871 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:22:02.758871 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:22:02.758871 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:22:02.758871 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Sep 04 01:22:02.760481 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Sep 04 01:22:02.760481 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 04 01:22:02.760481 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 04 01:22:02.760481 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 04 01:22:02.760481 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 04 01:22:02.760481 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 04 01:22:02.760481 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:22:02.760481 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Sep 04 01:22:02.760481 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 04 01:22:02.760481 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:22:02.760481 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application On instance['name']: Sep 04 01:22:02.760481 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 04 01:22:02.760481 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:22:02.760481 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2745/5443] 10.222.0.30 () {60 vars in 1152 bytes} [Sun Sep 4 01:22:02 2022] POST /identity/v3/projects => generated 412 bytes in 199 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Sep 04 01:22:02.762447 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620cc55-ad98-490c-829b-bb7d6d85052f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:02.765875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42d29c-a1d6-4999-bf38-743747464977 tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:02.779423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f87081-93bb-4756-896a-11559d7e86a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:02.780338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f87081-93bb-4756-896a-11559d7e86a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:02.780619 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f87081-93bb-4756-896a-11559d7e86a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:02.780895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f87081-93bb-4756-896a-11559d7e86a5 admin admin] PATH_INFO: `/v3/projects/a52377783544441494a00738deca797a/users/446b20309ffa4c3daf9e9a73e326fb17/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:02.786116 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42d29c-a1d6-4999-bf38-743747464977 tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:02.787336 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f87081-93bb-4756-896a-11559d7e86a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a52377783544441494a00738deca797a, user_id=446b20309ffa4c3daf9e9a73e326fb17, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:02.792089 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f87081-93bb-4756-896a-11559d7e86a5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:02.801644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716242d-1504-40b1-bc83-eb206d80c73a tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '705c375157af4a12b976fb857cbb57d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a0d95fffc4041689bbeac2530278d69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:02.803188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716242d-1504-40b1-bc83-eb206d80c73a tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:02.803479 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716242d-1504-40b1-bc83-eb206d80c73a tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:02.806016 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716242d-1504-40b1-bc83-eb206d80c73a tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] PATH_INFO: `/v3/projects/d4323669c00f44b680d450e9ea01740c` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:02.824367 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2699/5444] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:22:02 2022] PUT /identity/v3/projects/a52377783544441494a00738deca797a/users/446b20309ffa4c3daf9e9a73e326fb17/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:02.826188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716242d-1504-40b1-bc83-eb206d80c73a tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d4323669c00f44b680d450e9ea01740c)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:02.831594 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716242d-1504-40b1-bc83-eb206d80c73a tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:02.835928 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a576d4-d275-48cf-828f-cad4523294a5 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:02.836449 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a576d4-d275-48cf-828f-cad4523294a5 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:02.836874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a576d4-d275-48cf-828f-cad4523294a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:02.865901 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-4716242d-1504-40b1-bc83-eb206d80c73a tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] Could not find project: d4323669c00f44b680d450e9ea01740c.: keystone.exception.ProjectNotFound: Could not find project: d4323669c00f44b680d450e9ea01740c. Sep 04 01:22:02.865901 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:22:02.865901 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:22:02.865901 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:22:02.865901 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:22:02.865901 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:22:02.865901 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:22:02.865901 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:22:02.865901 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:22:02.865901 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:22:02.865901 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:22:02.865901 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:22:02.865901 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Sep 04 01:22:02.865901 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Sep 04 01:22:02.867713 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:22:02.867713 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:22:02.867713 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Sep 04 01:22:02.867713 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Sep 04 01:22:02.867713 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 01:22:02.867713 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 01:22:02.867713 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 01:22:02.867713 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 01:22:02.867713 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d4323669c00f44b680d450e9ea01740c. Sep 04 01:22:02.867713 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:22:02.868509 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2746/5445] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:22:02 2022] DELETE /identity/v3/projects/d4323669c00f44b680d450e9ea01740c => generated 113 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:22:02.873852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716242d-1504-40b1-bc83-eb206d80c73a tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:02.893452 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d1a576d4-d275-48cf-828f-cad4523294a5 None None] MFA Rules not processed for user `446b20309ffa4c3daf9e9a73e326fb17`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:02.895247 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d1a576d4-d275-48cf-828f-cad4523294a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:02.942403 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:02.982938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716242d-1504-40b1-bc83-eb206d80c73a tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:03.060085 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2700/5446] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:02 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:22:03.067590 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bcaa7-af42-4cee-b776-d696cce1dbd4 tempest-ProjectsNegativeStaticTestJSON-1246518202 tempest-ProjectsNegativeStaticTestJSON-1246518202-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b5df7fa794e429eaa957a0141a6bd84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fd4ae8f68b1416399f522a1768d9c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:03.068285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bcaa7-af42-4cee-b776-d696cce1dbd4 tempest-ProjectsNegativeStaticTestJSON-1246518202 tempest-ProjectsNegativeStaticTestJSON-1246518202-project] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:03.068565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bcaa7-af42-4cee-b776-d696cce1dbd4 tempest-ProjectsNegativeStaticTestJSON-1246518202 tempest-ProjectsNegativeStaticTestJSON-1246518202-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:03.068839 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bcaa7-af42-4cee-b776-d696cce1dbd4 tempest-ProjectsNegativeStaticTestJSON-1246518202 tempest-ProjectsNegativeStaticTestJSON-1246518202-project] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:03.069563 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64bcaa7-af42-4cee-b776-d696cce1dbd4 tempest-ProjectsNegativeStaticTestJSON-1246518202 tempest-ProjectsNegativeStaticTestJSON-1246518202-project] RBAC: Authorizing `identity:list_projects()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:03.083418 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-c64bcaa7-af42-4cee-b776-d696cce1dbd4 tempest-ProjectsNegativeStaticTestJSON-1246518202 tempest-ProjectsNegativeStaticTestJSON-1246518202-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Sep 04 01:22:03.083418 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:22:03.083418 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:22:03.083418 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:22:03.083418 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:22:03.083418 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:22:03.083418 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:22:03.083418 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:22:03.083418 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:22:03.083418 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:22:03.083418 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:22:03.083418 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:22:03.083418 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Sep 04 01:22:03.083418 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._list_projects() Sep 04 01:22:03.084582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Sep 04 01:22:03.084582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Sep 04 01:22:03.084582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Sep 04 01:22:03.084582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application enforcer_obj._enforce( Sep 04 01:22:03.084582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Sep 04 01:22:03.084582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Sep 04 01:22:03.084582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 04 01:22:03.084582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Sep 04 01:22:03.084582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Sep 04 01:22:03.084582 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:22:03.084582 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2747/5447] 10.222.0.30 () {58 vars in 1131 bytes} [Sun Sep 4 01:22:02 2022] GET /identity/v3/projects => generated 135 bytes in 212 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Sep 04 01:22:03.090426 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a576d4-d275-48cf-828f-cad4523294a5 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:03.090426 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d1a576d4-d275-48cf-828f-cad4523294a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:03.091005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bcaa7-af42-4cee-b776-d696cce1dbd4 tempest-ProjectsNegativeStaticTestJSON-1246518202 tempest-ProjectsNegativeStaticTestJSON-1246518202-project] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:03.215730 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a576d4-d275-48cf-828f-cad4523294a5 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:03.226228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c806bc-e698-4652-8785-f987ccae60bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:03.226977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c806bc-e698-4652-8785-f987ccae60bb service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:03.227257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c806bc-e698-4652-8785-f987ccae60bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:03.227564 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c806bc-e698-4652-8785-f987ccae60bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:03.268614 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:03.280505 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bcaa7-af42-4cee-b776-d696cce1dbd4 tempest-ProjectsNegativeStaticTestJSON-1246518202 tempest-ProjectsNegativeStaticTestJSON-1246518202-project] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:03.314772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60761268-0ea4-41db-9d17-ca522c9f579b tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '705c375157af4a12b976fb857cbb57d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a0d95fffc4041689bbeac2530278d69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:03.321706 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60761268-0ea4-41db-9d17-ca522c9f579b tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:03.323112 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60761268-0ea4-41db-9d17-ca522c9f579b tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:03.323594 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60761268-0ea4-41db-9d17-ca522c9f579b tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:03.325737 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60761268-0ea4-41db-9d17-ca522c9f579b tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:03.330618 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60761268-0ea4-41db-9d17-ca522c9f579b tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:03.369548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c806bc-e698-4652-8785-f987ccae60bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:03.371113 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c806bc-e698-4652-8785-f987ccae60bb service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:03.399433 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2701/5448] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:22:03 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:22:03.424417 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2748/5449] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:22:03 2022] POST /identity/v3/projects => generated 359 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:03.425364 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c806bc-e698-4652-8785-f987ccae60bb service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:03.466423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c806bc-e698-4652-8785-f987ccae60bb service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:03.572508 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0adbc7f-28d7-48f3-afba-b66c30d4d287 tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '705c375157af4a12b976fb857cbb57d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a0d95fffc4041689bbeac2530278d69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:03.574757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adbc7f-28d7-48f3-afba-b66c30d4d287 tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:03.575142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adbc7f-28d7-48f3-afba-b66c30d4d287 tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:03.575516 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adbc7f-28d7-48f3-afba-b66c30d4d287 tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:03.578139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0adbc7f-28d7-48f3-afba-b66c30d4d287 tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:03.580149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0adbc7f-28d7-48f3-afba-b66c30d4d287 tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:03.607827 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.sql.core [None req-f0adbc7f-28d7-48f3-afba-b66c30d4d287 tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1230995185' for key 'project.ixu_project_name_domain_id'") Sep 04 01:22:03.607827 n-d-master-1 devstack@keystone.service[81825]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 04 01:22:03.607827 n-d-master-1 devstack@keystone.service[81825]: [parameters: {'id': 'fe1b5812858841e68a7cfaca7ce3c1d5', 'name': 'tempest-project-dup-1230995185', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 04 01:22:03.607827 n-d-master-1 devstack@keystone.service[81825]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81825) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 04 01:22:03.637237 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-f0adbc7f-28d7-48f3-afba-b66c30d4d287 tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1230995185, project id fe1b5812858841e68a7cfaca7ce3c1d5.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1230995185, project id fe1b5812858841e68a7cfaca7ce3c1d5. Sep 04 01:22:03.637237 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:22:03.637237 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 04 01:22:03.637237 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 04 01:22:03.637237 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 04 01:22:03.637237 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 04 01:22:03.637237 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 04 01:22:03.637237 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application result = self._query(query) Sep 04 01:22:03.637237 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 04 01:22:03.637237 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application conn.query(q) Sep 04 01:22:03.637237 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 04 01:22:03.637237 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 04 01:22:03.638337 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 04 01:22:03.638337 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application result.read() Sep 04 01:22:03.638337 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 04 01:22:03.638337 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 04 01:22:03.638337 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 04 01:22:03.638337 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 04 01:22:03.638337 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 04 01:22:03.638337 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 04 01:22:03.638337 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 04 01:22:03.638337 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 04 01:22:03.638337 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-1230995185' for key 'project.ixu_project_name_domain_id'") Sep 04 01:22:03.638337 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:22:03.638337 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 04 01:22:03.638337 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:22:03.638337 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:22:03.638337 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 04 01:22:03.638337 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 04 01:22:03.639435 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 04 01:22:03.639435 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 04 01:22:03.639435 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 04 01:22:03.639435 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application next(self.gen) Sep 04 01:22:03.639435 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 04 01:22:03.639435 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application yield resource Sep 04 01:22:03.639435 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 04 01:22:03.639435 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application next(self.gen) Sep 04 01:22:03.639435 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 04 01:22:03.639435 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self.session.rollback() Sep 04 01:22:03.639435 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 04 01:22:03.639435 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self.force_reraise() Sep 04 01:22:03.639435 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 04 01:22:03.639435 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise self.value Sep 04 01:22:03.639435 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 04 01:22:03.639435 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 04 01:22:03.639435 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 04 01:22:03.639435 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application session.commit() Sep 04 01:22:03.641105 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 04 01:22:03.641105 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 04 01:22:03.641105 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 04 01:22:03.641105 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._prepare_impl() Sep 04 01:22:03.641105 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 04 01:22:03.641105 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self.session.flush() Sep 04 01:22:03.641105 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 04 01:22:03.641105 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._flush(objects) Sep 04 01:22:03.641105 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 04 01:22:03.641105 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 04 01:22:03.641105 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 04 01:22:03.641105 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application compat.raise_( Sep 04 01:22:03.641105 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 04 01:22:03.641105 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception Sep 04 01:22:03.641105 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 04 01:22:03.641105 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application flush_context.execute() Sep 04 01:22:03.641105 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 04 01:22:03.642895 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rec.execute(self) Sep 04 01:22:03.642895 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 04 01:22:03.642895 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 04 01:22:03.642895 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 04 01:22:03.642895 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 04 01:22:03.642895 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 04 01:22:03.642895 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 04 01:22:03.642895 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 04 01:22:03.642895 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 04 01:22:03.642895 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 04 01:22:03.642895 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 04 01:22:03.642895 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 04 01:22:03.642895 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 04 01:22:03.642895 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 04 01:22:03.642895 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 04 01:22:03.642895 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 04 01:22:03.644597 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 04 01:22:03.644597 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 04 01:22:03.644597 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception Sep 04 01:22:03.644597 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 04 01:22:03.644597 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 04 01:22:03.644597 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 04 01:22:03.644597 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 04 01:22:03.644597 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 04 01:22:03.644597 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application result = self._query(query) Sep 04 01:22:03.644597 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 04 01:22:03.644597 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application conn.query(q) Sep 04 01:22:03.644597 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 04 01:22:03.644597 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 04 01:22:03.644597 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 04 01:22:03.644597 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application result.read() Sep 04 01:22:03.644597 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 04 01:22:03.644597 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 04 01:22:03.646714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 04 01:22:03.646714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 04 01:22:03.646714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 04 01:22:03.646714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 04 01:22:03.646714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 04 01:22:03.646714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 04 01:22:03.646714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1230995185' for key 'project.ixu_project_name_domain_id'") Sep 04 01:22:03.646714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 04 01:22:03.646714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [parameters: {'id': 'fe1b5812858841e68a7cfaca7ce3c1d5', 'name': 'tempest-project-dup-1230995185', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 04 01:22:03.646714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 04 01:22:03.646714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:22:03.646714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:22:03.646714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:22:03.646714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:22:03.646714 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 04 01:22:03.651250 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 04 01:22:03.651250 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 04 01:22:03.651250 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 04 01:22:03.651250 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-1230995185 at domain ID default. Sep 04 01:22:03.651250 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:22:03.651250 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:22:03.651250 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:22:03.651250 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:22:03.651250 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:22:03.651250 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:22:03.651250 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:22:03.651250 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:22:03.651250 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:22:03.651250 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:22:03.651250 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:22:03.651250 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:22:03.651250 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:22:03.655074 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:22:03.655074 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 04 01:22:03.655074 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 04 01:22:03.655074 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:22:03.655074 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:22:03.655074 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 04 01:22:03.655074 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 04 01:22:03.655074 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1230995185, project id fe1b5812858841e68a7cfaca7ce3c1d5. Sep 04 01:22:03.655074 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:22:03.657525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60761268-0ea4-41db-9d17-ca522c9f579b tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:03.657711 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2702/5450] 10.222.0.30 () {60 vars in 1152 bytes} [Sun Sep 4 01:22:03 2022] POST /identity/v3/projects => generated 285 bytes in 226 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 04 01:22:03.659410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60761268-0ea4-41db-9d17-ca522c9f579b tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:03.672600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15809294-e035-4a2a-bfba-085989acabdf tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '705c375157af4a12b976fb857cbb57d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a0d95fffc4041689bbeac2530278d69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:03.673708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15809294-e035-4a2a-bfba-085989acabdf tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:03.673999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15809294-e035-4a2a-bfba-085989acabdf tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:03.674356 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15809294-e035-4a2a-bfba-085989acabdf tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] PATH_INFO: `/v3/projects/35a3e5243c104080b05bba557524d974` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:03.675609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15809294-e035-4a2a-bfba-085989acabdf tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] RBAC: Authorizing `identity:delete_project(project_id=35a3e5243c104080b05bba557524d974)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:03.678216 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15809294-e035-4a2a-bfba-085989acabdf tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:03.742266 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-15809294-e035-4a2a-bfba-085989acabdf tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35a3e5243c104080b05bba557524d974', 'request_id': 'req-15809294-e035-4a2a-bfba-085989acabdf'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:03.754747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-15809294-e035-4a2a-bfba-085989acabdf tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35a3e5243c104080b05bba557524d974', 'request_id': 'req-15809294-e035-4a2a-bfba-085989acabdf'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:03.765378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-15809294-e035-4a2a-bfba-085989acabdf tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35a3e5243c104080b05bba557524d974', 'request_id': 'req-15809294-e035-4a2a-bfba-085989acabdf'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:03.781496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-15809294-e035-4a2a-bfba-085989acabdf tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] The token cache is being invalidate because project 35a3e5243c104080b05bba557524d974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:22:03.782149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-15809294-e035-4a2a-bfba-085989acabdf tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:03.783007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-15809294-e035-4a2a-bfba-085989acabdf tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:03.784906 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2749/5451] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:22:03 2022] DELETE /identity/v3/projects/35a3e5243c104080b05bba557524d974 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:03.790495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0adbc7f-28d7-48f3-afba-b66c30d4d287 tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:03.792772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f0adbc7f-28d7-48f3-afba-b66c30d4d287 tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:03.801604 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:03.893771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0adbc7f-28d7-48f3-afba-b66c30d4d287 tempest-ProjectsNegativeStaticTestJSON-1102436383 tempest-ProjectsNegativeStaticTestJSON-1102436383-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:03.980786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f6dc3-0158-4a4b-94a1-894829b94a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:03.981520 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f6dc3-0158-4a4b-94a1-894829b94a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:03.981798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f6dc3-0158-4a4b-94a1-894829b94a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:03.982074 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f6dc3-0158-4a4b-94a1-894829b94a8c admin admin] PATH_INFO: `/v3/users/0b5df7fa794e429eaa957a0141a6bd84` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:03.983312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f6dc3-0158-4a4b-94a1-894829b94a8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b5df7fa794e429eaa957a0141a6bd84)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:03.985877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f6dc3-0158-4a4b-94a1-894829b94a8c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:04.079451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1a8f6dc3-0158-4a4b-94a1-894829b94a8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b5df7fa794e429eaa957a0141a6bd84'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:04.081877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1a8f6dc3-0158-4a4b-94a1-894829b94a8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b5df7fa794e429eaa957a0141a6bd84'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:04.093908 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1a8f6dc3-0158-4a4b-94a1-894829b94a8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b5df7fa794e429eaa957a0141a6bd84'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:04.104368 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1a8f6dc3-0158-4a4b-94a1-894829b94a8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b5df7fa794e429eaa957a0141a6bd84'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:04.105721 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1a8f6dc3-0158-4a4b-94a1-894829b94a8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b5df7fa794e429eaa957a0141a6bd84'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:04.136020 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2703/5452] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:22:03 2022] DELETE /identity/v3/users/0b5df7fa794e429eaa957a0141a6bd84 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:04.140321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421c6f6-65e2-4303-8bf4-ffaac867ad1b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:04.140853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421c6f6-65e2-4303-8bf4-ffaac867ad1b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:04.141344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421c6f6-65e2-4303-8bf4-ffaac867ad1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:04.170385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-1421c6f6-65e2-4303-8bf4-ffaac867ad1b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:04.173168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1421c6f6-65e2-4303-8bf4-ffaac867ad1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:04.264068 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2750/5453] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:04.285097 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f6dc3-0158-4a4b-94a1-894829b94a8c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:04.286840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1a8f6dc3-0158-4a4b-94a1-894829b94a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:04.382981 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:04.436205 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f6dc3-0158-4a4b-94a1-894829b94a8c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:04.455412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda2d7e-6c3e-4164-8054-bc048d3e4e4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:04.456426 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda2d7e-6c3e-4164-8054-bc048d3e4e4f service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:04.456931 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda2d7e-6c3e-4164-8054-bc048d3e4e4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:04.457985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda2d7e-6c3e-4164-8054-bc048d3e4e4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:04.471122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda2d7e-6c3e-4164-8054-bc048d3e4e4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:04.501796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda2d7e-6c3e-4164-8054-bc048d3e4e4f service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:04.501796 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2704/5454] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:22:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:22:05.276161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421c6f6-65e2-4303-8bf4-ffaac867ad1b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:05.277874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1421c6f6-65e2-4303-8bf4-ffaac867ad1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:05.291463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421c6f6-65e2-4303-8bf4-ffaac867ad1b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:05.296766 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0916e29-5e84-4e0c-99d5-f979a5054145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:05.297409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0916e29-5e84-4e0c-99d5-f979a5054145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:05.297712 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0916e29-5e84-4e0c-99d5-f979a5054145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:05.298174 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0916e29-5e84-4e0c-99d5-f979a5054145 admin admin] PATH_INFO: `/v3/projects/0fd4ae8f68b1416399f522a1768d9c16` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:05.299304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0916e29-5e84-4e0c-99d5-f979a5054145 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fd4ae8f68b1416399f522a1768d9c16)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:05.301501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0916e29-5e84-4e0c-99d5-f979a5054145 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:05.364406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e0916e29-5e84-4e0c-99d5-f979a5054145 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fd4ae8f68b1416399f522a1768d9c16', 'request_id': 'req-e0916e29-5e84-4e0c-99d5-f979a5054145'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:05.375335 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e0916e29-5e84-4e0c-99d5-f979a5054145 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fd4ae8f68b1416399f522a1768d9c16', 'request_id': 'req-e0916e29-5e84-4e0c-99d5-f979a5054145'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:05.382749 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=84,keystone:INSERT=3,keystone:DELETE=13 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:05.384227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e0916e29-5e84-4e0c-99d5-f979a5054145 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fd4ae8f68b1416399f522a1768d9c16', 'request_id': 'req-e0916e29-5e84-4e0c-99d5-f979a5054145'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:05.401803 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e0916e29-5e84-4e0c-99d5-f979a5054145 admin admin] The token cache is being invalidate because project 0fd4ae8f68b1416399f522a1768d9c16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:22:05.402389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e0916e29-5e84-4e0c-99d5-f979a5054145 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:05.403246 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e0916e29-5e84-4e0c-99d5-f979a5054145 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:05.406242 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2751/5455] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:22:05 2022] DELETE /identity/v3/projects/0fd4ae8f68b1416399f522a1768d9c16 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:05.410122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda2d7e-6c3e-4164-8054-bc048d3e4e4f service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:05.423060 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda2d7e-6c3e-4164-8054-bc048d3e4e4f service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:05.541616 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f325730-7040-430e-ace1-bfdab9c44cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:05.543794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f325730-7040-430e-ace1-bfdab9c44cf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:05.544108 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f325730-7040-430e-ace1-bfdab9c44cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:05.544441 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f325730-7040-430e-ace1-bfdab9c44cf1 admin admin] PATH_INFO: `/v3/users/705c375157af4a12b976fb857cbb57d3` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:05.545891 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f325730-7040-430e-ace1-bfdab9c44cf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=705c375157af4a12b976fb857cbb57d3)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:05.548939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f325730-7040-430e-ace1-bfdab9c44cf1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:05.638437 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8f325730-7040-430e-ace1-bfdab9c44cf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '705c375157af4a12b976fb857cbb57d3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:05.639160 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8f325730-7040-430e-ace1-bfdab9c44cf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '705c375157af4a12b976fb857cbb57d3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:05.650146 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8f325730-7040-430e-ace1-bfdab9c44cf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '705c375157af4a12b976fb857cbb57d3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:05.663340 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8f325730-7040-430e-ace1-bfdab9c44cf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '705c375157af4a12b976fb857cbb57d3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:05.664051 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8f325730-7040-430e-ace1-bfdab9c44cf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '705c375157af4a12b976fb857cbb57d3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:05.712148 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2705/5456] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:22:05 2022] DELETE /identity/v3/users/705c375157af4a12b976fb857cbb57d3 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:06.507547 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0916e29-5e84-4e0c-99d5-f979a5054145 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:06.510093 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e0916e29-5e84-4e0c-99d5-f979a5054145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:06.540472 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0916e29-5e84-4e0c-99d5-f979a5054145 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:06.650532 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fdbf10-9d2f-4305-943d-94db896e3774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:06.652279 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdbf10-9d2f-4305-943d-94db896e3774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:06.653343 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdbf10-9d2f-4305-943d-94db896e3774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:06.653755 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdbf10-9d2f-4305-943d-94db896e3774 admin admin] PATH_INFO: `/v3/projects/6a0d95fffc4041689bbeac2530278d69` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:06.665643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fdbf10-9d2f-4305-943d-94db896e3774 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a0d95fffc4041689bbeac2530278d69)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:06.668466 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fdbf10-9d2f-4305-943d-94db896e3774 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:06.758276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c5fdbf10-9d2f-4305-943d-94db896e3774 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a0d95fffc4041689bbeac2530278d69', 'request_id': 'req-c5fdbf10-9d2f-4305-943d-94db896e3774'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:06.778067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c5fdbf10-9d2f-4305-943d-94db896e3774 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a0d95fffc4041689bbeac2530278d69', 'request_id': 'req-c5fdbf10-9d2f-4305-943d-94db896e3774'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:06.788092 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c5fdbf10-9d2f-4305-943d-94db896e3774 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a0d95fffc4041689bbeac2530278d69', 'request_id': 'req-c5fdbf10-9d2f-4305-943d-94db896e3774'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:06.814187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c5fdbf10-9d2f-4305-943d-94db896e3774 admin admin] The token cache is being invalidate because project 6a0d95fffc4041689bbeac2530278d69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:22:06.814639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c5fdbf10-9d2f-4305-943d-94db896e3774 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:06.815527 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c5fdbf10-9d2f-4305-943d-94db896e3774 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:06.818161 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2752/5457] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:22:06 2022] DELETE /identity/v3/projects/6a0d95fffc4041689bbeac2530278d69 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:06.823839 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63715ae-f150-4173-942a-fc2f8ef397af None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:06.824368 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63715ae-f150-4173-942a-fc2f8ef397af None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:06.824485 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63715ae-f150-4173-942a-fc2f8ef397af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:06.879555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a63715ae-f150-4173-942a-fc2f8ef397af None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:06.880794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a63715ae-f150-4173-942a-fc2f8ef397af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:07.003720 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:07.040368 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2706/5458] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:07.047990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb228b5-72ec-4b5e-978f-4bdee67583b6 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:07.048275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb228b5-72ec-4b5e-978f-4bdee67583b6 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:07.048549 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb228b5-72ec-4b5e-978f-4bdee67583b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:07.082673 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-eeb228b5-72ec-4b5e-978f-4bdee67583b6 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:07.083905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-eeb228b5-72ec-4b5e-978f-4bdee67583b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:07.103812 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2753/5459] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:07.109345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63715ae-f150-4173-942a-fc2f8ef397af None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:07.158048 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63715ae-f150-4173-942a-fc2f8ef397af None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:07.242924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b8541-3d06-4c2b-813a-c47cb63b8e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:07.243628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b8541-3d06-4c2b-813a-c47cb63b8e8a admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:07.243907 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b8541-3d06-4c2b-813a-c47cb63b8e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:07.248515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b8541-3d06-4c2b-813a-c47cb63b8e8a admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:07.249319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b8541-3d06-4c2b-813a-c47cb63b8e8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:22:07.251971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b8541-3d06-4c2b-813a-c47cb63b8e8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:07.255217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b8541-3d06-4c2b-813a-c47cb63b8e8a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:07.352489 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2707/5460] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:22:07.353893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb228b5-72ec-4b5e-978f-4bdee67583b6 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:07.374786 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb228b5-72ec-4b5e-978f-4bdee67583b6 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:07.390147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a298b7-30a4-4986-9c63-768388bad1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:07.390768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a298b7-30a4-4986-9c63-768388bad1ef admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:07.391346 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a298b7-30a4-4986-9c63-768388bad1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:07.391559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a298b7-30a4-4986-9c63-768388bad1ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:07.392223 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a298b7-30a4-4986-9c63-768388bad1ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:07.399600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a298b7-30a4-4986-9c63-768388bad1ef admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:07.487995 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2754/5461] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:22:07 2022] POST /identity/v3/projects => generated 365 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:07.492873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b8541-3d06-4c2b-813a-c47cb63b8e8a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:07.504129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b8541-3d06-4c2b-813a-c47cb63b8e8a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:07.752494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8dcba-4ffb-4e2e-8b0f-7392c942f83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:07.753510 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8dcba-4ffb-4e2e-8b0f-7392c942f83b admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:07.755241 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8dcba-4ffb-4e2e-8b0f-7392c942f83b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:07.755525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8dcba-4ffb-4e2e-8b0f-7392c942f83b admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:07.756381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c8dcba-4ffb-4e2e-8b0f-7392c942f83b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:07.763859 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c8dcba-4ffb-4e2e-8b0f-7392c942f83b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:07.823745 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2708/5462] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:22:07 2022] POST /identity/v3/users => generated 283 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:07.826666 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a298b7-30a4-4986-9c63-768388bad1ef admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:07.841528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a298b7-30a4-4986-9c63-768388bad1ef admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:07.853943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8cc874-d900-4138-a82a-946604a9ce03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:07.854573 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cc874-d900-4138-a82a-946604a9ce03 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:07.854850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cc874-d900-4138-a82a-946604a9ce03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:07.855202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cc874-d900-4138-a82a-946604a9ce03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:07.856341 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8cc874-d900-4138-a82a-946604a9ce03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:07.860165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8cc874-d900-4138-a82a-946604a9ce03 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:07.885621 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2755/5463] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:07.890309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8dcba-4ffb-4e2e-8b0f-7392c942f83b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:07.925997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8dcba-4ffb-4e2e-8b0f-7392c942f83b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:07.945404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40886a55-9e6d-4fe5-8a70-e3d4f2bc89f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:07.948886 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40886a55-9e6d-4fe5-8a70-e3d4f2bc89f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:07.949672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40886a55-9e6d-4fe5-8a70-e3d4f2bc89f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:07.950938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40886a55-9e6d-4fe5-8a70-e3d4f2bc89f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:07.951957 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40886a55-9e6d-4fe5-8a70-e3d4f2bc89f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:07.959364 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40886a55-9e6d-4fe5-8a70-e3d4f2bc89f6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:08.010324 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2709/5464] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:08.014687 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8cc874-d900-4138-a82a-946604a9ce03 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:08.030758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8cc874-d900-4138-a82a-946604a9ce03 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:08.053142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11f5e5-cbe0-4507-9b83-49f3e908fd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:08.053992 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11f5e5-cbe0-4507-9b83-49f3e908fd6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:08.054465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11f5e5-cbe0-4507-9b83-49f3e908fd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:08.054729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11f5e5-cbe0-4507-9b83-49f3e908fd6d admin admin] PATH_INFO: `/v3/projects/040fe228b490490bbbfae2119dd82c5f/users/3604a90a6eaa4274bf2ba184e96b2dd0/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:08.101874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a11f5e5-cbe0-4507-9b83-49f3e908fd6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=040fe228b490490bbbfae2119dd82c5f, user_id=3604a90a6eaa4274bf2ba184e96b2dd0, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:08.104899 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a11f5e5-cbe0-4507-9b83-49f3e908fd6d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:08.138142 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2756/5465] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:22:08 2022] PUT /identity/v3/projects/040fe228b490490bbbfae2119dd82c5f/users/3604a90a6eaa4274bf2ba184e96b2dd0/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:08.140634 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d230db-214e-4169-8e47-f6675f3780bd None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:08.140793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d230db-214e-4169-8e47-f6675f3780bd None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:08.141056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d230db-214e-4169-8e47-f6675f3780bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:08.227577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-88d230db-214e-4169-8e47-f6675f3780bd None None] MFA Rules not processed for user `3604a90a6eaa4274bf2ba184e96b2dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:08.244969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-88d230db-214e-4169-8e47-f6675f3780bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:08.440145 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2710/5466] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:08.441464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11f5e5-cbe0-4507-9b83-49f3e908fd6d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:08.480094 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:08.546644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11f5e5-cbe0-4507-9b83-49f3e908fd6d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:08.562611 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d230db-214e-4169-8e47-f6675f3780bd None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:08.564858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-88d230db-214e-4169-8e47-f6675f3780bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:08.567194 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d3767-3166-4437-9dc5-ce9ea48a88e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:08.568034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d3767-3166-4437-9dc5-ce9ea48a88e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:08.568497 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d3767-3166-4437-9dc5-ce9ea48a88e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:08.568799 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d3767-3166-4437-9dc5-ce9ea48a88e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:08.570838 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6d3767-3166-4437-9dc5-ce9ea48a88e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:08.572937 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6d3767-3166-4437-9dc5-ce9ea48a88e4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:08.625570 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2757/5467] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:22:08 2022] POST /identity/v3/projects => generated 367 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:08.630729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d3767-3166-4437-9dc5-ce9ea48a88e4 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:08.719182 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:08.735059 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d230db-214e-4169-8e47-f6675f3780bd None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:08.759604 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d3767-3166-4437-9dc5-ce9ea48a88e4 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:08.768133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de56f55-57c6-4acb-b5d7-9e2f79b7ac64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:08.769038 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de56f55-57c6-4acb-b5d7-9e2f79b7ac64 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:08.770264 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de56f55-57c6-4acb-b5d7-9e2f79b7ac64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:08.770547 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de56f55-57c6-4acb-b5d7-9e2f79b7ac64 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:08.771377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de56f55-57c6-4acb-b5d7-9e2f79b7ac64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:08.774747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de56f55-57c6-4acb-b5d7-9e2f79b7ac64 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:08.814035 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2758/5468] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:22:08 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:08.817808 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de56f55-57c6-4acb-b5d7-9e2f79b7ac64 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:08.830849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e011af-4ea3-4855-8808-3c1eb8fd1bb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:08.831551 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e011af-4ea3-4855-8808-3c1eb8fd1bb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:08.831839 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e011af-4ea3-4855-8808-3c1eb8fd1bb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:08.832146 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e011af-4ea3-4855-8808-3c1eb8fd1bb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:08.833950 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de56f55-57c6-4acb-b5d7-9e2f79b7ac64 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:08.837759 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-20e011af-4ea3-4855-8808-3c1eb8fd1bb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:08.842852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccdc6d-6098-475f-85dc-c93ac80bb955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:08.843477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccdc6d-6098-475f-85dc-c93ac80bb955 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:08.844096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccdc6d-6098-475f-85dc-c93ac80bb955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:08.844472 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccdc6d-6098-475f-85dc-c93ac80bb955 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:08.847143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ccdc6d-6098-475f-85dc-c93ac80bb955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:08.849423 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ccdc6d-6098-475f-85dc-c93ac80bb955 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:08.868326 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2759/5469] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:22:08.872020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccdc6d-6098-475f-85dc-c93ac80bb955 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:08.905153 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccdc6d-6098-475f-85dc-c93ac80bb955 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:08.915904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ba1ed-44cc-4d44-8423-2a4068a17c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:08.916722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ba1ed-44cc-4d44-8423-2a4068a17c28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:08.917008 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ba1ed-44cc-4d44-8423-2a4068a17c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:08.917289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ba1ed-44cc-4d44-8423-2a4068a17c28 admin admin] PATH_INFO: `/v3/projects/5557c603db334af097b8c270127d3092/users/658625e2c3ed4be986cd757ebfd3b0b6/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:08.927866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e011af-4ea3-4855-8808-3c1eb8fd1bb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:08.930616 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e011af-4ea3-4855-8808-3c1eb8fd1bb5 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:08.942075 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ba1ed-44cc-4d44-8423-2a4068a17c28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5557c603db334af097b8c270127d3092, user_id=658625e2c3ed4be986cd757ebfd3b0b6, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:08.944463 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2711/5470] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:22:08 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:22:08.951162 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ba1ed-44cc-4d44-8423-2a4068a17c28 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:08.974270 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2760/5471] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:22:08 2022] PUT /identity/v3/projects/5557c603db334af097b8c270127d3092/users/658625e2c3ed4be986cd757ebfd3b0b6/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:08.975504 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e011af-4ea3-4855-8808-3c1eb8fd1bb5 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:08.989512 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e011af-4ea3-4855-8808-3c1eb8fd1bb5 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:09.121613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db335c02-7b35-487b-aaae-3ffe81a84933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:09.122375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db335c02-7b35-487b-aaae-3ffe81a84933 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:09.122659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db335c02-7b35-487b-aaae-3ffe81a84933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:09.122935 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db335c02-7b35-487b-aaae-3ffe81a84933 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:09.124598 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db335c02-7b35-487b-aaae-3ffe81a84933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:09.129825 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db335c02-7b35-487b-aaae-3ffe81a84933 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:09.162220 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2712/5472] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:09.166489 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ba1ed-44cc-4d44-8423-2a4068a17c28 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:09.179497 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ba1ed-44cc-4d44-8423-2a4068a17c28 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:09.186570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e90a4-7813-4a9b-9f17-c5770fc1e71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:09.187454 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e90a4-7813-4a9b-9f17-c5770fc1e71f admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:09.187745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e90a4-7813-4a9b-9f17-c5770fc1e71f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:09.188515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e90a4-7813-4a9b-9f17-c5770fc1e71f admin admin] PATH_INFO: `/v3/projects/5557c603db334af097b8c270127d3092/users/658625e2c3ed4be986cd757ebfd3b0b6/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:09.190733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e90a4-7813-4a9b-9f17-c5770fc1e71f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5557c603db334af097b8c270127d3092, user_id=658625e2c3ed4be986cd757ebfd3b0b6, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:09.193584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e90a4-7813-4a9b-9f17-c5770fc1e71f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:09.231629 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2761/5473] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:22:09 2022] PUT /identity/v3/projects/5557c603db334af097b8c270127d3092/users/658625e2c3ed4be986cd757ebfd3b0b6/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:09.232627 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13606bd-9e77-424d-8d32-848309cc6f48 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:09.232913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13606bd-9e77-424d-8d32-848309cc6f48 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:09.233213 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13606bd-9e77-424d-8d32-848309cc6f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:09.271455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-f13606bd-9e77-424d-8d32-848309cc6f48 None None] MFA Rules not processed for user `658625e2c3ed4be986cd757ebfd3b0b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:09.273000 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f13606bd-9e77-424d-8d32-848309cc6f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:09.416976 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:09.515741 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2713/5474] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:09 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:22:09.520478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e90a4-7813-4a9b-9f17-c5770fc1e71f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:09.535604 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e90a4-7813-4a9b-9f17-c5770fc1e71f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:09.543628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e2df4-8e94-4ed1-bee7-0f2125fabd02 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658625e2c3ed4be986cd757ebfd3b0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5557c603db334af097b8c270127d3092', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:09.545754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e2df4-8e94-4ed1-bee7-0f2125fabd02 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:09.546606 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e2df4-8e94-4ed1-bee7-0f2125fabd02 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:09.547168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e2df4-8e94-4ed1-bee7-0f2125fabd02 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:09.548215 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e2df4-8e94-4ed1-bee7-0f2125fabd02 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:09.550597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e2df4-8e94-4ed1-bee7-0f2125fabd02 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:09.654886 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2762/5475] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:22:09 2022] POST /identity/v3/projects => generated 359 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:09.656319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13606bd-9e77-424d-8d32-848309cc6f48 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:09.668909 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13606bd-9e77-424d-8d32-848309cc6f48 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:09.823470 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991501a8-8a97-4322-9b1c-9c10eb890fc4 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658625e2c3ed4be986cd757ebfd3b0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5557c603db334af097b8c270127d3092', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:09.824182 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991501a8-8a97-4322-9b1c-9c10eb890fc4 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:09.824638 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991501a8-8a97-4322-9b1c-9c10eb890fc4 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:09.825068 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991501a8-8a97-4322-9b1c-9c10eb890fc4 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:09.825830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991501a8-8a97-4322-9b1c-9c10eb890fc4 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:09.827734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991501a8-8a97-4322-9b1c-9c10eb890fc4 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:09.919287 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2714/5476] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:22:09 2022] POST /identity/v3/users => generated 373 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:09.923134 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e2df4-8e94-4ed1-bee7-0f2125fabd02 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:09.944999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e2df4-8e94-4ed1-bee7-0f2125fabd02 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:09.965102 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27efe6-d89b-4f59-9b84-e2ae641b0422 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658625e2c3ed4be986cd757ebfd3b0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5557c603db334af097b8c270127d3092', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:09.966401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27efe6-d89b-4f59-9b84-e2ae641b0422 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:09.966693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27efe6-d89b-4f59-9b84-e2ae641b0422 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:09.966985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27efe6-d89b-4f59-9b84-e2ae641b0422 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] PATH_INFO: `/v3/users/ffbce4e101844aaa9732ce2f7042a112` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:10.004836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27efe6-d89b-4f59-9b84-e2ae641b0422 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorizing `identity:get_user(user_id=ffbce4e101844aaa9732ce2f7042a112)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:10.007779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27efe6-d89b-4f59-9b84-e2ae641b0422 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:10.009729 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2763/5477] 10.222.0.30 () {58 vars in 1221 bytes} [Sun Sep 4 01:22:09 2022] GET /identity/v3/users/ffbce4e101844aaa9732ce2f7042a112 => generated 373 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:22:10.013859 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991501a8-8a97-4322-9b1c-9c10eb890fc4 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:10.028767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991501a8-8a97-4322-9b1c-9c10eb890fc4 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:10.043530 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f39ee-78c8-4138-bd3c-f1aa5b6433e6 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658625e2c3ed4be986cd757ebfd3b0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5557c603db334af097b8c270127d3092', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:10.044193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f39ee-78c8-4138-bd3c-f1aa5b6433e6 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:10.044479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f39ee-78c8-4138-bd3c-f1aa5b6433e6 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:10.045972 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f39ee-78c8-4138-bd3c-f1aa5b6433e6 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] PATH_INFO: `/v3/users/ffbce4e101844aaa9732ce2f7042a112` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:10.047331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f39ee-78c8-4138-bd3c-f1aa5b6433e6 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ffbce4e101844aaa9732ce2f7042a112)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:10.049512 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f39ee-78c8-4138-bd3c-f1aa5b6433e6 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:10.123484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ba0f39ee-78c8-4138-bd3c-f1aa5b6433e6 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffbce4e101844aaa9732ce2f7042a112'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:10.127043 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ba0f39ee-78c8-4138-bd3c-f1aa5b6433e6 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffbce4e101844aaa9732ce2f7042a112'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:10.144748 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ba0f39ee-78c8-4138-bd3c-f1aa5b6433e6 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffbce4e101844aaa9732ce2f7042a112'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:10.156004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ba0f39ee-78c8-4138-bd3c-f1aa5b6433e6 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffbce4e101844aaa9732ce2f7042a112'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:10.158444 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ba0f39ee-78c8-4138-bd3c-f1aa5b6433e6 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffbce4e101844aaa9732ce2f7042a112'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:10.200280 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27efe6-d89b-4f59-9b84-e2ae641b0422 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:10.200726 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2715/5478] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:22:10 2022] DELETE /identity/v3/users/ffbce4e101844aaa9732ce2f7042a112 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:10.202739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4e27efe6-d89b-4f59-9b84-e2ae641b0422 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:10.222270 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:10.246341 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27efe6-d89b-4f59-9b84-e2ae641b0422 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:10.360206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305f802-bc6e-4ee6-8fea-fff52146419e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658625e2c3ed4be986cd757ebfd3b0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5557c603db334af097b8c270127d3092', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:10.368475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305f802-bc6e-4ee6-8fea-fff52146419e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:10.369023 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305f802-bc6e-4ee6-8fea-fff52146419e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:10.369577 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305f802-bc6e-4ee6-8fea-fff52146419e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] PATH_INFO: `/v3/projects/82a6f045c7bd436b80a7f2cb8d7cb034` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:10.372436 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305f802-bc6e-4ee6-8fea-fff52146419e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorizing `identity:delete_project(project_id=82a6f045c7bd436b80a7f2cb8d7cb034)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:10.378498 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305f802-bc6e-4ee6-8fea-fff52146419e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:10.486694 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9305f802-bc6e-4ee6-8fea-fff52146419e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82a6f045c7bd436b80a7f2cb8d7cb034', 'request_id': 'req-9305f802-bc6e-4ee6-8fea-fff52146419e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:10.504634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9305f802-bc6e-4ee6-8fea-fff52146419e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82a6f045c7bd436b80a7f2cb8d7cb034', 'request_id': 'req-9305f802-bc6e-4ee6-8fea-fff52146419e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:10.512257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9305f802-bc6e-4ee6-8fea-fff52146419e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82a6f045c7bd436b80a7f2cb8d7cb034', 'request_id': 'req-9305f802-bc6e-4ee6-8fea-fff52146419e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:10.536961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9305f802-bc6e-4ee6-8fea-fff52146419e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] The token cache is being invalidate because project 82a6f045c7bd436b80a7f2cb8d7cb034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:22:10.538236 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9305f802-bc6e-4ee6-8fea-fff52146419e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:10.546099 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9305f802-bc6e-4ee6-8fea-fff52146419e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:10.548724 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2764/5479] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:22:10 2022] DELETE /identity/v3/projects/82a6f045c7bd436b80a7f2cb8d7cb034 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:10.555021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f39ee-78c8-4138-bd3c-f1aa5b6433e6 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:10.574288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f39ee-78c8-4138-bd3c-f1aa5b6433e6 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:10.732028 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:10.818507 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b676d1-d8bb-47e4-a401-9059f1ee071e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658625e2c3ed4be986cd757ebfd3b0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5557c603db334af097b8c270127d3092', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:10.819359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b676d1-d8bb-47e4-a401-9059f1ee071e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:10.819703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b676d1-d8bb-47e4-a401-9059f1ee071e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:10.819974 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b676d1-d8bb-47e4-a401-9059f1ee071e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:10.820716 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b676d1-d8bb-47e4-a401-9059f1ee071e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:10.825428 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b676d1-d8bb-47e4-a401-9059f1ee071e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:10.891198 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2716/5480] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:22:10 2022] POST /identity/v3/projects => generated 360 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:10.892496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305f802-bc6e-4ee6-8fea-fff52146419e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:10.894335 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9305f802-bc6e-4ee6-8fea-fff52146419e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:10.915247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305f802-bc6e-4ee6-8fea-fff52146419e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:11.044633 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171c297-ba4f-4742-9026-21c4a72135cc tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658625e2c3ed4be986cd757ebfd3b0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5557c603db334af097b8c270127d3092', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:11.045298 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171c297-ba4f-4742-9026-21c4a72135cc tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:11.045571 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171c297-ba4f-4742-9026-21c4a72135cc tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:11.045998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171c297-ba4f-4742-9026-21c4a72135cc tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:11.046728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e171c297-ba4f-4742-9026-21c4a72135cc tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:11.048890 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e171c297-ba4f-4742-9026-21c4a72135cc tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:11.098269 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2765/5481] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:22:10 2022] POST /identity/v3/users => generated 414 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:22:11.102772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b676d1-d8bb-47e4-a401-9059f1ee071e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:11.115090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b676d1-d8bb-47e4-a401-9059f1ee071e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:11.138700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6f215-e1bc-496e-8ea0-5bdee6c17315 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658625e2c3ed4be986cd757ebfd3b0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5557c603db334af097b8c270127d3092', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:11.139365 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6f215-e1bc-496e-8ea0-5bdee6c17315 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:11.139648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6f215-e1bc-496e-8ea0-5bdee6c17315 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:11.139920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6f215-e1bc-496e-8ea0-5bdee6c17315 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:11.140843 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6f215-e1bc-496e-8ea0-5bdee6c17315 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:11.145004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6f215-e1bc-496e-8ea0-5bdee6c17315 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:11.190114 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2717/5482] 10.222.0.30 () {60 vars in 1143 bytes} [Sun Sep 4 01:22:11 2022] POST /identity/v3/roles => generated 237 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:22:11.196285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171c297-ba4f-4742-9026-21c4a72135cc tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:11.212739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171c297-ba4f-4742-9026-21c4a72135cc tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:11.224858 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c778118-940b-4d43-90bb-a823adc72382 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658625e2c3ed4be986cd757ebfd3b0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5557c603db334af097b8c270127d3092', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:11.225697 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c778118-940b-4d43-90bb-a823adc72382 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:11.226247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c778118-940b-4d43-90bb-a823adc72382 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:11.226598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c778118-940b-4d43-90bb-a823adc72382 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] PATH_INFO: `/v3/users/3c0f0f83437b4df59fe2f775daa16421` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:11.260333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c778118-940b-4d43-90bb-a823adc72382 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorizing `identity:get_user(user_id=3c0f0f83437b4df59fe2f775daa16421)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:11.265045 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c778118-940b-4d43-90bb-a823adc72382 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:11.267708 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2766/5483] 10.222.0.30 () {58 vars in 1221 bytes} [Sun Sep 4 01:22:11 2022] GET /identity/v3/users/3c0f0f83437b4df59fe2f775daa16421 => generated 414 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:22:11.272473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6f215-e1bc-496e-8ea0-5bdee6c17315 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:11.295878 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6f215-e1bc-496e-8ea0-5bdee6c17315 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:11.326207 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38f981-69a7-4890-abdf-7aa20909b351 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658625e2c3ed4be986cd757ebfd3b0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5557c603db334af097b8c270127d3092', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:11.326890 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38f981-69a7-4890-abdf-7aa20909b351 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:11.327172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38f981-69a7-4890-abdf-7aa20909b351 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:11.327445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38f981-69a7-4890-abdf-7aa20909b351 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] PATH_INFO: `/v3/roles/0982793d97ce4926a335dd7d93bc8779` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:11.330912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf38f981-69a7-4890-abdf-7aa20909b351 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorizing `identity:get_role(role_id=0982793d97ce4926a335dd7d93bc8779)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:11.332553 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf38f981-69a7-4890-abdf-7aa20909b351 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:11.333956 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2718/5484] 10.222.0.30 () {58 vars in 1221 bytes} [Sun Sep 4 01:22:11 2022] GET /identity/v3/roles/0982793d97ce4926a335dd7d93bc8779 => generated 237 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:22:11.338197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c778118-940b-4d43-90bb-a823adc72382 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:11.357926 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c778118-940b-4d43-90bb-a823adc72382 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:11.364001 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9e1d5-abd8-4244-8409-f9d975e30bb9 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658625e2c3ed4be986cd757ebfd3b0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5557c603db334af097b8c270127d3092', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:11.364861 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9e1d5-abd8-4244-8409-f9d975e30bb9 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:11.365349 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9e1d5-abd8-4244-8409-f9d975e30bb9 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:11.366380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9e1d5-abd8-4244-8409-f9d975e30bb9 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:11.368145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9e1d5-abd8-4244-8409-f9d975e30bb9 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:11.375239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9e1d5-abd8-4244-8409-f9d975e30bb9 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:11.399442 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:11.445710 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2767/5485] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:22:11 2022] POST /identity/v3/projects => generated 359 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:11.451283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38f981-69a7-4890-abdf-7aa20909b351 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:11.466550 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38f981-69a7-4890-abdf-7aa20909b351 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:11.637850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9244e-2bcc-4544-974c-d1fff4530cc2 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658625e2c3ed4be986cd757ebfd3b0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5557c603db334af097b8c270127d3092', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:11.639285 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9244e-2bcc-4544-974c-d1fff4530cc2 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:11.640011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9244e-2bcc-4544-974c-d1fff4530cc2 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:11.640812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9244e-2bcc-4544-974c-d1fff4530cc2 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] PATH_INFO: `/v3/projects/1b8cc0b9d9804dc888a61b5ddec92748` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:11.644139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e9244e-2bcc-4544-974c-d1fff4530cc2 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorizing `identity:get_project(project_id=1b8cc0b9d9804dc888a61b5ddec92748)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:11.646852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e9244e-2bcc-4544-974c-d1fff4530cc2 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:11.650738 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2719/5486] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:22:11 2022] GET /identity/v3/projects/1b8cc0b9d9804dc888a61b5ddec92748 => generated 359 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:22:11.655007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9e1d5-abd8-4244-8409-f9d975e30bb9 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:11.672206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9e1d5-abd8-4244-8409-f9d975e30bb9 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:11.698619 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b329eb7-0a2e-4b9f-8244-82740a643163 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658625e2c3ed4be986cd757ebfd3b0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5557c603db334af097b8c270127d3092', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:11.699388 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b329eb7-0a2e-4b9f-8244-82740a643163 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:11.699676 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b329eb7-0a2e-4b9f-8244-82740a643163 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:11.699955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b329eb7-0a2e-4b9f-8244-82740a643163 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] PATH_INFO: `/v3/projects/1b8cc0b9d9804dc888a61b5ddec92748/users/3c0f0f83437b4df59fe2f775daa16421/roles/0982793d97ce4926a335dd7d93bc8779` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:11.724962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b329eb7-0a2e-4b9f-8244-82740a643163 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1b8cc0b9d9804dc888a61b5ddec92748, user_id=3c0f0f83437b4df59fe2f775daa16421, role_id=0982793d97ce4926a335dd7d93bc8779)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:11.728015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b329eb7-0a2e-4b9f-8244-82740a643163 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:11.781184 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2768/5487] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:22:11 2022] PUT /identity/v3/projects/1b8cc0b9d9804dc888a61b5ddec92748/users/3c0f0f83437b4df59fe2f775daa16421/roles/0982793d97ce4926a335dd7d93bc8779 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:11.786207 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9244e-2bcc-4544-974c-d1fff4530cc2 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:11.808795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9244e-2bcc-4544-974c-d1fff4530cc2 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:11.942186 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1bfd1-d3a2-42c8-bb60-ea2c55491bf2 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658625e2c3ed4be986cd757ebfd3b0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5557c603db334af097b8c270127d3092', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:11.942829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1bfd1-d3a2-42c8-bb60-ea2c55491bf2 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:11.943173 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1bfd1-d3a2-42c8-bb60-ea2c55491bf2 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:11.944895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1bfd1-d3a2-42c8-bb60-ea2c55491bf2 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:11.946051 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1bfd1-d3a2-42c8-bb60-ea2c55491bf2 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:11.949209 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1bfd1-d3a2-42c8-bb60-ea2c55491bf2 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:12.004332 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2720/5488] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:22:11 2022] POST /identity/v3/projects => generated 360 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:12.005085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b329eb7-0a2e-4b9f-8244-82740a643163 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:12.017897 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b329eb7-0a2e-4b9f-8244-82740a643163 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:12.101884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997abc1-f0d5-4ff5-ad03-2e185af40817 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658625e2c3ed4be986cd757ebfd3b0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5557c603db334af097b8c270127d3092', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:12.103393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997abc1-f0d5-4ff5-ad03-2e185af40817 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:12.103888 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997abc1-f0d5-4ff5-ad03-2e185af40817 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:12.104322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997abc1-f0d5-4ff5-ad03-2e185af40817 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] PATH_INFO: `/v3/projects/b4b0aea47b8040c28e159f1616a7392e` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:12.106325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997abc1-f0d5-4ff5-ad03-2e185af40817 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorizing `identity:get_project(project_id=b4b0aea47b8040c28e159f1616a7392e)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:12.108823 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997abc1-f0d5-4ff5-ad03-2e185af40817 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:12.111190 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2769/5489] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:22:12 2022] GET /identity/v3/projects/b4b0aea47b8040c28e159f1616a7392e => generated 360 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:22:12.115635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1bfd1-d3a2-42c8-bb60-ea2c55491bf2 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:12.136738 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1bfd1-d3a2-42c8-bb60-ea2c55491bf2 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:12.144195 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e0090-d4cd-4059-8d4c-a75bd5744077 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658625e2c3ed4be986cd757ebfd3b0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5557c603db334af097b8c270127d3092', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:12.145312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e0090-d4cd-4059-8d4c-a75bd5744077 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:12.145796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e0090-d4cd-4059-8d4c-a75bd5744077 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:12.146324 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e0090-d4cd-4059-8d4c-a75bd5744077 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] PATH_INFO: `/v3/projects/b4b0aea47b8040c28e159f1616a7392e/users/3c0f0f83437b4df59fe2f775daa16421/roles/0982793d97ce4926a335dd7d93bc8779` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:12.149872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e0090-d4cd-4059-8d4c-a75bd5744077 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b4b0aea47b8040c28e159f1616a7392e, user_id=3c0f0f83437b4df59fe2f775daa16421, role_id=0982793d97ce4926a335dd7d93bc8779)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:12.153664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e0090-d4cd-4059-8d4c-a75bd5744077 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:12.176230 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2721/5490] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:22:12 2022] PUT /identity/v3/projects/b4b0aea47b8040c28e159f1616a7392e/users/3c0f0f83437b4df59fe2f775daa16421/roles/0982793d97ce4926a335dd7d93bc8779 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:12.181459 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997abc1-f0d5-4ff5-ad03-2e185af40817 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:12.194892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997abc1-f0d5-4ff5-ad03-2e185af40817 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:12.273269 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13b647-3cfb-4760-a540-c9e627a015cf tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658625e2c3ed4be986cd757ebfd3b0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5557c603db334af097b8c270127d3092', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:12.274519 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13b647-3cfb-4760-a540-c9e627a015cf tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:12.275178 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13b647-3cfb-4760-a540-c9e627a015cf tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:12.275963 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13b647-3cfb-4760-a540-c9e627a015cf tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] PATH_INFO: `/v3/users/3c0f0f83437b4df59fe2f775daa16421/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:12.277658 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13b647-3cfb-4760-a540-c9e627a015cf tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=3c0f0f83437b4df59fe2f775daa16421)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:12.280695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13b647-3cfb-4760-a540-c9e627a015cf tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:12.335798 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2770/5491] 10.222.0.30 () {58 vars in 1248 bytes} [Sun Sep 4 01:22:12 2022] GET /identity/v3/users/3c0f0f83437b4df59fe2f775daa16421/projects => generated 843 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:22:12.340306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e0090-d4cd-4059-8d4c-a75bd5744077 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:12.355778 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e0090-d4cd-4059-8d4c-a75bd5744077 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:12.371694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137076ed-794d-473a-8c4b-ebb261c5ea94 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658625e2c3ed4be986cd757ebfd3b0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5557c603db334af097b8c270127d3092', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:12.372500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137076ed-794d-473a-8c4b-ebb261c5ea94 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:12.373394 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137076ed-794d-473a-8c4b-ebb261c5ea94 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:12.373731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137076ed-794d-473a-8c4b-ebb261c5ea94 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] PATH_INFO: `/v3/projects/b4b0aea47b8040c28e159f1616a7392e` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:12.377149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137076ed-794d-473a-8c4b-ebb261c5ea94 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b4b0aea47b8040c28e159f1616a7392e)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:12.386011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137076ed-794d-473a-8c4b-ebb261c5ea94 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:12.423460 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:12.486390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-137076ed-794d-473a-8c4b-ebb261c5ea94 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4b0aea47b8040c28e159f1616a7392e', 'request_id': 'req-137076ed-794d-473a-8c4b-ebb261c5ea94'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:12.525355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-137076ed-794d-473a-8c4b-ebb261c5ea94 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4b0aea47b8040c28e159f1616a7392e', 'request_id': 'req-137076ed-794d-473a-8c4b-ebb261c5ea94'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:12.535565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-137076ed-794d-473a-8c4b-ebb261c5ea94 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4b0aea47b8040c28e159f1616a7392e', 'request_id': 'req-137076ed-794d-473a-8c4b-ebb261c5ea94'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:12.572018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-137076ed-794d-473a-8c4b-ebb261c5ea94 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] The token cache is being invalidate because project b4b0aea47b8040c28e159f1616a7392e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:22:12.572849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-137076ed-794d-473a-8c4b-ebb261c5ea94 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:12.575675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-137076ed-794d-473a-8c4b-ebb261c5ea94 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:12.582104 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2722/5492] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:22:12 2022] DELETE /identity/v3/projects/b4b0aea47b8040c28e159f1616a7392e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:12.582639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13b647-3cfb-4760-a540-c9e627a015cf tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:12.587978 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fb13b647-3cfb-4760-a540-c9e627a015cf tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:12.620654 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13b647-3cfb-4760-a540-c9e627a015cf tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:12.751629 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:12.779984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde62301-9db5-4504-bae8-5b63cd599c32 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658625e2c3ed4be986cd757ebfd3b0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5557c603db334af097b8c270127d3092', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:12.782017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde62301-9db5-4504-bae8-5b63cd599c32 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:12.782524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde62301-9db5-4504-bae8-5b63cd599c32 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:12.783004 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde62301-9db5-4504-bae8-5b63cd599c32 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] PATH_INFO: `/v3/projects/1b8cc0b9d9804dc888a61b5ddec92748` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:12.785305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde62301-9db5-4504-bae8-5b63cd599c32 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1b8cc0b9d9804dc888a61b5ddec92748)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:12.788736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde62301-9db5-4504-bae8-5b63cd599c32 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:12.880277 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bde62301-9db5-4504-bae8-5b63cd599c32 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b8cc0b9d9804dc888a61b5ddec92748', 'request_id': 'req-bde62301-9db5-4504-bae8-5b63cd599c32'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:12.890170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bde62301-9db5-4504-bae8-5b63cd599c32 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b8cc0b9d9804dc888a61b5ddec92748', 'request_id': 'req-bde62301-9db5-4504-bae8-5b63cd599c32'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:12.902098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bde62301-9db5-4504-bae8-5b63cd599c32 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b8cc0b9d9804dc888a61b5ddec92748', 'request_id': 'req-bde62301-9db5-4504-bae8-5b63cd599c32'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:12.919792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bde62301-9db5-4504-bae8-5b63cd599c32 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] The token cache is being invalidate because project 1b8cc0b9d9804dc888a61b5ddec92748 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:22:12.920127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bde62301-9db5-4504-bae8-5b63cd599c32 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:12.920842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bde62301-9db5-4504-bae8-5b63cd599c32 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:12.923667 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2771/5493] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:22:12 2022] DELETE /identity/v3/projects/1b8cc0b9d9804dc888a61b5ddec92748 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:12.929098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137076ed-794d-473a-8c4b-ebb261c5ea94 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:12.946876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137076ed-794d-473a-8c4b-ebb261c5ea94 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:13.082117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed7669-9719-4633-8eb8-a8a3c22baeb8 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658625e2c3ed4be986cd757ebfd3b0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5557c603db334af097b8c270127d3092', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:13.082774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed7669-9719-4633-8eb8-a8a3c22baeb8 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:13.083064 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed7669-9719-4633-8eb8-a8a3c22baeb8 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:13.083380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed7669-9719-4633-8eb8-a8a3c22baeb8 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] PATH_INFO: `/v3/roles/0982793d97ce4926a335dd7d93bc8779` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:13.085531 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed7669-9719-4633-8eb8-a8a3c22baeb8 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0982793d97ce4926a335dd7d93bc8779)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:13.087677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed7669-9719-4633-8eb8-a8a3c22baeb8 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:13.138322 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d3ed7669-9719-4633-8eb8-a8a3c22baeb8 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invalidating the token cache because role 0982793d97ce4926a335dd7d93bc8779 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:22:13.139563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d3ed7669-9719-4633-8eb8-a8a3c22baeb8 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:13.141266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d3ed7669-9719-4633-8eb8-a8a3c22baeb8 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:13.143955 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2723/5494] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:22:12 2022] DELETE /identity/v3/roles/0982793d97ce4926a335dd7d93bc8779 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:13.148746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde62301-9db5-4504-bae8-5b63cd599c32 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:13.150260 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-bde62301-9db5-4504-bae8-5b63cd599c32 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:13.167169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde62301-9db5-4504-bae8-5b63cd599c32 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:13.255978 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd265d9-dd28-459b-b74a-abff9816da0d tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658625e2c3ed4be986cd757ebfd3b0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5557c603db334af097b8c270127d3092', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:13.257548 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd265d9-dd28-459b-b74a-abff9816da0d tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:13.257995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd265d9-dd28-459b-b74a-abff9816da0d tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:13.258452 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd265d9-dd28-459b-b74a-abff9816da0d tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] PATH_INFO: `/v3/users/3c0f0f83437b4df59fe2f775daa16421` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:13.260040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd265d9-dd28-459b-b74a-abff9816da0d tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3c0f0f83437b4df59fe2f775daa16421)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:13.262242 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd265d9-dd28-459b-b74a-abff9816da0d tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:13.329871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-edd265d9-dd28-459b-b74a-abff9816da0d tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c0f0f83437b4df59fe2f775daa16421'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:13.330921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-edd265d9-dd28-459b-b74a-abff9816da0d tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c0f0f83437b4df59fe2f775daa16421'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:13.342775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-edd265d9-dd28-459b-b74a-abff9816da0d tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c0f0f83437b4df59fe2f775daa16421'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:13.358056 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-edd265d9-dd28-459b-b74a-abff9816da0d tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c0f0f83437b4df59fe2f775daa16421'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:13.359552 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-edd265d9-dd28-459b-b74a-abff9816da0d tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c0f0f83437b4df59fe2f775daa16421'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:13.376602 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:13.388668 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2772/5495] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:22:13 2022] DELETE /identity/v3/users/3c0f0f83437b4df59fe2f775daa16421 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:13.393679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed7669-9719-4633-8eb8-a8a3c22baeb8 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:13.398738 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d3ed7669-9719-4633-8eb8-a8a3c22baeb8 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:13.444690 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed7669-9719-4633-8eb8-a8a3c22baeb8 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:13.576874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5844a-f2a7-4f60-baef-1a68562c6a4b tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658625e2c3ed4be986cd757ebfd3b0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5557c603db334af097b8c270127d3092', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:13.577998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5844a-f2a7-4f60-baef-1a68562c6a4b tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:13.578536 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5844a-f2a7-4f60-baef-1a68562c6a4b tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:13.578975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5844a-f2a7-4f60-baef-1a68562c6a4b tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] PATH_INFO: `/v3/projects/0ffe023836de4a88bb9727826de02f95` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:13.581001 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f5844a-f2a7-4f60-baef-1a68562c6a4b tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0ffe023836de4a88bb9727826de02f95)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:13.584978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f5844a-f2a7-4f60-baef-1a68562c6a4b tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:13.610779 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:13.696446 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b7f5844a-f2a7-4f60-baef-1a68562c6a4b tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ffe023836de4a88bb9727826de02f95', 'request_id': 'req-b7f5844a-f2a7-4f60-baef-1a68562c6a4b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:13.713095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b7f5844a-f2a7-4f60-baef-1a68562c6a4b tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ffe023836de4a88bb9727826de02f95', 'request_id': 'req-b7f5844a-f2a7-4f60-baef-1a68562c6a4b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:13.721203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b7f5844a-f2a7-4f60-baef-1a68562c6a4b tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ffe023836de4a88bb9727826de02f95', 'request_id': 'req-b7f5844a-f2a7-4f60-baef-1a68562c6a4b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:13.738015 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b7f5844a-f2a7-4f60-baef-1a68562c6a4b tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] The token cache is being invalidate because project 0ffe023836de4a88bb9727826de02f95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:22:13.738987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b7f5844a-f2a7-4f60-baef-1a68562c6a4b tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:13.739662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b7f5844a-f2a7-4f60-baef-1a68562c6a4b tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:13.741959 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2724/5496] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:22:13 2022] DELETE /identity/v3/projects/0ffe023836de4a88bb9727826de02f95 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:13.748285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd265d9-dd28-459b-b74a-abff9816da0d tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:13.749835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-edd265d9-dd28-459b-b74a-abff9816da0d tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:13.786509 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd265d9-dd28-459b-b74a-abff9816da0d tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:13.912984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6a0d4-e041-48df-a0b7-ce7ed1c7e787 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658625e2c3ed4be986cd757ebfd3b0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5557c603db334af097b8c270127d3092', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:13.912984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6a0d4-e041-48df-a0b7-ce7ed1c7e787 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:13.912984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6a0d4-e041-48df-a0b7-ce7ed1c7e787 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:13.913379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6a0d4-e041-48df-a0b7-ce7ed1c7e787 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] PATH_INFO: `/v3/users/3604a90a6eaa4274bf2ba184e96b2dd0` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:13.918132 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6a0d4-e041-48df-a0b7-ce7ed1c7e787 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorizing `identity:update_user(user_id=3604a90a6eaa4274bf2ba184e96b2dd0)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:13.919181 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-5be6a0d4-e041-48df-a0b7-ce7ed1c7e787 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:22:13.919181 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:22:13.919181 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:22:13.920619 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6a0d4-e041-48df-a0b7-ce7ed1c7e787 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:13.976079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5be6a0d4-e041-48df-a0b7-ce7ed1c7e787 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3604a90a6eaa4274bf2ba184e96b2dd0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:14.004051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5be6a0d4-e041-48df-a0b7-ce7ed1c7e787 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invalidating the token cache because user 3604a90a6eaa4274bf2ba184e96b2dd0 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:22:14.004753 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5be6a0d4-e041-48df-a0b7-ce7ed1c7e787 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:14.005591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5be6a0d4-e041-48df-a0b7-ce7ed1c7e787 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:14.011500 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2773/5497] 10.222.0.30 () {60 vars in 1243 bytes} [Sun Sep 4 01:22:13 2022] PATCH /identity/v3/users/3604a90a6eaa4274bf2ba184e96b2dd0 => generated 296 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:22:14.013409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ac405-a5c7-4bad-9be7-2d1f14b1e7ed None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:14.013846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ac405-a5c7-4bad-9be7-2d1f14b1e7ed None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:14.014370 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ac405-a5c7-4bad-9be7-2d1f14b1e7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:14.079324 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-378ac405-a5c7-4bad-9be7-2d1f14b1e7ed None None] MFA Rules not processed for user `3604a90a6eaa4274bf2ba184e96b2dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:14.081701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-378ac405-a5c7-4bad-9be7-2d1f14b1e7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:14.095295 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2725/5498] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:14 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 01:22:14.096562 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6a0d4-e041-48df-a0b7-ce7ed1c7e787 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:14.098466 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5be6a0d4-e041-48df-a0b7-ce7ed1c7e787 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:14.126024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6a0d4-e041-48df-a0b7-ce7ed1c7e787 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:14.133877 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911fdb6-540d-476d-b318-4bf807b7e91e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658625e2c3ed4be986cd757ebfd3b0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5557c603db334af097b8c270127d3092', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:14.134880 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911fdb6-540d-476d-b318-4bf807b7e91e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:14.136273 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911fdb6-540d-476d-b318-4bf807b7e91e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:14.136863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911fdb6-540d-476d-b318-4bf807b7e91e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] PATH_INFO: `/v3/users/3604a90a6eaa4274bf2ba184e96b2dd0` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:14.138568 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3911fdb6-540d-476d-b318-4bf807b7e91e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorizing `identity:update_user(user_id=3604a90a6eaa4274bf2ba184e96b2dd0)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:14.144304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3911fdb6-540d-476d-b318-4bf807b7e91e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:14.204843 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3911fdb6-540d-476d-b318-4bf807b7e91e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3604a90a6eaa4274bf2ba184e96b2dd0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:14.222058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3911fdb6-540d-476d-b318-4bf807b7e91e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invalidating the token cache because user 3604a90a6eaa4274bf2ba184e96b2dd0 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:22:14.222365 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3911fdb6-540d-476d-b318-4bf807b7e91e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:14.223425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3911fdb6-540d-476d-b318-4bf807b7e91e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:14.230601 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2774/5499] 10.222.0.30 () {60 vars in 1243 bytes} [Sun Sep 4 01:22:14 2022] PATCH /identity/v3/users/3604a90a6eaa4274bf2ba184e96b2dd0 => generated 296 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:22:14.231804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ac405-a5c7-4bad-9be7-2d1f14b1e7ed None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:14.255121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ac405-a5c7-4bad-9be7-2d1f14b1e7ed None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:14.263610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d703c910-4956-4c40-a494-34949925a4ea tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658625e2c3ed4be986cd757ebfd3b0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5557c603db334af097b8c270127d3092', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:14.265063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703c910-4956-4c40-a494-34949925a4ea tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:14.265505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703c910-4956-4c40-a494-34949925a4ea tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:14.265896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703c910-4956-4c40-a494-34949925a4ea tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] PATH_INFO: `/v3/users/3604a90a6eaa4274bf2ba184e96b2dd0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:14.294505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d703c910-4956-4c40-a494-34949925a4ea tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorizing `identity:update_user(user_id=3604a90a6eaa4274bf2ba184e96b2dd0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:14.297007 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-d703c910-4956-4c40-a494-34949925a4ea tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:22:14.297007 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:22:14.297007 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:22:14.300972 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d703c910-4956-4c40-a494-34949925a4ea tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:14.375058 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d703c910-4956-4c40-a494-34949925a4ea tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3604a90a6eaa4274bf2ba184e96b2dd0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:14.406125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d703c910-4956-4c40-a494-34949925a4ea tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invalidating the token cache because user 3604a90a6eaa4274bf2ba184e96b2dd0 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:22:14.406125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d703c910-4956-4c40-a494-34949925a4ea tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:14.407033 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d703c910-4956-4c40-a494-34949925a4ea tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:14.414388 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2726/5500] 10.222.0.30 () {60 vars in 1243 bytes} [Sun Sep 4 01:22:14 2022] PATCH /identity/v3/users/3604a90a6eaa4274bf2ba184e96b2dd0 => generated 296 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:22:14.416382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e696f7-274f-4974-962b-7c0ef7177f50 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:14.416744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e696f7-274f-4974-962b-7c0ef7177f50 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:14.417142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e696f7-274f-4974-962b-7c0ef7177f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:14.486429 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-90e696f7-274f-4974-962b-7c0ef7177f50 None None] MFA Rules not processed for user `3604a90a6eaa4274bf2ba184e96b2dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:14.487857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-90e696f7-274f-4974-962b-7c0ef7177f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:14.491952 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2775/5501] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:14 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 01:22:14.496026 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d703c910-4956-4c40-a494-34949925a4ea tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:14.497826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d703c910-4956-4c40-a494-34949925a4ea tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:14.541001 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d703c910-4956-4c40-a494-34949925a4ea tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:14.555442 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d152c45-6ca6-4f35-9537-920938ff1343 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658625e2c3ed4be986cd757ebfd3b0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5557c603db334af097b8c270127d3092', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:14.556210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d152c45-6ca6-4f35-9537-920938ff1343 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:14.556995 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d152c45-6ca6-4f35-9537-920938ff1343 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:14.556995 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d152c45-6ca6-4f35-9537-920938ff1343 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] PATH_INFO: `/v3/users/3604a90a6eaa4274bf2ba184e96b2dd0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:14.560043 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d152c45-6ca6-4f35-9537-920938ff1343 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorizing `identity:update_user(user_id=3604a90a6eaa4274bf2ba184e96b2dd0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:14.562138 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d152c45-6ca6-4f35-9537-920938ff1343 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:14.616765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1d152c45-6ca6-4f35-9537-920938ff1343 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3604a90a6eaa4274bf2ba184e96b2dd0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:14.628682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1d152c45-6ca6-4f35-9537-920938ff1343 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invalidating the token cache because user 3604a90a6eaa4274bf2ba184e96b2dd0 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:22:14.629343 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1d152c45-6ca6-4f35-9537-920938ff1343 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:14.631148 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1d152c45-6ca6-4f35-9537-920938ff1343 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:14.635842 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2727/5502] 10.222.0.30 () {60 vars in 1243 bytes} [Sun Sep 4 01:22:14 2022] PATCH /identity/v3/users/3604a90a6eaa4274bf2ba184e96b2dd0 => generated 296 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:22:14.641378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e696f7-274f-4974-962b-7c0ef7177f50 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:14.664293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e696f7-274f-4974-962b-7c0ef7177f50 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:14.697151 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d152c45-6ca6-4f35-9537-920938ff1343 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:14.698885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1d152c45-6ca6-4f35-9537-920938ff1343 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:14.713630 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc5f07-a4bd-4f56-a100-426cbe166f3d tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658625e2c3ed4be986cd757ebfd3b0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5557c603db334af097b8c270127d3092', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:14.714785 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc5f07-a4bd-4f56-a100-426cbe166f3d tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:14.715818 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc5f07-a4bd-4f56-a100-426cbe166f3d tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:14.716406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc5f07-a4bd-4f56-a100-426cbe166f3d tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:14.717922 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc5f07-a4bd-4f56-a100-426cbe166f3d tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:14.720207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc5f07-a4bd-4f56-a100-426cbe166f3d tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:14.766531 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2776/5503] 10.222.0.30 () {60 vars in 1143 bytes} [Sun Sep 4 01:22:14 2022] POST /identity/v3/users => generated 265 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:14.770894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc5f07-a4bd-4f56-a100-426cbe166f3d tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:14.775017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-dcdc5f07-a4bd-4f56-a100-426cbe166f3d tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:14.807388 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc5f07-a4bd-4f56-a100-426cbe166f3d tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:14.818425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b4c5a-3b85-4abb-8e6a-ef55675ae46e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658625e2c3ed4be986cd757ebfd3b0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5557c603db334af097b8c270127d3092', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:14.820156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b4c5a-3b85-4abb-8e6a-ef55675ae46e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:14.823165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b4c5a-3b85-4abb-8e6a-ef55675ae46e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:14.823745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b4c5a-3b85-4abb-8e6a-ef55675ae46e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] PATH_INFO: `/v3/users/20c23440d2a340c88357d42935869407/password` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:14.886625 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d152c45-6ca6-4f35-9537-920938ff1343 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:14.899751 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14068e5f-1d9d-47de-9453-78e76b145c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:14.899751 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14068e5f-1d9d-47de-9453-78e76b145c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:14.899751 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14068e5f-1d9d-47de-9453-78e76b145c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:14.899751 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14068e5f-1d9d-47de-9453-78e76b145c99 admin admin] PATH_INFO: `/v3/users/6b3a542a69a94937a1cd4824482908e7` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:14.904485 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14068e5f-1d9d-47de-9453-78e76b145c99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b3a542a69a94937a1cd4824482908e7)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:14.906673 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14068e5f-1d9d-47de-9453-78e76b145c99 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:14.919754 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=82,keystone:DELETE=11,keystone:INSERT=5,keystone:UPDATE=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:14.949145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-128b4c5a-3b85-4abb-8e6a-ef55675ae46e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '20c23440d2a340c88357d42935869407'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:14.966408 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2777/5504] 10.222.0.30 () {60 vars in 1269 bytes} [Sun Sep 4 01:22:14 2022] POST /identity/v3/users/20c23440d2a340c88357d42935869407/password => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:15.009509 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-14068e5f-1d9d-47de-9453-78e76b145c99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b3a542a69a94937a1cd4824482908e7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:15.010916 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-14068e5f-1d9d-47de-9453-78e76b145c99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b3a542a69a94937a1cd4824482908e7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:15.024822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-14068e5f-1d9d-47de-9453-78e76b145c99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b3a542a69a94937a1cd4824482908e7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:15.035140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-14068e5f-1d9d-47de-9453-78e76b145c99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b3a542a69a94937a1cd4824482908e7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:15.035948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-14068e5f-1d9d-47de-9453-78e76b145c99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b3a542a69a94937a1cd4824482908e7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:15.067999 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2728/5505] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:22:14 2022] DELETE /identity/v3/users/6b3a542a69a94937a1cd4824482908e7 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:22:15.074003 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d759269-c7ea-41ee-81d3-78407b8c8331 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:15.074747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d759269-c7ea-41ee-81d3-78407b8c8331 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:15.075097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d759269-c7ea-41ee-81d3-78407b8c8331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:15.099600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-7d759269-c7ea-41ee-81d3-78407b8c8331 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:15.101659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7d759269-c7ea-41ee-81d3-78407b8c8331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:15.120116 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=85,keystone:UPDATE=3,keystone:INSERT=9,keystone:DELETE=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:15.185156 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2778/5506] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:15.205558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14068e5f-1d9d-47de-9453-78e76b145c99 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:15.207031 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-14068e5f-1d9d-47de-9453-78e76b145c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:15.393166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14068e5f-1d9d-47de-9453-78e76b145c99 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:15.410268 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4906050-4161-4bce-b0da-232fb4b205c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:15.410905 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4906050-4161-4bce-b0da-232fb4b205c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:15.411189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4906050-4161-4bce-b0da-232fb4b205c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:15.411464 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4906050-4161-4bce-b0da-232fb4b205c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:15.433723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4906050-4161-4bce-b0da-232fb4b205c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:15.435201 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4906050-4161-4bce-b0da-232fb4b205c3 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:15.471824 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2729/5507] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:22:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:22:15.850462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d759269-c7ea-41ee-81d3-78407b8c8331 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:15.852709 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7d759269-c7ea-41ee-81d3-78407b8c8331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:15.874142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d759269-c7ea-41ee-81d3-78407b8c8331 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:15.888407 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc295c6-231f-423f-acc6-c60d75490d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:15.889308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc295c6-231f-423f-acc6-c60d75490d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:15.889686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc295c6-231f-423f-acc6-c60d75490d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:15.889931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc295c6-231f-423f-acc6-c60d75490d96 admin admin] PATH_INFO: `/v3/projects/86273f4e776d4b7b800e4ce57764c5f0` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:15.891273 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc295c6-231f-423f-acc6-c60d75490d96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86273f4e776d4b7b800e4ce57764c5f0)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:15.893460 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc295c6-231f-423f-acc6-c60d75490d96 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:15.943569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2fc295c6-231f-423f-acc6-c60d75490d96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86273f4e776d4b7b800e4ce57764c5f0', 'request_id': 'req-2fc295c6-231f-423f-acc6-c60d75490d96'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:15.952638 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2fc295c6-231f-423f-acc6-c60d75490d96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86273f4e776d4b7b800e4ce57764c5f0', 'request_id': 'req-2fc295c6-231f-423f-acc6-c60d75490d96'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:15.959189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2fc295c6-231f-423f-acc6-c60d75490d96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86273f4e776d4b7b800e4ce57764c5f0', 'request_id': 'req-2fc295c6-231f-423f-acc6-c60d75490d96'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:15.970574 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2fc295c6-231f-423f-acc6-c60d75490d96 admin admin] The token cache is being invalidate because project 86273f4e776d4b7b800e4ce57764c5f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:22:15.970880 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2fc295c6-231f-423f-acc6-c60d75490d96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:15.971810 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2fc295c6-231f-423f-acc6-c60d75490d96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:15.972396 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d2c42-1776-4840-b226-97e2d1cbcc9a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:15.972396 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d2c42-1776-4840-b226-97e2d1cbcc9a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:15.972662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d2c42-1776-4840-b226-97e2d1cbcc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:15.973813 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2779/5508] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:22:15 2022] DELETE /identity/v3/projects/86273f4e776d4b7b800e4ce57764c5f0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:15.977427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc295c6-231f-423f-acc6-c60d75490d96 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:15.978805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2fc295c6-231f-423f-acc6-c60d75490d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:15.994984 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-fd9d2c42-1776-4840-b226-97e2d1cbcc9a None None] MFA Rules not processed for user `20c23440d2a340c88357d42935869407`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:15.997233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-fd9d2c42-1776-4840-b226-97e2d1cbcc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:16.000678 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2730/5509] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:15 2022] POST /identity/v3/auth/tokens => generated 330 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 04 01:22:16.004656 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d2c42-1776-4840-b226-97e2d1cbcc9a None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:16.006020 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-fd9d2c42-1776-4840-b226-97e2d1cbcc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:16.054287 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc295c6-231f-423f-acc6-c60d75490d96 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:16.059370 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f6bd7-7557-41be-8a61-c2496d7d3403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:16.060024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f6bd7-7557-41be-8a61-c2496d7d3403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:16.060375 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f6bd7-7557-41be-8a61-c2496d7d3403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:16.060579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f6bd7-7557-41be-8a61-c2496d7d3403 admin admin] PATH_INFO: `/v3/users/446b20309ffa4c3daf9e9a73e326fb17` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:16.061999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f6bd7-7557-41be-8a61-c2496d7d3403 admin admin] RBAC: Authorizing `identity:delete_user(user_id=446b20309ffa4c3daf9e9a73e326fb17)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:16.064022 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f6bd7-7557-41be-8a61-c2496d7d3403 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:16.079484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d2c42-1776-4840-b226-97e2d1cbcc9a None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:16.085535 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ddcdd-97ac-4730-8a6d-c1d8d83063b1 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658625e2c3ed4be986cd757ebfd3b0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5557c603db334af097b8c270127d3092', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:16.086173 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ddcdd-97ac-4730-8a6d-c1d8d83063b1 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:16.086455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ddcdd-97ac-4730-8a6d-c1d8d83063b1 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:16.086730 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ddcdd-97ac-4730-8a6d-c1d8d83063b1 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:16.093687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ddcdd-97ac-4730-8a6d-c1d8d83063b1 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:16.095908 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ddcdd-97ac-4730-8a6d-c1d8d83063b1 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:16.103739 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2731/5510] 10.222.0.30 () {56 vars in 1263 bytes} [Sun Sep 4 01:22:16 2022] GET /identity/v3/auth/tokens => generated 330 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 04 01:22:16.108158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ddcdd-97ac-4730-8a6d-c1d8d83063b1 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:16.118871 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:16.120054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ddcdd-97ac-4730-8a6d-c1d8d83063b1 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:16.125602 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba90337-78bb-4efc-b4c4-af4756cf5278 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658625e2c3ed4be986cd757ebfd3b0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5557c603db334af097b8c270127d3092', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:16.125911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2d5f6bd7-7557-41be-8a61-c2496d7d3403 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '446b20309ffa4c3daf9e9a73e326fb17'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:16.126284 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba90337-78bb-4efc-b4c4-af4756cf5278 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:16.126697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba90337-78bb-4efc-b4c4-af4756cf5278 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:16.126964 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba90337-78bb-4efc-b4c4-af4756cf5278 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] PATH_INFO: `/v3/users/20c23440d2a340c88357d42935869407` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:16.127188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2d5f6bd7-7557-41be-8a61-c2496d7d3403 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '446b20309ffa4c3daf9e9a73e326fb17'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:16.128192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba90337-78bb-4efc-b4c4-af4756cf5278 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorizing `identity:delete_user(user_id=20c23440d2a340c88357d42935869407)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:16.130173 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba90337-78bb-4efc-b4c4-af4756cf5278 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:16.137331 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:16.139529 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2d5f6bd7-7557-41be-8a61-c2496d7d3403 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '446b20309ffa4c3daf9e9a73e326fb17'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:16.149226 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2d5f6bd7-7557-41be-8a61-c2496d7d3403 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '446b20309ffa4c3daf9e9a73e326fb17'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:16.150477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2d5f6bd7-7557-41be-8a61-c2496d7d3403 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '446b20309ffa4c3daf9e9a73e326fb17'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:16.176693 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2780/5511] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:22:15 2022] DELETE /identity/v3/users/446b20309ffa4c3daf9e9a73e326fb17 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:22:16.195985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0ba90337-78bb-4efc-b4c4-af4756cf5278 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20c23440d2a340c88357d42935869407'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:16.196681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0ba90337-78bb-4efc-b4c4-af4756cf5278 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20c23440d2a340c88357d42935869407'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:16.205447 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0ba90337-78bb-4efc-b4c4-af4756cf5278 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20c23440d2a340c88357d42935869407'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:16.214381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0ba90337-78bb-4efc-b4c4-af4756cf5278 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20c23440d2a340c88357d42935869407'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:16.215651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0ba90337-78bb-4efc-b4c4-af4756cf5278 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20c23440d2a340c88357d42935869407'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:16.239895 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2732/5512] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:22:16 2022] DELETE /identity/v3/users/20c23440d2a340c88357d42935869407 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:16.245721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f6bd7-7557-41be-8a61-c2496d7d3403 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:16.247702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2d5f6bd7-7557-41be-8a61-c2496d7d3403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:16.321767 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f6bd7-7557-41be-8a61-c2496d7d3403 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:16.403942 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b654ee0-97a2-4650-8607-9909e1edefbd tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658625e2c3ed4be986cd757ebfd3b0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5557c603db334af097b8c270127d3092', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:16.404583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b654ee0-97a2-4650-8607-9909e1edefbd tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:16.404927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b654ee0-97a2-4650-8607-9909e1edefbd tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:16.405214 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b654ee0-97a2-4650-8607-9909e1edefbd tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:16.405934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b654ee0-97a2-4650-8607-9909e1edefbd tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:16.407861 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b654ee0-97a2-4650-8607-9909e1edefbd tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:16.468812 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2781/5513] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:22:16 2022] POST /identity/v3/users => generated 361 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:22:16.473282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba90337-78bb-4efc-b4c4-af4756cf5278 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:16.475095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0ba90337-78bb-4efc-b4c4-af4756cf5278 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:16.491255 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba90337-78bb-4efc-b4c4-af4756cf5278 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:16.499163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6293e-afd0-4e1e-b1d8-d09f460b1f1e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658625e2c3ed4be986cd757ebfd3b0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5557c603db334af097b8c270127d3092', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:16.499905 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6293e-afd0-4e1e-b1d8-d09f460b1f1e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:16.501884 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6293e-afd0-4e1e-b1d8-d09f460b1f1e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:16.503007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6293e-afd0-4e1e-b1d8-d09f460b1f1e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:16.504600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b6293e-afd0-4e1e-b1d8-d09f460b1f1e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:16.505936 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b654ee0-97a2-4650-8607-9909e1edefbd tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:16.507895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b6293e-afd0-4e1e-b1d8-d09f460b1f1e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:16.509301 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7b654ee0-97a2-4650-8607-9909e1edefbd tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:16.575429 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2733/5514] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:22:16 2022] POST /identity/v3/projects => generated 359 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:16.581335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6293e-afd0-4e1e-b1d8-d09f460b1f1e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:16.655222 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:16.660027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6293e-afd0-4e1e-b1d8-d09f460b1f1e tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:16.665070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b654ee0-97a2-4650-8607-9909e1edefbd tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:16.665214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f3b24-dda9-41d6-a6a3-2e4668a9fc7a tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658625e2c3ed4be986cd757ebfd3b0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5557c603db334af097b8c270127d3092', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:16.665770 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f3b24-dda9-41d6-a6a3-2e4668a9fc7a tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:16.666055 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f3b24-dda9-41d6-a6a3-2e4668a9fc7a tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:16.666433 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f3b24-dda9-41d6-a6a3-2e4668a9fc7a tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] PATH_INFO: `/v3/users/f2a825f3a4ce4f4ea976f4c70895332d` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:16.683469 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f3b24-dda9-41d6-a6a3-2e4668a9fc7a tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorizing `identity:update_user(user_id=f2a825f3a4ce4f4ea976f4c70895332d)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:16.685724 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f3b24-dda9-41d6-a6a3-2e4668a9fc7a tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:16.725667 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2734/5515] 10.222.0.30 () {60 vars in 1244 bytes} [Sun Sep 4 01:22:16 2022] PATCH /identity/v3/users/f2a825f3a4ce4f4ea976f4c70895332d => generated 521 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:22:16.726651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f3b24-dda9-41d6-a6a3-2e4668a9fc7a tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:16.743645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a558b-3f20-440f-aab1-f68f2f3059c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:16.744523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a558b-3f20-440f-aab1-f68f2f3059c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:16.744931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a558b-3f20-440f-aab1-f68f2f3059c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:16.745312 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a558b-3f20-440f-aab1-f68f2f3059c9 admin admin] PATH_INFO: `/v3/projects/a52377783544441494a00738deca797a` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:16.747354 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a558b-3f20-440f-aab1-f68f2f3059c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a52377783544441494a00738deca797a)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:16.748332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f3b24-dda9-41d6-a6a3-2e4668a9fc7a tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:16.750593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a558b-3f20-440f-aab1-f68f2f3059c9 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:16.754480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0ac8b-c194-40f2-ab66-28b504e8f65b tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658625e2c3ed4be986cd757ebfd3b0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5557c603db334af097b8c270127d3092', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:16.755582 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0ac8b-c194-40f2-ab66-28b504e8f65b tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:16.755957 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0ac8b-c194-40f2-ab66-28b504e8f65b tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:16.757066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0ac8b-c194-40f2-ab66-28b504e8f65b tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] PATH_INFO: `/v3/users/f2a825f3a4ce4f4ea976f4c70895332d` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:16.775203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0ac8b-c194-40f2-ab66-28b504e8f65b tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorizing `identity:get_user(user_id=f2a825f3a4ce4f4ea976f4c70895332d)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:16.778304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0ac8b-c194-40f2-ab66-28b504e8f65b tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:16.781017 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2735/5516] 10.222.0.30 () {58 vars in 1221 bytes} [Sun Sep 4 01:22:16 2022] GET /identity/v3/users/f2a825f3a4ce4f4ea976f4c70895332d => generated 388 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:22:16.790020 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0ac8b-c194-40f2-ab66-28b504e8f65b tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:16.807424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0ac8b-c194-40f2-ab66-28b504e8f65b tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:16.816118 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901da93-6459-48bf-a18f-d04d0e678e2c tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658625e2c3ed4be986cd757ebfd3b0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5557c603db334af097b8c270127d3092', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:16.817801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901da93-6459-48bf-a18f-d04d0e678e2c tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:16.818936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901da93-6459-48bf-a18f-d04d0e678e2c tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:16.819372 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901da93-6459-48bf-a18f-d04d0e678e2c tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] PATH_INFO: `/v3/projects/3eaf1a95286a4daeaa7f7827abe66536` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:16.821664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901da93-6459-48bf-a18f-d04d0e678e2c tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3eaf1a95286a4daeaa7f7827abe66536)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:16.825644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901da93-6459-48bf-a18f-d04d0e678e2c tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:16.833639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ab4a558b-3f20-440f-aab1-f68f2f3059c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a52377783544441494a00738deca797a', 'request_id': 'req-ab4a558b-3f20-440f-aab1-f68f2f3059c9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:16.844863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ab4a558b-3f20-440f-aab1-f68f2f3059c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a52377783544441494a00738deca797a', 'request_id': 'req-ab4a558b-3f20-440f-aab1-f68f2f3059c9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:16.854838 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=2,keystone:UPDATE=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:16.857065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ab4a558b-3f20-440f-aab1-f68f2f3059c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a52377783544441494a00738deca797a', 'request_id': 'req-ab4a558b-3f20-440f-aab1-f68f2f3059c9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:16.878455 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ab4a558b-3f20-440f-aab1-f68f2f3059c9 admin admin] The token cache is being invalidate because project a52377783544441494a00738deca797a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:22:16.878455 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ab4a558b-3f20-440f-aab1-f68f2f3059c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:16.879526 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ab4a558b-3f20-440f-aab1-f68f2f3059c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:16.887882 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2782/5517] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:22:16 2022] DELETE /identity/v3/projects/a52377783544441494a00738deca797a => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:16.889626 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dba4f2-03ae-4936-bc74-f758752d220f None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:16.889919 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dba4f2-03ae-4936-bc74-f758752d220f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:16.890205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dba4f2-03ae-4936-bc74-f758752d220f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:16.925959 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4901da93-6459-48bf-a18f-d04d0e678e2c tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eaf1a95286a4daeaa7f7827abe66536', 'request_id': 'req-4901da93-6459-48bf-a18f-d04d0e678e2c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:16.929888 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c3dba4f2-03ae-4936-bc74-f758752d220f None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:16.931444 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c3dba4f2-03ae-4936-bc74-f758752d220f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:16.940781 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4901da93-6459-48bf-a18f-d04d0e678e2c tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eaf1a95286a4daeaa7f7827abe66536', 'request_id': 'req-4901da93-6459-48bf-a18f-d04d0e678e2c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:16.952211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4901da93-6459-48bf-a18f-d04d0e678e2c tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eaf1a95286a4daeaa7f7827abe66536', 'request_id': 'req-4901da93-6459-48bf-a18f-d04d0e678e2c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:16.974683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4901da93-6459-48bf-a18f-d04d0e678e2c tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] The token cache is being invalidate because project 3eaf1a95286a4daeaa7f7827abe66536 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:22:16.975872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4901da93-6459-48bf-a18f-d04d0e678e2c tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:16.976803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4901da93-6459-48bf-a18f-d04d0e678e2c tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:16.979761 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2736/5518] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:22:16 2022] DELETE /identity/v3/projects/3eaf1a95286a4daeaa7f7827abe66536 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:16.985279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901da93-6459-48bf-a18f-d04d0e678e2c tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:16.986869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4901da93-6459-48bf-a18f-d04d0e678e2c tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:17.038124 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2783/5519] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:17.045777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b479a-6c66-46a8-89a2-73ddb06bc575 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:17.046066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b479a-6c66-46a8-89a2-73ddb06bc575 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:17.046349 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b479a-6c66-46a8-89a2-73ddb06bc575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:17.069648 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-0c0b479a-6c66-46a8-89a2-73ddb06bc575 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:17.071015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0c0b479a-6c66-46a8-89a2-73ddb06bc575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:17.095392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901da93-6459-48bf-a18f-d04d0e678e2c tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:17.103120 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2784/5520] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:22:17.107383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b479a-6c66-46a8-89a2-73ddb06bc575 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:17.110178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ff36d-d064-4bb8-b850-86a6346f38a7 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658625e2c3ed4be986cd757ebfd3b0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5557c603db334af097b8c270127d3092', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:17.111049 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ff36d-d064-4bb8-b850-86a6346f38a7 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:17.111679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ff36d-d064-4bb8-b850-86a6346f38a7 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:17.112252 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ff36d-d064-4bb8-b850-86a6346f38a7 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] PATH_INFO: `/v3/users/f2a825f3a4ce4f4ea976f4c70895332d` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:17.115053 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ff36d-d064-4bb8-b850-86a6346f38a7 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f2a825f3a4ce4f4ea976f4c70895332d)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:17.118130 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b479a-6c66-46a8-89a2-73ddb06bc575 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:17.118465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ff36d-d064-4bb8-b850-86a6346f38a7 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:17.124813 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a68c0-91e1-4b1d-825e-103d615ae6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:17.125447 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a68c0-91e1-4b1d-825e-103d615ae6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:17.125743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a68c0-91e1-4b1d-825e-103d615ae6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:17.126025 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a68c0-91e1-4b1d-825e-103d615ae6a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:17.126807 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a68c0-91e1-4b1d-825e-103d615ae6a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:22:17.127113 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a68c0-91e1-4b1d-825e-103d615ae6a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:17.128925 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a68c0-91e1-4b1d-825e-103d615ae6a0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:17.152093 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2785/5521] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:22:17.154427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a68c0-91e1-4b1d-825e-103d615ae6a0 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:17.167358 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a68c0-91e1-4b1d-825e-103d615ae6a0 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:17.175426 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01431f00-420c-48a6-af06-3cdcdf5924b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:17.176836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01431f00-420c-48a6-af06-3cdcdf5924b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:17.177121 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01431f00-420c-48a6-af06-3cdcdf5924b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:17.177491 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01431f00-420c-48a6-af06-3cdcdf5924b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:17.180302 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01431f00-420c-48a6-af06-3cdcdf5924b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:17.180667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-083ff36d-d064-4bb8-b850-86a6346f38a7 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2a825f3a4ce4f4ea976f4c70895332d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:17.182202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-083ff36d-d064-4bb8-b850-86a6346f38a7 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2a825f3a4ce4f4ea976f4c70895332d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:17.183166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01431f00-420c-48a6-af06-3cdcdf5924b4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:17.194543 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-083ff36d-d064-4bb8-b850-86a6346f38a7 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2a825f3a4ce4f4ea976f4c70895332d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:17.202144 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:17.204961 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-083ff36d-d064-4bb8-b850-86a6346f38a7 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2a825f3a4ce4f4ea976f4c70895332d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:17.205805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-083ff36d-d064-4bb8-b850-86a6346f38a7 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2a825f3a4ce4f4ea976f4c70895332d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:17.230206 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2786/5522] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:22:17 2022] POST /identity/v3/projects => generated 369 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:17.233029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01431f00-420c-48a6-af06-3cdcdf5924b4 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:17.237568 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2737/5523] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:22:16 2022] DELETE /identity/v3/users/f2a825f3a4ce4f4ea976f4c70895332d => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:17.238598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-01431f00-420c-48a6-af06-3cdcdf5924b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:17.242817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ff36d-d064-4bb8-b850-86a6346f38a7 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:17.244323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-083ff36d-d064-4bb8-b850-86a6346f38a7 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:17.285644 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:17.357202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ff36d-d064-4bb8-b850-86a6346f38a7 tempest-UsersV3TestJSON-1788268003 tempest-UsersV3TestJSON-1788268003-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:17.364199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d93dc-f63d-4e96-87c9-b6f1179eb7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:17.365322 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d93dc-f63d-4e96-87c9-b6f1179eb7fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:17.365711 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d93dc-f63d-4e96-87c9-b6f1179eb7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:17.366121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d93dc-f63d-4e96-87c9-b6f1179eb7fc admin admin] PATH_INFO: `/v3/users/3604a90a6eaa4274bf2ba184e96b2dd0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:17.383699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01431f00-420c-48a6-af06-3cdcdf5924b4 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:17.396416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103054c4-2018-4311-93b7-2141a8320a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:17.399983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103054c4-2018-4311-93b7-2141a8320a8c admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:17.400268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103054c4-2018-4311-93b7-2141a8320a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:17.400543 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103054c4-2018-4311-93b7-2141a8320a8c admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:17.401193 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103054c4-2018-4311-93b7-2141a8320a8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:17.402017 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d93dc-f63d-4e96-87c9-b6f1179eb7fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3604a90a6eaa4274bf2ba184e96b2dd0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:17.403189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103054c4-2018-4311-93b7-2141a8320a8c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:17.405325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d93dc-f63d-4e96-87c9-b6f1179eb7fc admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:17.446224 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2787/5524] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:22:17 2022] POST /identity/v3/users => generated 285 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:17.448806 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103054c4-2018-4311-93b7-2141a8320a8c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:17.473633 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103054c4-2018-4311-93b7-2141a8320a8c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:17.484642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bcb7f-2508-4408-9a9f-af587dad7ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:17.485282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bcb7f-2508-4408-9a9f-af587dad7ffc admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:17.485585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bcb7f-2508-4408-9a9f-af587dad7ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:17.485853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bcb7f-2508-4408-9a9f-af587dad7ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:17.486497 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7bcb7f-2508-4408-9a9f-af587dad7ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:17.488219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7bcb7f-2508-4408-9a9f-af587dad7ffc admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:17.509791 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2788/5525] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:22:17.515373 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bcb7f-2508-4408-9a9f-af587dad7ffc admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:17.528642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bcb7f-2508-4408-9a9f-af587dad7ffc admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:17.531763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-484d93dc-f63d-4e96-87c9-b6f1179eb7fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3604a90a6eaa4274bf2ba184e96b2dd0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:17.532444 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-484d93dc-f63d-4e96-87c9-b6f1179eb7fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3604a90a6eaa4274bf2ba184e96b2dd0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:17.534078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662f22d-a33a-479d-a6ff-6fa6644620f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:17.534767 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662f22d-a33a-479d-a6ff-6fa6644620f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:17.535284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662f22d-a33a-479d-a6ff-6fa6644620f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:17.535630 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662f22d-a33a-479d-a6ff-6fa6644620f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:17.536337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662f22d-a33a-479d-a6ff-6fa6644620f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:17.538653 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662f22d-a33a-479d-a6ff-6fa6644620f5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:17.546622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-484d93dc-f63d-4e96-87c9-b6f1179eb7fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3604a90a6eaa4274bf2ba184e96b2dd0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:17.558915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-484d93dc-f63d-4e96-87c9-b6f1179eb7fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3604a90a6eaa4274bf2ba184e96b2dd0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:17.561539 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2789/5526] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:17.563561 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-484d93dc-f63d-4e96-87c9-b6f1179eb7fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3604a90a6eaa4274bf2ba184e96b2dd0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:17.564583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662f22d-a33a-479d-a6ff-6fa6644620f5 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:17.567559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7662f22d-a33a-479d-a6ff-6fa6644620f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:17.596587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662f22d-a33a-479d-a6ff-6fa6644620f5 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:17.597907 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2738/5527] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:22:17 2022] DELETE /identity/v3/users/3604a90a6eaa4274bf2ba184e96b2dd0 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:17.600677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25aff2-6d85-4fa9-998a-d1c51c3eb851 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:17.600927 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25aff2-6d85-4fa9-998a-d1c51c3eb851 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:17.601203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25aff2-6d85-4fa9-998a-d1c51c3eb851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:17.627946 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-4b25aff2-6d85-4fa9-998a-d1c51c3eb851 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:17.632587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4b25aff2-6d85-4fa9-998a-d1c51c3eb851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:17.697965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875cbc49-357a-40f5-b3b9-3166cd2b27b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:17.698932 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875cbc49-357a-40f5-b3b9-3166cd2b27b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:17.699446 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875cbc49-357a-40f5-b3b9-3166cd2b27b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:17.699806 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875cbc49-357a-40f5-b3b9-3166cd2b27b5 admin admin] PATH_INFO: `/v3/projects/efa43dae1638466abe56366c78a4bc43/users/c78a44853db54afc87cda53393f1a06a/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:17.736833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875cbc49-357a-40f5-b3b9-3166cd2b27b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efa43dae1638466abe56366c78a4bc43, user_id=c78a44853db54afc87cda53393f1a06a, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:17.745729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875cbc49-357a-40f5-b3b9-3166cd2b27b5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:17.762319 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2739/5528] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:17.774564 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25aff2-6d85-4fa9-998a-d1c51c3eb851 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:17.775998 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2790/5529] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:22:17 2022] PUT /identity/v3/projects/efa43dae1638466abe56366c78a4bc43/users/c78a44853db54afc87cda53393f1a06a/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:17.786606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4b25aff2-6d85-4fa9-998a-d1c51c3eb851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:17.799441 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9e6d4-aea8-4129-947a-c9e034354a79 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:17.800670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9e6d4-aea8-4129-947a-c9e034354a79 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:17.801107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9e6d4-aea8-4129-947a-c9e034354a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:17.894588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-7bf9e6d4-aea8-4129-947a-c9e034354a79 None None] MFA Rules not processed for user `c78a44853db54afc87cda53393f1a06a`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:17.895908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7bf9e6d4-aea8-4129-947a-c9e034354a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:17.909234 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:17.958390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25aff2-6d85-4fa9-998a-d1c51c3eb851 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:17.982565 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:18.045491 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2791/5530] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:18.050407 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9e6d4-aea8-4129-947a-c9e034354a79 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:18.074323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d379c-911b-4ec6-a181-4a3b04cc66ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:18.075682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d379c-911b-4ec6-a181-4a3b04cc66ab service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:18.075986 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d379c-911b-4ec6-a181-4a3b04cc66ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:18.076263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d379c-911b-4ec6-a181-4a3b04cc66ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:18.161616 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9e6d4-aea8-4129-947a-c9e034354a79 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:18.180043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febc285-3320-4f92-a215-c7ad8b9c54c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:18.180827 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febc285-3320-4f92-a215-c7ad8b9c54c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:18.181545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febc285-3320-4f92-a215-c7ad8b9c54c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:18.181545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febc285-3320-4f92-a215-c7ad8b9c54c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:18.182624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3febc285-3320-4f92-a215-c7ad8b9c54c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:18.183276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d379c-911b-4ec6-a181-4a3b04cc66ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:18.184853 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d379c-911b-4ec6-a181-4a3b04cc66ab service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:18.184996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3febc285-3320-4f92-a215-c7ad8b9c54c3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:18.196984 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2740/5531] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:22:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:22:18.240398 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2792/5532] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:22:18 2022] POST /identity/v3/projects => generated 369 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:22:18.245207 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d379c-911b-4ec6-a181-4a3b04cc66ab service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:18.258298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d379c-911b-4ec6-a181-4a3b04cc66ab service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:18.336297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea25f39-765b-42af-bd41-88e1fe9ba91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:18.337309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea25f39-765b-42af-bd41-88e1fe9ba91c admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:18.337714 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea25f39-765b-42af-bd41-88e1fe9ba91c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:18.338113 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea25f39-765b-42af-bd41-88e1fe9ba91c admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:18.338899 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea25f39-765b-42af-bd41-88e1fe9ba91c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:18.341220 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea25f39-765b-42af-bd41-88e1fe9ba91c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:18.380865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febc285-3320-4f92-a215-c7ad8b9c54c3 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:18.394266 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2741/5533] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:22:18 2022] POST /identity/v3/users => generated 291 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:18.406282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febc285-3320-4f92-a215-c7ad8b9c54c3 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:18.414481 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b34bf2-dd70-40df-abf4-21b0a40d2891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:18.415960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b34bf2-dd70-40df-abf4-21b0a40d2891 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:18.416345 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b34bf2-dd70-40df-abf4-21b0a40d2891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:18.416721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b34bf2-dd70-40df-abf4-21b0a40d2891 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:18.418070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b34bf2-dd70-40df-abf4-21b0a40d2891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:18.419806 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b34bf2-dd70-40df-abf4-21b0a40d2891 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:18.443821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea25f39-765b-42af-bd41-88e1fe9ba91c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:18.447706 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2793/5534] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:18.460920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea25f39-765b-42af-bd41-88e1fe9ba91c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:18.470301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d54b77-438f-4a99-a379-5e9b66fcd936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:18.471544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d54b77-438f-4a99-a379-5e9b66fcd936 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:18.471927 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d54b77-438f-4a99-a379-5e9b66fcd936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:18.472429 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d54b77-438f-4a99-a379-5e9b66fcd936 admin admin] PATH_INFO: `/v3/projects/03baa375379a49f2adc2d73678ada3cd/users/a9d5bb7521574fb8bb4f8156277046b2/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:18.501137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d54b77-438f-4a99-a379-5e9b66fcd936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03baa375379a49f2adc2d73678ada3cd, user_id=a9d5bb7521574fb8bb4f8156277046b2, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:18.505482 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d54b77-438f-4a99-a379-5e9b66fcd936 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:18.532947 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2742/5535] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:22:18 2022] PUT /identity/v3/projects/03baa375379a49f2adc2d73678ada3cd/users/a9d5bb7521574fb8bb4f8156277046b2/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:18.533511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b34bf2-dd70-40df-abf4-21b0a40d2891 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:18.546242 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b34bf2-dd70-40df-abf4-21b0a40d2891 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:18.661167 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bad4f8-4342-4df4-9e3e-3a44ede06771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:18.662839 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bad4f8-4342-4df4-9e3e-3a44ede06771 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:18.663754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bad4f8-4342-4df4-9e3e-3a44ede06771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:18.665213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bad4f8-4342-4df4-9e3e-3a44ede06771 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:18.666168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bad4f8-4342-4df4-9e3e-3a44ede06771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:18.668224 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bad4f8-4342-4df4-9e3e-3a44ede06771 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:18.683394 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2794/5536] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:22:18.684919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d54b77-438f-4a99-a379-5e9b66fcd936 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:18.690885 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:18.697817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d54b77-438f-4a99-a379-5e9b66fcd936 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:18.705417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab844c90-a07a-4498-96f0-0a643c201df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:18.706687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab844c90-a07a-4498-96f0-0a643c201df6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:18.707182 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab844c90-a07a-4498-96f0-0a643c201df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:18.708179 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab844c90-a07a-4498-96f0-0a643c201df6 admin admin] PATH_INFO: `/v3/projects/03baa375379a49f2adc2d73678ada3cd/users/a9d5bb7521574fb8bb4f8156277046b2/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:18.710746 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab844c90-a07a-4498-96f0-0a643c201df6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03baa375379a49f2adc2d73678ada3cd, user_id=a9d5bb7521574fb8bb4f8156277046b2, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:18.714352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab844c90-a07a-4498-96f0-0a643c201df6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:18.741510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea6d77-83f2-44a3-b2a4-9af0017372e7 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:18.742051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea6d77-83f2-44a3-b2a4-9af0017372e7 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:18.743075 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea6d77-83f2-44a3-b2a4-9af0017372e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:18.749644 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2743/5537] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:22:18 2022] PUT /identity/v3/projects/03baa375379a49f2adc2d73678ada3cd/users/a9d5bb7521574fb8bb4f8156277046b2/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:18.787236 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ecea6d77-83f2-44a3-b2a4-9af0017372e7 None None] MFA Rules not processed for user `a9d5bb7521574fb8bb4f8156277046b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:18.789262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ecea6d77-83f2-44a3-b2a4-9af0017372e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:18.832917 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:18.899232 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2795/5538] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:18 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:18.911061 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab844c90-a07a-4498-96f0-0a643c201df6 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:18.941255 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea6d77-83f2-44a3-b2a4-9af0017372e7 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:18.950672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ecea6d77-83f2-44a3-b2a4-9af0017372e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:19.031647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab844c90-a07a-4498-96f0-0a643c201df6 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:19.037004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14040dad-e744-4906-a471-d732df7cd0cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:19.038392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14040dad-e744-4906-a471-d732df7cd0cc service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:19.039234 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14040dad-e744-4906-a471-d732df7cd0cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:19.039234 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14040dad-e744-4906-a471-d732df7cd0cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:19.050414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14040dad-e744-4906-a471-d732df7cd0cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:19.051900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14040dad-e744-4906-a471-d732df7cd0cc service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:19.065312 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2744/5539] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:22:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:22:19.128150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea6d77-83f2-44a3-b2a4-9af0017372e7 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:19.135817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f7c2f-d314-4f65-befb-2be61b85da58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:19.137537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f7c2f-d314-4f65-befb-2be61b85da58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:19.137937 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f7c2f-d314-4f65-befb-2be61b85da58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:19.138545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f7c2f-d314-4f65-befb-2be61b85da58 admin admin] PATH_INFO: `/v3/projects/040fe228b490490bbbfae2119dd82c5f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:19.141319 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f7c2f-d314-4f65-befb-2be61b85da58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=040fe228b490490bbbfae2119dd82c5f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:19.150422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f7c2f-d314-4f65-befb-2be61b85da58 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:19.220875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14040dad-e744-4906-a471-d732df7cd0cc service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:19.222741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-14040dad-e744-4906-a471-d732df7cd0cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:19.248858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14040dad-e744-4906-a471-d732df7cd0cc service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:19.274146 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-478f7c2f-d314-4f65-befb-2be61b85da58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '040fe228b490490bbbfae2119dd82c5f', 'request_id': 'req-478f7c2f-d314-4f65-befb-2be61b85da58'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:19.294311 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-478f7c2f-d314-4f65-befb-2be61b85da58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '040fe228b490490bbbfae2119dd82c5f', 'request_id': 'req-478f7c2f-d314-4f65-befb-2be61b85da58'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:19.300696 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-478f7c2f-d314-4f65-befb-2be61b85da58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '040fe228b490490bbbfae2119dd82c5f', 'request_id': 'req-478f7c2f-d314-4f65-befb-2be61b85da58'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:19.329100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-478f7c2f-d314-4f65-befb-2be61b85da58 admin admin] The token cache is being invalidate because project 040fe228b490490bbbfae2119dd82c5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:22:19.329495 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-478f7c2f-d314-4f65-befb-2be61b85da58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:19.330566 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-478f7c2f-d314-4f65-befb-2be61b85da58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:19.332601 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2796/5540] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:22:18 2022] DELETE /identity/v3/projects/040fe228b490490bbbfae2119dd82c5f => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:19.338102 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f7c2f-d314-4f65-befb-2be61b85da58 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:19.340424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-478f7c2f-d314-4f65-befb-2be61b85da58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:19.411900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c073e1a-81d8-43f0-ab33-38841129622d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:19.412591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c073e1a-81d8-43f0-ab33-38841129622d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:19.412868 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c073e1a-81d8-43f0-ab33-38841129622d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:19.413139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c073e1a-81d8-43f0-ab33-38841129622d admin admin] PATH_INFO: `/v3/users/fc931004996446208e5b1afda099f81b` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:19.418101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c073e1a-81d8-43f0-ab33-38841129622d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc931004996446208e5b1afda099f81b)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:19.420632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c073e1a-81d8-43f0-ab33-38841129622d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:19.475213 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:19.482255 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f7c2f-d314-4f65-befb-2be61b85da58 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:19.488554 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b29d79-be1d-4a00-a683-2428eda675be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:19.491041 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b29d79-be1d-4a00-a683-2428eda675be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:19.491415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b29d79-be1d-4a00-a683-2428eda675be admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:19.491781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b29d79-be1d-4a00-a683-2428eda675be admin admin] PATH_INFO: `/v3/users/658625e2c3ed4be986cd757ebfd3b0b6` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:19.493220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b29d79-be1d-4a00-a683-2428eda675be admin admin] RBAC: Authorizing `identity:delete_user(user_id=658625e2c3ed4be986cd757ebfd3b0b6)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:19.496017 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1c073e1a-81d8-43f0-ab33-38841129622d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc931004996446208e5b1afda099f81b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:19.496264 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b29d79-be1d-4a00-a683-2428eda675be admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:19.497374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1c073e1a-81d8-43f0-ab33-38841129622d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc931004996446208e5b1afda099f81b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:19.512393 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1c073e1a-81d8-43f0-ab33-38841129622d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc931004996446208e5b1afda099f81b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:19.525494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1c073e1a-81d8-43f0-ab33-38841129622d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc931004996446208e5b1afda099f81b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:19.528123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1c073e1a-81d8-43f0-ab33-38841129622d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc931004996446208e5b1afda099f81b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:19.579110 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f4b29d79-be1d-4a00-a683-2428eda675be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '658625e2c3ed4be986cd757ebfd3b0b6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:19.579925 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f4b29d79-be1d-4a00-a683-2428eda675be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '658625e2c3ed4be986cd757ebfd3b0b6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:19.586210 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2745/5541] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:22:19 2022] DELETE /identity/v3/users/fc931004996446208e5b1afda099f81b => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:19.588021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e01976-e3ab-4c2b-9187-81139d4104d8 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:19.588450 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e01976-e3ab-4c2b-9187-81139d4104d8 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:19.589317 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e01976-e3ab-4c2b-9187-81139d4104d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:19.604060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f4b29d79-be1d-4a00-a683-2428eda675be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '658625e2c3ed4be986cd757ebfd3b0b6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:19.622794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f4b29d79-be1d-4a00-a683-2428eda675be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '658625e2c3ed4be986cd757ebfd3b0b6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:19.623511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f4b29d79-be1d-4a00-a683-2428eda675be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '658625e2c3ed4be986cd757ebfd3b0b6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:19.656428 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-73e01976-e3ab-4c2b-9187-81139d4104d8 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:19.663767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-73e01976-e3ab-4c2b-9187-81139d4104d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:19.667701 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2797/5542] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:22:19 2022] DELETE /identity/v3/users/658625e2c3ed4be986cd757ebfd3b0b6 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:19.672970 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:19.798788 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2746/5543] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:19.925166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b29d79-be1d-4a00-a683-2428eda675be admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:19.926895 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f4b29d79-be1d-4a00-a683-2428eda675be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:20.038965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b29d79-be1d-4a00-a683-2428eda675be admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:20.050347 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc0fd0-f84b-4145-ab59-864369ac42a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:20.051099 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc0fd0-f84b-4145-ab59-864369ac42a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:20.051256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc0fd0-f84b-4145-ab59-864369ac42a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:20.051542 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc0fd0-f84b-4145-ab59-864369ac42a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:20.067251 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc0fd0-f84b-4145-ab59-864369ac42a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:20.068860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc0fd0-f84b-4145-ab59-864369ac42a8 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:20.081974 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2798/5544] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:22:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:22:20.510488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e01976-e3ab-4c2b-9187-81139d4104d8 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:20.512043 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-73e01976-e3ab-4c2b-9187-81139d4104d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:20.527384 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e01976-e3ab-4c2b-9187-81139d4104d8 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:20.537290 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ac4a4-28ad-463e-83a4-1bffaf089d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:20.538491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ac4a4-28ad-463e-83a4-1bffaf089d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:20.544805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ac4a4-28ad-463e-83a4-1bffaf089d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:20.545106 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ac4a4-28ad-463e-83a4-1bffaf089d2d admin admin] PATH_INFO: `/v3/projects/5557c603db334af097b8c270127d3092` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:20.548895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ac4a4-28ad-463e-83a4-1bffaf089d2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5557c603db334af097b8c270127d3092)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:20.561154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ac4a4-28ad-463e-83a4-1bffaf089d2d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:20.651162 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4d6ac4a4-28ad-463e-83a4-1bffaf089d2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5557c603db334af097b8c270127d3092', 'request_id': 'req-4d6ac4a4-28ad-463e-83a4-1bffaf089d2d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:20.663559 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4d6ac4a4-28ad-463e-83a4-1bffaf089d2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5557c603db334af097b8c270127d3092', 'request_id': 'req-4d6ac4a4-28ad-463e-83a4-1bffaf089d2d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:20.676694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4d6ac4a4-28ad-463e-83a4-1bffaf089d2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5557c603db334af097b8c270127d3092', 'request_id': 'req-4d6ac4a4-28ad-463e-83a4-1bffaf089d2d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:20.695757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4d6ac4a4-28ad-463e-83a4-1bffaf089d2d admin admin] The token cache is being invalidate because project 5557c603db334af097b8c270127d3092 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:22:20.696075 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4d6ac4a4-28ad-463e-83a4-1bffaf089d2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:20.697304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4d6ac4a4-28ad-463e-83a4-1bffaf089d2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:20.703653 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2747/5545] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:22:20 2022] DELETE /identity/v3/projects/5557c603db334af097b8c270127d3092 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:20.705006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619725fe-bb6b-4369-82f6-5a52e13a7ea8 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:20.705292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619725fe-bb6b-4369-82f6-5a52e13a7ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:20.705612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619725fe-bb6b-4369-82f6-5a52e13a7ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:20.732072 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-619725fe-bb6b-4369-82f6-5a52e13a7ea8 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:20.734175 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-619725fe-bb6b-4369-82f6-5a52e13a7ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:20.846941 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2799/5546] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:20.848354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66f18f-2a67-4319-8e22-037e5265fa9f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:20.848826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66f18f-2a67-4319-8e22-037e5265fa9f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:20.849148 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66f18f-2a67-4319-8e22-037e5265fa9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:20.879639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-6c66f18f-2a67-4319-8e22-037e5265fa9f None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:20.881474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6c66f18f-2a67-4319-8e22-037e5265fa9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:20.895714 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2748/5547] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:22:20.899109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619725fe-bb6b-4369-82f6-5a52e13a7ea8 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:20.912355 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619725fe-bb6b-4369-82f6-5a52e13a7ea8 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:20.917759 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9de9c8-452e-4523-bd96-02843943cdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:20.919638 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9de9c8-452e-4523-bd96-02843943cdb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:20.920147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9de9c8-452e-4523-bd96-02843943cdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:20.920709 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9de9c8-452e-4523-bd96-02843943cdb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:20.921603 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9de9c8-452e-4523-bd96-02843943cdb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:22:20.922142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9de9c8-452e-4523-bd96-02843943cdb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:20.924310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9de9c8-452e-4523-bd96-02843943cdb5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:20.945129 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2800/5548] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:22:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:22:20.946618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66f18f-2a67-4319-8e22-037e5265fa9f None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:20.957538 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66f18f-2a67-4319-8e22-037e5265fa9f None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:20.963723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a1d8d-c850-4d80-a1d9-d3ea52ce60f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:20.964350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a1d8d-c850-4d80-a1d9-d3ea52ce60f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:20.964636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a1d8d-c850-4d80-a1d9-d3ea52ce60f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:20.965018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a1d8d-c850-4d80-a1d9-d3ea52ce60f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:20.965984 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a1d8d-c850-4d80-a1d9-d3ea52ce60f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:20.967930 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a1d8d-c850-4d80-a1d9-d3ea52ce60f3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:21.011093 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2749/5549] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:22:20 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:22:21.013644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9de9c8-452e-4523-bd96-02843943cdb5 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:21.031833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9de9c8-452e-4523-bd96-02843943cdb5 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:21.047321 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:21.110752 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a1d8d-c850-4d80-a1d9-d3ea52ce60f3 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:21.114348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7e6a1d8d-c850-4d80-a1d9-d3ea52ce60f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:21.168448 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba662a-1d06-4eee-b798-2eab6b755784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:21.169219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba662a-1d06-4eee-b798-2eab6b755784 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:21.169794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba662a-1d06-4eee-b798-2eab6b755784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:21.170127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba662a-1d06-4eee-b798-2eab6b755784 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:21.170845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba662a-1d06-4eee-b798-2eab6b755784 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:21.173174 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba662a-1d06-4eee-b798-2eab6b755784 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:21.225482 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2801/5550] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:22:21 2022] POST /identity/v3/users => generated 290 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:21.229520 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba662a-1d06-4eee-b798-2eab6b755784 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:21.256020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba662a-1d06-4eee-b798-2eab6b755784 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:21.276089 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95eb11b-b5c1-46f7-a019-d0d55ccd0d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:21.278328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95eb11b-b5c1-46f7-a019-d0d55ccd0d92 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:21.284603 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95eb11b-b5c1-46f7-a019-d0d55ccd0d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:21.285096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95eb11b-b5c1-46f7-a019-d0d55ccd0d92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:21.286018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95eb11b-b5c1-46f7-a019-d0d55ccd0d92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:21.304105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95eb11b-b5c1-46f7-a019-d0d55ccd0d92 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:21.356249 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a1d8d-c850-4d80-a1d9-d3ea52ce60f3 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:21.371661 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2802/5551] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:21.388875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95eb11b-b5c1-46f7-a019-d0d55ccd0d92 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:21.402159 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6761b-5a91-4973-a551-de80444cb270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:21.403351 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6761b-5a91-4973-a551-de80444cb270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:21.403781 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6761b-5a91-4973-a551-de80444cb270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:21.404315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6761b-5a91-4973-a551-de80444cb270 admin admin] PATH_INFO: `/v3/projects/d27f6449bf4f4b71a953ba3748d64873` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:21.406378 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e6761b-5a91-4973-a551-de80444cb270 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d27f6449bf4f4b71a953ba3748d64873)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:21.408120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e6761b-5a91-4973-a551-de80444cb270 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:21.435770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95eb11b-b5c1-46f7-a019-d0d55ccd0d92 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:21.466064 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:21.500590 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817f92e-c84b-445e-a1c9-b7aa4fab2636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:21.501651 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817f92e-c84b-445e-a1c9-b7aa4fab2636 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:21.502389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817f92e-c84b-445e-a1c9-b7aa4fab2636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:21.503048 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817f92e-c84b-445e-a1c9-b7aa4fab2636 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:21.503894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817f92e-c84b-445e-a1c9-b7aa4fab2636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:21.518837 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817f92e-c84b-445e-a1c9-b7aa4fab2636 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:21.552920 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2803/5552] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:21.557742 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817f92e-c84b-445e-a1c9-b7aa4fab2636 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:21.583121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-03e6761b-5a91-4973-a551-de80444cb270 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd27f6449bf4f4b71a953ba3748d64873', 'request_id': 'req-03e6761b-5a91-4973-a551-de80444cb270'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:21.594882 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817f92e-c84b-445e-a1c9-b7aa4fab2636 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:21.604072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-03e6761b-5a91-4973-a551-de80444cb270 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd27f6449bf4f4b71a953ba3748d64873', 'request_id': 'req-03e6761b-5a91-4973-a551-de80444cb270'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:21.617031 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-03e6761b-5a91-4973-a551-de80444cb270 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd27f6449bf4f4b71a953ba3748d64873', 'request_id': 'req-03e6761b-5a91-4973-a551-de80444cb270'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:21.634414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-03e6761b-5a91-4973-a551-de80444cb270 admin admin] The token cache is being invalidate because project d27f6449bf4f4b71a953ba3748d64873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:22:21.635135 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-03e6761b-5a91-4973-a551-de80444cb270 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:21.636126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-03e6761b-5a91-4973-a551-de80444cb270 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:21.642258 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2750/5553] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:22:21 2022] DELETE /identity/v3/projects/d27f6449bf4f4b71a953ba3748d64873 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:21.644381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105beed-db4e-4165-82a1-2752062ed32d None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:21.644921 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105beed-db4e-4165-82a1-2752062ed32d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:21.645564 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105beed-db4e-4165-82a1-2752062ed32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:21.698956 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-4105beed-db4e-4165-82a1-2752062ed32d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:21.704986 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4105beed-db4e-4165-82a1-2752062ed32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:21.827032 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595bbce-56d5-4182-83f9-e40bda957581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:21.828836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595bbce-56d5-4182-83f9-e40bda957581 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:21.828836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595bbce-56d5-4182-83f9-e40bda957581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:21.828836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595bbce-56d5-4182-83f9-e40bda957581 admin admin] PATH_INFO: `/v3/projects/6b3c38e3d2e742cf93e9480fd737bcd0/users/15c472f7b61241529446ff99e7c4dbff/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:21.890244 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2751/5554] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:21.891864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595bbce-56d5-4182-83f9-e40bda957581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b3c38e3d2e742cf93e9480fd737bcd0, user_id=15c472f7b61241529446ff99e7c4dbff, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:21.894905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595bbce-56d5-4182-83f9-e40bda957581 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:21.898807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b63ca-0117-4b2b-b697-89966a1f6af9 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:21.899434 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b63ca-0117-4b2b-b697-89966a1f6af9 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:21.899890 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b63ca-0117-4b2b-b697-89966a1f6af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:21.933470 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2804/5555] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:22:21 2022] PUT /identity/v3/projects/6b3c38e3d2e742cf93e9480fd737bcd0/users/15c472f7b61241529446ff99e7c4dbff/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:21.938400 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2eb049-4c5e-4e4a-b418-ece9f03ed779 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:21.938745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2eb049-4c5e-4e4a-b418-ece9f03ed779 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:21.938986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2eb049-4c5e-4e4a-b418-ece9f03ed779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:21.951930 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-760b63ca-0117-4b2b-b697-89966a1f6af9 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:21.953644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-760b63ca-0117-4b2b-b697-89966a1f6af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:21.996959 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-0e2eb049-4c5e-4e4a-b418-ece9f03ed779 None None] MFA Rules not processed for user `15c472f7b61241529446ff99e7c4dbff`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:21.998538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0e2eb049-4c5e-4e4a-b418-ece9f03ed779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:22.115928 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2752/5556] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:22:22.120918 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:22.121264 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b63ca-0117-4b2b-b697-89966a1f6af9 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:22.137853 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b63ca-0117-4b2b-b697-89966a1f6af9 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:22.144584 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9383c-59c3-4157-bc57-c44120dbb099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:22.145519 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9383c-59c3-4157-bc57-c44120dbb099 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:22.145896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9383c-59c3-4157-bc57-c44120dbb099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:22.146310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9383c-59c3-4157-bc57-c44120dbb099 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:22.147824 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9383c-59c3-4157-bc57-c44120dbb099 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:22:22.148353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9383c-59c3-4157-bc57-c44120dbb099 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:22.150539 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9383c-59c3-4157-bc57-c44120dbb099 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:22.179628 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2805/5557] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:22:22.183849 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2eb049-4c5e-4e4a-b418-ece9f03ed779 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:22.185323 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2753/5558] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:22:22.187379 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9383c-59c3-4157-bc57-c44120dbb099 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:22.203827 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2eb049-4c5e-4e4a-b418-ece9f03ed779 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:22.205722 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9383c-59c3-4157-bc57-c44120dbb099 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:22.214051 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc013b13-f229-414e-9f89-716fd3d9dd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:22.214529 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc013b13-f229-414e-9f89-716fd3d9dd51 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:22.214919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc013b13-f229-414e-9f89-716fd3d9dd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:22.215500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc013b13-f229-414e-9f89-716fd3d9dd51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:22.216688 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc013b13-f229-414e-9f89-716fd3d9dd51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:22.218809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc013b13-f229-414e-9f89-716fd3d9dd51 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:22.218985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c7957-9650-4c4c-a84f-e408bad1e13e tempest-DefaultDomainTestJSON-1832884086 tempest-DefaultDomainTestJSON-1832884086-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c472f7b61241529446ff99e7c4dbff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b3c38e3d2e742cf93e9480fd737bcd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:22.219493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c7957-9650-4c4c-a84f-e408bad1e13e tempest-DefaultDomainTestJSON-1832884086 tempest-DefaultDomainTestJSON-1832884086-project] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:22.219776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c7957-9650-4c4c-a84f-e408bad1e13e tempest-DefaultDomainTestJSON-1832884086 tempest-DefaultDomainTestJSON-1832884086-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:22.220370 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c7957-9650-4c4c-a84f-e408bad1e13e tempest-DefaultDomainTestJSON-1832884086 tempest-DefaultDomainTestJSON-1832884086-project] PATH_INFO: `/v3/domains/default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:22.221890 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c7957-9650-4c4c-a84f-e408bad1e13e tempest-DefaultDomainTestJSON-1832884086 tempest-DefaultDomainTestJSON-1832884086-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:22.224019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c7957-9650-4c4c-a84f-e408bad1e13e tempest-DefaultDomainTestJSON-1832884086 tempest-DefaultDomainTestJSON-1832884086-project] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:22.225719 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2806/5559] 10.222.0.30 () {58 vars in 1152 bytes} [Sun Sep 4 01:22:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:22:22.239656 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c7957-9650-4c4c-a84f-e408bad1e13e tempest-DefaultDomainTestJSON-1832884086 tempest-DefaultDomainTestJSON-1832884086-project] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:22.240722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-044c7957-9650-4c4c-a84f-e408bad1e13e tempest-DefaultDomainTestJSON-1832884086 tempest-DefaultDomainTestJSON-1832884086-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:22.272546 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2754/5560] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:22:22 2022] POST /identity/v3/projects => generated 369 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:22.275949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc013b13-f229-414e-9f89-716fd3d9dd51 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:22.285864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c7957-9650-4c4c-a84f-e408bad1e13e tempest-DefaultDomainTestJSON-1832884086 tempest-DefaultDomainTestJSON-1832884086-project] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:22.289678 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:22.464408 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc013b13-f229-414e-9f89-716fd3d9dd51 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:22.470182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba013655-4603-4ad5-902a-f539f96b9332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:22.471130 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba013655-4603-4ad5-902a-f539f96b9332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:22.471581 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba013655-4603-4ad5-902a-f539f96b9332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:22.472011 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba013655-4603-4ad5-902a-f539f96b9332 admin admin] PATH_INFO: `/v3/users/15c472f7b61241529446ff99e7c4dbff` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:22.479611 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba013655-4603-4ad5-902a-f539f96b9332 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15c472f7b61241529446ff99e7c4dbff)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:22.482918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2cb49c-2d6f-4264-a5bd-bbab31a6f0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:22.483959 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba013655-4603-4ad5-902a-f539f96b9332 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:22.484717 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2cb49c-2d6f-4264-a5bd-bbab31a6f0e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:22.485936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2cb49c-2d6f-4264-a5bd-bbab31a6f0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:22.486321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2cb49c-2d6f-4264-a5bd-bbab31a6f0e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:22.488273 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2cb49c-2d6f-4264-a5bd-bbab31a6f0e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:22.495240 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2cb49c-2d6f-4264-a5bd-bbab31a6f0e2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:22.582385 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2755/5561] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:22:22 2022] POST /identity/v3/users => generated 285 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:22.585634 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2cb49c-2d6f-4264-a5bd-bbab31a6f0e2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:22.592811 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ba013655-4603-4ad5-902a-f539f96b9332 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15c472f7b61241529446ff99e7c4dbff'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:22.593766 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ba013655-4603-4ad5-902a-f539f96b9332 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15c472f7b61241529446ff99e7c4dbff'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:22.617977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2cb49c-2d6f-4264-a5bd-bbab31a6f0e2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:22.628492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ba013655-4603-4ad5-902a-f539f96b9332 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15c472f7b61241529446ff99e7c4dbff'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:22.630437 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87fad3f-dd32-4d87-8dd4-a7f57c304281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:22.632269 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fad3f-dd32-4d87-8dd4-a7f57c304281 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:22.633371 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fad3f-dd32-4d87-8dd4-a7f57c304281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:22.633765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fad3f-dd32-4d87-8dd4-a7f57c304281 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:22.636348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87fad3f-dd32-4d87-8dd4-a7f57c304281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:22.640533 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ba013655-4603-4ad5-902a-f539f96b9332 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15c472f7b61241529446ff99e7c4dbff'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:22.640708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87fad3f-dd32-4d87-8dd4-a7f57c304281 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:22.642640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ba013655-4603-4ad5-902a-f539f96b9332 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15c472f7b61241529446ff99e7c4dbff'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:22.672993 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2756/5562] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:22.675466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87fad3f-dd32-4d87-8dd4-a7f57c304281 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:22.678024 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2807/5563] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:22:22 2022] DELETE /identity/v3/users/15c472f7b61241529446ff99e7c4dbff => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:22.682884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fbfb9-858b-4b9e-8504-103e21603dd8 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:22.684336 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f87fad3f-dd32-4d87-8dd4-a7f57c304281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:22.686256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fbfb9-858b-4b9e-8504-103e21603dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:22.686874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fbfb9-858b-4b9e-8504-103e21603dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:22.701057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87fad3f-dd32-4d87-8dd4-a7f57c304281 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:22.724481 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-091fbfb9-858b-4b9e-8504-103e21603dd8 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:22.726875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-091fbfb9-858b-4b9e-8504-103e21603dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:22.832227 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa77d7e-9565-4dbe-b3c2-070b60fa2012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:22.833938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa77d7e-9565-4dbe-b3c2-070b60fa2012 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:22.834983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa77d7e-9565-4dbe-b3c2-070b60fa2012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:22.835270 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa77d7e-9565-4dbe-b3c2-070b60fa2012 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:22.836841 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa77d7e-9565-4dbe-b3c2-070b60fa2012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:22.839413 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa77d7e-9565-4dbe-b3c2-070b60fa2012 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:22.865609 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2757/5564] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:22.870147 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa77d7e-9565-4dbe-b3c2-070b60fa2012 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:22.871131 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2808/5565] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:22.886224 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa77d7e-9565-4dbe-b3c2-070b60fa2012 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:22.894327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8339e17-3b96-4867-becc-f6dbe78ed384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:22.894965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8339e17-3b96-4867-becc-f6dbe78ed384 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:22.895253 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8339e17-3b96-4867-becc-f6dbe78ed384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:22.896373 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8339e17-3b96-4867-becc-f6dbe78ed384 admin admin] PATH_INFO: `/v3/projects/c865cd65112f459a88eb27273135f8ce/users/c69bb2164eaf4a31b66b00d82872aada/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:22.907866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091fbfb9-858b-4b9e-8504-103e21603dd8 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:22.910563 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-091fbfb9-858b-4b9e-8504-103e21603dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:22.919064 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:22.965981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8339e17-3b96-4867-becc-f6dbe78ed384 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c865cd65112f459a88eb27273135f8ce, user_id=c69bb2164eaf4a31b66b00d82872aada, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:22.972390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8339e17-3b96-4867-becc-f6dbe78ed384 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:23.024401 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2758/5566] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:22:22 2022] PUT /identity/v3/projects/c865cd65112f459a88eb27273135f8ce/users/c69bb2164eaf4a31b66b00d82872aada/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:22:23.026102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2719a3-aa9c-40a4-85db-0e85c895942a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:23.026405 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2719a3-aa9c-40a4-85db-0e85c895942a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:23.026685 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2719a3-aa9c-40a4-85db-0e85c895942a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:23.115454 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091fbfb9-858b-4b9e-8504-103e21603dd8 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:23.132204 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5e2719a3-aa9c-40a4-85db-0e85c895942a None None] MFA Rules not processed for user `c69bb2164eaf4a31b66b00d82872aada`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:23.133453 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5e2719a3-aa9c-40a4-85db-0e85c895942a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:23.247286 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:23.247568 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd52bfc-3177-450b-877e-30c3d63e8117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:23.248047 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd52bfc-3177-450b-877e-30c3d63e8117 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:23.248339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd52bfc-3177-450b-877e-30c3d63e8117 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:23.248613 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd52bfc-3177-450b-877e-30c3d63e8117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:23.307315 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2759/5567] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:23.350753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2719a3-aa9c-40a4-85db-0e85c895942a None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:23.369470 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2719a3-aa9c-40a4-85db-0e85c895942a None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:23.374669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd52bfc-3177-450b-877e-30c3d63e8117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:23.377286 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd52bfc-3177-450b-877e-30c3d63e8117 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:23.378680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae9f8c-5d42-4e2c-86b7-0bedf2207026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:23.379312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae9f8c-5d42-4e2c-86b7-0bedf2207026 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:23.379592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae9f8c-5d42-4e2c-86b7-0bedf2207026 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:23.379864 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae9f8c-5d42-4e2c-86b7-0bedf2207026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:23.392582 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2809/5568] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:22:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:22:23.400078 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae9f8c-5d42-4e2c-86b7-0bedf2207026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:23.401594 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae9f8c-5d42-4e2c-86b7-0bedf2207026 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:23.424524 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2760/5569] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:22:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:22:23.782698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd52bfc-3177-450b-877e-30c3d63e8117 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:23.784761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fdd52bfc-3177-450b-877e-30c3d63e8117 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:23.801766 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd52bfc-3177-450b-877e-30c3d63e8117 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:23.811834 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf21bd9-92d2-45f9-904d-79a110126419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:23.812928 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf21bd9-92d2-45f9-904d-79a110126419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:23.813313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf21bd9-92d2-45f9-904d-79a110126419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:23.813780 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf21bd9-92d2-45f9-904d-79a110126419 admin admin] PATH_INFO: `/v3/users/c78a44853db54afc87cda53393f1a06a` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:23.815404 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf21bd9-92d2-45f9-904d-79a110126419 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c78a44853db54afc87cda53393f1a06a)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:23.817865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf21bd9-92d2-45f9-904d-79a110126419 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:23.952434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9cf21bd9-92d2-45f9-904d-79a110126419 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c78a44853db54afc87cda53393f1a06a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:23.957745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9cf21bd9-92d2-45f9-904d-79a110126419 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c78a44853db54afc87cda53393f1a06a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:23.988116 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9cf21bd9-92d2-45f9-904d-79a110126419 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c78a44853db54afc87cda53393f1a06a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:24.001739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9cf21bd9-92d2-45f9-904d-79a110126419 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c78a44853db54afc87cda53393f1a06a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:24.003244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9cf21bd9-92d2-45f9-904d-79a110126419 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c78a44853db54afc87cda53393f1a06a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:24.004109 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:24.035711 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2810/5570] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:22:23 2022] DELETE /identity/v3/users/c78a44853db54afc87cda53393f1a06a => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:24.041883 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e8d13-30ea-4c6e-b161-157e640e0882 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:24.042381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e8d13-30ea-4c6e-b161-157e640e0882 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:24.042850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e8d13-30ea-4c6e-b161-157e640e0882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:24.068975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-f47e8d13-30ea-4c6e-b161-157e640e0882 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:24.070531 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f47e8d13-30ea-4c6e-b161-157e640e0882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:24.202901 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2761/5571] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:24.223833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf21bd9-92d2-45f9-904d-79a110126419 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:24.225929 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9cf21bd9-92d2-45f9-904d-79a110126419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:24.386003 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf21bd9-92d2-45f9-904d-79a110126419 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:24.390753 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc235a9a-e825-4b77-8092-fa8e4057f442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:24.391425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc235a9a-e825-4b77-8092-fa8e4057f442 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:24.391753 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc235a9a-e825-4b77-8092-fa8e4057f442 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:24.392070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc235a9a-e825-4b77-8092-fa8e4057f442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:24.407916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc235a9a-e825-4b77-8092-fa8e4057f442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:24.409014 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc235a9a-e825-4b77-8092-fa8e4057f442 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:24.423603 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2811/5572] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:22:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:22:24.439846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e8d13-30ea-4c6e-b161-157e640e0882 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:24.441791 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f47e8d13-30ea-4c6e-b161-157e640e0882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:24.472961 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e8d13-30ea-4c6e-b161-157e640e0882 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:24.486114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65047f-4cb1-458b-a805-07917526e28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:24.498740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65047f-4cb1-458b-a805-07917526e28e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:24.500114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65047f-4cb1-458b-a805-07917526e28e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:24.503285 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65047f-4cb1-458b-a805-07917526e28e admin admin] PATH_INFO: `/v3/projects/6b3c38e3d2e742cf93e9480fd737bcd0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:24.508945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65047f-4cb1-458b-a805-07917526e28e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b3c38e3d2e742cf93e9480fd737bcd0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:24.518983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65047f-4cb1-458b-a805-07917526e28e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:24.592571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-fc65047f-4cb1-458b-a805-07917526e28e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b3c38e3d2e742cf93e9480fd737bcd0', 'request_id': 'req-fc65047f-4cb1-458b-a805-07917526e28e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:24.603918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-fc65047f-4cb1-458b-a805-07917526e28e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b3c38e3d2e742cf93e9480fd737bcd0', 'request_id': 'req-fc65047f-4cb1-458b-a805-07917526e28e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:24.613102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-fc65047f-4cb1-458b-a805-07917526e28e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b3c38e3d2e742cf93e9480fd737bcd0', 'request_id': 'req-fc65047f-4cb1-458b-a805-07917526e28e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:24.633191 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-fc65047f-4cb1-458b-a805-07917526e28e admin admin] The token cache is being invalidate because project 6b3c38e3d2e742cf93e9480fd737bcd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:22:24.633519 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-fc65047f-4cb1-458b-a805-07917526e28e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:24.634195 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-fc65047f-4cb1-458b-a805-07917526e28e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:24.636529 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2762/5573] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:22:24 2022] DELETE /identity/v3/projects/6b3c38e3d2e742cf93e9480fd737bcd0 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:24.643528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2639d8b-17e2-4d93-a481-2cfebfa14bca None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:24.644825 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2639d8b-17e2-4d93-a481-2cfebfa14bca None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:24.645172 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2639d8b-17e2-4d93-a481-2cfebfa14bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:24.670868 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e2639d8b-17e2-4d93-a481-2cfebfa14bca None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:24.672341 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e2639d8b-17e2-4d93-a481-2cfebfa14bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:24.778342 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2812/5574] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:24.780621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603a1fc-5608-4c0c-937c-9dd69bb835a6 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:24.780922 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603a1fc-5608-4c0c-937c-9dd69bb835a6 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:24.781245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603a1fc-5608-4c0c-937c-9dd69bb835a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:24.790478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2639d8b-17e2-4d93-a481-2cfebfa14bca None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:24.792349 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e2639d8b-17e2-4d93-a481-2cfebfa14bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:24.812386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2639d8b-17e2-4d93-a481-2cfebfa14bca None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:24.816661 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-9603a1fc-5608-4c0c-937c-9dd69bb835a6 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:24.819479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9603a1fc-5608-4c0c-937c-9dd69bb835a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:24.820553 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fd1ee-7fe8-4fc8-962a-6ee0d9157508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:24.821210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fd1ee-7fe8-4fc8-962a-6ee0d9157508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:24.821599 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fd1ee-7fe8-4fc8-962a-6ee0d9157508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:24.821847 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fd1ee-7fe8-4fc8-962a-6ee0d9157508 admin admin] PATH_INFO: `/v3/projects/efa43dae1638466abe56366c78a4bc43` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:24.823073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fd1ee-7fe8-4fc8-962a-6ee0d9157508 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efa43dae1638466abe56366c78a4bc43)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:24.835095 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2763/5575] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:24.835268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fd1ee-7fe8-4fc8-962a-6ee0d9157508 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:24.836649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603a1fc-5608-4c0c-937c-9dd69bb835a6 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:24.849212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603a1fc-5608-4c0c-937c-9dd69bb835a6 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:24.854547 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c7858-61ea-4db8-9817-c1dd845df833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:24.855272 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c7858-61ea-4db8-9817-c1dd845df833 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:24.855560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c7858-61ea-4db8-9817-c1dd845df833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:24.855886 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c7858-61ea-4db8-9817-c1dd845df833 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:24.856680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c7858-61ea-4db8-9817-c1dd845df833 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:22:24.857014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c7858-61ea-4db8-9817-c1dd845df833 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:24.858820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c7858-61ea-4db8-9817-c1dd845df833 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:24.877538 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2764/5576] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:22:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:22:24.882474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c7858-61ea-4db8-9817-c1dd845df833 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:24.908729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c7858-61ea-4db8-9817-c1dd845df833 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:24.910271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e38fd1ee-7fe8-4fc8-962a-6ee0d9157508 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efa43dae1638466abe56366c78a4bc43', 'request_id': 'req-e38fd1ee-7fe8-4fc8-962a-6ee0d9157508'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:24.924819 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e38fd1ee-7fe8-4fc8-962a-6ee0d9157508 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efa43dae1638466abe56366c78a4bc43', 'request_id': 'req-e38fd1ee-7fe8-4fc8-962a-6ee0d9157508'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:24.935284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e38fd1ee-7fe8-4fc8-962a-6ee0d9157508 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efa43dae1638466abe56366c78a4bc43', 'request_id': 'req-e38fd1ee-7fe8-4fc8-962a-6ee0d9157508'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:24.950013 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e38fd1ee-7fe8-4fc8-962a-6ee0d9157508 admin admin] The token cache is being invalidate because project efa43dae1638466abe56366c78a4bc43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:22:24.950289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e38fd1ee-7fe8-4fc8-962a-6ee0d9157508 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:24.951417 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e38fd1ee-7fe8-4fc8-962a-6ee0d9157508 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:24.953809 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2813/5577] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:22:24 2022] DELETE /identity/v3/projects/efa43dae1638466abe56366c78a4bc43 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:22:24.957611 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fd1ee-7fe8-4fc8-962a-6ee0d9157508 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:24.961136 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e38fd1ee-7fe8-4fc8-962a-6ee0d9157508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:24.962513 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:24.980673 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:25.000958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc44f6-11bd-4357-9dae-1f19d558c939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:25.001638 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc44f6-11bd-4357-9dae-1f19d558c939 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:25.001948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc44f6-11bd-4357-9dae-1f19d558c939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:25.002608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc44f6-11bd-4357-9dae-1f19d558c939 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:25.003672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc44f6-11bd-4357-9dae-1f19d558c939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:25.005931 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc44f6-11bd-4357-9dae-1f19d558c939 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:25.045117 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2765/5578] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:22:24 2022] POST /identity/v3/projects => generated 399 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:25.051094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc44f6-11bd-4357-9dae-1f19d558c939 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:25.054389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-79fc44f6-11bd-4357-9dae-1f19d558c939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:25.088955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fd1ee-7fe8-4fc8-962a-6ee0d9157508 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:25.195938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42abb1f6-1cde-4b1e-8d39-ee4c4699090e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:25.198652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abb1f6-1cde-4b1e-8d39-ee4c4699090e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:25.198992 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abb1f6-1cde-4b1e-8d39-ee4c4699090e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:25.199414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abb1f6-1cde-4b1e-8d39-ee4c4699090e admin admin] PATH_INFO: `/v3/users/a9d5bb7521574fb8bb4f8156277046b2` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:25.202750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42abb1f6-1cde-4b1e-8d39-ee4c4699090e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9d5bb7521574fb8bb4f8156277046b2)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:25.204006 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc44f6-11bd-4357-9dae-1f19d558c939 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:25.208440 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42abb1f6-1cde-4b1e-8d39-ee4c4699090e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:25.214129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3daac7-b70f-4a78-a435-51ef595868ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:25.218052 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3daac7-b70f-4a78-a435-51ef595868ac admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:25.219017 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3daac7-b70f-4a78-a435-51ef595868ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:25.219652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3daac7-b70f-4a78-a435-51ef595868ac admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:25.220689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3daac7-b70f-4a78-a435-51ef595868ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:25.225852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3daac7-b70f-4a78-a435-51ef595868ac admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:25.268774 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2766/5579] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:22:25 2022] POST /identity/v3/users => generated 306 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:25.272643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3daac7-b70f-4a78-a435-51ef595868ac admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:25.298462 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3daac7-b70f-4a78-a435-51ef595868ac admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:25.305832 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500e357-a9bd-491c-b7d6-c95fa151a79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:25.306974 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500e357-a9bd-491c-b7d6-c95fa151a79d admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:25.307707 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500e357-a9bd-491c-b7d6-c95fa151a79d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:25.307707 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500e357-a9bd-491c-b7d6-c95fa151a79d admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:25.308901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500e357-a9bd-491c-b7d6-c95fa151a79d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:25.311233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500e357-a9bd-491c-b7d6-c95fa151a79d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:25.329479 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2767/5580] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:25.329686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-42abb1f6-1cde-4b1e-8d39-ee4c4699090e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9d5bb7521574fb8bb4f8156277046b2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:25.332974 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-42abb1f6-1cde-4b1e-8d39-ee4c4699090e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9d5bb7521574fb8bb4f8156277046b2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:25.333488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500e357-a9bd-491c-b7d6-c95fa151a79d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:25.340534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7500e357-a9bd-491c-b7d6-c95fa151a79d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:25.351914 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-42abb1f6-1cde-4b1e-8d39-ee4c4699090e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9d5bb7521574fb8bb4f8156277046b2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:25.367485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-42abb1f6-1cde-4b1e-8d39-ee4c4699090e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9d5bb7521574fb8bb4f8156277046b2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:25.368669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-42abb1f6-1cde-4b1e-8d39-ee4c4699090e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9d5bb7521574fb8bb4f8156277046b2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:25.388519 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500e357-a9bd-491c-b7d6-c95fa151a79d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:25.400526 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32492849-e086-4c15-bfc9-a0239a9127e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:25.401502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32492849-e086-4c15-bfc9-a0239a9127e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:25.402218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32492849-e086-4c15-bfc9-a0239a9127e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:25.402739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32492849-e086-4c15-bfc9-a0239a9127e7 admin admin] PATH_INFO: `/v3/projects/b8ea4b99a2de4d5ca44b6e1810158861/users/25f221b3d1cd44fbbc596f4a13b74f1a/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:25.407703 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2814/5581] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:22:24 2022] DELETE /identity/v3/users/a9d5bb7521574fb8bb4f8156277046b2 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:22:25.421701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32492849-e086-4c15-bfc9-a0239a9127e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8ea4b99a2de4d5ca44b6e1810158861, user_id=25f221b3d1cd44fbbc596f4a13b74f1a, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:25.426080 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32492849-e086-4c15-bfc9-a0239a9127e7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:25.455743 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2768/5582] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:22:25 2022] PUT /identity/v3/projects/b8ea4b99a2de4d5ca44b6e1810158861/users/25f221b3d1cd44fbbc596f4a13b74f1a/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:25.464803 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42abb1f6-1cde-4b1e-8d39-ee4c4699090e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:25.603495 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:25.667584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42abb1f6-1cde-4b1e-8d39-ee4c4699090e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:25.768562 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2810b-4162-42b1-9259-98a93d493611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:25.769559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2810b-4162-42b1-9259-98a93d493611 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:25.770084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2810b-4162-42b1-9259-98a93d493611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:25.770447 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2810b-4162-42b1-9259-98a93d493611 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:25.771327 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e2810b-4162-42b1-9259-98a93d493611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:25.773845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e2810b-4162-42b1-9259-98a93d493611 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:25.804077 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2815/5583] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:25.807513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32492849-e086-4c15-bfc9-a0239a9127e7 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:25.826025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32492849-e086-4c15-bfc9-a0239a9127e7 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:25.836897 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10e1e4-0064-4533-a6a0-e58153a46991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:25.838299 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10e1e4-0064-4533-a6a0-e58153a46991 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:25.838853 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10e1e4-0064-4533-a6a0-e58153a46991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:25.839367 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10e1e4-0064-4533-a6a0-e58153a46991 admin admin] PATH_INFO: `/v3/projects/b8ea4b99a2de4d5ca44b6e1810158861/users/25f221b3d1cd44fbbc596f4a13b74f1a/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:25.849106 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10e1e4-0064-4533-a6a0-e58153a46991 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8ea4b99a2de4d5ca44b6e1810158861, user_id=25f221b3d1cd44fbbc596f4a13b74f1a, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:25.859488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10e1e4-0064-4533-a6a0-e58153a46991 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:25.932675 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2769/5584] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:22:25 2022] PUT /identity/v3/projects/b8ea4b99a2de4d5ca44b6e1810158861/users/25f221b3d1cd44fbbc596f4a13b74f1a/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:25.945395 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1775c6-79ad-42be-9252-b2e1944fabc0 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:25.945994 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1775c6-79ad-42be-9252-b2e1944fabc0 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:25.947629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1775c6-79ad-42be-9252-b2e1944fabc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:26.031282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-7a1775c6-79ad-42be-9252-b2e1944fabc0 None None] MFA Rules not processed for user `25f221b3d1cd44fbbc596f4a13b74f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:26.036079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7a1775c6-79ad-42be-9252-b2e1944fabc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:26.061387 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10e1e4-0064-4533-a6a0-e58153a46991 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:26.063727 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9e10e1e4-0064-4533-a6a0-e58153a46991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:26.169871 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2816/5585] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:25 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:26.174666 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1775c6-79ad-42be-9252-b2e1944fabc0 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:26.285084 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10e1e4-0064-4533-a6a0-e58153a46991 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:26.325010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0b83a-7672-46ba-8903-d1bdb4c5e8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:26.325712 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0b83a-7672-46ba-8903-d1bdb4c5e8e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:26.325998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0b83a-7672-46ba-8903-d1bdb4c5e8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:26.326273 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0b83a-7672-46ba-8903-d1bdb4c5e8e5 admin admin] PATH_INFO: `/v3/projects/03baa375379a49f2adc2d73678ada3cd` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:26.328643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd0b83a-7672-46ba-8903-d1bdb4c5e8e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03baa375379a49f2adc2d73678ada3cd)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:26.334381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd0b83a-7672-46ba-8903-d1bdb4c5e8e5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:26.337041 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1775c6-79ad-42be-9252-b2e1944fabc0 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:26.340771 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:26.343327 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e632726-5119-49b6-949d-6fdbf9f3a7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:26.344709 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e632726-5119-49b6-949d-6fdbf9f3a7a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:26.345069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e632726-5119-49b6-949d-6fdbf9f3a7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:26.345420 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e632726-5119-49b6-949d-6fdbf9f3a7a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:26.346640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e632726-5119-49b6-949d-6fdbf9f3a7a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:26.348687 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e632726-5119-49b6-949d-6fdbf9f3a7a7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:26.358428 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:26.404213 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2817/5586] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:22:26 2022] POST /identity/v3/projects => generated 399 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:26.406149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e632726-5119-49b6-949d-6fdbf9f3a7a7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:26.473237 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dfd0b83a-7672-46ba-8903-d1bdb4c5e8e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03baa375379a49f2adc2d73678ada3cd', 'request_id': 'req-dfd0b83a-7672-46ba-8903-d1bdb4c5e8e5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:26.487906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dfd0b83a-7672-46ba-8903-d1bdb4c5e8e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03baa375379a49f2adc2d73678ada3cd', 'request_id': 'req-dfd0b83a-7672-46ba-8903-d1bdb4c5e8e5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:26.501273 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dfd0b83a-7672-46ba-8903-d1bdb4c5e8e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03baa375379a49f2adc2d73678ada3cd', 'request_id': 'req-dfd0b83a-7672-46ba-8903-d1bdb4c5e8e5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:26.522228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dfd0b83a-7672-46ba-8903-d1bdb4c5e8e5 admin admin] The token cache is being invalidate because project 03baa375379a49f2adc2d73678ada3cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:22:26.522601 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dfd0b83a-7672-46ba-8903-d1bdb4c5e8e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:26.529578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dfd0b83a-7672-46ba-8903-d1bdb4c5e8e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:26.534092 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2770/5587] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:22:26 2022] DELETE /identity/v3/projects/03baa375379a49f2adc2d73678ada3cd => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:26.535465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ba1a7-8d38-4556-8f90-2639dd6e7989 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:26.535809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ba1a7-8d38-4556-8f90-2639dd6e7989 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:26.536101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ba1a7-8d38-4556-8f90-2639dd6e7989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:26.574346 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e632726-5119-49b6-949d-6fdbf9f3a7a7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:26.583632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b74ba1a7-8d38-4556-8f90-2639dd6e7989 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:26.586570 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b74ba1a7-8d38-4556-8f90-2639dd6e7989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:26.659809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed22e079-1e2e-4944-b71b-eead5ff929f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:26.660452 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22e079-1e2e-4944-b71b-eead5ff929f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:26.661106 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22e079-1e2e-4944-b71b-eead5ff929f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:26.661106 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22e079-1e2e-4944-b71b-eead5ff929f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:26.661722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed22e079-1e2e-4944-b71b-eead5ff929f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:26.663806 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed22e079-1e2e-4944-b71b-eead5ff929f5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:26.667638 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2771/5588] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:26.674788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd3e66-38dd-499e-86de-802c7888c7bf None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:26.675287 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd3e66-38dd-499e-86de-802c7888c7bf None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:26.675760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd3e66-38dd-499e-86de-802c7888c7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:26.699989 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2818/5589] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:22:26 2022] POST /identity/v3/users => generated 300 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:26.703500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed22e079-1e2e-4944-b71b-eead5ff929f5 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:26.706390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ed22e079-1e2e-4944-b71b-eead5ff929f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:26.710229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-41fd3e66-38dd-499e-86de-802c7888c7bf None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:26.711416 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-41fd3e66-38dd-499e-86de-802c7888c7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:26.720396 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2772/5590] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:26.724451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd3e66-38dd-499e-86de-802c7888c7bf None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:26.727107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed22e079-1e2e-4944-b71b-eead5ff929f5 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:26.733206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a75f9-f522-4ebc-998b-c4c665cb38c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:26.734031 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a75f9-f522-4ebc-998b-c4c665cb38c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:26.734349 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a75f9-f522-4ebc-998b-c4c665cb38c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:26.734488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd3e66-38dd-499e-86de-802c7888c7bf None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:26.734811 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a75f9-f522-4ebc-998b-c4c665cb38c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:26.735820 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a75f9-f522-4ebc-998b-c4c665cb38c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:26.738205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a75f9-f522-4ebc-998b-c4c665cb38c6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:26.739377 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a0023-b148-4f83-987c-ca97bb15e9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:26.739997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a0023-b148-4f83-987c-ca97bb15e9ef admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:26.740446 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a0023-b148-4f83-987c-ca97bb15e9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:26.741042 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a0023-b148-4f83-987c-ca97bb15e9ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:26.741412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a0023-b148-4f83-987c-ca97bb15e9ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:22:26.741745 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a0023-b148-4f83-987c-ca97bb15e9ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:26.743464 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a0023-b148-4f83-987c-ca97bb15e9ef admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:26.754497 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2819/5591] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:26.758716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a75f9-f522-4ebc-998b-c4c665cb38c6 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:26.764594 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2773/5592] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:22:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:22:26.765628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a0023-b148-4f83-987c-ca97bb15e9ef admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:26.772136 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a75f9-f522-4ebc-998b-c4c665cb38c6 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:26.778534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a0023-b148-4f83-987c-ca97bb15e9ef admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:26.779217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f511ae-48de-480f-a65b-697babb32800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:26.780567 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f511ae-48de-480f-a65b-697babb32800 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:26.781000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f511ae-48de-480f-a65b-697babb32800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:26.781422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f511ae-48de-480f-a65b-697babb32800 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:26.782263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f511ae-48de-480f-a65b-697babb32800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:26.784265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f511ae-48de-480f-a65b-697babb32800 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:26.784727 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093de8f-c4b9-4f76-ad57-aa54a528aa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:26.785523 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093de8f-c4b9-4f76-ad57-aa54a528aa84 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:26.785921 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093de8f-c4b9-4f76-ad57-aa54a528aa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:26.786368 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093de8f-c4b9-4f76-ad57-aa54a528aa84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:26.787379 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093de8f-c4b9-4f76-ad57-aa54a528aa84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:26.791881 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093de8f-c4b9-4f76-ad57-aa54a528aa84 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:26.804938 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2820/5593] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:22:26.808498 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f511ae-48de-480f-a65b-697babb32800 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:26.825182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f511ae-48de-480f-a65b-697babb32800 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:26.829042 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2774/5594] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:22:26 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:26.831155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e47f1-90d3-4a1c-8caa-97a18504d74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:26.832537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e47f1-90d3-4a1c-8caa-97a18504d74f admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:26.833176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e47f1-90d3-4a1c-8caa-97a18504d74f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:26.833790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e47f1-90d3-4a1c-8caa-97a18504d74f admin admin] PATH_INFO: `/v3/projects/5b9d9ff4eaf54c4d8ec9017d4d3e3747/users/7bf82d86eb7e459abdc31121f1e86668/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:26.834753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093de8f-c4b9-4f76-ad57-aa54a528aa84 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:26.859431 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e47f1-90d3-4a1c-8caa-97a18504d74f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b9d9ff4eaf54c4d8ec9017d4d3e3747, user_id=7bf82d86eb7e459abdc31121f1e86668, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:26.867028 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e47f1-90d3-4a1c-8caa-97a18504d74f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:26.890319 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2821/5595] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:22:26 2022] PUT /identity/v3/projects/5b9d9ff4eaf54c4d8ec9017d4d3e3747/users/7bf82d86eb7e459abdc31121f1e86668/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:26.902864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e731c-afdd-480a-9730-74ceb2e6f37c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:26.903459 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e731c-afdd-480a-9730-74ceb2e6f37c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:26.903996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e731c-afdd-480a-9730-74ceb2e6f37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:26.922257 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:26.947661 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093de8f-c4b9-4f76-ad57-aa54a528aa84 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:26.958323 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-aa7e731c-afdd-480a-9730-74ceb2e6f37c None None] MFA Rules not processed for user `7bf82d86eb7e459abdc31121f1e86668`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:26.960711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-aa7e731c-afdd-480a-9730-74ceb2e6f37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:26.996625 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:27.040329 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c7a62-fdd6-48c4-992f-6a7ea3bb6087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:27.041506 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c7a62-fdd6-48c4-992f-6a7ea3bb6087 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:27.042007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c7a62-fdd6-48c4-992f-6a7ea3bb6087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:27.042620 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c7a62-fdd6-48c4-992f-6a7ea3bb6087 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:27.043972 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c7a62-fdd6-48c4-992f-6a7ea3bb6087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:27.046837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c7a62-fdd6-48c4-992f-6a7ea3bb6087 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:27.056385 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2822/5596] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:26 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:27.076108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e731c-afdd-480a-9730-74ceb2e6f37c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:27.078067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-aa7e731c-afdd-480a-9730-74ceb2e6f37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:27.091944 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2775/5597] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:22:26 2022] POST /identity/v3/users => generated 287 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:22:27.096308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c7a62-fdd6-48c4-992f-6a7ea3bb6087 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:27.141767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c7a62-fdd6-48c4-992f-6a7ea3bb6087 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:27.155225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf114cf-de93-43f7-bc08-9ec5b3652695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:27.155225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf114cf-de93-43f7-bc08-9ec5b3652695 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:27.155225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf114cf-de93-43f7-bc08-9ec5b3652695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:27.155707 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf114cf-de93-43f7-bc08-9ec5b3652695 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:27.156730 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf114cf-de93-43f7-bc08-9ec5b3652695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:27.167382 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf114cf-de93-43f7-bc08-9ec5b3652695 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:27.201548 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2776/5598] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:22:27.203251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf114cf-de93-43f7-bc08-9ec5b3652695 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:27.217971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e731c-afdd-480a-9730-74ceb2e6f37c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:27.220492 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf114cf-de93-43f7-bc08-9ec5b3652695 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:27.229842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2dbbf0-6f18-416a-bff2-9f59422944f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:27.230797 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2dbbf0-6f18-416a-bff2-9f59422944f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:27.231308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2dbbf0-6f18-416a-bff2-9f59422944f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:27.232405 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2dbbf0-6f18-416a-bff2-9f59422944f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:27.232709 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244b79b-8748-42bc-8ecd-3f13f68df3d5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efcee9b21ea94b1b8e5c9c5acb35839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:27.233928 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2dbbf0-6f18-416a-bff2-9f59422944f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:27.234088 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244b79b-8748-42bc-8ecd-3f13f68df3d5 service glance] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:27.234190 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244b79b-8748-42bc-8ecd-3f13f68df3d5 service glance] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:27.234607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244b79b-8748-42bc-8ecd-3f13f68df3d5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:27.236222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2dbbf0-6f18-416a-bff2-9f59422944f8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:27.236382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c244b79b-8748-42bc-8ecd-3f13f68df3d5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:27.260433 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2777/5599] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:27.261976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2dbbf0-6f18-416a-bff2-9f59422944f8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:27.299397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2dbbf0-6f18-416a-bff2-9f59422944f8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:27.319662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bd00c-0efb-48d2-95a8-c752e52a67c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:27.320534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bd00c-0efb-48d2-95a8-c752e52a67c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:27.320965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bd00c-0efb-48d2-95a8-c752e52a67c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:27.321598 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bd00c-0efb-48d2-95a8-c752e52a67c1 admin admin] PATH_INFO: `/v3/projects/cc286707eafc4effa2ddbfd634951fe9/users/36a5a8387c9c4870a3babe72af81b857/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:27.349345 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244b79b-8748-42bc-8ecd-3f13f68df3d5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:27.352681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014bd00c-0efb-48d2-95a8-c752e52a67c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc286707eafc4effa2ddbfd634951fe9, user_id=36a5a8387c9c4870a3babe72af81b857, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:27.354925 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244b79b-8748-42bc-8ecd-3f13f68df3d5 service glance] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:27.360363 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014bd00c-0efb-48d2-95a8-c752e52a67c1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:27.374614 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2823/5600] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:22:27 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:22:27.398267 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2778/5601] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:22:27 2022] PUT /identity/v3/projects/cc286707eafc4effa2ddbfd634951fe9/users/36a5a8387c9c4870a3babe72af81b857/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:22:27.400443 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c9a34-4670-48a6-bb31-ecca20d97ac2 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:27.400807 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c9a34-4670-48a6-bb31-ecca20d97ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:27.401159 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c9a34-4670-48a6-bb31-ecca20d97ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:27.457502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-2e7c9a34-4670-48a6-bb31-ecca20d97ac2 None None] MFA Rules not processed for user `36a5a8387c9c4870a3babe72af81b857`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:27.470845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2e7c9a34-4670-48a6-bb31-ecca20d97ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:27.622655 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2824/5602] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:27.628237 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bd00c-0efb-48d2-95a8-c752e52a67c1 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:27.775632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bd00c-0efb-48d2-95a8-c752e52a67c1 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:27.781811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06264574-b256-4093-88f1-25adb4c9d8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:27.783061 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06264574-b256-4093-88f1-25adb4c9d8f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:27.783569 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06264574-b256-4093-88f1-25adb4c9d8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:27.784118 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06264574-b256-4093-88f1-25adb4c9d8f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:27.785331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06264574-b256-4093-88f1-25adb4c9d8f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:27.788644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06264574-b256-4093-88f1-25adb4c9d8f2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:27.829630 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2779/5603] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:22:27 2022] POST /identity/v3/projects => generated 373 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:27.830195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c9a34-4670-48a6-bb31-ecca20d97ac2 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:27.842757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c9a34-4670-48a6-bb31-ecca20d97ac2 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:27.846623 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:28.023103 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e3cff-a993-49d0-91a1-db91bf6f552d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:28.023676 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e3cff-a993-49d0-91a1-db91bf6f552d admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:28.024002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e3cff-a993-49d0-91a1-db91bf6f552d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:28.024524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e3cff-a993-49d0-91a1-db91bf6f552d admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:28.025247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e3cff-a993-49d0-91a1-db91bf6f552d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:28.027450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e3cff-a993-49d0-91a1-db91bf6f552d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:28.105378 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2825/5604] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:22:27 2022] POST /identity/v3/users => generated 293 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:22:28.107713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06264574-b256-4093-88f1-25adb4c9d8f2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:28.122602 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06264574-b256-4093-88f1-25adb4c9d8f2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:28.131742 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6129e-2a05-4910-98bb-2d4d07cdccac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:28.133277 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6129e-2a05-4910-98bb-2d4d07cdccac admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:28.134188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6129e-2a05-4910-98bb-2d4d07cdccac admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:28.138118 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6129e-2a05-4910-98bb-2d4d07cdccac admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:28.144136 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6129e-2a05-4910-98bb-2d4d07cdccac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:28.149405 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6129e-2a05-4910-98bb-2d4d07cdccac admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:28.175065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e3cff-a993-49d0-91a1-db91bf6f552d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:28.176203 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2780/5605] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:28.179115 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6129e-2a05-4910-98bb-2d4d07cdccac admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:28.190529 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e3cff-a993-49d0-91a1-db91bf6f552d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:28.194812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6129e-2a05-4910-98bb-2d4d07cdccac admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:28.201537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c9713-3a31-4fc1-9084-76b00fca5912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:28.202554 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c9713-3a31-4fc1-9084-76b00fca5912 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:28.203052 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c9713-3a31-4fc1-9084-76b00fca5912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:28.203172 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26bc0c6-9a6f-488c-8bda-94a948c431a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:28.203682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c9713-3a31-4fc1-9084-76b00fca5912 admin admin] PATH_INFO: `/v3/projects/242dc2b7dbe548a2ad5109893c40ce0a/users/05a3d2e003e044bb96bbd5ab0c5412b0/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:28.203823 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bc0c6-9a6f-488c-8bda-94a948c431a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:28.204650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bc0c6-9a6f-488c-8bda-94a948c431a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:28.205006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bc0c6-9a6f-488c-8bda-94a948c431a3 admin admin] PATH_INFO: `/v3/users/25f221b3d1cd44fbbc596f4a13b74f1a` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:28.210423 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26bc0c6-9a6f-488c-8bda-94a948c431a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25f221b3d1cd44fbbc596f4a13b74f1a)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:28.215947 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26bc0c6-9a6f-488c-8bda-94a948c431a3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:28.224521 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:28.232327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c9713-3a31-4fc1-9084-76b00fca5912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=242dc2b7dbe548a2ad5109893c40ce0a, user_id=05a3d2e003e044bb96bbd5ab0c5412b0, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:28.237193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c9713-3a31-4fc1-9084-76b00fca5912 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:28.262784 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2781/5606] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:22:28 2022] PUT /identity/v3/projects/242dc2b7dbe548a2ad5109893c40ce0a/users/05a3d2e003e044bb96bbd5ab0c5412b0/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:28.264191 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c9713-3a31-4fc1-9084-76b00fca5912 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:28.331774 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a26bc0c6-9a6f-488c-8bda-94a948c431a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25f221b3d1cd44fbbc596f4a13b74f1a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:28.332592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a26bc0c6-9a6f-488c-8bda-94a948c431a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25f221b3d1cd44fbbc596f4a13b74f1a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:28.342490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a26bc0c6-9a6f-488c-8bda-94a948c431a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25f221b3d1cd44fbbc596f4a13b74f1a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:28.352379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a26bc0c6-9a6f-488c-8bda-94a948c431a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25f221b3d1cd44fbbc596f4a13b74f1a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:28.353615 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a26bc0c6-9a6f-488c-8bda-94a948c431a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25f221b3d1cd44fbbc596f4a13b74f1a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:28.364878 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c9713-3a31-4fc1-9084-76b00fca5912 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:28.369977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ccde5-7c71-434f-b5b3-c4d11e92513f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:28.370816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ccde5-7c71-434f-b5b3-c4d11e92513f admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:28.371119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ccde5-7c71-434f-b5b3-c4d11e92513f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:28.371489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ccde5-7c71-434f-b5b3-c4d11e92513f admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:28.372248 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ccde5-7c71-434f-b5b3-c4d11e92513f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:28.374026 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ccde5-7c71-434f-b5b3-c4d11e92513f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:28.389487 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2782/5608] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:28.392814 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2826/5608] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:22:28 2022] DELETE /identity/v3/users/25f221b3d1cd44fbbc596f4a13b74f1a => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:22:28.393917 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26bc0c6-9a6f-488c-8bda-94a948c431a3 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:28.395597 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2885b8b-aae6-4808-b4f5-dff3f2643758 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:28.395851 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2885b8b-aae6-4808-b4f5-dff3f2643758 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:28.396154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2885b8b-aae6-4808-b4f5-dff3f2643758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:28.399066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a26bc0c6-9a6f-488c-8bda-94a948c431a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:28.444182 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b2885b8b-aae6-4808-b4f5-dff3f2643758 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:28.445884 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b2885b8b-aae6-4808-b4f5-dff3f2643758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:28.517720 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26bc0c6-9a6f-488c-8bda-94a948c431a3 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:28.523361 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700562b-6581-47dc-b4ff-5c715d9e8c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:28.524211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700562b-6581-47dc-b4ff-5c715d9e8c8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:28.524531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700562b-6581-47dc-b4ff-5c715d9e8c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:28.524897 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700562b-6581-47dc-b4ff-5c715d9e8c8a admin admin] PATH_INFO: `/v3/projects/242dc2b7dbe548a2ad5109893c40ce0a/users/05a3d2e003e044bb96bbd5ab0c5412b0/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:28.528285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700562b-6581-47dc-b4ff-5c715d9e8c8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=242dc2b7dbe548a2ad5109893c40ce0a, user_id=05a3d2e003e044bb96bbd5ab0c5412b0, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:28.536679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700562b-6581-47dc-b4ff-5c715d9e8c8a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:28.546691 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2783/5609] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:22:28.555618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2885b8b-aae6-4808-b4f5-dff3f2643758 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:28.557568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b2885b8b-aae6-4808-b4f5-dff3f2643758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:28.564636 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2827/5610] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:22:28 2022] PUT /identity/v3/projects/242dc2b7dbe548a2ad5109893c40ce0a/users/05a3d2e003e044bb96bbd5ab0c5412b0/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:28.576636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d568829-cbba-4c17-a871-5282922399ec None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:28.576923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d568829-cbba-4c17-a871-5282922399ec None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:28.577198 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d568829-cbba-4c17-a871-5282922399ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:28.588116 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:28.626629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-1d568829-cbba-4c17-a871-5282922399ec None None] MFA Rules not processed for user `05a3d2e003e044bb96bbd5ab0c5412b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:28.628024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1d568829-cbba-4c17-a871-5282922399ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:28.659905 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2885b8b-aae6-4808-b4f5-dff3f2643758 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:28.730633 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2828/5611] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:28.732101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d568829-cbba-4c17-a871-5282922399ec None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:28.743388 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:28.745096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d568829-cbba-4c17-a871-5282922399ec None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:28.751485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a266dc-e88c-44f5-b990-ccceb62c7cb8 tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05a3d2e003e044bb96bbd5ab0c5412b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '242dc2b7dbe548a2ad5109893c40ce0a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:28.752715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a266dc-e88c-44f5-b990-ccceb62c7cb8 tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:28.753204 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a266dc-e88c-44f5-b990-ccceb62c7cb8 tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:28.753806 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a266dc-e88c-44f5-b990-ccceb62c7cb8 tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:28.754722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a266dc-e88c-44f5-b990-ccceb62c7cb8 tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:22:28.755288 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a266dc-e88c-44f5-b990-ccceb62c7cb8 tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:28.757941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a266dc-e88c-44f5-b990-ccceb62c7cb8 tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:28.765318 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654091f-1cf1-464a-9d8b-76ddd5081fbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:28.766828 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654091f-1cf1-464a-9d8b-76ddd5081fbd service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:28.767203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654091f-1cf1-464a-9d8b-76ddd5081fbd service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:28.768312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654091f-1cf1-464a-9d8b-76ddd5081fbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:28.779845 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2829/5612] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:22:28.781789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a266dc-e88c-44f5-b990-ccceb62c7cb8 tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:28.826567 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a266dc-e88c-44f5-b990-ccceb62c7cb8 tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:28.848567 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b661a-b921-4563-917d-3cbe18e3ce9c tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05a3d2e003e044bb96bbd5ab0c5412b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '242dc2b7dbe548a2ad5109893c40ce0a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:28.856997 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b661a-b921-4563-917d-3cbe18e3ce9c tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:28.857857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b661a-b921-4563-917d-3cbe18e3ce9c tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:28.858609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b661a-b921-4563-917d-3cbe18e3ce9c tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:28.862212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b661a-b921-4563-917d-3cbe18e3ce9c tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:28.868071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654091f-1cf1-464a-9d8b-76ddd5081fbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:28.869892 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654091f-1cf1-464a-9d8b-76ddd5081fbd service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:28.871551 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b661a-b921-4563-917d-3cbe18e3ce9c tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:28.884843 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2784/5613] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:22:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:22:28.923282 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2830/5614] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:22:28 2022] POST /identity/v3/projects => generated 349 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:28.924764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654091f-1cf1-464a-9d8b-76ddd5081fbd service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:28.937015 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654091f-1cf1-464a-9d8b-76ddd5081fbd service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:29.074319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55274f3b-3cf5-4bc3-ab64-05214e75402f tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05a3d2e003e044bb96bbd5ab0c5412b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '242dc2b7dbe548a2ad5109893c40ce0a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:29.075435 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55274f3b-3cf5-4bc3-ab64-05214e75402f tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:29.076002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55274f3b-3cf5-4bc3-ab64-05214e75402f tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:29.076520 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55274f3b-3cf5-4bc3-ab64-05214e75402f tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:29.077520 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55274f3b-3cf5-4bc3-ab64-05214e75402f tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:22:29.078213 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55274f3b-3cf5-4bc3-ab64-05214e75402f tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:29.080212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55274f3b-3cf5-4bc3-ab64-05214e75402f tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:29.106512 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2785/5615] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:22:29.217227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b661a-b921-4563-917d-3cbe18e3ce9c tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:29.220225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6c6b661a-b921-4563-917d-3cbe18e3ce9c tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:29.353131 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b661a-b921-4563-917d-3cbe18e3ce9c tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:29.357762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a6ca5-91c9-47db-9c35-6b276311cbc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:29.358480 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a6ca5-91c9-47db-9c35-6b276311cbc8 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:29.359516 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a6ca5-91c9-47db-9c35-6b276311cbc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:29.359870 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a6ca5-91c9-47db-9c35-6b276311cbc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:29.382619 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a6ca5-91c9-47db-9c35-6b276311cbc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:29.385773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a6ca5-91c9-47db-9c35-6b276311cbc8 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:29.399999 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2831/5616] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:22:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:22:29.592729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55274f3b-3cf5-4bc3-ab64-05214e75402f tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:29.596197 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-55274f3b-3cf5-4bc3-ab64-05214e75402f tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:29.750799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55274f3b-3cf5-4bc3-ab64-05214e75402f tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:29.758259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d9bbc-7c0c-4255-b421-841ffa42b840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:29.758984 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d9bbc-7c0c-4255-b421-841ffa42b840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:29.759161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d9bbc-7c0c-4255-b421-841ffa42b840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:29.759525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d9bbc-7c0c-4255-b421-841ffa42b840 admin admin] PATH_INFO: `/v3/projects/b8ea4b99a2de4d5ca44b6e1810158861` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:29.760853 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d9bbc-7c0c-4255-b421-841ffa42b840 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8ea4b99a2de4d5ca44b6e1810158861)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:29.762984 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d9bbc-7c0c-4255-b421-841ffa42b840 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:29.808088 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:29.826475 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b39d9bbc-7c0c-4255-b421-841ffa42b840 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8ea4b99a2de4d5ca44b6e1810158861', 'request_id': 'req-b39d9bbc-7c0c-4255-b421-841ffa42b840'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:29.835608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b39d9bbc-7c0c-4255-b421-841ffa42b840 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8ea4b99a2de4d5ca44b6e1810158861', 'request_id': 'req-b39d9bbc-7c0c-4255-b421-841ffa42b840'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:29.841606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b39d9bbc-7c0c-4255-b421-841ffa42b840 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8ea4b99a2de4d5ca44b6e1810158861', 'request_id': 'req-b39d9bbc-7c0c-4255-b421-841ffa42b840'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:29.855109 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b39d9bbc-7c0c-4255-b421-841ffa42b840 admin admin] The token cache is being invalidate because project b8ea4b99a2de4d5ca44b6e1810158861 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:22:29.855403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b39d9bbc-7c0c-4255-b421-841ffa42b840 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:29.856112 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b39d9bbc-7c0c-4255-b421-841ffa42b840 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:29.860920 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2786/5617] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:22:29 2022] DELETE /identity/v3/projects/b8ea4b99a2de4d5ca44b6e1810158861 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:29.861986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a6ca5-91c9-47db-9c35-6b276311cbc8 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:29.874721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a6ca5-91c9-47db-9c35-6b276311cbc8 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:29.953795 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:29.963579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2a35d-0cd2-4062-89ef-e0e47193b03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:29.964769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2a35d-0cd2-4062-89ef-e0e47193b03c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:29.965186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2a35d-0cd2-4062-89ef-e0e47193b03c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:29.965579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2a35d-0cd2-4062-89ef-e0e47193b03c admin admin] PATH_INFO: `/v3/users/7bf82d86eb7e459abdc31121f1e86668` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:29.967233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2a35d-0cd2-4062-89ef-e0e47193b03c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bf82d86eb7e459abdc31121f1e86668)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:29.972636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2a35d-0cd2-4062-89ef-e0e47193b03c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:30.025149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f3c2a35d-0cd2-4062-89ef-e0e47193b03c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bf82d86eb7e459abdc31121f1e86668'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:30.025957 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f3c2a35d-0cd2-4062-89ef-e0e47193b03c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bf82d86eb7e459abdc31121f1e86668'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:30.034135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f3c2a35d-0cd2-4062-89ef-e0e47193b03c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bf82d86eb7e459abdc31121f1e86668'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:30.045571 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f3c2a35d-0cd2-4062-89ef-e0e47193b03c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bf82d86eb7e459abdc31121f1e86668'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:30.047647 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f3c2a35d-0cd2-4062-89ef-e0e47193b03c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bf82d86eb7e459abdc31121f1e86668'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:30.070509 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2832/5618] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:22:29 2022] DELETE /identity/v3/users/7bf82d86eb7e459abdc31121f1e86668 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:30.534957 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d9bbc-7c0c-4255-b421-841ffa42b840 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:30.536396 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b39d9bbc-7c0c-4255-b421-841ffa42b840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:30.559280 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d9bbc-7c0c-4255-b421-841ffa42b840 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:30.676164 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f59ae-be8b-4ddd-80d3-52fa41178178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:30.676826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f59ae-be8b-4ddd-80d3-52fa41178178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:30.677105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f59ae-be8b-4ddd-80d3-52fa41178178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:30.677406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f59ae-be8b-4ddd-80d3-52fa41178178 admin admin] PATH_INFO: `/v3/projects/5b9d9ff4eaf54c4d8ec9017d4d3e3747` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:30.678829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f59ae-be8b-4ddd-80d3-52fa41178178 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b9d9ff4eaf54c4d8ec9017d4d3e3747)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:30.680823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f59ae-be8b-4ddd-80d3-52fa41178178 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:30.765375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4d4f59ae-be8b-4ddd-80d3-52fa41178178 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b9d9ff4eaf54c4d8ec9017d4d3e3747', 'request_id': 'req-4d4f59ae-be8b-4ddd-80d3-52fa41178178'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:30.796751 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4d4f59ae-be8b-4ddd-80d3-52fa41178178 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b9d9ff4eaf54c4d8ec9017d4d3e3747', 'request_id': 'req-4d4f59ae-be8b-4ddd-80d3-52fa41178178'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:30.805826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4d4f59ae-be8b-4ddd-80d3-52fa41178178 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b9d9ff4eaf54c4d8ec9017d4d3e3747', 'request_id': 'req-4d4f59ae-be8b-4ddd-80d3-52fa41178178'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:30.836084 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4d4f59ae-be8b-4ddd-80d3-52fa41178178 admin admin] The token cache is being invalidate because project 5b9d9ff4eaf54c4d8ec9017d4d3e3747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:22:30.836376 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4d4f59ae-be8b-4ddd-80d3-52fa41178178 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:30.837138 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4d4f59ae-be8b-4ddd-80d3-52fa41178178 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:30.839196 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2787/5619] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:22:30 2022] DELETE /identity/v3/projects/5b9d9ff4eaf54c4d8ec9017d4d3e3747 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:30.843935 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62693a60-1616-4dc6-895d-3fecedc22a12 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:30.844459 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62693a60-1616-4dc6-895d-3fecedc22a12 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:30.845243 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62693a60-1616-4dc6-895d-3fecedc22a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:30.886492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-62693a60-1616-4dc6-895d-3fecedc22a12 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:30.888044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-62693a60-1616-4dc6-895d-3fecedc22a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:30.987740 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2833/5620] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:30.989146 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536094c-228c-4850-80b3-cd9178cfcf5a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:30.989527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536094c-228c-4850-80b3-cd9178cfcf5a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:30.989800 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536094c-228c-4850-80b3-cd9178cfcf5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:31.025105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-8536094c-228c-4850-80b3-cd9178cfcf5a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:31.026565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8536094c-228c-4850-80b3-cd9178cfcf5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:31.039743 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2788/5621] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:31.043591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62693a60-1616-4dc6-895d-3fecedc22a12 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:31.056079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62693a60-1616-4dc6-895d-3fecedc22a12 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:31.064002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db21d98-10c4-4f37-886b-a855d78001d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:31.065421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db21d98-10c4-4f37-886b-a855d78001d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:31.065971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db21d98-10c4-4f37-886b-a855d78001d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:31.066472 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db21d98-10c4-4f37-886b-a855d78001d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:31.068114 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db21d98-10c4-4f37-886b-a855d78001d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:22:31.068860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db21d98-10c4-4f37-886b-a855d78001d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:31.072135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db21d98-10c4-4f37-886b-a855d78001d8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:31.096898 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2834/5622] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:22:31.101871 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536094c-228c-4850-80b3-cd9178cfcf5a None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:31.112217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536094c-228c-4850-80b3-cd9178cfcf5a None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:31.118021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18e437-385a-4b02-93ff-45ccc4635dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:31.118903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18e437-385a-4b02-93ff-45ccc4635dae admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:31.119626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18e437-385a-4b02-93ff-45ccc4635dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:31.119626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18e437-385a-4b02-93ff-45ccc4635dae admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:31.120265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f18e437-385a-4b02-93ff-45ccc4635dae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:31.122509 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f18e437-385a-4b02-93ff-45ccc4635dae admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:31.186012 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2789/5623] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:22:31 2022] POST /identity/v3/projects => generated 381 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:31.190545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db21d98-10c4-4f37-886b-a855d78001d8 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:31.204871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db21d98-10c4-4f37-886b-a855d78001d8 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:31.359960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f34db3-8f24-4ba5-8d7c-792a5372e0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:31.360608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f34db3-8f24-4ba5-8d7c-792a5372e0b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:31.360889 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f34db3-8f24-4ba5-8d7c-792a5372e0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:31.361177 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f34db3-8f24-4ba5-8d7c-792a5372e0b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:31.361854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f34db3-8f24-4ba5-8d7c-792a5372e0b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:31.367059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f34db3-8f24-4ba5-8d7c-792a5372e0b1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:31.378992 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:31.405966 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2835/5624] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:22:31 2022] POST /identity/v3/users => generated 291 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:31.409500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18e437-385a-4b02-93ff-45ccc4635dae admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:31.446956 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18e437-385a-4b02-93ff-45ccc4635dae admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:31.460430 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed6a26-93fd-481c-a92d-2736602fb051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:31.464228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed6a26-93fd-481c-a92d-2736602fb051 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:31.464456 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed6a26-93fd-481c-a92d-2736602fb051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:31.465027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed6a26-93fd-481c-a92d-2736602fb051 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:31.469761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed6a26-93fd-481c-a92d-2736602fb051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:31.471418 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed6a26-93fd-481c-a92d-2736602fb051 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:31.498439 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2790/5625] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:31.505287 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f34db3-8f24-4ba5-8d7c-792a5372e0b1 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:31.520654 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f34db3-8f24-4ba5-8d7c-792a5372e0b1 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:31.535021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae144f-dd11-4218-a4c4-0fbde043cd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:31.535648 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae144f-dd11-4218-a4c4-0fbde043cd5a admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:31.535933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae144f-dd11-4218-a4c4-0fbde043cd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:31.536210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae144f-dd11-4218-a4c4-0fbde043cd5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:31.537343 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fae144f-dd11-4218-a4c4-0fbde043cd5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:31.539193 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fae144f-dd11-4218-a4c4-0fbde043cd5a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:31.555195 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2836/5626] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:31.558912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed6a26-93fd-481c-a92d-2736602fb051 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:31.571254 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed6a26-93fd-481c-a92d-2736602fb051 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:31.577833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7d186-f2cb-4738-8cbf-16f049530d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:31.578718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7d186-f2cb-4738-8cbf-16f049530d2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:31.579157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7d186-f2cb-4738-8cbf-16f049530d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:31.579601 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7d186-f2cb-4738-8cbf-16f049530d2c admin admin] PATH_INFO: `/v3/projects/61d2ffb870d642039dbdce5bd823ac31/users/1593eee8b04f4d55ba65ddae8a236a1e/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:31.583178 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:31.605211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7d186-f2cb-4738-8cbf-16f049530d2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=61d2ffb870d642039dbdce5bd823ac31, user_id=1593eee8b04f4d55ba65ddae8a236a1e, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:31.609364 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7d186-f2cb-4738-8cbf-16f049530d2c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:31.633399 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2791/5627] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:22:31 2022] PUT /identity/v3/projects/61d2ffb870d642039dbdce5bd823ac31/users/1593eee8b04f4d55ba65ddae8a236a1e/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:31.643936 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b28bad-7ef1-41cb-a2ce-aeb1e2d9b68c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:31.648145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b28bad-7ef1-41cb-a2ce-aeb1e2d9b68c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:31.648145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b28bad-7ef1-41cb-a2ce-aeb1e2d9b68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:31.687432 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-85b28bad-7ef1-41cb-a2ce-aeb1e2d9b68c None None] MFA Rules not processed for user `1593eee8b04f4d55ba65ddae8a236a1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:31.689266 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-85b28bad-7ef1-41cb-a2ce-aeb1e2d9b68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:31.775157 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2837/5628] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:31.790231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7d186-f2cb-4738-8cbf-16f049530d2c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:31.794185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-59c7d186-f2cb-4738-8cbf-16f049530d2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:31.936975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7d186-f2cb-4738-8cbf-16f049530d2c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:31.941295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168748b-3bff-47c3-bc32-69ec758e6128 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efcee9b21ea94b1b8e5c9c5acb35839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:31.942014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168748b-3bff-47c3-bc32-69ec758e6128 service glance] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:31.942298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168748b-3bff-47c3-bc32-69ec758e6128 service glance] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:31.942833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168748b-3bff-47c3-bc32-69ec758e6128 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:31.960196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168748b-3bff-47c3-bc32-69ec758e6128 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:31.963207 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168748b-3bff-47c3-bc32-69ec758e6128 service glance] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:31.989892 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2792/5629] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:22:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:22:32.347338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b28bad-7ef1-41cb-a2ce-aeb1e2d9b68c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:32.440907 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b28bad-7ef1-41cb-a2ce-aeb1e2d9b68c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:32.446637 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ded21a-d7a2-4cc8-a0f1-f9f2255099a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:32.447511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ded21a-d7a2-4cc8-a0f1-f9f2255099a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:32.447979 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ded21a-d7a2-4cc8-a0f1-f9f2255099a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:32.448685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ded21a-d7a2-4cc8-a0f1-f9f2255099a8 admin admin] PATH_INFO: `/v3/users/1593eee8b04f4d55ba65ddae8a236a1e` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:32.450091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ded21a-d7a2-4cc8-a0f1-f9f2255099a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1593eee8b04f4d55ba65ddae8a236a1e)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:32.452387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ded21a-d7a2-4cc8-a0f1-f9f2255099a8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:32.554725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b6ded21a-d7a2-4cc8-a0f1-f9f2255099a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1593eee8b04f4d55ba65ddae8a236a1e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:32.555539 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b6ded21a-d7a2-4cc8-a0f1-f9f2255099a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1593eee8b04f4d55ba65ddae8a236a1e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:32.563500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b6ded21a-d7a2-4cc8-a0f1-f9f2255099a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1593eee8b04f4d55ba65ddae8a236a1e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:32.575000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b6ded21a-d7a2-4cc8-a0f1-f9f2255099a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1593eee8b04f4d55ba65ddae8a236a1e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:32.576133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b6ded21a-d7a2-4cc8-a0f1-f9f2255099a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1593eee8b04f4d55ba65ddae8a236a1e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:32.586120 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:32.601876 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2838/5630] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:22:32 2022] DELETE /identity/v3/users/1593eee8b04f4d55ba65ddae8a236a1e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:32.606225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25691dab-8495-4924-b34e-f72780841016 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:32.606558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25691dab-8495-4924-b34e-f72780841016 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:32.606832 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25691dab-8495-4924-b34e-f72780841016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:32.631795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-25691dab-8495-4924-b34e-f72780841016 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:32.633244 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-25691dab-8495-4924-b34e-f72780841016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:32.702654 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2793/5631] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:32.715436 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ded21a-d7a2-4cc8-a0f1-f9f2255099a8 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:32.717171 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b6ded21a-d7a2-4cc8-a0f1-f9f2255099a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:32.796360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ded21a-d7a2-4cc8-a0f1-f9f2255099a8 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:32.801738 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed31b9a-4e2f-47b7-b893-72364bff89e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:32.802839 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed31b9a-4e2f-47b7-b893-72364bff89e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:32.803325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed31b9a-4e2f-47b7-b893-72364bff89e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:32.803768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed31b9a-4e2f-47b7-b893-72364bff89e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:32.815940 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed31b9a-4e2f-47b7-b893-72364bff89e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:32.817835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed31b9a-4e2f-47b7-b893-72364bff89e3 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:32.842334 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2839/5632] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:22:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:22:32.931255 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25691dab-8495-4924-b34e-f72780841016 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:32.934485 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-25691dab-8495-4924-b34e-f72780841016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:33.072230 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25691dab-8495-4924-b34e-f72780841016 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:33.077829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d38497-df80-4064-a922-d75e9707770d tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05a3d2e003e044bb96bbd5ab0c5412b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '242dc2b7dbe548a2ad5109893c40ce0a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:33.078859 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d38497-df80-4064-a922-d75e9707770d tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:33.079376 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d38497-df80-4064-a922-d75e9707770d tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:33.079875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d38497-df80-4064-a922-d75e9707770d tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] PATH_INFO: `/v3/projects/33329157ffad430ab379570d22f25c97` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:33.086343 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d38497-df80-4064-a922-d75e9707770d tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] RBAC: Authorizing `identity:delete_project(project_id=33329157ffad430ab379570d22f25c97)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:33.088660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d38497-df80-4064-a922-d75e9707770d tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:33.136977 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:33.168511 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-26d38497-df80-4064-a922-d75e9707770d tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33329157ffad430ab379570d22f25c97', 'request_id': 'req-26d38497-df80-4064-a922-d75e9707770d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:33.182737 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-26d38497-df80-4064-a922-d75e9707770d tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33329157ffad430ab379570d22f25c97', 'request_id': 'req-26d38497-df80-4064-a922-d75e9707770d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:33.193933 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-26d38497-df80-4064-a922-d75e9707770d tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33329157ffad430ab379570d22f25c97', 'request_id': 'req-26d38497-df80-4064-a922-d75e9707770d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:33.219357 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-26d38497-df80-4064-a922-d75e9707770d tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] The token cache is being invalidate because project 33329157ffad430ab379570d22f25c97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:22:33.220116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-26d38497-df80-4064-a922-d75e9707770d tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:33.221036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-26d38497-df80-4064-a922-d75e9707770d tempest-QuotasNegativeTest-2131348186 tempest-QuotasNegativeTest-2131348186-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:33.225400 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2794/5633] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:22:32 2022] DELETE /identity/v3/projects/33329157ffad430ab379570d22f25c97 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:33.235058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed31b9a-4e2f-47b7-b893-72364bff89e3 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:33.236892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4ed31b9a-4e2f-47b7-b893-72364bff89e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:33.253059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed31b9a-4e2f-47b7-b893-72364bff89e3 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:33.356269 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18beb26e-20f3-439b-99fa-360c08a7a069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:33.358143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18beb26e-20f3-439b-99fa-360c08a7a069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:33.358757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18beb26e-20f3-439b-99fa-360c08a7a069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:33.368207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18beb26e-20f3-439b-99fa-360c08a7a069 admin admin] PATH_INFO: `/v3/users/36a5a8387c9c4870a3babe72af81b857` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:33.370509 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18beb26e-20f3-439b-99fa-360c08a7a069 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36a5a8387c9c4870a3babe72af81b857)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:33.376965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18beb26e-20f3-439b-99fa-360c08a7a069 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:33.470161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-18beb26e-20f3-439b-99fa-360c08a7a069 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36a5a8387c9c4870a3babe72af81b857'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:33.470845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-18beb26e-20f3-439b-99fa-360c08a7a069 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36a5a8387c9c4870a3babe72af81b857'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:33.481537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-18beb26e-20f3-439b-99fa-360c08a7a069 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36a5a8387c9c4870a3babe72af81b857'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:33.498496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-18beb26e-20f3-439b-99fa-360c08a7a069 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36a5a8387c9c4870a3babe72af81b857'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:33.499742 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-18beb26e-20f3-439b-99fa-360c08a7a069 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36a5a8387c9c4870a3babe72af81b857'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:33.525486 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2840/5634] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:22:33 2022] DELETE /identity/v3/users/36a5a8387c9c4870a3babe72af81b857 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:33.530679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13060716-9bdd-487c-baf2-527237a52faf None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:33.534879 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13060716-9bdd-487c-baf2-527237a52faf None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:33.535568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13060716-9bdd-487c-baf2-527237a52faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:33.557918 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18beb26e-20f3-439b-99fa-360c08a7a069 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:33.562471 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-18beb26e-20f3-439b-99fa-360c08a7a069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:33.580585 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:33.589762 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-13060716-9bdd-487c-baf2-527237a52faf None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:33.595310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-13060716-9bdd-487c-baf2-527237a52faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:33.683585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18beb26e-20f3-439b-99fa-360c08a7a069 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:33.689648 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03607ed2-c2ed-417e-8e60-3ac29377477e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:33.690664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03607ed2-c2ed-417e-8e60-3ac29377477e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:33.691183 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03607ed2-c2ed-417e-8e60-3ac29377477e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:33.691708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03607ed2-c2ed-417e-8e60-3ac29377477e admin admin] PATH_INFO: `/v3/projects/61d2ffb870d642039dbdce5bd823ac31` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:33.693115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03607ed2-c2ed-417e-8e60-3ac29377477e admin admin] RBAC: Authorizing `identity:delete_project(project_id=61d2ffb870d642039dbdce5bd823ac31)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:33.695509 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03607ed2-c2ed-417e-8e60-3ac29377477e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:33.731841 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2795/5635] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:33.765980 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13060716-9bdd-487c-baf2-527237a52faf None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:33.768527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-13060716-9bdd-487c-baf2-527237a52faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:33.770752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-03607ed2-c2ed-417e-8e60-3ac29377477e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61d2ffb870d642039dbdce5bd823ac31', 'request_id': 'req-03607ed2-c2ed-417e-8e60-3ac29377477e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:33.795861 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-03607ed2-c2ed-417e-8e60-3ac29377477e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61d2ffb870d642039dbdce5bd823ac31', 'request_id': 'req-03607ed2-c2ed-417e-8e60-3ac29377477e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:33.803595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-03607ed2-c2ed-417e-8e60-3ac29377477e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61d2ffb870d642039dbdce5bd823ac31', 'request_id': 'req-03607ed2-c2ed-417e-8e60-3ac29377477e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:33.828756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-03607ed2-c2ed-417e-8e60-3ac29377477e admin admin] The token cache is being invalidate because project 61d2ffb870d642039dbdce5bd823ac31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:22:33.829057 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-03607ed2-c2ed-417e-8e60-3ac29377477e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:33.832263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-03607ed2-c2ed-417e-8e60-3ac29377477e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:33.838164 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2841/5636] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:22:33 2022] DELETE /identity/v3/projects/61d2ffb870d642039dbdce5bd823ac31 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:22:33.839543 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0377188-cacb-4f29-9873-50df52057cf0 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:33.839844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0377188-cacb-4f29-9873-50df52057cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:33.840105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0377188-cacb-4f29-9873-50df52057cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:33.869184 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13060716-9bdd-487c-baf2-527237a52faf None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:33.887855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-d0377188-cacb-4f29-9873-50df52057cf0 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:33.889157 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d0377188-cacb-4f29-9873-50df52057cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:33.955463 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274f6ac-a857-4d22-9f73-0293f6605401 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:33.956939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274f6ac-a857-4d22-9f73-0293f6605401 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:33.957400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274f6ac-a857-4d22-9f73-0293f6605401 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:33.957939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274f6ac-a857-4d22-9f73-0293f6605401 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:33.961391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3274f6ac-a857-4d22-9f73-0293f6605401 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:34.015290 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:34.056020 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2842/5637] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:34.057687 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2d012-4183-4f54-9a39-4a3220d36660 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:34.057985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2d012-4183-4f54-9a39-4a3220d36660 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:34.058396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2d012-4183-4f54-9a39-4a3220d36660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:34.103828 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274f6ac-a857-4d22-9f73-0293f6605401 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:34.105451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274f6ac-a857-4d22-9f73-0293f6605401 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:34.111347 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-31d2d012-4183-4f54-9a39-4a3220d36660 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:34.113282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-31d2d012-4183-4f54-9a39-4a3220d36660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:34.134853 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2796/5638] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:22:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:22:34.140158 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2843/5639] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:34.144338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274f6ac-a857-4d22-9f73-0293f6605401 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:34.162740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274f6ac-a857-4d22-9f73-0293f6605401 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:34.162740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e45bae-88b8-41ac-af65-016d44b0496f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:34.163729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e45bae-88b8-41ac-af65-016d44b0496f admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:34.163931 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e45bae-88b8-41ac-af65-016d44b0496f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:34.164749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e45bae-88b8-41ac-af65-016d44b0496f admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:34.167109 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e45bae-88b8-41ac-af65-016d44b0496f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:22:34.167109 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e45bae-88b8-41ac-af65-016d44b0496f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:34.167792 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e45bae-88b8-41ac-af65-016d44b0496f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:34.181673 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2797/5640] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:22:34.186931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d2d012-4183-4f54-9a39-4a3220d36660 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:34.200077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d2d012-4183-4f54-9a39-4a3220d36660 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:34.207543 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c071491b-3ea6-404f-99fc-be7e7ec5a3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:34.208328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071491b-3ea6-404f-99fc-be7e7ec5a3a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:34.209369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071491b-3ea6-404f-99fc-be7e7ec5a3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:34.209939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071491b-3ea6-404f-99fc-be7e7ec5a3a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:34.211792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c071491b-3ea6-404f-99fc-be7e7ec5a3a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:34.214205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c071491b-3ea6-404f-99fc-be7e7ec5a3a7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:34.258185 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2844/5641] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:22:34 2022] POST /identity/v3/projects => generated 377 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:34.262677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e45bae-88b8-41ac-af65-016d44b0496f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:34.275813 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e45bae-88b8-41ac-af65-016d44b0496f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:34.390812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139fc82-c2b0-4590-8bd0-511d45c75f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:34.391871 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139fc82-c2b0-4590-8bd0-511d45c75f42 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:34.392221 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139fc82-c2b0-4590-8bd0-511d45c75f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:34.392587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139fc82-c2b0-4590-8bd0-511d45c75f42 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:34.393494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139fc82-c2b0-4590-8bd0-511d45c75f42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:34.397175 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139fc82-c2b0-4590-8bd0-511d45c75f42 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:34.461472 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2798/5642] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:22:34 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:34.464201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c071491b-3ea6-404f-99fc-be7e7ec5a3a7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:34.497575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c071491b-3ea6-404f-99fc-be7e7ec5a3a7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:34.507886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ddac73-8ade-402e-b71d-0fd4d741c35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:34.509968 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ddac73-8ade-402e-b71d-0fd4d741c35c admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:34.510496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ddac73-8ade-402e-b71d-0fd4d741c35c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:34.511066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ddac73-8ade-402e-b71d-0fd4d741c35c admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:34.512021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ddac73-8ade-402e-b71d-0fd4d741c35c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:34.515240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ddac73-8ade-402e-b71d-0fd4d741c35c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:34.544837 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2845/5643] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:22:34.548488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139fc82-c2b0-4590-8bd0-511d45c75f42 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:34.572247 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139fc82-c2b0-4590-8bd0-511d45c75f42 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:34.581878 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7b886-5222-450e-b49e-221669c588d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:34.582061 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7b886-5222-450e-b49e-221669c588d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:34.582557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7b886-5222-450e-b49e-221669c588d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:34.582557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7b886-5222-450e-b49e-221669c588d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:34.583248 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc7b886-5222-450e-b49e-221669c588d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:34.585352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc7b886-5222-450e-b49e-221669c588d5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:34.612151 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2799/5644] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:34.617231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ddac73-8ade-402e-b71d-0fd4d741c35c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:34.632743 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:34.645300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ddac73-8ade-402e-b71d-0fd4d741c35c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:34.656265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d25987-94f5-42e3-9855-572fc6954a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:34.657786 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d25987-94f5-42e3-9855-572fc6954a42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:34.658497 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d25987-94f5-42e3-9855-572fc6954a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:34.659596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d25987-94f5-42e3-9855-572fc6954a42 admin admin] PATH_INFO: `/v3/projects/e939dc08210f46ffa5b6050608705be1/users/ad0b11c1c1614f1abfcf326d5238a670/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:34.697856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d25987-94f5-42e3-9855-572fc6954a42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e939dc08210f46ffa5b6050608705be1, user_id=ad0b11c1c1614f1abfcf326d5238a670, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:34.700440 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d25987-94f5-42e3-9855-572fc6954a42 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:34.747215 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2846/5645] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:22:34 2022] PUT /identity/v3/projects/e939dc08210f46ffa5b6050608705be1/users/ad0b11c1c1614f1abfcf326d5238a670/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:34.752451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee5f8d-eb87-421a-b1d7-658cda942af5 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:34.752785 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee5f8d-eb87-421a-b1d7-658cda942af5 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:34.753066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee5f8d-eb87-421a-b1d7-658cda942af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:34.788295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-05ee5f8d-eb87-421a-b1d7-658cda942af5 None None] MFA Rules not processed for user `ad0b11c1c1614f1abfcf326d5238a670`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:34.789712 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-05ee5f8d-eb87-421a-b1d7-658cda942af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:34.881488 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2800/5646] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:34.883459 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d25987-94f5-42e3-9855-572fc6954a42 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:34.987810 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d25987-94f5-42e3-9855-572fc6954a42 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:34.995036 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c8384-a7b3-43ed-9ddd-e50c53f56865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:34.995671 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c8384-a7b3-43ed-9ddd-e50c53f56865 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:34.995986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c8384-a7b3-43ed-9ddd-e50c53f56865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:34.996265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c8384-a7b3-43ed-9ddd-e50c53f56865 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:34.996916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c8384-a7b3-43ed-9ddd-e50c53f56865 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:35.004500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c8384-a7b3-43ed-9ddd-e50c53f56865 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:35.048688 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2847/5647] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:22:34 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:35.053154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee5f8d-eb87-421a-b1d7-658cda942af5 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:35.066681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee5f8d-eb87-421a-b1d7-658cda942af5 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:35.095164 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:35.163013 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493904df-d060-4a54-a8e3-e4697c6e6e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:35.163693 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493904df-d060-4a54-a8e3-e4697c6e6e53 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:35.163981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493904df-d060-4a54-a8e3-e4697c6e6e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:35.164430 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493904df-d060-4a54-a8e3-e4697c6e6e53 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:35.165687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493904df-d060-4a54-a8e3-e4697c6e6e53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:35.167383 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493904df-d060-4a54-a8e3-e4697c6e6e53 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:35.226036 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2801/5648] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:22:35 2022] POST /identity/v3/users => generated 295 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:35.227184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c8384-a7b3-43ed-9ddd-e50c53f56865 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:35.258437 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c8384-a7b3-43ed-9ddd-e50c53f56865 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:35.277740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed110a-732e-41f4-bcf8-9cde3cfc3440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:35.278469 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed110a-732e-41f4-bcf8-9cde3cfc3440 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:35.286308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed110a-732e-41f4-bcf8-9cde3cfc3440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:35.286608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed110a-732e-41f4-bcf8-9cde3cfc3440 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:35.287408 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed110a-732e-41f4-bcf8-9cde3cfc3440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:35.289136 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed110a-732e-41f4-bcf8-9cde3cfc3440 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:35.316030 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2848/5649] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:22:35.320871 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493904df-d060-4a54-a8e3-e4697c6e6e53 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:35.335137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493904df-d060-4a54-a8e3-e4697c6e6e53 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:35.345028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb179b0f-831e-43fa-838f-2492b8087b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:35.345835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb179b0f-831e-43fa-838f-2492b8087b45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:35.346199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb179b0f-831e-43fa-838f-2492b8087b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:35.346485 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb179b0f-831e-43fa-838f-2492b8087b45 admin admin] PATH_INFO: `/v3/projects/9bb0baa91ec4406c82179c1e57f8c53c/users/b5ffbee89f3348b9929101b45f2a144e/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:35.354256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed110a-732e-41f4-bcf8-9cde3cfc3440 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:35.356941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-03ed110a-732e-41f4-bcf8-9cde3cfc3440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:35.386866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb179b0f-831e-43fa-838f-2492b8087b45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bb0baa91ec4406c82179c1e57f8c53c, user_id=b5ffbee89f3348b9929101b45f2a144e, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:35.397722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed110a-732e-41f4-bcf8-9cde3cfc3440 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:35.408144 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb179b0f-831e-43fa-838f-2492b8087b45 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:35.414825 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa85a5-2f9d-49ec-b918-c08b1f2d1951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:35.415494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa85a5-2f9d-49ec-b918-c08b1f2d1951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:35.415768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa85a5-2f9d-49ec-b918-c08b1f2d1951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:35.416037 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa85a5-2f9d-49ec-b918-c08b1f2d1951 admin admin] PATH_INFO: `/v3/projects/cc286707eafc4effa2ddbfd634951fe9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:35.418804 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa85a5-2f9d-49ec-b918-c08b1f2d1951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc286707eafc4effa2ddbfd634951fe9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:35.420329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa85a5-2f9d-49ec-b918-c08b1f2d1951 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:35.477417 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2802/5650] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:22:35 2022] PUT /identity/v3/projects/9bb0baa91ec4406c82179c1e57f8c53c/users/b5ffbee89f3348b9929101b45f2a144e/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:35.481703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb179b0f-831e-43fa-838f-2492b8087b45 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:35.516973 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e5fa85a5-2f9d-49ec-b918-c08b1f2d1951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc286707eafc4effa2ddbfd634951fe9', 'request_id': 'req-e5fa85a5-2f9d-49ec-b918-c08b1f2d1951'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:35.538654 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e5fa85a5-2f9d-49ec-b918-c08b1f2d1951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc286707eafc4effa2ddbfd634951fe9', 'request_id': 'req-e5fa85a5-2f9d-49ec-b918-c08b1f2d1951'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:35.555864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e5fa85a5-2f9d-49ec-b918-c08b1f2d1951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc286707eafc4effa2ddbfd634951fe9', 'request_id': 'req-e5fa85a5-2f9d-49ec-b918-c08b1f2d1951'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:35.594430 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e5fa85a5-2f9d-49ec-b918-c08b1f2d1951 admin admin] The token cache is being invalidate because project cc286707eafc4effa2ddbfd634951fe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:22:35.594740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e5fa85a5-2f9d-49ec-b918-c08b1f2d1951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:35.598191 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e5fa85a5-2f9d-49ec-b918-c08b1f2d1951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:35.600885 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2849/5651] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:22:35 2022] DELETE /identity/v3/projects/cc286707eafc4effa2ddbfd634951fe9 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:22:35.605008 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa85a5-2f9d-49ec-b918-c08b1f2d1951 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:35.606493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e5fa85a5-2f9d-49ec-b918-c08b1f2d1951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:35.664035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb179b0f-831e-43fa-838f-2492b8087b45 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:35.694645 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:35.775608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa85a5-2f9d-49ec-b918-c08b1f2d1951 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:35.791771 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b4b58-6a9c-451b-93e4-f8ee33ab521d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:35.793373 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b4b58-6a9c-451b-93e4-f8ee33ab521d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:35.795028 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b4b58-6a9c-451b-93e4-f8ee33ab521d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:35.795683 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b4b58-6a9c-451b-93e4-f8ee33ab521d admin admin] PATH_INFO: `/v3/users/05a3d2e003e044bb96bbd5ab0c5412b0` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:35.800766 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b4b58-6a9c-451b-93e4-f8ee33ab521d admin admin] RBAC: Authorizing `identity:delete_user(user_id=05a3d2e003e044bb96bbd5ab0c5412b0)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:35.806054 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b4b58-6a9c-451b-93e4-f8ee33ab521d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:35.891768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09f76f-4c37-4a87-866d-56a445834b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:35.893804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09f76f-4c37-4a87-866d-56a445834b94 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:35.894239 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09f76f-4c37-4a87-866d-56a445834b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:35.906478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09f76f-4c37-4a87-866d-56a445834b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:35.910419 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09f76f-4c37-4a87-866d-56a445834b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:35.913898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09f76f-4c37-4a87-866d-56a445834b94 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:35.931853 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2803/5652] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 450 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:35.934590 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-305b4b58-6a9c-451b-93e4-f8ee33ab521d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05a3d2e003e044bb96bbd5ab0c5412b0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:35.935607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-305b4b58-6a9c-451b-93e4-f8ee33ab521d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05a3d2e003e044bb96bbd5ab0c5412b0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:35.935970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09f76f-4c37-4a87-866d-56a445834b94 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:35.938057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2b09f76f-4c37-4a87-866d-56a445834b94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:35.957534 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-305b4b58-6a9c-451b-93e4-f8ee33ab521d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05a3d2e003e044bb96bbd5ab0c5412b0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:35.966699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09f76f-4c37-4a87-866d-56a445834b94 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:35.979103 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-305b4b58-6a9c-451b-93e4-f8ee33ab521d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05a3d2e003e044bb96bbd5ab0c5412b0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:35.980009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-305b4b58-6a9c-451b-93e4-f8ee33ab521d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05a3d2e003e044bb96bbd5ab0c5412b0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:35.989685 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e85967-493b-407c-b43b-d8e893d1215f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:35.993022 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e85967-493b-407c-b43b-d8e893d1215f admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:35.993684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e85967-493b-407c-b43b-d8e893d1215f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:35.996639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e85967-493b-407c-b43b-d8e893d1215f admin admin] PATH_INFO: `/v3/projects/9bb0baa91ec4406c82179c1e57f8c53c/users/b5ffbee89f3348b9929101b45f2a144e/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:36.003563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e85967-493b-407c-b43b-d8e893d1215f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bb0baa91ec4406c82179c1e57f8c53c, user_id=b5ffbee89f3348b9929101b45f2a144e, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:36.016387 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e85967-493b-407c-b43b-d8e893d1215f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:36.029032 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2850/5653] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:22:35 2022] DELETE /identity/v3/users/05a3d2e003e044bb96bbd5ab0c5412b0 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:22:36.054065 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2804/5654] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:22:35 2022] PUT /identity/v3/projects/9bb0baa91ec4406c82179c1e57f8c53c/users/b5ffbee89f3348b9929101b45f2a144e/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:36.065072 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c005f9c-302f-4862-b17a-5be504cfccb8 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:36.065406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c005f9c-302f-4862-b17a-5be504cfccb8 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:36.065654 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c005f9c-302f-4862-b17a-5be504cfccb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:36.131523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-2c005f9c-302f-4862-b17a-5be504cfccb8 None None] MFA Rules not processed for user `b5ffbee89f3348b9929101b45f2a144e`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:36.133016 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2c005f9c-302f-4862-b17a-5be504cfccb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:36.264026 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2851/5655] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:36 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:36.274260 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c2127-66ee-46a5-939c-70397ff968eb None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:36.274709 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c2127-66ee-46a5-939c-70397ff968eb None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:36.274996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c2127-66ee-46a5-939c-70397ff968eb None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:36.277680 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2805/5656] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:22:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:22:36.279621 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c005f9c-302f-4862-b17a-5be504cfccb8 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:36.282301 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2c005f9c-302f-4862-b17a-5be504cfccb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:36.284789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ed7cd-b780-4686-9b2c-7961c2340600 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:36.288054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ed7cd-b780-4686-9b2c-7961c2340600 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:36.288359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ed7cd-b780-4686-9b2c-7961c2340600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:36.345825 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-791ed7cd-b780-4686-9b2c-7961c2340600 None None] MFA Rules not processed for user `2cdde7a212954a01a2591ad5ac30d049`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:36.347534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-791ed7cd-b780-4686-9b2c-7961c2340600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:36.361481 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:36.438206 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:36.441601 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2806/5657] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:22:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:36.474956 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ed7cd-b780-4686-9b2c-7961c2340600 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:36.477541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-791ed7cd-b780-4686-9b2c-7961c2340600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:36.495713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ed7cd-b780-4686-9b2c-7961c2340600 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:36.498977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c005f9c-302f-4862-b17a-5be504cfccb8 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:36.502391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6935f0-0e3b-48b9-a140-153dd7218b1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:36.504815 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6935f0-0e3b-48b9-a140-153dd7218b1e service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:36.506270 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6935f0-0e3b-48b9-a140-153dd7218b1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:36.507711 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6935f0-0e3b-48b9-a140-153dd7218b1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:36.509205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f574fb-e66a-49e3-82a2-74ff35fbf255 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:36.515995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f574fb-e66a-49e3-82a2-74ff35fbf255 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:36.516576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f574fb-e66a-49e3-82a2-74ff35fbf255 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:36.516965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f574fb-e66a-49e3-82a2-74ff35fbf255 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:36.524683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6935f0-0e3b-48b9-a140-153dd7218b1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:36.527637 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6935f0-0e3b-48b9-a140-153dd7218b1e service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:36.546309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f574fb-e66a-49e3-82a2-74ff35fbf255 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:36.548666 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f574fb-e66a-49e3-82a2-74ff35fbf255 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:36.551182 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2807/5658] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:22:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:22:36.565087 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2852/5659] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:22:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:22:37.137820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6935f0-0e3b-48b9-a140-153dd7218b1e service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:37.139312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8d6935f0-0e3b-48b9-a140-153dd7218b1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:37.257699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6935f0-0e3b-48b9-a140-153dd7218b1e service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:37.262982 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d698d87-f6cc-4d4c-b629-207f8d73b87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:37.263768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d698d87-f6cc-4d4c-b629-207f8d73b87b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:37.264051 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d698d87-f6cc-4d4c-b629-207f8d73b87b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:37.264327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d698d87-f6cc-4d4c-b629-207f8d73b87b admin admin] PATH_INFO: `/v3/projects/242dc2b7dbe548a2ad5109893c40ce0a` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:37.265667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d698d87-f6cc-4d4c-b629-207f8d73b87b admin admin] RBAC: Authorizing `identity:delete_project(project_id=242dc2b7dbe548a2ad5109893c40ce0a)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:37.267739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d698d87-f6cc-4d4c-b629-207f8d73b87b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:37.362932 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4d698d87-f6cc-4d4c-b629-207f8d73b87b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '242dc2b7dbe548a2ad5109893c40ce0a', 'request_id': 'req-4d698d87-f6cc-4d4c-b629-207f8d73b87b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:37.376992 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4d698d87-f6cc-4d4c-b629-207f8d73b87b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '242dc2b7dbe548a2ad5109893c40ce0a', 'request_id': 'req-4d698d87-f6cc-4d4c-b629-207f8d73b87b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:37.386645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4d698d87-f6cc-4d4c-b629-207f8d73b87b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '242dc2b7dbe548a2ad5109893c40ce0a', 'request_id': 'req-4d698d87-f6cc-4d4c-b629-207f8d73b87b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:37.420949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4d698d87-f6cc-4d4c-b629-207f8d73b87b admin admin] The token cache is being invalidate because project 242dc2b7dbe548a2ad5109893c40ce0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:22:37.421160 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4d698d87-f6cc-4d4c-b629-207f8d73b87b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:37.424293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4d698d87-f6cc-4d4c-b629-207f8d73b87b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:37.429472 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2808/5660] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:22:37 2022] DELETE /identity/v3/projects/242dc2b7dbe548a2ad5109893c40ce0a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:37.432596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb5d58-f120-4694-84c4-541dd9f93301 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:37.433092 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb5d58-f120-4694-84c4-541dd9f93301 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:37.433505 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb5d58-f120-4694-84c4-541dd9f93301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:37.488924 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-02bb5d58-f120-4694-84c4-541dd9f93301 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:37.492493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-02bb5d58-f120-4694-84c4-541dd9f93301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:37.642629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd423b6-677e-42e8-8ffa-f597463516cc None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:37.643035 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2853/5661] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:37.643811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd423b6-677e-42e8-8ffa-f597463516cc None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:37.644319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd423b6-677e-42e8-8ffa-f597463516cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:37.698505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-2cd423b6-677e-42e8-8ffa-f597463516cc None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:37.700530 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2cd423b6-677e-42e8-8ffa-f597463516cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:37.723404 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2809/5662] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:22:37.728855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb5d58-f120-4694-84c4-541dd9f93301 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:37.741717 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb5d58-f120-4694-84c4-541dd9f93301 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:37.749061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9769d-2246-4c54-85de-36a13f5f3bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:37.750151 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9769d-2246-4c54-85de-36a13f5f3bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:37.750676 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9769d-2246-4c54-85de-36a13f5f3bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:37.751134 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9769d-2246-4c54-85de-36a13f5f3bb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:37.764667 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9769d-2246-4c54-85de-36a13f5f3bb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:22:37.766825 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9769d-2246-4c54-85de-36a13f5f3bb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:37.769914 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9769d-2246-4c54-85de-36a13f5f3bb0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:37.801663 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2854/5663] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:22:37.812889 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd423b6-677e-42e8-8ffa-f597463516cc None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:37.844572 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd423b6-677e-42e8-8ffa-f597463516cc None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:37.858215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb2182-9b76-4658-a6a5-688312f35200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:37.858953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb2182-9b76-4658-a6a5-688312f35200 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:37.859325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb2182-9b76-4658-a6a5-688312f35200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:37.860089 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb2182-9b76-4658-a6a5-688312f35200 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:37.861722 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb2182-9b76-4658-a6a5-688312f35200 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:37.866575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb2182-9b76-4658-a6a5-688312f35200 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:37.918103 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2810/5664] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:22:37 2022] POST /identity/v3/projects => generated 407 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:37.931001 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9769d-2246-4c54-85de-36a13f5f3bb0 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:37.955936 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9769d-2246-4c54-85de-36a13f5f3bb0 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:38.039735 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0417d13-7bd9-4ef5-9e7f-4273ae12df8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:38.040343 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0417d13-7bd9-4ef5-9e7f-4273ae12df8d admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:38.040718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0417d13-7bd9-4ef5-9e7f-4273ae12df8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:38.041096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0417d13-7bd9-4ef5-9e7f-4273ae12df8d admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:38.041867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0417d13-7bd9-4ef5-9e7f-4273ae12df8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:38.044246 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0417d13-7bd9-4ef5-9e7f-4273ae12df8d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:38.081329 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb2182-9b76-4658-a6a5-688312f35200 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:38.081516 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2855/5665] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:22:37 2022] POST /identity/v3/users => generated 304 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:38.099852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb2182-9b76-4658-a6a5-688312f35200 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:38.106530 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440c5e9-5207-4acc-941e-2a4c31dbef1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:38.107291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440c5e9-5207-4acc-941e-2a4c31dbef1e admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:38.107915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440c5e9-5207-4acc-941e-2a4c31dbef1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:38.108282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440c5e9-5207-4acc-941e-2a4c31dbef1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:38.109027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440c5e9-5207-4acc-941e-2a4c31dbef1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:38.111636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440c5e9-5207-4acc-941e-2a4c31dbef1e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:38.121760 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:38.137631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0417d13-7bd9-4ef5-9e7f-4273ae12df8d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:38.163569 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2811/5666] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:38.169813 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0417d13-7bd9-4ef5-9e7f-4273ae12df8d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:38.182659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6b726-d437-449c-a439-6129f6df8966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:38.183691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6b726-d437-449c-a439-6129f6df8966 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:38.184765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6b726-d437-449c-a439-6129f6df8966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:38.185203 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6b726-d437-449c-a439-6129f6df8966 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:38.186178 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6b726-d437-449c-a439-6129f6df8966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:38.193301 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6b726-d437-449c-a439-6129f6df8966 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:38.213640 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2856/5667] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:38.219326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440c5e9-5207-4acc-941e-2a4c31dbef1e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:38.240788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440c5e9-5207-4acc-941e-2a4c31dbef1e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:38.248591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb184cf8-67ff-4c44-95b2-ef8bed9c3dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:38.250445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb184cf8-67ff-4c44-95b2-ef8bed9c3dce admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:38.250858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb184cf8-67ff-4c44-95b2-ef8bed9c3dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:38.251238 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb184cf8-67ff-4c44-95b2-ef8bed9c3dce admin admin] PATH_INFO: `/v3/projects/2534bf5e5c0c4d40b2deab2d5f0b0cb0/users/12d94ae895c74ebba46b3e2f03c404fb/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:38.270211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb184cf8-67ff-4c44-95b2-ef8bed9c3dce admin admin] RBAC: Authorizing `identity:create_grant(project_id=2534bf5e5c0c4d40b2deab2d5f0b0cb0, user_id=12d94ae895c74ebba46b3e2f03c404fb, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:38.274661 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb184cf8-67ff-4c44-95b2-ef8bed9c3dce admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:38.294639 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2812/5668] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:22:38 2022] PUT /identity/v3/projects/2534bf5e5c0c4d40b2deab2d5f0b0cb0/users/12d94ae895c74ebba46b3e2f03c404fb/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:22:38.308004 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bff4a-4e1f-448a-ac2e-0eaa50274d06 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:38.308357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bff4a-4e1f-448a-ac2e-0eaa50274d06 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:38.308800 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bff4a-4e1f-448a-ac2e-0eaa50274d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:38.347913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-194bff4a-4e1f-448a-ac2e-0eaa50274d06 None None] MFA Rules not processed for user `12d94ae895c74ebba46b3e2f03c404fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:38.349294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-194bff4a-4e1f-448a-ac2e-0eaa50274d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:38.405293 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:38.503276 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2857/5669] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:38 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:38.504411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb184cf8-67ff-4c44-95b2-ef8bed9c3dce admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:38.624461 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb184cf8-67ff-4c44-95b2-ef8bed9c3dce admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:38.631411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eed7ba-e79f-48ae-9672-68f0cc4b5741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:38.632466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eed7ba-e79f-48ae-9672-68f0cc4b5741 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:38.632761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eed7ba-e79f-48ae-9672-68f0cc4b5741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:38.633034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eed7ba-e79f-48ae-9672-68f0cc4b5741 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:38.633707 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eed7ba-e79f-48ae-9672-68f0cc4b5741 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:38.636348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eed7ba-e79f-48ae-9672-68f0cc4b5741 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:38.682524 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2813/5670] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:22:38 2022] POST /identity/v3/projects => generated 407 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:38.683820 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bff4a-4e1f-448a-ac2e-0eaa50274d06 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:38.699903 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bff4a-4e1f-448a-ac2e-0eaa50274d06 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:38.823463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38431e4-d299-4fd6-9cdb-6f974d3b3775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:38.824251 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38431e4-d299-4fd6-9cdb-6f974d3b3775 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:38.824621 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38431e4-d299-4fd6-9cdb-6f974d3b3775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:38.825077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38431e4-d299-4fd6-9cdb-6f974d3b3775 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:38.825992 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38431e4-d299-4fd6-9cdb-6f974d3b3775 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:38.828418 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38431e4-d299-4fd6-9cdb-6f974d3b3775 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:38.873739 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2858/5671] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:22:38 2022] POST /identity/v3/users => generated 310 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:38.875146 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eed7ba-e79f-48ae-9672-68f0cc4b5741 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:38.898820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eed7ba-e79f-48ae-9672-68f0cc4b5741 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:38.914147 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c22c7-04e1-4efc-831e-b0a0a0dcd4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:38.916135 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c22c7-04e1-4efc-831e-b0a0a0dcd4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:38.917806 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c22c7-04e1-4efc-831e-b0a0a0dcd4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:38.918407 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c22c7-04e1-4efc-831e-b0a0a0dcd4a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:38.919288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c22c7-04e1-4efc-831e-b0a0a0dcd4a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:38.921852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c22c7-04e1-4efc-831e-b0a0a0dcd4a8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:38.956591 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2814/5672] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:38.961493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38431e4-d299-4fd6-9cdb-6f974d3b3775 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:38.972508 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38431e4-d299-4fd6-9cdb-6f974d3b3775 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:38.992011 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad349459-4550-4173-957c-e1f9b2c5a9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:38.993081 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad349459-4550-4173-957c-e1f9b2c5a9eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:38.993576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad349459-4550-4173-957c-e1f9b2c5a9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:38.993860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad349459-4550-4173-957c-e1f9b2c5a9eb admin admin] PATH_INFO: `/v3/projects/915c368288974922a488cb5858b2e990/users/14b6d8ffc7404842a8bf4922dbd5eb89/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:39.047664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad349459-4550-4173-957c-e1f9b2c5a9eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=915c368288974922a488cb5858b2e990, user_id=14b6d8ffc7404842a8bf4922dbd5eb89, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:39.056446 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad349459-4550-4173-957c-e1f9b2c5a9eb admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:39.089512 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2859/5673] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:22:38 2022] PUT /identity/v3/projects/915c368288974922a488cb5858b2e990/users/14b6d8ffc7404842a8bf4922dbd5eb89/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:39.093588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c22c7-04e1-4efc-831e-b0a0a0dcd4a8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:39.105344 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c22c7-04e1-4efc-831e-b0a0a0dcd4a8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:39.207154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5e23a-7a56-4285-9e6c-b16e9965e109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:39.209122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5e23a-7a56-4285-9e6c-b16e9965e109 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:39.209538 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5e23a-7a56-4285-9e6c-b16e9965e109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:39.210472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5e23a-7a56-4285-9e6c-b16e9965e109 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:39.213522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5e23a-7a56-4285-9e6c-b16e9965e109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:39.218189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5e23a-7a56-4285-9e6c-b16e9965e109 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:39.254556 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2815/5674] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:39.256661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad349459-4550-4173-957c-e1f9b2c5a9eb admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:39.266591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad349459-4550-4173-957c-e1f9b2c5a9eb admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:39.273366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e23d3-229e-42fc-bff5-dbeba80ff278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:39.275110 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e23d3-229e-42fc-bff5-dbeba80ff278 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:39.275555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e23d3-229e-42fc-bff5-dbeba80ff278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:39.276228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e23d3-229e-42fc-bff5-dbeba80ff278 admin admin] PATH_INFO: `/v3/projects/915c368288974922a488cb5858b2e990/users/14b6d8ffc7404842a8bf4922dbd5eb89/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:39.279124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e23d3-229e-42fc-bff5-dbeba80ff278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=915c368288974922a488cb5858b2e990, user_id=14b6d8ffc7404842a8bf4922dbd5eb89, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:39.282628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e23d3-229e-42fc-bff5-dbeba80ff278 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:39.335689 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2860/5675] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:22:39 2022] PUT /identity/v3/projects/915c368288974922a488cb5858b2e990/users/14b6d8ffc7404842a8bf4922dbd5eb89/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:39.338902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078e369-38e9-4ad9-b284-faf7e41fd665 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:39.338902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078e369-38e9-4ad9-b284-faf7e41fd665 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:39.338902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078e369-38e9-4ad9-b284-faf7e41fd665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:39.379364 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-6078e369-38e9-4ad9-b284-faf7e41fd665 None None] MFA Rules not processed for user `14b6d8ffc7404842a8bf4922dbd5eb89`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:39.383246 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6078e369-38e9-4ad9-b284-faf7e41fd665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:39.436969 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:39.523717 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2816/5676] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:39 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:39.535281 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e23d3-229e-42fc-bff5-dbeba80ff278 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:39.537963 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-566e23d3-229e-42fc-bff5-dbeba80ff278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:39.562495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078e369-38e9-4ad9-b284-faf7e41fd665 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:39.563856 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6078e369-38e9-4ad9-b284-faf7e41fd665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:39.632650 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078e369-38e9-4ad9-b284-faf7e41fd665 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:39.641885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd282a2-fe21-45dd-b912-f3be82109dd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:39.642558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd282a2-fe21-45dd-b912-f3be82109dd4 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:39.642840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd282a2-fe21-45dd-b912-f3be82109dd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:39.643111 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd282a2-fe21-45dd-b912-f3be82109dd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:39.697756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e23d3-229e-42fc-bff5-dbeba80ff278 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:39.722341 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019258f4-fdad-496a-abfd-2995bcdbe23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:39.725271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019258f4-fdad-496a-abfd-2995bcdbe23c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:39.726603 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019258f4-fdad-496a-abfd-2995bcdbe23c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:39.726891 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019258f4-fdad-496a-abfd-2995bcdbe23c admin admin] PATH_INFO: `/v3/users/e3029c8759614a508f3b78b80c4ca0bc` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:39.730363 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019258f4-fdad-496a-abfd-2995bcdbe23c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3029c8759614a508f3b78b80c4ca0bc)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:39.732102 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019258f4-fdad-496a-abfd-2995bcdbe23c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:39.802600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd282a2-fe21-45dd-b912-f3be82109dd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:39.809926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd282a2-fe21-45dd-b912-f3be82109dd4 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:39.824604 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:39.844559 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2817/5677] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:22:39 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:22:39.851678 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-019258f4-fdad-496a-abfd-2995bcdbe23c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3029c8759614a508f3b78b80c4ca0bc'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:39.853181 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-019258f4-fdad-496a-abfd-2995bcdbe23c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3029c8759614a508f3b78b80c4ca0bc'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:39.862557 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-019258f4-fdad-496a-abfd-2995bcdbe23c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3029c8759614a508f3b78b80c4ca0bc'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:39.873634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-019258f4-fdad-496a-abfd-2995bcdbe23c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3029c8759614a508f3b78b80c4ca0bc'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:39.874559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-019258f4-fdad-496a-abfd-2995bcdbe23c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3029c8759614a508f3b78b80c4ca0bc'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:39.911321 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2861/5678] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:22:39 2022] DELETE /identity/v3/users/e3029c8759614a508f3b78b80c4ca0bc => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:40.285896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd282a2-fe21-45dd-b912-f3be82109dd4 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:40.298574 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd282a2-fe21-45dd-b912-f3be82109dd4 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:40.378422 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fcaf50-32ef-48bc-887e-bab34e4fd369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:40.379059 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcaf50-32ef-48bc-887e-bab34e4fd369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:40.379334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcaf50-32ef-48bc-887e-bab34e4fd369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:40.379603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcaf50-32ef-48bc-887e-bab34e4fd369 admin admin] PATH_INFO: `/v3/projects/236b31360354448d96e7af6b6c8e94bc` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:40.381255 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fcaf50-32ef-48bc-887e-bab34e4fd369 admin admin] RBAC: Authorizing `identity:delete_project(project_id=236b31360354448d96e7af6b6c8e94bc)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:40.383242 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fcaf50-32ef-48bc-887e-bab34e4fd369 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:40.418278 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019258f4-fdad-496a-abfd-2995bcdbe23c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:40.419698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-019258f4-fdad-496a-abfd-2995bcdbe23c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:40.435204 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:40.477773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-98fcaf50-32ef-48bc-887e-bab34e4fd369 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '236b31360354448d96e7af6b6c8e94bc', 'request_id': 'req-98fcaf50-32ef-48bc-887e-bab34e4fd369'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:40.492005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-98fcaf50-32ef-48bc-887e-bab34e4fd369 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '236b31360354448d96e7af6b6c8e94bc', 'request_id': 'req-98fcaf50-32ef-48bc-887e-bab34e4fd369'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:40.499865 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-98fcaf50-32ef-48bc-887e-bab34e4fd369 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '236b31360354448d96e7af6b6c8e94bc', 'request_id': 'req-98fcaf50-32ef-48bc-887e-bab34e4fd369'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:40.514851 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-98fcaf50-32ef-48bc-887e-bab34e4fd369 admin admin] The token cache is being invalidate because project 236b31360354448d96e7af6b6c8e94bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:22:40.515435 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-98fcaf50-32ef-48bc-887e-bab34e4fd369 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:40.516376 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-98fcaf50-32ef-48bc-887e-bab34e4fd369 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:40.520358 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2818/5679] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:22:40 2022] DELETE /identity/v3/projects/236b31360354448d96e7af6b6c8e94bc => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:40.533755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e11237-1316-41f0-aa5c-52b72330f1d8 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:40.536197 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e11237-1316-41f0-aa5c-52b72330f1d8 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:40.537191 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e11237-1316-41f0-aa5c-52b72330f1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:40.587265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019258f4-fdad-496a-abfd-2995bcdbe23c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:40.595304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-93e11237-1316-41f0-aa5c-52b72330f1d8 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:40.597056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-93e11237-1316-41f0-aa5c-52b72330f1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:40.672331 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2819/5680] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:22:40.676942 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966c701-9be7-47c9-ac8c-02784976af67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:40.678220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966c701-9be7-47c9-ac8c-02784976af67 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:40.678613 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966c701-9be7-47c9-ac8c-02784976af67 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:40.679247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966c701-9be7-47c9-ac8c-02784976af67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:40.681416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8966c701-9be7-47c9-ac8c-02784976af67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:40.681967 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81487b17-65bd-452b-97af-de47e3bc3bbe None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:40.682254 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81487b17-65bd-452b-97af-de47e3bc3bbe None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:40.682525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81487b17-65bd-452b-97af-de47e3bc3bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:40.704348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-81487b17-65bd-452b-97af-de47e3bc3bbe None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:40.705577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-81487b17-65bd-452b-97af-de47e3bc3bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:40.718291 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2820/5681] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:40.720112 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81487b17-65bd-452b-97af-de47e3bc3bbe None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:40.734123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81487b17-65bd-452b-97af-de47e3bc3bbe None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:40.741638 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb42fa-685c-4171-9480-57d3175ac45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:40.742394 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb42fa-685c-4171-9480-57d3175ac45b admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:40.742671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb42fa-685c-4171-9480-57d3175ac45b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:40.742905 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb42fa-685c-4171-9480-57d3175ac45b admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:40.743714 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb42fa-685c-4171-9480-57d3175ac45b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:22:40.744017 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb42fa-685c-4171-9480-57d3175ac45b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:40.747528 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb42fa-685c-4171-9480-57d3175ac45b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:40.754588 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:40.784187 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2821/5682] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:22:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:22:40.788678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb42fa-685c-4171-9480-57d3175ac45b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:40.789790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966c701-9be7-47c9-ac8c-02784976af67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:40.791797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966c701-9be7-47c9-ac8c-02784976af67 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:40.805569 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2862/5683] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:22:40 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:22:40.815261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb42fa-685c-4171-9480-57d3175ac45b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:40.840243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dad079-bb1f-4de1-93ac-1610dac904b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:40.840243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dad079-bb1f-4de1-93ac-1610dac904b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:40.840243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dad079-bb1f-4de1-93ac-1610dac904b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:40.840243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dad079-bb1f-4de1-93ac-1610dac904b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:40.840711 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dad079-bb1f-4de1-93ac-1610dac904b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:40.841968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dad079-bb1f-4de1-93ac-1610dac904b5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:40.924024 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2822/5684] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:22:40 2022] POST /identity/v3/projects => generated 403 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:40.925508 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966c701-9be7-47c9-ac8c-02784976af67 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:40.939249 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966c701-9be7-47c9-ac8c-02784976af67 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:41.030808 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836ccbe-4d8f-4fb3-8669-1b36f5a44b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:41.031657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836ccbe-4d8f-4fb3-8669-1b36f5a44b1b admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:41.032439 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836ccbe-4d8f-4fb3-8669-1b36f5a44b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:41.033130 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836ccbe-4d8f-4fb3-8669-1b36f5a44b1b admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:41.033982 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836ccbe-4d8f-4fb3-8669-1b36f5a44b1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:41.037079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836ccbe-4d8f-4fb3-8669-1b36f5a44b1b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:41.069720 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2863/5685] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:22:40 2022] POST /identity/v3/users => generated 302 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:41.071362 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dad079-bb1f-4de1-93ac-1610dac904b5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:41.088092 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dad079-bb1f-4de1-93ac-1610dac904b5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:41.095657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b78dbf-87da-41b0-a0b4-7fd4f6e6884f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:41.096713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b78dbf-87da-41b0-a0b4-7fd4f6e6884f admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:41.099038 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b78dbf-87da-41b0-a0b4-7fd4f6e6884f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:41.099514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b78dbf-87da-41b0-a0b4-7fd4f6e6884f admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:41.100819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b78dbf-87da-41b0-a0b4-7fd4f6e6884f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:41.104045 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b78dbf-87da-41b0-a0b4-7fd4f6e6884f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:41.129811 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2823/5686] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:41.131472 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836ccbe-4d8f-4fb3-8669-1b36f5a44b1b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:41.143318 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836ccbe-4d8f-4fb3-8669-1b36f5a44b1b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:41.149747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4bea4-c71e-48b8-b4c1-eded7074efa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:41.150492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4bea4-c71e-48b8-b4c1-eded7074efa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:41.150839 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4bea4-c71e-48b8-b4c1-eded7074efa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:41.151219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4bea4-c71e-48b8-b4c1-eded7074efa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:41.152085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4bea4-c71e-48b8-b4c1-eded7074efa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:41.153800 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4bea4-c71e-48b8-b4c1-eded7074efa2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:41.168773 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2864/5687] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:41.169981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b78dbf-87da-41b0-a0b4-7fd4f6e6884f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:41.182708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b78dbf-87da-41b0-a0b4-7fd4f6e6884f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:41.198589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630611b0-3289-4369-9589-42a614a7ff42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:41.200016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630611b0-3289-4369-9589-42a614a7ff42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:41.200500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630611b0-3289-4369-9589-42a614a7ff42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:41.200931 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630611b0-3289-4369-9589-42a614a7ff42 admin admin] PATH_INFO: `/v3/projects/e3ea5b23a918491a8e278509042f1e12/users/551702ce15ec4969adc5affe33f29ce6/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:41.224904 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630611b0-3289-4369-9589-42a614a7ff42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ea5b23a918491a8e278509042f1e12, user_id=551702ce15ec4969adc5affe33f29ce6, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:41.228511 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630611b0-3289-4369-9589-42a614a7ff42 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:41.258536 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2824/5688] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:22:41 2022] PUT /identity/v3/projects/e3ea5b23a918491a8e278509042f1e12/users/551702ce15ec4969adc5affe33f29ce6/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:41.260160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f351f-29da-4f61-9b87-86eb35d9172a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:41.260838 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f351f-29da-4f61-9b87-86eb35d9172a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:41.261632 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f351f-29da-4f61-9b87-86eb35d9172a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:41.298773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-bd3f351f-29da-4f61-9b87-86eb35d9172a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:41.301284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-bd3f351f-29da-4f61-9b87-86eb35d9172a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:41.383061 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2865/5689] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:22:41.400202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630611b0-3289-4369-9589-42a614a7ff42 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:41.401745 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-630611b0-3289-4369-9589-42a614a7ff42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:41.472399 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:41.497769 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630611b0-3289-4369-9589-42a614a7ff42 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:41.504019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75640501-ef21-4c24-b709-8363572a0a52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:41.506178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75640501-ef21-4c24-b709-8363572a0a52 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:41.506884 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75640501-ef21-4c24-b709-8363572a0a52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:41.507582 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75640501-ef21-4c24-b709-8363572a0a52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:41.527642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75640501-ef21-4c24-b709-8363572a0a52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:41.530806 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75640501-ef21-4c24-b709-8363572a0a52 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:41.554011 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2825/5690] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:22:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:22:44.681227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f351f-29da-4f61-9b87-86eb35d9172a None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:44.683638 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-bd3f351f-29da-4f61-9b87-86eb35d9172a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:44.714733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f351f-29da-4f61-9b87-86eb35d9172a None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:44.727578 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282ef6b-1330-4b25-961f-1e1190140daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:44.728245 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282ef6b-1330-4b25-961f-1e1190140daa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:44.728539 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282ef6b-1330-4b25-961f-1e1190140daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:44.728828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282ef6b-1330-4b25-961f-1e1190140daa admin admin] PATH_INFO: `/v3/users/c69bb2164eaf4a31b66b00d82872aada` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:44.730223 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282ef6b-1330-4b25-961f-1e1190140daa admin admin] RBAC: Authorizing `identity:delete_user(user_id=c69bb2164eaf4a31b66b00d82872aada)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:44.732499 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282ef6b-1330-4b25-961f-1e1190140daa admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:44.882906 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6282ef6b-1330-4b25-961f-1e1190140daa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c69bb2164eaf4a31b66b00d82872aada'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:44.884133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6282ef6b-1330-4b25-961f-1e1190140daa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c69bb2164eaf4a31b66b00d82872aada'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:44.898847 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:44.903855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6282ef6b-1330-4b25-961f-1e1190140daa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c69bb2164eaf4a31b66b00d82872aada'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:44.928319 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6282ef6b-1330-4b25-961f-1e1190140daa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c69bb2164eaf4a31b66b00d82872aada'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:44.929788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6282ef6b-1330-4b25-961f-1e1190140daa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c69bb2164eaf4a31b66b00d82872aada'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:44.964549 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2866/5691] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:22:44 2022] DELETE /identity/v3/users/c69bb2164eaf4a31b66b00d82872aada => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:44.968879 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c280f1-762e-445c-9e8e-a59efc7bd730 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:44.969359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c280f1-762e-445c-9e8e-a59efc7bd730 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:44.971104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c280f1-762e-445c-9e8e-a59efc7bd730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:45.008550 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c9c280f1-762e-445c-9e8e-a59efc7bd730 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:45.009983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c9c280f1-762e-445c-9e8e-a59efc7bd730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:45.173129 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2826/5692] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:45.200677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282ef6b-1330-4b25-961f-1e1190140daa admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:45.202407 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6282ef6b-1330-4b25-961f-1e1190140daa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:45.342728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282ef6b-1330-4b25-961f-1e1190140daa admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:45.353379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a234ce-2f17-4601-934e-6b1133eb234e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:45.354305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a234ce-2f17-4601-934e-6b1133eb234e service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:45.358259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a234ce-2f17-4601-934e-6b1133eb234e service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:45.358259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a234ce-2f17-4601-934e-6b1133eb234e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:45.376818 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a234ce-2f17-4601-934e-6b1133eb234e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:45.378500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a234ce-2f17-4601-934e-6b1133eb234e service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:45.403768 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2867/5693] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:22:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:22:46.825039 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c280f1-762e-445c-9e8e-a59efc7bd730 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:46.828483 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c9c280f1-762e-445c-9e8e-a59efc7bd730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:46.844450 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c280f1-762e-445c-9e8e-a59efc7bd730 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:46.852743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c678847-fa13-4e59-8414-2c47d2d5d619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:46.853847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c678847-fa13-4e59-8414-2c47d2d5d619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:46.854511 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c678847-fa13-4e59-8414-2c47d2d5d619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:46.855100 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c678847-fa13-4e59-8414-2c47d2d5d619 admin admin] PATH_INFO: `/v3/projects/c865cd65112f459a88eb27273135f8ce` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:46.858088 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c678847-fa13-4e59-8414-2c47d2d5d619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c865cd65112f459a88eb27273135f8ce)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:46.864461 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c678847-fa13-4e59-8414-2c47d2d5d619 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:47.010500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5c678847-fa13-4e59-8414-2c47d2d5d619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c865cd65112f459a88eb27273135f8ce', 'request_id': 'req-5c678847-fa13-4e59-8414-2c47d2d5d619'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:47.035233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5c678847-fa13-4e59-8414-2c47d2d5d619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c865cd65112f459a88eb27273135f8ce', 'request_id': 'req-5c678847-fa13-4e59-8414-2c47d2d5d619'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:47.068050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5c678847-fa13-4e59-8414-2c47d2d5d619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c865cd65112f459a88eb27273135f8ce', 'request_id': 'req-5c678847-fa13-4e59-8414-2c47d2d5d619'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:47.090742 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5c678847-fa13-4e59-8414-2c47d2d5d619 admin admin] The token cache is being invalidate because project c865cd65112f459a88eb27273135f8ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:22:47.091190 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5c678847-fa13-4e59-8414-2c47d2d5d619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:47.093905 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5c678847-fa13-4e59-8414-2c47d2d5d619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:47.106592 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2827/5694] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:22:46 2022] DELETE /identity/v3/projects/c865cd65112f459a88eb27273135f8ce => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:47.107364 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96911a3-bc13-476b-8a42-fed26db4cd2e None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:47.107894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96911a3-bc13-476b-8a42-fed26db4cd2e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:47.108179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96911a3-bc13-476b-8a42-fed26db4cd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:47.137895 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-f96911a3-bc13-476b-8a42-fed26db4cd2e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:47.139145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f96911a3-bc13-476b-8a42-fed26db4cd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:47.266606 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2868/5695] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:47.269102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1e06c-0325-4159-8d80-897235a264c2 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:47.269578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1e06c-0325-4159-8d80-897235a264c2 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:47.271848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1e06c-0325-4159-8d80-897235a264c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:47.298274 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a2d1e06c-0325-4159-8d80-897235a264c2 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:47.299793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a2d1e06c-0325-4159-8d80-897235a264c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:47.313475 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2828/5696] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:47.317019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96911a3-bc13-476b-8a42-fed26db4cd2e None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:47.361309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96911a3-bc13-476b-8a42-fed26db4cd2e None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:47.375665 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec7e11-cbec-453c-ac09-200fcc4ba63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:47.376290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec7e11-cbec-453c-ac09-200fcc4ba63c admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:47.376570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec7e11-cbec-453c-ac09-200fcc4ba63c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:47.376841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec7e11-cbec-453c-ac09-200fcc4ba63c admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:47.377629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec7e11-cbec-453c-ac09-200fcc4ba63c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:22:47.377937 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec7e11-cbec-453c-ac09-200fcc4ba63c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:47.379556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec7e11-cbec-453c-ac09-200fcc4ba63c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:47.394300 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2869/5697] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:22:47.399296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1e06c-0325-4159-8d80-897235a264c2 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:47.410652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1e06c-0325-4159-8d80-897235a264c2 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:47.416194 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406021b7-9d4d-45b3-8b02-8f23fe77e223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:47.417047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406021b7-9d4d-45b3-8b02-8f23fe77e223 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:47.417322 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406021b7-9d4d-45b3-8b02-8f23fe77e223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:47.417807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406021b7-9d4d-45b3-8b02-8f23fe77e223 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:47.418738 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406021b7-9d4d-45b3-8b02-8f23fe77e223 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:47.429357 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406021b7-9d4d-45b3-8b02-8f23fe77e223 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:47.506721 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2829/5698] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:22:47 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:47.507797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec7e11-cbec-453c-ac09-200fcc4ba63c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:47.520672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec7e11-cbec-453c-ac09-200fcc4ba63c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:47.663225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43b9b1-63d3-48b4-a67d-4e551e19a33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:47.664324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43b9b1-63d3-48b4-a67d-4e551e19a33c admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:47.664826 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43b9b1-63d3-48b4-a67d-4e551e19a33c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:47.665296 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43b9b1-63d3-48b4-a67d-4e551e19a33c admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:47.666685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43b9b1-63d3-48b4-a67d-4e551e19a33c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:47.669209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43b9b1-63d3-48b4-a67d-4e551e19a33c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:47.689699 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:47.726196 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2870/5699] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:22:47 2022] POST /identity/v3/users => generated 290 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:47.730298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406021b7-9d4d-45b3-8b02-8f23fe77e223 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:47.744268 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406021b7-9d4d-45b3-8b02-8f23fe77e223 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:47.754692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48459c69-05bd-4a22-a409-87b55240c2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:47.755782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48459c69-05bd-4a22-a409-87b55240c2ee admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:47.756346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48459c69-05bd-4a22-a409-87b55240c2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:47.756779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48459c69-05bd-4a22-a409-87b55240c2ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:47.758219 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48459c69-05bd-4a22-a409-87b55240c2ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:47.760509 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48459c69-05bd-4a22-a409-87b55240c2ee admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:47.774001 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2830/5700] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:47.778384 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43b9b1-63d3-48b4-a67d-4e551e19a33c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:47.790937 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43b9b1-63d3-48b4-a67d-4e551e19a33c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:47.796843 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1dc39-25e8-4234-bf35-0492e5591527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:47.797483 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1dc39-25e8-4234-bf35-0492e5591527 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:47.797763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1dc39-25e8-4234-bf35-0492e5591527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:47.798032 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1dc39-25e8-4234-bf35-0492e5591527 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:47.798679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1dc39-25e8-4234-bf35-0492e5591527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:47.801208 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1dc39-25e8-4234-bf35-0492e5591527 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:47.819490 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2871/5701] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:47.821194 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48459c69-05bd-4a22-a409-87b55240c2ee admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:47.842779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48459c69-05bd-4a22-a409-87b55240c2ee admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:47.853461 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0c62b-53a7-40f1-991e-3426d58ff153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:47.854374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0c62b-53a7-40f1-991e-3426d58ff153 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:47.855508 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0c62b-53a7-40f1-991e-3426d58ff153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:47.856116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0c62b-53a7-40f1-991e-3426d58ff153 admin admin] PATH_INFO: `/v3/projects/2f743c6268164854a215a15f3c82bae1/users/bdfdb11e893a4f36abc6cf9bc07850da/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:47.898250 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae0c62b-53a7-40f1-991e-3426d58ff153 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f743c6268164854a215a15f3c82bae1, user_id=bdfdb11e893a4f36abc6cf9bc07850da, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:47.900913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae0c62b-53a7-40f1-991e-3426d58ff153 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:47.942232 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2831/5702] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:22:47 2022] PUT /identity/v3/projects/2f743c6268164854a215a15f3c82bae1/users/bdfdb11e893a4f36abc6cf9bc07850da/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:22:47.943877 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e154c-2854-4df8-a45f-25c1b7c048ee None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:47.944173 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e154c-2854-4df8-a45f-25c1b7c048ee None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:47.944454 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e154c-2854-4df8-a45f-25c1b7c048ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:48.014542 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-2c9e154c-2854-4df8-a45f-25c1b7c048ee None None] MFA Rules not processed for user `bdfdb11e893a4f36abc6cf9bc07850da`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:48.018391 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2c9e154c-2854-4df8-a45f-25c1b7c048ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:48.217020 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2872/5703] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:48.218431 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0c62b-53a7-40f1-991e-3426d58ff153 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:48.222608 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:48.362333 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0c62b-53a7-40f1-991e-3426d58ff153 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:48.366852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0884a-35f9-496d-a0e8-75d0c980ba20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:48.367468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0884a-35f9-496d-a0e8-75d0c980ba20 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:48.367748 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0884a-35f9-496d-a0e8-75d0c980ba20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:48.368015 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0884a-35f9-496d-a0e8-75d0c980ba20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:48.368664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b0884a-35f9-496d-a0e8-75d0c980ba20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:48.370635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b0884a-35f9-496d-a0e8-75d0c980ba20 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:48.454519 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2832/5704] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:22:48 2022] POST /identity/v3/projects => generated 379 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:22:48.462380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e154c-2854-4df8-a45f-25c1b7c048ee None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:48.484971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e154c-2854-4df8-a45f-25c1b7c048ee None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:48.616517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201ba44-3e09-4582-a010-3924c63cbe9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:48.617198 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201ba44-3e09-4582-a010-3924c63cbe9f admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:48.617502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201ba44-3e09-4582-a010-3924c63cbe9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:48.617775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201ba44-3e09-4582-a010-3924c63cbe9f admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:48.618511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8201ba44-3e09-4582-a010-3924c63cbe9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:48.620449 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8201ba44-3e09-4582-a010-3924c63cbe9f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:48.659135 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2873/5705] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:22:48 2022] POST /identity/v3/users => generated 296 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:48.663041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0884a-35f9-496d-a0e8-75d0c980ba20 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:48.677166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0884a-35f9-496d-a0e8-75d0c980ba20 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:48.687481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989726b5-2300-45a4-a7f2-413452b5c758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:48.688486 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989726b5-2300-45a4-a7f2-413452b5c758 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:48.688947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989726b5-2300-45a4-a7f2-413452b5c758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:48.689482 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989726b5-2300-45a4-a7f2-413452b5c758 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:48.690339 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989726b5-2300-45a4-a7f2-413452b5c758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:48.692180 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989726b5-2300-45a4-a7f2-413452b5c758 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:48.705729 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2833/5706] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:48.711885 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201ba44-3e09-4582-a010-3924c63cbe9f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:48.724432 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201ba44-3e09-4582-a010-3924c63cbe9f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:48.743692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a6227-01e5-4c0b-bb56-b831a9028489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:48.744409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a6227-01e5-4c0b-bb56-b831a9028489 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:48.744755 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a6227-01e5-4c0b-bb56-b831a9028489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:48.745144 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a6227-01e5-4c0b-bb56-b831a9028489 admin admin] PATH_INFO: `/v3/projects/293365b8abf343c5b24b410c8ed1f1ef/users/3aa13075902a41df8dd6294dee627c2c/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:48.783419 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a6227-01e5-4c0b-bb56-b831a9028489 admin admin] RBAC: Authorizing `identity:create_grant(project_id=293365b8abf343c5b24b410c8ed1f1ef, user_id=3aa13075902a41df8dd6294dee627c2c, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:48.790051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a6227-01e5-4c0b-bb56-b831a9028489 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:48.820821 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2874/5707] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:22:48 2022] PUT /identity/v3/projects/293365b8abf343c5b24b410c8ed1f1ef/users/3aa13075902a41df8dd6294dee627c2c/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:48.825030 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989726b5-2300-45a4-a7f2-413452b5c758 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:48.840192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989726b5-2300-45a4-a7f2-413452b5c758 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:48.960892 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861faa03-223d-4f5a-a02c-05fe3dba9309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:48.961541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861faa03-223d-4f5a-a02c-05fe3dba9309 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:48.962034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861faa03-223d-4f5a-a02c-05fe3dba9309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:48.962491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861faa03-223d-4f5a-a02c-05fe3dba9309 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:48.963342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861faa03-223d-4f5a-a02c-05fe3dba9309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:48.965233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861faa03-223d-4f5a-a02c-05fe3dba9309 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:48.977941 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2834/5708] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:48.981816 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a6227-01e5-4c0b-bb56-b831a9028489 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:48.994770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a6227-01e5-4c0b-bb56-b831a9028489 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:49.001173 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644c611-e91f-4f5e-852a-a3dd26d79c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:49.002157 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644c611-e91f-4f5e-852a-a3dd26d79c8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:49.002618 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644c611-e91f-4f5e-852a-a3dd26d79c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:49.003050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644c611-e91f-4f5e-852a-a3dd26d79c8a admin admin] PATH_INFO: `/v3/projects/293365b8abf343c5b24b410c8ed1f1ef/users/3aa13075902a41df8dd6294dee627c2c/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:49.005789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f644c611-e91f-4f5e-852a-a3dd26d79c8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=293365b8abf343c5b24b410c8ed1f1ef, user_id=3aa13075902a41df8dd6294dee627c2c, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:49.009182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f644c611-e91f-4f5e-852a-a3dd26d79c8a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:49.026172 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2875/5709] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:22:48 2022] PUT /identity/v3/projects/293365b8abf343c5b24b410c8ed1f1ef/users/3aa13075902a41df8dd6294dee627c2c/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:22:49.037716 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160370a-084d-4997-b6ab-a76e319a43a5 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:49.037997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160370a-084d-4997-b6ab-a76e319a43a5 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:49.038269 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160370a-084d-4997-b6ab-a76e319a43a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:49.076759 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-9160370a-084d-4997-b6ab-a76e319a43a5 None None] MFA Rules not processed for user `3aa13075902a41df8dd6294dee627c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:49.078201 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9160370a-084d-4997-b6ab-a76e319a43a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:49.159682 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:49.171890 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2835/5710] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:49 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:49.206528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644c611-e91f-4f5e-852a-a3dd26d79c8a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:49.208701 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f644c611-e91f-4f5e-852a-a3dd26d79c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:49.253628 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:49.338777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644c611-e91f-4f5e-852a-a3dd26d79c8a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:49.345424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31eabe-7b38-40be-ae72-6071d313447c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:49.347044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31eabe-7b38-40be-ae72-6071d313447c service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:49.347492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31eabe-7b38-40be-ae72-6071d313447c service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:49.363100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31eabe-7b38-40be-ae72-6071d313447c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:49.387740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31eabe-7b38-40be-ae72-6071d313447c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:49.389747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31eabe-7b38-40be-ae72-6071d313447c service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:49.404868 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160370a-084d-4997-b6ab-a76e319a43a5 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:49.406313 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9160370a-084d-4997-b6ab-a76e319a43a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:49.417422 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2876/5711] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:22:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:22:49.582363 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160370a-084d-4997-b6ab-a76e319a43a5 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:49.598052 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd1432-8448-4244-8f8e-b9cc638fe2b1 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5ffbee89f3348b9929101b45f2a144e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb0baa91ec4406c82179c1e57f8c53c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:49.601781 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd1432-8448-4244-8f8e-b9cc638fe2b1 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:49.602088 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd1432-8448-4244-8f8e-b9cc638fe2b1 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:49.602418 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd1432-8448-4244-8f8e-b9cc638fe2b1 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:49.607642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd1432-8448-4244-8f8e-b9cc638fe2b1 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:22:49.608030 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd1432-8448-4244-8f8e-b9cc638fe2b1 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:49.614223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd1432-8448-4244-8f8e-b9cc638fe2b1 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:49.636125 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31eabe-7b38-40be-ae72-6071d313447c service cinder] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:49.645382 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2836/5712] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:22:49.647664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31eabe-7b38-40be-ae72-6071d313447c service cinder] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:49.649960 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd1432-8448-4244-8f8e-b9cc638fe2b1 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:49.658135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1bf86-00ff-4ae1-837b-c47a0765bc57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:49.658773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1bf86-00ff-4ae1-837b-c47a0765bc57 service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:49.659057 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1bf86-00ff-4ae1-837b-c47a0765bc57 service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:49.659384 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1bf86-00ff-4ae1-837b-c47a0765bc57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:49.671566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd1432-8448-4244-8f8e-b9cc638fe2b1 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:49.687643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de1c9b-f76c-4f8c-a860-687f75088ef7 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5ffbee89f3348b9929101b45f2a144e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb0baa91ec4406c82179c1e57f8c53c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:49.688581 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de1c9b-f76c-4f8c-a860-687f75088ef7 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:49.689039 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de1c9b-f76c-4f8c-a860-687f75088ef7 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:49.689520 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de1c9b-f76c-4f8c-a860-687f75088ef7 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:49.690333 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de1c9b-f76c-4f8c-a860-687f75088ef7 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:49.697372 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de1c9b-f76c-4f8c-a860-687f75088ef7 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:49.777545 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2837/5713] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:22:49 2022] POST /identity/v3/projects => generated 349 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:49.781578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de1c9b-f76c-4f8c-a860-687f75088ef7 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:49.800776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1bf86-00ff-4ae1-837b-c47a0765bc57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:49.802523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1bf86-00ff-4ae1-837b-c47a0765bc57 service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:49.819702 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2877/5714] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:22:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:22:49.921892 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de1c9b-f76c-4f8c-a860-687f75088ef7 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:49.940637 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76efbeac-834a-4a1b-b6f7-b8285e86d4b9 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5ffbee89f3348b9929101b45f2a144e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb0baa91ec4406c82179c1e57f8c53c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:49.941448 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efbeac-834a-4a1b-b6f7-b8285e86d4b9 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:49.941837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efbeac-834a-4a1b-b6f7-b8285e86d4b9 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:49.942314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efbeac-834a-4a1b-b6f7-b8285e86d4b9 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:49.946309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76efbeac-834a-4a1b-b6f7-b8285e86d4b9 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:22:49.948101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76efbeac-834a-4a1b-b6f7-b8285e86d4b9 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:49.951401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76efbeac-834a-4a1b-b6f7-b8285e86d4b9 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:49.986675 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2838/5715] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:22:50.833289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1bf86-00ff-4ae1-837b-c47a0765bc57 service cinder] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:50.853226 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1bf86-00ff-4ae1-837b-c47a0765bc57 service cinder] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:50.860733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d0086-7d6e-40db-aa09-a94118f20733 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5ffbee89f3348b9929101b45f2a144e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb0baa91ec4406c82179c1e57f8c53c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:50.861729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d0086-7d6e-40db-aa09-a94118f20733 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:50.862230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d0086-7d6e-40db-aa09-a94118f20733 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:50.863601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d0086-7d6e-40db-aa09-a94118f20733 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] PATH_INFO: `/v3/projects/05db16679748433e887dfcec02eff830` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:50.866125 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882d0086-7d6e-40db-aa09-a94118f20733 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] RBAC: Authorizing `identity:delete_project(project_id=05db16679748433e887dfcec02eff830)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:50.868276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882d0086-7d6e-40db-aa09-a94118f20733 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:50.974811 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-882d0086-7d6e-40db-aa09-a94118f20733 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05db16679748433e887dfcec02eff830', 'request_id': 'req-882d0086-7d6e-40db-aa09-a94118f20733'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:50.996838 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-882d0086-7d6e-40db-aa09-a94118f20733 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05db16679748433e887dfcec02eff830', 'request_id': 'req-882d0086-7d6e-40db-aa09-a94118f20733'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:51.005418 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-882d0086-7d6e-40db-aa09-a94118f20733 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05db16679748433e887dfcec02eff830', 'request_id': 'req-882d0086-7d6e-40db-aa09-a94118f20733'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:51.032778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-882d0086-7d6e-40db-aa09-a94118f20733 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] The token cache is being invalidate because project 05db16679748433e887dfcec02eff830 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:22:51.033690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-882d0086-7d6e-40db-aa09-a94118f20733 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:51.033920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-882d0086-7d6e-40db-aa09-a94118f20733 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:51.037484 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2878/5716] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:22:50 2022] DELETE /identity/v3/projects/05db16679748433e887dfcec02eff830 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:22:51.080023 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76efbeac-834a-4a1b-b6f7-b8285e86d4b9 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:51.082051 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-76efbeac-834a-4a1b-b6f7-b8285e86d4b9 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:51.230955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76efbeac-834a-4a1b-b6f7-b8285e86d4b9 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:51.273171 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:51.353422 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f2fa1-ab32-4878-8708-4abf4b9cf63a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:51.354524 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f2fa1-ab32-4878-8708-4abf4b9cf63a service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:51.355019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f2fa1-ab32-4878-8708-4abf4b9cf63a service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:51.355471 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f2fa1-ab32-4878-8708-4abf4b9cf63a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:51.363671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6d2f2fa1-ab32-4878-8708-4abf4b9cf63a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:51.534041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f2fa1-ab32-4878-8708-4abf4b9cf63a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:51.535494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f2fa1-ab32-4878-8708-4abf4b9cf63a service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:51.555092 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2839/5717] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:22:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:22:53.884514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d0086-7d6e-40db-aa09-a94118f20733 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:53.887101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-882d0086-7d6e-40db-aa09-a94118f20733 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:54.017336 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:54.064021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d0086-7d6e-40db-aa09-a94118f20733 tempest-RoutersIpV6AdminTest-1122139403 tempest-RoutersIpV6AdminTest-1122139403-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:54.081130 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c355d6-28aa-4fc7-b983-6bd1c53b57c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:54.081696 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f2fa1-ab32-4878-8708-4abf4b9cf63a service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:54.082166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c355d6-28aa-4fc7-b983-6bd1c53b57c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:54.083212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6d2f2fa1-ab32-4878-8708-4abf4b9cf63a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:54.084269 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c355d6-28aa-4fc7-b983-6bd1c53b57c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:54.084606 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c355d6-28aa-4fc7-b983-6bd1c53b57c9 admin admin] PATH_INFO: `/v3/users/e45404b70e5543ed9af440b1aefef5ca` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:54.087592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c355d6-28aa-4fc7-b983-6bd1c53b57c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e45404b70e5543ed9af440b1aefef5ca)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:54.094954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c355d6-28aa-4fc7-b983-6bd1c53b57c9 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:54.109967 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f2fa1-ab32-4878-8708-4abf4b9cf63a service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:54.131278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb3bdf-77ff-4438-a63b-34ea610fd450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:54.134802 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb3bdf-77ff-4438-a63b-34ea610fd450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:54.135483 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb3bdf-77ff-4438-a63b-34ea610fd450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:54.136209 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb3bdf-77ff-4438-a63b-34ea610fd450 admin admin] PATH_INFO: `/v3/users/12d94ae895c74ebba46b3e2f03c404fb` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:54.139557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb3bdf-77ff-4438-a63b-34ea610fd450 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12d94ae895c74ebba46b3e2f03c404fb)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:54.145035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb3bdf-77ff-4438-a63b-34ea610fd450 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:54.239611 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-32c355d6-28aa-4fc7-b983-6bd1c53b57c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e45404b70e5543ed9af440b1aefef5ca'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:54.241219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-32c355d6-28aa-4fc7-b983-6bd1c53b57c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e45404b70e5543ed9af440b1aefef5ca'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:54.254493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-32c355d6-28aa-4fc7-b983-6bd1c53b57c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e45404b70e5543ed9af440b1aefef5ca'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:54.273572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-32c355d6-28aa-4fc7-b983-6bd1c53b57c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e45404b70e5543ed9af440b1aefef5ca'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:54.274451 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-32c355d6-28aa-4fc7-b983-6bd1c53b57c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e45404b70e5543ed9af440b1aefef5ca'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:54.344222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dacb3bdf-77ff-4438-a63b-34ea610fd450 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12d94ae895c74ebba46b3e2f03c404fb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:54.349918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dacb3bdf-77ff-4438-a63b-34ea610fd450 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12d94ae895c74ebba46b3e2f03c404fb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:54.361577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dacb3bdf-77ff-4438-a63b-34ea610fd450 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12d94ae895c74ebba46b3e2f03c404fb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:54.376942 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2879/5718] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:22:53 2022] DELETE /identity/v3/users/e45404b70e5543ed9af440b1aefef5ca => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:54.381566 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe805c2-b5f1-43d1-b5ea-42685b89c80b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:54.382184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe805c2-b5f1-43d1-b5ea-42685b89c80b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:54.382809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe805c2-b5f1-43d1-b5ea-42685b89c80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:54.388701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dacb3bdf-77ff-4438-a63b-34ea610fd450 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12d94ae895c74ebba46b3e2f03c404fb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:54.389496 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dacb3bdf-77ff-4438-a63b-34ea610fd450 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12d94ae895c74ebba46b3e2f03c404fb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:54.445783 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2840/5719] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:22:54 2022] DELETE /identity/v3/users/12d94ae895c74ebba46b3e2f03c404fb => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:54.459266 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-cbe805c2-b5f1-43d1-b5ea-42685b89c80b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:54.459875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839f781-1112-4c10-be4d-6a9f55d24c4f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:54.460895 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-cbe805c2-b5f1-43d1-b5ea-42685b89c80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:54.461403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839f781-1112-4c10-be4d-6a9f55d24c4f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:54.461963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839f781-1112-4c10-be4d-6a9f55d24c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:54.508754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-9839f781-1112-4c10-be4d-6a9f55d24c4f None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:54.510801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9839f781-1112-4c10-be4d-6a9f55d24c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:54.577750 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2880/5720] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:54.607083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe805c2-b5f1-43d1-b5ea-42685b89c80b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:54.609096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-cbe805c2-b5f1-43d1-b5ea-42685b89c80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:54.621047 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:54.686503 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2841/5721] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:54.705978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839f781-1112-4c10-be4d-6a9f55d24c4f None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:54.709292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9839f781-1112-4c10-be4d-6a9f55d24c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:54.738675 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe805c2-b5f1-43d1-b5ea-42685b89c80b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:54.756546 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884639b9-644c-44a4-a54c-3ffebc743a04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:54.757286 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884639b9-644c-44a4-a54c-3ffebc743a04 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:54.757912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884639b9-644c-44a4-a54c-3ffebc743a04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:54.757912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884639b9-644c-44a4-a54c-3ffebc743a04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:54.777303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884639b9-644c-44a4-a54c-3ffebc743a04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:54.778813 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884639b9-644c-44a4-a54c-3ffebc743a04 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:54.794366 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2881/5722] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:22:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:22:54.826344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf0bc0-8beb-44a6-91d9-b3914d66aa69 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:54.826624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf0bc0-8beb-44a6-91d9-b3914d66aa69 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:54.826906 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf0bc0-8beb-44a6-91d9-b3914d66aa69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:54.859660 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:54.875516 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-01bf0bc0-8beb-44a6-91d9-b3914d66aa69 None None] MFA Rules not processed for user `551702ce15ec4969adc5affe33f29ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:54.876763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-01bf0bc0-8beb-44a6-91d9-b3914d66aa69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:54.896919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839f781-1112-4c10-be4d-6a9f55d24c4f None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:54.905126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5df6d5-5afb-4721-a9c3-6ad040e92252 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:54.906393 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5df6d5-5afb-4721-a9c3-6ad040e92252 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:54.906910 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5df6d5-5afb-4721-a9c3-6ad040e92252 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:54.907411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5df6d5-5afb-4721-a9c3-6ad040e92252 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:54.919552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5df6d5-5afb-4721-a9c3-6ad040e92252 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:54.921924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5df6d5-5afb-4721-a9c3-6ad040e92252 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:54.944684 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2842/5723] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:22:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:22:55.035458 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2882/5724] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:54 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:55.037601 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5df6d5-5afb-4721-a9c3-6ad040e92252 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:55.040226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-eb5df6d5-5afb-4721-a9c3-6ad040e92252 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:55.070736 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5df6d5-5afb-4721-a9c3-6ad040e92252 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:55.084165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79fad7-9581-4278-a1c7-7297505b86bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:55.086652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79fad7-9581-4278-a1c7-7297505b86bd admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:55.090275 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79fad7-9581-4278-a1c7-7297505b86bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:55.090901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79fad7-9581-4278-a1c7-7297505b86bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:55.092006 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79fad7-9581-4278-a1c7-7297505b86bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:55.094262 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79fad7-9581-4278-a1c7-7297505b86bd admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:55.159954 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2843/5725] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:22:55 2022] POST /identity/v3/projects => generated 405 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:22:55.164251 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf0bc0-8beb-44a6-91d9-b3914d66aa69 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:55.181819 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf0bc0-8beb-44a6-91d9-b3914d66aa69 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:55.190906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79fad7-9581-4278-a1c7-7297505b86bd admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:55.193905 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-fc79fad7-9581-4278-a1c7-7297505b86bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:55.334389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41124486-b4b6-41f9-bfba-440c0d1190f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:55.335364 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41124486-b4b6-41f9-bfba-440c0d1190f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:55.338213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41124486-b4b6-41f9-bfba-440c0d1190f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:55.338494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41124486-b4b6-41f9-bfba-440c0d1190f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:55.341062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41124486-b4b6-41f9-bfba-440c0d1190f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:55.343848 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41124486-b4b6-41f9-bfba-440c0d1190f7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:55.345944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79fad7-9581-4278-a1c7-7297505b86bd admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:55.355814 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd72937-743e-408f-a501-77b867392357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:55.371456 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd72937-743e-408f-a501-77b867392357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:55.373571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd72937-743e-408f-a501-77b867392357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:55.374087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd72937-743e-408f-a501-77b867392357 admin admin] PATH_INFO: `/v3/users/ffecd714d4dc4c05a908dd59d7ba912c` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:55.378026 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd72937-743e-408f-a501-77b867392357 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffecd714d4dc4c05a908dd59d7ba912c)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:55.381135 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd72937-743e-408f-a501-77b867392357 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:55.399025 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2883/5726] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:22:55 2022] POST /identity/v3/users => generated 303 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:55.401812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41124486-b4b6-41f9-bfba-440c0d1190f7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:55.420217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41124486-b4b6-41f9-bfba-440c0d1190f7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:55.426093 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e8125-7d32-47a6-95e5-bd9c6de296e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:55.427465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e8125-7d32-47a6-95e5-bd9c6de296e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:55.427791 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e8125-7d32-47a6-95e5-bd9c6de296e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:55.428030 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e8125-7d32-47a6-95e5-bd9c6de296e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:55.428731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e8125-7d32-47a6-95e5-bd9c6de296e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:55.430664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e8125-7d32-47a6-95e5-bd9c6de296e1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:55.452719 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2884/5727] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:55.453794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e8125-7d32-47a6-95e5-bd9c6de296e1 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:55.466497 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e8125-7d32-47a6-95e5-bd9c6de296e1 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:55.473507 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67f2e6-982e-4f28-9300-1f5dd9317094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:55.474186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67f2e6-982e-4f28-9300-1f5dd9317094 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:55.474476 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67f2e6-982e-4f28-9300-1f5dd9317094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:55.474755 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67f2e6-982e-4f28-9300-1f5dd9317094 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:55.475409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e67f2e6-982e-4f28-9300-1f5dd9317094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:55.477317 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e67f2e6-982e-4f28-9300-1f5dd9317094 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:55.491897 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2885/5728] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:55.496405 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67f2e6-982e-4f28-9300-1f5dd9317094 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:55.511189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67f2e6-982e-4f28-9300-1f5dd9317094 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:55.528578 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39fed23-34eb-46d1-936f-8fd113022e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:55.530438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fed23-34eb-46d1-936f-8fd113022e00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:55.530769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fed23-34eb-46d1-936f-8fd113022e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:55.531016 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fed23-34eb-46d1-936f-8fd113022e00 admin admin] PATH_INFO: `/v3/projects/2fedbaf2968d48619ae6db9108523f56/users/d353ffb7bcc348f3b70c2960c5195b98/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:55.557899 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ffd72937-743e-408f-a501-77b867392357 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffecd714d4dc4c05a908dd59d7ba912c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:55.558664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ffd72937-743e-408f-a501-77b867392357 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffecd714d4dc4c05a908dd59d7ba912c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:55.558959 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39fed23-34eb-46d1-936f-8fd113022e00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fedbaf2968d48619ae6db9108523f56, user_id=d353ffb7bcc348f3b70c2960c5195b98, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:55.564562 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39fed23-34eb-46d1-936f-8fd113022e00 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:55.575543 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ffd72937-743e-408f-a501-77b867392357 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffecd714d4dc4c05a908dd59d7ba912c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:55.589936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ffd72937-743e-408f-a501-77b867392357 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffecd714d4dc4c05a908dd59d7ba912c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:55.591039 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ffd72937-743e-408f-a501-77b867392357 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffecd714d4dc4c05a908dd59d7ba912c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:55.595652 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2886/5729] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:22:55 2022] PUT /identity/v3/projects/2fedbaf2968d48619ae6db9108523f56/users/d353ffb7bcc348f3b70c2960c5195b98/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:55.601710 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:55.625973 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2844/5730] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:22:55 2022] DELETE /identity/v3/users/ffecd714d4dc4c05a908dd59d7ba912c => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:55.702568 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39fed23-34eb-46d1-936f-8fd113022e00 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:55.704441 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c39fed23-34eb-46d1-936f-8fd113022e00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:55.777772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd72937-743e-408f-a501-77b867392357 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:55.779332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ffd72937-743e-408f-a501-77b867392357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:55.807146 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:55.855260 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39fed23-34eb-46d1-936f-8fd113022e00 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:55.933059 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd72937-743e-408f-a501-77b867392357 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:55.946118 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b4568-2fcd-498e-81a0-9590e1042ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:55.949177 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b4568-2fcd-498e-81a0-9590e1042ebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:55.950704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b4568-2fcd-498e-81a0-9590e1042ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:55.951013 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b4568-2fcd-498e-81a0-9590e1042ebc admin admin] PATH_INFO: `/v3/projects/2534bf5e5c0c4d40b2deab2d5f0b0cb0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:55.957727 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b4568-2fcd-498e-81a0-9590e1042ebc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2534bf5e5c0c4d40b2deab2d5f0b0cb0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:55.971108 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b4568-2fcd-498e-81a0-9590e1042ebc admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:55.996191 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce1096-1d39-4c34-a432-5695ca6e7df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:55.997368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce1096-1d39-4c34-a432-5695ca6e7df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:55.997683 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce1096-1d39-4c34-a432-5695ca6e7df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:55.997962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce1096-1d39-4c34-a432-5695ca6e7df7 admin admin] PATH_INFO: `/v3/projects/7c41ad7dfbc0495895bc0461c9310940` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:55.999193 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce1096-1d39-4c34-a432-5695ca6e7df7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c41ad7dfbc0495895bc0461c9310940)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:56.001649 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce1096-1d39-4c34-a432-5695ca6e7df7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:56.085927 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-fa3b4568-2fcd-498e-81a0-9590e1042ebc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2534bf5e5c0c4d40b2deab2d5f0b0cb0', 'request_id': 'req-fa3b4568-2fcd-498e-81a0-9590e1042ebc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:56.099973 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-fa3b4568-2fcd-498e-81a0-9590e1042ebc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2534bf5e5c0c4d40b2deab2d5f0b0cb0', 'request_id': 'req-fa3b4568-2fcd-498e-81a0-9590e1042ebc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:56.117509 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-fa3b4568-2fcd-498e-81a0-9590e1042ebc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2534bf5e5c0c4d40b2deab2d5f0b0cb0', 'request_id': 'req-fa3b4568-2fcd-498e-81a0-9590e1042ebc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:56.121651 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-59ce1096-1d39-4c34-a432-5695ca6e7df7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c41ad7dfbc0495895bc0461c9310940', 'request_id': 'req-59ce1096-1d39-4c34-a432-5695ca6e7df7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:56.141125 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-59ce1096-1d39-4c34-a432-5695ca6e7df7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c41ad7dfbc0495895bc0461c9310940', 'request_id': 'req-59ce1096-1d39-4c34-a432-5695ca6e7df7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:56.142401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-fa3b4568-2fcd-498e-81a0-9590e1042ebc admin admin] The token cache is being invalidate because project 2534bf5e5c0c4d40b2deab2d5f0b0cb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:22:56.144197 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-fa3b4568-2fcd-498e-81a0-9590e1042ebc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:56.146593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-fa3b4568-2fcd-498e-81a0-9590e1042ebc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:56.149302 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-59ce1096-1d39-4c34-a432-5695ca6e7df7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c41ad7dfbc0495895bc0461c9310940', 'request_id': 'req-59ce1096-1d39-4c34-a432-5695ca6e7df7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:56.153842 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2845/5731] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:22:55 2022] DELETE /identity/v3/projects/2534bf5e5c0c4d40b2deab2d5f0b0cb0 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:56.155219 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b4568-2fcd-498e-81a0-9590e1042ebc admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:56.161668 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-fa3b4568-2fcd-498e-81a0-9590e1042ebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:56.171701 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-59ce1096-1d39-4c34-a432-5695ca6e7df7 admin admin] The token cache is being invalidate because project 7c41ad7dfbc0495895bc0461c9310940 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:22:56.174591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-59ce1096-1d39-4c34-a432-5695ca6e7df7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:56.177043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-59ce1096-1d39-4c34-a432-5695ca6e7df7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:56.180656 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2887/5732] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:22:55 2022] DELETE /identity/v3/projects/7c41ad7dfbc0495895bc0461c9310940 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:56.184792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce1096-1d39-4c34-a432-5695ca6e7df7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:56.187523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-59ce1096-1d39-4c34-a432-5695ca6e7df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:56.306431 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b4568-2fcd-498e-81a0-9590e1042ebc admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:56.326856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce1096-1d39-4c34-a432-5695ca6e7df7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:56.342251 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:56.344685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cd0d9-300b-4580-9a45-b9f27093c860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:56.345349 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cd0d9-300b-4580-9a45-b9f27093c860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:56.345655 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cd0d9-300b-4580-9a45-b9f27093c860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:56.345937 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cd0d9-300b-4580-9a45-b9f27093c860 admin admin] PATH_INFO: `/v3/users/7ec4e2b916174b01bc4a521187ac207f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:56.352176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52cd0d9-300b-4580-9a45-b9f27093c860 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ec4e2b916174b01bc4a521187ac207f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:56.354281 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52cd0d9-300b-4580-9a45-b9f27093c860 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:56.398562 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:56.412377 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffb579-4950-44c6-a56d-67bf3c3588c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:56.413620 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffb579-4950-44c6-a56d-67bf3c3588c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:56.413945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffb579-4950-44c6-a56d-67bf3c3588c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:56.414457 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffb579-4950-44c6-a56d-67bf3c3588c3 admin admin] PATH_INFO: `/v3/users/14b6d8ffc7404842a8bf4922dbd5eb89` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:56.417295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ffb579-4950-44c6-a56d-67bf3c3588c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14b6d8ffc7404842a8bf4922dbd5eb89)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:56.420003 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ffb579-4950-44c6-a56d-67bf3c3588c3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:56.458668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d52cd0d9-300b-4580-9a45-b9f27093c860 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ec4e2b916174b01bc4a521187ac207f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:56.461282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d52cd0d9-300b-4580-9a45-b9f27093c860 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ec4e2b916174b01bc4a521187ac207f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:56.473160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d52cd0d9-300b-4580-9a45-b9f27093c860 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ec4e2b916174b01bc4a521187ac207f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:56.503316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d52cd0d9-300b-4580-9a45-b9f27093c860 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ec4e2b916174b01bc4a521187ac207f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:56.504787 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d52cd0d9-300b-4580-9a45-b9f27093c860 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ec4e2b916174b01bc4a521187ac207f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:56.550142 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2888/5733] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:22:56 2022] DELETE /identity/v3/users/7ec4e2b916174b01bc4a521187ac207f => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:56.551301 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cd0d9-300b-4580-9a45-b9f27093c860 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:56.556195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d52cd0d9-300b-4580-9a45-b9f27093c860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:56.611459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-26ffb579-4950-44c6-a56d-67bf3c3588c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14b6d8ffc7404842a8bf4922dbd5eb89'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:56.613738 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-26ffb579-4950-44c6-a56d-67bf3c3588c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14b6d8ffc7404842a8bf4922dbd5eb89'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:56.637009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-26ffb579-4950-44c6-a56d-67bf3c3588c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14b6d8ffc7404842a8bf4922dbd5eb89'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:56.674399 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-26ffb579-4950-44c6-a56d-67bf3c3588c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14b6d8ffc7404842a8bf4922dbd5eb89'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:56.675872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-26ffb579-4950-44c6-a56d-67bf3c3588c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14b6d8ffc7404842a8bf4922dbd5eb89'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:56.720370 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2846/5734] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:22:56 2022] DELETE /identity/v3/users/14b6d8ffc7404842a8bf4922dbd5eb89 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:56.724267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cd0d9-300b-4580-9a45-b9f27093c860 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:56.834922 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83290371-d357-4190-b448-fcabd1b21f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:56.835799 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83290371-d357-4190-b448-fcabd1b21f92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:56.836310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83290371-d357-4190-b448-fcabd1b21f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:56.836659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83290371-d357-4190-b448-fcabd1b21f92 admin admin] PATH_INFO: `/v3/projects/21bb617ad8c047d2923ee668cf394370` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:56.838063 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83290371-d357-4190-b448-fcabd1b21f92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21bb617ad8c047d2923ee668cf394370)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:56.840077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83290371-d357-4190-b448-fcabd1b21f92 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:56.939509 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:56.941756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-83290371-d357-4190-b448-fcabd1b21f92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21bb617ad8c047d2923ee668cf394370', 'request_id': 'req-83290371-d357-4190-b448-fcabd1b21f92'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:56.961150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-83290371-d357-4190-b448-fcabd1b21f92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21bb617ad8c047d2923ee668cf394370', 'request_id': 'req-83290371-d357-4190-b448-fcabd1b21f92'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:56.973017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-83290371-d357-4190-b448-fcabd1b21f92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21bb617ad8c047d2923ee668cf394370', 'request_id': 'req-83290371-d357-4190-b448-fcabd1b21f92'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:56.997271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-83290371-d357-4190-b448-fcabd1b21f92 admin admin] The token cache is being invalidate because project 21bb617ad8c047d2923ee668cf394370 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:22:56.997617 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-83290371-d357-4190-b448-fcabd1b21f92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:56.998293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-83290371-d357-4190-b448-fcabd1b21f92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:57.000272 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2889/5735] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:22:56 2022] DELETE /identity/v3/projects/21bb617ad8c047d2923ee668cf394370 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:57.006550 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfac23c-bcec-4433-b919-56453c7659f4 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:57.006915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfac23c-bcec-4433-b919-56453c7659f4 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:57.007252 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfac23c-bcec-4433-b919-56453c7659f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:57.036336 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-edfac23c-bcec-4433-b919-56453c7659f4 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:57.037849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-edfac23c-bcec-4433-b919-56453c7659f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:57.243391 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2847/5736] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:57.251923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbdd5c-6ee5-4ed5-8103-b537c198b52a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:57.252375 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbdd5c-6ee5-4ed5-8103-b537c198b52a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:57.255827 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbdd5c-6ee5-4ed5-8103-b537c198b52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:57.294440 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ffdbdd5c-6ee5-4ed5-8103-b537c198b52a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:57.295790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ffdbdd5c-6ee5-4ed5-8103-b537c198b52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:57.310005 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2890/5737] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:57.312883 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfac23c-bcec-4433-b919-56453c7659f4 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:57.339491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfac23c-bcec-4433-b919-56453c7659f4 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:57.345843 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3478a18-2164-4be1-b197-732f342d1782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:57.346618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3478a18-2164-4be1-b197-732f342d1782 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:57.347035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3478a18-2164-4be1-b197-732f342d1782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:57.347389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3478a18-2164-4be1-b197-732f342d1782 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:57.348150 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3478a18-2164-4be1-b197-732f342d1782 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:22:57.349111 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3478a18-2164-4be1-b197-732f342d1782 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:57.351066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3478a18-2164-4be1-b197-732f342d1782 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:57.394421 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2848/5738] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:22:57.394881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdbdd5c-6ee5-4ed5-8103-b537c198b52a None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:57.407542 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdbdd5c-6ee5-4ed5-8103-b537c198b52a None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:57.415265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049654d-c5b3-444b-b432-ed4cb5e12664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:57.416328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049654d-c5b3-444b-b432-ed4cb5e12664 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:57.416840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049654d-c5b3-444b-b432-ed4cb5e12664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:57.417527 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049654d-c5b3-444b-b432-ed4cb5e12664 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:57.418427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2049654d-c5b3-444b-b432-ed4cb5e12664 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:57.421810 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2049654d-c5b3-444b-b432-ed4cb5e12664 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:57.475641 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2891/5739] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:22:57 2022] POST /identity/v3/projects => generated 393 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:57.476999 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3478a18-2164-4be1-b197-732f342d1782 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:57.494829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3478a18-2164-4be1-b197-732f342d1782 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:57.541149 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:57.596449 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02784446-6167-4c3f-b5f2-f4583698a233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:57.597142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02784446-6167-4c3f-b5f2-f4583698a233 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:57.597649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02784446-6167-4c3f-b5f2-f4583698a233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:57.597985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02784446-6167-4c3f-b5f2-f4583698a233 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:57.598923 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02784446-6167-4c3f-b5f2-f4583698a233 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:57.601579 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02784446-6167-4c3f-b5f2-f4583698a233 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:57.634444 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2849/5740] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:22:57 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:57.638598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049654d-c5b3-444b-b432-ed4cb5e12664 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:57.651478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049654d-c5b3-444b-b432-ed4cb5e12664 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:57.656483 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dcf55f-d85e-4895-85be-13c79a89a290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:57.657097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dcf55f-d85e-4895-85be-13c79a89a290 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:57.657388 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dcf55f-d85e-4895-85be-13c79a89a290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:57.657682 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dcf55f-d85e-4895-85be-13c79a89a290 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:57.658321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dcf55f-d85e-4895-85be-13c79a89a290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:57.659948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dcf55f-d85e-4895-85be-13c79a89a290 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:57.674582 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2892/5741] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:22:57.678494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02784446-6167-4c3f-b5f2-f4583698a233 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:57.691223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02784446-6167-4c3f-b5f2-f4583698a233 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:57.700272 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f022f-809a-4b5f-96fc-60d436ca72d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:57.700915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f022f-809a-4b5f-96fc-60d436ca72d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:57.701207 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f022f-809a-4b5f-96fc-60d436ca72d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:57.701518 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f022f-809a-4b5f-96fc-60d436ca72d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:57.702170 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f022f-809a-4b5f-96fc-60d436ca72d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:57.704433 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f022f-809a-4b5f-96fc-60d436ca72d1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:57.717305 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2850/5742] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:57.721251 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dcf55f-d85e-4895-85be-13c79a89a290 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:57.745049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dcf55f-d85e-4895-85be-13c79a89a290 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:57.750434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62daa520-29d8-4cfe-bfb7-d11a5b67e6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:57.751244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62daa520-29d8-4cfe-bfb7-d11a5b67e6cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:57.751761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62daa520-29d8-4cfe-bfb7-d11a5b67e6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:57.752135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62daa520-29d8-4cfe-bfb7-d11a5b67e6cf admin admin] PATH_INFO: `/v3/projects/51c180d4274946dc8e40eb3b09f8dc3f/users/bfd3e634551940cea7c8e492c7d8b79b/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:57.764895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f022f-809a-4b5f-96fc-60d436ca72d1 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:57.769245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ce4f022f-809a-4b5f-96fc-60d436ca72d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:57.771206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62daa520-29d8-4cfe-bfb7-d11a5b67e6cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=51c180d4274946dc8e40eb3b09f8dc3f, user_id=bfd3e634551940cea7c8e492c7d8b79b, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:57.773998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62daa520-29d8-4cfe-bfb7-d11a5b67e6cf admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:57.790925 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f022f-809a-4b5f-96fc-60d436ca72d1 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:57.800016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a60bc-9b93-4003-95ce-d7fd752d9692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:57.800669 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2893/5743] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:22:57 2022] PUT /identity/v3/projects/51c180d4274946dc8e40eb3b09f8dc3f/users/bfd3e634551940cea7c8e492c7d8b79b/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:57.802384 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a60bc-9b93-4003-95ce-d7fd752d9692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:57.802924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a60bc-9b93-4003-95ce-d7fd752d9692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:57.803415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a60bc-9b93-4003-95ce-d7fd752d9692 admin admin] PATH_INFO: `/v3/projects/e76cbf853de5408d83dbb3fbe5d811ea` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:57.805590 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9a60bc-9b93-4003-95ce-d7fd752d9692 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e76cbf853de5408d83dbb3fbe5d811ea)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:57.806085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b017e2-2e48-4aa4-9586-8849a58f1ead None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:57.806529 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b017e2-2e48-4aa4-9586-8849a58f1ead None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:57.806916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b017e2-2e48-4aa4-9586-8849a58f1ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:57.810348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9a60bc-9b93-4003-95ce-d7fd752d9692 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:57.833781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c9b017e2-2e48-4aa4-9586-8849a58f1ead None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:57.835149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c9b017e2-2e48-4aa4-9586-8849a58f1ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:57.899275 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ca9a60bc-9b93-4003-95ce-d7fd752d9692 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e76cbf853de5408d83dbb3fbe5d811ea', 'request_id': 'req-ca9a60bc-9b93-4003-95ce-d7fd752d9692'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:57.910223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ca9a60bc-9b93-4003-95ce-d7fd752d9692 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e76cbf853de5408d83dbb3fbe5d811ea', 'request_id': 'req-ca9a60bc-9b93-4003-95ce-d7fd752d9692'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:57.924135 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ca9a60bc-9b93-4003-95ce-d7fd752d9692 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e76cbf853de5408d83dbb3fbe5d811ea', 'request_id': 'req-ca9a60bc-9b93-4003-95ce-d7fd752d9692'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:57.949090 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2894/5744] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:57.950745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b017e2-2e48-4aa4-9586-8849a58f1ead None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:57.953298 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c9b017e2-2e48-4aa4-9586-8849a58f1ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:57.957211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ca9a60bc-9b93-4003-95ce-d7fd752d9692 admin admin] The token cache is being invalidate because project e76cbf853de5408d83dbb3fbe5d811ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:22:57.957619 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ca9a60bc-9b93-4003-95ce-d7fd752d9692 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:57.958524 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ca9a60bc-9b93-4003-95ce-d7fd752d9692 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:57.960721 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2851/5745] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:22:57 2022] DELETE /identity/v3/projects/e76cbf853de5408d83dbb3fbe5d811ea => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:22:57.961690 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a60bc-9b93-4003-95ce-d7fd752d9692 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:57.963575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ca9a60bc-9b93-4003-95ce-d7fd752d9692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:57.969720 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b017e2-2e48-4aa4-9586-8849a58f1ead None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:58.049267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df08193-7b0c-40cd-bb08-b4fecb7a2fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:58.050332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df08193-7b0c-40cd-bb08-b4fecb7a2fd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:58.050712 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df08193-7b0c-40cd-bb08-b4fecb7a2fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:58.051192 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df08193-7b0c-40cd-bb08-b4fecb7a2fd2 admin admin] PATH_INFO: `/v3/projects/915c368288974922a488cb5858b2e990` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:58.053061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df08193-7b0c-40cd-bb08-b4fecb7a2fd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=915c368288974922a488cb5858b2e990)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:58.055213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df08193-7b0c-40cd-bb08-b4fecb7a2fd2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:58.064351 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a60bc-9b93-4003-95ce-d7fd752d9692 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:58.077573 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:58.079691 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272c940-3728-4205-bd1f-b71ede1a1d6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:58.080537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272c940-3728-4205-bd1f-b71ede1a1d6c service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:58.081038 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272c940-3728-4205-bd1f-b71ede1a1d6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:58.081293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272c940-3728-4205-bd1f-b71ede1a1d6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:58.083585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c272c940-3728-4205-bd1f-b71ede1a1d6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:58.100591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c272c940-3728-4205-bd1f-b71ede1a1d6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:58.102817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c272c940-3728-4205-bd1f-b71ede1a1d6c service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:58.127714 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2852/5746] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:22:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:22:58.132154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179fda0-3cba-45c1-a9e7-c3a91bb49e04 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:58.133050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179fda0-3cba-45c1-a9e7-c3a91bb49e04 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:58.133381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179fda0-3cba-45c1-a9e7-c3a91bb49e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:58.139128 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8df08193-7b0c-40cd-bb08-b4fecb7a2fd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '915c368288974922a488cb5858b2e990', 'request_id': 'req-8df08193-7b0c-40cd-bb08-b4fecb7a2fd2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:58.160729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8df08193-7b0c-40cd-bb08-b4fecb7a2fd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '915c368288974922a488cb5858b2e990', 'request_id': 'req-8df08193-7b0c-40cd-bb08-b4fecb7a2fd2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:58.170362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8df08193-7b0c-40cd-bb08-b4fecb7a2fd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '915c368288974922a488cb5858b2e990', 'request_id': 'req-8df08193-7b0c-40cd-bb08-b4fecb7a2fd2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:58.200365 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8df08193-7b0c-40cd-bb08-b4fecb7a2fd2 admin admin] The token cache is being invalidate because project 915c368288974922a488cb5858b2e990 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:22:58.200840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8df08193-7b0c-40cd-bb08-b4fecb7a2fd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:58.201773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8df08193-7b0c-40cd-bb08-b4fecb7a2fd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:22:58.206133 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2895/5747] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:22:57 2022] DELETE /identity/v3/projects/915c368288974922a488cb5858b2e990 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:58.211572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608068e-230c-47d9-9669-b4c81b1950c6 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:58.211889 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-8179fda0-3cba-45c1-a9e7-c3a91bb49e04 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:58.212051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608068e-230c-47d9-9669-b4c81b1950c6 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:58.212422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608068e-230c-47d9-9669-b4c81b1950c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:58.213860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8179fda0-3cba-45c1-a9e7-c3a91bb49e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:58.261631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-8608068e-230c-47d9-9669-b4c81b1950c6 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:58.263327 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8608068e-230c-47d9-9669-b4c81b1950c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:58.331164 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:58.461445 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2853/5748] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:58.462938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839f90a-a67b-4c90-ace4-2b6159a0d804 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:58.463230 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839f90a-a67b-4c90-ace4-2b6159a0d804 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:58.463505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839f90a-a67b-4c90-ace4-2b6159a0d804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:58.474501 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2896/5749] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:58.484293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872348b-6af8-46f3-821f-e7b75e3a8a3f None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:58.496126 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872348b-6af8-46f3-821f-e7b75e3a8a3f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:58.496602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872348b-6af8-46f3-821f-e7b75e3a8a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:58.557281 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c839f90a-a67b-4c90-ace4-2b6159a0d804 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:58.562083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c839f90a-a67b-4c90-ace4-2b6159a0d804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:58.574036 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c872348b-6af8-46f3-821f-e7b75e3a8a3f None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:58.580366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c872348b-6af8-46f3-821f-e7b75e3a8a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:58.581171 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2854/5750] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:58.586393 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839f90a-a67b-4c90-ace4-2b6159a0d804 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:58.596968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839f90a-a67b-4c90-ace4-2b6159a0d804 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:58.605942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea5140-89d5-4406-ae61-3b20d9ed563b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:58.606592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea5140-89d5-4406-ae61-3b20d9ed563b admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:58.606861 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea5140-89d5-4406-ae61-3b20d9ed563b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:58.607132 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea5140-89d5-4406-ae61-3b20d9ed563b admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:58.607797 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea5140-89d5-4406-ae61-3b20d9ed563b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:22:58.608102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea5140-89d5-4406-ae61-3b20d9ed563b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:58.620415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea5140-89d5-4406-ae61-3b20d9ed563b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:58.620523 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2897/5751] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:22:58.621682 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872348b-6af8-46f3-821f-e7b75e3a8a3f None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:58.640273 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872348b-6af8-46f3-821f-e7b75e3a8a3f None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:58.651896 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2855/5752] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:22:58.652821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea5140-89d5-4406-ae61-3b20d9ed563b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:58.659699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c06567-d363-4525-9f66-471818d3485f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:58.660457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c06567-d363-4525-9f66-471818d3485f admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:58.664468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c06567-d363-4525-9f66-471818d3485f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:58.665006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c06567-d363-4525-9f66-471818d3485f admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:58.666888 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c06567-d363-4525-9f66-471818d3485f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:22:58.667108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c06567-d363-4525-9f66-471818d3485f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:58.670551 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c06567-d363-4525-9f66-471818d3485f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:58.682098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea5140-89d5-4406-ae61-3b20d9ed563b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:58.694901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053a36a-2bda-45bb-8ee9-d36336174d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:58.695536 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053a36a-2bda-45bb-8ee9-d36336174d84 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:58.695816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053a36a-2bda-45bb-8ee9-d36336174d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:58.696214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053a36a-2bda-45bb-8ee9-d36336174d84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:58.696867 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4053a36a-2bda-45bb-8ee9-d36336174d84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:58.699488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4053a36a-2bda-45bb-8ee9-d36336174d84 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:58.709903 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2898/5753] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:22:58.713873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c06567-d363-4525-9f66-471818d3485f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:58.727387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c06567-d363-4525-9f66-471818d3485f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:58.733705 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc84c0-7e13-4e1c-96e0-ba6b89dfef16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:58.734353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc84c0-7e13-4e1c-96e0-ba6b89dfef16 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:58.734639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc84c0-7e13-4e1c-96e0-ba6b89dfef16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:58.735356 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc84c0-7e13-4e1c-96e0-ba6b89dfef16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:58.736467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc84c0-7e13-4e1c-96e0-ba6b89dfef16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:58.739821 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc84c0-7e13-4e1c-96e0-ba6b89dfef16 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:58.792278 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2856/5754] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:22:58 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:58.793204 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053a36a-2bda-45bb-8ee9-d36336174d84 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:58.804523 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2899/5755] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:22:58 2022] POST /identity/v3/projects => generated 391 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:58.806198 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc84c0-7e13-4e1c-96e0-ba6b89dfef16 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:58.961879 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053a36a-2bda-45bb-8ee9-d36336174d84 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:59.002345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0986d7d-0772-4d64-b4fd-ad19fc239f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:59.003045 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0986d7d-0772-4d64-b4fd-ad19fc239f3f admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:59.003335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0986d7d-0772-4d64-b4fd-ad19fc239f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:59.003649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0986d7d-0772-4d64-b4fd-ad19fc239f3f admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:59.004354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0986d7d-0772-4d64-b4fd-ad19fc239f3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:59.007056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0986d7d-0772-4d64-b4fd-ad19fc239f3f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:59.015776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc84c0-7e13-4e1c-96e0-ba6b89dfef16 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:59.036514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36021f-7415-4cd2-a6d3-f997f29c378c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:59.040213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36021f-7415-4cd2-a6d3-f997f29c378c admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:59.041908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36021f-7415-4cd2-a6d3-f997f29c378c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:59.045866 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2857/5756] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:22:58 2022] POST /identity/v3/users => generated 287 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:59.047341 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36021f-7415-4cd2-a6d3-f997f29c378c admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:59.048215 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36021f-7415-4cd2-a6d3-f997f29c378c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:59.049681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0986d7d-0772-4d64-b4fd-ad19fc239f3f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:59.051745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36021f-7415-4cd2-a6d3-f997f29c378c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:59.074548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0986d7d-0772-4d64-b4fd-ad19fc239f3f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:59.085295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def87612-c75c-4549-958b-82773d51dc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:59.086168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def87612-c75c-4549-958b-82773d51dc1c admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:59.087152 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def87612-c75c-4549-958b-82773d51dc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:59.087512 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def87612-c75c-4549-958b-82773d51dc1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:59.088177 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def87612-c75c-4549-958b-82773d51dc1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:59.089985 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:59.091699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def87612-c75c-4549-958b-82773d51dc1c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:59.117768 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2858/5757] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:59.123937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def87612-c75c-4549-958b-82773d51dc1c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:59.130264 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2900/5758] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:22:58 2022] POST /identity/v3/users => generated 296 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:22:59.138992 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36021f-7415-4cd2-a6d3-f997f29c378c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:59.159406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def87612-c75c-4549-958b-82773d51dc1c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:59.161234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36021f-7415-4cd2-a6d3-f997f29c378c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:59.166772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05b229-967f-417f-bac8-1279329bdf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:59.167405 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05b229-967f-417f-bac8-1279329bdf8f admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:59.167686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05b229-967f-417f-bac8-1279329bdf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:59.167958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05b229-967f-417f-bac8-1279329bdf8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:59.170721 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe05b229-967f-417f-bac8-1279329bdf8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:59.177902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe05b229-967f-417f-bac8-1279329bdf8f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:59.178596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20348b-0bb2-46ce-89c8-fa6d5698be1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:59.179224 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20348b-0bb2-46ce-89c8-fa6d5698be1b admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:59.179684 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20348b-0bb2-46ce-89c8-fa6d5698be1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:59.179816 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20348b-0bb2-46ce-89c8-fa6d5698be1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:59.180418 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20348b-0bb2-46ce-89c8-fa6d5698be1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:59.182094 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20348b-0bb2-46ce-89c8-fa6d5698be1b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:59.204848 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2901/5759] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:22:59.206037 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20348b-0bb2-46ce-89c8-fa6d5698be1b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:59.210087 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2859/5760] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:22:59.214307 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05b229-967f-417f-bac8-1279329bdf8f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:59.231542 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20348b-0bb2-46ce-89c8-fa6d5698be1b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:59.238115 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05b229-967f-417f-bac8-1279329bdf8f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:59.243951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9408f-f338-4563-b2e1-b1ed235df9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:59.244650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9408f-f338-4563-b2e1-b1ed235df9fe admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:59.244935 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9408f-f338-4563-b2e1-b1ed235df9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:59.245207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9408f-f338-4563-b2e1-b1ed235df9fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:59.246597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9408f-f338-4563-b2e1-b1ed235df9fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:59.248608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9408f-f338-4563-b2e1-b1ed235df9fe admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:59.251938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd7882-8c9a-412e-a687-c79fcc471a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:59.252599 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd7882-8c9a-412e-a687-c79fcc471a69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:59.252910 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd7882-8c9a-412e-a687-c79fcc471a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:59.253180 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd7882-8c9a-412e-a687-c79fcc471a69 admin admin] PATH_INFO: `/v3/projects/5b87ba6c4ecf4a59b9f3cd9b5d61b36a/users/7210e9a1826a42d7bfd28ac00af106d0/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:59.301243 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2902/5761] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:22:59.305867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9408f-f338-4563-b2e1-b1ed235df9fe admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:59.332332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9408f-f338-4563-b2e1-b1ed235df9fe admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:59.337091 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd7882-8c9a-412e-a687-c79fcc471a69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b87ba6c4ecf4a59b9f3cd9b5d61b36a, user_id=7210e9a1826a42d7bfd28ac00af106d0, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:59.350183 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd7882-8c9a-412e-a687-c79fcc471a69 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:59.362018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc88c3-4ddc-4970-97bc-c70e72287154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:59.362675 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc88c3-4ddc-4970-97bc-c70e72287154 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:59.362955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc88c3-4ddc-4970-97bc-c70e72287154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:59.363228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc88c3-4ddc-4970-97bc-c70e72287154 admin admin] PATH_INFO: `/v3/projects/e4e8ca561de2480da8f2abef9f90f12b/users/3dd0a849bc9c4538836f54fb9763f64d/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:59.404862 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2860/5762] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:22:59 2022] PUT /identity/v3/projects/5b87ba6c4ecf4a59b9f3cd9b5d61b36a/users/7210e9a1826a42d7bfd28ac00af106d0/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:22:59.418283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d48f9-07be-4fa3-8036-cf4655d93986 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:59.418576 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d48f9-07be-4fa3-8036-cf4655d93986 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:59.418855 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d48f9-07be-4fa3-8036-cf4655d93986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:59.432414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc88c3-4ddc-4970-97bc-c70e72287154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4e8ca561de2480da8f2abef9f90f12b, user_id=3dd0a849bc9c4538836f54fb9763f64d, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:59.437797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc88c3-4ddc-4970-97bc-c70e72287154 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:59.467115 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2903/5763] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:22:59 2022] PUT /identity/v3/projects/e4e8ca561de2480da8f2abef9f90f12b/users/3dd0a849bc9c4538836f54fb9763f64d/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:22:59.478026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff7e28-69ef-4560-ab3d-06b700362d37 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:59.478321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff7e28-69ef-4560-ab3d-06b700362d37 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:59.479236 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff7e28-69ef-4560-ab3d-06b700362d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:59.493012 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-6f5d48f9-07be-4fa3-8036-cf4655d93986 None None] MFA Rules not processed for user `7210e9a1826a42d7bfd28ac00af106d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:59.496188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6f5d48f9-07be-4fa3-8036-cf4655d93986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:59.583238 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-daff7e28-69ef-4560-ab3d-06b700362d37 None None] MFA Rules not processed for user `3dd0a849bc9c4538836f54fb9763f64d`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:22:59.584493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-daff7e28-69ef-4560-ab3d-06b700362d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:59.650107 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:59.777479 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2861/5764] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:59.781880 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d48f9-07be-4fa3-8036-cf4655d93986 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:59.797623 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2904/5765] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:22:59 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:22:59.822676 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff7e28-69ef-4560-ab3d-06b700362d37 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:22:59.842454 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-daff7e28-69ef-4560-ab3d-06b700362d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:22:59.969165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff7e28-69ef-4560-ab3d-06b700362d37 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:59.975449 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b4890-2ed8-40e9-86b5-513daea34463 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:59.976284 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d48f9-07be-4fa3-8036-cf4655d93986 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:22:59.978988 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b4890-2ed8-40e9-86b5-513daea34463 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:59.979580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b4890-2ed8-40e9-86b5-513daea34463 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:59.980227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b4890-2ed8-40e9-86b5-513daea34463 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:59.983235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec442e35-bd98-4695-99ae-ad122859ac94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:22:59.984012 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec442e35-bd98-4695-99ae-ad122859ac94 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:22:59.984325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec442e35-bd98-4695-99ae-ad122859ac94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:22:59.984685 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec442e35-bd98-4695-99ae-ad122859ac94 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:22:59.985555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec442e35-bd98-4695-99ae-ad122859ac94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:22:59.987824 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec442e35-bd98-4695-99ae-ad122859ac94 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:22:59.998737 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b4890-2ed8-40e9-86b5-513daea34463 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:00.002114 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b4890-2ed8-40e9-86b5-513daea34463 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:00.016809 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2905/5766] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:22:59 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:23:00.065318 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2862/5767] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:22:59 2022] POST /identity/v3/projects => generated 371 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:23:00.067626 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b4890-2ed8-40e9-86b5-513daea34463 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:00.086037 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b4890-2ed8-40e9-86b5-513daea34463 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:00.108235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec442e35-bd98-4695-99ae-ad122859ac94 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:00.208946 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:00.274079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec442e35-bd98-4695-99ae-ad122859ac94 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:00.275651 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cc66b-e4ad-4302-9fd5-65a775336815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:00.276355 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cc66b-e4ad-4302-9fd5-65a775336815 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:00.276768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cc66b-e4ad-4302-9fd5-65a775336815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:00.277653 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cc66b-e4ad-4302-9fd5-65a775336815 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:00.277880 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cc66b-e4ad-4302-9fd5-65a775336815 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:00.279723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee185a-8345-40f3-b317-7ac10cdfd7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:00.280654 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee185a-8345-40f3-b317-7ac10cdfd7b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:00.281006 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee185a-8345-40f3-b317-7ac10cdfd7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:00.281493 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee185a-8345-40f3-b317-7ac10cdfd7b0 admin admin] PATH_INFO: `/v3/users/3dd0a849bc9c4538836f54fb9763f64d` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:00.283235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee185a-8345-40f3-b317-7ac10cdfd7b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dd0a849bc9c4538836f54fb9763f64d)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:00.285485 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee185a-8345-40f3-b317-7ac10cdfd7b0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:00.287135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cc66b-e4ad-4302-9fd5-65a775336815 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:00.335144 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2906/5768] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:23:00 2022] POST /identity/v3/users => generated 292 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:23:00.339465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cc66b-e4ad-4302-9fd5-65a775336815 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:00.374920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cc66b-e4ad-4302-9fd5-65a775336815 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:00.389072 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02c63b-29f9-4777-be1a-3693033792a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:00.389762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02c63b-29f9-4777-be1a-3693033792a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:00.390040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02c63b-29f9-4777-be1a-3693033792a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:00.390308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02c63b-29f9-4777-be1a-3693033792a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:00.394552 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02c63b-29f9-4777-be1a-3693033792a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:00.395154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7eee185a-8345-40f3-b317-7ac10cdfd7b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dd0a849bc9c4538836f54fb9763f64d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:00.397959 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7eee185a-8345-40f3-b317-7ac10cdfd7b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dd0a849bc9c4538836f54fb9763f64d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:00.399197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02c63b-29f9-4777-be1a-3693033792a7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:00.414925 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:00.416312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7eee185a-8345-40f3-b317-7ac10cdfd7b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dd0a849bc9c4538836f54fb9763f64d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:00.434885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7eee185a-8345-40f3-b317-7ac10cdfd7b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dd0a849bc9c4538836f54fb9763f64d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:00.435857 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7eee185a-8345-40f3-b317-7ac10cdfd7b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dd0a849bc9c4538836f54fb9763f64d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:00.451436 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2907/5769] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:23:00.452443 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02c63b-29f9-4777-be1a-3693033792a7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:00.459579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3e02c63b-29f9-4777-be1a-3693033792a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:00.463558 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2863/5770] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:23:00 2022] DELETE /identity/v3/users/3dd0a849bc9c4538836f54fb9763f64d => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:00.468419 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c047fc9-c55a-43dc-a35f-fa4d27b946e4 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:00.468735 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c047fc9-c55a-43dc-a35f-fa4d27b946e4 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:00.469038 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c047fc9-c55a-43dc-a35f-fa4d27b946e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:00.525258 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02c63b-29f9-4777-be1a-3693033792a7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:00.535261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-2c047fc9-c55a-43dc-a35f-fa4d27b946e4 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:00.536890 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2c047fc9-c55a-43dc-a35f-fa4d27b946e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:00.688587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00bc58e-2ea9-46e7-9655-7ad07e424313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:00.689326 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bc58e-2ea9-46e7-9655-7ad07e424313 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:00.691150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bc58e-2ea9-46e7-9655-7ad07e424313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:00.691593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bc58e-2ea9-46e7-9655-7ad07e424313 admin admin] PATH_INFO: `/v3/projects/54232641553f470c97835e2069e17ecc/users/e0777068fc2444f09e154712d584cfe3/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:00.706072 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2864/5771] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:23:00.729265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00bc58e-2ea9-46e7-9655-7ad07e424313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54232641553f470c97835e2069e17ecc, user_id=e0777068fc2444f09e154712d584cfe3, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:00.730425 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c047fc9-c55a-43dc-a35f-fa4d27b946e4 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:00.731610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2c047fc9-c55a-43dc-a35f-fa4d27b946e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:00.742548 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00bc58e-2ea9-46e7-9655-7ad07e424313 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:00.779242 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2908/5772] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:23:00 2022] PUT /identity/v3/projects/54232641553f470c97835e2069e17ecc/users/e0777068fc2444f09e154712d584cfe3/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:00.783508 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00bc58e-2ea9-46e7-9655-7ad07e424313 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:00.888037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c047fc9-c55a-43dc-a35f-fa4d27b946e4 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:00.955462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00bc58e-2ea9-46e7-9655-7ad07e424313 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:00.966206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58298469-3175-4446-8b8f-94d6dc2b0f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:00.968621 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58298469-3175-4446-8b8f-94d6dc2b0f97 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:00.968976 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58298469-3175-4446-8b8f-94d6dc2b0f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:00.969324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58298469-3175-4446-8b8f-94d6dc2b0f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:00.970769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58298469-3175-4446-8b8f-94d6dc2b0f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:00.973707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58298469-3175-4446-8b8f-94d6dc2b0f97 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:01.013769 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2909/5773] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:23:01.016540 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58298469-3175-4446-8b8f-94d6dc2b0f97 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:01.038386 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b357b-5aaf-46a1-b04a-6597390d5f0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:01.039607 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b357b-5aaf-46a1-b04a-6597390d5f0b service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:01.040358 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58298469-3175-4446-8b8f-94d6dc2b0f97 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:01.040735 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b357b-5aaf-46a1-b04a-6597390d5f0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:01.041862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b357b-5aaf-46a1-b04a-6597390d5f0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:01.054574 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ae5de-7016-42a4-b081-7e5b527de217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:01.055352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ae5de-7016-42a4-b081-7e5b527de217 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:01.055707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ae5de-7016-42a4-b081-7e5b527de217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:01.056076 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ae5de-7016-42a4-b081-7e5b527de217 admin admin] PATH_INFO: `/v3/projects/54232641553f470c97835e2069e17ecc/users/e0777068fc2444f09e154712d584cfe3/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:01.059821 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ae5de-7016-42a4-b081-7e5b527de217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54232641553f470c97835e2069e17ecc, user_id=e0777068fc2444f09e154712d584cfe3, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:01.064130 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ae5de-7016-42a4-b081-7e5b527de217 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:01.065175 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b357b-5aaf-46a1-b04a-6597390d5f0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:01.066983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b357b-5aaf-46a1-b04a-6597390d5f0b service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:01.096696 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2865/5774] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:23:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:23:01.097139 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2910/5775] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:23:01 2022] PUT /identity/v3/projects/54232641553f470c97835e2069e17ecc/users/e0777068fc2444f09e154712d584cfe3/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:01.108974 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455d05a-ea03-4191-8905-41712d7847f8 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:01.112131 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455d05a-ea03-4191-8905-41712d7847f8 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:01.112433 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455d05a-ea03-4191-8905-41712d7847f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:01.148437 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-7455d05a-ea03-4191-8905-41712d7847f8 None None] MFA Rules not processed for user `e0777068fc2444f09e154712d584cfe3`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:01.149919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7455d05a-ea03-4191-8905-41712d7847f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:01.172855 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:01.260927 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2866/5776] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:23:01.275938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ae5de-7016-42a4-b081-7e5b527de217 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:01.279372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5a2ae5de-7016-42a4-b081-7e5b527de217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:01.379833 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:01.467211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ae5de-7016-42a4-b081-7e5b527de217 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:01.483728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80363a0-3997-4dc3-8e4d-2a9d8206c569 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:01.484304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80363a0-3997-4dc3-8e4d-2a9d8206c569 service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:01.484997 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80363a0-3997-4dc3-8e4d-2a9d8206c569 service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:01.484997 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80363a0-3997-4dc3-8e4d-2a9d8206c569 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:01.504827 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80363a0-3997-4dc3-8e4d-2a9d8206c569 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:01.506318 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80363a0-3997-4dc3-8e4d-2a9d8206c569 service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:01.533847 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2911/5777] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:23:01 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:23:02.251971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455d05a-ea03-4191-8905-41712d7847f8 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:02.415031 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455d05a-ea03-4191-8905-41712d7847f8 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:02.473521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443ad84-a713-4522-8742-295eabb60cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:02.473521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443ad84-a713-4522-8742-295eabb60cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:02.473521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443ad84-a713-4522-8742-295eabb60cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:02.473521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443ad84-a713-4522-8742-295eabb60cce admin admin] PATH_INFO: `/v3/users/7210e9a1826a42d7bfd28ac00af106d0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:02.474037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443ad84-a713-4522-8742-295eabb60cce admin admin] RBAC: Authorizing `identity:delete_user(user_id=7210e9a1826a42d7bfd28ac00af106d0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:02.474339 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443ad84-a713-4522-8742-295eabb60cce admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:02.561419 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80363a0-3997-4dc3-8e4d-2a9d8206c569 service cinder] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:02.563435 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a80363a0-3997-4dc3-8e4d-2a9d8206c569 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:02.587192 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80363a0-3997-4dc3-8e4d-2a9d8206c569 service cinder] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:02.601675 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc504998-bc58-4a2d-bb08-2a1dbc119102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:02.602596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc504998-bc58-4a2d-bb08-2a1dbc119102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:02.603063 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc504998-bc58-4a2d-bb08-2a1dbc119102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:02.603494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc504998-bc58-4a2d-bb08-2a1dbc119102 admin admin] PATH_INFO: `/v3/projects/e4e8ca561de2480da8f2abef9f90f12b` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:02.604870 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc504998-bc58-4a2d-bb08-2a1dbc119102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4e8ca561de2480da8f2abef9f90f12b)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:02.607232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc504998-bc58-4a2d-bb08-2a1dbc119102 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:02.625185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9443ad84-a713-4522-8742-295eabb60cce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7210e9a1826a42d7bfd28ac00af106d0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:02.628077 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9443ad84-a713-4522-8742-295eabb60cce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7210e9a1826a42d7bfd28ac00af106d0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:02.652955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9443ad84-a713-4522-8742-295eabb60cce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7210e9a1826a42d7bfd28ac00af106d0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:02.693111 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9443ad84-a713-4522-8742-295eabb60cce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7210e9a1826a42d7bfd28ac00af106d0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:02.693975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9443ad84-a713-4522-8742-295eabb60cce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7210e9a1826a42d7bfd28ac00af106d0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:02.712735 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bc504998-bc58-4a2d-bb08-2a1dbc119102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4e8ca561de2480da8f2abef9f90f12b', 'request_id': 'req-bc504998-bc58-4a2d-bb08-2a1dbc119102'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:02.731312 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bc504998-bc58-4a2d-bb08-2a1dbc119102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4e8ca561de2480da8f2abef9f90f12b', 'request_id': 'req-bc504998-bc58-4a2d-bb08-2a1dbc119102'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:02.739501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bc504998-bc58-4a2d-bb08-2a1dbc119102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4e8ca561de2480da8f2abef9f90f12b', 'request_id': 'req-bc504998-bc58-4a2d-bb08-2a1dbc119102'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:02.745088 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2867/5778] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:23:02 2022] DELETE /identity/v3/users/7210e9a1826a42d7bfd28ac00af106d0 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:02.772027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bc504998-bc58-4a2d-bb08-2a1dbc119102 admin admin] The token cache is being invalidate because project e4e8ca561de2480da8f2abef9f90f12b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:23:02.772273 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bc504998-bc58-4a2d-bb08-2a1dbc119102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:02.773409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bc504998-bc58-4a2d-bb08-2a1dbc119102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:02.779234 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2912/5779] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:23:02 2022] DELETE /identity/v3/projects/e4e8ca561de2480da8f2abef9f90f12b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:02.780814 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb79bb-201b-4c60-bff8-a592a0d3cac8 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:02.781098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb79bb-201b-4c60-bff8-a592a0d3cac8 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:02.781474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb79bb-201b-4c60-bff8-a592a0d3cac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:02.797414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020b702-9400-4329-9d72-eba07617b5cf None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:02.798336 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020b702-9400-4329-9d72-eba07617b5cf None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:02.798618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020b702-9400-4329-9d72-eba07617b5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:02.830789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-6cfb79bb-201b-4c60-bff8-a592a0d3cac8 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:02.832017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6cfb79bb-201b-4c60-bff8-a592a0d3cac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:02.844874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c020b702-9400-4329-9d72-eba07617b5cf None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:02.846268 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c020b702-9400-4329-9d72-eba07617b5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:02.912178 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:02.977222 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2868/5780] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:23:02.980676 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2913/5781] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:23:02.988516 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ec411-c628-473a-aac2-340a345f5270 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:02.989481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ec411-c628-473a-aac2-340a345f5270 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:02.989769 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ec411-c628-473a-aac2-340a345f5270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:03.013633 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-f28ec411-c628-473a-aac2-340a345f5270 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:03.014554 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f28ec411-c628-473a-aac2-340a345f5270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:03.034263 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2869/5782] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:23:03.037262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb79bb-201b-4c60-bff8-a592a0d3cac8 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:03.038843 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ec411-c628-473a-aac2-340a345f5270 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:03.040014 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6cfb79bb-201b-4c60-bff8-a592a0d3cac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:03.059128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ec411-c628-473a-aac2-340a345f5270 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:03.074980 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9a39b-fd77-4195-bc44-1a9dfd5e2e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:03.075549 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9a39b-fd77-4195-bc44-1a9dfd5e2e3e admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:03.075828 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9a39b-fd77-4195-bc44-1a9dfd5e2e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:03.080218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9a39b-fd77-4195-bc44-1a9dfd5e2e3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:03.081012 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9a39b-fd77-4195-bc44-1a9dfd5e2e3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:23:03.081330 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9a39b-fd77-4195-bc44-1a9dfd5e2e3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:03.092605 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9a39b-fd77-4195-bc44-1a9dfd5e2e3e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:03.125776 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2870/5783] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:23:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:23:03.126908 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9a39b-fd77-4195-bc44-1a9dfd5e2e3e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:03.148853 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9a39b-fd77-4195-bc44-1a9dfd5e2e3e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:03.154191 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:03.166729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d231bf-67cc-4ad5-acfb-7890367e50ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:03.167392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d231bf-67cc-4ad5-acfb-7890367e50ae admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:03.167703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d231bf-67cc-4ad5-acfb-7890367e50ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:03.168047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d231bf-67cc-4ad5-acfb-7890367e50ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:03.168786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d231bf-67cc-4ad5-acfb-7890367e50ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:03.171571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d231bf-67cc-4ad5-acfb-7890367e50ae admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:03.183491 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb79bb-201b-4c60-bff8-a592a0d3cac8 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:03.194078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149af2fb-82e4-4863-b254-ef8ba5a6bf0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:03.195778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149af2fb-82e4-4863-b254-ef8ba5a6bf0f service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:03.196396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149af2fb-82e4-4863-b254-ef8ba5a6bf0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:03.196820 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149af2fb-82e4-4863-b254-ef8ba5a6bf0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:03.214152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149af2fb-82e4-4863-b254-ef8ba5a6bf0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:03.216317 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149af2fb-82e4-4863-b254-ef8ba5a6bf0f service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:03.231749 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2914/5784] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:23:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:23:03.242406 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2871/5785] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:23:03 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:23:03.247071 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149af2fb-82e4-4863-b254-ef8ba5a6bf0f service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:03.269402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149af2fb-82e4-4863-b254-ef8ba5a6bf0f service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:03.496196 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eee424-17b2-4f78-a12f-634fffe11d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:03.499874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eee424-17b2-4f78-a12f-634fffe11d30 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:03.500174 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eee424-17b2-4f78-a12f-634fffe11d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:03.500449 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eee424-17b2-4f78-a12f-634fffe11d30 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:03.502283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eee424-17b2-4f78-a12f-634fffe11d30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:03.511405 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eee424-17b2-4f78-a12f-634fffe11d30 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:03.581186 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2915/5786] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:23:03 2022] POST /identity/v3/users => generated 288 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:23:03.585997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d231bf-67cc-4ad5-acfb-7890367e50ae admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:03.611119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d231bf-67cc-4ad5-acfb-7890367e50ae admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:03.621956 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f05d53-b274-4b10-b6ec-472f4aaba774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:03.623088 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f05d53-b274-4b10-b6ec-472f4aaba774 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:03.623662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f05d53-b274-4b10-b6ec-472f4aaba774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:03.624183 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f05d53-b274-4b10-b6ec-472f4aaba774 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:03.625163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f05d53-b274-4b10-b6ec-472f4aaba774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:03.628093 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f05d53-b274-4b10-b6ec-472f4aaba774 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:03.647111 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2872/5787] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:23:03.648762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eee424-17b2-4f78-a12f-634fffe11d30 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:03.662502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eee424-17b2-4f78-a12f-634fffe11d30 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:03.680785 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8bf14-5ea7-400e-b802-8d67dc77bc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:03.681633 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8bf14-5ea7-400e-b802-8d67dc77bc53 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:03.681914 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8bf14-5ea7-400e-b802-8d67dc77bc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:03.682188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8bf14-5ea7-400e-b802-8d67dc77bc53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:03.682841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8bf14-5ea7-400e-b802-8d67dc77bc53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:03.687225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8bf14-5ea7-400e-b802-8d67dc77bc53 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:03.718337 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2916/5788] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:23:03.719963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f05d53-b274-4b10-b6ec-472f4aaba774 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:03.735674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f05d53-b274-4b10-b6ec-472f4aaba774 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:03.754307 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae4fe0-67be-4d22-8fa3-23a34c96a6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:03.755814 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae4fe0-67be-4d22-8fa3-23a34c96a6f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:03.756200 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae4fe0-67be-4d22-8fa3-23a34c96a6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:03.756651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae4fe0-67be-4d22-8fa3-23a34c96a6f5 admin admin] PATH_INFO: `/v3/projects/84719fc7693d4d99857aa9c4df006afe/users/a440510a3f83472c93ae804e9221d0e7/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:03.790238 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae4fe0-67be-4d22-8fa3-23a34c96a6f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84719fc7693d4d99857aa9c4df006afe, user_id=a440510a3f83472c93ae804e9221d0e7, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:03.794160 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae4fe0-67be-4d22-8fa3-23a34c96a6f5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:03.858047 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47925e66-b491-4f60-b7a0-43864da76f84 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:03.858462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47925e66-b491-4f60-b7a0-43864da76f84 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:03.858875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47925e66-b491-4f60-b7a0-43864da76f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:03.862268 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2873/5789] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:23:03 2022] PUT /identity/v3/projects/84719fc7693d4d99857aa9c4df006afe/users/a440510a3f83472c93ae804e9221d0e7/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:03.953465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-47925e66-b491-4f60-b7a0-43864da76f84 None None] MFA Rules not processed for user `a440510a3f83472c93ae804e9221d0e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:03.956276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-47925e66-b491-4f60-b7a0-43864da76f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:04.135532 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2917/5790] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:23:04.219334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae4fe0-67be-4d22-8fa3-23a34c96a6f5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:04.423539 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae4fe0-67be-4d22-8fa3-23a34c96a6f5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:04.433847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e7db6-ed7a-4000-8955-becd989bc891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:04.434758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e7db6-ed7a-4000-8955-becd989bc891 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:04.435051 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e7db6-ed7a-4000-8955-becd989bc891 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:04.435332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e7db6-ed7a-4000-8955-becd989bc891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:04.459854 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e7db6-ed7a-4000-8955-becd989bc891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:04.464779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e7db6-ed7a-4000-8955-becd989bc891 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:04.490273 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2874/5791] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:23:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:23:04.662865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47925e66-b491-4f60-b7a0-43864da76f84 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:04.851198 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47925e66-b491-4f60-b7a0-43864da76f84 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:04.877293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd057e-e9b5-4650-926d-7b93a63c1d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:04.880581 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd057e-e9b5-4650-926d-7b93a63c1d1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:04.882124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd057e-e9b5-4650-926d-7b93a63c1d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:04.892195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd057e-e9b5-4650-926d-7b93a63c1d1f admin admin] PATH_INFO: `/v3/users/a440510a3f83472c93ae804e9221d0e7` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:04.897757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd057e-e9b5-4650-926d-7b93a63c1d1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a440510a3f83472c93ae804e9221d0e7)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:04.905656 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd057e-e9b5-4650-926d-7b93a63c1d1f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:04.915154 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:05.094092 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-accd057e-e9b5-4650-926d-7b93a63c1d1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a440510a3f83472c93ae804e9221d0e7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:05.094884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-accd057e-e9b5-4650-926d-7b93a63c1d1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a440510a3f83472c93ae804e9221d0e7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:05.126079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-accd057e-e9b5-4650-926d-7b93a63c1d1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a440510a3f83472c93ae804e9221d0e7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:05.146206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-accd057e-e9b5-4650-926d-7b93a63c1d1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a440510a3f83472c93ae804e9221d0e7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:05.147073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-accd057e-e9b5-4650-926d-7b93a63c1d1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a440510a3f83472c93ae804e9221d0e7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:05.196634 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2918/5792] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:23:04 2022] DELETE /identity/v3/users/a440510a3f83472c93ae804e9221d0e7 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:05.202138 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9781ab-2450-4bce-8755-92ad158da0af None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:05.202732 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9781ab-2450-4bce-8755-92ad158da0af None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:05.202732 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9781ab-2450-4bce-8755-92ad158da0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:05.259101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-aa9781ab-2450-4bce-8755-92ad158da0af None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:05.266877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-aa9781ab-2450-4bce-8755-92ad158da0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:05.445307 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2875/5793] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:23:05.458503 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd057e-e9b5-4650-926d-7b93a63c1d1f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:05.461098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-accd057e-e9b5-4650-926d-7b93a63c1d1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:05.468148 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9781ab-2450-4bce-8755-92ad158da0af None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:05.470351 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-aa9781ab-2450-4bce-8755-92ad158da0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:05.478913 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:05.492720 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9781ab-2450-4bce-8755-92ad158da0af None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:05.511896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d4861-9639-4d36-b1b7-ceba0e00dee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:05.512577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d4861-9639-4d36-b1b7-ceba0e00dee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:05.512894 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d4861-9639-4d36-b1b7-ceba0e00dee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:05.513173 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d4861-9639-4d36-b1b7-ceba0e00dee6 admin admin] PATH_INFO: `/v3/projects/5b87ba6c4ecf4a59b9f3cd9b5d61b36a` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:05.516766 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d4861-9639-4d36-b1b7-ceba0e00dee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b87ba6c4ecf4a59b9f3cd9b5d61b36a)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:05.530517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d4861-9639-4d36-b1b7-ceba0e00dee6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:05.625598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd057e-e9b5-4650-926d-7b93a63c1d1f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:05.635444 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d72b2-6056-485f-bdfc-c89c5c90a259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:05.636153 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d72b2-6056-485f-bdfc-c89c5c90a259 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:05.636723 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d72b2-6056-485f-bdfc-c89c5c90a259 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:05.637027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d72b2-6056-485f-bdfc-c89c5c90a259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:05.670218 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d72b2-6056-485f-bdfc-c89c5c90a259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:05.671703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d72b2-6056-485f-bdfc-c89c5c90a259 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:05.691050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0d9d4861-9639-4d36-b1b7-ceba0e00dee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b87ba6c4ecf4a59b9f3cd9b5d61b36a', 'request_id': 'req-0d9d4861-9639-4d36-b1b7-ceba0e00dee6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:05.713984 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2919/5794] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:23:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:23:05.716939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0d9d4861-9639-4d36-b1b7-ceba0e00dee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b87ba6c4ecf4a59b9f3cd9b5d61b36a', 'request_id': 'req-0d9d4861-9639-4d36-b1b7-ceba0e00dee6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:05.728086 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0d9d4861-9639-4d36-b1b7-ceba0e00dee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b87ba6c4ecf4a59b9f3cd9b5d61b36a', 'request_id': 'req-0d9d4861-9639-4d36-b1b7-ceba0e00dee6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:05.758563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0d9d4861-9639-4d36-b1b7-ceba0e00dee6 admin admin] The token cache is being invalidate because project 5b87ba6c4ecf4a59b9f3cd9b5d61b36a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:23:05.758918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0d9d4861-9639-4d36-b1b7-ceba0e00dee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:05.760183 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0d9d4861-9639-4d36-b1b7-ceba0e00dee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:05.772719 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d72b2-6056-485f-bdfc-c89c5c90a259 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:05.773278 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2876/5795] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:23:05 2022] DELETE /identity/v3/projects/5b87ba6c4ecf4a59b9f3cd9b5d61b36a => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:23:05.783731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d72b2-6056-485f-bdfc-c89c5c90a259 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:05.914758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5f6cc-bc99-4c6f-91f9-8fc129bbdd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:05.915420 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5f6cc-bc99-4c6f-91f9-8fc129bbdd22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:05.916108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5f6cc-bc99-4c6f-91f9-8fc129bbdd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:05.916108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5f6cc-bc99-4c6f-91f9-8fc129bbdd22 admin admin] PATH_INFO: `/v3/users/e0777068fc2444f09e154712d584cfe3` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:05.919857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5f6cc-bc99-4c6f-91f9-8fc129bbdd22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0777068fc2444f09e154712d584cfe3)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:05.925926 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5f6cc-bc99-4c6f-91f9-8fc129bbdd22 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:05.991760 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:06.058416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dcf5f6cc-bc99-4c6f-91f9-8fc129bbdd22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0777068fc2444f09e154712d584cfe3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:06.062166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dcf5f6cc-bc99-4c6f-91f9-8fc129bbdd22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0777068fc2444f09e154712d584cfe3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:06.082093 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dcf5f6cc-bc99-4c6f-91f9-8fc129bbdd22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0777068fc2444f09e154712d584cfe3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:06.115635 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dcf5f6cc-bc99-4c6f-91f9-8fc129bbdd22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0777068fc2444f09e154712d584cfe3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:06.116274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dcf5f6cc-bc99-4c6f-91f9-8fc129bbdd22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0777068fc2444f09e154712d584cfe3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:06.152244 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2920/5796] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:23:05 2022] DELETE /identity/v3/users/e0777068fc2444f09e154712d584cfe3 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:06.682269 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d4861-9639-4d36-b1b7-ceba0e00dee6 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:06.683790 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0d9d4861-9639-4d36-b1b7-ceba0e00dee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:06.708571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d4861-9639-4d36-b1b7-ceba0e00dee6 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:06.938316 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7abea6-416c-439f-b17b-f3ca53a5294e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:06.938725 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7abea6-416c-439f-b17b-f3ca53a5294e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:06.939010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7abea6-416c-439f-b17b-f3ca53a5294e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:06.939287 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7abea6-416c-439f-b17b-f3ca53a5294e admin admin] PATH_INFO: `/v3/projects/84719fc7693d4d99857aa9c4df006afe` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:06.946429 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7abea6-416c-439f-b17b-f3ca53a5294e admin admin] RBAC: Authorizing `identity:delete_project(project_id=84719fc7693d4d99857aa9c4df006afe)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:06.948432 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7abea6-416c-439f-b17b-f3ca53a5294e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:07.083683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1b7abea6-416c-439f-b17b-f3ca53a5294e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84719fc7693d4d99857aa9c4df006afe', 'request_id': 'req-1b7abea6-416c-439f-b17b-f3ca53a5294e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:07.106589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1b7abea6-416c-439f-b17b-f3ca53a5294e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84719fc7693d4d99857aa9c4df006afe', 'request_id': 'req-1b7abea6-416c-439f-b17b-f3ca53a5294e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:07.125928 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1b7abea6-416c-439f-b17b-f3ca53a5294e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84719fc7693d4d99857aa9c4df006afe', 'request_id': 'req-1b7abea6-416c-439f-b17b-f3ca53a5294e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:07.154198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1b7abea6-416c-439f-b17b-f3ca53a5294e admin admin] The token cache is being invalidate because project 84719fc7693d4d99857aa9c4df006afe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:23:07.154488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1b7abea6-416c-439f-b17b-f3ca53a5294e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:07.157006 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1b7abea6-416c-439f-b17b-f3ca53a5294e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:07.158577 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2877/5797] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:23:06 2022] DELETE /identity/v3/projects/84719fc7693d4d99857aa9c4df006afe => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:07.164927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac493e-8962-4441-8a8b-4b28f783ca71 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:07.165369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac493e-8962-4441-8a8b-4b28f783ca71 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:07.165793 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac493e-8962-4441-8a8b-4b28f783ca71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:07.251864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-9fac493e-8962-4441-8a8b-4b28f783ca71 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:07.257228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9fac493e-8962-4441-8a8b-4b28f783ca71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:07.445644 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2921/5798] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:23:07.448344 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b140d47-9c5d-4581-8a4f-ad13463ad67a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:07.451759 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b140d47-9c5d-4581-8a4f-ad13463ad67a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:07.453589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b140d47-9c5d-4581-8a4f-ad13463ad67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:07.602657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-0b140d47-9c5d-4581-8a4f-ad13463ad67a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:07.610074 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0b140d47-9c5d-4581-8a4f-ad13463ad67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:07.642836 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2878/5799] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:23:07.647547 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac493e-8962-4441-8a8b-4b28f783ca71 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:07.677460 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac493e-8962-4441-8a8b-4b28f783ca71 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:07.683499 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac966bf-5b62-44b6-a876-c8bf7ff3c5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:07.684636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac966bf-5b62-44b6-a876-c8bf7ff3c5cc admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:07.685177 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac966bf-5b62-44b6-a876-c8bf7ff3c5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:07.685738 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac966bf-5b62-44b6-a876-c8bf7ff3c5cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:07.686717 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac966bf-5b62-44b6-a876-c8bf7ff3c5cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:23:07.687768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac966bf-5b62-44b6-a876-c8bf7ff3c5cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:07.691066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac966bf-5b62-44b6-a876-c8bf7ff3c5cc admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:07.741999 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2922/5800] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:23:07.746241 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b140d47-9c5d-4581-8a4f-ad13463ad67a None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:07.763902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b140d47-9c5d-4581-8a4f-ad13463ad67a None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:07.772098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6a0ef-7e6e-4f13-9249-db35a3c3b712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:07.772960 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6a0ef-7e6e-4f13-9249-db35a3c3b712 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:07.773426 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6a0ef-7e6e-4f13-9249-db35a3c3b712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:07.773904 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6a0ef-7e6e-4f13-9249-db35a3c3b712 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:07.775953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6a0ef-7e6e-4f13-9249-db35a3c3b712 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:07.778116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6a0ef-7e6e-4f13-9249-db35a3c3b712 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:07.795509 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:07.878350 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2879/5801] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:23:07 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:23:07.879163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac966bf-5b62-44b6-a876-c8bf7ff3c5cc admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:07.897023 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac966bf-5b62-44b6-a876-c8bf7ff3c5cc admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:07.944880 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6a0ef-7e6e-4f13-9249-db35a3c3b712 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:07.947476 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-78b6a0ef-7e6e-4f13-9249-db35a3c3b712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:08.126677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a778c0-78da-4b0b-a3cd-18d3a4a00124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:08.128203 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a778c0-78da-4b0b-a3cd-18d3a4a00124 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:08.128615 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a778c0-78da-4b0b-a3cd-18d3a4a00124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:08.128986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a778c0-78da-4b0b-a3cd-18d3a4a00124 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:08.129859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a778c0-78da-4b0b-a3cd-18d3a4a00124 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:08.135032 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a778c0-78da-4b0b-a3cd-18d3a4a00124 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:08.195838 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6a0ef-7e6e-4f13-9249-db35a3c3b712 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:08.204118 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655a1b2-0d5d-4268-b2d6-3dcef1cc2971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:08.205321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655a1b2-0d5d-4268-b2d6-3dcef1cc2971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:08.206168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655a1b2-0d5d-4268-b2d6-3dcef1cc2971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:08.207858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655a1b2-0d5d-4268-b2d6-3dcef1cc2971 admin admin] PATH_INFO: `/v3/users/bdfdb11e893a4f36abc6cf9bc07850da` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:08.214141 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2923/5802] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:23:07 2022] POST /identity/v3/users => generated 292 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:23:08.214728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655a1b2-0d5d-4268-b2d6-3dcef1cc2971 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdfdb11e893a4f36abc6cf9bc07850da)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:08.215084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a778c0-78da-4b0b-a3cd-18d3a4a00124 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:08.218812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655a1b2-0d5d-4268-b2d6-3dcef1cc2971 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:08.257913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a778c0-78da-4b0b-a3cd-18d3a4a00124 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:08.270666 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fc6da-6020-4478-b428-7b6218958708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:08.271593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fc6da-6020-4478-b428-7b6218958708 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:08.272040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fc6da-6020-4478-b428-7b6218958708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:08.272468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fc6da-6020-4478-b428-7b6218958708 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:08.273288 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21fc6da-6020-4478-b428-7b6218958708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:08.275110 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21fc6da-6020-4478-b428-7b6218958708 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:08.305296 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2924/5803] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:23:08.310412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fc6da-6020-4478-b428-7b6218958708 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:08.332105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fc6da-6020-4478-b428-7b6218958708 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:08.343589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8655a1b2-0d5d-4268-b2d6-3dcef1cc2971 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdfdb11e893a4f36abc6cf9bc07850da'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:08.346410 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8655a1b2-0d5d-4268-b2d6-3dcef1cc2971 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdfdb11e893a4f36abc6cf9bc07850da'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:08.347535 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37f5dc-80c9-4c28-8416-a555fc4a1e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:08.348629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37f5dc-80c9-4c28-8416-a555fc4a1e8d admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:08.349099 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37f5dc-80c9-4c28-8416-a555fc4a1e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:08.349735 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37f5dc-80c9-4c28-8416-a555fc4a1e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:08.350905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37f5dc-80c9-4c28-8416-a555fc4a1e8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:08.357549 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37f5dc-80c9-4c28-8416-a555fc4a1e8d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:08.359513 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:08.374631 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8655a1b2-0d5d-4268-b2d6-3dcef1cc2971 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdfdb11e893a4f36abc6cf9bc07850da'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:08.391256 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2925/5804] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:23:08.392578 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37f5dc-80c9-4c28-8416-a555fc4a1e8d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:08.395507 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ad37f5dc-80c9-4c28-8416-a555fc4a1e8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:08.411734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8655a1b2-0d5d-4268-b2d6-3dcef1cc2971 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdfdb11e893a4f36abc6cf9bc07850da'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:08.412360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8655a1b2-0d5d-4268-b2d6-3dcef1cc2971 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdfdb11e893a4f36abc6cf9bc07850da'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:08.423916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37f5dc-80c9-4c28-8416-a555fc4a1e8d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:08.447116 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb6aa4-4f0b-4134-9b71-70767d69c6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:08.448396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb6aa4-4f0b-4134-9b71-70767d69c6d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:08.455433 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb6aa4-4f0b-4134-9b71-70767d69c6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:08.456007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb6aa4-4f0b-4134-9b71-70767d69c6d1 admin admin] PATH_INFO: `/v3/projects/c6b40f7e26564dbda4bcb18f10b81e03/users/18266482882e4d0facfb769cb039fef9/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:08.507306 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2880/5805] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:23:07 2022] DELETE /identity/v3/users/bdfdb11e893a4f36abc6cf9bc07850da => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:23:08.511312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b34ef-9825-4263-ace7-edda5b589392 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:08.511664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b34ef-9825-4263-ace7-edda5b589392 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:08.512003 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b34ef-9825-4263-ace7-edda5b589392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:08.521546 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb6aa4-4f0b-4134-9b71-70767d69c6d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b40f7e26564dbda4bcb18f10b81e03, user_id=18266482882e4d0facfb769cb039fef9, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:08.537185 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb6aa4-4f0b-4134-9b71-70767d69c6d1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:08.550978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-4d6b34ef-9825-4263-ace7-edda5b589392 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:08.553267 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4d6b34ef-9825-4263-ace7-edda5b589392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:08.569386 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2926/5806] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:23:08 2022] PUT /identity/v3/projects/c6b40f7e26564dbda4bcb18f10b81e03/users/18266482882e4d0facfb769cb039fef9/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:08.579955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8d92f-0c85-497e-81e8-dc4dd58dece7 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:08.580638 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8d92f-0c85-497e-81e8-dc4dd58dece7 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:08.581082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8d92f-0c85-497e-81e8-dc4dd58dece7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:08.666381 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-42c8d92f-0c85-497e-81e8-dc4dd58dece7 None None] MFA Rules not processed for user `18266482882e4d0facfb769cb039fef9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:08.672429 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-42c8d92f-0c85-497e-81e8-dc4dd58dece7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:08.739762 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2881/5807] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:23:08.768819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b34ef-9825-4263-ace7-edda5b589392 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:08.776990 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4d6b34ef-9825-4263-ace7-edda5b589392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:08.795612 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:08.891637 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2927/5808] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:23:08.896260 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8d92f-0c85-497e-81e8-dc4dd58dece7 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:08.967063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b34ef-9825-4263-ace7-edda5b589392 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:09.129195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8d92f-0c85-497e-81e8-dc4dd58dece7 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:09.151008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d2f16-293f-414e-afff-5b408a3c5537 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:09.152460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d2f16-293f-414e-afff-5b408a3c5537 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:09.152857 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d2f16-293f-414e-afff-5b408a3c5537 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:09.153240 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d2f16-293f-414e-afff-5b408a3c5537 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:09.158182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a67fb-2b31-4b2c-ac36-7bbf2038af1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:09.158812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a67fb-2b31-4b2c-ac36-7bbf2038af1c admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:09.159090 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a67fb-2b31-4b2c-ac36-7bbf2038af1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:09.159398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a67fb-2b31-4b2c-ac36-7bbf2038af1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:09.160055 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a67fb-2b31-4b2c-ac36-7bbf2038af1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:09.162629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a67fb-2b31-4b2c-ac36-7bbf2038af1c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:09.180824 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d2f16-293f-414e-afff-5b408a3c5537 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:09.183613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d2f16-293f-414e-afff-5b408a3c5537 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:09.204878 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2882/5809] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:23:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:23:09.304087 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2928/5810] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:23:08 2022] POST /identity/v3/projects => generated 381 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:23:09.308235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d2f16-293f-414e-afff-5b408a3c5537 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:09.314716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a67fb-2b31-4b2c-ac36-7bbf2038af1c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:09.316762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-634a67fb-2b31-4b2c-ac36-7bbf2038af1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:09.324285 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d2f16-293f-414e-afff-5b408a3c5537 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:09.497244 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:09.551946 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d5cb9-6446-4175-8990-9a7a4dd6edc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:09.552661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a67fb-2b31-4b2c-ac36-7bbf2038af1c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:09.553817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d5cb9-6446-4175-8990-9a7a4dd6edc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:09.554428 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d5cb9-6446-4175-8990-9a7a4dd6edc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:09.554428 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d5cb9-6446-4175-8990-9a7a4dd6edc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:09.556806 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d5cb9-6446-4175-8990-9a7a4dd6edc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:09.563741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d5cb9-6446-4175-8990-9a7a4dd6edc4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:09.564469 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d80934b-1312-4d80-9a6b-b4b741d68321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:09.568146 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80934b-1312-4d80-9a6b-b4b741d68321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:09.568490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80934b-1312-4d80-9a6b-b4b741d68321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:09.568778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80934b-1312-4d80-9a6b-b4b741d68321 admin admin] PATH_INFO: `/v3/projects/54232641553f470c97835e2069e17ecc` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:09.572017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d80934b-1312-4d80-9a6b-b4b741d68321 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54232641553f470c97835e2069e17ecc)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:09.579783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d80934b-1312-4d80-9a6b-b4b741d68321 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:09.634904 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2883/5811] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:23:09 2022] POST /identity/v3/users => generated 297 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:23:09.638980 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d5cb9-6446-4175-8990-9a7a4dd6edc4 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:09.667331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d5cb9-6446-4175-8990-9a7a4dd6edc4 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:09.702968 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8d80934b-1312-4d80-9a6b-b4b741d68321 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54232641553f470c97835e2069e17ecc', 'request_id': 'req-8d80934b-1312-4d80-9a6b-b4b741d68321'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:09.703944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a14450-56ca-40e6-955f-7d50c7e5424c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:09.704578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a14450-56ca-40e6-955f-7d50c7e5424c admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:09.704866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a14450-56ca-40e6-955f-7d50c7e5424c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:09.705141 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a14450-56ca-40e6-955f-7d50c7e5424c admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:09.705846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a14450-56ca-40e6-955f-7d50c7e5424c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:09.708109 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a14450-56ca-40e6-955f-7d50c7e5424c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:09.722510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8d80934b-1312-4d80-9a6b-b4b741d68321 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54232641553f470c97835e2069e17ecc', 'request_id': 'req-8d80934b-1312-4d80-9a6b-b4b741d68321'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:09.761514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8d80934b-1312-4d80-9a6b-b4b741d68321 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54232641553f470c97835e2069e17ecc', 'request_id': 'req-8d80934b-1312-4d80-9a6b-b4b741d68321'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:09.769769 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2884/5812] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:23:09.774449 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a14450-56ca-40e6-955f-7d50c7e5424c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:09.794756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8d80934b-1312-4d80-9a6b-b4b741d68321 admin admin] The token cache is being invalidate because project 54232641553f470c97835e2069e17ecc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:23:09.797889 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8d80934b-1312-4d80-9a6b-b4b741d68321 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:09.804589 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8d80934b-1312-4d80-9a6b-b4b741d68321 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:09.812439 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2929/5813] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:23:09 2022] DELETE /identity/v3/projects/54232641553f470c97835e2069e17ecc => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:23:09.823912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af626cb-c34a-43e3-91f7-8aa6b0dc72f1 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:09.825822 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af626cb-c34a-43e3-91f7-8aa6b0dc72f1 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:09.827840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af626cb-c34a-43e3-91f7-8aa6b0dc72f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:09.828608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a14450-56ca-40e6-955f-7d50c7e5424c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:09.879051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-0af626cb-c34a-43e3-91f7-8aa6b0dc72f1 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:09.883205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0af626cb-c34a-43e3-91f7-8aa6b0dc72f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:09.954046 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:10.007293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fac44-91f2-4ccb-9baf-1159219f23ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:10.007995 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fac44-91f2-4ccb-9baf-1159219f23ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:10.008276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fac44-91f2-4ccb-9baf-1159219f23ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:10.008548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fac44-91f2-4ccb-9baf-1159219f23ac admin admin] PATH_INFO: `/v3/projects/755ce5ba97e140d4a928e83683a3feac/users/822fe016ef004bbf9a8d68d797789601/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:10.052801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521fac44-91f2-4ccb-9baf-1159219f23ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=755ce5ba97e140d4a928e83683a3feac, user_id=822fe016ef004bbf9a8d68d797789601, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:10.055534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521fac44-91f2-4ccb-9baf-1159219f23ac admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:10.093240 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2885/5814] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:23:09 2022] PUT /identity/v3/projects/755ce5ba97e140d4a928e83683a3feac/users/822fe016ef004bbf9a8d68d797789601/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:23:10.103679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fac44-91f2-4ccb-9baf-1159219f23ac admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:10.131136 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-521fac44-91f2-4ccb-9baf-1159219f23ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:10.137558 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2930/5815] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:23:10.143864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe0fca-c19d-484b-b50e-8b15331b5aab None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:10.144184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe0fca-c19d-484b-b50e-8b15331b5aab None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:10.144430 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe0fca-c19d-484b-b50e-8b15331b5aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:10.217741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c6fe0fca-c19d-484b-b50e-8b15331b5aab None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:10.218981 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c6fe0fca-c19d-484b-b50e-8b15331b5aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:10.334277 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fac44-91f2-4ccb-9baf-1159219f23ac admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:10.367030 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777b0f6-6d58-4e18-bc14-be833bbf7ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:10.368782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777b0f6-6d58-4e18-bc14-be833bbf7ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:10.369417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777b0f6-6d58-4e18-bc14-be833bbf7ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:10.372300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777b0f6-6d58-4e18-bc14-be833bbf7ca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:10.373358 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777b0f6-6d58-4e18-bc14-be833bbf7ca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:10.378722 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777b0f6-6d58-4e18-bc14-be833bbf7ca7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:10.424688 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2886/5816] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:23:10.426300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777b0f6-6d58-4e18-bc14-be833bbf7ca7 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:10.465729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777b0f6-6d58-4e18-bc14-be833bbf7ca7 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:10.475750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4ae75-7eb6-4126-ac71-e7e2a09578e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:10.476590 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4ae75-7eb6-4126-ac71-e7e2a09578e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:10.477525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4ae75-7eb6-4126-ac71-e7e2a09578e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:10.477910 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4ae75-7eb6-4126-ac71-e7e2a09578e3 admin admin] PATH_INFO: `/v3/projects/755ce5ba97e140d4a928e83683a3feac/users/822fe016ef004bbf9a8d68d797789601/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:10.479801 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2931/5817] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:23:10.480349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4ae75-7eb6-4126-ac71-e7e2a09578e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=755ce5ba97e140d4a928e83683a3feac, user_id=822fe016ef004bbf9a8d68d797789601, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:10.483353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4ae75-7eb6-4126-ac71-e7e2a09578e3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:10.484248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe0fca-c19d-484b-b50e-8b15331b5aab None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:10.516501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe0fca-c19d-484b-b50e-8b15331b5aab None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:10.540850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffaeb5-7323-47f8-9e72-052a4729c4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:10.545197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffaeb5-7323-47f8-9e72-052a4729c4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:10.545734 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffaeb5-7323-47f8-9e72-052a4729c4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:10.546205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffaeb5-7323-47f8-9e72-052a4729c4a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:10.550079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ffaeb5-7323-47f8-9e72-052a4729c4a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:23:10.550650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ffaeb5-7323-47f8-9e72-052a4729c4a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:10.552937 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2887/5818] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:23:10 2022] PUT /identity/v3/projects/755ce5ba97e140d4a928e83683a3feac/users/822fe016ef004bbf9a8d68d797789601/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:10.556670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ffaeb5-7323-47f8-9e72-052a4729c4a4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:10.568724 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85521b-60c9-49b2-8f89-ceeef394736e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:10.574055 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85521b-60c9-49b2-8f89-ceeef394736e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:10.574844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85521b-60c9-49b2-8f89-ceeef394736e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:10.599668 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2932/5819] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:23:10.605362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffaeb5-7323-47f8-9e72-052a4729c4a4 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:10.626654 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:10.653207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffaeb5-7323-47f8-9e72-052a4729c4a4 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:10.674748 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-8d85521b-60c9-49b2-8f89-ceeef394736e None None] MFA Rules not processed for user `822fe016ef004bbf9a8d68d797789601`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:10.684181 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8d85521b-60c9-49b2-8f89-ceeef394736e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:10.871817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3086f-5ae0-4332-ae9c-b1350c93c7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:10.872751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3086f-5ae0-4332-ae9c-b1350c93c7da admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:10.873194 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3086f-5ae0-4332-ae9c-b1350c93c7da admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:10.875453 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3086f-5ae0-4332-ae9c-b1350c93c7da admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:10.876422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb3086f-5ae0-4332-ae9c-b1350c93c7da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:10.882461 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb3086f-5ae0-4332-ae9c-b1350c93c7da admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:10.945263 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2888/5820] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:10 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:23:10.959245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85521b-60c9-49b2-8f89-ceeef394736e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:10.960739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8d85521b-60c9-49b2-8f89-ceeef394736e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:10.968189 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2933/5821] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:23:10 2022] POST /identity/v3/projects => generated 367 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:23:10.972399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3086f-5ae0-4332-ae9c-b1350c93c7da admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:11.098857 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:11.147140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85521b-60c9-49b2-8f89-ceeef394736e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:11.177294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3086f-5ae0-4332-ae9c-b1350c93c7da admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:11.193320 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb279c3f-9b90-4400-8ba0-e0f00cf302d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:11.194097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb279c3f-9b90-4400-8ba0-e0f00cf302d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:11.194483 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb279c3f-9b90-4400-8ba0-e0f00cf302d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:11.194993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb279c3f-9b90-4400-8ba0-e0f00cf302d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:11.195860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb279c3f-9b90-4400-8ba0-e0f00cf302d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:11.202154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb279c3f-9b90-4400-8ba0-e0f00cf302d1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:11.248392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f24d7-4b65-40ec-838a-f6f0f79d27e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:11.249028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f24d7-4b65-40ec-838a-f6f0f79d27e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:11.249311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f24d7-4b65-40ec-838a-f6f0f79d27e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:11.249717 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f24d7-4b65-40ec-838a-f6f0f79d27e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:11.252241 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4b7f24d7-4b65-40ec-838a-f6f0f79d27e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:11.256005 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2934/5822] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:23:10 2022] POST /identity/v3/users => generated 284 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:23:11.260085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb279c3f-9b90-4400-8ba0-e0f00cf302d1 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:11.278971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb279c3f-9b90-4400-8ba0-e0f00cf302d1 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:11.293119 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34987f82-bef9-4a3e-a861-24412e0e6e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:11.294028 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34987f82-bef9-4a3e-a861-24412e0e6e1c admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:11.294425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34987f82-bef9-4a3e-a861-24412e0e6e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:11.297344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34987f82-bef9-4a3e-a861-24412e0e6e1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:11.298154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34987f82-bef9-4a3e-a861-24412e0e6e1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:11.303413 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34987f82-bef9-4a3e-a861-24412e0e6e1c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:11.333094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f24d7-4b65-40ec-838a-f6f0f79d27e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:11.334656 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f24d7-4b65-40ec-838a-f6f0f79d27e2 service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:11.341939 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2935/5823] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:23:11.345904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34987f82-bef9-4a3e-a861-24412e0e6e1c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:11.360931 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2889/5824] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:23:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:23:11.367540 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34987f82-bef9-4a3e-a861-24412e0e6e1c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:11.384957 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08bff37-9b89-4a22-8b63-6e3599667041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:11.387693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08bff37-9b89-4a22-8b63-6e3599667041 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:11.388081 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08bff37-9b89-4a22-8b63-6e3599667041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:11.391407 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08bff37-9b89-4a22-8b63-6e3599667041 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:11.395468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08bff37-9b89-4a22-8b63-6e3599667041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:11.399147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08bff37-9b89-4a22-8b63-6e3599667041 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:11.444931 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2936/5825] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:23:11.446636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f24d7-4b65-40ec-838a-f6f0f79d27e2 service cinder] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:11.479931 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f24d7-4b65-40ec-838a-f6f0f79d27e2 service cinder] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:11.507082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe54cba-622d-4b42-811f-025874b813d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:11.509769 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe54cba-622d-4b42-811f-025874b813d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:11.513373 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe54cba-622d-4b42-811f-025874b813d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:11.513763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe54cba-622d-4b42-811f-025874b813d8 admin admin] PATH_INFO: `/v3/projects/59ea7d81f4c94fe5a979b235b687cd84/users/ffaa9fd656d94b46bb7ebe8dbe3fbc27/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:11.575399 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe54cba-622d-4b42-811f-025874b813d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59ea7d81f4c94fe5a979b235b687cd84, user_id=ffaa9fd656d94b46bb7ebe8dbe3fbc27, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:11.581299 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe54cba-622d-4b42-811f-025874b813d8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:11.645371 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2890/5826] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:23:11 2022] PUT /identity/v3/projects/59ea7d81f4c94fe5a979b235b687cd84/users/ffaa9fd656d94b46bb7ebe8dbe3fbc27/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:11.646197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262dc684-5f1c-4b74-a74f-c3fa582bb3db None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:11.647214 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262dc684-5f1c-4b74-a74f-c3fa582bb3db None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:11.647703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262dc684-5f1c-4b74-a74f-c3fa582bb3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:11.737646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-262dc684-5f1c-4b74-a74f-c3fa582bb3db None None] MFA Rules not processed for user `ffaa9fd656d94b46bb7ebe8dbe3fbc27`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:11.740120 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-262dc684-5f1c-4b74-a74f-c3fa582bb3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:11.874519 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:11.930635 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2937/5827] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:23:11.934982 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe54cba-622d-4b42-811f-025874b813d8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:12.159692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe54cba-622d-4b42-811f-025874b813d8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:12.170009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732881f-af3a-43e3-bbdb-cac4a997f5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:12.170646 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732881f-af3a-43e3-bbdb-cac4a997f5fd admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:12.170929 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732881f-af3a-43e3-bbdb-cac4a997f5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:12.171205 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732881f-af3a-43e3-bbdb-cac4a997f5fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:12.171864 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732881f-af3a-43e3-bbdb-cac4a997f5fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:12.174265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732881f-af3a-43e3-bbdb-cac4a997f5fd admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:12.239773 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2891/5828] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:23:11 2022] POST /identity/v3/projects => generated 369 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:23:12.255809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262dc684-5f1c-4b74-a74f-c3fa582bb3db None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:12.273767 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262dc684-5f1c-4b74-a74f-c3fa582bb3db None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:12.421630 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9587f10-859d-4fd7-8621-c89f65a1fa6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:12.422324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9587f10-859d-4fd7-8621-c89f65a1fa6b admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:12.422610 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9587f10-859d-4fd7-8621-c89f65a1fa6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:12.422942 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9587f10-859d-4fd7-8621-c89f65a1fa6b admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:12.423590 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9587f10-859d-4fd7-8621-c89f65a1fa6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:12.427954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9587f10-859d-4fd7-8621-c89f65a1fa6b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:12.486028 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2938/5829] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:23:12 2022] POST /identity/v3/users => generated 291 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:23:12.490726 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732881f-af3a-43e3-bbdb-cac4a997f5fd admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:12.506229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732881f-af3a-43e3-bbdb-cac4a997f5fd admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:12.520703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854fe29-6871-4250-8773-71f6a2c2cca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:12.521342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854fe29-6871-4250-8773-71f6a2c2cca4 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:12.521657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854fe29-6871-4250-8773-71f6a2c2cca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:12.521941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854fe29-6871-4250-8773-71f6a2c2cca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:12.522603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854fe29-6871-4250-8773-71f6a2c2cca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:12.524566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854fe29-6871-4250-8773-71f6a2c2cca4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:12.526484 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:12.577374 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9587f10-859d-4fd7-8621-c89f65a1fa6b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:12.578824 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2892/5830] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:23:12.589679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9587f10-859d-4fd7-8621-c89f65a1fa6b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:12.614278 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f589351-0cdf-4489-a35e-0b6b0705f1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:12.615099 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f589351-0cdf-4489-a35e-0b6b0705f1a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:12.615388 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f589351-0cdf-4489-a35e-0b6b0705f1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:12.615663 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f589351-0cdf-4489-a35e-0b6b0705f1a5 admin admin] PATH_INFO: `/v3/projects/319e65a2a0944f62884438c3e416091e/users/a1594364d6094c03a4adbff5d4c588a4/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:12.674471 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f589351-0cdf-4489-a35e-0b6b0705f1a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=319e65a2a0944f62884438c3e416091e, user_id=a1594364d6094c03a4adbff5d4c588a4, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:12.678501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f589351-0cdf-4489-a35e-0b6b0705f1a5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:12.719629 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2939/5831] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:23:12 2022] PUT /identity/v3/projects/319e65a2a0944f62884438c3e416091e/users/a1594364d6094c03a4adbff5d4c588a4/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:12.724702 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854fe29-6871-4250-8773-71f6a2c2cca4 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:12.747908 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854fe29-6871-4250-8773-71f6a2c2cca4 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:12.955025 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eeb1e6-0cb5-4992-9337-6121be0ef3ab None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:12.955314 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eeb1e6-0cb5-4992-9337-6121be0ef3ab None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:12.955598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eeb1e6-0cb5-4992-9337-6121be0ef3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:12.995753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d4f6b-e984-4166-afb2-40e8403465cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:12.996634 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d4f6b-e984-4166-afb2-40e8403465cf admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:12.997775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d4f6b-e984-4166-afb2-40e8403465cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:12.998245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d4f6b-e984-4166-afb2-40e8403465cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:13.000275 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d4f6b-e984-4166-afb2-40e8403465cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:13.002124 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d4f6b-e984-4166-afb2-40e8403465cf admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:13.056890 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2893/5832] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:23:13.057996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d4f6b-e984-4166-afb2-40e8403465cf admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:13.087763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-15eeb1e6-0cb5-4992-9337-6121be0ef3ab None None] MFA Rules not processed for user `d353ffb7bcc348f3b70c2960c5195b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:13.089035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-15eeb1e6-0cb5-4992-9337-6121be0ef3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:13.091390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-aa4d4f6b-e984-4166-afb2-40e8403465cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:13.135924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d4f6b-e984-4166-afb2-40e8403465cf admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:13.160414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca0f74-ebd4-4a28-b1db-6f20a0c672cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:13.161081 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca0f74-ebd4-4a28-b1db-6f20a0c672cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:13.161503 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca0f74-ebd4-4a28-b1db-6f20a0c672cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:13.161787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca0f74-ebd4-4a28-b1db-6f20a0c672cc admin admin] PATH_INFO: `/v3/projects/2f743c6268164854a215a15f3c82bae1` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:13.165036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca0f74-ebd4-4a28-b1db-6f20a0c672cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f743c6268164854a215a15f3c82bae1)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:13.168599 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca0f74-ebd4-4a28-b1db-6f20a0c672cc admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:13.339209 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3bca0f74-ebd4-4a28-b1db-6f20a0c672cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f743c6268164854a215a15f3c82bae1', 'request_id': 'req-3bca0f74-ebd4-4a28-b1db-6f20a0c672cc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:13.379968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3bca0f74-ebd4-4a28-b1db-6f20a0c672cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f743c6268164854a215a15f3c82bae1', 'request_id': 'req-3bca0f74-ebd4-4a28-b1db-6f20a0c672cc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:13.408503 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3bca0f74-ebd4-4a28-b1db-6f20a0c672cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f743c6268164854a215a15f3c82bae1', 'request_id': 'req-3bca0f74-ebd4-4a28-b1db-6f20a0c672cc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:13.472995 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2940/5833] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:12 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 519 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:23:13.473967 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eeb1e6-0cb5-4992-9337-6121be0ef3ab None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:13.474746 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3bca0f74-ebd4-4a28-b1db-6f20a0c672cc admin admin] The token cache is being invalidate because project 2f743c6268164854a215a15f3c82bae1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:23:13.475232 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3bca0f74-ebd4-4a28-b1db-6f20a0c672cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:13.476146 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3bca0f74-ebd4-4a28-b1db-6f20a0c672cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:13.492172 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2894/5834] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:23:13 2022] DELETE /identity/v3/projects/2f743c6268164854a215a15f3c82bae1 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:13.498032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4beea9-1ae3-4ef9-a1fb-dcc8b7bf8512 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:13.498568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4beea9-1ae3-4ef9-a1fb-dcc8b7bf8512 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:13.500469 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4beea9-1ae3-4ef9-a1fb-dcc8b7bf8512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:13.515979 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eeb1e6-0cb5-4992-9337-6121be0ef3ab None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:13.549977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-9a4beea9-1ae3-4ef9-a1fb-dcc8b7bf8512 None None] MFA Rules not processed for user `551702ce15ec4969adc5affe33f29ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:13.552069 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9a4beea9-1ae3-4ef9-a1fb-dcc8b7bf8512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:13.697992 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:13.711984 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2895/5835] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:13 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:23:13.713590 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4beea9-1ae3-4ef9-a1fb-dcc8b7bf8512 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:13.717358 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9a4beea9-1ae3-4ef9-a1fb-dcc8b7bf8512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:13.762100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4e410-aa6f-4a62-b1b9-8ee036011e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:13.762293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4e410-aa6f-4a62-b1b9-8ee036011e13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:13.762554 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4e410-aa6f-4a62-b1b9-8ee036011e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:13.762829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4e410-aa6f-4a62-b1b9-8ee036011e13 admin admin] PATH_INFO: `/v3/projects/319e65a2a0944f62884438c3e416091e/users/a1594364d6094c03a4adbff5d4c588a4/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:13.773263 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:13.783424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b4e410-aa6f-4a62-b1b9-8ee036011e13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=319e65a2a0944f62884438c3e416091e, user_id=a1594364d6094c03a4adbff5d4c588a4, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:13.786426 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b4e410-aa6f-4a62-b1b9-8ee036011e13 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:13.821704 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2941/5836] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:23:13 2022] PUT /identity/v3/projects/319e65a2a0944f62884438c3e416091e/users/a1594364d6094c03a4adbff5d4c588a4/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:13.823494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4e410-aa6f-4a62-b1b9-8ee036011e13 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:13.832249 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-42b4e410-aa6f-4a62-b1b9-8ee036011e13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:13.899782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4beea9-1ae3-4ef9-a1fb-dcc8b7bf8512 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:14.023164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4e410-aa6f-4a62-b1b9-8ee036011e13 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:14.045110 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e8b27-86e4-4f7d-a148-cbfd7026239d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:14.045780 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e8b27-86e4-4f7d-a148-cbfd7026239d service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:14.046063 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e8b27-86e4-4f7d-a148-cbfd7026239d service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:14.046340 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e8b27-86e4-4f7d-a148-cbfd7026239d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:14.065052 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9d5e8b27-86e4-4f7d-a148-cbfd7026239d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:14.080488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d8952-eb5e-4d49-a3a7-197e2d2ef28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:14.081503 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d8952-eb5e-4d49-a3a7-197e2d2ef28c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:14.081975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d8952-eb5e-4d49-a3a7-197e2d2ef28c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:14.086316 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d8952-eb5e-4d49-a3a7-197e2d2ef28c admin admin] PATH_INFO: `/v3/users/3aa13075902a41df8dd6294dee627c2c` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:14.089347 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d8952-eb5e-4d49-a3a7-197e2d2ef28c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aa13075902a41df8dd6294dee627c2c)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:14.093672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d8952-eb5e-4d49-a3a7-197e2d2ef28c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:14.245636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7e9d8952-eb5e-4d49-a3a7-197e2d2ef28c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aa13075902a41df8dd6294dee627c2c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:14.247118 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7e9d8952-eb5e-4d49-a3a7-197e2d2ef28c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aa13075902a41df8dd6294dee627c2c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:14.247316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e8b27-86e4-4f7d-a148-cbfd7026239d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:14.253769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e8b27-86e4-4f7d-a148-cbfd7026239d service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:14.266680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7e9d8952-eb5e-4d49-a3a7-197e2d2ef28c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aa13075902a41df8dd6294dee627c2c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:14.274900 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2942/5837] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:23:13 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:23:14.276543 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ef474-d15f-40c1-9d98-0c299fa61176 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:14.277794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ef474-d15f-40c1-9d98-0c299fa61176 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:14.279600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ef474-d15f-40c1-9d98-0c299fa61176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:14.304122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7e9d8952-eb5e-4d49-a3a7-197e2d2ef28c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aa13075902a41df8dd6294dee627c2c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:14.305362 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7e9d8952-eb5e-4d49-a3a7-197e2d2ef28c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aa13075902a41df8dd6294dee627c2c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:14.372659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-eb9ef474-d15f-40c1-9d98-0c299fa61176 None None] MFA Rules not processed for user `a1594364d6094c03a4adbff5d4c588a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:14.375359 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2896/5838] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:23:13 2022] DELETE /identity/v3/users/3aa13075902a41df8dd6294dee627c2c => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:14.376135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-eb9ef474-d15f-40c1-9d98-0c299fa61176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:14.380855 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051479af-bc26-4d99-a02d-b1f2acdc6723 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:14.382223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051479af-bc26-4d99-a02d-b1f2acdc6723 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:14.382557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051479af-bc26-4d99-a02d-b1f2acdc6723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:14.488108 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-051479af-bc26-4d99-a02d-b1f2acdc6723 None None] MFA Rules not processed for user `bfd3e634551940cea7c8e492c7d8b79b`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:14.490165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-051479af-bc26-4d99-a02d-b1f2acdc6723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:14.610869 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:14.678415 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:14.695096 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2897/5839] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:23:14.707190 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c30a8-453f-4547-854d-f5db0a73ee20 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:14.707558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c30a8-453f-4547-854d-f5db0a73ee20 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:14.707936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c30a8-453f-4547-854d-f5db0a73ee20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:14.727025 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2943/5840] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:14 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:23:14.798422 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-221c30a8-453f-4547-854d-f5db0a73ee20 None None] MFA Rules not processed for user `bfd3e634551940cea7c8e492c7d8b79b`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:14.801715 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-221c30a8-453f-4547-854d-f5db0a73ee20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:14.827641 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2898/5841] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:23:14.838510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ef474-d15f-40c1-9d98-0c299fa61176 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:14.839969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-eb9ef474-d15f-40c1-9d98-0c299fa61176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:14.941255 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c30a8-453f-4547-854d-f5db0a73ee20 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:14.943228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-221c30a8-453f-4547-854d-f5db0a73ee20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:15.104358 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c30a8-453f-4547-854d-f5db0a73ee20 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:15.116714 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16101206-19f2-4333-b604-013245b5ae22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:15.131973 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16101206-19f2-4333-b604-013245b5ae22 service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:15.135683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16101206-19f2-4333-b604-013245b5ae22 service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:15.136117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16101206-19f2-4333-b604-013245b5ae22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:15.166962 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16101206-19f2-4333-b604-013245b5ae22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:15.173425 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16101206-19f2-4333-b604-013245b5ae22 service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:15.237197 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2899/5842] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:23:14 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:23:15.244760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ef474-d15f-40c1-9d98-0c299fa61176 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:15.277264 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9ed66-4b55-4459-a6a1-8e6877b344de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:15.278218 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9ed66-4b55-4459-a6a1-8e6877b344de service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:15.278501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9ed66-4b55-4459-a6a1-8e6877b344de service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:15.278778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9ed66-4b55-4459-a6a1-8e6877b344de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:15.313534 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef9ed66-4b55-4459-a6a1-8e6877b344de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:15.315193 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef9ed66-4b55-4459-a6a1-8e6877b344de service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:15.353574 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2944/5843] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:23:14 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:23:16.340735 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16101206-19f2-4333-b604-013245b5ae22 service cinder] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:16.344577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-16101206-19f2-4333-b604-013245b5ae22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:16.410756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9ed66-4b55-4459-a6a1-8e6877b344de service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:16.413077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8ef9ed66-4b55-4459-a6a1-8e6877b344de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:16.650292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16101206-19f2-4333-b604-013245b5ae22 service cinder] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:16.674187 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784bd8a-dcc3-4cd4-a76e-85680e6f5903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:16.674883 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784bd8a-dcc3-4cd4-a76e-85680e6f5903 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:16.675170 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784bd8a-dcc3-4cd4-a76e-85680e6f5903 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:16.675480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784bd8a-dcc3-4cd4-a76e-85680e6f5903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:16.677796 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9ed66-4b55-4459-a6a1-8e6877b344de service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:16.679182 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1784bd8a-dcc3-4cd4-a76e-85680e6f5903 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:16.691168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b867d8b-e2d6-4f1d-9d20-047e789b7d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:16.693988 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b867d8b-e2d6-4f1d-9d20-047e789b7d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:16.694644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b867d8b-e2d6-4f1d-9d20-047e789b7d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:16.695240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b867d8b-e2d6-4f1d-9d20-047e789b7d34 admin admin] PATH_INFO: `/v3/projects/293365b8abf343c5b24b410c8ed1f1ef` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:16.696747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b867d8b-e2d6-4f1d-9d20-047e789b7d34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=293365b8abf343c5b24b410c8ed1f1ef)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:16.699304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b867d8b-e2d6-4f1d-9d20-047e789b7d34 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:16.722341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784bd8a-dcc3-4cd4-a76e-85680e6f5903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:16.723849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784bd8a-dcc3-4cd4-a76e-85680e6f5903 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:16.761499 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2900/5844] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:23:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:23:16.862265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2b867d8b-e2d6-4f1d-9d20-047e789b7d34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '293365b8abf343c5b24b410c8ed1f1ef', 'request_id': 'req-2b867d8b-e2d6-4f1d-9d20-047e789b7d34'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:16.894586 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2b867d8b-e2d6-4f1d-9d20-047e789b7d34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '293365b8abf343c5b24b410c8ed1f1ef', 'request_id': 'req-2b867d8b-e2d6-4f1d-9d20-047e789b7d34'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:16.915344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2b867d8b-e2d6-4f1d-9d20-047e789b7d34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '293365b8abf343c5b24b410c8ed1f1ef', 'request_id': 'req-2b867d8b-e2d6-4f1d-9d20-047e789b7d34'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:16.985408 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2b867d8b-e2d6-4f1d-9d20-047e789b7d34 admin admin] The token cache is being invalidate because project 293365b8abf343c5b24b410c8ed1f1ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:23:17.000303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2b867d8b-e2d6-4f1d-9d20-047e789b7d34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:17.007018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2b867d8b-e2d6-4f1d-9d20-047e789b7d34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:17.037287 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2945/5845] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:23:16 2022] DELETE /identity/v3/projects/293365b8abf343c5b24b410c8ed1f1ef => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:17.042329 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332496ee-740c-44a0-9f6f-3a044ce7a28e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:17.042797 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332496ee-740c-44a0-9f6f-3a044ce7a28e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:17.043088 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332496ee-740c-44a0-9f6f-3a044ce7a28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:17.116111 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-332496ee-740c-44a0-9f6f-3a044ce7a28e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:17.127031 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-332496ee-740c-44a0-9f6f-3a044ce7a28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:17.359994 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2901/5846] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:23:17.367967 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b357e80-7876-44d6-ace6-0605eeef45bc None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:17.368562 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b357e80-7876-44d6-ace6-0605eeef45bc None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:17.369013 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b357e80-7876-44d6-ace6-0605eeef45bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:17.440663 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-8b357e80-7876-44d6-ace6-0605eeef45bc None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:17.453081 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8b357e80-7876-44d6-ace6-0605eeef45bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:17.475511 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2946/5847] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:23:17.479666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332496ee-740c-44a0-9f6f-3a044ce7a28e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:17.491339 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332496ee-740c-44a0-9f6f-3a044ce7a28e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:17.519697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e1313-26b7-4755-a7c4-af38cea99149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:17.520353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e1313-26b7-4755-a7c4-af38cea99149 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:17.520639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e1313-26b7-4755-a7c4-af38cea99149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:17.520920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e1313-26b7-4755-a7c4-af38cea99149 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:17.521628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45e1313-26b7-4755-a7c4-af38cea99149 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:23:17.521937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45e1313-26b7-4755-a7c4-af38cea99149 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:17.529277 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45e1313-26b7-4755-a7c4-af38cea99149 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:17.573842 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2902/5848] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:23:17.578059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b357e80-7876-44d6-ace6-0605eeef45bc None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:17.592844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b357e80-7876-44d6-ace6-0605eeef45bc None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:17.600392 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f60771-ab34-4199-9e54-df296a239457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:17.604993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f60771-ab34-4199-9e54-df296a239457 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:17.605649 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f60771-ab34-4199-9e54-df296a239457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:17.606246 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f60771-ab34-4199-9e54-df296a239457 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:17.606808 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f60771-ab34-4199-9e54-df296a239457 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:17.612801 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f60771-ab34-4199-9e54-df296a239457 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:17.625791 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:17.692349 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2947/5849] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:23:17 2022] POST /identity/v3/projects => generated 363 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:23:17.696633 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e1313-26b7-4755-a7c4-af38cea99149 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:17.702509 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:17.710875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e1313-26b7-4755-a7c4-af38cea99149 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:17.848803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431571d9-fd60-4c96-81f6-8789067bee75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:17.849460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431571d9-fd60-4c96-81f6-8789067bee75 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:17.851909 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431571d9-fd60-4c96-81f6-8789067bee75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:17.852392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431571d9-fd60-4c96-81f6-8789067bee75 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:17.853374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431571d9-fd60-4c96-81f6-8789067bee75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:17.855624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431571d9-fd60-4c96-81f6-8789067bee75 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:17.906367 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2903/5850] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:23:17 2022] POST /identity/v3/users => generated 282 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:23:17.910892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f60771-ab34-4199-9e54-df296a239457 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:17.933967 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f60771-ab34-4199-9e54-df296a239457 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:17.943860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e78b57-2b5b-4fcb-9398-f27e0a63aa79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:17.946263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e78b57-2b5b-4fcb-9398-f27e0a63aa79 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:17.946727 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e78b57-2b5b-4fcb-9398-f27e0a63aa79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:17.948060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e78b57-2b5b-4fcb-9398-f27e0a63aa79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:17.950244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e78b57-2b5b-4fcb-9398-f27e0a63aa79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:17.952048 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e78b57-2b5b-4fcb-9398-f27e0a63aa79 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:17.975042 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2948/5851] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:23:17.978880 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431571d9-fd60-4c96-81f6-8789067bee75 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:18.003373 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431571d9-fd60-4c96-81f6-8789067bee75 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:18.020866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6959cec-6e6d-4edf-8cd8-42e9d353a647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:18.023438 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6959cec-6e6d-4edf-8cd8-42e9d353a647 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:18.023750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6959cec-6e6d-4edf-8cd8-42e9d353a647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:18.024100 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6959cec-6e6d-4edf-8cd8-42e9d353a647 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:18.026631 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6959cec-6e6d-4edf-8cd8-42e9d353a647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:18.031721 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6959cec-6e6d-4edf-8cd8-42e9d353a647 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:18.067436 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2904/5852] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:23:18.071245 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e78b57-2b5b-4fcb-9398-f27e0a63aa79 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:18.085089 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e78b57-2b5b-4fcb-9398-f27e0a63aa79 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:18.104901 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4c215-37f0-4cf9-886c-d6a4ab958a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:18.106018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4c215-37f0-4cf9-886c-d6a4ab958a89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:18.106311 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4c215-37f0-4cf9-886c-d6a4ab958a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:18.106584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4c215-37f0-4cf9-886c-d6a4ab958a89 admin admin] PATH_INFO: `/v3/projects/1546f8d45c094e6199c7458bd88386b2/users/5fc26e9a68894578b31fe07e6244a07f/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:18.154804 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4c215-37f0-4cf9-886c-d6a4ab958a89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1546f8d45c094e6199c7458bd88386b2, user_id=5fc26e9a68894578b31fe07e6244a07f, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:18.159622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4c215-37f0-4cf9-886c-d6a4ab958a89 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:18.190876 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2949/5853] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:23:18 2022] PUT /identity/v3/projects/1546f8d45c094e6199c7458bd88386b2/users/5fc26e9a68894578b31fe07e6244a07f/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:18.201645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc336253-c6db-4e39-8f0b-22fd582a4534 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:18.201950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc336253-c6db-4e39-8f0b-22fd582a4534 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:18.204135 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc336253-c6db-4e39-8f0b-22fd582a4534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:18.324192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-cc336253-c6db-4e39-8f0b-22fd582a4534 None None] MFA Rules not processed for user `5fc26e9a68894578b31fe07e6244a07f`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:18.333717 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-cc336253-c6db-4e39-8f0b-22fd582a4534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:18.608011 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2905/5854] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:23:18.612013 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4c215-37f0-4cf9-886c-d6a4ab958a89 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:18.754625 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc336253-c6db-4e39-8f0b-22fd582a4534 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:18.756362 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-cc336253-c6db-4e39-8f0b-22fd582a4534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:18.776876 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4c215-37f0-4cf9-886c-d6a4ab958a89 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:18.786494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223d39d-7513-4748-84eb-c23028e29d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:18.787257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223d39d-7513-4748-84eb-c23028e29d01 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:18.787627 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223d39d-7513-4748-84eb-c23028e29d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:18.787899 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223d39d-7513-4748-84eb-c23028e29d01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:18.788563 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223d39d-7513-4748-84eb-c23028e29d01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:18.797911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223d39d-7513-4748-84eb-c23028e29d01 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:18.876444 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2950/5855] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:23:18 2022] POST /identity/v3/projects => generated 363 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:23:18.881803 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223d39d-7513-4748-84eb-c23028e29d01 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:19.058441 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223d39d-7513-4748-84eb-c23028e29d01 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:19.059266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc336253-c6db-4e39-8f0b-22fd582a4534 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:19.074059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4837f-6146-4e6c-95c2-9119b4505e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:19.075098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4837f-6146-4e6c-95c2-9119b4505e58 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:19.075581 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4837f-6146-4e6c-95c2-9119b4505e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:19.076285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4837f-6146-4e6c-95c2-9119b4505e58 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:19.076954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4837f-6146-4e6c-95c2-9119b4505e58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:19.082462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4837f-6146-4e6c-95c2-9119b4505e58 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:19.084946 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:19.176535 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2951/5856] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:23:18 2022] POST /identity/v3/users => generated 288 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:23:19.181098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4837f-6146-4e6c-95c2-9119b4505e58 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:19.229207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4837f-6146-4e6c-95c2-9119b4505e58 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:19.245454 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3f15f-566a-4cb6-b170-82a205296cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:19.245993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3f15f-566a-4cb6-b170-82a205296cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:19.246276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3f15f-566a-4cb6-b170-82a205296cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:19.246551 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3f15f-566a-4cb6-b170-82a205296cc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:19.247201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3f15f-566a-4cb6-b170-82a205296cc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:19.256274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3f15f-566a-4cb6-b170-82a205296cc7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:19.286932 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ab360-0528-4616-a8d4-c951829cd816 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:19.287569 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ab360-0528-4616-a8d4-c951829cd816 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:19.287850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ab360-0528-4616-a8d4-c951829cd816 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:19.288122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ab360-0528-4616-a8d4-c951829cd816 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:19.303508 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2952/5857] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:23:19.304689 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3f15f-566a-4cb6-b170-82a205296cc7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:19.305685 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-427ab360-0528-4616-a8d4-c951829cd816 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:19.341169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3f15f-566a-4cb6-b170-82a205296cc7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:19.350928 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ab360-0528-4616-a8d4-c951829cd816 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:19.351642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ab360-0528-4616-a8d4-c951829cd816 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:19.366693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73af9827-7d28-4f1b-acbc-2eb8b99b0429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:19.367497 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af9827-7d28-4f1b-acbc-2eb8b99b0429 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:19.367756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af9827-7d28-4f1b-acbc-2eb8b99b0429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:19.368038 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af9827-7d28-4f1b-acbc-2eb8b99b0429 admin admin] PATH_INFO: `/v3/projects/55497780fd1942c49e439551f4fb85b1/users/736f50e02eeb45c9b52ef5604a0b43eb/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:19.409575 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2906/5858] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:23:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:23:19.411565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39addde4-b5b6-4778-aa53-109e6b5af38c None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:19.411857 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39addde4-b5b6-4778-aa53-109e6b5af38c None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:19.412139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39addde4-b5b6-4778-aa53-109e6b5af38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:19.416915 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:19.431943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73af9827-7d28-4f1b-acbc-2eb8b99b0429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55497780fd1942c49e439551f4fb85b1, user_id=736f50e02eeb45c9b52ef5604a0b43eb, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:19.451205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73af9827-7d28-4f1b-acbc-2eb8b99b0429 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:19.497359 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2953/5859] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:23:19 2022] PUT /identity/v3/projects/55497780fd1942c49e439551f4fb85b1/users/736f50e02eeb45c9b52ef5604a0b43eb/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:19.502385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73af9827-7d28-4f1b-acbc-2eb8b99b0429 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:19.506089 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-39addde4-b5b6-4778-aa53-109e6b5af38c None None] MFA Rules not processed for user `bfd3e634551940cea7c8e492c7d8b79b`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:19.510154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-39addde4-b5b6-4778-aa53-109e6b5af38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:19.758896 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2907/5860] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:23:19.791025 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73af9827-7d28-4f1b-acbc-2eb8b99b0429 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:19.815057 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ec07f-0ce0-4ed2-bcc9-914966ae395e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:19.817107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ec07f-0ce0-4ed2-bcc9-914966ae395e admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:19.817342 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ec07f-0ce0-4ed2-bcc9-914966ae395e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:19.817717 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ec07f-0ce0-4ed2-bcc9-914966ae395e admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:19.818398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ec07f-0ce0-4ed2-bcc9-914966ae395e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:19.820065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ec07f-0ce0-4ed2-bcc9-914966ae395e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:19.844056 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2954/5861] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:23:19.848622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39addde4-b5b6-4778-aa53-109e6b5af38c None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:19.879770 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39addde4-b5b6-4778-aa53-109e6b5af38c None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:19.888248 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307004e4-2a42-4f01-bb68-8484a40bb4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:19.889605 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307004e4-2a42-4f01-bb68-8484a40bb4fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:19.890110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307004e4-2a42-4f01-bb68-8484a40bb4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:19.890673 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307004e4-2a42-4f01-bb68-8484a40bb4fe admin admin] PATH_INFO: `/v3/projects/55497780fd1942c49e439551f4fb85b1/users/736f50e02eeb45c9b52ef5604a0b43eb/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:19.896411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307004e4-2a42-4f01-bb68-8484a40bb4fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=55497780fd1942c49e439551f4fb85b1, user_id=736f50e02eeb45c9b52ef5604a0b43eb, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:19.899866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307004e4-2a42-4f01-bb68-8484a40bb4fe admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:19.927272 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2908/5862] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:23:19 2022] PUT /identity/v3/projects/55497780fd1942c49e439551f4fb85b1/users/736f50e02eeb45c9b52ef5604a0b43eb/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:19.938379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde98d5-fb08-4a83-b9cc-f96812a36092 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:19.939115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde98d5-fb08-4a83-b9cc-f96812a36092 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:19.939997 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde98d5-fb08-4a83-b9cc-f96812a36092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:19.996639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-6dde98d5-fb08-4a83-b9cc-f96812a36092 None None] MFA Rules not processed for user `736f50e02eeb45c9b52ef5604a0b43eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:19.998566 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6dde98d5-fb08-4a83-b9cc-f96812a36092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:20.302767 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2955/5863] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:19 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:23:20.382185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307004e4-2a42-4f01-bb68-8484a40bb4fe admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:20.384302 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-307004e4-2a42-4f01-bb68-8484a40bb4fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:20.568073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307004e4-2a42-4f01-bb68-8484a40bb4fe admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:20.580859 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a59e45-b946-49a6-bd64-278d2bc1acc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:20.581818 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a59e45-b946-49a6-bd64-278d2bc1acc1 service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:20.582317 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a59e45-b946-49a6-bd64-278d2bc1acc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:20.582779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a59e45-b946-49a6-bd64-278d2bc1acc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:20.622874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a59e45-b946-49a6-bd64-278d2bc1acc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:20.624525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a59e45-b946-49a6-bd64-278d2bc1acc1 service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:20.665620 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2909/5864] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:23:20 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:23:21.513656 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde98d5-fb08-4a83-b9cc-f96812a36092 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:21.545015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde98d5-fb08-4a83-b9cc-f96812a36092 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:21.559717 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7b9b1-5a2a-4c77-b8c9-c19a8a8e04ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:21.560587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7b9b1-5a2a-4c77-b8c9-c19a8a8e04ef service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:21.561896 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7b9b1-5a2a-4c77-b8c9-c19a8a8e04ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:21.562396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7b9b1-5a2a-4c77-b8c9-c19a8a8e04ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:21.735732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7b9b1-5a2a-4c77-b8c9-c19a8a8e04ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:21.741893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7b9b1-5a2a-4c77-b8c9-c19a8a8e04ef service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:21.771484 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2956/5865] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:23:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:23:22.495511 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a59e45-b946-49a6-bd64-278d2bc1acc1 service cinder] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:22.515337 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a59e45-b946-49a6-bd64-278d2bc1acc1 service cinder] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:22.521137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec06f1d-4ebb-4460-a59d-5457a87ee033 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:22.522021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec06f1d-4ebb-4460-a59d-5457a87ee033 service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:22.522982 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec06f1d-4ebb-4460-a59d-5457a87ee033 service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:22.523430 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec06f1d-4ebb-4460-a59d-5457a87ee033 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:22.526635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2ec06f1d-4ebb-4460-a59d-5457a87ee033 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:22.729620 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:22.791483 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec06f1d-4ebb-4460-a59d-5457a87ee033 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:22.793783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec06f1d-4ebb-4460-a59d-5457a87ee033 service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:22.833128 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2910/5866] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:23:22 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:23:23.241739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7b9b1-5a2a-4c77-b8c9-c19a8a8e04ef service cinder] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:23.243271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b2d7b9b1-5a2a-4c77-b8c9-c19a8a8e04ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:23.262389 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:23.377840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7b9b1-5a2a-4c77-b8c9-c19a8a8e04ef service cinder] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:23.395609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164bdc0b-b6fb-43e2-b665-8b87efe8a89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:23.398947 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bdc0b-b6fb-43e2-b665-8b87efe8a89a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:23.399933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bdc0b-b6fb-43e2-b665-8b87efe8a89a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:23.401052 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bdc0b-b6fb-43e2-b665-8b87efe8a89a admin admin] PATH_INFO: `/v3/users/ffaa9fd656d94b46bb7ebe8dbe3fbc27` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:23.407432 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164bdc0b-b6fb-43e2-b665-8b87efe8a89a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffaa9fd656d94b46bb7ebe8dbe3fbc27)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:23.413617 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164bdc0b-b6fb-43e2-b665-8b87efe8a89a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:23.541084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-164bdc0b-b6fb-43e2-b665-8b87efe8a89a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffaa9fd656d94b46bb7ebe8dbe3fbc27'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:23.542314 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-164bdc0b-b6fb-43e2-b665-8b87efe8a89a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffaa9fd656d94b46bb7ebe8dbe3fbc27'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:23.562174 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-164bdc0b-b6fb-43e2-b665-8b87efe8a89a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffaa9fd656d94b46bb7ebe8dbe3fbc27'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:23.578031 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-164bdc0b-b6fb-43e2-b665-8b87efe8a89a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffaa9fd656d94b46bb7ebe8dbe3fbc27'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:23.578875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-164bdc0b-b6fb-43e2-b665-8b87efe8a89a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffaa9fd656d94b46bb7ebe8dbe3fbc27'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:23.616017 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2957/5867] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:23:23 2022] DELETE /identity/v3/users/ffaa9fd656d94b46bb7ebe8dbe3fbc27 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:23.620411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233e60c-4bf8-4782-aed6-8d22bb779f75 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:23.620976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233e60c-4bf8-4782-aed6-8d22bb779f75 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:23.620976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233e60c-4bf8-4782-aed6-8d22bb779f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:23.672476 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-8233e60c-4bf8-4782-aed6-8d22bb779f75 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:23.673782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8233e60c-4bf8-4782-aed6-8d22bb779f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:23.857983 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2911/5868] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:23:23.952118 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164bdc0b-b6fb-43e2-b665-8b87efe8a89a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:23.953686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-164bdc0b-b6fb-43e2-b665-8b87efe8a89a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:24.122792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164bdc0b-b6fb-43e2-b665-8b87efe8a89a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:24.136112 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b68c6d-9993-41f4-957a-d9bd4181c8ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:24.136776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b68c6d-9993-41f4-957a-d9bd4181c8ee service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:24.137065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b68c6d-9993-41f4-957a-d9bd4181c8ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:24.137301 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b68c6d-9993-41f4-957a-d9bd4181c8ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:24.167119 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b68c6d-9993-41f4-957a-d9bd4181c8ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:24.168642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b68c6d-9993-41f4-957a-d9bd4181c8ee service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:24.194544 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2958/5869] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:23:25.795399 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233e60c-4bf8-4782-aed6-8d22bb779f75 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:25.796866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8233e60c-4bf8-4782-aed6-8d22bb779f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:25.815870 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233e60c-4bf8-4782-aed6-8d22bb779f75 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:25.830683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e04723-1f52-4f40-9e3b-233e08f346e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:25.831733 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e04723-1f52-4f40-9e3b-233e08f346e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:25.834427 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e04723-1f52-4f40-9e3b-233e08f346e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:25.835074 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e04723-1f52-4f40-9e3b-233e08f346e0 admin admin] PATH_INFO: `/v3/projects/59ea7d81f4c94fe5a979b235b687cd84` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:25.837420 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e04723-1f52-4f40-9e3b-233e08f346e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59ea7d81f4c94fe5a979b235b687cd84)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:25.839900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e04723-1f52-4f40-9e3b-233e08f346e0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:26.034032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-28e04723-1f52-4f40-9e3b-233e08f346e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59ea7d81f4c94fe5a979b235b687cd84', 'request_id': 'req-28e04723-1f52-4f40-9e3b-233e08f346e0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:26.054791 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-28e04723-1f52-4f40-9e3b-233e08f346e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59ea7d81f4c94fe5a979b235b687cd84', 'request_id': 'req-28e04723-1f52-4f40-9e3b-233e08f346e0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:26.069421 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-28e04723-1f52-4f40-9e3b-233e08f346e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59ea7d81f4c94fe5a979b235b687cd84', 'request_id': 'req-28e04723-1f52-4f40-9e3b-233e08f346e0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:26.099635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-28e04723-1f52-4f40-9e3b-233e08f346e0 admin admin] The token cache is being invalidate because project 59ea7d81f4c94fe5a979b235b687cd84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:23:26.100120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-28e04723-1f52-4f40-9e3b-233e08f346e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:26.101503 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-28e04723-1f52-4f40-9e3b-233e08f346e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:26.109788 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2912/5870] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:23:25 2022] DELETE /identity/v3/projects/59ea7d81f4c94fe5a979b235b687cd84 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:26.122047 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b68c6d-9993-41f4-957a-d9bd4181c8ee service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:26.134215 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b68c6d-9993-41f4-957a-d9bd4181c8ee service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:26.167218 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:26.211594 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57097ef6-4235-402c-b7b1-de2a5a117e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:26.212747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57097ef6-4235-402c-b7b1-de2a5a117e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:26.213525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57097ef6-4235-402c-b7b1-de2a5a117e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:26.214072 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57097ef6-4235-402c-b7b1-de2a5a117e96 admin admin] PATH_INFO: `/v3/users/a1594364d6094c03a4adbff5d4c588a4` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:26.216424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57097ef6-4235-402c-b7b1-de2a5a117e96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1594364d6094c03a4adbff5d4c588a4)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:26.219217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57097ef6-4235-402c-b7b1-de2a5a117e96 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:26.322130 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-57097ef6-4235-402c-b7b1-de2a5a117e96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1594364d6094c03a4adbff5d4c588a4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:26.323630 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-57097ef6-4235-402c-b7b1-de2a5a117e96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1594364d6094c03a4adbff5d4c588a4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:26.340666 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-57097ef6-4235-402c-b7b1-de2a5a117e96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1594364d6094c03a4adbff5d4c588a4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:26.362566 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-57097ef6-4235-402c-b7b1-de2a5a117e96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1594364d6094c03a4adbff5d4c588a4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:26.362566 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-57097ef6-4235-402c-b7b1-de2a5a117e96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1594364d6094c03a4adbff5d4c588a4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:26.417960 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2959/5871] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:23:26 2022] DELETE /identity/v3/users/a1594364d6094c03a4adbff5d4c588a4 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:27.973379 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e04723-1f52-4f40-9e3b-233e08f346e0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:27.976218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-28e04723-1f52-4f40-9e3b-233e08f346e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:28.022044 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e04723-1f52-4f40-9e3b-233e08f346e0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:28.215448 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:28.236708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2587e645-50e6-4d7a-8e70-2e95bd9e61e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:28.237536 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587e645-50e6-4d7a-8e70-2e95bd9e61e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:28.240081 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587e645-50e6-4d7a-8e70-2e95bd9e61e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:28.242007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587e645-50e6-4d7a-8e70-2e95bd9e61e6 admin admin] PATH_INFO: `/v3/projects/319e65a2a0944f62884438c3e416091e` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:28.246194 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2587e645-50e6-4d7a-8e70-2e95bd9e61e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=319e65a2a0944f62884438c3e416091e)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:28.251156 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2587e645-50e6-4d7a-8e70-2e95bd9e61e6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:28.369333 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2587e645-50e6-4d7a-8e70-2e95bd9e61e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '319e65a2a0944f62884438c3e416091e', 'request_id': 'req-2587e645-50e6-4d7a-8e70-2e95bd9e61e6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:28.387166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2587e645-50e6-4d7a-8e70-2e95bd9e61e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '319e65a2a0944f62884438c3e416091e', 'request_id': 'req-2587e645-50e6-4d7a-8e70-2e95bd9e61e6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:28.396006 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2587e645-50e6-4d7a-8e70-2e95bd9e61e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '319e65a2a0944f62884438c3e416091e', 'request_id': 'req-2587e645-50e6-4d7a-8e70-2e95bd9e61e6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:28.417793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2587e645-50e6-4d7a-8e70-2e95bd9e61e6 admin admin] The token cache is being invalidate because project 319e65a2a0944f62884438c3e416091e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:23:28.418134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2587e645-50e6-4d7a-8e70-2e95bd9e61e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:28.418887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2587e645-50e6-4d7a-8e70-2e95bd9e61e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:28.424100 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2913/5872] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:23:27 2022] DELETE /identity/v3/projects/319e65a2a0944f62884438c3e416091e => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:28.426634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596410b-8bcb-406f-b6fd-4f6abc6915f0 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:28.427150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596410b-8bcb-406f-b6fd-4f6abc6915f0 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:28.427804 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596410b-8bcb-406f-b6fd-4f6abc6915f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:28.472538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-5596410b-8bcb-406f-b6fd-4f6abc6915f0 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:28.474551 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5596410b-8bcb-406f-b6fd-4f6abc6915f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:28.585866 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2960/5873] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:23:28.594630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69046b6-58bc-4982-9748-3d082d3ce0a7 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:28.595837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69046b6-58bc-4982-9748-3d082d3ce0a7 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:28.596363 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69046b6-58bc-4982-9748-3d082d3ce0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:28.640126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-f69046b6-58bc-4982-9748-3d082d3ce0a7 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:28.652671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f69046b6-58bc-4982-9748-3d082d3ce0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:28.698059 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2914/5874] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:23:28.702291 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596410b-8bcb-406f-b6fd-4f6abc6915f0 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:28.717579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596410b-8bcb-406f-b6fd-4f6abc6915f0 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:28.743829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96959afb-ae90-4e59-9ff6-1265fc48a38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:28.745475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96959afb-ae90-4e59-9ff6-1265fc48a38f admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:28.746021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96959afb-ae90-4e59-9ff6-1265fc48a38f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:28.746446 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96959afb-ae90-4e59-9ff6-1265fc48a38f admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:28.748099 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96959afb-ae90-4e59-9ff6-1265fc48a38f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:23:28.748553 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96959afb-ae90-4e59-9ff6-1265fc48a38f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:28.751467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96959afb-ae90-4e59-9ff6-1265fc48a38f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:28.771349 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2961/5875] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:23:28.775601 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69046b6-58bc-4982-9748-3d082d3ce0a7 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:28.789117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69046b6-58bc-4982-9748-3d082d3ce0a7 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:28.799025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38b38d-c09c-41d1-8583-52c54b503276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:28.800413 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38b38d-c09c-41d1-8583-52c54b503276 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:28.800855 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38b38d-c09c-41d1-8583-52c54b503276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:28.801246 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38b38d-c09c-41d1-8583-52c54b503276 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:28.802983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf38b38d-c09c-41d1-8583-52c54b503276 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:28.805680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf38b38d-c09c-41d1-8583-52c54b503276 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:28.901873 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2915/5876] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:23:28 2022] POST /identity/v3/projects => generated 377 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:23:28.904774 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96959afb-ae90-4e59-9ff6-1265fc48a38f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:28.919710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96959afb-ae90-4e59-9ff6-1265fc48a38f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:28.966495 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:29.011305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35312cc-ccb7-4f1b-9a23-a3753affb6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:29.012021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35312cc-ccb7-4f1b-9a23-a3753affb6bb admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:29.012382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35312cc-ccb7-4f1b-9a23-a3753affb6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:29.012922 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35312cc-ccb7-4f1b-9a23-a3753affb6bb admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:29.014343 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35312cc-ccb7-4f1b-9a23-a3753affb6bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:29.017150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35312cc-ccb7-4f1b-9a23-a3753affb6bb admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:29.059116 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2962/5877] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:23:28 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:23:29.063689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38b38d-c09c-41d1-8583-52c54b503276 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:29.081052 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38b38d-c09c-41d1-8583-52c54b503276 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:29.087269 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc1b4c-a8ab-417f-8e05-572394524467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:29.088815 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc1b4c-a8ab-417f-8e05-572394524467 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:29.089123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc1b4c-a8ab-417f-8e05-572394524467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:29.089403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc1b4c-a8ab-417f-8e05-572394524467 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:29.090081 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc1b4c-a8ab-417f-8e05-572394524467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:29.092670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc1b4c-a8ab-417f-8e05-572394524467 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:29.119483 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2916/5878] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:23:29.123677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35312cc-ccb7-4f1b-9a23-a3753affb6bb admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:29.140440 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35312cc-ccb7-4f1b-9a23-a3753affb6bb admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:29.150164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571bdf0-0113-4c3b-8f84-cacbac673fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:29.150802 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571bdf0-0113-4c3b-8f84-cacbac673fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:29.151085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571bdf0-0113-4c3b-8f84-cacbac673fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:29.151361 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571bdf0-0113-4c3b-8f84-cacbac673fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:29.152008 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571bdf0-0113-4c3b-8f84-cacbac673fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:29.156157 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571bdf0-0113-4c3b-8f84-cacbac673fe5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:29.174366 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2963/5879] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:23:29.176952 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc1b4c-a8ab-417f-8e05-572394524467 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:29.192712 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc1b4c-a8ab-417f-8e05-572394524467 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:29.208783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f16c13-6e29-4e65-8bda-c863d19b1b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:29.209795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f16c13-6e29-4e65-8bda-c863d19b1b0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:29.210462 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f16c13-6e29-4e65-8bda-c863d19b1b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:29.210932 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f16c13-6e29-4e65-8bda-c863d19b1b0b admin admin] PATH_INFO: `/v3/projects/6b8affec378c41bf9bce8b4bda33d639/users/81cf18d8b7ea4aa4b6cf85c4a744d5b6/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:29.318831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f16c13-6e29-4e65-8bda-c863d19b1b0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b8affec378c41bf9bce8b4bda33d639, user_id=81cf18d8b7ea4aa4b6cf85c4a744d5b6, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:29.327543 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f16c13-6e29-4e65-8bda-c863d19b1b0b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:29.368151 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2917/5880] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:23:29 2022] PUT /identity/v3/projects/6b8affec378c41bf9bce8b4bda33d639/users/81cf18d8b7ea4aa4b6cf85c4a744d5b6/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:29.379343 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b083ae5-70b7-40aa-b475-8c4922a12d25 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:29.379747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b083ae5-70b7-40aa-b475-8c4922a12d25 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:29.379940 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b083ae5-70b7-40aa-b475-8c4922a12d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:29.481427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-1b083ae5-70b7-40aa-b475-8c4922a12d25 None None] MFA Rules not processed for user `81cf18d8b7ea4aa4b6cf85c4a744d5b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:29.485987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1b083ae5-70b7-40aa-b475-8c4922a12d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:29.638164 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2964/5881] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:23:29.642557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f16c13-6e29-4e65-8bda-c863d19b1b0b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:29.773821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f16c13-6e29-4e65-8bda-c863d19b1b0b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:29.779570 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83cb656-758e-455b-aa99-8c19070f4141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:29.780789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cb656-758e-455b-aa99-8c19070f4141 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:29.781176 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cb656-758e-455b-aa99-8c19070f4141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:29.781594 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cb656-758e-455b-aa99-8c19070f4141 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:29.782405 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83cb656-758e-455b-aa99-8c19070f4141 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:29.786714 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83cb656-758e-455b-aa99-8c19070f4141 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:29.833066 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2918/5882] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:23:29 2022] POST /identity/v3/projects => generated 377 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:23:29.833634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b083ae5-70b7-40aa-b475-8c4922a12d25 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:29.846185 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b083ae5-70b7-40aa-b475-8c4922a12d25 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:29.988943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e499cc-6245-4e6f-90aa-1821254bf9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:29.989734 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e499cc-6245-4e6f-90aa-1821254bf9b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:29.990438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e499cc-6245-4e6f-90aa-1821254bf9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:29.990791 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e499cc-6245-4e6f-90aa-1821254bf9b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:29.991528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e499cc-6245-4e6f-90aa-1821254bf9b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:29.993987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e499cc-6245-4e6f-90aa-1821254bf9b4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:30.030886 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2965/5883] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:23:29 2022] POST /identity/v3/users => generated 295 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:23:30.034826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83cb656-758e-455b-aa99-8c19070f4141 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:30.051304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83cb656-758e-455b-aa99-8c19070f4141 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:30.060120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fcda0-f856-4cf0-abae-c0567a227394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:30.061224 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fcda0-f856-4cf0-abae-c0567a227394 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:30.061749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fcda0-f856-4cf0-abae-c0567a227394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:30.062247 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fcda0-f856-4cf0-abae-c0567a227394 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:30.063106 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6fcda0-f856-4cf0-abae-c0567a227394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:30.064918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6fcda0-f856-4cf0-abae-c0567a227394 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:30.068471 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:30.083957 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2919/5884] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:23:30.088357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e499cc-6245-4e6f-90aa-1821254bf9b4 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:30.106327 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e499cc-6245-4e6f-90aa-1821254bf9b4 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:30.115290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d37c8-1e51-4a47-8729-8915f45bdfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:30.115955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d37c8-1e51-4a47-8729-8915f45bdfef admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:30.116443 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d37c8-1e51-4a47-8729-8915f45bdfef admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:30.116882 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d37c8-1e51-4a47-8729-8915f45bdfef admin admin] PATH_INFO: `/v3/projects/23247ede4e864163b4c35bd09a03097e/users/8d496d61685748cfbaddd1e52762e83f/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:30.159856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d37c8-1e51-4a47-8729-8915f45bdfef admin admin] RBAC: Authorizing `identity:create_grant(project_id=23247ede4e864163b4c35bd09a03097e, user_id=8d496d61685748cfbaddd1e52762e83f, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:30.164112 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d37c8-1e51-4a47-8729-8915f45bdfef admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:30.200147 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2966/5885] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:23:30 2022] PUT /identity/v3/projects/23247ede4e864163b4c35bd09a03097e/users/8d496d61685748cfbaddd1e52762e83f/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:30.204877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fcda0-f856-4cf0-abae-c0567a227394 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:30.218832 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fcda0-f856-4cf0-abae-c0567a227394 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:30.351510 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad5c9b-7fe7-4f13-84ec-e1e0d3fbb317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:30.353188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad5c9b-7fe7-4f13-84ec-e1e0d3fbb317 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:30.353727 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad5c9b-7fe7-4f13-84ec-e1e0d3fbb317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:30.354228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad5c9b-7fe7-4f13-84ec-e1e0d3fbb317 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:30.355686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ad5c9b-7fe7-4f13-84ec-e1e0d3fbb317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:30.357735 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ad5c9b-7fe7-4f13-84ec-e1e0d3fbb317 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:30.372843 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2920/5886] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:23:30.377238 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d37c8-1e51-4a47-8729-8915f45bdfef admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:30.392986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d37c8-1e51-4a47-8729-8915f45bdfef admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:30.403930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53a630-da49-4eba-bc89-9696987d8448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:30.404621 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53a630-da49-4eba-bc89-9696987d8448 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:30.404904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53a630-da49-4eba-bc89-9696987d8448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:30.405178 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53a630-da49-4eba-bc89-9696987d8448 admin admin] PATH_INFO: `/v3/projects/23247ede4e864163b4c35bd09a03097e/users/8d496d61685748cfbaddd1e52762e83f/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:30.407209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53a630-da49-4eba-bc89-9696987d8448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23247ede4e864163b4c35bd09a03097e, user_id=8d496d61685748cfbaddd1e52762e83f, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:30.410754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53a630-da49-4eba-bc89-9696987d8448 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:30.417097 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:30.423786 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2967/5887] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:23:30 2022] PUT /identity/v3/projects/23247ede4e864163b4c35bd09a03097e/users/8d496d61685748cfbaddd1e52762e83f/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:30.435002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aad98-87d1-44a6-adeb-200d34b95f19 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:30.435567 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aad98-87d1-44a6-adeb-200d34b95f19 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:30.435997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aad98-87d1-44a6-adeb-200d34b95f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:30.551474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-736aad98-87d1-44a6-adeb-200d34b95f19 None None] MFA Rules not processed for user `8d496d61685748cfbaddd1e52762e83f`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:30.553693 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-736aad98-87d1-44a6-adeb-200d34b95f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:30.840913 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2921/5888] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:23:30.915555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53a630-da49-4eba-bc89-9696987d8448 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:30.918245 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fd53a630-da49-4eba-bc89-9696987d8448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:31.138973 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53a630-da49-4eba-bc89-9696987d8448 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:31.149267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bc6e7-d62b-4fac-98fc-6754ca0cd38e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:31.150279 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bc6e7-d62b-4fac-98fc-6754ca0cd38e service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:31.150784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bc6e7-d62b-4fac-98fc-6754ca0cd38e service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:31.151886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bc6e7-d62b-4fac-98fc-6754ca0cd38e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:31.260069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bc6e7-d62b-4fac-98fc-6754ca0cd38e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:31.263505 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bc6e7-d62b-4fac-98fc-6754ca0cd38e service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:31.287632 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2968/5889] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:23:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:23:34.169000 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736aad98-87d1-44a6-adeb-200d34b95f19 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:34.170473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-736aad98-87d1-44a6-adeb-200d34b95f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:34.193734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736aad98-87d1-44a6-adeb-200d34b95f19 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:34.198374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5430c8-27a0-4123-8230-7a7ed061dd88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:34.199158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5430c8-27a0-4123-8230-7a7ed061dd88 service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:34.199507 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5430c8-27a0-4123-8230-7a7ed061dd88 service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:34.199853 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5430c8-27a0-4123-8230-7a7ed061dd88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:34.231094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5430c8-27a0-4123-8230-7a7ed061dd88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:34.232782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5430c8-27a0-4123-8230-7a7ed061dd88 service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:34.249599 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2922/5890] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:23:34 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:23:36.173648 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bc6e7-d62b-4fac-98fc-6754ca0cd38e service cinder] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:36.176922 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-714bc6e7-d62b-4fac-98fc-6754ca0cd38e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:36.357929 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bc6e7-d62b-4fac-98fc-6754ca0cd38e service cinder] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:36.384350 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72c032-422a-4bd9-b151-17ec44d8eea1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:36.386260 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72c032-422a-4bd9-b151-17ec44d8eea1 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:36.388875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72c032-422a-4bd9-b151-17ec44d8eea1 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:36.389344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72c032-422a-4bd9-b151-17ec44d8eea1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:36.399245 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6a72c032-422a-4bd9-b151-17ec44d8eea1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:36.531305 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:36.578178 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72c032-422a-4bd9-b151-17ec44d8eea1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:36.584735 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72c032-422a-4bd9-b151-17ec44d8eea1 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:36.663610 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2969/5891] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:23:36 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:23:39.728613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5430c8-27a0-4123-8230-7a7ed061dd88 service cinder] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:39.731949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7e5430c8-27a0-4123-8230-7a7ed061dd88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:39.897590 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5430c8-27a0-4123-8230-7a7ed061dd88 service cinder] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:39.903826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23d279-7fc6-4f3b-8c7b-67ee3598f725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:39.904994 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23d279-7fc6-4f3b-8c7b-67ee3598f725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:39.905654 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23d279-7fc6-4f3b-8c7b-67ee3598f725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:39.906343 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23d279-7fc6-4f3b-8c7b-67ee3598f725 admin admin] PATH_INFO: `/v3/users/18266482882e4d0facfb769cb039fef9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:39.907954 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d23d279-7fc6-4f3b-8c7b-67ee3598f725 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18266482882e4d0facfb769cb039fef9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:39.910798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d23d279-7fc6-4f3b-8c7b-67ee3598f725 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:39.919238 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:40.020348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7d23d279-7fc6-4f3b-8c7b-67ee3598f725 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18266482882e4d0facfb769cb039fef9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:40.021195 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7d23d279-7fc6-4f3b-8c7b-67ee3598f725 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18266482882e4d0facfb769cb039fef9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:40.032331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7d23d279-7fc6-4f3b-8c7b-67ee3598f725 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18266482882e4d0facfb769cb039fef9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:40.044813 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7d23d279-7fc6-4f3b-8c7b-67ee3598f725 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18266482882e4d0facfb769cb039fef9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:40.045917 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7d23d279-7fc6-4f3b-8c7b-67ee3598f725 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18266482882e4d0facfb769cb039fef9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:40.100249 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2923/5892] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:23:39 2022] DELETE /identity/v3/users/18266482882e4d0facfb769cb039fef9 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:23:40.105233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1966be-26b3-42af-965b-9607eca6a093 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:40.105887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1966be-26b3-42af-965b-9607eca6a093 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:40.107069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1966be-26b3-42af-965b-9607eca6a093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:40.150716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ca1966be-26b3-42af-965b-9607eca6a093 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:40.152054 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ca1966be-26b3-42af-965b-9607eca6a093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:40.284245 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2970/5893] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:23:40.296571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23d279-7fc6-4f3b-8c7b-67ee3598f725 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:40.301992 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7d23d279-7fc6-4f3b-8c7b-67ee3598f725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:40.545631 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23d279-7fc6-4f3b-8c7b-67ee3598f725 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:40.554165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15b013-0dad-4f90-a80b-696d434a0fd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:40.555116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15b013-0dad-4f90-a80b-696d434a0fd4 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:40.555571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15b013-0dad-4f90-a80b-696d434a0fd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:40.557385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15b013-0dad-4f90-a80b-696d434a0fd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:40.625740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac15b013-0dad-4f90-a80b-696d434a0fd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:40.635891 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac15b013-0dad-4f90-a80b-696d434a0fd4 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:40.677889 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2924/5894] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:23:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:23:41.709775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1966be-26b3-42af-965b-9607eca6a093 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:41.711942 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ca1966be-26b3-42af-965b-9607eca6a093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:41.732393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1966be-26b3-42af-965b-9607eca6a093 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:41.746651 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3956c7-73a1-4240-ae46-6212ef60c026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:41.747611 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3956c7-73a1-4240-ae46-6212ef60c026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:41.748203 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3956c7-73a1-4240-ae46-6212ef60c026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:41.748584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3956c7-73a1-4240-ae46-6212ef60c026 admin admin] PATH_INFO: `/v3/projects/c6b40f7e26564dbda4bcb18f10b81e03` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:41.751416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3956c7-73a1-4240-ae46-6212ef60c026 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6b40f7e26564dbda4bcb18f10b81e03)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:41.755068 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3956c7-73a1-4240-ae46-6212ef60c026 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:41.980204 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9b3956c7-73a1-4240-ae46-6212ef60c026 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6b40f7e26564dbda4bcb18f10b81e03', 'request_id': 'req-9b3956c7-73a1-4240-ae46-6212ef60c026'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:42.022123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9b3956c7-73a1-4240-ae46-6212ef60c026 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6b40f7e26564dbda4bcb18f10b81e03', 'request_id': 'req-9b3956c7-73a1-4240-ae46-6212ef60c026'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:42.047299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9b3956c7-73a1-4240-ae46-6212ef60c026 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6b40f7e26564dbda4bcb18f10b81e03', 'request_id': 'req-9b3956c7-73a1-4240-ae46-6212ef60c026'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:42.081770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9b3956c7-73a1-4240-ae46-6212ef60c026 admin admin] The token cache is being invalidate because project c6b40f7e26564dbda4bcb18f10b81e03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:23:42.081770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9b3956c7-73a1-4240-ae46-6212ef60c026 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:42.082206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9b3956c7-73a1-4240-ae46-6212ef60c026 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:42.093751 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2971/5895] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:23:41 2022] DELETE /identity/v3/projects/c6b40f7e26564dbda4bcb18f10b81e03 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:42.098342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15b013-0dad-4f90-a80b-696d434a0fd4 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:42.131869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15b013-0dad-4f90-a80b-696d434a0fd4 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:42.425772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321f200-9bba-4673-a288-078a4d92e114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:42.427309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321f200-9bba-4673-a288-078a4d92e114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:42.429817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321f200-9bba-4673-a288-078a4d92e114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:42.431678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321f200-9bba-4673-a288-078a4d92e114 admin admin] PATH_INFO: `/v3/users/822fe016ef004bbf9a8d68d797789601` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:42.437555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0321f200-9bba-4673-a288-078a4d92e114 admin admin] RBAC: Authorizing `identity:delete_user(user_id=822fe016ef004bbf9a8d68d797789601)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:42.465366 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0321f200-9bba-4673-a288-078a4d92e114 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:42.582537 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:42.653790 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0321f200-9bba-4673-a288-078a4d92e114 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '822fe016ef004bbf9a8d68d797789601'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:42.655780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0321f200-9bba-4673-a288-078a4d92e114 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '822fe016ef004bbf9a8d68d797789601'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:42.669705 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0321f200-9bba-4673-a288-078a4d92e114 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '822fe016ef004bbf9a8d68d797789601'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:42.681854 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0321f200-9bba-4673-a288-078a4d92e114 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '822fe016ef004bbf9a8d68d797789601'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:42.684158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0321f200-9bba-4673-a288-078a4d92e114 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '822fe016ef004bbf9a8d68d797789601'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:42.740179 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2925/5896] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:23:42 2022] DELETE /identity/v3/users/822fe016ef004bbf9a8d68d797789601 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:43.461459 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3956c7-73a1-4240-ae46-6212ef60c026 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:43.463632 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9b3956c7-73a1-4240-ae46-6212ef60c026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:43.506118 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3956c7-73a1-4240-ae46-6212ef60c026 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:43.645181 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b79119-ad58-45bc-96e4-d69dc735c9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:43.646039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b79119-ad58-45bc-96e4-d69dc735c9ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:43.646325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b79119-ad58-45bc-96e4-d69dc735c9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:43.646601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b79119-ad58-45bc-96e4-d69dc735c9ec admin admin] PATH_INFO: `/v3/projects/755ce5ba97e140d4a928e83683a3feac` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:43.649157 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b79119-ad58-45bc-96e4-d69dc735c9ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=755ce5ba97e140d4a928e83683a3feac)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:43.651214 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b79119-ad58-45bc-96e4-d69dc735c9ec admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:43.713593 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:43.785244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a2b79119-ad58-45bc-96e4-d69dc735c9ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '755ce5ba97e140d4a928e83683a3feac', 'request_id': 'req-a2b79119-ad58-45bc-96e4-d69dc735c9ec'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:43.798036 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a2b79119-ad58-45bc-96e4-d69dc735c9ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '755ce5ba97e140d4a928e83683a3feac', 'request_id': 'req-a2b79119-ad58-45bc-96e4-d69dc735c9ec'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:43.806517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a2b79119-ad58-45bc-96e4-d69dc735c9ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '755ce5ba97e140d4a928e83683a3feac', 'request_id': 'req-a2b79119-ad58-45bc-96e4-d69dc735c9ec'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:43.823149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a2b79119-ad58-45bc-96e4-d69dc735c9ec admin admin] The token cache is being invalidate because project 755ce5ba97e140d4a928e83683a3feac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:23:43.823821 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a2b79119-ad58-45bc-96e4-d69dc735c9ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:43.824775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a2b79119-ad58-45bc-96e4-d69dc735c9ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:43.827173 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2972/5897] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:23:43 2022] DELETE /identity/v3/projects/755ce5ba97e140d4a928e83683a3feac => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:43.832590 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edffa72c-ea70-4a3e-86fa-af9ea87e33e2 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:43.833165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edffa72c-ea70-4a3e-86fa-af9ea87e33e2 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:43.833165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edffa72c-ea70-4a3e-86fa-af9ea87e33e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:43.859995 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-edffa72c-ea70-4a3e-86fa-af9ea87e33e2 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:43.861776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-edffa72c-ea70-4a3e-86fa-af9ea87e33e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:43.981369 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2926/5898] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:23:43.988960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499bfda-ced3-46fa-b5c8-999b1a9ad4e2 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:43.989293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499bfda-ced3-46fa-b5c8-999b1a9ad4e2 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:43.989542 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499bfda-ced3-46fa-b5c8-999b1a9ad4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:44.016476 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-0499bfda-ced3-46fa-b5c8-999b1a9ad4e2 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:44.017754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0499bfda-ced3-46fa-b5c8-999b1a9ad4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:44.031444 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edffa72c-ea70-4a3e-86fa-af9ea87e33e2 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:44.031958 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2973/5899] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:23:44.042037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edffa72c-ea70-4a3e-86fa-af9ea87e33e2 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:44.047065 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affeb776-4c72-419b-83b7-6e5cba4fed1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:44.047803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affeb776-4c72-419b-83b7-6e5cba4fed1d admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:44.048467 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affeb776-4c72-419b-83b7-6e5cba4fed1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:44.048824 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affeb776-4c72-419b-83b7-6e5cba4fed1d admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:44.049673 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affeb776-4c72-419b-83b7-6e5cba4fed1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:23:44.050079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affeb776-4c72-419b-83b7-6e5cba4fed1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:44.052238 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affeb776-4c72-419b-83b7-6e5cba4fed1d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:44.068346 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2927/5900] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:23:44.071887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499bfda-ced3-46fa-b5c8-999b1a9ad4e2 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:44.084895 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499bfda-ced3-46fa-b5c8-999b1a9ad4e2 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:44.098323 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965f238-9e8f-4b83-9ddc-d8f3f4bd44db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:44.099170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965f238-9e8f-4b83-9ddc-d8f3f4bd44db admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:44.099458 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965f238-9e8f-4b83-9ddc-d8f3f4bd44db admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:44.099726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965f238-9e8f-4b83-9ddc-d8f3f4bd44db admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:44.100372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e965f238-9e8f-4b83-9ddc-d8f3f4bd44db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:44.102823 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e965f238-9e8f-4b83-9ddc-d8f3f4bd44db admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:44.147715 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affeb776-4c72-419b-83b7-6e5cba4fed1d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:44.158184 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2974/5901] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:23:44 2022] POST /identity/v3/projects => generated 387 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:23:44.161117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affeb776-4c72-419b-83b7-6e5cba4fed1d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:44.336537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ecd15-2ef2-4b90-9d34-399ee1c2c775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:44.337175 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ecd15-2ef2-4b90-9d34-399ee1c2c775 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:44.337481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ecd15-2ef2-4b90-9d34-399ee1c2c775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:44.337768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ecd15-2ef2-4b90-9d34-399ee1c2c775 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:44.338418 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ecd15-2ef2-4b90-9d34-399ee1c2c775 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:44.345096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ecd15-2ef2-4b90-9d34-399ee1c2c775 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:44.390955 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2928/5902] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:23:44 2022] POST /identity/v3/users => generated 294 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:23:44.396648 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965f238-9e8f-4b83-9ddc-d8f3f4bd44db admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:44.420920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965f238-9e8f-4b83-9ddc-d8f3f4bd44db admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:44.444115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55659ca5-3074-4510-b6b0-e55426c99a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:44.444115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55659ca5-3074-4510-b6b0-e55426c99a38 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:44.444115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55659ca5-3074-4510-b6b0-e55426c99a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:44.444115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55659ca5-3074-4510-b6b0-e55426c99a38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:44.444550 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55659ca5-3074-4510-b6b0-e55426c99a38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:44.444550 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55659ca5-3074-4510-b6b0-e55426c99a38 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:44.472806 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ecd15-2ef2-4b90-9d34-399ee1c2c775 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:44.474630 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2975/5903] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:23:44.504021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ecd15-2ef2-4b90-9d34-399ee1c2c775 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:44.519449 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ba69f-f419-4490-b9b8-93290a0fe33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:44.520482 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ba69f-f419-4490-b9b8-93290a0fe33f admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:44.521026 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ba69f-f419-4490-b9b8-93290a0fe33f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:44.521730 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ba69f-f419-4490-b9b8-93290a0fe33f admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:44.522669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ba69f-f419-4490-b9b8-93290a0fe33f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:44.526559 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ba69f-f419-4490-b9b8-93290a0fe33f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:44.550628 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2929/5904] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:23:44.555503 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55659ca5-3074-4510-b6b0-e55426c99a38 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:44.570553 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55659ca5-3074-4510-b6b0-e55426c99a38 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:44.587042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d536d-07b1-4236-a846-ea21ec1370ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:44.587728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d536d-07b1-4236-a846-ea21ec1370ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:44.588006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d536d-07b1-4236-a846-ea21ec1370ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:44.588278 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d536d-07b1-4236-a846-ea21ec1370ed admin admin] PATH_INFO: `/v3/projects/790725ee598a4f05b2b2d70f670be6aa/users/31e887a53109450ca52f0d08967f75bf/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:44.622630 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d536d-07b1-4236-a846-ea21ec1370ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=790725ee598a4f05b2b2d70f670be6aa, user_id=31e887a53109450ca52f0d08967f75bf, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:44.625365 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d536d-07b1-4236-a846-ea21ec1370ed admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:44.660802 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2976/5905] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:23:44 2022] PUT /identity/v3/projects/790725ee598a4f05b2b2d70f670be6aa/users/31e887a53109450ca52f0d08967f75bf/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:44.671407 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc487c37-2e72-4191-9748-48ebd913b75a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:44.672151 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc487c37-2e72-4191-9748-48ebd913b75a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:44.672701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc487c37-2e72-4191-9748-48ebd913b75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:44.738978 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:44.774227 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-dc487c37-2e72-4191-9748-48ebd913b75a None None] MFA Rules not processed for user `31e887a53109450ca52f0d08967f75bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:44.785940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-dc487c37-2e72-4191-9748-48ebd913b75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:44.977182 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2930/5906] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:23:44.981470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d536d-07b1-4236-a846-ea21ec1370ed admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:45.116203 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d536d-07b1-4236-a846-ea21ec1370ed admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:45.129745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14f0bd-560a-4a3d-a5f5-5fda0bdf544e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:45.133518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14f0bd-560a-4a3d-a5f5-5fda0bdf544e admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:45.134507 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14f0bd-560a-4a3d-a5f5-5fda0bdf544e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:45.135050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14f0bd-560a-4a3d-a5f5-5fda0bdf544e admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:45.136267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14f0bd-560a-4a3d-a5f5-5fda0bdf544e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:45.140471 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14f0bd-560a-4a3d-a5f5-5fda0bdf544e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:45.230090 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2977/5907] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:23:44 2022] POST /identity/v3/projects => generated 387 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:23:45.234272 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc487c37-2e72-4191-9748-48ebd913b75a None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:45.257626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc487c37-2e72-4191-9748-48ebd913b75a None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:45.382579 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae232513-d965-4780-9bed-7d25f6303683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:45.383498 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae232513-d965-4780-9bed-7d25f6303683 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:45.383636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae232513-d965-4780-9bed-7d25f6303683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:45.384116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae232513-d965-4780-9bed-7d25f6303683 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:45.384776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae232513-d965-4780-9bed-7d25f6303683 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:45.387519 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae232513-d965-4780-9bed-7d25f6303683 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:45.424164 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2931/5908] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:23:45 2022] POST /identity/v3/users => generated 300 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:23:45.428402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14f0bd-560a-4a3d-a5f5-5fda0bdf544e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:45.441254 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14f0bd-560a-4a3d-a5f5-5fda0bdf544e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:45.447882 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cd5f9-ecd2-44b2-a456-1f511fcf0d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:45.448746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cd5f9-ecd2-44b2-a456-1f511fcf0d56 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:45.449417 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cd5f9-ecd2-44b2-a456-1f511fcf0d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:45.450015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cd5f9-ecd2-44b2-a456-1f511fcf0d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:45.451138 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4cd5f9-ecd2-44b2-a456-1f511fcf0d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:45.453095 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4cd5f9-ecd2-44b2-a456-1f511fcf0d56 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:45.476171 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae232513-d965-4780-9bed-7d25f6303683 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:45.485538 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2978/5909] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:23:45.496863 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae232513-d965-4780-9bed-7d25f6303683 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:45.511403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44892798-cf96-4b75-ab08-4fe5de95811e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:45.512706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44892798-cf96-4b75-ab08-4fe5de95811e admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:45.512857 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44892798-cf96-4b75-ab08-4fe5de95811e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:45.515065 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44892798-cf96-4b75-ab08-4fe5de95811e admin admin] PATH_INFO: `/v3/projects/3970b68da5c04ab7b211c52d0284f0fb/users/78ab5ae121c748c5b7ea09c5ffe651e2/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:45.564393 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44892798-cf96-4b75-ab08-4fe5de95811e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3970b68da5c04ab7b211c52d0284f0fb, user_id=78ab5ae121c748c5b7ea09c5ffe651e2, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:45.573242 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44892798-cf96-4b75-ab08-4fe5de95811e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:45.604528 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2932/5910] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:23:45 2022] PUT /identity/v3/projects/3970b68da5c04ab7b211c52d0284f0fb/users/78ab5ae121c748c5b7ea09c5ffe651e2/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:45.606498 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cd5f9-ecd2-44b2-a456-1f511fcf0d56 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:45.626331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cd5f9-ecd2-44b2-a456-1f511fcf0d56 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:45.657364 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:45.750436 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b10cc-d484-43e1-8403-885002a73de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:45.750436 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b10cc-d484-43e1-8403-885002a73de9 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:45.750436 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b10cc-d484-43e1-8403-885002a73de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:45.750436 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b10cc-d484-43e1-8403-885002a73de9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:45.750953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b10cc-d484-43e1-8403-885002a73de9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:45.752368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b10cc-d484-43e1-8403-885002a73de9 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:45.768956 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2979/5911] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:23:45.770706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44892798-cf96-4b75-ab08-4fe5de95811e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:45.794570 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44892798-cf96-4b75-ab08-4fe5de95811e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:45.808392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985afb5c-4975-4a26-9abb-1450da9afe17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:45.809158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985afb5c-4975-4a26-9abb-1450da9afe17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:45.809561 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985afb5c-4975-4a26-9abb-1450da9afe17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:45.809905 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985afb5c-4975-4a26-9abb-1450da9afe17 admin admin] PATH_INFO: `/v3/projects/3970b68da5c04ab7b211c52d0284f0fb/users/78ab5ae121c748c5b7ea09c5ffe651e2/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:45.815902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985afb5c-4975-4a26-9abb-1450da9afe17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3970b68da5c04ab7b211c52d0284f0fb, user_id=78ab5ae121c748c5b7ea09c5ffe651e2, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:45.823083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985afb5c-4975-4a26-9abb-1450da9afe17 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:45.866275 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2933/5912] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:23:45 2022] PUT /identity/v3/projects/3970b68da5c04ab7b211c52d0284f0fb/users/78ab5ae121c748c5b7ea09c5ffe651e2/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:45.875183 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a47ea5-d69e-418d-8325-629700b3dd35 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:45.875949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a47ea5-d69e-418d-8325-629700b3dd35 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:45.876452 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a47ea5-d69e-418d-8325-629700b3dd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:45.934402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-42a47ea5-d69e-418d-8325-629700b3dd35 None None] MFA Rules not processed for user `78ab5ae121c748c5b7ea09c5ffe651e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:45.935994 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-42a47ea5-d69e-418d-8325-629700b3dd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:46.002553 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985afb5c-4975-4a26-9abb-1450da9afe17 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:46.005617 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-985afb5c-4975-4a26-9abb-1450da9afe17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:46.238838 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2980/5913] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:45 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:23:46.239243 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:46.246095 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a47ea5-d69e-418d-8325-629700b3dd35 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:46.247933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-42a47ea5-d69e-418d-8325-629700b3dd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:46.268337 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985afb5c-4975-4a26-9abb-1450da9afe17 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:46.291850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3effd2-f9ab-4a4e-ac0c-f2c6f5259c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:46.292508 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3effd2-f9ab-4a4e-ac0c-f2c6f5259c31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:46.292787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3effd2-f9ab-4a4e-ac0c-f2c6f5259c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:46.293060 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3effd2-f9ab-4a4e-ac0c-f2c6f5259c31 admin admin] PATH_INFO: `/v3/users/81cf18d8b7ea4aa4b6cf85c4a744d5b6` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:46.294251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3effd2-f9ab-4a4e-ac0c-f2c6f5259c31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81cf18d8b7ea4aa4b6cf85c4a744d5b6)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:46.296799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3effd2-f9ab-4a4e-ac0c-f2c6f5259c31 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:46.371412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6e3effd2-f9ab-4a4e-ac0c-f2c6f5259c31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81cf18d8b7ea4aa4b6cf85c4a744d5b6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:46.374469 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6e3effd2-f9ab-4a4e-ac0c-f2c6f5259c31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81cf18d8b7ea4aa4b6cf85c4a744d5b6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:46.391667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6e3effd2-f9ab-4a4e-ac0c-f2c6f5259c31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81cf18d8b7ea4aa4b6cf85c4a744d5b6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:46.391849 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a47ea5-d69e-418d-8325-629700b3dd35 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:46.408441 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6e3effd2-f9ab-4a4e-ac0c-f2c6f5259c31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81cf18d8b7ea4aa4b6cf85c4a744d5b6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:46.412544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c57d1-1486-4715-9771-a439d3d98734 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:46.413264 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c57d1-1486-4715-9771-a439d3d98734 service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:46.413463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c57d1-1486-4715-9771-a439d3d98734 service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:46.413740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c57d1-1486-4715-9771-a439d3d98734 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:46.416012 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6e3effd2-f9ab-4a4e-ac0c-f2c6f5259c31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81cf18d8b7ea4aa4b6cf85c4a744d5b6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:46.421544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-907c57d1-1486-4715-9771-a439d3d98734 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:46.448047 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c57d1-1486-4715-9771-a439d3d98734 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:46.449246 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c57d1-1486-4715-9771-a439d3d98734 service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:46.453673 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2934/5914] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:23:46 2022] DELETE /identity/v3/users/81cf18d8b7ea4aa4b6cf85c4a744d5b6 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:46.458608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824eef1-b199-4539-a395-f145a3f7a5f5 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:46.458907 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824eef1-b199-4539-a395-f145a3f7a5f5 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:46.459157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824eef1-b199-4539-a395-f145a3f7a5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:46.470829 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2981/5915] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:23:46 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:23:46.529718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-9824eef1-b199-4539-a395-f145a3f7a5f5 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:46.530956 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9824eef1-b199-4539-a395-f145a3f7a5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:46.749054 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2935/5916] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:23:46.781164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c57d1-1486-4715-9771-a439d3d98734 service cinder] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:46.782715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-907c57d1-1486-4715-9771-a439d3d98734 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:46.818744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c57d1-1486-4715-9771-a439d3d98734 service cinder] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:46.828614 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ec404-7be2-437f-8676-627acebb3374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:46.830084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ec404-7be2-437f-8676-627acebb3374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:46.830603 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ec404-7be2-437f-8676-627acebb3374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:46.832515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ec404-7be2-437f-8676-627acebb3374 admin admin] PATH_INFO: `/v3/users/31e887a53109450ca52f0d08967f75bf` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:46.836649 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ec404-7be2-437f-8676-627acebb3374 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31e887a53109450ca52f0d08967f75bf)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:46.842491 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ec404-7be2-437f-8676-627acebb3374 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:46.887032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824eef1-b199-4539-a395-f145a3f7a5f5 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:46.888504 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9824eef1-b199-4539-a395-f145a3f7a5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:46.909392 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:46.932128 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ce7ec404-7be2-437f-8676-627acebb3374 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31e887a53109450ca52f0d08967f75bf'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:46.933365 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ce7ec404-7be2-437f-8676-627acebb3374 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31e887a53109450ca52f0d08967f75bf'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:46.944481 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ce7ec404-7be2-437f-8676-627acebb3374 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31e887a53109450ca52f0d08967f75bf'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:46.958034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ce7ec404-7be2-437f-8676-627acebb3374 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31e887a53109450ca52f0d08967f75bf'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:46.960435 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ce7ec404-7be2-437f-8676-627acebb3374 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31e887a53109450ca52f0d08967f75bf'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:46.992989 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2982/5917] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:23:46 2022] DELETE /identity/v3/users/31e887a53109450ca52f0d08967f75bf => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:46.997210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270a795-f506-4119-9b74-e060996d62d0 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:46.997741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270a795-f506-4119-9b74-e060996d62d0 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:46.998863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270a795-f506-4119-9b74-e060996d62d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:47.004953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824eef1-b199-4539-a395-f145a3f7a5f5 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:47.032053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-0270a795-f506-4119-9b74-e060996d62d0 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:47.033519 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0270a795-f506-4119-9b74-e060996d62d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:47.063446 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:47.108896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2dda5-6117-43bb-ac5d-1d873bf507ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:47.109504 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2dda5-6117-43bb-ac5d-1d873bf507ab service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:47.109787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2dda5-6117-43bb-ac5d-1d873bf507ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:47.110084 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2dda5-6117-43bb-ac5d-1d873bf507ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:47.111906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c3c2dda5-6117-43bb-ac5d-1d873bf507ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:47.144329 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2983/5918] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:23:47.147857 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2dda5-6117-43bb-ac5d-1d873bf507ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:47.149465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2dda5-6117-43bb-ac5d-1d873bf507ab service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:47.158530 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270a795-f506-4119-9b74-e060996d62d0 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:47.160570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0270a795-f506-4119-9b74-e060996d62d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:47.161778 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2936/5919] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:23:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:23:47.203257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270a795-f506-4119-9b74-e060996d62d0 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:47.211905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd00bb2-1d21-43f0-9e05-3f7a1b2ade30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:47.212874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd00bb2-1d21-43f0-9e05-3f7a1b2ade30 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:47.213513 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd00bb2-1d21-43f0-9e05-3f7a1b2ade30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:47.213971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd00bb2-1d21-43f0-9e05-3f7a1b2ade30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:47.237779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd00bb2-1d21-43f0-9e05-3f7a1b2ade30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:47.239743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd00bb2-1d21-43f0-9e05-3f7a1b2ade30 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:47.256129 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2984/5920] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:23:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:23:48.047498 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2dda5-6117-43bb-ac5d-1d873bf507ab service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:48.052880 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c3c2dda5-6117-43bb-ac5d-1d873bf507ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:48.068006 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2dda5-6117-43bb-ac5d-1d873bf507ab service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:48.078851 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce24222-c816-43f6-a002-1c15b59a1699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:48.079697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce24222-c816-43f6-a002-1c15b59a1699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:48.081068 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce24222-c816-43f6-a002-1c15b59a1699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:48.081759 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce24222-c816-43f6-a002-1c15b59a1699 admin admin] PATH_INFO: `/v3/projects/790725ee598a4f05b2b2d70f670be6aa` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:48.089072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce24222-c816-43f6-a002-1c15b59a1699 admin admin] RBAC: Authorizing `identity:delete_project(project_id=790725ee598a4f05b2b2d70f670be6aa)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:48.091507 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce24222-c816-43f6-a002-1c15b59a1699 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:48.199406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dce24222-c816-43f6-a002-1c15b59a1699 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '790725ee598a4f05b2b2d70f670be6aa', 'request_id': 'req-dce24222-c816-43f6-a002-1c15b59a1699'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:48.211438 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dce24222-c816-43f6-a002-1c15b59a1699 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '790725ee598a4f05b2b2d70f670be6aa', 'request_id': 'req-dce24222-c816-43f6-a002-1c15b59a1699'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:48.219796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dce24222-c816-43f6-a002-1c15b59a1699 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '790725ee598a4f05b2b2d70f670be6aa', 'request_id': 'req-dce24222-c816-43f6-a002-1c15b59a1699'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:48.238618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dce24222-c816-43f6-a002-1c15b59a1699 admin admin] The token cache is being invalidate because project 790725ee598a4f05b2b2d70f670be6aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:23:48.239957 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dce24222-c816-43f6-a002-1c15b59a1699 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:48.243006 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dce24222-c816-43f6-a002-1c15b59a1699 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:48.251571 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2937/5921] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:23:48 2022] DELETE /identity/v3/projects/790725ee598a4f05b2b2d70f670be6aa => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:48.255044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd00bb2-1d21-43f0-9e05-3f7a1b2ade30 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:48.271748 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd00bb2-1d21-43f0-9e05-3f7a1b2ade30 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:48.390600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95eb0a-a324-495a-9e72-074f17520709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:48.391414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95eb0a-a324-495a-9e72-074f17520709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:48.391576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95eb0a-a324-495a-9e72-074f17520709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:48.391744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95eb0a-a324-495a-9e72-074f17520709 admin admin] PATH_INFO: `/v3/users/78ab5ae121c748c5b7ea09c5ffe651e2` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:48.402332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95eb0a-a324-495a-9e72-074f17520709 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78ab5ae121c748c5b7ea09c5ffe651e2)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:48.404252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95eb0a-a324-495a-9e72-074f17520709 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:48.494992 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce24222-c816-43f6-a002-1c15b59a1699 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:48.496640 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-dce24222-c816-43f6-a002-1c15b59a1699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:48.506045 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:48.518478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4e95eb0a-a324-495a-9e72-074f17520709 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78ab5ae121c748c5b7ea09c5ffe651e2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:48.519336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4e95eb0a-a324-495a-9e72-074f17520709 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78ab5ae121c748c5b7ea09c5ffe651e2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:48.519899 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce24222-c816-43f6-a002-1c15b59a1699 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:48.532962 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b962b32-552d-46f8-9371-eb4c74009a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:48.534574 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b962b32-552d-46f8-9371-eb4c74009a0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:48.535021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b962b32-552d-46f8-9371-eb4c74009a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:48.535362 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b962b32-552d-46f8-9371-eb4c74009a0e admin admin] PATH_INFO: `/v3/projects/6b8affec378c41bf9bce8b4bda33d639` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:48.538265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4e95eb0a-a324-495a-9e72-074f17520709 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78ab5ae121c748c5b7ea09c5ffe651e2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:48.540350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b962b32-552d-46f8-9371-eb4c74009a0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b8affec378c41bf9bce8b4bda33d639)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:48.543457 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b962b32-552d-46f8-9371-eb4c74009a0e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:48.554873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4e95eb0a-a324-495a-9e72-074f17520709 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78ab5ae121c748c5b7ea09c5ffe651e2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:48.555589 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4e95eb0a-a324-495a-9e72-074f17520709 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78ab5ae121c748c5b7ea09c5ffe651e2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:48.588274 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2985/5922] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:23:48 2022] DELETE /identity/v3/users/78ab5ae121c748c5b7ea09c5ffe651e2 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:48.644457 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2b962b32-552d-46f8-9371-eb4c74009a0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b8affec378c41bf9bce8b4bda33d639', 'request_id': 'req-2b962b32-552d-46f8-9371-eb4c74009a0e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:48.661895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2b962b32-552d-46f8-9371-eb4c74009a0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b8affec378c41bf9bce8b4bda33d639', 'request_id': 'req-2b962b32-552d-46f8-9371-eb4c74009a0e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:48.673947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2b962b32-552d-46f8-9371-eb4c74009a0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b8affec378c41bf9bce8b4bda33d639', 'request_id': 'req-2b962b32-552d-46f8-9371-eb4c74009a0e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:48.704380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2b962b32-552d-46f8-9371-eb4c74009a0e admin admin] The token cache is being invalidate because project 6b8affec378c41bf9bce8b4bda33d639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:23:48.705315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2b962b32-552d-46f8-9371-eb4c74009a0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:48.707938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2b962b32-552d-46f8-9371-eb4c74009a0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:48.711310 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2938/5923] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:23:48 2022] DELETE /identity/v3/projects/6b8affec378c41bf9bce8b4bda33d639 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:48.715268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95eb0a-a324-495a-9e72-074f17520709 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:48.717344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4e95eb0a-a324-495a-9e72-074f17520709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:48.821778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95eb0a-a324-495a-9e72-074f17520709 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:48.932024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad573aa2-87be-4fb4-8881-d168728efaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:48.932769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad573aa2-87be-4fb4-8881-d168728efaa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:48.933047 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad573aa2-87be-4fb4-8881-d168728efaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:48.933319 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad573aa2-87be-4fb4-8881-d168728efaa1 admin admin] PATH_INFO: `/v3/users/8d496d61685748cfbaddd1e52762e83f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:48.935159 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad573aa2-87be-4fb4-8881-d168728efaa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d496d61685748cfbaddd1e52762e83f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:48.936579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad573aa2-87be-4fb4-8881-d168728efaa1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:49.034874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ad573aa2-87be-4fb4-8881-d168728efaa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d496d61685748cfbaddd1e52762e83f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:49.038019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ad573aa2-87be-4fb4-8881-d168728efaa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d496d61685748cfbaddd1e52762e83f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:49.054213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ad573aa2-87be-4fb4-8881-d168728efaa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d496d61685748cfbaddd1e52762e83f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:49.074527 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ad573aa2-87be-4fb4-8881-d168728efaa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d496d61685748cfbaddd1e52762e83f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:49.075708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ad573aa2-87be-4fb4-8881-d168728efaa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d496d61685748cfbaddd1e52762e83f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:49.082511 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:49.104685 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2986/5924] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:23:48 2022] DELETE /identity/v3/users/8d496d61685748cfbaddd1e52762e83f => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:49.638620 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b962b32-552d-46f8-9371-eb4c74009a0e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:49.640242 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2b962b32-552d-46f8-9371-eb4c74009a0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:49.663321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b962b32-552d-46f8-9371-eb4c74009a0e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:49.729665 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:49.766651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e29b0e-013d-4c0d-ac19-f351434383ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:49.767862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e29b0e-013d-4c0d-ac19-f351434383ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:49.768979 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e29b0e-013d-4c0d-ac19-f351434383ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:49.769593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e29b0e-013d-4c0d-ac19-f351434383ad admin admin] PATH_INFO: `/v3/projects/23247ede4e864163b4c35bd09a03097e` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:49.771629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e29b0e-013d-4c0d-ac19-f351434383ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=23247ede4e864163b4c35bd09a03097e)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:49.775323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e29b0e-013d-4c0d-ac19-f351434383ad admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:49.844734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-83e29b0e-013d-4c0d-ac19-f351434383ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23247ede4e864163b4c35bd09a03097e', 'request_id': 'req-83e29b0e-013d-4c0d-ac19-f351434383ad'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:49.864805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-83e29b0e-013d-4c0d-ac19-f351434383ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23247ede4e864163b4c35bd09a03097e', 'request_id': 'req-83e29b0e-013d-4c0d-ac19-f351434383ad'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:49.897119 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad573aa2-87be-4fb4-8881-d168728efaa1 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:49.898854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ad573aa2-87be-4fb4-8881-d168728efaa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:49.902617 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-83e29b0e-013d-4c0d-ac19-f351434383ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23247ede4e864163b4c35bd09a03097e', 'request_id': 'req-83e29b0e-013d-4c0d-ac19-f351434383ad'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:49.944000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad573aa2-87be-4fb4-8881-d168728efaa1 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:49.950122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-83e29b0e-013d-4c0d-ac19-f351434383ad admin admin] The token cache is being invalidate because project 23247ede4e864163b4c35bd09a03097e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:23:49.950465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-83e29b0e-013d-4c0d-ac19-f351434383ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:49.953851 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-83e29b0e-013d-4c0d-ac19-f351434383ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:49.959298 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2939/5925] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:23:49 2022] DELETE /identity/v3/projects/23247ede4e864163b4c35bd09a03097e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:49.960814 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78019d1c-0d61-4476-94b3-625e0aa0781e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:49.961109 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78019d1c-0d61-4476-94b3-625e0aa0781e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:49.961448 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78019d1c-0d61-4476-94b3-625e0aa0781e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:50.006859 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-78019d1c-0d61-4476-94b3-625e0aa0781e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:50.011178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-78019d1c-0d61-4476-94b3-625e0aa0781e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:50.147511 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2940/5926] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:23:50.154536 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe2735-39c1-4c8f-a21f-dd5b251d79c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:50.158096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a39d7f-77e8-4457-9530-e6b31808d788 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:50.158096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a39d7f-77e8-4457-9530-e6b31808d788 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:50.158096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a39d7f-77e8-4457-9530-e6b31808d788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:50.158586 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe2735-39c1-4c8f-a21f-dd5b251d79c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:50.158586 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe2735-39c1-4c8f-a21f-dd5b251d79c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:50.158586 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe2735-39c1-4c8f-a21f-dd5b251d79c9 admin admin] PATH_INFO: `/v3/projects/3970b68da5c04ab7b211c52d0284f0fb` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:50.159830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe2735-39c1-4c8f-a21f-dd5b251d79c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3970b68da5c04ab7b211c52d0284f0fb)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:50.161842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe2735-39c1-4c8f-a21f-dd5b251d79c9 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:50.202797 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-33a39d7f-77e8-4457-9530-e6b31808d788 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:50.204058 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-33a39d7f-77e8-4457-9530-e6b31808d788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:50.229219 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2941/5927] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:23:50.233210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a39d7f-77e8-4457-9530-e6b31808d788 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:50.258750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a39d7f-77e8-4457-9530-e6b31808d788 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:50.290224 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d5fe2735-39c1-4c8f-a21f-dd5b251d79c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3970b68da5c04ab7b211c52d0284f0fb', 'request_id': 'req-d5fe2735-39c1-4c8f-a21f-dd5b251d79c9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:50.309834 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d5fe2735-39c1-4c8f-a21f-dd5b251d79c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3970b68da5c04ab7b211c52d0284f0fb', 'request_id': 'req-d5fe2735-39c1-4c8f-a21f-dd5b251d79c9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:50.319565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d5fe2735-39c1-4c8f-a21f-dd5b251d79c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3970b68da5c04ab7b211c52d0284f0fb', 'request_id': 'req-d5fe2735-39c1-4c8f-a21f-dd5b251d79c9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:50.346690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d5fe2735-39c1-4c8f-a21f-dd5b251d79c9 admin admin] The token cache is being invalidate because project 3970b68da5c04ab7b211c52d0284f0fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:23:50.347031 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d5fe2735-39c1-4c8f-a21f-dd5b251d79c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:50.348452 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d5fe2735-39c1-4c8f-a21f-dd5b251d79c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:50.352998 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2987/5928] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:23:49 2022] DELETE /identity/v3/projects/3970b68da5c04ab7b211c52d0284f0fb => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:23:50.359560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a7948-a800-4187-bb26-a8b7a1b018b1 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:50.359853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a7948-a800-4187-bb26-a8b7a1b018b1 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:50.360134 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a7948-a800-4187-bb26-a8b7a1b018b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:50.390101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-6f3a7948-a800-4187-bb26-a8b7a1b018b1 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:50.392694 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6f3a7948-a800-4187-bb26-a8b7a1b018b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:50.398206 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab9a91-72f5-4de8-a3ae-507a84f4d796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:50.398872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab9a91-72f5-4de8-a3ae-507a84f4d796 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:50.399248 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab9a91-72f5-4de8-a3ae-507a84f4d796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:50.399534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab9a91-72f5-4de8-a3ae-507a84f4d796 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:50.400305 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab9a91-72f5-4de8-a3ae-507a84f4d796 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:23:50.400611 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab9a91-72f5-4de8-a3ae-507a84f4d796 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:50.402254 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab9a91-72f5-4de8-a3ae-507a84f4d796 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:50.411273 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2988/5929] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:23:50.415063 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8477a-2265-43e9-aebe-2b083274d60f None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:50.415361 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8477a-2265-43e9-aebe-2b083274d60f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:50.415636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8477a-2265-43e9-aebe-2b083274d60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:50.416179 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:50.433901 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2942/5930] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:23:50.436946 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab9a91-72f5-4de8-a3ae-507a84f4d796 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:50.439174 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-54ab9a91-72f5-4de8-a3ae-507a84f4d796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:50.444371 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c5c8477a-2265-43e9-aebe-2b083274d60f None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:50.445870 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c5c8477a-2265-43e9-aebe-2b083274d60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:50.459420 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2989/5931] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:23:50.463539 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8477a-2265-43e9-aebe-2b083274d60f None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:50.463837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab9a91-72f5-4de8-a3ae-507a84f4d796 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:50.470746 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef009a8a-4d5c-43a5-b888-af6e315f868f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:50.472435 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef009a8a-4d5c-43a5-b888-af6e315f868f admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:50.472917 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef009a8a-4d5c-43a5-b888-af6e315f868f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:50.473387 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef009a8a-4d5c-43a5-b888-af6e315f868f admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:50.474262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8477a-2265-43e9-aebe-2b083274d60f None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:50.474488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef009a8a-4d5c-43a5-b888-af6e315f868f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:50.477315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef009a8a-4d5c-43a5-b888-af6e315f868f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:50.479576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460db1f-77bf-4855-a083-5840deb53463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:50.480275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460db1f-77bf-4855-a083-5840deb53463 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:50.480622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460db1f-77bf-4855-a083-5840deb53463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:50.480968 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460db1f-77bf-4855-a083-5840deb53463 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:50.481864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460db1f-77bf-4855-a083-5840deb53463 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:23:50.482271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460db1f-77bf-4855-a083-5840deb53463 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:50.483950 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460db1f-77bf-4855-a083-5840deb53463 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:50.502790 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2990/5932] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:23:50.503870 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460db1f-77bf-4855-a083-5840deb53463 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:50.519174 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460db1f-77bf-4855-a083-5840deb53463 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:50.536695 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2943/5933] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:23:50 2022] POST /identity/v3/projects => generated 393 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:23:50.539117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef009a8a-4d5c-43a5-b888-af6e315f868f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:50.540156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57128694-09a5-47e5-a1b8-464a3489d262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:50.540792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57128694-09a5-47e5-a1b8-464a3489d262 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:50.541660 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57128694-09a5-47e5-a1b8-464a3489d262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:50.541939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57128694-09a5-47e5-a1b8-464a3489d262 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:50.542598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57128694-09a5-47e5-a1b8-464a3489d262 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:50.545598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57128694-09a5-47e5-a1b8-464a3489d262 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:50.588264 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2991/5934] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:23:50 2022] POST /identity/v3/projects => generated 407 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:23:50.592680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57128694-09a5-47e5-a1b8-464a3489d262 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:50.635592 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:50.664593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef009a8a-4d5c-43a5-b888-af6e315f868f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:50.692942 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57128694-09a5-47e5-a1b8-464a3489d262 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:50.719008 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6deab0-1ca6-4151-b0ee-2309e7b3e2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:50.719792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6deab0-1ca6-4151-b0ee-2309e7b3e2a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:50.720230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6deab0-1ca6-4151-b0ee-2309e7b3e2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:50.720515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6deab0-1ca6-4151-b0ee-2309e7b3e2a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:50.721921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6deab0-1ca6-4151-b0ee-2309e7b3e2a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:50.726362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6deab0-1ca6-4151-b0ee-2309e7b3e2a8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:50.735093 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882a627-672a-4fa4-bc63-74f4a3bf5e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:50.736460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882a627-672a-4fa4-bc63-74f4a3bf5e97 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:50.736460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882a627-672a-4fa4-bc63-74f4a3bf5e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:50.736460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882a627-672a-4fa4-bc63-74f4a3bf5e97 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:50.736848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b882a627-672a-4fa4-bc63-74f4a3bf5e97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:50.739668 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b882a627-672a-4fa4-bc63-74f4a3bf5e97 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:50.774810 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2992/5935] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:23:50 2022] POST /identity/v3/users => generated 304 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:23:50.776050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6deab0-1ca6-4151-b0ee-2309e7b3e2a8 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:50.781072 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2944/5936] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:23:50 2022] POST /identity/v3/users => generated 297 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:23:50.782400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882a627-672a-4fa4-bc63-74f4a3bf5e97 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:50.790930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6deab0-1ca6-4151-b0ee-2309e7b3e2a8 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:50.796583 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882a627-672a-4fa4-bc63-74f4a3bf5e97 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:50.797417 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcc46e-2b0f-4abb-b78f-fd1449e5c849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:50.798267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcc46e-2b0f-4abb-b78f-fd1449e5c849 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:50.798650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcc46e-2b0f-4abb-b78f-fd1449e5c849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:50.799025 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcc46e-2b0f-4abb-b78f-fd1449e5c849 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:50.800444 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bcc46e-2b0f-4abb-b78f-fd1449e5c849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:50.803059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bcc46e-2b0f-4abb-b78f-fd1449e5c849 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:50.805876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528237dc-3fe7-4489-a576-b258c32cfa14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:50.807290 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528237dc-3fe7-4489-a576-b258c32cfa14 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:50.807852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528237dc-3fe7-4489-a576-b258c32cfa14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:50.808346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528237dc-3fe7-4489-a576-b258c32cfa14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:50.809238 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528237dc-3fe7-4489-a576-b258c32cfa14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:50.811810 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528237dc-3fe7-4489-a576-b258c32cfa14 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:50.822145 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2993/5937] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:23:50.823430 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcc46e-2b0f-4abb-b78f-fd1449e5c849 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:50.828429 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2945/5938] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:23:50.832861 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528237dc-3fe7-4489-a576-b258c32cfa14 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:50.836596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcc46e-2b0f-4abb-b78f-fd1449e5c849 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:50.842217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a5d1d-bea4-48ed-b870-18d7bb3cd49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:50.843420 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a5d1d-bea4-48ed-b870-18d7bb3cd49b admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:50.844475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a5d1d-bea4-48ed-b870-18d7bb3cd49b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:50.844861 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a5d1d-bea4-48ed-b870-18d7bb3cd49b admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:50.845142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528237dc-3fe7-4489-a576-b258c32cfa14 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:50.846090 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a5d1d-bea4-48ed-b870-18d7bb3cd49b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:50.849244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a5d1d-bea4-48ed-b870-18d7bb3cd49b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:50.854120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62379a0-e75c-40bb-bfc1-f1ec7a0e087d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:50.854919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62379a0-e75c-40bb-bfc1-f1ec7a0e087d admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:50.855379 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62379a0-e75c-40bb-bfc1-f1ec7a0e087d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:50.855821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62379a0-e75c-40bb-bfc1-f1ec7a0e087d admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:50.856659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62379a0-e75c-40bb-bfc1-f1ec7a0e087d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:50.859150 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62379a0-e75c-40bb-bfc1-f1ec7a0e087d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:50.869165 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2994/5939] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:23:50.870406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a5d1d-bea4-48ed-b870-18d7bb3cd49b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:50.874985 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2946/5940] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:23:50.880465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62379a0-e75c-40bb-bfc1-f1ec7a0e087d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:50.888612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a5d1d-bea4-48ed-b870-18d7bb3cd49b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:50.897876 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a23fed-fc44-4dd4-885b-b63797633a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:50.898655 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a23fed-fc44-4dd4-885b-b63797633a13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:50.898862 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a23fed-fc44-4dd4-885b-b63797633a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:50.899910 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a23fed-fc44-4dd4-885b-b63797633a13 admin admin] PATH_INFO: `/v3/projects/9b7ce4b0a7b642eda715c5f84dfd8b6a/users/5c98702486964510b7fd15a42af3f563/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:50.905968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62379a0-e75c-40bb-bfc1-f1ec7a0e087d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:50.917226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027312c4-cc00-490d-be77-85cb9012569e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:50.918332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027312c4-cc00-490d-be77-85cb9012569e admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:50.919124 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027312c4-cc00-490d-be77-85cb9012569e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:50.919826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027312c4-cc00-490d-be77-85cb9012569e admin admin] PATH_INFO: `/v3/projects/47f24a1ee7bc4960a2756e747eeb52aa/users/197b50455702458b86039c8c7cc3f2dd/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:50.924624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a23fed-fc44-4dd4-885b-b63797633a13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b7ce4b0a7b642eda715c5f84dfd8b6a, user_id=5c98702486964510b7fd15a42af3f563, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:50.929392 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a23fed-fc44-4dd4-885b-b63797633a13 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:50.944576 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027312c4-cc00-490d-be77-85cb9012569e admin admin] RBAC: Authorizing `identity:create_grant(project_id=47f24a1ee7bc4960a2756e747eeb52aa, user_id=197b50455702458b86039c8c7cc3f2dd, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:50.949021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027312c4-cc00-490d-be77-85cb9012569e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:50.988103 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2947/5942] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:23:50 2022] PUT /identity/v3/projects/47f24a1ee7bc4960a2756e747eeb52aa/users/197b50455702458b86039c8c7cc3f2dd/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:23:51.003816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab07589-c175-459e-8ee0-967c9c02284e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:51.003816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab07589-c175-459e-8ee0-967c9c02284e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:51.003816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab07589-c175-459e-8ee0-967c9c02284e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:51.006657 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2995/5942] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:23:50 2022] PUT /identity/v3/projects/9b7ce4b0a7b642eda715c5f84dfd8b6a/users/5c98702486964510b7fd15a42af3f563/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:51.046071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-dab07589-c175-459e-8ee0-967c9c02284e None None] MFA Rules not processed for user `197b50455702458b86039c8c7cc3f2dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:51.047245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-dab07589-c175-459e-8ee0-967c9c02284e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:51.062728 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:51.107835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f730c3f-2e03-4685-84ef-6c188a8158dc None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:51.107835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f730c3f-2e03-4685-84ef-6c188a8158dc None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:51.108284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f730c3f-2e03-4685-84ef-6c188a8158dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:51.146440 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-4f730c3f-2e03-4685-84ef-6c188a8158dc None None] MFA Rules not processed for user `5c98702486964510b7fd15a42af3f563`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:51.147792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4f730c3f-2e03-4685-84ef-6c188a8158dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:51.173798 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2948/5943] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:23:51.179079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab07589-c175-459e-8ee0-967c9c02284e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:51.322749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab07589-c175-459e-8ee0-967c9c02284e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:51.337914 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc106198-1d38-418a-81ce-71a6d060a811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:51.339187 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc106198-1d38-418a-81ce-71a6d060a811 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:51.339509 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc106198-1d38-418a-81ce-71a6d060a811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:51.339811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc106198-1d38-418a-81ce-71a6d060a811 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:51.341965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc106198-1d38-418a-81ce-71a6d060a811 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:51.345611 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc106198-1d38-418a-81ce-71a6d060a811 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:51.351945 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2996/5944] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:51 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:23:51.356574 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f730c3f-2e03-4685-84ef-6c188a8158dc None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:51.385018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f730c3f-2e03-4685-84ef-6c188a8158dc None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:51.399296 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696479fa-ec30-45e8-8397-1fc516109d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:51.401335 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696479fa-ec30-45e8-8397-1fc516109d28 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:51.401886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696479fa-ec30-45e8-8397-1fc516109d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:51.402478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696479fa-ec30-45e8-8397-1fc516109d28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:51.403358 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696479fa-ec30-45e8-8397-1fc516109d28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:51.405613 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696479fa-ec30-45e8-8397-1fc516109d28 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:51.422742 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2949/5945] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:23:51 2022] POST /identity/v3/projects => generated 393 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:23:51.423738 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc106198-1d38-418a-81ce-71a6d060a811 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:51.495583 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2997/5946] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:23:51 2022] POST /identity/v3/projects => generated 409 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:23:51.503383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696479fa-ec30-45e8-8397-1fc516109d28 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:51.551329 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc106198-1d38-418a-81ce-71a6d060a811 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:51.566294 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:51.607528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696479fa-ec30-45e8-8397-1fc516109d28 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:51.614829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b827b4b-1dcd-4ef3-b639-9e773f5ba628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:51.615805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b827b4b-1dcd-4ef3-b639-9e773f5ba628 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:51.616304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b827b4b-1dcd-4ef3-b639-9e773f5ba628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:51.616945 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b827b4b-1dcd-4ef3-b639-9e773f5ba628 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:51.617871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b827b4b-1dcd-4ef3-b639-9e773f5ba628 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:51.618169 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:51.620745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b827b4b-1dcd-4ef3-b639-9e773f5ba628 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:51.637745 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ef407-74f9-4aec-9a0e-9ec1de9a2f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:51.638415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ef407-74f9-4aec-9a0e-9ec1de9a2f94 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:51.638887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ef407-74f9-4aec-9a0e-9ec1de9a2f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:51.639193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ef407-74f9-4aec-9a0e-9ec1de9a2f94 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:51.639867 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ef407-74f9-4aec-9a0e-9ec1de9a2f94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:51.641978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ef407-74f9-4aec-9a0e-9ec1de9a2f94 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:51.651265 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2998/5947] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:23:51 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:23:51.654810 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b827b4b-1dcd-4ef3-b639-9e773f5ba628 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:51.667890 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b827b4b-1dcd-4ef3-b639-9e773f5ba628 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:51.675219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2870b-c9d9-40b3-a1f2-fae70b76aa12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:51.676010 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2870b-c9d9-40b3-a1f2-fae70b76aa12 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:51.676404 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2870b-c9d9-40b3-a1f2-fae70b76aa12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:51.676619 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2870b-c9d9-40b3-a1f2-fae70b76aa12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:51.677406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b2870b-c9d9-40b3-a1f2-fae70b76aa12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:51.678841 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2950/5948] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:23:51 2022] POST /identity/v3/users => generated 303 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:23:51.679307 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b2870b-c9d9-40b3-a1f2-fae70b76aa12 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:51.684669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ef407-74f9-4aec-9a0e-9ec1de9a2f94 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:51.697145 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 2999/5949] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:23:51.698428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2870b-c9d9-40b3-a1f2-fae70b76aa12 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:51.705890 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ef407-74f9-4aec-9a0e-9ec1de9a2f94 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:51.709705 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2870b-c9d9-40b3-a1f2-fae70b76aa12 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:51.712630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f372840-bcfa-4343-b31f-116555ad4072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:51.713521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f372840-bcfa-4343-b31f-116555ad4072 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:51.714024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f372840-bcfa-4343-b31f-116555ad4072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:51.714640 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f372840-bcfa-4343-b31f-116555ad4072 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:51.715061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a81be-5edc-4f72-83a9-825ba52d7ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:51.715723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f372840-bcfa-4343-b31f-116555ad4072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:51.715903 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a81be-5edc-4f72-83a9-825ba52d7ce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:51.716176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a81be-5edc-4f72-83a9-825ba52d7ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:51.716626 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a81be-5edc-4f72-83a9-825ba52d7ce5 admin admin] PATH_INFO: `/v3/projects/7079d55caaea4a57a731ff68dc343b1a/users/b34e8c1993814896a96f70f79f9bd269/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:51.718342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f372840-bcfa-4343-b31f-116555ad4072 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:51.734496 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2951/5950] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:23:51.738009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a81be-5edc-4f72-83a9-825ba52d7ce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7079d55caaea4a57a731ff68dc343b1a, user_id=b34e8c1993814896a96f70f79f9bd269, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:51.739150 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f372840-bcfa-4343-b31f-116555ad4072 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:51.742736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a81be-5edc-4f72-83a9-825ba52d7ce5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:51.754684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f372840-bcfa-4343-b31f-116555ad4072 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:51.767659 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3000/5951] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:23:51 2022] PUT /identity/v3/projects/7079d55caaea4a57a731ff68dc343b1a/users/b34e8c1993814896a96f70f79f9bd269/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:51.774449 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a81be-5edc-4f72-83a9-825ba52d7ce5 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:51.837012 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d48678-e8f8-489f-b0db-f1e9cada9364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:51.838131 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d48678-e8f8-489f-b0db-f1e9cada9364 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:51.838518 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d48678-e8f8-489f-b0db-f1e9cada9364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:51.838895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d48678-e8f8-489f-b0db-f1e9cada9364 admin admin] PATH_INFO: `/v3/projects/1643746e991a4d3c9238337dc815f6df/users/16741a706fed476095f71206da028d3e/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:51.856565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d48678-e8f8-489f-b0db-f1e9cada9364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1643746e991a4d3c9238337dc815f6df, user_id=16741a706fed476095f71206da028d3e, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:51.859688 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d48678-e8f8-489f-b0db-f1e9cada9364 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:51.861123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a81be-5edc-4f72-83a9-825ba52d7ce5 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:51.867489 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557fb383-54ab-4830-b505-6a9aedf8663d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:51.868367 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fb383-54ab-4830-b505-6a9aedf8663d admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:51.868612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fb383-54ab-4830-b505-6a9aedf8663d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:51.868858 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fb383-54ab-4830-b505-6a9aedf8663d admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:51.869530 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557fb383-54ab-4830-b505-6a9aedf8663d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:51.871264 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557fb383-54ab-4830-b505-6a9aedf8663d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:51.879002 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2952/5952] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:23:51 2022] PUT /identity/v3/projects/1643746e991a4d3c9238337dc815f6df/users/16741a706fed476095f71206da028d3e/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:51.882942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d48678-e8f8-489f-b0db-f1e9cada9364 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:51.887985 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3001/5953] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:23:51.889123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557fb383-54ab-4830-b505-6a9aedf8663d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:51.901197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557fb383-54ab-4830-b505-6a9aedf8663d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:51.953544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d48678-e8f8-489f-b0db-f1e9cada9364 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:51.959140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ac108-a13b-46c6-9a1e-8fe6146fa311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:51.959909 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ac108-a13b-46c6-9a1e-8fe6146fa311 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:51.960196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ac108-a13b-46c6-9a1e-8fe6146fa311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:51.960621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ac108-a13b-46c6-9a1e-8fe6146fa311 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:51.961274 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ac108-a13b-46c6-9a1e-8fe6146fa311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:51.963065 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ac108-a13b-46c6-9a1e-8fe6146fa311 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:51.977806 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2953/5954] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:23:51.978823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ac108-a13b-46c6-9a1e-8fe6146fa311 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:51.989709 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ac108-a13b-46c6-9a1e-8fe6146fa311 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:51.994686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165defe-9435-40c0-9fc6-7bf23e92b532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:51.995356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165defe-9435-40c0-9fc6-7bf23e92b532 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:51.995638 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165defe-9435-40c0-9fc6-7bf23e92b532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:51.995917 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165defe-9435-40c0-9fc6-7bf23e92b532 admin admin] PATH_INFO: `/v3/projects/1643746e991a4d3c9238337dc815f6df/users/16741a706fed476095f71206da028d3e/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:51.997924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165defe-9435-40c0-9fc6-7bf23e92b532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1643746e991a4d3c9238337dc815f6df, user_id=16741a706fed476095f71206da028d3e, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:52.000593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165defe-9435-40c0-9fc6-7bf23e92b532 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:52.007756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc035ed-6495-4f8a-9c37-59cf814ce25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:52.009080 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc035ed-6495-4f8a-9c37-59cf814ce25a admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:52.009960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc035ed-6495-4f8a-9c37-59cf814ce25a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:52.011468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc035ed-6495-4f8a-9c37-59cf814ce25a admin admin] PATH_INFO: `/v3/projects/7079d55caaea4a57a731ff68dc343b1a/users/b34e8c1993814896a96f70f79f9bd269/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:52.014264 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc035ed-6495-4f8a-9c37-59cf814ce25a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7079d55caaea4a57a731ff68dc343b1a, user_id=b34e8c1993814896a96f70f79f9bd269, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:52.017925 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc035ed-6495-4f8a-9c37-59cf814ce25a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:52.027630 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2954/5955] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:23:51 2022] PUT /identity/v3/projects/1643746e991a4d3c9238337dc815f6df/users/16741a706fed476095f71206da028d3e/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:52.029190 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7ac6f-0255-43e4-a900-ed1673e6d45e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:52.030435 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7ac6f-0255-43e4-a900-ed1673e6d45e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:52.030718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7ac6f-0255-43e4-a900-ed1673e6d45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:52.047799 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3002/5956] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:23:51 2022] PUT /identity/v3/projects/7079d55caaea4a57a731ff68dc343b1a/users/b34e8c1993814896a96f70f79f9bd269/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:52.059687 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92581408-b90d-4153-a6c1-e27749f36138 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:52.059978 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92581408-b90d-4153-a6c1-e27749f36138 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:52.060285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92581408-b90d-4153-a6c1-e27749f36138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:52.079039 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d1a7ac6f-0255-43e4-a900-ed1673e6d45e None None] MFA Rules not processed for user `16741a706fed476095f71206da028d3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:52.081764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d1a7ac6f-0255-43e4-a900-ed1673e6d45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:52.095748 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-92581408-b90d-4153-a6c1-e27749f36138 None None] MFA Rules not processed for user `b34e8c1993814896a96f70f79f9bd269`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:52.099040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-92581408-b90d-4153-a6c1-e27749f36138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:52.111190 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:52.125139 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:52.188008 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2955/5957] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:52 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:23:52.203745 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7ac6f-0255-43e4-a900-ed1673e6d45e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:52.207678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d1a7ac6f-0255-43e4-a900-ed1673e6d45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:52.228166 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3003/5958] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:52 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:23:52.240197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92581408-b90d-4153-a6c1-e27749f36138 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:52.241659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-92581408-b90d-4153-a6c1-e27749f36138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:52.290684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7ac6f-0255-43e4-a900-ed1673e6d45e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:52.295663 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce4a2e-f8b4-4e42-a45d-dc784d59973b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:52.296300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce4a2e-f8b4-4e42-a45d-dc784d59973b service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:52.296579 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce4a2e-f8b4-4e42-a45d-dc784d59973b service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:52.297351 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce4a2e-f8b4-4e42-a45d-dc784d59973b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:52.315638 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce4a2e-f8b4-4e42-a45d-dc784d59973b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:52.317602 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce4a2e-f8b4-4e42-a45d-dc784d59973b service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:52.319848 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92581408-b90d-4153-a6c1-e27749f36138 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:52.324951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a9a9b-93ab-4702-a683-cd67a0bfb51d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:52.326379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a9a9b-93ab-4702-a683-cd67a0bfb51d service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:52.326672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a9a9b-93ab-4702-a683-cd67a0bfb51d service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:52.327089 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a9a9b-93ab-4702-a683-cd67a0bfb51d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:52.330163 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2956/5959] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:23:52 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:23:52.337899 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a9a9b-93ab-4702-a683-cd67a0bfb51d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:52.339362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a9a9b-93ab-4702-a683-cd67a0bfb51d service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:52.351070 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3004/5960] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:23:52 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:23:52.404232 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce4a2e-f8b4-4e42-a45d-dc784d59973b service cinder] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:52.416195 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce4a2e-f8b4-4e42-a45d-dc784d59973b service cinder] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:52.421912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6fb17-a159-4a14-96cf-242573c5e360 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:52.422940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6fb17-a159-4a14-96cf-242573c5e360 service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:52.423322 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6fb17-a159-4a14-96cf-242573c5e360 service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:52.423692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6fb17-a159-4a14-96cf-242573c5e360 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:52.517809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd6fb17-a159-4a14-96cf-242573c5e360 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:52.520477 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd6fb17-a159-4a14-96cf-242573c5e360 service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:52.532547 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2957/5961] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:23:52 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:23:52.711303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a9a9b-93ab-4702-a683-cd67a0bfb51d service cinder] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:52.725933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a9a9b-93ab-4702-a683-cd67a0bfb51d service cinder] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:52.731835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfa6f8-5db4-4dc9-a685-10ba86b5f030 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:52.732949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfa6f8-5db4-4dc9-a685-10ba86b5f030 service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:52.733510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfa6f8-5db4-4dc9-a685-10ba86b5f030 service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:52.734125 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfa6f8-5db4-4dc9-a685-10ba86b5f030 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:52.825850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfa6f8-5db4-4dc9-a685-10ba86b5f030 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:52.827642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfa6f8-5db4-4dc9-a685-10ba86b5f030 service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:52.840076 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3005/5962] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:23:52 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:23:54.932359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6fb17-a159-4a14-96cf-242573c5e360 service cinder] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:54.934758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3fd6fb17-a159-4a14-96cf-242573c5e360 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:55.084453 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:55.090383 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6fb17-a159-4a14-96cf-242573c5e360 service cinder] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:55.103334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4aa550-a23c-413a-9033-182ccaf2eaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:55.104002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4aa550-a23c-413a-9033-182ccaf2eaf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:55.104295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4aa550-a23c-413a-9033-182ccaf2eaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:55.104562 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4aa550-a23c-413a-9033-182ccaf2eaf9 admin admin] PATH_INFO: `/v3/users/5fc26e9a68894578b31fe07e6244a07f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:55.110386 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4aa550-a23c-413a-9033-182ccaf2eaf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fc26e9a68894578b31fe07e6244a07f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:55.112964 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4aa550-a23c-413a-9033-182ccaf2eaf9 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:55.219025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ac4aa550-a23c-413a-9033-182ccaf2eaf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fc26e9a68894578b31fe07e6244a07f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:55.219767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ac4aa550-a23c-413a-9033-182ccaf2eaf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fc26e9a68894578b31fe07e6244a07f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:55.234442 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ac4aa550-a23c-413a-9033-182ccaf2eaf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fc26e9a68894578b31fe07e6244a07f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:55.256047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ac4aa550-a23c-413a-9033-182ccaf2eaf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fc26e9a68894578b31fe07e6244a07f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:55.256825 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ac4aa550-a23c-413a-9033-182ccaf2eaf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fc26e9a68894578b31fe07e6244a07f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:55.288460 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2958/5963] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:23:54 2022] DELETE /identity/v3/users/5fc26e9a68894578b31fe07e6244a07f => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:55.294766 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86398c-41ee-4723-8a17-396ff359d8b9 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:55.296449 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86398c-41ee-4723-8a17-396ff359d8b9 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:55.297628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86398c-41ee-4723-8a17-396ff359d8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:55.349941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ed86398c-41ee-4723-8a17-396ff359d8b9 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:55.352773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ed86398c-41ee-4723-8a17-396ff359d8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:55.485141 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:55.579964 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3006/5964] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:23:55.606664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4aa550-a23c-413a-9033-182ccaf2eaf9 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:55.608327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ac4aa550-a23c-413a-9033-182ccaf2eaf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:55.744832 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4aa550-a23c-413a-9033-182ccaf2eaf9 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:55.756817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445f7c4-1771-4264-b124-66a2116280a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:55.757481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445f7c4-1771-4264-b124-66a2116280a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:55.757806 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445f7c4-1771-4264-b124-66a2116280a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:55.758080 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445f7c4-1771-4264-b124-66a2116280a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:55.781223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445f7c4-1771-4264-b124-66a2116280a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:55.782760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445f7c4-1771-4264-b124-66a2116280a8 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:55.803784 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2959/5965] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:23:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:23:57.738146 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86398c-41ee-4723-8a17-396ff359d8b9 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:57.740082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ed86398c-41ee-4723-8a17-396ff359d8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:57.758595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86398c-41ee-4723-8a17-396ff359d8b9 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:57.772475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b5a6d-f6fe-4c0b-9444-19ac97cb4bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:57.773135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b5a6d-f6fe-4c0b-9444-19ac97cb4bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:57.773420 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b5a6d-f6fe-4c0b-9444-19ac97cb4bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:57.773722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b5a6d-f6fe-4c0b-9444-19ac97cb4bbd admin admin] PATH_INFO: `/v3/projects/1546f8d45c094e6199c7458bd88386b2` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:57.775447 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b5a6d-f6fe-4c0b-9444-19ac97cb4bbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1546f8d45c094e6199c7458bd88386b2)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:57.777399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b5a6d-f6fe-4c0b-9444-19ac97cb4bbd admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:57.886050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ee1b5a6d-f6fe-4c0b-9444-19ac97cb4bbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1546f8d45c094e6199c7458bd88386b2', 'request_id': 'req-ee1b5a6d-f6fe-4c0b-9444-19ac97cb4bbd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:57.899599 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ee1b5a6d-f6fe-4c0b-9444-19ac97cb4bbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1546f8d45c094e6199c7458bd88386b2', 'request_id': 'req-ee1b5a6d-f6fe-4c0b-9444-19ac97cb4bbd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:57.909760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ee1b5a6d-f6fe-4c0b-9444-19ac97cb4bbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1546f8d45c094e6199c7458bd88386b2', 'request_id': 'req-ee1b5a6d-f6fe-4c0b-9444-19ac97cb4bbd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:57.947492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ee1b5a6d-f6fe-4c0b-9444-19ac97cb4bbd admin admin] The token cache is being invalidate because project 1546f8d45c094e6199c7458bd88386b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:23:57.950162 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ee1b5a6d-f6fe-4c0b-9444-19ac97cb4bbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:57.952224 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ee1b5a6d-f6fe-4c0b-9444-19ac97cb4bbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:57.958887 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3007/5966] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:23:57 2022] DELETE /identity/v3/projects/1546f8d45c094e6199c7458bd88386b2 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:57.963225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445f7c4-1771-4264-b124-66a2116280a8 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:57.983315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445f7c4-1771-4264-b124-66a2116280a8 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:58.070341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb1a49-bced-402c-b0c2-f1da73117cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:58.081531 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb1a49-bced-402c-b0c2-f1da73117cf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:58.082033 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb1a49-bced-402c-b0c2-f1da73117cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:58.082504 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb1a49-bced-402c-b0c2-f1da73117cf6 admin admin] PATH_INFO: `/v3/users/736f50e02eeb45c9b52ef5604a0b43eb` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:58.084469 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb1a49-bced-402c-b0c2-f1da73117cf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=736f50e02eeb45c9b52ef5604a0b43eb)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:58.092349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb1a49-bced-402c-b0c2-f1da73117cf6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:58.136044 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:58.184128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-36cb1a49-bced-402c-b0c2-f1da73117cf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '736f50e02eeb45c9b52ef5604a0b43eb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:58.186208 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-36cb1a49-bced-402c-b0c2-f1da73117cf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '736f50e02eeb45c9b52ef5604a0b43eb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:58.209256 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-36cb1a49-bced-402c-b0c2-f1da73117cf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '736f50e02eeb45c9b52ef5604a0b43eb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:58.240753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-36cb1a49-bced-402c-b0c2-f1da73117cf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '736f50e02eeb45c9b52ef5604a0b43eb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:58.241769 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-36cb1a49-bced-402c-b0c2-f1da73117cf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '736f50e02eeb45c9b52ef5604a0b43eb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:58.317547 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2960/5967] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:23:57 2022] DELETE /identity/v3/users/736f50e02eeb45c9b52ef5604a0b43eb => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:59.083973 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b5a6d-f6fe-4c0b-9444-19ac97cb4bbd admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:59.086150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ee1b5a6d-f6fe-4c0b-9444-19ac97cb4bbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:59.106835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b5a6d-f6fe-4c0b-9444-19ac97cb4bbd admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:59.186211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0754720-b157-4678-990f-b0e0a4b79cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:59.189398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0754720-b157-4678-990f-b0e0a4b79cab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:59.194728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0754720-b157-4678-990f-b0e0a4b79cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:59.194728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0754720-b157-4678-990f-b0e0a4b79cab admin admin] PATH_INFO: `/v3/projects/55497780fd1942c49e439551f4fb85b1` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:59.196029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0754720-b157-4678-990f-b0e0a4b79cab admin admin] RBAC: Authorizing `identity:delete_project(project_id=55497780fd1942c49e439551f4fb85b1)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:59.199394 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0754720-b157-4678-990f-b0e0a4b79cab admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:59.270257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a0754720-b157-4678-990f-b0e0a4b79cab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55497780fd1942c49e439551f4fb85b1', 'request_id': 'req-a0754720-b157-4678-990f-b0e0a4b79cab'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:59.284278 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a0754720-b157-4678-990f-b0e0a4b79cab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55497780fd1942c49e439551f4fb85b1', 'request_id': 'req-a0754720-b157-4678-990f-b0e0a4b79cab'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:59.293246 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a0754720-b157-4678-990f-b0e0a4b79cab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55497780fd1942c49e439551f4fb85b1', 'request_id': 'req-a0754720-b157-4678-990f-b0e0a4b79cab'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:59.303994 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:23:59.309939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a0754720-b157-4678-990f-b0e0a4b79cab admin admin] The token cache is being invalidate because project 55497780fd1942c49e439551f4fb85b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:23:59.310534 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a0754720-b157-4678-990f-b0e0a4b79cab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:59.311853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a0754720-b157-4678-990f-b0e0a4b79cab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:59.321129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f26e4-3a25-4294-b585-669487d16194 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:59.322350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f26e4-3a25-4294-b585-669487d16194 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:59.322951 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f26e4-3a25-4294-b585-669487d16194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:59.327551 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3008/5968] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:23:59 2022] DELETE /identity/v3/projects/55497780fd1942c49e439551f4fb85b1 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:23:59.348365 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-0b2f26e4-3a25-4294-b585-669487d16194 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:59.350252 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0b2f26e4-3a25-4294-b585-669487d16194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:59.434512 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0754720-b157-4678-990f-b0e0a4b79cab admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:59.436498 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a0754720-b157-4678-990f-b0e0a4b79cab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:59.445520 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2961/5969] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:23:59.456929 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9f884-bb6f-495e-93ec-e8ac36de673a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:59.458027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9f884-bb6f-495e-93ec-e8ac36de673a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:59.458609 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9f884-bb6f-495e-93ec-e8ac36de673a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:59.465929 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0754720-b157-4678-990f-b0e0a4b79cab admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:59.477637 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320042c-e20d-4a50-ac3e-0b9af2bf5dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:59.478325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320042c-e20d-4a50-ac3e-0b9af2bf5dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:59.478678 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320042c-e20d-4a50-ac3e-0b9af2bf5dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:59.479499 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320042c-e20d-4a50-ac3e-0b9af2bf5dd8 admin admin] PATH_INFO: `/v3/users/551702ce15ec4969adc5affe33f29ce6` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:59.481253 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320042c-e20d-4a50-ac3e-0b9af2bf5dd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=551702ce15ec4969adc5affe33f29ce6)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:59.486334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320042c-e20d-4a50-ac3e-0b9af2bf5dd8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:59.505109 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-20f9f884-bb6f-495e-93ec-e8ac36de673a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:23:59.507644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-20f9f884-bb6f-495e-93ec-e8ac36de673a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:59.544576 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2962/5970] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:23:59.547989 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9f884-bb6f-495e-93ec-e8ac36de673a None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:59.576679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9f884-bb6f-495e-93ec-e8ac36de673a None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:59.591237 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8cdbcb-059e-4851-a165-f5f574a33b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:59.592169 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cdbcb-059e-4851-a165-f5f574a33b5d admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:59.592661 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cdbcb-059e-4851-a165-f5f574a33b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:59.593106 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cdbcb-059e-4851-a165-f5f574a33b5d admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:59.593952 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8cdbcb-059e-4851-a165-f5f574a33b5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:23:59.594427 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8cdbcb-059e-4851-a165-f5f574a33b5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:59.598859 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8cdbcb-059e-4851-a165-f5f574a33b5d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:59.602283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4320042c-e20d-4a50-ac3e-0b9af2bf5dd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '551702ce15ec4969adc5affe33f29ce6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:59.605845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4320042c-e20d-4a50-ac3e-0b9af2bf5dd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '551702ce15ec4969adc5affe33f29ce6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:59.620304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4320042c-e20d-4a50-ac3e-0b9af2bf5dd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '551702ce15ec4969adc5affe33f29ce6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:59.628334 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2963/5971] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:23:59.635817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8cdbcb-059e-4851-a165-f5f574a33b5d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:59.637959 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3d8cdbcb-059e-4851-a165-f5f574a33b5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:59.644863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4320042c-e20d-4a50-ac3e-0b9af2bf5dd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '551702ce15ec4969adc5affe33f29ce6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:59.645906 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4320042c-e20d-4a50-ac3e-0b9af2bf5dd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '551702ce15ec4969adc5affe33f29ce6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:23:59.652271 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8cdbcb-059e-4851-a165-f5f574a33b5d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:59.657631 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9cb3f1-e40e-4312-88b0-41830071cbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:59.658218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9cb3f1-e40e-4312-88b0-41830071cbc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:59.658534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9cb3f1-e40e-4312-88b0-41830071cbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:59.658824 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9cb3f1-e40e-4312-88b0-41830071cbc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:59.659437 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9cb3f1-e40e-4312-88b0-41830071cbc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:59.661517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9cb3f1-e40e-4312-88b0-41830071cbc8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:59.670761 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3009/5972] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:23:59 2022] DELETE /identity/v3/users/551702ce15ec4969adc5affe33f29ce6 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:23:59.696135 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2964/5973] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:23:59 2022] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:23:59.699797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320042c-e20d-4a50-ac3e-0b9af2bf5dd8 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:59.799416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320042c-e20d-4a50-ac3e-0b9af2bf5dd8 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:59.871002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f46e7a-832f-47fa-b2d2-0cca7bf2004a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:59.871626 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f46e7a-832f-47fa-b2d2-0cca7bf2004a admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:59.871905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f46e7a-832f-47fa-b2d2-0cca7bf2004a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:59.872179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f46e7a-832f-47fa-b2d2-0cca7bf2004a admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:59.872822 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f46e7a-832f-47fa-b2d2-0cca7bf2004a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:59.875317 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f46e7a-832f-47fa-b2d2-0cca7bf2004a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:59.929467 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3010/5974] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:23:59 2022] POST /identity/v3/users => generated 291 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:23:59.934084 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9cb3f1-e40e-4312-88b0-41830071cbc8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:59.949773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f46e7a-832f-47fa-b2d2-0cca7bf2004a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:23:59.953202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-10f46e7a-832f-47fa-b2d2-0cca7bf2004a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:23:59.959075 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9cb3f1-e40e-4312-88b0-41830071cbc8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:23:59.968819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4a5a4-7f56-48c7-8579-14de2d866e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:23:59.969466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4a5a4-7f56-48c7-8579-14de2d866e41 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:23:59.969753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4a5a4-7f56-48c7-8579-14de2d866e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:23:59.970024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4a5a4-7f56-48c7-8579-14de2d866e41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:23:59.970672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4a5a4-7f56-48c7-8579-14de2d866e41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:23:59.975426 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4a5a4-7f56-48c7-8579-14de2d866e41 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:23:59.986826 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f46e7a-832f-47fa-b2d2-0cca7bf2004a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:00.018457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d389144-5710-4a40-a7c6-7d31f8e19ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:00.019548 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d389144-5710-4a40-a7c6-7d31f8e19ba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:00.019831 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d389144-5710-4a40-a7c6-7d31f8e19ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:00.020105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d389144-5710-4a40-a7c6-7d31f8e19ba8 admin admin] PATH_INFO: `/v3/projects/e3ea5b23a918491a8e278509042f1e12` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:00.021675 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2965/5975] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:24:00.023801 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d389144-5710-4a40-a7c6-7d31f8e19ba8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3ea5b23a918491a8e278509042f1e12)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:00.031396 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4a5a4-7f56-48c7-8579-14de2d866e41 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:00.035742 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d389144-5710-4a40-a7c6-7d31f8e19ba8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:00.045545 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:00.081956 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4a5a4-7f56-48c7-8579-14de2d866e41 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:00.102034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bbfed4-2324-464d-ad55-6f6c53095e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:00.102984 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbfed4-2324-464d-ad55-6f6c53095e24 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:00.103269 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbfed4-2324-464d-ad55-6f6c53095e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:00.108390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbfed4-2324-464d-ad55-6f6c53095e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:00.109049 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bbfed4-2324-464d-ad55-6f6c53095e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:00.111144 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bbfed4-2324-464d-ad55-6f6c53095e24 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:00.134242 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2966/5976] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:24:00.137294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bbfed4-2324-464d-ad55-6f6c53095e24 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:00.165067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8d389144-5710-4a40-a7c6-7d31f8e19ba8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3ea5b23a918491a8e278509042f1e12', 'request_id': 'req-8d389144-5710-4a40-a7c6-7d31f8e19ba8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:00.173408 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bbfed4-2324-464d-ad55-6f6c53095e24 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:00.182780 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8d389144-5710-4a40-a7c6-7d31f8e19ba8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3ea5b23a918491a8e278509042f1e12', 'request_id': 'req-8d389144-5710-4a40-a7c6-7d31f8e19ba8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:00.213984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8d389144-5710-4a40-a7c6-7d31f8e19ba8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3ea5b23a918491a8e278509042f1e12', 'request_id': 'req-8d389144-5710-4a40-a7c6-7d31f8e19ba8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:00.265113 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8d389144-5710-4a40-a7c6-7d31f8e19ba8 admin admin] The token cache is being invalidate because project e3ea5b23a918491a8e278509042f1e12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:24:00.266440 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8d389144-5710-4a40-a7c6-7d31f8e19ba8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:00.268754 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:00.269295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8d389144-5710-4a40-a7c6-7d31f8e19ba8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:00.272963 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3011/5977] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:23:59 2022] DELETE /identity/v3/projects/e3ea5b23a918491a8e278509042f1e12 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:00.277284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d389144-5710-4a40-a7c6-7d31f8e19ba8 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:00.286949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8d389144-5710-4a40-a7c6-7d31f8e19ba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:00.331607 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c869a1-4459-437c-bd92-71160002500f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:00.333117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c869a1-4459-437c-bd92-71160002500f admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:00.333666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c869a1-4459-437c-bd92-71160002500f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:00.334155 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c869a1-4459-437c-bd92-71160002500f admin admin] PATH_INFO: `/v3/projects/14613cd21bcc4429937a13b6ab956fea/users/d49428a9b0c14a1baed458f7ab91734c/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:00.368946 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c869a1-4459-437c-bd92-71160002500f admin admin] RBAC: Authorizing `identity:create_grant(project_id=14613cd21bcc4429937a13b6ab956fea, user_id=d49428a9b0c14a1baed458f7ab91734c, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:00.372165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c869a1-4459-437c-bd92-71160002500f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:00.406393 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2967/5978] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:24:00 2022] PUT /identity/v3/projects/14613cd21bcc4429937a13b6ab956fea/users/d49428a9b0c14a1baed458f7ab91734c/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:00.419367 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063e866-9722-4cdf-9364-3aa8b991510a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:00.419820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063e866-9722-4cdf-9364-3aa8b991510a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:00.420108 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063e866-9722-4cdf-9364-3aa8b991510a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:00.465657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d389144-5710-4a40-a7c6-7d31f8e19ba8 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:00.494948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5063e866-9722-4cdf-9364-3aa8b991510a None None] MFA Rules not processed for user `d49428a9b0c14a1baed458f7ab91734c`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:00.496810 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5063e866-9722-4cdf-9364-3aa8b991510a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:00.587116 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2968/5979] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:00.591060 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063e866-9722-4cdf-9364-3aa8b991510a None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:00.592485 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5063e866-9722-4cdf-9364-3aa8b991510a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:00.643449 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87552dbc-8f7f-4e49-b25a-478efdcae080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:00.644101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87552dbc-8f7f-4e49-b25a-478efdcae080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:00.644382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87552dbc-8f7f-4e49-b25a-478efdcae080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:00.644658 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87552dbc-8f7f-4e49-b25a-478efdcae080 admin admin] PATH_INFO: `/v3/users/d353ffb7bcc348f3b70c2960c5195b98` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:00.645942 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87552dbc-8f7f-4e49-b25a-478efdcae080 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d353ffb7bcc348f3b70c2960c5195b98)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:00.648320 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87552dbc-8f7f-4e49-b25a-478efdcae080 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:00.702236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063e866-9722-4cdf-9364-3aa8b991510a None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:00.708817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14944d1-d053-4c7b-bc03-976301f03cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:00.709824 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14944d1-d053-4c7b-bc03-976301f03cd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:00.710530 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14944d1-d053-4c7b-bc03-976301f03cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:00.711041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14944d1-d053-4c7b-bc03-976301f03cd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:00.711942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14944d1-d053-4c7b-bc03-976301f03cd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:00.714293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14944d1-d053-4c7b-bc03-976301f03cd8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:00.736124 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:00.750130 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-87552dbc-8f7f-4e49-b25a-478efdcae080 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd353ffb7bcc348f3b70c2960c5195b98'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:00.751053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-87552dbc-8f7f-4e49-b25a-478efdcae080 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd353ffb7bcc348f3b70c2960c5195b98'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:00.765087 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2969/5980] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:24:00 2022] POST /identity/v3/projects => generated 383 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:24:00.768534 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-87552dbc-8f7f-4e49-b25a-478efdcae080 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd353ffb7bcc348f3b70c2960c5195b98'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:00.770365 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14944d1-d053-4c7b-bc03-976301f03cd8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:00.774355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f14944d1-d053-4c7b-bc03-976301f03cd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:00.786429 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-87552dbc-8f7f-4e49-b25a-478efdcae080 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd353ffb7bcc348f3b70c2960c5195b98'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:00.787477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-87552dbc-8f7f-4e49-b25a-478efdcae080 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd353ffb7bcc348f3b70c2960c5195b98'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:00.826640 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3012/5981] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:24:00 2022] DELETE /identity/v3/users/d353ffb7bcc348f3b70c2960c5195b98 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:00.875723 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:00.918092 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14944d1-d053-4c7b-bc03-976301f03cd8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:00.988728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53655668-734f-4ba1-9b51-e3b7dddda040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:00.989597 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53655668-734f-4ba1-9b51-e3b7dddda040 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:00.990036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53655668-734f-4ba1-9b51-e3b7dddda040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:00.990536 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53655668-734f-4ba1-9b51-e3b7dddda040 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:00.991352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53655668-734f-4ba1-9b51-e3b7dddda040 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:00.993944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53655668-734f-4ba1-9b51-e3b7dddda040 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:01.033285 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2970/5982] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:24:00 2022] POST /identity/v3/users => generated 298 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:24:01.036248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87552dbc-8f7f-4e49-b25a-478efdcae080 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:01.053427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87552dbc-8f7f-4e49-b25a-478efdcae080 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:01.074221 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb68fab6-c23e-47d7-b550-1d45c74a7593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:01.075001 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68fab6-c23e-47d7-b550-1d45c74a7593 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:01.076363 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68fab6-c23e-47d7-b550-1d45c74a7593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:01.077224 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68fab6-c23e-47d7-b550-1d45c74a7593 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:01.078321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb68fab6-c23e-47d7-b550-1d45c74a7593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:01.087771 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb68fab6-c23e-47d7-b550-1d45c74a7593 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:01.122909 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3013/5983] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:24:01.123956 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53655668-734f-4ba1-9b51-e3b7dddda040 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:01.139942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53655668-734f-4ba1-9b51-e3b7dddda040 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:01.160349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45902613-77f6-44ed-8508-46877742f3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:01.161954 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45902613-77f6-44ed-8508-46877742f3a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:01.166534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45902613-77f6-44ed-8508-46877742f3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:01.167048 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45902613-77f6-44ed-8508-46877742f3a5 admin admin] PATH_INFO: `/v3/projects/98a0cbda3a1345128c5ba19ed7e4ed91/users/22256dbb10f740a199eccf4242f0dc57/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:01.202529 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb68fab6-c23e-47d7-b550-1d45c74a7593 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:01.205914 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-bb68fab6-c23e-47d7-b550-1d45c74a7593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:01.228905 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45902613-77f6-44ed-8508-46877742f3a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98a0cbda3a1345128c5ba19ed7e4ed91, user_id=22256dbb10f740a199eccf4242f0dc57, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:01.233807 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb68fab6-c23e-47d7-b550-1d45c74a7593 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:01.235629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45902613-77f6-44ed-8508-46877742f3a5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:01.262479 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08a6d1-3a74-4c6c-abe1-0197a83face0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:01.263572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08a6d1-3a74-4c6c-abe1-0197a83face0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:01.264696 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08a6d1-3a74-4c6c-abe1-0197a83face0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:01.265203 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08a6d1-3a74-4c6c-abe1-0197a83face0 admin admin] PATH_INFO: `/v3/projects/2fedbaf2968d48619ae6db9108523f56` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:01.267325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c08a6d1-3a74-4c6c-abe1-0197a83face0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fedbaf2968d48619ae6db9108523f56)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:01.268116 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2971/5984] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:24:01 2022] PUT /identity/v3/projects/98a0cbda3a1345128c5ba19ed7e4ed91/users/22256dbb10f740a199eccf4242f0dc57/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:01.274670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45902613-77f6-44ed-8508-46877742f3a5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:01.286402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c08a6d1-3a74-4c6c-abe1-0197a83face0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:01.414321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6c08a6d1-3a74-4c6c-abe1-0197a83face0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fedbaf2968d48619ae6db9108523f56', 'request_id': 'req-6c08a6d1-3a74-4c6c-abe1-0197a83face0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:01.425346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45902613-77f6-44ed-8508-46877742f3a5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:01.433576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6c08a6d1-3a74-4c6c-abe1-0197a83face0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fedbaf2968d48619ae6db9108523f56', 'request_id': 'req-6c08a6d1-3a74-4c6c-abe1-0197a83face0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:01.459398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6c08a6d1-3a74-4c6c-abe1-0197a83face0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fedbaf2968d48619ae6db9108523f56', 'request_id': 'req-6c08a6d1-3a74-4c6c-abe1-0197a83face0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:01.497141 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6c08a6d1-3a74-4c6c-abe1-0197a83face0 admin admin] The token cache is being invalidate because project 2fedbaf2968d48619ae6db9108523f56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:24:01.497791 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6c08a6d1-3a74-4c6c-abe1-0197a83face0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:01.499465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6c08a6d1-3a74-4c6c-abe1-0197a83face0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:01.504473 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3014/5985] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:24:01 2022] DELETE /identity/v3/projects/2fedbaf2968d48619ae6db9108523f56 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:24:01.505554 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08a6d1-3a74-4c6c-abe1-0197a83face0 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:01.510125 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6c08a6d1-3a74-4c6c-abe1-0197a83face0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:01.527587 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:01.550239 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5389090-57de-4ff4-987d-61477bce19ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:01.550881 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5389090-57de-4ff4-987d-61477bce19ce admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:01.551283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5389090-57de-4ff4-987d-61477bce19ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:01.551627 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5389090-57de-4ff4-987d-61477bce19ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:01.552394 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5389090-57de-4ff4-987d-61477bce19ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:01.554128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5389090-57de-4ff4-987d-61477bce19ce admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:01.592291 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2972/5986] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:24:01.593779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c26320-97a0-4d7f-a896-04204649c137 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:01.594087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c26320-97a0-4d7f-a896-04204649c137 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:01.594340 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c26320-97a0-4d7f-a896-04204649c137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:01.630949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08a6d1-3a74-4c6c-abe1-0197a83face0 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:01.648202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a8cf1-2f19-4612-a6a0-0caaba5ca238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:01.648757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a8cf1-2f19-4612-a6a0-0caaba5ca238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:01.648981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-07c26320-97a0-4d7f-a896-04204649c137 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:01.649194 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a8cf1-2f19-4612-a6a0-0caaba5ca238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:01.649374 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a8cf1-2f19-4612-a6a0-0caaba5ca238 admin admin] PATH_INFO: `/v3/users/197b50455702458b86039c8c7cc3f2dd` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:01.650845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a8cf1-2f19-4612-a6a0-0caaba5ca238 admin admin] RBAC: Authorizing `identity:delete_user(user_id=197b50455702458b86039c8c7cc3f2dd)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:01.651029 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-07c26320-97a0-4d7f-a896-04204649c137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:01.653242 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a8cf1-2f19-4612-a6a0-0caaba5ca238 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:01.673240 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2973/5987] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:01.676013 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c26320-97a0-4d7f-a896-04204649c137 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:01.679659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-07c26320-97a0-4d7f-a896-04204649c137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:01.705019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c26320-97a0-4d7f-a896-04204649c137 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:01.716260 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25759906-43c0-4945-946c-09a8795c8098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:01.717126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25759906-43c0-4945-946c-09a8795c8098 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:01.717403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25759906-43c0-4945-946c-09a8795c8098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:01.717739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25759906-43c0-4945-946c-09a8795c8098 admin admin] PATH_INFO: `/v3/projects/98a0cbda3a1345128c5ba19ed7e4ed91/users/22256dbb10f740a199eccf4242f0dc57/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:01.720191 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25759906-43c0-4945-946c-09a8795c8098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98a0cbda3a1345128c5ba19ed7e4ed91, user_id=22256dbb10f740a199eccf4242f0dc57, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:01.727572 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:01.727906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25759906-43c0-4945-946c-09a8795c8098 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:01.749862 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7c8a8cf1-2f19-4612-a6a0-0caaba5ca238 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '197b50455702458b86039c8c7cc3f2dd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:01.750565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7c8a8cf1-2f19-4612-a6a0-0caaba5ca238 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '197b50455702458b86039c8c7cc3f2dd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:01.765715 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2974/5988] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:24:01 2022] PUT /identity/v3/projects/98a0cbda3a1345128c5ba19ed7e4ed91/users/22256dbb10f740a199eccf4242f0dc57/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:01.766954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7c8a8cf1-2f19-4612-a6a0-0caaba5ca238 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '197b50455702458b86039c8c7cc3f2dd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:01.770740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f650bb-c287-4410-9dd8-323f31c1383c None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:01.771037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f650bb-c287-4410-9dd8-323f31c1383c None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:01.771284 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f650bb-c287-4410-9dd8-323f31c1383c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:01.788292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7c8a8cf1-2f19-4612-a6a0-0caaba5ca238 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '197b50455702458b86039c8c7cc3f2dd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:01.789084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7c8a8cf1-2f19-4612-a6a0-0caaba5ca238 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '197b50455702458b86039c8c7cc3f2dd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:01.822438 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-23f650bb-c287-4410-9dd8-323f31c1383c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:01.824836 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-23f650bb-c287-4410-9dd8-323f31c1383c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:01.829241 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3015/5989] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:24:01 2022] DELETE /identity/v3/users/197b50455702458b86039c8c7cc3f2dd => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:01.839040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548273d-0aa3-49b9-b173-746dd5834d42 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:01.839441 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548273d-0aa3-49b9-b173-746dd5834d42 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:01.839724 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548273d-0aa3-49b9-b173-746dd5834d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:01.922816 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-5548273d-0aa3-49b9-b173-746dd5834d42 None None] MFA Rules not processed for user `22256dbb10f740a199eccf4242f0dc57`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:01.924470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5548273d-0aa3-49b9-b173-746dd5834d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:01.981707 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2975/5990] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:01.983858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6606c-fd21-422f-a762-f8bddb947965 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:01.984218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6606c-fd21-422f-a762-f8bddb947965 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:01.984596 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6606c-fd21-422f-a762-f8bddb947965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:02.031436 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-bfc6606c-fd21-422f-a762-f8bddb947965 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:02.033149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bfc6606c-fd21-422f-a762-f8bddb947965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:02.044135 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2976/5991] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:02.046785 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6606c-fd21-422f-a762-f8bddb947965 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:02.058731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6606c-fd21-422f-a762-f8bddb947965 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:02.064182 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641fb53-ef53-4b44-ac92-cae5af17c28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:02.065659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641fb53-ef53-4b44-ac92-cae5af17c28f admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:02.065940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641fb53-ef53-4b44-ac92-cae5af17c28f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:02.066212 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3016/5992] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:01 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:02.066601 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641fb53-ef53-4b44-ac92-cae5af17c28f admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:02.067466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641fb53-ef53-4b44-ac92-cae5af17c28f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:24:02.067771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641fb53-ef53-4b44-ac92-cae5af17c28f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:02.069390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641fb53-ef53-4b44-ac92-cae5af17c28f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:02.077295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548273d-0aa3-49b9-b173-746dd5834d42 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:02.078727 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5548273d-0aa3-49b9-b173-746dd5834d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:02.089076 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2977/5993] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:24:02.090016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641fb53-ef53-4b44-ac92-cae5af17c28f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:02.092877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4641fb53-ef53-4b44-ac92-cae5af17c28f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:02.161991 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548273d-0aa3-49b9-b173-746dd5834d42 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:02.166731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a49594-e80a-4969-8488-15a0d79c903f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:02.168036 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a49594-e80a-4969-8488-15a0d79c903f service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:02.168379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a49594-e80a-4969-8488-15a0d79c903f service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:02.168754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a49594-e80a-4969-8488-15a0d79c903f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:02.181133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a49594-e80a-4969-8488-15a0d79c903f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:02.183064 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a49594-e80a-4969-8488-15a0d79c903f service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:02.197748 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3017/5994] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:24:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:24:02.197748 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a49594-e80a-4969-8488-15a0d79c903f service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:02.208550 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a49594-e80a-4969-8488-15a0d79c903f service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:02.209563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641fb53-ef53-4b44-ac92-cae5af17c28f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:02.213824 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd7a4a-b114-4f08-aa8d-28eec57a1e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:02.214540 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd7a4a-b114-4f08-aa8d-28eec57a1e07 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:02.214916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd7a4a-b114-4f08-aa8d-28eec57a1e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:02.215284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd7a4a-b114-4f08-aa8d-28eec57a1e07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:02.216018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd7a4a-b114-4f08-aa8d-28eec57a1e07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:02.218278 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd7a4a-b114-4f08-aa8d-28eec57a1e07 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:02.225015 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8100c3-ffbe-470a-b381-52e9b13de36a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:02.225793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8100c3-ffbe-470a-b381-52e9b13de36a service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:02.226078 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8100c3-ffbe-470a-b381-52e9b13de36a service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:02.226527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8100c3-ffbe-470a-b381-52e9b13de36a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:02.228338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ef8100c3-ffbe-470a-b381-52e9b13de36a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:02.255647 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3018/5995] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:24:02 2022] POST /identity/v3/projects => generated 365 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:24:02.259859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd7a4a-b114-4f08-aa8d-28eec57a1e07 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:02.309087 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:02.325345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8100c3-ffbe-470a-b381-52e9b13de36a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:02.326934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8100c3-ffbe-470a-b381-52e9b13de36a service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:02.344888 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2978/5996] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:24:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:24:02.430039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd7a4a-b114-4f08-aa8d-28eec57a1e07 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:02.436225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21e814-a12d-4f0f-b936-3f3cd79870b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:02.436946 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21e814-a12d-4f0f-b936-3f3cd79870b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:02.437346 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21e814-a12d-4f0f-b936-3f3cd79870b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:02.437739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21e814-a12d-4f0f-b936-3f3cd79870b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:02.439001 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc21e814-a12d-4f0f-b936-3f3cd79870b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:02.443160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc21e814-a12d-4f0f-b936-3f3cd79870b5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:02.499263 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3019/5997] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:24:02 2022] POST /identity/v3/users => generated 283 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:24:02.504294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8100c3-ffbe-470a-b381-52e9b13de36a service cinder] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:02.512294 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:02.522325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8100c3-ffbe-470a-b381-52e9b13de36a service cinder] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:02.528683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d15b01-d739-4e11-b45f-ad5ad44efe16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:02.529899 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d15b01-d739-4e11-b45f-ad5ad44efe16 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:02.530577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d15b01-d739-4e11-b45f-ad5ad44efe16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:02.531066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d15b01-d739-4e11-b45f-ad5ad44efe16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:02.532222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d15b01-d739-4e11-b45f-ad5ad44efe16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:02.534731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d15b01-d739-4e11-b45f-ad5ad44efe16 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:02.553152 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2979/5998] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:24:02.557142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21e814-a12d-4f0f-b936-3f3cd79870b5 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:02.570065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21e814-a12d-4f0f-b936-3f3cd79870b5 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:02.575649 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a3712-75a8-4d97-8178-0f55521616b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:02.576610 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a3712-75a8-4d97-8178-0f55521616b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:02.576996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a3712-75a8-4d97-8178-0f55521616b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:02.577362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a3712-75a8-4d97-8178-0f55521616b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:02.578135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a3712-75a8-4d97-8178-0f55521616b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:02.581235 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a3712-75a8-4d97-8178-0f55521616b5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:02.622069 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3020/5999] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:24:02.623340 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d15b01-d739-4e11-b45f-ad5ad44efe16 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:02.636014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d15b01-d739-4e11-b45f-ad5ad44efe16 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:02.652407 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e54ab0-ece2-43d6-9597-a90e9644fa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:02.653486 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e54ab0-ece2-43d6-9597-a90e9644fa92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:02.653780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e54ab0-ece2-43d6-9597-a90e9644fa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:02.654172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e54ab0-ece2-43d6-9597-a90e9644fa92 admin admin] PATH_INFO: `/v3/projects/6583531501cb4afd987e0b2c54d1195b/users/36b2c6030d9441caae29744931f8935a/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:02.690444 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e54ab0-ece2-43d6-9597-a90e9644fa92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6583531501cb4afd987e0b2c54d1195b, user_id=36b2c6030d9441caae29744931f8935a, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:02.699401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e54ab0-ece2-43d6-9597-a90e9644fa92 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:02.730576 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2980/6000] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:24:02 2022] PUT /identity/v3/projects/6583531501cb4afd987e0b2c54d1195b/users/36b2c6030d9441caae29744931f8935a/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:02.744791 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c7749-44b6-4f15-a5a9-359b506be04d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:02.746628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c7749-44b6-4f15-a5a9-359b506be04d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:02.747150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c7749-44b6-4f15-a5a9-359b506be04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:02.810078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-945c7749-44b6-4f15-a5a9-359b506be04d None None] MFA Rules not processed for user `36b2c6030d9441caae29744931f8935a`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:02.811904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-945c7749-44b6-4f15-a5a9-359b506be04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:02.848503 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e54ab0-ece2-43d6-9597-a90e9644fa92 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:02.850604 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-23e54ab0-ece2-43d6-9597-a90e9644fa92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:02.985453 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3021/6001] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:02.987942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e54ab0-ece2-43d6-9597-a90e9644fa92 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:02.997913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c7749-44b6-4f15-a5a9-359b506be04d None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:02.999484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef50c4-30f9-48e8-8b8f-f9a2f5750b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:03.000054 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-945c7749-44b6-4f15-a5a9-359b506be04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:03.000539 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef50c4-30f9-48e8-8b8f-f9a2f5750b0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:03.000999 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef50c4-30f9-48e8-8b8f-f9a2f5750b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:03.001577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef50c4-30f9-48e8-8b8f-f9a2f5750b0a admin admin] PATH_INFO: `/v3/projects/47f24a1ee7bc4960a2756e747eeb52aa` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:03.003170 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef50c4-30f9-48e8-8b8f-f9a2f5750b0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=47f24a1ee7bc4960a2756e747eeb52aa)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:03.005718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef50c4-30f9-48e8-8b8f-f9a2f5750b0a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:03.101243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3eef50c4-30f9-48e8-8b8f-f9a2f5750b0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47f24a1ee7bc4960a2756e747eeb52aa', 'request_id': 'req-3eef50c4-30f9-48e8-8b8f-f9a2f5750b0a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:03.121221 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3eef50c4-30f9-48e8-8b8f-f9a2f5750b0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47f24a1ee7bc4960a2756e747eeb52aa', 'request_id': 'req-3eef50c4-30f9-48e8-8b8f-f9a2f5750b0a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:03.132443 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3eef50c4-30f9-48e8-8b8f-f9a2f5750b0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47f24a1ee7bc4960a2756e747eeb52aa', 'request_id': 'req-3eef50c4-30f9-48e8-8b8f-f9a2f5750b0a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:03.166000 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3eef50c4-30f9-48e8-8b8f-f9a2f5750b0a admin admin] The token cache is being invalidate because project 47f24a1ee7bc4960a2756e747eeb52aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:24:03.166292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3eef50c4-30f9-48e8-8b8f-f9a2f5750b0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:03.167711 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3eef50c4-30f9-48e8-8b8f-f9a2f5750b0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:03.174760 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2981/6002] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:24:02 2022] DELETE /identity/v3/projects/47f24a1ee7bc4960a2756e747eeb52aa => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:03.179139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef50c4-30f9-48e8-8b8f-f9a2f5750b0a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:03.182339 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3eef50c4-30f9-48e8-8b8f-f9a2f5750b0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:03.222134 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c7749-44b6-4f15-a5a9-359b506be04d None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:03.254012 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:03.311421 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef50c4-30f9-48e8-8b8f-f9a2f5750b0a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:03.324876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3d104-0dc1-4cf4-8e12-f44bc906af5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:03.327578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3d104-0dc1-4cf4-8e12-f44bc906af5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:03.327578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3d104-0dc1-4cf4-8e12-f44bc906af5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:03.327807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3d104-0dc1-4cf4-8e12-f44bc906af5d admin admin] PATH_INFO: `/v3/users/16741a706fed476095f71206da028d3e` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:03.332912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3d104-0dc1-4cf4-8e12-f44bc906af5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=16741a706fed476095f71206da028d3e)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:03.337071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3d104-0dc1-4cf4-8e12-f44bc906af5d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:03.345218 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:03.349725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384fb59-32b8-407a-8db6-a220575666ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:03.350367 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384fb59-32b8-407a-8db6-a220575666ad service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:03.350668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384fb59-32b8-407a-8db6-a220575666ad service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:03.351018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384fb59-32b8-407a-8db6-a220575666ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:03.354352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9384fb59-32b8-407a-8db6-a220575666ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:03.451438 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a1e3d104-0dc1-4cf4-8e12-f44bc906af5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16741a706fed476095f71206da028d3e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:03.451970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a1e3d104-0dc1-4cf4-8e12-f44bc906af5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16741a706fed476095f71206da028d3e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:03.462167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a1e3d104-0dc1-4cf4-8e12-f44bc906af5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16741a706fed476095f71206da028d3e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:03.478704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a1e3d104-0dc1-4cf4-8e12-f44bc906af5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16741a706fed476095f71206da028d3e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:03.481644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a1e3d104-0dc1-4cf4-8e12-f44bc906af5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16741a706fed476095f71206da028d3e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:03.508381 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9384fb59-32b8-407a-8db6-a220575666ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:03.510098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9384fb59-32b8-407a-8db6-a220575666ad service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:03.528793 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2982/6003] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:24:03 2022] DELETE /identity/v3/users/16741a706fed476095f71206da028d3e => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:03.530787 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3022/6004] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:24:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:24:03.600664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3d104-0dc1-4cf4-8e12-f44bc906af5d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:03.602622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a1e3d104-0dc1-4cf4-8e12-f44bc906af5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:03.758548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3d104-0dc1-4cf4-8e12-f44bc906af5d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:03.765998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396ecff-d6d4-48ad-bb5c-de16ab44d75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:03.766873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396ecff-d6d4-48ad-bb5c-de16ab44d75c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:03.767364 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396ecff-d6d4-48ad-bb5c-de16ab44d75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:03.768360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396ecff-d6d4-48ad-bb5c-de16ab44d75c admin admin] PATH_INFO: `/v3/users/36b2c6030d9441caae29744931f8935a` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:03.770782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396ecff-d6d4-48ad-bb5c-de16ab44d75c admin admin] RBAC: Authorizing `identity:delete_user(user_id=36b2c6030d9441caae29744931f8935a)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:03.782225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396ecff-d6d4-48ad-bb5c-de16ab44d75c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:03.856129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6396ecff-d6d4-48ad-bb5c-de16ab44d75c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36b2c6030d9441caae29744931f8935a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:03.856935 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6396ecff-d6d4-48ad-bb5c-de16ab44d75c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36b2c6030d9441caae29744931f8935a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:03.873636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6396ecff-d6d4-48ad-bb5c-de16ab44d75c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36b2c6030d9441caae29744931f8935a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:03.895343 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6396ecff-d6d4-48ad-bb5c-de16ab44d75c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36b2c6030d9441caae29744931f8935a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:03.896765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6396ecff-d6d4-48ad-bb5c-de16ab44d75c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36b2c6030d9441caae29744931f8935a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:03.918280 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:03.928634 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2983/6005] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:24:03 2022] DELETE /identity/v3/users/36b2c6030d9441caae29744931f8935a => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:03.933250 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c721c2-9f0d-4349-a402-5a5053219b91 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:03.933572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c721c2-9f0d-4349-a402-5a5053219b91 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:03.933821 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c721c2-9f0d-4349-a402-5a5053219b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:03.955933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c3c721c2-9f0d-4349-a402-5a5053219b91 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:03.957487 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c3c721c2-9f0d-4349-a402-5a5053219b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:04.062837 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3023/6006] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:04.076174 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396ecff-d6d4-48ad-bb5c-de16ab44d75c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:04.078361 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6396ecff-d6d4-48ad-bb5c-de16ab44d75c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:04.161165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396ecff-d6d4-48ad-bb5c-de16ab44d75c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:04.166365 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78804119-fe38-4038-895f-bcce9363271e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:04.167412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78804119-fe38-4038-895f-bcce9363271e service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:04.167852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78804119-fe38-4038-895f-bcce9363271e service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:04.168256 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78804119-fe38-4038-895f-bcce9363271e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:04.199769 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78804119-fe38-4038-895f-bcce9363271e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:04.201224 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78804119-fe38-4038-895f-bcce9363271e service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:04.219440 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2984/6007] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:24:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:24:04.439853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c721c2-9f0d-4349-a402-5a5053219b91 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:04.442512 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c3c721c2-9f0d-4349-a402-5a5053219b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:04.464809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c721c2-9f0d-4349-a402-5a5053219b91 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:04.477552 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c712fa-3fb3-4ffe-bbde-ed83bdd09a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:04.478994 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c712fa-3fb3-4ffe-bbde-ed83bdd09a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:04.479288 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c712fa-3fb3-4ffe-bbde-ed83bdd09a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:04.479564 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c712fa-3fb3-4ffe-bbde-ed83bdd09a1f admin admin] PATH_INFO: `/v3/projects/1643746e991a4d3c9238337dc815f6df` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:04.482238 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c712fa-3fb3-4ffe-bbde-ed83bdd09a1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1643746e991a4d3c9238337dc815f6df)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:04.488508 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c712fa-3fb3-4ffe-bbde-ed83bdd09a1f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:04.661105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c1c712fa-3fb3-4ffe-bbde-ed83bdd09a1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1643746e991a4d3c9238337dc815f6df', 'request_id': 'req-c1c712fa-3fb3-4ffe-bbde-ed83bdd09a1f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:04.667179 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:04.680796 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c1c712fa-3fb3-4ffe-bbde-ed83bdd09a1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1643746e991a4d3c9238337dc815f6df', 'request_id': 'req-c1c712fa-3fb3-4ffe-bbde-ed83bdd09a1f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:04.712063 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c1c712fa-3fb3-4ffe-bbde-ed83bdd09a1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1643746e991a4d3c9238337dc815f6df', 'request_id': 'req-c1c712fa-3fb3-4ffe-bbde-ed83bdd09a1f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:04.755280 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c1c712fa-3fb3-4ffe-bbde-ed83bdd09a1f admin admin] The token cache is being invalidate because project 1643746e991a4d3c9238337dc815f6df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:24:04.755614 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c1c712fa-3fb3-4ffe-bbde-ed83bdd09a1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:04.756277 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c1c712fa-3fb3-4ffe-bbde-ed83bdd09a1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:04.757886 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3024/6008] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:24:04 2022] DELETE /identity/v3/projects/1643746e991a4d3c9238337dc815f6df => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:04.763314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb76465-be55-40d4-9e4e-e93b7a945c01 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:04.763862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb76465-be55-40d4-9e4e-e93b7a945c01 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:04.763862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb76465-be55-40d4-9e4e-e93b7a945c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:04.790482 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-fbb76465-be55-40d4-9e4e-e93b7a945c01 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:04.792224 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-fbb76465-be55-40d4-9e4e-e93b7a945c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:04.908083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c712fa-3fb3-4ffe-bbde-ed83bdd09a1f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:04.909687 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c1c712fa-3fb3-4ffe-bbde-ed83bdd09a1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:05.004286 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2985/6009] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:24:05.011766 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388920ce-5257-4ef0-bd63-4ba5893e1a16 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:05.012092 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388920ce-5257-4ef0-bd63-4ba5893e1a16 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:05.012323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388920ce-5257-4ef0-bd63-4ba5893e1a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:05.032649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-388920ce-5257-4ef0-bd63-4ba5893e1a16 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:05.034042 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-388920ce-5257-4ef0-bd63-4ba5893e1a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:05.050477 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2986/6010] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:24:05.051303 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388920ce-5257-4ef0-bd63-4ba5893e1a16 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:05.061813 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388920ce-5257-4ef0-bd63-4ba5893e1a16 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:05.071298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309c8c6-eeb1-4deb-a40d-83ef37e0aa9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:05.072938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309c8c6-eeb1-4deb-a40d-83ef37e0aa9c admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:05.073484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309c8c6-eeb1-4deb-a40d-83ef37e0aa9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:05.073984 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309c8c6-eeb1-4deb-a40d-83ef37e0aa9c admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:05.074888 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309c8c6-eeb1-4deb-a40d-83ef37e0aa9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:24:05.075426 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309c8c6-eeb1-4deb-a40d-83ef37e0aa9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:05.077378 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309c8c6-eeb1-4deb-a40d-83ef37e0aa9c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:05.096368 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2987/6011] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:24:05.108046 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c712fa-3fb3-4ffe-bbde-ed83bdd09a1f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:05.110040 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309c8c6-eeb1-4deb-a40d-83ef37e0aa9c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:05.121002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309c8c6-eeb1-4deb-a40d-83ef37e0aa9c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:05.121684 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76f269-c8b5-4a53-af6d-4b4edfaf2f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:05.123359 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76f269-c8b5-4a53-af6d-4b4edfaf2f8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:05.125527 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76f269-c8b5-4a53-af6d-4b4edfaf2f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:05.126035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76f269-c8b5-4a53-af6d-4b4edfaf2f8e admin admin] PATH_INFO: `/v3/projects/6583531501cb4afd987e0b2c54d1195b` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:05.126597 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d96d21-2f67-4a74-9e0f-72adad5717a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:05.127954 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d96d21-2f67-4a74-9e0f-72adad5717a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:05.128404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d96d21-2f67-4a74-9e0f-72adad5717a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:05.128536 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b76f269-c8b5-4a53-af6d-4b4edfaf2f8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6583531501cb4afd987e0b2c54d1195b)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:05.128961 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d96d21-2f67-4a74-9e0f-72adad5717a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:05.130036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d96d21-2f67-4a74-9e0f-72adad5717a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:05.131282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b76f269-c8b5-4a53-af6d-4b4edfaf2f8e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:05.132301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d96d21-2f67-4a74-9e0f-72adad5717a5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:05.202300 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2988/6012] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:24:05 2022] POST /identity/v3/projects => generated 377 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:24:05.202300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d96d21-2f67-4a74-9e0f-72adad5717a5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:05.207025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-54d96d21-2f67-4a74-9e0f-72adad5717a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:05.232723 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1b76f269-c8b5-4a53-af6d-4b4edfaf2f8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6583531501cb4afd987e0b2c54d1195b', 'request_id': 'req-1b76f269-c8b5-4a53-af6d-4b4edfaf2f8e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:05.247878 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1b76f269-c8b5-4a53-af6d-4b4edfaf2f8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6583531501cb4afd987e0b2c54d1195b', 'request_id': 'req-1b76f269-c8b5-4a53-af6d-4b4edfaf2f8e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:05.266081 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1b76f269-c8b5-4a53-af6d-4b4edfaf2f8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6583531501cb4afd987e0b2c54d1195b', 'request_id': 'req-1b76f269-c8b5-4a53-af6d-4b4edfaf2f8e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:05.290788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1b76f269-c8b5-4a53-af6d-4b4edfaf2f8e admin admin] The token cache is being invalidate because project 6583531501cb4afd987e0b2c54d1195b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:24:05.291369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1b76f269-c8b5-4a53-af6d-4b4edfaf2f8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:05.292280 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1b76f269-c8b5-4a53-af6d-4b4edfaf2f8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:05.294435 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3025/6013] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:24:04 2022] DELETE /identity/v3/projects/6583531501cb4afd987e0b2c54d1195b => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:24:05.295388 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76f269-c8b5-4a53-af6d-4b4edfaf2f8e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:05.300072 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1b76f269-c8b5-4a53-af6d-4b4edfaf2f8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:05.322605 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d96d21-2f67-4a74-9e0f-72adad5717a5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:05.326829 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:05.401458 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76f269-c8b5-4a53-af6d-4b4edfaf2f8e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:05.406132 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d6131-cef8-49a5-a436-fcf36763c315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:05.406717 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d6131-cef8-49a5-a436-fcf36763c315 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:05.407058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d6131-cef8-49a5-a436-fcf36763c315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:05.407511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d6131-cef8-49a5-a436-fcf36763c315 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:05.408432 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d6131-cef8-49a5-a436-fcf36763c315 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:05.410768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d6131-cef8-49a5-a436-fcf36763c315 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:05.450262 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3026/6014] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:24:05 2022] POST /identity/v3/users => generated 289 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:24:05.451668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c18e62-3e10-4168-a04c-b9b378cfc91c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:05.453774 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c18e62-3e10-4168-a04c-b9b378cfc91c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:05.454156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c18e62-3e10-4168-a04c-b9b378cfc91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:05.463535 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d661f-bb4b-4c19-8038-61e250e4cf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:05.464210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d661f-bb4b-4c19-8038-61e250e4cf72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:05.464488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d661f-bb4b-4c19-8038-61e250e4cf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:05.464766 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d661f-bb4b-4c19-8038-61e250e4cf72 admin admin] PATH_INFO: `/v3/users/ad0b11c1c1614f1abfcf326d5238a670` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:05.466861 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d661f-bb4b-4c19-8038-61e250e4cf72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad0b11c1c1614f1abfcf326d5238a670)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:05.467364 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:05.468826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d661f-bb4b-4c19-8038-61e250e4cf72 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:05.486253 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-17c18e62-3e10-4168-a04c-b9b378cfc91c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:05.489418 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-17c18e62-3e10-4168-a04c-b9b378cfc91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:05.505538 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3027/6015] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:05.515664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c18e62-3e10-4168-a04c-b9b378cfc91c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:05.546489 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c18e62-3e10-4168-a04c-b9b378cfc91c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:05.559495 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bdc6e1-8064-410c-9d8a-89fc0334b1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:05.560588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdc6e1-8064-410c-9d8a-89fc0334b1de admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:05.561042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdc6e1-8064-410c-9d8a-89fc0334b1de admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:05.561427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdc6e1-8064-410c-9d8a-89fc0334b1de admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:05.569688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bdc6e1-8064-410c-9d8a-89fc0334b1de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:05.571432 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bdc6e1-8064-410c-9d8a-89fc0334b1de admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:05.584691 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ba2d661f-bb4b-4c19-8038-61e250e4cf72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad0b11c1c1614f1abfcf326d5238a670'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:05.591411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ba2d661f-bb4b-4c19-8038-61e250e4cf72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad0b11c1c1614f1abfcf326d5238a670'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:05.592759 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3028/6016] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:24:05.594800 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4af80-20dd-4b9b-8f95-db90bdd181d0 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:05.595275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4af80-20dd-4b9b-8f95-db90bdd181d0 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:05.596282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4af80-20dd-4b9b-8f95-db90bdd181d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:05.606026 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ba2d661f-bb4b-4c19-8038-61e250e4cf72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad0b11c1c1614f1abfcf326d5238a670'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:05.623593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-4ad4af80-20dd-4b9b-8f95-db90bdd181d0 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:05.625535 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4ad4af80-20dd-4b9b-8f95-db90bdd181d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:05.637221 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3029/6017] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:05.638568 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4af80-20dd-4b9b-8f95-db90bdd181d0 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:05.640402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4ad4af80-20dd-4b9b-8f95-db90bdd181d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:05.641910 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ba2d661f-bb4b-4c19-8038-61e250e4cf72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad0b11c1c1614f1abfcf326d5238a670'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:05.642955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ba2d661f-bb4b-4c19-8038-61e250e4cf72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad0b11c1c1614f1abfcf326d5238a670'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:05.667568 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2989/6018] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:24:05 2022] DELETE /identity/v3/users/ad0b11c1c1614f1abfcf326d5238a670 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:05.668755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d661f-bb4b-4c19-8038-61e250e4cf72 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:05.687796 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4af80-20dd-4b9b-8f95-db90bdd181d0 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:05.770474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d661f-bb4b-4c19-8038-61e250e4cf72 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:05.779190 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42014802-5083-4042-bbb2-4ab7e419a65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:05.779190 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42014802-5083-4042-bbb2-4ab7e419a65a admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:05.779190 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42014802-5083-4042-bbb2-4ab7e419a65a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:05.780802 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42014802-5083-4042-bbb2-4ab7e419a65a admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:05.782989 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42014802-5083-4042-bbb2-4ab7e419a65a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:24:05.783924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42014802-5083-4042-bbb2-4ab7e419a65a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:05.787110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42014802-5083-4042-bbb2-4ab7e419a65a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:05.792577 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e28474-e4d8-4a24-917b-2099924dc7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:05.793486 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e28474-e4d8-4a24-917b-2099924dc7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:05.793775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e28474-e4d8-4a24-917b-2099924dc7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:05.794052 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e28474-e4d8-4a24-917b-2099924dc7c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:05.794798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e28474-e4d8-4a24-917b-2099924dc7c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:05.796581 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e28474-e4d8-4a24-917b-2099924dc7c0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:05.813522 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3030/6019] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:24:05.815402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0b3cc-7ab2-49c8-ada2-9da55566ac71 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:05.815859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0b3cc-7ab2-49c8-ada2-9da55566ac71 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:05.816299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0b3cc-7ab2-49c8-ada2-9da55566ac71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:05.818235 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2990/6020] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:24:05.824439 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42014802-5083-4042-bbb2-4ab7e419a65a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:05.858175 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42014802-5083-4042-bbb2-4ab7e419a65a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:05.861361 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-82c0b3cc-7ab2-49c8-ada2-9da55566ac71 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:05.863801 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-82c0b3cc-7ab2-49c8-ada2-9da55566ac71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:05.874621 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3031/6021] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:05.875713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4cdf76-1ced-46b1-8811-17cdbcd61dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:05.878694 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0b3cc-7ab2-49c8-ada2-9da55566ac71 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:05.885018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cdf76-1ced-46b1-8811-17cdbcd61dcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:05.886490 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cdf76-1ced-46b1-8811-17cdbcd61dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:05.887876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cdf76-1ced-46b1-8811-17cdbcd61dcc admin admin] PATH_INFO: `/v3/projects/53a4fe7f6c114343854490085f8ab566/users/2c3166204f834b148d9807b1b8115f5d/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:05.889998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0b3cc-7ab2-49c8-ada2-9da55566ac71 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:05.895976 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd1d3d-18f2-4708-9431-ab6a89de2fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:05.896924 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd1d3d-18f2-4708-9431-ab6a89de2fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:05.897315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd1d3d-18f2-4708-9431-ab6a89de2fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:05.897726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd1d3d-18f2-4708-9431-ab6a89de2fd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:05.898470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd1d3d-18f2-4708-9431-ab6a89de2fd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:05.900722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd1d3d-18f2-4708-9431-ab6a89de2fd4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:05.948814 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4cdf76-1ced-46b1-8811-17cdbcd61dcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=53a4fe7f6c114343854490085f8ab566, user_id=2c3166204f834b148d9807b1b8115f5d, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:05.951065 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3032/6022] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:24:05 2022] POST /identity/v3/projects => generated 389 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:24:05.952092 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4cdf76-1ced-46b1-8811-17cdbcd61dcc admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:05.952280 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd1d3d-18f2-4708-9431-ab6a89de2fd4 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:05.954230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a1cd1d3d-18f2-4708-9431-ab6a89de2fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:05.961609 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:05.985948 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2991/6023] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:24:05 2022] PUT /identity/v3/projects/53a4fe7f6c114343854490085f8ab566/users/2c3166204f834b148d9807b1b8115f5d/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:05.996798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4cdf76-1ced-46b1-8811-17cdbcd61dcc admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:06.090772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4cdf76-1ced-46b1-8811-17cdbcd61dcc admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:06.096625 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54134b1-f209-4b41-8bcb-4feb5ee7c20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:06.098433 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54134b1-f209-4b41-8bcb-4feb5ee7c20e admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:06.098729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54134b1-f209-4b41-8bcb-4feb5ee7c20e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:06.099007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54134b1-f209-4b41-8bcb-4feb5ee7c20e admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:06.099970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54134b1-f209-4b41-8bcb-4feb5ee7c20e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:06.102417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54134b1-f209-4b41-8bcb-4feb5ee7c20e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:06.138644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd1d3d-18f2-4708-9431-ab6a89de2fd4 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:06.156228 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2992/6024] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:24:05 2022] POST /identity/v3/users => generated 295 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:24:06.157613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b59775-3ec5-4030-b460-ebfe3fa92053 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:06.157907 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b59775-3ec5-4030-b460-ebfe3fa92053 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:06.158948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b59775-3ec5-4030-b460-ebfe3fa92053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:06.224900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e7b59775-3ec5-4030-b460-ebfe3fa92053 None None] MFA Rules not processed for user `2c3166204f834b148d9807b1b8115f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:06.226596 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e7b59775-3ec5-4030-b460-ebfe3fa92053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:06.238606 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a6e02-bb07-4c60-8db7-4d7a4d600532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:06.239252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a6e02-bb07-4c60-8db7-4d7a4d600532 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:06.239498 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a6e02-bb07-4c60-8db7-4d7a4d600532 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:06.239772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a6e02-bb07-4c60-8db7-4d7a4d600532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:06.249737 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a6e02-bb07-4c60-8db7-4d7a4d600532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:06.251252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a6e02-bb07-4c60-8db7-4d7a4d600532 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:06.274121 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3033/6025] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:24:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:24:06.275052 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a6e02-bb07-4c60-8db7-4d7a4d600532 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:06.291416 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:06.296613 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a6e02-bb07-4c60-8db7-4d7a4d600532 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:06.313739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b192e70-2f7d-4030-bcb0-659ef01d2515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:06.315222 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b192e70-2f7d-4030-bcb0-659ef01d2515 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:06.315680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b192e70-2f7d-4030-bcb0-659ef01d2515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:06.316132 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b192e70-2f7d-4030-bcb0-659ef01d2515 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:06.316950 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b192e70-2f7d-4030-bcb0-659ef01d2515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:06.322605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b192e70-2f7d-4030-bcb0-659ef01d2515 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:06.345085 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3034/6026] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:24:06.348973 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b192e70-2f7d-4030-bcb0-659ef01d2515 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:06.369406 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2993/6027] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:06.371188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b59775-3ec5-4030-b460-ebfe3fa92053 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:06.373206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b192e70-2f7d-4030-bcb0-659ef01d2515 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:06.386195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a2784-a774-4359-945b-449183b5f1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:06.387164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a2784-a774-4359-945b-449183b5f1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:06.387627 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a2784-a774-4359-945b-449183b5f1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:06.388970 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a2784-a774-4359-945b-449183b5f1d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:06.389807 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a2784-a774-4359-945b-449183b5f1d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:06.394042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a2784-a774-4359-945b-449183b5f1d6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:06.394521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b59775-3ec5-4030-b460-ebfe3fa92053 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:06.405729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be26f46-6692-48e8-ab37-88511353d5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:06.407539 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be26f46-6692-48e8-ab37-88511353d5c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:06.409835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be26f46-6692-48e8-ab37-88511353d5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:06.410147 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be26f46-6692-48e8-ab37-88511353d5c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:06.410811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be26f46-6692-48e8-ab37-88511353d5c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:06.415080 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be26f46-6692-48e8-ab37-88511353d5c2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:06.416848 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3035/6028] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:24:06.424390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a2784-a774-4359-945b-449183b5f1d6 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:06.443839 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a2784-a774-4359-945b-449183b5f1d6 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:06.449119 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e655e97-45f4-4b71-8d75-5f3eed45f319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:06.449857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e655e97-45f4-4b71-8d75-5f3eed45f319 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:06.450075 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e655e97-45f4-4b71-8d75-5f3eed45f319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:06.450378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e655e97-45f4-4b71-8d75-5f3eed45f319 admin admin] PATH_INFO: `/v3/projects/960a8911f9c141d89fbde370c945c05f/users/2bd410471c2340aa97bbfe8057122303/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:06.471817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e655e97-45f4-4b71-8d75-5f3eed45f319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=960a8911f9c141d89fbde370c945c05f, user_id=2bd410471c2340aa97bbfe8057122303, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:06.475359 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e655e97-45f4-4b71-8d75-5f3eed45f319 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:06.502991 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3036/6029] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:24:06 2022] PUT /identity/v3/projects/960a8911f9c141d89fbde370c945c05f/users/2bd410471c2340aa97bbfe8057122303/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:06.505830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d049e9-8aec-46a6-89cf-b822c5ac8e4b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:06.506241 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d049e9-8aec-46a6-89cf-b822c5ac8e4b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:06.507044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d049e9-8aec-46a6-89cf-b822c5ac8e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:06.512461 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2994/6030] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:24:06 2022] POST /identity/v3/projects => generated 379 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:24:06.516372 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be26f46-6692-48e8-ab37-88511353d5c2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:06.529637 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e9d049e9-8aec-46a6-89cf-b822c5ac8e4b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:06.531307 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e9d049e9-8aec-46a6-89cf-b822c5ac8e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:06.620786 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3037/6031] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:06.622497 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:06.632831 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d049e9-8aec-46a6-89cf-b822c5ac8e4b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:06.640695 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be26f46-6692-48e8-ab37-88511353d5c2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:06.653953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a88d0f-91de-4e21-9506-d3035c7ed3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:06.654679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a88d0f-91de-4e21-9506-d3035c7ed3f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:06.654964 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a88d0f-91de-4e21-9506-d3035c7ed3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:06.655237 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a88d0f-91de-4e21-9506-d3035c7ed3f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:06.655883 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a88d0f-91de-4e21-9506-d3035c7ed3f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:06.657852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a88d0f-91de-4e21-9506-d3035c7ed3f9 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:06.703109 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2995/6032] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:24:06 2022] POST /identity/v3/users => generated 290 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:24:06.706923 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a88d0f-91de-4e21-9506-d3035c7ed3f9 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:06.722798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a88d0f-91de-4e21-9506-d3035c7ed3f9 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:06.741333 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b4bd0-0700-4293-9298-4ac1b94cd328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:06.742009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b4bd0-0700-4293-9298-4ac1b94cd328 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:06.742294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b4bd0-0700-4293-9298-4ac1b94cd328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:06.742569 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b4bd0-0700-4293-9298-4ac1b94cd328 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:06.743222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b4bd0-0700-4293-9298-4ac1b94cd328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:06.744840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b4bd0-0700-4293-9298-4ac1b94cd328 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:06.765658 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d049e9-8aec-46a6-89cf-b822c5ac8e4b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:06.768753 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2996/6033] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:24:06.772969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b4bd0-0700-4293-9298-4ac1b94cd328 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:06.777659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87779c-a552-4606-8ead-bb944f73a90f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:06.778915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87779c-a552-4606-8ead-bb944f73a90f service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:06.779735 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87779c-a552-4606-8ead-bb944f73a90f service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:06.780745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87779c-a552-4606-8ead-bb944f73a90f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:06.791542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b4bd0-0700-4293-9298-4ac1b94cd328 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:06.796987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84dfb68-886c-4093-8b43-feabc942a746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:06.797644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dfb68-886c-4093-8b43-feabc942a746 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:06.797930 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dfb68-886c-4093-8b43-feabc942a746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:06.798202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dfb68-886c-4093-8b43-feabc942a746 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:06.799392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84dfb68-886c-4093-8b43-feabc942a746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:06.800998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84dfb68-886c-4093-8b43-feabc942a746 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:06.806845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f87779c-a552-4606-8ead-bb944f73a90f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:06.812336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f87779c-a552-4606-8ead-bb944f73a90f service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:06.827784 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2997/6034] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:24:06.831888 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84dfb68-886c-4093-8b43-feabc942a746 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:06.842093 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3038/6035] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:24:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:24:06.864588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84dfb68-886c-4093-8b43-feabc942a746 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:06.873869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a353e8-ead4-401f-8c4f-0b7e339a09ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:06.874599 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a353e8-ead4-401f-8c4f-0b7e339a09ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:06.874923 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a353e8-ead4-401f-8c4f-0b7e339a09ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:06.875153 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a353e8-ead4-401f-8c4f-0b7e339a09ed admin admin] PATH_INFO: `/v3/projects/ef793657ad3e44828045d7d24129442a/users/0073abf2771c4797a1cc4fcd71f6b008/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:06.890271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87779c-a552-4606-8ead-bb944f73a90f service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:06.891776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6f87779c-a552-4606-8ead-bb944f73a90f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:06.911624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87779c-a552-4606-8ead-bb944f73a90f service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:06.914911 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a353e8-ead4-401f-8c4f-0b7e339a09ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef793657ad3e44828045d7d24129442a, user_id=0073abf2771c4797a1cc4fcd71f6b008, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:06.917992 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a353e8-ead4-401f-8c4f-0b7e339a09ed admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:06.927011 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e33b11a-f2e3-4a0e-a7be-70fa8b6711f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:06.927674 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33b11a-f2e3-4a0e-a7be-70fa8b6711f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:06.927962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33b11a-f2e3-4a0e-a7be-70fa8b6711f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:06.928715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33b11a-f2e3-4a0e-a7be-70fa8b6711f1 admin admin] PATH_INFO: `/v3/projects/e939dc08210f46ffa5b6050608705be1` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:06.942139 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e33b11a-f2e3-4a0e-a7be-70fa8b6711f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e939dc08210f46ffa5b6050608705be1)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:06.947329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e33b11a-f2e3-4a0e-a7be-70fa8b6711f1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:06.964804 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2998/6036] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:24:06 2022] PUT /identity/v3/projects/ef793657ad3e44828045d7d24129442a/users/0073abf2771c4797a1cc4fcd71f6b008/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:24:06.979479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ba31e-209e-4473-a342-04dd5c07f304 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:06.979755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ba31e-209e-4473-a342-04dd5c07f304 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:06.980174 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ba31e-209e-4473-a342-04dd5c07f304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:07.045881 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-0e3ba31e-209e-4473-a342-04dd5c07f304 None None] MFA Rules not processed for user `0073abf2771c4797a1cc4fcd71f6b008`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:07.047112 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0e3ba31e-209e-4473-a342-04dd5c07f304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:07.080289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0e33b11a-f2e3-4a0e-a7be-70fa8b6711f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e939dc08210f46ffa5b6050608705be1', 'request_id': 'req-0e33b11a-f2e3-4a0e-a7be-70fa8b6711f1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:07.101664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0e33b11a-f2e3-4a0e-a7be-70fa8b6711f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e939dc08210f46ffa5b6050608705be1', 'request_id': 'req-0e33b11a-f2e3-4a0e-a7be-70fa8b6711f1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:07.103166 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:07.119920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0e33b11a-f2e3-4a0e-a7be-70fa8b6711f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e939dc08210f46ffa5b6050608705be1', 'request_id': 'req-0e33b11a-f2e3-4a0e-a7be-70fa8b6711f1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:07.152565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0e33b11a-f2e3-4a0e-a7be-70fa8b6711f1 admin admin] The token cache is being invalidate because project e939dc08210f46ffa5b6050608705be1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:24:07.152909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0e33b11a-f2e3-4a0e-a7be-70fa8b6711f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:07.154181 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0e33b11a-f2e3-4a0e-a7be-70fa8b6711f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:07.159362 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3039/6037] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:24:06 2022] DELETE /identity/v3/projects/e939dc08210f46ffa5b6050608705be1 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:24:07.162972 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e33b11a-f2e3-4a0e-a7be-70fa8b6711f1 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:07.166182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0e33b11a-f2e3-4a0e-a7be-70fa8b6711f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:07.273579 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 2999/6038] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:07.277653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ba31e-209e-4473-a342-04dd5c07f304 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:07.279465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0e3ba31e-209e-4473-a342-04dd5c07f304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:07.339093 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e33b11a-f2e3-4a0e-a7be-70fa8b6711f1 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:07.356685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9e6ad-2c01-4ed7-a2b2-51552514db28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:07.357355 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9e6ad-2c01-4ed7-a2b2-51552514db28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:07.357742 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9e6ad-2c01-4ed7-a2b2-51552514db28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:07.358043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9e6ad-2c01-4ed7-a2b2-51552514db28 admin admin] PATH_INFO: `/v3/users/b5ffbee89f3348b9929101b45f2a144e` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:07.359384 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9e6ad-2c01-4ed7-a2b2-51552514db28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5ffbee89f3348b9929101b45f2a144e)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:07.361929 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9e6ad-2c01-4ed7-a2b2-51552514db28 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:07.376337 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ba31e-209e-4473-a342-04dd5c07f304 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:07.384175 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a3c02-0d88-4f4f-972e-ee5b8e300788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:07.385833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a3c02-0d88-4f4f-972e-ee5b8e300788 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:07.386379 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a3c02-0d88-4f4f-972e-ee5b8e300788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:07.386850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a3c02-0d88-4f4f-972e-ee5b8e300788 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:07.387682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a3c02-0d88-4f4f-972e-ee5b8e300788 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:07.391880 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a3c02-0d88-4f4f-972e-ee5b8e300788 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:07.442849 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3000/6039] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:24:07 2022] POST /identity/v3/projects => generated 375 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:24:07.444412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a3c02-0d88-4f4f-972e-ee5b8e300788 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:07.450492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e1a9e6ad-2c01-4ed7-a2b2-51552514db28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5ffbee89f3348b9929101b45f2a144e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:07.452334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e1a9e6ad-2c01-4ed7-a2b2-51552514db28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5ffbee89f3348b9929101b45f2a144e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:07.471369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e1a9e6ad-2c01-4ed7-a2b2-51552514db28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5ffbee89f3348b9929101b45f2a144e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:07.496971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e1a9e6ad-2c01-4ed7-a2b2-51552514db28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5ffbee89f3348b9929101b45f2a144e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:07.497743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e1a9e6ad-2c01-4ed7-a2b2-51552514db28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5ffbee89f3348b9929101b45f2a144e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:07.509488 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:07.546382 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3040/6040] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:24:07 2022] DELETE /identity/v3/users/b5ffbee89f3348b9929101b45f2a144e => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:07.681606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a3c02-0d88-4f4f-972e-ee5b8e300788 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:07.818179 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03307864-d853-4885-981c-99e788e65ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:07.819722 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03307864-d853-4885-981c-99e788e65ac7 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:07.822303 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03307864-d853-4885-981c-99e788e65ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:07.822979 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03307864-d853-4885-981c-99e788e65ac7 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:07.823892 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03307864-d853-4885-981c-99e788e65ac7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:07.831539 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03307864-d853-4885-981c-99e788e65ac7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:07.887695 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3001/6041] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:24:07 2022] POST /identity/v3/users => generated 294 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:24:07.891717 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9e6ad-2c01-4ed7-a2b2-51552514db28 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:07.894144 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e1a9e6ad-2c01-4ed7-a2b2-51552514db28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:07.930841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9e6ad-2c01-4ed7-a2b2-51552514db28 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:07.949762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3149ff95-8eec-4435-ae26-a487605c216d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:07.952599 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149ff95-8eec-4435-ae26-a487605c216d admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:07.954912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149ff95-8eec-4435-ae26-a487605c216d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:07.956666 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149ff95-8eec-4435-ae26-a487605c216d admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:07.960208 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3149ff95-8eec-4435-ae26-a487605c216d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:07.965710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3149ff95-8eec-4435-ae26-a487605c216d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:07.979212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03307864-d853-4885-981c-99e788e65ac7 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:07.981531 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-03307864-d853-4885-981c-99e788e65ac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:08.016175 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03307864-d853-4885-981c-99e788e65ac7 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:08.033651 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3041/6042] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:24:08.034774 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3149ff95-8eec-4435-ae26-a487605c216d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:08.042403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a8d28-e750-4e41-96c4-99aadd5decc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:08.045626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a8d28-e750-4e41-96c4-99aadd5decc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:08.046137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a8d28-e750-4e41-96c4-99aadd5decc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:08.046498 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a8d28-e750-4e41-96c4-99aadd5decc5 admin admin] PATH_INFO: `/v3/projects/9bb0baa91ec4406c82179c1e57f8c53c` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:08.049181 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a8d28-e750-4e41-96c4-99aadd5decc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bb0baa91ec4406c82179c1e57f8c53c)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:08.059938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a8d28-e750-4e41-96c4-99aadd5decc5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:08.067912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3149ff95-8eec-4435-ae26-a487605c216d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:08.091303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a0591-053a-4031-ac69-7b61fc4f2a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:08.092161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a0591-053a-4031-ac69-7b61fc4f2a26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:08.092550 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a0591-053a-4031-ac69-7b61fc4f2a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:08.093599 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a0591-053a-4031-ac69-7b61fc4f2a26 admin admin] PATH_INFO: `/v3/projects/a7322c4c417241178ba66b633bca1d1b/users/599a8d44cef94921b89f8cee037af289/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:08.143190 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a0591-053a-4031-ac69-7b61fc4f2a26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7322c4c417241178ba66b633bca1d1b, user_id=599a8d44cef94921b89f8cee037af289, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:08.146152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a0591-053a-4031-ac69-7b61fc4f2a26 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:08.181958 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3042/6043] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:24:08 2022] PUT /identity/v3/projects/a7322c4c417241178ba66b633bca1d1b/users/599a8d44cef94921b89f8cee037af289/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:08.186057 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a0591-053a-4031-ac69-7b61fc4f2a26 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:08.216496 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f43a8d28-e750-4e41-96c4-99aadd5decc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bb0baa91ec4406c82179c1e57f8c53c', 'request_id': 'req-f43a8d28-e750-4e41-96c4-99aadd5decc5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:08.232333 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f43a8d28-e750-4e41-96c4-99aadd5decc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bb0baa91ec4406c82179c1e57f8c53c', 'request_id': 'req-f43a8d28-e750-4e41-96c4-99aadd5decc5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:08.243706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f43a8d28-e750-4e41-96c4-99aadd5decc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bb0baa91ec4406c82179c1e57f8c53c', 'request_id': 'req-f43a8d28-e750-4e41-96c4-99aadd5decc5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:08.258652 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:08.263092 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f43a8d28-e750-4e41-96c4-99aadd5decc5 admin admin] The token cache is being invalidate because project 9bb0baa91ec4406c82179c1e57f8c53c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:24:08.263890 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f43a8d28-e750-4e41-96c4-99aadd5decc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:08.264819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f43a8d28-e750-4e41-96c4-99aadd5decc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:08.273216 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3002/6044] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:24:07 2022] DELETE /identity/v3/projects/9bb0baa91ec4406c82179c1e57f8c53c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:24:08.279214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e86941-2734-42eb-8be9-fea05a8b1543 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:08.279675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e86941-2734-42eb-8be9-fea05a8b1543 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:08.280198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e86941-2734-42eb-8be9-fea05a8b1543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:08.308446 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-54e86941-2734-42eb-8be9-fea05a8b1543 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:08.309688 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-54e86941-2734-42eb-8be9-fea05a8b1543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:08.324162 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a0591-053a-4031-ac69-7b61fc4f2a26 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:08.363902 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:08.409635 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816e1e3-cddb-425a-9bc3-adecf98258f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:08.414064 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816e1e3-cddb-425a-9bc3-adecf98258f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:08.414529 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816e1e3-cddb-425a-9bc3-adecf98258f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:08.414989 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816e1e3-cddb-425a-9bc3-adecf98258f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:08.415815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4816e1e3-cddb-425a-9bc3-adecf98258f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:08.418232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4816e1e3-cddb-425a-9bc3-adecf98258f6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:08.428628 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3003/6045] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:08.429683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e86941-2734-42eb-8be9-fea05a8b1543 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:08.434538 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-54e86941-2734-42eb-8be9-fea05a8b1543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:08.454334 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3043/6046] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:24:08.454334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b220a1-2b13-43d0-9f21-f8509fc8d959 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:08.454334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b220a1-2b13-43d0-9f21-f8509fc8d959 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:08.457073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b220a1-2b13-43d0-9f21-f8509fc8d959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:08.469907 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e86941-2734-42eb-8be9-fea05a8b1543 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:08.484100 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20822f2c-365e-4660-a7e7-5d5a64a957bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:08.484907 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20822f2c-365e-4660-a7e7-5d5a64a957bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:08.485296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20822f2c-365e-4660-a7e7-5d5a64a957bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:08.485692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20822f2c-365e-4660-a7e7-5d5a64a957bc admin admin] PATH_INFO: `/v3/users/5c98702486964510b7fd15a42af3f563` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:08.489102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20822f2c-365e-4660-a7e7-5d5a64a957bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c98702486964510b7fd15a42af3f563)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:08.507169 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20822f2c-365e-4660-a7e7-5d5a64a957bc admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:08.513415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-01b220a1-2b13-43d0-9f21-f8509fc8d959 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:08.515668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-01b220a1-2b13-43d0-9f21-f8509fc8d959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:08.551074 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3044/6047] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:08.552051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b220a1-2b13-43d0-9f21-f8509fc8d959 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:08.556893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-01b220a1-2b13-43d0-9f21-f8509fc8d959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:08.581155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b220a1-2b13-43d0-9f21-f8509fc8d959 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:08.596100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aab095-019c-42be-9df6-ef75ab15c4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:08.597107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aab095-019c-42be-9df6-ef75ab15c4eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:08.597668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aab095-019c-42be-9df6-ef75ab15c4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:08.598170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aab095-019c-42be-9df6-ef75ab15c4eb admin admin] PATH_INFO: `/v3/projects/a7322c4c417241178ba66b633bca1d1b/users/599a8d44cef94921b89f8cee037af289/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:08.602750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aab095-019c-42be-9df6-ef75ab15c4eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7322c4c417241178ba66b633bca1d1b, user_id=599a8d44cef94921b89f8cee037af289, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:08.606418 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aab095-019c-42be-9df6-ef75ab15c4eb admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:08.641554 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-20822f2c-365e-4660-a7e7-5d5a64a957bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c98702486964510b7fd15a42af3f563'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:08.644912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-20822f2c-365e-4660-a7e7-5d5a64a957bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c98702486964510b7fd15a42af3f563'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:08.651067 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3045/6048] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:24:08 2022] PUT /identity/v3/projects/a7322c4c417241178ba66b633bca1d1b/users/599a8d44cef94921b89f8cee037af289/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:08.653342 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aab095-019c-42be-9df6-ef75ab15c4eb admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:08.661182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c1aab095-019c-42be-9df6-ef75ab15c4eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:08.662486 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-20822f2c-365e-4660-a7e7-5d5a64a957bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c98702486964510b7fd15a42af3f563'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:08.683120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-20822f2c-365e-4660-a7e7-5d5a64a957bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c98702486964510b7fd15a42af3f563'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:08.683951 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-20822f2c-365e-4660-a7e7-5d5a64a957bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c98702486964510b7fd15a42af3f563'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:08.721890 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3004/6049] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:24:08 2022] DELETE /identity/v3/users/5c98702486964510b7fd15a42af3f563 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:08.723340 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fe095-c6e7-4e8d-9aa6-63374f446a70 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:08.723741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fe095-c6e7-4e8d-9aa6-63374f446a70 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:08.726192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fe095-c6e7-4e8d-9aa6-63374f446a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:08.792507 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-0b6fe095-c6e7-4e8d-9aa6-63374f446a70 None None] MFA Rules not processed for user `599a8d44cef94921b89f8cee037af289`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:08.797860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0b6fe095-c6e7-4e8d-9aa6-63374f446a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:08.811492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aab095-019c-42be-9df6-ef75ab15c4eb admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:08.942420 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c0af3-f172-4f1f-a8af-35314d97c74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:08.942724 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c0af3-f172-4f1f-a8af-35314d97c74e admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:08.943006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c0af3-f172-4f1f-a8af-35314d97c74e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:08.943280 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c0af3-f172-4f1f-a8af-35314d97c74e admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:08.946231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c0af3-f172-4f1f-a8af-35314d97c74e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:24:08.946545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c0af3-f172-4f1f-a8af-35314d97c74e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:08.949974 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c0af3-f172-4f1f-a8af-35314d97c74e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:08.951949 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:08.980810 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3046/6050] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:24:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:24:08.983291 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77989d56-a418-4a0e-940b-2edbdd35c509 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:08.983587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77989d56-a418-4a0e-940b-2edbdd35c509 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:08.988455 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77989d56-a418-4a0e-940b-2edbdd35c509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:09.005539 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3005/6051] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:09.006431 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6fe095-c6e7-4e8d-9aa6-63374f446a70 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:09.021365 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-77989d56-a418-4a0e-940b-2edbdd35c509 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:09.022615 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-77989d56-a418-4a0e-940b-2edbdd35c509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:09.026737 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6fe095-c6e7-4e8d-9aa6-63374f446a70 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:09.036607 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477e79e-ec24-42bd-965e-775ff2752a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:09.037244 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477e79e-ec24-42bd-965e-775ff2752a67 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:09.037552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477e79e-ec24-42bd-965e-775ff2752a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:09.037832 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477e79e-ec24-42bd-965e-775ff2752a67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:09.038484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c477e79e-ec24-42bd-965e-775ff2752a67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:09.040418 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c477e79e-ec24-42bd-965e-775ff2752a67 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:09.050036 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3047/6052] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:09.050036 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77989d56-a418-4a0e-940b-2edbdd35c509 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:09.051585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-77989d56-a418-4a0e-940b-2edbdd35c509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:09.119662 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3006/6053] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:24:09 2022] POST /identity/v3/projects => generated 365 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:24:09.120560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477e79e-ec24-42bd-965e-775ff2752a67 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:09.127102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c477e79e-ec24-42bd-965e-775ff2752a67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:09.155690 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:09.210527 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77989d56-a418-4a0e-940b-2edbdd35c509 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:09.272294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477e79e-ec24-42bd-965e-775ff2752a67 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:09.283485 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c42ae-98a6-4293-87f9-d86bc3165cf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:09.284269 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c42ae-98a6-4293-87f9-d86bc3165cf1 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:09.284551 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c42ae-98a6-4293-87f9-d86bc3165cf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:09.284825 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c42ae-98a6-4293-87f9-d86bc3165cf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:09.336293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcddcd0-2a08-4931-b4da-fcdc25cf90ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:09.337109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcddcd0-2a08-4931-b4da-fcdc25cf90ec service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:09.337393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcddcd0-2a08-4931-b4da-fcdc25cf90ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:09.339695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcddcd0-2a08-4931-b4da-fcdc25cf90ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:09.443112 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c42ae-98a6-4293-87f9-d86bc3165cf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:09.444601 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c42ae-98a6-4293-87f9-d86bc3165cf1 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:09.483684 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3007/6054] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:24:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:24:09.484523 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c42ae-98a6-4293-87f9-d86bc3165cf1 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:09.520678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c42ae-98a6-4293-87f9-d86bc3165cf1 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:09.526445 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcddcd0-2a08-4931-b4da-fcdc25cf90ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:09.528016 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcddcd0-2a08-4931-b4da-fcdc25cf90ec service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:09.542539 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e87c3-5e9b-401b-8bb0-1f3b59bf5bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:09.543184 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e87c3-5e9b-401b-8bb0-1f3b59bf5bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:09.543467 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e87c3-5e9b-401b-8bb0-1f3b59bf5bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:09.543739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e87c3-5e9b-401b-8bb0-1f3b59bf5bf8 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:09.544380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e87c3-5e9b-401b-8bb0-1f3b59bf5bf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:09.551350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e87c3-5e9b-401b-8bb0-1f3b59bf5bf8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:09.559046 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3048/6055] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:24:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:24:09.625474 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3008/6056] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:24:09 2022] POST /identity/v3/users => generated 283 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:24:09.626894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcddcd0-2a08-4931-b4da-fcdc25cf90ec service cinder] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:09.645682 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcddcd0-2a08-4931-b4da-fcdc25cf90ec service cinder] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:09.671930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4db03d-68e5-4b76-9fe2-87e33fe1f666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:09.678285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4db03d-68e5-4b76-9fe2-87e33fe1f666 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:09.679316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4db03d-68e5-4b76-9fe2-87e33fe1f666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:09.679763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4db03d-68e5-4b76-9fe2-87e33fe1f666 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:09.684133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4db03d-68e5-4b76-9fe2-87e33fe1f666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:09.695813 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4db03d-68e5-4b76-9fe2-87e33fe1f666 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:09.748336 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3049/6057] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:24:09.752971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e87c3-5e9b-401b-8bb0-1f3b59bf5bf8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:09.771224 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e87c3-5e9b-401b-8bb0-1f3b59bf5bf8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:09.791747 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795240e-1211-4eb4-bc59-d13b418329be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:09.792667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795240e-1211-4eb4-bc59-d13b418329be admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:09.795007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795240e-1211-4eb4-bc59-d13b418329be admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:09.797966 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795240e-1211-4eb4-bc59-d13b418329be admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:09.798915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795240e-1211-4eb4-bc59-d13b418329be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:09.802147 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795240e-1211-4eb4-bc59-d13b418329be admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:09.842585 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3009/6058] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:24:09.847722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4db03d-68e5-4b76-9fe2-87e33fe1f666 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:09.864239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4db03d-68e5-4b76-9fe2-87e33fe1f666 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:09.877534 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4d719-eb0b-44bb-92fe-14e208db98f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:09.878231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4d719-eb0b-44bb-92fe-14e208db98f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:09.878515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4d719-eb0b-44bb-92fe-14e208db98f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:09.878790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4d719-eb0b-44bb-92fe-14e208db98f1 admin admin] PATH_INFO: `/v3/projects/7e5109bf3fe94d048de6d45e5a813f72/users/aa6a455e8f9443a2bd14dbfd4ff03046/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:09.901949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795240e-1211-4eb4-bc59-d13b418329be admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:09.911252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa4d719-eb0b-44bb-92fe-14e208db98f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e5109bf3fe94d048de6d45e5a813f72, user_id=aa6a455e8f9443a2bd14dbfd4ff03046, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:09.913257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa4d719-eb0b-44bb-92fe-14e208db98f1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:09.923756 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795240e-1211-4eb4-bc59-d13b418329be admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:09.949298 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3050/6059] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:24:09 2022] PUT /identity/v3/projects/7e5109bf3fe94d048de6d45e5a813f72/users/aa6a455e8f9443a2bd14dbfd4ff03046/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:09.963537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b6fa4-a404-4dfb-9be8-86b7626a5792 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:09.964011 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b6fa4-a404-4dfb-9be8-86b7626a5792 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:09.964442 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b6fa4-a404-4dfb-9be8-86b7626a5792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:10.055229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-248b6fa4-a404-4dfb-9be8-86b7626a5792 None None] MFA Rules not processed for user `aa6a455e8f9443a2bd14dbfd4ff03046`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:10.059211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-248b6fa4-a404-4dfb-9be8-86b7626a5792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:10.075431 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:10.084975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91cc312-5bef-49bf-b9f1-6b86aedf6b27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:10.085653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91cc312-5bef-49bf-b9f1-6b86aedf6b27 service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:10.085909 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91cc312-5bef-49bf-b9f1-6b86aedf6b27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:10.086188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91cc312-5bef-49bf-b9f1-6b86aedf6b27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:10.090884 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d91cc312-5bef-49bf-b9f1-6b86aedf6b27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:10.197072 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:10.220238 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91cc312-5bef-49bf-b9f1-6b86aedf6b27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:10.222874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91cc312-5bef-49bf-b9f1-6b86aedf6b27 service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:10.226175 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3051/6060] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:24:10.228247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b6fa4-a404-4dfb-9be8-86b7626a5792 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:10.241252 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3010/6061] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:24:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:24:10.489018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b6fa4-a404-4dfb-9be8-86b7626a5792 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:10.507256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64124e-375e-4bb8-a937-030858b2b9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:10.508066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64124e-375e-4bb8-a937-030858b2b9f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:10.508349 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64124e-375e-4bb8-a937-030858b2b9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:10.508625 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64124e-375e-4bb8-a937-030858b2b9f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:10.509273 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64124e-375e-4bb8-a937-030858b2b9f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:10.511316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64124e-375e-4bb8-a937-030858b2b9f3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:10.593405 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3052/6062] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:24:10 2022] POST /identity/v3/projects => generated 365 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:24:10.594755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91cc312-5bef-49bf-b9f1-6b86aedf6b27 service cinder] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:10.615109 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91cc312-5bef-49bf-b9f1-6b86aedf6b27 service cinder] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:10.763633 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877817e1-9215-4fc5-a651-a7c944ebcd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:10.764273 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877817e1-9215-4fc5-a651-a7c944ebcd49 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:10.764684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877817e1-9215-4fc5-a651-a7c944ebcd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:10.764966 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877817e1-9215-4fc5-a651-a7c944ebcd49 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:10.766199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877817e1-9215-4fc5-a651-a7c944ebcd49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:10.768794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877817e1-9215-4fc5-a651-a7c944ebcd49 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:10.823758 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3011/6063] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:24:10 2022] POST /identity/v3/users => generated 289 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:24:10.827768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64124e-375e-4bb8-a937-030858b2b9f3 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:10.845554 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64124e-375e-4bb8-a937-030858b2b9f3 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:10.858344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b27b1-bbd8-4ad2-b062-826c3ef7f0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:10.858973 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b27b1-bbd8-4ad2-b062-826c3ef7f0b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:10.859252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b27b1-bbd8-4ad2-b062-826c3ef7f0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:10.859525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b27b1-bbd8-4ad2-b062-826c3ef7f0b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:10.860177 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b27b1-bbd8-4ad2-b062-826c3ef7f0b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:10.861893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b27b1-bbd8-4ad2-b062-826c3ef7f0b7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:10.885981 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3053/6064] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:24:10.890189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877817e1-9215-4fc5-a651-a7c944ebcd49 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:10.905651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877817e1-9215-4fc5-a651-a7c944ebcd49 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:10.924409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce2d45-00d5-48c6-b427-3a2d58f290e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:10.925106 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce2d45-00d5-48c6-b427-3a2d58f290e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:10.925384 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce2d45-00d5-48c6-b427-3a2d58f290e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:10.925689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce2d45-00d5-48c6-b427-3a2d58f290e0 admin admin] PATH_INFO: `/v3/projects/4472369a3d5245cdb04375ef390e68ba/users/f05692040cac41c5bca43afe7bfc9c56/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:10.959862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce2d45-00d5-48c6-b427-3a2d58f290e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4472369a3d5245cdb04375ef390e68ba, user_id=f05692040cac41c5bca43afe7bfc9c56, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:10.962761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce2d45-00d5-48c6-b427-3a2d58f290e0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:10.982501 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3012/6065] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:24:10 2022] PUT /identity/v3/projects/4472369a3d5245cdb04375ef390e68ba/users/f05692040cac41c5bca43afe7bfc9c56/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:24:10.989409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b27b1-bbd8-4ad2-b062-826c3ef7f0b7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:11.005298 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b27b1-bbd8-4ad2-b062-826c3ef7f0b7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:11.050862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce2d45-00d5-48c6-b427-3a2d58f290e0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:11.052188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-57ce2d45-00d5-48c6-b427-3a2d58f290e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:11.204115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0e3f5-bac3-4714-bc69-8a16a15e1966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:11.204758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0e3f5-bac3-4714-bc69-8a16a15e1966 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:11.213935 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0e3f5-bac3-4714-bc69-8a16a15e1966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:11.214348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0e3f5-bac3-4714-bc69-8a16a15e1966 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:11.215261 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0e3f5-bac3-4714-bc69-8a16a15e1966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:11.218660 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0e3f5-bac3-4714-bc69-8a16a15e1966 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:11.243915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce2d45-00d5-48c6-b427-3a2d58f290e0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:11.244894 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3054/6066] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:24:11.250234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0e3f5-bac3-4714-bc69-8a16a15e1966 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:11.259776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998e512-ad00-4b49-ae18-4a48e8aa4b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:11.260507 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998e512-ad00-4b49-ae18-4a48e8aa4b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:11.260903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998e512-ad00-4b49-ae18-4a48e8aa4b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:11.261249 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998e512-ad00-4b49-ae18-4a48e8aa4b88 admin admin] PATH_INFO: `/v3/projects/9b7ce4b0a7b642eda715c5f84dfd8b6a` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:11.262600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998e512-ad00-4b49-ae18-4a48e8aa4b88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b7ce4b0a7b642eda715c5f84dfd8b6a)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:11.264941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998e512-ad00-4b49-ae18-4a48e8aa4b88 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:11.266837 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0e3f5-bac3-4714-bc69-8a16a15e1966 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:11.276712 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046f006-69b0-4214-85d4-656c9a12833d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:11.277736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046f006-69b0-4214-85d4-656c9a12833d admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:11.278209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046f006-69b0-4214-85d4-656c9a12833d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:11.278496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046f006-69b0-4214-85d4-656c9a12833d admin admin] PATH_INFO: `/v3/projects/4472369a3d5245cdb04375ef390e68ba/users/f05692040cac41c5bca43afe7bfc9c56/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:11.280510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046f006-69b0-4214-85d4-656c9a12833d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4472369a3d5245cdb04375ef390e68ba, user_id=f05692040cac41c5bca43afe7bfc9c56, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:11.288900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046f006-69b0-4214-85d4-656c9a12833d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:11.311369 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3055/6067] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:24:11 2022] PUT /identity/v3/projects/4472369a3d5245cdb04375ef390e68ba/users/f05692040cac41c5bca43afe7bfc9c56/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:11.326352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452b570-9d04-4cd9-9304-c08e130a44d3 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:11.327305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452b570-9d04-4cd9-9304-c08e130a44d3 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:11.327688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452b570-9d04-4cd9-9304-c08e130a44d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:11.346323 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:11.369635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d998e512-ad00-4b49-ae18-4a48e8aa4b88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b7ce4b0a7b642eda715c5f84dfd8b6a', 'request_id': 'req-d998e512-ad00-4b49-ae18-4a48e8aa4b88'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:11.371611 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:11.386658 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d998e512-ad00-4b49-ae18-4a48e8aa4b88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b7ce4b0a7b642eda715c5f84dfd8b6a', 'request_id': 'req-d998e512-ad00-4b49-ae18-4a48e8aa4b88'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:11.402719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d998e512-ad00-4b49-ae18-4a48e8aa4b88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b7ce4b0a7b642eda715c5f84dfd8b6a', 'request_id': 'req-d998e512-ad00-4b49-ae18-4a48e8aa4b88'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:11.409352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-d452b570-9d04-4cd9-9304-c08e130a44d3 None None] MFA Rules not processed for user `f05692040cac41c5bca43afe7bfc9c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:11.410702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d452b570-9d04-4cd9-9304-c08e130a44d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:11.431193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d998e512-ad00-4b49-ae18-4a48e8aa4b88 admin admin] The token cache is being invalidate because project 9b7ce4b0a7b642eda715c5f84dfd8b6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:24:11.431582 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d998e512-ad00-4b49-ae18-4a48e8aa4b88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:11.432445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d998e512-ad00-4b49-ae18-4a48e8aa4b88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:11.463806 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3013/6068] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:24:11 2022] DELETE /identity/v3/projects/9b7ce4b0a7b642eda715c5f84dfd8b6a => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:11.468227 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998e512-ad00-4b49-ae18-4a48e8aa4b88 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:11.475949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d998e512-ad00-4b49-ae18-4a48e8aa4b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:11.589902 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3056/6069] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:11.596553 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452b570-9d04-4cd9-9304-c08e130a44d3 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:11.600294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d452b570-9d04-4cd9-9304-c08e130a44d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:11.628316 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998e512-ad00-4b49-ae18-4a48e8aa4b88 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:11.652100 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb24e4d-b455-4027-8f04-58f61f915df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:11.652973 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb24e4d-b455-4027-8f04-58f61f915df4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:11.654102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb24e4d-b455-4027-8f04-58f61f915df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:11.657700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb24e4d-b455-4027-8f04-58f61f915df4 admin admin] PATH_INFO: `/v3/users/b34e8c1993814896a96f70f79f9bd269` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:11.660572 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb24e4d-b455-4027-8f04-58f61f915df4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b34e8c1993814896a96f70f79f9bd269)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:11.663743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb24e4d-b455-4027-8f04-58f61f915df4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:11.775237 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452b570-9d04-4cd9-9304-c08e130a44d3 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:11.781813 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-adb24e4d-b455-4027-8f04-58f61f915df4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b34e8c1993814896a96f70f79f9bd269'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:11.784112 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be65be-4640-446a-a28b-a38fbd010154 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:11.784794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-adb24e4d-b455-4027-8f04-58f61f915df4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b34e8c1993814896a96f70f79f9bd269'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:11.785073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be65be-4640-446a-a28b-a38fbd010154 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:11.785990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be65be-4640-446a-a28b-a38fbd010154 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:11.787646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be65be-4640-446a-a28b-a38fbd010154 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:11.791128 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a1be65be-4640-446a-a28b-a38fbd010154 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:11.805505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-adb24e4d-b455-4027-8f04-58f61f915df4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b34e8c1993814896a96f70f79f9bd269'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:11.822480 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be65be-4640-446a-a28b-a38fbd010154 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:11.824906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-adb24e4d-b455-4027-8f04-58f61f915df4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b34e8c1993814896a96f70f79f9bd269'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:11.825966 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-adb24e4d-b455-4027-8f04-58f61f915df4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b34e8c1993814896a96f70f79f9bd269'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:11.826351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be65be-4640-446a-a28b-a38fbd010154 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:11.867057 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3014/6070] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:24:11 2022] DELETE /identity/v3/users/b34e8c1993814896a96f70f79f9bd269 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:11.878668 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3057/6071] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:24:11 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:24:13.278077 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb24e4d-b455-4027-8f04-58f61f915df4 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:13.280869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-adb24e4d-b455-4027-8f04-58f61f915df4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:13.425942 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:13.432274 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb24e4d-b455-4027-8f04-58f61f915df4 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:13.438853 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f022b87-2bbc-4a21-9f64-6346a137241c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:13.440698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f022b87-2bbc-4a21-9f64-6346a137241c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:13.441427 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f022b87-2bbc-4a21-9f64-6346a137241c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:13.442275 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f022b87-2bbc-4a21-9f64-6346a137241c admin admin] PATH_INFO: `/v3/projects/7079d55caaea4a57a731ff68dc343b1a` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:13.468631 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f022b87-2bbc-4a21-9f64-6346a137241c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7079d55caaea4a57a731ff68dc343b1a)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:13.481450 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f022b87-2bbc-4a21-9f64-6346a137241c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:13.552609 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5f022b87-2bbc-4a21-9f64-6346a137241c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7079d55caaea4a57a731ff68dc343b1a', 'request_id': 'req-5f022b87-2bbc-4a21-9f64-6346a137241c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:13.581860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5f022b87-2bbc-4a21-9f64-6346a137241c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7079d55caaea4a57a731ff68dc343b1a', 'request_id': 'req-5f022b87-2bbc-4a21-9f64-6346a137241c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:13.595245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5f022b87-2bbc-4a21-9f64-6346a137241c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7079d55caaea4a57a731ff68dc343b1a', 'request_id': 'req-5f022b87-2bbc-4a21-9f64-6346a137241c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:13.619841 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5f022b87-2bbc-4a21-9f64-6346a137241c admin admin] The token cache is being invalidate because project 7079d55caaea4a57a731ff68dc343b1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:24:13.620191 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5f022b87-2bbc-4a21-9f64-6346a137241c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:13.621397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5f022b87-2bbc-4a21-9f64-6346a137241c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:13.623816 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3015/6072] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:24:13 2022] DELETE /identity/v3/projects/7079d55caaea4a57a731ff68dc343b1a => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:13.631380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6f31b-3bc9-4702-88e0-b95b8370747b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:13.631883 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6f31b-3bc9-4702-88e0-b95b8370747b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:13.631977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6f31b-3bc9-4702-88e0-b95b8370747b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:13.675213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-6de6f31b-3bc9-4702-88e0-b95b8370747b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:13.678817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6de6f31b-3bc9-4702-88e0-b95b8370747b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:13.823254 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3058/6073] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:13.831666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b2585-fcfb-4e55-9aab-07c169bfa5f3 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:13.832034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b2585-fcfb-4e55-9aab-07c169bfa5f3 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:13.832326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b2585-fcfb-4e55-9aab-07c169bfa5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:13.875532 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-385b2585-fcfb-4e55-9aab-07c169bfa5f3 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:13.880029 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-385b2585-fcfb-4e55-9aab-07c169bfa5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:13.907062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6f31b-3bc9-4702-88e0-b95b8370747b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:13.927397 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3016/6074] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:13.933353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6f31b-3bc9-4702-88e0-b95b8370747b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:13.948993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85020f0-5708-4a5a-80f5-b8c818d5365a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:13.949834 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85020f0-5708-4a5a-80f5-b8c818d5365a admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:13.950119 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85020f0-5708-4a5a-80f5-b8c818d5365a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:13.950386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85020f0-5708-4a5a-80f5-b8c818d5365a admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:13.951040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85020f0-5708-4a5a-80f5-b8c818d5365a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:24:13.951714 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85020f0-5708-4a5a-80f5-b8c818d5365a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:13.954553 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85020f0-5708-4a5a-80f5-b8c818d5365a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:13.995515 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3059/6075] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:24:13.996661 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b2585-fcfb-4e55-9aab-07c169bfa5f3 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:14.011914 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b2585-fcfb-4e55-9aab-07c169bfa5f3 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:14.023626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d45bc-5d65-4796-aee7-afb5fb8d734c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:14.024269 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d45bc-5d65-4796-aee7-afb5fb8d734c admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:14.024705 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d45bc-5d65-4796-aee7-afb5fb8d734c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:14.024983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d45bc-5d65-4796-aee7-afb5fb8d734c admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:14.025753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d45bc-5d65-4796-aee7-afb5fb8d734c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:14.027615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d45bc-5d65-4796-aee7-afb5fb8d734c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:14.122399 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3017/6076] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:24:13 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:24:14.126001 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85020f0-5708-4a5a-80f5-b8c818d5365a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:14.144380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85020f0-5708-4a5a-80f5-b8c818d5365a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:14.183294 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:14.378702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bfd1f1-2d5a-47fd-8f12-b2c89fed7e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:14.379440 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfd1f1-2d5a-47fd-8f12-b2c89fed7e27 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:14.379991 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfd1f1-2d5a-47fd-8f12-b2c89fed7e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:14.380359 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfd1f1-2d5a-47fd-8f12-b2c89fed7e27 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:14.381291 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bfd1f1-2d5a-47fd-8f12-b2c89fed7e27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:14.385142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bfd1f1-2d5a-47fd-8f12-b2c89fed7e27 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:14.435060 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3060/6077] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:24:14 2022] POST /identity/v3/users => generated 287 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:24:14.439836 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d45bc-5d65-4796-aee7-afb5fb8d734c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:14.455815 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d45bc-5d65-4796-aee7-afb5fb8d734c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:14.471222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87e99c-3b2a-4897-bb6a-bb17fec6aa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:14.473610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87e99c-3b2a-4897-bb6a-bb17fec6aa0c admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:14.475976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87e99c-3b2a-4897-bb6a-bb17fec6aa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:14.476535 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87e99c-3b2a-4897-bb6a-bb17fec6aa0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:14.495104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce87e99c-3b2a-4897-bb6a-bb17fec6aa0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:14.499691 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce87e99c-3b2a-4897-bb6a-bb17fec6aa0c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:14.529664 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3018/6078] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:24:14.545466 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bfd1f1-2d5a-47fd-8f12-b2c89fed7e27 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:14.550829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bfd1f1-2d5a-47fd-8f12-b2c89fed7e27 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:14.565685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9b04c-15f0-49e8-9483-09a1373cc6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:14.567357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9b04c-15f0-49e8-9483-09a1373cc6a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:14.568685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9b04c-15f0-49e8-9483-09a1373cc6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:14.569371 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9b04c-15f0-49e8-9483-09a1373cc6a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:14.570900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9b04c-15f0-49e8-9483-09a1373cc6a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:14.573357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9b04c-15f0-49e8-9483-09a1373cc6a5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:14.600875 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3061/6079] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:24:14.604878 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87e99c-3b2a-4897-bb6a-bb17fec6aa0c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:14.619023 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87e99c-3b2a-4897-bb6a-bb17fec6aa0c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:14.629156 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c0dbd-123f-4f77-bbe0-6e9f7c7ed031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:14.631647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c0dbd-123f-4f77-bbe0-6e9f7c7ed031 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:14.632765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c0dbd-123f-4f77-bbe0-6e9f7c7ed031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:14.633478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c0dbd-123f-4f77-bbe0-6e9f7c7ed031 admin admin] PATH_INFO: `/v3/projects/e8a72b55afb44f1988dfccb7ebe1d1e9/users/4d3b411776e14166a4e85693d9c5fe66/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:14.668544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c0dbd-123f-4f77-bbe0-6e9f7c7ed031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8a72b55afb44f1988dfccb7ebe1d1e9, user_id=4d3b411776e14166a4e85693d9c5fe66, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:14.684474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c0dbd-123f-4f77-bbe0-6e9f7c7ed031 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:14.727947 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3019/6080] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:24:14 2022] PUT /identity/v3/projects/e8a72b55afb44f1988dfccb7ebe1d1e9/users/4d3b411776e14166a4e85693d9c5fe66/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:14.740398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359545d4-c970-4351-bd82-5c7dd779b934 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:14.741473 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359545d4-c970-4351-bd82-5c7dd779b934 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:14.742170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359545d4-c970-4351-bd82-5c7dd779b934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:14.804738 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-359545d4-c970-4351-bd82-5c7dd779b934 None None] MFA Rules not processed for user `4d3b411776e14166a4e85693d9c5fe66`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:14.806293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-359545d4-c970-4351-bd82-5c7dd779b934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:14.940605 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3062/6081] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:14.952713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c0dbd-123f-4f77-bbe0-6e9f7c7ed031 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:14.954620 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-062c0dbd-123f-4f77-bbe0-6e9f7c7ed031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:15.077039 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c0dbd-123f-4f77-bbe0-6e9f7c7ed031 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:15.092613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f0fcc-94f4-405d-b648-b2f86d2554b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:15.093382 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f0fcc-94f4-405d-b648-b2f86d2554b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:15.093794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f0fcc-94f4-405d-b648-b2f86d2554b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:15.094183 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f0fcc-94f4-405d-b648-b2f86d2554b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:15.113915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f0fcc-94f4-405d-b648-b2f86d2554b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:15.115530 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f0fcc-94f4-405d-b648-b2f86d2554b3 service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:15.145309 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3020/6082] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:24:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:24:15.175045 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359545d4-c970-4351-bd82-5c7dd779b934 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:15.285288 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359545d4-c970-4351-bd82-5c7dd779b934 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:15.301891 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76599da-b3b3-4490-a8f0-17a8d48d39f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:15.302923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76599da-b3b3-4490-a8f0-17a8d48d39f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:15.303368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76599da-b3b3-4490-a8f0-17a8d48d39f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:15.303854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76599da-b3b3-4490-a8f0-17a8d48d39f8 admin admin] PATH_INFO: `/v3/users/4d3b411776e14166a4e85693d9c5fe66` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:15.325462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76599da-b3b3-4490-a8f0-17a8d48d39f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d3b411776e14166a4e85693d9c5fe66)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:15.334174 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76599da-b3b3-4490-a8f0-17a8d48d39f8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:15.394496 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:15.422385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a76599da-b3b3-4490-a8f0-17a8d48d39f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d3b411776e14166a4e85693d9c5fe66'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:15.423654 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a76599da-b3b3-4490-a8f0-17a8d48d39f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d3b411776e14166a4e85693d9c5fe66'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:15.434889 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a76599da-b3b3-4490-a8f0-17a8d48d39f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d3b411776e14166a4e85693d9c5fe66'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:15.452869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a76599da-b3b3-4490-a8f0-17a8d48d39f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d3b411776e14166a4e85693d9c5fe66'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:15.453690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a76599da-b3b3-4490-a8f0-17a8d48d39f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d3b411776e14166a4e85693d9c5fe66'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:15.511597 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3063/6083] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:24:15 2022] DELETE /identity/v3/users/4d3b411776e14166a4e85693d9c5fe66 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:15.516896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5893eb-40e0-4f42-9dc2-93fa4b5af9d8 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:15.518146 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5893eb-40e0-4f42-9dc2-93fa4b5af9d8 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:15.518272 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5893eb-40e0-4f42-9dc2-93fa4b5af9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:15.559283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-2b5893eb-40e0-4f42-9dc2-93fa4b5af9d8 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:15.560896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2b5893eb-40e0-4f42-9dc2-93fa4b5af9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:15.619611 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:15.725031 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3021/6084] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:15.743224 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76599da-b3b3-4490-a8f0-17a8d48d39f8 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:15.746740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a76599da-b3b3-4490-a8f0-17a8d48d39f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:15.937873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76599da-b3b3-4490-a8f0-17a8d48d39f8 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:15.945933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324afd35-8425-4fb9-be1a-04beb6e0a1ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:15.947951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324afd35-8425-4fb9-be1a-04beb6e0a1ec service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:15.948332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324afd35-8425-4fb9-be1a-04beb6e0a1ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:15.949488 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324afd35-8425-4fb9-be1a-04beb6e0a1ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:15.972724 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324afd35-8425-4fb9-be1a-04beb6e0a1ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:15.974678 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324afd35-8425-4fb9-be1a-04beb6e0a1ec service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:16.014393 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3064/6085] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:24:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:24:17.561796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41820395-661a-472e-8162-0b092ab655a2 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:17.562836 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41820395-661a-472e-8162-0b092ab655a2 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:17.563417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41820395-661a-472e-8162-0b092ab655a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:17.631157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-41820395-661a-472e-8162-0b092ab655a2 None None] MFA Rules not processed for user `2bd410471c2340aa97bbfe8057122303`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:17.634325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-41820395-661a-472e-8162-0b092ab655a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:17.770536 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3022/6086] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:17 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:17.788198 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324afd35-8425-4fb9-be1a-04beb6e0a1ec service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:17.797712 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-324afd35-8425-4fb9-be1a-04beb6e0a1ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:17.932349 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324afd35-8425-4fb9-be1a-04beb6e0a1ec service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:17.939894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87b442-a7af-4712-98d9-7bb48166cc0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:17.940533 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87b442-a7af-4712-98d9-7bb48166cc0a service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:17.940881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87b442-a7af-4712-98d9-7bb48166cc0a service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:17.941167 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87b442-a7af-4712-98d9-7bb48166cc0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:17.956997 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe87b442-a7af-4712-98d9-7bb48166cc0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:17.959031 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe87b442-a7af-4712-98d9-7bb48166cc0a service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:17.994097 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3065/6087] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:24:17 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:24:18.374406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41820395-661a-472e-8162-0b092ab655a2 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:18.391872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41820395-661a-472e-8162-0b092ab655a2 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:18.407413 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6a2d5-3e70-4ffa-ac5c-1b72c4162e91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:18.408101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6a2d5-3e70-4ffa-ac5c-1b72c4162e91 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:18.408385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6a2d5-3e70-4ffa-ac5c-1b72c4162e91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:18.411845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6a2d5-3e70-4ffa-ac5c-1b72c4162e91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:18.416101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-20c6a2d5-3e70-4ffa-ac5c-1b72c4162e91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:18.497416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87b442-a7af-4712-98d9-7bb48166cc0a service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:18.499210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fe87b442-a7af-4712-98d9-7bb48166cc0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:18.544259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87b442-a7af-4712-98d9-7bb48166cc0a service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:18.561308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68a09c-8c2a-457a-b210-0018accef6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:18.561900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68a09c-8c2a-457a-b210-0018accef6d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:18.564620 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68a09c-8c2a-457a-b210-0018accef6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:18.565244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68a09c-8c2a-457a-b210-0018accef6d8 admin admin] PATH_INFO: `/v3/projects/e8a72b55afb44f1988dfccb7ebe1d1e9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:18.570191 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68a09c-8c2a-457a-b210-0018accef6d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8a72b55afb44f1988dfccb7ebe1d1e9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:18.572122 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68a09c-8c2a-457a-b210-0018accef6d8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:18.612019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6a2d5-3e70-4ffa-ac5c-1b72c4162e91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:18.622313 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6a2d5-3e70-4ffa-ac5c-1b72c4162e91 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:18.660266 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3023/6088] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:24:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:24:18.682691 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:18.722635 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2d68a09c-8c2a-457a-b210-0018accef6d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8a72b55afb44f1988dfccb7ebe1d1e9', 'request_id': 'req-2d68a09c-8c2a-457a-b210-0018accef6d8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:18.768435 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2d68a09c-8c2a-457a-b210-0018accef6d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8a72b55afb44f1988dfccb7ebe1d1e9', 'request_id': 'req-2d68a09c-8c2a-457a-b210-0018accef6d8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:18.787777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2d68a09c-8c2a-457a-b210-0018accef6d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8a72b55afb44f1988dfccb7ebe1d1e9', 'request_id': 'req-2d68a09c-8c2a-457a-b210-0018accef6d8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:18.836207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2d68a09c-8c2a-457a-b210-0018accef6d8 admin admin] The token cache is being invalidate because project e8a72b55afb44f1988dfccb7ebe1d1e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:24:18.843661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2d68a09c-8c2a-457a-b210-0018accef6d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:18.851765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2d68a09c-8c2a-457a-b210-0018accef6d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:18.855030 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3066/6089] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:24:18 2022] DELETE /identity/v3/projects/e8a72b55afb44f1988dfccb7ebe1d1e9 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:24:18.859883 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbbc05-81f9-4a24-af9f-9cb742c1c172 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:18.860168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbbc05-81f9-4a24-af9f-9cb742c1c172 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:18.860651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbbc05-81f9-4a24-af9f-9cb742c1c172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:18.904782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-ebfbbc05-81f9-4a24-af9f-9cb742c1c172 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:18.906543 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ebfbbc05-81f9-4a24-af9f-9cb742c1c172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:18.962713 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68a09c-8c2a-457a-b210-0018accef6d8 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:18.965548 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2d68a09c-8c2a-457a-b210-0018accef6d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:19.056688 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:19.089550 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3024/6090] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:19.096422 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ace2f-606e-4af1-acd8-684f60f31e0c None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:19.097111 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ace2f-606e-4af1-acd8-684f60f31e0c None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:19.098237 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ace2f-606e-4af1-acd8-684f60f31e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:19.136873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-8b5ace2f-606e-4af1-acd8-684f60f31e0c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:19.138429 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8b5ace2f-606e-4af1-acd8-684f60f31e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:19.151328 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3025/6091] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:19.157638 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ace2f-606e-4af1-acd8-684f60f31e0c None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:19.163707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68a09c-8c2a-457a-b210-0018accef6d8 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:19.175651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ace2f-606e-4af1-acd8-684f60f31e0c None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:19.181173 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7782a6a-0ceb-4ffb-95a5-b6ba624674a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:19.181888 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7782a6a-0ceb-4ffb-95a5-b6ba624674a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:19.182165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7782a6a-0ceb-4ffb-95a5-b6ba624674a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:19.182507 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7782a6a-0ceb-4ffb-95a5-b6ba624674a4 admin admin] PATH_INFO: `/v3/users/2c3166204f834b148d9807b1b8115f5d` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:19.183766 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780cf78e-55db-49eb-b06d-307c4cf37e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:19.184664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cf78e-55db-49eb-b06d-307c4cf37e9b admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:19.184902 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7782a6a-0ceb-4ffb-95a5-b6ba624674a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c3166204f834b148d9807b1b8115f5d)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:19.185397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cf78e-55db-49eb-b06d-307c4cf37e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:19.186188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cf78e-55db-49eb-b06d-307c4cf37e9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:19.187666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780cf78e-55db-49eb-b06d-307c4cf37e9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:24:19.188572 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780cf78e-55db-49eb-b06d-307c4cf37e9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:19.189770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7782a6a-0ceb-4ffb-95a5-b6ba624674a4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:19.191667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780cf78e-55db-49eb-b06d-307c4cf37e9b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:19.223430 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3026/6092] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:24:19.229820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780cf78e-55db-49eb-b06d-307c4cf37e9b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:19.270770 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780cf78e-55db-49eb-b06d-307c4cf37e9b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:19.289968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692fe6ae-0924-4ecb-8685-f67abf55a5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:19.292386 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692fe6ae-0924-4ecb-8685-f67abf55a5ca admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:19.292822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692fe6ae-0924-4ecb-8685-f67abf55a5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:19.293381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692fe6ae-0924-4ecb-8685-f67abf55a5ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:19.305878 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692fe6ae-0924-4ecb-8685-f67abf55a5ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:19.310584 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692fe6ae-0924-4ecb-8685-f67abf55a5ca admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:19.320076 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d7782a6a-0ceb-4ffb-95a5-b6ba624674a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c3166204f834b148d9807b1b8115f5d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:19.322535 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d7782a6a-0ceb-4ffb-95a5-b6ba624674a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c3166204f834b148d9807b1b8115f5d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:19.341475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d7782a6a-0ceb-4ffb-95a5-b6ba624674a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c3166204f834b148d9807b1b8115f5d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:19.366168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d7782a6a-0ceb-4ffb-95a5-b6ba624674a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c3166204f834b148d9807b1b8115f5d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:19.366962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d7782a6a-0ceb-4ffb-95a5-b6ba624674a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c3166204f834b148d9807b1b8115f5d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:19.394777 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3027/6093] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:24:19 2022] POST /identity/v3/projects => generated 375 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:24:19.398699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692fe6ae-0924-4ecb-8685-f67abf55a5ca admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:19.400647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-692fe6ae-0924-4ecb-8685-f67abf55a5ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:19.419378 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3067/6094] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:24:18 2022] DELETE /identity/v3/users/2c3166204f834b148d9807b1b8115f5d => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:24:19.423873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc5151-92c7-4ee9-88dd-0c52eac6613a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:19.424158 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc5151-92c7-4ee9-88dd-0c52eac6613a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:19.424436 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc5151-92c7-4ee9-88dd-0c52eac6613a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:19.509382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-0efc5151-92c7-4ee9-88dd-0c52eac6613a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:19.516224 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0efc5151-92c7-4ee9-88dd-0c52eac6613a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:19.584701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692fe6ae-0924-4ecb-8685-f67abf55a5ca admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:19.628470 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:19.699330 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3068/6095] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:19.738687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975a063-9cf3-4228-bda2-6d761175f7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:19.739321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975a063-9cf3-4228-bda2-6d761175f7c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:19.739750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975a063-9cf3-4228-bda2-6d761175f7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:19.740034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975a063-9cf3-4228-bda2-6d761175f7c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:19.742258 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975a063-9cf3-4228-bda2-6d761175f7c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:19.744253 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975a063-9cf3-4228-bda2-6d761175f7c8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:19.782518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc5151-92c7-4ee9-88dd-0c52eac6613a None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:19.784076 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0efc5151-92c7-4ee9-88dd-0c52eac6613a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:19.788048 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3028/6096] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:24:19 2022] POST /identity/v3/users => generated 288 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:24:19.790318 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975a063-9cf3-4228-bda2-6d761175f7c8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:19.812355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975a063-9cf3-4228-bda2-6d761175f7c8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:19.831032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95300b5c-da06-41d0-bd4d-4221f3badd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:19.831827 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95300b5c-da06-41d0-bd4d-4221f3badd8a admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:19.832261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95300b5c-da06-41d0-bd4d-4221f3badd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:19.832546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95300b5c-da06-41d0-bd4d-4221f3badd8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:19.833203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95300b5c-da06-41d0-bd4d-4221f3badd8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:19.835157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95300b5c-da06-41d0-bd4d-4221f3badd8a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:19.870496 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3029/6097] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:24:19.874147 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95300b5c-da06-41d0-bd4d-4221f3badd8a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:19.902068 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95300b5c-da06-41d0-bd4d-4221f3badd8a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:19.917138 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec0bcd-8e59-4e1f-99ac-94c3374fc621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:19.917958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec0bcd-8e59-4e1f-99ac-94c3374fc621 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:19.918261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec0bcd-8e59-4e1f-99ac-94c3374fc621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:19.918518 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec0bcd-8e59-4e1f-99ac-94c3374fc621 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:19.919166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec0bcd-8e59-4e1f-99ac-94c3374fc621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:19.923198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec0bcd-8e59-4e1f-99ac-94c3374fc621 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:19.982256 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3030/6098] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:24:19.983274 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec0bcd-8e59-4e1f-99ac-94c3374fc621 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:19.991054 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc5151-92c7-4ee9-88dd-0c52eac6613a None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:19.995982 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed4153-c54c-4346-8667-f650f2d096ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:19.996607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed4153-c54c-4346-8667-f650f2d096ce service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:19.996887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed4153-c54c-4346-8667-f650f2d096ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:19.997160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed4153-c54c-4346-8667-f650f2d096ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:20.002960 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec0bcd-8e59-4e1f-99ac-94c3374fc621 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:20.013799 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed4153-c54c-4346-8667-f650f2d096ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:20.015273 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed4153-c54c-4346-8667-f650f2d096ce service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:20.020521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94de982-043f-427c-bc77-a60bc0a297eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:20.021212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94de982-043f-427c-bc77-a60bc0a297eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:20.021511 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94de982-043f-427c-bc77-a60bc0a297eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:20.021784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94de982-043f-427c-bc77-a60bc0a297eb admin admin] PATH_INFO: `/v3/projects/01249e093e414a6e866f6c60a9d5d9d6/users/be960d7837fb40ce8edfd8f29cb43e95/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:20.059368 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3069/6099] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:24:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:24:20.082504 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94de982-043f-427c-bc77-a60bc0a297eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=01249e093e414a6e866f6c60a9d5d9d6, user_id=be960d7837fb40ce8edfd8f29cb43e95, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:20.087975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94de982-043f-427c-bc77-a60bc0a297eb admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:20.134218 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3031/6100] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:24:19 2022] PUT /identity/v3/projects/01249e093e414a6e866f6c60a9d5d9d6/users/be960d7837fb40ce8edfd8f29cb43e95/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:20.143018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcb2a0-e1a7-417b-8d88-fa27ebfcad64 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:20.143373 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcb2a0-e1a7-417b-8d88-fa27ebfcad64 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:20.143698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcb2a0-e1a7-417b-8d88-fa27ebfcad64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:20.209042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a9fcb2a0-e1a7-417b-8d88-fa27ebfcad64 None None] MFA Rules not processed for user `be960d7837fb40ce8edfd8f29cb43e95`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:20.212776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a9fcb2a0-e1a7-417b-8d88-fa27ebfcad64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:20.397819 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3070/6101] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:20.404286 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94de982-043f-427c-bc77-a60bc0a297eb admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:20.406242 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c94de982-043f-427c-bc77-a60bc0a297eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:20.417706 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:20.658282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94de982-043f-427c-bc77-a60bc0a297eb admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:20.674611 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2597e3-8cd0-4914-91d2-f1154cb0a4a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:20.675252 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2597e3-8cd0-4914-91d2-f1154cb0a4a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:20.675536 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2597e3-8cd0-4914-91d2-f1154cb0a4a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:20.675811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2597e3-8cd0-4914-91d2-f1154cb0a4a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:20.718166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2597e3-8cd0-4914-91d2-f1154cb0a4a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:20.719592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2597e3-8cd0-4914-91d2-f1154cb0a4a7 service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:20.759263 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3032/6102] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:24:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:24:20.936653 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcb2a0-e1a7-417b-8d88-fa27ebfcad64 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:20.939650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a9fcb2a0-e1a7-417b-8d88-fa27ebfcad64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:21.120970 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcb2a0-e1a7-417b-8d88-fa27ebfcad64 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:21.134143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13b3f1-ca99-429f-a735-d56981826df7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:21.135317 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13b3f1-ca99-429f-a735-d56981826df7 service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:21.135992 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13b3f1-ca99-429f-a735-d56981826df7 service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:21.136357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13b3f1-ca99-429f-a735-d56981826df7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:21.139518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fc13b3f1-ca99-429f-a735-d56981826df7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:21.186064 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc13b3f1-ca99-429f-a735-d56981826df7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:21.188364 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc13b3f1-ca99-429f-a735-d56981826df7 service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:21.209278 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:21.239088 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3071/6103] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:24:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:24:21.698625 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2597e3-8cd0-4914-91d2-f1154cb0a4a7 service cinder] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:21.700435 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bd2597e3-8cd0-4914-91d2-f1154cb0a4a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:21.826159 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13b3f1-ca99-429f-a735-d56981826df7 service placement] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:21.827686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fc13b3f1-ca99-429f-a735-d56981826df7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:21.888951 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2597e3-8cd0-4914-91d2-f1154cb0a4a7 service cinder] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:21.906559 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ff74f-efc7-42ad-82c9-cb441e49c06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:21.908740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ff74f-efc7-42ad-82c9-cb441e49c06a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:21.909093 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ff74f-efc7-42ad-82c9-cb441e49c06a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:21.909473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ff74f-efc7-42ad-82c9-cb441e49c06a admin admin] PATH_INFO: `/v3/projects/53a4fe7f6c114343854490085f8ab566` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:21.912251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ff74f-efc7-42ad-82c9-cb441e49c06a admin admin] RBAC: Authorizing `identity:delete_project(project_id=53a4fe7f6c114343854490085f8ab566)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:21.914428 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ff74f-efc7-42ad-82c9-cb441e49c06a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:22.002651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-946ff74f-efc7-42ad-82c9-cb441e49c06a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53a4fe7f6c114343854490085f8ab566', 'request_id': 'req-946ff74f-efc7-42ad-82c9-cb441e49c06a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:22.009087 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13b3f1-ca99-429f-a735-d56981826df7 service placement] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:22.019923 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-946ff74f-efc7-42ad-82c9-cb441e49c06a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53a4fe7f6c114343854490085f8ab566', 'request_id': 'req-946ff74f-efc7-42ad-82c9-cb441e49c06a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:22.030138 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-946ff74f-efc7-42ad-82c9-cb441e49c06a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53a4fe7f6c114343854490085f8ab566', 'request_id': 'req-946ff74f-efc7-42ad-82c9-cb441e49c06a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:22.050456 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-946ff74f-efc7-42ad-82c9-cb441e49c06a admin admin] The token cache is being invalidate because project 53a4fe7f6c114343854490085f8ab566 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:24:22.051101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-946ff74f-efc7-42ad-82c9-cb441e49c06a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:22.052780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-946ff74f-efc7-42ad-82c9-cb441e49c06a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:22.054883 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3033/6104] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:24:21 2022] DELETE /identity/v3/projects/53a4fe7f6c114343854490085f8ab566 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:22.058737 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ff74f-efc7-42ad-82c9-cb441e49c06a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:22.060442 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-946ff74f-efc7-42ad-82c9-cb441e49c06a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:22.154139 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:22.162734 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba0ef2-66d5-4eb5-ab65-512ec5670bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:22.164007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba0ef2-66d5-4eb5-ab65-512ec5670bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:22.171460 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba0ef2-66d5-4eb5-ab65-512ec5670bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:22.175440 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba0ef2-66d5-4eb5-ab65-512ec5670bc6 admin admin] PATH_INFO: `/v3/users/aa6a455e8f9443a2bd14dbfd4ff03046` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:22.180824 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba0ef2-66d5-4eb5-ab65-512ec5670bc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa6a455e8f9443a2bd14dbfd4ff03046)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:22.185079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba0ef2-66d5-4eb5-ab65-512ec5670bc6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:22.218038 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ff74f-efc7-42ad-82c9-cb441e49c06a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:22.235096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70735389-d9d2-482f-bda3-53faee570e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:22.236442 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70735389-d9d2-482f-bda3-53faee570e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:22.237056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70735389-d9d2-482f-bda3-53faee570e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:22.237194 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70735389-d9d2-482f-bda3-53faee570e56 admin admin] PATH_INFO: `/v3/users/0073abf2771c4797a1cc4fcd71f6b008` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:22.246997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70735389-d9d2-482f-bda3-53faee570e56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0073abf2771c4797a1cc4fcd71f6b008)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:22.251345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70735389-d9d2-482f-bda3-53faee570e56 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:22.294384 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dfba0ef2-66d5-4eb5-ab65-512ec5670bc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa6a455e8f9443a2bd14dbfd4ff03046'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:22.295071 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dfba0ef2-66d5-4eb5-ab65-512ec5670bc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa6a455e8f9443a2bd14dbfd4ff03046'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:22.309982 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dfba0ef2-66d5-4eb5-ab65-512ec5670bc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa6a455e8f9443a2bd14dbfd4ff03046'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:22.324661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dfba0ef2-66d5-4eb5-ab65-512ec5670bc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa6a455e8f9443a2bd14dbfd4ff03046'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:22.326324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dfba0ef2-66d5-4eb5-ab65-512ec5670bc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa6a455e8f9443a2bd14dbfd4ff03046'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:22.354030 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-70735389-d9d2-482f-bda3-53faee570e56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0073abf2771c4797a1cc4fcd71f6b008'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:22.354843 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-70735389-d9d2-482f-bda3-53faee570e56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0073abf2771c4797a1cc4fcd71f6b008'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:22.371861 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-70735389-d9d2-482f-bda3-53faee570e56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0073abf2771c4797a1cc4fcd71f6b008'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:22.374178 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3072/6105] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:24:21 2022] DELETE /identity/v3/users/aa6a455e8f9443a2bd14dbfd4ff03046 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:24:22.379029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b3278-1988-4f7c-8d6d-5f721202493c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:22.379029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b3278-1988-4f7c-8d6d-5f721202493c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:22.379029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b3278-1988-4f7c-8d6d-5f721202493c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:22.392854 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-70735389-d9d2-482f-bda3-53faee570e56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0073abf2771c4797a1cc4fcd71f6b008'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:22.393651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-70735389-d9d2-482f-bda3-53faee570e56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0073abf2771c4797a1cc4fcd71f6b008'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:22.442772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-366b3278-1988-4f7c-8d6d-5f721202493c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:22.447876 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-366b3278-1988-4f7c-8d6d-5f721202493c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:22.464271 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3034/6106] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:24:22 2022] DELETE /identity/v3/users/0073abf2771c4797a1cc4fcd71f6b008 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:22.524363 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:22.627763 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3073/6107] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:24:22.638654 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70735389-d9d2-482f-bda3-53faee570e56 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:22.640999 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-70735389-d9d2-482f-bda3-53faee570e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:22.803137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70735389-d9d2-482f-bda3-53faee570e56 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:22.810718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33959473-c638-4cd8-af5e-9568e48e3f91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:22.811354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33959473-c638-4cd8-af5e-9568e48e3f91 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:22.811631 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33959473-c638-4cd8-af5e-9568e48e3f91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:22.811900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33959473-c638-4cd8-af5e-9568e48e3f91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:22.969077 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33959473-c638-4cd8-af5e-9568e48e3f91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:22.971818 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33959473-c638-4cd8-af5e-9568e48e3f91 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:23.008724 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3035/6108] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:24:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:24:23.011570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b3278-1988-4f7c-8d6d-5f721202493c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:23.014956 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-366b3278-1988-4f7c-8d6d-5f721202493c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:23.046784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b3278-1988-4f7c-8d6d-5f721202493c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:23.055945 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88fe53-2849-46a5-8963-6f34b7f39c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:23.060167 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88fe53-2849-46a5-8963-6f34b7f39c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:23.063414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88fe53-2849-46a5-8963-6f34b7f39c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:23.066537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88fe53-2849-46a5-8963-6f34b7f39c10 admin admin] PATH_INFO: `/v3/projects/ef793657ad3e44828045d7d24129442a` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:23.068619 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88fe53-2849-46a5-8963-6f34b7f39c10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef793657ad3e44828045d7d24129442a)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:23.117692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88fe53-2849-46a5-8963-6f34b7f39c10 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:23.230010 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5d88fe53-2849-46a5-8963-6f34b7f39c10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef793657ad3e44828045d7d24129442a', 'request_id': 'req-5d88fe53-2849-46a5-8963-6f34b7f39c10'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:23.248572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5d88fe53-2849-46a5-8963-6f34b7f39c10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef793657ad3e44828045d7d24129442a', 'request_id': 'req-5d88fe53-2849-46a5-8963-6f34b7f39c10'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:23.261716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5d88fe53-2849-46a5-8963-6f34b7f39c10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef793657ad3e44828045d7d24129442a', 'request_id': 'req-5d88fe53-2849-46a5-8963-6f34b7f39c10'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:23.288229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5d88fe53-2849-46a5-8963-6f34b7f39c10 admin admin] The token cache is being invalidate because project ef793657ad3e44828045d7d24129442a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:24:23.288890 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5d88fe53-2849-46a5-8963-6f34b7f39c10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:23.297206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5d88fe53-2849-46a5-8963-6f34b7f39c10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:23.301333 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3074/6109] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:24:23 2022] DELETE /identity/v3/projects/ef793657ad3e44828045d7d24129442a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:23.306570 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33959473-c638-4cd8-af5e-9568e48e3f91 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:23.331417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33959473-c638-4cd8-af5e-9568e48e3f91 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:23.345373 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:23.592638 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06339812-a465-4a43-b3b5-23c04485b791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:23.592853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88fe53-2849-46a5-8963-6f34b7f39c10 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:23.593413 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06339812-a465-4a43-b3b5-23c04485b791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:23.593833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06339812-a465-4a43-b3b5-23c04485b791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:23.594115 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06339812-a465-4a43-b3b5-23c04485b791 admin admin] PATH_INFO: `/v3/users/599a8d44cef94921b89f8cee037af289` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:23.594673 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5d88fe53-2849-46a5-8963-6f34b7f39c10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:23.598105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06339812-a465-4a43-b3b5-23c04485b791 admin admin] RBAC: Authorizing `identity:delete_user(user_id=599a8d44cef94921b89f8cee037af289)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:23.605524 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06339812-a465-4a43-b3b5-23c04485b791 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:23.762372 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-06339812-a465-4a43-b3b5-23c04485b791 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '599a8d44cef94921b89f8cee037af289'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:23.767566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-06339812-a465-4a43-b3b5-23c04485b791 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '599a8d44cef94921b89f8cee037af289'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:23.792154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-06339812-a465-4a43-b3b5-23c04485b791 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '599a8d44cef94921b89f8cee037af289'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:23.811725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88fe53-2849-46a5-8963-6f34b7f39c10 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:23.814924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-06339812-a465-4a43-b3b5-23c04485b791 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '599a8d44cef94921b89f8cee037af289'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:23.815477 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-06339812-a465-4a43-b3b5-23c04485b791 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '599a8d44cef94921b89f8cee037af289'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:23.824931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437d078-35ef-4c48-8b8b-e2c1f317ef4c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:23.825673 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437d078-35ef-4c48-8b8b-e2c1f317ef4c service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:23.826037 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437d078-35ef-4c48-8b8b-e2c1f317ef4c service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:23.826379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437d078-35ef-4c48-8b8b-e2c1f317ef4c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:23.835126 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2437d078-35ef-4c48-8b8b-e2c1f317ef4c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:23.855288 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3036/6110] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:24:23 2022] DELETE /identity/v3/users/599a8d44cef94921b89f8cee037af289 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:23.967681 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:23.990629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2437d078-35ef-4c48-8b8b-e2c1f317ef4c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:23.992324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2437d078-35ef-4c48-8b8b-e2c1f317ef4c service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:24.026902 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3075/6111] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:24:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 04 01:24:24.241883 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded853d0-44ae-4de8-ad0c-51fccd8cb8ca None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:24.243411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded853d0-44ae-4de8-ad0c-51fccd8cb8ca None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:24.243920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded853d0-44ae-4de8-ad0c-51fccd8cb8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:24.280798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-ded853d0-44ae-4de8-ad0c-51fccd8cb8ca None None] MFA Rules not processed for user `2bd410471c2340aa97bbfe8057122303`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:24.285109 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ded853d0-44ae-4de8-ad0c-51fccd8cb8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:24.319712 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437d078-35ef-4c48-8b8b-e2c1f317ef4c service swift] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:24.321748 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2437d078-35ef-4c48-8b8b-e2c1f317ef4c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:24.353147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437d078-35ef-4c48-8b8b-e2c1f317ef4c service swift] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:24.477390 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3037/6112] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:24.626751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3daeeb-512e-44eb-be66-9cee4bc88ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:24.627960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3daeeb-512e-44eb-be66-9cee4bc88ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:24.628612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3daeeb-512e-44eb-be66-9cee4bc88ead admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:24.629702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3daeeb-512e-44eb-be66-9cee4bc88ead admin admin] PATH_INFO: `/v3/projects/7e5109bf3fe94d048de6d45e5a813f72` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:24.631677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3daeeb-512e-44eb-be66-9cee4bc88ead admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e5109bf3fe94d048de6d45e5a813f72)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:24.634710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3daeeb-512e-44eb-be66-9cee4bc88ead admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:24.719527 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9a3daeeb-512e-44eb-be66-9cee4bc88ead admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e5109bf3fe94d048de6d45e5a813f72', 'request_id': 'req-9a3daeeb-512e-44eb-be66-9cee4bc88ead'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:24.734662 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9a3daeeb-512e-44eb-be66-9cee4bc88ead admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e5109bf3fe94d048de6d45e5a813f72', 'request_id': 'req-9a3daeeb-512e-44eb-be66-9cee4bc88ead'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:24.748762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9a3daeeb-512e-44eb-be66-9cee4bc88ead admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e5109bf3fe94d048de6d45e5a813f72', 'request_id': 'req-9a3daeeb-512e-44eb-be66-9cee4bc88ead'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:24.764007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9a3daeeb-512e-44eb-be66-9cee4bc88ead admin admin] The token cache is being invalidate because project 7e5109bf3fe94d048de6d45e5a813f72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:24:24.764443 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9a3daeeb-512e-44eb-be66-9cee4bc88ead admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:24.765250 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9a3daeeb-512e-44eb-be66-9cee4bc88ead admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:24.768049 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3076/6113] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:24:24 2022] DELETE /identity/v3/projects/7e5109bf3fe94d048de6d45e5a813f72 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:24.772144 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded853d0-44ae-4de8-ad0c-51fccd8cb8ca None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:24.788125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded853d0-44ae-4de8-ad0c-51fccd8cb8ca None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:24.854980 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:24.985110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ad231-ba6e-42bf-9c77-d79347c42e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:24.986176 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ad231-ba6e-42bf-9c77-d79347c42e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:24.986458 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ad231-ba6e-42bf-9c77-d79347c42e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:24.986941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ad231-ba6e-42bf-9c77-d79347c42e1c admin admin] PATH_INFO: `/v3/users/f05692040cac41c5bca43afe7bfc9c56` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:24.995683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ad231-ba6e-42bf-9c77-d79347c42e1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f05692040cac41c5bca43afe7bfc9c56)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:24.998346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ad231-ba6e-42bf-9c77-d79347c42e1c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:25.137198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ff9ad231-ba6e-42bf-9c77-d79347c42e1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f05692040cac41c5bca43afe7bfc9c56'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:25.139319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ff9ad231-ba6e-42bf-9c77-d79347c42e1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f05692040cac41c5bca43afe7bfc9c56'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:25.183955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ff9ad231-ba6e-42bf-9c77-d79347c42e1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f05692040cac41c5bca43afe7bfc9c56'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:25.204021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ff9ad231-ba6e-42bf-9c77-d79347c42e1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f05692040cac41c5bca43afe7bfc9c56'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:25.207727 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ff9ad231-ba6e-42bf-9c77-d79347c42e1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f05692040cac41c5bca43afe7bfc9c56'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:25.303317 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3038/6114] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:24:24 2022] DELETE /identity/v3/users/f05692040cac41c5bca43afe7bfc9c56 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:26.862274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3daeeb-512e-44eb-be66-9cee4bc88ead admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:26.864840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9a3daeeb-512e-44eb-be66-9cee4bc88ead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:26.888666 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3daeeb-512e-44eb-be66-9cee4bc88ead admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:27.067052 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c846b-a3ea-4950-8d0c-f0875c9ddbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:27.068225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c846b-a3ea-4950-8d0c-f0875c9ddbdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:27.068696 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c846b-a3ea-4950-8d0c-f0875c9ddbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:27.069126 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c846b-a3ea-4950-8d0c-f0875c9ddbdd admin admin] PATH_INFO: `/v3/projects/a7322c4c417241178ba66b633bca1d1b` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:27.072035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c846b-a3ea-4950-8d0c-f0875c9ddbdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7322c4c417241178ba66b633bca1d1b)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:27.074263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c846b-a3ea-4950-8d0c-f0875c9ddbdd admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:27.105284 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:27.151658 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a91c846b-a3ea-4950-8d0c-f0875c9ddbdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7322c4c417241178ba66b633bca1d1b', 'request_id': 'req-a91c846b-a3ea-4950-8d0c-f0875c9ddbdd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:27.166456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a91c846b-a3ea-4950-8d0c-f0875c9ddbdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7322c4c417241178ba66b633bca1d1b', 'request_id': 'req-a91c846b-a3ea-4950-8d0c-f0875c9ddbdd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:27.182914 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a91c846b-a3ea-4950-8d0c-f0875c9ddbdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7322c4c417241178ba66b633bca1d1b', 'request_id': 'req-a91c846b-a3ea-4950-8d0c-f0875c9ddbdd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:27.229157 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a91c846b-a3ea-4950-8d0c-f0875c9ddbdd admin admin] The token cache is being invalidate because project a7322c4c417241178ba66b633bca1d1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:24:27.229628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a91c846b-a3ea-4950-8d0c-f0875c9ddbdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:27.232489 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a91c846b-a3ea-4950-8d0c-f0875c9ddbdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:27.244387 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3077/6115] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:24:26 2022] DELETE /identity/v3/projects/a7322c4c417241178ba66b633bca1d1b => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:27.246708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d691048-8c5a-45f7-b89f-414d019ee014 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:27.247223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d691048-8c5a-45f7-b89f-414d019ee014 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:27.247339 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d691048-8c5a-45f7-b89f-414d019ee014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:27.251817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c846b-a3ea-4950-8d0c-f0875c9ddbdd admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:27.254248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a91c846b-a3ea-4950-8d0c-f0875c9ddbdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:27.298793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5d691048-8c5a-45f7-b89f-414d019ee014 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:27.300592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5d691048-8c5a-45f7-b89f-414d019ee014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:27.433282 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3039/6116] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:27.442615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809e7aa-8a57-4ba7-a2cf-81ac7f37a4b2 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:27.443166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809e7aa-8a57-4ba7-a2cf-81ac7f37a4b2 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:27.443623 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809e7aa-8a57-4ba7-a2cf-81ac7f37a4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:27.444186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c846b-a3ea-4950-8d0c-f0875c9ddbdd admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:27.463710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9479b1-10aa-44ce-b25e-bb29d774642f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:27.464372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9479b1-10aa-44ce-b25e-bb29d774642f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:27.464648 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9479b1-10aa-44ce-b25e-bb29d774642f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:27.464921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9479b1-10aa-44ce-b25e-bb29d774642f admin admin] PATH_INFO: `/v3/projects/4472369a3d5245cdb04375ef390e68ba` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:27.466146 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9479b1-10aa-44ce-b25e-bb29d774642f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4472369a3d5245cdb04375ef390e68ba)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:27.468098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9479b1-10aa-44ce-b25e-bb29d774642f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:27.504379 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-f809e7aa-8a57-4ba7-a2cf-81ac7f37a4b2 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:27.505792 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f809e7aa-8a57-4ba7-a2cf-81ac7f37a4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:27.527060 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3040/6117] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:24:27.531173 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809e7aa-8a57-4ba7-a2cf-81ac7f37a4b2 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:27.563283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809e7aa-8a57-4ba7-a2cf-81ac7f37a4b2 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:27.592832 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-df9479b1-10aa-44ce-b25e-bb29d774642f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4472369a3d5245cdb04375ef390e68ba', 'request_id': 'req-df9479b1-10aa-44ce-b25e-bb29d774642f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:27.609021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-df9479b1-10aa-44ce-b25e-bb29d774642f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4472369a3d5245cdb04375ef390e68ba', 'request_id': 'req-df9479b1-10aa-44ce-b25e-bb29d774642f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:27.617255 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-df9479b1-10aa-44ce-b25e-bb29d774642f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4472369a3d5245cdb04375ef390e68ba', 'request_id': 'req-df9479b1-10aa-44ce-b25e-bb29d774642f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:27.640854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-df9479b1-10aa-44ce-b25e-bb29d774642f admin admin] The token cache is being invalidate because project 4472369a3d5245cdb04375ef390e68ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:24:27.641475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-df9479b1-10aa-44ce-b25e-bb29d774642f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:27.642858 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-df9479b1-10aa-44ce-b25e-bb29d774642f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:27.650766 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3078/6118] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:24:27 2022] DELETE /identity/v3/projects/4472369a3d5245cdb04375ef390e68ba => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:27.656328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794c64f-ab82-44ef-945c-5db0d3cb71dc None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:27.656786 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794c64f-ab82-44ef-945c-5db0d3cb71dc None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:27.657246 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794c64f-ab82-44ef-945c-5db0d3cb71dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:27.674031 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:27.718264 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-5794c64f-ab82-44ef-945c-5db0d3cb71dc None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:27.719561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5794c64f-ab82-44ef-945c-5db0d3cb71dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:27.746309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea8562-6715-4a50-9546-f41fc258b74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:27.755846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea8562-6715-4a50-9546-f41fc258b74b admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:27.756161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea8562-6715-4a50-9546-f41fc258b74b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:27.756461 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea8562-6715-4a50-9546-f41fc258b74b admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:27.757212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea8562-6715-4a50-9546-f41fc258b74b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:24:27.758852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea8562-6715-4a50-9546-f41fc258b74b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:27.770130 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea8562-6715-4a50-9546-f41fc258b74b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:27.817770 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3041/6119] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:24:27.825231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea8562-6715-4a50-9546-f41fc258b74b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:27.827037 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:27.830393 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b4ea8562-6715-4a50-9546-f41fc258b74b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:27.862170 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea8562-6715-4a50-9546-f41fc258b74b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:27.878193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123466fc-8119-4db3-9b45-12e72aff3ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:27.879117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123466fc-8119-4db3-9b45-12e72aff3ed6 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:27.879747 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123466fc-8119-4db3-9b45-12e72aff3ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:27.880262 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123466fc-8119-4db3-9b45-12e72aff3ed6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:27.882605 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123466fc-8119-4db3-9b45-12e72aff3ed6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:27.884948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123466fc-8119-4db3-9b45-12e72aff3ed6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:27.929174 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3079/6120] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:27.940716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9457c-b6fe-4d80-a217-b797bb6cf51d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:27.941000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9457c-b6fe-4d80-a217-b797bb6cf51d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:27.941274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9457c-b6fe-4d80-a217-b797bb6cf51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:27.968243 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3042/6121] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:24:27 2022] POST /identity/v3/projects => generated 381 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:24:27.973415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123466fc-8119-4db3-9b45-12e72aff3ed6 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:28.011159 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-46d9457c-b6fe-4d80-a217-b797bb6cf51d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:28.012649 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-46d9457c-b6fe-4d80-a217-b797bb6cf51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:28.139881 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123466fc-8119-4db3-9b45-12e72aff3ed6 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:28.154767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0931648-0d3e-4e3d-9ad4-ace51c4eedf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:28.155634 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0931648-0d3e-4e3d-9ad4-ace51c4eedf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:28.156098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0931648-0d3e-4e3d-9ad4-ace51c4eedf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:28.156546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0931648-0d3e-4e3d-9ad4-ace51c4eedf9 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:28.157653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0931648-0d3e-4e3d-9ad4-ace51c4eedf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:28.161916 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0931648-0d3e-4e3d-9ad4-ace51c4eedf9 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:28.214480 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3043/6122] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:24:27 2022] POST /identity/v3/users => generated 291 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:24:28.219029 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0931648-0d3e-4e3d-9ad4-ace51c4eedf9 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:28.240967 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3080/6123] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:28.242284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9457c-b6fe-4d80-a217-b797bb6cf51d None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:28.258032 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9457c-b6fe-4d80-a217-b797bb6cf51d None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:28.272209 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0931648-0d3e-4e3d-9ad4-ace51c4eedf9 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:28.288081 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab690082-1f76-4530-be78-8ad8493b64ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:28.288723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab690082-1f76-4530-be78-8ad8493b64ef admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:28.289210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab690082-1f76-4530-be78-8ad8493b64ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:28.289686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab690082-1f76-4530-be78-8ad8493b64ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:28.290559 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab690082-1f76-4530-be78-8ad8493b64ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:28.292451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab690082-1f76-4530-be78-8ad8493b64ef admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:28.309333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61fc01-b3f7-40f0-9719-bc365908c01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:28.311409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61fc01-b3f7-40f0-9719-bc365908c01c admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:28.314083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61fc01-b3f7-40f0-9719-bc365908c01c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:28.314662 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61fc01-b3f7-40f0-9719-bc365908c01c admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:28.315465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e61fc01-b3f7-40f0-9719-bc365908c01c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:24:28.315875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e61fc01-b3f7-40f0-9719-bc365908c01c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:28.317505 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3044/6124] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:24:28.320442 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e61fc01-b3f7-40f0-9719-bc365908c01c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:28.321673 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab690082-1f76-4530-be78-8ad8493b64ef admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:28.339206 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab690082-1f76-4530-be78-8ad8493b64ef admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:28.350172 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3081/6125] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:24:28.355471 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61fc01-b3f7-40f0-9719-bc365908c01c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:28.356337 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f78f6c-5cc5-4ad9-9529-8db60939d8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:28.357162 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f78f6c-5cc5-4ad9-9529-8db60939d8ad admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:28.357660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f78f6c-5cc5-4ad9-9529-8db60939d8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:28.358123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f78f6c-5cc5-4ad9-9529-8db60939d8ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:28.358939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f78f6c-5cc5-4ad9-9529-8db60939d8ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:28.361332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f78f6c-5cc5-4ad9-9529-8db60939d8ad admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:28.376115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61fc01-b3f7-40f0-9719-bc365908c01c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:28.385929 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3045/6126] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:24:28.390437 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f78f6c-5cc5-4ad9-9529-8db60939d8ad admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:28.393516 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac0f70-070d-48e6-a62b-db06d98f8e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:28.394154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac0f70-070d-48e6-a62b-db06d98f8e2b admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:28.394410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac0f70-070d-48e6-a62b-db06d98f8e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:28.394682 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac0f70-070d-48e6-a62b-db06d98f8e2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:28.395330 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eac0f70-070d-48e6-a62b-db06d98f8e2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:28.397257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eac0f70-070d-48e6-a62b-db06d98f8e2b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:28.422781 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f78f6c-5cc5-4ad9-9529-8db60939d8ad admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:28.439331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdacc83-efb8-444d-9915-6f97340eaa94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:28.440487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdacc83-efb8-444d-9915-6f97340eaa94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:28.440943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdacc83-efb8-444d-9915-6f97340eaa94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:28.441389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdacc83-efb8-444d-9915-6f97340eaa94 admin admin] PATH_INFO: `/v3/projects/bf4e21de2ae84279a4f5962beab8a8f7/users/37393d3f6ed44a27897382573e024459/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:28.468773 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3082/6127] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:24:28 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:24:28.473779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdacc83-efb8-444d-9915-6f97340eaa94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf4e21de2ae84279a4f5962beab8a8f7, user_id=37393d3f6ed44a27897382573e024459, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:28.476592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdacc83-efb8-444d-9915-6f97340eaa94 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:28.483825 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac0f70-070d-48e6-a62b-db06d98f8e2b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:28.514792 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3046/6128] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:24:28 2022] PUT /identity/v3/projects/bf4e21de2ae84279a4f5962beab8a8f7/users/37393d3f6ed44a27897382573e024459/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:28.525998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518758a-bf7f-471b-9524-cb968e8713ba None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:28.526279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518758a-bf7f-471b-9524-cb968e8713ba None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:28.526790 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518758a-bf7f-471b-9524-cb968e8713ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:28.588966 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-8518758a-bf7f-471b-9524-cb968e8713ba None None] MFA Rules not processed for user `37393d3f6ed44a27897382573e024459`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:28.592690 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8518758a-bf7f-471b-9524-cb968e8713ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:28.629951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac0f70-070d-48e6-a62b-db06d98f8e2b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:28.703517 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:28.761172 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:28.762864 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3047/6129] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:28.776203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518758a-bf7f-471b-9524-cb968e8713ba None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:28.781525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8518758a-bf7f-471b-9524-cb968e8713ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:28.790847 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b7fd8-19df-4a86-9fe3-b7cb4b5414b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:28.794300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b7fd8-19df-4a86-9fe3-b7cb4b5414b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:28.794871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b7fd8-19df-4a86-9fe3-b7cb4b5414b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:28.795391 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b7fd8-19df-4a86-9fe3-b7cb4b5414b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:28.796441 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b7fd8-19df-4a86-9fe3-b7cb4b5414b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:28.814059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b7fd8-19df-4a86-9fe3-b7cb4b5414b0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:28.885482 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3083/6130] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:24:28 2022] POST /identity/v3/users => generated 292 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:24:28.896173 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b7fd8-19df-4a86-9fe3-b7cb4b5414b0 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:28.939252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b7fd8-19df-4a86-9fe3-b7cb4b5414b0 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:28.954505 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b796d-ce02-47db-9964-73dcf247632e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:28.955513 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b796d-ce02-47db-9964-73dcf247632e admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:28.956792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b796d-ce02-47db-9964-73dcf247632e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:28.957998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b796d-ce02-47db-9964-73dcf247632e admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:28.959702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b796d-ce02-47db-9964-73dcf247632e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:28.963188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b796d-ce02-47db-9964-73dcf247632e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:29.010515 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3084/6131] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:24:29.015728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b796d-ce02-47db-9964-73dcf247632e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:29.016024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518758a-bf7f-471b-9524-cb968e8713ba None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:29.028701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe88f76-729c-49e2-85da-9dafec065487 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:29.029392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe88f76-729c-49e2-85da-9dafec065487 service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:29.029704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe88f76-729c-49e2-85da-9dafec065487 service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:29.029978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe88f76-729c-49e2-85da-9dafec065487 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:29.040752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b796d-ce02-47db-9964-73dcf247632e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:29.053170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a8586-3aeb-4bd7-bf62-0d11fa6e6c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:29.054118 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a8586-3aeb-4bd7-bf62-0d11fa6e6c0a admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:29.054670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a8586-3aeb-4bd7-bf62-0d11fa6e6c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:29.055170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a8586-3aeb-4bd7-bf62-0d11fa6e6c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:29.056037 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a8586-3aeb-4bd7-bf62-0d11fa6e6c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:29.058788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a8586-3aeb-4bd7-bf62-0d11fa6e6c0a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:29.074107 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3085/6132] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:24:29.078410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a8586-3aeb-4bd7-bf62-0d11fa6e6c0a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:29.079366 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe88f76-729c-49e2-85da-9dafec065487 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:29.086663 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe88f76-729c-49e2-85da-9dafec065487 service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:29.092109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a8586-3aeb-4bd7-bf62-0d11fa6e6c0a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:29.098332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662c8f9-a6e2-4c64-99e2-e428ff98ff27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:29.099986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662c8f9-a6e2-4c64-99e2-e428ff98ff27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:29.100525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662c8f9-a6e2-4c64-99e2-e428ff98ff27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:29.101051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662c8f9-a6e2-4c64-99e2-e428ff98ff27 admin admin] PATH_INFO: `/v3/projects/9b8cf1ccc16a47049ddb0f97c5eea301/users/8877696acd6f48aab094d921503b0672/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:29.120672 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3048/6133] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:24:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:24:29.154587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe88f76-729c-49e2-85da-9dafec065487 service cinder] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:29.177135 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe88f76-729c-49e2-85da-9dafec065487 service cinder] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:29.193342 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9662c8f9-a6e2-4c64-99e2-e428ff98ff27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b8cf1ccc16a47049ddb0f97c5eea301, user_id=8877696acd6f48aab094d921503b0672, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:29.196257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df75949-f3eb-41bf-881f-89533619ab1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:29.196446 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df75949-f3eb-41bf-881f-89533619ab1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:29.196682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df75949-f3eb-41bf-881f-89533619ab1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:29.196905 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df75949-f3eb-41bf-881f-89533619ab1a admin admin] PATH_INFO: `/v3/users/37393d3f6ed44a27897382573e024459` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:29.200256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9662c8f9-a6e2-4c64-99e2-e428ff98ff27 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:29.202842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df75949-f3eb-41bf-881f-89533619ab1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=37393d3f6ed44a27897382573e024459)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:29.205423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df75949-f3eb-41bf-881f-89533619ab1a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:29.254768 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3086/6134] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:24:29 2022] PUT /identity/v3/projects/9b8cf1ccc16a47049ddb0f97c5eea301/users/8877696acd6f48aab094d921503b0672/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:24:29.256289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fa78b-b574-495f-8d33-c0a69372d53d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:29.256623 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fa78b-b574-495f-8d33-c0a69372d53d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:29.256843 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fa78b-b574-495f-8d33-c0a69372d53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:29.339238 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-6e5fa78b-b574-495f-8d33-c0a69372d53d None None] MFA Rules not processed for user `8877696acd6f48aab094d921503b0672`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:29.340461 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6e5fa78b-b574-495f-8d33-c0a69372d53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:29.355951 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2df75949-f3eb-41bf-881f-89533619ab1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37393d3f6ed44a27897382573e024459'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:29.356773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2df75949-f3eb-41bf-881f-89533619ab1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37393d3f6ed44a27897382573e024459'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:29.374090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2df75949-f3eb-41bf-881f-89533619ab1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37393d3f6ed44a27897382573e024459'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:29.395426 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2df75949-f3eb-41bf-881f-89533619ab1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37393d3f6ed44a27897382573e024459'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:29.397120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2df75949-f3eb-41bf-881f-89533619ab1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37393d3f6ed44a27897382573e024459'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:29.500773 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3049/6135] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:24:29 2022] DELETE /identity/v3/users/37393d3f6ed44a27897382573e024459 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:24:29.505980 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc9325-54c6-45ef-805d-717bbe03721d None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:29.506279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc9325-54c6-45ef-805d-717bbe03721d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:29.506543 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc9325-54c6-45ef-805d-717bbe03721d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:29.573317 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-54bc9325-54c6-45ef-805d-717bbe03721d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:29.574900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-54bc9325-54c6-45ef-805d-717bbe03721d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:29.587011 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3087/6136] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:29.598040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5fa78b-b574-495f-8d33-c0a69372d53d None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:29.599750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6e5fa78b-b574-495f-8d33-c0a69372d53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:29.710215 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3050/6137] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:24:29.731659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc9325-54c6-45ef-805d-717bbe03721d None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:29.733407 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-54bc9325-54c6-45ef-805d-717bbe03721d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:29.742111 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:29.747821 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5fa78b-b574-495f-8d33-c0a69372d53d None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:29.855591 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:29.869938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc9325-54c6-45ef-805d-717bbe03721d None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:29.874392 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798211b-b3a9-4063-9ae3-a4214ac8b32a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:29.875285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798211b-b3a9-4063-9ae3-a4214ac8b32a service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:29.875619 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798211b-b3a9-4063-9ae3-a4214ac8b32a service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:29.876641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798211b-b3a9-4063-9ae3-a4214ac8b32a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:29.879279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a75845-85be-4f22-bc84-9f032b4438a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:29.879926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a75845-85be-4f22-bc84-9f032b4438a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:29.880380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a75845-85be-4f22-bc84-9f032b4438a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:29.880678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a75845-85be-4f22-bc84-9f032b4438a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:29.905103 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a75845-85be-4f22-bc84-9f032b4438a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:29.908311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a75845-85be-4f22-bc84-9f032b4438a2 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:29.926259 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3051/6138] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:24:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:24:30.008173 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798211b-b3a9-4063-9ae3-a4214ac8b32a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:30.012037 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798211b-b3a9-4063-9ae3-a4214ac8b32a service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:30.032317 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3088/6139] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:24:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:24:30.127037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a75845-85be-4f22-bc84-9f032b4438a2 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:30.128704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-20a75845-85be-4f22-bc84-9f032b4438a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:30.151465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a75845-85be-4f22-bc84-9f032b4438a2 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:30.167860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6579d-f205-470c-a692-3ef4d9aa0492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:30.168726 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6579d-f205-470c-a692-3ef4d9aa0492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:30.169079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6579d-f205-470c-a692-3ef4d9aa0492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:30.169449 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6579d-f205-470c-a692-3ef4d9aa0492 admin admin] PATH_INFO: `/v3/users/be960d7837fb40ce8edfd8f29cb43e95` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:30.171137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a6579d-f205-470c-a692-3ef4d9aa0492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be960d7837fb40ce8edfd8f29cb43e95)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:30.173157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a6579d-f205-470c-a692-3ef4d9aa0492 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:30.310977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f9a6579d-f205-470c-a692-3ef4d9aa0492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be960d7837fb40ce8edfd8f29cb43e95'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:30.313014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f9a6579d-f205-470c-a692-3ef4d9aa0492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be960d7837fb40ce8edfd8f29cb43e95'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:30.333463 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f9a6579d-f205-470c-a692-3ef4d9aa0492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be960d7837fb40ce8edfd8f29cb43e95'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:30.349373 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f9a6579d-f205-470c-a692-3ef4d9aa0492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be960d7837fb40ce8edfd8f29cb43e95'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:30.350046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f9a6579d-f205-470c-a692-3ef4d9aa0492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be960d7837fb40ce8edfd8f29cb43e95'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:30.384542 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3052/6140] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:24:30 2022] DELETE /identity/v3/users/be960d7837fb40ce8edfd8f29cb43e95 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:30.389547 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c028cf1-76ee-4fe3-9a09-3d98c7c48b58 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:30.389835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c028cf1-76ee-4fe3-9a09-3d98c7c48b58 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:30.390194 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c028cf1-76ee-4fe3-9a09-3d98c7c48b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:30.441895 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-8c028cf1-76ee-4fe3-9a09-3d98c7c48b58 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:30.443415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8c028cf1-76ee-4fe3-9a09-3d98c7c48b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:30.642347 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3089/6141] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:30.666405 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6579d-f205-470c-a692-3ef4d9aa0492 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:30.670814 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f9a6579d-f205-470c-a692-3ef4d9aa0492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:30.819327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6579d-f205-470c-a692-3ef4d9aa0492 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:30.830795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ee8e7-a178-4c59-9a6e-14721f1f0b47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:30.831636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ee8e7-a178-4c59-9a6e-14721f1f0b47 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:30.832056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ee8e7-a178-4c59-9a6e-14721f1f0b47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:30.832436 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ee8e7-a178-4c59-9a6e-14721f1f0b47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:30.853517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ee8e7-a178-4c59-9a6e-14721f1f0b47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:30.857480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ee8e7-a178-4c59-9a6e-14721f1f0b47 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:30.882148 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3053/6142] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:24:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:24:31.526992 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c028cf1-76ee-4fe3-9a09-3d98c7c48b58 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:31.529302 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8c028cf1-76ee-4fe3-9a09-3d98c7c48b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:31.553928 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c028cf1-76ee-4fe3-9a09-3d98c7c48b58 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:31.567005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b4faa-dcd7-40b2-b9c1-c59716c41552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:31.568061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b4faa-dcd7-40b2-b9c1-c59716c41552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:31.568579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b4faa-dcd7-40b2-b9c1-c59716c41552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:31.569085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b4faa-dcd7-40b2-b9c1-c59716c41552 admin admin] PATH_INFO: `/v3/projects/01249e093e414a6e866f6c60a9d5d9d6` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:31.572139 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b4faa-dcd7-40b2-b9c1-c59716c41552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01249e093e414a6e866f6c60a9d5d9d6)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:31.577659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b4faa-dcd7-40b2-b9c1-c59716c41552 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:31.695264 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e04b4faa-dcd7-40b2-b9c1-c59716c41552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01249e093e414a6e866f6c60a9d5d9d6', 'request_id': 'req-e04b4faa-dcd7-40b2-b9c1-c59716c41552'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:31.725386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e04b4faa-dcd7-40b2-b9c1-c59716c41552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01249e093e414a6e866f6c60a9d5d9d6', 'request_id': 'req-e04b4faa-dcd7-40b2-b9c1-c59716c41552'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:31.736380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e04b4faa-dcd7-40b2-b9c1-c59716c41552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01249e093e414a6e866f6c60a9d5d9d6', 'request_id': 'req-e04b4faa-dcd7-40b2-b9c1-c59716c41552'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:31.773868 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e04b4faa-dcd7-40b2-b9c1-c59716c41552 admin admin] The token cache is being invalidate because project 01249e093e414a6e866f6c60a9d5d9d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:24:31.776351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e04b4faa-dcd7-40b2-b9c1-c59716c41552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:31.789127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e04b4faa-dcd7-40b2-b9c1-c59716c41552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:31.796975 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3090/6143] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:24:31 2022] DELETE /identity/v3/projects/01249e093e414a6e866f6c60a9d5d9d6 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:31.799473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec66eff-1ee9-44fd-abf3-a4533cd39551 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:31.806651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec66eff-1ee9-44fd-abf3-a4533cd39551 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:31.806935 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec66eff-1ee9-44fd-abf3-a4533cd39551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:31.850479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-6ec66eff-1ee9-44fd-abf3-a4533cd39551 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:31.852202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6ec66eff-1ee9-44fd-abf3-a4533cd39551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:31.897272 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:32.005481 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3054/6144] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:24:32.013052 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538c940-6e8c-488c-a0fc-e78f4ecdc70e None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:32.013672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538c940-6e8c-488c-a0fc-e78f4ecdc70e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:32.014206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538c940-6e8c-488c-a0fc-e78f4ecdc70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:32.059239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-9538c940-6e8c-488c-a0fc-e78f4ecdc70e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:32.060962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9538c940-6e8c-488c-a0fc-e78f4ecdc70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:32.088765 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3091/6145] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:32.089229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec66eff-1ee9-44fd-abf3-a4533cd39551 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:32.107086 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec66eff-1ee9-44fd-abf3-a4533cd39551 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:32.139831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a716b-3862-4fc0-a51a-c813e6b8dce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:32.140477 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a716b-3862-4fc0-a51a-c813e6b8dce0 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:32.140754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a716b-3862-4fc0-a51a-c813e6b8dce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:32.141029 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a716b-3862-4fc0-a51a-c813e6b8dce0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:32.142320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a716b-3862-4fc0-a51a-c813e6b8dce0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:24:32.142623 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a716b-3862-4fc0-a51a-c813e6b8dce0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:32.144251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a716b-3862-4fc0-a51a-c813e6b8dce0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:32.197583 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3055/6146] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:24:32.198508 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538c940-6e8c-488c-a0fc-e78f4ecdc70e None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:32.229083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538c940-6e8c-488c-a0fc-e78f4ecdc70e None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:32.269642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac87b18-c2e3-40d8-9da4-8d7121834e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:32.269642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac87b18-c2e3-40d8-9da4-8d7121834e19 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:32.269642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac87b18-c2e3-40d8-9da4-8d7121834e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:32.269642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac87b18-c2e3-40d8-9da4-8d7121834e19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:32.270144 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac87b18-c2e3-40d8-9da4-8d7121834e19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:32.270144 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac87b18-c2e3-40d8-9da4-8d7121834e19 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:32.277757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a716b-3862-4fc0-a51a-c813e6b8dce0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:32.280895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-506a716b-3862-4fc0-a51a-c813e6b8dce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:32.308581 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:32.318934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a716b-3862-4fc0-a51a-c813e6b8dce0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:32.342115 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f0037-59b2-44e1-b9bc-6a18575e8107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:32.343526 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f0037-59b2-44e1-b9bc-6a18575e8107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:32.346403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f0037-59b2-44e1-b9bc-6a18575e8107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:32.346713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f0037-59b2-44e1-b9bc-6a18575e8107 admin admin] PATH_INFO: `/v3/projects/bf4e21de2ae84279a4f5962beab8a8f7` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:32.347511 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3092/6147] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:24:32 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:24:32.348349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f0037-59b2-44e1-b9bc-6a18575e8107 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf4e21de2ae84279a4f5962beab8a8f7)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:32.348611 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac87b18-c2e3-40d8-9da4-8d7121834e19 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:32.350437 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f0037-59b2-44e1-b9bc-6a18575e8107 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:32.497954 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ea5f0037-59b2-44e1-b9bc-6a18575e8107 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf4e21de2ae84279a4f5962beab8a8f7', 'request_id': 'req-ea5f0037-59b2-44e1-b9bc-6a18575e8107'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:32.522950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ea5f0037-59b2-44e1-b9bc-6a18575e8107 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf4e21de2ae84279a4f5962beab8a8f7', 'request_id': 'req-ea5f0037-59b2-44e1-b9bc-6a18575e8107'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:32.530005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac87b18-c2e3-40d8-9da4-8d7121834e19 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:32.531961 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ea5f0037-59b2-44e1-b9bc-6a18575e8107 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf4e21de2ae84279a4f5962beab8a8f7', 'request_id': 'req-ea5f0037-59b2-44e1-b9bc-6a18575e8107'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:32.557695 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ea5f0037-59b2-44e1-b9bc-6a18575e8107 admin admin] The token cache is being invalidate because project bf4e21de2ae84279a4f5962beab8a8f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:24:32.557975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ea5f0037-59b2-44e1-b9bc-6a18575e8107 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:32.567105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ea5f0037-59b2-44e1-b9bc-6a18575e8107 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:32.573537 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3056/6148] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:24:32 2022] DELETE /identity/v3/projects/bf4e21de2ae84279a4f5962beab8a8f7 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:32.575270 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda1dbc-693d-499d-8f51-e5340967657f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:32.575567 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda1dbc-693d-499d-8f51-e5340967657f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:32.576039 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda1dbc-693d-499d-8f51-e5340967657f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:32.615778 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-9fda1dbc-693d-499d-8f51-e5340967657f None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:32.617111 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9fda1dbc-693d-499d-8f51-e5340967657f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:32.636610 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4a228-f52b-47a7-a3db-aef9891e1b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:32.637350 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4a228-f52b-47a7-a3db-aef9891e1b26 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:32.637675 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4a228-f52b-47a7-a3db-aef9891e1b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:32.638020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4a228-f52b-47a7-a3db-aef9891e1b26 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:32.638722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4a228-f52b-47a7-a3db-aef9891e1b26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:32.642356 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4a228-f52b-47a7-a3db-aef9891e1b26 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:32.695336 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3093/6149] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:24:32 2022] POST /identity/v3/users => generated 292 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:24:32.697916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4a228-f52b-47a7-a3db-aef9891e1b26 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:32.706240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-45f4a228-f52b-47a7-a3db-aef9891e1b26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:32.732500 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3057/6150] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:32.737496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4a228-f52b-47a7-a3db-aef9891e1b26 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:32.743683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f8557-c621-4172-a380-86648a9c5e70 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:32.743972 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f8557-c621-4172-a380-86648a9c5e70 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:32.744273 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f8557-c621-4172-a380-86648a9c5e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:32.750476 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31411528-0953-4751-84e9-7cb95ea166ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:32.751155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31411528-0953-4751-84e9-7cb95ea166ea admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:32.751435 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31411528-0953-4751-84e9-7cb95ea166ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:32.752608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31411528-0953-4751-84e9-7cb95ea166ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:32.753266 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31411528-0953-4751-84e9-7cb95ea166ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:32.757264 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31411528-0953-4751-84e9-7cb95ea166ea admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:32.784100 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-042f8557-c621-4172-a380-86648a9c5e70 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:32.786992 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-042f8557-c621-4172-a380-86648a9c5e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:32.794645 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3094/6151] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:24:32.798755 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31411528-0953-4751-84e9-7cb95ea166ea admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:32.810436 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3058/6152] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:32.813221 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f8557-c621-4172-a380-86648a9c5e70 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:32.826723 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31411528-0953-4751-84e9-7cb95ea166ea admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:32.840611 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f8f3a-1fdc-4a02-949a-b23b7ae077d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:32.841912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f8f3a-1fdc-4a02-949a-b23b7ae077d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:32.842801 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f8f3a-1fdc-4a02-949a-b23b7ae077d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:32.843243 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f8f3a-1fdc-4a02-949a-b23b7ae077d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:32.844373 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f8f3a-1fdc-4a02-949a-b23b7ae077d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:32.848551 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f8f3a-1fdc-4a02-949a-b23b7ae077d3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:32.851995 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f8557-c621-4172-a380-86648a9c5e70 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:32.869595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c7f9a-18d8-4b5f-ad46-997eee193c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:32.874400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c7f9a-18d8-4b5f-ad46-997eee193c93 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:32.875481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c7f9a-18d8-4b5f-ad46-997eee193c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:32.875769 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c7f9a-18d8-4b5f-ad46-997eee193c93 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:32.879702 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c7f9a-18d8-4b5f-ad46-997eee193c93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:24:32.880030 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c7f9a-18d8-4b5f-ad46-997eee193c93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:32.887633 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c7f9a-18d8-4b5f-ad46-997eee193c93 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:32.889179 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3095/6153] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:24:32.892603 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f8f3a-1fdc-4a02-949a-b23b7ae077d3 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:32.918346 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f8f3a-1fdc-4a02-949a-b23b7ae077d3 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:32.929229 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3059/6154] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:24:32.931861 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c7f9a-18d8-4b5f-ad46-997eee193c93 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:32.943166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035eb0ad-df95-4110-905a-3bc4de75e1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:32.943166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035eb0ad-df95-4110-905a-3bc4de75e1f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:32.943646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035eb0ad-df95-4110-905a-3bc4de75e1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:32.943646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035eb0ad-df95-4110-905a-3bc4de75e1f3 admin admin] PATH_INFO: `/v3/projects/a5a001aca0e84fcf860c62adecb9429f/users/ddd11882332f401d92366a6cde7137ae/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:32.965534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c7f9a-18d8-4b5f-ad46-997eee193c93 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:32.979896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044884a-c74c-4ae4-ac77-de12bec02746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:32.981465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044884a-c74c-4ae4-ac77-de12bec02746 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:32.981754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044884a-c74c-4ae4-ac77-de12bec02746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:32.982033 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044884a-c74c-4ae4-ac77-de12bec02746 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:32.982684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044884a-c74c-4ae4-ac77-de12bec02746 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:32.986889 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044884a-c74c-4ae4-ac77-de12bec02746 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:32.988715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035eb0ad-df95-4110-905a-3bc4de75e1f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5a001aca0e84fcf860c62adecb9429f, user_id=ddd11882332f401d92366a6cde7137ae, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:32.994129 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035eb0ad-df95-4110-905a-3bc4de75e1f3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:33.022807 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3096/6155] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:24:32 2022] PUT /identity/v3/projects/a5a001aca0e84fcf860c62adecb9429f/users/ddd11882332f401d92366a6cde7137ae/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:33.028133 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:33.033883 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7306d-702a-412d-b161-c3765b6d209c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:33.034260 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7306d-702a-412d-b161-c3765b6d209c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:33.034611 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7306d-702a-412d-b161-c3765b6d209c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:33.069276 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3060/6156] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:24:32 2022] POST /identity/v3/projects => generated 383 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:24:33.076554 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044884a-c74c-4ae4-ac77-de12bec02746 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:33.124387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-3ae7306d-702a-412d-b161-c3765b6d209c None None] MFA Rules not processed for user `ddd11882332f401d92366a6cde7137ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:33.125731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3ae7306d-702a-412d-b161-c3765b6d209c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:33.185966 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:33.242901 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3097/6157] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:24:33.248051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7306d-702a-412d-b161-c3765b6d209c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:33.292535 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044884a-c74c-4ae4-ac77-de12bec02746 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:33.304064 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa1a45-a152-483e-a3bd-10740c242af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:33.306456 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa1a45-a152-483e-a3bd-10740c242af0 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:33.307182 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa1a45-a152-483e-a3bd-10740c242af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:33.307302 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa1a45-a152-483e-a3bd-10740c242af0 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:33.307945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa1a45-a152-483e-a3bd-10740c242af0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:33.335931 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa1a45-a152-483e-a3bd-10740c242af0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:33.406981 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3061/6158] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:24:33 2022] POST /identity/v3/users => generated 292 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:24:33.411557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa1a45-a152-483e-a3bd-10740c242af0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:33.427481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa1a45-a152-483e-a3bd-10740c242af0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:33.434891 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b46152-fcbe-4ef9-9f40-714f38b7e9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:33.436062 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b46152-fcbe-4ef9-9f40-714f38b7e9ff admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:33.436517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b46152-fcbe-4ef9-9f40-714f38b7e9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:33.436898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b46152-fcbe-4ef9-9f40-714f38b7e9ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:33.437848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b46152-fcbe-4ef9-9f40-714f38b7e9ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:33.440293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b46152-fcbe-4ef9-9f40-714f38b7e9ff admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:33.444393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7306d-702a-412d-b161-c3765b6d209c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:33.460163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf428e15-5e06-471f-a8f6-3860f7810286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:33.460785 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf428e15-5e06-471f-a8f6-3860f7810286 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:33.461063 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf428e15-5e06-471f-a8f6-3860f7810286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:33.461336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf428e15-5e06-471f-a8f6-3860f7810286 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:33.462175 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf428e15-5e06-471f-a8f6-3860f7810286 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:33.463013 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3062/6159] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:24:33.466615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b46152-fcbe-4ef9-9f40-714f38b7e9ff admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:33.468230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf428e15-5e06-471f-a8f6-3860f7810286 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:33.492128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b46152-fcbe-4ef9-9f40-714f38b7e9ff admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:33.523485 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d7700-bf3f-4265-9a7f-e32f3ac04971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:33.524117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d7700-bf3f-4265-9a7f-e32f3ac04971 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:33.524396 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d7700-bf3f-4265-9a7f-e32f3ac04971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:33.524669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d7700-bf3f-4265-9a7f-e32f3ac04971 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:33.525325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d7700-bf3f-4265-9a7f-e32f3ac04971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:33.537045 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3098/6160] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:24:33 2022] POST /identity/v3/projects => generated 383 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:24:33.538441 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d7700-bf3f-4265-9a7f-e32f3ac04971 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:33.542778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf428e15-5e06-471f-a8f6-3860f7810286 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:33.591490 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3063/6161] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:24:33.594306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d7700-bf3f-4265-9a7f-e32f3ac04971 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:33.636420 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d7700-bf3f-4265-9a7f-e32f3ac04971 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:33.829545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf428e15-5e06-471f-a8f6-3860f7810286 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:33.841785 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f42a4-8658-4e9a-ae14-7f92c2a8cdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:33.842407 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f42a4-8658-4e9a-ae14-7f92c2a8cdba admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:33.842688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f42a4-8658-4e9a-ae14-7f92c2a8cdba admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:33.842960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f42a4-8658-4e9a-ae14-7f92c2a8cdba admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:33.843601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f42a4-8658-4e9a-ae14-7f92c2a8cdba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:33.846225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f42a4-8658-4e9a-ae14-7f92c2a8cdba admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:33.885451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aab086-491b-4ccd-8c9b-8a0d1cadb9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:33.886148 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aab086-491b-4ccd-8c9b-8a0d1cadb9a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:33.886566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aab086-491b-4ccd-8c9b-8a0d1cadb9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:33.886847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aab086-491b-4ccd-8c9b-8a0d1cadb9a7 admin admin] PATH_INFO: `/v3/projects/d709a6ce4787415c82305f1f9136348c/users/789ad235a087474f9f94bfe739f4430c/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:33.916387 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3099/6162] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:24:33 2022] POST /identity/v3/users => generated 292 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:24:33.917302 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f42a4-8658-4e9a-ae14-7f92c2a8cdba admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:33.929856 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aab086-491b-4ccd-8c9b-8a0d1cadb9a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d709a6ce4787415c82305f1f9136348c, user_id=789ad235a087474f9f94bfe739f4430c, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:33.932545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aab086-491b-4ccd-8c9b-8a0d1cadb9a7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:33.942160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f42a4-8658-4e9a-ae14-7f92c2a8cdba admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:33.960002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc504e82-70a3-4630-816d-2efe87c64ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:33.960669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc504e82-70a3-4630-816d-2efe87c64ebc admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:33.961013 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc504e82-70a3-4630-816d-2efe87c64ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:33.961280 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc504e82-70a3-4630-816d-2efe87c64ebc admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:33.962235 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc504e82-70a3-4630-816d-2efe87c64ebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:33.964128 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc504e82-70a3-4630-816d-2efe87c64ebc admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:33.965136 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3064/6163] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:24:33 2022] PUT /identity/v3/projects/d709a6ce4787415c82305f1f9136348c/users/789ad235a087474f9f94bfe739f4430c/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:33.978110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255063c-5aba-4529-8f6b-ccba84fa5e00 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:33.978401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255063c-5aba-4529-8f6b-ccba84fa5e00 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:33.978677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255063c-5aba-4529-8f6b-ccba84fa5e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:33.981720 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3100/6164] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:24:33.982906 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc504e82-70a3-4630-816d-2efe87c64ebc admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:34.004456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc504e82-70a3-4630-816d-2efe87c64ebc admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:34.062936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5255063c-5aba-4529-8f6b-ccba84fa5e00 None None] MFA Rules not processed for user `789ad235a087474f9f94bfe739f4430c`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:34.064113 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5255063c-5aba-4529-8f6b-ccba84fa5e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:34.091521 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:34.148574 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:34.163218 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134ee56-797e-4ecd-811a-3a087d47198b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:34.163859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134ee56-797e-4ecd-811a-3a087d47198b admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:34.164139 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134ee56-797e-4ecd-811a-3a087d47198b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:34.164790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134ee56-797e-4ecd-811a-3a087d47198b admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:34.165106 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134ee56-797e-4ecd-811a-3a087d47198b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:34.174429 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134ee56-797e-4ecd-811a-3a087d47198b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:34.218594 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3065/6165] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:24:34.233046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255063c-5aba-4529-8f6b-ccba84fa5e00 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:34.234575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5255063c-5aba-4529-8f6b-ccba84fa5e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:34.241463 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3101/6166] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:24:34.249366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134ee56-797e-4ecd-811a-3a087d47198b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:34.297360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134ee56-797e-4ecd-811a-3a087d47198b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:34.342349 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9da4d7-b7fa-4517-a1de-b60139e077d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:34.347218 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9da4d7-b7fa-4517-a1de-b60139e077d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:34.347701 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9da4d7-b7fa-4517-a1de-b60139e077d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:34.349006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9da4d7-b7fa-4517-a1de-b60139e077d0 admin admin] PATH_INFO: `/v3/projects/224734bfc9a04a269c077e067abb4b87/users/6e53f7c3cf15472db2667105d238eaff/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:34.390625 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9da4d7-b7fa-4517-a1de-b60139e077d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=224734bfc9a04a269c077e067abb4b87, user_id=6e53f7c3cf15472db2667105d238eaff, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:34.396018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9da4d7-b7fa-4517-a1de-b60139e077d0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:34.419460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255063c-5aba-4529-8f6b-ccba84fa5e00 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:34.435390 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3102/6167] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:24:34 2022] PUT /identity/v3/projects/224734bfc9a04a269c077e067abb4b87/users/6e53f7c3cf15472db2667105d238eaff/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:34.436889 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421299cb-b87f-456b-9209-588ec0a14e10 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:34.437175 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421299cb-b87f-456b-9209-588ec0a14e10 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:34.437467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421299cb-b87f-456b-9209-588ec0a14e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:34.527049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-421299cb-b87f-456b-9209-588ec0a14e10 None None] MFA Rules not processed for user `6e53f7c3cf15472db2667105d238eaff`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:34.528402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-421299cb-b87f-456b-9209-588ec0a14e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:34.552625 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f454b14-c783-4165-b3c3-9b8c556753e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:34.553320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f454b14-c783-4165-b3c3-9b8c556753e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:34.553980 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f454b14-c783-4165-b3c3-9b8c556753e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:34.554263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f454b14-c783-4165-b3c3-9b8c556753e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:34.686918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f454b14-c783-4165-b3c3-9b8c556753e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:34.689423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f454b14-c783-4165-b3c3-9b8c556753e1 service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:34.709767 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3066/6168] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:24:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:24:34.710903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f454b14-c783-4165-b3c3-9b8c556753e1 service cinder] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:34.720885 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3103/6169] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:34.821841 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:34.866309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f454b14-c783-4165-b3c3-9b8c556753e1 service cinder] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:34.871829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be413625-59ca-46e6-9574-cf423c738bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:34.872455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be413625-59ca-46e6-9574-cf423c738bbd admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:34.872876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be413625-59ca-46e6-9574-cf423c738bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:34.873147 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be413625-59ca-46e6-9574-cf423c738bbd admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:34.873876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be413625-59ca-46e6-9574-cf423c738bbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:34.876410 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be413625-59ca-46e6-9574-cf423c738bbd admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:34.930739 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3067/6170] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:24:34 2022] POST /identity/v3/projects => generated 383 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:24:34.932642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421299cb-b87f-456b-9209-588ec0a14e10 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:34.956774 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421299cb-b87f-456b-9209-588ec0a14e10 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:35.138230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96ae24-aa63-4467-810d-f1939991c3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:35.138978 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96ae24-aa63-4467-810d-f1939991c3e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:35.139327 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96ae24-aa63-4467-810d-f1939991c3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:35.139672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96ae24-aa63-4467-810d-f1939991c3e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:35.140324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad96ae24-aa63-4467-810d-f1939991c3e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:35.142462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad96ae24-aa63-4467-810d-f1939991c3e3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:35.204339 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3104/6171] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:24:34 2022] POST /identity/v3/users => generated 298 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:24:35.205098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be413625-59ca-46e6-9574-cf423c738bbd admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:35.242035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be413625-59ca-46e6-9574-cf423c738bbd admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:35.259846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f21b84-2fab-4ccf-b4b9-de31dce61e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:35.261130 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f21b84-2fab-4ccf-b4b9-de31dce61e04 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:35.261413 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f21b84-2fab-4ccf-b4b9-de31dce61e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:35.261708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f21b84-2fab-4ccf-b4b9-de31dce61e04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:35.265011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f21b84-2fab-4ccf-b4b9-de31dce61e04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:35.271072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f21b84-2fab-4ccf-b4b9-de31dce61e04 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:35.305862 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3068/6172] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:24:35.307406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96ae24-aa63-4467-810d-f1939991c3e3 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:35.327283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96ae24-aa63-4467-810d-f1939991c3e3 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:35.346825 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1db26-f4ea-416b-b50e-a12a4e3d2e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:35.350076 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1db26-f4ea-416b-b50e-a12a4e3d2e94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:35.352927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1db26-f4ea-416b-b50e-a12a4e3d2e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:35.353631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1db26-f4ea-416b-b50e-a12a4e3d2e94 admin admin] PATH_INFO: `/v3/projects/51efdc3a819c4b5885ea1ea954764bf8/users/1febc08eb49040dc8526cf90a6605d94/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:35.432915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1db26-f4ea-416b-b50e-a12a4e3d2e94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51efdc3a819c4b5885ea1ea954764bf8, user_id=1febc08eb49040dc8526cf90a6605d94, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:35.449294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1db26-f4ea-416b-b50e-a12a4e3d2e94 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:35.499913 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3105/6173] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:24:35 2022] PUT /identity/v3/projects/51efdc3a819c4b5885ea1ea954764bf8/users/1febc08eb49040dc8526cf90a6605d94/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:35.502705 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f21b84-2fab-4ccf-b4b9-de31dce61e04 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:35.524326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f21b84-2fab-4ccf-b4b9-de31dce61e04 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:35.690732 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93134fc4-d1d1-4633-888f-45aea8d3a855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:35.691364 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93134fc4-d1d1-4633-888f-45aea8d3a855 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:35.691646 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93134fc4-d1d1-4633-888f-45aea8d3a855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:35.691922 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93134fc4-d1d1-4633-888f-45aea8d3a855 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:35.692580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93134fc4-d1d1-4633-888f-45aea8d3a855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:35.694235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93134fc4-d1d1-4633-888f-45aea8d3a855 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:35.715674 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3069/6174] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:24:35.720931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1db26-f4ea-416b-b50e-a12a4e3d2e94 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:35.728745 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:35.738078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1db26-f4ea-416b-b50e-a12a4e3d2e94 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:35.749814 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be77129-0e04-4d92-863a-3178ea1148be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:35.752371 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be77129-0e04-4d92-863a-3178ea1148be admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:35.753338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be77129-0e04-4d92-863a-3178ea1148be admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:35.753649 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be77129-0e04-4d92-863a-3178ea1148be admin admin] PATH_INFO: `/v3/projects/51efdc3a819c4b5885ea1ea954764bf8/users/1febc08eb49040dc8526cf90a6605d94/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:35.756402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be77129-0e04-4d92-863a-3178ea1148be admin admin] RBAC: Authorizing `identity:create_grant(project_id=51efdc3a819c4b5885ea1ea954764bf8, user_id=1febc08eb49040dc8526cf90a6605d94, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:35.759615 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be77129-0e04-4d92-863a-3178ea1148be admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:35.788416 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524f815-dbce-424a-a306-ca71b24bcf38 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:35.788663 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3106/6175] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:24:35 2022] PUT /identity/v3/projects/51efdc3a819c4b5885ea1ea954764bf8/users/1febc08eb49040dc8526cf90a6605d94/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:35.788764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524f815-dbce-424a-a306-ca71b24bcf38 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:35.788974 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524f815-dbce-424a-a306-ca71b24bcf38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:35.904918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e524f815-dbce-424a-a306-ca71b24bcf38 None None] MFA Rules not processed for user `1febc08eb49040dc8526cf90a6605d94`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:35.906435 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e524f815-dbce-424a-a306-ca71b24bcf38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:36.153965 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3070/6176] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:35 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:24:36.162798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be77129-0e04-4d92-863a-3178ea1148be admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:36.355645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be77129-0e04-4d92-863a-3178ea1148be admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:36.362126 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd87b6a-4fcf-4593-9765-971649bc2054 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:36.364986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd87b6a-4fcf-4593-9765-971649bc2054 service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:36.365603 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd87b6a-4fcf-4593-9765-971649bc2054 service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:36.366162 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd87b6a-4fcf-4593-9765-971649bc2054 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:36.599263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd87b6a-4fcf-4593-9765-971649bc2054 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:36.603922 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd87b6a-4fcf-4593-9765-971649bc2054 service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:36.632467 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3107/6177] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:24:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:24:38.838300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524f815-dbce-424a-a306-ca71b24bcf38 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:38.840352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e524f815-dbce-424a-a306-ca71b24bcf38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:38.914779 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:38.995821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524f815-dbce-424a-a306-ca71b24bcf38 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:39.028934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec67ec-74fb-49a8-b61d-ae703e378730 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:39.030300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec67ec-74fb-49a8-b61d-ae703e378730 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:39.034873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec67ec-74fb-49a8-b61d-ae703e378730 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:39.035524 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec67ec-74fb-49a8-b61d-ae703e378730 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:39.039645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-efec67ec-74fb-49a8-b61d-ae703e378730 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:39.308336 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec67ec-74fb-49a8-b61d-ae703e378730 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:39.310237 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec67ec-74fb-49a8-b61d-ae703e378730 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:39.362478 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3071/6178] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:24:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:24:39.881350 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd87b6a-4fcf-4593-9765-971649bc2054 service cinder] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:39.892173 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd87b6a-4fcf-4593-9765-971649bc2054 service cinder] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:39.902871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f289a-1b91-43df-b01f-88b92947cbe5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:39.903790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f289a-1b91-43df-b01f-88b92947cbe5 service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:39.905977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f289a-1b91-43df-b01f-88b92947cbe5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:39.906493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f289a-1b91-43df-b01f-88b92947cbe5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:40.052462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112f289a-1b91-43df-b01f-88b92947cbe5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:40.053961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112f289a-1b91-43df-b01f-88b92947cbe5 service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:40.072173 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3108/6179] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:24:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:24:41.274347 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec67ec-74fb-49a8-b61d-ae703e378730 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:41.288633 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec67ec-74fb-49a8-b61d-ae703e378730 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:41.299820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09be8af-4f10-428f-8b81-8c88484b2bad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:41.301612 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09be8af-4f10-428f-8b81-8c88484b2bad service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:41.302917 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09be8af-4f10-428f-8b81-8c88484b2bad service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:41.306292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09be8af-4f10-428f-8b81-8c88484b2bad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:41.331862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09be8af-4f10-428f-8b81-8c88484b2bad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:41.336270 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09be8af-4f10-428f-8b81-8c88484b2bad service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:41.379197 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3072/6180] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:24:41 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:24:45.122373 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f289a-1b91-43df-b01f-88b92947cbe5 service cinder] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:45.126927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-112f289a-1b91-43df-b01f-88b92947cbe5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:45.185145 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09be8af-4f10-428f-8b81-8c88484b2bad service cinder] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:45.186759 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a09be8af-4f10-428f-8b81-8c88484b2bad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:45.269707 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:45.347779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f289a-1b91-43df-b01f-88b92947cbe5 service cinder] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:45.354771 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19ea9f-1332-4ddf-be71-af1bfa43412e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:45.357580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19ea9f-1332-4ddf-be71-af1bfa43412e service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:45.357580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19ea9f-1332-4ddf-be71-af1bfa43412e service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:45.357580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19ea9f-1332-4ddf-be71-af1bfa43412e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:45.358487 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3a19ea9f-1332-4ddf-be71-af1bfa43412e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:45.369306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09be8af-4f10-428f-8b81-8c88484b2bad service cinder] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:45.379338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19ea9f-1332-4ddf-be71-af1bfa43412e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:45.381006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19ea9f-1332-4ddf-be71-af1bfa43412e service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:45.411920 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3109/6181] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:24:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:24:45.421853 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68524f43-a916-4662-b724-1e344e0acd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:45.422769 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68524f43-a916-4662-b724-1e344e0acd92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:45.423368 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68524f43-a916-4662-b724-1e344e0acd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:45.424093 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68524f43-a916-4662-b724-1e344e0acd92 admin admin] PATH_INFO: `/v3/users/8877696acd6f48aab094d921503b0672` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:45.425615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68524f43-a916-4662-b724-1e344e0acd92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8877696acd6f48aab094d921503b0672)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:45.428296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68524f43-a916-4662-b724-1e344e0acd92 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:45.594458 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-68524f43-a916-4662-b724-1e344e0acd92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8877696acd6f48aab094d921503b0672'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:45.595518 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-68524f43-a916-4662-b724-1e344e0acd92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8877696acd6f48aab094d921503b0672'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:45.615497 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-68524f43-a916-4662-b724-1e344e0acd92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8877696acd6f48aab094d921503b0672'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:45.640062 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-68524f43-a916-4662-b724-1e344e0acd92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8877696acd6f48aab094d921503b0672'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:45.640950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-68524f43-a916-4662-b724-1e344e0acd92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8877696acd6f48aab094d921503b0672'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:45.648204 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:45.733696 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3073/6182] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:24:45 2022] DELETE /identity/v3/users/8877696acd6f48aab094d921503b0672 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:24:45.739187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bbbcee-cb0e-4903-a960-7cc68482c536 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:45.739722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bbbcee-cb0e-4903-a960-7cc68482c536 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:45.740006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bbbcee-cb0e-4903-a960-7cc68482c536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:45.824707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-75bbbcee-cb0e-4903-a960-7cc68482c536 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:45.832450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-75bbbcee-cb0e-4903-a960-7cc68482c536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:46.030282 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3110/6183] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:46.045452 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68524f43-a916-4662-b724-1e344e0acd92 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:46.047114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-68524f43-a916-4662-b724-1e344e0acd92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:46.185420 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68524f43-a916-4662-b724-1e344e0acd92 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:46.192474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5404151-af77-45d0-add0-250172267894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:46.193109 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5404151-af77-45d0-add0-250172267894 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:46.193396 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5404151-af77-45d0-add0-250172267894 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:46.193724 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5404151-af77-45d0-add0-250172267894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:46.218507 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5404151-af77-45d0-add0-250172267894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:46.222647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5404151-af77-45d0-add0-250172267894 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:46.260470 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3074/6184] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:24:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:24:46.841767 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bbbcee-cb0e-4903-a960-7cc68482c536 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:46.846462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-75bbbcee-cb0e-4903-a960-7cc68482c536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:46.869899 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bbbcee-cb0e-4903-a960-7cc68482c536 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:46.875944 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11104855-7db7-43c3-a7ff-bdc1d5615439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:46.876803 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11104855-7db7-43c3-a7ff-bdc1d5615439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:46.877143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11104855-7db7-43c3-a7ff-bdc1d5615439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:46.877518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11104855-7db7-43c3-a7ff-bdc1d5615439 admin admin] PATH_INFO: `/v3/projects/9b8cf1ccc16a47049ddb0f97c5eea301` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:46.879477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11104855-7db7-43c3-a7ff-bdc1d5615439 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b8cf1ccc16a47049ddb0f97c5eea301)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:46.881915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11104855-7db7-43c3-a7ff-bdc1d5615439 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:47.004905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-11104855-7db7-43c3-a7ff-bdc1d5615439 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b8cf1ccc16a47049ddb0f97c5eea301', 'request_id': 'req-11104855-7db7-43c3-a7ff-bdc1d5615439'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:47.030360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-11104855-7db7-43c3-a7ff-bdc1d5615439 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b8cf1ccc16a47049ddb0f97c5eea301', 'request_id': 'req-11104855-7db7-43c3-a7ff-bdc1d5615439'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:47.045658 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-11104855-7db7-43c3-a7ff-bdc1d5615439 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b8cf1ccc16a47049ddb0f97c5eea301', 'request_id': 'req-11104855-7db7-43c3-a7ff-bdc1d5615439'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:47.088600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-11104855-7db7-43c3-a7ff-bdc1d5615439 admin admin] The token cache is being invalidate because project 9b8cf1ccc16a47049ddb0f97c5eea301 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:24:47.088899 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-11104855-7db7-43c3-a7ff-bdc1d5615439 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:47.089622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-11104855-7db7-43c3-a7ff-bdc1d5615439 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:47.091182 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3111/6185] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:24:46 2022] DELETE /identity/v3/projects/9b8cf1ccc16a47049ddb0f97c5eea301 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:47.096099 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f952e-0fed-4bab-8420-00c62c8749d8 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:47.096646 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f952e-0fed-4bab-8420-00c62c8749d8 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:47.097090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f952e-0fed-4bab-8420-00c62c8749d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:47.145978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-806f952e-0fed-4bab-8420-00c62c8749d8 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:47.147510 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-806f952e-0fed-4bab-8420-00c62c8749d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:47.327372 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3075/6186] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:47.443427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30a5e5-0122-4f2f-b8be-6db92d740112 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:47.443641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30a5e5-0122-4f2f-b8be-6db92d740112 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:47.443841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30a5e5-0122-4f2f-b8be-6db92d740112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:47.495479 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-4e30a5e5-0122-4f2f-b8be-6db92d740112 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:47.498164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4e30a5e5-0122-4f2f-b8be-6db92d740112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:47.521073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f952e-0fed-4bab-8420-00c62c8749d8 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:47.527540 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3112/6187] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:47.532869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f952e-0fed-4bab-8420-00c62c8749d8 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:47.544266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f7e62-259f-47c1-bfd5-e97b74146199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:47.545356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f7e62-259f-47c1-bfd5-e97b74146199 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:47.545951 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f7e62-259f-47c1-bfd5-e97b74146199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:47.546481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f7e62-259f-47c1-bfd5-e97b74146199 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:47.549371 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f7e62-259f-47c1-bfd5-e97b74146199 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:24:47.550075 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f7e62-259f-47c1-bfd5-e97b74146199 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:47.551931 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f7e62-259f-47c1-bfd5-e97b74146199 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:47.611243 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30a5e5-0122-4f2f-b8be-6db92d740112 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:47.623820 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3076/6188] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:24:47.635546 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30a5e5-0122-4f2f-b8be-6db92d740112 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:47.649822 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da67ce6-be33-48c5-bde0-bc8fa6180846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:47.650783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da67ce6-be33-48c5-bde0-bc8fa6180846 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:47.651285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da67ce6-be33-48c5-bde0-bc8fa6180846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:47.652915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da67ce6-be33-48c5-bde0-bc8fa6180846 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:47.654011 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da67ce6-be33-48c5-bde0-bc8fa6180846 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:47.664183 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da67ce6-be33-48c5-bde0-bc8fa6180846 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:47.770799 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3113/6189] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:24:47 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:24:47.771915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f7e62-259f-47c1-bfd5-e97b74146199 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:47.783624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f7e62-259f-47c1-bfd5-e97b74146199 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:47.865580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f463496-157a-4ea8-b2ed-b414600620c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:47.866428 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f463496-157a-4ea8-b2ed-b414600620c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:47.866810 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f463496-157a-4ea8-b2ed-b414600620c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:47.867185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f463496-157a-4ea8-b2ed-b414600620c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:47.867947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f463496-157a-4ea8-b2ed-b414600620c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:47.870032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f463496-157a-4ea8-b2ed-b414600620c8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:47.915942 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:47.926278 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da67ce6-be33-48c5-bde0-bc8fa6180846 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:47.935184 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3077/6190] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:24:47 2022] POST /identity/v3/users => generated 281 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:24:47.940116 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da67ce6-be33-48c5-bde0-bc8fa6180846 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:47.972782 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2366b7-856c-488a-abc8-b489bbb40d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:47.979336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2366b7-856c-488a-abc8-b489bbb40d8c admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:47.982465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2366b7-856c-488a-abc8-b489bbb40d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:47.982760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2366b7-856c-488a-abc8-b489bbb40d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:47.983453 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2366b7-856c-488a-abc8-b489bbb40d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:48.013248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2366b7-856c-488a-abc8-b489bbb40d8c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:48.062558 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3114/6191] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:24:48.064777 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f463496-157a-4ea8-b2ed-b414600620c8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:48.084482 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f463496-157a-4ea8-b2ed-b414600620c8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:48.103207 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3c706-857b-4c5b-b867-d019e4008d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:48.104139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3c706-857b-4c5b-b867-d019e4008d3e admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:48.111686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3c706-857b-4c5b-b867-d019e4008d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:48.112739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3c706-857b-4c5b-b867-d019e4008d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:48.116580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a3c706-857b-4c5b-b867-d019e4008d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:48.127811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a3c706-857b-4c5b-b867-d019e4008d3e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:48.171788 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3078/6192] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:24:48.172791 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2366b7-856c-488a-abc8-b489bbb40d8c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:48.193709 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2366b7-856c-488a-abc8-b489bbb40d8c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:48.229894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c3f12-163c-4f85-a935-c8219278a527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:48.229894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c3f12-163c-4f85-a935-c8219278a527 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:48.229894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c3f12-163c-4f85-a935-c8219278a527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:48.230211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c3f12-163c-4f85-a935-c8219278a527 admin admin] PATH_INFO: `/v3/projects/60636bdd3d8a49708dea4a3575cc43bd/users/bd742a8d889e4a41abcc7ab0e9f009e2/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:48.295812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c3f12-163c-4f85-a935-c8219278a527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60636bdd3d8a49708dea4a3575cc43bd, user_id=bd742a8d889e4a41abcc7ab0e9f009e2, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:48.301716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c3f12-163c-4f85-a935-c8219278a527 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:48.302475 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:48.318156 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3c706-857b-4c5b-b867-d019e4008d3e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:48.320408 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e3a3c706-857b-4c5b-b867-d019e4008d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:48.339895 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3115/6193] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:24:48 2022] PUT /identity/v3/projects/60636bdd3d8a49708dea4a3575cc43bd/users/bd742a8d889e4a41abcc7ab0e9f009e2/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:48.342336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa37dc-c715-4ada-921c-be1086172b8a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:48.342627 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa37dc-c715-4ada-921c-be1086172b8a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:48.342931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa37dc-c715-4ada-921c-be1086172b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:48.403537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-84fa37dc-c715-4ada-921c-be1086172b8a None None] MFA Rules not processed for user `bd742a8d889e4a41abcc7ab0e9f009e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:48.405269 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-84fa37dc-c715-4ada-921c-be1086172b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:48.574116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3c706-857b-4c5b-b867-d019e4008d3e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:48.684921 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a9fcf-61f9-481b-91d6-3f6c86cf6472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:48.684921 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a9fcf-61f9-481b-91d6-3f6c86cf6472 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:48.684921 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a9fcf-61f9-481b-91d6-3f6c86cf6472 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:48.684921 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a9fcf-61f9-481b-91d6-3f6c86cf6472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:48.697947 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3116/6194] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:24:48.707740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-513a9fcf-61f9-481b-91d6-3f6c86cf6472 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:48.837687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a9fcf-61f9-481b-91d6-3f6c86cf6472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:48.839162 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a9fcf-61f9-481b-91d6-3f6c86cf6472 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:48.873111 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3079/6195] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:24:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:24:48.874683 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa37dc-c715-4ada-921c-be1086172b8a None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:48.895024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa37dc-c715-4ada-921c-be1086172b8a None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:48.907544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52138dd-8542-4150-965a-d84164266f35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:48.908295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52138dd-8542-4150-965a-d84164266f35 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:48.908584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52138dd-8542-4150-965a-d84164266f35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:48.908866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52138dd-8542-4150-965a-d84164266f35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:48.932294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52138dd-8542-4150-965a-d84164266f35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:48.933828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52138dd-8542-4150-965a-d84164266f35 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:48.963450 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3117/6196] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:24:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:24:54.632031 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a9fcf-61f9-481b-91d6-3f6c86cf6472 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:54.634152 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-513a9fcf-61f9-481b-91d6-3f6c86cf6472 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:54.661934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a9fcf-61f9-481b-91d6-3f6c86cf6472 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:54.668428 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9914247-f1c6-44f8-b722-ba8efd70b4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:54.669342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9914247-f1c6-44f8-b722-ba8efd70b4e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:54.670307 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9914247-f1c6-44f8-b722-ba8efd70b4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:54.670784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9914247-f1c6-44f8-b722-ba8efd70b4e1 admin admin] PATH_INFO: `/v3/users/789ad235a087474f9f94bfe739f4430c` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:54.681659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9914247-f1c6-44f8-b722-ba8efd70b4e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=789ad235a087474f9f94bfe739f4430c)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:54.686313 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9914247-f1c6-44f8-b722-ba8efd70b4e1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:54.819094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c9914247-f1c6-44f8-b722-ba8efd70b4e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '789ad235a087474f9f94bfe739f4430c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:54.822146 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c9914247-f1c6-44f8-b722-ba8efd70b4e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '789ad235a087474f9f94bfe739f4430c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:54.832371 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:54.870375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c9914247-f1c6-44f8-b722-ba8efd70b4e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '789ad235a087474f9f94bfe739f4430c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:54.902960 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c9914247-f1c6-44f8-b722-ba8efd70b4e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '789ad235a087474f9f94bfe739f4430c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:54.903769 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c9914247-f1c6-44f8-b722-ba8efd70b4e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '789ad235a087474f9f94bfe739f4430c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:54.958130 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3080/6197] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:24:54 2022] DELETE /identity/v3/users/789ad235a087474f9f94bfe739f4430c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:54.963692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136ca72-5096-4c9a-9047-39c7d4db265f None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:54.965090 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136ca72-5096-4c9a-9047-39c7d4db265f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:54.965706 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136ca72-5096-4c9a-9047-39c7d4db265f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:55.019108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-2136ca72-5096-4c9a-9047-39c7d4db265f None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:55.020431 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2136ca72-5096-4c9a-9047-39c7d4db265f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:55.195133 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3118/6198] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:55.247002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9914247-f1c6-44f8-b722-ba8efd70b4e1 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:55.249010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c9914247-f1c6-44f8-b722-ba8efd70b4e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:55.490726 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9914247-f1c6-44f8-b722-ba8efd70b4e1 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:55.503295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f50ad-838f-4d19-84cf-4cbc379e0d78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:55.504084 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f50ad-838f-4d19-84cf-4cbc379e0d78 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:55.504475 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f50ad-838f-4d19-84cf-4cbc379e0d78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:55.505016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f50ad-838f-4d19-84cf-4cbc379e0d78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:55.547429 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f50ad-838f-4d19-84cf-4cbc379e0d78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:55.552420 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f50ad-838f-4d19-84cf-4cbc379e0d78 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:55.594464 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3081/6199] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:24:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:24:56.449959 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136ca72-5096-4c9a-9047-39c7d4db265f None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:56.451415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2136ca72-5096-4c9a-9047-39c7d4db265f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:56.480099 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136ca72-5096-4c9a-9047-39c7d4db265f None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:56.505014 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2e7b8-fc23-44a3-81ea-058bc09f3290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:56.505716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2e7b8-fc23-44a3-81ea-058bc09f3290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:56.505996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2e7b8-fc23-44a3-81ea-058bc09f3290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:56.506270 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2e7b8-fc23-44a3-81ea-058bc09f3290 admin admin] PATH_INFO: `/v3/users/ddd11882332f401d92366a6cde7137ae` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:56.507518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2e7b8-fc23-44a3-81ea-058bc09f3290 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddd11882332f401d92366a6cde7137ae)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:56.509479 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2e7b8-fc23-44a3-81ea-058bc09f3290 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:56.680124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-11e2e7b8-fc23-44a3-81ea-058bc09f3290 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddd11882332f401d92366a6cde7137ae'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:56.680829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-11e2e7b8-fc23-44a3-81ea-058bc09f3290 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddd11882332f401d92366a6cde7137ae'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:56.734911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-11e2e7b8-fc23-44a3-81ea-058bc09f3290 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddd11882332f401d92366a6cde7137ae'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:56.757561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-11e2e7b8-fc23-44a3-81ea-058bc09f3290 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddd11882332f401d92366a6cde7137ae'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:56.758204 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-11e2e7b8-fc23-44a3-81ea-058bc09f3290 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddd11882332f401d92366a6cde7137ae'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:56.760490 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:INSERT=2,keystone:SELECT=90,keystone:DELETE=8 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:56.797648 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3119/6200] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:24:56 2022] DELETE /identity/v3/users/ddd11882332f401d92366a6cde7137ae => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:56.803292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971bf8a-a95a-40ca-b4c4-4b28b6f0395d None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:56.803817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971bf8a-a95a-40ca-b4c4-4b28b6f0395d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:56.804113 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971bf8a-a95a-40ca-b4c4-4b28b6f0395d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:56.881008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-9971bf8a-a95a-40ca-b4c4-4b28b6f0395d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:56.885266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9971bf8a-a95a-40ca-b4c4-4b28b6f0395d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:57.162156 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3082/6201] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:57.239914 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2e7b8-fc23-44a3-81ea-058bc09f3290 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:57.241699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-11e2e7b8-fc23-44a3-81ea-058bc09f3290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:57.409210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2e7b8-fc23-44a3-81ea-058bc09f3290 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:57.422222 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761fbb2-a812-4b46-b784-34b72179c7ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:57.422859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761fbb2-a812-4b46-b784-34b72179c7ef service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:57.423140 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761fbb2-a812-4b46-b784-34b72179c7ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:57.423415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761fbb2-a812-4b46-b784-34b72179c7ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:57.444792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7761fbb2-a812-4b46-b784-34b72179c7ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:57.446271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7761fbb2-a812-4b46-b784-34b72179c7ef service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:57.473931 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3120/6202] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:24:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:24:58.752694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971bf8a-a95a-40ca-b4c4-4b28b6f0395d None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:58.754089 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9971bf8a-a95a-40ca-b4c4-4b28b6f0395d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:58.784198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971bf8a-a95a-40ca-b4c4-4b28b6f0395d None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:58.815104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c412027-69a3-4ec1-8687-39610a216708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:58.815823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c412027-69a3-4ec1-8687-39610a216708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:58.816110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c412027-69a3-4ec1-8687-39610a216708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:58.817846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c412027-69a3-4ec1-8687-39610a216708 admin admin] PATH_INFO: `/v3/projects/a5a001aca0e84fcf860c62adecb9429f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:58.820649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c412027-69a3-4ec1-8687-39610a216708 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5a001aca0e84fcf860c62adecb9429f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:58.822638 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c412027-69a3-4ec1-8687-39610a216708 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:58.989655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1c412027-69a3-4ec1-8687-39610a216708 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5a001aca0e84fcf860c62adecb9429f', 'request_id': 'req-1c412027-69a3-4ec1-8687-39610a216708'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:59.016524 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1c412027-69a3-4ec1-8687-39610a216708 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5a001aca0e84fcf860c62adecb9429f', 'request_id': 'req-1c412027-69a3-4ec1-8687-39610a216708'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:59.034784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1c412027-69a3-4ec1-8687-39610a216708 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5a001aca0e84fcf860c62adecb9429f', 'request_id': 'req-1c412027-69a3-4ec1-8687-39610a216708'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:59.036350 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:59.059703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1c412027-69a3-4ec1-8687-39610a216708 admin admin] The token cache is being invalidate because project a5a001aca0e84fcf860c62adecb9429f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:24:59.060964 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1c412027-69a3-4ec1-8687-39610a216708 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:59.062134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1c412027-69a3-4ec1-8687-39610a216708 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:59.066560 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3083/6203] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:24:58 2022] DELETE /identity/v3/projects/a5a001aca0e84fcf860c62adecb9429f => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:59.071976 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761fbb2-a812-4b46-b784-34b72179c7ef service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:59.084274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761fbb2-a812-4b46-b784-34b72179c7ef service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:59.207633 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c412027-69a3-4ec1-8687-39610a216708 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:59.209395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1c412027-69a3-4ec1-8687-39610a216708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:59.231605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e89ac-0c3d-4cb3-b405-47903b0aa94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:59.233287 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e89ac-0c3d-4cb3-b405-47903b0aa94b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:59.236353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e89ac-0c3d-4cb3-b405-47903b0aa94b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:59.236686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e89ac-0c3d-4cb3-b405-47903b0aa94b admin admin] PATH_INFO: `/v3/users/6e53f7c3cf15472db2667105d238eaff` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:59.240498 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e89ac-0c3d-4cb3-b405-47903b0aa94b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e53f7c3cf15472db2667105d238eaff)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:59.246203 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e89ac-0c3d-4cb3-b405-47903b0aa94b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:59.387854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-849e89ac-0c3d-4cb3-b405-47903b0aa94b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e53f7c3cf15472db2667105d238eaff'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:59.389935 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-849e89ac-0c3d-4cb3-b405-47903b0aa94b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e53f7c3cf15472db2667105d238eaff'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:59.405322 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c412027-69a3-4ec1-8687-39610a216708 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:59.416318 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705cd50a-cd05-4067-9b9b-e3372746981a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:59.417111 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cd50a-cd05-4067-9b9b-e3372746981a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:59.417396 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cd50a-cd05-4067-9b9b-e3372746981a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:59.417691 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cd50a-cd05-4067-9b9b-e3372746981a admin admin] PATH_INFO: `/v3/projects/d709a6ce4787415c82305f1f9136348c` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:59.418514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-849e89ac-0c3d-4cb3-b405-47903b0aa94b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e53f7c3cf15472db2667105d238eaff'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:59.421097 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705cd50a-cd05-4067-9b9b-e3372746981a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d709a6ce4787415c82305f1f9136348c)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:59.423122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705cd50a-cd05-4067-9b9b-e3372746981a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:24:59.446229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-849e89ac-0c3d-4cb3-b405-47903b0aa94b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e53f7c3cf15472db2667105d238eaff'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:59.448154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-849e89ac-0c3d-4cb3-b405-47903b0aa94b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e53f7c3cf15472db2667105d238eaff'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:59.508413 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3121/6204] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:24:59 2022] DELETE /identity/v3/users/6e53f7c3cf15472db2667105d238eaff => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:24:59.534185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-705cd50a-cd05-4067-9b9b-e3372746981a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd709a6ce4787415c82305f1f9136348c', 'request_id': 'req-705cd50a-cd05-4067-9b9b-e3372746981a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:59.561459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-705cd50a-cd05-4067-9b9b-e3372746981a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd709a6ce4787415c82305f1f9136348c', 'request_id': 'req-705cd50a-cd05-4067-9b9b-e3372746981a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:59.575386 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-705cd50a-cd05-4067-9b9b-e3372746981a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd709a6ce4787415c82305f1f9136348c', 'request_id': 'req-705cd50a-cd05-4067-9b9b-e3372746981a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:59.608034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-705cd50a-cd05-4067-9b9b-e3372746981a admin admin] The token cache is being invalidate because project d709a6ce4787415c82305f1f9136348c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:24:59.608326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-705cd50a-cd05-4067-9b9b-e3372746981a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:59.615263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-705cd50a-cd05-4067-9b9b-e3372746981a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:24:59.619014 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3084/6205] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:24:59 2022] DELETE /identity/v3/projects/d709a6ce4787415c82305f1f9136348c => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:24:59.623776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba9acf-a647-4618-a3df-e3cc2f6ffa37 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:59.624071 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba9acf-a647-4618-a3df-e3cc2f6ffa37 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:59.624351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba9acf-a647-4618-a3df-e3cc2f6ffa37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:59.645285 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:24:59.683872 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-88ba9acf-a647-4618-a3df-e3cc2f6ffa37 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:59.685339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-88ba9acf-a647-4618-a3df-e3cc2f6ffa37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:59.865216 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3122/6206] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:59.873342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7b85c-73ad-4c00-898b-b5c6441f2572 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:59.873936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7b85c-73ad-4c00-898b-b5c6441f2572 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:59.874062 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7b85c-73ad-4c00-898b-b5c6441f2572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:59.910946 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-63b7b85c-73ad-4c00-898b-b5c6441f2572 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:24:59.913033 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-63b7b85c-73ad-4c00-898b-b5c6441f2572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:24:59.939247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba9acf-a647-4618-a3df-e3cc2f6ffa37 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:24:59.947113 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3085/6207] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:24:59.959846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba9acf-a647-4618-a3df-e3cc2f6ffa37 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:24:59.965654 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da94c50-08d0-4f75-ab14-fc1a67292c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:24:59.966325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da94c50-08d0-4f75-ab14-fc1a67292c59 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:24:59.966621 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da94c50-08d0-4f75-ab14-fc1a67292c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:24:59.966897 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da94c50-08d0-4f75-ab14-fc1a67292c59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:24:59.967563 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da94c50-08d0-4f75-ab14-fc1a67292c59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:24:59.967871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da94c50-08d0-4f75-ab14-fc1a67292c59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:24:59.969634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da94c50-08d0-4f75-ab14-fc1a67292c59 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:25:00.005741 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3123/6208] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:25:00.010216 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7b85c-73ad-4c00-898b-b5c6441f2572 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:25:00.023758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7b85c-73ad-4c00-898b-b5c6441f2572 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:25:00.041660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b33fa-cb7b-4f7a-b994-3b0ecc8974d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:25:00.042435 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b33fa-cb7b-4f7a-b994-3b0ecc8974d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:00.042720 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b33fa-cb7b-4f7a-b994-3b0ecc8974d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:00.043007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b33fa-cb7b-4f7a-b994-3b0ecc8974d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:00.043645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b33fa-cb7b-4f7a-b994-3b0ecc8974d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:25:00.049844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b33fa-cb7b-4f7a-b994-3b0ecc8974d0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:25:00.223118 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3086/6209] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:25:00 2022] POST /identity/v3/projects => generated 373 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:25:00.228583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da94c50-08d0-4f75-ab14-fc1a67292c59 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:25:00.251706 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da94c50-08d0-4f75-ab14-fc1a67292c59 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:25:00.454278 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069d85f-6bd9-4481-a375-446dd6383bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:25:00.456511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069d85f-6bd9-4481-a375-446dd6383bbe admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:00.457142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069d85f-6bd9-4481-a375-446dd6383bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:00.457743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069d85f-6bd9-4481-a375-446dd6383bbe admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:00.459161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069d85f-6bd9-4481-a375-446dd6383bbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:25:00.468067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069d85f-6bd9-4481-a375-446dd6383bbe admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:25:00.510352 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3124/6210] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:25:00 2022] POST /identity/v3/users => generated 287 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:25:00.514869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b33fa-cb7b-4f7a-b994-3b0ecc8974d0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:25:00.536801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b33fa-cb7b-4f7a-b994-3b0ecc8974d0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:25:00.551319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef56ec-68d5-479b-866e-b2fe2ab962e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:25:00.553424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef56ec-68d5-479b-866e-b2fe2ab962e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:00.557804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef56ec-68d5-479b-866e-b2fe2ab962e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:00.559585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef56ec-68d5-479b-866e-b2fe2ab962e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:00.564654 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef56ec-68d5-479b-866e-b2fe2ab962e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:25:00.573338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef56ec-68d5-479b-866e-b2fe2ab962e3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:25:00.618046 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3087/6211] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:25:00 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:25:00.620451 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069d85f-6bd9-4481-a375-446dd6383bbe admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:25:00.636696 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069d85f-6bd9-4481-a375-446dd6383bbe admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:25:00.645916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c0827-3945-4b1a-a58a-859915f130db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:25:00.647438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c0827-3945-4b1a-a58a-859915f130db admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:00.648287 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c0827-3945-4b1a-a58a-859915f130db admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:00.648841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c0827-3945-4b1a-a58a-859915f130db admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:00.649851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c0827-3945-4b1a-a58a-859915f130db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:25:00.654283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c0827-3945-4b1a-a58a-859915f130db admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:25:00.680344 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef56ec-68d5-479b-866e-b2fe2ab962e3 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:25:00.688904 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3125/6212] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:25:00 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:25:00.700989 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef56ec-68d5-479b-866e-b2fe2ab962e3 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:25:00.725020 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa17cad-560e-465d-a9c2-a3a25b905168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:25:00.734071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa17cad-560e-465d-a9c2-a3a25b905168 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:00.736151 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa17cad-560e-465d-a9c2-a3a25b905168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:00.736624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa17cad-560e-465d-a9c2-a3a25b905168 admin admin] PATH_INFO: `/v3/projects/0f645c2372984102846875f1178d25bd/users/b39d22316a154afd90ff1887c72c10d8/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:00.771794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa17cad-560e-465d-a9c2-a3a25b905168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f645c2372984102846875f1178d25bd, user_id=b39d22316a154afd90ff1887c72c10d8, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:25:00.775183 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa17cad-560e-465d-a9c2-a3a25b905168 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:25:00.832139 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3088/6213] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:25:00 2022] PUT /identity/v3/projects/0f645c2372984102846875f1178d25bd/users/b39d22316a154afd90ff1887c72c10d8/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:25:00.844503 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c5a50-ff16-4f92-a0e1-a7b8afe46f05 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:00.844933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c5a50-ff16-4f92-a0e1-a7b8afe46f05 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:00.845325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c5a50-ff16-4f92-a0e1-a7b8afe46f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:00.920964 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-0f7c5a50-ff16-4f92-a0e1-a7b8afe46f05 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:25:00.930314 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0f7c5a50-ff16-4f92-a0e1-a7b8afe46f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:25:01.040238 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa17cad-560e-465d-a9c2-a3a25b905168 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:25:01.042255 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2fa17cad-560e-465d-a9c2-a3a25b905168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:25:01.100579 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:25:01.145819 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3126/6214] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:25:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:25:01.160816 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c5a50-ff16-4f92-a0e1-a7b8afe46f05 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:25:01.162858 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0f7c5a50-ff16-4f92-a0e1-a7b8afe46f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:25:01.189446 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:25:01.217906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa17cad-560e-465d-a9c2-a3a25b905168 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:25:01.233248 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8461d-e474-44a5-81f3-1430831931f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:25:01.233947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8461d-e474-44a5-81f3-1430831931f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:01.234307 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8461d-e474-44a5-81f3-1430831931f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:01.235146 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8461d-e474-44a5-81f3-1430831931f4 admin admin] PATH_INFO: `/v3/projects/224734bfc9a04a269c077e067abb4b87` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:01.237047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d8461d-e474-44a5-81f3-1430831931f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=224734bfc9a04a269c077e067abb4b87)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:25:01.239626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d8461d-e474-44a5-81f3-1430831931f4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:25:01.271008 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c5a50-ff16-4f92-a0e1-a7b8afe46f05 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:25:01.306797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f618f94-426c-4a2a-babe-774aade1a609 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:25:01.307450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f618f94-426c-4a2a-babe-774aade1a609 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:01.309292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f618f94-426c-4a2a-babe-774aade1a609 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:01.313577 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f618f94-426c-4a2a-babe-774aade1a609 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:01.338936 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f618f94-426c-4a2a-babe-774aade1a609 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:25:01.340944 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f618f94-426c-4a2a-babe-774aade1a609 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:25:01.365884 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-09d8461d-e474-44a5-81f3-1430831931f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '224734bfc9a04a269c077e067abb4b87', 'request_id': 'req-09d8461d-e474-44a5-81f3-1430831931f4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:25:01.377400 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3127/6215] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:25:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:25:01.393003 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-09d8461d-e474-44a5-81f3-1430831931f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '224734bfc9a04a269c077e067abb4b87', 'request_id': 'req-09d8461d-e474-44a5-81f3-1430831931f4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:25:01.412186 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-09d8461d-e474-44a5-81f3-1430831931f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '224734bfc9a04a269c077e067abb4b87', 'request_id': 'req-09d8461d-e474-44a5-81f3-1430831931f4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:25:01.459702 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-09d8461d-e474-44a5-81f3-1430831931f4 admin admin] The token cache is being invalidate because project 224734bfc9a04a269c077e067abb4b87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:25:01.460142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-09d8461d-e474-44a5-81f3-1430831931f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:25:01.460852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-09d8461d-e474-44a5-81f3-1430831931f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:25:01.466254 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3089/6216] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:25:01 2022] DELETE /identity/v3/projects/224734bfc9a04a269c077e067abb4b87 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:25:01.467387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f618f94-426c-4a2a-babe-774aade1a609 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:25:01.485591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f618f94-426c-4a2a-babe-774aade1a609 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:25:01.598899 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e30561-6335-4c96-a4d2-ba3494742482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:25:01.599559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e30561-6335-4c96-a4d2-ba3494742482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:01.599852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e30561-6335-4c96-a4d2-ba3494742482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:01.600148 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e30561-6335-4c96-a4d2-ba3494742482 admin admin] PATH_INFO: `/v3/users/1febc08eb49040dc8526cf90a6605d94` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:01.601368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e30561-6335-4c96-a4d2-ba3494742482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1febc08eb49040dc8526cf90a6605d94)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:25:01.603709 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e30561-6335-4c96-a4d2-ba3494742482 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:25:01.692406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-81e30561-6335-4c96-a4d2-ba3494742482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1febc08eb49040dc8526cf90a6605d94'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:25:01.693133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-81e30561-6335-4c96-a4d2-ba3494742482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1febc08eb49040dc8526cf90a6605d94'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:25:01.709210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-81e30561-6335-4c96-a4d2-ba3494742482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1febc08eb49040dc8526cf90a6605d94'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:25:01.737015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-81e30561-6335-4c96-a4d2-ba3494742482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1febc08eb49040dc8526cf90a6605d94'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:25:01.737702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-81e30561-6335-4c96-a4d2-ba3494742482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1febc08eb49040dc8526cf90a6605d94'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:25:01.776938 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3128/6217] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:25:01 2022] DELETE /identity/v3/users/1febc08eb49040dc8526cf90a6605d94 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:25:03.033573 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8461d-e474-44a5-81f3-1430831931f4 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:25:03.035884 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-09d8461d-e474-44a5-81f3-1430831931f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:25:03.072958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8461d-e474-44a5-81f3-1430831931f4 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:25:03.148313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e30561-6335-4c96-a4d2-ba3494742482 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:25:03.151068 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-81e30561-6335-4c96-a4d2-ba3494742482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:25:03.228506 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018bd74-0eff-42b6-98cc-1dfecfcca013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:25:03.229190 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018bd74-0eff-42b6-98cc-1dfecfcca013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:03.230656 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018bd74-0eff-42b6-98cc-1dfecfcca013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:03.231141 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018bd74-0eff-42b6-98cc-1dfecfcca013 admin admin] PATH_INFO: `/v3/users/6da5161f966c4d61b0c30e78829e5e1d` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:03.234875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018bd74-0eff-42b6-98cc-1dfecfcca013 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6da5161f966c4d61b0c30e78829e5e1d)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:25:03.240674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018bd74-0eff-42b6-98cc-1dfecfcca013 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:25:03.261511 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:25:03.345508 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9018bd74-0eff-42b6-98cc-1dfecfcca013 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6da5161f966c4d61b0c30e78829e5e1d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:25:03.346205 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9018bd74-0eff-42b6-98cc-1dfecfcca013 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6da5161f966c4d61b0c30e78829e5e1d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:25:03.360135 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:25:03.362689 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e30561-6335-4c96-a4d2-ba3494742482 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:25:03.372481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9018bd74-0eff-42b6-98cc-1dfecfcca013 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6da5161f966c4d61b0c30e78829e5e1d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:25:03.377729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7571b4-6099-4784-b64c-de6ad75e9b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:25:03.378641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7571b4-6099-4784-b64c-de6ad75e9b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:03.379012 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7571b4-6099-4784-b64c-de6ad75e9b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:03.379338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7571b4-6099-4784-b64c-de6ad75e9b77 admin admin] PATH_INFO: `/v3/projects/51efdc3a819c4b5885ea1ea954764bf8` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:03.382337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7571b4-6099-4784-b64c-de6ad75e9b77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51efdc3a819c4b5885ea1ea954764bf8)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:25:03.384668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7571b4-6099-4784-b64c-de6ad75e9b77 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:25:03.393682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9018bd74-0eff-42b6-98cc-1dfecfcca013 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6da5161f966c4d61b0c30e78829e5e1d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:25:03.394455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9018bd74-0eff-42b6-98cc-1dfecfcca013 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6da5161f966c4d61b0c30e78829e5e1d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:25:03.433362 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3090/6218] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:25:03 2022] DELETE /identity/v3/users/6da5161f966c4d61b0c30e78829e5e1d => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:25:03.464934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2c7571b4-6099-4784-b64c-de6ad75e9b77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51efdc3a819c4b5885ea1ea954764bf8', 'request_id': 'req-2c7571b4-6099-4784-b64c-de6ad75e9b77'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:25:03.491228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2c7571b4-6099-4784-b64c-de6ad75e9b77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51efdc3a819c4b5885ea1ea954764bf8', 'request_id': 'req-2c7571b4-6099-4784-b64c-de6ad75e9b77'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:25:03.500433 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2c7571b4-6099-4784-b64c-de6ad75e9b77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51efdc3a819c4b5885ea1ea954764bf8', 'request_id': 'req-2c7571b4-6099-4784-b64c-de6ad75e9b77'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:25:03.516359 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2c7571b4-6099-4784-b64c-de6ad75e9b77 admin admin] The token cache is being invalidate because project 51efdc3a819c4b5885ea1ea954764bf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:25:03.517234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2c7571b4-6099-4784-b64c-de6ad75e9b77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:25:03.518173 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2c7571b4-6099-4784-b64c-de6ad75e9b77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:25:03.521183 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3129/6219] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:25:03 2022] DELETE /identity/v3/projects/51efdc3a819c4b5885ea1ea954764bf8 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:25:03.526491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d25417-74b3-4d5b-98a4-d94b617a3395 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:03.527737 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d25417-74b3-4d5b-98a4-d94b617a3395 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:03.528264 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d25417-74b3-4d5b-98a4-d94b617a3395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:03.574001 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-97d25417-74b3-4d5b-98a4-d94b617a3395 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:25:03.575313 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-97d25417-74b3-4d5b-98a4-d94b617a3395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:25:03.712258 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3091/6220] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:25:03.722857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8eebe2-b0b4-465c-8ba8-3f439e43014b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:03.723467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8eebe2-b0b4-465c-8ba8-3f439e43014b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:03.723798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8eebe2-b0b4-465c-8ba8-3f439e43014b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:03.769901 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ab8eebe2-b0b4-465c-8ba8-3f439e43014b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:25:03.771391 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ab8eebe2-b0b4-465c-8ba8-3f439e43014b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:25:03.798604 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3130/6221] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:25:03.799909 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d25417-74b3-4d5b-98a4-d94b617a3395 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:25:03.813719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d25417-74b3-4d5b-98a4-d94b617a3395 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:25:03.826027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392c30c-7d44-4377-9586-d3666f1bc822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:25:03.826988 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392c30c-7d44-4377-9586-d3666f1bc822 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:03.827442 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392c30c-7d44-4377-9586-d3666f1bc822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:03.828457 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392c30c-7d44-4377-9586-d3666f1bc822 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:03.829609 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392c30c-7d44-4377-9586-d3666f1bc822 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:25:03.831249 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392c30c-7d44-4377-9586-d3666f1bc822 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:25:03.835840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392c30c-7d44-4377-9586-d3666f1bc822 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:25:03.882911 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3092/6222] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:25:03.887896 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8eebe2-b0b4-465c-8ba8-3f439e43014b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:25:03.924054 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8eebe2-b0b4-465c-8ba8-3f439e43014b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:25:03.941969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ec888-ff21-492f-aac1-75751ddd5e53 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:03.942563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ec888-ff21-492f-aac1-75751ddd5e53 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:03.943252 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ec888-ff21-492f-aac1-75751ddd5e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:03.950496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5683e34-742e-4e67-ba87-32d34ad1b2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:25:03.951155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5683e34-742e-4e67-ba87-32d34ad1b2d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:03.951446 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5683e34-742e-4e67-ba87-32d34ad1b2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:03.953702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5683e34-742e-4e67-ba87-32d34ad1b2d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:03.954474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5683e34-742e-4e67-ba87-32d34ad1b2d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:25:03.981456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5683e34-742e-4e67-ba87-32d34ad1b2d6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:25:04.028309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-926ec888-ff21-492f-aac1-75751ddd5e53 None None] MFA Rules not processed for user `b39d22316a154afd90ff1887c72c10d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:25:04.032299 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-926ec888-ff21-492f-aac1-75751ddd5e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:25:04.070521 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3131/6223] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:25:03 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:25:04.072871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5683e34-742e-4e67-ba87-32d34ad1b2d6 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:25:04.077659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a5683e34-742e-4e67-ba87-32d34ad1b2d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:25:04.167765 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3093/6224] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:25:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:25:04.169362 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ec888-ff21-492f-aac1-75751ddd5e53 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:25:04.190058 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ec888-ff21-492f-aac1-75751ddd5e53 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:25:04.224768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5683e34-742e-4e67-ba87-32d34ad1b2d6 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:25:04.237047 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3db8c2-9100-459e-b088-d89202437c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:25:04.241496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3db8c2-9100-459e-b088-d89202437c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:04.242528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3db8c2-9100-459e-b088-d89202437c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:04.243357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3db8c2-9100-459e-b088-d89202437c32 admin admin] PATH_INFO: `/v3/projects/f9beb76200ba4f1fbefc4033581f993f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:04.247394 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3db8c2-9100-459e-b088-d89202437c32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9beb76200ba4f1fbefc4033581f993f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:25:04.251789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3db8c2-9100-459e-b088-d89202437c32 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:25:04.263685 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:25:04.283356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b41829-3068-4635-b3fa-6231918183c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:25:04.284374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b41829-3068-4635-b3fa-6231918183c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:04.284924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b41829-3068-4635-b3fa-6231918183c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:04.285809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b41829-3068-4635-b3fa-6231918183c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:04.287315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b41829-3068-4635-b3fa-6231918183c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:25:04.290258 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b41829-3068-4635-b3fa-6231918183c0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:25:04.324451 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3094/6225] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:25:04 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:25:04.326066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b41829-3068-4635-b3fa-6231918183c0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:25:04.329415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-85b41829-3068-4635-b3fa-6231918183c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:25:04.336850 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:25:04.349757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2e3db8c2-9100-459e-b088-d89202437c32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9beb76200ba4f1fbefc4033581f993f', 'request_id': 'req-2e3db8c2-9100-459e-b088-d89202437c32'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:25:04.361937 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2e3db8c2-9100-459e-b088-d89202437c32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9beb76200ba4f1fbefc4033581f993f', 'request_id': 'req-2e3db8c2-9100-459e-b088-d89202437c32'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:25:04.369107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2e3db8c2-9100-459e-b088-d89202437c32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9beb76200ba4f1fbefc4033581f993f', 'request_id': 'req-2e3db8c2-9100-459e-b088-d89202437c32'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:25:04.383785 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2e3db8c2-9100-459e-b088-d89202437c32 admin admin] The token cache is being invalidate because project f9beb76200ba4f1fbefc4033581f993f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:25:04.384357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2e3db8c2-9100-459e-b088-d89202437c32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:25:04.385231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2e3db8c2-9100-459e-b088-d89202437c32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:25:04.387600 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3132/6226] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:25:04 2022] DELETE /identity/v3/projects/f9beb76200ba4f1fbefc4033581f993f => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:25:04.388726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3db8c2-9100-459e-b088-d89202437c32 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:25:04.390474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2e3db8c2-9100-459e-b088-d89202437c32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:25:04.411156 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b41829-3068-4635-b3fa-6231918183c0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:25:04.474726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3db8c2-9100-459e-b088-d89202437c32 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:25:04.495529 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f3330-c037-4f56-ac78-a8f2fc1add09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:25:04.496177 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f3330-c037-4f56-ac78-a8f2fc1add09 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:04.497738 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f3330-c037-4f56-ac78-a8f2fc1add09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:04.498299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f3330-c037-4f56-ac78-a8f2fc1add09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:04.499257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f3330-c037-4f56-ac78-a8f2fc1add09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:25:04.501793 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f3330-c037-4f56-ac78-a8f2fc1add09 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:25:04.515784 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3133/6227] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:25:04.518525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260f239-eb74-4b27-9910-421646b0ca2d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:04.519087 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260f239-eb74-4b27-9910-421646b0ca2d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:04.519710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260f239-eb74-4b27-9910-421646b0ca2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:04.530555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb85ea-e4e8-4c25-bcf5-74e946e3a445 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:25:04.531941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb85ea-e4e8-4c25-bcf5-74e946e3a445 service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:04.532229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb85ea-e4e8-4c25-bcf5-74e946e3a445 service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:04.532507 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb85ea-e4e8-4c25-bcf5-74e946e3a445 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:04.541229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e2cb85ea-e4e8-4c25-bcf5-74e946e3a445 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:25:04.550346 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-3260f239-eb74-4b27-9910-421646b0ca2d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:25:04.551759 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3260f239-eb74-4b27-9910-421646b0ca2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:25:04.570303 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3134/6228] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:25:04.571456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260f239-eb74-4b27-9910-421646b0ca2d None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:25:04.596625 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260f239-eb74-4b27-9910-421646b0ca2d None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:25:04.603715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad08d8a-b1b3-4672-926f-7bb9c848d543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:25:04.606350 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad08d8a-b1b3-4672-926f-7bb9c848d543 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:04.606994 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad08d8a-b1b3-4672-926f-7bb9c848d543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:04.607384 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad08d8a-b1b3-4672-926f-7bb9c848d543 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:04.608627 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad08d8a-b1b3-4672-926f-7bb9c848d543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:25:04.611329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad08d8a-b1b3-4672-926f-7bb9c848d543 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:25:04.630434 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3135/6229] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:25:04.630434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a53db-17a8-4a0f-96a6-5b568e0d4bef None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:04.630434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a53db-17a8-4a0f-96a6-5b568e0d4bef None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:04.630434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a53db-17a8-4a0f-96a6-5b568e0d4bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:04.658730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-838a53db-17a8-4a0f-96a6-5b568e0d4bef None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:25:04.661860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-838a53db-17a8-4a0f-96a6-5b568e0d4bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:25:04.682082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb85ea-e4e8-4c25-bcf5-74e946e3a445 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:25:04.683959 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3136/6230] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:25:04.685002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a53db-17a8-4a0f-96a6-5b568e0d4bef None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:25:04.685531 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb85ea-e4e8-4c25-bcf5-74e946e3a445 service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:25:04.706591 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3095/6231] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:25:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:25:04.708981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb85ea-e4e8-4c25-bcf5-74e946e3a445 service cinder] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:25:04.720281 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a53db-17a8-4a0f-96a6-5b568e0d4bef None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:25:04.724194 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb85ea-e4e8-4c25-bcf5-74e946e3a445 service cinder] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:25:04.731087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605304b9-f798-461f-bf19-e327e086ba52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:25:04.731989 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605304b9-f798-461f-bf19-e327e086ba52 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:04.732841 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605304b9-f798-461f-bf19-e327e086ba52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:04.733367 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605304b9-f798-461f-bf19-e327e086ba52 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:04.733895 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a3c32a-9ce3-4490-b185-134288b0aaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:25:04.735388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605304b9-f798-461f-bf19-e327e086ba52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:25:04.735569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3c32a-9ce3-4490-b185-134288b0aaa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:04.736009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3c32a-9ce3-4490-b185-134288b0aaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:04.736287 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605304b9-f798-461f-bf19-e327e086ba52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:25:04.736460 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3c32a-9ce3-4490-b185-134288b0aaa5 admin admin] PATH_INFO: `/v3/projects/eaa828c364924bd08fe55a25c93842d9/users/7e650cf5687c40379b9a85203f024cb5/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:04.739028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605304b9-f798-461f-bf19-e327e086ba52 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:25:04.754489 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3096/6232] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:25:04.755961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a3c32a-9ce3-4490-b185-134288b0aaa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaa828c364924bd08fe55a25c93842d9, user_id=7e650cf5687c40379b9a85203f024cb5, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:25:04.759088 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a3c32a-9ce3-4490-b185-134288b0aaa5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:25:04.760202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605304b9-f798-461f-bf19-e327e086ba52 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:25:04.783877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605304b9-f798-461f-bf19-e327e086ba52 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:25:04.795391 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3137/6233] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:25:04 2022] PUT /identity/v3/projects/eaa828c364924bd08fe55a25c93842d9/users/7e650cf5687c40379b9a85203f024cb5/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:25:04.800636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef262386-3bf4-4115-b3b8-4fe2daaec368 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:04.801016 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef262386-3bf4-4115-b3b8-4fe2daaec368 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:04.801393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef262386-3bf4-4115-b3b8-4fe2daaec368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:04.838814 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ef262386-3bf4-4115-b3b8-4fe2daaec368 None None] MFA Rules not processed for user `7e650cf5687c40379b9a85203f024cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:25:04.840446 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ef262386-3bf4-4115-b3b8-4fe2daaec368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:25:04.854193 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:25:04.937341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a240e-0d6e-4fee-8439-3afd79c31304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:25:04.943186 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a240e-0d6e-4fee-8439-3afd79c31304 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:04.948717 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a240e-0d6e-4fee-8439-3afd79c31304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:04.949008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a240e-0d6e-4fee-8439-3afd79c31304 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:04.955611 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a240e-0d6e-4fee-8439-3afd79c31304 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:25:04.962161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a240e-0d6e-4fee-8439-3afd79c31304 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:25:05.018671 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3138/6234] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:25:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:25:05.023707 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3097/6235] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:25:04 2022] POST /identity/v3/projects => generated 383 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:25:05.024368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef262386-3bf4-4115-b3b8-4fe2daaec368 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:25:05.032797 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:25:05.042434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef262386-3bf4-4115-b3b8-4fe2daaec368 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:25:05.143908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29354e22-b01f-4b5a-8beb-1aafcd88c3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:25:05.144718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29354e22-b01f-4b5a-8beb-1aafcd88c3aa admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:05.145004 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29354e22-b01f-4b5a-8beb-1aafcd88c3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:05.145276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29354e22-b01f-4b5a-8beb-1aafcd88c3aa admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:05.146008 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29354e22-b01f-4b5a-8beb-1aafcd88c3aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:25:05.148620 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29354e22-b01f-4b5a-8beb-1aafcd88c3aa admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:25:05.227783 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3139/6236] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:25:05 2022] POST /identity/v3/users => generated 292 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:25:05.231990 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a240e-0d6e-4fee-8439-3afd79c31304 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:25:05.256238 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a240e-0d6e-4fee-8439-3afd79c31304 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:25:05.258944 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29354e22-b01f-4b5a-8beb-1aafcd88c3aa admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:25:05.264163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-29354e22-b01f-4b5a-8beb-1aafcd88c3aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:25:05.284077 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d0cd0-a08a-48c0-b7a8-4dd1f192415a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:25:05.284926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d0cd0-a08a-48c0-b7a8-4dd1f192415a admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:05.285213 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d0cd0-a08a-48c0-b7a8-4dd1f192415a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:05.285515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d0cd0-a08a-48c0-b7a8-4dd1f192415a admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:05.286161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d0cd0-a08a-48c0-b7a8-4dd1f192415a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:25:05.288561 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d0cd0-a08a-48c0-b7a8-4dd1f192415a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:25:05.312622 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3098/6237] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:25:05.317887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d0cd0-a08a-48c0-b7a8-4dd1f192415a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:25:05.342527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d0cd0-a08a-48c0-b7a8-4dd1f192415a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:25:05.355566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3391d-dbbc-4844-bcb8-592befa47c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:25:05.356198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3391d-dbbc-4844-bcb8-592befa47c50 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:05.356473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3391d-dbbc-4844-bcb8-592befa47c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:05.356743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3391d-dbbc-4844-bcb8-592befa47c50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:05.357392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3391d-dbbc-4844-bcb8-592befa47c50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:25:05.360994 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3391d-dbbc-4844-bcb8-592befa47c50 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:25:05.407909 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3099/6238] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:25:05.410859 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3391d-dbbc-4844-bcb8-592befa47c50 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:25:05.428621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3391d-dbbc-4844-bcb8-592befa47c50 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:25:05.433689 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29354e22-b01f-4b5a-8beb-1aafcd88c3aa admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:25:05.434909 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700a448-481d-444d-91d3-178f716d8e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:25:05.435592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700a448-481d-444d-91d3-178f716d8e18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:05.435940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700a448-481d-444d-91d3-178f716d8e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:05.436217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700a448-481d-444d-91d3-178f716d8e18 admin admin] PATH_INFO: `/v3/projects/9a8bafab6be64fe1be010e4385039b09/users/3734668c07164b759f9084fdcccf7d36/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:05.457298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700a448-481d-444d-91d3-178f716d8e18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a8bafab6be64fe1be010e4385039b09, user_id=3734668c07164b759f9084fdcccf7d36, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:25:05.459359 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703112f5-d638-40b3-9b26-521b166cf9aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:25:05.459982 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700a448-481d-444d-91d3-178f716d8e18 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:25:05.460648 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703112f5-d638-40b3-9b26-521b166cf9aa service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:05.461133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703112f5-d638-40b3-9b26-521b166cf9aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:05.461747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703112f5-d638-40b3-9b26-521b166cf9aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:05.485580 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3100/6239] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:25:05 2022] PUT /identity/v3/projects/9a8bafab6be64fe1be010e4385039b09/users/3734668c07164b759f9084fdcccf7d36/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:25:05.487843 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcecab-b882-4702-99d3-f3c811f29e9e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:05.488391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcecab-b882-4702-99d3-f3c811f29e9e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:05.488669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcecab-b882-4702-99d3-f3c811f29e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:05.517064 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-ebfcecab-b882-4702-99d3-f3c811f29e9e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:25:05.518579 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ebfcecab-b882-4702-99d3-f3c811f29e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:25:05.641299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703112f5-d638-40b3-9b26-521b166cf9aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:25:05.644882 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703112f5-d638-40b3-9b26-521b166cf9aa service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:25:05.661743 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3140/6240] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:25:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:25:05.703520 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3101/6241] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:25:05.723934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703112f5-d638-40b3-9b26-521b166cf9aa service cinder] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:25:05.726749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-703112f5-d638-40b3-9b26-521b166cf9aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:25:05.803587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfcecab-b882-4702-99d3-f3c811f29e9e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:25:05.805304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ebfcecab-b882-4702-99d3-f3c811f29e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:25:05.889950 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:25:05.909284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703112f5-d638-40b3-9b26-521b166cf9aa service cinder] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:25:05.989834 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfcecab-b882-4702-99d3-f3c811f29e9e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:25:06.000429 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e33a240-1ed8-45e0-9f17-116e5fbe7bd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:25:06.001412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33a240-1ed8-45e0-9f17-116e5fbe7bd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:06.002597 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33a240-1ed8-45e0-9f17-116e5fbe7bd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:06.002941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33a240-1ed8-45e0-9f17-116e5fbe7bd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:06.023218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0e33a240-1ed8-45e0-9f17-116e5fbe7bd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:25:06.088920 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:25:06.111051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d81900-69ab-4eb1-843d-1c7c8d84b761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:25:06.112743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d81900-69ab-4eb1-843d-1c7c8d84b761 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:06.113525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d81900-69ab-4eb1-843d-1c7c8d84b761 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:06.114031 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d81900-69ab-4eb1-843d-1c7c8d84b761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:06.138265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d81900-69ab-4eb1-843d-1c7c8d84b761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:25:06.140048 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d81900-69ab-4eb1-843d-1c7c8d84b761 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:25:06.160604 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3141/6242] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:25:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:25:06.217022 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e33a240-1ed8-45e0-9f17-116e5fbe7bd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:25:06.225265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e33a240-1ed8-45e0-9f17-116e5fbe7bd6 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:25:06.265846 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3102/6243] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:25:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:25:07.739781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d81900-69ab-4eb1-843d-1c7c8d84b761 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:25:07.752570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d81900-69ab-4eb1-843d-1c7c8d84b761 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:25:07.768467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e36a20-783c-475d-8657-216fe3de2bad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:25:07.769106 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e36a20-783c-475d-8657-216fe3de2bad service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:07.769389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e36a20-783c-475d-8657-216fe3de2bad service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:07.769692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e36a20-783c-475d-8657-216fe3de2bad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:07.778641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-86e36a20-783c-475d-8657-216fe3de2bad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:25:07.812608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e36a20-783c-475d-8657-216fe3de2bad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:25:07.814553 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e36a20-783c-475d-8657-216fe3de2bad service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:25:07.841089 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3142/6244] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:25:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:25:08.077522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b620560-b3bc-46cd-84d5-ae4e3f138648 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:08.077522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b620560-b3bc-46cd-84d5-ae4e3f138648 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:08.077522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b620560-b3bc-46cd-84d5-ae4e3f138648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:08.360221 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5b620560-b3bc-46cd-84d5-ae4e3f138648 None None] MFA Rules not processed for user `bfd3e634551940cea7c8e492c7d8b79b`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:25:08.361638 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5b620560-b3bc-46cd-84d5-ae4e3f138648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:25:08.461533 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3103/6245] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:25:08 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:25:08.964409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ea679-cb8a-4355-a565-ad67fe032cca None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:08.965353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ea679-cb8a-4355-a565-ad67fe032cca None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:08.966818 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ea679-cb8a-4355-a565-ad67fe032cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:09.000142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-db4ea679-cb8a-4355-a565-ad67fe032cca None None] MFA Rules not processed for user `b39d22316a154afd90ff1887c72c10d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:25:09.002775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-db4ea679-cb8a-4355-a565-ad67fe032cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:25:09.174889 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3143/6246] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:25:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:25:15.007390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b620560-b3bc-46cd-84d5-ae4e3f138648 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:25:15.029343 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b620560-b3bc-46cd-84d5-ae4e3f138648 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:25:15.045102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5fff0-907a-4657-b48e-930494d7ebee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:25:15.049048 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5fff0-907a-4657-b48e-930494d7ebee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:15.051392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5fff0-907a-4657-b48e-930494d7ebee admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:15.053009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5fff0-907a-4657-b48e-930494d7ebee admin admin] PATH_INFO: `/v3/users/7e650cf5687c40379b9a85203f024cb5` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:15.057143 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5fff0-907a-4657-b48e-930494d7ebee admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e650cf5687c40379b9a85203f024cb5)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:25:15.059412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5fff0-907a-4657-b48e-930494d7ebee admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:25:15.184820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d5e5fff0-907a-4657-b48e-930494d7ebee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e650cf5687c40379b9a85203f024cb5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:25:15.186007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d5e5fff0-907a-4657-b48e-930494d7ebee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e650cf5687c40379b9a85203f024cb5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:25:15.204764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d5e5fff0-907a-4657-b48e-930494d7ebee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e650cf5687c40379b9a85203f024cb5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:25:15.228411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d5e5fff0-907a-4657-b48e-930494d7ebee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e650cf5687c40379b9a85203f024cb5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:25:15.229394 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d5e5fff0-907a-4657-b48e-930494d7ebee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e650cf5687c40379b9a85203f024cb5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:25:15.288542 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3104/6247] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:25:15 2022] DELETE /identity/v3/users/7e650cf5687c40379b9a85203f024cb5 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:25:15.289865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7594b4a-abaf-4e4b-81ff-48bf11b3d9c2 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:15.290421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7594b4a-abaf-4e4b-81ff-48bf11b3d9c2 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:15.290628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7594b4a-abaf-4e4b-81ff-48bf11b3d9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:15.359976 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c7594b4a-abaf-4e4b-81ff-48bf11b3d9c2 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:25:15.370556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c7594b4a-abaf-4e4b-81ff-48bf11b3d9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:25:15.622192 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3144/6248] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:25:16.019411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5fff0-907a-4657-b48e-930494d7ebee admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:25:16.021041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d5e5fff0-907a-4657-b48e-930494d7ebee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:25:16.137981 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:25:16.197259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5fff0-907a-4657-b48e-930494d7ebee admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:25:16.214858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c08bd-5a5e-49f3-91b3-61229c3db87c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:25:16.221036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c08bd-5a5e-49f3-91b3-61229c3db87c service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:16.223654 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c08bd-5a5e-49f3-91b3-61229c3db87c service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:16.224031 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c08bd-5a5e-49f3-91b3-61229c3db87c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:16.259886 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c08bd-5a5e-49f3-91b3-61229c3db87c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:25:16.266589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c08bd-5a5e-49f3-91b3-61229c3db87c service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:25:16.299292 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3105/6249] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:25:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:25:18.814330 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7594b4a-abaf-4e4b-81ff-48bf11b3d9c2 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:25:18.815887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c7594b4a-abaf-4e4b-81ff-48bf11b3d9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:25:18.851858 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7594b4a-abaf-4e4b-81ff-48bf11b3d9c2 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:25:18.866902 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc3fd8-e211-4e90-b613-3f710f0783ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:25:18.867652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc3fd8-e211-4e90-b613-3f710f0783ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:18.868040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc3fd8-e211-4e90-b613-3f710f0783ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:18.868441 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc3fd8-e211-4e90-b613-3f710f0783ba admin admin] PATH_INFO: `/v3/projects/eaa828c364924bd08fe55a25c93842d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:18.869817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc3fd8-e211-4e90-b613-3f710f0783ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaa828c364924bd08fe55a25c93842d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:25:18.872125 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc3fd8-e211-4e90-b613-3f710f0783ba admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:25:18.961876 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:25:19.021922 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b9cc3fd8-e211-4e90-b613-3f710f0783ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaa828c364924bd08fe55a25c93842d9', 'request_id': 'req-b9cc3fd8-e211-4e90-b613-3f710f0783ba'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:25:19.052547 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b9cc3fd8-e211-4e90-b613-3f710f0783ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaa828c364924bd08fe55a25c93842d9', 'request_id': 'req-b9cc3fd8-e211-4e90-b613-3f710f0783ba'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:25:19.111099 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b9cc3fd8-e211-4e90-b613-3f710f0783ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaa828c364924bd08fe55a25c93842d9', 'request_id': 'req-b9cc3fd8-e211-4e90-b613-3f710f0783ba'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:25:19.176587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b9cc3fd8-e211-4e90-b613-3f710f0783ba admin admin] The token cache is being invalidate because project eaa828c364924bd08fe55a25c93842d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:25:19.176829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b9cc3fd8-e211-4e90-b613-3f710f0783ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:25:19.184582 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b9cc3fd8-e211-4e90-b613-3f710f0783ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:25:19.194071 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3145/6250] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:25:18 2022] DELETE /identity/v3/projects/eaa828c364924bd08fe55a25c93842d9 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:25:24.021390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dba663-99c3-447f-a8bc-ce13badef922 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:24.021889 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dba663-99c3-447f-a8bc-ce13badef922 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:24.021984 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dba663-99c3-447f-a8bc-ce13badef922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:24.054529 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d8dba663-99c3-447f-a8bc-ce13badef922 None None] MFA Rules not processed for user `3734668c07164b759f9084fdcccf7d36`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:25:24.056130 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d8dba663-99c3-447f-a8bc-ce13badef922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:25:24.129225 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3106/6251] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:25:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:25:24.440894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc3fd8-e211-4e90-b613-3f710f0783ba admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:25:24.442439 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b9cc3fd8-e211-4e90-b613-3f710f0783ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:25:24.619407 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc3fd8-e211-4e90-b613-3f710f0783ba admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:25:24.633856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3470d66-96ca-4530-8459-06cd3198f282 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:25:24.634806 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3470d66-96ca-4530-8459-06cd3198f282 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:24.645960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3470d66-96ca-4530-8459-06cd3198f282 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:24.650186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3470d66-96ca-4530-8459-06cd3198f282 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:24.659407 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3470d66-96ca-4530-8459-06cd3198f282 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:25:24.666641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3470d66-96ca-4530-8459-06cd3198f282 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:25:24.696792 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3146/6252] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:25:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:25:27.748772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3d175-1325-401d-b53e-7dbcc2d17669 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:27.749635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3d175-1325-401d-b53e-7dbcc2d17669 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:27.750172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3d175-1325-401d-b53e-7dbcc2d17669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:27.786182 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-1dc3d175-1325-401d-b53e-7dbcc2d17669 None None] MFA Rules not processed for user `3734668c07164b759f9084fdcccf7d36`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:25:27.788165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1dc3d175-1325-401d-b53e-7dbcc2d17669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:25:27.803513 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3107/6253] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:25:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:25:33.131886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3470d66-96ca-4530-8459-06cd3198f282 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:25:33.134231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a3470d66-96ca-4530-8459-06cd3198f282 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:25:33.236657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3470d66-96ca-4530-8459-06cd3198f282 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:25:33.256077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506acbd8-ad4c-41d4-8a5d-ea577b416b0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:25:33.258027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506acbd8-ad4c-41d4-8a5d-ea577b416b0c service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:33.258569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506acbd8-ad4c-41d4-8a5d-ea577b416b0c service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:33.259017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506acbd8-ad4c-41d4-8a5d-ea577b416b0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:33.262200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-506acbd8-ad4c-41d4-8a5d-ea577b416b0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:25:33.390485 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:25:33.410466 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506acbd8-ad4c-41d4-8a5d-ea577b416b0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:25:33.416524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506acbd8-ad4c-41d4-8a5d-ea577b416b0c service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:25:33.459609 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3147/6254] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:25:33 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:25:37.772467 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=47 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:25:40.881776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a320fd6-8ed8-4560-b944-75b1cbcbfc8d None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:40.881776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a320fd6-8ed8-4560-b944-75b1cbcbfc8d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:40.881776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a320fd6-8ed8-4560-b944-75b1cbcbfc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:40.909580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-1a320fd6-8ed8-4560-b944-75b1cbcbfc8d None None] MFA Rules not processed for user `b39d22316a154afd90ff1887c72c10d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:25:40.912828 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1a320fd6-8ed8-4560-b944-75b1cbcbfc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:25:40.950602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f9131-4c11-4c60-94e0-14e1776f081e None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:40.951638 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f9131-4c11-4c60-94e0-14e1776f081e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:40.952133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f9131-4c11-4c60-94e0-14e1776f081e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:40.988697 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-4c3f9131-4c11-4c60-94e0-14e1776f081e None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:25:40.991774 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4c3f9131-4c11-4c60-94e0-14e1776f081e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:25:41.088428 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3108/6255] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:25:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:25:41.143966 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3148/6256] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:25:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:25:41.208413 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a320fd6-8ed8-4560-b944-75b1cbcbfc8d None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:25:41.210239 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1a320fd6-8ed8-4560-b944-75b1cbcbfc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:25:41.363314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a320fd6-8ed8-4560-b944-75b1cbcbfc8d None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:25:41.379220 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112652d-83a1-4ec3-a59e-39e9aec0fb0b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:25:41.379998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112652d-83a1-4ec3-a59e-39e9aec0fb0b service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:41.380378 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112652d-83a1-4ec3-a59e-39e9aec0fb0b service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:41.380748 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112652d-83a1-4ec3-a59e-39e9aec0fb0b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:41.397605 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112652d-83a1-4ec3-a59e-39e9aec0fb0b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:25:41.399635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112652d-83a1-4ec3-a59e-39e9aec0fb0b service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:25:41.416966 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3109/6257] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:25:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:25:51.027824 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f9131-4c11-4c60-94e0-14e1776f081e None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:25:51.029290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4c3f9131-4c11-4c60-94e0-14e1776f081e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:25:51.273143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f9131-4c11-4c60-94e0-14e1776f081e None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:25:51.279858 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb6dca-1879-47c0-81a0-ae1172ceb592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:25:51.280573 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb6dca-1879-47c0-81a0-ae1172ceb592 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:51.280930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb6dca-1879-47c0-81a0-ae1172ceb592 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:51.281280 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb6dca-1879-47c0-81a0-ae1172ceb592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:51.289086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b7cb6dca-1879-47c0-81a0-ae1172ceb592 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:25:51.318755 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb6dca-1879-47c0-81a0-ae1172ceb592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:25:51.320575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb6dca-1879-47c0-81a0-ae1172ceb592 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:25:51.345941 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3149/6258] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:25:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:25:51.411662 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=57 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:25:51.598812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112652d-83a1-4ec3-a59e-39e9aec0fb0b service swift] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:25:51.617313 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112652d-83a1-4ec3-a59e-39e9aec0fb0b service swift] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:25:51.631336 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbb2c0-b787-461c-91cf-c19e364c978a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:25:51.632071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbb2c0-b787-461c-91cf-c19e364c978a service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:51.633640 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbb2c0-b787-461c-91cf-c19e364c978a service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:51.634141 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbb2c0-b787-461c-91cf-c19e364c978a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:51.641038 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6abbb2c0-b787-461c-91cf-c19e364c978a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:25:51.679961 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abbb2c0-b787-461c-91cf-c19e364c978a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:25:51.682415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abbb2c0-b787-461c-91cf-c19e364c978a service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:25:51.726122 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3110/6259] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:25:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:25:51.936120 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb6dca-1879-47c0-81a0-ae1172ceb592 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:25:51.956710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb6dca-1879-47c0-81a0-ae1172ceb592 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:25:51.968254 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab72d6-1082-48c3-9fa8-d9db71b919be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:25:51.969279 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab72d6-1082-48c3-9fa8-d9db71b919be service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:25:51.969728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab72d6-1082-48c3-9fa8-d9db71b919be service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:25:51.971019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab72d6-1082-48c3-9fa8-d9db71b919be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:25:51.977554 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e3ab72d6-1082-48c3-9fa8-d9db71b919be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:25:52.028712 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab72d6-1082-48c3-9fa8-d9db71b919be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:25:52.030252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab72d6-1082-48c3-9fa8-d9db71b919be service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:25:52.054876 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3150/6260] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:25:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:26:00.203699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbb2c0-b787-461c-91cf-c19e364c978a service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:00.206712 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6abbb2c0-b787-461c-91cf-c19e364c978a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:00.235480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbb2c0-b787-461c-91cf-c19e364c978a service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:00.242720 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f380185-9900-40ed-9838-d6eeb788df2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:00.243351 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f380185-9900-40ed-9838-d6eeb788df2d service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:00.243633 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f380185-9900-40ed-9838-d6eeb788df2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:00.247247 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f380185-9900-40ed-9838-d6eeb788df2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:00.252299 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8f380185-9900-40ed-9838-d6eeb788df2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:00.494413 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f380185-9900-40ed-9838-d6eeb788df2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:00.495874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f380185-9900-40ed-9838-d6eeb788df2d service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:00.544460 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3111/6261] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:26:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:26:02.045182 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=59 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:26:04.209664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab72d6-1082-48c3-9fa8-d9db71b919be service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:04.230719 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab72d6-1082-48c3-9fa8-d9db71b919be service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:04.254105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ce9b4-a554-43f1-964f-9eb950c71851 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:04.254975 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ce9b4-a554-43f1-964f-9eb950c71851 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:04.255255 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ce9b4-a554-43f1-964f-9eb950c71851 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:04.255826 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ce9b4-a554-43f1-964f-9eb950c71851 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:04.263103 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-223ce9b4-a554-43f1-964f-9eb950c71851 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:04.300164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ce9b4-a554-43f1-964f-9eb950c71851 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:04.302396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ce9b4-a554-43f1-964f-9eb950c71851 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:04.304710 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f380185-9900-40ed-9838-d6eeb788df2d service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:04.307010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8f380185-9900-40ed-9838-d6eeb788df2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:04.324248 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3151/6262] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:26:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:26:04.475318 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f380185-9900-40ed-9838-d6eeb788df2d service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:04.499165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbcde5c-5685-4431-9ca2-88496413fe2c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:04.502120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcde5c-5685-4431-9ca2-88496413fe2c service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:04.502608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcde5c-5685-4431-9ca2-88496413fe2c service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:04.503077 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcde5c-5685-4431-9ca2-88496413fe2c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:04.509145 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6dbcde5c-5685-4431-9ca2-88496413fe2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:04.545394 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbcde5c-5685-4431-9ca2-88496413fe2c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:04.547579 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbcde5c-5685-4431-9ca2-88496413fe2c service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:04.574169 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3112/6263] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:26:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:26:07.575024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ce9b4-a554-43f1-964f-9eb950c71851 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:07.577040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-223ce9b4-a554-43f1-964f-9eb950c71851 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:07.607301 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ce9b4-a554-43f1-964f-9eb950c71851 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:07.624739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee2bdd-e14a-47af-beaf-8dc73db06992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:07.625410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee2bdd-e14a-47af-beaf-8dc73db06992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:07.625725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee2bdd-e14a-47af-beaf-8dc73db06992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:07.626002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee2bdd-e14a-47af-beaf-8dc73db06992 admin admin] PATH_INFO: `/v3/users/bd742a8d889e4a41abcc7ab0e9f009e2` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:07.629050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee2bdd-e14a-47af-beaf-8dc73db06992 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd742a8d889e4a41abcc7ab0e9f009e2)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:07.631056 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee2bdd-e14a-47af-beaf-8dc73db06992 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:07.756698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fdee2bdd-e14a-47af-beaf-8dc73db06992 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd742a8d889e4a41abcc7ab0e9f009e2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:07.759013 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fdee2bdd-e14a-47af-beaf-8dc73db06992 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd742a8d889e4a41abcc7ab0e9f009e2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:07.805369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbcde5c-5685-4431-9ca2-88496413fe2c service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:07.807178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6dbcde5c-5685-4431-9ca2-88496413fe2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:07.812931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fdee2bdd-e14a-47af-beaf-8dc73db06992 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd742a8d889e4a41abcc7ab0e9f009e2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:07.843765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fdee2bdd-e14a-47af-beaf-8dc73db06992 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd742a8d889e4a41abcc7ab0e9f009e2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:07.850079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fdee2bdd-e14a-47af-beaf-8dc73db06992 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd742a8d889e4a41abcc7ab0e9f009e2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:07.862134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbcde5c-5685-4431-9ca2-88496413fe2c service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:07.885624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6365231-cf62-495e-a5ec-1ccb9e3bfb4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:07.896279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6365231-cf62-495e-a5ec-1ccb9e3bfb4a service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:07.898090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6365231-cf62-495e-a5ec-1ccb9e3bfb4a service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:07.899303 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6365231-cf62-495e-a5ec-1ccb9e3bfb4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:07.904995 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e6365231-cf62-495e-a5ec-1ccb9e3bfb4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:07.924561 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3152/6264] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:26:07 2022] DELETE /identity/v3/users/bd742a8d889e4a41abcc7ab0e9f009e2 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:26:07.926040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fa9a8-43dc-49b9-aeb9-50c40bcb3340 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:07.928451 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fa9a8-43dc-49b9-aeb9-50c40bcb3340 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:07.928797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fa9a8-43dc-49b9-aeb9-50c40bcb3340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:07.958672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6365231-cf62-495e-a5ec-1ccb9e3bfb4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:07.960614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6365231-cf62-495e-a5ec-1ccb9e3bfb4a service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:07.972726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-085fa9a8-43dc-49b9-aeb9-50c40bcb3340 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:26:07.977859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-085fa9a8-43dc-49b9-aeb9-50c40bcb3340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:07.993303 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3113/6265] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:26:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:26:08.163698 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3153/6266] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:26:08.174954 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6365231-cf62-495e-a5ec-1ccb9e3bfb4a service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:08.176468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e6365231-cf62-495e-a5ec-1ccb9e3bfb4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:08.216817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6365231-cf62-495e-a5ec-1ccb9e3bfb4a service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:08.363124 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf002c7-80ee-41ca-858a-014263b33fbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:08.364045 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf002c7-80ee-41ca-858a-014263b33fbc service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:08.364315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf002c7-80ee-41ca-858a-014263b33fbc service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:08.364730 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf002c7-80ee-41ca-858a-014263b33fbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:08.386587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf002c7-80ee-41ca-858a-014263b33fbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:08.388902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf002c7-80ee-41ca-858a-014263b33fbc service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:08.395572 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:26:08.416338 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3114/6267] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:26:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:26:08.612548 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5ffdf-bec3-4fca-8ff7-2df843b76832 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:08.614212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5ffdf-bec3-4fca-8ff7-2df843b76832 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:08.614766 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5ffdf-bec3-4fca-8ff7-2df843b76832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:08.644053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-79d5ffdf-bec3-4fca-8ff7-2df843b76832 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:26:08.646146 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-79d5ffdf-bec3-4fca-8ff7-2df843b76832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:08.753544 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3154/6268] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:26:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:26:08.760607 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf002c7-80ee-41ca-858a-014263b33fbc service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:08.762292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-baf002c7-80ee-41ca-858a-014263b33fbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:08.854794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5ffdf-bec3-4fca-8ff7-2df843b76832 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:08.856541 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-79d5ffdf-bec3-4fca-8ff7-2df843b76832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:08.873624 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:26:08.881188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5ffdf-bec3-4fca-8ff7-2df843b76832 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:08.893225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c8cf9-afe3-4f90-9d04-f740fca4eab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:08.894314 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c8cf9-afe3-4f90-9d04-f740fca4eab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:08.895041 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c8cf9-afe3-4f90-9d04-f740fca4eab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:08.896310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c8cf9-afe3-4f90-9d04-f740fca4eab4 admin admin] PATH_INFO: `/v3/projects/60636bdd3d8a49708dea4a3575cc43bd` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:08.900012 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c8cf9-afe3-4f90-9d04-f740fca4eab4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60636bdd3d8a49708dea4a3575cc43bd)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:08.905229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c8cf9-afe3-4f90-9d04-f740fca4eab4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:08.931372 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf002c7-80ee-41ca-858a-014263b33fbc service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:08.944633 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc183ed-acd2-4372-aace-4ff1b3a090cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:08.945330 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc183ed-acd2-4372-aace-4ff1b3a090cb service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:08.945717 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc183ed-acd2-4372-aace-4ff1b3a090cb service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:08.946187 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc183ed-acd2-4372-aace-4ff1b3a090cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:08.981723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc183ed-acd2-4372-aace-4ff1b3a090cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:08.984846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc183ed-acd2-4372-aace-4ff1b3a090cb service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:08.995474 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3115/6269] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:26:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:26:08.999747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ac3c8cf9-afe3-4f90-9d04-f740fca4eab4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60636bdd3d8a49708dea4a3575cc43bd', 'request_id': 'req-ac3c8cf9-afe3-4f90-9d04-f740fca4eab4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:09.010725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ac3c8cf9-afe3-4f90-9d04-f740fca4eab4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60636bdd3d8a49708dea4a3575cc43bd', 'request_id': 'req-ac3c8cf9-afe3-4f90-9d04-f740fca4eab4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:09.030497 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ac3c8cf9-afe3-4f90-9d04-f740fca4eab4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60636bdd3d8a49708dea4a3575cc43bd', 'request_id': 'req-ac3c8cf9-afe3-4f90-9d04-f740fca4eab4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:09.062694 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ac3c8cf9-afe3-4f90-9d04-f740fca4eab4 admin admin] The token cache is being invalidate because project 60636bdd3d8a49708dea4a3575cc43bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:26:09.063170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ac3c8cf9-afe3-4f90-9d04-f740fca4eab4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:09.064020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ac3c8cf9-afe3-4f90-9d04-f740fca4eab4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:09.065780 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3155/6270] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:26:08 2022] DELETE /identity/v3/projects/60636bdd3d8a49708dea4a3575cc43bd => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:26:09.070741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60657ac6-942f-4d64-96a1-ffb7a2e3f948 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:09.071154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60657ac6-942f-4d64-96a1-ffb7a2e3f948 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:09.071836 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60657ac6-942f-4d64-96a1-ffb7a2e3f948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:09.117300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-60657ac6-942f-4d64-96a1-ffb7a2e3f948 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:26:09.119610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-60657ac6-942f-4d64-96a1-ffb7a2e3f948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:09.275646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c8cf9-afe3-4f90-9d04-f740fca4eab4 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:09.277325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ac3c8cf9-afe3-4f90-9d04-f740fca4eab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:09.428102 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3116/6271] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:26:09.435908 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b9a7a-cf9a-4d59-b85b-7398424cc632 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:09.437842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b9a7a-cf9a-4d59-b85b-7398424cc632 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:09.438677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b9a7a-cf9a-4d59-b85b-7398424cc632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:09.483511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c8cf9-afe3-4f90-9d04-f740fca4eab4 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:09.496745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d96ef1-8c41-47eb-b5c1-78026309e141 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efcee9b21ea94b1b8e5c9c5acb35839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:09.497898 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d96ef1-8c41-47eb-b5c1-78026309e141 service glance] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:09.498279 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d96ef1-8c41-47eb-b5c1-78026309e141 service glance] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:09.498688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d96ef1-8c41-47eb-b5c1-78026309e141 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:09.501317 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e0d96ef1-8c41-47eb-b5c1-78026309e141 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:09.501519 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a07b9a7a-cf9a-4d59-b85b-7398424cc632 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:26:09.505181 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a07b9a7a-cf9a-4d59-b85b-7398424cc632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:09.530055 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3117/6272] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:26:09.535219 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b9a7a-cf9a-4d59-b85b-7398424cc632 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:09.551930 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b9a7a-cf9a-4d59-b85b-7398424cc632 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:09.561910 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ad5d6-a5a3-4132-9cf1-881e1f174ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:09.571105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ad5d6-a5a3-4132-9cf1-881e1f174ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:09.572456 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ad5d6-a5a3-4132-9cf1-881e1f174ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:09.575065 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ad5d6-a5a3-4132-9cf1-881e1f174ea3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:09.576711 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ad5d6-a5a3-4132-9cf1-881e1f174ea3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:26:09.577630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ad5d6-a5a3-4132-9cf1-881e1f174ea3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:09.579641 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ad5d6-a5a3-4132-9cf1-881e1f174ea3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:09.595968 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3118/6273] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:26:09.601780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ad5d6-a5a3-4132-9cf1-881e1f174ea3 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:09.618127 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ad5d6-a5a3-4132-9cf1-881e1f174ea3 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:09.635555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a950ac-eda1-49f0-9465-e12534493aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:09.638459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a950ac-eda1-49f0-9465-e12534493aaa admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:09.638900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a950ac-eda1-49f0-9465-e12534493aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:09.639322 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a950ac-eda1-49f0-9465-e12534493aaa admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:09.640374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a950ac-eda1-49f0-9465-e12534493aaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:09.642578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a950ac-eda1-49f0-9465-e12534493aaa admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:09.681964 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3119/6274] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:26:09 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:26:09.687281 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a950ac-eda1-49f0-9465-e12534493aaa admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:09.689395 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d96ef1-8c41-47eb-b5c1-78026309e141 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:09.691049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d96ef1-8c41-47eb-b5c1-78026309e141 service glance] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:09.715334 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3156/6275] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:26:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:26:09.764294 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:26:09.794749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a950ac-eda1-49f0-9465-e12534493aaa admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:09.804201 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc87ed-5672-4c5d-8d16-b1de9382f3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:09.804963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc87ed-5672-4c5d-8d16-b1de9382f3c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:09.805514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc87ed-5672-4c5d-8d16-b1de9382f3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:09.805893 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc87ed-5672-4c5d-8d16-b1de9382f3c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:09.806632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc87ed-5672-4c5d-8d16-b1de9382f3c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:09.809222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc87ed-5672-4c5d-8d16-b1de9382f3c5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:09.855071 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3120/6276] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:26:09 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:26:09.858850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d96ef1-8c41-47eb-b5c1-78026309e141 service glance] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:09.875408 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d96ef1-8c41-47eb-b5c1-78026309e141 service glance] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:09.889675 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509c5d5-3f7c-4acf-96b0-6286969e1788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:09.890309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509c5d5-3f7c-4acf-96b0-6286969e1788 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:09.890589 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509c5d5-3f7c-4acf-96b0-6286969e1788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:09.890861 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509c5d5-3f7c-4acf-96b0-6286969e1788 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:09.891506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509c5d5-3f7c-4acf-96b0-6286969e1788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:09.893181 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509c5d5-3f7c-4acf-96b0-6286969e1788 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:09.917775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc87ed-5672-4c5d-8d16-b1de9382f3c5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:09.920066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-eccc87ed-5672-4c5d-8d16-b1de9382f3c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:09.921728 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3157/6277] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:26:09.922614 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509c5d5-3f7c-4acf-96b0-6286969e1788 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:09.941387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509c5d5-3f7c-4acf-96b0-6286969e1788 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:09.965946 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6abce-bd3c-4736-af9a-5b509878828c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:09.966514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6abce-bd3c-4736-af9a-5b509878828c admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:09.966799 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6abce-bd3c-4736-af9a-5b509878828c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:09.967074 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6abce-bd3c-4736-af9a-5b509878828c admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:09.967724 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6abce-bd3c-4736-af9a-5b509878828c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:09.969367 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6abce-bd3c-4736-af9a-5b509878828c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:10.012036 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3158/6278] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:26:10.014234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6abce-bd3c-4736-af9a-5b509878828c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:10.047704 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6abce-bd3c-4736-af9a-5b509878828c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:10.066053 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc87ed-5672-4c5d-8d16-b1de9382f3c5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:10.066609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cb0d2-3484-4a89-99c7-8e76b0a9a681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:10.067358 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cb0d2-3484-4a89-99c7-8e76b0a9a681 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:10.067645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cb0d2-3484-4a89-99c7-8e76b0a9a681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:10.067922 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cb0d2-3484-4a89-99c7-8e76b0a9a681 admin admin] PATH_INFO: `/v3/projects/570d8ec710af402685d0534fcabf6579/users/c17bbe0c1329462c8cd7232dad26bd70/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:10.070099 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa602a-1c5c-4617-9d3b-4096f7bc8ac1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:10.071415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa602a-1c5c-4617-9d3b-4096f7bc8ac1 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:10.071415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa602a-1c5c-4617-9d3b-4096f7bc8ac1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:10.071415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa602a-1c5c-4617-9d3b-4096f7bc8ac1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:10.073156 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:26:10.082217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-cefa602a-1c5c-4617-9d3b-4096f7bc8ac1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:10.096545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefa602a-1c5c-4617-9d3b-4096f7bc8ac1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:10.097966 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefa602a-1c5c-4617-9d3b-4096f7bc8ac1 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:10.106036 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16cb0d2-3484-4a89-99c7-8e76b0a9a681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=570d8ec710af402685d0534fcabf6579, user_id=c17bbe0c1329462c8cd7232dad26bd70, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:10.109954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16cb0d2-3484-4a89-99c7-8e76b0a9a681 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:10.123923 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3121/6279] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:26:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:26:10.168084 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3159/6280] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:26:10 2022] PUT /identity/v3/projects/570d8ec710af402685d0534fcabf6579/users/c17bbe0c1329462c8cd7232dad26bd70/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:26:10.168310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb3a61-2375-49d8-96c7-26bc1b0a9f7e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:10.168310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb3a61-2375-49d8-96c7-26bc1b0a9f7e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:10.168458 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb3a61-2375-49d8-96c7-26bc1b0a9f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:10.224613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-f8fb3a61-2375-49d8-96c7-26bc1b0a9f7e None None] MFA Rules not processed for user `c17bbe0c1329462c8cd7232dad26bd70`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:26:10.226139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f8fb3a61-2375-49d8-96c7-26bc1b0a9f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:10.367847 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cb0d2-3484-4a89-99c7-8e76b0a9a681 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:10.459263 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3122/6281] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:26:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:26:10.472358 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb3a61-2375-49d8-96c7-26bc1b0a9f7e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:10.585069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cb0d2-3484-4a89-99c7-8e76b0a9a681 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:10.597863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039bfd4-d0e7-472e-ba1c-fed552f59caf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:10.598500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039bfd4-d0e7-472e-ba1c-fed552f59caf service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:10.598781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039bfd4-d0e7-472e-ba1c-fed552f59caf service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:10.599057 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039bfd4-d0e7-472e-ba1c-fed552f59caf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:10.606958 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5039bfd4-d0e7-472e-ba1c-fed552f59caf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:10.665094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb3a61-2375-49d8-96c7-26bc1b0a9f7e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:10.683279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a00e7-14d5-4a30-b0ec-3d3643b0eeaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:10.683915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a00e7-14d5-4a30-b0ec-3d3643b0eeaf service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:10.684225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a00e7-14d5-4a30-b0ec-3d3643b0eeaf service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:10.684666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a00e7-14d5-4a30-b0ec-3d3643b0eeaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:10.703809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a00e7-14d5-4a30-b0ec-3d3643b0eeaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:10.709417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a00e7-14d5-4a30-b0ec-3d3643b0eeaf service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:10.747827 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039bfd4-d0e7-472e-ba1c-fed552f59caf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:10.751656 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039bfd4-d0e7-472e-ba1c-fed552f59caf service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:10.760604 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3123/6282] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:26:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:26:10.768953 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3160/6283] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:26:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:26:10.922149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a00e7-14d5-4a30-b0ec-3d3643b0eeaf service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:10.923812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-955a00e7-14d5-4a30-b0ec-3d3643b0eeaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:10.969846 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:26:11.122828 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a00e7-14d5-4a30-b0ec-3d3643b0eeaf service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:11.136223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b9a9f-0cc2-4952-ae78-c677f811a532 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:11.137217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b9a9f-0cc2-4952-ae78-c677f811a532 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:11.137928 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b9a9f-0cc2-4952-ae78-c677f811a532 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:11.138420 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b9a9f-0cc2-4952-ae78-c677f811a532 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:11.145339 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ed1b9a9f-0cc2-4952-ae78-c677f811a532 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:11.180214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b9a9f-0cc2-4952-ae78-c677f811a532 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:11.182099 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b9a9f-0cc2-4952-ae78-c677f811a532 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:11.211928 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3124/6284] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:26:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:26:12.213555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039bfd4-d0e7-472e-ba1c-fed552f59caf service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:12.315059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039bfd4-d0e7-472e-ba1c-fed552f59caf service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:12.320147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb09ed-ed47-494c-bde2-37841c0f6046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:12.320940 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb09ed-ed47-494c-bde2-37841c0f6046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:12.321333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb09ed-ed47-494c-bde2-37841c0f6046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:12.321763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb09ed-ed47-494c-bde2-37841c0f6046 admin admin] PATH_INFO: `/v3/users/c17bbe0c1329462c8cd7232dad26bd70` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:12.323285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb09ed-ed47-494c-bde2-37841c0f6046 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c17bbe0c1329462c8cd7232dad26bd70)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:12.326187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb09ed-ed47-494c-bde2-37841c0f6046 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:12.372401 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:26:12.407153 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2beb09ed-ed47-494c-bde2-37841c0f6046 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c17bbe0c1329462c8cd7232dad26bd70'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:12.408749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2beb09ed-ed47-494c-bde2-37841c0f6046 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c17bbe0c1329462c8cd7232dad26bd70'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:12.423271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2beb09ed-ed47-494c-bde2-37841c0f6046 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c17bbe0c1329462c8cd7232dad26bd70'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:12.453345 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2beb09ed-ed47-494c-bde2-37841c0f6046 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c17bbe0c1329462c8cd7232dad26bd70'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:12.454795 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2beb09ed-ed47-494c-bde2-37841c0f6046 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c17bbe0c1329462c8cd7232dad26bd70'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:12.499174 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3161/6285] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:26:12 2022] DELETE /identity/v3/users/c17bbe0c1329462c8cd7232dad26bd70 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:26:12.503367 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477ae5f-a55e-4204-a163-295d7e404f0e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:12.503865 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477ae5f-a55e-4204-a163-295d7e404f0e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:12.503950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477ae5f-a55e-4204-a163-295d7e404f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:12.539013 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-4477ae5f-a55e-4204-a163-295d7e404f0e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:26:12.540251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4477ae5f-a55e-4204-a163-295d7e404f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:12.698820 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3125/6286] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:26:12.706710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb09ed-ed47-494c-bde2-37841c0f6046 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:12.708760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2beb09ed-ed47-494c-bde2-37841c0f6046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:12.844643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb09ed-ed47-494c-bde2-37841c0f6046 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:12.855014 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744a127-e840-49a3-b15f-9cc2554f7771 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:12.856109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744a127-e840-49a3-b15f-9cc2554f7771 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:12.856634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744a127-e840-49a3-b15f-9cc2554f7771 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:12.857075 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744a127-e840-49a3-b15f-9cc2554f7771 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:12.883492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744a127-e840-49a3-b15f-9cc2554f7771 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:12.886438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744a127-e840-49a3-b15f-9cc2554f7771 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:12.914754 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3162/6287] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:26:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:26:13.928440 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477ae5f-a55e-4204-a163-295d7e404f0e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:13.930178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4477ae5f-a55e-4204-a163-295d7e404f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:13.956335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477ae5f-a55e-4204-a163-295d7e404f0e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:13.961867 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96120a7-52aa-41b4-b211-c624b7a6f77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:13.962528 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96120a7-52aa-41b4-b211-c624b7a6f77d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:13.962805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96120a7-52aa-41b4-b211-c624b7a6f77d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:13.963084 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96120a7-52aa-41b4-b211-c624b7a6f77d admin admin] PATH_INFO: `/v3/projects/570d8ec710af402685d0534fcabf6579` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:13.964231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96120a7-52aa-41b4-b211-c624b7a6f77d admin admin] RBAC: Authorizing `identity:delete_project(project_id=570d8ec710af402685d0534fcabf6579)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:13.966828 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96120a7-52aa-41b4-b211-c624b7a6f77d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:14.060507 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d96120a7-52aa-41b4-b211-c624b7a6f77d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '570d8ec710af402685d0534fcabf6579', 'request_id': 'req-d96120a7-52aa-41b4-b211-c624b7a6f77d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:14.082822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d96120a7-52aa-41b4-b211-c624b7a6f77d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '570d8ec710af402685d0534fcabf6579', 'request_id': 'req-d96120a7-52aa-41b4-b211-c624b7a6f77d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:14.092968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d96120a7-52aa-41b4-b211-c624b7a6f77d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '570d8ec710af402685d0534fcabf6579', 'request_id': 'req-d96120a7-52aa-41b4-b211-c624b7a6f77d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:14.109276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d96120a7-52aa-41b4-b211-c624b7a6f77d admin admin] The token cache is being invalidate because project 570d8ec710af402685d0534fcabf6579 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:26:14.109564 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d96120a7-52aa-41b4-b211-c624b7a6f77d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:14.116294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d96120a7-52aa-41b4-b211-c624b7a6f77d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:14.122960 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3126/6288] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:26:13 2022] DELETE /identity/v3/projects/570d8ec710af402685d0534fcabf6579 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:26:14.127595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f86bf-68e7-497a-a31d-a674ad1dbc06 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:14.128131 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f86bf-68e7-497a-a31d-a674ad1dbc06 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:14.128131 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f86bf-68e7-497a-a31d-a674ad1dbc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:14.151207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a42f86bf-68e7-497a-a31d-a674ad1dbc06 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:26:14.152445 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a42f86bf-68e7-497a-a31d-a674ad1dbc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:14.373863 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3163/6289] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:26:14.375750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2b888-0b02-4b1d-8c62-5fb994ea20b7 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:14.376108 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2b888-0b02-4b1d-8c62-5fb994ea20b7 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:14.376451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2b888-0b02-4b1d-8c62-5fb994ea20b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:14.422413 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-16f2b888-0b02-4b1d-8c62-5fb994ea20b7 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:26:14.423738 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-16f2b888-0b02-4b1d-8c62-5fb994ea20b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:14.456296 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3127/6290] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:26:14.460285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f86bf-68e7-497a-a31d-a674ad1dbc06 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:14.479882 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f86bf-68e7-497a-a31d-a674ad1dbc06 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:14.495221 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123f31c-e254-4698-aea5-5e37bdebd206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:14.495873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123f31c-e254-4698-aea5-5e37bdebd206 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:14.496156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123f31c-e254-4698-aea5-5e37bdebd206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:14.496430 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123f31c-e254-4698-aea5-5e37bdebd206 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:14.497710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123f31c-e254-4698-aea5-5e37bdebd206 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:26:14.497998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123f31c-e254-4698-aea5-5e37bdebd206 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:14.499631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123f31c-e254-4698-aea5-5e37bdebd206 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:14.520430 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3164/6291] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:26:14.523637 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2b888-0b02-4b1d-8c62-5fb994ea20b7 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:14.538012 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2b888-0b02-4b1d-8c62-5fb994ea20b7 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:14.553081 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50db74d-3a36-44d9-ba4a-26f8af404ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:14.553734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50db74d-3a36-44d9-ba4a-26f8af404ecd admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:14.554018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50db74d-3a36-44d9-ba4a-26f8af404ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:14.554309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50db74d-3a36-44d9-ba4a-26f8af404ecd admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:14.554932 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50db74d-3a36-44d9-ba4a-26f8af404ecd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:14.557309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50db74d-3a36-44d9-ba4a-26f8af404ecd admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:14.609260 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:26:14.617289 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3128/6292] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:26:14 2022] POST /identity/v3/projects => generated 369 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:26:14.621325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123f31c-e254-4698-aea5-5e37bdebd206 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:14.645538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123f31c-e254-4698-aea5-5e37bdebd206 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:14.726047 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:26:14.801993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978ff16-06ef-4889-a14a-f01e3f37fb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:14.804027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978ff16-06ef-4889-a14a-f01e3f37fb74 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:14.804519 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978ff16-06ef-4889-a14a-f01e3f37fb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:14.809111 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978ff16-06ef-4889-a14a-f01e3f37fb74 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:14.810785 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6978ff16-06ef-4889-a14a-f01e3f37fb74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:14.812959 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6978ff16-06ef-4889-a14a-f01e3f37fb74 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:14.854165 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3165/6293] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:26:14 2022] POST /identity/v3/users => generated 285 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:26:14.858983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50db74d-3a36-44d9-ba4a-26f8af404ecd admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:14.876782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50db74d-3a36-44d9-ba4a-26f8af404ecd admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:14.885345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511f17b-f156-4868-805f-c4caa355eead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:14.886311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511f17b-f156-4868-805f-c4caa355eead admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:14.886692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511f17b-f156-4868-805f-c4caa355eead admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:14.887102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511f17b-f156-4868-805f-c4caa355eead admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:14.888184 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511f17b-f156-4868-805f-c4caa355eead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:14.890165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511f17b-f156-4868-805f-c4caa355eead admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:14.923023 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3129/6294] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:26:14.927579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978ff16-06ef-4889-a14a-f01e3f37fb74 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:14.958969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978ff16-06ef-4889-a14a-f01e3f37fb74 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:14.992585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515cf3c-8047-443a-acdd-bbd727d18a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:14.993487 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515cf3c-8047-443a-acdd-bbd727d18a36 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:14.993781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515cf3c-8047-443a-acdd-bbd727d18a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:14.994057 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515cf3c-8047-443a-acdd-bbd727d18a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:14.994767 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515cf3c-8047-443a-acdd-bbd727d18a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:14.996520 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515cf3c-8047-443a-acdd-bbd727d18a36 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:15.032898 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3166/6295] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:26:15.034469 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511f17b-f156-4868-805f-c4caa355eead admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:15.058548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511f17b-f156-4868-805f-c4caa355eead admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:15.066945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db91d8-d23b-4395-a9a6-54f533c4fc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:15.067819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db91d8-d23b-4395-a9a6-54f533c4fc2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:15.068149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db91d8-d23b-4395-a9a6-54f533c4fc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:15.068431 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db91d8-d23b-4395-a9a6-54f533c4fc2a admin admin] PATH_INFO: `/v3/projects/3d1aec6041834d3ba6ff0ba03822d43a/users/c7218510c88f493589895b3d86bd9451/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:15.129992 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db91d8-d23b-4395-a9a6-54f533c4fc2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d1aec6041834d3ba6ff0ba03822d43a, user_id=c7218510c88f493589895b3d86bd9451, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:15.137960 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db91d8-d23b-4395-a9a6-54f533c4fc2a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:15.189966 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3130/6296] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:26:15 2022] PUT /identity/v3/projects/3d1aec6041834d3ba6ff0ba03822d43a/users/c7218510c88f493589895b3d86bd9451/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:26:15.200503 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ddde9-085a-42fa-b6dd-835cba239537 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:15.201096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ddde9-085a-42fa-b6dd-835cba239537 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:15.201096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ddde9-085a-42fa-b6dd-835cba239537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:15.327909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-579ddde9-085a-42fa-b6dd-835cba239537 None None] MFA Rules not processed for user `c7218510c88f493589895b3d86bd9451`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:26:15.329297 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-579ddde9-085a-42fa-b6dd-835cba239537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:15.511309 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3167/6297] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:26:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:26:15.525029 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db91d8-d23b-4395-a9a6-54f533c4fc2a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:15.526848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-83db91d8-d23b-4395-a9a6-54f533c4fc2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:15.618986 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db91d8-d23b-4395-a9a6-54f533c4fc2a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:15.625807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e9b65-1a4f-4424-b806-4a39d0e631a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:15.626570 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e9b65-1a4f-4424-b806-4a39d0e631a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:15.626926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e9b65-1a4f-4424-b806-4a39d0e631a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:15.627275 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e9b65-1a4f-4424-b806-4a39d0e631a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:15.658924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e9b65-1a4f-4424-b806-4a39d0e631a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:15.661960 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e9b65-1a4f-4424-b806-4a39d0e631a7 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:15.675801 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3131/6298] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:26:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:26:15.952807 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ddde9-085a-42fa-b6dd-835cba239537 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:15.958817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-579ddde9-085a-42fa-b6dd-835cba239537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:16.187163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ddde9-085a-42fa-b6dd-835cba239537 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:16.187163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5cf69-aeed-4d7a-a2f4-ed66bc2deebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:16.187163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5cf69-aeed-4d7a-a2f4-ed66bc2deebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:16.187163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5cf69-aeed-4d7a-a2f4-ed66bc2deebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:16.187706 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5cf69-aeed-4d7a-a2f4-ed66bc2deebd admin admin] PATH_INFO: `/v3/users/801ea22245104e7da6366b14379adad3` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:16.187706 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5cf69-aeed-4d7a-a2f4-ed66bc2deebd admin admin] RBAC: Authorizing `identity:delete_user(user_id=801ea22245104e7da6366b14379adad3)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:16.191212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5cf69-aeed-4d7a-a2f4-ed66bc2deebd admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:16.260941 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:26:16.267949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fbf5cf69-aeed-4d7a-a2f4-ed66bc2deebd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '801ea22245104e7da6366b14379adad3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:16.269901 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fbf5cf69-aeed-4d7a-a2f4-ed66bc2deebd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '801ea22245104e7da6366b14379adad3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:16.284558 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fbf5cf69-aeed-4d7a-a2f4-ed66bc2deebd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '801ea22245104e7da6366b14379adad3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:16.303521 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fbf5cf69-aeed-4d7a-a2f4-ed66bc2deebd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '801ea22245104e7da6366b14379adad3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:16.304472 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fbf5cf69-aeed-4d7a-a2f4-ed66bc2deebd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '801ea22245104e7da6366b14379adad3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:16.338412 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3168/6299] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:26:15 2022] DELETE /identity/v3/users/801ea22245104e7da6366b14379adad3 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:26:16.742525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e9b65-1a4f-4424-b806-4a39d0e631a7 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:16.767332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e9b65-1a4f-4424-b806-4a39d0e631a7 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:16.876250 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad9648-9d58-4fa3-93ba-99431b336c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:16.876973 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad9648-9d58-4fa3-93ba-99431b336c50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:16.877241 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad9648-9d58-4fa3-93ba-99431b336c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:16.877552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad9648-9d58-4fa3-93ba-99431b336c50 admin admin] PATH_INFO: `/v3/projects/d55147c802484bc7bafdaa417d0373d8` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:16.878941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad9648-9d58-4fa3-93ba-99431b336c50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d55147c802484bc7bafdaa417d0373d8)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:16.880880 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad9648-9d58-4fa3-93ba-99431b336c50 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:16.954650 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f6ad9648-9d58-4fa3-93ba-99431b336c50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd55147c802484bc7bafdaa417d0373d8', 'request_id': 'req-f6ad9648-9d58-4fa3-93ba-99431b336c50'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:16.967746 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f6ad9648-9d58-4fa3-93ba-99431b336c50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd55147c802484bc7bafdaa417d0373d8', 'request_id': 'req-f6ad9648-9d58-4fa3-93ba-99431b336c50'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:16.975495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f6ad9648-9d58-4fa3-93ba-99431b336c50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd55147c802484bc7bafdaa417d0373d8', 'request_id': 'req-f6ad9648-9d58-4fa3-93ba-99431b336c50'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:16.990435 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:26:17.013459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f6ad9648-9d58-4fa3-93ba-99431b336c50 admin admin] The token cache is being invalidate because project d55147c802484bc7bafdaa417d0373d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:26:17.013951 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f6ad9648-9d58-4fa3-93ba-99431b336c50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:17.015016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f6ad9648-9d58-4fa3-93ba-99431b336c50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:17.020445 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3132/6300] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:26:16 2022] DELETE /identity/v3/projects/d55147c802484bc7bafdaa417d0373d8 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:26:17.021391 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5cf69-aeed-4d7a-a2f4-ed66bc2deebd admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:17.023421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fbf5cf69-aeed-4d7a-a2f4-ed66bc2deebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:17.050595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5cf69-aeed-4d7a-a2f4-ed66bc2deebd admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:17.190944 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c63cb-3bd8-4567-9d82-a59a79ea1ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:17.194985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c63cb-3bd8-4567-9d82-a59a79ea1ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:17.196082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c63cb-3bd8-4567-9d82-a59a79ea1ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:17.196511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c63cb-3bd8-4567-9d82-a59a79ea1ad5 admin admin] PATH_INFO: `/v3/users/bbd00e21b41b4dc5b56ccff0127b76af` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:17.198006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c63cb-3bd8-4567-9d82-a59a79ea1ad5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbd00e21b41b4dc5b56ccff0127b76af)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:17.200929 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c63cb-3bd8-4567-9d82-a59a79ea1ad5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:17.295905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-cc2c63cb-3bd8-4567-9d82-a59a79ea1ad5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbd00e21b41b4dc5b56ccff0127b76af'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:17.297031 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-cc2c63cb-3bd8-4567-9d82-a59a79ea1ad5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbd00e21b41b4dc5b56ccff0127b76af'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:17.307508 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-cc2c63cb-3bd8-4567-9d82-a59a79ea1ad5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbd00e21b41b4dc5b56ccff0127b76af'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:17.322433 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-cc2c63cb-3bd8-4567-9d82-a59a79ea1ad5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbd00e21b41b4dc5b56ccff0127b76af'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:17.323333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-cc2c63cb-3bd8-4567-9d82-a59a79ea1ad5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbd00e21b41b4dc5b56ccff0127b76af'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:17.357275 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3169/6301] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:26:17 2022] DELETE /identity/v3/users/bbd00e21b41b4dc5b56ccff0127b76af => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:26:17.772051 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad9648-9d58-4fa3-93ba-99431b336c50 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:17.773572 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f6ad9648-9d58-4fa3-93ba-99431b336c50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:17.793412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad9648-9d58-4fa3-93ba-99431b336c50 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:17.876916 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd04be-6fa9-43e4-8120-93dd6b7402f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:17.877606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd04be-6fa9-43e4-8120-93dd6b7402f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:17.877888 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd04be-6fa9-43e4-8120-93dd6b7402f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:17.878163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd04be-6fa9-43e4-8120-93dd6b7402f9 admin admin] PATH_INFO: `/v3/projects/6fd683c4aec640359c8348ee6bb9a385` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:17.879310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd04be-6fa9-43e4-8120-93dd6b7402f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fd683c4aec640359c8348ee6bb9a385)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:17.881229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd04be-6fa9-43e4-8120-93dd6b7402f9 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:17.940136 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-62cd04be-6fa9-43e4-8120-93dd6b7402f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fd683c4aec640359c8348ee6bb9a385', 'request_id': 'req-62cd04be-6fa9-43e4-8120-93dd6b7402f9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:17.954444 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-62cd04be-6fa9-43e4-8120-93dd6b7402f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fd683c4aec640359c8348ee6bb9a385', 'request_id': 'req-62cd04be-6fa9-43e4-8120-93dd6b7402f9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:17.972530 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-62cd04be-6fa9-43e4-8120-93dd6b7402f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fd683c4aec640359c8348ee6bb9a385', 'request_id': 'req-62cd04be-6fa9-43e4-8120-93dd6b7402f9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:17.990525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-62cd04be-6fa9-43e4-8120-93dd6b7402f9 admin admin] The token cache is being invalidate because project 6fd683c4aec640359c8348ee6bb9a385 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:26:17.990824 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-62cd04be-6fa9-43e4-8120-93dd6b7402f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:17.991655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-62cd04be-6fa9-43e4-8120-93dd6b7402f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:26:17.999062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dd6a3-fd09-48b3-8853-3c99dbf33fe5 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:17.999373 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dd6a3-fd09-48b3-8853-3c99dbf33fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:17.999652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dd6a3-fd09-48b3-8853-3c99dbf33fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:18.005609 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3133/6302] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:26:17 2022] DELETE /identity/v3/projects/6fd683c4aec640359c8348ee6bb9a385 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:26:18.024164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-465dd6a3-fd09-48b3-8853-3c99dbf33fe5 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:26:18.025393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-465dd6a3-fd09-48b3-8853-3c99dbf33fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:18.109522 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:26:18.170188 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3170/6303] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:26:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:26:18.178607 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7a270-b710-4552-9c9f-1db884bff34d None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:18.178937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7a270-b710-4552-9c9f-1db884bff34d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:18.179237 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7a270-b710-4552-9c9f-1db884bff34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:18.218400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-1ba7a270-b710-4552-9c9f-1db884bff34d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:26:18.219663 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1ba7a270-b710-4552-9c9f-1db884bff34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:18.252554 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465dd6a3-fd09-48b3-8853-3c99dbf33fe5 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:18.258411 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3134/6304] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:26:18.273002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465dd6a3-fd09-48b3-8853-3c99dbf33fe5 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:18.283903 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7b5a1-5d57-4f98-90cf-5c48b348794c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:18.285066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7b5a1-5d57-4f98-90cf-5c48b348794c admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:18.285354 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7b5a1-5d57-4f98-90cf-5c48b348794c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:18.285661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7b5a1-5d57-4f98-90cf-5c48b348794c admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:18.286327 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d7b5a1-5d57-4f98-90cf-5c48b348794c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:26:18.286634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d7b5a1-5d57-4f98-90cf-5c48b348794c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:18.288273 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d7b5a1-5d57-4f98-90cf-5c48b348794c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:18.308992 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7a270-b710-4552-9c9f-1db884bff34d None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:18.313716 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3171/6305] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:26:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:26:18.321195 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7a270-b710-4552-9c9f-1db884bff34d None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:18.330516 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb71870-269b-4649-a025-ff9812ad9ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:18.331652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb71870-269b-4649-a025-ff9812ad9ede admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:18.331934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb71870-269b-4649-a025-ff9812ad9ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:18.332226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb71870-269b-4649-a025-ff9812ad9ede admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:18.332849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb71870-269b-4649-a025-ff9812ad9ede admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:18.336347 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb71870-269b-4649-a025-ff9812ad9ede admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:18.409769 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3135/6306] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:26:18 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:26:18.413208 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7b5a1-5d57-4f98-90cf-5c48b348794c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:18.428763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7b5a1-5d57-4f98-90cf-5c48b348794c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:18.587338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3f976-2f60-4652-ba75-23fe1ea0b732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:18.588398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3f976-2f60-4652-ba75-23fe1ea0b732 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:18.588855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3f976-2f60-4652-ba75-23fe1ea0b732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:18.589556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3f976-2f60-4652-ba75-23fe1ea0b732 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:18.590424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3f976-2f60-4652-ba75-23fe1ea0b732 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:18.593408 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3f976-2f60-4652-ba75-23fe1ea0b732 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:18.632849 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3172/6307] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:26:18 2022] POST /identity/v3/users => generated 292 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:26:18.637057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb71870-269b-4649-a025-ff9812ad9ede admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:18.654063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb71870-269b-4649-a025-ff9812ad9ede admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:18.662537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefdb77-8ab8-4310-ba30-93882b1964fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:18.664383 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefdb77-8ab8-4310-ba30-93882b1964fa admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:18.665408 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefdb77-8ab8-4310-ba30-93882b1964fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:18.665863 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefdb77-8ab8-4310-ba30-93882b1964fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:18.667559 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fefdb77-8ab8-4310-ba30-93882b1964fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:18.670078 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fefdb77-8ab8-4310-ba30-93882b1964fa admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:18.688458 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3136/6308] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:26:18.692994 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3f976-2f60-4652-ba75-23fe1ea0b732 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:18.706084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3f976-2f60-4652-ba75-23fe1ea0b732 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:18.711733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad31e08-b8cb-4c8f-9ab9-3d943c53d2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:18.712536 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad31e08-b8cb-4c8f-9ab9-3d943c53d2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:18.712925 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad31e08-b8cb-4c8f-9ab9-3d943c53d2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:18.713302 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad31e08-b8cb-4c8f-9ab9-3d943c53d2e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:18.714107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad31e08-b8cb-4c8f-9ab9-3d943c53d2e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:18.716287 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad31e08-b8cb-4c8f-9ab9-3d943c53d2e6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:18.732610 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3173/6309] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:26:18.733953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefdb77-8ab8-4310-ba30-93882b1964fa admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:18.764557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefdb77-8ab8-4310-ba30-93882b1964fa admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:18.775077 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ecbf2-2fc3-4673-a0a7-d71b7a45a397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:18.777185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ecbf2-2fc3-4673-a0a7-d71b7a45a397 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:18.777786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ecbf2-2fc3-4673-a0a7-d71b7a45a397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:18.778241 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ecbf2-2fc3-4673-a0a7-d71b7a45a397 admin admin] PATH_INFO: `/v3/projects/597639ba527e4aa094273398f7d578d5/users/a9787a91c5864d41bea568643916fe4a/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:18.808428 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ecbf2-2fc3-4673-a0a7-d71b7a45a397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=597639ba527e4aa094273398f7d578d5, user_id=a9787a91c5864d41bea568643916fe4a, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:18.816218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ecbf2-2fc3-4673-a0a7-d71b7a45a397 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:18.845653 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3137/6310] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:26:18 2022] PUT /identity/v3/projects/597639ba527e4aa094273398f7d578d5/users/a9787a91c5864d41bea568643916fe4a/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:26:18.850906 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c6c4a-66e6-40a3-86af-77e330599673 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:18.851196 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c6c4a-66e6-40a3-86af-77e330599673 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:18.851480 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c6c4a-66e6-40a3-86af-77e330599673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:18.893357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-736c6c4a-66e6-40a3-86af-77e330599673 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:26:18.895322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-736c6c4a-66e6-40a3-86af-77e330599673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:18.976743 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3174/6311] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:26:18.984629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ecbf2-2fc3-4673-a0a7-d71b7a45a397 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:18.986798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a41ecbf2-2fc3-4673-a0a7-d71b7a45a397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:19.043140 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:26:19.119918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ecbf2-2fc3-4673-a0a7-d71b7a45a397 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:19.125319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0016250-a38d-4a86-be5c-4ffed2cef2d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:19.126329 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0016250-a38d-4a86-be5c-4ffed2cef2d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:19.126843 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0016250-a38d-4a86-be5c-4ffed2cef2d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:19.127301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0016250-a38d-4a86-be5c-4ffed2cef2d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:19.150828 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0016250-a38d-4a86-be5c-4ffed2cef2d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:19.154318 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0016250-a38d-4a86-be5c-4ffed2cef2d8 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:19.176575 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3138/6312] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:26:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:26:24.375328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c6c4a-66e6-40a3-86af-77e330599673 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:24.377019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-736c6c4a-66e6-40a3-86af-77e330599673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:24.608613 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:26:24.668395 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c6c4a-66e6-40a3-86af-77e330599673 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:24.674603 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815fd9c0-f7bd-4784-9f22-711e57be08fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:24.675916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fd9c0-f7bd-4784-9f22-711e57be08fa service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:24.676407 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fd9c0-f7bd-4784-9f22-711e57be08fa service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:24.677050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fd9c0-f7bd-4784-9f22-711e57be08fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:24.679499 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-815fd9c0-f7bd-4784-9f22-711e57be08fa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:24.842960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815fd9c0-f7bd-4784-9f22-711e57be08fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:24.848152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815fd9c0-f7bd-4784-9f22-711e57be08fa service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:24.877384 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3175/6313] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:26:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 736 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 04 01:26:29.168848 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=16 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:26:32.415685 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39294cff-6a3a-4fcf-bf4b-a5234f71cd75 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:32.416294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39294cff-6a3a-4fcf-bf4b-a5234f71cd75 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:32.416700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39294cff-6a3a-4fcf-bf4b-a5234f71cd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:32.507388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-39294cff-6a3a-4fcf-bf4b-a5234f71cd75 None None] MFA Rules not processed for user `a9787a91c5864d41bea568643916fe4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:26:32.509699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-39294cff-6a3a-4fcf-bf4b-a5234f71cd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:32.814138 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3139/6314] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:26:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:26:32.825703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d95b3-c0df-4279-965e-695aebdab884 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:32.826259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d95b3-c0df-4279-965e-695aebdab884 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:32.826259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d95b3-c0df-4279-965e-695aebdab884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:32.952717 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-936d95b3-c0df-4279-965e-695aebdab884 None None] MFA Rules not processed for user `a9787a91c5864d41bea568643916fe4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:26:32.954022 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-936d95b3-c0df-4279-965e-695aebdab884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:33.012838 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3176/6315] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:26:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:26:33.021259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39294cff-6a3a-4fcf-bf4b-a5234f71cd75 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:33.022773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-39294cff-6a3a-4fcf-bf4b-a5234f71cd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:33.282773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39294cff-6a3a-4fcf-bf4b-a5234f71cd75 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:33.307191 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8d1ff-d98b-4b7a-b339-f3d62856e509 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:33.308414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8d1ff-d98b-4b7a-b339-f3d62856e509 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:33.309527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8d1ff-d98b-4b7a-b339-f3d62856e509 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:33.310001 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8d1ff-d98b-4b7a-b339-f3d62856e509 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:33.326924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c8d1ff-d98b-4b7a-b339-f3d62856e509 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:33.328915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c8d1ff-d98b-4b7a-b339-f3d62856e509 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:33.349801 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3140/6316] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:26:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:26:35.875758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d930091-c2ee-4437-b8a7-4befd3b77dbd None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:35.876240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d930091-c2ee-4437-b8a7-4befd3b77dbd None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:35.876624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d930091-c2ee-4437-b8a7-4befd3b77dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:35.926389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-7d930091-c2ee-4437-b8a7-4befd3b77dbd None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:26:35.929547 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7d930091-c2ee-4437-b8a7-4befd3b77dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:36.096849 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3177/6317] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:26:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:26:36.127236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8d1ff-d98b-4b7a-b339-f3d62856e509 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:36.150878 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8d1ff-d98b-4b7a-b339-f3d62856e509 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:36.179618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88ccdf-1efa-482b-a60b-b4cb79177b67 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:36.181803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88ccdf-1efa-482b-a60b-b4cb79177b67 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:36.183534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88ccdf-1efa-482b-a60b-b4cb79177b67 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:36.184171 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88ccdf-1efa-482b-a60b-b4cb79177b67 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:36.229976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d88ccdf-1efa-482b-a60b-b4cb79177b67 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:36.234655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d88ccdf-1efa-482b-a60b-b4cb79177b67 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:36.273522 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3141/6318] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:26:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:26:46.064854 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=63 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:26:46.255995 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=72 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:26:52.614648 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d1f35-f5af-492e-b629-2174fb484a75 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:52.615764 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d1f35-f5af-492e-b629-2174fb484a75 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:52.616277 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d1f35-f5af-492e-b629-2174fb484a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:52.642573 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e33d1f35-f5af-492e-b629-2174fb484a75 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:26:52.645457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e33d1f35-f5af-492e-b629-2174fb484a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:52.659924 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3178/6319] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 01:26:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:26:52.682588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88ccdf-1efa-482b-a60b-b4cb79177b67 service swift] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:52.706808 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88ccdf-1efa-482b-a60b-b4cb79177b67 service swift] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:52.715652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa63ebe-6a4c-4d80-836e-429ad3f71592 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:52.717161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa63ebe-6a4c-4d80-836e-429ad3f71592 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:52.717663 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa63ebe-6a4c-4d80-836e-429ad3f71592 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:52.718500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa63ebe-6a4c-4d80-836e-429ad3f71592 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:52.731587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa63ebe-6a4c-4d80-836e-429ad3f71592 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:52.734878 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa63ebe-6a4c-4d80-836e-429ad3f71592 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:52.747258 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3142/6320] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:26:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:26:55.828086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ba4c8-8435-487f-9d72-fe07f6fbc5e9 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:55.828646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ba4c8-8435-487f-9d72-fe07f6fbc5e9 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:55.828646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ba4c8-8435-487f-9d72-fe07f6fbc5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:55.902276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e85ba4c8-8435-487f-9d72-fe07f6fbc5e9 None None] MFA Rules not processed for user `3734668c07164b759f9084fdcccf7d36`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:26:55.902276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e85ba4c8-8435-487f-9d72-fe07f6fbc5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:56.033717 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3179/6321] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:26:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:26:56.516522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa63ebe-6a4c-4d80-836e-429ad3f71592 service swift] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:56.528839 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa63ebe-6a4c-4d80-836e-429ad3f71592 service swift] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:56.542955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050ad73-ccff-4635-8e67-d7f594a2b02f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:56.543591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050ad73-ccff-4635-8e67-d7f594a2b02f service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:56.543877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050ad73-ccff-4635-8e67-d7f594a2b02f service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:56.544162 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050ad73-ccff-4635-8e67-d7f594a2b02f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:56.551562 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e050ad73-ccff-4635-8e67-d7f594a2b02f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:56.581589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050ad73-ccff-4635-8e67-d7f594a2b02f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:56.583131 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050ad73-ccff-4635-8e67-d7f594a2b02f service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:26:56.613025 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3143/6322] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:26:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:26:59.734581 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ba4c8-8435-487f-9d72-fe07f6fbc5e9 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:26:59.736309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e85ba4c8-8435-487f-9d72-fe07f6fbc5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:26:59.822363 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ba4c8-8435-487f-9d72-fe07f6fbc5e9 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:26:59.841167 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d9d97-4587-4823-8188-0ac0b41c7b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:26:59.842261 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d9d97-4587-4823-8188-0ac0b41c7b8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:26:59.843391 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d9d97-4587-4823-8188-0ac0b41c7b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:26:59.843839 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d9d97-4587-4823-8188-0ac0b41c7b8d admin admin] PATH_INFO: `/v3/users/b39d22316a154afd90ff1887c72c10d8` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:26:59.863350 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d9d97-4587-4823-8188-0ac0b41c7b8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b39d22316a154afd90ff1887c72c10d8)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:26:59.878985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d9d97-4587-4823-8188-0ac0b41c7b8d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:27:00.045571 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9b5d9d97-4587-4823-8188-0ac0b41c7b8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b39d22316a154afd90ff1887c72c10d8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:27:00.049281 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9b5d9d97-4587-4823-8188-0ac0b41c7b8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b39d22316a154afd90ff1887c72c10d8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:27:00.079539 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9b5d9d97-4587-4823-8188-0ac0b41c7b8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b39d22316a154afd90ff1887c72c10d8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:27:00.121939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9b5d9d97-4587-4823-8188-0ac0b41c7b8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b39d22316a154afd90ff1887c72c10d8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:27:00.122603 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9b5d9d97-4587-4823-8188-0ac0b41c7b8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b39d22316a154afd90ff1887c72c10d8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:27:00.211688 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3180/6323] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:26:59 2022] DELETE /identity/v3/users/b39d22316a154afd90ff1887c72c10d8 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:27:00.820141 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050ad73-ccff-4635-8e67-d7f594a2b02f service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:27:00.843805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050ad73-ccff-4635-8e67-d7f594a2b02f service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:27:01.033920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db72799-63ec-4042-87a4-aa0a8696b00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:27:01.035024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db72799-63ec-4042-87a4-aa0a8696b00b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:27:01.035726 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db72799-63ec-4042-87a4-aa0a8696b00b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:27:01.036394 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db72799-63ec-4042-87a4-aa0a8696b00b admin admin] PATH_INFO: `/v3/projects/0f645c2372984102846875f1178d25bd` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:27:01.037985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db72799-63ec-4042-87a4-aa0a8696b00b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f645c2372984102846875f1178d25bd)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:27:01.042398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db72799-63ec-4042-87a4-aa0a8696b00b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:27:01.162370 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1db72799-63ec-4042-87a4-aa0a8696b00b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f645c2372984102846875f1178d25bd', 'request_id': 'req-1db72799-63ec-4042-87a4-aa0a8696b00b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:27:01.186678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1db72799-63ec-4042-87a4-aa0a8696b00b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f645c2372984102846875f1178d25bd', 'request_id': 'req-1db72799-63ec-4042-87a4-aa0a8696b00b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:27:01.205969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1db72799-63ec-4042-87a4-aa0a8696b00b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f645c2372984102846875f1178d25bd', 'request_id': 'req-1db72799-63ec-4042-87a4-aa0a8696b00b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:27:01.226666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1db72799-63ec-4042-87a4-aa0a8696b00b admin admin] The token cache is being invalidate because project 0f645c2372984102846875f1178d25bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:27:01.227176 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1db72799-63ec-4042-87a4-aa0a8696b00b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:27:01.228191 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1db72799-63ec-4042-87a4-aa0a8696b00b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:27:01.230700 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3144/6324] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:27:00 2022] DELETE /identity/v3/projects/0f645c2372984102846875f1178d25bd => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:27:01.237085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd932b4-3728-4531-a937-328491c7d250 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:27:01.238412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd932b4-3728-4531-a937-328491c7d250 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:27:01.238873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd932b4-3728-4531-a937-328491c7d250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:27:01.287609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-7fd932b4-3728-4531-a937-328491c7d250 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:27:01.289284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7fd932b4-3728-4531-a937-328491c7d250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:27:01.555607 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3181/6325] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:27:01.563786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec168ab-fda7-477a-886f-3d3387a8d6f2 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:27:01.564074 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec168ab-fda7-477a-886f-3d3387a8d6f2 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:27:01.564377 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec168ab-fda7-477a-886f-3d3387a8d6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:27:01.587896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-8ec168ab-fda7-477a-886f-3d3387a8d6f2 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:27:01.589201 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8ec168ab-fda7-477a-886f-3d3387a8d6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:27:01.606354 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd932b4-3728-4531-a937-328491c7d250 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:27:01.613069 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3145/6326] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:27:01.620647 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd932b4-3728-4531-a937-328491c7d250 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:27:01.626077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319276b7-385d-4ffd-bda5-325098ed175c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:27:01.626904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319276b7-385d-4ffd-bda5-325098ed175c admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:27:01.627491 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319276b7-385d-4ffd-bda5-325098ed175c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:27:01.627932 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319276b7-385d-4ffd-bda5-325098ed175c admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:27:01.628734 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319276b7-385d-4ffd-bda5-325098ed175c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:27:01.629183 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319276b7-385d-4ffd-bda5-325098ed175c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:27:01.631126 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319276b7-385d-4ffd-bda5-325098ed175c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:27:01.640148 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:27:01.654723 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3182/6327] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:27:01.655899 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec168ab-fda7-477a-886f-3d3387a8d6f2 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:27:01.668941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec168ab-fda7-477a-886f-3d3387a8d6f2 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:27:01.680503 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e60ab-6fa6-430a-b1f3-8202d90d5459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:27:01.684225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e60ab-6fa6-430a-b1f3-8202d90d5459 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:27:01.684869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e60ab-6fa6-430a-b1f3-8202d90d5459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:27:01.686010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e60ab-6fa6-430a-b1f3-8202d90d5459 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:27:01.688659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e60ab-6fa6-430a-b1f3-8202d90d5459 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:27:01.693973 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e60ab-6fa6-430a-b1f3-8202d90d5459 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:27:01.773848 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3146/6328] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:27:01 2022] POST /identity/v3/projects => generated 367 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:27:01.778953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319276b7-385d-4ffd-bda5-325098ed175c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:27:01.804246 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319276b7-385d-4ffd-bda5-325098ed175c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:27:02.009487 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85af2c-0fe7-4be6-a7a9-df0f131c5ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:27:02.012366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85af2c-0fe7-4be6-a7a9-df0f131c5ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:27:02.012657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85af2c-0fe7-4be6-a7a9-df0f131c5ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:27:02.012940 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85af2c-0fe7-4be6-a7a9-df0f131c5ce7 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:27:02.013628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85af2c-0fe7-4be6-a7a9-df0f131c5ce7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:27:02.015587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85af2c-0fe7-4be6-a7a9-df0f131c5ce7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:27:02.083842 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3183/6329] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:27:01 2022] POST /identity/v3/users => generated 284 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:27:02.087990 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e60ab-6fa6-430a-b1f3-8202d90d5459 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:27:02.103336 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e60ab-6fa6-430a-b1f3-8202d90d5459 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:27:02.118443 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4143c9-6b88-4bfb-92e9-b76438adc966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:27:02.119304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4143c9-6b88-4bfb-92e9-b76438adc966 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:27:02.127215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4143c9-6b88-4bfb-92e9-b76438adc966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:27:02.127820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4143c9-6b88-4bfb-92e9-b76438adc966 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:27:02.128789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4143c9-6b88-4bfb-92e9-b76438adc966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:27:02.140618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4143c9-6b88-4bfb-92e9-b76438adc966 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:27:02.169177 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3147/6330] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:27:02.171205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85af2c-0fe7-4be6-a7a9-df0f131c5ce7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:27:02.194597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85af2c-0fe7-4be6-a7a9-df0f131c5ce7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:27:02.201462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe124b-fdc2-4448-b19b-fa416ba296cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:27:02.203571 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe124b-fdc2-4448-b19b-fa416ba296cb admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:27:02.203912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe124b-fdc2-4448-b19b-fa416ba296cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:27:02.204321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe124b-fdc2-4448-b19b-fa416ba296cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:27:02.205056 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe124b-fdc2-4448-b19b-fa416ba296cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:27:02.234434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe124b-fdc2-4448-b19b-fa416ba296cb admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:27:02.253700 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3184/6331] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:27:02.257877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4143c9-6b88-4bfb-92e9-b76438adc966 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:27:02.269758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4143c9-6b88-4bfb-92e9-b76438adc966 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:27:02.284544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2d0ad-d734-4164-8f52-fa36448c6c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:27:02.286659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2d0ad-d734-4164-8f52-fa36448c6c9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:27:02.287536 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2d0ad-d734-4164-8f52-fa36448c6c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:27:02.289484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2d0ad-d734-4164-8f52-fa36448c6c9d admin admin] PATH_INFO: `/v3/projects/062bc353167746c38111c52516119046/users/0096f986882c420a81d07c3f3fb9ec43/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:27:02.323532 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2d0ad-d734-4164-8f52-fa36448c6c9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=062bc353167746c38111c52516119046, user_id=0096f986882c420a81d07c3f3fb9ec43, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:27:02.329996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2d0ad-d734-4164-8f52-fa36448c6c9d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:27:02.346535 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:27:02.355076 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3148/6332] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:27:02 2022] PUT /identity/v3/projects/062bc353167746c38111c52516119046/users/0096f986882c420a81d07c3f3fb9ec43/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:27:02.367345 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecb745-781c-4f4d-8635-0947fb270e09 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:27:02.367639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecb745-781c-4f4d-8635-0947fb270e09 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:27:02.367919 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecb745-781c-4f4d-8635-0947fb270e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:27:02.445873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-52ecb745-781c-4f4d-8635-0947fb270e09 None None] MFA Rules not processed for user `0096f986882c420a81d07c3f3fb9ec43`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:27:02.450246 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-52ecb745-781c-4f4d-8635-0947fb270e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:27:02.609822 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3185/6333] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:27:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:27:02.626185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2d0ad-d734-4164-8f52-fa36448c6c9d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:27:02.628886 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-61a2d0ad-d734-4164-8f52-fa36448c6c9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:27:02.706754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2d0ad-d734-4164-8f52-fa36448c6c9d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:27:02.710517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba434a4a-995b-4959-9a90-164b8b47c8c0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efcee9b21ea94b1b8e5c9c5acb35839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:27:02.711689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba434a4a-995b-4959-9a90-164b8b47c8c0 service glance] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:27:02.711689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba434a4a-995b-4959-9a90-164b8b47c8c0 service glance] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:27:02.711689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba434a4a-995b-4959-9a90-164b8b47c8c0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:27:02.722752 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba434a4a-995b-4959-9a90-164b8b47c8c0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:27:02.724401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba434a4a-995b-4959-9a90-164b8b47c8c0 service glance] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:27:02.757603 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3149/6334] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:27:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:27:12.595194 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=67,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:27:12.734342 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=26 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:27:13.687914 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e7d40-86bb-45ba-b49f-013e1c974279 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:27:13.688456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e7d40-86bb-45ba-b49f-013e1c974279 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:27:13.688575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e7d40-86bb-45ba-b49f-013e1c974279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:27:13.734198 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-642e7d40-86bb-45ba-b49f-013e1c974279 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:27:13.735506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-642e7d40-86bb-45ba-b49f-013e1c974279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:27:13.882557 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3186/6335] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 01:27:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:27:13.896363 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba434a4a-995b-4959-9a90-164b8b47c8c0 service glance] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:27:13.897843 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ba434a4a-995b-4959-9a90-164b8b47c8c0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:27:13.999667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba434a4a-995b-4959-9a90-164b8b47c8c0 service glance] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:27:14.006901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73972d5-6a3d-4c93-8381-d74844bbe35c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:27:14.007519 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73972d5-6a3d-4c93-8381-d74844bbe35c service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:27:14.008072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73972d5-6a3d-4c93-8381-d74844bbe35c service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:27:14.008523 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73972d5-6a3d-4c93-8381-d74844bbe35c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:27:14.020231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73972d5-6a3d-4c93-8381-d74844bbe35c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:27:14.024240 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73972d5-6a3d-4c93-8381-d74844bbe35c service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:27:14.040906 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3150/6336] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:27:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:27:23.873519 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=25 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:27:24.037026 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=32 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:27:31.295767 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a887ba6-e3f3-4478-b466-2bd9eae14cde None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:27:31.296277 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a887ba6-e3f3-4478-b466-2bd9eae14cde None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:27:31.297638 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a887ba6-e3f3-4478-b466-2bd9eae14cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:27:31.320177 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-5a887ba6-e3f3-4478-b466-2bd9eae14cde None None] MFA Rules not processed for user `a9787a91c5864d41bea568643916fe4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:27:31.321393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5a887ba6-e3f3-4478-b466-2bd9eae14cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:27:31.401671 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3187/6337] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:27:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:27:41.393502 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=25 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:27:46.753263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3334d-5715-4d1a-82a4-a6f2edb03792 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:27:46.753910 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3334d-5715-4d1a-82a4-a6f2edb03792 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:27:46.755195 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3334d-5715-4d1a-82a4-a6f2edb03792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:27:46.790573 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c7b3334d-5715-4d1a-82a4-a6f2edb03792 None None] MFA Rules not processed for user `bfd3e634551940cea7c8e492c7d8b79b`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:27:46.793250 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c7b3334d-5715-4d1a-82a4-a6f2edb03792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:27:46.923621 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3151/6338] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:27:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:27:53.606160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a887ba6-e3f3-4478-b466-2bd9eae14cde None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:27:53.608291 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5a887ba6-e3f3-4478-b466-2bd9eae14cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:27:53.714755 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a887ba6-e3f3-4478-b466-2bd9eae14cde None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:27:53.719879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b46f4-781c-4174-a8ef-f65f83fa40d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:27:53.720705 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b46f4-781c-4174-a8ef-f65f83fa40d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:27:53.721132 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b46f4-781c-4174-a8ef-f65f83fa40d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:27:53.721607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b46f4-781c-4174-a8ef-f65f83fa40d7 admin admin] PATH_INFO: `/v3/users/c7218510c88f493589895b3d86bd9451` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:27:53.723194 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b46f4-781c-4174-a8ef-f65f83fa40d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7218510c88f493589895b3d86bd9451)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:27:53.725642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b46f4-781c-4174-a8ef-f65f83fa40d7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:27:53.809588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c59b46f4-781c-4174-a8ef-f65f83fa40d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7218510c88f493589895b3d86bd9451'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:27:53.810281 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c59b46f4-781c-4174-a8ef-f65f83fa40d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7218510c88f493589895b3d86bd9451'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:27:53.819918 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c59b46f4-781c-4174-a8ef-f65f83fa40d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7218510c88f493589895b3d86bd9451'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:27:53.832055 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c59b46f4-781c-4174-a8ef-f65f83fa40d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7218510c88f493589895b3d86bd9451'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:27:53.833312 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c59b46f4-781c-4174-a8ef-f65f83fa40d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7218510c88f493589895b3d86bd9451'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:27:53.864642 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3188/6339] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:27:53 2022] DELETE /identity/v3/users/c7218510c88f493589895b3d86bd9451 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:27:53.870388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb578ac-9b31-41bc-bfa7-4c7b4876a7d7 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:27:53.871375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb578ac-9b31-41bc-bfa7-4c7b4876a7d7 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:27:53.874148 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb578ac-9b31-41bc-bfa7-4c7b4876a7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:27:53.918889 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-4bb578ac-9b31-41bc-bfa7-4c7b4876a7d7 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:27:53.920494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4bb578ac-9b31-41bc-bfa7-4c7b4876a7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:27:54.009655 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3152/6340] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:27:54.018892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b46f4-781c-4174-a8ef-f65f83fa40d7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:27:54.020513 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c59b46f4-781c-4174-a8ef-f65f83fa40d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:27:54.114574 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b46f4-781c-4174-a8ef-f65f83fa40d7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:27:54.119681 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ade68-afd6-4eb3-8b37-bdfe3aed6f38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:27:54.120535 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ade68-afd6-4eb3-8b37-bdfe3aed6f38 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:27:54.123883 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ade68-afd6-4eb3-8b37-bdfe3aed6f38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:27:54.124420 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ade68-afd6-4eb3-8b37-bdfe3aed6f38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:27:54.146256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ade68-afd6-4eb3-8b37-bdfe3aed6f38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:27:54.148515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ade68-afd6-4eb3-8b37-bdfe3aed6f38 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:27:54.180485 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3189/6341] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:27:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:27:54.505609 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb578ac-9b31-41bc-bfa7-4c7b4876a7d7 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:27:54.507818 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4bb578ac-9b31-41bc-bfa7-4c7b4876a7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:27:54.528928 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb578ac-9b31-41bc-bfa7-4c7b4876a7d7 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:27:54.538667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ae380-2e8a-425a-bbbf-ed6a3b2ad398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:27:54.540492 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ae380-2e8a-425a-bbbf-ed6a3b2ad398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:27:54.545501 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ae380-2e8a-425a-bbbf-ed6a3b2ad398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:27:54.545501 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ae380-2e8a-425a-bbbf-ed6a3b2ad398 admin admin] PATH_INFO: `/v3/projects/3d1aec6041834d3ba6ff0ba03822d43a` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:27:54.545501 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ae380-2e8a-425a-bbbf-ed6a3b2ad398 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d1aec6041834d3ba6ff0ba03822d43a)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:27:54.545856 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ae380-2e8a-425a-bbbf-ed6a3b2ad398 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:27:54.689752 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cd5ae380-2e8a-425a-bbbf-ed6a3b2ad398 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d1aec6041834d3ba6ff0ba03822d43a', 'request_id': 'req-cd5ae380-2e8a-425a-bbbf-ed6a3b2ad398'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:27:54.745239 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cd5ae380-2e8a-425a-bbbf-ed6a3b2ad398 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d1aec6041834d3ba6ff0ba03822d43a', 'request_id': 'req-cd5ae380-2e8a-425a-bbbf-ed6a3b2ad398'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:27:54.763437 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cd5ae380-2e8a-425a-bbbf-ed6a3b2ad398 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d1aec6041834d3ba6ff0ba03822d43a', 'request_id': 'req-cd5ae380-2e8a-425a-bbbf-ed6a3b2ad398'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:27:54.780508 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cd5ae380-2e8a-425a-bbbf-ed6a3b2ad398 admin admin] The token cache is being invalidate because project 3d1aec6041834d3ba6ff0ba03822d43a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:27:54.780909 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cd5ae380-2e8a-425a-bbbf-ed6a3b2ad398 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:27:54.781655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cd5ae380-2e8a-425a-bbbf-ed6a3b2ad398 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:27:54.783632 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3153/6342] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:27:54 2022] DELETE /identity/v3/projects/3d1aec6041834d3ba6ff0ba03822d43a => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:27:54.788708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6b88c-a172-41fe-aff5-4f9584fb7208 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:27:54.789728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6b88c-a172-41fe-aff5-4f9584fb7208 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:27:54.791020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6b88c-a172-41fe-aff5-4f9584fb7208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:27:54.818383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a5e6b88c-a172-41fe-aff5-4f9584fb7208 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:27:54.819702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a5e6b88c-a172-41fe-aff5-4f9584fb7208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:27:54.845144 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:27:54.934446 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3190/6343] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:27:54.935610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f602c6-7173-449a-97dd-576044f4a240 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:27:54.936015 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f602c6-7173-449a-97dd-576044f4a240 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:27:54.936200 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f602c6-7173-449a-97dd-576044f4a240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:27:54.958723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b1f602c6-7173-449a-97dd-576044f4a240 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:27:54.959692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b1f602c6-7173-449a-97dd-576044f4a240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:27:54.967876 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3154/6344] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:27:54.972256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6b88c-a172-41fe-aff5-4f9584fb7208 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:27:54.984930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6b88c-a172-41fe-aff5-4f9584fb7208 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:27:54.992428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30a82e-df5e-45bb-bbe3-c8e665895c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:27:54.993677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30a82e-df5e-45bb-bbe3-c8e665895c3f admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:27:54.993961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30a82e-df5e-45bb-bbe3-c8e665895c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:27:54.994237 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30a82e-df5e-45bb-bbe3-c8e665895c3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:27:54.994901 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30a82e-df5e-45bb-bbe3-c8e665895c3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:27:54.995206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30a82e-df5e-45bb-bbe3-c8e665895c3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:27:54.997229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30a82e-df5e-45bb-bbe3-c8e665895c3f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:27:55.013366 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3191/6345] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:27:55.018432 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f602c6-7173-449a-97dd-576044f4a240 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:27:55.030082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f602c6-7173-449a-97dd-576044f4a240 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:27:55.035416 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3e1be-f001-4e1c-bdf4-2bdb2700e771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:27:55.036230 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3e1be-f001-4e1c-bdf4-2bdb2700e771 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:27:55.036663 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3e1be-f001-4e1c-bdf4-2bdb2700e771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:27:55.037531 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3e1be-f001-4e1c-bdf4-2bdb2700e771 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:27:55.038381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d3e1be-f001-4e1c-bdf4-2bdb2700e771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:27:55.041784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d3e1be-f001-4e1c-bdf4-2bdb2700e771 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:27:55.073679 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:27:55.086031 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3155/6346] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:27:55 2022] POST /identity/v3/projects => generated 359 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:27:55.090207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30a82e-df5e-45bb-bbe3-c8e665895c3f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:27:55.102921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30a82e-df5e-45bb-bbe3-c8e665895c3f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:27:55.197569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7b9e6-21d1-47e7-9e6e-a7c28c4183df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:27:55.198202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7b9e6-21d1-47e7-9e6e-a7c28c4183df admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:27:55.198610 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7b9e6-21d1-47e7-9e6e-a7c28c4183df admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:27:55.198895 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7b9e6-21d1-47e7-9e6e-a7c28c4183df admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:27:55.199534 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7b9e6-21d1-47e7-9e6e-a7c28c4183df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:27:55.201595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7b9e6-21d1-47e7-9e6e-a7c28c4183df admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:27:55.237786 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3192/6347] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:27:55 2022] POST /identity/v3/users => generated 280 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:27:55.241287 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3e1be-f001-4e1c-bdf4-2bdb2700e771 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:27:55.256072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3e1be-f001-4e1c-bdf4-2bdb2700e771 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:27:55.261133 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f914562-aabf-4898-80c8-9af089fb1a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:27:55.263001 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f914562-aabf-4898-80c8-9af089fb1a44 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:27:55.263299 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f914562-aabf-4898-80c8-9af089fb1a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:27:55.263733 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f914562-aabf-4898-80c8-9af089fb1a44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:27:55.264452 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f914562-aabf-4898-80c8-9af089fb1a44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:27:55.267584 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f914562-aabf-4898-80c8-9af089fb1a44 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:27:55.288752 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3156/6348] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:27:55.290530 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7b9e6-21d1-47e7-9e6e-a7c28c4183df admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:27:55.302857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7b9e6-21d1-47e7-9e6e-a7c28c4183df admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:27:55.309554 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf72485-2148-46f6-9461-c461efa524ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:27:55.310392 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf72485-2148-46f6-9461-c461efa524ff admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:27:55.310966 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf72485-2148-46f6-9461-c461efa524ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:27:55.311504 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf72485-2148-46f6-9461-c461efa524ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:27:55.312331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf72485-2148-46f6-9461-c461efa524ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:27:55.314602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf72485-2148-46f6-9461-c461efa524ff admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:27:55.336979 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3193/6349] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:27:55.339466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f914562-aabf-4898-80c8-9af089fb1a44 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:27:55.356876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f914562-aabf-4898-80c8-9af089fb1a44 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:27:55.366461 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e8044-79ae-43c8-9b46-0a3c1f33edf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:27:55.367272 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e8044-79ae-43c8-9b46-0a3c1f33edf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:27:55.369767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e8044-79ae-43c8-9b46-0a3c1f33edf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:27:55.370354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e8044-79ae-43c8-9b46-0a3c1f33edf9 admin admin] PATH_INFO: `/v3/projects/9385f441900f4a789f9a56fb383dbd50/users/0c6f1a91c035491ea2da3f7f3e46a814/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:27:55.392162 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e8044-79ae-43c8-9b46-0a3c1f33edf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9385f441900f4a789f9a56fb383dbd50, user_id=0c6f1a91c035491ea2da3f7f3e46a814, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:27:55.395820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e8044-79ae-43c8-9b46-0a3c1f33edf9 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:27:55.422695 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3157/6350] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:27:55 2022] PUT /identity/v3/projects/9385f441900f4a789f9a56fb383dbd50/users/0c6f1a91c035491ea2da3f7f3e46a814/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:27:55.424421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae486557-b0d9-436b-b373-1d8afc2d95f2 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:27:55.424713 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae486557-b0d9-436b-b373-1d8afc2d95f2 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:27:55.424986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae486557-b0d9-436b-b373-1d8afc2d95f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:27:55.463183 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ae486557-b0d9-436b-b373-1d8afc2d95f2 None None] MFA Rules not processed for user `0c6f1a91c035491ea2da3f7f3e46a814`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:27:55.464829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ae486557-b0d9-436b-b373-1d8afc2d95f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:27:55.620715 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3194/6351] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:27:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:27:55.641072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e8044-79ae-43c8-9b46-0a3c1f33edf9 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:27:55.642950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-468e8044-79ae-43c8-9b46-0a3c1f33edf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:27:55.817173 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e8044-79ae-43c8-9b46-0a3c1f33edf9 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:27:55.825548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7bb13-06d0-4d7b-bd54-73e04d2b43fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:27:55.826343 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7bb13-06d0-4d7b-bd54-73e04d2b43fd service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:27:55.826631 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7bb13-06d0-4d7b-bd54-73e04d2b43fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:27:55.826921 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7bb13-06d0-4d7b-bd54-73e04d2b43fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:27:55.858055 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece7bb13-06d0-4d7b-bd54-73e04d2b43fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:27:55.860948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece7bb13-06d0-4d7b-bd54-73e04d2b43fd service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:27:55.893584 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3158/6352] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:27:55 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:28:05.001689 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae486557-b0d9-436b-b373-1d8afc2d95f2 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:28:05.004134 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ae486557-b0d9-436b-b373-1d8afc2d95f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:28:05.027858 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:28:05.181084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae486557-b0d9-436b-b373-1d8afc2d95f2 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:28:05.207430 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0570087-7f60-4084-9898-6100de90dc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:28:05.208111 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0570087-7f60-4084-9898-6100de90dc28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:05.208396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0570087-7f60-4084-9898-6100de90dc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:05.208671 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0570087-7f60-4084-9898-6100de90dc28 admin admin] PATH_INFO: `/v3/users/d49428a9b0c14a1baed458f7ab91734c` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:05.209840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0570087-7f60-4084-9898-6100de90dc28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d49428a9b0c14a1baed458f7ab91734c)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:28:05.211820 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0570087-7f60-4084-9898-6100de90dc28 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:28:05.292625 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e0570087-7f60-4084-9898-6100de90dc28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd49428a9b0c14a1baed458f7ab91734c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:28:05.293542 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e0570087-7f60-4084-9898-6100de90dc28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd49428a9b0c14a1baed458f7ab91734c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:28:05.306661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e0570087-7f60-4084-9898-6100de90dc28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd49428a9b0c14a1baed458f7ab91734c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:28:05.321992 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e0570087-7f60-4084-9898-6100de90dc28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd49428a9b0c14a1baed458f7ab91734c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:28:05.324839 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e0570087-7f60-4084-9898-6100de90dc28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd49428a9b0c14a1baed458f7ab91734c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:28:05.353237 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3195/6353] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:28:05 2022] DELETE /identity/v3/users/d49428a9b0c14a1baed458f7ab91734c => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:28:05.355927 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b64e6-8539-4b57-b1d3-2914b10fa430 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:05.356452 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b64e6-8539-4b57-b1d3-2914b10fa430 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:05.356599 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b64e6-8539-4b57-b1d3-2914b10fa430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:05.391912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-499b64e6-8539-4b57-b1d3-2914b10fa430 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:28:05.393162 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-499b64e6-8539-4b57-b1d3-2914b10fa430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:28:05.492799 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3159/6354] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:28:05.499590 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0570087-7f60-4084-9898-6100de90dc28 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:28:05.501213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e0570087-7f60-4084-9898-6100de90dc28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:28:05.583321 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:28:05.591510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0570087-7f60-4084-9898-6100de90dc28 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:28:05.598657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ac838-e280-44b4-83e0-030ee31d033c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:28:05.599594 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ac838-e280-44b4-83e0-030ee31d033c service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:05.600192 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ac838-e280-44b4-83e0-030ee31d033c service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:05.600476 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ac838-e280-44b4-83e0-030ee31d033c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:05.611782 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ac838-e280-44b4-83e0-030ee31d033c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:28:05.613548 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ac838-e280-44b4-83e0-030ee31d033c service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:28:05.625517 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3196/6355] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:28:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:28:06.001728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b64e6-8539-4b57-b1d3-2914b10fa430 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:28:06.004534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-499b64e6-8539-4b57-b1d3-2914b10fa430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:28:06.029116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b64e6-8539-4b57-b1d3-2914b10fa430 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:28:06.037468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b043ed4-1d6e-4bf9-af84-73e4eafe8dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:28:06.038141 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b043ed4-1d6e-4bf9-af84-73e4eafe8dc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:06.038568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b043ed4-1d6e-4bf9-af84-73e4eafe8dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:06.038839 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b043ed4-1d6e-4bf9-af84-73e4eafe8dc8 admin admin] PATH_INFO: `/v3/projects/14613cd21bcc4429937a13b6ab956fea` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:06.042190 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b043ed4-1d6e-4bf9-af84-73e4eafe8dc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14613cd21bcc4429937a13b6ab956fea)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:28:06.044125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b043ed4-1d6e-4bf9-af84-73e4eafe8dc8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:28:06.143522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1b043ed4-1d6e-4bf9-af84-73e4eafe8dc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14613cd21bcc4429937a13b6ab956fea', 'request_id': 'req-1b043ed4-1d6e-4bf9-af84-73e4eafe8dc8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:28:06.156693 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1b043ed4-1d6e-4bf9-af84-73e4eafe8dc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14613cd21bcc4429937a13b6ab956fea', 'request_id': 'req-1b043ed4-1d6e-4bf9-af84-73e4eafe8dc8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:28:06.165325 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:28:06.167564 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1b043ed4-1d6e-4bf9-af84-73e4eafe8dc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14613cd21bcc4429937a13b6ab956fea', 'request_id': 'req-1b043ed4-1d6e-4bf9-af84-73e4eafe8dc8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:28:06.190038 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1b043ed4-1d6e-4bf9-af84-73e4eafe8dc8 admin admin] The token cache is being invalidate because project 14613cd21bcc4429937a13b6ab956fea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:28:06.190567 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1b043ed4-1d6e-4bf9-af84-73e4eafe8dc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:28:06.191860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1b043ed4-1d6e-4bf9-af84-73e4eafe8dc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:28:06.197051 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3160/6356] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:28:06 2022] DELETE /identity/v3/projects/14613cd21bcc4429937a13b6ab956fea => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:28:06.201007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ac838-e280-44b4-83e0-030ee31d033c service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:28:06.211721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ac838-e280-44b4-83e0-030ee31d033c service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:28:06.284204 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604a903-269f-40fd-a49a-5f96fb43586e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:28:06.285374 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604a903-269f-40fd-a49a-5f96fb43586e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:06.285792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604a903-269f-40fd-a49a-5f96fb43586e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:06.286169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604a903-269f-40fd-a49a-5f96fb43586e admin admin] PATH_INFO: `/v3/users/22256dbb10f740a199eccf4242f0dc57` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:06.287455 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604a903-269f-40fd-a49a-5f96fb43586e admin admin] RBAC: Authorizing `identity:delete_user(user_id=22256dbb10f740a199eccf4242f0dc57)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:28:06.289830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604a903-269f-40fd-a49a-5f96fb43586e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:28:06.353859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5604a903-269f-40fd-a49a-5f96fb43586e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22256dbb10f740a199eccf4242f0dc57'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:28:06.354598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5604a903-269f-40fd-a49a-5f96fb43586e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22256dbb10f740a199eccf4242f0dc57'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:28:06.365922 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5604a903-269f-40fd-a49a-5f96fb43586e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22256dbb10f740a199eccf4242f0dc57'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:28:06.380705 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5604a903-269f-40fd-a49a-5f96fb43586e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22256dbb10f740a199eccf4242f0dc57'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:28:06.381811 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5604a903-269f-40fd-a49a-5f96fb43586e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22256dbb10f740a199eccf4242f0dc57'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:28:06.403256 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3197/6357] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:28:06 2022] DELETE /identity/v3/users/22256dbb10f740a199eccf4242f0dc57 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:28:06.876696 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b043ed4-1d6e-4bf9-af84-73e4eafe8dc8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:28:06.878481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1b043ed4-1d6e-4bf9-af84-73e4eafe8dc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:28:06.913868 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b043ed4-1d6e-4bf9-af84-73e4eafe8dc8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:28:06.993474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f7b79-39c1-449c-a463-7dc28de99f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:28:06.994233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f7b79-39c1-449c-a463-7dc28de99f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:06.994516 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f7b79-39c1-449c-a463-7dc28de99f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:06.994785 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f7b79-39c1-449c-a463-7dc28de99f54 admin admin] PATH_INFO: `/v3/projects/98a0cbda3a1345128c5ba19ed7e4ed91` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:06.995910 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f7b79-39c1-449c-a463-7dc28de99f54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98a0cbda3a1345128c5ba19ed7e4ed91)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:28:06.998023 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f7b79-39c1-449c-a463-7dc28de99f54 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:28:07.057097 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1a8f7b79-39c1-449c-a463-7dc28de99f54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98a0cbda3a1345128c5ba19ed7e4ed91', 'request_id': 'req-1a8f7b79-39c1-449c-a463-7dc28de99f54'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:28:07.066864 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1a8f7b79-39c1-449c-a463-7dc28de99f54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98a0cbda3a1345128c5ba19ed7e4ed91', 'request_id': 'req-1a8f7b79-39c1-449c-a463-7dc28de99f54'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:28:07.073961 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1a8f7b79-39c1-449c-a463-7dc28de99f54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98a0cbda3a1345128c5ba19ed7e4ed91', 'request_id': 'req-1a8f7b79-39c1-449c-a463-7dc28de99f54'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:28:07.086419 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1a8f7b79-39c1-449c-a463-7dc28de99f54 admin admin] The token cache is being invalidate because project 98a0cbda3a1345128c5ba19ed7e4ed91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:28:07.086808 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1a8f7b79-39c1-449c-a463-7dc28de99f54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:28:07.087556 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1a8f7b79-39c1-449c-a463-7dc28de99f54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:28:07.092580 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3161/6358] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:28:06 2022] DELETE /identity/v3/projects/98a0cbda3a1345128c5ba19ed7e4ed91 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:28:07.095004 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1f4bf-715e-4035-897a-d11917e16e24 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:07.095762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1f4bf-715e-4035-897a-d11917e16e24 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:07.097125 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1f4bf-715e-4035-897a-d11917e16e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:07.122310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-68e1f4bf-715e-4035-897a-d11917e16e24 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:28:07.123596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-68e1f4bf-715e-4035-897a-d11917e16e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:28:07.200401 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3198/6359] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:28:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:28:07.208941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ce5fc-ad3d-4d1d-b45e-5fd4cf28f831 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:07.209387 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ce5fc-ad3d-4d1d-b45e-5fd4cf28f831 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:07.210038 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ce5fc-ad3d-4d1d-b45e-5fd4cf28f831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:07.243295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5b0ce5fc-ad3d-4d1d-b45e-5fd4cf28f831 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:28:07.245498 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5b0ce5fc-ad3d-4d1d-b45e-5fd4cf28f831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:28:07.256954 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3162/6360] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:28:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:28:07.266626 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1f4bf-715e-4035-897a-d11917e16e24 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:28:07.277839 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1f4bf-715e-4035-897a-d11917e16e24 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:28:07.283822 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bed090-ece3-45bf-8e3b-08255e30e339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:28:07.284692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bed090-ece3-45bf-8e3b-08255e30e339 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:07.285289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bed090-ece3-45bf-8e3b-08255e30e339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:07.285927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bed090-ece3-45bf-8e3b-08255e30e339 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:07.286702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bed090-ece3-45bf-8e3b-08255e30e339 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:28:07.287104 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bed090-ece3-45bf-8e3b-08255e30e339 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:28:07.288861 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bed090-ece3-45bf-8e3b-08255e30e339 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:28:07.299426 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:28:07.310815 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3199/6361] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:28:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:28:07.311702 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ce5fc-ad3d-4d1d-b45e-5fd4cf28f831 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:28:07.324489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ce5fc-ad3d-4d1d-b45e-5fd4cf28f831 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:28:07.330701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1c64d-1614-41a8-acc8-e147515a128c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:28:07.331455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1c64d-1614-41a8-acc8-e147515a128c admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:07.331818 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1c64d-1614-41a8-acc8-e147515a128c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:07.332353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1c64d-1614-41a8-acc8-e147515a128c admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:07.333478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b1c64d-1614-41a8-acc8-e147515a128c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:28:07.335623 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b1c64d-1614-41a8-acc8-e147515a128c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:28:07.369369 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3163/6362] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:28:07 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:28:07.373464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bed090-ece3-45bf-8e3b-08255e30e339 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:28:07.384358 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bed090-ece3-45bf-8e3b-08255e30e339 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:28:07.469115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1d225-4e83-4dc9-b72a-ea38109f5298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:28:07.469984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1d225-4e83-4dc9-b72a-ea38109f5298 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:07.470366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1d225-4e83-4dc9-b72a-ea38109f5298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:07.470735 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1d225-4e83-4dc9-b72a-ea38109f5298 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:07.472531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1d225-4e83-4dc9-b72a-ea38109f5298 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:28:07.475775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1d225-4e83-4dc9-b72a-ea38109f5298 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:28:07.501505 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3200/6363] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:28:07 2022] POST /identity/v3/users => generated 288 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:28:07.505331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1c64d-1614-41a8-acc8-e147515a128c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:28:07.518833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1c64d-1614-41a8-acc8-e147515a128c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:28:07.524967 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80293eca-f5c0-41ad-8b81-6a0c0927ca1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:28:07.525710 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80293eca-f5c0-41ad-8b81-6a0c0927ca1c admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:07.526321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80293eca-f5c0-41ad-8b81-6a0c0927ca1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:07.526667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80293eca-f5c0-41ad-8b81-6a0c0927ca1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:07.527409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80293eca-f5c0-41ad-8b81-6a0c0927ca1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:28:07.529066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80293eca-f5c0-41ad-8b81-6a0c0927ca1c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:28:07.540813 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3164/6364] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:28:07.544811 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1d225-4e83-4dc9-b72a-ea38109f5298 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:28:07.555636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1d225-4e83-4dc9-b72a-ea38109f5298 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:28:07.560512 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde47b0-c796-4a61-86f5-9d75800a26f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:28:07.561248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde47b0-c796-4a61-86f5-9d75800a26f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:07.561564 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde47b0-c796-4a61-86f5-9d75800a26f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:07.561901 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde47b0-c796-4a61-86f5-9d75800a26f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:07.562616 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde47b0-c796-4a61-86f5-9d75800a26f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:28:07.564276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde47b0-c796-4a61-86f5-9d75800a26f8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:28:07.575631 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3201/6365] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:28:07.579791 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80293eca-f5c0-41ad-8b81-6a0c0927ca1c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:28:07.591579 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80293eca-f5c0-41ad-8b81-6a0c0927ca1c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:28:07.596318 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6024e1f-bf1d-4779-8842-0748cec11794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:28:07.596968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6024e1f-bf1d-4779-8842-0748cec11794 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:07.597367 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6024e1f-bf1d-4779-8842-0748cec11794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:07.597793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6024e1f-bf1d-4779-8842-0748cec11794 admin admin] PATH_INFO: `/v3/projects/5b86fba5842b4d30a8f87091fa4fd312/users/856563aa981b4b9093c57c8d86482086/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:07.617388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6024e1f-bf1d-4779-8842-0748cec11794 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b86fba5842b4d30a8f87091fa4fd312, user_id=856563aa981b4b9093c57c8d86482086, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:28:07.620495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6024e1f-bf1d-4779-8842-0748cec11794 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:28:07.635808 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3165/6366] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:28:07 2022] PUT /identity/v3/projects/5b86fba5842b4d30a8f87091fa4fd312/users/856563aa981b4b9093c57c8d86482086/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:28:07.649151 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65e799-9609-499b-8c7c-56aba3fd9e92 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:07.649151 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65e799-9609-499b-8c7c-56aba3fd9e92 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:07.649557 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65e799-9609-499b-8c7c-56aba3fd9e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:07.683390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-9b65e799-9609-499b-8c7c-56aba3fd9e92 None None] MFA Rules not processed for user `856563aa981b4b9093c57c8d86482086`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:28:07.684677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9b65e799-9609-499b-8c7c-56aba3fd9e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:28:07.794165 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3202/6367] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:28:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:28:07.807074 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6024e1f-bf1d-4779-8842-0748cec11794 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:28:07.809144 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f6024e1f-bf1d-4779-8842-0748cec11794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:28:07.837470 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:28:07.891130 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6024e1f-bf1d-4779-8842-0748cec11794 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:28:07.907419 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d9bc2-4adf-4978-a1ba-1fc517f0ca15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:28:07.908462 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d9bc2-4adf-4978-a1ba-1fc517f0ca15 service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:07.908960 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d9bc2-4adf-4978-a1ba-1fc517f0ca15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:07.909470 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d9bc2-4adf-4978-a1ba-1fc517f0ca15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:07.921891 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d9bc2-4adf-4978-a1ba-1fc517f0ca15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:28:07.924660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d9bc2-4adf-4978-a1ba-1fc517f0ca15 service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:28:07.936132 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3166/6368] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:28:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:28:17.779310 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=67,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:28:17.931034 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=18 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:28:20.953225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b65e799-9609-499b-8c7c-56aba3fd9e92 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:28:20.955334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9b65e799-9609-499b-8c7c-56aba3fd9e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:28:21.097715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b65e799-9609-499b-8c7c-56aba3fd9e92 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:28:21.108897 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d96de-a00c-4709-89b7-97e4f858c52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:28:21.109941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d96de-a00c-4709-89b7-97e4f858c52c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:21.110457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d96de-a00c-4709-89b7-97e4f858c52c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:21.110927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d96de-a00c-4709-89b7-97e4f858c52c admin admin] PATH_INFO: `/v3/users/0096f986882c420a81d07c3f3fb9ec43` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:21.113091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d96de-a00c-4709-89b7-97e4f858c52c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0096f986882c420a81d07c3f3fb9ec43)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:28:21.117229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d96de-a00c-4709-89b7-97e4f858c52c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:28:21.209695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e42d96de-a00c-4709-89b7-97e4f858c52c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0096f986882c420a81d07c3f3fb9ec43'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:28:21.211154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e42d96de-a00c-4709-89b7-97e4f858c52c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0096f986882c420a81d07c3f3fb9ec43'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:28:21.226880 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e42d96de-a00c-4709-89b7-97e4f858c52c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0096f986882c420a81d07c3f3fb9ec43'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:28:21.243969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e42d96de-a00c-4709-89b7-97e4f858c52c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0096f986882c420a81d07c3f3fb9ec43'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:28:21.244773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e42d96de-a00c-4709-89b7-97e4f858c52c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0096f986882c420a81d07c3f3fb9ec43'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:28:21.280903 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3203/6369] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:28:20 2022] DELETE /identity/v3/users/0096f986882c420a81d07c3f3fb9ec43 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:28:21.285171 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e9829-f65c-4e19-8371-676a2dabb081 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:21.286115 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e9829-f65c-4e19-8371-676a2dabb081 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:21.286229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e9829-f65c-4e19-8371-676a2dabb081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:21.316804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d61e9829-f65c-4e19-8371-676a2dabb081 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:28:21.320885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d61e9829-f65c-4e19-8371-676a2dabb081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:28:21.409828 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3167/6370] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:28:21.419926 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d96de-a00c-4709-89b7-97e4f858c52c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:28:21.421702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e42d96de-a00c-4709-89b7-97e4f858c52c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:28:21.525275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d96de-a00c-4709-89b7-97e4f858c52c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:28:21.529172 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd82032-c7eb-4ff4-9d9c-ca2f431856bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:28:21.529849 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd82032-c7eb-4ff4-9d9c-ca2f431856bf service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:21.530279 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd82032-c7eb-4ff4-9d9c-ca2f431856bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:21.530562 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd82032-c7eb-4ff4-9d9c-ca2f431856bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:21.542992 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd82032-c7eb-4ff4-9d9c-ca2f431856bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:28:21.545292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd82032-c7eb-4ff4-9d9c-ca2f431856bf service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:28:21.560467 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3204/6371] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:28:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:28:22.108032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e9829-f65c-4e19-8371-676a2dabb081 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:28:22.109563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d61e9829-f65c-4e19-8371-676a2dabb081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:28:22.128093 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e9829-f65c-4e19-8371-676a2dabb081 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:28:22.141460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdebcd-4a3d-452c-9cd0-f93d502411d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:28:22.142943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdebcd-4a3d-452c-9cd0-f93d502411d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:22.143221 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdebcd-4a3d-452c-9cd0-f93d502411d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:22.143489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdebcd-4a3d-452c-9cd0-f93d502411d0 admin admin] PATH_INFO: `/v3/projects/062bc353167746c38111c52516119046` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:22.144888 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cdebcd-4a3d-452c-9cd0-f93d502411d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=062bc353167746c38111c52516119046)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:28:22.147688 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cdebcd-4a3d-452c-9cd0-f93d502411d0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:28:22.248533 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-35cdebcd-4a3d-452c-9cd0-f93d502411d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '062bc353167746c38111c52516119046', 'request_id': 'req-35cdebcd-4a3d-452c-9cd0-f93d502411d0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:28:22.274617 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-35cdebcd-4a3d-452c-9cd0-f93d502411d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '062bc353167746c38111c52516119046', 'request_id': 'req-35cdebcd-4a3d-452c-9cd0-f93d502411d0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:28:22.291784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-35cdebcd-4a3d-452c-9cd0-f93d502411d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '062bc353167746c38111c52516119046', 'request_id': 'req-35cdebcd-4a3d-452c-9cd0-f93d502411d0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:28:22.328615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-35cdebcd-4a3d-452c-9cd0-f93d502411d0 admin admin] The token cache is being invalidate because project 062bc353167746c38111c52516119046 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:28:22.328908 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-35cdebcd-4a3d-452c-9cd0-f93d502411d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:28:22.329881 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-35cdebcd-4a3d-452c-9cd0-f93d502411d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:28:22.332192 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3168/6372] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:28:22 2022] DELETE /identity/v3/projects/062bc353167746c38111c52516119046 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:28:22.337343 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f74df-4166-490f-8973-c50556befb61 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:22.337847 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f74df-4166-490f-8973-c50556befb61 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:22.337847 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f74df-4166-490f-8973-c50556befb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:22.374556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-253f74df-4166-490f-8973-c50556befb61 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:28:22.378295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-253f74df-4166-490f-8973-c50556befb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:28:22.421214 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:28:22.513920 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3205/6373] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:28:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:28:22.523662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cf7e5-56f3-42e0-9852-50ddf6e3afb5 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:22.524270 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cf7e5-56f3-42e0-9852-50ddf6e3afb5 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:22.524739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cf7e5-56f3-42e0-9852-50ddf6e3afb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:22.566218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c67cf7e5-56f3-42e0-9852-50ddf6e3afb5 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:28:22.568310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c67cf7e5-56f3-42e0-9852-50ddf6e3afb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:28:22.577950 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3169/6374] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:28:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:28:22.581968 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f74df-4166-490f-8973-c50556befb61 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:28:22.595058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f74df-4166-490f-8973-c50556befb61 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:28:22.600920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209290e-9882-4f82-bd4e-217afbd28716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:28:22.602219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209290e-9882-4f82-bd4e-217afbd28716 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:22.602587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209290e-9882-4f82-bd4e-217afbd28716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:22.602933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209290e-9882-4f82-bd4e-217afbd28716 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:22.603655 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6209290e-9882-4f82-bd4e-217afbd28716 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:28:22.604023 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6209290e-9882-4f82-bd4e-217afbd28716 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:28:22.605756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6209290e-9882-4f82-bd4e-217afbd28716 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:28:22.623932 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3206/6375] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:28:22.628870 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67cf7e5-56f3-42e0-9852-50ddf6e3afb5 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:28:22.642850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67cf7e5-56f3-42e0-9852-50ddf6e3afb5 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:28:22.661781 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1298a-41d3-4f9d-867d-80bccd5356ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:28:22.662432 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1298a-41d3-4f9d-867d-80bccd5356ba admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:22.662714 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1298a-41d3-4f9d-867d-80bccd5356ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:22.662981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1298a-41d3-4f9d-867d-80bccd5356ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:22.664168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca1298a-41d3-4f9d-867d-80bccd5356ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:28:22.666122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca1298a-41d3-4f9d-867d-80bccd5356ba admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:28:22.721007 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3170/6376] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:28:22 2022] POST /identity/v3/projects => generated 391 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:28:22.725359 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209290e-9882-4f82-bd4e-217afbd28716 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:28:22.741533 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209290e-9882-4f82-bd4e-217afbd28716 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:28:22.829422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269592cc-8ae2-496a-8a91-bf73791e10ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:28:22.831248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269592cc-8ae2-496a-8a91-bf73791e10ed admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:22.831537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269592cc-8ae2-496a-8a91-bf73791e10ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:22.831815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269592cc-8ae2-496a-8a91-bf73791e10ed admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:22.832576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269592cc-8ae2-496a-8a91-bf73791e10ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:28:22.835957 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269592cc-8ae2-496a-8a91-bf73791e10ed admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:28:22.866059 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3207/6377] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:28:22 2022] POST /identity/v3/users => generated 296 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:28:22.870475 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1298a-41d3-4f9d-867d-80bccd5356ba admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:28:22.885878 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1298a-41d3-4f9d-867d-80bccd5356ba admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:28:22.891929 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef23b4-56a0-4b65-bc25-6d5283fb40ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:28:22.892769 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef23b4-56a0-4b65-bc25-6d5283fb40ac admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:22.893047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef23b4-56a0-4b65-bc25-6d5283fb40ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:22.893499 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef23b4-56a0-4b65-bc25-6d5283fb40ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:22.894129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef23b4-56a0-4b65-bc25-6d5283fb40ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:28:22.896410 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef23b4-56a0-4b65-bc25-6d5283fb40ac admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:28:22.913637 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3171/6378] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:28:22.915146 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269592cc-8ae2-496a-8a91-bf73791e10ed admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:28:22.928399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269592cc-8ae2-496a-8a91-bf73791e10ed admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:28:22.936307 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aaef55-87e9-4cc2-a59f-adbf9e9d06e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:28:22.937582 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aaef55-87e9-4cc2-a59f-adbf9e9d06e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:22.937874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aaef55-87e9-4cc2-a59f-adbf9e9d06e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:22.938154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aaef55-87e9-4cc2-a59f-adbf9e9d06e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:22.939026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aaef55-87e9-4cc2-a59f-adbf9e9d06e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:28:22.941381 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aaef55-87e9-4cc2-a59f-adbf9e9d06e3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:28:22.958409 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3208/6379] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:28:22.959641 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef23b4-56a0-4b65-bc25-6d5283fb40ac admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:28:22.973378 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef23b4-56a0-4b65-bc25-6d5283fb40ac admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:28:22.984932 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17dcc99-eac0-4044-a2d3-d4dd3a6eb2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:28:22.985613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17dcc99-eac0-4044-a2d3-d4dd3a6eb2c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:22.986074 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17dcc99-eac0-4044-a2d3-d4dd3a6eb2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:22.986402 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17dcc99-eac0-4044-a2d3-d4dd3a6eb2c7 admin admin] PATH_INFO: `/v3/projects/5f680bdbe357495d8f22cd14d454d17c/users/ece1d6709f6d480fbaffa3b47f293dcb/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:23.017361 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17dcc99-eac0-4044-a2d3-d4dd3a6eb2c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f680bdbe357495d8f22cd14d454d17c, user_id=ece1d6709f6d480fbaffa3b47f293dcb, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:28:23.020401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17dcc99-eac0-4044-a2d3-d4dd3a6eb2c7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:28:23.045383 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3172/6380] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:28:22 2022] PUT /identity/v3/projects/5f680bdbe357495d8f22cd14d454d17c/users/ece1d6709f6d480fbaffa3b47f293dcb/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:28:23.056219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59611a-18ba-4060-8a44-872e8051e2eb None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:23.056544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59611a-18ba-4060-8a44-872e8051e2eb None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:23.056789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59611a-18ba-4060-8a44-872e8051e2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:23.092873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-3d59611a-18ba-4060-8a44-872e8051e2eb None None] MFA Rules not processed for user `ece1d6709f6d480fbaffa3b47f293dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:28:23.094355 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3d59611a-18ba-4060-8a44-872e8051e2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:28:23.192273 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3209/6381] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:28:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:28:23.197408 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17dcc99-eac0-4044-a2d3-d4dd3a6eb2c7 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:28:23.225951 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:28:23.336096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17dcc99-eac0-4044-a2d3-d4dd3a6eb2c7 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:28:23.341881 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b590c9-d4d9-4117-836f-41ec2ae94dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:28:23.342925 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b590c9-d4d9-4117-836f-41ec2ae94dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:23.343300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b590c9-d4d9-4117-836f-41ec2ae94dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:23.343656 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b590c9-d4d9-4117-836f-41ec2ae94dc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:23.344376 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b590c9-d4d9-4117-836f-41ec2ae94dc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:28:23.347293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b590c9-d4d9-4117-836f-41ec2ae94dc0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:28:23.407807 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3173/6382] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:28:23 2022] POST /identity/v3/projects => generated 393 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:28:23.411333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59611a-18ba-4060-8a44-872e8051e2eb None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:28:23.425302 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59611a-18ba-4060-8a44-872e8051e2eb None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:28:23.457966 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:28:23.537087 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d7d12-f457-4325-88f5-42fcb1c7d5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:28:23.537776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d7d12-f457-4325-88f5-42fcb1c7d5b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:23.538060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d7d12-f457-4325-88f5-42fcb1c7d5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:23.538884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d7d12-f457-4325-88f5-42fcb1c7d5b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:23.539533 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d7d12-f457-4325-88f5-42fcb1c7d5b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:28:23.543502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d7d12-f457-4325-88f5-42fcb1c7d5b1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:28:23.597585 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3210/6383] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:28:23 2022] POST /identity/v3/users => generated 303 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:28:23.601391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b590c9-d4d9-4117-836f-41ec2ae94dc0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:28:23.624510 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b590c9-d4d9-4117-836f-41ec2ae94dc0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:28:23.639070 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22e251-4336-4004-9d02-b1cea5b8eacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:28:23.639720 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22e251-4336-4004-9d02-b1cea5b8eacf admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:23.640001 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22e251-4336-4004-9d02-b1cea5b8eacf admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:23.640273 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22e251-4336-4004-9d02-b1cea5b8eacf admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:23.640939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22e251-4336-4004-9d02-b1cea5b8eacf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:28:23.642580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22e251-4336-4004-9d02-b1cea5b8eacf admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:28:23.671425 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3174/6384] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:28:23.675237 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d7d12-f457-4325-88f5-42fcb1c7d5b1 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:28:23.696711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d7d12-f457-4325-88f5-42fcb1c7d5b1 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:28:23.709716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb574d3c-847f-444f-9835-fa60d36ff6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:28:23.710443 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb574d3c-847f-444f-9835-fa60d36ff6a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:23.710779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb574d3c-847f-444f-9835-fa60d36ff6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:23.711064 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb574d3c-847f-444f-9835-fa60d36ff6a0 admin admin] PATH_INFO: `/v3/projects/f877a330dfc74574a8fc989032408cdf/users/a064da3c57b44f54ba4e070ba77e0afe/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:23.752392 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb574d3c-847f-444f-9835-fa60d36ff6a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f877a330dfc74574a8fc989032408cdf, user_id=a064da3c57b44f54ba4e070ba77e0afe, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:28:23.761973 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb574d3c-847f-444f-9835-fa60d36ff6a0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:28:23.793762 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3211/6385] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:28:23 2022] PUT /identity/v3/projects/f877a330dfc74574a8fc989032408cdf/users/a064da3c57b44f54ba4e070ba77e0afe/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:28:23.798293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22e251-4336-4004-9d02-b1cea5b8eacf admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:28:23.829869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22e251-4336-4004-9d02-b1cea5b8eacf admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:28:24.025755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa02b3a-7949-4b27-8e5b-1a8c158d8293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:28:24.027272 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa02b3a-7949-4b27-8e5b-1a8c158d8293 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:24.027877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa02b3a-7949-4b27-8e5b-1a8c158d8293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:24.027977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa02b3a-7949-4b27-8e5b-1a8c158d8293 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:24.028812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa02b3a-7949-4b27-8e5b-1a8c158d8293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:28:24.030688 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa02b3a-7949-4b27-8e5b-1a8c158d8293 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:28:24.073614 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3175/6386] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:28:24.074573 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb574d3c-847f-444f-9835-fa60d36ff6a0 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:28:24.094938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb574d3c-847f-444f-9835-fa60d36ff6a0 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:28:24.119847 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03462ad-fdb0-49f9-ae7d-abc2c33af0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:28:24.122670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03462ad-fdb0-49f9-ae7d-abc2c33af0c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:24.122960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03462ad-fdb0-49f9-ae7d-abc2c33af0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:24.123244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03462ad-fdb0-49f9-ae7d-abc2c33af0c0 admin admin] PATH_INFO: `/v3/projects/f877a330dfc74574a8fc989032408cdf/users/a064da3c57b44f54ba4e070ba77e0afe/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:24.129814 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03462ad-fdb0-49f9-ae7d-abc2c33af0c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f877a330dfc74574a8fc989032408cdf, user_id=a064da3c57b44f54ba4e070ba77e0afe, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:28:24.133803 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03462ad-fdb0-49f9-ae7d-abc2c33af0c0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:28:24.173234 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3212/6387] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:28:24 2022] PUT /identity/v3/projects/f877a330dfc74574a8fc989032408cdf/users/a064da3c57b44f54ba4e070ba77e0afe/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:28:24.184749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a6b49-5d15-44f3-b419-8f561cec11c6 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:24.185343 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a6b49-5d15-44f3-b419-8f561cec11c6 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:24.185878 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a6b49-5d15-44f3-b419-8f561cec11c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:24.263474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c33a6b49-5d15-44f3-b419-8f561cec11c6 None None] MFA Rules not processed for user `a064da3c57b44f54ba4e070ba77e0afe`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:28:24.266250 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c33a6b49-5d15-44f3-b419-8f561cec11c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:28:24.451073 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3176/6388] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:28:24 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:28:24.468973 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03462ad-fdb0-49f9-ae7d-abc2c33af0c0 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:28:24.470888 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a03462ad-fdb0-49f9-ae7d-abc2c33af0c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:28:24.638225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03462ad-fdb0-49f9-ae7d-abc2c33af0c0 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:28:24.656662 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cbcef8-e08e-4e54-8381-020c1ae47ae8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:28:24.657515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbcef8-e08e-4e54-8381-020c1ae47ae8 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:24.657897 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbcef8-e08e-4e54-8381-020c1ae47ae8 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:24.658251 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbcef8-e08e-4e54-8381-020c1ae47ae8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:24.866197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cbcef8-e08e-4e54-8381-020c1ae47ae8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:28:24.870207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cbcef8-e08e-4e54-8381-020c1ae47ae8 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:28:24.906810 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3213/6389] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:28:24 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:28:26.710649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a6b49-5d15-44f3-b419-8f561cec11c6 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:28:26.713997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c33a6b49-5d15-44f3-b419-8f561cec11c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:28:26.731843 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:28:26.861417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a6b49-5d15-44f3-b419-8f561cec11c6 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:28:26.869476 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa68b4-0c6b-434d-8fc5-8b7ed1a4b33f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:28:26.870321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa68b4-0c6b-434d-8fc5-8b7ed1a4b33f service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:26.871353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa68b4-0c6b-434d-8fc5-8b7ed1a4b33f service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:26.871851 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa68b4-0c6b-434d-8fc5-8b7ed1a4b33f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:26.874376 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-31aa68b4-0c6b-434d-8fc5-8b7ed1a4b33f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:28:26.892885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa68b4-0c6b-434d-8fc5-8b7ed1a4b33f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:28:26.895595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa68b4-0c6b-434d-8fc5-8b7ed1a4b33f service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:28:26.909054 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3177/6390] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:28:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:28:29.831298 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cebc6-8484-4252-becf-3c01ded95406 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:29.832841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cebc6-8484-4252-becf-3c01ded95406 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:29.833271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cebc6-8484-4252-becf-3c01ded95406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:29.851364 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:28:29.860736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a63cebc6-8484-4252-becf-3c01ded95406 None None] MFA Rules not processed for user `a9787a91c5864d41bea568643916fe4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:28:29.862747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a63cebc6-8484-4252-becf-3c01ded95406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:28:29.954468 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3214/6391] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:28:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:28:30.395260 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa68b4-0c6b-434d-8fc5-8b7ed1a4b33f service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:28:30.396963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-31aa68b4-0c6b-434d-8fc5-8b7ed1a4b33f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:28:30.506518 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa68b4-0c6b-434d-8fc5-8b7ed1a4b33f service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:28:30.513708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c333cff-7547-4b48-b2fd-23de301800c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:28:30.514534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c333cff-7547-4b48-b2fd-23de301800c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:30.515508 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c333cff-7547-4b48-b2fd-23de301800c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:30.516153 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c333cff-7547-4b48-b2fd-23de301800c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:30.519552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3c333cff-7547-4b48-b2fd-23de301800c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:28:30.541630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c333cff-7547-4b48-b2fd-23de301800c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:28:30.543675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c333cff-7547-4b48-b2fd-23de301800c9 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:28:30.556942 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3178/6392] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:28:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:28:31.104698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63cebc6-8484-4252-becf-3c01ded95406 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:28:31.120452 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63cebc6-8484-4252-becf-3c01ded95406 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:28:31.127255 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928e741-01e6-4077-835f-be9aec5def62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:28:31.128020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928e741-01e6-4077-835f-be9aec5def62 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:31.129951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928e741-01e6-4077-835f-be9aec5def62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:31.130363 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928e741-01e6-4077-835f-be9aec5def62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:31.170056 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928e741-01e6-4077-835f-be9aec5def62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:28:31.171795 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928e741-01e6-4077-835f-be9aec5def62 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:28:31.205949 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3215/6393] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:28:31 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:28:39.474425 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bc248-f99b-44eb-bb64-55968652080f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:39.474913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bc248-f99b-44eb-bb64-55968652080f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:39.475008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bc248-f99b-44eb-bb64-55968652080f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:39.553462 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a07bc248-f99b-44eb-bb64-55968652080f None None] MFA Rules not processed for user `ece1d6709f6d480fbaffa3b47f293dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:28:39.553462 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a07bc248-f99b-44eb-bb64-55968652080f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:28:39.570019 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3179/6394] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:28:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:28:41.190488 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=28 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:28:48.644741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03405c11-16bd-473f-a7e7-5e24395a1aa8 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:48.645468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03405c11-16bd-473f-a7e7-5e24395a1aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:48.645468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03405c11-16bd-473f-a7e7-5e24395a1aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:48.671597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-03405c11-16bd-473f-a7e7-5e24395a1aa8 None None] MFA Rules not processed for user `2bd410471c2340aa97bbfe8057122303`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:28:48.674536 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-03405c11-16bd-473f-a7e7-5e24395a1aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:28:48.770681 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3216/6395] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:28:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:28:49.505049 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=63 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:28:49.801410 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07bc248-f99b-44eb-bb64-55968652080f None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:28:49.803014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a07bc248-f99b-44eb-bb64-55968652080f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:28:49.940616 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07bc248-f99b-44eb-bb64-55968652080f None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:28:49.951918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc1cf5-3774-402a-9e32-53e962258d89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:28:49.952713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc1cf5-3774-402a-9e32-53e962258d89 service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:49.953096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc1cf5-3774-402a-9e32-53e962258d89 service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:49.953511 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc1cf5-3774-402a-9e32-53e962258d89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:49.955562 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b0fc1cf5-3774-402a-9e32-53e962258d89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:28:50.081641 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc1cf5-3774-402a-9e32-53e962258d89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:28:50.083288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc1cf5-3774-402a-9e32-53e962258d89 service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:28:50.097115 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3180/6396] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:28:49 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:28:58.764872 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=25 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:28:58.912589 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03405c11-16bd-473f-a7e7-5e24395a1aa8 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:28:58.915085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-03405c11-16bd-473f-a7e7-5e24395a1aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:28:59.028088 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03405c11-16bd-473f-a7e7-5e24395a1aa8 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:28:59.033044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f650c4-ecbe-408b-a711-92f0f65c531d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:28:59.033905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f650c4-ecbe-408b-a711-92f0f65c531d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:59.034327 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f650c4-ecbe-408b-a711-92f0f65c531d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:59.034755 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f650c4-ecbe-408b-a711-92f0f65c531d admin admin] PATH_INFO: `/v3/users/856563aa981b4b9093c57c8d86482086` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:59.036234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f650c4-ecbe-408b-a711-92f0f65c531d admin admin] RBAC: Authorizing `identity:delete_user(user_id=856563aa981b4b9093c57c8d86482086)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:28:59.039025 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f650c4-ecbe-408b-a711-92f0f65c531d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:28:59.116999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-50f650c4-ecbe-408b-a711-92f0f65c531d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '856563aa981b4b9093c57c8d86482086'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:28:59.118704 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-50f650c4-ecbe-408b-a711-92f0f65c531d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '856563aa981b4b9093c57c8d86482086'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:28:59.134217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-50f650c4-ecbe-408b-a711-92f0f65c531d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '856563aa981b4b9093c57c8d86482086'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:28:59.150759 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-50f650c4-ecbe-408b-a711-92f0f65c531d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '856563aa981b4b9093c57c8d86482086'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:28:59.153606 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-50f650c4-ecbe-408b-a711-92f0f65c531d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '856563aa981b4b9093c57c8d86482086'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:28:59.197756 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3217/6397] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:28:58 2022] DELETE /identity/v3/users/856563aa981b4b9093c57c8d86482086 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:28:59.202379 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d669fd-574c-4d45-a8df-7eb948183986 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:59.203343 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d669fd-574c-4d45-a8df-7eb948183986 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:59.203852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d669fd-574c-4d45-a8df-7eb948183986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:59.257398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-77d669fd-574c-4d45-a8df-7eb948183986 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:28:59.259013 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-77d669fd-574c-4d45-a8df-7eb948183986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:28:59.424455 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3181/6398] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:28:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:28:59.453915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f650c4-ecbe-408b-a711-92f0f65c531d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:28:59.455560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-50f650c4-ecbe-408b-a711-92f0f65c531d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:28:59.567281 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:28:59.581550 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f650c4-ecbe-408b-a711-92f0f65c531d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:28:59.592049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f0fd9-658b-4376-9b50-bf38ae5148ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:28:59.593100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f0fd9-658b-4376-9b50-bf38ae5148ce service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:28:59.593905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f0fd9-658b-4376-9b50-bf38ae5148ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:28:59.595078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f0fd9-658b-4376-9b50-bf38ae5148ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:28:59.622656 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f0fd9-658b-4376-9b50-bf38ae5148ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:28:59.625604 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f0fd9-658b-4376-9b50-bf38ae5148ce service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:28:59.655616 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3218/6399] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:28:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:29:01.618364 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d669fd-574c-4d45-a8df-7eb948183986 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:01.619932 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-77d669fd-574c-4d45-a8df-7eb948183986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:01.643746 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d669fd-574c-4d45-a8df-7eb948183986 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:01.662485 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b02a5-b5e3-433b-a83b-9c1a07888798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:01.663542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b02a5-b5e3-433b-a83b-9c1a07888798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:01.665910 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b02a5-b5e3-433b-a83b-9c1a07888798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:01.666309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b02a5-b5e3-433b-a83b-9c1a07888798 admin admin] PATH_INFO: `/v3/projects/5b86fba5842b4d30a8f87091fa4fd312` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:01.667851 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b02a5-b5e3-433b-a83b-9c1a07888798 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b86fba5842b4d30a8f87091fa4fd312)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:01.671912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b02a5-b5e3-433b-a83b-9c1a07888798 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:01.786124 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:29:01.791710 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-801b02a5-b5e3-433b-a83b-9c1a07888798 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b86fba5842b4d30a8f87091fa4fd312', 'request_id': 'req-801b02a5-b5e3-433b-a83b-9c1a07888798'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:01.803016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-801b02a5-b5e3-433b-a83b-9c1a07888798 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b86fba5842b4d30a8f87091fa4fd312', 'request_id': 'req-801b02a5-b5e3-433b-a83b-9c1a07888798'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:01.820175 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-801b02a5-b5e3-433b-a83b-9c1a07888798 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b86fba5842b4d30a8f87091fa4fd312', 'request_id': 'req-801b02a5-b5e3-433b-a83b-9c1a07888798'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:01.846998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-801b02a5-b5e3-433b-a83b-9c1a07888798 admin admin] The token cache is being invalidate because project 5b86fba5842b4d30a8f87091fa4fd312 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:29:01.847883 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-801b02a5-b5e3-433b-a83b-9c1a07888798 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:01.850783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-801b02a5-b5e3-433b-a83b-9c1a07888798 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:01.853649 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3182/6400] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:29:01 2022] DELETE /identity/v3/projects/5b86fba5842b4d30a8f87091fa4fd312 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:29:01.863219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d07a1d-7045-4f28-a5c0-c3347b925a4d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:01.864330 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d07a1d-7045-4f28-a5c0-c3347b925a4d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:01.864951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d07a1d-7045-4f28-a5c0-c3347b925a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:01.951038 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-94d07a1d-7045-4f28-a5c0-c3347b925a4d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:29:01.957356 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-94d07a1d-7045-4f28-a5c0-c3347b925a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:02.190219 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3219/6401] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:29:02.196359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63223d4e-1650-438f-9af2-6c07a4d71e8a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:02.197050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63223d4e-1650-438f-9af2-6c07a4d71e8a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:02.197502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63223d4e-1650-438f-9af2-6c07a4d71e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:02.228804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-63223d4e-1650-438f-9af2-6c07a4d71e8a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:29:02.230348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-63223d4e-1650-438f-9af2-6c07a4d71e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:02.248134 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3183/6402] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:29:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:29:02.252162 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d07a1d-7045-4f28-a5c0-c3347b925a4d None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:02.266530 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d07a1d-7045-4f28-a5c0-c3347b925a4d None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:02.285791 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297972a8-f966-4dcc-9058-4094559470de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:02.288097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297972a8-f966-4dcc-9058-4094559470de admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:02.288395 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297972a8-f966-4dcc-9058-4094559470de admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:02.288673 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297972a8-f966-4dcc-9058-4094559470de admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:02.289370 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297972a8-f966-4dcc-9058-4094559470de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:29:02.289720 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297972a8-f966-4dcc-9058-4094559470de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:02.292111 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297972a8-f966-4dcc-9058-4094559470de admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:02.316381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63223d4e-1650-438f-9af2-6c07a4d71e8a None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:02.323468 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3220/6403] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:29:02.329950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63223d4e-1650-438f-9af2-6c07a4d71e8a None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:02.341890 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879ebf9-9c2b-4aff-a0cd-03598110928e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:02.342520 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879ebf9-9c2b-4aff-a0cd-03598110928e admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:02.342952 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879ebf9-9c2b-4aff-a0cd-03598110928e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:02.343546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879ebf9-9c2b-4aff-a0cd-03598110928e admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:02.344340 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879ebf9-9c2b-4aff-a0cd-03598110928e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:02.346563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879ebf9-9c2b-4aff-a0cd-03598110928e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:02.390974 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3184/6404] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:29:02 2022] POST /identity/v3/projects => generated 375 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:29:02.392490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297972a8-f966-4dcc-9058-4094559470de admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:02.409657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297972a8-f966-4dcc-9058-4094559470de admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:02.491180 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5607fe-f836-4030-a49b-e67f15ef7645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:02.492220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5607fe-f836-4030-a49b-e67f15ef7645 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:02.492707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5607fe-f836-4030-a49b-e67f15ef7645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:02.493201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5607fe-f836-4030-a49b-e67f15ef7645 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:02.494129 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5607fe-f836-4030-a49b-e67f15ef7645 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:02.496444 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5607fe-f836-4030-a49b-e67f15ef7645 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:02.550501 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3221/6405] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:29:02 2022] POST /identity/v3/users => generated 288 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:29:02.551501 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879ebf9-9c2b-4aff-a0cd-03598110928e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:02.564741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879ebf9-9c2b-4aff-a0cd-03598110928e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:02.580990 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3a287-aa3c-4b2d-9761-a1d5ffddc464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:02.581686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3a287-aa3c-4b2d-9761-a1d5ffddc464 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:02.582217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3a287-aa3c-4b2d-9761-a1d5ffddc464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:02.582354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3a287-aa3c-4b2d-9761-a1d5ffddc464 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:02.582909 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3a287-aa3c-4b2d-9761-a1d5ffddc464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:02.586088 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3a287-aa3c-4b2d-9761-a1d5ffddc464 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:02.611558 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3185/6406] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:29:02.615295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5607fe-f836-4030-a49b-e67f15ef7645 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:02.630977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5607fe-f836-4030-a49b-e67f15ef7645 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:02.645375 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8601fa1-8c37-498f-84d8-60edb1a3b37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:02.647131 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8601fa1-8c37-498f-84d8-60edb1a3b37d admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:02.647616 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8601fa1-8c37-498f-84d8-60edb1a3b37d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:02.648139 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8601fa1-8c37-498f-84d8-60edb1a3b37d admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:02.649006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8601fa1-8c37-498f-84d8-60edb1a3b37d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:02.653019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8601fa1-8c37-498f-84d8-60edb1a3b37d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:02.681400 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3222/6407] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:29:02.687567 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3a287-aa3c-4b2d-9761-a1d5ffddc464 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:02.704424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3a287-aa3c-4b2d-9761-a1d5ffddc464 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:02.711571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae99c3-bdd0-4ebe-bbcf-29623f68d682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:02.711922 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae99c3-bdd0-4ebe-bbcf-29623f68d682 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:02.712209 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae99c3-bdd0-4ebe-bbcf-29623f68d682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:02.712483 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae99c3-bdd0-4ebe-bbcf-29623f68d682 admin admin] PATH_INFO: `/v3/projects/aea8a8275b0f421db987389979c4414f/users/81fa1bdd44cb4385945cef313b1f41fd/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:02.732833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae99c3-bdd0-4ebe-bbcf-29623f68d682 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aea8a8275b0f421db987389979c4414f, user_id=81fa1bdd44cb4385945cef313b1f41fd, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:02.741976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae99c3-bdd0-4ebe-bbcf-29623f68d682 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:02.770442 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3186/6408] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:29:02 2022] PUT /identity/v3/projects/aea8a8275b0f421db987389979c4414f/users/81fa1bdd44cb4385945cef313b1f41fd/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:29:02.780659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1c57c-5819-48f3-87d5-efd2008f117e None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:02.780999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1c57c-5819-48f3-87d5-efd2008f117e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:02.781222 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1c57c-5819-48f3-87d5-efd2008f117e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:02.838500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-3cc1c57c-5819-48f3-87d5-efd2008f117e None None] MFA Rules not processed for user `81fa1bdd44cb4385945cef313b1f41fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:29:02.839723 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3cc1c57c-5819-48f3-87d5-efd2008f117e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:02.904864 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:29:02.993952 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3223/6409] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:29:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:29:02.998530 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae99c3-bdd0-4ebe-bbcf-29623f68d682 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:03.218397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae99c3-bdd0-4ebe-bbcf-29623f68d682 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:03.239358 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a83db4-4952-4c09-8ce5-f8c7ca430924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:03.241734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a83db4-4952-4c09-8ce5-f8c7ca430924 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:03.242969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a83db4-4952-4c09-8ce5-f8c7ca430924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:03.244210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a83db4-4952-4c09-8ce5-f8c7ca430924 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:03.245031 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a83db4-4952-4c09-8ce5-f8c7ca430924 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:03.258731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a83db4-4952-4c09-8ce5-f8c7ca430924 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:03.350535 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3187/6410] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:29:02 2022] POST /identity/v3/projects => generated 377 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:29:03.354674 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1c57c-5819-48f3-87d5-efd2008f117e None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:03.373250 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1c57c-5819-48f3-87d5-efd2008f117e None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:03.494078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb084f-12c8-4bc7-bf47-6a8570925852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:03.494720 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb084f-12c8-4bc7-bf47-6a8570925852 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:03.495007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb084f-12c8-4bc7-bf47-6a8570925852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:03.495295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb084f-12c8-4bc7-bf47-6a8570925852 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:03.495944 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb084f-12c8-4bc7-bf47-6a8570925852 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:03.498250 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb084f-12c8-4bc7-bf47-6a8570925852 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:03.559502 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3224/6411] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:29:03 2022] POST /identity/v3/users => generated 289 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:29:03.560320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a83db4-4952-4c09-8ce5-f8c7ca430924 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:03.580864 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a83db4-4952-4c09-8ce5-f8c7ca430924 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:03.589298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a08ba-e9cc-44af-ad16-82c46b042f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:03.592126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a08ba-e9cc-44af-ad16-82c46b042f26 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:03.592417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a08ba-e9cc-44af-ad16-82c46b042f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:03.592700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a08ba-e9cc-44af-ad16-82c46b042f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:03.593793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a08ba-e9cc-44af-ad16-82c46b042f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:03.596018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a08ba-e9cc-44af-ad16-82c46b042f26 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:03.624349 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb084f-12c8-4bc7-bf47-6a8570925852 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:03.634594 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3188/6412] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:29:03.640055 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb084f-12c8-4bc7-bf47-6a8570925852 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:03.651200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfebe10-6ace-4b79-9e92-a4fd061259a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:03.651200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfebe10-6ace-4b79-9e92-a4fd061259a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:03.651200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfebe10-6ace-4b79-9e92-a4fd061259a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:03.651200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfebe10-6ace-4b79-9e92-a4fd061259a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:03.651501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfebe10-6ace-4b79-9e92-a4fd061259a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:03.652600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfebe10-6ace-4b79-9e92-a4fd061259a1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:03.680941 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3225/6413] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:29:03.685160 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a08ba-e9cc-44af-ad16-82c46b042f26 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:03.700137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a08ba-e9cc-44af-ad16-82c46b042f26 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:03.712030 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36140e98-4615-4257-9105-41015c0daac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:03.713306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36140e98-4615-4257-9105-41015c0daac2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:03.713837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36140e98-4615-4257-9105-41015c0daac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:03.714382 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36140e98-4615-4257-9105-41015c0daac2 admin admin] PATH_INFO: `/v3/projects/4acbeedc7d554febb2349a1dbede1333/users/bcc542671718486683d1c160b83c62e4/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:03.739365 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36140e98-4615-4257-9105-41015c0daac2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4acbeedc7d554febb2349a1dbede1333, user_id=bcc542671718486683d1c160b83c62e4, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:03.743467 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36140e98-4615-4257-9105-41015c0daac2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:03.774607 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3189/6414] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:29:03 2022] PUT /identity/v3/projects/4acbeedc7d554febb2349a1dbede1333/users/bcc542671718486683d1c160b83c62e4/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:29:03.778863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d5e16-0eda-4529-81ab-a4c039fd10f8 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:03.779147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d5e16-0eda-4529-81ab-a4c039fd10f8 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:03.779425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d5e16-0eda-4529-81ab-a4c039fd10f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:03.874854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-8c8d5e16-0eda-4529-81ab-a4c039fd10f8 None None] MFA Rules not processed for user `bcc542671718486683d1c160b83c62e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:29:03.877042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8c8d5e16-0eda-4529-81ab-a4c039fd10f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:03.974798 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3226/6415] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:29:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:29:03.976010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36140e98-4615-4257-9105-41015c0daac2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:04.000171 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:29:04.108588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36140e98-4615-4257-9105-41015c0daac2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:04.123325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b244f-716b-4c5e-8ba2-b3a10141aef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:04.129996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b244f-716b-4c5e-8ba2-b3a10141aef6 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:04.132301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b244f-716b-4c5e-8ba2-b3a10141aef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:04.132685 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b244f-716b-4c5e-8ba2-b3a10141aef6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:04.133498 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b244f-716b-4c5e-8ba2-b3a10141aef6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:04.141276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b244f-716b-4c5e-8ba2-b3a10141aef6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:04.245148 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3190/6416] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:29:03 2022] POST /identity/v3/projects => generated 375 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:29:04.246063 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d5e16-0eda-4529-81ab-a4c039fd10f8 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:04.268342 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d5e16-0eda-4529-81ab-a4c039fd10f8 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:04.383238 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:29:04.431998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd49504-b51c-4fc6-8404-4c6cabe58690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:04.432632 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd49504-b51c-4fc6-8404-4c6cabe58690 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:04.432915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd49504-b51c-4fc6-8404-4c6cabe58690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:04.433193 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd49504-b51c-4fc6-8404-4c6cabe58690 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:04.436991 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd49504-b51c-4fc6-8404-4c6cabe58690 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:04.457201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd49504-b51c-4fc6-8404-4c6cabe58690 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:04.501853 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3227/6417] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:29:04 2022] POST /identity/v3/users => generated 294 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:29:04.503091 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b244f-716b-4c5e-8ba2-b3a10141aef6 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:04.524143 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b244f-716b-4c5e-8ba2-b3a10141aef6 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:04.538910 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113cb0d-71ca-4457-8fad-fae53dcb4be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:04.539565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113cb0d-71ca-4457-8fad-fae53dcb4be9 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:04.539889 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113cb0d-71ca-4457-8fad-fae53dcb4be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:04.540170 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113cb0d-71ca-4457-8fad-fae53dcb4be9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:04.540874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1113cb0d-71ca-4457-8fad-fae53dcb4be9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:04.542715 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1113cb0d-71ca-4457-8fad-fae53dcb4be9 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:04.559819 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3191/6418] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:29:04.563715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd49504-b51c-4fc6-8404-4c6cabe58690 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:04.580287 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd49504-b51c-4fc6-8404-4c6cabe58690 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:04.591853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f5119-b8bb-43ac-9dd6-338143fe9f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:04.592542 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f5119-b8bb-43ac-9dd6-338143fe9f54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:04.592824 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f5119-b8bb-43ac-9dd6-338143fe9f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:04.593106 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f5119-b8bb-43ac-9dd6-338143fe9f54 admin admin] PATH_INFO: `/v3/projects/27f5db694a674c478fd358b40c3777f9/users/9a70b8e020954858a2de8c12af059d7c/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:04.614303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f5119-b8bb-43ac-9dd6-338143fe9f54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f5db694a674c478fd358b40c3777f9, user_id=9a70b8e020954858a2de8c12af059d7c, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:04.618714 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f5119-b8bb-43ac-9dd6-338143fe9f54 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:04.637606 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3228/6419] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:29:04 2022] PUT /identity/v3/projects/27f5db694a674c478fd358b40c3777f9/users/9a70b8e020954858a2de8c12af059d7c/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:29:04.641426 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113cb0d-71ca-4457-8fad-fae53dcb4be9 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:04.658987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113cb0d-71ca-4457-8fad-fae53dcb4be9 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:04.836183 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe76b1b-ab8a-4b45-be64-8037376547ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:04.838234 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe76b1b-ab8a-4b45-be64-8037376547ff admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:04.838876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe76b1b-ab8a-4b45-be64-8037376547ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:04.839496 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe76b1b-ab8a-4b45-be64-8037376547ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:04.840334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe76b1b-ab8a-4b45-be64-8037376547ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:04.842735 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe76b1b-ab8a-4b45-be64-8037376547ff admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:04.862530 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3192/6420] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:29:04.868989 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f5119-b8bb-43ac-9dd6-338143fe9f54 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:04.885122 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f5119-b8bb-43ac-9dd6-338143fe9f54 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:04.894102 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12276e6-f677-4922-9d72-05ab77be8006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:04.894881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12276e6-f677-4922-9d72-05ab77be8006 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:04.895433 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12276e6-f677-4922-9d72-05ab77be8006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:04.896029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12276e6-f677-4922-9d72-05ab77be8006 admin admin] PATH_INFO: `/v3/projects/27f5db694a674c478fd358b40c3777f9/users/9a70b8e020954858a2de8c12af059d7c/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:04.903074 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12276e6-f677-4922-9d72-05ab77be8006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f5db694a674c478fd358b40c3777f9, user_id=9a70b8e020954858a2de8c12af059d7c, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:04.906119 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12276e6-f677-4922-9d72-05ab77be8006 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:04.921512 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3229/6421] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:29:04 2022] PUT /identity/v3/projects/27f5db694a674c478fd358b40c3777f9/users/9a70b8e020954858a2de8c12af059d7c/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:29:04.933476 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596ec43-4e84-420e-9e49-625b2c4ae645 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:04.933807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596ec43-4e84-420e-9e49-625b2c4ae645 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:04.934034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596ec43-4e84-420e-9e49-625b2c4ae645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:04.981699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-1596ec43-4e84-420e-9e49-625b2c4ae645 None None] MFA Rules not processed for user `9a70b8e020954858a2de8c12af059d7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:29:04.983073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1596ec43-4e84-420e-9e49-625b2c4ae645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:05.088528 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3193/6422] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:29:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:29:05.100151 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12276e6-f677-4922-9d72-05ab77be8006 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:05.103326 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d12276e6-f677-4922-9d72-05ab77be8006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:05.227468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12276e6-f677-4922-9d72-05ab77be8006 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:05.235785 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916bfc0-07a3-4ebc-a49c-753334e86b90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:05.236426 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916bfc0-07a3-4ebc-a49c-753334e86b90 service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:05.237549 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916bfc0-07a3-4ebc-a49c-753334e86b90 service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:05.237830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916bfc0-07a3-4ebc-a49c-753334e86b90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:05.354623 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916bfc0-07a3-4ebc-a49c-753334e86b90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:05.356597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916bfc0-07a3-4ebc-a49c-753334e86b90 service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:05.374365 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3230/6423] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:29:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:29:08.065880 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596ec43-4e84-420e-9e49-625b2c4ae645 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:08.067965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1596ec43-4e84-420e-9e49-625b2c4ae645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:08.092445 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:29:08.219392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596ec43-4e84-420e-9e49-625b2c4ae645 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:08.240717 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab560cb-6e18-4aa8-904d-4667caa5eb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:08.244198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab560cb-6e18-4aa8-904d-4667caa5eb76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:08.244686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab560cb-6e18-4aa8-904d-4667caa5eb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:08.245178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab560cb-6e18-4aa8-904d-4667caa5eb76 admin admin] PATH_INFO: `/v3/users/a9787a91c5864d41bea568643916fe4a` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:08.247370 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab560cb-6e18-4aa8-904d-4667caa5eb76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9787a91c5864d41bea568643916fe4a)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:08.252636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab560cb-6e18-4aa8-904d-4667caa5eb76 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:08.356580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5ab560cb-6e18-4aa8-904d-4667caa5eb76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9787a91c5864d41bea568643916fe4a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:08.359810 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5ab560cb-6e18-4aa8-904d-4667caa5eb76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9787a91c5864d41bea568643916fe4a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:08.390989 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5ab560cb-6e18-4aa8-904d-4667caa5eb76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9787a91c5864d41bea568643916fe4a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:08.415145 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5ab560cb-6e18-4aa8-904d-4667caa5eb76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9787a91c5864d41bea568643916fe4a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:08.417154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5ab560cb-6e18-4aa8-904d-4667caa5eb76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9787a91c5864d41bea568643916fe4a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:08.425425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916bfc0-07a3-4ebc-a49c-753334e86b90 service cinder] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:08.439176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916bfc0-07a3-4ebc-a49c-753334e86b90 service cinder] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:08.448132 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095a0a6-c75d-406d-9629-c14079864219 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:08.450261 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095a0a6-c75d-406d-9629-c14079864219 service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:08.450725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095a0a6-c75d-406d-9629-c14079864219 service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:08.451162 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095a0a6-c75d-406d-9629-c14079864219 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:08.457041 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c095a0a6-c75d-406d-9629-c14079864219 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:08.463497 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3194/6424] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:29:08 2022] DELETE /identity/v3/users/a9787a91c5864d41bea568643916fe4a => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:29:08.544095 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:29:08.602548 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c095a0a6-c75d-406d-9629-c14079864219 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:08.604059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c095a0a6-c75d-406d-9629-c14079864219 service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:08.622046 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3231/6425] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:29:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:29:08.749556 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab560cb-6e18-4aa8-904d-4667caa5eb76 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:08.751363 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5ab560cb-6e18-4aa8-904d-4667caa5eb76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:08.863370 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab560cb-6e18-4aa8-904d-4667caa5eb76 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:08.870572 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dedb54-d7cd-4092-b98c-23a573788c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:08.871265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dedb54-d7cd-4092-b98c-23a573788c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:08.871822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dedb54-d7cd-4092-b98c-23a573788c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:08.872158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dedb54-d7cd-4092-b98c-23a573788c14 admin admin] PATH_INFO: `/v3/projects/597639ba527e4aa094273398f7d578d5` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:08.874491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dedb54-d7cd-4092-b98c-23a573788c14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=597639ba527e4aa094273398f7d578d5)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:08.876847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dedb54-d7cd-4092-b98c-23a573788c14 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:08.946029 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:29:08.961483 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-54dedb54-d7cd-4092-b98c-23a573788c14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '597639ba527e4aa094273398f7d578d5', 'request_id': 'req-54dedb54-d7cd-4092-b98c-23a573788c14'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:08.971514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-54dedb54-d7cd-4092-b98c-23a573788c14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '597639ba527e4aa094273398f7d578d5', 'request_id': 'req-54dedb54-d7cd-4092-b98c-23a573788c14'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:08.980613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-54dedb54-d7cd-4092-b98c-23a573788c14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '597639ba527e4aa094273398f7d578d5', 'request_id': 'req-54dedb54-d7cd-4092-b98c-23a573788c14'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:09.001786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-54dedb54-d7cd-4092-b98c-23a573788c14 admin admin] The token cache is being invalidate because project 597639ba527e4aa094273398f7d578d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:29:09.002154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-54dedb54-d7cd-4092-b98c-23a573788c14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:09.002966 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-54dedb54-d7cd-4092-b98c-23a573788c14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:09.004997 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3195/6426] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:29:08 2022] DELETE /identity/v3/projects/597639ba527e4aa094273398f7d578d5 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:29:09.011754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a0476-1601-4f63-8f65-1029a715876b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:09.012021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a0476-1601-4f63-8f65-1029a715876b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:09.012299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a0476-1601-4f63-8f65-1029a715876b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:09.050233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-3d9a0476-1601-4f63-8f65-1029a715876b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:29:09.052531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3d9a0476-1601-4f63-8f65-1029a715876b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:09.153477 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3232/6427] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:29:09.163868 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd690b-ef38-4054-aeeb-a0888abf1369 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:09.165212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd690b-ef38-4054-aeeb-a0888abf1369 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:09.165817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd690b-ef38-4054-aeeb-a0888abf1369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:09.202390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-79fd690b-ef38-4054-aeeb-a0888abf1369 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:29:09.203973 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-79fd690b-ef38-4054-aeeb-a0888abf1369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:09.231103 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3196/6428] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:29:09.232307 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a0476-1601-4f63-8f65-1029a715876b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:09.247765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a0476-1601-4f63-8f65-1029a715876b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:09.257895 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0513e5-7bad-4387-b7ef-66bd70c1a9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:09.258730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0513e5-7bad-4387-b7ef-66bd70c1a9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:09.259163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0513e5-7bad-4387-b7ef-66bd70c1a9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:09.265396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0513e5-7bad-4387-b7ef-66bd70c1a9e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:09.265396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0513e5-7bad-4387-b7ef-66bd70c1a9e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:29:09.265396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0513e5-7bad-4387-b7ef-66bd70c1a9e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:09.265396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0513e5-7bad-4387-b7ef-66bd70c1a9e7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:09.290793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd690b-ef38-4054-aeeb-a0888abf1369 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:09.310053 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3233/6429] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:29:09.328666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd690b-ef38-4054-aeeb-a0888abf1369 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:09.336425 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d789d50-e1c4-431c-8b63-7305be7072f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:09.337458 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d789d50-e1c4-431c-8b63-7305be7072f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:09.337689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d789d50-e1c4-431c-8b63-7305be7072f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:09.338043 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d789d50-e1c4-431c-8b63-7305be7072f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:09.338843 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d789d50-e1c4-431c-8b63-7305be7072f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:09.341198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d789d50-e1c4-431c-8b63-7305be7072f3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:09.446411 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3197/6430] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:29:09 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:29:09.446916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0513e5-7bad-4387-b7ef-66bd70c1a9e7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:09.462136 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0513e5-7bad-4387-b7ef-66bd70c1a9e7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:09.476307 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d789d50-e1c4-431c-8b63-7305be7072f3 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:09.479058 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8d789d50-e1c4-431c-8b63-7305be7072f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:09.603020 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d789d50-e1c4-431c-8b63-7305be7072f3 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:09.611368 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c5f9b-30e3-4fa6-87b7-f327191971cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:09.612363 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c5f9b-30e3-4fa6-87b7-f327191971cb service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:09.612703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c5f9b-30e3-4fa6-87b7-f327191971cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:09.613043 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c5f9b-30e3-4fa6-87b7-f327191971cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:09.619445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c02c5f9b-30e3-4fa6-87b7-f327191971cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:09.740071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c5f9b-30e3-4fa6-87b7-f327191971cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:09.741763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c5f9b-30e3-4fa6-87b7-f327191971cb service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:09.767530 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3198/6431] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:29:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:29:09.797747 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa89a0-4f22-4661-84ce-ee0a10f0c6ce None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:09.798173 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa89a0-4f22-4661-84ce-ee0a10f0c6ce None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:09.798577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa89a0-4f22-4661-84ce-ee0a10f0c6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:09.860728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabd644-95fb-439a-ae1d-55ce6efe4195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:09.867670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabd644-95fb-439a-ae1d-55ce6efe4195 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:09.868436 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabd644-95fb-439a-ae1d-55ce6efe4195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:09.869655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-29aa89a0-4f22-4661-84ce-ee0a10f0c6ce None None] MFA Rules not processed for user `3734668c07164b759f9084fdcccf7d36`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:29:09.870321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabd644-95fb-439a-ae1d-55ce6efe4195 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:09.871189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddabd644-95fb-439a-ae1d-55ce6efe4195 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:09.873831 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddabd644-95fb-439a-ae1d-55ce6efe4195 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:09.875350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-29aa89a0-4f22-4661-84ce-ee0a10f0c6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:09.994684 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3234/6432] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:29:09 2022] POST /identity/v3/users => generated 288 bytes in 551 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:29:09.998725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabd644-95fb-439a-ae1d-55ce6efe4195 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:10.028793 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabd644-95fb-439a-ae1d-55ce6efe4195 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:10.038641 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:29:10.056251 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4b86d-19a5-4866-a7db-a2365f0f48aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:10.057072 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4b86d-19a5-4866-a7db-a2365f0f48aa admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:10.057565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4b86d-19a5-4866-a7db-a2365f0f48aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:10.057987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4b86d-19a5-4866-a7db-a2365f0f48aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:10.058789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4b86d-19a5-4866-a7db-a2365f0f48aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:10.060641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4b86d-19a5-4866-a7db-a2365f0f48aa admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:10.096699 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3235/6433] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:29:10.100725 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3199/6434] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:29:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:29:10.101768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4b86d-19a5-4866-a7db-a2365f0f48aa admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:10.127803 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4b86d-19a5-4866-a7db-a2365f0f48aa admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:10.156142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4618bc8c-5254-48a0-b2e5-880d8705769d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:10.156766 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618bc8c-5254-48a0-b2e5-880d8705769d admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:10.157047 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618bc8c-5254-48a0-b2e5-880d8705769d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:10.157321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618bc8c-5254-48a0-b2e5-880d8705769d admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:10.158051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4618bc8c-5254-48a0-b2e5-880d8705769d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:10.159675 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4618bc8c-5254-48a0-b2e5-880d8705769d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:10.204788 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3236/6435] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:29:10.204941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa89a0-4f22-4661-84ce-ee0a10f0c6ce None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:10.241890 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa89a0-4f22-4661-84ce-ee0a10f0c6ce None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:10.265516 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a813231-6579-4119-998c-6214f1d35b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:10.267072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a813231-6579-4119-998c-6214f1d35b02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:10.268296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a813231-6579-4119-998c-6214f1d35b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:10.270540 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a813231-6579-4119-998c-6214f1d35b02 admin admin] PATH_INFO: `/v3/projects/8a35f431a73544288270bd215cf145b2/users/60ba6a2ce93d49df9c088e4e79b051d0/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:10.339669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a813231-6579-4119-998c-6214f1d35b02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a35f431a73544288270bd215cf145b2, user_id=60ba6a2ce93d49df9c088e4e79b051d0, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:10.349757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a813231-6579-4119-998c-6214f1d35b02 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:10.387050 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3200/6436] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:29:10 2022] PUT /identity/v3/projects/8a35f431a73544288270bd215cf145b2/users/60ba6a2ce93d49df9c088e4e79b051d0/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:29:10.392544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a65e6-4a8c-4806-9388-844aef9d4b75 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:10.392832 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a65e6-4a8c-4806-9388-844aef9d4b75 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:10.393107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a65e6-4a8c-4806-9388-844aef9d4b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:10.435457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-947a65e6-4a8c-4806-9388-844aef9d4b75 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:29:10.439997 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-947a65e6-4a8c-4806-9388-844aef9d4b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:10.525830 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:29:10.610881 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3237/6437] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:29:10.706804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a813231-6579-4119-998c-6214f1d35b02 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:10.709105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4a813231-6579-4119-998c-6214f1d35b02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:10.847724 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a813231-6579-4119-998c-6214f1d35b02 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:10.856816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb5a51-f676-434b-8480-b6635c6947a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:10.857610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb5a51-f676-434b-8480-b6635c6947a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:10.857912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb5a51-f676-434b-8480-b6635c6947a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:10.858184 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb5a51-f676-434b-8480-b6635c6947a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:10.883460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb5a51-f676-434b-8480-b6635c6947a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:10.886044 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb5a51-f676-434b-8480-b6635c6947a6 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:10.920014 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3201/6438] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:29:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:29:20.598288 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=14 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:29:20.906717 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=41,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:29:22.368606 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a65e6-4a8c-4806-9388-844aef9d4b75 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:22.370837 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-947a65e6-4a8c-4806-9388-844aef9d4b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:22.391107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a65e6-4a8c-4806-9388-844aef9d4b75 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:22.406269 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d36fb4-a5e9-4338-8fbe-89cd7270a21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:22.406942 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d36fb4-a5e9-4338-8fbe-89cd7270a21a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:22.407224 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d36fb4-a5e9-4338-8fbe-89cd7270a21a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:22.407499 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d36fb4-a5e9-4338-8fbe-89cd7270a21a admin admin] PATH_INFO: `/v3/users/81fa1bdd44cb4385945cef313b1f41fd` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:22.408756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d36fb4-a5e9-4338-8fbe-89cd7270a21a admin admin] RBAC: Authorizing `identity:delete_user(user_id=81fa1bdd44cb4385945cef313b1f41fd)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:22.411486 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d36fb4-a5e9-4338-8fbe-89cd7270a21a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:22.528999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-53d36fb4-a5e9-4338-8fbe-89cd7270a21a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81fa1bdd44cb4385945cef313b1f41fd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:22.529724 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-53d36fb4-a5e9-4338-8fbe-89cd7270a21a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81fa1bdd44cb4385945cef313b1f41fd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:22.546518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-53d36fb4-a5e9-4338-8fbe-89cd7270a21a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81fa1bdd44cb4385945cef313b1f41fd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:22.569010 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-53d36fb4-a5e9-4338-8fbe-89cd7270a21a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81fa1bdd44cb4385945cef313b1f41fd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:22.569670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-53d36fb4-a5e9-4338-8fbe-89cd7270a21a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81fa1bdd44cb4385945cef313b1f41fd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:22.613957 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3238/6439] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:29:22 2022] DELETE /identity/v3/users/81fa1bdd44cb4385945cef313b1f41fd => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:29:22.618182 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c66ff0-e913-4f3c-a7ef-e84c373e64fd None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:22.618682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c66ff0-e913-4f3c-a7ef-e84c373e64fd None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:22.618900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c66ff0-e913-4f3c-a7ef-e84c373e64fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:22.656591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-88c66ff0-e913-4f3c-a7ef-e84c373e64fd None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:29:22.657863 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-88c66ff0-e913-4f3c-a7ef-e84c373e64fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:22.808078 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3202/6440] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:29:22.838508 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d36fb4-a5e9-4338-8fbe-89cd7270a21a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:22.839979 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-53d36fb4-a5e9-4338-8fbe-89cd7270a21a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:23.028496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d36fb4-a5e9-4338-8fbe-89cd7270a21a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:23.032782 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e98864-455f-4fc6-a5d2-30985e911317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:23.033420 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e98864-455f-4fc6-a5d2-30985e911317 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:23.033722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e98864-455f-4fc6-a5d2-30985e911317 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:23.034019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e98864-455f-4fc6-a5d2-30985e911317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:23.057225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e98864-455f-4fc6-a5d2-30985e911317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:23.058727 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e98864-455f-4fc6-a5d2-30985e911317 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:23.096116 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3239/6441] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:29:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:29:24.565537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c66ff0-e913-4f3c-a7ef-e84c373e64fd None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:24.568162 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-88c66ff0-e913-4f3c-a7ef-e84c373e64fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:24.590821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c66ff0-e913-4f3c-a7ef-e84c373e64fd None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:24.606340 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160d484-dd77-46c8-a1e9-56c47d82e0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:24.609525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160d484-dd77-46c8-a1e9-56c47d82e0cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:24.610652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160d484-dd77-46c8-a1e9-56c47d82e0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:24.611853 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160d484-dd77-46c8-a1e9-56c47d82e0cf admin admin] PATH_INFO: `/v3/projects/aea8a8275b0f421db987389979c4414f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:24.620932 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5160d484-dd77-46c8-a1e9-56c47d82e0cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=aea8a8275b0f421db987389979c4414f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:24.623315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5160d484-dd77-46c8-a1e9-56c47d82e0cf admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:24.752913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5160d484-dd77-46c8-a1e9-56c47d82e0cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aea8a8275b0f421db987389979c4414f', 'request_id': 'req-5160d484-dd77-46c8-a1e9-56c47d82e0cf'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:24.787799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5160d484-dd77-46c8-a1e9-56c47d82e0cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aea8a8275b0f421db987389979c4414f', 'request_id': 'req-5160d484-dd77-46c8-a1e9-56c47d82e0cf'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:24.809860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5160d484-dd77-46c8-a1e9-56c47d82e0cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aea8a8275b0f421db987389979c4414f', 'request_id': 'req-5160d484-dd77-46c8-a1e9-56c47d82e0cf'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:24.844015 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5160d484-dd77-46c8-a1e9-56c47d82e0cf admin admin] The token cache is being invalidate because project aea8a8275b0f421db987389979c4414f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:29:24.846095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5160d484-dd77-46c8-a1e9-56c47d82e0cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:24.858428 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5160d484-dd77-46c8-a1e9-56c47d82e0cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:24.860135 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3203/6442] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:29:24 2022] DELETE /identity/v3/projects/aea8a8275b0f421db987389979c4414f => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:29:24.865764 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e98864-455f-4fc6-a5d2-30985e911317 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:24.879060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e98864-455f-4fc6-a5d2-30985e911317 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:25.011132 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669d278-09d0-4d78-b9ed-f77f41a25470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:25.011812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669d278-09d0-4d78-b9ed-f77f41a25470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:25.012082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669d278-09d0-4d78-b9ed-f77f41a25470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:25.012358 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669d278-09d0-4d78-b9ed-f77f41a25470 admin admin] PATH_INFO: `/v3/users/bcc542671718486683d1c160b83c62e4` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:25.016419 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669d278-09d0-4d78-b9ed-f77f41a25470 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcc542671718486683d1c160b83c62e4)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:25.018275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669d278-09d0-4d78-b9ed-f77f41a25470 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:25.037160 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:29:25.112878 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6669d278-09d0-4d78-b9ed-f77f41a25470 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcc542671718486683d1c160b83c62e4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:25.114752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6669d278-09d0-4d78-b9ed-f77f41a25470 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcc542671718486683d1c160b83c62e4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:25.131024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6669d278-09d0-4d78-b9ed-f77f41a25470 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcc542671718486683d1c160b83c62e4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:25.157890 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6669d278-09d0-4d78-b9ed-f77f41a25470 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcc542671718486683d1c160b83c62e4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:25.158525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6669d278-09d0-4d78-b9ed-f77f41a25470 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcc542671718486683d1c160b83c62e4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:25.200730 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3240/6443] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:29:24 2022] DELETE /identity/v3/users/bcc542671718486683d1c160b83c62e4 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:29:25.902371 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160d484-dd77-46c8-a1e9-56c47d82e0cf admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:25.904494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5160d484-dd77-46c8-a1e9-56c47d82e0cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:25.938490 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160d484-dd77-46c8-a1e9-56c47d82e0cf admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:26.194127 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d83f6-e8e0-4784-b288-0aabbecf1910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:26.194786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d83f6-e8e0-4784-b288-0aabbecf1910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:26.195069 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d83f6-e8e0-4784-b288-0aabbecf1910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:26.195377 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d83f6-e8e0-4784-b288-0aabbecf1910 admin admin] PATH_INFO: `/v3/projects/4acbeedc7d554febb2349a1dbede1333` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:26.196674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d83f6-e8e0-4784-b288-0aabbecf1910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4acbeedc7d554febb2349a1dbede1333)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:26.198689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d83f6-e8e0-4784-b288-0aabbecf1910 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:26.245612 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:29:26.308968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e28d83f6-e8e0-4784-b288-0aabbecf1910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4acbeedc7d554febb2349a1dbede1333', 'request_id': 'req-e28d83f6-e8e0-4784-b288-0aabbecf1910'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:26.340964 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e28d83f6-e8e0-4784-b288-0aabbecf1910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4acbeedc7d554febb2349a1dbede1333', 'request_id': 'req-e28d83f6-e8e0-4784-b288-0aabbecf1910'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:26.354514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e28d83f6-e8e0-4784-b288-0aabbecf1910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4acbeedc7d554febb2349a1dbede1333', 'request_id': 'req-e28d83f6-e8e0-4784-b288-0aabbecf1910'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:26.400269 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e28d83f6-e8e0-4784-b288-0aabbecf1910 admin admin] The token cache is being invalidate because project 4acbeedc7d554febb2349a1dbede1333 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:29:26.400571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e28d83f6-e8e0-4784-b288-0aabbecf1910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:26.402563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e28d83f6-e8e0-4784-b288-0aabbecf1910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:26.406467 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3204/6444] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:29:25 2022] DELETE /identity/v3/projects/4acbeedc7d554febb2349a1dbede1333 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:29:26.410220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669d278-09d0-4d78-b9ed-f77f41a25470 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:26.414191 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6669d278-09d0-4d78-b9ed-f77f41a25470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:26.434450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669d278-09d0-4d78-b9ed-f77f41a25470 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:26.598328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c036939-228b-4dfd-99eb-ad055c3e827f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:26.599004 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c036939-228b-4dfd-99eb-ad055c3e827f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:26.599288 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c036939-228b-4dfd-99eb-ad055c3e827f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:26.599566 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c036939-228b-4dfd-99eb-ad055c3e827f admin admin] PATH_INFO: `/v3/users/9a70b8e020954858a2de8c12af059d7c` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:26.601530 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c036939-228b-4dfd-99eb-ad055c3e827f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a70b8e020954858a2de8c12af059d7c)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:26.603439 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c036939-228b-4dfd-99eb-ad055c3e827f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:26.713242 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9c036939-228b-4dfd-99eb-ad055c3e827f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a70b8e020954858a2de8c12af059d7c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:26.721964 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9c036939-228b-4dfd-99eb-ad055c3e827f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a70b8e020954858a2de8c12af059d7c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:26.731117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9c036939-228b-4dfd-99eb-ad055c3e827f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a70b8e020954858a2de8c12af059d7c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:26.753202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9c036939-228b-4dfd-99eb-ad055c3e827f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a70b8e020954858a2de8c12af059d7c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:26.753983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9c036939-228b-4dfd-99eb-ad055c3e827f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a70b8e020954858a2de8c12af059d7c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:26.789660 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3241/6445] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:29:26 2022] DELETE /identity/v3/users/9a70b8e020954858a2de8c12af059d7c => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:29:28.124674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d83f6-e8e0-4784-b288-0aabbecf1910 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:28.134644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e28d83f6-e8e0-4784-b288-0aabbecf1910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:28.161467 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d83f6-e8e0-4784-b288-0aabbecf1910 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:28.174938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89caa6d-8608-41c1-8d5d-10fd1c637b28 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:28.175411 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89caa6d-8608-41c1-8d5d-10fd1c637b28 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:28.175516 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89caa6d-8608-41c1-8d5d-10fd1c637b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:28.294401 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:29:28.308645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a89caa6d-8608-41c1-8d5d-10fd1c637b28 None None] MFA Rules not processed for user `60ba6a2ce93d49df9c088e4e79b051d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:29:28.318901 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a89caa6d-8608-41c1-8d5d-10fd1c637b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:28.385099 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957b51c-4c0a-4318-9eff-07b3eafc49fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:28.391574 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957b51c-4c0a-4318-9eff-07b3eafc49fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:28.392059 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957b51c-4c0a-4318-9eff-07b3eafc49fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:28.392514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957b51c-4c0a-4318-9eff-07b3eafc49fc admin admin] PATH_INFO: `/v3/projects/27f5db694a674c478fd358b40c3777f9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:28.396613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957b51c-4c0a-4318-9eff-07b3eafc49fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=27f5db694a674c478fd358b40c3777f9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:28.399983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957b51c-4c0a-4318-9eff-07b3eafc49fc admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:28.594383 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3242/6446] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:29:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:29:28.617239 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d957b51c-4c0a-4318-9eff-07b3eafc49fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27f5db694a674c478fd358b40c3777f9', 'request_id': 'req-d957b51c-4c0a-4318-9eff-07b3eafc49fc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:28.626299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89caa6d-8608-41c1-8d5d-10fd1c637b28 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:28.628076 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a89caa6d-8608-41c1-8d5d-10fd1c637b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:28.648943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d957b51c-4c0a-4318-9eff-07b3eafc49fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27f5db694a674c478fd358b40c3777f9', 'request_id': 'req-d957b51c-4c0a-4318-9eff-07b3eafc49fc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:28.660778 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d957b51c-4c0a-4318-9eff-07b3eafc49fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27f5db694a674c478fd358b40c3777f9', 'request_id': 'req-d957b51c-4c0a-4318-9eff-07b3eafc49fc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:28.707422 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d957b51c-4c0a-4318-9eff-07b3eafc49fc admin admin] The token cache is being invalidate because project 27f5db694a674c478fd358b40c3777f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:29:28.707797 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d957b51c-4c0a-4318-9eff-07b3eafc49fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:28.708397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d957b51c-4c0a-4318-9eff-07b3eafc49fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:28.715557 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3205/6447] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:29:28 2022] DELETE /identity/v3/projects/27f5db694a674c478fd358b40c3777f9 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:29:28.718722 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54677376-adde-4225-b91b-0a8e30b042c7 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:28.720124 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54677376-adde-4225-b91b-0a8e30b042c7 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:28.720406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54677376-adde-4225-b91b-0a8e30b042c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:28.773840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-54677376-adde-4225-b91b-0a8e30b042c7 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:29:28.785204 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-54677376-adde-4225-b91b-0a8e30b042c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:28.901075 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:29:28.936982 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3206/6448] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:29:28.938335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54677376-adde-4225-b91b-0a8e30b042c7 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:28.940957 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-54677376-adde-4225-b91b-0a8e30b042c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:28.960513 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89caa6d-8608-41c1-8d5d-10fd1c637b28 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:29.107901 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c21aca-1042-4ed9-9dac-819f73becadb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:29.108530 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c21aca-1042-4ed9-9dac-819f73becadb service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:29.108814 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c21aca-1042-4ed9-9dac-819f73becadb service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:29.109233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c21aca-1042-4ed9-9dac-819f73becadb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:29.112542 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c5c21aca-1042-4ed9-9dac-819f73becadb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:29.132450 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54677376-adde-4225-b91b-0a8e30b042c7 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:29.145338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70459d72-1eff-469e-a5fc-65b8364ef08b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:29.145997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70459d72-1eff-469e-a5fc-65b8364ef08b service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:29.146300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70459d72-1eff-469e-a5fc-65b8364ef08b service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:29.146554 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70459d72-1eff-469e-a5fc-65b8364ef08b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:29.150415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-70459d72-1eff-469e-a5fc-65b8364ef08b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:29.167895 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:29:29.197321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70459d72-1eff-469e-a5fc-65b8364ef08b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:29.199265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70459d72-1eff-469e-a5fc-65b8364ef08b service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:29.218285 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3207/6449] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:29:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:29:29.231796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b8c6c-8829-48d0-90f5-7d23ade585d3 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:29.233114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b8c6c-8829-48d0-90f5-7d23ade585d3 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:29.235547 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b8c6c-8829-48d0-90f5-7d23ade585d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:29.269521 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c21aca-1042-4ed9-9dac-819f73becadb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:29.273060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c21aca-1042-4ed9-9dac-819f73becadb service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:29.288338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5a9b8c6c-8829-48d0-90f5-7d23ade585d3 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:29:29.290090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5a9b8c6c-8829-48d0-90f5-7d23ade585d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:29.294149 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3243/6450] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:29:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:29:29.339031 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3208/6451] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:29:29.342942 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c21aca-1042-4ed9-9dac-819f73becadb service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:29.361025 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c21aca-1042-4ed9-9dac-819f73becadb service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:29.370989 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c14528-ce90-48da-bf73-ef475997bfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:29.372030 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c14528-ce90-48da-bf73-ef475997bfb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:29.372476 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c14528-ce90-48da-bf73-ef475997bfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:29.372922 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c14528-ce90-48da-bf73-ef475997bfb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:29.373815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c14528-ce90-48da-bf73-ef475997bfb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:29:29.374284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c14528-ce90-48da-bf73-ef475997bfb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:29.376999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c14528-ce90-48da-bf73-ef475997bfb9 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:29.423633 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3244/6452] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:29:29.432963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b8c6c-8829-48d0-90f5-7d23ade585d3 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:29.444549 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b8c6c-8829-48d0-90f5-7d23ade585d3 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:29.456725 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ce2dd-2210-4108-8517-5fc7802302e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:29.458459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ce2dd-2210-4108-8517-5fc7802302e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:29.459008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ce2dd-2210-4108-8517-5fc7802302e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:29.459206 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ce2dd-2210-4108-8517-5fc7802302e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:29.459829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ce2dd-2210-4108-8517-5fc7802302e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:29.466057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ce2dd-2210-4108-8517-5fc7802302e0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:29.583164 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3209/6453] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:29:29 2022] POST /identity/v3/projects => generated 369 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:29:29.585048 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c14528-ce90-48da-bf73-ef475997bfb9 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:29.605553 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c14528-ce90-48da-bf73-ef475997bfb9 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:29.723731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54fd91-2dc1-4d14-ab63-018a4be8f2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:29.724430 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54fd91-2dc1-4d14-ab63-018a4be8f2cc admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:29.724713 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54fd91-2dc1-4d14-ab63-018a4be8f2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:29.724990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54fd91-2dc1-4d14-ab63-018a4be8f2cc admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:29.728015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54fd91-2dc1-4d14-ab63-018a4be8f2cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:29.744872 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54fd91-2dc1-4d14-ab63-018a4be8f2cc admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:29.819358 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3245/6454] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:29:29 2022] POST /identity/v3/users => generated 285 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:29:29.829871 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ce2dd-2210-4108-8517-5fc7802302e0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:29.856972 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ce2dd-2210-4108-8517-5fc7802302e0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:29.884443 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7e0f9-50fd-4ab2-a0e8-09a361f268f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:29.885190 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7e0f9-50fd-4ab2-a0e8-09a361f268f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:29.885532 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7e0f9-50fd-4ab2-a0e8-09a361f268f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:29.885791 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7e0f9-50fd-4ab2-a0e8-09a361f268f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:29.886613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d7e0f9-50fd-4ab2-a0e8-09a361f268f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:29.891595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d7e0f9-50fd-4ab2-a0e8-09a361f268f9 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:29.937166 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3210/6455] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:29:29.938948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54fd91-2dc1-4d14-ab63-018a4be8f2cc admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:29.958972 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54fd91-2dc1-4d14-ab63-018a4be8f2cc admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:29.971709 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed18f16-e4ca-495b-881b-2dc925524d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:29.972348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed18f16-e4ca-495b-881b-2dc925524d66 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:29.972691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed18f16-e4ca-495b-881b-2dc925524d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:29.973013 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed18f16-e4ca-495b-881b-2dc925524d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:29.973701 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed18f16-e4ca-495b-881b-2dc925524d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:29.975472 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed18f16-e4ca-495b-881b-2dc925524d66 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:30.017768 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3246/6456] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:29:30.018899 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7e0f9-50fd-4ab2-a0e8-09a361f268f9 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:30.040869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7e0f9-50fd-4ab2-a0e8-09a361f268f9 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:30.062981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a1a84-7d9b-4887-a5a6-ee0ec513bca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:30.064130 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a1a84-7d9b-4887-a5a6-ee0ec513bca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:30.064615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a1a84-7d9b-4887-a5a6-ee0ec513bca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:30.065975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a1a84-7d9b-4887-a5a6-ee0ec513bca7 admin admin] PATH_INFO: `/v3/projects/650213f5e01a4c3ebfb1dce1053a19fe/users/dfc7700b32d24d6d81be8005aa62c92d/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:30.105136 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a1a84-7d9b-4887-a5a6-ee0ec513bca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=650213f5e01a4c3ebfb1dce1053a19fe, user_id=dfc7700b32d24d6d81be8005aa62c92d, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:30.108154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a1a84-7d9b-4887-a5a6-ee0ec513bca7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:30.128038 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3211/6457] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:29:30 2022] PUT /identity/v3/projects/650213f5e01a4c3ebfb1dce1053a19fe/users/dfc7700b32d24d6d81be8005aa62c92d/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:29:30.138930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281dc27-5182-4f05-ae49-394288787bdd None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:30.140048 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281dc27-5182-4f05-ae49-394288787bdd None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:30.140658 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281dc27-5182-4f05-ae49-394288787bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:30.181024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-3281dc27-5182-4f05-ae49-394288787bdd None None] MFA Rules not processed for user `dfc7700b32d24d6d81be8005aa62c92d`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:29:30.185996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3281dc27-5182-4f05-ae49-394288787bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:30.308373 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3247/6458] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:29:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:29:30.328765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a1a84-7d9b-4887-a5a6-ee0ec513bca7 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:30.331682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-847a1a84-7d9b-4887-a5a6-ee0ec513bca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:30.509919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a1a84-7d9b-4887-a5a6-ee0ec513bca7 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:30.520892 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e60552-404c-4942-9020-03258cb67431 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efcee9b21ea94b1b8e5c9c5acb35839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:30.521676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e60552-404c-4942-9020-03258cb67431 service glance] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:30.522541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e60552-404c-4942-9020-03258cb67431 service glance] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:30.524004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e60552-404c-4942-9020-03258cb67431 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:30.551831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e60552-404c-4942-9020-03258cb67431 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:30.562828 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e60552-404c-4942-9020-03258cb67431 service glance] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:30.589513 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3212/6459] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:29:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:29:30.716532 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4acb29-9833-420e-af06-19e80f96089d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:30.716838 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4acb29-9833-420e-af06-19e80f96089d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:30.717137 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4acb29-9833-420e-af06-19e80f96089d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:30.762238 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-6e4acb29-9833-420e-af06-19e80f96089d None None] MFA Rules not processed for user `60ba6a2ce93d49df9c088e4e79b051d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:29:30.763830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6e4acb29-9833-420e-af06-19e80f96089d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:30.790107 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:29:30.909853 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3248/6460] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:29:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:29:38.151170 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e60552-404c-4942-9020-03258cb67431 service glance] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:38.152676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c0e60552-404c-4942-9020-03258cb67431 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:38.178573 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:29:38.319510 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e60552-404c-4942-9020-03258cb67431 service glance] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:38.333781 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3bfb1-d444-424d-9086-65431b6005f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:38.337862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3bfb1-d444-424d-9086-65431b6005f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:38.339328 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3bfb1-d444-424d-9086-65431b6005f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:38.339825 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3bfb1-d444-424d-9086-65431b6005f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:38.342308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1bd3bfb1-d444-424d-9086-65431b6005f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:38.464403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd3bfb1-d444-424d-9086-65431b6005f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:38.466595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd3bfb1-d444-424d-9086-65431b6005f3 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:38.481921 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3213/6461] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:29:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:29:40.898049 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=18 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:29:43.884024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4acb29-9833-420e-af06-19e80f96089d None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:43.888720 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6e4acb29-9833-420e-af06-19e80f96089d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:44.025684 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4acb29-9833-420e-af06-19e80f96089d None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:44.032947 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415753d-ff85-4a25-9f19-97a51754b70e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:44.034489 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415753d-ff85-4a25-9f19-97a51754b70e service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:44.034927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415753d-ff85-4a25-9f19-97a51754b70e service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:44.035371 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415753d-ff85-4a25-9f19-97a51754b70e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:44.037310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5415753d-ff85-4a25-9f19-97a51754b70e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:44.178369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415753d-ff85-4a25-9f19-97a51754b70e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:44.180057 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415753d-ff85-4a25-9f19-97a51754b70e service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:44.193804 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3249/6462] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:29:43 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:29:45.369096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3bfb1-d444-424d-9086-65431b6005f3 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:45.371291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1bd3bfb1-d444-424d-9086-65431b6005f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:45.405580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3bfb1-d444-424d-9086-65431b6005f3 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:45.418885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5dbfa-67dd-4b40-a90c-f2a9852a28e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:45.422236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5dbfa-67dd-4b40-a90c-f2a9852a28e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:45.423377 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5dbfa-67dd-4b40-a90c-f2a9852a28e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:45.423888 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5dbfa-67dd-4b40-a90c-f2a9852a28e2 admin admin] PATH_INFO: `/v3/users/bfd3e634551940cea7c8e492c7d8b79b` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:45.425664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5dbfa-67dd-4b40-a90c-f2a9852a28e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfd3e634551940cea7c8e492c7d8b79b)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:45.427844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5dbfa-67dd-4b40-a90c-f2a9852a28e2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:45.562212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-34d5dbfa-67dd-4b40-a90c-f2a9852a28e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfd3e634551940cea7c8e492c7d8b79b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:45.562970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-34d5dbfa-67dd-4b40-a90c-f2a9852a28e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfd3e634551940cea7c8e492c7d8b79b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:45.581050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-34d5dbfa-67dd-4b40-a90c-f2a9852a28e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfd3e634551940cea7c8e492c7d8b79b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:45.595368 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-34d5dbfa-67dd-4b40-a90c-f2a9852a28e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfd3e634551940cea7c8e492c7d8b79b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:45.596143 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-34d5dbfa-67dd-4b40-a90c-f2a9852a28e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfd3e634551940cea7c8e492c7d8b79b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:45.641483 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3214/6463] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:29:45 2022] DELETE /identity/v3/users/bfd3e634551940cea7c8e492c7d8b79b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:29:46.077624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415753d-ff85-4a25-9f19-97a51754b70e service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:46.081374 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5415753d-ff85-4a25-9f19-97a51754b70e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:46.184248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415753d-ff85-4a25-9f19-97a51754b70e service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:46.251073 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:29:46.261461 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5dbfa-67dd-4b40-a90c-f2a9852a28e2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:46.263170 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-34d5dbfa-67dd-4b40-a90c-f2a9852a28e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:46.337668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c3115-166c-46c5-b062-9dd3d2775ed5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:46.338438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c3115-166c-46c5-b062-9dd3d2775ed5 service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:46.338840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c3115-166c-46c5-b062-9dd3d2775ed5 service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:46.338986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c3115-166c-46c5-b062-9dd3d2775ed5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:46.341697 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6d8c3115-166c-46c5-b062-9dd3d2775ed5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:46.346015 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:29:46.367237 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c3115-166c-46c5-b062-9dd3d2775ed5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:46.368866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c3115-166c-46c5-b062-9dd3d2775ed5 service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:46.384079 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3250/6464] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:29:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:29:46.387873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5dbfa-67dd-4b40-a90c-f2a9852a28e2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:46.396476 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f30314-4ce0-4f49-849f-09f3d9e09109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:46.397710 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f30314-4ce0-4f49-849f-09f3d9e09109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:46.398157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f30314-4ce0-4f49-849f-09f3d9e09109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:46.398595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f30314-4ce0-4f49-849f-09f3d9e09109 admin admin] PATH_INFO: `/v3/projects/51c180d4274946dc8e40eb3b09f8dc3f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:46.400496 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f30314-4ce0-4f49-849f-09f3d9e09109 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51c180d4274946dc8e40eb3b09f8dc3f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:46.403020 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f30314-4ce0-4f49-849f-09f3d9e09109 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:46.484001 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a2f30314-4ce0-4f49-849f-09f3d9e09109 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51c180d4274946dc8e40eb3b09f8dc3f', 'request_id': 'req-a2f30314-4ce0-4f49-849f-09f3d9e09109'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:46.494844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a2f30314-4ce0-4f49-849f-09f3d9e09109 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51c180d4274946dc8e40eb3b09f8dc3f', 'request_id': 'req-a2f30314-4ce0-4f49-849f-09f3d9e09109'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:46.504161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a2f30314-4ce0-4f49-849f-09f3d9e09109 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51c180d4274946dc8e40eb3b09f8dc3f', 'request_id': 'req-a2f30314-4ce0-4f49-849f-09f3d9e09109'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:46.517653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a2f30314-4ce0-4f49-849f-09f3d9e09109 admin admin] The token cache is being invalidate because project 51c180d4274946dc8e40eb3b09f8dc3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:29:46.517940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a2f30314-4ce0-4f49-849f-09f3d9e09109 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:46.518901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a2f30314-4ce0-4f49-849f-09f3d9e09109 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:46.521599 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3215/6465] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:29:46 2022] DELETE /identity/v3/projects/51c180d4274946dc8e40eb3b09f8dc3f => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:29:46.526150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf80496-095f-41b7-860e-aeb77e92b748 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:46.526436 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf80496-095f-41b7-860e-aeb77e92b748 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:46.526711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf80496-095f-41b7-860e-aeb77e92b748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:46.552689 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-baf80496-095f-41b7-860e-aeb77e92b748 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:29:46.554230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-baf80496-095f-41b7-860e-aeb77e92b748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:46.632519 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3251/6466] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:29:46.639915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76903c6-cea0-4f51-b363-9eb0fe520fc7 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:46.640199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76903c6-cea0-4f51-b363-9eb0fe520fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:46.640476 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76903c6-cea0-4f51-b363-9eb0fe520fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:46.664895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e76903c6-cea0-4f51-b363-9eb0fe520fc7 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:29:46.666315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e76903c6-cea0-4f51-b363-9eb0fe520fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:46.678155 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3216/6467] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:29:46.681030 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf80496-095f-41b7-860e-aeb77e92b748 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:46.693187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf80496-095f-41b7-860e-aeb77e92b748 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:46.700166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76652799-e51e-4b86-8416-81c190cd6846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:46.700795 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76652799-e51e-4b86-8416-81c190cd6846 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:46.701079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76652799-e51e-4b86-8416-81c190cd6846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:46.701355 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76652799-e51e-4b86-8416-81c190cd6846 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:46.702135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76652799-e51e-4b86-8416-81c190cd6846 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:29:46.702470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76652799-e51e-4b86-8416-81c190cd6846 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:46.704368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76652799-e51e-4b86-8416-81c190cd6846 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:46.721601 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3252/6468] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:29:46.723423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76903c6-cea0-4f51-b363-9eb0fe520fc7 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:46.735587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76903c6-cea0-4f51-b363-9eb0fe520fc7 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:46.741327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea421fdd-bf7c-4f61-a694-41ebb97e4cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:46.742060 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea421fdd-bf7c-4f61-a694-41ebb97e4cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:46.742417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea421fdd-bf7c-4f61-a694-41ebb97e4cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:46.742892 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea421fdd-bf7c-4f61-a694-41ebb97e4cc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:46.743648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea421fdd-bf7c-4f61-a694-41ebb97e4cc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:46.745728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea421fdd-bf7c-4f61-a694-41ebb97e4cc8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:46.786805 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3217/6469] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:29:46 2022] POST /identity/v3/projects => generated 403 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:29:46.787935 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76652799-e51e-4b86-8416-81c190cd6846 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:46.799472 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76652799-e51e-4b86-8416-81c190cd6846 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:46.864716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b75c1a-4e03-4d84-b588-ab8a46e3432c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:46.865339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b75c1a-4e03-4d84-b588-ab8a46e3432c admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:46.865676 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b75c1a-4e03-4d84-b588-ab8a46e3432c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:46.865960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b75c1a-4e03-4d84-b588-ab8a46e3432c admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:46.866601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b75c1a-4e03-4d84-b588-ab8a46e3432c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:46.868637 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b75c1a-4e03-4d84-b588-ab8a46e3432c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:46.898928 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3253/6470] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:29:46 2022] POST /identity/v3/users => generated 302 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:29:46.901723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea421fdd-bf7c-4f61-a694-41ebb97e4cc8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:46.912796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea421fdd-bf7c-4f61-a694-41ebb97e4cc8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:46.917578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05397210-cac8-4f87-8699-bfc8b95845d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:46.918192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05397210-cac8-4f87-8699-bfc8b95845d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:46.918483 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05397210-cac8-4f87-8699-bfc8b95845d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:46.918746 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05397210-cac8-4f87-8699-bfc8b95845d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:46.919381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05397210-cac8-4f87-8699-bfc8b95845d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:46.921040 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05397210-cac8-4f87-8699-bfc8b95845d9 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:46.932790 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3218/6471] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:29:46.936640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b75c1a-4e03-4d84-b588-ab8a46e3432c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:46.949345 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b75c1a-4e03-4d84-b588-ab8a46e3432c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:46.955062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffe9a7-cde4-44da-a200-7318ead6c2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:46.955937 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffe9a7-cde4-44da-a200-7318ead6c2b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:46.956229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffe9a7-cde4-44da-a200-7318ead6c2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:46.956505 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffe9a7-cde4-44da-a200-7318ead6c2b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:46.960271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fffe9a7-cde4-44da-a200-7318ead6c2b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:46.962053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fffe9a7-cde4-44da-a200-7318ead6c2b8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:46.977423 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3254/6472] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:29:46.979113 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05397210-cac8-4f87-8699-bfc8b95845d9 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:47.013702 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05397210-cac8-4f87-8699-bfc8b95845d9 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:47.020834 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb346d-1a55-411f-8269-76042a144939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:47.021536 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb346d-1a55-411f-8269-76042a144939 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:47.021819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb346d-1a55-411f-8269-76042a144939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:47.022093 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb346d-1a55-411f-8269-76042a144939 admin admin] PATH_INFO: `/v3/projects/50d9795bf1244498a78ebd445ef16f36/users/732dd956337c4cd58702a7dbd4302928/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:47.043043 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb346d-1a55-411f-8269-76042a144939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50d9795bf1244498a78ebd445ef16f36, user_id=732dd956337c4cd58702a7dbd4302928, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:47.046114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb346d-1a55-411f-8269-76042a144939 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:47.061372 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3219/6473] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:29:46 2022] PUT /identity/v3/projects/50d9795bf1244498a78ebd445ef16f36/users/732dd956337c4cd58702a7dbd4302928/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:29:47.071960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5add5f-0600-4e96-8f14-5402d95db9ac None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:47.072244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5add5f-0600-4e96-8f14-5402d95db9ac None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:47.072510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5add5f-0600-4e96-8f14-5402d95db9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:47.104859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ee5add5f-0600-4e96-8f14-5402d95db9ac None None] MFA Rules not processed for user `732dd956337c4cd58702a7dbd4302928`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:29:47.106158 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ee5add5f-0600-4e96-8f14-5402d95db9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:47.138562 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:29:47.194086 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3255/6474] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:29:47 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:29:47.209501 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb346d-1a55-411f-8269-76042a144939 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:47.300191 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb346d-1a55-411f-8269-76042a144939 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:47.311241 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4115e-d53f-4ed9-88de-fde0e551ccf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:47.312158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4115e-d53f-4ed9-88de-fde0e551ccf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:47.312532 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4115e-d53f-4ed9-88de-fde0e551ccf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:47.312814 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4115e-d53f-4ed9-88de-fde0e551ccf5 admin admin] PATH_INFO: `/v3/users/732dd956337c4cd58702a7dbd4302928` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:47.314776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e4115e-d53f-4ed9-88de-fde0e551ccf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=732dd956337c4cd58702a7dbd4302928)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:47.320127 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e4115e-d53f-4ed9-88de-fde0e551ccf5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:47.323106 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:29:47.400622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-96e4115e-d53f-4ed9-88de-fde0e551ccf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '732dd956337c4cd58702a7dbd4302928'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:47.401411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-96e4115e-d53f-4ed9-88de-fde0e551ccf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '732dd956337c4cd58702a7dbd4302928'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:47.417855 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-96e4115e-d53f-4ed9-88de-fde0e551ccf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '732dd956337c4cd58702a7dbd4302928'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:47.431680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-96e4115e-d53f-4ed9-88de-fde0e551ccf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '732dd956337c4cd58702a7dbd4302928'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:47.432332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-96e4115e-d53f-4ed9-88de-fde0e551ccf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '732dd956337c4cd58702a7dbd4302928'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:47.496393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fec4f0-0835-4438-99c3-4d5d310d246c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:47.497102 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fec4f0-0835-4438-99c3-4d5d310d246c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:47.497471 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fec4f0-0835-4438-99c3-4d5d310d246c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:47.506111 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3220/6475] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:29:47 2022] DELETE /identity/v3/users/732dd956337c4cd58702a7dbd4302928 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:29:47.534284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-f0fec4f0-0835-4438-99c3-4d5d310d246c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:29:47.535583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f0fec4f0-0835-4438-99c3-4d5d310d246c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:47.674405 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3256/6476] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:29:47.686900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4115e-d53f-4ed9-88de-fde0e551ccf5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:47.688369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-96e4115e-d53f-4ed9-88de-fde0e551ccf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:47.801186 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4115e-d53f-4ed9-88de-fde0e551ccf5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:47.810662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefac5b-b30e-49d6-97ae-f1eb9186bf61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:47.811757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefac5b-b30e-49d6-97ae-f1eb9186bf61 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:47.814090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefac5b-b30e-49d6-97ae-f1eb9186bf61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:47.814090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefac5b-b30e-49d6-97ae-f1eb9186bf61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:47.830313 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aefac5b-b30e-49d6-97ae-f1eb9186bf61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:47.832951 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aefac5b-b30e-49d6-97ae-f1eb9186bf61 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:47.858027 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3221/6477] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:29:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:29:48.279107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fec4f0-0835-4438-99c3-4d5d310d246c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:48.280661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f0fec4f0-0835-4438-99c3-4d5d310d246c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:48.314855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fec4f0-0835-4438-99c3-4d5d310d246c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:48.324934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0150215-b288-4a5d-ad9e-61aaf438bf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:48.324934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0150215-b288-4a5d-ad9e-61aaf438bf3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:48.326852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0150215-b288-4a5d-ad9e-61aaf438bf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:48.327298 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0150215-b288-4a5d-ad9e-61aaf438bf3b admin admin] PATH_INFO: `/v3/projects/50d9795bf1244498a78ebd445ef16f36` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:48.329052 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0150215-b288-4a5d-ad9e-61aaf438bf3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=50d9795bf1244498a78ebd445ef16f36)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:48.331265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0150215-b288-4a5d-ad9e-61aaf438bf3b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:48.421315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e0150215-b288-4a5d-ad9e-61aaf438bf3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50d9795bf1244498a78ebd445ef16f36', 'request_id': 'req-e0150215-b288-4a5d-ad9e-61aaf438bf3b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:48.434242 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e0150215-b288-4a5d-ad9e-61aaf438bf3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50d9795bf1244498a78ebd445ef16f36', 'request_id': 'req-e0150215-b288-4a5d-ad9e-61aaf438bf3b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:48.443024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e0150215-b288-4a5d-ad9e-61aaf438bf3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50d9795bf1244498a78ebd445ef16f36', 'request_id': 'req-e0150215-b288-4a5d-ad9e-61aaf438bf3b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:48.470279 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e0150215-b288-4a5d-ad9e-61aaf438bf3b admin admin] The token cache is being invalidate because project 50d9795bf1244498a78ebd445ef16f36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:29:48.470571 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e0150215-b288-4a5d-ad9e-61aaf438bf3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:48.471245 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e0150215-b288-4a5d-ad9e-61aaf438bf3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:48.473370 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3257/6478] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:29:48 2022] DELETE /identity/v3/projects/50d9795bf1244498a78ebd445ef16f36 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:29:48.478948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2750f-9346-4c8c-8905-e3566ab299f2 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:48.479508 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2750f-9346-4c8c-8905-e3566ab299f2 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:48.479786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2750f-9346-4c8c-8905-e3566ab299f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:48.505798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-51f2750f-9346-4c8c-8905-e3566ab299f2 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:29:48.506775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-51f2750f-9346-4c8c-8905-e3566ab299f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:48.590532 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3222/6479] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:29:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:29:48.599061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d02fc-6993-4700-9680-7d1c8522d278 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:48.599603 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d02fc-6993-4700-9680-7d1c8522d278 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:48.599974 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d02fc-6993-4700-9680-7d1c8522d278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:48.632468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-f25d02fc-6993-4700-9680-7d1c8522d278 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:29:48.633894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f25d02fc-6993-4700-9680-7d1c8522d278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:48.646411 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3258/6480] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:29:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:29:48.650302 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f2750f-9346-4c8c-8905-e3566ab299f2 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:48.665765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f2750f-9346-4c8c-8905-e3566ab299f2 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:48.682586 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4524e-ebf1-48ae-b53a-3e0178996a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:48.683228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4524e-ebf1-48ae-b53a-3e0178996a57 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:48.683510 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4524e-ebf1-48ae-b53a-3e0178996a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:48.683788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4524e-ebf1-48ae-b53a-3e0178996a57 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:48.684452 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d4524e-ebf1-48ae-b53a-3e0178996a57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:29:48.684756 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d4524e-ebf1-48ae-b53a-3e0178996a57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:48.687510 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d4524e-ebf1-48ae-b53a-3e0178996a57 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:48.704855 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3223/6481] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:29:48.709445 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d02fc-6993-4700-9680-7d1c8522d278 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:48.723977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d02fc-6993-4700-9680-7d1c8522d278 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:48.737123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751aeb01-fc92-4e91-b16e-cb679d7a8baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:48.738307 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751aeb01-fc92-4e91-b16e-cb679d7a8baf admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:48.738592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751aeb01-fc92-4e91-b16e-cb679d7a8baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:48.738867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751aeb01-fc92-4e91-b16e-cb679d7a8baf admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:48.739509 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751aeb01-fc92-4e91-b16e-cb679d7a8baf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:48.742671 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751aeb01-fc92-4e91-b16e-cb679d7a8baf admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:48.823470 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3259/6482] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:29:48 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:29:48.827577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4524e-ebf1-48ae-b53a-3e0178996a57 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:48.839321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4524e-ebf1-48ae-b53a-3e0178996a57 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:48.850349 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:29:48.923952 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba6905-e502-40fd-a1be-6319ea1563f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:48.924569 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba6905-e502-40fd-a1be-6319ea1563f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:48.924847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba6905-e502-40fd-a1be-6319ea1563f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:48.925120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba6905-e502-40fd-a1be-6319ea1563f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:48.926167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba6905-e502-40fd-a1be-6319ea1563f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:48.928259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba6905-e502-40fd-a1be-6319ea1563f1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:48.966221 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3224/6483] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:29:48 2022] POST /identity/v3/users => generated 283 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:29:48.967859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751aeb01-fc92-4e91-b16e-cb679d7a8baf admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:48.995198 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751aeb01-fc92-4e91-b16e-cb679d7a8baf admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:49.019831 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb40e0f-ba2d-4d61-bf96-755b091dc00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:49.020572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb40e0f-ba2d-4d61-bf96-755b091dc00a admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:49.020855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb40e0f-ba2d-4d61-bf96-755b091dc00a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:49.021127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb40e0f-ba2d-4d61-bf96-755b091dc00a admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:49.021805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb40e0f-ba2d-4d61-bf96-755b091dc00a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:49.023447 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb40e0f-ba2d-4d61-bf96-755b091dc00a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:49.043169 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3260/6484] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:29:49.044460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba6905-e502-40fd-a1be-6319ea1563f1 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:49.057354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba6905-e502-40fd-a1be-6319ea1563f1 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:49.062310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee82f00-4782-497d-a92d-6c5064e62f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:49.062922 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee82f00-4782-497d-a92d-6c5064e62f86 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:49.063267 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee82f00-4782-497d-a92d-6c5064e62f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:49.063541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee82f00-4782-497d-a92d-6c5064e62f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:49.067407 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee82f00-4782-497d-a92d-6c5064e62f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:49.069340 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee82f00-4782-497d-a92d-6c5064e62f86 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:49.085687 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3225/6485] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:29:49.087293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb40e0f-ba2d-4d61-bf96-755b091dc00a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:49.099171 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb40e0f-ba2d-4d61-bf96-755b091dc00a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:49.105805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ffc0dc-82f1-4322-86e2-8b3e881d225c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:49.106798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffc0dc-82f1-4322-86e2-8b3e881d225c admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:49.107302 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffc0dc-82f1-4322-86e2-8b3e881d225c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:49.108156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffc0dc-82f1-4322-86e2-8b3e881d225c admin admin] PATH_INFO: `/v3/projects/00979ace24c645c58df3e190417fd0e4/users/1da13322d7c749e58574c6262659bd69/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:49.115047 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:29:49.135819 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ffc0dc-82f1-4322-86e2-8b3e881d225c admin admin] RBAC: Authorizing `identity:create_grant(project_id=00979ace24c645c58df3e190417fd0e4, user_id=1da13322d7c749e58574c6262659bd69, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:49.142308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ffc0dc-82f1-4322-86e2-8b3e881d225c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:49.171888 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3261/6486] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:29:49 2022] PUT /identity/v3/projects/00979ace24c645c58df3e190417fd0e4/users/1da13322d7c749e58574c6262659bd69/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:29:49.183905 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a9292-01ed-4776-bb33-e3e35aab6697 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:49.184500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a9292-01ed-4776-bb33-e3e35aab6697 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:49.185040 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a9292-01ed-4776-bb33-e3e35aab6697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:49.233287 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-ab6a9292-01ed-4776-bb33-e3e35aab6697 None None] MFA Rules not processed for user `1da13322d7c749e58574c6262659bd69`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:29:49.234789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ab6a9292-01ed-4776-bb33-e3e35aab6697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:49.333771 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3226/6487] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:29:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:29:49.421379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ffc0dc-82f1-4322-86e2-8b3e881d225c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:49.423385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c4ffc0dc-82f1-4322-86e2-8b3e881d225c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:49.593736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ffc0dc-82f1-4322-86e2-8b3e881d225c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:49.600946 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf6bd0-9d59-48b2-848b-3e08a093e67f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:49.602345 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf6bd0-9d59-48b2-848b-3e08a093e67f service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:49.602821 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf6bd0-9d59-48b2-848b-3e08a093e67f service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:49.603638 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf6bd0-9d59-48b2-848b-3e08a093e67f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:49.616794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf6bd0-9d59-48b2-848b-3e08a093e67f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:49.620321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf6bd0-9d59-48b2-848b-3e08a093e67f service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:49.631780 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3262/6488] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:29:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:29:49.645070 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c040e-85ad-44d8-833f-7b3d38b31bac None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:49.645592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c040e-85ad-44d8-833f-7b3d38b31bac None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:49.645806 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c040e-85ad-44d8-833f-7b3d38b31bac None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:49.647647 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3227/6489] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:29:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:29:49.652917 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf6bd0-9d59-48b2-848b-3e08a093e67f service nova] Authenticating service token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:29:49.666850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf6bd0-9d59-48b2-848b-3e08a093e67f service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:49.684858 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf6bd0-9d59-48b2-848b-3e08a093e67f service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:49.695799 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040b5d7-92f9-442a-8f3d-8c6914a00a25 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1da13322d7c749e58574c6262659bd69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00979ace24c645c58df3e190417fd0e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:49.696596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040b5d7-92f9-442a-8f3d-8c6914a00a25 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:49.696891 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040b5d7-92f9-442a-8f3d-8c6914a00a25 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:49.697576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040b5d7-92f9-442a-8f3d-8c6914a00a25 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] PATH_INFO: `/v3/projects/00979ace24c645c58df3e190417fd0e4` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:49.699017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f040b5d7-92f9-442a-8f3d-8c6914a00a25 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] RBAC: Authorizing `identity:get_project(project_id=00979ace24c645c58df3e190417fd0e4)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:49.701386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f040b5d7-92f9-442a-8f3d-8c6914a00a25 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:49.704595 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3263/6490] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:29:49 2022] GET /identity/v3/projects/00979ace24c645c58df3e190417fd0e4 => generated 365 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:29:49.739195 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50b7c6-38b5-4481-8743-9811780ed33b None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:49.739485 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50b7c6-38b5-4481-8743-9811780ed33b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:49.739745 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50b7c6-38b5-4481-8743-9811780ed33b None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:49.741234 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3228/6491] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:29:49.746698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040b5d7-92f9-442a-8f3d-8c6914a00a25 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] Authenticating service token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:29:49.768886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040b5d7-92f9-442a-8f3d-8c6914a00a25 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:49.784522 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040b5d7-92f9-442a-8f3d-8c6914a00a25 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:49.790231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe2938-412b-49bd-97b3-ad700c25ca04 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1da13322d7c749e58574c6262659bd69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00979ace24c645c58df3e190417fd0e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:49.791453 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe2938-412b-49bd-97b3-ad700c25ca04 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:49.791866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe2938-412b-49bd-97b3-ad700c25ca04 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:49.792346 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe2938-412b-49bd-97b3-ad700c25ca04 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] PATH_INFO: `/v3/projects/00979ace24c645c58df3e190417fd0e4` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:49.793710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe2938-412b-49bd-97b3-ad700c25ca04 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] RBAC: Authorizing `identity:get_project(project_id=00979ace24c645c58df3e190417fd0e4)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:49.796351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe2938-412b-49bd-97b3-ad700c25ca04 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:49.799163 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3264/6492] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:29:49 2022] GET /identity/v3/projects/00979ace24c645c58df3e190417fd0e4 => generated 365 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:29:49.846008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fe760-85d9-4264-a22b-dfa5e4ae623d None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:49.846721 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fe760-85d9-4264-a22b-dfa5e4ae623d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:49.847831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fe760-85d9-4264-a22b-dfa5e4ae623d None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:49.850196 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3229/6493] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:29:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:29:49.855537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe2938-412b-49bd-97b3-ad700c25ca04 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] Authenticating service token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:29:49.858658 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e4fe2938-412b-49bd-97b3-ad700c25ca04 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:49.893912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe2938-412b-49bd-97b3-ad700c25ca04 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:49.903810 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe2938-412b-49bd-97b3-ad700c25ca04 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:49.909259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043fe9f-bb54-47c8-857d-74b8fe630924 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1da13322d7c749e58574c6262659bd69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00979ace24c645c58df3e190417fd0e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:49.910517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043fe9f-bb54-47c8-857d-74b8fe630924 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:49.910872 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043fe9f-bb54-47c8-857d-74b8fe630924 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:49.911223 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043fe9f-bb54-47c8-857d-74b8fe630924 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] PATH_INFO: `/v3/projects/00979ace24c645c58df3e190417fd0e4` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:49.918912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043fe9f-bb54-47c8-857d-74b8fe630924 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] RBAC: Authorizing `identity:get_project(project_id=00979ace24c645c58df3e190417fd0e4)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:49.918912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043fe9f-bb54-47c8-857d-74b8fe630924 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:49.918912 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3265/6494] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:29:49 2022] GET /identity/v3/projects/00979ace24c645c58df3e190417fd0e4 => generated 365 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:29:49.953995 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53676de4-bf41-4409-b87d-550baf30a4bb None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:49.956082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53676de4-bf41-4409-b87d-550baf30a4bb None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:49.956082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53676de4-bf41-4409-b87d-550baf30a4bb None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:49.958059 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3230/6495] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:29:49.964737 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043fe9f-bb54-47c8-857d-74b8fe630924 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] Authenticating service token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:29:49.989850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043fe9f-bb54-47c8-857d-74b8fe630924 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:50.000410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043fe9f-bb54-47c8-857d-74b8fe630924 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:50.004865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90139126-e4b8-4061-9fbf-f47d291b99e8 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1da13322d7c749e58574c6262659bd69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00979ace24c645c58df3e190417fd0e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:50.005497 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90139126-e4b8-4061-9fbf-f47d291b99e8 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:50.005779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90139126-e4b8-4061-9fbf-f47d291b99e8 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:50.006050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90139126-e4b8-4061-9fbf-f47d291b99e8 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] PATH_INFO: `/v3/projects/00979ace24c645c58df3e190417fd0e4` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:50.007187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90139126-e4b8-4061-9fbf-f47d291b99e8 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] RBAC: Authorizing `identity:get_project(project_id=00979ace24c645c58df3e190417fd0e4)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:50.009560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90139126-e4b8-4061-9fbf-f47d291b99e8 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:50.010841 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3266/6496] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:29:49 2022] GET /identity/v3/projects/00979ace24c645c58df3e190417fd0e4 => generated 365 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:29:50.059857 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc835d34-72c6-4190-b357-b8d78d2ebed9 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:50.060192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc835d34-72c6-4190-b357-b8d78d2ebed9 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:50.060504 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc835d34-72c6-4190-b357-b8d78d2ebed9 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:50.062270 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3231/6497] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:29:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:29:50.067550 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90139126-e4b8-4061-9fbf-f47d291b99e8 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] Authenticating service token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:29:50.086169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90139126-e4b8-4061-9fbf-f47d291b99e8 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:50.095340 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90139126-e4b8-4061-9fbf-f47d291b99e8 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:50.100468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e878984-2e38-4b9a-8238-530a048630c4 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1da13322d7c749e58574c6262659bd69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00979ace24c645c58df3e190417fd0e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:50.101304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e878984-2e38-4b9a-8238-530a048630c4 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:50.101928 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e878984-2e38-4b9a-8238-530a048630c4 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:50.102519 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e878984-2e38-4b9a-8238-530a048630c4 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] PATH_INFO: `/v3/projects/00979ace24c645c58df3e190417fd0e4` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:50.104027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e878984-2e38-4b9a-8238-530a048630c4 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] RBAC: Authorizing `identity:get_project(project_id=00979ace24c645c58df3e190417fd0e4)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:50.106583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e878984-2e38-4b9a-8238-530a048630c4 tempest-QuotasTestJSON-1165790873 tempest-QuotasTestJSON-1165790873-project] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:50.113901 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3267/6498] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:29:50 2022] GET /identity/v3/projects/00979ace24c645c58df3e190417fd0e4 => generated 365 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:29:50.150848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc835d34-72c6-4190-b357-b8d78d2ebed9 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:50.230293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc835d34-72c6-4190-b357-b8d78d2ebed9 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:50.239388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863656d-eba7-48ac-845f-6d44716e8613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:50.240035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863656d-eba7-48ac-845f-6d44716e8613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:50.240320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863656d-eba7-48ac-845f-6d44716e8613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:50.240658 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863656d-eba7-48ac-845f-6d44716e8613 admin admin] PATH_INFO: `/v3/users/1da13322d7c749e58574c6262659bd69` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:50.241838 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e863656d-eba7-48ac-845f-6d44716e8613 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1da13322d7c749e58574c6262659bd69)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:50.243778 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e863656d-eba7-48ac-845f-6d44716e8613 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:50.270173 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:29:50.303598 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e863656d-eba7-48ac-845f-6d44716e8613 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1da13322d7c749e58574c6262659bd69'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:50.304416 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e863656d-eba7-48ac-845f-6d44716e8613 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1da13322d7c749e58574c6262659bd69'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:50.314011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e863656d-eba7-48ac-845f-6d44716e8613 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1da13322d7c749e58574c6262659bd69'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:50.323032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e863656d-eba7-48ac-845f-6d44716e8613 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1da13322d7c749e58574c6262659bd69'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:50.323797 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e863656d-eba7-48ac-845f-6d44716e8613 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1da13322d7c749e58574c6262659bd69'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:50.344407 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3232/6499] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:29:50 2022] DELETE /identity/v3/users/1da13322d7c749e58574c6262659bd69 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:29:50.351325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb07bb6-6309-455e-a4a8-80a1d16d2f73 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:50.353997 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb07bb6-6309-455e-a4a8-80a1d16d2f73 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:50.354272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb07bb6-6309-455e-a4a8-80a1d16d2f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:50.377593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-beb07bb6-6309-455e-a4a8-80a1d16d2f73 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:29:50.378919 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-beb07bb6-6309-455e-a4a8-80a1d16d2f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:50.460392 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3268/6500] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:29:50.470653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863656d-eba7-48ac-845f-6d44716e8613 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:50.473041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e863656d-eba7-48ac-845f-6d44716e8613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:50.537562 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863656d-eba7-48ac-845f-6d44716e8613 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:50.541965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f42a8c-ab8b-44b2-8668-c2c7ad37c591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:50.542871 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f42a8c-ab8b-44b2-8668-c2c7ad37c591 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:50.543218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f42a8c-ab8b-44b2-8668-c2c7ad37c591 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:50.543560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f42a8c-ab8b-44b2-8668-c2c7ad37c591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:50.554247 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f42a8c-ab8b-44b2-8668-c2c7ad37c591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:50.555772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f42a8c-ab8b-44b2-8668-c2c7ad37c591 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:50.566626 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3233/6501] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:29:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:29:50.990707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb07bb6-6309-455e-a4a8-80a1d16d2f73 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:50.992161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-beb07bb6-6309-455e-a4a8-80a1d16d2f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:51.020082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb07bb6-6309-455e-a4a8-80a1d16d2f73 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:51.069752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a837d0f-5430-483e-88ed-af5c73bcde97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:51.071691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a837d0f-5430-483e-88ed-af5c73bcde97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:51.072904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a837d0f-5430-483e-88ed-af5c73bcde97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:51.073277 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a837d0f-5430-483e-88ed-af5c73bcde97 admin admin] PATH_INFO: `/v3/projects/00979ace24c645c58df3e190417fd0e4` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:51.075784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a837d0f-5430-483e-88ed-af5c73bcde97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00979ace24c645c58df3e190417fd0e4)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:51.078881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a837d0f-5430-483e-88ed-af5c73bcde97 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:51.110137 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:29:51.144744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3a837d0f-5430-483e-88ed-af5c73bcde97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00979ace24c645c58df3e190417fd0e4', 'request_id': 'req-3a837d0f-5430-483e-88ed-af5c73bcde97'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:51.153499 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3a837d0f-5430-483e-88ed-af5c73bcde97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00979ace24c645c58df3e190417fd0e4', 'request_id': 'req-3a837d0f-5430-483e-88ed-af5c73bcde97'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:51.169274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3a837d0f-5430-483e-88ed-af5c73bcde97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00979ace24c645c58df3e190417fd0e4', 'request_id': 'req-3a837d0f-5430-483e-88ed-af5c73bcde97'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:51.183315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3a837d0f-5430-483e-88ed-af5c73bcde97 admin admin] The token cache is being invalidate because project 00979ace24c645c58df3e190417fd0e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:29:51.183606 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3a837d0f-5430-483e-88ed-af5c73bcde97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:51.184272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3a837d0f-5430-483e-88ed-af5c73bcde97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:51.193935 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3269/6502] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:29:50 2022] DELETE /identity/v3/projects/00979ace24c645c58df3e190417fd0e4 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:29:51.195527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6760a8d-3c55-4ec3-b5e3-729e04ee7018 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:51.196466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6760a8d-3c55-4ec3-b5e3-729e04ee7018 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:51.197084 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6760a8d-3c55-4ec3-b5e3-729e04ee7018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:51.233179 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-f6760a8d-3c55-4ec3-b5e3-729e04ee7018 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:29:51.236561 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f6760a8d-3c55-4ec3-b5e3-729e04ee7018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:51.367556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecae539-c6bb-4356-95b5-ba74279decdc None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:51.367556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecae539-c6bb-4356-95b5-ba74279decdc None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:51.367556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecae539-c6bb-4356-95b5-ba74279decdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:51.368978 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3234/6503] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:29:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:29:51.430592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-cecae539-c6bb-4356-95b5-ba74279decdc None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:29:51.438683 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-cecae539-c6bb-4356-95b5-ba74279decdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:51.455271 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3270/6504] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:29:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:29:51.455881 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6760a8d-3c55-4ec3-b5e3-729e04ee7018 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:51.476210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6760a8d-3c55-4ec3-b5e3-729e04ee7018 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:51.483763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e8a95-0de4-494c-825e-990bdc4b7d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:51.484430 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e8a95-0de4-494c-825e-990bdc4b7d78 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:51.484839 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e8a95-0de4-494c-825e-990bdc4b7d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:51.485296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e8a95-0de4-494c-825e-990bdc4b7d78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:51.486087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e8a95-0de4-494c-825e-990bdc4b7d78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:29:51.486492 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e8a95-0de4-494c-825e-990bdc4b7d78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:51.488514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e8a95-0de4-494c-825e-990bdc4b7d78 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:51.503067 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3235/6505] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:29:51.507780 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecae539-c6bb-4356-95b5-ba74279decdc None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:51.520531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecae539-c6bb-4356-95b5-ba74279decdc None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:51.534458 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb378d7-ac1b-4dc7-9675-fafa6ec84c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:51.535289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb378d7-ac1b-4dc7-9675-fafa6ec84c39 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:51.535575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb378d7-ac1b-4dc7-9675-fafa6ec84c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:51.535855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb378d7-ac1b-4dc7-9675-fafa6ec84c39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:51.536523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb378d7-ac1b-4dc7-9675-fafa6ec84c39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:51.538540 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb378d7-ac1b-4dc7-9675-fafa6ec84c39 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:51.578426 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3271/6506] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:29:51 2022] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:29:51.579866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e8a95-0de4-494c-825e-990bdc4b7d78 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:51.596546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e8a95-0de4-494c-825e-990bdc4b7d78 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:51.628914 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:29:51.673941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5895c44-fedf-4cc8-9c80-2ecd7f807a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:51.674709 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5895c44-fedf-4cc8-9c80-2ecd7f807a8c admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:51.675068 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5895c44-fedf-4cc8-9c80-2ecd7f807a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:51.676273 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5895c44-fedf-4cc8-9c80-2ecd7f807a8c admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:51.678226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5895c44-fedf-4cc8-9c80-2ecd7f807a8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:51.680397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5895c44-fedf-4cc8-9c80-2ecd7f807a8c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:51.725110 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb378d7-ac1b-4dc7-9675-fafa6ec84c39 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:51.739477 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3236/6507] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:29:51 2022] POST /identity/v3/users => generated 287 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:29:51.742466 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb378d7-ac1b-4dc7-9675-fafa6ec84c39 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:51.751889 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5012b-c577-4cbc-8eb2-0792ff48615d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:51.752881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5012b-c577-4cbc-8eb2-0792ff48615d admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:51.753984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5012b-c577-4cbc-8eb2-0792ff48615d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:51.754725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5012b-c577-4cbc-8eb2-0792ff48615d admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:51.755760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5012b-c577-4cbc-8eb2-0792ff48615d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:51.759076 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5012b-c577-4cbc-8eb2-0792ff48615d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:51.777163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5895c44-fedf-4cc8-9c80-2ecd7f807a8c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:51.785787 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3272/6508] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:29:51.791234 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5895c44-fedf-4cc8-9c80-2ecd7f807a8c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:51.812291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b3c79-0c25-45fd-9546-987360230947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:51.815095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b3c79-0c25-45fd-9546-987360230947 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:51.815650 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b3c79-0c25-45fd-9546-987360230947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:51.816760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b3c79-0c25-45fd-9546-987360230947 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:51.817717 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b3c79-0c25-45fd-9546-987360230947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:51.822186 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b3c79-0c25-45fd-9546-987360230947 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:51.844229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5012b-c577-4cbc-8eb2-0792ff48615d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:51.850476 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3237/6509] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:29:51.859547 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5012b-c577-4cbc-8eb2-0792ff48615d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:51.870042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c0242-aaa3-48d0-a184-cee67db203fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:51.871494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c0242-aaa3-48d0-a184-cee67db203fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:51.872017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c0242-aaa3-48d0-a184-cee67db203fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:51.872481 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c0242-aaa3-48d0-a184-cee67db203fb admin admin] PATH_INFO: `/v3/projects/c5d7e9cba83d4298946122c3762acad9/users/14bbc589ca7543c48b5e81da59fe173f/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:51.894870 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c0242-aaa3-48d0-a184-cee67db203fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5d7e9cba83d4298946122c3762acad9, user_id=14bbc589ca7543c48b5e81da59fe173f, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:51.897989 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c0242-aaa3-48d0-a184-cee67db203fb admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:51.932692 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3273/6510] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:29:51 2022] PUT /identity/v3/projects/c5d7e9cba83d4298946122c3762acad9/users/14bbc589ca7543c48b5e81da59fe173f/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:29:51.934771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95245c65-095a-47b9-86ae-734d7bcf56e2 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:51.934928 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95245c65-095a-47b9-86ae-734d7bcf56e2 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:51.935102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95245c65-095a-47b9-86ae-734d7bcf56e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:51.994275 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-95245c65-095a-47b9-86ae-734d7bcf56e2 None None] MFA Rules not processed for user `14bbc589ca7543c48b5e81da59fe173f`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:29:52.016859 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-95245c65-095a-47b9-86ae-734d7bcf56e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:52.129369 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3238/6511] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:29:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:29:52.143248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c0242-aaa3-48d0-a184-cee67db203fb admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:52.146060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c93c0242-aaa3-48d0-a184-cee67db203fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:52.290617 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c0242-aaa3-48d0-a184-cee67db203fb admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:52.299726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa560aa-ddde-4609-8bf1-cf268967b8d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:52.300964 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa560aa-ddde-4609-8bf1-cf268967b8d1 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:52.301244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa560aa-ddde-4609-8bf1-cf268967b8d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:52.301705 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa560aa-ddde-4609-8bf1-cf268967b8d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:52.348216 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa560aa-ddde-4609-8bf1-cf268967b8d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:52.350141 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa560aa-ddde-4609-8bf1-cf268967b8d1 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:52.377859 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3274/6512] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:29:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:29:57.620526 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95245c65-095a-47b9-86ae-734d7bcf56e2 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:57.623038 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-95245c65-095a-47b9-86ae-734d7bcf56e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:57.783717 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95245c65-095a-47b9-86ae-734d7bcf56e2 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:57.789750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f926a-436e-4d8c-9089-a2519f0ba78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:57.790399 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f926a-436e-4d8c-9089-a2519f0ba78b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:57.790682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f926a-436e-4d8c-9089-a2519f0ba78b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:57.790957 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f926a-436e-4d8c-9089-a2519f0ba78b admin admin] PATH_INFO: `/v3/users/0c6f1a91c035491ea2da3f7f3e46a814` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:57.792110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f926a-436e-4d8c-9089-a2519f0ba78b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c6f1a91c035491ea2da3f7f3e46a814)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:57.794107 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f926a-436e-4d8c-9089-a2519f0ba78b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:57.861634 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:29:57.872808 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-039f926a-436e-4d8c-9089-a2519f0ba78b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c6f1a91c035491ea2da3f7f3e46a814'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:57.874545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-039f926a-436e-4d8c-9089-a2519f0ba78b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c6f1a91c035491ea2da3f7f3e46a814'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:57.883499 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-039f926a-436e-4d8c-9089-a2519f0ba78b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c6f1a91c035491ea2da3f7f3e46a814'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:57.903154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa560aa-ddde-4609-8bf1-cf268967b8d1 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:57.907775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-039f926a-436e-4d8c-9089-a2519f0ba78b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c6f1a91c035491ea2da3f7f3e46a814'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:57.910229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-039f926a-436e-4d8c-9089-a2519f0ba78b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c6f1a91c035491ea2da3f7f3e46a814'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:57.921095 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa560aa-ddde-4609-8bf1-cf268967b8d1 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:57.931750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29af208-2b3a-4cbd-8861-073776e4fb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:57.932660 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29af208-2b3a-4cbd-8861-073776e4fb3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:57.933094 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29af208-2b3a-4cbd-8861-073776e4fb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:57.933595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29af208-2b3a-4cbd-8861-073776e4fb3c admin admin] PATH_INFO: `/v3/users/14bbc589ca7543c48b5e81da59fe173f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:57.934896 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29af208-2b3a-4cbd-8861-073776e4fb3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=14bbc589ca7543c48b5e81da59fe173f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:57.937021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29af208-2b3a-4cbd-8861-073776e4fb3c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:57.948556 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3239/6513] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:29:57 2022] DELETE /identity/v3/users/0c6f1a91c035491ea2da3f7f3e46a814 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:29:57.958102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac2c00-9c90-4ab0-9028-35176ea26e3e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:57.959865 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac2c00-9c90-4ab0-9028-35176ea26e3e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:57.960259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac2c00-9c90-4ab0-9028-35176ea26e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:57.997987 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:29:58.000155 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-7fac2c00-9c90-4ab0-9028-35176ea26e3e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:29:58.001743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7fac2c00-9c90-4ab0-9028-35176ea26e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:58.052490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e29af208-2b3a-4cbd-8861-073776e4fb3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14bbc589ca7543c48b5e81da59fe173f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:58.053206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e29af208-2b3a-4cbd-8861-073776e4fb3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14bbc589ca7543c48b5e81da59fe173f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:58.082396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e29af208-2b3a-4cbd-8861-073776e4fb3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14bbc589ca7543c48b5e81da59fe173f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:58.098410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e29af208-2b3a-4cbd-8861-073776e4fb3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14bbc589ca7543c48b5e81da59fe173f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:58.099314 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e29af208-2b3a-4cbd-8861-073776e4fb3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14bbc589ca7543c48b5e81da59fe173f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:58.167642 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3275/6514] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:29:57 2022] DELETE /identity/v3/users/14bbc589ca7543c48b5e81da59fe173f => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:29:58.169049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb379b9e-75e9-4a9b-a910-88f8fc6cc55f None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:58.169337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb379b9e-75e9-4a9b-a910-88f8fc6cc55f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:58.170278 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3240/6515] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:29:58.173761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb379b9e-75e9-4a9b-a910-88f8fc6cc55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:58.210908 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac2c00-9c90-4ab0-9028-35176ea26e3e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:58.214126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7fac2c00-9c90-4ab0-9028-35176ea26e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:58.238646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-eb379b9e-75e9-4a9b-a910-88f8fc6cc55f None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:29:58.239942 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-eb379b9e-75e9-4a9b-a910-88f8fc6cc55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:58.336051 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac2c00-9c90-4ab0-9028-35176ea26e3e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:58.355108 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3276/6516] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:29:58.365999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb379b9e-75e9-4a9b-a910-88f8fc6cc55f None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:58.367628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-eb379b9e-75e9-4a9b-a910-88f8fc6cc55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:58.456580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f56692-ffe0-4cb1-9bac-c0b8413f375c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:58.457217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f56692-ffe0-4cb1-9bac-c0b8413f375c service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:58.459286 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f56692-ffe0-4cb1-9bac-c0b8413f375c service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:58.459587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f56692-ffe0-4cb1-9bac-c0b8413f375c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:58.479168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f56692-ffe0-4cb1-9bac-c0b8413f375c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:58.482014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f56692-ffe0-4cb1-9bac-c0b8413f375c service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:58.504291 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3241/6517] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:29:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:29:58.505597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb379b9e-75e9-4a9b-a910-88f8fc6cc55f None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:58.509798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3beb9-7b3c-4857-b5f0-361843372bbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:58.512166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3beb9-7b3c-4857-b5f0-361843372bbc service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:58.512166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3beb9-7b3c-4857-b5f0-361843372bbc service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:58.512166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3beb9-7b3c-4857-b5f0-361843372bbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:58.522582 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3beb9-7b3c-4857-b5f0-361843372bbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:58.524641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3beb9-7b3c-4857-b5f0-361843372bbc service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:58.537343 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3277/6518] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:29:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:29:58.965703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f56692-ffe0-4cb1-9bac-c0b8413f375c service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:58.967197 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-40f56692-ffe0-4cb1-9bac-c0b8413f375c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:58.990345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f56692-ffe0-4cb1-9bac-c0b8413f375c service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:58.995854 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dadfad1-97ac-46a7-9bb9-f30e1800917d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:58.997193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadfad1-97ac-46a7-9bb9-f30e1800917d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:58.997672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadfad1-97ac-46a7-9bb9-f30e1800917d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:58.998126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadfad1-97ac-46a7-9bb9-f30e1800917d admin admin] PATH_INFO: `/v3/projects/c5d7e9cba83d4298946122c3762acad9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:59.004086 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dadfad1-97ac-46a7-9bb9-f30e1800917d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5d7e9cba83d4298946122c3762acad9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:59.006344 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dadfad1-97ac-46a7-9bb9-f30e1800917d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:59.041616 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:29:59.106749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8dadfad1-97ac-46a7-9bb9-f30e1800917d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5d7e9cba83d4298946122c3762acad9', 'request_id': 'req-8dadfad1-97ac-46a7-9bb9-f30e1800917d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:59.125080 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8dadfad1-97ac-46a7-9bb9-f30e1800917d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5d7e9cba83d4298946122c3762acad9', 'request_id': 'req-8dadfad1-97ac-46a7-9bb9-f30e1800917d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:59.133972 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8dadfad1-97ac-46a7-9bb9-f30e1800917d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5d7e9cba83d4298946122c3762acad9', 'request_id': 'req-8dadfad1-97ac-46a7-9bb9-f30e1800917d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:59.158585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8dadfad1-97ac-46a7-9bb9-f30e1800917d admin admin] The token cache is being invalidate because project c5d7e9cba83d4298946122c3762acad9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:29:59.162089 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8dadfad1-97ac-46a7-9bb9-f30e1800917d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:59.162672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8dadfad1-97ac-46a7-9bb9-f30e1800917d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:59.174378 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3242/6519] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:29:58 2022] DELETE /identity/v3/projects/c5d7e9cba83d4298946122c3762acad9 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:29:59.175962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3beb9-7b3c-4857-b5f0-361843372bbc service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:59.176581 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04381975-9d51-40e8-b50c-00ccc469fd92 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:59.176913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04381975-9d51-40e8-b50c-00ccc469fd92 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:59.177226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04381975-9d51-40e8-b50c-00ccc469fd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:59.177931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-43a3beb9-7b3c-4857-b5f0-361843372bbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:59.196421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3beb9-7b3c-4857-b5f0-361843372bbc service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:59.232014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-04381975-9d51-40e8-b50c-00ccc469fd92 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:29:59.236145 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-04381975-9d51-40e8-b50c-00ccc469fd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:59.306143 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:29:59.336965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71780e53-535d-4c7c-9690-d18000b6f9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:59.338233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71780e53-535d-4c7c-9690-d18000b6f9b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:59.338668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71780e53-535d-4c7c-9690-d18000b6f9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:59.339094 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71780e53-535d-4c7c-9690-d18000b6f9b9 admin admin] PATH_INFO: `/v3/projects/9385f441900f4a789f9a56fb383dbd50` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:59.342776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71780e53-535d-4c7c-9690-d18000b6f9b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9385f441900f4a789f9a56fb383dbd50)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:59.345831 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71780e53-535d-4c7c-9690-d18000b6f9b9 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:59.373715 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3243/6520] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:29:59.382102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c2ec6-0fd8-4757-9565-91f683ed8c2e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:59.383238 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c2ec6-0fd8-4757-9565-91f683ed8c2e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:59.383616 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c2ec6-0fd8-4757-9565-91f683ed8c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:59.425339 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-608c2ec6-0fd8-4757-9565-91f683ed8c2e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:29:59.426825 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-608c2ec6-0fd8-4757-9565-91f683ed8c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:59.446023 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3244/6521] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:29:59.453752 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c2ec6-0fd8-4757-9565-91f683ed8c2e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:59.491364 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c2ec6-0fd8-4757-9565-91f683ed8c2e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:59.496436 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-71780e53-535d-4c7c-9690-d18000b6f9b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9385f441900f4a789f9a56fb383dbd50', 'request_id': 'req-71780e53-535d-4c7c-9690-d18000b6f9b9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:59.509284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-71780e53-535d-4c7c-9690-d18000b6f9b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9385f441900f4a789f9a56fb383dbd50', 'request_id': 'req-71780e53-535d-4c7c-9690-d18000b6f9b9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:59.531223 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-71780e53-535d-4c7c-9690-d18000b6f9b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9385f441900f4a789f9a56fb383dbd50', 'request_id': 'req-71780e53-535d-4c7c-9690-d18000b6f9b9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:59.558266 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-71780e53-535d-4c7c-9690-d18000b6f9b9 admin admin] The token cache is being invalidate because project 9385f441900f4a789f9a56fb383dbd50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:29:59.558561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-71780e53-535d-4c7c-9690-d18000b6f9b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:59.559236 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-71780e53-535d-4c7c-9690-d18000b6f9b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:29:59.562894 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3278/6522] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:29:59 2022] DELETE /identity/v3/projects/9385f441900f4a789f9a56fb383dbd50 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:29:59.568572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bce08-c1de-484d-937e-938fce54febb None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:59.570119 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bce08-c1de-484d-937e-938fce54febb None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:59.570680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bce08-c1de-484d-937e-938fce54febb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:59.599256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-8f4bce08-c1de-484d-937e-938fce54febb None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:29:59.603549 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8f4bce08-c1de-484d-937e-938fce54febb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:59.679520 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3279/6523] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:29:59.685693 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a91cc-3b99-4165-a80f-4f5b82854276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:59.686156 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a91cc-3b99-4165-a80f-4f5b82854276 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:59.686519 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a91cc-3b99-4165-a80f-4f5b82854276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:59.686861 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a91cc-3b99-4165-a80f-4f5b82854276 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:59.687315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2667b4-0943-434b-8327-85c2b6d01b88 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:59.687669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a91cc-3b99-4165-a80f-4f5b82854276 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:29:59.687811 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2667b4-0943-434b-8327-85c2b6d01b88 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:59.688075 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2667b4-0943-434b-8327-85c2b6d01b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:59.688448 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a91cc-3b99-4165-a80f-4f5b82854276 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:59.698070 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a91cc-3b99-4165-a80f-4f5b82854276 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:59.724365 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3245/6524] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:29:59.729750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a91cc-3b99-4165-a80f-4f5b82854276 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:59.733053 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2d7a91cc-3b99-4165-a80f-4f5b82854276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:59.747799 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-3f2667b4-0943-434b-8327-85c2b6d01b88 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:29:59.756996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3f2667b4-0943-434b-8327-85c2b6d01b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:29:59.759265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a91cc-3b99-4165-a80f-4f5b82854276 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:59.772443 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d14ed5-65ed-4b7c-a291-7655a2c95e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:59.773250 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d14ed5-65ed-4b7c-a291-7655a2c95e38 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:59.773612 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d14ed5-65ed-4b7c-a291-7655a2c95e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:59.773956 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d14ed5-65ed-4b7c-a291-7655a2c95e38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:59.774681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d14ed5-65ed-4b7c-a291-7655a2c95e38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:59.778732 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d14ed5-65ed-4b7c-a291-7655a2c95e38 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:59.803872 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3280/6525] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:29:59.804830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2667b4-0943-434b-8327-85c2b6d01b88 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:59.826144 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2667b4-0943-434b-8327-85c2b6d01b88 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:59.837220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f244f-e13b-40c5-8946-659cafa430a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:59.839006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f244f-e13b-40c5-8946-659cafa430a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:59.840341 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f244f-e13b-40c5-8946-659cafa430a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:59.840678 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f244f-e13b-40c5-8946-659cafa430a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:59.841698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f244f-e13b-40c5-8946-659cafa430a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:29:59.844073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f244f-e13b-40c5-8946-659cafa430a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:29:59.847905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f244f-e13b-40c5-8946-659cafa430a1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:29:59.850368 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3246/6526] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:29:59 2022] POST /identity/v3/projects => generated 391 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:29:59.854172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d14ed5-65ed-4b7c-a291-7655a2c95e38 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:59.863779 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:29:59.887013 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3281/6527] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:29:59.891479 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f244f-e13b-40c5-8946-659cafa430a1 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:29:59.909763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f244f-e13b-40c5-8946-659cafa430a1 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:59.986705 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d14ed5-65ed-4b7c-a291-7655a2c95e38 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:29:59.996660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fa126-43a9-422e-99c6-8f7ba1da61b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:29:59.997536 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fa126-43a9-422e-99c6-8f7ba1da61b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:29:59.997975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fa126-43a9-422e-99c6-8f7ba1da61b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:29:59.998446 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fa126-43a9-422e-99c6-8f7ba1da61b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:29:59.999253 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402fa126-43a9-422e-99c6-8f7ba1da61b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:00.001703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402fa126-43a9-422e-99c6-8f7ba1da61b6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:00.029045 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:00.053416 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3247/6528] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:29:59 2022] POST /identity/v3/users => generated 296 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:00.054656 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fa126-43a9-422e-99c6-8f7ba1da61b6 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:00.056448 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08724b8b-c831-43cd-a076-dbf90f05fbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:00.059855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08724b8b-c831-43cd-a076-dbf90f05fbdc admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:00.060172 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08724b8b-c831-43cd-a076-dbf90f05fbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:00.061515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08724b8b-c831-43cd-a076-dbf90f05fbdc admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:00.062375 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08724b8b-c831-43cd-a076-dbf90f05fbdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:00.065420 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08724b8b-c831-43cd-a076-dbf90f05fbdc admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:00.079415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fa126-43a9-422e-99c6-8f7ba1da61b6 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:00.097765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b94d501-4ec6-4db0-93f7-589231c2d40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:00.098409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94d501-4ec6-4db0-93f7-589231c2d40b admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:00.098684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94d501-4ec6-4db0-93f7-589231c2d40b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:00.098951 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94d501-4ec6-4db0-93f7-589231c2d40b admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:00.100843 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b94d501-4ec6-4db0-93f7-589231c2d40b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:00.102542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b94d501-4ec6-4db0-93f7-589231c2d40b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:00.127920 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3248/6529] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:00.132170 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b94d501-4ec6-4db0-93f7-589231c2d40b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:00.134806 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3282/6530] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:29:59 2022] POST /identity/v3/projects => generated 377 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:30:00.144322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08724b8b-c831-43cd-a076-dbf90f05fbdc admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:00.153902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b94d501-4ec6-4db0-93f7-589231c2d40b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:00.237864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08724b8b-c831-43cd-a076-dbf90f05fbdc admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:00.242901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38a837-0053-4c6e-962f-5a3f12d60cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:00.243517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38a837-0053-4c6e-962f-5a3f12d60cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:00.243788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c2cd4-7e0d-48db-be7d-007d092faeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:00.243934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38a837-0053-4c6e-962f-5a3f12d60cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:00.244035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38a837-0053-4c6e-962f-5a3f12d60cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:00.244589 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c2cd4-7e0d-48db-be7d-007d092faeca admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:00.244752 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff38a837-0053-4c6e-962f-5a3f12d60cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:00.245166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c2cd4-7e0d-48db-be7d-007d092faeca admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:00.245883 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c2cd4-7e0d-48db-be7d-007d092faeca admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:00.246385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c2cd4-7e0d-48db-be7d-007d092faeca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:00.246710 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff38a837-0053-4c6e-962f-5a3f12d60cb7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:00.248939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c2cd4-7e0d-48db-be7d-007d092faeca admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:00.261529 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3249/6531] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:00.265362 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38a837-0053-4c6e-962f-5a3f12d60cb7 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:00.278521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38a837-0053-4c6e-962f-5a3f12d60cb7 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:00.283477 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3283/6532] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:30:00 2022] POST /identity/v3/users => generated 289 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:00.284661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c2cd4-7e0d-48db-be7d-007d092faeca admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:00.290128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf730f72-8c54-4df9-be2e-448ecb705e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:00.291166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf730f72-8c54-4df9-be2e-448ecb705e92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:00.291669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf730f72-8c54-4df9-be2e-448ecb705e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:00.291945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf730f72-8c54-4df9-be2e-448ecb705e92 admin admin] PATH_INFO: `/v3/projects/20e607fd91e8442cab5a24b82c66910d/users/068674c62caa435b9338d3579fc69c0c/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:00.295827 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c2cd4-7e0d-48db-be7d-007d092faeca admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:00.302467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296d6eb-5d44-4ea6-ad80-47f3695f84e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:00.303223 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296d6eb-5d44-4ea6-ad80-47f3695f84e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:00.303823 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296d6eb-5d44-4ea6-ad80-47f3695f84e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:00.304175 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296d6eb-5d44-4ea6-ad80-47f3695f84e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:00.305420 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7296d6eb-5d44-4ea6-ad80-47f3695f84e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:00.308077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7296d6eb-5d44-4ea6-ad80-47f3695f84e7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:00.316074 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf730f72-8c54-4df9-be2e-448ecb705e92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20e607fd91e8442cab5a24b82c66910d, user_id=068674c62caa435b9338d3579fc69c0c, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:00.320166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf730f72-8c54-4df9-be2e-448ecb705e92 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:00.336014 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3284/6533] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:00.340142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296d6eb-5d44-4ea6-ad80-47f3695f84e7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:00.343740 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3250/6534] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:30:00 2022] PUT /identity/v3/projects/20e607fd91e8442cab5a24b82c66910d/users/068674c62caa435b9338d3579fc69c0c/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:00.352960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296d6eb-5d44-4ea6-ad80-47f3695f84e7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:00.356153 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf730f72-8c54-4df9-be2e-448ecb705e92 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:00.357891 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-cf730f72-8c54-4df9-be2e-448ecb705e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:00.458337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ad9cf-97f4-4db3-9843-ae5b587de91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:00.459590 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ad9cf-97f4-4db3-9843-ae5b587de91e admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:00.460131 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ad9cf-97f4-4db3-9843-ae5b587de91e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:00.460617 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ad9cf-97f4-4db3-9843-ae5b587de91e admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:00.461413 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:00.462408 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ad9cf-97f4-4db3-9843-ae5b587de91e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:00.466411 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ad9cf-97f4-4db3-9843-ae5b587de91e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:00.469168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf730f72-8c54-4df9-be2e-448ecb705e92 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:00.477971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b239a-1f00-41e8-8003-3ee119f361b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:00.478624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b239a-1f00-41e8-8003-3ee119f361b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:00.478902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b239a-1f00-41e8-8003-3ee119f361b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:00.479423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b239a-1f00-41e8-8003-3ee119f361b8 admin admin] PATH_INFO: `/v3/users/60ba6a2ce93d49df9c088e4e79b051d0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:00.480583 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b239a-1f00-41e8-8003-3ee119f361b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60ba6a2ce93d49df9c088e4e79b051d0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:00.482557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b239a-1f00-41e8-8003-3ee119f361b8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:00.482885 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3285/6535] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:00.484194 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc63c4-3ad5-4a3f-aa54-f770d02b8e25 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:00.485695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc63c4-3ad5-4a3f-aa54-f770d02b8e25 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:00.486165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc63c4-3ad5-4a3f-aa54-f770d02b8e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:00.524818 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e8bc63c4-3ad5-4a3f-aa54-f770d02b8e25 None None] MFA Rules not processed for user `068674c62caa435b9338d3579fc69c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:00.526193 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e8bc63c4-3ad5-4a3f-aa54-f770d02b8e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:00.548082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-624b239a-1f00-41e8-8003-3ee119f361b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60ba6a2ce93d49df9c088e4e79b051d0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:00.548940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-624b239a-1f00-41e8-8003-3ee119f361b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60ba6a2ce93d49df9c088e4e79b051d0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:00.558031 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-624b239a-1f00-41e8-8003-3ee119f361b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60ba6a2ce93d49df9c088e4e79b051d0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:00.570204 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-624b239a-1f00-41e8-8003-3ee119f361b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60ba6a2ce93d49df9c088e4e79b051d0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:00.571064 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-624b239a-1f00-41e8-8003-3ee119f361b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60ba6a2ce93d49df9c088e4e79b051d0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:00.588805 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:00.599388 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3251/6536] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:00 2022] DELETE /identity/v3/users/60ba6a2ce93d49df9c088e4e79b051d0 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:00.600522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b239a-1f00-41e8-8003-3ee119f361b8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:00.605892 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-624b239a-1f00-41e8-8003-3ee119f361b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:00.626293 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3286/6537] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:00 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:00.627857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc63c4-3ad5-4a3f-aa54-f770d02b8e25 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:00.629923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e8bc63c4-3ad5-4a3f-aa54-f770d02b8e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:00.646009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc63c4-3ad5-4a3f-aa54-f770d02b8e25 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:00.733251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b239a-1f00-41e8-8003-3ee119f361b8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:00.734389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65167640-7008-432c-9d57-03541cdc8151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:00.735224 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65167640-7008-432c-9d57-03541cdc8151 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:00.735852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65167640-7008-432c-9d57-03541cdc8151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:00.736369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65167640-7008-432c-9d57-03541cdc8151 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:00.738758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65167640-7008-432c-9d57-03541cdc8151 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:00.739865 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57e9c2-cd8f-4f04-bf6f-fdf877d12a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:00.740648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57e9c2-cd8f-4f04-bf6f-fdf877d12a9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:00.741053 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57e9c2-cd8f-4f04-bf6f-fdf877d12a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:00.741342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57e9c2-cd8f-4f04-bf6f-fdf877d12a9c admin admin] PATH_INFO: `/v3/projects/63d3a45c0bbf4f7a9f80fd73445b2b20/users/f0b129b9e9904c4eb8fe4a4f45ee1aec/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:00.741944 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65167640-7008-432c-9d57-03541cdc8151 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:00.765067 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57e9c2-cd8f-4f04-bf6f-fdf877d12a9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=63d3a45c0bbf4f7a9f80fd73445b2b20, user_id=f0b129b9e9904c4eb8fe4a4f45ee1aec, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:00.767895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57e9c2-cd8f-4f04-bf6f-fdf877d12a9c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:00.793240 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3287/6538] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:30:00 2022] POST /identity/v3/projects => generated 391 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:00.797108 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3252/6539] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:30:00 2022] PUT /identity/v3/projects/63d3a45c0bbf4f7a9f80fd73445b2b20/users/f0b129b9e9904c4eb8fe4a4f45ee1aec/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:00.797356 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65167640-7008-432c-9d57-03541cdc8151 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:00.807913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039e1db-1e6d-4176-8d3a-8394e76f8c7d None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:00.808576 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039e1db-1e6d-4176-8d3a-8394e76f8c7d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:00.809094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039e1db-1e6d-4176-8d3a-8394e76f8c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:00.900644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-9039e1db-1e6d-4176-8d3a-8394e76f8c7d None None] MFA Rules not processed for user `f0b129b9e9904c4eb8fe4a4f45ee1aec`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:00.903533 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9039e1db-1e6d-4176-8d3a-8394e76f8c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:00.964167 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65167640-7008-432c-9d57-03541cdc8151 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:00.969113 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707cc8de-431b-41cb-97e0-5caa03ec4ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:00.969775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cc8de-431b-41cb-97e0-5caa03ec4ece admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:00.970062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cc8de-431b-41cb-97e0-5caa03ec4ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:00.970329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cc8de-431b-41cb-97e0-5caa03ec4ece admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:00.970965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707cc8de-431b-41cb-97e0-5caa03ec4ece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:00.974227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707cc8de-431b-41cb-97e0-5caa03ec4ece admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:00.990878 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:01.008082 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3288/6540] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:30:00 2022] POST /identity/v3/users => generated 302 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:01.009682 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707cc8de-431b-41cb-97e0-5caa03ec4ece admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:01.018106 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-707cc8de-431b-41cb-97e0-5caa03ec4ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:01.032436 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707cc8de-431b-41cb-97e0-5caa03ec4ece admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:01.038527 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e3bce-1224-4336-ad9a-647949a23f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:01.039553 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e3bce-1224-4336-ad9a-647949a23f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:01.040109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e3bce-1224-4336-ad9a-647949a23f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:01.040593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e3bce-1224-4336-ad9a-647949a23f84 admin admin] PATH_INFO: `/v3/projects/8a35f431a73544288270bd215cf145b2` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:01.042275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e3bce-1224-4336-ad9a-647949a23f84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a35f431a73544288270bd215cf145b2)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:01.044473 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e3bce-1224-4336-ad9a-647949a23f84 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:01.045854 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3253/6541] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:30:01.047051 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039e1db-1e6d-4176-8d3a-8394e76f8c7d None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:01.070132 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039e1db-1e6d-4176-8d3a-8394e76f8c7d None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:01.077472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee3bfc-bfaf-4c82-8d3e-b20e2c834937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:01.078922 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee3bfc-bfaf-4c82-8d3e-b20e2c834937 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:01.078922 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee3bfc-bfaf-4c82-8d3e-b20e2c834937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:01.079173 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee3bfc-bfaf-4c82-8d3e-b20e2c834937 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:01.080117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee3bfc-bfaf-4c82-8d3e-b20e2c834937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:01.082627 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee3bfc-bfaf-4c82-8d3e-b20e2c834937 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:01.098313 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3254/6542] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:01.099646 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee3bfc-bfaf-4c82-8d3e-b20e2c834937 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:01.102760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7dee3bfc-bfaf-4c82-8d3e-b20e2c834937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:01.113288 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ba4e3bce-1224-4336-ad9a-647949a23f84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a35f431a73544288270bd215cf145b2', 'request_id': 'req-ba4e3bce-1224-4336-ad9a-647949a23f84'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:01.125312 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ba4e3bce-1224-4336-ad9a-647949a23f84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a35f431a73544288270bd215cf145b2', 'request_id': 'req-ba4e3bce-1224-4336-ad9a-647949a23f84'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:01.127641 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:01.135321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ba4e3bce-1224-4336-ad9a-647949a23f84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a35f431a73544288270bd215cf145b2', 'request_id': 'req-ba4e3bce-1224-4336-ad9a-647949a23f84'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:01.152592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ba4e3bce-1224-4336-ad9a-647949a23f84 admin admin] The token cache is being invalidate because project 8a35f431a73544288270bd215cf145b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:30:01.153127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ba4e3bce-1224-4336-ad9a-647949a23f84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:01.154166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ba4e3bce-1224-4336-ad9a-647949a23f84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:01.156228 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3289/6543] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:30:01 2022] DELETE /identity/v3/projects/8a35f431a73544288270bd215cf145b2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:01.157582 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e3bce-1224-4336-ad9a-647949a23f84 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:01.160421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ba4e3bce-1224-4336-ad9a-647949a23f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:01.197369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee3bfc-bfaf-4c82-8d3e-b20e2c834937 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:01.250053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e3bce-1224-4336-ad9a-647949a23f84 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:01.257632 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12876100-5105-45b9-b061-d5fc0035689c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:01.258871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12876100-5105-45b9-b061-d5fc0035689c admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:01.259723 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12876100-5105-45b9-b061-d5fc0035689c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:01.260108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12876100-5105-45b9-b061-d5fc0035689c admin admin] PATH_INFO: `/v3/projects/62ee527887264cbca4fbeca6a3b05200/users/1334bdbad9574c8ea33f6f4f73594351/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:01.265796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd47a7-0e7e-4fc7-962b-b59a7e3f5d75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:01.266428 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd47a7-0e7e-4fc7-962b-b59a7e3f5d75 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:01.266710 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd47a7-0e7e-4fc7-962b-b59a7e3f5d75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:01.266987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd47a7-0e7e-4fc7-962b-b59a7e3f5d75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:01.269248 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5cfd47a7-0e7e-4fc7-962b-b59a7e3f5d75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:01.280069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12876100-5105-45b9-b061-d5fc0035689c admin admin] RBAC: Authorizing `identity:create_grant(project_id=62ee527887264cbca4fbeca6a3b05200, user_id=1334bdbad9574c8ea33f6f4f73594351, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:01.285134 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12876100-5105-45b9-b061-d5fc0035689c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:01.308858 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3290/6544] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:30:01 2022] PUT /identity/v3/projects/62ee527887264cbca4fbeca6a3b05200/users/1334bdbad9574c8ea33f6f4f73594351/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:01.310500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9480e3a-fc25-4c52-af1c-6433430d35b2 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:01.310885 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9480e3a-fc25-4c52-af1c-6433430d35b2 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:01.311237 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9480e3a-fc25-4c52-af1c-6433430d35b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:01.340040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a9480e3a-fc25-4c52-af1c-6433430d35b2 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:01.342108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a9480e3a-fc25-4c52-af1c-6433430d35b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:01.354957 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd47a7-0e7e-4fc7-962b-b59a7e3f5d75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:01.356699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd47a7-0e7e-4fc7-962b-b59a7e3f5d75 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:01.371202 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3255/6545] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:30:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:30:01.397788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd47a7-0e7e-4fc7-962b-b59a7e3f5d75 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:01.414034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd47a7-0e7e-4fc7-962b-b59a7e3f5d75 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:01.447493 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3291/6546] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:01.447493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9480e3a-fc25-4c52-af1c-6433430d35b2 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:01.447493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a9480e3a-fc25-4c52-af1c-6433430d35b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:01.470531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9480e3a-fc25-4c52-af1c-6433430d35b2 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:01.474584 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:01.480408 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382126b0-b72e-48be-bc73-224b6d17b4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:01.481918 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382126b0-b72e-48be-bc73-224b6d17b4ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:01.482724 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382126b0-b72e-48be-bc73-224b6d17b4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:01.483007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382126b0-b72e-48be-bc73-224b6d17b4ff admin admin] PATH_INFO: `/v3/users/f0b129b9e9904c4eb8fe4a4f45ee1aec` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:01.484187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382126b0-b72e-48be-bc73-224b6d17b4ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0b129b9e9904c4eb8fe4a4f45ee1aec)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:01.486147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382126b0-b72e-48be-bc73-224b6d17b4ff admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:01.490619 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f605c-2af8-48b4-80b4-9783ec83a316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:01.491269 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f605c-2af8-48b4-80b4-9783ec83a316 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:01.491573 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f605c-2af8-48b4-80b4-9783ec83a316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:01.491824 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f605c-2af8-48b4-80b4-9783ec83a316 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:01.493416 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f605c-2af8-48b4-80b4-9783ec83a316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:01.494883 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f605c-2af8-48b4-80b4-9783ec83a316 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:01.513560 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3256/6547] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:01.514772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784ffac-ac92-4fb7-8a07-13f40f27ccb3 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:01.515061 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784ffac-ac92-4fb7-8a07-13f40f27ccb3 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:01.515337 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784ffac-ac92-4fb7-8a07-13f40f27ccb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:01.548558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-0784ffac-ac92-4fb7-8a07-13f40f27ccb3 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:01.549883 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0784ffac-ac92-4fb7-8a07-13f40f27ccb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:01.555199 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-382126b0-b72e-48be-bc73-224b6d17b4ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0b129b9e9904c4eb8fe4a4f45ee1aec'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:01.555931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-382126b0-b72e-48be-bc73-224b6d17b4ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0b129b9e9904c4eb8fe4a4f45ee1aec'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:01.559171 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3257/6548] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:01.560120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784ffac-ac92-4fb7-8a07-13f40f27ccb3 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:01.566565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-382126b0-b72e-48be-bc73-224b6d17b4ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0b129b9e9904c4eb8fe4a4f45ee1aec'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:01.570917 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784ffac-ac92-4fb7-8a07-13f40f27ccb3 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:01.575813 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-382126b0-b72e-48be-bc73-224b6d17b4ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0b129b9e9904c4eb8fe4a4f45ee1aec'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:01.576660 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-382126b0-b72e-48be-bc73-224b6d17b4ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0b129b9e9904c4eb8fe4a4f45ee1aec'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:01.577133 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facac268-616d-4b2e-a274-3b7418ae7a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:01.577846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facac268-616d-4b2e-a274-3b7418ae7a51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:01.578179 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facac268-616d-4b2e-a274-3b7418ae7a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:01.578844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facac268-616d-4b2e-a274-3b7418ae7a51 admin admin] PATH_INFO: `/v3/projects/62ee527887264cbca4fbeca6a3b05200/users/1334bdbad9574c8ea33f6f4f73594351/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:01.579671 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:01.580654 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facac268-616d-4b2e-a274-3b7418ae7a51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62ee527887264cbca4fbeca6a3b05200, user_id=1334bdbad9574c8ea33f6f4f73594351, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:01.584359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facac268-616d-4b2e-a274-3b7418ae7a51 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:01.595492 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3258/6549] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:30:01 2022] PUT /identity/v3/projects/62ee527887264cbca4fbeca6a3b05200/users/1334bdbad9574c8ea33f6f4f73594351/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:01.596315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facac268-616d-4b2e-a274-3b7418ae7a51 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:01.605845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-facac268-616d-4b2e-a274-3b7418ae7a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:01.611633 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3292/6550] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:01 2022] DELETE /identity/v3/users/f0b129b9e9904c4eb8fe4a4f45ee1aec => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:01.613423 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca29b54-14c3-4885-af0a-7b9bc7f2121a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:01.613740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca29b54-14c3-4885-af0a-7b9bc7f2121a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:01.614014 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca29b54-14c3-4885-af0a-7b9bc7f2121a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:01.642243 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-5ca29b54-14c3-4885-af0a-7b9bc7f2121a None None] MFA Rules not processed for user `1334bdbad9574c8ea33f6f4f73594351`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:01.644097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5ca29b54-14c3-4885-af0a-7b9bc7f2121a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:01.683055 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facac268-616d-4b2e-a274-3b7418ae7a51 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:01.720772 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3293/6551] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:01 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:01.723109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9dbe0-e43b-46e3-9449-e1a70e4ae8a5 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:01.723964 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9dbe0-e43b-46e3-9449-e1a70e4ae8a5 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:01.724210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9dbe0-e43b-46e3-9449-e1a70e4ae8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:01.746848 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-28a9dbe0-e43b-46e3-9449-e1a70e4ae8a5 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:01.748281 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-28a9dbe0-e43b-46e3-9449-e1a70e4ae8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:01.764298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e97b7-e3f5-4e4e-b12a-3c16e430ec84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:01.764846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e97b7-e3f5-4e4e-b12a-3c16e430ec84 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:01.765129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e97b7-e3f5-4e4e-b12a-3c16e430ec84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:01.765400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e97b7-e3f5-4e4e-b12a-3c16e430ec84 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:01.766202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e97b7-e3f5-4e4e-b12a-3c16e430ec84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:30:01.766415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e97b7-e3f5-4e4e-b12a-3c16e430ec84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:01.768568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e97b7-e3f5-4e4e-b12a-3c16e430ec84 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:01.771534 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3294/6552] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:01.774240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9dbe0-e43b-46e3-9449-e1a70e4ae8a5 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:01.789488 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3259/6553] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:01.789488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e97b7-e3f5-4e4e-b12a-3c16e430ec84 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:01.790502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ef3e97b7-e3f5-4e4e-b12a-3c16e430ec84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:01.795072 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9dbe0-e43b-46e3-9449-e1a70e4ae8a5 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:01.798810 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63be28-83f4-4100-89c7-2b13314c4f21 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:01.799423 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63be28-83f4-4100-89c7-2b13314c4f21 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:01.799817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63be28-83f4-4100-89c7-2b13314c4f21 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:01.800806 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63be28-83f4-4100-89c7-2b13314c4f21 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:01.801519 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63be28-83f4-4100-89c7-2b13314c4f21 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:01.803303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63be28-83f4-4100-89c7-2b13314c4f21 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:01.838454 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3295/6554] 10.222.0.30 () {60 vars in 1149 bytes} [Sun Sep 4 01:30:01 2022] POST /identity/v3/domains => generated 277 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:01.839379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63be28-83f4-4100-89c7-2b13314c4f21 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:01.864878 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e97b7-e3f5-4e4e-b12a-3c16e430ec84 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:01.876626 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:01.916245 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63be28-83f4-4100-89c7-2b13314c4f21 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:01.920992 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28784f-a31c-4af5-bec2-42b62942b280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:01.921641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28784f-a31c-4af5-bec2-42b62942b280 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:01.921919 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28784f-a31c-4af5-bec2-42b62942b280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:01.922342 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28784f-a31c-4af5-bec2-42b62942b280 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:01.922987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e28784f-a31c-4af5-bec2-42b62942b280 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:01.925492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e28784f-a31c-4af5-bec2-42b62942b280 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:01.933230 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01443041-7d89-4912-8dae-afa4085d21e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:01.933966 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01443041-7d89-4912-8dae-afa4085d21e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:01.934284 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01443041-7d89-4912-8dae-afa4085d21e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:01.934564 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01443041-7d89-4912-8dae-afa4085d21e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:01.945202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01443041-7d89-4912-8dae-afa4085d21e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:01.946959 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01443041-7d89-4912-8dae-afa4085d21e1 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:01.958672 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3296/6555] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:30:01 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:01.958672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28784f-a31c-4af5-bec2-42b62942b280 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:01.959109 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3260/6556] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:30:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:30:01.960092 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01443041-7d89-4912-8dae-afa4085d21e1 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:01.981104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01443041-7d89-4912-8dae-afa4085d21e1 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:02.007701 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:02.060872 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28784f-a31c-4af5-bec2-42b62942b280 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:02.066498 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab31fdd-338f-4c17-b64c-665a61c002fe tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:02.067270 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab31fdd-338f-4c17-b64c-665a61c002fe tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:02.067625 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab31fdd-338f-4c17-b64c-665a61c002fe tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:02.068002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab31fdd-338f-4c17-b64c-665a61c002fe tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/2d286f4c5e11455fa5f398ad0d168afd/config` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:02.068756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab31fdd-338f-4c17-b64c-665a61c002fe tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=2d286f4c5e11455fa5f398ad0d168afd)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:02.069926 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-cab31fdd-338f-4c17-b64c-665a61c002fe tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:30:02.069926 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:30:02.069926 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:30:02.071138 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70f78d-9822-4a76-9eb2-99dff22cfeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:02.071616 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab31fdd-338f-4c17-b64c-665a61c002fe tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:02.072723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70f78d-9822-4a76-9eb2-99dff22cfeaa admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:02.073189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70f78d-9822-4a76-9eb2-99dff22cfeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:02.073770 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70f78d-9822-4a76-9eb2-99dff22cfeaa admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:02.074852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b70f78d-9822-4a76-9eb2-99dff22cfeaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:02.077516 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b70f78d-9822-4a76-9eb2-99dff22cfeaa admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:02.108008 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3261/6557] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:30:01 2022] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:30:02.113540 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70f78d-9822-4a76-9eb2-99dff22cfeaa admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:02.126418 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70f78d-9822-4a76-9eb2-99dff22cfeaa admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:02.128174 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3297/6558] 10.222.0.30 () {60 vars in 1269 bytes} [Sun Sep 4 01:30:01 2022] PUT /identity/v3/domains/2d286f4c5e11455fa5f398ad0d168afd/config => generated 138 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:02.132602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab31fdd-338f-4c17-b64c-665a61c002fe tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:02.134915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b06c07-7609-4db9-981d-a5db257fb00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:02.135540 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b06c07-7609-4db9-981d-a5db257fb00f admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:02.135999 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b06c07-7609-4db9-981d-a5db257fb00f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:02.136274 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b06c07-7609-4db9-981d-a5db257fb00f admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:02.137223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b06c07-7609-4db9-981d-a5db257fb00f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:02.141792 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b06c07-7609-4db9-981d-a5db257fb00f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:02.148671 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab31fdd-338f-4c17-b64c-665a61c002fe tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:02.153285 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3262/6559] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:02.159926 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f88cc-06e5-4be9-9328-cae892b3e3ef tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:02.161060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f88cc-06e5-4be9-9328-cae892b3e3ef tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:02.162457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f88cc-06e5-4be9-9328-cae892b3e3ef tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:02.163119 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f88cc-06e5-4be9-9328-cae892b3e3ef tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/2d286f4c5e11455fa5f398ad0d168afd/config/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:02.166477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f88cc-06e5-4be9-9328-cae892b3e3ef tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=2d286f4c5e11455fa5f398ad0d168afd, group=identity)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:02.168095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b06c07-7609-4db9-981d-a5db257fb00f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:02.168396 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-da0f88cc-06e5-4be9-9328-cae892b3e3ef tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:30:02.168396 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:30:02.168396 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:30:02.169372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f88cc-06e5-4be9-9328-cae892b3e3ef tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:02.179564 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3298/6560] 10.222.0.30 () {58 vars in 1275 bytes} [Sun Sep 4 01:30:02 2022] GET /identity/v3/domains/2d286f4c5e11455fa5f398ad0d168afd/config/identity => generated 45 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:02.183561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f88cc-06e5-4be9-9328-cae892b3e3ef tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:02.189182 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b06c07-7609-4db9-981d-a5db257fb00f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:02.196958 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f88cc-06e5-4be9-9328-cae892b3e3ef tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:02.200634 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9121e01-b028-4c9f-80a0-918293cbb19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:02.201256 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9121e01-b028-4c9f-80a0-918293cbb19d admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:02.201566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9121e01-b028-4c9f-80a0-918293cbb19d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:02.201840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9121e01-b028-4c9f-80a0-918293cbb19d admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:02.202479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9121e01-b028-4c9f-80a0-918293cbb19d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:02.204079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9121e01-b028-4c9f-80a0-918293cbb19d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:02.204986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621f11c-52af-4b9a-b75b-2314c3f891a5 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:02.206970 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621f11c-52af-4b9a-b75b-2314c3f891a5 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:02.207290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621f11c-52af-4b9a-b75b-2314c3f891a5 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:02.207528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621f11c-52af-4b9a-b75b-2314c3f891a5 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/2d286f4c5e11455fa5f398ad0d168afd/config/identity/driver` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:02.208877 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621f11c-52af-4b9a-b75b-2314c3f891a5 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=2d286f4c5e11455fa5f398ad0d168afd, group=identity, option=driver)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:02.210687 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621f11c-52af-4b9a-b75b-2314c3f891a5 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:02.219030 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3263/6561] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:02.219480 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3299/6562] 10.222.0.30 () {58 vars in 1296 bytes} [Sun Sep 4 01:30:02 2022] GET /identity/v3/domains/2d286f4c5e11455fa5f398ad0d168afd/config/identity/driver => generated 31 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 04 01:30:02.223583 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9121e01-b028-4c9f-80a0-918293cbb19d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:02.226669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621f11c-52af-4b9a-b75b-2314c3f891a5 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:02.239026 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9121e01-b028-4c9f-80a0-918293cbb19d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:02.240339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621f11c-52af-4b9a-b75b-2314c3f891a5 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:02.247551 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2013f2-f789-4077-b390-4d1454ff6948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:02.248585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2013f2-f789-4077-b390-4d1454ff6948 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:02.249016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2013f2-f789-4077-b390-4d1454ff6948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:02.249594 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2013f2-f789-4077-b390-4d1454ff6948 admin admin] PATH_INFO: `/v3/projects/f3b6f6d57b5647eebd2b2f5173eb8a65/users/0890bb25f8c34d1d90a9d3101c759ca8/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:02.250093 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e015b-d251-4153-a254-d67e2d491749 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:02.250787 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e015b-d251-4153-a254-d67e2d491749 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:02.251157 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e015b-d251-4153-a254-d67e2d491749 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:02.251446 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e015b-d251-4153-a254-d67e2d491749 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/2d286f4c5e11455fa5f398ad0d168afd/config/ldap` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:02.252752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e015b-d251-4153-a254-d67e2d491749 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=2d286f4c5e11455fa5f398ad0d168afd, group=ldap)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:02.256298 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e015b-d251-4153-a254-d67e2d491749 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:02.266307 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3300/6563] 10.222.0.30 () {58 vars in 1263 bytes} [Sun Sep 4 01:30:02 2022] GET /identity/v3/domains/2d286f4c5e11455fa5f398ad0d168afd/config/ldap => generated 106 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:02.267212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e015b-d251-4153-a254-d67e2d491749 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:02.278575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2013f2-f789-4077-b390-4d1454ff6948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3b6f6d57b5647eebd2b2f5173eb8a65, user_id=0890bb25f8c34d1d90a9d3101c759ca8, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:02.282266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2013f2-f789-4077-b390-4d1454ff6948 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:02.290461 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e015b-d251-4153-a254-d67e2d491749 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:02.298189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2012ae4-61ca-49ce-a6dd-f35697814632 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:02.300444 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2012ae4-61ca-49ce-a6dd-f35697814632 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:02.300984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2012ae4-61ca-49ce-a6dd-f35697814632 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:02.301494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2012ae4-61ca-49ce-a6dd-f35697814632 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/2d286f4c5e11455fa5f398ad0d168afd/config/ldap/url` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:02.303494 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3264/6564] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:30:02 2022] PUT /identity/v3/projects/f3b6f6d57b5647eebd2b2f5173eb8a65/users/0890bb25f8c34d1d90a9d3101c759ca8/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:30:02.303962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2012ae4-61ca-49ce-a6dd-f35697814632 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=2d286f4c5e11455fa5f398ad0d168afd, group=ldap, option=url)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:02.305694 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2012ae4-61ca-49ce-a6dd-f35697814632 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:02.316042 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3301/6565] 10.222.0.30 () {58 vars in 1275 bytes} [Sun Sep 4 01:30:02 2022] GET /identity/v3/domains/2d286f4c5e11455fa5f398ad0d168afd/config/ldap/url => generated 46 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:02.316339 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d71c7-e39c-47fe-b357-af7de6f19a4b None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:02.316816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d71c7-e39c-47fe-b357-af7de6f19a4b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:02.319000 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d71c7-e39c-47fe-b357-af7de6f19a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:02.320646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2012ae4-61ca-49ce-a6dd-f35697814632 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:02.334382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2012ae4-61ca-49ce-a6dd-f35697814632 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:02.356327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-f64d71c7-e39c-47fe-b357-af7de6f19a4b None None] MFA Rules not processed for user `0890bb25f8c34d1d90a9d3101c759ca8`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:02.357628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f64d71c7-e39c-47fe-b357-af7de6f19a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:02.417067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde9149-15a6-4585-95ef-91593763352c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:02.417766 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde9149-15a6-4585-95ef-91593763352c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:02.418051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde9149-15a6-4585-95ef-91593763352c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:02.418334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde9149-15a6-4585-95ef-91593763352c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/2d286f4c5e11455fa5f398ad0d168afd/config/ldap/user_tree_dn` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:02.419489 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdde9149-15a6-4585-95ef-91593763352c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=2d286f4c5e11455fa5f398ad0d168afd, group=ldap, option=user_tree_dn)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:02.421160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdde9149-15a6-4585-95ef-91593763352c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:02.423112 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:02.427032 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3302/6566] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Sep 4 01:30:02 2022] GET /identity/v3/domains/2d286f4c5e11455fa5f398ad0d168afd/config/ldap/user_tree_dn => generated 63 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:02.427912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde9149-15a6-4585-95ef-91593763352c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:02.429614 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fdde9149-15a6-4585-95ef-91593763352c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:02.464078 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3265/6567] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:02.464727 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d71c7-e39c-47fe-b357-af7de6f19a4b None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:02.480675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d71c7-e39c-47fe-b357-af7de6f19a4b None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:02.487495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e99a01-8aab-40e7-8d26-c07c3399c9b1 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:02.487495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e99a01-8aab-40e7-8d26-c07c3399c9b1 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:02.487758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e99a01-8aab-40e7-8d26-c07c3399c9b1 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:02.487960 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e99a01-8aab-40e7-8d26-c07c3399c9b1 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/2d286f4c5e11455fa5f398ad0d168afd/config` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:02.488843 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e99a01-8aab-40e7-8d26-c07c3399c9b1 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=2d286f4c5e11455fa5f398ad0d168afd)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:02.490165 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-41e99a01-8aab-40e7-8d26-c07c3399c9b1 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:30:02.490165 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:30:02.490165 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:30:02.491225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e99a01-8aab-40e7-8d26-c07c3399c9b1 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:02.509813 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3266/6568] 10.222.0.30 () {58 vars in 1251 bytes} [Sun Sep 4 01:30:02 2022] DELETE /identity/v3/domains/2d286f4c5e11455fa5f398ad0d168afd/config => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:02.509813 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e99a01-8aab-40e7-8d26-c07c3399c9b1 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:02.511567 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:02.516763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde9149-15a6-4585-95ef-91593763352c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:02.521603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e99a01-8aab-40e7-8d26-c07c3399c9b1 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:02.524857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2f197-8268-4d2c-8012-41dd5a31048e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:02.526046 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2f197-8268-4d2c-8012-41dd5a31048e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:02.526847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd2f00-70cd-4461-a9dd-92c3fdb78781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:02.527008 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2f197-8268-4d2c-8012-41dd5a31048e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:02.527260 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2f197-8268-4d2c-8012-41dd5a31048e admin admin] PATH_INFO: `/v3/projects/63d3a45c0bbf4f7a9f80fd73445b2b20` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:02.527576 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd2f00-70cd-4461-a9dd-92c3fdb78781 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:02.528078 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd2f00-70cd-4461-a9dd-92c3fdb78781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:02.528372 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd2f00-70cd-4461-a9dd-92c3fdb78781 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:02.528792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2f197-8268-4d2c-8012-41dd5a31048e admin admin] RBAC: Authorizing `identity:delete_project(project_id=63d3a45c0bbf4f7a9f80fd73445b2b20)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:02.529011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd2f00-70cd-4461-a9dd-92c3fdb78781 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:02.531216 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd2f00-70cd-4461-a9dd-92c3fdb78781 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:02.531433 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2f197-8268-4d2c-8012-41dd5a31048e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:02.576445 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3267/6569] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:30:02 2022] POST /identity/v3/projects => generated 369 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:02.576445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd2f00-70cd-4461-a9dd-92c3fdb78781 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:02.597915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2ad2f197-8268-4d2c-8012-41dd5a31048e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63d3a45c0bbf4f7a9f80fd73445b2b20', 'request_id': 'req-2ad2f197-8268-4d2c-8012-41dd5a31048e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:02.609728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2ad2f197-8268-4d2c-8012-41dd5a31048e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63d3a45c0bbf4f7a9f80fd73445b2b20', 'request_id': 'req-2ad2f197-8268-4d2c-8012-41dd5a31048e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:02.619527 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2ad2f197-8268-4d2c-8012-41dd5a31048e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63d3a45c0bbf4f7a9f80fd73445b2b20', 'request_id': 'req-2ad2f197-8268-4d2c-8012-41dd5a31048e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:02.635439 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2ad2f197-8268-4d2c-8012-41dd5a31048e admin admin] The token cache is being invalidate because project 63d3a45c0bbf4f7a9f80fd73445b2b20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:30:02.635977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2ad2f197-8268-4d2c-8012-41dd5a31048e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:02.637000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2ad2f197-8268-4d2c-8012-41dd5a31048e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:02.638935 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3303/6570] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:30:02 2022] DELETE /identity/v3/projects/63d3a45c0bbf4f7a9f80fd73445b2b20 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:02.642922 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2f197-8268-4d2c-8012-41dd5a31048e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:02.644957 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2ad2f197-8268-4d2c-8012-41dd5a31048e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:02.659977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd2f00-70cd-4461-a9dd-92c3fdb78781 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:02.724801 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2f197-8268-4d2c-8012-41dd5a31048e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:02.726322 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4c8d0-7498-4d4a-9a83-cd78ffc05a49 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:02.727194 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4c8d0-7498-4d4a-9a83-cd78ffc05a49 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:02.727826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4c8d0-7498-4d4a-9a83-cd78ffc05a49 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:02.728238 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4c8d0-7498-4d4a-9a83-cd78ffc05a49 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/2d286f4c5e11455fa5f398ad0d168afd` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:02.729514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d4c8d0-7498-4d4a-9a83-cd78ffc05a49 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2d286f4c5e11455fa5f398ad0d168afd)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:02.729650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31c31d-1417-49f8-9ca8-ceb98cc323a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:02.730331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31c31d-1417-49f8-9ca8-ceb98cc323a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:02.730678 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31c31d-1417-49f8-9ca8-ceb98cc323a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:02.731010 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31c31d-1417-49f8-9ca8-ceb98cc323a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:02.731107 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d4c8d0-7498-4d4a-9a83-cd78ffc05a49 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:02.731750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31c31d-1417-49f8-9ca8-ceb98cc323a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:02.733841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31c31d-1417-49f8-9ca8-ceb98cc323a6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:02.756987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-31d4c8d0-7498-4d4a-9a83-cd78ffc05a49 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2d286f4c5e11455fa5f398ad0d168afd'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:02.757765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-31d4c8d0-7498-4d4a-9a83-cd78ffc05a49 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2d286f4c5e11455fa5f398ad0d168afd'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:02.762854 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3304/6571] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:30:02 2022] POST /identity/v3/users => generated 291 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:02.762854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309f7fa-36e0-4bd8-b09b-5995a8d03e42 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:02.762854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309f7fa-36e0-4bd8-b09b-5995a8d03e42 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:02.762854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309f7fa-36e0-4bd8-b09b-5995a8d03e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:02.782763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-b309f7fa-36e0-4bd8-b09b-5995a8d03e42 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:02.784330 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b309f7fa-36e0-4bd8-b09b-5995a8d03e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:02.796973 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-31d4c8d0-7498-4d4a-9a83-cd78ffc05a49 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2d286f4c5e11455fa5f398ad0d168afd'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:02.797730 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-31d4c8d0-7498-4d4a-9a83-cd78ffc05a49 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2d286f4c5e11455fa5f398ad0d168afd'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:02.800270 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3268/6572] 10.222.0.30 () {60 vars in 1249 bytes} [Sun Sep 4 01:30:02 2022] PATCH /identity/v3/domains/2d286f4c5e11455fa5f398ad0d168afd => generated 278 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:02.801033 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4c8d0-7498-4d4a-9a83-cd78ffc05a49 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:02.802788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-31d4c8d0-7498-4d4a-9a83-cd78ffc05a49 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:02.837742 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:02.850495 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3305/6573] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:02.851364 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309f7fa-36e0-4bd8-b09b-5995a8d03e42 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:02.852600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b309f7fa-36e0-4bd8-b09b-5995a8d03e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:02.875448 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:02.888089 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4c8d0-7498-4d4a-9a83-cd78ffc05a49 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:02.894618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6867acc-cf71-4b1d-a8e5-5868b2f061a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:02.895269 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6867acc-cf71-4b1d-a8e5-5868b2f061a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:02.895553 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6867acc-cf71-4b1d-a8e5-5868b2f061a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:02.895823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6867acc-cf71-4b1d-a8e5-5868b2f061a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:02.896471 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6867acc-cf71-4b1d-a8e5-5868b2f061a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:02.898128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6867acc-cf71-4b1d-a8e5-5868b2f061a0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:02.911818 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3269/6574] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:02.913968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683a3be-e7b2-4587-97a1-87dd2c99788f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:02.914341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683a3be-e7b2-4587-97a1-87dd2c99788f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:02.914764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683a3be-e7b2-4587-97a1-87dd2c99788f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:02.928908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309f7fa-36e0-4bd8-b09b-5995a8d03e42 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:02.933973 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1228325-de16-4333-9bb3-b3fd9df91f22 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:02.934604 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1228325-de16-4333-9bb3-b3fd9df91f22 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:02.934887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1228325-de16-4333-9bb3-b3fd9df91f22 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:02.935162 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1228325-de16-4333-9bb3-b3fd9df91f22 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/2d286f4c5e11455fa5f398ad0d168afd` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:02.938076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-6683a3be-e7b2-4587-97a1-87dd2c99788f None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:02.939069 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6683a3be-e7b2-4587-97a1-87dd2c99788f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:02.946384 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1228325-de16-4333-9bb3-b3fd9df91f22 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2d286f4c5e11455fa5f398ad0d168afd)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:02.947855 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3270/6575] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:02.947985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1228325-de16-4333-9bb3-b3fd9df91f22 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:02.948679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683a3be-e7b2-4587-97a1-87dd2c99788f None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:02.958820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683a3be-e7b2-4587-97a1-87dd2c99788f None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:02.963965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd363e3-dc33-42c0-9e74-17c444eff8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:02.964603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd363e3-dc33-42c0-9e74-17c444eff8ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:02.964893 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd363e3-dc33-42c0-9e74-17c444eff8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:02.965165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd363e3-dc33-42c0-9e74-17c444eff8ae admin admin] PATH_INFO: `/v3/projects/896fbfa1c11240f9a4d783a68b362232/users/6da97a32e5f74f49a315bd32b1fc99c4/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:02.971186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b1228325-de16-4333-9bb3-b3fd9df91f22 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2d286f4c5e11455fa5f398ad0d168afd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:02.979651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd363e3-dc33-42c0-9e74-17c444eff8ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=896fbfa1c11240f9a4d783a68b362232, user_id=6da97a32e5f74f49a315bd32b1fc99c4, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:02.981227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b1228325-de16-4333-9bb3-b3fd9df91f22 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2d286f4c5e11455fa5f398ad0d168afd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:02.982616 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd363e3-dc33-42c0-9e74-17c444eff8ae admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:02.996538 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3271/6576] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:30:02 2022] PUT /identity/v3/projects/896fbfa1c11240f9a4d783a68b362232/users/6da97a32e5f74f49a315bd32b1fc99c4/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:02.997848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd363e3-dc33-42c0-9e74-17c444eff8ae admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:03.026511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b1228325-de16-4333-9bb3-b3fd9df91f22 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d286f4c5e11455fa5f398ad0d168afd', 'request_id': 'req-b1228325-de16-4333-9bb3-b3fd9df91f22'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:03.036463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b1228325-de16-4333-9bb3-b3fd9df91f22 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d286f4c5e11455fa5f398ad0d168afd', 'request_id': 'req-b1228325-de16-4333-9bb3-b3fd9df91f22'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:03.043125 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b1228325-de16-4333-9bb3-b3fd9df91f22 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d286f4c5e11455fa5f398ad0d168afd', 'request_id': 'req-b1228325-de16-4333-9bb3-b3fd9df91f22'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:03.056210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b1228325-de16-4333-9bb3-b3fd9df91f22 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] The token cache is being invalidate because project 2d286f4c5e11455fa5f398ad0d168afd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:30:03.056510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b1228325-de16-4333-9bb3-b3fd9df91f22 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:03.057381 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b1228325-de16-4333-9bb3-b3fd9df91f22 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:03.066454 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b1228325-de16-4333-9bb3-b3fd9df91f22 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2d286f4c5e11455fa5f398ad0d168afd', 'request_id': 'req-b1228325-de16-4333-9bb3-b3fd9df91f22'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:03.067152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b1228325-de16-4333-9bb3-b3fd9df91f22 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2d286f4c5e11455fa5f398ad0d168afd', 'request_id': 'req-b1228325-de16-4333-9bb3-b3fd9df91f22'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:03.068866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b1228325-de16-4333-9bb3-b3fd9df91f22 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2d286f4c5e11455fa5f398ad0d168afd', 'request_id': 'req-b1228325-de16-4333-9bb3-b3fd9df91f22'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:03.073739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd363e3-dc33-42c0-9e74-17c444eff8ae admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:03.078921 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3306/6577] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:30:02 2022] DELETE /identity/v3/domains/2d286f4c5e11455fa5f398ad0d168afd => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:03.083086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1228325-de16-4333-9bb3-b3fd9df91f22 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:03.085213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b1228325-de16-4333-9bb3-b3fd9df91f22 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:03.145260 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06394c6e-271f-4310-972d-7d7b2bfe69be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:03.145914 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06394c6e-271f-4310-972d-7d7b2bfe69be admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:03.146197 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06394c6e-271f-4310-972d-7d7b2bfe69be admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:03.146473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06394c6e-271f-4310-972d-7d7b2bfe69be admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:03.147233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06394c6e-271f-4310-972d-7d7b2bfe69be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:30:03.147541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06394c6e-271f-4310-972d-7d7b2bfe69be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:03.149253 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06394c6e-271f-4310-972d-7d7b2bfe69be admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:03.153041 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:03.160984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1228325-de16-4333-9bb3-b3fd9df91f22 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:03.164470 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3272/6578] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:03.165644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06394c6e-271f-4310-972d-7d7b2bfe69be admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:03.167578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-06394c6e-271f-4310-972d-7d7b2bfe69be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:03.170561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3168de-c0fc-4c67-bfc1-9a2496b31313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:03.171098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3168de-c0fc-4c67-bfc1-9a2496b31313 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:03.171403 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3168de-c0fc-4c67-bfc1-9a2496b31313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:03.171640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3168de-c0fc-4c67-bfc1-9a2496b31313 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:03.172640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3168de-c0fc-4c67-bfc1-9a2496b31313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:03.175977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3168de-c0fc-4c67-bfc1-9a2496b31313 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:03.186618 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3307/6579] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:03.187329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3168de-c0fc-4c67-bfc1-9a2496b31313 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:03.189102 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7d3168de-c0fc-4c67-bfc1-9a2496b31313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:03.202236 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3168de-c0fc-4c67-bfc1-9a2496b31313 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:03.209843 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c3f55-a8e5-40cb-9ccc-792068df1124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:03.210737 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c3f55-a8e5-40cb-9ccc-792068df1124 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:03.211008 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c3f55-a8e5-40cb-9ccc-792068df1124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:03.211307 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c3f55-a8e5-40cb-9ccc-792068df1124 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:03.212046 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c3f55-a8e5-40cb-9ccc-792068df1124 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:03.212527 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:03.214811 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c3f55-a8e5-40cb-9ccc-792068df1124 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:03.244980 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06394c6e-271f-4310-972d-7d7b2bfe69be admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:03.249759 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3308/6580] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:30:03 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:03.249759 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c3f55-a8e5-40cb-9ccc-792068df1124 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:03.319229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d47c5-3c6c-4930-be0e-7f18743f8868 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:03.319943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d47c5-3c6c-4930-be0e-7f18743f8868 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:03.320263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d47c5-3c6c-4930-be0e-7f18743f8868 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:03.320852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d47c5-3c6c-4930-be0e-7f18743f8868 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:03.322370 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d47c5-3c6c-4930-be0e-7f18743f8868 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:03.324461 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d47c5-3c6c-4930-be0e-7f18743f8868 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:03.326603 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c3f55-a8e5-40cb-9ccc-792068df1124 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:03.332753 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711649a3-f2a8-4265-a41c-366a3b1cd35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:03.333465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711649a3-f2a8-4265-a41c-366a3b1cd35a admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:03.333723 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711649a3-f2a8-4265-a41c-366a3b1cd35a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:03.334005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711649a3-f2a8-4265-a41c-366a3b1cd35a admin admin] PATH_INFO: `/v3/projects/896fbfa1c11240f9a4d783a68b362232/users/6da97a32e5f74f49a315bd32b1fc99c4/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:03.336236 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711649a3-f2a8-4265-a41c-366a3b1cd35a admin admin] RBAC: Authorizing `identity:create_grant(project_id=896fbfa1c11240f9a4d783a68b362232, user_id=6da97a32e5f74f49a315bd32b1fc99c4, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:03.339079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711649a3-f2a8-4265-a41c-366a3b1cd35a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:03.344793 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3273/6581] 10.222.0.30 () {60 vars in 1149 bytes} [Sun Sep 4 01:30:03 2022] POST /identity/v3/domains => generated 277 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:03.344793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d47c5-3c6c-4930-be0e-7f18743f8868 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:03.357519 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3309/6582] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:30:03 2022] PUT /identity/v3/projects/896fbfa1c11240f9a4d783a68b362232/users/6da97a32e5f74f49a315bd32b1fc99c4/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:03.359402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711649a3-f2a8-4265-a41c-366a3b1cd35a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:03.418575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d47c5-3c6c-4930-be0e-7f18743f8868 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:03.442044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711649a3-f2a8-4265-a41c-366a3b1cd35a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:03.452956 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac130b62-cb99-4428-a044-1bc659317bfe tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:03.452956 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac130b62-cb99-4428-a044-1bc659317bfe tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:03.452956 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac130b62-cb99-4428-a044-1bc659317bfe tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:03.453317 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac130b62-cb99-4428-a044-1bc659317bfe tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/ce0af2ac7c884ce3907500206fb01686/config` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:03.453317 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac130b62-cb99-4428-a044-1bc659317bfe tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=ce0af2ac7c884ce3907500206fb01686)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:03.453913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac130b62-cb99-4428-a044-1bc659317bfe tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:03.480218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a508b-e023-4f42-8491-c3be0c8e58bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:03.480895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a508b-e023-4f42-8491-c3be0c8e58bc admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:03.481218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a508b-e023-4f42-8491-c3be0c8e58bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:03.481495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a508b-e023-4f42-8491-c3be0c8e58bc admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:03.482142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a508b-e023-4f42-8491-c3be0c8e58bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:03.484087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a508b-e023-4f42-8491-c3be0c8e58bc admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:03.496080 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3310/6583] 10.222.0.30 () {60 vars in 1269 bytes} [Sun Sep 4 01:30:03 2022] PUT /identity/v3/domains/ce0af2ac7c884ce3907500206fb01686/config => generated 138 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:03.497632 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037392f5-c69f-425c-90aa-c53ef4374b37 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:03.498372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037392f5-c69f-425c-90aa-c53ef4374b37 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:03.498807 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037392f5-c69f-425c-90aa-c53ef4374b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:03.514910 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3274/6584] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:30:03 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:03.516594 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a508b-e023-4f42-8491-c3be0c8e58bc admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:03.531412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a508b-e023-4f42-8491-c3be0c8e58bc admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:03.536952 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-037392f5-c69f-425c-90aa-c53ef4374b37 None None] MFA Rules not processed for user `6da97a32e5f74f49a315bd32b1fc99c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:03.538213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-037392f5-c69f-425c-90aa-c53ef4374b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:03.538633 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ffc68-c74b-4761-bb04-3d7df8792240 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:03.539372 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ffc68-c74b-4761-bb04-3d7df8792240 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:03.539670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ffc68-c74b-4761-bb04-3d7df8792240 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:03.539948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ffc68-c74b-4761-bb04-3d7df8792240 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/ce0af2ac7c884ce3907500206fb01686/config` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:03.540696 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ffc68-c74b-4761-bb04-3d7df8792240 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=ce0af2ac7c884ce3907500206fb01686)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:03.541736 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-120ffc68-c74b-4761-bb04-3d7df8792240 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:30:03.541736 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:30:03.541736 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:30:03.542636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ffc68-c74b-4761-bb04-3d7df8792240 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:03.550455 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:03.569837 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:03.581117 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3275/6585] 10.222.0.30 () {60 vars in 1271 bytes} [Sun Sep 4 01:30:03 2022] PATCH /identity/v3/domains/ce0af2ac7c884ce3907500206fb01686/config => generated 141 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:03.582149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ffc68-c74b-4761-bb04-3d7df8792240 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:03.595542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ffc68-c74b-4761-bb04-3d7df8792240 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:03.600918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824ef6f-ef62-41a2-a505-b2985bd5a807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:03.601903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824ef6f-ef62-41a2-a505-b2985bd5a807 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:03.601903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824ef6f-ef62-41a2-a505-b2985bd5a807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:03.602128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824ef6f-ef62-41a2-a505-b2985bd5a807 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:03.602746 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824ef6f-ef62-41a2-a505-b2985bd5a807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:03.604394 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824ef6f-ef62-41a2-a505-b2985bd5a807 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:03.617486 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3276/6586] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:03.617695 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824ef6f-ef62-41a2-a505-b2985bd5a807 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:03.630760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824ef6f-ef62-41a2-a505-b2985bd5a807 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:03.636825 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259fb51a-fd06-403d-98e4-1e22dfad7254 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:03.637840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259fb51a-fd06-403d-98e4-1e22dfad7254 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:03.638266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259fb51a-fd06-403d-98e4-1e22dfad7254 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:03.638692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259fb51a-fd06-403d-98e4-1e22dfad7254 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/ce0af2ac7c884ce3907500206fb01686/config` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:03.639447 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3311/6587] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:03 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:03.640229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259fb51a-fd06-403d-98e4-1e22dfad7254 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=ce0af2ac7c884ce3907500206fb01686)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:03.640528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037392f5-c69f-425c-90aa-c53ef4374b37 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:03.641705 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-259fb51a-fd06-403d-98e4-1e22dfad7254 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:30:03.641705 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:30:03.641705 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:30:03.642986 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259fb51a-fd06-403d-98e4-1e22dfad7254 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:03.651287 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3277/6588] 10.222.0.30 () {58 vars in 1248 bytes} [Sun Sep 4 01:30:03 2022] GET /identity/v3/domains/ce0af2ac7c884ce3907500206fb01686/config => generated 141 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:03.652180 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259fb51a-fd06-403d-98e4-1e22dfad7254 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:03.655673 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037392f5-c69f-425c-90aa-c53ef4374b37 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:03.661851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5eb4e-7314-428b-b939-39203bfd2122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:03.662529 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5eb4e-7314-428b-b939-39203bfd2122 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:03.662814 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5eb4e-7314-428b-b939-39203bfd2122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:03.663086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5eb4e-7314-428b-b939-39203bfd2122 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:03.663576 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259fb51a-fd06-403d-98e4-1e22dfad7254 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:03.663847 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5eb4e-7314-428b-b939-39203bfd2122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:03.665516 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5eb4e-7314-428b-b939-39203bfd2122 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:03.668677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd748bb2-1f23-4658-9493-dc4a4df353c4 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da97a32e5f74f49a315bd32b1fc99c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '896fbfa1c11240f9a4d783a68b362232', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:03.669008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd748bb2-1f23-4658-9493-dc4a4df353c4 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:03.669293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd748bb2-1f23-4658-9493-dc4a4df353c4 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:03.669621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd748bb2-1f23-4658-9493-dc4a4df353c4 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:03.670310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd748bb2-1f23-4658-9493-dc4a4df353c4 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:03.671301 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-bd748bb2-1f23-4658-9493-dc4a4df353c4 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:30:03.671301 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:30:03.671301 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:30:03.672192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd748bb2-1f23-4658-9493-dc4a4df353c4 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:03.683004 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3312/6589] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:03.683004 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5eb4e-7314-428b-b939-39203bfd2122 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:03.707783 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3278/6590] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:30:03 2022] POST /identity/v3/services => generated 286 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:03.709881 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd748bb2-1f23-4658-9493-dc4a4df353c4 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:03.725685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5eb4e-7314-428b-b939-39203bfd2122 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:03.757740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5caaab-8885-4e0d-83f4-1819b2387537 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:03.759768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5caaab-8885-4e0d-83f4-1819b2387537 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:03.759768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5caaab-8885-4e0d-83f4-1819b2387537 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:03.759768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5caaab-8885-4e0d-83f4-1819b2387537 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/ce0af2ac7c884ce3907500206fb01686/config` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:03.759768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5caaab-8885-4e0d-83f4-1819b2387537 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=ce0af2ac7c884ce3907500206fb01686)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:03.761361 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-8b5caaab-8885-4e0d-83f4-1819b2387537 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:30:03.761361 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:30:03.761361 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:30:03.762564 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5caaab-8885-4e0d-83f4-1819b2387537 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:03.771501 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd748bb2-1f23-4658-9493-dc4a4df353c4 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:03.783676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bf453-abf3-4abf-becc-fb76d4f5bfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:03.783676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bf453-abf3-4abf-becc-fb76d4f5bfd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:03.783676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bf453-abf3-4abf-becc-fb76d4f5bfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:03.785121 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3313/6591] 10.222.0.30 () {58 vars in 1251 bytes} [Sun Sep 4 01:30:03 2022] DELETE /identity/v3/domains/ce0af2ac7c884ce3907500206fb01686/config => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:03.787162 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bf453-abf3-4abf-becc-fb76d4f5bfd0 admin admin] PATH_INFO: `/v3/projects/410552f63405456cb530e87cad8638b1/users/8644efc22cf0450aa0ac9b7441c667b1/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:03.788354 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5caaab-8885-4e0d-83f4-1819b2387537 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:03.806368 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38bf453-abf3-4abf-becc-fb76d4f5bfd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=410552f63405456cb530e87cad8638b1, user_id=8644efc22cf0450aa0ac9b7441c667b1, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:03.811525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38bf453-abf3-4abf-becc-fb76d4f5bfd0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:03.830153 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3279/6592] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:30:03 2022] PUT /identity/v3/projects/410552f63405456cb530e87cad8638b1/users/8644efc22cf0450aa0ac9b7441c667b1/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:03.831940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bf453-abf3-4abf-becc-fb76d4f5bfd0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:03.843828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5caaab-8885-4e0d-83f4-1819b2387537 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:03.925258 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bf453-abf3-4abf-becc-fb76d4f5bfd0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:03.928128 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aadfe9-8caf-44b3-8496-254d6b402949 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da97a32e5f74f49a315bd32b1fc99c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '896fbfa1c11240f9a4d783a68b362232', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:03.928857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aadfe9-8caf-44b3-8496-254d6b402949 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:03.929244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aadfe9-8caf-44b3-8496-254d6b402949 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:03.929639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aadfe9-8caf-44b3-8496-254d6b402949 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:03.930347 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aadfe9-8caf-44b3-8496-254d6b402949 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:03.931215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfeda47-6209-4c23-8c78-3d9162b2b027 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:03.931374 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-39aadfe9-8caf-44b3-8496-254d6b402949 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:30:03.931374 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:30:03.931374 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:30:03.932204 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfeda47-6209-4c23-8c78-3d9162b2b027 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:03.932412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aadfe9-8caf-44b3-8496-254d6b402949 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:03.932671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfeda47-6209-4c23-8c78-3d9162b2b027 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:03.933053 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfeda47-6209-4c23-8c78-3d9162b2b027 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/ce0af2ac7c884ce3907500206fb01686/config` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:03.934749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfeda47-6209-4c23-8c78-3d9162b2b027 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=ce0af2ac7c884ce3907500206fb01686)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:03.936619 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfeda47-6209-4c23-8c78-3d9162b2b027 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:03.947292 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-dbfeda47-6209-4c23-8c78-3d9162b2b027 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Could not find any options in domain configuration for domain ce0af2ac7c884ce3907500206fb01686.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain ce0af2ac7c884ce3907500206fb01686. Sep 04 01:30:03.947292 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:30:03.947292 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:30:03.947292 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:30:03.947292 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:30:03.947292 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:30:03.947292 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:30:03.947292 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:30:03.947292 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:30:03.947292 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:30:03.947292 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:30:03.947292 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:30:03.947292 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Sep 04 01:30:03.948463 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Sep 04 01:30:03.948463 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Sep 04 01:30:03.948463 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Sep 04 01:30:03.948463 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:30:03.948463 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:30:03.948463 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Sep 04 01:30:03.948463 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Sep 04 01:30:03.948463 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain ce0af2ac7c884ce3907500206fb01686. Sep 04 01:30:03.948463 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:30:03.953658 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3280/6593] 10.222.0.30 () {58 vars in 1248 bytes} [Sun Sep 4 01:30:03 2022] GET /identity/v3/domains/ce0af2ac7c884ce3907500206fb01686/config => generated 151 bytes in 123 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:30:03.955343 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df15a4-9391-4e4c-90d3-c5220c77d526 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:03.955706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df15a4-9391-4e4c-90d3-c5220c77d526 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:03.956843 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df15a4-9391-4e4c-90d3-c5220c77d526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:03.963794 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-39aadfe9-8caf-44b3-8496-254d6b402949 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1445026700. To ensure interoperability, identifiers should be a valid uuid. Sep 04 01:30:03.963794 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 04 01:30:03.963794 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:30:03.992322 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-41df15a4-9391-4e4c-90d3-c5220c77d526 None None] MFA Rules not processed for user `8644efc22cf0450aa0ac9b7441c667b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:03.993685 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-41df15a4-9391-4e4c-90d3-c5220c77d526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:04.011884 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3314/6594] 10.222.0.30 () {60 vars in 1156 bytes} [Sun Sep 4 01:30:03 2022] POST /identity/v3/endpoints => generated 361 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:04.012781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aadfe9-8caf-44b3-8496-254d6b402949 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:04.035656 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aadfe9-8caf-44b3-8496-254d6b402949 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:04.040567 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847405dd-20a7-4e62-95d0-86f2ab0ef0b1 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:04.041206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847405dd-20a7-4e62-95d0-86f2ab0ef0b1 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:04.041523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847405dd-20a7-4e62-95d0-86f2ab0ef0b1 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:04.041798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847405dd-20a7-4e62-95d0-86f2ab0ef0b1 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/ce0af2ac7c884ce3907500206fb01686/config` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:04.042402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847405dd-20a7-4e62-95d0-86f2ab0ef0b1 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=ce0af2ac7c884ce3907500206fb01686)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:04.043970 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847405dd-20a7-4e62-95d0-86f2ab0ef0b1 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:04.050645 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3315/6595] 10.222.0.30 () {58 vars in 1251 bytes} [Sun Sep 4 01:30:04 2022] DELETE /identity/v3/domains/ce0af2ac7c884ce3907500206fb01686/config => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:04.051504 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847405dd-20a7-4e62-95d0-86f2ab0ef0b1 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:04.063954 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3281/6596] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:03 2022] POST /identity/v3/auth/tokens => generated 3569 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:04.064759 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df15a4-9391-4e4c-90d3-c5220c77d526 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:04.073652 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:INSERT=5,keystone:DELETE=4,keystone:SELECT=91 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:04.074021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847405dd-20a7-4e62-95d0-86f2ab0ef0b1 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:04.079743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf30a59-3113-4a13-b8b2-79df5e5e8788 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da97a32e5f74f49a315bd32b1fc99c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '896fbfa1c11240f9a4d783a68b362232', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:04.080509 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf30a59-3113-4a13-b8b2-79df5e5e8788 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:04.080820 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf30a59-3113-4a13-b8b2-79df5e5e8788 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:04.081764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df15a4-9391-4e4c-90d3-c5220c77d526 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:04.082199 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf30a59-3113-4a13-b8b2-79df5e5e8788 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] PATH_INFO: `/v3/regions/tempest-region-1445026700` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:04.082350 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf30a59-3113-4a13-b8b2-79df5e5e8788 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1445026700)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:04.083429 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf30a59-3113-4a13-b8b2-79df5e5e8788 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:04.085685 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3316/6597] 10.222.0.30 () {58 vars in 1206 bytes} [Sun Sep 4 01:30:04 2022] GET /identity/v3/regions/tempest-region-1445026700 => generated 180 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:04.085685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf30a59-3113-4a13-b8b2-79df5e5e8788 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:04.088674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e7fb7-8753-4b66-9083-8a46530041a4 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:04.088674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e7fb7-8753-4b66-9083-8a46530041a4 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:04.088896 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7cf30a59-3113-4a13-b8b2-79df5e5e8788 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:04.088985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e7fb7-8753-4b66-9083-8a46530041a4 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:04.088985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e7fb7-8753-4b66-9083-8a46530041a4 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/ce0af2ac7c884ce3907500206fb01686` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:04.090192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e7fb7-8753-4b66-9083-8a46530041a4 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ce0af2ac7c884ce3907500206fb01686)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:04.091958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e7fb7-8753-4b66-9083-8a46530041a4 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:04.106238 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:04.114774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f02e7fb7-8753-4b66-9083-8a46530041a4 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ce0af2ac7c884ce3907500206fb01686'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:04.115784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f02e7fb7-8753-4b66-9083-8a46530041a4 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ce0af2ac7c884ce3907500206fb01686'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:04.141046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f02e7fb7-8753-4b66-9083-8a46530041a4 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ce0af2ac7c884ce3907500206fb01686'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:04.141754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f02e7fb7-8753-4b66-9083-8a46530041a4 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ce0af2ac7c884ce3907500206fb01686'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:04.144681 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3282/6598] 10.222.0.30 () {60 vars in 1249 bytes} [Sun Sep 4 01:30:04 2022] PATCH /identity/v3/domains/ce0af2ac7c884ce3907500206fb01686 => generated 278 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:04.145409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e7fb7-8753-4b66-9083-8a46530041a4 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:04.146799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f02e7fb7-8753-4b66-9083-8a46530041a4 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:04.162083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf30a59-3113-4a13-b8b2-79df5e5e8788 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:04.213222 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f9a7b-1336-4810-a0b7-5ad62d2da43e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:04.213774 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f9a7b-1336-4810-a0b7-5ad62d2da43e service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:04.214053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f9a7b-1336-4810-a0b7-5ad62d2da43e service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:04.214324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f9a7b-1336-4810-a0b7-5ad62d2da43e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:04.214430 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e7fb7-8753-4b66-9083-8a46530041a4 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:04.216039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a90f9a7b-1336-4810-a0b7-5ad62d2da43e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:04.219225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b2fcf-4248-49bc-8701-2a994df937c2 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da97a32e5f74f49a315bd32b1fc99c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '896fbfa1c11240f9a4d783a68b362232', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:04.219831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b2fcf-4248-49bc-8701-2a994df937c2 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:04.220114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b2fcf-4248-49bc-8701-2a994df937c2 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:04.220393 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b2fcf-4248-49bc-8701-2a994df937c2 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:04.221045 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b2fcf-4248-49bc-8701-2a994df937c2 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:04.222740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b2fcf-4248-49bc-8701-2a994df937c2 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:04.238101 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3283/6599] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:30:04 2022] POST /identity/v3/services => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:04.238906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b2fcf-4248-49bc-8701-2a994df937c2 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:04.240423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-658b2fcf-4248-49bc-8701-2a994df937c2 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:04.275962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f9a7b-1336-4810-a0b7-5ad62d2da43e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:04.277575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f9a7b-1336-4810-a0b7-5ad62d2da43e service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:04.286992 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3317/6600] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:30:04 2022] GET /identity/v3/auth/tokens => generated 3569 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:30:04.287773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f9a7b-1336-4810-a0b7-5ad62d2da43e service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:04.298149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f9a7b-1336-4810-a0b7-5ad62d2da43e service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:04.318682 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08eedcf-2dfd-4fb3-aae6-9206421abecc tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da97a32e5f74f49a315bd32b1fc99c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '896fbfa1c11240f9a4d783a68b362232', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:04.319298 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08eedcf-2dfd-4fb3-aae6-9206421abecc tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:04.319583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08eedcf-2dfd-4fb3-aae6-9206421abecc tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:04.320007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08eedcf-2dfd-4fb3-aae6-9206421abecc tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:04.320691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08eedcf-2dfd-4fb3-aae6-9206421abecc tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:04.320956 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b2fcf-4248-49bc-8701-2a994df937c2 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:04.322651 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08eedcf-2dfd-4fb3-aae6-9206421abecc tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:04.326596 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349eaedd-e603-4e1d-95f8-9c6452902390 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:04.327249 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349eaedd-e603-4e1d-95f8-9c6452902390 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:04.327533 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349eaedd-e603-4e1d-95f8-9c6452902390 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:04.327815 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349eaedd-e603-4e1d-95f8-9c6452902390 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/ce0af2ac7c884ce3907500206fb01686` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:04.342707 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-b08eedcf-2dfd-4fb3-aae6-9206421abecc tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1135514202. To ensure interoperability, identifiers should be a valid uuid. Sep 04 01:30:04.342707 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 04 01:30:04.342707 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:30:04.343427 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349eaedd-e603-4e1d-95f8-9c6452902390 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ce0af2ac7c884ce3907500206fb01686)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:04.345393 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349eaedd-e603-4e1d-95f8-9c6452902390 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:04.381795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-349eaedd-e603-4e1d-95f8-9c6452902390 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ce0af2ac7c884ce3907500206fb01686'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:04.396505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-349eaedd-e603-4e1d-95f8-9c6452902390 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ce0af2ac7c884ce3907500206fb01686'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:04.401358 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3318/6601] 10.222.0.30 () {60 vars in 1156 bytes} [Sun Sep 4 01:30:04 2022] POST /identity/v3/endpoints => generated 363 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:04.406065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08eedcf-2dfd-4fb3-aae6-9206421abecc tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:04.408852 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:04.437332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08eedcf-2dfd-4fb3-aae6-9206421abecc tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:04.472898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-349eaedd-e603-4e1d-95f8-9c6452902390 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce0af2ac7c884ce3907500206fb01686', 'request_id': 'req-349eaedd-e603-4e1d-95f8-9c6452902390'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:04.477187 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:04.483404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-349eaedd-e603-4e1d-95f8-9c6452902390 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce0af2ac7c884ce3907500206fb01686', 'request_id': 'req-349eaedd-e603-4e1d-95f8-9c6452902390'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:04.493793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-349eaedd-e603-4e1d-95f8-9c6452902390 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce0af2ac7c884ce3907500206fb01686', 'request_id': 'req-349eaedd-e603-4e1d-95f8-9c6452902390'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:04.522270 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-349eaedd-e603-4e1d-95f8-9c6452902390 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] The token cache is being invalidate because project ce0af2ac7c884ce3907500206fb01686 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:30:04.522978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-349eaedd-e603-4e1d-95f8-9c6452902390 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:04.524051 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-349eaedd-e603-4e1d-95f8-9c6452902390 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:04.535826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-349eaedd-e603-4e1d-95f8-9c6452902390 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ce0af2ac7c884ce3907500206fb01686', 'request_id': 'req-349eaedd-e603-4e1d-95f8-9c6452902390'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:04.536884 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-349eaedd-e603-4e1d-95f8-9c6452902390 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ce0af2ac7c884ce3907500206fb01686', 'request_id': 'req-349eaedd-e603-4e1d-95f8-9c6452902390'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:04.537525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-349eaedd-e603-4e1d-95f8-9c6452902390 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ce0af2ac7c884ce3907500206fb01686', 'request_id': 'req-349eaedd-e603-4e1d-95f8-9c6452902390'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:04.555321 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3284/6602] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:30:04 2022] DELETE /identity/v3/domains/ce0af2ac7c884ce3907500206fb01686 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:04.560210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349eaedd-e603-4e1d-95f8-9c6452902390 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:04.571269 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-349eaedd-e603-4e1d-95f8-9c6452902390 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:04.580346 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f6e60-6121-4463-aaea-abe7f7b0090a tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da97a32e5f74f49a315bd32b1fc99c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '896fbfa1c11240f9a4d783a68b362232', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:04.582678 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f6e60-6121-4463-aaea-abe7f7b0090a tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:04.583132 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f6e60-6121-4463-aaea-abe7f7b0090a tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:04.583636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f6e60-6121-4463-aaea-abe7f7b0090a tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] PATH_INFO: `/v3/regions/tempest-region-1135514202` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:04.584530 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f6e60-6121-4463-aaea-abe7f7b0090a tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1135514202)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:04.586409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f6e60-6121-4463-aaea-abe7f7b0090a tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:04.593547 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3319/6603] 10.222.0.30 () {58 vars in 1206 bytes} [Sun Sep 4 01:30:04 2022] GET /identity/v3/regions/tempest-region-1135514202 => generated 180 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:04.594611 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f6e60-6121-4463-aaea-abe7f7b0090a tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:04.597148 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-467f6e60-6121-4463-aaea-abe7f7b0090a tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:04.611654 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f6e60-6121-4463-aaea-abe7f7b0090a tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:04.618254 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68236e3c-421f-4e89-94f5-602aa8989761 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da97a32e5f74f49a315bd32b1fc99c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '896fbfa1c11240f9a4d783a68b362232', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:04.618902 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68236e3c-421f-4e89-94f5-602aa8989761 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:04.619210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68236e3c-421f-4e89-94f5-602aa8989761 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:04.619485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68236e3c-421f-4e89-94f5-602aa8989761 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:04.620189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68236e3c-421f-4e89-94f5-602aa8989761 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:04.623290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68236e3c-421f-4e89-94f5-602aa8989761 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:04.641849 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-68236e3c-421f-4e89-94f5-602aa8989761 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-979393510. To ensure interoperability, identifiers should be a valid uuid. Sep 04 01:30:04.641849 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 04 01:30:04.641849 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:30:04.695556 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3320/6604] 10.222.0.30 () {60 vars in 1156 bytes} [Sun Sep 4 01:30:04 2022] POST /identity/v3/endpoints => generated 358 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:04.700189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68236e3c-421f-4e89-94f5-602aa8989761 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:04.700514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349eaedd-e603-4e1d-95f8-9c6452902390 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:04.719706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93720f1-6b89-474b-b4f7-7fef19b43f2e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:04.720695 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93720f1-6b89-474b-b4f7-7fef19b43f2e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:04.721018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93720f1-6b89-474b-b4f7-7fef19b43f2e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:04.721298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93720f1-6b89-474b-b4f7-7fef19b43f2e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:04.723244 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93720f1-6b89-474b-b4f7-7fef19b43f2e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:04.725355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93720f1-6b89-474b-b4f7-7fef19b43f2e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:04.748115 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3285/6605] 10.222.0.30 () {60 vars in 1149 bytes} [Sun Sep 4 01:30:04 2022] POST /identity/v3/domains => generated 275 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:04.752485 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93720f1-6b89-474b-b4f7-7fef19b43f2e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:04.755462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68236e3c-421f-4e89-94f5-602aa8989761 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:04.820286 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5438e8-7c27-4bdc-b59e-76fda232b0cd tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da97a32e5f74f49a315bd32b1fc99c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '896fbfa1c11240f9a4d783a68b362232', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:04.820286 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5438e8-7c27-4bdc-b59e-76fda232b0cd tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:04.820594 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5438e8-7c27-4bdc-b59e-76fda232b0cd tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:04.820706 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5438e8-7c27-4bdc-b59e-76fda232b0cd tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] PATH_INFO: `/v3/regions/tempest-region-979393510` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:04.821240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5438e8-7c27-4bdc-b59e-76fda232b0cd tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-979393510)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:04.822651 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5438e8-7c27-4bdc-b59e-76fda232b0cd tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:04.824906 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3321/6606] 10.222.0.30 () {58 vars in 1203 bytes} [Sun Sep 4 01:30:04 2022] GET /identity/v3/regions/tempest-region-979393510 => generated 178 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:04.830413 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5438e8-7c27-4bdc-b59e-76fda232b0cd tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:04.849018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5438e8-7c27-4bdc-b59e-76fda232b0cd tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:04.854402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abb827-3e0a-4783-9d24-c18429b0dc10 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da97a32e5f74f49a315bd32b1fc99c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '896fbfa1c11240f9a4d783a68b362232', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:04.855031 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abb827-3e0a-4783-9d24-c18429b0dc10 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:04.855318 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abb827-3e0a-4783-9d24-c18429b0dc10 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:04.855595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abb827-3e0a-4783-9d24-c18429b0dc10 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:04.856234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48abb827-3e0a-4783-9d24-c18429b0dc10 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:04.857277 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-48abb827-3e0a-4783-9d24-c18429b0dc10 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:30:04.857277 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:30:04.857277 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:30:04.858252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48abb827-3e0a-4783-9d24-c18429b0dc10 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:04.870164 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3322/6607] 10.222.0.30 () {58 vars in 1134 bytes} [Sun Sep 4 01:30:04 2022] GET /identity/v3/endpoints => generated 4396 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:04.874218 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abb827-3e0a-4783-9d24-c18429b0dc10 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:04.879463 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93720f1-6b89-474b-b4f7-7fef19b43f2e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:04.885177 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abb827-3e0a-4783-9d24-c18429b0dc10 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:04.890691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854bd745-a134-4855-bf2f-050b3cfa8639 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da97a32e5f74f49a315bd32b1fc99c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '896fbfa1c11240f9a4d783a68b362232', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:04.891402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854bd745-a134-4855-bf2f-050b3cfa8639 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:04.891528 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516b90b-2437-4424-9718-45d8ebe401fe tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:04.891821 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854bd745-a134-4855-bf2f-050b3cfa8639 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:04.892074 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516b90b-2437-4424-9718-45d8ebe401fe tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:04.892344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854bd745-a134-4855-bf2f-050b3cfa8639 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] PATH_INFO: `/v3/endpoints/02d7a44b170549d6bb99436085e4f62c` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:04.892461 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516b90b-2437-4424-9718-45d8ebe401fe tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:04.892626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516b90b-2437-4424-9718-45d8ebe401fe tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/61c2dee96cca4904a97e8d38c2236e6e/config` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:04.894718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516b90b-2437-4424-9718-45d8ebe401fe tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=61c2dee96cca4904a97e8d38c2236e6e)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:04.895833 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-1516b90b-2437-4424-9718-45d8ebe401fe tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:30:04.895833 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:30:04.895833 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:30:04.896973 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516b90b-2437-4424-9718-45d8ebe401fe tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:04.902939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854bd745-a134-4855-bf2f-050b3cfa8639 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=02d7a44b170549d6bb99436085e4f62c)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:04.904542 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-854bd745-a134-4855-bf2f-050b3cfa8639 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:30:04.904542 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:30:04.904542 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:30:04.905545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854bd745-a134-4855-bf2f-050b3cfa8639 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:04.908538 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3323/6608] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:30:04 2022] GET /identity/v3/endpoints/02d7a44b170549d6bb99436085e4f62c => generated 358 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:04.912762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854bd745-a134-4855-bf2f-050b3cfa8639 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:04.925369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854bd745-a134-4855-bf2f-050b3cfa8639 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:04.931850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e89e0-c88b-486a-bd46-050d62610a44 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da97a32e5f74f49a315bd32b1fc99c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '896fbfa1c11240f9a4d783a68b362232', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:04.932708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e89e0-c88b-486a-bd46-050d62610a44 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:04.933219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e89e0-c88b-486a-bd46-050d62610a44 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:04.933607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e89e0-c88b-486a-bd46-050d62610a44 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] PATH_INFO: `/v3/endpoints/02d7a44b170549d6bb99436085e4f62c` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:04.935707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e89e0-c88b-486a-bd46-050d62610a44 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=02d7a44b170549d6bb99436085e4f62c)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:04.937004 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-388e89e0-c88b-486a-bd46-050d62610a44 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:30:04.937004 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:30:04.937004 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:30:04.938301 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e89e0-c88b-486a-bd46-050d62610a44 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:04.938734 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:04.953722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-388e89e0-c88b-486a-bd46-050d62610a44 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '02d7a44b170549d6bb99436085e4f62c', 'request_id': 'req-388e89e0-c88b-486a-bd46-050d62610a44'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:04.978503 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3286/6609] 10.222.0.30 () {60 vars in 1269 bytes} [Sun Sep 4 01:30:04 2022] PUT /identity/v3/domains/61c2dee96cca4904a97e8d38c2236e6e/config => generated 138 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:04.982752 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516b90b-2437-4424-9718-45d8ebe401fe tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:04.991653 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3324/6610] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Sep 4 01:30:04 2022] DELETE /identity/v3/endpoints/02d7a44b170549d6bb99436085e4f62c => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:30:04.997152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e89e0-c88b-486a-bd46-050d62610a44 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:05.009728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516b90b-2437-4424-9718-45d8ebe401fe tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:05.044706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac27a52-3acc-4c36-b285-7a4b07a9c923 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:05.045686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e89e0-c88b-486a-bd46-050d62610a44 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:05.046170 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac27a52-3acc-4c36-b285-7a4b07a9c923 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:05.046459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac27a52-3acc-4c36-b285-7a4b07a9c923 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:05.047004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac27a52-3acc-4c36-b285-7a4b07a9c923 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/61c2dee96cca4904a97e8d38c2236e6e/config/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:05.048964 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac27a52-3acc-4c36-b285-7a4b07a9c923 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=61c2dee96cca4904a97e8d38c2236e6e, group=identity)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:05.051960 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac27a52-3acc-4c36-b285-7a4b07a9c923 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:05.058111 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790a46d-62e9-4a84-9cee-ccbb656e6783 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da97a32e5f74f49a315bd32b1fc99c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '896fbfa1c11240f9a4d783a68b362232', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:05.058833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790a46d-62e9-4a84-9cee-ccbb656e6783 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:05.059198 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790a46d-62e9-4a84-9cee-ccbb656e6783 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:05.059546 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790a46d-62e9-4a84-9cee-ccbb656e6783 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:05.060241 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790a46d-62e9-4a84-9cee-ccbb656e6783 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:05.062104 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790a46d-62e9-4a84-9cee-ccbb656e6783 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:05.086713 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3325/6611] 10.222.0.30 () {58 vars in 1134 bytes} [Sun Sep 4 01:30:04 2022] GET /identity/v3/endpoints => generated 4051 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:05.089762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790a46d-62e9-4a84-9cee-ccbb656e6783 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:05.104699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790a46d-62e9-4a84-9cee-ccbb656e6783 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:05.109552 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3287/6612] 10.222.0.30 () {60 vars in 1297 bytes} [Sun Sep 4 01:30:04 2022] PATCH /identity/v3/domains/61c2dee96cca4904a97e8d38c2236e6e/config/identity => generated 176 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:05.113412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac27a52-3acc-4c36-b285-7a4b07a9c923 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:05.114130 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933423a-6f04-49f3-bf09-8af1c0a2ecad tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da97a32e5f74f49a315bd32b1fc99c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '896fbfa1c11240f9a4d783a68b362232', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:05.115088 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933423a-6f04-49f3-bf09-8af1c0a2ecad tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:05.115484 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933423a-6f04-49f3-bf09-8af1c0a2ecad tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:05.115756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933423a-6f04-49f3-bf09-8af1c0a2ecad tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] PATH_INFO: `/v3/endpoints/02d7a44b170549d6bb99436085e4f62c` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:05.120965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a933423a-6f04-49f3-bf09-8af1c0a2ecad tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 01:30:05.145922 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac27a52-3acc-4c36-b285-7a4b07a9c923 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:05.155057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d8787-3e36-4102-bea4-c5561f7d4c7c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:05.155743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d8787-3e36-4102-bea4-c5561f7d4c7c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:05.156281 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d8787-3e36-4102-bea4-c5561f7d4c7c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:05.156569 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d8787-3e36-4102-bea4-c5561f7d4c7c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/61c2dee96cca4904a97e8d38c2236e6e/config/identity/driver` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:05.157258 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d8787-3e36-4102-bea4-c5561f7d4c7c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=61c2dee96cca4904a97e8d38c2236e6e, group=identity, option=driver)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:05.158900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d8787-3e36-4102-bea4-c5561f7d4c7c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:05.160490 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-a933423a-6f04-49f3-bf09-8af1c0a2ecad tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Could not find endpoint: 02d7a44b170549d6bb99436085e4f62c.: keystone.exception.EndpointNotFound: Could not find endpoint: 02d7a44b170549d6bb99436085e4f62c. Sep 04 01:30:05.160490 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:30:05.160490 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Sep 04 01:30:05.160490 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Sep 04 01:30:05.160490 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Sep 04 01:30:05.160490 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._iter().one() Sep 04 01:30:05.160490 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Sep 04 01:30:05.160490 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._only_one_row( Sep 04 01:30:05.160490 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Sep 04 01:30:05.160490 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exc.NoResultFound( Sep 04 01:30:05.160490 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Sep 04 01:30:05.160490 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:30:05.160490 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:30:05.160490 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:30:05.160490 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:30:05.160490 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Sep 04 01:30:05.161561 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Sep 04 01:30:05.161561 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Sep 04 01:30:05.161561 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Sep 04 01:30:05.161561 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Sep 04 01:30:05.161561 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Sep 04 01:30:05.161561 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 02d7a44b170549d6bb99436085e4f62c. Sep 04 01:30:05.161561 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:30:05.161561 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:30:05.161561 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:30:05.161561 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:30:05.161561 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:30:05.161561 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:30:05.161561 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:30:05.161561 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:30:05.161561 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:30:05.161561 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:30:05.161561 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:30:05.165931 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:30:05.165931 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:30:05.165931 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:30:05.165931 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Sep 04 01:30:05.165931 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Sep 04 01:30:05.165931 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 01:30:05.165931 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 01:30:05.165931 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 01:30:05.165931 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 01:30:05.165931 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:30:05.165931 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:30:05.165931 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 01:30:05.165931 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 01:30:05.165931 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 01:30:05.165931 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 01:30:05.165931 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 01:30:05.166940 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 01:30:05.166940 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 01:30:05.166940 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 01:30:05.166940 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 01:30:05.166940 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 01:30:05.166940 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 01:30:05.166940 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 01:30:05.166940 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 01:30:05.166940 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 01:30:05.166940 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Sep 04 01:30:05.166940 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Sep 04 01:30:05.166940 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 02d7a44b170549d6bb99436085e4f62c. Sep 04 01:30:05.166940 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:30:05.166940 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3326/6613] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Sep 4 01:30:05 2022] DELETE /identity/v3/endpoints/02d7a44b170549d6bb99436085e4f62c => generated 114 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:30:05.170381 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933423a-6f04-49f3-bf09-8af1c0a2ecad tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:05.184017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933423a-6f04-49f3-bf09-8af1c0a2ecad tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:05.196539 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c6a20-67fd-48b0-a583-3eea6a5ed5b3 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da97a32e5f74f49a315bd32b1fc99c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '896fbfa1c11240f9a4d783a68b362232', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:05.197538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c6a20-67fd-48b0-a583-3eea6a5ed5b3 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:05.198866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c6a20-67fd-48b0-a583-3eea6a5ed5b3 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:05.198866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c6a20-67fd-48b0-a583-3eea6a5ed5b3 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] PATH_INFO: `/v3/regions/tempest-region-979393510` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:05.198866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c6a20-67fd-48b0-a583-3eea6a5ed5b3 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-979393510)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:05.199658 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-0c5c6a20-67fd-48b0-a583-3eea6a5ed5b3 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:30:05.199658 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:30:05.199658 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:30:05.201947 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c6a20-67fd-48b0-a583-3eea6a5ed5b3 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:05.214783 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3288/6614] 10.222.0.30 () {60 vars in 1318 bytes} [Sun Sep 4 01:30:05 2022] PATCH /identity/v3/domains/61c2dee96cca4904a97e8d38c2236e6e/config/identity/driver => generated 175 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:05.219380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d8787-3e36-4102-bea4-c5561f7d4c7c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:05.227117 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:05.244355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d8787-3e36-4102-bea4-c5561f7d4c7c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:05.248116 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3327/6615] 10.222.0.30 () {58 vars in 1206 bytes} [Sun Sep 4 01:30:05 2022] DELETE /identity/v3/regions/tempest-region-979393510 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:30:05.255275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c6a20-67fd-48b0-a583-3eea6a5ed5b3 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:05.269517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db9f3b-b862-4fd5-b967-9851d6cb7d4f tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:05.270333 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db9f3b-b862-4fd5-b967-9851d6cb7d4f tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:05.270718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db9f3b-b862-4fd5-b967-9851d6cb7d4f tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:05.270999 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db9f3b-b862-4fd5-b967-9851d6cb7d4f tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/61c2dee96cca4904a97e8d38c2236e6e/config/identity/driver` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:05.271765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db9f3b-b862-4fd5-b967-9851d6cb7d4f tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=61c2dee96cca4904a97e8d38c2236e6e, group=identity, option=driver)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:05.273395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db9f3b-b862-4fd5-b967-9851d6cb7d4f tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:05.283056 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c6a20-67fd-48b0-a583-3eea6a5ed5b3 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:05.292710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a40237-5380-4c6a-bca7-26a3f8cee1c3 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da97a32e5f74f49a315bd32b1fc99c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '896fbfa1c11240f9a4d783a68b362232', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:05.293373 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a40237-5380-4c6a-bca7-26a3f8cee1c3 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:05.293717 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a40237-5380-4c6a-bca7-26a3f8cee1c3 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:05.293999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a40237-5380-4c6a-bca7-26a3f8cee1c3 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:05.294696 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a40237-5380-4c6a-bca7-26a3f8cee1c3 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:05.298703 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3289/6616] 10.222.0.30 () {58 vars in 1299 bytes} [Sun Sep 4 01:30:05 2022] DELETE /identity/v3/domains/61c2dee96cca4904a97e8d38c2236e6e/config/identity/driver => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:05.302784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a40237-5380-4c6a-bca7-26a3f8cee1c3 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:05.306125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db9f3b-b862-4fd5-b967-9851d6cb7d4f tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:05.317110 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3328/6617] 10.222.0.30 () {58 vars in 1134 bytes} [Sun Sep 4 01:30:05 2022] GET /identity/v3/endpoints => generated 4051 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:05.318134 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a40237-5380-4c6a-bca7-26a3f8cee1c3 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:05.329465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a40237-5380-4c6a-bca7-26a3f8cee1c3 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:05.334923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76513f-14a8-426a-b7e4-0c9db5ec8224 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da97a32e5f74f49a315bd32b1fc99c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '896fbfa1c11240f9a4d783a68b362232', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:05.335540 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76513f-14a8-426a-b7e4-0c9db5ec8224 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:05.335823 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76513f-14a8-426a-b7e4-0c9db5ec8224 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:05.336100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76513f-14a8-426a-b7e4-0c9db5ec8224 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:05.336801 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de76513f-14a8-426a-b7e4-0c9db5ec8224 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Adding query filter params (service_id=52316776ebcb43d2ba86abd848f5dd14) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:30:05.337109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de76513f-14a8-426a-b7e4-0c9db5ec8224 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:05.338780 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de76513f-14a8-426a-b7e4-0c9db5ec8224 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:05.347479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db9f3b-b862-4fd5-b967-9851d6cb7d4f tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:05.347721 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3329/6618] 10.222.0.30 () {58 vars in 1221 bytes} [Sun Sep 4 01:30:05 2022] GET /identity/v3/endpoints?service_id=52316776ebcb43d2ba86abd848f5dd14 => generated 503 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:05.351900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76513f-14a8-426a-b7e4-0c9db5ec8224 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:05.357669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f26d9-7905-4561-990e-593690348ae1 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:05.358657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f26d9-7905-4561-990e-593690348ae1 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:05.359038 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f26d9-7905-4561-990e-593690348ae1 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:05.359413 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f26d9-7905-4561-990e-593690348ae1 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/61c2dee96cca4904a97e8d38c2236e6e/config/identity/driver` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:05.361056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f26d9-7905-4561-990e-593690348ae1 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=61c2dee96cca4904a97e8d38c2236e6e, group=identity, option=driver)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:05.362796 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76513f-14a8-426a-b7e4-0c9db5ec8224 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:05.364145 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f26d9-7905-4561-990e-593690348ae1 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:05.368073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f89243-0289-4ed9-8811-0947a87e83b7 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da97a32e5f74f49a315bd32b1fc99c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '896fbfa1c11240f9a4d783a68b362232', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:05.368704 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f89243-0289-4ed9-8811-0947a87e83b7 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:05.368986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f89243-0289-4ed9-8811-0947a87e83b7 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:05.369261 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f89243-0289-4ed9-8811-0947a87e83b7 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:05.369950 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f89243-0289-4ed9-8811-0947a87e83b7 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Adding query filter params (service_id=8ec3f67780894b5c96bc3600b7d83b41) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:30:05.370677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f89243-0289-4ed9-8811-0947a87e83b7 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:05.371877 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f89243-0289-4ed9-8811-0947a87e83b7 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:05.380509 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-5b2f26d9-7905-4561-990e-593690348ae1 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Could not find option driver in group identity in domain configuration for domain 61c2dee96cca4904a97e8d38c2236e6e.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 61c2dee96cca4904a97e8d38c2236e6e. Sep 04 01:30:05.380509 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:30:05.380509 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:30:05.380509 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:30:05.380509 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:30:05.380509 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:30:05.380509 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:30:05.380509 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:30:05.380509 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:30:05.380509 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:30:05.380509 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:30:05.380509 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:30:05.380509 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Sep 04 01:30:05.381533 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Sep 04 01:30:05.381533 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Sep 04 01:30:05.381533 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Sep 04 01:30:05.381533 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:30:05.381533 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:30:05.381533 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Sep 04 01:30:05.381533 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Sep 04 01:30:05.381533 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 61c2dee96cca4904a97e8d38c2236e6e. Sep 04 01:30:05.381533 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:30:05.384401 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3290/6619] 10.222.0.30 () {58 vars in 1296 bytes} [Sun Sep 4 01:30:05 2022] GET /identity/v3/domains/61c2dee96cca4904a97e8d38c2236e6e/config/identity/driver => generated 171 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:30:05.386943 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3330/6620] 10.222.0.30 () {58 vars in 1221 bytes} [Sun Sep 4 01:30:05 2022] GET /identity/v3/endpoints?service_id=8ec3f67780894b5c96bc3600b7d83b41 => generated 505 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:30:05.387320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f26d9-7905-4561-990e-593690348ae1 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:05.388515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f89243-0289-4ed9-8811-0947a87e83b7 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:05.406317 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f26d9-7905-4561-990e-593690348ae1 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:05.412613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd91888-3b25-4be6-aaf6-b901cf8398d4 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da97a32e5f74f49a315bd32b1fc99c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '896fbfa1c11240f9a4d783a68b362232', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:05.413755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd91888-3b25-4be6-aaf6-b901cf8398d4 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:05.414138 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd91888-3b25-4be6-aaf6-b901cf8398d4 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:05.414484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd91888-3b25-4be6-aaf6-b901cf8398d4 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:05.415286 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd91888-3b25-4be6-aaf6-b901cf8398d4 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:30:05.415664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd91888-3b25-4be6-aaf6-b901cf8398d4 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:05.416098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f89243-0289-4ed9-8811-0947a87e83b7 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:05.416884 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-9dd91888-3b25-4be6-aaf6-b901cf8398d4 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:30:05.416884 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:30:05.416884 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:30:05.417810 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd91888-3b25-4be6-aaf6-b901cf8398d4 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:05.423032 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67dbd35-a077-435d-931c-068529ce9070 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:05.423827 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67dbd35-a077-435d-931c-068529ce9070 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:05.424239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67dbd35-a077-435d-931c-068529ce9070 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:05.424608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67dbd35-a077-435d-931c-068529ce9070 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/61c2dee96cca4904a97e8d38c2236e6e/config/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:05.425325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67dbd35-a077-435d-931c-068529ce9070 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=61c2dee96cca4904a97e8d38c2236e6e, group=identity)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:05.427121 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67dbd35-a077-435d-931c-068529ce9070 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:05.444231 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3291/6621] 10.222.0.30 () {58 vars in 1167 bytes} [Sun Sep 4 01:30:05 2022] GET /identity/v3/endpoints?interface=public => generated 3406 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:05.445556 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd91888-3b25-4be6-aaf6-b901cf8398d4 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:05.459286 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd91888-3b25-4be6-aaf6-b901cf8398d4 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:05.463166 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3331/6622] 10.222.0.30 () {58 vars in 1278 bytes} [Sun Sep 4 01:30:05 2022] DELETE /identity/v3/domains/61c2dee96cca4904a97e8d38c2236e6e/config/identity => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:05.468682 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67dbd35-a077-435d-931c-068529ce9070 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:05.473692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aef354-83ff-41b4-ad10-4be0640b0ad5 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da97a32e5f74f49a315bd32b1fc99c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '896fbfa1c11240f9a4d783a68b362232', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:05.474769 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aef354-83ff-41b4-ad10-4be0640b0ad5 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:05.475261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aef354-83ff-41b4-ad10-4be0640b0ad5 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:05.475663 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aef354-83ff-41b4-ad10-4be0640b0ad5 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:05.476332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aef354-83ff-41b4-ad10-4be0640b0ad5 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:30:05.476691 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aef354-83ff-41b4-ad10-4be0640b0ad5 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:05.478704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aef354-83ff-41b4-ad10-4be0640b0ad5 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:05.483084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67dbd35-a077-435d-931c-068529ce9070 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:05.493036 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3292/6623] 10.222.0.30 () {58 vars in 1171 bytes} [Sun Sep 4 01:30:05 2022] GET /identity/v3/endpoints?interface=internal => generated 480 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:05.493231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e538ed9-a227-4553-8447-93f6981d4343 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:05.493231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e538ed9-a227-4553-8447-93f6981d4343 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:05.493231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e538ed9-a227-4553-8447-93f6981d4343 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:05.493495 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e538ed9-a227-4553-8447-93f6981d4343 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/61c2dee96cca4904a97e8d38c2236e6e/config/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:05.493810 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e538ed9-a227-4553-8447-93f6981d4343 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=61c2dee96cca4904a97e8d38c2236e6e, group=identity)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:05.493984 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aef354-83ff-41b4-ad10-4be0640b0ad5 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:05.495662 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e538ed9-a227-4553-8447-93f6981d4343 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:05.508424 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-1e538ed9-a227-4553-8447-93f6981d4343 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Could not find group identity in domain configuration for domain 61c2dee96cca4904a97e8d38c2236e6e.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 61c2dee96cca4904a97e8d38c2236e6e. Sep 04 01:30:05.508424 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:30:05.508424 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:30:05.508424 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:30:05.508424 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:30:05.508424 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:30:05.508424 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:30:05.508424 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:30:05.508424 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:30:05.508424 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:30:05.508424 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:30:05.508424 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:30:05.508424 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Sep 04 01:30:05.509342 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Sep 04 01:30:05.509342 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Sep 04 01:30:05.509342 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Sep 04 01:30:05.509342 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:30:05.509342 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:30:05.509342 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Sep 04 01:30:05.509342 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Sep 04 01:30:05.509342 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 61c2dee96cca4904a97e8d38c2236e6e. Sep 04 01:30:05.509342 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:30:05.509924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aef354-83ff-41b4-ad10-4be0640b0ad5 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:05.510388 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3332/6624] 10.222.0.30 () {58 vars in 1275 bytes} [Sun Sep 4 01:30:05 2022] GET /identity/v3/domains/61c2dee96cca4904a97e8d38c2236e6e/config/identity => generated 154 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:30:05.514819 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e538ed9-a227-4553-8447-93f6981d4343 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:05.519029 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe233f34-9fe2-4b87-8ee9-c85126047d3c tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da97a32e5f74f49a315bd32b1fc99c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '896fbfa1c11240f9a4d783a68b362232', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:05.519682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe233f34-9fe2-4b87-8ee9-c85126047d3c tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:05.520049 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe233f34-9fe2-4b87-8ee9-c85126047d3c tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:05.520295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe233f34-9fe2-4b87-8ee9-c85126047d3c tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:05.521005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe233f34-9fe2-4b87-8ee9-c85126047d3c tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:05.522661 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe233f34-9fe2-4b87-8ee9-c85126047d3c tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:05.529422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e538ed9-a227-4553-8447-93f6981d4343 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:05.536861 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42342c66-84f5-45c1-81b1-bc5683c3b1dd tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:05.537797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42342c66-84f5-45c1-81b1-bc5683c3b1dd tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:05.538392 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42342c66-84f5-45c1-81b1-bc5683c3b1dd tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:05.538825 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42342c66-84f5-45c1-81b1-bc5683c3b1dd tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/61c2dee96cca4904a97e8d38c2236e6e/config` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:05.539747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42342c66-84f5-45c1-81b1-bc5683c3b1dd tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=61c2dee96cca4904a97e8d38c2236e6e)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:05.541600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42342c66-84f5-45c1-81b1-bc5683c3b1dd tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:05.542820 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3293/6625] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:30:05 2022] POST /identity/v3/services => generated 288 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:05.547241 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe233f34-9fe2-4b87-8ee9-c85126047d3c tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:05.551859 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3333/6626] 10.222.0.30 () {58 vars in 1251 bytes} [Sun Sep 4 01:30:05 2022] DELETE /identity/v3/domains/61c2dee96cca4904a97e8d38c2236e6e/config => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:30:05.555824 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42342c66-84f5-45c1-81b1-bc5683c3b1dd tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:05.568534 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42342c66-84f5-45c1-81b1-bc5683c3b1dd tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:05.575702 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe233f34-9fe2-4b87-8ee9-c85126047d3c tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:05.584399 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31fbb6-7d27-49a6-9d1b-9dd9897139ae tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da97a32e5f74f49a315bd32b1fc99c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '896fbfa1c11240f9a4d783a68b362232', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:05.585522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31fbb6-7d27-49a6-9d1b-9dd9897139ae tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:05.585919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31fbb6-7d27-49a6-9d1b-9dd9897139ae tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:05.586789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31fbb6-7d27-49a6-9d1b-9dd9897139ae tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:05.587570 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd31fbb6-7d27-49a6-9d1b-9dd9897139ae tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:05.589069 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-dd31fbb6-7d27-49a6-9d1b-9dd9897139ae tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:30:05.589069 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:30:05.589069 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:30:05.590532 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ef4a8-b29b-44a5-ae11-d65d63119d5f tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:05.591022 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd31fbb6-7d27-49a6-9d1b-9dd9897139ae tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:05.591506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ef4a8-b29b-44a5-ae11-d65d63119d5f tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:05.591933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ef4a8-b29b-44a5-ae11-d65d63119d5f tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:05.592590 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ef4a8-b29b-44a5-ae11-d65d63119d5f tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/61c2dee96cca4904a97e8d38c2236e6e` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:05.594385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ef4a8-b29b-44a5-ae11-d65d63119d5f tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=61c2dee96cca4904a97e8d38c2236e6e)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:05.596971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ef4a8-b29b-44a5-ae11-d65d63119d5f tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:05.620237 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-dd31fbb6-7d27-49a6-9d1b-9dd9897139ae tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1255281670. To ensure interoperability, identifiers should be a valid uuid. Sep 04 01:30:05.620237 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 04 01:30:05.620237 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:30:05.624821 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-806ef4a8-b29b-44a5-ae11-d65d63119d5f tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '61c2dee96cca4904a97e8d38c2236e6e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:05.626454 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-806ef4a8-b29b-44a5-ae11-d65d63119d5f tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '61c2dee96cca4904a97e8d38c2236e6e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:05.658645 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3294/6627] 10.222.0.30 () {60 vars in 1156 bytes} [Sun Sep 4 01:30:05 2022] POST /identity/v3/endpoints => generated 361 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:05.661933 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31fbb6-7d27-49a6-9d1b-9dd9897139ae tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:05.664693 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-dd31fbb6-7d27-49a6-9d1b-9dd9897139ae tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:05.669028 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-806ef4a8-b29b-44a5-ae11-d65d63119d5f tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '61c2dee96cca4904a97e8d38c2236e6e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:05.670000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-806ef4a8-b29b-44a5-ae11-d65d63119d5f tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '61c2dee96cca4904a97e8d38c2236e6e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:05.673474 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3334/6628] 10.222.0.30 () {60 vars in 1249 bytes} [Sun Sep 4 01:30:05 2022] PATCH /identity/v3/domains/61c2dee96cca4904a97e8d38c2236e6e => generated 276 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:05.676659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ef4a8-b29b-44a5-ae11-d65d63119d5f tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:05.678176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-806ef4a8-b29b-44a5-ae11-d65d63119d5f tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:05.710072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31fbb6-7d27-49a6-9d1b-9dd9897139ae tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:05.719488 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=83,keystone:DELETE=10,keystone:INSERT=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:05.776113 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ef4a8-b29b-44a5-ae11-d65d63119d5f tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:05.793761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07cf2f-f5b8-4015-8e7f-7649f8741074 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:05.794400 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07cf2f-f5b8-4015-8e7f-7649f8741074 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:05.794680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07cf2f-f5b8-4015-8e7f-7649f8741074 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:05.794954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07cf2f-f5b8-4015-8e7f-7649f8741074 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/61c2dee96cca4904a97e8d38c2236e6e` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:05.796357 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314e1c5-64fe-4c27-9c85-67c3386e044b tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da97a32e5f74f49a315bd32b1fc99c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '896fbfa1c11240f9a4d783a68b362232', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:05.797108 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314e1c5-64fe-4c27-9c85-67c3386e044b tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:05.797400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314e1c5-64fe-4c27-9c85-67c3386e044b tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:05.797710 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314e1c5-64fe-4c27-9c85-67c3386e044b tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] PATH_INFO: `/v3/regions/tempest-region-1255281670` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:05.798420 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6314e1c5-64fe-4c27-9c85-67c3386e044b tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1255281670)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:05.799598 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6314e1c5-64fe-4c27-9c85-67c3386e044b tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:05.802198 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3295/6629] 10.222.0.30 () {58 vars in 1206 bytes} [Sun Sep 4 01:30:05 2022] GET /identity/v3/regions/tempest-region-1255281670 => generated 180 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:30:05.806201 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314e1c5-64fe-4c27-9c85-67c3386e044b tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:05.806995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e07cf2f-f5b8-4015-8e7f-7649f8741074 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=61c2dee96cca4904a97e8d38c2236e6e)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:05.807879 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6314e1c5-64fe-4c27-9c85-67c3386e044b tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:05.808795 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e07cf2f-f5b8-4015-8e7f-7649f8741074 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:05.822244 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314e1c5-64fe-4c27-9c85-67c3386e044b tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:05.825981 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:05.829210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7404e3-d176-4be0-b1bd-98cb89a23c75 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da97a32e5f74f49a315bd32b1fc99c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '896fbfa1c11240f9a4d783a68b362232', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:05.829887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7404e3-d176-4be0-b1bd-98cb89a23c75 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:05.830172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7404e3-d176-4be0-b1bd-98cb89a23c75 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:05.830445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7404e3-d176-4be0-b1bd-98cb89a23c75 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] PATH_INFO: `/v3/endpoints/4702c521ba0c429bb277b5409dddf4ae` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:05.835055 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9e07cf2f-f5b8-4015-8e7f-7649f8741074 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '61c2dee96cca4904a97e8d38c2236e6e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:05.840404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7404e3-d176-4be0-b1bd-98cb89a23c75 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=4702c521ba0c429bb277b5409dddf4ae)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:05.842472 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-9f7404e3-d176-4be0-b1bd-98cb89a23c75 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:30:05.842472 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:30:05.842472 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:30:05.844111 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7404e3-d176-4be0-b1bd-98cb89a23c75 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:05.846754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9e07cf2f-f5b8-4015-8e7f-7649f8741074 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '61c2dee96cca4904a97e8d38c2236e6e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:05.872378 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-9f7404e3-d176-4be0-b1bd-98cb89a23c75 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1963414686. To ensure interoperability, identifiers should be a valid uuid. Sep 04 01:30:05.872378 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 04 01:30:05.872378 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:30:05.928918 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3296/6630] 10.222.0.30 () {60 vars in 1256 bytes} [Sun Sep 4 01:30:05 2022] PATCH /identity/v3/endpoints/4702c521ba0c429bb277b5409dddf4ae => generated 364 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:30:05.932351 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7404e3-d176-4be0-b1bd-98cb89a23c75 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:05.969572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9e07cf2f-f5b8-4015-8e7f-7649f8741074 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61c2dee96cca4904a97e8d38c2236e6e', 'request_id': 'req-9e07cf2f-f5b8-4015-8e7f-7649f8741074'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:05.978474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7404e3-d176-4be0-b1bd-98cb89a23c75 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:05.989910 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9e07cf2f-f5b8-4015-8e7f-7649f8741074 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61c2dee96cca4904a97e8d38c2236e6e', 'request_id': 'req-9e07cf2f-f5b8-4015-8e7f-7649f8741074'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:05.998032 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9e07cf2f-f5b8-4015-8e7f-7649f8741074 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61c2dee96cca4904a97e8d38c2236e6e', 'request_id': 'req-9e07cf2f-f5b8-4015-8e7f-7649f8741074'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:06.014106 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9e07cf2f-f5b8-4015-8e7f-7649f8741074 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] The token cache is being invalidate because project 61c2dee96cca4904a97e8d38c2236e6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:30:06.014542 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9e07cf2f-f5b8-4015-8e7f-7649f8741074 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:06.015442 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9e07cf2f-f5b8-4015-8e7f-7649f8741074 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:06.025500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9e07cf2f-f5b8-4015-8e7f-7649f8741074 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '61c2dee96cca4904a97e8d38c2236e6e', 'request_id': 'req-9e07cf2f-f5b8-4015-8e7f-7649f8741074'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:06.026620 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9e07cf2f-f5b8-4015-8e7f-7649f8741074 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '61c2dee96cca4904a97e8d38c2236e6e', 'request_id': 'req-9e07cf2f-f5b8-4015-8e7f-7649f8741074'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:06.027415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9e07cf2f-f5b8-4015-8e7f-7649f8741074 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '61c2dee96cca4904a97e8d38c2236e6e', 'request_id': 'req-9e07cf2f-f5b8-4015-8e7f-7649f8741074'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:06.040462 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3335/6631] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:30:05 2022] DELETE /identity/v3/domains/61c2dee96cca4904a97e8d38c2236e6e => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:06.046133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07cf2f-f5b8-4015-8e7f-7649f8741074 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:06.051189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9e07cf2f-f5b8-4015-8e7f-7649f8741074 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:06.097551 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47f505-2341-4e86-a36e-24af857be726 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da97a32e5f74f49a315bd32b1fc99c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '896fbfa1c11240f9a4d783a68b362232', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:06.098648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47f505-2341-4e86-a36e-24af857be726 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:06.099348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47f505-2341-4e86-a36e-24af857be726 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:06.099912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47f505-2341-4e86-a36e-24af857be726 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] PATH_INFO: `/v3/regions/tempest-region-1963414686` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:06.101034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d47f505-2341-4e86-a36e-24af857be726 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1963414686)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:06.103402 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d47f505-2341-4e86-a36e-24af857be726 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:06.106416 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3297/6632] 10.222.0.30 () {58 vars in 1206 bytes} [Sun Sep 4 01:30:05 2022] GET /identity/v3/regions/tempest-region-1963414686 => generated 180 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:06.110271 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47f505-2341-4e86-a36e-24af857be726 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:06.116028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2d47f505-2341-4e86-a36e-24af857be726 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:06.139769 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47f505-2341-4e86-a36e-24af857be726 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:06.149823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa6b8b-4d5a-4fb4-a405-f3c81d68ac3d tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da97a32e5f74f49a315bd32b1fc99c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '896fbfa1c11240f9a4d783a68b362232', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:06.150550 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa6b8b-4d5a-4fb4-a405-f3c81d68ac3d tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:06.150876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa6b8b-4d5a-4fb4-a405-f3c81d68ac3d tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:06.151157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa6b8b-4d5a-4fb4-a405-f3c81d68ac3d tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] PATH_INFO: `/v3/endpoints/4702c521ba0c429bb277b5409dddf4ae` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:06.157697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa6b8b-4d5a-4fb4-a405-f3c81d68ac3d tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=4702c521ba0c429bb277b5409dddf4ae)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:06.158937 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-dcaa6b8b-4d5a-4fb4-a405-f3c81d68ac3d tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:30:06.158937 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:30:06.158937 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:30:06.160034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa6b8b-4d5a-4fb4-a405-f3c81d68ac3d tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:06.186395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dcaa6b8b-4d5a-4fb4-a405-f3c81d68ac3d tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '4702c521ba0c429bb277b5409dddf4ae', 'request_id': 'req-dcaa6b8b-4d5a-4fb4-a405-f3c81d68ac3d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:06.203461 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3298/6633] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Sep 4 01:30:06 2022] DELETE /identity/v3/endpoints/4702c521ba0c429bb277b5409dddf4ae => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:06.206608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa6b8b-4d5a-4fb4-a405-f3c81d68ac3d tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:06.206757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07cf2f-f5b8-4015-8e7f-7649f8741074 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:06.244405 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a48da8-d1ca-47a0-bf4d-4cfd04ebff7a tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:06.245035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a48da8-d1ca-47a0-bf4d-4cfd04ebff7a tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:06.245316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a48da8-d1ca-47a0-bf4d-4cfd04ebff7a tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:06.245626 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a48da8-d1ca-47a0-bf4d-4cfd04ebff7a tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:06.246430 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a48da8-d1ca-47a0-bf4d-4cfd04ebff7a tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:06.248372 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-d5a48da8-d1ca-47a0-bf4d-4cfd04ebff7a tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:30:06.248372 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:30:06.248372 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:30:06.249310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a48da8-d1ca-47a0-bf4d-4cfd04ebff7a tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:06.263858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa6b8b-4d5a-4fb4-a405-f3c81d68ac3d tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:06.270469 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3336/6634] 10.222.0.30 () {58 vars in 1173 bytes} [Sun Sep 4 01:30:06 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:06.271464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a48da8-d1ca-47a0-bf4d-4cfd04ebff7a tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:06.280505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae984c9-55b0-451b-8a04-7d8218e47346 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da97a32e5f74f49a315bd32b1fc99c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '896fbfa1c11240f9a4d783a68b362232', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:06.283011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae984c9-55b0-451b-8a04-7d8218e47346 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:06.283311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae984c9-55b0-451b-8a04-7d8218e47346 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:06.283587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae984c9-55b0-451b-8a04-7d8218e47346 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] PATH_INFO: `/v3/regions/tempest-region-1963414686` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:06.285090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae984c9-55b0-451b-8a04-7d8218e47346 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1963414686)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:06.286151 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-4ae984c9-55b0-451b-8a04-7d8218e47346 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:30:06.286151 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:30:06.286151 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:30:06.287276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae984c9-55b0-451b-8a04-7d8218e47346 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:06.314797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a48da8-d1ca-47a0-bf4d-4cfd04ebff7a tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:06.330620 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c4236-d0c1-4511-b47a-370ec75bd4c6 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:06.331913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c4236-d0c1-4511-b47a-370ec75bd4c6 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:06.332381 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c4236-d0c1-4511-b47a-370ec75bd4c6 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:06.332664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c4236-d0c1-4511-b47a-370ec75bd4c6 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:06.333320 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c4236-d0c1-4511-b47a-370ec75bd4c6 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:06.337228 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3299/6635] 10.222.0.30 () {58 vars in 1209 bytes} [Sun Sep 4 01:30:06 2022] DELETE /identity/v3/regions/tempest-region-1963414686 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:06.337420 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae984c9-55b0-451b-8a04-7d8218e47346 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:06.346859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c4236-d0c1-4511-b47a-370ec75bd4c6 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:06.348342 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3337/6636] 10.222.0.30 () {58 vars in 1200 bytes} [Sun Sep 4 01:30:06 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:06.354204 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c4236-d0c1-4511-b47a-370ec75bd4c6 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:06.361168 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:06.379950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae984c9-55b0-451b-8a04-7d8218e47346 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:06.388607 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319ff52-a64b-4db4-98f1-5c7d54f6a024 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da97a32e5f74f49a315bd32b1fc99c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '896fbfa1c11240f9a4d783a68b362232', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:06.389643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319ff52-a64b-4db4-98f1-5c7d54f6a024 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:06.390045 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319ff52-a64b-4db4-98f1-5c7d54f6a024 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:06.390438 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319ff52-a64b-4db4-98f1-5c7d54f6a024 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] PATH_INFO: `/v3/regions/tempest-region-1255281670` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:06.392238 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c4236-d0c1-4511-b47a-370ec75bd4c6 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:06.392806 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0319ff52-a64b-4db4-98f1-5c7d54f6a024 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1255281670)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:06.395554 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0319ff52-a64b-4db4-98f1-5c7d54f6a024 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:06.427353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2f998-8a41-417d-bac2-789f2ea07c4a tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:06.429059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2f998-8a41-417d-bac2-789f2ea07c4a tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:06.429482 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2f998-8a41-417d-bac2-789f2ea07c4a tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:06.429868 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2f998-8a41-417d-bac2-789f2ea07c4a tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:06.436018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2f998-8a41-417d-bac2-789f2ea07c4a tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:06.444292 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3300/6637] 10.222.0.30 () {58 vars in 1209 bytes} [Sun Sep 4 01:30:06 2022] DELETE /identity/v3/regions/tempest-region-1255281670 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:06.444507 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319ff52-a64b-4db4-98f1-5c7d54f6a024 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:06.446883 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2f998-8a41-417d-bac2-789f2ea07c4a tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:06.456543 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3338/6638] 10.222.0.30 () {58 vars in 1221 bytes} [Sun Sep 4 01:30:06 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:06.459921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2f998-8a41-417d-bac2-789f2ea07c4a tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:06.482348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2f998-8a41-417d-bac2-789f2ea07c4a tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:06.490874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319ff52-a64b-4db4-98f1-5c7d54f6a024 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:06.500936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79381baa-b3ee-4632-9309-83fa0086db26 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da97a32e5f74f49a315bd32b1fc99c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '896fbfa1c11240f9a4d783a68b362232', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:06.503350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79381baa-b3ee-4632-9309-83fa0086db26 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:06.503669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79381baa-b3ee-4632-9309-83fa0086db26 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:06.503946 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79381baa-b3ee-4632-9309-83fa0086db26 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] PATH_INFO: `/v3/services/525841751baf42eba0e27f35ad8fb035` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:06.504563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79381baa-b3ee-4632-9309-83fa0086db26 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorizing `identity:delete_service(service_id=525841751baf42eba0e27f35ad8fb035)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:06.507044 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79381baa-b3ee-4632-9309-83fa0086db26 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:06.512113 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcaea53-c080-4048-afff-fcc098e3010a tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:06.512778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcaea53-c080-4048-afff-fcc098e3010a tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:06.513062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcaea53-c080-4048-afff-fcc098e3010a tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:06.513341 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcaea53-c080-4048-afff-fcc098e3010a tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:06.514034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcaea53-c080-4048-afff-fcc098e3010a tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:06.518848 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcaea53-c080-4048-afff-fcc098e3010a tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:06.521964 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3339/6639] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:30:06 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:06.534944 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcaea53-c080-4048-afff-fcc098e3010a tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:06.542862 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1dcaea53-c080-4048-afff-fcc098e3010a tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:06.565946 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3301/6640] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:30:06 2022] DELETE /identity/v3/services/525841751baf42eba0e27f35ad8fb035 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:06.570959 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79381baa-b3ee-4632-9309-83fa0086db26 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:06.614313 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:06.632851 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79381baa-b3ee-4632-9309-83fa0086db26 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:06.646948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f1cc2-c809-4df3-9f05-17d8e605cdf0 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:06.648253 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f1cc2-c809-4df3-9f05-17d8e605cdf0 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:06.648253 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f1cc2-c809-4df3-9f05-17d8e605cdf0 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:06.648253 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f1cc2-c809-4df3-9f05-17d8e605cdf0 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:06.648850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f1cc2-c809-4df3-9f05-17d8e605cdf0 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:06.652658 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-5d4f1cc2-c809-4df3-9f05-17d8e605cdf0 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:30:06.652658 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:30:06.652658 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:30:06.657075 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f1cc2-c809-4df3-9f05-17d8e605cdf0 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:06.663856 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3302/6641] 10.222.0.30 () {58 vars in 1188 bytes} [Sun Sep 4 01:30:06 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:06.664969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f1cc2-c809-4df3-9f05-17d8e605cdf0 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:06.708304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f1cc2-c809-4df3-9f05-17d8e605cdf0 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:06.722275 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0904057-19e1-4f14-87a6-08a5d7d702ab tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da97a32e5f74f49a315bd32b1fc99c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '896fbfa1c11240f9a4d783a68b362232', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:06.723187 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0904057-19e1-4f14-87a6-08a5d7d702ab tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:06.723755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0904057-19e1-4f14-87a6-08a5d7d702ab tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:06.724186 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0904057-19e1-4f14-87a6-08a5d7d702ab tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] PATH_INFO: `/v3/endpoints/cc0fecd7d64149959aeaa0796e38e5a2` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:06.731838 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0904057-19e1-4f14-87a6-08a5d7d702ab tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=cc0fecd7d64149959aeaa0796e38e5a2)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:06.734495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0904057-19e1-4f14-87a6-08a5d7d702ab tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:06.735522 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcaea53-c080-4048-afff-fcc098e3010a tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:06.749195 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c0904057-19e1-4f14-87a6-08a5d7d702ab tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'cc0fecd7d64149959aeaa0796e38e5a2', 'request_id': 'req-c0904057-19e1-4f14-87a6-08a5d7d702ab'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:06.768042 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3303/6642] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Sep 4 01:30:06 2022] DELETE /identity/v3/endpoints/cc0fecd7d64149959aeaa0796e38e5a2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:06.769118 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0904057-19e1-4f14-87a6-08a5d7d702ab tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:06.791332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6947c-dbe4-4f32-85ef-5190203d3fcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:06.792359 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6947c-dbe4-4f32-85ef-5190203d3fcf service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:06.792828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6947c-dbe4-4f32-85ef-5190203d3fcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:06.793315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6947c-dbe4-4f32-85ef-5190203d3fcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:06.805564 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6dd6947c-dbe4-4f32-85ef-5190203d3fcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:06.808210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0904057-19e1-4f14-87a6-08a5d7d702ab tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:06.816119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd679a-1835-4fac-a449-27f88b9f6e6f tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:06.816940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd679a-1835-4fac-a449-27f88b9f6e6f tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:06.817533 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd679a-1835-4fac-a449-27f88b9f6e6f tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:06.817884 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd679a-1835-4fac-a449-27f88b9f6e6f tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:06.818699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd679a-1835-4fac-a449-27f88b9f6e6f tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:06.820940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd679a-1835-4fac-a449-27f88b9f6e6f tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:06.824965 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3304/6643] 10.222.0.30 () {58 vars in 1200 bytes} [Sun Sep 4 01:30:06 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:06.824965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd679a-1835-4fac-a449-27f88b9f6e6f tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:06.860459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd679a-1835-4fac-a449-27f88b9f6e6f tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:06.868495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba098f75-4e39-41a4-a601-c6ca30be92c3 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da97a32e5f74f49a315bd32b1fc99c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '896fbfa1c11240f9a4d783a68b362232', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:06.869261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba098f75-4e39-41a4-a601-c6ca30be92c3 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:06.869863 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba098f75-4e39-41a4-a601-c6ca30be92c3 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:06.870216 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba098f75-4e39-41a4-a601-c6ca30be92c3 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] PATH_INFO: `/v3/regions/tempest-region-1135514202` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:06.871006 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba098f75-4e39-41a4-a601-c6ca30be92c3 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1135514202)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:06.874106 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba098f75-4e39-41a4-a601-c6ca30be92c3 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:06.894305 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-ba098f75-4e39-41a4-a601-c6ca30be92c3 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1135514202. To ensure interoperability, identifiers should be a valid uuid. Sep 04 01:30:06.894305 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 04 01:30:06.894305 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:30:06.912491 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3305/6644] 10.222.0.30 () {58 vars in 1209 bytes} [Sun Sep 4 01:30:06 2022] DELETE /identity/v3/regions/tempest-region-1135514202 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:06.914221 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2cfb53-96d4-400e-938e-60609ae1cd8d None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:06.917773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2cfb53-96d4-400e-938e-60609ae1cd8d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:06.918331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2cfb53-96d4-400e-938e-60609ae1cd8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:06.983007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd6947c-dbe4-4f32-85ef-5190203d3fcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:06.984639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd6947c-dbe4-4f32-85ef-5190203d3fcf service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:06.986189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-bf2cfb53-96d4-400e-938e-60609ae1cd8d None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:06.988389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bf2cfb53-96d4-400e-938e-60609ae1cd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:07.036045 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3340/6645] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:30:06 2022] GET /identity/v3/auth/tokens => generated 3820 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:30:07.037338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6947c-dbe4-4f32-85ef-5190203d3fcf service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:07.055275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6947c-dbe4-4f32-85ef-5190203d3fcf service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:07.073101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc30343f-f98f-485c-9350-bc68cdc043ce tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:07.073794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30343f-f98f-485c-9350-bc68cdc043ce tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:07.074079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30343f-f98f-485c-9350-bc68cdc043ce tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:07.074357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30343f-f98f-485c-9350-bc68cdc043ce tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:07.074952 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc30343f-f98f-485c-9350-bc68cdc043ce tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:07.076746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc30343f-f98f-485c-9350-bc68cdc043ce tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:07.078078 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3341/6646] 10.222.0.30 () {58 vars in 1203 bytes} [Sun Sep 4 01:30:07 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:07.079010 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc30343f-f98f-485c-9350-bc68cdc043ce tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:07.102596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc30343f-f98f-485c-9350-bc68cdc043ce tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:07.107592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8015bf-d1e5-4189-93f6-a0fa067adc2e tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da97a32e5f74f49a315bd32b1fc99c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '896fbfa1c11240f9a4d783a68b362232', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:07.108477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8015bf-d1e5-4189-93f6-a0fa067adc2e tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:07.108925 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8015bf-d1e5-4189-93f6-a0fa067adc2e tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:07.109211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8015bf-d1e5-4189-93f6-a0fa067adc2e tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] PATH_INFO: `/v3/services/8ec3f67780894b5c96bc3600b7d83b41` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:07.109835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8015bf-d1e5-4189-93f6-a0fa067adc2e tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorizing `identity:delete_service(service_id=8ec3f67780894b5c96bc3600b7d83b41)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:07.111459 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8015bf-d1e5-4189-93f6-a0fa067adc2e tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:07.150350 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3342/6647] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:30:07 2022] DELETE /identity/v3/services/8ec3f67780894b5c96bc3600b7d83b41 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:07.155879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8015bf-d1e5-4189-93f6-a0fa067adc2e tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:07.163454 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:07.170807 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3306/6648] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:30:06 2022] POST /identity/v3/auth/tokens => generated 3510 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:07.173009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2cfb53-96d4-400e-938e-60609ae1cd8d None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:07.220271 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2cfb53-96d4-400e-938e-60609ae1cd8d None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:07.223129 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8015bf-d1e5-4189-93f6-a0fa067adc2e tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:07.233644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0e3eb-e150-4c47-9fe4-5f990531ca6e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:07.234320 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0e3eb-e150-4c47-9fe4-5f990531ca6e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:07.234607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0e3eb-e150-4c47-9fe4-5f990531ca6e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:07.234889 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0e3eb-e150-4c47-9fe4-5f990531ca6e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:07.235488 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0e3eb-e150-4c47-9fe4-5f990531ca6e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:07.237382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0e3eb-e150-4c47-9fe4-5f990531ca6e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:07.257731 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3343/6649] 10.222.0.30 () {58 vars in 1209 bytes} [Sun Sep 4 01:30:07 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:07.257731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0e3eb-e150-4c47-9fe4-5f990531ca6e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:07.257731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-bff0e3eb-e150-4c47-9fe4-5f990531ca6e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:07.264291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef96e2d-9958-46e3-a602-6d537b8ee5e4 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da97a32e5f74f49a315bd32b1fc99c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '896fbfa1c11240f9a4d783a68b362232', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:07.264291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef96e2d-9958-46e3-a602-6d537b8ee5e4 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:07.264291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef96e2d-9958-46e3-a602-6d537b8ee5e4 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:07.264636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef96e2d-9958-46e3-a602-6d537b8ee5e4 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] PATH_INFO: `/v3/endpoints/417b8e88436d448f952971c5ed28f84f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:07.273878 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef96e2d-9958-46e3-a602-6d537b8ee5e4 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=417b8e88436d448f952971c5ed28f84f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:07.275686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef96e2d-9958-46e3-a602-6d537b8ee5e4 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:07.288919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-eef96e2d-9958-46e3-a602-6d537b8ee5e4 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '417b8e88436d448f952971c5ed28f84f', 'request_id': 'req-eef96e2d-9958-46e3-a602-6d537b8ee5e4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:07.304346 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3307/6650] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Sep 4 01:30:07 2022] DELETE /identity/v3/endpoints/417b8e88436d448f952971c5ed28f84f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:07.305801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef96e2d-9958-46e3-a602-6d537b8ee5e4 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:07.339065 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef96e2d-9958-46e3-a602-6d537b8ee5e4 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:07.343742 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:07.344484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f7781-e825-4a8e-9a1a-3eea406d116c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:07.345203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f7781-e825-4a8e-9a1a-3eea406d116c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:07.345517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f7781-e825-4a8e-9a1a-3eea406d116c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:07.345885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f7781-e825-4a8e-9a1a-3eea406d116c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:07.346708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f7781-e825-4a8e-9a1a-3eea406d116c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:07.348235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f7781-e825-4a8e-9a1a-3eea406d116c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:07.352350 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3308/6651] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:07 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:07.352350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f7781-e825-4a8e-9a1a-3eea406d116c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:07.388699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f7781-e825-4a8e-9a1a-3eea406d116c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:07.395850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf39b76-7cca-4a40-a02d-ebd3c7e8a425 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da97a32e5f74f49a315bd32b1fc99c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '896fbfa1c11240f9a4d783a68b362232', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:07.396773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf39b76-7cca-4a40-a02d-ebd3c7e8a425 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:07.397124 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf39b76-7cca-4a40-a02d-ebd3c7e8a425 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:07.397549 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf39b76-7cca-4a40-a02d-ebd3c7e8a425 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] PATH_INFO: `/v3/regions/tempest-region-1445026700` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:07.398235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf39b76-7cca-4a40-a02d-ebd3c7e8a425 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1445026700)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:07.400155 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf39b76-7cca-4a40-a02d-ebd3c7e8a425 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:07.421797 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-1bf39b76-7cca-4a40-a02d-ebd3c7e8a425 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1445026700. To ensure interoperability, identifiers should be a valid uuid. Sep 04 01:30:07.421797 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 04 01:30:07.421797 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:30:07.427458 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0e3eb-e150-4c47-9fe4-5f990531ca6e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:07.436481 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3309/6652] 10.222.0.30 () {58 vars in 1209 bytes} [Sun Sep 4 01:30:07 2022] DELETE /identity/v3/regions/tempest-region-1445026700 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:07.436481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf39b76-7cca-4a40-a02d-ebd3c7e8a425 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:07.448419 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26fa6f-d6d8-4a06-8b70-ba318ae1a6ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:07.449032 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26fa6f-d6d8-4a06-8b70-ba318ae1a6ff service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:07.449313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26fa6f-d6d8-4a06-8b70-ba318ae1a6ff service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:07.449709 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26fa6f-d6d8-4a06-8b70-ba318ae1a6ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:07.465314 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d26fa6f-d6d8-4a06-8b70-ba318ae1a6ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:07.469093 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d26fa6f-d6d8-4a06-8b70-ba318ae1a6ff service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:07.491479 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3344/6653] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:30:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:30:07.492481 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26fa6f-d6d8-4a06-8b70-ba318ae1a6ff service swift] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:07.493009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf39b76-7cca-4a40-a02d-ebd3c7e8a425 tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:07.498147 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00017d0b-983a-418f-9edf-030db07ca1f6 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:07.498765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00017d0b-983a-418f-9edf-030db07ca1f6 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:07.499068 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00017d0b-983a-418f-9edf-030db07ca1f6 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:07.499356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00017d0b-983a-418f-9edf-030db07ca1f6 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:07.499952 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00017d0b-983a-418f-9edf-030db07ca1f6 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:07.503722 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00017d0b-983a-418f-9edf-030db07ca1f6 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:07.508296 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3310/6654] 10.222.0.30 () {58 vars in 1218 bytes} [Sun Sep 4 01:30:07 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:07.511686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00017d0b-983a-418f-9edf-030db07ca1f6 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:07.513202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26fa6f-d6d8-4a06-8b70-ba318ae1a6ff service swift] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:07.537941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00017d0b-983a-418f-9edf-030db07ca1f6 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:07.546904 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d1a9f-4af2-43d2-a16e-41d1f384bd94 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:07.547611 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d1a9f-4af2-43d2-a16e-41d1f384bd94 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:07.547896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d1a9f-4af2-43d2-a16e-41d1f384bd94 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:07.548206 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d1a9f-4af2-43d2-a16e-41d1f384bd94 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:07.548862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15d1a9f-4af2-43d2-a16e-41d1f384bd94 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:07.551873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15d1a9f-4af2-43d2-a16e-41d1f384bd94 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:07.552888 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3311/6655] 10.222.0.30 () {58 vars in 1248 bytes} [Sun Sep 4 01:30:07 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:07.561179 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d1a9f-4af2-43d2-a16e-41d1f384bd94 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:07.567863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b730a-2e11-4533-b00f-4fdda16f7aae tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da97a32e5f74f49a315bd32b1fc99c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '896fbfa1c11240f9a4d783a68b362232', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:07.568718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b730a-2e11-4533-b00f-4fdda16f7aae tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:07.569110 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b730a-2e11-4533-b00f-4fdda16f7aae tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:07.569534 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b730a-2e11-4533-b00f-4fdda16f7aae tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] PATH_INFO: `/v3/services/52316776ebcb43d2ba86abd848f5dd14` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:07.570289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b730a-2e11-4533-b00f-4fdda16f7aae tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorizing `identity:delete_service(service_id=52316776ebcb43d2ba86abd848f5dd14)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:07.572761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b730a-2e11-4533-b00f-4fdda16f7aae tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:07.583502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d1a9f-4af2-43d2-a16e-41d1f384bd94 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:07.593591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aac50e-f0a5-4029-8441-7cc45d612741 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:07.596113 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aac50e-f0a5-4029-8441-7cc45d612741 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:07.600954 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aac50e-f0a5-4029-8441-7cc45d612741 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:07.600954 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aac50e-f0a5-4029-8441-7cc45d612741 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:07.602826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aac50e-f0a5-4029-8441-7cc45d612741 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:07.610565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aac50e-f0a5-4029-8441-7cc45d612741 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:07.613883 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3312/6656] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:07 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:07.622385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aac50e-f0a5-4029-8441-7cc45d612741 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:07.641971 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3345/6657] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:30:07 2022] DELETE /identity/v3/services/52316776ebcb43d2ba86abd848f5dd14 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:07.645215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aac50e-f0a5-4029-8441-7cc45d612741 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:07.646301 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b730a-2e11-4533-b00f-4fdda16f7aae tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:07.649573 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-791b730a-2e11-4533-b00f-4fdda16f7aae tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:07.681804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d7e89-5aa8-475a-89f1-895ea37bf0f4 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:07.682475 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d7e89-5aa8-475a-89f1-895ea37bf0f4 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:07.682757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d7e89-5aa8-475a-89f1-895ea37bf0f4 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:07.683036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d7e89-5aa8-475a-89f1-895ea37bf0f4 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:07.683625 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d7e89-5aa8-475a-89f1-895ea37bf0f4 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:07.685341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d7e89-5aa8-475a-89f1-895ea37bf0f4 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:07.686719 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3313/6658] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Sep 4 01:30:07 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:07.691145 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d7e89-5aa8-475a-89f1-895ea37bf0f4 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:07.711665 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d7e89-5aa8-475a-89f1-895ea37bf0f4 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:07.719310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8f814-dfb0-47c3-a906-1cdc240912d3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:07.720308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8f814-dfb0-47c3-a906-1cdc240912d3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:07.720753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8f814-dfb0-47c3-a906-1cdc240912d3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:07.721176 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8f814-dfb0-47c3-a906-1cdc240912d3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:07.722467 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e8f814-dfb0-47c3-a906-1cdc240912d3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:07.724414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e8f814-dfb0-47c3-a906-1cdc240912d3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:07.726541 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3314/6659] 10.222.0.30 () {58 vars in 1227 bytes} [Sun Sep 4 01:30:07 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 04 01:30:07.729918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8f814-dfb0-47c3-a906-1cdc240912d3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:07.741720 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8f814-dfb0-47c3-a906-1cdc240912d3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:07.748252 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf079bf-9fcf-4716-b551-f509cd668d55 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:07.749146 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf079bf-9fcf-4716-b551-f509cd668d55 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:07.749604 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf079bf-9fcf-4716-b551-f509cd668d55 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:07.750031 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf079bf-9fcf-4716-b551-f509cd668d55 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:07.750789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf079bf-9fcf-4716-b551-f509cd668d55 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:07.752641 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf079bf-9fcf-4716-b551-f509cd668d55 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:07.754240 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3315/6660] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:07 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 04 01:30:07.757871 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf079bf-9fcf-4716-b551-f509cd668d55 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:07.783398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf079bf-9fcf-4716-b551-f509cd668d55 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:07.800859 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d963d7-d657-4e08-9185-bd24e6650611 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:07.801605 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d963d7-d657-4e08-9185-bd24e6650611 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:07.803070 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d963d7-d657-4e08-9185-bd24e6650611 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:07.804452 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d963d7-d657-4e08-9185-bd24e6650611 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:07.806710 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d963d7-d657-4e08-9185-bd24e6650611 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:07.808779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d963d7-d657-4e08-9185-bd24e6650611 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:07.813676 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3316/6661] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Sep 4 01:30:07 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 04 01:30:07.817809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d963d7-d657-4e08-9185-bd24e6650611 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:07.825332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b730a-2e11-4533-b00f-4fdda16f7aae tempest-EndPointsTestJSON-312255868 tempest-EndPointsTestJSON-312255868-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:07.840092 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b2320-9ed1-4899-bd9c-86b3391ac180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:07.841237 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b2320-9ed1-4899-bd9c-86b3391ac180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:07.841747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b2320-9ed1-4899-bd9c-86b3391ac180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:07.842203 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b2320-9ed1-4899-bd9c-86b3391ac180 admin admin] PATH_INFO: `/v3/users/0890bb25f8c34d1d90a9d3101c759ca8` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:07.847577 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b2320-9ed1-4899-bd9c-86b3391ac180 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0890bb25f8c34d1d90a9d3101c759ca8)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:07.849907 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b2320-9ed1-4899-bd9c-86b3391ac180 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:07.856228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d963d7-d657-4e08-9185-bd24e6650611 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:07.868359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937139a-9c7b-47d7-9615-6881c6e95e5d tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:07.870994 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937139a-9c7b-47d7-9615-6881c6e95e5d tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:07.871389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937139a-9c7b-47d7-9615-6881c6e95e5d tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:07.871737 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937139a-9c7b-47d7-9615-6881c6e95e5d tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:07.872410 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4937139a-9c7b-47d7-9615-6881c6e95e5d tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:07.878027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4937139a-9c7b-47d7-9615-6881c6e95e5d tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:07.882312 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3317/6662] 10.222.0.30 () {58 vars in 1242 bytes} [Sun Sep 4 01:30:07 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:07.883622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937139a-9c7b-47d7-9615-6881c6e95e5d tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:07.908382 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937139a-9c7b-47d7-9615-6881c6e95e5d tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:07.925539 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54020d6d-1399-4c6b-8620-4059c782f22b tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:07.926509 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54020d6d-1399-4c6b-8620-4059c782f22b tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:07.927332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54020d6d-1399-4c6b-8620-4059c782f22b tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:07.927906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54020d6d-1399-4c6b-8620-4059c782f22b tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:07.928922 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54020d6d-1399-4c6b-8620-4059c782f22b tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:07.930775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54020d6d-1399-4c6b-8620-4059c782f22b tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:07.935285 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3318/6663] 10.222.0.30 () {58 vars in 1248 bytes} [Sun Sep 4 01:30:07 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:07.936360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54020d6d-1399-4c6b-8620-4059c782f22b tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:07.948407 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54020d6d-1399-4c6b-8620-4059c782f22b tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:07.957052 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb64b2-e5f1-43e4-8558-e0983ea89beb tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:07.958288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb64b2-e5f1-43e4-8558-e0983ea89beb tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:07.958829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb64b2-e5f1-43e4-8558-e0983ea89beb tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:07.959114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb64b2-e5f1-43e4-8558-e0983ea89beb tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:07.959720 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb64b2-e5f1-43e4-8558-e0983ea89beb tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:07.961980 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f00b2320-9ed1-4899-bd9c-86b3391ac180 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0890bb25f8c34d1d90a9d3101c759ca8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:07.963428 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb64b2-e5f1-43e4-8558-e0983ea89beb tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:07.963722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f00b2320-9ed1-4899-bd9c-86b3391ac180 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0890bb25f8c34d1d90a9d3101c759ca8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:07.974457 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3319/6664] 10.222.0.30 () {58 vars in 1248 bytes} [Sun Sep 4 01:30:07 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:07.975500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb64b2-e5f1-43e4-8558-e0983ea89beb tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:07.977485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f00b2320-9ed1-4899-bd9c-86b3391ac180 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0890bb25f8c34d1d90a9d3101c759ca8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:07.977646 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-24cb64b2-e5f1-43e4-8558-e0983ea89beb tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:07.991084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f00b2320-9ed1-4899-bd9c-86b3391ac180 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0890bb25f8c34d1d90a9d3101c759ca8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:07.993318 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb64b2-e5f1-43e4-8558-e0983ea89beb tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:07.994036 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f00b2320-9ed1-4899-bd9c-86b3391ac180 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0890bb25f8c34d1d90a9d3101c759ca8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:08.000236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04711ca4-9ba2-4259-bc9e-7171a5d6d5e4 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:08.000961 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04711ca4-9ba2-4259-bc9e-7171a5d6d5e4 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:08.001251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04711ca4-9ba2-4259-bc9e-7171a5d6d5e4 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:08.002274 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04711ca4-9ba2-4259-bc9e-7171a5d6d5e4 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:08.003464 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04711ca4-9ba2-4259-bc9e-7171a5d6d5e4 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:08.005203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04711ca4-9ba2-4259-bc9e-7171a5d6d5e4 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:08.011633 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3320/6665] 10.222.0.30 () {58 vars in 1269 bytes} [Sun Sep 4 01:30:07 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:08.012964 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04711ca4-9ba2-4259-bc9e-7171a5d6d5e4 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:08.015728 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:08.031165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04711ca4-9ba2-4259-bc9e-7171a5d6d5e4 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:08.035563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe991c1-e796-4c94-a2ab-75eebc7b630a tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:08.036252 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe991c1-e796-4c94-a2ab-75eebc7b630a tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:08.036514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe991c1-e796-4c94-a2ab-75eebc7b630a tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:08.036793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe991c1-e796-4c94-a2ab-75eebc7b630a tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:08.037595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe991c1-e796-4c94-a2ab-75eebc7b630a tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:08.039159 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe991c1-e796-4c94-a2ab-75eebc7b630a tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:08.044309 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3321/6666] 10.222.0.30 () {58 vars in 1248 bytes} [Sun Sep 4 01:30:08 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:08.046512 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe991c1-e796-4c94-a2ab-75eebc7b630a tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:08.061304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe991c1-e796-4c94-a2ab-75eebc7b630a tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:08.062050 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3346/6667] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:07 2022] DELETE /identity/v3/users/0890bb25f8c34d1d90a9d3101c759ca8 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:08.063934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d993f1-dd99-4233-8948-4596cf78bedf None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:08.064216 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d993f1-dd99-4233-8948-4596cf78bedf None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:08.064492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d993f1-dd99-4233-8948-4596cf78bedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:08.105402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-39d993f1-dd99-4233-8948-4596cf78bedf None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:08.107457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-39d993f1-dd99-4233-8948-4596cf78bedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:08.197035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d1456-82e8-4d95-867c-0bf0eaf4a5ae tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:08.198486 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d1456-82e8-4d95-867c-0bf0eaf4a5ae tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:08.199004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d1456-82e8-4d95-867c-0bf0eaf4a5ae tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:08.199639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d1456-82e8-4d95-867c-0bf0eaf4a5ae tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:08.200472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d1456-82e8-4d95-867c-0bf0eaf4a5ae tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:08.202454 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d1456-82e8-4d95-867c-0bf0eaf4a5ae tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:08.207925 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3322/6668] 10.222.0.30 () {58 vars in 1257 bytes} [Sun Sep 4 01:30:08 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:08.212941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d1456-82e8-4d95-867c-0bf0eaf4a5ae tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:08.216138 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3347/6669] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:08.228099 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d993f1-dd99-4233-8948-4596cf78bedf None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:08.230327 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-39d993f1-dd99-4233-8948-4596cf78bedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:08.241571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d1456-82e8-4d95-867c-0bf0eaf4a5ae tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:08.264199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731782f-fef4-4028-9876-d1c9f2c9608d tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:08.269072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731782f-fef4-4028-9876-d1c9f2c9608d tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:08.269372 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731782f-fef4-4028-9876-d1c9f2c9608d tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:08.271095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731782f-fef4-4028-9876-d1c9f2c9608d tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:08.271095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731782f-fef4-4028-9876-d1c9f2c9608d tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:08.274629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731782f-fef4-4028-9876-d1c9f2c9608d tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:08.277170 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3323/6670] 10.222.0.30 () {58 vars in 1248 bytes} [Sun Sep 4 01:30:08 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:08.280978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731782f-fef4-4028-9876-d1c9f2c9608d tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:08.303898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731782f-fef4-4028-9876-d1c9f2c9608d tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:08.342229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae745bc-eda7-4636-a65e-8a0d118337ac tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:08.342903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae745bc-eda7-4636-a65e-8a0d118337ac tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:08.343185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae745bc-eda7-4636-a65e-8a0d118337ac tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:08.343459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae745bc-eda7-4636-a65e-8a0d118337ac tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:08.344050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae745bc-eda7-4636-a65e-8a0d118337ac tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:08.352313 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae745bc-eda7-4636-a65e-8a0d118337ac tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:08.354065 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3324/6671] 10.222.0.30 () {58 vars in 1242 bytes} [Sun Sep 4 01:30:08 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:08.358060 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae745bc-eda7-4636-a65e-8a0d118337ac tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:08.399083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae745bc-eda7-4636-a65e-8a0d118337ac tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:08.409885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead0907-0eed-4a25-badf-8966a313c6d3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:08.416312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead0907-0eed-4a25-badf-8966a313c6d3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:08.416860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead0907-0eed-4a25-badf-8966a313c6d3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:08.417349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead0907-0eed-4a25-badf-8966a313c6d3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:08.418433 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead0907-0eed-4a25-badf-8966a313c6d3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:08.420368 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead0907-0eed-4a25-badf-8966a313c6d3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:08.425140 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3325/6672] 10.222.0.30 () {58 vars in 1251 bytes} [Sun Sep 4 01:30:08 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:08.426323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead0907-0eed-4a25-badf-8966a313c6d3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:08.432020 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:08.440557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead0907-0eed-4a25-badf-8966a313c6d3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:08.446610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99064365-a3b1-409d-8f83-537d841e680e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:08.447629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99064365-a3b1-409d-8f83-537d841e680e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:08.448129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99064365-a3b1-409d-8f83-537d841e680e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:08.448619 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99064365-a3b1-409d-8f83-537d841e680e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:08.449479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99064365-a3b1-409d-8f83-537d841e680e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:08.451530 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99064365-a3b1-409d-8f83-537d841e680e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:08.462046 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3326/6673] 10.222.0.30 () {58 vars in 1254 bytes} [Sun Sep 4 01:30:08 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:08.463906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99064365-a3b1-409d-8f83-537d841e680e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:08.465998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-99064365-a3b1-409d-8f83-537d841e680e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:08.477206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d993f1-dd99-4233-8948-4596cf78bedf None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:08.481505 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954974d6-6ffa-47c0-bbdc-90b05f382ac2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:08.482238 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954974d6-6ffa-47c0-bbdc-90b05f382ac2 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:08.482728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954974d6-6ffa-47c0-bbdc-90b05f382ac2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:08.483044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954974d6-6ffa-47c0-bbdc-90b05f382ac2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:08.489237 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99064365-a3b1-409d-8f83-537d841e680e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:08.493709 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098029b1-3189-44e7-8480-361715d2cb85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:08.494625 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098029b1-3189-44e7-8480-361715d2cb85 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:08.495130 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098029b1-3189-44e7-8480-361715d2cb85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:08.495641 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098029b1-3189-44e7-8480-361715d2cb85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:08.499183 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-098029b1-3189-44e7-8480-361715d2cb85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:08.501827 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954974d6-6ffa-47c0-bbdc-90b05f382ac2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:08.504311 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954974d6-6ffa-47c0-bbdc-90b05f382ac2 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:08.528919 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3348/6674] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:30:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:30:08.529633 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954974d6-6ffa-47c0-bbdc-90b05f382ac2 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:08.552082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954974d6-6ffa-47c0-bbdc-90b05f382ac2 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:08.566633 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a599e5-78d5-4012-9219-877ae5fbdd22 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:08.567782 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a599e5-78d5-4012-9219-877ae5fbdd22 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:08.568312 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a599e5-78d5-4012-9219-877ae5fbdd22 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:08.569537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a599e5-78d5-4012-9219-877ae5fbdd22 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:08.569537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a599e5-78d5-4012-9219-877ae5fbdd22 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:08.573982 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a599e5-78d5-4012-9219-877ae5fbdd22 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:08.578206 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3349/6675] 10.222.0.30 () {58 vars in 1290 bytes} [Sun Sep 4 01:30:08 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:08.579220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a599e5-78d5-4012-9219-877ae5fbdd22 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:08.593689 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a599e5-78d5-4012-9219-877ae5fbdd22 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:08.602017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61645d4-a693-42ae-80c8-9737224620c4 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:08.602755 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61645d4-a693-42ae-80c8-9737224620c4 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:08.603043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61645d4-a693-42ae-80c8-9737224620c4 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:08.603321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61645d4-a693-42ae-80c8-9737224620c4 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:08.603923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61645d4-a693-42ae-80c8-9737224620c4 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:08.606426 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61645d4-a693-42ae-80c8-9737224620c4 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:08.611119 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3350/6676] 10.222.0.30 () {58 vars in 1257 bytes} [Sun Sep 4 01:30:08 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 04 01:30:08.615657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61645d4-a693-42ae-80c8-9737224620c4 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:08.630873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61645d4-a693-42ae-80c8-9737224620c4 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:08.642047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098029b1-3189-44e7-8480-361715d2cb85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:08.644030 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098029b1-3189-44e7-8480-361715d2cb85 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:08.645738 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ad656-e05f-45e0-af41-460da21523f3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:08.646557 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ad656-e05f-45e0-af41-460da21523f3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:08.647424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ad656-e05f-45e0-af41-460da21523f3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:08.648188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ad656-e05f-45e0-af41-460da21523f3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:08.648282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ad656-e05f-45e0-af41-460da21523f3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:08.651936 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ad656-e05f-45e0-af41-460da21523f3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:08.659469 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3351/6677] 10.222.0.30 () {58 vars in 1266 bytes} [Sun Sep 4 01:30:08 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:08.663291 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ad656-e05f-45e0-af41-460da21523f3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:08.695890 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ad656-e05f-45e0-af41-460da21523f3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:08.703220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beace16-c529-4a93-9f14-329c929c5ad3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:08.704621 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beace16-c529-4a93-9f14-329c929c5ad3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:08.704922 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beace16-c529-4a93-9f14-329c929c5ad3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:08.705039 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3327/6678] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:30:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:30:08.705204 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beace16-c529-4a93-9f14-329c929c5ad3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:08.705931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beace16-c529-4a93-9f14-329c929c5ad3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:08.708070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beace16-c529-4a93-9f14-329c929c5ad3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:08.710360 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3352/6679] 10.222.0.30 () {58 vars in 1308 bytes} [Sun Sep 4 01:30:08 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:08.714206 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098029b1-3189-44e7-8480-361715d2cb85 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:08.733954 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098029b1-3189-44e7-8480-361715d2cb85 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:08.744663 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518627c-6027-438a-ab12-484a64cbdfaa tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:08.746096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518627c-6027-438a-ab12-484a64cbdfaa tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:08.747032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518627c-6027-438a-ab12-484a64cbdfaa tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:08.747540 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518627c-6027-438a-ab12-484a64cbdfaa tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:08.750699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518627c-6027-438a-ab12-484a64cbdfaa tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:08.754320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518627c-6027-438a-ab12-484a64cbdfaa tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:08.761599 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beace16-c529-4a93-9f14-329c929c5ad3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:08.762413 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3328/6680] 10.222.0.30 () {58 vars in 1290 bytes} [Sun Sep 4 01:30:08 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:08.784555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beace16-c529-4a93-9f14-329c929c5ad3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:08.793964 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7cd07-2db2-43dd-8057-9057568acf4e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:08.795428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7cd07-2db2-43dd-8057-9057568acf4e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:08.795877 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7cd07-2db2-43dd-8057-9057568acf4e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:08.796333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7cd07-2db2-43dd-8057-9057568acf4e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:08.797100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d7cd07-2db2-43dd-8057-9057568acf4e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:08.798920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d7cd07-2db2-43dd-8057-9057568acf4e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:08.801318 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3353/6681] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:30:08 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:08.806488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518627c-6027-438a-ab12-484a64cbdfaa tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:08.822504 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518627c-6027-438a-ab12-484a64cbdfaa tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:08.850166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b926f5-8c2b-46b6-bba1-ab3b8ce03530 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:08.850850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b926f5-8c2b-46b6-bba1-ab3b8ce03530 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:08.854323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b926f5-8c2b-46b6-bba1-ab3b8ce03530 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:08.854667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b926f5-8c2b-46b6-bba1-ab3b8ce03530 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:08.855365 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b926f5-8c2b-46b6-bba1-ab3b8ce03530 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:08.858140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b926f5-8c2b-46b6-bba1-ab3b8ce03530 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:08.865156 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3329/6682] 10.222.0.30 () {58 vars in 1227 bytes} [Sun Sep 4 01:30:08 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 04 01:30:08.869095 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7cd07-2db2-43dd-8057-9057568acf4e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:08.887545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7cd07-2db2-43dd-8057-9057568acf4e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:08.902954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad422e-2c1d-4084-91b1-829e479ad1c7 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:08.903689 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad422e-2c1d-4084-91b1-829e479ad1c7 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:08.903976 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad422e-2c1d-4084-91b1-829e479ad1c7 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:08.904257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad422e-2c1d-4084-91b1-829e479ad1c7 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:08.905233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad422e-2c1d-4084-91b1-829e479ad1c7 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:08.907214 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad422e-2c1d-4084-91b1-829e479ad1c7 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:08.912220 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3354/6683] 10.222.0.30 () {58 vars in 1242 bytes} [Sun Sep 4 01:30:08 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:08.913286 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b926f5-8c2b-46b6-bba1-ab3b8ce03530 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:08.935427 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b926f5-8c2b-46b6-bba1-ab3b8ce03530 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:08.946351 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597b63f1-5905-4ffe-a5cc-81639b2acce3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:08.946967 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b63f1-5905-4ffe-a5cc-81639b2acce3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:08.947261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b63f1-5905-4ffe-a5cc-81639b2acce3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:08.947542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b63f1-5905-4ffe-a5cc-81639b2acce3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:08.948146 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597b63f1-5905-4ffe-a5cc-81639b2acce3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:08.950682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597b63f1-5905-4ffe-a5cc-81639b2acce3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:08.956748 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad422e-2c1d-4084-91b1-829e479ad1c7 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:08.957843 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3330/6684] 10.222.0.30 () {58 vars in 1245 bytes} [Sun Sep 4 01:30:08 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:08.976338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad422e-2c1d-4084-91b1-829e479ad1c7 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:08.990821 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca0fdd-acd7-4f2f-80d9-0fcbfcd5af27 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:08.992815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca0fdd-acd7-4f2f-80d9-0fcbfcd5af27 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:08.993109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca0fdd-acd7-4f2f-80d9-0fcbfcd5af27 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:08.993390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca0fdd-acd7-4f2f-80d9-0fcbfcd5af27 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:08.994485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca0fdd-acd7-4f2f-80d9-0fcbfcd5af27 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:09.000979 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca0fdd-acd7-4f2f-80d9-0fcbfcd5af27 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:09.004623 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3355/6685] 10.222.0.30 () {58 vars in 1251 bytes} [Sun Sep 4 01:30:08 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:09.023020 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597b63f1-5905-4ffe-a5cc-81639b2acce3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:09.036478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597b63f1-5905-4ffe-a5cc-81639b2acce3 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:09.058379 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479d8b1-399d-4a05-8b0b-53d14c086501 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:09.061470 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479d8b1-399d-4a05-8b0b-53d14c086501 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:09.061988 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479d8b1-399d-4a05-8b0b-53d14c086501 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:09.062426 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479d8b1-399d-4a05-8b0b-53d14c086501 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:09.063540 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479d8b1-399d-4a05-8b0b-53d14c086501 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:09.082727 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479d8b1-399d-4a05-8b0b-53d14c086501 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:09.088107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca0fdd-acd7-4f2f-80d9-0fcbfcd5af27 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:09.092000 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3331/6686] 10.222.0.30 () {58 vars in 1254 bytes} [Sun Sep 4 01:30:09 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:09.148646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca0fdd-acd7-4f2f-80d9-0fcbfcd5af27 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:09.155496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37177f-f1bf-4234-8f84-15bb54b5c8e9 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:09.157195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37177f-f1bf-4234-8f84-15bb54b5c8e9 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:09.157195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37177f-f1bf-4234-8f84-15bb54b5c8e9 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:09.157195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37177f-f1bf-4234-8f84-15bb54b5c8e9 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:09.158312 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37177f-f1bf-4234-8f84-15bb54b5c8e9 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:09.160365 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37177f-f1bf-4234-8f84-15bb54b5c8e9 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:09.161792 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479d8b1-399d-4a05-8b0b-53d14c086501 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:09.162272 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3356/6687] 10.222.0.30 () {58 vars in 1257 bytes} [Sun Sep 4 01:30:09 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:09.166389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37177f-f1bf-4234-8f84-15bb54b5c8e9 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:09.167487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e479d8b1-399d-4a05-8b0b-53d14c086501 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:09.186794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37177f-f1bf-4234-8f84-15bb54b5c8e9 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:09.195724 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479d8b1-399d-4a05-8b0b-53d14c086501 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:09.199080 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cbd9f-de7a-4eb6-a858-951b5dc906b1 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:09.200150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cbd9f-de7a-4eb6-a858-951b5dc906b1 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:09.200532 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cbd9f-de7a-4eb6-a858-951b5dc906b1 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:09.200731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cbd9f-de7a-4eb6-a858-951b5dc906b1 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:09.202864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070cbd9f-de7a-4eb6-a858-951b5dc906b1 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:09.206480 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070cbd9f-de7a-4eb6-a858-951b5dc906b1 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:09.207778 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c6164-26b9-41e7-8dae-700a2a7686b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:09.208644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c6164-26b9-41e7-8dae-700a2a7686b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:09.208949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c6164-26b9-41e7-8dae-700a2a7686b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:09.209198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c6164-26b9-41e7-8dae-700a2a7686b2 admin admin] PATH_INFO: `/v3/projects/f3b6f6d57b5647eebd2b2f5173eb8a65` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:09.213813 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3357/6688] 10.222.0.30 () {58 vars in 1251 bytes} [Sun Sep 4 01:30:09 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:09.213970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c6164-26b9-41e7-8dae-700a2a7686b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3b6f6d57b5647eebd2b2f5173eb8a65)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:09.215422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cbd9f-de7a-4eb6-a858-951b5dc906b1 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:09.216229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c6164-26b9-41e7-8dae-700a2a7686b2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:09.236233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cbd9f-de7a-4eb6-a858-951b5dc906b1 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:09.248096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f6a21-5854-41be-b018-f10a0f8be43c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:09.249709 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f6a21-5854-41be-b018-f10a0f8be43c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:09.249995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f6a21-5854-41be-b018-f10a0f8be43c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:09.250272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f6a21-5854-41be-b018-f10a0f8be43c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:09.250873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f6a21-5854-41be-b018-f10a0f8be43c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:09.255382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f6a21-5854-41be-b018-f10a0f8be43c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:09.258427 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3358/6689] 10.222.0.30 () {58 vars in 1257 bytes} [Sun Sep 4 01:30:09 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:09.263785 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f6a21-5854-41be-b018-f10a0f8be43c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:09.286305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f6a21-5854-41be-b018-f10a0f8be43c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:09.306268 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-234c6164-26b9-41e7-8dae-700a2a7686b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3b6f6d57b5647eebd2b2f5173eb8a65', 'request_id': 'req-234c6164-26b9-41e7-8dae-700a2a7686b2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:09.331211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-234c6164-26b9-41e7-8dae-700a2a7686b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3b6f6d57b5647eebd2b2f5173eb8a65', 'request_id': 'req-234c6164-26b9-41e7-8dae-700a2a7686b2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:09.337413 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-234c6164-26b9-41e7-8dae-700a2a7686b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3b6f6d57b5647eebd2b2f5173eb8a65', 'request_id': 'req-234c6164-26b9-41e7-8dae-700a2a7686b2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:09.351004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-234c6164-26b9-41e7-8dae-700a2a7686b2 admin admin] The token cache is being invalidate because project f3b6f6d57b5647eebd2b2f5173eb8a65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:30:09.351364 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-234c6164-26b9-41e7-8dae-700a2a7686b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:09.352215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-234c6164-26b9-41e7-8dae-700a2a7686b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:09.354064 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3332/6690] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:30:09 2022] DELETE /identity/v3/projects/f3b6f6d57b5647eebd2b2f5173eb8a65 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:09.358041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c6164-26b9-41e7-8dae-700a2a7686b2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:09.359523 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-234c6164-26b9-41e7-8dae-700a2a7686b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:09.363944 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:09.412532 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1710e-e082-432d-b729-ad3507e7cba0 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:09.413864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1710e-e082-432d-b729-ad3507e7cba0 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:09.414322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1710e-e082-432d-b729-ad3507e7cba0 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:09.414750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1710e-e082-432d-b729-ad3507e7cba0 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:09.415686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c1710e-e082-432d-b729-ad3507e7cba0 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:09.417941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c1710e-e082-432d-b729-ad3507e7cba0 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:09.419773 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3359/6691] 10.222.0.30 () {58 vars in 1293 bytes} [Sun Sep 4 01:30:09 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:09.423316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1710e-e082-432d-b729-ad3507e7cba0 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:09.428684 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-20c1710e-e082-432d-b729-ad3507e7cba0 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:09.438030 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:09.447174 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1710e-e082-432d-b729-ad3507e7cba0 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:09.454678 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cdede-1d19-4ecb-b212-767ec2f0a714 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:09.455983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cdede-1d19-4ecb-b212-767ec2f0a714 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:09.457089 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cdede-1d19-4ecb-b212-767ec2f0a714 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:09.457601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cdede-1d19-4ecb-b212-767ec2f0a714 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:09.458717 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cdede-1d19-4ecb-b212-767ec2f0a714 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:09.460728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cdede-1d19-4ecb-b212-767ec2f0a714 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:09.464101 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3360/6692] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:30:09 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 04 01:30:09.468056 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cdede-1d19-4ecb-b212-767ec2f0a714 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:09.475201 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c6164-26b9-41e7-8dae-700a2a7686b2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:09.482137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007a4ab-a88d-42c5-beb6-5dde242a2dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:09.482976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007a4ab-a88d-42c5-beb6-5dde242a2dd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:09.483267 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007a4ab-a88d-42c5-beb6-5dde242a2dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:09.483501 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007a4ab-a88d-42c5-beb6-5dde242a2dd1 admin admin] PATH_INFO: `/v3/users/6da97a32e5f74f49a315bd32b1fc99c4` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:09.493232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cdede-1d19-4ecb-b212-767ec2f0a714 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:09.495920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c007a4ab-a88d-42c5-beb6-5dde242a2dd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6da97a32e5f74f49a315bd32b1fc99c4)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:09.499779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c007a4ab-a88d-42c5-beb6-5dde242a2dd1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:09.510872 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493771f-c301-4164-80f8-aabdd70194ba tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:09.514044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493771f-c301-4164-80f8-aabdd70194ba tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:09.514612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493771f-c301-4164-80f8-aabdd70194ba tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:09.515261 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493771f-c301-4164-80f8-aabdd70194ba tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:09.516401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493771f-c301-4164-80f8-aabdd70194ba tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:09.518798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493771f-c301-4164-80f8-aabdd70194ba tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:09.520328 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3361/6693] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:30:09 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 04 01:30:09.528751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493771f-c301-4164-80f8-aabdd70194ba tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:09.555017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493771f-c301-4164-80f8-aabdd70194ba tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:09.572451 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcb1f8-7494-4762-85f8-ca94a876eaf7 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:09.573487 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcb1f8-7494-4762-85f8-ca94a876eaf7 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:09.575401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcb1f8-7494-4762-85f8-ca94a876eaf7 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:09.577694 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcb1f8-7494-4762-85f8-ca94a876eaf7 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:09.579336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfcb1f8-7494-4762-85f8-ca94a876eaf7 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:09.584119 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfcb1f8-7494-4762-85f8-ca94a876eaf7 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:09.589479 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3362/6694] 10.222.0.30 () {58 vars in 1212 bytes} [Sun Sep 4 01:30:09 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:09.592412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcb1f8-7494-4762-85f8-ca94a876eaf7 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:09.597695 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c007a4ab-a88d-42c5-beb6-5dde242a2dd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6da97a32e5f74f49a315bd32b1fc99c4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:09.598427 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c007a4ab-a88d-42c5-beb6-5dde242a2dd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6da97a32e5f74f49a315bd32b1fc99c4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:09.612990 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c007a4ab-a88d-42c5-beb6-5dde242a2dd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6da97a32e5f74f49a315bd32b1fc99c4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:09.621191 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcb1f8-7494-4762-85f8-ca94a876eaf7 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:09.673346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c007a4ab-a88d-42c5-beb6-5dde242a2dd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6da97a32e5f74f49a315bd32b1fc99c4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:09.681928 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c007a4ab-a88d-42c5-beb6-5dde242a2dd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6da97a32e5f74f49a315bd32b1fc99c4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:09.739707 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3333/6695] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:09 2022] DELETE /identity/v3/users/6da97a32e5f74f49a315bd32b1fc99c4 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:09.784743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1611ee-b4ee-4954-8a16-523e91660f21 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:09.785454 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1611ee-b4ee-4954-8a16-523e91660f21 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:09.792922 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1611ee-b4ee-4954-8a16-523e91660f21 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:09.792922 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1611ee-b4ee-4954-8a16-523e91660f21 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:09.792922 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1611ee-b4ee-4954-8a16-523e91660f21 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:09.794050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1611ee-b4ee-4954-8a16-523e91660f21 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:09.799593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007a4ab-a88d-42c5-beb6-5dde242a2dd1 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:09.801819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c007a4ab-a88d-42c5-beb6-5dde242a2dd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:09.818266 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3363/6696] 10.222.0.30 () {58 vars in 1227 bytes} [Sun Sep 4 01:30:09 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:09.933776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007a4ab-a88d-42c5-beb6-5dde242a2dd1 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:09.939434 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac4e1e-23d7-4509-86ce-10d4b0705f12 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:09.940411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac4e1e-23d7-4509-86ce-10d4b0705f12 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:09.940756 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac4e1e-23d7-4509-86ce-10d4b0705f12 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:09.941094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac4e1e-23d7-4509-86ce-10d4b0705f12 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:09.941797 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac4e1e-23d7-4509-86ce-10d4b0705f12 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:09.943440 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac4e1e-23d7-4509-86ce-10d4b0705f12 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:09.945485 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3334/6697] 10.222.0.30 () {58 vars in 1215 bytes} [Sun Sep 4 01:30:09 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:09.948778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1611ee-b4ee-4954-8a16-523e91660f21 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:09.967521 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1611ee-b4ee-4954-8a16-523e91660f21 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:09.988195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74b1a5-28ef-4996-a8d5-d1e17c2989a2 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:09.992925 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74b1a5-28ef-4996-a8d5-d1e17c2989a2 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:09.993319 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74b1a5-28ef-4996-a8d5-d1e17c2989a2 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:09.993641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74b1a5-28ef-4996-a8d5-d1e17c2989a2 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:09.994865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74b1a5-28ef-4996-a8d5-d1e17c2989a2 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:09.999712 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74b1a5-28ef-4996-a8d5-d1e17c2989a2 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:10.003545 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3364/6698] 10.222.0.30 () {58 vars in 1218 bytes} [Sun Sep 4 01:30:09 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:10.008385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac4e1e-23d7-4509-86ce-10d4b0705f12 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:10.022970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac4e1e-23d7-4509-86ce-10d4b0705f12 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:10.037129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c2b1e-96b9-40fd-b6da-bb9353df6b22 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:10.037833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c2b1e-96b9-40fd-b6da-bb9353df6b22 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:10.038095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c2b1e-96b9-40fd-b6da-bb9353df6b22 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:10.038374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c2b1e-96b9-40fd-b6da-bb9353df6b22 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:10.038981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c2b1e-96b9-40fd-b6da-bb9353df6b22 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:10.042744 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c2b1e-96b9-40fd-b6da-bb9353df6b22 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:10.048056 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74b1a5-28ef-4996-a8d5-d1e17c2989a2 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:10.048490 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3335/6699] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:30:10 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:10.065733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74b1a5-28ef-4996-a8d5-d1e17c2989a2 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:10.105954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b7ef7-f686-4080-8cd5-62b21e110f4c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:10.108891 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b7ef7-f686-4080-8cd5-62b21e110f4c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:10.109860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b7ef7-f686-4080-8cd5-62b21e110f4c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:10.111175 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b7ef7-f686-4080-8cd5-62b21e110f4c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:10.112297 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b7ef7-f686-4080-8cd5-62b21e110f4c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:10.132027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b7ef7-f686-4080-8cd5-62b21e110f4c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:10.134631 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3365/6700] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Sep 4 01:30:10 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:10.138628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c2b1e-96b9-40fd-b6da-bb9353df6b22 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:10.157887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c2b1e-96b9-40fd-b6da-bb9353df6b22 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:10.178635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16ec0d-4695-4902-a979-fdfbd4ee11f0 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:10.179806 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16ec0d-4695-4902-a979-fdfbd4ee11f0 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:10.180358 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16ec0d-4695-4902-a979-fdfbd4ee11f0 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:10.181348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16ec0d-4695-4902-a979-fdfbd4ee11f0 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:10.182306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16ec0d-4695-4902-a979-fdfbd4ee11f0 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:10.184329 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16ec0d-4695-4902-a979-fdfbd4ee11f0 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:10.189549 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3336/6701] 10.222.0.30 () {58 vars in 1260 bytes} [Sun Sep 4 01:30:10 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:10.193120 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b7ef7-f686-4080-8cd5-62b21e110f4c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:10.205765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b7ef7-f686-4080-8cd5-62b21e110f4c tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:10.217699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312bc896-6d78-4c67-b45a-8817cc475a30 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:10.218796 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312bc896-6d78-4c67-b45a-8817cc475a30 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:10.219300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312bc896-6d78-4c67-b45a-8817cc475a30 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:10.220122 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312bc896-6d78-4c67-b45a-8817cc475a30 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:10.220964 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312bc896-6d78-4c67-b45a-8817cc475a30 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:10.224094 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312bc896-6d78-4c67-b45a-8817cc475a30 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:10.227667 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3366/6702] 10.222.0.30 () {58 vars in 1263 bytes} [Sun Sep 4 01:30:10 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:10.231853 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16ec0d-4695-4902-a979-fdfbd4ee11f0 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:10.244161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16ec0d-4695-4902-a979-fdfbd4ee11f0 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:10.249539 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cbc05-0f7f-4ac0-90c8-3f9a25ccb22e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:10.250183 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cbc05-0f7f-4ac0-90c8-3f9a25ccb22e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:10.250465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cbc05-0f7f-4ac0-90c8-3f9a25ccb22e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:10.250742 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cbc05-0f7f-4ac0-90c8-3f9a25ccb22e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:10.251369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836cbc05-0f7f-4ac0-90c8-3f9a25ccb22e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:10.253642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836cbc05-0f7f-4ac0-90c8-3f9a25ccb22e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:10.258456 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3337/6703] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:30:10 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:10.258982 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312bc896-6d78-4c67-b45a-8817cc475a30 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:10.274412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312bc896-6d78-4c67-b45a-8817cc475a30 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:10.309158 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9c2fd-a360-496d-b23d-8cb2bff735fa tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:10.311094 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9c2fd-a360-496d-b23d-8cb2bff735fa tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:10.311439 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9c2fd-a360-496d-b23d-8cb2bff735fa tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:10.311815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9c2fd-a360-496d-b23d-8cb2bff735fa tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:10.312949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf9c2fd-a360-496d-b23d-8cb2bff735fa tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:10.319042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf9c2fd-a360-496d-b23d-8cb2bff735fa tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:10.323823 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3367/6704] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:30:10 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 04 01:30:10.325072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cbc05-0f7f-4ac0-90c8-3f9a25ccb22e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:10.341987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cbc05-0f7f-4ac0-90c8-3f9a25ccb22e tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:10.356725 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa41ca1-6887-458c-a62a-3f3bc86367cc tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:10.357621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa41ca1-6887-458c-a62a-3f3bc86367cc tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:10.357917 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa41ca1-6887-458c-a62a-3f3bc86367cc tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:10.358201 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa41ca1-6887-458c-a62a-3f3bc86367cc tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:10.359440 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa41ca1-6887-458c-a62a-3f3bc86367cc tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:10.365580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa41ca1-6887-458c-a62a-3f3bc86367cc tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:10.371313 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3338/6705] 10.222.0.30 () {58 vars in 1278 bytes} [Sun Sep 4 01:30:10 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 04 01:30:10.372460 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9c2fd-a360-496d-b23d-8cb2bff735fa tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:10.420131 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9c2fd-a360-496d-b23d-8cb2bff735fa tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:10.435595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8c2e4-1667-48c6-943e-ad8c18e06395 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:10.437189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8c2e4-1667-48c6-943e-ad8c18e06395 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:10.439616 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8c2e4-1667-48c6-943e-ad8c18e06395 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:10.441572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8c2e4-1667-48c6-943e-ad8c18e06395 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/61c2dee96cca4904a97e8d38c2236e6e` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:10.462910 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8c2e4-1667-48c6-943e-ad8c18e06395 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 01:30:10.486159 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-87f8c2e4-1667-48c6-943e-ad8c18e06395 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Could not find domain: 61c2dee96cca4904a97e8d38c2236e6e.: keystone.exception.DomainNotFound: Could not find domain: 61c2dee96cca4904a97e8d38c2236e6e. Sep 04 01:30:10.486159 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:30:10.486159 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 04 01:30:10.486159 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 04 01:30:10.486159 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 01:30:10.486159 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 01:30:10.486159 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 01:30:10.486159 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 01:30:10.486159 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 61c2dee96cca4904a97e8d38c2236e6e. Sep 04 01:30:10.486159 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:30:10.486159 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:30:10.486159 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:30:10.486159 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:30:10.486159 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:30:10.486159 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:30:10.488128 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:30:10.488128 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:30:10.488128 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:30:10.488128 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:30:10.488128 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:30:10.488128 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:30:10.488128 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:30:10.488128 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:30:10.488128 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 04 01:30:10.488128 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 04 01:30:10.488128 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 01:30:10.488128 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 01:30:10.488128 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 01:30:10.488128 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 01:30:10.488128 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:30:10.488128 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:30:10.489101 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 01:30:10.489101 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 01:30:10.489101 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 01:30:10.489101 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 01:30:10.489101 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 01:30:10.489101 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 01:30:10.489101 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 01:30:10.489101 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 01:30:10.489101 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 01:30:10.489101 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 01:30:10.489101 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 01:30:10.489101 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 01:30:10.489101 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 01:30:10.489101 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 01:30:10.489101 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 04 01:30:10.489101 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 01:30:10.489101 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 61c2dee96cca4904a97e8d38c2236e6e. Sep 04 01:30:10.490149 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:30:10.498456 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa41ca1-6887-458c-a62a-3f3bc86367cc tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:10.499082 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3368/6706] 10.222.0.30 () {60 vars in 1249 bytes} [Sun Sep 4 01:30:10 2022] PATCH /identity/v3/domains/61c2dee96cca4904a97e8d38c2236e6e => generated 112 bytes in 126 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:30:10.513226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa41ca1-6887-458c-a62a-3f3bc86367cc tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:10.526128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53272d46-133e-4728-b705-a434878a0b2b tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:10.527158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53272d46-133e-4728-b705-a434878a0b2b tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:10.527453 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53272d46-133e-4728-b705-a434878a0b2b tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:10.527770 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53272d46-133e-4728-b705-a434878a0b2b tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/ce0af2ac7c884ce3907500206fb01686` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:10.546528 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53272d46-133e-4728-b705-a434878a0b2b tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 01:30:10.558478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-53272d46-133e-4728-b705-a434878a0b2b tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Could not find domain: ce0af2ac7c884ce3907500206fb01686.: keystone.exception.DomainNotFound: Could not find domain: ce0af2ac7c884ce3907500206fb01686. Sep 04 01:30:10.558478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:30:10.558478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 04 01:30:10.558478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 04 01:30:10.558478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 01:30:10.558478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 01:30:10.558478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 01:30:10.558478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 01:30:10.558478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: ce0af2ac7c884ce3907500206fb01686. Sep 04 01:30:10.558478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:30:10.558478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:30:10.558478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:30:10.558478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:30:10.558478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:30:10.558478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:30:10.562959 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:30:10.562959 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:30:10.562959 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:30:10.562959 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:30:10.562959 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:30:10.562959 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:30:10.562959 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:30:10.562959 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:30:10.562959 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 04 01:30:10.562959 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 04 01:30:10.562959 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 01:30:10.562959 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 01:30:10.562959 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 01:30:10.562959 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 01:30:10.562959 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:30:10.562959 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:30:10.564100 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 01:30:10.564100 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 01:30:10.564100 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 01:30:10.564100 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 01:30:10.564100 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 01:30:10.564100 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 01:30:10.564100 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 01:30:10.564100 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 01:30:10.564100 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 01:30:10.564100 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 01:30:10.564100 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 01:30:10.564100 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 01:30:10.564100 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 01:30:10.564100 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 01:30:10.564100 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 04 01:30:10.564100 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 01:30:10.564100 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: ce0af2ac7c884ce3907500206fb01686. Sep 04 01:30:10.565980 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:30:10.567810 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8c2e4-1667-48c6-943e-ad8c18e06395 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:10.571660 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3339/6707] 10.222.0.30 () {60 vars in 1249 bytes} [Sun Sep 4 01:30:10 2022] PATCH /identity/v3/domains/ce0af2ac7c884ce3907500206fb01686 => generated 112 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Sep 04 01:30:10.646985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8c2e4-1667-48c6-943e-ad8c18e06395 tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:10.654908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacc086-656b-4ee7-b986-b7aa131c49cb tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1334bdbad9574c8ea33f6f4f73594351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ee527887264cbca4fbeca6a3b05200', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:10.655985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacc086-656b-4ee7-b986-b7aa131c49cb tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:10.656463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacc086-656b-4ee7-b986-b7aa131c49cb tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:10.656929 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacc086-656b-4ee7-b986-b7aa131c49cb tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] PATH_INFO: `/v3/domains/2d286f4c5e11455fa5f398ad0d168afd` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:10.666823 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfacc086-656b-4ee7-b986-b7aa131c49cb tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 01:30:10.667120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53272d46-133e-4728-b705-a434878a0b2b tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:10.671917 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-53272d46-133e-4728-b705-a434878a0b2b tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:10.676111 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-bfacc086-656b-4ee7-b986-b7aa131c49cb tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Could not find domain: 2d286f4c5e11455fa5f398ad0d168afd.: keystone.exception.DomainNotFound: Could not find domain: 2d286f4c5e11455fa5f398ad0d168afd. Sep 04 01:30:10.676111 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:30:10.676111 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 04 01:30:10.676111 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 04 01:30:10.676111 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 01:30:10.676111 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 01:30:10.676111 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 01:30:10.676111 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 01:30:10.676111 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 2d286f4c5e11455fa5f398ad0d168afd. Sep 04 01:30:10.676111 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:30:10.676111 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:30:10.676111 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:30:10.676111 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:30:10.676111 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:30:10.676111 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:30:10.677063 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:30:10.677063 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:30:10.677063 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:30:10.677063 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:30:10.677063 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:30:10.677063 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:30:10.677063 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:30:10.677063 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:30:10.677063 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 04 01:30:10.677063 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 04 01:30:10.677063 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 01:30:10.677063 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 01:30:10.677063 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 01:30:10.677063 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 01:30:10.677063 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:30:10.677063 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:30:10.678048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 01:30:10.678048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 01:30:10.678048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 01:30:10.678048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 01:30:10.678048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 01:30:10.678048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 01:30:10.678048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 01:30:10.678048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 01:30:10.678048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 01:30:10.678048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 01:30:10.678048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 01:30:10.678048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 01:30:10.678048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 01:30:10.678048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 01:30:10.678048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 04 01:30:10.678048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 01:30:10.678048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 2d286f4c5e11455fa5f398ad0d168afd. Sep 04 01:30:10.679064 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:30:10.689658 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3369/6708] 10.222.0.30 () {60 vars in 1249 bytes} [Sun Sep 4 01:30:10 2022] PATCH /identity/v3/domains/2d286f4c5e11455fa5f398ad0d168afd => generated 112 bytes in 122 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:30:10.691794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacc086-656b-4ee7-b986-b7aa131c49cb tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:10.695990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-bfacc086-656b-4ee7-b986-b7aa131c49cb tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:10.757016 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:10.795048 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53272d46-133e-4728-b705-a434878a0b2b tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:10.801888 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40f4ab-15be-4b6a-942b-55c93b9f167b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:10.803120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40f4ab-15be-4b6a-942b-55c93b9f167b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:10.803351 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40f4ab-15be-4b6a-942b-55c93b9f167b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:10.803938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40f4ab-15be-4b6a-942b-55c93b9f167b admin admin] PATH_INFO: `/v3/projects/896fbfa1c11240f9a4d783a68b362232` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:10.805773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40f4ab-15be-4b6a-942b-55c93b9f167b admin admin] RBAC: Authorizing `identity:delete_project(project_id=896fbfa1c11240f9a4d783a68b362232)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:10.810059 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40f4ab-15be-4b6a-942b-55c93b9f167b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:10.871990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacc086-656b-4ee7-b986-b7aa131c49cb tempest-DomainConfigurationTestJSON-1399306387 tempest-DomainConfigurationTestJSON-1399306387-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:10.888990 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3f40f4ab-15be-4b6a-942b-55c93b9f167b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '896fbfa1c11240f9a4d783a68b362232', 'request_id': 'req-3f40f4ab-15be-4b6a-942b-55c93b9f167b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:10.905042 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3f40f4ab-15be-4b6a-942b-55c93b9f167b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '896fbfa1c11240f9a4d783a68b362232', 'request_id': 'req-3f40f4ab-15be-4b6a-942b-55c93b9f167b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:10.921661 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3f40f4ab-15be-4b6a-942b-55c93b9f167b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '896fbfa1c11240f9a4d783a68b362232', 'request_id': 'req-3f40f4ab-15be-4b6a-942b-55c93b9f167b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:10.942173 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3f40f4ab-15be-4b6a-942b-55c93b9f167b admin admin] The token cache is being invalidate because project 896fbfa1c11240f9a4d783a68b362232 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:30:10.944219 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3f40f4ab-15be-4b6a-942b-55c93b9f167b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:10.946385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3f40f4ab-15be-4b6a-942b-55c93b9f167b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:10.948320 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3340/6709] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:30:10 2022] DELETE /identity/v3/projects/896fbfa1c11240f9a4d783a68b362232 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:30:10.955755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092913ce-b96e-4252-be6e-1f3930b38847 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:10.956988 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092913ce-b96e-4252-be6e-1f3930b38847 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:10.957284 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092913ce-b96e-4252-be6e-1f3930b38847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:10.995202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-092913ce-b96e-4252-be6e-1f3930b38847 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:10.996767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-092913ce-b96e-4252-be6e-1f3930b38847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:11.019360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227a971-964b-4041-9b46-b557b64f14ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:11.020318 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227a971-964b-4041-9b46-b557b64f14ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:11.020702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227a971-964b-4041-9b46-b557b64f14ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:11.020972 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227a971-964b-4041-9b46-b557b64f14ba admin admin] PATH_INFO: `/v3/users/068674c62caa435b9338d3579fc69c0c` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:11.023725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3227a971-964b-4041-9b46-b557b64f14ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=068674c62caa435b9338d3579fc69c0c)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:11.032408 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3227a971-964b-4041-9b46-b557b64f14ba admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:11.152252 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:11.185290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3227a971-964b-4041-9b46-b557b64f14ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '068674c62caa435b9338d3579fc69c0c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:11.187621 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3227a971-964b-4041-9b46-b557b64f14ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '068674c62caa435b9338d3579fc69c0c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:11.203807 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3341/6710] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:11.211397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71d879-c36a-4e46-a585-d6ae3244b391 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:11.211907 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71d879-c36a-4e46-a585-d6ae3244b391 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:11.212341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71d879-c36a-4e46-a585-d6ae3244b391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:11.271330 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3227a971-964b-4041-9b46-b557b64f14ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '068674c62caa435b9338d3579fc69c0c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:11.309602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3227a971-964b-4041-9b46-b557b64f14ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '068674c62caa435b9338d3579fc69c0c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:11.311160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3227a971-964b-4041-9b46-b557b64f14ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '068674c62caa435b9338d3579fc69c0c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:11.313570 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5d71d879-c36a-4e46-a585-d6ae3244b391 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:11.321180 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5d71d879-c36a-4e46-a585-d6ae3244b391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:11.362497 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3342/6711] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:11.365266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d71d879-c36a-4e46-a585-d6ae3244b391 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:11.379915 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3370/6712] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:10 2022] DELETE /identity/v3/users/068674c62caa435b9338d3579fc69c0c => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:11.386537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8da89-aa04-4188-98d4-7228bf7c9536 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:11.387135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8da89-aa04-4188-98d4-7228bf7c9536 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:11.389228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8da89-aa04-4188-98d4-7228bf7c9536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:11.398754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d71d879-c36a-4e46-a585-d6ae3244b391 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:11.489398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-3ca8da89-aa04-4188-98d4-7228bf7c9536 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:11.491323 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3ca8da89-aa04-4188-98d4-7228bf7c9536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:11.630249 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51733ff-389e-405b-b0bb-605d41418663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:11.630894 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51733ff-389e-405b-b0bb-605d41418663 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:11.631180 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51733ff-389e-405b-b0bb-605d41418663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:11.631455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51733ff-389e-405b-b0bb-605d41418663 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:11.633603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51733ff-389e-405b-b0bb-605d41418663 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:30:11.638487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51733ff-389e-405b-b0bb-605d41418663 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:11.642806 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51733ff-389e-405b-b0bb-605d41418663 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:11.651586 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:11.698590 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3343/6713] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:11.701969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51733ff-389e-405b-b0bb-605d41418663 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:11.727860 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3371/6714] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:11.729652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8da89-aa04-4188-98d4-7228bf7c9536 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:11.755340 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3ca8da89-aa04-4188-98d4-7228bf7c9536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:11.772716 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51733ff-389e-405b-b0bb-605d41418663 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:11.811725 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55963bce-af7a-443b-b47f-660359cc7927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:11.812472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55963bce-af7a-443b-b47f-660359cc7927 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:11.813467 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55963bce-af7a-443b-b47f-660359cc7927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:11.813771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55963bce-af7a-443b-b47f-660359cc7927 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:11.816987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55963bce-af7a-443b-b47f-660359cc7927 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:11.821902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55963bce-af7a-443b-b47f-660359cc7927 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:11.909118 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3344/6715] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:30:11 2022] POST /identity/v3/projects => generated 367 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:11.910081 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55963bce-af7a-443b-b47f-660359cc7927 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:11.969908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8da89-aa04-4188-98d4-7228bf7c9536 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:12.132110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55963bce-af7a-443b-b47f-660359cc7927 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:12.187140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cae4a6-8412-4766-96e8-e58d0102cb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:12.196403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cae4a6-8412-4766-96e8-e58d0102cb07 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:12.196801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cae4a6-8412-4766-96e8-e58d0102cb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:12.197087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cae4a6-8412-4766-96e8-e58d0102cb07 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:12.198494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cae4a6-8412-4766-96e8-e58d0102cb07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:12.207877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cae4a6-8412-4766-96e8-e58d0102cb07 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:12.212184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8dea15-11bf-4d38-be83-3422e18abba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:12.214972 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8dea15-11bf-4d38-be83-3422e18abba5 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:12.216509 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8dea15-11bf-4d38-be83-3422e18abba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:12.216821 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8dea15-11bf-4d38-be83-3422e18abba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:12.328782 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8dea15-11bf-4d38-be83-3422e18abba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:12.330485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8dea15-11bf-4d38-be83-3422e18abba5 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:12.351405 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3345/6716] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:30:11 2022] POST /identity/v3/users => generated 284 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:12.355623 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cae4a6-8412-4766-96e8-e58d0102cb07 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:12.376545 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3372/6717] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:30:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:30:12.399863 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cae4a6-8412-4766-96e8-e58d0102cb07 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:12.405420 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff67cb-b818-4ed3-94aa-ee86a500cbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:12.405563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff67cb-b818-4ed3-94aa-ee86a500cbe8 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:12.405834 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff67cb-b818-4ed3-94aa-ee86a500cbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:12.406105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff67cb-b818-4ed3-94aa-ee86a500cbe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:12.409542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff67cb-b818-4ed3-94aa-ee86a500cbe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:12.411146 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff67cb-b818-4ed3-94aa-ee86a500cbe8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:12.443848 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3346/6718] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:12.444427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8dea15-11bf-4d38-be83-3422e18abba5 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:12.464231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8dea15-11bf-4d38-be83-3422e18abba5 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:12.487942 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a543c9c-40a8-4084-b2e8-a961ba16556f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:12.488707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a543c9c-40a8-4084-b2e8-a961ba16556f admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:12.489005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a543c9c-40a8-4084-b2e8-a961ba16556f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:12.489284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a543c9c-40a8-4084-b2e8-a961ba16556f admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:12.489965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a543c9c-40a8-4084-b2e8-a961ba16556f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:12.491588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a543c9c-40a8-4084-b2e8-a961ba16556f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:12.519541 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3373/6719] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:12.520424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff67cb-b818-4ed3-94aa-ee86a500cbe8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:12.541318 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff67cb-b818-4ed3-94aa-ee86a500cbe8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:12.593511 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b752bd6-9e95-4d95-aaea-61fcf135095b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:12.593511 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b752bd6-9e95-4d95-aaea-61fcf135095b admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:12.593511 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b752bd6-9e95-4d95-aaea-61fcf135095b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:12.593511 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b752bd6-9e95-4d95-aaea-61fcf135095b admin admin] PATH_INFO: `/v3/projects/d07274c87c09468fa3ec11d8a46ad2e0/users/495ec428bc394d29ab93ab339a2bfc79/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:12.626071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b752bd6-9e95-4d95-aaea-61fcf135095b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d07274c87c09468fa3ec11d8a46ad2e0, user_id=495ec428bc394d29ab93ab339a2bfc79, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:12.631117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b752bd6-9e95-4d95-aaea-61fcf135095b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:12.680671 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3347/6720] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:30:12 2022] PUT /identity/v3/projects/d07274c87c09468fa3ec11d8a46ad2e0/users/495ec428bc394d29ab93ab339a2bfc79/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:12.695951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a3437-3e80-484c-a63d-613f320c393f None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:12.695951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a3437-3e80-484c-a63d-613f320c393f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:12.696175 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a3437-3e80-484c-a63d-613f320c393f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:12.714304 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:12.802316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-1b4a3437-3e80-484c-a63d-613f320c393f None None] MFA Rules not processed for user `495ec428bc394d29ab93ab339a2bfc79`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:12.802316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1b4a3437-3e80-484c-a63d-613f320c393f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:12.843446 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b752bd6-9e95-4d95-aaea-61fcf135095b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:12.845631 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4b752bd6-9e95-4d95-aaea-61fcf135095b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:12.990395 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3374/6721] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:12.994660 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a3437-3e80-484c-a63d-613f320c393f None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:13.030802 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b752bd6-9e95-4d95-aaea-61fcf135095b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:13.040429 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f5551-91a2-48a6-8f80-ec5f0ead1679 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:13.041400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f5551-91a2-48a6-8f80-ec5f0ead1679 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:13.042506 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f5551-91a2-48a6-8f80-ec5f0ead1679 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:13.042954 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f5551-91a2-48a6-8f80-ec5f0ead1679 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:13.051008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b36f5551-91a2-48a6-8f80-ec5f0ead1679 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:13.070055 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f5551-91a2-48a6-8f80-ec5f0ead1679 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:13.072165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f5551-91a2-48a6-8f80-ec5f0ead1679 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:13.089757 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3348/6722] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:30:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:30:13.102804 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a3437-3e80-484c-a63d-613f320c393f None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:13.130224 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d0111-cca3-431d-a0b3-c9bbfcd59ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:13.131048 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d0111-cca3-431d-a0b3-c9bbfcd59ebd admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:13.131406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d0111-cca3-431d-a0b3-c9bbfcd59ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:13.131756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d0111-cca3-431d-a0b3-c9bbfcd59ebd admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:13.132552 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d0111-cca3-431d-a0b3-c9bbfcd59ebd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:13.134910 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d0111-cca3-431d-a0b3-c9bbfcd59ebd admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:13.203049 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3375/6723] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:30:12 2022] POST /identity/v3/projects => generated 367 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:30:13.208545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f5551-91a2-48a6-8f80-ec5f0ead1679 service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:13.263098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f5551-91a2-48a6-8f80-ec5f0ead1679 service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:13.277358 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:13.430913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693442e-1f32-4c4a-8cb1-0f5c2d0aaf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:13.431572 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693442e-1f32-4c4a-8cb1-0f5c2d0aaf1e admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:13.432085 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693442e-1f32-4c4a-8cb1-0f5c2d0aaf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:13.432488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693442e-1f32-4c4a-8cb1-0f5c2d0aaf1e admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:13.433229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693442e-1f32-4c4a-8cb1-0f5c2d0aaf1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:13.438050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693442e-1f32-4c4a-8cb1-0f5c2d0aaf1e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:13.466697 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d0111-cca3-431d-a0b3-c9bbfcd59ebd admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:13.468626 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d61d0111-cca3-431d-a0b3-c9bbfcd59ebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:13.516873 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3349/6724] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:30:13 2022] POST /identity/v3/users => generated 290 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:13.522311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693442e-1f32-4c4a-8cb1-0f5c2d0aaf1e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:13.539959 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693442e-1f32-4c4a-8cb1-0f5c2d0aaf1e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:13.557060 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e2ba2-e551-4d70-8026-f1506f9d3743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:13.557995 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e2ba2-e551-4d70-8026-f1506f9d3743 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:13.558626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e2ba2-e551-4d70-8026-f1506f9d3743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:13.559059 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e2ba2-e551-4d70-8026-f1506f9d3743 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:13.559866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e2ba2-e551-4d70-8026-f1506f9d3743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:13.564070 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e2ba2-e551-4d70-8026-f1506f9d3743 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:13.585615 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3350/6725] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:13.590181 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e2ba2-e551-4d70-8026-f1506f9d3743 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:13.611132 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e2ba2-e551-4d70-8026-f1506f9d3743 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:13.625150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d0111-cca3-431d-a0b3-c9bbfcd59ebd admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:13.627967 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31e78e-44b5-4cec-bdba-3690bbaeec39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:13.628662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31e78e-44b5-4cec-bdba-3690bbaeec39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:13.628944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31e78e-44b5-4cec-bdba-3690bbaeec39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:13.629218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31e78e-44b5-4cec-bdba-3690bbaeec39 admin admin] PATH_INFO: `/v3/projects/a1dd5932f7234a10bef4cb388cf1efe4/users/9a4c861028c740a8b5097eb5eb64d3a8/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:13.640864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f335a0-2c2b-4a66-88bd-e0c762025b57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:13.641410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f335a0-2c2b-4a66-88bd-e0c762025b57 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:13.641752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f335a0-2c2b-4a66-88bd-e0c762025b57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:13.642066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f335a0-2c2b-4a66-88bd-e0c762025b57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:13.651102 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-81f335a0-2c2b-4a66-88bd-e0c762025b57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:13.672198 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f335a0-2c2b-4a66-88bd-e0c762025b57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:13.687373 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f335a0-2c2b-4a66-88bd-e0c762025b57 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:13.691798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31e78e-44b5-4cec-bdba-3690bbaeec39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1dd5932f7234a10bef4cb388cf1efe4, user_id=9a4c861028c740a8b5097eb5eb64d3a8, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:13.700335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31e78e-44b5-4cec-bdba-3690bbaeec39 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:13.727065 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3376/6726] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:30:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:30:13.728187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f335a0-2c2b-4a66-88bd-e0c762025b57 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:13.733503 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-81f335a0-2c2b-4a66-88bd-e0c762025b57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:13.746919 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3351/6727] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:30:13 2022] PUT /identity/v3/projects/a1dd5932f7234a10bef4cb388cf1efe4/users/9a4c861028c740a8b5097eb5eb64d3a8/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:13.746919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31e78e-44b5-4cec-bdba-3690bbaeec39 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:13.772740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f335a0-2c2b-4a66-88bd-e0c762025b57 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:13.809987 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:13.879603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31e78e-44b5-4cec-bdba-3690bbaeec39 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:13.887756 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0fc96-d14d-46f5-9645-17627a320787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:13.888962 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0fc96-d14d-46f5-9645-17627a320787 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:13.889248 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0fc96-d14d-46f5-9645-17627a320787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:13.889680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0fc96-d14d-46f5-9645-17627a320787 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:13.890337 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0fc96-d14d-46f5-9645-17627a320787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:13.892731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0fc96-d14d-46f5-9645-17627a320787 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:13.902332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa361c50-1903-4c2e-985c-85242bd885a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:13.903181 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa361c50-1903-4c2e-985c-85242bd885a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:13.903621 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa361c50-1903-4c2e-985c-85242bd885a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:13.904037 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa361c50-1903-4c2e-985c-85242bd885a6 admin admin] PATH_INFO: `/v3/projects/20e607fd91e8442cab5a24b82c66910d` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:13.905569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa361c50-1903-4c2e-985c-85242bd885a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20e607fd91e8442cab5a24b82c66910d)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:13.910004 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3352/6728] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:13.911998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0fc96-d14d-46f5-9645-17627a320787 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:13.914595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa361c50-1903-4c2e-985c-85242bd885a6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:13.922125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-aba0fc96-d14d-46f5-9645-17627a320787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:13.954307 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0fc96-d14d-46f5-9645-17627a320787 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:13.968181 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783bffe2-2f4c-471f-85a7-505a0c9dde29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:13.968996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bffe2-2f4c-471f-85a7-505a0c9dde29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:13.969395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bffe2-2f4c-471f-85a7-505a0c9dde29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:13.969782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bffe2-2f4c-471f-85a7-505a0c9dde29 admin admin] PATH_INFO: `/v3/users/8644efc22cf0450aa0ac9b7441c667b1` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:13.972715 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783bffe2-2f4c-471f-85a7-505a0c9dde29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8644efc22cf0450aa0ac9b7441c667b1)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:13.974731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783bffe2-2f4c-471f-85a7-505a0c9dde29 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:14.015865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-aa361c50-1903-4c2e-985c-85242bd885a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20e607fd91e8442cab5a24b82c66910d', 'request_id': 'req-aa361c50-1903-4c2e-985c-85242bd885a6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:14.039065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-aa361c50-1903-4c2e-985c-85242bd885a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20e607fd91e8442cab5a24b82c66910d', 'request_id': 'req-aa361c50-1903-4c2e-985c-85242bd885a6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:14.056992 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-aa361c50-1903-4c2e-985c-85242bd885a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20e607fd91e8442cab5a24b82c66910d', 'request_id': 'req-aa361c50-1903-4c2e-985c-85242bd885a6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:14.094137 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-aa361c50-1903-4c2e-985c-85242bd885a6 admin admin] The token cache is being invalidate because project 20e607fd91e8442cab5a24b82c66910d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:30:14.094915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-aa361c50-1903-4c2e-985c-85242bd885a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:14.095763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-aa361c50-1903-4c2e-985c-85242bd885a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:14.097526 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3377/6729] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:30:13 2022] DELETE /identity/v3/projects/20e607fd91e8442cab5a24b82c66910d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:14.098531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa361c50-1903-4c2e-985c-85242bd885a6 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:14.102166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-783bffe2-2f4c-471f-85a7-505a0c9dde29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8644efc22cf0450aa0ac9b7441c667b1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:14.102974 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-aa361c50-1903-4c2e-985c-85242bd885a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:14.105836 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-783bffe2-2f4c-471f-85a7-505a0c9dde29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8644efc22cf0450aa0ac9b7441c667b1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:14.118299 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:14.123529 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-783bffe2-2f4c-471f-85a7-505a0c9dde29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8644efc22cf0450aa0ac9b7441c667b1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:14.144783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-783bffe2-2f4c-471f-85a7-505a0c9dde29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8644efc22cf0450aa0ac9b7441c667b1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:14.151290 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-783bffe2-2f4c-471f-85a7-505a0c9dde29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8644efc22cf0450aa0ac9b7441c667b1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:14.182398 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3353/6730] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:13 2022] DELETE /identity/v3/users/8644efc22cf0450aa0ac9b7441c667b1 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:14.183329 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783bffe2-2f4c-471f-85a7-505a0c9dde29 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:14.184772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-783bffe2-2f4c-471f-85a7-505a0c9dde29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:14.220853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa361c50-1903-4c2e-985c-85242bd885a6 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:14.331495 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:14.334467 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783bffe2-2f4c-471f-85a7-505a0c9dde29 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:14.345473 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025125f-ebf5-49c0-bdd9-129df7fb9833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:14.349260 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025125f-ebf5-49c0-bdd9-129df7fb9833 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:14.349719 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025125f-ebf5-49c0-bdd9-129df7fb9833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:14.350473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da36eb-f916-4c45-bb48-cc451900e93f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:14.351476 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da36eb-f916-4c45-bb48-cc451900e93f service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:14.351976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da36eb-f916-4c45-bb48-cc451900e93f service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:14.352446 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da36eb-f916-4c45-bb48-cc451900e93f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:14.354271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025125f-ebf5-49c0-bdd9-129df7fb9833 admin admin] PATH_INFO: `/v3/projects/a1dd5932f7234a10bef4cb388cf1efe4/users/9a4c861028c740a8b5097eb5eb64d3a8/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:14.357143 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-72da36eb-f916-4c45-bb48-cc451900e93f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:14.358801 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9025125f-ebf5-49c0-bdd9-129df7fb9833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1dd5932f7234a10bef4cb388cf1efe4, user_id=9a4c861028c740a8b5097eb5eb64d3a8, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:14.362869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9025125f-ebf5-49c0-bdd9-129df7fb9833 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:14.381578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da36eb-f916-4c45-bb48-cc451900e93f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:14.383281 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da36eb-f916-4c45-bb48-cc451900e93f service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:14.388353 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3378/6731] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:30:14 2022] PUT /identity/v3/projects/a1dd5932f7234a10bef4cb388cf1efe4/users/9a4c861028c740a8b5097eb5eb64d3a8/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:14.389398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025125f-ebf5-49c0-bdd9-129df7fb9833 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:14.393040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9025125f-ebf5-49c0-bdd9-129df7fb9833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:14.415747 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3354/6732] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:30:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:30:14.417214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff65d4-8888-435d-af19-f4bc02432ae7 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:14.417530 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff65d4-8888-435d-af19-f4bc02432ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:14.417809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff65d4-8888-435d-af19-f4bc02432ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:14.470814 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-35ff65d4-8888-435d-af19-f4bc02432ae7 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:14.474335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-35ff65d4-8888-435d-af19-f4bc02432ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:14.501319 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025125f-ebf5-49c0-bdd9-129df7fb9833 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:14.506565 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3355/6733] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:14.506565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cca5a5-1df0-4a54-a8fc-ef6046b252f6 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:14.506565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cca5a5-1df0-4a54-a8fc-ef6046b252f6 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:14.506565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cca5a5-1df0-4a54-a8fc-ef6046b252f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:14.523489 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f776bde-a877-43bc-8e59-b320a14a27a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:14.524147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f776bde-a877-43bc-8e59-b320a14a27a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:14.524423 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f776bde-a877-43bc-8e59-b320a14a27a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:14.524693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f776bde-a877-43bc-8e59-b320a14a27a8 admin admin] PATH_INFO: `/v3/users/1334bdbad9574c8ea33f6f4f73594351` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:14.526739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f776bde-a877-43bc-8e59-b320a14a27a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1334bdbad9574c8ea33f6f4f73594351)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:14.528784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f776bde-a877-43bc-8e59-b320a14a27a8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:14.562627 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-05cca5a5-1df0-4a54-a8fc-ef6046b252f6 None None] MFA Rules not processed for user `9a4c861028c740a8b5097eb5eb64d3a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:14.566704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-05cca5a5-1df0-4a54-a8fc-ef6046b252f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:14.703130 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3356/6734] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:14.704272 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cca5a5-1df0-4a54-a8fc-ef6046b252f6 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:14.706248 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-05cca5a5-1df0-4a54-a8fc-ef6046b252f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:14.724722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8f776bde-a877-43bc-8e59-b320a14a27a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1334bdbad9574c8ea33f6f4f73594351'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:14.725715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8f776bde-a877-43bc-8e59-b320a14a27a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1334bdbad9574c8ea33f6f4f73594351'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:14.749713 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8f776bde-a877-43bc-8e59-b320a14a27a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1334bdbad9574c8ea33f6f4f73594351'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:14.762738 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8f776bde-a877-43bc-8e59-b320a14a27a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1334bdbad9574c8ea33f6f4f73594351'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:14.763505 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8f776bde-a877-43bc-8e59-b320a14a27a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1334bdbad9574c8ea33f6f4f73594351'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:14.810016 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3379/6735] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:14 2022] DELETE /identity/v3/users/1334bdbad9574c8ea33f6f4f73594351 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:14.810846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f776bde-a877-43bc-8e59-b320a14a27a8 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:14.818301 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8f776bde-a877-43bc-8e59-b320a14a27a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:14.825421 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:14.874095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cca5a5-1df0-4a54-a8fc-ef6046b252f6 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:15.028728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cec35c-dde5-42ef-9331-31110ef85c04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:15.033087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cec35c-dde5-42ef-9331-31110ef85c04 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:15.033087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cec35c-dde5-42ef-9331-31110ef85c04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:15.033087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cec35c-dde5-42ef-9331-31110ef85c04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:15.041905 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-36cec35c-dde5-42ef-9331-31110ef85c04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:15.051105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f776bde-a877-43bc-8e59-b320a14a27a8 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:15.065335 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ad785-b8d7-46ad-868b-80d7aadbee46 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:15.066433 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ad785-b8d7-46ad-868b-80d7aadbee46 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:15.066787 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ad785-b8d7-46ad-868b-80d7aadbee46 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:15.067138 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ad785-b8d7-46ad-868b-80d7aadbee46 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:15.067884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ad785-b8d7-46ad-868b-80d7aadbee46 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:15.070340 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ad785-b8d7-46ad-868b-80d7aadbee46 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:15.107639 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3380/6736] 10.222.0.30 () {60 vars in 1149 bytes} [Sun Sep 4 01:30:14 2022] POST /identity/v3/domains => generated 276 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:15.112775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ad785-b8d7-46ad-868b-80d7aadbee46 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:15.117845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a37ad785-b8d7-46ad-868b-80d7aadbee46 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:15.128327 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:15.204412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cec35c-dde5-42ef-9331-31110ef85c04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:15.211903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cec35c-dde5-42ef-9331-31110ef85c04 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:15.237710 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3357/6737] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:30:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:30:15.238556 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cec35c-dde5-42ef-9331-31110ef85c04 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:15.245417 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ad785-b8d7-46ad-868b-80d7aadbee46 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:15.254434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee3af7-9c11-46c8-a1f9-d99c049ba660 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:15.255062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee3af7-9c11-46c8-a1f9-d99c049ba660 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:15.255341 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee3af7-9c11-46c8-a1f9-d99c049ba660 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:15.255768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee3af7-9c11-46c8-a1f9-d99c049ba660 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:15.260880 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cec35c-dde5-42ef-9331-31110ef85c04 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:15.262584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-99ee3af7-9c11-46c8-a1f9-d99c049ba660 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:15.390468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f82a8f-d312-4b7a-8fed-809d9627aa16 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:15.392214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f82a8f-d312-4b7a-8fed-809d9627aa16 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:15.392500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f82a8f-d312-4b7a-8fed-809d9627aa16 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:15.394133 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f82a8f-d312-4b7a-8fed-809d9627aa16 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/groups` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:15.394791 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f82a8f-d312-4b7a-8fed-809d9627aa16 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:15.400370 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f82a8f-d312-4b7a-8fed-809d9627aa16 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:15.421496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee3af7-9c11-46c8-a1f9-d99c049ba660 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:15.423017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee3af7-9c11-46c8-a1f9-d99c049ba660 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:15.474749 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3381/6738] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:30:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:30:15.475711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee3af7-9c11-46c8-a1f9-d99c049ba660 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:15.477155 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3358/6739] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Sep 4 01:30:15 2022] POST /identity/v3/groups => generated 280 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:15.490431 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee3af7-9c11-46c8-a1f9-d99c049ba660 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:15.495409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886aed5d-3569-46dd-a856-0df056edac9a tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:15.496102 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886aed5d-3569-46dd-a856-0df056edac9a tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:15.496327 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886aed5d-3569-46dd-a856-0df056edac9a tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:15.496606 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886aed5d-3569-46dd-a856-0df056edac9a tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/groups/6dc1eab0df274e25a613dd9beaba3675` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:15.503382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886aed5d-3569-46dd-a856-0df056edac9a tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:update_group(group_id=6dc1eab0df274e25a613dd9beaba3675)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:15.504328 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-886aed5d-3569-46dd-a856-0df056edac9a tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:30:15.504328 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:30:15.504328 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:30:15.505570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886aed5d-3569-46dd-a856-0df056edac9a tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:15.533505 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3382/6740] 10.222.0.30 () {60 vars in 1247 bytes} [Sun Sep 4 01:30:15 2022] PATCH /identity/v3/groups/6dc1eab0df274e25a613dd9beaba3675 => generated 292 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:15.541746 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f82a8f-d312-4b7a-8fed-809d9627aa16 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:15.562658 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f82a8f-d312-4b7a-8fed-809d9627aa16 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:15.570596 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca312f-e732-47c6-bdd8-088f8679c3dd tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:15.571306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca312f-e732-47c6-bdd8-088f8679c3dd tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:15.571593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca312f-e732-47c6-bdd8-088f8679c3dd tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:15.572003 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca312f-e732-47c6-bdd8-088f8679c3dd tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/groups/6dc1eab0df274e25a613dd9beaba3675` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:15.581652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca312f-e732-47c6-bdd8-088f8679c3dd tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:get_group(group_id=6dc1eab0df274e25a613dd9beaba3675)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:15.583110 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-e2ca312f-e732-47c6-bdd8-088f8679c3dd tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:30:15.583110 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:30:15.583110 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:30:15.585343 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca312f-e732-47c6-bdd8-088f8679c3dd tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:15.602061 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3359/6741] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:15 2022] GET /identity/v3/groups/6dc1eab0df274e25a613dd9beaba3675 => generated 292 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:15.602154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886aed5d-3569-46dd-a856-0df056edac9a tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:15.604530 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886aed5d-3569-46dd-a856-0df056edac9a tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:15.621231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47bd86a-3bb1-4d6a-8b60-3ac5ecba8f6f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:15.621866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47bd86a-3bb1-4d6a-8b60-3ac5ecba8f6f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:15.622226 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47bd86a-3bb1-4d6a-8b60-3ac5ecba8f6f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:15.622503 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47bd86a-3bb1-4d6a-8b60-3ac5ecba8f6f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/groups/6dc1eab0df274e25a613dd9beaba3675` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:15.623828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47bd86a-3bb1-4d6a-8b60-3ac5ecba8f6f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:update_group(group_id=6dc1eab0df274e25a613dd9beaba3675)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:15.626201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47bd86a-3bb1-4d6a-8b60-3ac5ecba8f6f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:15.671362 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3383/6742] 10.222.0.30 () {60 vars in 1246 bytes} [Sun Sep 4 01:30:15 2022] PATCH /identity/v3/groups/6dc1eab0df274e25a613dd9beaba3675 => generated 307 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:15.677015 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca312f-e732-47c6-bdd8-088f8679c3dd tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:15.694127 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca312f-e732-47c6-bdd8-088f8679c3dd tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:15.705767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f6ded-c150-467d-b0d2-f0b95018a6ef tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:15.706888 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f6ded-c150-467d-b0d2-f0b95018a6ef tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:15.707179 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f6ded-c150-467d-b0d2-f0b95018a6ef tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:15.707513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f6ded-c150-467d-b0d2-f0b95018a6ef tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/groups/6dc1eab0df274e25a613dd9beaba3675` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:15.724872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f6ded-c150-467d-b0d2-f0b95018a6ef tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:delete_group(group_id=6dc1eab0df274e25a613dd9beaba3675)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:15.727571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f6ded-c150-467d-b0d2-f0b95018a6ef tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:15.763889 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:15.870422 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3360/6743] 10.222.0.30 () {58 vars in 1227 bytes} [Sun Sep 4 01:30:15 2022] DELETE /identity/v3/groups/6dc1eab0df274e25a613dd9beaba3675 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:15.871227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47bd86a-3bb1-4d6a-8b60-3ac5ecba8f6f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:15.889137 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47bd86a-3bb1-4d6a-8b60-3ac5ecba8f6f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:15.917047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f6ded-c150-467d-b0d2-f0b95018a6ef tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:15.919131 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-dd6f6ded-c150-467d-b0d2-f0b95018a6ef tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:16.043984 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f6ded-c150-467d-b0d2-f0b95018a6ef tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:16.060936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec477a2-5099-4ae2-8d5e-4dd67d4255ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:16.061610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec477a2-5099-4ae2-8d5e-4dd67d4255ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:16.061890 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec477a2-5099-4ae2-8d5e-4dd67d4255ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:16.062162 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec477a2-5099-4ae2-8d5e-4dd67d4255ea admin admin] PATH_INFO: `/v3/projects/62ee527887264cbca4fbeca6a3b05200` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:16.065206 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec477a2-5099-4ae2-8d5e-4dd67d4255ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=62ee527887264cbca4fbeca6a3b05200)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:16.069265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec477a2-5099-4ae2-8d5e-4dd67d4255ea admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:16.133242 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a482c-cfad-4e8d-a395-61c60fdc6f9e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:16.134783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a482c-cfad-4e8d-a395-61c60fdc6f9e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:16.135071 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a482c-cfad-4e8d-a395-61c60fdc6f9e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:16.135348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a482c-cfad-4e8d-a395-61c60fdc6f9e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/groups` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:16.136048 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a482c-cfad-4e8d-a395-61c60fdc6f9e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:16.138358 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a482c-cfad-4e8d-a395-61c60fdc6f9e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:16.180896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7ec477a2-5099-4ae2-8d5e-4dd67d4255ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62ee527887264cbca4fbeca6a3b05200', 'request_id': 'req-7ec477a2-5099-4ae2-8d5e-4dd67d4255ea'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:16.185851 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3384/6744] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Sep 4 01:30:15 2022] POST /identity/v3/groups => generated 324 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:30:16.187902 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a482c-cfad-4e8d-a395-61c60fdc6f9e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:16.194416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-851a482c-cfad-4e8d-a395-61c60fdc6f9e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:16.207495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7ec477a2-5099-4ae2-8d5e-4dd67d4255ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62ee527887264cbca4fbeca6a3b05200', 'request_id': 'req-7ec477a2-5099-4ae2-8d5e-4dd67d4255ea'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:16.226671 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:UPDATE=2,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:16.233576 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7ec477a2-5099-4ae2-8d5e-4dd67d4255ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62ee527887264cbca4fbeca6a3b05200', 'request_id': 'req-7ec477a2-5099-4ae2-8d5e-4dd67d4255ea'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:16.250305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a482c-cfad-4e8d-a395-61c60fdc6f9e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:16.267260 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7ec477a2-5099-4ae2-8d5e-4dd67d4255ea admin admin] The token cache is being invalidate because project 62ee527887264cbca4fbeca6a3b05200 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:30:16.267570 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7ec477a2-5099-4ae2-8d5e-4dd67d4255ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:16.269390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7ec477a2-5099-4ae2-8d5e-4dd67d4255ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:16.275293 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3361/6745] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:30:15 2022] DELETE /identity/v3/projects/62ee527887264cbca4fbeca6a3b05200 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:16.277669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec477a2-5099-4ae2-8d5e-4dd67d4255ea admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:16.280052 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7ec477a2-5099-4ae2-8d5e-4dd67d4255ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:16.405769 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:16.412246 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec477a2-5099-4ae2-8d5e-4dd67d4255ea admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:16.422479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e41d9e-a095-433a-8154-ed68bb33c7c8 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:16.426353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e41d9e-a095-433a-8154-ed68bb33c7c8 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:16.426881 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e41d9e-a095-433a-8154-ed68bb33c7c8 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:16.427499 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e41d9e-a095-433a-8154-ed68bb33c7c8 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:16.428573 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e41d9e-a095-433a-8154-ed68bb33c7c8 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:16.433779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e41d9e-a095-433a-8154-ed68bb33c7c8 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:16.464509 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8855083-f79b-49a3-b06d-109382c985e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:16.466880 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8855083-f79b-49a3-b06d-109382c985e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:16.468417 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8855083-f79b-49a3-b06d-109382c985e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:16.468931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8855083-f79b-49a3-b06d-109382c985e8 admin admin] PATH_INFO: `/v3/projects/410552f63405456cb530e87cad8638b1` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:16.470644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8855083-f79b-49a3-b06d-109382c985e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=410552f63405456cb530e87cad8638b1)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:16.473291 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8855083-f79b-49a3-b06d-109382c985e8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:16.507235 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3362/6746] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:30:16 2022] POST /identity/v3/users => generated 323 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:16.516911 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffbf0d-cfdb-4e91-9721-37504a74633e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:16.518371 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffbf0d-cfdb-4e91-9721-37504a74633e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:16.518727 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffbf0d-cfdb-4e91-9721-37504a74633e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:16.556851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b8855083-f79b-49a3-b06d-109382c985e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '410552f63405456cb530e87cad8638b1', 'request_id': 'req-b8855083-f79b-49a3-b06d-109382c985e8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:16.582167 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b8855083-f79b-49a3-b06d-109382c985e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '410552f63405456cb530e87cad8638b1', 'request_id': 'req-b8855083-f79b-49a3-b06d-109382c985e8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:16.605332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b8855083-f79b-49a3-b06d-109382c985e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '410552f63405456cb530e87cad8638b1', 'request_id': 'req-b8855083-f79b-49a3-b06d-109382c985e8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:16.616044 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-7dffbf0d-cfdb-4e91-9721-37504a74633e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:16.623266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7dffbf0d-cfdb-4e91-9721-37504a74633e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:16.636933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b8855083-f79b-49a3-b06d-109382c985e8 admin admin] The token cache is being invalidate because project 410552f63405456cb530e87cad8638b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:30:16.637393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b8855083-f79b-49a3-b06d-109382c985e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:16.638244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b8855083-f79b-49a3-b06d-109382c985e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:16.643755 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3385/6747] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:30:16 2022] DELETE /identity/v3/projects/410552f63405456cb530e87cad8638b1 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:16.644841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8855083-f79b-49a3-b06d-109382c985e8 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:16.646365 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b8855083-f79b-49a3-b06d-109382c985e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:16.787841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8855083-f79b-49a3-b06d-109382c985e8 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:16.813217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0794bf5-1747-4438-81ba-63568dbe082e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:16.814342 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0794bf5-1747-4438-81ba-63568dbe082e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:16.819718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0794bf5-1747-4438-81ba-63568dbe082e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:16.820378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0794bf5-1747-4438-81ba-63568dbe082e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/groups/787acbc4940141809ffe2227510d9c33/users/a610ebd923824fa081af0b8d7401e978` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:16.873605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0794bf5-1747-4438-81ba-63568dbe082e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=787acbc4940141809ffe2227510d9c33, user_id=a610ebd923824fa081af0b8d7401e978)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:16.875690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0794bf5-1747-4438-81ba-63568dbe082e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:16.919893 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3386/6748] 10.222.0.30 () {60 vars in 1360 bytes} [Sun Sep 4 01:30:16 2022] PUT /identity/v3/groups/787acbc4940141809ffe2227510d9c33/users/a610ebd923824fa081af0b8d7401e978 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:16.921053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58782ec-4f4e-40dd-ace5-154b27697e58 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:16.921342 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58782ec-4f4e-40dd-ace5-154b27697e58 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:16.926184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58782ec-4f4e-40dd-ace5-154b27697e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:16.937179 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:16.937708 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3363/6749] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:16.947731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffbf0d-cfdb-4e91-9721-37504a74633e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:16.951944 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-d58782ec-4f4e-40dd-ace5-154b27697e58 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:16.953559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d58782ec-4f4e-40dd-ace5-154b27697e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:16.990566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffbf0d-cfdb-4e91-9721-37504a74633e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:17.075796 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3387/6750] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:17.086465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241be474-ef4a-41ad-a215-30cb7631ecf5 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:17.087053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241be474-ef4a-41ad-a215-30cb7631ecf5 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:17.088472 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241be474-ef4a-41ad-a215-30cb7631ecf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:17.130294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6acf1f-9e53-4001-bc0e-d9072623e14e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:17.130942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6acf1f-9e53-4001-bc0e-d9072623e14e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:17.131430 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6acf1f-9e53-4001-bc0e-d9072623e14e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:17.131812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6acf1f-9e53-4001-bc0e-d9072623e14e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:17.132369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6acf1f-9e53-4001-bc0e-d9072623e14e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:17.134491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6acf1f-9e53-4001-bc0e-d9072623e14e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:17.135619 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-241be474-ef4a-41ad-a215-30cb7631ecf5 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:17.137058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-241be474-ef4a-41ad-a215-30cb7631ecf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:17.164914 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3388/6751] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:17.168526 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf12f3-a435-43a8-9dea-dc9aee22faa3 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:17.168526 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf12f3-a435-43a8-9dea-dc9aee22faa3 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:17.169041 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf12f3-a435-43a8-9dea-dc9aee22faa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:17.222008 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a9cf12f3-a435-43a8-9dea-dc9aee22faa3 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:17.223450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a9cf12f3-a435-43a8-9dea-dc9aee22faa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:17.235612 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3389/6752] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:17.235612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf12f3-a435-43a8-9dea-dc9aee22faa3 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:17.243642 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3364/6753] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:30:16 2022] POST /identity/v3/users => generated 323 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:17.244638 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6acf1f-9e53-4001-bc0e-d9072623e14e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:17.250855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf12f3-a435-43a8-9dea-dc9aee22faa3 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:17.274661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f72c5-0e2e-4df5-87cd-df102827381a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:17.275513 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f72c5-0e2e-4df5-87cd-df102827381a admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:17.275984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f72c5-0e2e-4df5-87cd-df102827381a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:17.276450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f72c5-0e2e-4df5-87cd-df102827381a admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:17.277316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f72c5-0e2e-4df5-87cd-df102827381a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:30:17.277832 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f72c5-0e2e-4df5-87cd-df102827381a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:17.279948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f72c5-0e2e-4df5-87cd-df102827381a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:17.298687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6acf1f-9e53-4001-bc0e-d9072623e14e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:17.303295 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3390/6754] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:17.304222 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f72c5-0e2e-4df5-87cd-df102827381a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:17.315447 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047be10-a592-4766-9621-f502f84cd7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:17.316382 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047be10-a592-4766-9621-f502f84cd7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:17.316680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047be10-a592-4766-9621-f502f84cd7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:17.316949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047be10-a592-4766-9621-f502f84cd7f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:17.318069 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047be10-a592-4766-9621-f502f84cd7f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:30:17.318400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047be10-a592-4766-9621-f502f84cd7f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:17.320532 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047be10-a592-4766-9621-f502f84cd7f7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:17.330228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f72c5-0e2e-4df5-87cd-df102827381a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:17.345828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62353fd6-33c0-4fff-a3e3-8ee5096372a9 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:17.347058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62353fd6-33c0-4fff-a3e3-8ee5096372a9 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:17.347347 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62353fd6-33c0-4fff-a3e3-8ee5096372a9 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:17.347624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62353fd6-33c0-4fff-a3e3-8ee5096372a9 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/groups/787acbc4940141809ffe2227510d9c33/users/7caa2aedc2964edd8652a4d6f34fc648` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:17.353897 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3365/6755] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:17.354784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047be10-a592-4766-9621-f502f84cd7f7 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:17.375238 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047be10-a592-4766-9621-f502f84cd7f7 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:17.380849 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62353fd6-33c0-4fff-a3e3-8ee5096372a9 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=787acbc4940141809ffe2227510d9c33, user_id=7caa2aedc2964edd8652a4d6f34fc648)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:17.381041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ee13f-9346-4222-88b8-65fecb6ecadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:17.381826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ee13f-9346-4222-88b8-65fecb6ecadd admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:17.382106 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ee13f-9346-4222-88b8-65fecb6ecadd admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:17.382376 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ee13f-9346-4222-88b8-65fecb6ecadd admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:17.383199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ee13f-9346-4222-88b8-65fecb6ecadd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:17.383468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62353fd6-33c0-4fff-a3e3-8ee5096372a9 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:17.385749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ee13f-9346-4222-88b8-65fecb6ecadd admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:17.439561 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3391/6756] 10.222.0.30 () {60 vars in 1360 bytes} [Sun Sep 4 01:30:17 2022] PUT /identity/v3/groups/787acbc4940141809ffe2227510d9c33/users/7caa2aedc2964edd8652a4d6f34fc648 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:17.441642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62353fd6-33c0-4fff-a3e3-8ee5096372a9 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:17.477781 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3366/6757] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:30:17 2022] POST /identity/v3/projects => generated 365 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:17.478634 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ee13f-9346-4222-88b8-65fecb6ecadd admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:17.563302 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:17.620277 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ee13f-9346-4222-88b8-65fecb6ecadd admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:17.634157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea578999-1464-47c9-9f69-492b5fde76c5 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:17.634994 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea578999-1464-47c9-9f69-492b5fde76c5 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:17.636228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea578999-1464-47c9-9f69-492b5fde76c5 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:17.636228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea578999-1464-47c9-9f69-492b5fde76c5 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:17.637108 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea578999-1464-47c9-9f69-492b5fde76c5 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:17.641773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62353fd6-33c0-4fff-a3e3-8ee5096372a9 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:17.642175 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea578999-1464-47c9-9f69-492b5fde76c5 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:17.693741 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3367/6758] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:30:17 2022] POST /identity/v3/users => generated 323 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:17.694767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea578999-1464-47c9-9f69-492b5fde76c5 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:17.758923 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:17.779039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc03b7f-2558-41ae-9983-7175ce9af490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:17.780388 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc03b7f-2558-41ae-9983-7175ce9af490 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:17.780678 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc03b7f-2558-41ae-9983-7175ce9af490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:17.780956 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc03b7f-2558-41ae-9983-7175ce9af490 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:17.781630 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc03b7f-2558-41ae-9983-7175ce9af490 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:17.783647 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc03b7f-2558-41ae-9983-7175ce9af490 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:17.790969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea578999-1464-47c9-9f69-492b5fde76c5 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:17.799289 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be64ad-a098-4643-8a63-de72bc17b7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:17.799947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be64ad-a098-4643-8a63-de72bc17b7af admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:17.800231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be64ad-a098-4643-8a63-de72bc17b7af admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:17.800505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be64ad-a098-4643-8a63-de72bc17b7af admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:17.801139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be64ad-a098-4643-8a63-de72bc17b7af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:17.803494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be64ad-a098-4643-8a63-de72bc17b7af admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:17.840349 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3368/6759] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:30:17 2022] POST /identity/v3/users => generated 283 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:17.840349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be64ad-a098-4643-8a63-de72bc17b7af admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:17.853170 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3392/6760] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:30:17 2022] POST /identity/v3/projects => generated 365 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:17.854215 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc03b7f-2558-41ae-9983-7175ce9af490 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:17.859362 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be64ad-a098-4643-8a63-de72bc17b7af admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:17.927269 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c44afd-8c0a-4048-b075-eb244b32894f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:17.928466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c44afd-8c0a-4048-b075-eb244b32894f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:17.929000 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c44afd-8c0a-4048-b075-eb244b32894f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:17.930321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c44afd-8c0a-4048-b075-eb244b32894f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/groups/787acbc4940141809ffe2227510d9c33/users/8e43a0a7502f474686536429ab848dc2` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:17.952491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c44afd-8c0a-4048-b075-eb244b32894f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=787acbc4940141809ffe2227510d9c33, user_id=8e43a0a7502f474686536429ab848dc2)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:17.955094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c44afd-8c0a-4048-b075-eb244b32894f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:17.993599 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc03b7f-2558-41ae-9983-7175ce9af490 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:17.997762 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3369/6761] 10.222.0.30 () {60 vars in 1360 bytes} [Sun Sep 4 01:30:17 2022] PUT /identity/v3/groups/787acbc4940141809ffe2227510d9c33/users/8e43a0a7502f474686536429ab848dc2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:17.998672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c44afd-8c0a-4048-b075-eb244b32894f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:18.037358 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:18.105595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c44afd-8c0a-4048-b075-eb244b32894f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:18.118585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a79530-5a5c-4797-a199-7d12a08163dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:18.120694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a79530-5a5c-4797-a199-7d12a08163dd admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:18.121258 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a79530-5a5c-4797-a199-7d12a08163dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:18.122432 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a79530-5a5c-4797-a199-7d12a08163dd admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:18.123363 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a79530-5a5c-4797-a199-7d12a08163dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:18.128833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a79530-5a5c-4797-a199-7d12a08163dd admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:18.138940 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa22ee-4432-48d3-8968-721275a2daa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:18.140676 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa22ee-4432-48d3-8968-721275a2daa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:18.143018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa22ee-4432-48d3-8968-721275a2daa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:18.143390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa22ee-4432-48d3-8968-721275a2daa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:18.144136 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa22ee-4432-48d3-8968-721275a2daa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:18.146051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa22ee-4432-48d3-8968-721275a2daa9 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:18.166973 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3393/6762] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:18.168294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa22ee-4432-48d3-8968-721275a2daa9 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:18.183756 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3370/6763] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:30:17 2022] POST /identity/v3/users => generated 283 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:18.184855 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a79530-5a5c-4797-a199-7d12a08163dd admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:18.219513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a79530-5a5c-4797-a199-7d12a08163dd admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:18.226631 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344a7c9-4568-401c-abc9-0bfbe65cf933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:18.227263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344a7c9-4568-401c-abc9-0bfbe65cf933 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:18.227551 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344a7c9-4568-401c-abc9-0bfbe65cf933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:18.227820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344a7c9-4568-401c-abc9-0bfbe65cf933 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:18.228753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344a7c9-4568-401c-abc9-0bfbe65cf933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:18.231008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344a7c9-4568-401c-abc9-0bfbe65cf933 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:18.261405 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3371/6764] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:18.263023 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344a7c9-4568-401c-abc9-0bfbe65cf933 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:18.280629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344a7c9-4568-401c-abc9-0bfbe65cf933 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:18.287987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9848f-1661-4583-ac02-a25f3d5ad489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:18.288910 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9848f-1661-4583-ac02-a25f3d5ad489 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:18.289498 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9848f-1661-4583-ac02-a25f3d5ad489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:18.289786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9848f-1661-4583-ac02-a25f3d5ad489 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:18.290436 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9848f-1661-4583-ac02-a25f3d5ad489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:18.292267 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9848f-1661-4583-ac02-a25f3d5ad489 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:18.312695 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3372/6765] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:18.314163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9848f-1661-4583-ac02-a25f3d5ad489 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:18.330736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa22ee-4432-48d3-8968-721275a2daa9 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:18.343677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0aef7-e1d3-47f8-8a4a-7a704b15618a tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:18.344446 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0aef7-e1d3-47f8-8a4a-7a704b15618a tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:18.344777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0aef7-e1d3-47f8-8a4a-7a704b15618a tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:18.345017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0aef7-e1d3-47f8-8a4a-7a704b15618a tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/groups/787acbc4940141809ffe2227510d9c33/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:18.354562 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc0aef7-e1d3-47f8-8a4a-7a704b15618a tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=787acbc4940141809ffe2227510d9c33)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:18.355624 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-adc0aef7-e1d3-47f8-8a4a-7a704b15618a tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:30:18.355624 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:30:18.355624 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:30:18.356843 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc0aef7-e1d3-47f8-8a4a-7a704b15618a tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:18.362854 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9848f-1661-4583-ac02-a25f3d5ad489 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:18.370830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d890bcec-e63e-4801-847c-056789300e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:18.377655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890bcec-e63e-4801-847c-056789300e7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:18.378489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890bcec-e63e-4801-847c-056789300e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:18.380989 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890bcec-e63e-4801-847c-056789300e7e admin admin] PATH_INFO: `/v3/projects/8e0c441964d14c18ba98a2fdb784b108/users/8269be51c14e443aac2b146a04be754e/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:18.399084 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3394/6766] 10.222.0.30 () {58 vars in 1242 bytes} [Sun Sep 4 01:30:18 2022] GET /identity/v3/groups/787acbc4940141809ffe2227510d9c33/users => generated 1085 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:18.400064 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0aef7-e1d3-47f8-8a4a-7a704b15618a tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:18.417531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0aef7-e1d3-47f8-8a4a-7a704b15618a tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:18.418199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890bcec-e63e-4801-847c-056789300e7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e0c441964d14c18ba98a2fdb784b108, user_id=8269be51c14e443aac2b146a04be754e, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:18.420901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890bcec-e63e-4801-847c-056789300e7e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:18.454363 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3373/6767] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:30:18 2022] PUT /identity/v3/projects/8e0c441964d14c18ba98a2fdb784b108/users/8269be51c14e443aac2b146a04be754e/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:18.455812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d890bcec-e63e-4801-847c-056789300e7e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:18.477836 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:18.558416 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d890bcec-e63e-4801-847c-056789300e7e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:18.563901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412571ac-c0fe-4318-ac35-aa89b92ff5b7 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:18.565369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412571ac-c0fe-4318-ac35-aa89b92ff5b7 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:18.565935 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412571ac-c0fe-4318-ac35-aa89b92ff5b7 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:18.566321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412571ac-c0fe-4318-ac35-aa89b92ff5b7 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/groups/787acbc4940141809ffe2227510d9c33/users/a610ebd923824fa081af0b8d7401e978` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:18.568343 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412571ac-c0fe-4318-ac35-aa89b92ff5b7 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=787acbc4940141809ffe2227510d9c33, user_id=a610ebd923824fa081af0b8d7401e978)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:18.569694 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-412571ac-c0fe-4318-ac35-aa89b92ff5b7 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:30:18.569694 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:30:18.569694 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:30:18.571165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412571ac-c0fe-4318-ac35-aa89b92ff5b7 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:18.576140 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124cb02-dc70-49d0-8127-479ff390bbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:18.577407 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124cb02-dc70-49d0-8127-479ff390bbb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:18.577895 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124cb02-dc70-49d0-8127-479ff390bbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:18.578601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124cb02-dc70-49d0-8127-479ff390bbb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:18.579896 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124cb02-dc70-49d0-8127-479ff390bbb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:18.583688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124cb02-dc70-49d0-8127-479ff390bbb3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:18.587360 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3374/6768] 10.222.0.30 () {58 vars in 1342 bytes} [Sun Sep 4 01:30:18 2022] HEAD /identity/v3/groups/787acbc4940141809ffe2227510d9c33/users/a610ebd923824fa081af0b8d7401e978 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:18.588853 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e2f01-8923-4ca5-982f-2741b9e2b69e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:18.589769 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e2f01-8923-4ca5-982f-2741b9e2b69e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:18.589769 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e2f01-8923-4ca5-982f-2741b9e2b69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:18.616741 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3395/6769] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:18.617777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124cb02-dc70-49d0-8127-479ff390bbb3 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:18.642089 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124cb02-dc70-49d0-8127-479ff390bbb3 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:18.653355 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1cc44-b72d-40fe-9c4a-5969849c605f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:18.654423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-fe2e2f01-8923-4ca5-982f-2741b9e2b69e None None] MFA Rules not processed for user `8269be51c14e443aac2b146a04be754e`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:18.656644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-fe2e2f01-8923-4ca5-982f-2741b9e2b69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:18.656951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1cc44-b72d-40fe-9c4a-5969849c605f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:18.657309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1cc44-b72d-40fe-9c4a-5969849c605f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:18.657675 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1cc44-b72d-40fe-9c4a-5969849c605f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/groups/787acbc4940141809ffe2227510d9c33/users/a610ebd923824fa081af0b8d7401e978` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:18.661601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d1cc44-b72d-40fe-9c4a-5969849c605f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=787acbc4940141809ffe2227510d9c33, user_id=a610ebd923824fa081af0b8d7401e978)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:18.663606 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d1cc44-b72d-40fe-9c4a-5969849c605f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:18.686186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d7d1cc44-b72d-40fe-9c4a-5969849c605f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a610ebd923824fa081af0b8d7401e978'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:18.723991 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3396/6770] 10.222.0.30 () {58 vars in 1344 bytes} [Sun Sep 4 01:30:18 2022] DELETE /identity/v3/groups/787acbc4940141809ffe2227510d9c33/users/a610ebd923824fa081af0b8d7401e978 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:18.728857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1cc44-b72d-40fe-9c4a-5969849c605f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:18.817789 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:18.864321 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3375/6771] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:18.864321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e2f01-8923-4ca5-982f-2741b9e2b69e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:18.887772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1cc44-b72d-40fe-9c4a-5969849c605f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:18.899819 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800047f0-4035-4b34-9db5-c593532fed87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:18.900549 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800047f0-4035-4b34-9db5-c593532fed87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:18.900837 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800047f0-4035-4b34-9db5-c593532fed87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:18.901119 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800047f0-4035-4b34-9db5-c593532fed87 admin admin] PATH_INFO: `/v3/projects/2882b2d9b505480cb0f62e9b4018b650/users/e937e79f4b8144f39f141ff2ae5a0856/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:18.907265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e2f01-8923-4ca5-982f-2741b9e2b69e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:18.921082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800047f0-4035-4b34-9db5-c593532fed87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2882b2d9b505480cb0f62e9b4018b650, user_id=e937e79f4b8144f39f141ff2ae5a0856, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:18.923852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800047f0-4035-4b34-9db5-c593532fed87 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:18.977490 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3397/6772] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:30:18 2022] PUT /identity/v3/projects/2882b2d9b505480cb0f62e9b4018b650/users/e937e79f4b8144f39f141ff2ae5a0856/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:18.978915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800047f0-4035-4b34-9db5-c593532fed87 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:19.086678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4ed99-842e-4847-8e0c-19b79bc45cfc tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:19.087442 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4ed99-842e-4847-8e0c-19b79bc45cfc tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:19.087912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4ed99-842e-4847-8e0c-19b79bc45cfc tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:19.088161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4ed99-842e-4847-8e0c-19b79bc45cfc tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/groups/787acbc4940141809ffe2227510d9c33/users/7caa2aedc2964edd8652a4d6f34fc648` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:19.100949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4ed99-842e-4847-8e0c-19b79bc45cfc tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=787acbc4940141809ffe2227510d9c33, user_id=7caa2aedc2964edd8652a4d6f34fc648)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:19.103213 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4ed99-842e-4847-8e0c-19b79bc45cfc tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:19.136896 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3376/6773] 10.222.0.30 () {58 vars in 1342 bytes} [Sun Sep 4 01:30:18 2022] HEAD /identity/v3/groups/787acbc4940141809ffe2227510d9c33/users/7caa2aedc2964edd8652a4d6f34fc648 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:19.138198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023fce3-1255-418b-b6a2-7627137488b8 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:19.138414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023fce3-1255-418b-b6a2-7627137488b8 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:19.139276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023fce3-1255-418b-b6a2-7627137488b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:19.152058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800047f0-4035-4b34-9db5-c593532fed87 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:19.180648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-0023fce3-1255-418b-b6a2-7627137488b8 None None] MFA Rules not processed for user `e937e79f4b8144f39f141ff2ae5a0856`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:19.181624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c74d7-f329-42f1-8efa-f75481b10bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:19.185574 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0023fce3-1255-418b-b6a2-7627137488b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:19.185775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c74d7-f329-42f1-8efa-f75481b10bda admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:19.185775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c74d7-f329-42f1-8efa-f75481b10bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:19.185775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c74d7-f329-42f1-8efa-f75481b10bda admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:19.185775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c74d7-f329-42f1-8efa-f75481b10bda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:19.187221 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c74d7-f329-42f1-8efa-f75481b10bda admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:19.243184 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:19.265117 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3398/6774] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:30:18 2022] POST /identity/v3/projects => generated 365 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:19.266347 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c74d7-f329-42f1-8efa-f75481b10bda admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:19.339943 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3377/6775] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:19.339943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023fce3-1255-418b-b6a2-7627137488b8 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:19.356676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023fce3-1255-418b-b6a2-7627137488b8 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:19.394918 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c74d7-f329-42f1-8efa-f75481b10bda admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:19.402904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcacd24-587b-430f-a7bf-96185f632f4f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:19.403603 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcacd24-587b-430f-a7bf-96185f632f4f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:19.403896 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcacd24-587b-430f-a7bf-96185f632f4f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:19.404179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcacd24-587b-430f-a7bf-96185f632f4f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/groups/787acbc4940141809ffe2227510d9c33/users/7caa2aedc2964edd8652a4d6f34fc648` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:19.407490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcacd24-587b-430f-a7bf-96185f632f4f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=787acbc4940141809ffe2227510d9c33, user_id=7caa2aedc2964edd8652a4d6f34fc648)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:19.409801 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcacd24-587b-430f-a7bf-96185f632f4f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:19.431416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8bcacd24-587b-430f-a7bf-96185f632f4f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7caa2aedc2964edd8652a4d6f34fc648'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:19.463346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da580d4-124a-4707-9850-0917bfd17f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:19.465193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da580d4-124a-4707-9850-0917bfd17f17 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:19.465499 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da580d4-124a-4707-9850-0917bfd17f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:19.465780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da580d4-124a-4707-9850-0917bfd17f17 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:19.467094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da580d4-124a-4707-9850-0917bfd17f17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:19.467647 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3399/6776] 10.222.0.30 () {58 vars in 1344 bytes} [Sun Sep 4 01:30:19 2022] DELETE /identity/v3/groups/787acbc4940141809ffe2227510d9c33/users/7caa2aedc2964edd8652a4d6f34fc648 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:19.468756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcacd24-587b-430f-a7bf-96185f632f4f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:19.473555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da580d4-124a-4707-9850-0917bfd17f17 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:19.531595 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3378/6777] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:30:19 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:19.536262 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da580d4-124a-4707-9850-0917bfd17f17 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:19.545130 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:19.560676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da580d4-124a-4707-9850-0917bfd17f17 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:19.595263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcacd24-587b-430f-a7bf-96185f632f4f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:19.607673 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53037a-4d45-4d35-9936-aec1a528313f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:19.608582 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53037a-4d45-4d35-9936-aec1a528313f admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:19.612683 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53037a-4d45-4d35-9936-aec1a528313f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:19.613079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53037a-4d45-4d35-9936-aec1a528313f admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:19.613891 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53037a-4d45-4d35-9936-aec1a528313f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:19.617338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53037a-4d45-4d35-9936-aec1a528313f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:19.673051 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63e2ac-8693-409c-8759-09922da1c34b tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:19.675157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63e2ac-8693-409c-8759-09922da1c34b tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:19.675453 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63e2ac-8693-409c-8759-09922da1c34b tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:19.676813 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63e2ac-8693-409c-8759-09922da1c34b tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/groups/787acbc4940141809ffe2227510d9c33/users/8e43a0a7502f474686536429ab848dc2` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:19.679833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d63e2ac-8693-409c-8759-09922da1c34b tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=787acbc4940141809ffe2227510d9c33, user_id=8e43a0a7502f474686536429ab848dc2)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:19.682375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d63e2ac-8693-409c-8759-09922da1c34b tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:19.688757 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3400/6778] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:30:19 2022] POST /identity/v3/projects => generated 363 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:19.693355 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53037a-4d45-4d35-9936-aec1a528313f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:19.725013 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3379/6779] 10.222.0.30 () {58 vars in 1342 bytes} [Sun Sep 4 01:30:19 2022] HEAD /identity/v3/groups/787acbc4940141809ffe2227510d9c33/users/8e43a0a7502f474686536429ab848dc2 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:19.733083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63e2ac-8693-409c-8759-09922da1c34b tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:19.761110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63e2ac-8693-409c-8759-09922da1c34b tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:19.874693 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ff3b6-5006-4d7c-8dff-1bf0859bb2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:19.875638 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ff3b6-5006-4d7c-8dff-1bf0859bb2d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:19.875925 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ff3b6-5006-4d7c-8dff-1bf0859bb2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:19.876397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ff3b6-5006-4d7c-8dff-1bf0859bb2d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:19.876809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53037a-4d45-4d35-9936-aec1a528313f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:19.877190 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ff3b6-5006-4d7c-8dff-1bf0859bb2d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:19.880630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ff3b6-5006-4d7c-8dff-1bf0859bb2d9 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:19.891760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8b942-2e51-4b90-b4d5-236003658ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:19.892401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8b942-2e51-4b90-b4d5-236003658ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:19.892718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8b942-2e51-4b90-b4d5-236003658ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:19.892996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8b942-2e51-4b90-b4d5-236003658ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:19.893863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8b942-2e51-4b90-b4d5-236003658ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:19.896699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8b942-2e51-4b90-b4d5-236003658ad9 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:19.929488 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3401/6780] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:19.930088 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8b942-2e51-4b90-b4d5-236003658ad9 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:19.936342 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3380/6781] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:30:19 2022] POST /identity/v3/users => generated 288 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:19.937537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ff3b6-5006-4d7c-8dff-1bf0859bb2d9 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:19.938454 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:19.954574 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ff3b6-5006-4d7c-8dff-1bf0859bb2d9 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:19.960449 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b36bc4-d7ff-4e6e-b0b5-3adcede418eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:19.961131 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b36bc4-d7ff-4e6e-b0b5-3adcede418eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:19.961415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b36bc4-d7ff-4e6e-b0b5-3adcede418eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:19.962617 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b36bc4-d7ff-4e6e-b0b5-3adcede418eb admin admin] PATH_INFO: `/v3/projects/6404bdfa77d241c19341d5c811fd63f4/users/804b1372719346c1b75b48a8cd828402/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:20.005150 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b36bc4-d7ff-4e6e-b0b5-3adcede418eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6404bdfa77d241c19341d5c811fd63f4, user_id=804b1372719346c1b75b48a8cd828402, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:20.013647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b36bc4-d7ff-4e6e-b0b5-3adcede418eb admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:20.023899 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8b942-2e51-4b90-b4d5-236003658ad9 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:20.029011 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc6bff-dad4-44a7-aae3-2cbc4a873f76 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:20.029845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc6bff-dad4-44a7-aae3-2cbc4a873f76 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:20.030234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc6bff-dad4-44a7-aae3-2cbc4a873f76 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:20.030616 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc6bff-dad4-44a7-aae3-2cbc4a873f76 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/groups/787acbc4940141809ffe2227510d9c33/users/8e43a0a7502f474686536429ab848dc2` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:20.033202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfc6bff-dad4-44a7-aae3-2cbc4a873f76 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=787acbc4940141809ffe2227510d9c33, user_id=8e43a0a7502f474686536429ab848dc2)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:20.036098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfc6bff-dad4-44a7-aae3-2cbc4a873f76 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:20.054613 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6dfc6bff-dad4-44a7-aae3-2cbc4a873f76 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '8e43a0a7502f474686536429ab848dc2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:20.055892 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3381/6782] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:30:19 2022] PUT /identity/v3/projects/6404bdfa77d241c19341d5c811fd63f4/users/804b1372719346c1b75b48a8cd828402/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:20.056919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b36bc4-d7ff-4e6e-b0b5-3adcede418eb admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:20.097745 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3402/6783] 10.222.0.30 () {58 vars in 1344 bytes} [Sun Sep 4 01:30:19 2022] DELETE /identity/v3/groups/787acbc4940141809ffe2227510d9c33/users/8e43a0a7502f474686536429ab848dc2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:20.102201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc6bff-dad4-44a7-aae3-2cbc4a873f76 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:20.243510 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b36bc4-d7ff-4e6e-b0b5-3adcede418eb admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:20.251374 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc6bff-dad4-44a7-aae3-2cbc4a873f76 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:20.258921 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311ed87-1094-434a-91b7-9aec0be92e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:20.259550 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311ed87-1094-434a-91b7-9aec0be92e22 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:20.259826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311ed87-1094-434a-91b7-9aec0be92e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:20.260099 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311ed87-1094-434a-91b7-9aec0be92e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:20.260748 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311ed87-1094-434a-91b7-9aec0be92e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:20.263151 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311ed87-1094-434a-91b7-9aec0be92e22 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:20.267108 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:20.276253 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c46c1-8536-419a-8897-533f9a2b1acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:20.280476 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c46c1-8536-419a-8897-533f9a2b1acf admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:20.282688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c46c1-8536-419a-8897-533f9a2b1acf admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:20.284339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c46c1-8536-419a-8897-533f9a2b1acf admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:20.287186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c46c1-8536-419a-8897-533f9a2b1acf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:20.292466 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c46c1-8536-419a-8897-533f9a2b1acf admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:20.293242 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3382/6784] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:20.294184 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311ed87-1094-434a-91b7-9aec0be92e22 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:20.351256 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3403/6785] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:20.355398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c46c1-8536-419a-8897-533f9a2b1acf admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:20.399899 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c46c1-8536-419a-8897-533f9a2b1acf admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:20.421140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311ed87-1094-434a-91b7-9aec0be92e22 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:20.423387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb217f6b-706a-4d0f-a643-33f55d8f1604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:20.426164 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040040d8-29d8-4c10-a30d-b1a5273870a6 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:20.426711 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040040d8-29d8-4c10-a30d-b1a5273870a6 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:20.426994 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040040d8-29d8-4c10-a30d-b1a5273870a6 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:20.427268 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040040d8-29d8-4c10-a30d-b1a5273870a6 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/groups/787acbc4940141809ffe2227510d9c33/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:20.427759 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb217f6b-706a-4d0f-a643-33f55d8f1604 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:20.428750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040040d8-29d8-4c10-a30d-b1a5273870a6 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=787acbc4940141809ffe2227510d9c33)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:20.429547 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb217f6b-706a-4d0f-a643-33f55d8f1604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:20.429812 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-040040d8-29d8-4c10-a30d-b1a5273870a6 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:30:20.429812 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:30:20.429812 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:30:20.431139 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb217f6b-706a-4d0f-a643-33f55d8f1604 admin admin] PATH_INFO: `/v3/projects/3949d553f6b3436182e40a5f800e056b/users/776b31b331fc47dcba674a52393feba2/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:20.431316 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040040d8-29d8-4c10-a30d-b1a5273870a6 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:20.444624 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3383/6786] 10.222.0.30 () {58 vars in 1242 bytes} [Sun Sep 4 01:30:20 2022] GET /identity/v3/groups/787acbc4940141809ffe2227510d9c33/users => generated 145 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:20.446232 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040040d8-29d8-4c10-a30d-b1a5273870a6 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:20.487227 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040040d8-29d8-4c10-a30d-b1a5273870a6 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:20.497494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29e816-21f8-4a8c-a3a1-c6642255da38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:20.498178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29e816-21f8-4a8c-a3a1-c6642255da38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:20.498463 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29e816-21f8-4a8c-a3a1-c6642255da38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:20.498740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29e816-21f8-4a8c-a3a1-c6642255da38 admin admin] PATH_INFO: `/v3/projects/6404bdfa77d241c19341d5c811fd63f4/users/804b1372719346c1b75b48a8cd828402/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:20.500829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe29e816-21f8-4a8c-a3a1-c6642255da38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6404bdfa77d241c19341d5c811fd63f4, user_id=804b1372719346c1b75b48a8cd828402, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:20.504476 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe29e816-21f8-4a8c-a3a1-c6642255da38 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:20.505111 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb217f6b-706a-4d0f-a643-33f55d8f1604 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3949d553f6b3436182e40a5f800e056b, user_id=776b31b331fc47dcba674a52393feba2, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:20.510469 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb217f6b-706a-4d0f-a643-33f55d8f1604 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:20.531059 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3384/6787] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:30:20 2022] PUT /identity/v3/projects/6404bdfa77d241c19341d5c811fd63f4/users/804b1372719346c1b75b48a8cd828402/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:20.537193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29e816-21f8-4a8c-a3a1-c6642255da38 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:20.576792 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3404/6788] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:30:20 2022] PUT /identity/v3/projects/3949d553f6b3436182e40a5f800e056b/users/776b31b331fc47dcba674a52393feba2/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:20.579232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf534f35-40a3-4561-982e-e2b90a158261 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:20.579232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf534f35-40a3-4561-982e-e2b90a158261 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:20.579232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf534f35-40a3-4561-982e-e2b90a158261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:20.661562 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29e816-21f8-4a8c-a3a1-c6642255da38 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:20.737906 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-cf534f35-40a3-4561-982e-e2b90a158261 None None] MFA Rules not processed for user `804b1372719346c1b75b48a8cd828402`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:20.741703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-cf534f35-40a3-4561-982e-e2b90a158261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:20.768634 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00b148-bf92-4200-8a9e-a2623df12c12 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:20.769343 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00b148-bf92-4200-8a9e-a2623df12c12 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:20.769617 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00b148-bf92-4200-8a9e-a2623df12c12 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:20.769953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00b148-bf92-4200-8a9e-a2623df12c12 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/users/8e43a0a7502f474686536429ab848dc2` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:20.771565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c00b148-bf92-4200-8a9e-a2623df12c12 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8e43a0a7502f474686536429ab848dc2)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:20.775541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c00b148-bf92-4200-8a9e-a2623df12c12 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:20.843442 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:20.873943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6c00b148-bf92-4200-8a9e-a2623df12c12 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e43a0a7502f474686536429ab848dc2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:20.877473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6c00b148-bf92-4200-8a9e-a2623df12c12 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e43a0a7502f474686536429ab848dc2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:20.892315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6c00b148-bf92-4200-8a9e-a2623df12c12 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e43a0a7502f474686536429ab848dc2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:20.909387 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6c00b148-bf92-4200-8a9e-a2623df12c12 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e43a0a7502f474686536429ab848dc2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:20.910338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6c00b148-bf92-4200-8a9e-a2623df12c12 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e43a0a7502f474686536429ab848dc2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:20.944198 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3385/6789] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:20 2022] DELETE /identity/v3/users/8e43a0a7502f474686536429ab848dc2 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:20.945102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00b148-bf92-4200-8a9e-a2623df12c12 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:20.947120 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:20.949214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6c00b148-bf92-4200-8a9e-a2623df12c12 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:21.016657 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3405/6790] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:20 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:21.022359 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf534f35-40a3-4561-982e-e2b90a158261 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:21.027786 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-cf534f35-40a3-4561-982e-e2b90a158261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:21.066019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf534f35-40a3-4561-982e-e2b90a158261 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:21.083008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00b148-bf92-4200-8a9e-a2623df12c12 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:21.092095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dff49c-9e7d-4298-85ba-8595443c5235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:21.093129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dff49c-9e7d-4298-85ba-8595443c5235 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:21.093629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dff49c-9e7d-4298-85ba-8595443c5235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:21.094056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dff49c-9e7d-4298-85ba-8595443c5235 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:21.094872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dff49c-9e7d-4298-85ba-8595443c5235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:21.097366 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dff49c-9e7d-4298-85ba-8595443c5235 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:21.112306 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3386/6791] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:21.114000 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dff49c-9e7d-4298-85ba-8595443c5235 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:21.201334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dff49c-9e7d-4298-85ba-8595443c5235 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:21.215623 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74914e2b-1e50-486b-b30b-0f45467248b3 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '804b1372719346c1b75b48a8cd828402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6404bdfa77d241c19341d5c811fd63f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:21.216266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74914e2b-1e50-486b-b30b-0f45467248b3 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:21.216551 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74914e2b-1e50-486b-b30b-0f45467248b3 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:21.216827 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74914e2b-1e50-486b-b30b-0f45467248b3 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:21.218826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74914e2b-1e50-486b-b30b-0f45467248b3 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:21.220664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74914e2b-1e50-486b-b30b-0f45467248b3 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:21.264430 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8cd2f-5e49-40e6-8504-fb8be98c2c95 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:21.265123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8cd2f-5e49-40e6-8504-fb8be98c2c95 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:21.265407 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8cd2f-5e49-40e6-8504-fb8be98c2c95 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:21.265703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8cd2f-5e49-40e6-8504-fb8be98c2c95 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/users/7caa2aedc2964edd8652a4d6f34fc648` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:21.266975 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3387/6792] 10.222.0.30 () {60 vars in 1150 bytes} [Sun Sep 4 01:30:21 2022] POST /identity/v3/domains => generated 277 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:21.269083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74914e2b-1e50-486b-b30b-0f45467248b3 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:21.275891 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca8cd2f-5e49-40e6-8504-fb8be98c2c95 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7caa2aedc2964edd8652a4d6f34fc648)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:21.284886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca8cd2f-5e49-40e6-8504-fb8be98c2c95 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:21.343917 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:21.459514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5ca8cd2f-5e49-40e6-8504-fb8be98c2c95 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7caa2aedc2964edd8652a4d6f34fc648'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:21.460380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5ca8cd2f-5e49-40e6-8504-fb8be98c2c95 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7caa2aedc2964edd8652a4d6f34fc648'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:21.466642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74914e2b-1e50-486b-b30b-0f45467248b3 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:21.476024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5ca8cd2f-5e49-40e6-8504-fb8be98c2c95 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7caa2aedc2964edd8652a4d6f34fc648'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:21.482954 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca3080-5de5-4e7e-baa3-ebaeaed3e9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:21.483643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca3080-5de5-4e7e-baa3-ebaeaed3e9b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:21.483922 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca3080-5de5-4e7e-baa3-ebaeaed3e9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:21.484193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca3080-5de5-4e7e-baa3-ebaeaed3e9b3 admin admin] PATH_INFO: `/v3/projects/3949d553f6b3436182e40a5f800e056b/users/776b31b331fc47dcba674a52393feba2/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:21.493154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca3080-5de5-4e7e-baa3-ebaeaed3e9b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3949d553f6b3436182e40a5f800e056b, user_id=776b31b331fc47dcba674a52393feba2, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:21.495900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca3080-5de5-4e7e-baa3-ebaeaed3e9b3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:21.503194 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5ca8cd2f-5e49-40e6-8504-fb8be98c2c95 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7caa2aedc2964edd8652a4d6f34fc648'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:21.503930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5ca8cd2f-5e49-40e6-8504-fb8be98c2c95 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7caa2aedc2964edd8652a4d6f34fc648'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:21.548794 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3388/6793] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:30:21 2022] PUT /identity/v3/projects/3949d553f6b3436182e40a5f800e056b/users/776b31b331fc47dcba674a52393feba2/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:21.550687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca3080-5de5-4e7e-baa3-ebaeaed3e9b3 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:21.552490 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3406/6794] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:21 2022] DELETE /identity/v3/users/7caa2aedc2964edd8652a4d6f34fc648 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:21.553081 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d5ca3080-5de5-4e7e-baa3-ebaeaed3e9b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:21.553843 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3673664-3f9e-4320-a823-c08abfed0521 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:21.554127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3673664-3f9e-4320-a823-c08abfed0521 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:21.554400 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3673664-3f9e-4320-a823-c08abfed0521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:21.607744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-b3673664-3f9e-4320-a823-c08abfed0521 None None] MFA Rules not processed for user `776b31b331fc47dcba674a52393feba2`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:21.608958 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b3673664-3f9e-4320-a823-c08abfed0521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:21.646212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca3080-5de5-4e7e-baa3-ebaeaed3e9b3 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:21.723765 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:21.763796 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3407/6795] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:21 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:21.764719 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3673664-3f9e-4320-a823-c08abfed0521 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:21.769373 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b3673664-3f9e-4320-a823-c08abfed0521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:21.887776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c9219-3030-41c5-91f3-cb27de73e55f tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '804b1372719346c1b75b48a8cd828402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6404bdfa77d241c19341d5c811fd63f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:21.888411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c9219-3030-41c5-91f3-cb27de73e55f tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:21.888697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c9219-3030-41c5-91f3-cb27de73e55f tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:21.888977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c9219-3030-41c5-91f3-cb27de73e55f tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:21.889694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c9219-3030-41c5-91f3-cb27de73e55f tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:21.891322 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c9219-3030-41c5-91f3-cb27de73e55f tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:21.902438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3673664-3f9e-4320-a823-c08abfed0521 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:21.907949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f0cd8e-f28b-42dc-9739-bd64a6a921bd tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:21.909160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0cd8e-f28b-42dc-9739-bd64a6a921bd tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:21.909463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0cd8e-f28b-42dc-9739-bd64a6a921bd tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:21.909765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0cd8e-f28b-42dc-9739-bd64a6a921bd tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/users/a610ebd923824fa081af0b8d7401e978` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:21.911146 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f0cd8e-f28b-42dc-9739-bd64a6a921bd tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a610ebd923824fa081af0b8d7401e978)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:21.914971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f0cd8e-f28b-42dc-9739-bd64a6a921bd tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:21.925882 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3389/6796] 10.222.0.30 () {60 vars in 1150 bytes} [Sun Sep 4 01:30:21 2022] POST /identity/v3/domains => generated 277 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:21.925882 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c9219-3030-41c5-91f3-cb27de73e55f tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:21.926886 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8c5c9219-3030-41c5-91f3-cb27de73e55f tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:22.072336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c9f0cd8e-f28b-42dc-9739-bd64a6a921bd tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a610ebd923824fa081af0b8d7401e978'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:22.073745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c9f0cd8e-f28b-42dc-9739-bd64a6a921bd tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a610ebd923824fa081af0b8d7401e978'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:22.094470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c9f0cd8e-f28b-42dc-9739-bd64a6a921bd tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a610ebd923824fa081af0b8d7401e978'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:22.113971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c9f0cd8e-f28b-42dc-9739-bd64a6a921bd tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a610ebd923824fa081af0b8d7401e978'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:22.114716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c9f0cd8e-f28b-42dc-9739-bd64a6a921bd tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a610ebd923824fa081af0b8d7401e978'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:22.135749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c9219-3030-41c5-91f3-cb27de73e55f tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:22.148933 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39af75-2006-4f50-95c3-74a474895fee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:22.149614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39af75-2006-4f50-95c3-74a474895fee service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:22.149903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39af75-2006-4f50-95c3-74a474895fee service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:22.151646 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39af75-2006-4f50-95c3-74a474895fee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:22.155382 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3408/6797] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:21 2022] DELETE /identity/v3/users/a610ebd923824fa081af0b8d7401e978 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:22.155536 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-dc39af75-2006-4f50-95c3-74a474895fee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:22.155979 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f0cd8e-f28b-42dc-9739-bd64a6a921bd tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:22.157348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c9f0cd8e-f28b-42dc-9739-bd64a6a921bd tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:22.196553 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:22.335735 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39af75-2006-4f50-95c3-74a474895fee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:22.337940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39af75-2006-4f50-95c3-74a474895fee service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:22.346341 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f0cd8e-f28b-42dc-9739-bd64a6a921bd tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:22.351920 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3390/6798] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:30:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:30:22.353151 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39af75-2006-4f50-95c3-74a474895fee service cinder] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:22.359051 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-dc39af75-2006-4f50-95c3-74a474895fee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:22.363548 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59c49a-d133-43b7-9641-ff68c9614716 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '804b1372719346c1b75b48a8cd828402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6404bdfa77d241c19341d5c811fd63f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:22.364194 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59c49a-d133-43b7-9641-ff68c9614716 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:22.364479 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59c49a-d133-43b7-9641-ff68c9614716 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:22.364756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59c49a-d133-43b7-9641-ff68c9614716 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:22.365461 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59c49a-d133-43b7-9641-ff68c9614716 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:22.367084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59c49a-d133-43b7-9641-ff68c9614716 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:22.423266 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3409/6799] 10.222.0.30 () {60 vars in 1150 bytes} [Sun Sep 4 01:30:22 2022] POST /identity/v3/domains => generated 277 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:22.429148 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59c49a-d133-43b7-9641-ff68c9614716 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:22.468543 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:22.619957 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39af75-2006-4f50-95c3-74a474895fee service cinder] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:22.703871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59c49a-d133-43b7-9641-ff68c9614716 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:22.727641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79803c-21cd-4f87-b8d5-6f7dc23695fb tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '804b1372719346c1b75b48a8cd828402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6404bdfa77d241c19341d5c811fd63f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:22.729680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79803c-21cd-4f87-b8d5-6f7dc23695fb tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:22.730157 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79803c-21cd-4f87-b8d5-6f7dc23695fb tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:22.730589 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79803c-21cd-4f87-b8d5-6f7dc23695fb tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:22.731411 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79803c-21cd-4f87-b8d5-6f7dc23695fb tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:22.734602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79803c-21cd-4f87-b8d5-6f7dc23695fb tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:22.786327 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3410/6800] 10.222.0.30 () {60 vars in 1150 bytes} [Sun Sep 4 01:30:22 2022] POST /identity/v3/domains => generated 278 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:22.791258 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79803c-21cd-4f87-b8d5-6f7dc23695fb tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:22.831278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2b06e-2bf6-4a40-9061-5cf59b15490e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:22.832804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2b06e-2bf6-4a40-9061-5cf59b15490e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:22.833093 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2b06e-2bf6-4a40-9061-5cf59b15490e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:22.833377 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2b06e-2bf6-4a40-9061-5cf59b15490e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/groups/787acbc4940141809ffe2227510d9c33` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:22.842081 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2b06e-2bf6-4a40-9061-5cf59b15490e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:delete_group(group_id=787acbc4940141809ffe2227510d9c33)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:22.844218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2b06e-2bf6-4a40-9061-5cf59b15490e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:22.961327 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3391/6801] 10.222.0.30 () {58 vars in 1227 bytes} [Sun Sep 4 01:30:22 2022] DELETE /identity/v3/groups/787acbc4940141809ffe2227510d9c33 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:22.961327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2b06e-2bf6-4a40-9061-5cf59b15490e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:22.964050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0dc2b06e-2bf6-4a40-9061-5cf59b15490e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:22.981184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79803c-21cd-4f87-b8d5-6f7dc23695fb tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:23.004283 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:23.063214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2b06e-2bf6-4a40-9061-5cf59b15490e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:23.068565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc94cc-41fe-4189-bd9c-d9d0c4b42605 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:23.069824 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc94cc-41fe-4189-bd9c-d9d0c4b42605 service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:23.070177 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc94cc-41fe-4189-bd9c-d9d0c4b42605 service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:23.070520 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc94cc-41fe-4189-bd9c-d9d0c4b42605 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:23.072614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b6cc94cc-41fe-4189-bd9c-d9d0c4b42605 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:23.086040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5904e5d-a110-438d-a076-8fa3078adc08 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '804b1372719346c1b75b48a8cd828402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6404bdfa77d241c19341d5c811fd63f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:23.086873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5904e5d-a110-438d-a076-8fa3078adc08 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:23.087168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5904e5d-a110-438d-a076-8fa3078adc08 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:23.087456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5904e5d-a110-438d-a076-8fa3078adc08 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] PATH_INFO: `/v3/domains/76b47bba476e44289e9a7d36627fbe38` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:23.100630 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5904e5d-a110-438d-a076-8fa3078adc08 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=76b47bba476e44289e9a7d36627fbe38)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:23.102576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5904e5d-a110-438d-a076-8fa3078adc08 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:23.175730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d5904e5d-a110-438d-a076-8fa3078adc08 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '76b47bba476e44289e9a7d36627fbe38'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:23.199322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d5904e5d-a110-438d-a076-8fa3078adc08 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '76b47bba476e44289e9a7d36627fbe38'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:23.217019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc94cc-41fe-4189-bd9c-d9d0c4b42605 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:23.219082 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:23.219916 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc94cc-41fe-4189-bd9c-d9d0c4b42605 service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:23.257416 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3392/6802] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:30:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:30:23.259842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc94cc-41fe-4189-bd9c-d9d0c4b42605 service cinder] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:23.323359 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d5904e5d-a110-438d-a076-8fa3078adc08 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76b47bba476e44289e9a7d36627fbe38', 'request_id': 'req-d5904e5d-a110-438d-a076-8fa3078adc08'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:23.343185 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d5904e5d-a110-438d-a076-8fa3078adc08 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76b47bba476e44289e9a7d36627fbe38', 'request_id': 'req-d5904e5d-a110-438d-a076-8fa3078adc08'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:23.359090 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d5904e5d-a110-438d-a076-8fa3078adc08 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76b47bba476e44289e9a7d36627fbe38', 'request_id': 'req-d5904e5d-a110-438d-a076-8fa3078adc08'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:23.390467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d5904e5d-a110-438d-a076-8fa3078adc08 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] The token cache is being invalidate because project 76b47bba476e44289e9a7d36627fbe38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:30:23.390826 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d5904e5d-a110-438d-a076-8fa3078adc08 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:23.391923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d5904e5d-a110-438d-a076-8fa3078adc08 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:23.403850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d5904e5d-a110-438d-a076-8fa3078adc08 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '76b47bba476e44289e9a7d36627fbe38', 'request_id': 'req-d5904e5d-a110-438d-a076-8fa3078adc08'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:23.404690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d5904e5d-a110-438d-a076-8fa3078adc08 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '76b47bba476e44289e9a7d36627fbe38', 'request_id': 'req-d5904e5d-a110-438d-a076-8fa3078adc08'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:23.405684 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d5904e5d-a110-438d-a076-8fa3078adc08 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '76b47bba476e44289e9a7d36627fbe38', 'request_id': 'req-d5904e5d-a110-438d-a076-8fa3078adc08'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:23.426834 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3411/6803] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:30:22 2022] DELETE /identity/v3/domains/76b47bba476e44289e9a7d36627fbe38 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:23.428612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5904e5d-a110-438d-a076-8fa3078adc08 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:23.430770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d5904e5d-a110-438d-a076-8fa3078adc08 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:23.514146 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc94cc-41fe-4189-bd9c-d9d0c4b42605 service cinder] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:23.626968 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5904e5d-a110-438d-a076-8fa3078adc08 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:23.636569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab730e77-b96b-4092-b6c5-6014a0b16467 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '804b1372719346c1b75b48a8cd828402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6404bdfa77d241c19341d5c811fd63f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:23.637246 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab730e77-b96b-4092-b6c5-6014a0b16467 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:23.637595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab730e77-b96b-4092-b6c5-6014a0b16467 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:23.637949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab730e77-b96b-4092-b6c5-6014a0b16467 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:23.638618 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab730e77-b96b-4092-b6c5-6014a0b16467 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:23.645135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab730e77-b96b-4092-b6c5-6014a0b16467 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:23.669074 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56b027-c5c2-4cbe-89e4-1c556a8bfaaa tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:23.669747 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56b027-c5c2-4cbe-89e4-1c556a8bfaaa tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:23.670037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56b027-c5c2-4cbe-89e4-1c556a8bfaaa tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:23.670364 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56b027-c5c2-4cbe-89e4-1c556a8bfaaa tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/groups` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:23.671013 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e56b027-c5c2-4cbe-89e4-1c556a8bfaaa tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:23.690124 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e56b027-c5c2-4cbe-89e4-1c556a8bfaaa tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:23.693366 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3412/6804] 10.222.0.30 () {60 vars in 1149 bytes} [Sun Sep 4 01:30:23 2022] POST /identity/v3/domains => generated 248 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:23.697694 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab730e77-b96b-4092-b6c5-6014a0b16467 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:23.735559 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3393/6805] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Sep 4 01:30:23 2022] POST /identity/v3/groups => generated 326 bytes in 478 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:23.740083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56b027-c5c2-4cbe-89e4-1c556a8bfaaa tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:23.743403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4e56b027-c5c2-4cbe-89e4-1c556a8bfaaa tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:23.775314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56b027-c5c2-4cbe-89e4-1c556a8bfaaa tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:23.797677 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:23.847900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab730e77-b96b-4092-b6c5-6014a0b16467 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:23.854417 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8bc4a-f81d-40fe-b543-9713027d741c tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '804b1372719346c1b75b48a8cd828402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6404bdfa77d241c19341d5c811fd63f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:23.856686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8bc4a-f81d-40fe-b543-9713027d741c tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:23.857203 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8bc4a-f81d-40fe-b543-9713027d741c tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:23.857950 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8bc4a-f81d-40fe-b543-9713027d741c tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] PATH_INFO: `/v3/domains/ebf26c86c7d9414da238082a1104cb92` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:23.876199 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8bc4a-f81d-40fe-b543-9713027d741c tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ebf26c86c7d9414da238082a1104cb92)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:23.879028 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8bc4a-f81d-40fe-b543-9713027d741c tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:23.899389 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:23.916978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2c68b-f54b-4734-98e5-779137e29e6f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:23.917657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2c68b-f54b-4734-98e5-779137e29e6f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:23.917944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2c68b-f54b-4734-98e5-779137e29e6f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:23.918491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2c68b-f54b-4734-98e5-779137e29e6f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/groups` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:23.918870 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2c68b-f54b-4734-98e5-779137e29e6f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:23.919948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b5e8bc4a-f81d-40fe-b543-9713027d741c tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ebf26c86c7d9414da238082a1104cb92'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:23.920852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b5e8bc4a-f81d-40fe-b543-9713027d741c tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ebf26c86c7d9414da238082a1104cb92'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:23.924094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2c68b-f54b-4734-98e5-779137e29e6f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:23.973046 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3394/6806] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Sep 4 01:30:23 2022] POST /identity/v3/groups => generated 325 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:30:23.978836 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2c68b-f54b-4734-98e5-779137e29e6f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:23.982440 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a2a2c68b-f54b-4734-98e5-779137e29e6f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:23.999258 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b5e8bc4a-f81d-40fe-b543-9713027d741c tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ebf26c86c7d9414da238082a1104cb92'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:24.001006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b5e8bc4a-f81d-40fe-b543-9713027d741c tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ebf26c86c7d9414da238082a1104cb92'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:24.009992 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3413/6807] 10.222.0.30 () {60 vars in 1249 bytes} [Sun Sep 4 01:30:23 2022] PATCH /identity/v3/domains/ebf26c86c7d9414da238082a1104cb92 => generated 249 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:24.010892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8bc4a-f81d-40fe-b543-9713027d741c tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:24.011568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2c68b-f54b-4734-98e5-779137e29e6f tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:24.014607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b5e8bc4a-f81d-40fe-b543-9713027d741c tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:24.154615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b3601-74d6-4afb-b60a-b501438f1e01 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:24.155481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b3601-74d6-4afb-b60a-b501438f1e01 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:24.155941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b3601-74d6-4afb-b60a-b501438f1e01 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:24.156370 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b3601-74d6-4afb-b60a-b501438f1e01 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/groups` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:24.157651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b3601-74d6-4afb-b60a-b501438f1e01 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:24.160517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b3601-74d6-4afb-b60a-b501438f1e01 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:24.192924 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8bc4a-f81d-40fe-b543-9713027d741c tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:24.203119 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3395/6808] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Sep 4 01:30:23 2022] POST /identity/v3/groups => generated 326 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:24.206899 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6168db3-7e4b-47e9-9829-112ecb39dbde tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '804b1372719346c1b75b48a8cd828402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6404bdfa77d241c19341d5c811fd63f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:24.207568 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6168db3-7e4b-47e9-9829-112ecb39dbde tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:24.207850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6168db3-7e4b-47e9-9829-112ecb39dbde tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:24.208125 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6168db3-7e4b-47e9-9829-112ecb39dbde tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] PATH_INFO: `/v3/domains/ebf26c86c7d9414da238082a1104cb92` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:24.210415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b3601-74d6-4afb-b60a-b501438f1e01 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:24.223132 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3a9b3601-74d6-4afb-b60a-b501438f1e01 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:24.234619 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6168db3-7e4b-47e9-9829-112ecb39dbde tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ebf26c86c7d9414da238082a1104cb92)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:24.237123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6168db3-7e4b-47e9-9829-112ecb39dbde tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:24.271605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c6168db3-7e4b-47e9-9829-112ecb39dbde tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ebf26c86c7d9414da238082a1104cb92'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:24.272015 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b3601-74d6-4afb-b60a-b501438f1e01 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:24.278085 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759dd50-3c2d-40c0-b214-c91ec2e05e08 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:24.279123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759dd50-3c2d-40c0-b214-c91ec2e05e08 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:24.279871 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759dd50-3c2d-40c0-b214-c91ec2e05e08 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:24.280319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759dd50-3c2d-40c0-b214-c91ec2e05e08 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/groups` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:24.281119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1759dd50-3c2d-40c0-b214-c91ec2e05e08 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:24.282461 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-1759dd50-3c2d-40c0-b214-c91ec2e05e08 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:30:24.282461 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:30:24.282461 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:30:24.284103 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1759dd50-3c2d-40c0-b214-c91ec2e05e08 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:24.287769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c6168db3-7e4b-47e9-9829-112ecb39dbde tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ebf26c86c7d9414da238082a1104cb92'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:24.294330 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3396/6809] 10.222.0.30 () {58 vars in 1125 bytes} [Sun Sep 4 01:30:24 2022] GET /identity/v3/groups => generated 1487 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:24.298314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759dd50-3c2d-40c0-b214-c91ec2e05e08 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:24.310549 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759dd50-3c2d-40c0-b214-c91ec2e05e08 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:24.317224 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca2b06-152f-4d52-ac8e-63e41b6455f7 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:24.318236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca2b06-152f-4d52-ac8e-63e41b6455f7 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:24.318671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca2b06-152f-4d52-ac8e-63e41b6455f7 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:24.319317 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca2b06-152f-4d52-ac8e-63e41b6455f7 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/groups/62162c1c80d943cd9b511a882be89855` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:24.327137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca2b06-152f-4d52-ac8e-63e41b6455f7 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:delete_group(group_id=62162c1c80d943cd9b511a882be89855)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:24.330920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca2b06-152f-4d52-ac8e-63e41b6455f7 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:24.373201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c6168db3-7e4b-47e9-9829-112ecb39dbde tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebf26c86c7d9414da238082a1104cb92', 'request_id': 'req-c6168db3-7e4b-47e9-9829-112ecb39dbde'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:24.388622 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3397/6810] 10.222.0.30 () {58 vars in 1227 bytes} [Sun Sep 4 01:30:24 2022] DELETE /identity/v3/groups/62162c1c80d943cd9b511a882be89855 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:24.393842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca2b06-152f-4d52-ac8e-63e41b6455f7 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:24.395908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c6168db3-7e4b-47e9-9829-112ecb39dbde tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebf26c86c7d9414da238082a1104cb92', 'request_id': 'req-c6168db3-7e4b-47e9-9829-112ecb39dbde'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:24.406392 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c6168db3-7e4b-47e9-9829-112ecb39dbde tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebf26c86c7d9414da238082a1104cb92', 'request_id': 'req-c6168db3-7e4b-47e9-9829-112ecb39dbde'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:24.437933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c6168db3-7e4b-47e9-9829-112ecb39dbde tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] The token cache is being invalidate because project ebf26c86c7d9414da238082a1104cb92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:30:24.438387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c6168db3-7e4b-47e9-9829-112ecb39dbde tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:24.444305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c6168db3-7e4b-47e9-9829-112ecb39dbde tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:24.453555 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:24.461799 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c6168db3-7e4b-47e9-9829-112ecb39dbde tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ebf26c86c7d9414da238082a1104cb92', 'request_id': 'req-c6168db3-7e4b-47e9-9829-112ecb39dbde'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:24.465075 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c6168db3-7e4b-47e9-9829-112ecb39dbde tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ebf26c86c7d9414da238082a1104cb92', 'request_id': 'req-c6168db3-7e4b-47e9-9829-112ecb39dbde'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:24.467378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c6168db3-7e4b-47e9-9829-112ecb39dbde tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ebf26c86c7d9414da238082a1104cb92', 'request_id': 'req-c6168db3-7e4b-47e9-9829-112ecb39dbde'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:24.489478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca2b06-152f-4d52-ac8e-63e41b6455f7 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:24.494311 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3414/6811] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:30:24 2022] DELETE /identity/v3/domains/ebf26c86c7d9414da238082a1104cb92 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:24.497663 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993f67f-c332-4721-8623-896b6f6cc9ab tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:24.497820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993f67f-c332-4721-8623-896b6f6cc9ab tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:24.498096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993f67f-c332-4721-8623-896b6f6cc9ab tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:24.499206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6168db3-7e4b-47e9-9829-112ecb39dbde tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:24.503569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c6168db3-7e4b-47e9-9829-112ecb39dbde tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:24.507251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993f67f-c332-4721-8623-896b6f6cc9ab tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/groups/17d51f130d614d9fa1e7283ace7037f8` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:24.519276 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:24.524232 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c993f67f-c332-4721-8623-896b6f6cc9ab tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:delete_group(group_id=17d51f130d614d9fa1e7283ace7037f8)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:24.528846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c993f67f-c332-4721-8623-896b6f6cc9ab tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:24.633951 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3398/6812] 10.222.0.30 () {58 vars in 1227 bytes} [Sun Sep 4 01:30:24 2022] DELETE /identity/v3/groups/17d51f130d614d9fa1e7283ace7037f8 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:24.644406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993f67f-c332-4721-8623-896b6f6cc9ab tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:24.646974 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c993f67f-c332-4721-8623-896b6f6cc9ab tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:24.664995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6168db3-7e4b-47e9-9829-112ecb39dbde tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:24.796761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993f67f-c332-4721-8623-896b6f6cc9ab tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:24.797615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9acba51-47ae-407c-b993-02c93b0df445 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:24.798327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acba51-47ae-407c-b993-02c93b0df445 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:24.799969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acba51-47ae-407c-b993-02c93b0df445 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:24.800334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acba51-47ae-407c-b993-02c93b0df445 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/groups/531ff762a10d449694dd0a8703fd8a74` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:24.807038 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9acba51-47ae-407c-b993-02c93b0df445 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:delete_group(group_id=531ff762a10d449694dd0a8703fd8a74)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:24.810314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9acba51-47ae-407c-b993-02c93b0df445 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:24.871555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c76a6-4d73-4362-a55f-97f6693c5e7f tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '804b1372719346c1b75b48a8cd828402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6404bdfa77d241c19341d5c811fd63f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:24.873503 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c76a6-4d73-4362-a55f-97f6693c5e7f tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:24.873809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c76a6-4d73-4362-a55f-97f6693c5e7f tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:24.874175 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c76a6-4d73-4362-a55f-97f6693c5e7f tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:24.880231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c76a6-4d73-4362-a55f-97f6693c5e7f tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:24.890515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c76a6-4d73-4362-a55f-97f6693c5e7f tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:24.892600 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3399/6813] 10.222.0.30 () {58 vars in 1227 bytes} [Sun Sep 4 01:30:24 2022] DELETE /identity/v3/groups/531ff762a10d449694dd0a8703fd8a74 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:24.893699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9acba51-47ae-407c-b993-02c93b0df445 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:24.895776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b9acba51-47ae-407c-b993-02c93b0df445 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:24.946389 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3415/6814] 10.222.0.30 () {60 vars in 1149 bytes} [Sun Sep 4 01:30:24 2022] POST /identity/v3/domains => generated 277 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:24.947447 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c76a6-4d73-4362-a55f-97f6693c5e7f tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:24.980889 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:25.010831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9acba51-47ae-407c-b993-02c93b0df445 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:25.078557 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c76a6-4d73-4362-a55f-97f6693c5e7f tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:25.090485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ab338-fb9a-4b9f-acd6-def7dcaa3050 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:25.092776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ab338-fb9a-4b9f-acd6-def7dcaa3050 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:25.093058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ab338-fb9a-4b9f-acd6-def7dcaa3050 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:25.093334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ab338-fb9a-4b9f-acd6-def7dcaa3050 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:25.094008 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ab338-fb9a-4b9f-acd6-def7dcaa3050 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:25.096432 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ab338-fb9a-4b9f-acd6-def7dcaa3050 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:25.129162 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e3b0a-2d8d-4af4-a2f8-6c4e8bdd4766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:25.129841 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e3b0a-2d8d-4af4-a2f8-6c4e8bdd4766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:25.130244 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e3b0a-2d8d-4af4-a2f8-6c4e8bdd4766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:25.130716 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e3b0a-2d8d-4af4-a2f8-6c4e8bdd4766 admin admin] PATH_INFO: `/v3/users/dfc7700b32d24d6d81be8005aa62c92d` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:25.132662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e3b0a-2d8d-4af4-a2f8-6c4e8bdd4766 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfc7700b32d24d6d81be8005aa62c92d)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:25.136171 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e3b0a-2d8d-4af4-a2f8-6c4e8bdd4766 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:25.152170 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3416/6815] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:30:24 2022] POST /identity/v3/users => generated 321 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:25.153179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ab338-fb9a-4b9f-acd6-def7dcaa3050 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:25.156042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8a5ab338-fb9a-4b9f-acd6-def7dcaa3050 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:25.228143 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-451e3b0a-2d8d-4af4-a2f8-6c4e8bdd4766 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfc7700b32d24d6d81be8005aa62c92d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:25.229665 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-451e3b0a-2d8d-4af4-a2f8-6c4e8bdd4766 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfc7700b32d24d6d81be8005aa62c92d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:25.239522 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:25.244215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-451e3b0a-2d8d-4af4-a2f8-6c4e8bdd4766 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfc7700b32d24d6d81be8005aa62c92d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:25.263407 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-451e3b0a-2d8d-4af4-a2f8-6c4e8bdd4766 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfc7700b32d24d6d81be8005aa62c92d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:25.266475 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-451e3b0a-2d8d-4af4-a2f8-6c4e8bdd4766 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfc7700b32d24d6d81be8005aa62c92d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:25.271284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ab338-fb9a-4b9f-acd6-def7dcaa3050 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:25.283757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb63f9-30fc-4685-825b-8586fc9957e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:25.285163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb63f9-30fc-4685-825b-8586fc9957e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:25.286614 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb63f9-30fc-4685-825b-8586fc9957e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:25.287192 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb63f9-30fc-4685-825b-8586fc9957e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:25.295821 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e9eb63f9-30fc-4685-825b-8586fc9957e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:25.334298 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3400/6816] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:24 2022] DELETE /identity/v3/users/dfc7700b32d24d6d81be8005aa62c92d => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:25.335608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e3b0a-2d8d-4af4-a2f8-6c4e8bdd4766 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:25.344498 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-451e3b0a-2d8d-4af4-a2f8-6c4e8bdd4766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:25.383616 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb63f9-30fc-4685-825b-8586fc9957e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:25.385650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb63f9-30fc-4685-825b-8586fc9957e1 service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:25.418897 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3417/6817] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:30:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:30:25.432423 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb63f9-30fc-4685-825b-8586fc9957e1 service cinder] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:25.438813 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e9eb63f9-30fc-4685-825b-8586fc9957e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:25.472607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb63f9-30fc-4685-825b-8586fc9957e1 service cinder] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:25.505014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e3b0a-2d8d-4af4-a2f8-6c4e8bdd4766 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:25.511771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae48c6-b9ef-49fc-8025-1e8747280e8d tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '804b1372719346c1b75b48a8cd828402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6404bdfa77d241c19341d5c811fd63f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:25.513245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae48c6-b9ef-49fc-8025-1e8747280e8d tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:25.514015 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae48c6-b9ef-49fc-8025-1e8747280e8d tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:25.514648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae48c6-b9ef-49fc-8025-1e8747280e8d tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] PATH_INFO: `/v3/domains/907b2809f372405fba68e70279608b64` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:25.579212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae48c6-b9ef-49fc-8025-1e8747280e8d tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=907b2809f372405fba68e70279608b64)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:25.592068 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae48c6-b9ef-49fc-8025-1e8747280e8d tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:25.618404 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ae14e-dea8-427c-b64b-f93f9f0d115d tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:25.619861 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ae14e-dea8-427c-b64b-f93f9f0d115d tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:25.620424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ae14e-dea8-427c-b64b-f93f9f0d115d tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:25.622602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ae14e-dea8-427c-b64b-f93f9f0d115d tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/groups` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:25.623194 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ae14e-dea8-427c-b64b-f93f9f0d115d tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:25.629119 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ae14e-dea8-427c-b64b-f93f9f0d115d tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:25.655355 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:25.693733 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3418/6818] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Sep 4 01:30:25 2022] POST /identity/v3/groups => generated 326 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:25.698914 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17fecd-efa7-41ea-b6aa-a361726396d5 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:25.699198 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17fecd-efa7-41ea-b6aa-a361726396d5 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:25.699474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17fecd-efa7-41ea-b6aa-a361726396d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:25.700665 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-bbae48c6-b9ef-49fc-8025-1e8747280e8d tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '907b2809f372405fba68e70279608b64'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:25.701491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-bbae48c6-b9ef-49fc-8025-1e8747280e8d tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '907b2809f372405fba68e70279608b64'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:25.757286 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-6f17fecd-efa7-41ea-b6aa-a361726396d5 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:25.759454 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6f17fecd-efa7-41ea-b6aa-a361726396d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:25.771611 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-bbae48c6-b9ef-49fc-8025-1e8747280e8d tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '907b2809f372405fba68e70279608b64'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:25.773324 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-bbae48c6-b9ef-49fc-8025-1e8747280e8d tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '907b2809f372405fba68e70279608b64'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:25.777735 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3401/6819] 10.222.0.30 () {60 vars in 1250 bytes} [Sun Sep 4 01:30:25 2022] PATCH /identity/v3/domains/907b2809f372405fba68e70279608b64 => generated 278 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:25.779162 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae48c6-b9ef-49fc-8025-1e8747280e8d tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:25.780946 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bbae48c6-b9ef-49fc-8025-1e8747280e8d tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:25.983393 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3419/6820] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:25.991616 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17fecd-efa7-41ea-b6aa-a361726396d5 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:26.001703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae48c6-b9ef-49fc-8025-1e8747280e8d tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:26.003917 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6f17fecd-efa7-41ea-b6aa-a361726396d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:26.008243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ea078-9a00-45d4-9a8b-a4817f353842 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:26.008917 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ea078-9a00-45d4-9a8b-a4817f353842 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:26.009201 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ea078-9a00-45d4-9a8b-a4817f353842 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:26.009647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ea078-9a00-45d4-9a8b-a4817f353842 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/groups/2ae72b1f6886431095390b399e0f01a1/users/cec000e92f9848f5a1b3b631bec4261f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:26.056914 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ea078-9a00-45d4-9a8b-a4817f353842 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=2ae72b1f6886431095390b399e0f01a1, user_id=cec000e92f9848f5a1b3b631bec4261f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:26.058917 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ea078-9a00-45d4-9a8b-a4817f353842 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:26.096675 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:26.126328 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3402/6821] 10.222.0.30 () {60 vars in 1360 bytes} [Sun Sep 4 01:30:25 2022] PUT /identity/v3/groups/2ae72b1f6886431095390b399e0f01a1/users/cec000e92f9848f5a1b3b631bec4261f => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:26.128409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ea078-9a00-45d4-9a8b-a4817f353842 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:26.133665 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-968ea078-9a00-45d4-9a8b-a4817f353842 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:26.221745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17fecd-efa7-41ea-b6aa-a361726396d5 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:26.294847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ea078-9a00-45d4-9a8b-a4817f353842 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:26.304389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b7029-e8a1-4ae1-902f-78abf6555900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:26.305032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b7029-e8a1-4ae1-902f-78abf6555900 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:26.305310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b7029-e8a1-4ae1-902f-78abf6555900 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:26.307159 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b7029-e8a1-4ae1-902f-78abf6555900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:26.369063 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffad847-dcc9-4e9f-91f1-284e9bf8b37a tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '804b1372719346c1b75b48a8cd828402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6404bdfa77d241c19341d5c811fd63f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:26.375467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffad847-dcc9-4e9f-91f1-284e9bf8b37a tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:26.375761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffad847-dcc9-4e9f-91f1-284e9bf8b37a tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:26.376050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffad847-dcc9-4e9f-91f1-284e9bf8b37a tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] PATH_INFO: `/v3/domains/907b2809f372405fba68e70279608b64` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:26.392127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffad847-dcc9-4e9f-91f1-284e9bf8b37a tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=907b2809f372405fba68e70279608b64)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:26.395559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffad847-dcc9-4e9f-91f1-284e9bf8b37a tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:26.416671 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3420/6822] 10.222.0.30 () {58 vars in 1227 bytes} [Sun Sep 4 01:30:25 2022] GET /identity/v3/domains/907b2809f372405fba68e70279608b64 => generated 278 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:26.417696 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffad847-dcc9-4e9f-91f1-284e9bf8b37a tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:26.490378 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:26.518858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b7029-e8a1-4ae1-902f-78abf6555900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:26.520258 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b7029-e8a1-4ae1-902f-78abf6555900 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:26.565164 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3403/6823] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:30:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:30:26.566098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b7029-e8a1-4ae1-902f-78abf6555900 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:26.601686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b7029-e8a1-4ae1-902f-78abf6555900 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:26.621986 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d04c02-4f6d-4803-b937-4cef68a58245 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '804b1372719346c1b75b48a8cd828402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6404bdfa77d241c19341d5c811fd63f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:26.622661 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d04c02-4f6d-4803-b937-4cef68a58245 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:26.623034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d04c02-4f6d-4803-b937-4cef68a58245 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:26.623325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d04c02-4f6d-4803-b937-4cef68a58245 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] PATH_INFO: `/v3/domains/907b2809f372405fba68e70279608b64` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:26.631941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d04c02-4f6d-4803-b937-4cef68a58245 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=907b2809f372405fba68e70279608b64)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:26.633626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d04c02-4f6d-4803-b937-4cef68a58245 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:26.653365 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffad847-dcc9-4e9f-91f1-284e9bf8b37a tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:26.665205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994b1c7-71ac-4b1d-b671-53874b79f0bc tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:26.665860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994b1c7-71ac-4b1d-b671-53874b79f0bc tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:26.666141 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994b1c7-71ac-4b1d-b671-53874b79f0bc tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:26.666475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994b1c7-71ac-4b1d-b671-53874b79f0bc tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/groups` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:26.667053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a994b1c7-71ac-4b1d-b671-53874b79f0bc tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:26.668988 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a994b1c7-71ac-4b1d-b671-53874b79f0bc tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:26.714880 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-57d04c02-4f6d-4803-b937-4cef68a58245 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '907b2809f372405fba68e70279608b64'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:26.718717 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3421/6824] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Sep 4 01:30:26 2022] POST /identity/v3/groups => generated 327 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:26.725024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994b1c7-71ac-4b1d-b671-53874b79f0bc tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:26.742723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-57d04c02-4f6d-4803-b937-4cef68a58245 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '907b2809f372405fba68e70279608b64'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:26.746830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994b1c7-71ac-4b1d-b671-53874b79f0bc tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:26.781110 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab91165-9e8c-4343-8270-de7fe98d5e15 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:26.788458 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab91165-9e8c-4343-8270-de7fe98d5e15 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:26.790275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab91165-9e8c-4343-8270-de7fe98d5e15 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:26.791042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab91165-9e8c-4343-8270-de7fe98d5e15 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/groups/2fa1647af8264996b14d0d26c2fd539f/users/cec000e92f9848f5a1b3b631bec4261f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:26.825005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab91165-9e8c-4343-8270-de7fe98d5e15 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=2fa1647af8264996b14d0d26c2fd539f, user_id=cec000e92f9848f5a1b3b631bec4261f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:26.829179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab91165-9e8c-4343-8270-de7fe98d5e15 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:26.866130 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-57d04c02-4f6d-4803-b937-4cef68a58245 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '907b2809f372405fba68e70279608b64', 'request_id': 'req-57d04c02-4f6d-4803-b937-4cef68a58245'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:26.884584 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-57d04c02-4f6d-4803-b937-4cef68a58245 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '907b2809f372405fba68e70279608b64', 'request_id': 'req-57d04c02-4f6d-4803-b937-4cef68a58245'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:26.896072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-57d04c02-4f6d-4803-b937-4cef68a58245 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '907b2809f372405fba68e70279608b64', 'request_id': 'req-57d04c02-4f6d-4803-b937-4cef68a58245'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:26.916366 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3422/6825] 10.222.0.30 () {60 vars in 1360 bytes} [Sun Sep 4 01:30:26 2022] PUT /identity/v3/groups/2fa1647af8264996b14d0d26c2fd539f/users/cec000e92f9848f5a1b3b631bec4261f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:30:26.920257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab91165-9e8c-4343-8270-de7fe98d5e15 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:26.922460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-57d04c02-4f6d-4803-b937-4cef68a58245 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] The token cache is being invalidate because project 907b2809f372405fba68e70279608b64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:30:26.922762 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-57d04c02-4f6d-4803-b937-4cef68a58245 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:26.923924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-57d04c02-4f6d-4803-b937-4cef68a58245 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:26.940875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-57d04c02-4f6d-4803-b937-4cef68a58245 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '907b2809f372405fba68e70279608b64', 'request_id': 'req-57d04c02-4f6d-4803-b937-4cef68a58245'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:26.945684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-57d04c02-4f6d-4803-b937-4cef68a58245 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '907b2809f372405fba68e70279608b64', 'request_id': 'req-57d04c02-4f6d-4803-b937-4cef68a58245'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:26.946404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-57d04c02-4f6d-4803-b937-4cef68a58245 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '907b2809f372405fba68e70279608b64', 'request_id': 'req-57d04c02-4f6d-4803-b937-4cef68a58245'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:26.966954 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3404/6826] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:30:26 2022] DELETE /identity/v3/domains/907b2809f372405fba68e70279608b64 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:26.968744 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d04c02-4f6d-4803-b937-4cef68a58245 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:26.971812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-57d04c02-4f6d-4803-b937-4cef68a58245 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:27.052012 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:27.117932 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab91165-9e8c-4343-8270-de7fe98d5e15 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:27.138362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe56c7-0553-4d9d-9450-457d10113d1e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:27.144359 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe56c7-0553-4d9d-9450-457d10113d1e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:27.144734 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe56c7-0553-4d9d-9450-457d10113d1e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:27.145019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe56c7-0553-4d9d-9450-457d10113d1e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/users/cec000e92f9848f5a1b3b631bec4261f/groups` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:27.147597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe56c7-0553-4d9d-9450-457d10113d1e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=cec000e92f9848f5a1b3b631bec4261f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:27.150530 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe56c7-0553-4d9d-9450-457d10113d1e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:27.156329 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d04c02-4f6d-4803-b937-4cef68a58245 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:27.183404 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3423/6827] 10.222.0.30 () {58 vars in 1242 bytes} [Sun Sep 4 01:30:26 2022] GET /identity/v3/users/cec000e92f9848f5a1b3b631bec4261f/groups => generated 839 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:27.190462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe56c7-0553-4d9d-9450-457d10113d1e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:27.198907 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5efe56c7-0553-4d9d-9450-457d10113d1e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:27.275482 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe56c7-0553-4d9d-9450-457d10113d1e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:27.316405 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12e0f3-161d-4fcf-aceb-a1bed7324c81 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:27.317193 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12e0f3-161d-4fcf-aceb-a1bed7324c81 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:27.321762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12e0f3-161d-4fcf-aceb-a1bed7324c81 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:27.322455 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12e0f3-161d-4fcf-aceb-a1bed7324c81 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/groups/2fa1647af8264996b14d0d26c2fd539f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:27.332591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc12e0f3-161d-4fcf-aceb-a1bed7324c81 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:delete_group(group_id=2fa1647af8264996b14d0d26c2fd539f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:27.338406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc12e0f3-161d-4fcf-aceb-a1bed7324c81 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:27.354798 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:27.496281 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0348c-cd5b-4df2-b384-0856246553fa tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '804b1372719346c1b75b48a8cd828402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6404bdfa77d241c19341d5c811fd63f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:27.496924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0348c-cd5b-4df2-b384-0856246553fa tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:27.497214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0348c-cd5b-4df2-b384-0856246553fa tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:27.501602 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0348c-cd5b-4df2-b384-0856246553fa tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:27.505161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b0348c-cd5b-4df2-b384-0856246553fa tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:27.518164 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b0348c-cd5b-4df2-b384-0856246553fa tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:27.575173 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3424/6828] 10.222.0.30 () {58 vars in 1227 bytes} [Sun Sep 4 01:30:27 2022] DELETE /identity/v3/groups/2fa1647af8264996b14d0d26c2fd539f => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:27.578295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12e0f3-161d-4fcf-aceb-a1bed7324c81 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:27.603578 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3405/6829] 10.222.0.30 () {58 vars in 1128 bytes} [Sun Sep 4 01:30:26 2022] GET /identity/v3/domains => generated 1614 bytes in 635 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:27.605320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0348c-cd5b-4df2-b384-0856246553fa tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:27.663342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0348c-cd5b-4df2-b384-0856246553fa tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:27.851435 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12e0f3-161d-4fcf-aceb-a1bed7324c81 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:27.879373 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a96f92-4df5-4a89-a66e-100491f8797e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:27.880329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a96f92-4df5-4a89-a66e-100491f8797e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:27.881030 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a96f92-4df5-4a89-a66e-100491f8797e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:27.881488 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a96f92-4df5-4a89-a66e-100491f8797e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/groups/2ae72b1f6886431095390b399e0f01a1` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:27.882896 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a96f92-4df5-4a89-a66e-100491f8797e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:delete_group(group_id=2ae72b1f6886431095390b399e0f01a1)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:27.886240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a96f92-4df5-4a89-a66e-100491f8797e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:27.909396 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c0a58-7ac3-40b2-ba2c-8ce014347186 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '804b1372719346c1b75b48a8cd828402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6404bdfa77d241c19341d5c811fd63f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:27.910144 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c0a58-7ac3-40b2-ba2c-8ce014347186 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:27.912551 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c0a58-7ac3-40b2-ba2c-8ce014347186 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:27.913450 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c0a58-7ac3-40b2-ba2c-8ce014347186 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] PATH_INFO: `/v3/domains/907b2809f372405fba68e70279608b64` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:27.932878 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c0a58-7ac3-40b2-ba2c-8ce014347186 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 01:30:27.960233 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-521c0a58-7ac3-40b2-ba2c-8ce014347186 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Could not find domain: 907b2809f372405fba68e70279608b64.: keystone.exception.DomainNotFound: Could not find domain: 907b2809f372405fba68e70279608b64. Sep 04 01:30:27.960233 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:30:27.960233 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 04 01:30:27.960233 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 04 01:30:27.960233 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 01:30:27.960233 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 01:30:27.960233 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 01:30:27.960233 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 01:30:27.960233 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 907b2809f372405fba68e70279608b64. Sep 04 01:30:27.960233 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:30:27.960233 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:30:27.960233 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:30:27.960233 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:30:27.960233 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:30:27.960233 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:30:27.960233 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:30:27.961478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:30:27.961478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:30:27.961478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:30:27.961478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:30:27.961478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:30:27.961478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:30:27.961478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:30:27.961478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 04 01:30:27.961478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 04 01:30:27.961478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 01:30:27.961478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 01:30:27.961478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 01:30:27.961478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 01:30:27.961478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:30:27.961478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:30:27.961478 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 01:30:27.962456 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 01:30:27.962456 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 01:30:27.962456 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 01:30:27.962456 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 01:30:27.962456 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 01:30:27.962456 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 01:30:27.962456 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 01:30:27.962456 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 01:30:27.962456 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 01:30:27.962456 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 01:30:27.962456 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 01:30:27.962456 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 01:30:27.962456 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 01:30:27.962456 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 04 01:30:27.962456 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 01:30:27.962456 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 907b2809f372405fba68e70279608b64. Sep 04 01:30:27.962456 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:30:27.963470 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3406/6830] 10.222.0.30 () {60 vars in 1249 bytes} [Sun Sep 4 01:30:27 2022] PATCH /identity/v3/domains/907b2809f372405fba68e70279608b64 => generated 112 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:30:27.968067 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c0a58-7ac3-40b2-ba2c-8ce014347186 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:28.016709 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c0a58-7ac3-40b2-ba2c-8ce014347186 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:28.040764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54968e55-1c64-4533-bac1-2e2ed9bcf080 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '804b1372719346c1b75b48a8cd828402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6404bdfa77d241c19341d5c811fd63f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:28.047342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54968e55-1c64-4533-bac1-2e2ed9bcf080 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:28.047342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54968e55-1c64-4533-bac1-2e2ed9bcf080 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:28.047342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54968e55-1c64-4533-bac1-2e2ed9bcf080 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:28.047682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54968e55-1c64-4533-bac1-2e2ed9bcf080 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:28.065504 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3425/6831] 10.222.0.30 () {58 vars in 1227 bytes} [Sun Sep 4 01:30:27 2022] DELETE /identity/v3/groups/2ae72b1f6886431095390b399e0f01a1 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:28.069180 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54968e55-1c64-4533-bac1-2e2ed9bcf080 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:28.073376 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a96f92-4df5-4a89-a66e-100491f8797e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:28.082464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a3a96f92-4df5-4a89-a66e-100491f8797e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:28.127583 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3407/6832] 10.222.0.30 () {60 vars in 1149 bytes} [Sun Sep 4 01:30:27 2022] POST /identity/v3/domains => generated 277 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:28.128675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54968e55-1c64-4533-bac1-2e2ed9bcf080 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:28.195396 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:28.255506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a96f92-4df5-4a89-a66e-100491f8797e tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:28.286844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54968e55-1c64-4533-bac1-2e2ed9bcf080 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:28.300361 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a2456-ab21-45b7-b148-1436d1425581 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:28.301022 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a2456-ab21-45b7-b148-1436d1425581 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:28.301303 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a2456-ab21-45b7-b148-1436d1425581 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:28.304455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a2456-ab21-45b7-b148-1436d1425581 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/users/cec000e92f9848f5a1b3b631bec4261f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:28.305869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a2456-ab21-45b7-b148-1436d1425581 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:delete_user(user_id=cec000e92f9848f5a1b3b631bec4261f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:28.308997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a2456-ab21-45b7-b148-1436d1425581 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:28.346472 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f09025-c567-46fd-b510-35cc9ff37df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:28.347575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f09025-c567-46fd-b510-35cc9ff37df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:28.348070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f09025-c567-46fd-b510-35cc9ff37df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:28.348603 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f09025-c567-46fd-b510-35cc9ff37df0 admin admin] PATH_INFO: `/v3/projects/650213f5e01a4c3ebfb1dce1053a19fe` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:28.351429 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f09025-c567-46fd-b510-35cc9ff37df0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=650213f5e01a4c3ebfb1dce1053a19fe)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:28.355039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f09025-c567-46fd-b510-35cc9ff37df0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:28.405159 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b87a2456-ab21-45b7-b148-1436d1425581 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cec000e92f9848f5a1b3b631bec4261f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:28.406965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b87a2456-ab21-45b7-b148-1436d1425581 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cec000e92f9848f5a1b3b631bec4261f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:28.416982 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b87a2456-ab21-45b7-b148-1436d1425581 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cec000e92f9848f5a1b3b631bec4261f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:28.420326 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:28.432408 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b87a2456-ab21-45b7-b148-1436d1425581 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cec000e92f9848f5a1b3b631bec4261f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:28.433205 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b87a2456-ab21-45b7-b148-1436d1425581 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cec000e92f9848f5a1b3b631bec4261f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:28.469918 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-72f09025-c567-46fd-b510-35cc9ff37df0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '650213f5e01a4c3ebfb1dce1053a19fe', 'request_id': 'req-72f09025-c567-46fd-b510-35cc9ff37df0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:28.481300 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3408/6833] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:28 2022] DELETE /identity/v3/users/cec000e92f9848f5a1b3b631bec4261f => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:28.482772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a2456-ab21-45b7-b148-1436d1425581 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:28.484182 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b87a2456-ab21-45b7-b148-1436d1425581 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:28.490300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-72f09025-c567-46fd-b510-35cc9ff37df0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '650213f5e01a4c3ebfb1dce1053a19fe', 'request_id': 'req-72f09025-c567-46fd-b510-35cc9ff37df0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:28.508645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-72f09025-c567-46fd-b510-35cc9ff37df0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '650213f5e01a4c3ebfb1dce1053a19fe', 'request_id': 'req-72f09025-c567-46fd-b510-35cc9ff37df0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:28.536511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-72f09025-c567-46fd-b510-35cc9ff37df0 admin admin] The token cache is being invalidate because project 650213f5e01a4c3ebfb1dce1053a19fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:30:28.537615 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-72f09025-c567-46fd-b510-35cc9ff37df0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:28.538606 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-72f09025-c567-46fd-b510-35cc9ff37df0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:28.546240 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3426/6834] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:30:28 2022] DELETE /identity/v3/projects/650213f5e01a4c3ebfb1dce1053a19fe => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:28.546240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f09025-c567-46fd-b510-35cc9ff37df0 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:28.546871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-72f09025-c567-46fd-b510-35cc9ff37df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:28.648198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a2456-ab21-45b7-b148-1436d1425581 tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:28.661306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98c0e1-8236-4c32-bdaf-2416fefc8c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:28.661991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98c0e1-8236-4c32-bdaf-2416fefc8c8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:28.662321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98c0e1-8236-4c32-bdaf-2416fefc8c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:28.662676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98c0e1-8236-4c32-bdaf-2416fefc8c8b admin admin] PATH_INFO: `/v3/users/e937e79f4b8144f39f141ff2ae5a0856` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:28.666353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98c0e1-8236-4c32-bdaf-2416fefc8c8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e937e79f4b8144f39f141ff2ae5a0856)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:28.668292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98c0e1-8236-4c32-bdaf-2416fefc8c8b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:28.866282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f09025-c567-46fd-b510-35cc9ff37df0 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:28.877086 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7a98c0e1-8236-4c32-bdaf-2416fefc8c8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e937e79f4b8144f39f141ff2ae5a0856'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:28.882000 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7a98c0e1-8236-4c32-bdaf-2416fefc8c8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e937e79f4b8144f39f141ff2ae5a0856'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:28.899138 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:28.902854 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7a98c0e1-8236-4c32-bdaf-2416fefc8c8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e937e79f4b8144f39f141ff2ae5a0856'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:28.930715 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7a98c0e1-8236-4c32-bdaf-2416fefc8c8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e937e79f4b8144f39f141ff2ae5a0856'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:28.931672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7a98c0e1-8236-4c32-bdaf-2416fefc8c8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e937e79f4b8144f39f141ff2ae5a0856'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:29.029160 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3409/6835] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:28 2022] DELETE /identity/v3/users/e937e79f4b8144f39f141ff2ae5a0856 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:29.036183 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98c0e1-8236-4c32-bdaf-2416fefc8c8b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:29.044954 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7a98c0e1-8236-4c32-bdaf-2416fefc8c8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:29.059618 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ff767-d155-4546-b971-45b7fa855e49 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '804b1372719346c1b75b48a8cd828402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6404bdfa77d241c19341d5c811fd63f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:29.060563 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ff767-d155-4546-b971-45b7fa855e49 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:29.061036 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ff767-d155-4546-b971-45b7fa855e49 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:29.063532 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ff767-d155-4546-b971-45b7fa855e49 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:29.064464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ff767-d155-4546-b971-45b7fa855e49 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:29.067620 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ff767-d155-4546-b971-45b7fa855e49 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:29.158620 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3427/6836] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:30:28 2022] POST /identity/v3/users => generated 346 bytes in 613 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:29.158927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e41ed2-ebf3-42a5-9c88-5141fdc8c2b2 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:29.159215 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e41ed2-ebf3-42a5-9c88-5141fdc8c2b2 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:29.159492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e41ed2-ebf3-42a5-9c88-5141fdc8c2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:29.258631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-60e41ed2-ebf3-42a5-9c88-5141fdc8c2b2 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:29.260005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-60e41ed2-ebf3-42a5-9c88-5141fdc8c2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:29.382234 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:29.408479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98c0e1-8236-4c32-bdaf-2416fefc8c8b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:29.428438 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3428/6837] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:29.430115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ad8eb-f044-45b4-a772-7105e245fffc None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:29.431416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ad8eb-f044-45b4-a772-7105e245fffc None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:29.431833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ad8eb-f044-45b4-a772-7105e245fffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:29.457267 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124305c-514a-4d54-a36d-71693d182e2b tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:29.458265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124305c-514a-4d54-a36d-71693d182e2b tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:29.458666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124305c-514a-4d54-a36d-71693d182e2b tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:29.459054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124305c-514a-4d54-a36d-71693d182e2b tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/domains/2cfd19c5019947e298eaaf58526cb3bb` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:29.460672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124305c-514a-4d54-a36d-71693d182e2b tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2cfd19c5019947e298eaaf58526cb3bb)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:29.462845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124305c-514a-4d54-a36d-71693d182e2b tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:29.487016 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-b93ad8eb-f044-45b4-a772-7105e245fffc None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:29.491007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b93ad8eb-f044-45b4-a772-7105e245fffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:29.509545 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3429/6838] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:29.511615 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ad8eb-f044-45b4-a772-7105e245fffc None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:29.526565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b93ad8eb-f044-45b4-a772-7105e245fffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:29.540827 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1124305c-514a-4d54-a36d-71693d182e2b tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2cfd19c5019947e298eaaf58526cb3bb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:29.547565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1124305c-514a-4d54-a36d-71693d182e2b tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2cfd19c5019947e298eaaf58526cb3bb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:29.615639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1124305c-514a-4d54-a36d-71693d182e2b tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2cfd19c5019947e298eaaf58526cb3bb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:29.618222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1124305c-514a-4d54-a36d-71693d182e2b tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2cfd19c5019947e298eaaf58526cb3bb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:29.622093 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3410/6839] 10.222.0.30 () {60 vars in 1249 bytes} [Sun Sep 4 01:30:29 2022] PATCH /identity/v3/domains/2cfd19c5019947e298eaaf58526cb3bb => generated 277 bytes in 592 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:29.625188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f9078-4a09-416f-bec6-c33bae2810c1 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:29.625188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f9078-4a09-416f-bec6-c33bae2810c1 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:29.625188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f9078-4a09-416f-bec6-c33bae2810c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:29.672780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-827f9078-4a09-416f-bec6-c33bae2810c1 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:29.675666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-827f9078-4a09-416f-bec6-c33bae2810c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:29.701193 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ad8eb-f044-45b4-a772-7105e245fffc None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:29.750911 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:29.819995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf40cca-d1bf-4062-92a8-0a6c5ea0ee57 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '804b1372719346c1b75b48a8cd828402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6404bdfa77d241c19341d5c811fd63f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:29.823115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf40cca-d1bf-4062-92a8-0a6c5ea0ee57 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:29.824285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf40cca-d1bf-4062-92a8-0a6c5ea0ee57 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:29.824723 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf40cca-d1bf-4062-92a8-0a6c5ea0ee57 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] PATH_INFO: `/v3/groups` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:29.825608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf40cca-d1bf-4062-92a8-0a6c5ea0ee57 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:29.828768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf40cca-d1bf-4062-92a8-0a6c5ea0ee57 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:29.857990 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3430/6840] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Sep 4 01:30:29 2022] POST /identity/v3/groups => generated 322 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:29.859178 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf40cca-d1bf-4062-92a8-0a6c5ea0ee57 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:29.862086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-acf40cca-d1bf-4062-92a8-0a6c5ea0ee57 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:29.873671 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3411/6841] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:29.874905 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f9078-4a09-416f-bec6-c33bae2810c1 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:29.877744 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-827f9078-4a09-416f-bec6-c33bae2810c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:30.005162 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf40cca-d1bf-4062-92a8-0a6c5ea0ee57 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:30.010070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8bb90-c73d-4110-8d8c-1822607bd541 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:30.010930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8bb90-c73d-4110-8d8c-1822607bd541 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:30.013074 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8bb90-c73d-4110-8d8c-1822607bd541 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:30.014984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8bb90-c73d-4110-8d8c-1822607bd541 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:30.017236 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7ee8bb90-c73d-4110-8d8c-1822607bd541 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:30.032683 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee8bb90-c73d-4110-8d8c-1822607bd541 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:30.035133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee8bb90-c73d-4110-8d8c-1822607bd541 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:30.052887 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3431/6842] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:30:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:30:30.061858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f9078-4a09-416f-bec6-c33bae2810c1 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:30.070703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8bb90-c73d-4110-8d8c-1822607bd541 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:30.072442 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5a6b6-0535-437f-9332-570ab82bc0bc tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4c861028c740a8b5097eb5eb64d3a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1dd5932f7234a10bef4cb388cf1efe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:30.073730 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5a6b6-0535-437f-9332-570ab82bc0bc tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:30.074423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5a6b6-0535-437f-9332-570ab82bc0bc tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:30.074825 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7ee8bb90-c73d-4110-8d8c-1822607bd541 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:30.075319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5a6b6-0535-437f-9332-570ab82bc0bc tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] PATH_INFO: `/v3/domains/2cfd19c5019947e298eaaf58526cb3bb` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:30.099355 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8bb90-c73d-4110-8d8c-1822607bd541 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:30.103447 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5a6b6-0535-437f-9332-570ab82bc0bc tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2cfd19c5019947e298eaaf58526cb3bb)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:30.106430 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5a6b6-0535-437f-9332-570ab82bc0bc tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:30.107119 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95ec95-8cb7-4865-8375-33f6a370adfc tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '804b1372719346c1b75b48a8cd828402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6404bdfa77d241c19341d5c811fd63f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:30.109048 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95ec95-8cb7-4865-8375-33f6a370adfc tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:30.109048 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95ec95-8cb7-4865-8375-33f6a370adfc tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:30.109048 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95ec95-8cb7-4865-8375-33f6a370adfc tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] PATH_INFO: `/v3/domains/754d7223129e424fbdd07939b5f00ff8` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:30.110730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95ec95-8cb7-4865-8375-33f6a370adfc tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=754d7223129e424fbdd07939b5f00ff8)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:30.113660 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95ec95-8cb7-4865-8375-33f6a370adfc tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:30.149500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9b95ec95-8cb7-4865-8375-33f6a370adfc tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '754d7223129e424fbdd07939b5f00ff8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:30.150857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9b95ec95-8cb7-4865-8375-33f6a370adfc tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '754d7223129e424fbdd07939b5f00ff8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:30.153701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-47b5a6b6-0535-437f-9332-570ab82bc0bc tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2cfd19c5019947e298eaaf58526cb3bb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:30.200754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-47b5a6b6-0535-437f-9332-570ab82bc0bc tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2cfd19c5019947e298eaaf58526cb3bb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:30.203969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9b95ec95-8cb7-4865-8375-33f6a370adfc tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '754d7223129e424fbdd07939b5f00ff8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:30.206305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9b95ec95-8cb7-4865-8375-33f6a370adfc tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '754d7223129e424fbdd07939b5f00ff8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:30.210634 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3432/6843] 10.222.0.30 () {60 vars in 1249 bytes} [Sun Sep 4 01:30:30 2022] PATCH /identity/v3/domains/754d7223129e424fbdd07939b5f00ff8 => generated 278 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:30.216163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95ec95-8cb7-4865-8375-33f6a370adfc tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:30.220056 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9b95ec95-8cb7-4865-8375-33f6a370adfc tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:30.278931 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:30.330779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-47b5a6b6-0535-437f-9332-570ab82bc0bc tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cfd19c5019947e298eaaf58526cb3bb', 'request_id': 'req-47b5a6b6-0535-437f-9332-570ab82bc0bc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:30.375022 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-47b5a6b6-0535-437f-9332-570ab82bc0bc tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cfd19c5019947e298eaaf58526cb3bb', 'request_id': 'req-47b5a6b6-0535-437f-9332-570ab82bc0bc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:30.391539 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-47b5a6b6-0535-437f-9332-570ab82bc0bc tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cfd19c5019947e298eaaf58526cb3bb', 'request_id': 'req-47b5a6b6-0535-437f-9332-570ab82bc0bc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:30.431247 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-47b5a6b6-0535-437f-9332-570ab82bc0bc tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] The token cache is being invalidate because project 2cfd19c5019947e298eaaf58526cb3bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:30:30.431571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-47b5a6b6-0535-437f-9332-570ab82bc0bc tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:30.432820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-47b5a6b6-0535-437f-9332-570ab82bc0bc tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:30.456815 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-47b5a6b6-0535-437f-9332-570ab82bc0bc tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2cfd19c5019947e298eaaf58526cb3bb', 'request_id': 'req-47b5a6b6-0535-437f-9332-570ab82bc0bc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:30.457318 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-47b5a6b6-0535-437f-9332-570ab82bc0bc tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2cfd19c5019947e298eaaf58526cb3bb', 'request_id': 'req-47b5a6b6-0535-437f-9332-570ab82bc0bc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:30.458264 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-47b5a6b6-0535-437f-9332-570ab82bc0bc tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2cfd19c5019947e298eaaf58526cb3bb', 'request_id': 'req-47b5a6b6-0535-437f-9332-570ab82bc0bc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:30.482564 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3412/6844] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:30:29 2022] DELETE /identity/v3/domains/2cfd19c5019947e298eaaf58526cb3bb => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:30.483862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5a6b6-0535-437f-9332-570ab82bc0bc tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:30.487457 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-47b5a6b6-0535-437f-9332-570ab82bc0bc tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:30.498427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95ec95-8cb7-4865-8375-33f6a370adfc tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:30.580644 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:30.660287 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb6b4b-7c86-4c8d-82e4-8c6df01a818f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:30.663722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb6b4b-7c86-4c8d-82e4-8c6df01a818f admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:30.665853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb6b4b-7c86-4c8d-82e4-8c6df01a818f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:30.666226 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb6b4b-7c86-4c8d-82e4-8c6df01a818f admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:30.666876 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb6b4b-7c86-4c8d-82e4-8c6df01a818f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:30:30.668625 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb6b4b-7c86-4c8d-82e4-8c6df01a818f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:30.670370 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5a6b6-0535-437f-9332-570ab82bc0bc tempest-GroupsV3TestJSON-840263055 tempest-GroupsV3TestJSON-840263055-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:30.682215 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb6b4b-7c86-4c8d-82e4-8c6df01a818f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:30.682637 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3574c1d-6d8e-44db-910d-5a415b1252aa tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '804b1372719346c1b75b48a8cd828402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6404bdfa77d241c19341d5c811fd63f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:30.683387 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3574c1d-6d8e-44db-910d-5a415b1252aa tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:30.683610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3574c1d-6d8e-44db-910d-5a415b1252aa tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:30.683908 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3574c1d-6d8e-44db-910d-5a415b1252aa tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] PATH_INFO: `/v3/domains/754d7223129e424fbdd07939b5f00ff8` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:30.720266 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3433/6845] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:30:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 509 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:30.723970 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb6b4b-7c86-4c8d-82e4-8c6df01a818f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:30.725788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6adb6b4b-7c86-4c8d-82e4-8c6df01a818f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:30.741315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb6b4b-7c86-4c8d-82e4-8c6df01a818f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:30.749051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2608e3-d56b-42a3-b732-819267226842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:30.749916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2608e3-d56b-42a3-b732-819267226842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:30.750201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2608e3-d56b-42a3-b732-819267226842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:30.750619 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2608e3-d56b-42a3-b732-819267226842 admin admin] PATH_INFO: `/v3/users/495ec428bc394d29ab93ab339a2bfc79` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:30.753044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2608e3-d56b-42a3-b732-819267226842 admin admin] RBAC: Authorizing `identity:delete_user(user_id=495ec428bc394d29ab93ab339a2bfc79)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:30.754140 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2608e3-d56b-42a3-b732-819267226842 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:30.755566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3574c1d-6d8e-44db-910d-5a415b1252aa tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=754d7223129e424fbdd07939b5f00ff8)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:30.757254 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3574c1d-6d8e-44db-910d-5a415b1252aa tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:30.823052 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f3574c1d-6d8e-44db-910d-5a415b1252aa tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '754d7223129e424fbdd07939b5f00ff8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:30.856241 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4c2608e3-d56b-42a3-b732-819267226842 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '495ec428bc394d29ab93ab339a2bfc79'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:30.856946 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4c2608e3-d56b-42a3-b732-819267226842 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '495ec428bc394d29ab93ab339a2bfc79'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:30.867038 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4c2608e3-d56b-42a3-b732-819267226842 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '495ec428bc394d29ab93ab339a2bfc79'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:30.903853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4c2608e3-d56b-42a3-b732-819267226842 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '495ec428bc394d29ab93ab339a2bfc79'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:30.907233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4c2608e3-d56b-42a3-b732-819267226842 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '495ec428bc394d29ab93ab339a2bfc79'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:30.942885 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3434/6846] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:30 2022] DELETE /identity/v3/users/495ec428bc394d29ab93ab339a2bfc79 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:30.944130 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2608e3-d56b-42a3-b732-819267226842 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:30.947999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4c2608e3-d56b-42a3-b732-819267226842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:31.001367 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:31.069924 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2608e3-d56b-42a3-b732-819267226842 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:31.084894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c45ae-b145-4c03-bd83-067b990c5d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:31.085616 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c45ae-b145-4c03-bd83-067b990c5d94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:31.086041 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c45ae-b145-4c03-bd83-067b990c5d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:31.086319 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c45ae-b145-4c03-bd83-067b990c5d94 admin admin] PATH_INFO: `/v3/projects/2882b2d9b505480cb0f62e9b4018b650` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:31.090063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f3574c1d-6d8e-44db-910d-5a415b1252aa tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b4e74b886f140da971dc93ccd4bc9d8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:31.090197 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f3574c1d-6d8e-44db-910d-5a415b1252aa tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b4e74b886f140da971dc93ccd4bc9d8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:31.090501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c45ae-b145-4c03-bd83-067b990c5d94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2882b2d9b505480cb0f62e9b4018b650)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:31.095392 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c45ae-b145-4c03-bd83-067b990c5d94 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:31.101090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f3574c1d-6d8e-44db-910d-5a415b1252aa tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b4e74b886f140da971dc93ccd4bc9d8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:31.122555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f3574c1d-6d8e-44db-910d-5a415b1252aa tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b4e74b886f140da971dc93ccd4bc9d8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:31.123319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f3574c1d-6d8e-44db-910d-5a415b1252aa tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b4e74b886f140da971dc93ccd4bc9d8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:31.153559 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f3574c1d-6d8e-44db-910d-5a415b1252aa tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '754d7223129e424fbdd07939b5f00ff8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:31.183420 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:31.190064 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1f6c45ae-b145-4c03-bd83-067b990c5d94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2882b2d9b505480cb0f62e9b4018b650', 'request_id': 'req-1f6c45ae-b145-4c03-bd83-067b990c5d94'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:31.207694 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1f6c45ae-b145-4c03-bd83-067b990c5d94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2882b2d9b505480cb0f62e9b4018b650', 'request_id': 'req-1f6c45ae-b145-4c03-bd83-067b990c5d94'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:31.217964 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1f6c45ae-b145-4c03-bd83-067b990c5d94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2882b2d9b505480cb0f62e9b4018b650', 'request_id': 'req-1f6c45ae-b145-4c03-bd83-067b990c5d94'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:31.229161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f3574c1d-6d8e-44db-910d-5a415b1252aa tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '754d7223129e424fbdd07939b5f00ff8', 'request_id': 'req-f3574c1d-6d8e-44db-910d-5a415b1252aa'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:31.233505 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1f6c45ae-b145-4c03-bd83-067b990c5d94 admin admin] The token cache is being invalidate because project 2882b2d9b505480cb0f62e9b4018b650 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:30:31.234193 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1f6c45ae-b145-4c03-bd83-067b990c5d94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:31.235100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1f6c45ae-b145-4c03-bd83-067b990c5d94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:31.237617 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3435/6847] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:30:30 2022] DELETE /identity/v3/projects/2882b2d9b505480cb0f62e9b4018b650 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:31.238560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c45ae-b145-4c03-bd83-067b990c5d94 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:31.240006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1f6c45ae-b145-4c03-bd83-067b990c5d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:31.249585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f3574c1d-6d8e-44db-910d-5a415b1252aa tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '754d7223129e424fbdd07939b5f00ff8', 'request_id': 'req-f3574c1d-6d8e-44db-910d-5a415b1252aa'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:31.257781 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f3574c1d-6d8e-44db-910d-5a415b1252aa tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '754d7223129e424fbdd07939b5f00ff8', 'request_id': 'req-f3574c1d-6d8e-44db-910d-5a415b1252aa'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:31.294847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f3574c1d-6d8e-44db-910d-5a415b1252aa tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] The token cache is being invalidate because project 754d7223129e424fbdd07939b5f00ff8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:30:31.295591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f3574c1d-6d8e-44db-910d-5a415b1252aa tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:31.298502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f3574c1d-6d8e-44db-910d-5a415b1252aa tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:31.322722 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f3574c1d-6d8e-44db-910d-5a415b1252aa tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '754d7223129e424fbdd07939b5f00ff8', 'request_id': 'req-f3574c1d-6d8e-44db-910d-5a415b1252aa'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:31.327398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f3574c1d-6d8e-44db-910d-5a415b1252aa tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '754d7223129e424fbdd07939b5f00ff8', 'request_id': 'req-f3574c1d-6d8e-44db-910d-5a415b1252aa'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:31.327398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f3574c1d-6d8e-44db-910d-5a415b1252aa tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '754d7223129e424fbdd07939b5f00ff8', 'request_id': 'req-f3574c1d-6d8e-44db-910d-5a415b1252aa'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:31.345567 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3413/6848] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:30:30 2022] DELETE /identity/v3/domains/754d7223129e424fbdd07939b5f00ff8 => generated 0 bytes in 859 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:31.347289 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0cd075-3901-4ded-aa84-11dc1c6de96a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:31.347689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0cd075-3901-4ded-aa84-11dc1c6de96a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:31.348107 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0cd075-3901-4ded-aa84-11dc1c6de96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:31.354125 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c45ae-b145-4c03-bd83-067b990c5d94 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:31.372257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-6d0cd075-3901-4ded-aa84-11dc1c6de96a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:31.373926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6d0cd075-3901-4ded-aa84-11dc1c6de96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:31.431487 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb73d52-fd37-4188-b394-f608a231c80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:31.432362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb73d52-fd37-4188-b394-f608a231c80b admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:31.432637 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb73d52-fd37-4188-b394-f608a231c80b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:31.432906 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb73d52-fd37-4188-b394-f608a231c80b admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:31.433589 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb73d52-fd37-4188-b394-f608a231c80b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:31.436219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb73d52-fd37-4188-b394-f608a231c80b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:31.453873 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=77,keystone:DELETE=21,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:31.469350 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3414/6849] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:31.474688 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0cd075-3901-4ded-aa84-11dc1c6de96a None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:31.479464 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6d0cd075-3901-4ded-aa84-11dc1c6de96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:31.517500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0cd075-3901-4ded-aa84-11dc1c6de96a None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:31.518129 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3436/6850] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:30:31 2022] POST /identity/v3/projects => generated 371 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:31.519397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb73d52-fd37-4188-b394-f608a231c80b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:31.522263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-dbb73d52-fd37-4188-b394-f608a231c80b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:31.624004 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb73d52-fd37-4188-b394-f608a231c80b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:31.637565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c426c0-b86d-4b4e-9c79-4207c81670d9 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '804b1372719346c1b75b48a8cd828402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6404bdfa77d241c19341d5c811fd63f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:31.638584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c426c0-b86d-4b4e-9c79-4207c81670d9 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:31.639035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c426c0-b86d-4b4e-9c79-4207c81670d9 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:31.639374 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c426c0-b86d-4b4e-9c79-4207c81670d9 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] PATH_INFO: `/v3/domains/754d7223129e424fbdd07939b5f00ff8` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:31.650101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c426c0-b86d-4b4e-9c79-4207c81670d9 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=754d7223129e424fbdd07939b5f00ff8)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:31.652029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c426c0-b86d-4b4e-9c79-4207c81670d9 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:31.655013 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:31.661974 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37430cba-1f1d-416b-b745-516803304a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:31.662798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37430cba-1f1d-416b-b745-516803304a65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:31.663325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37430cba-1f1d-416b-b745-516803304a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:31.663698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37430cba-1f1d-416b-b745-516803304a65 admin admin] PATH_INFO: `/v3/users/776b31b331fc47dcba674a52393feba2` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:31.665892 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37430cba-1f1d-416b-b745-516803304a65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=776b31b331fc47dcba674a52393feba2)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:31.668779 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-f8c426c0-b86d-4b4e-9c79-4207c81670d9 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Could not find domain: 754d7223129e424fbdd07939b5f00ff8.: keystone.exception.DomainNotFound: Could not find domain: 754d7223129e424fbdd07939b5f00ff8. Sep 04 01:30:31.668779 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:30:31.668779 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 04 01:30:31.668779 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 04 01:30:31.668779 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 01:30:31.668779 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 01:30:31.668779 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 01:30:31.668779 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 01:30:31.668779 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 754d7223129e424fbdd07939b5f00ff8. Sep 04 01:30:31.668779 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:30:31.668779 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:30:31.668779 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:30:31.668779 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:30:31.668779 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:30:31.668779 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:30:31.668779 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:30:31.670048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:30:31.670048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:30:31.670048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:30:31.670048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:30:31.670048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:30:31.670048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:30:31.670048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:30:31.670048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 04 01:30:31.670048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 04 01:30:31.670048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 04 01:30:31.670048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 04 01:30:31.670048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:30:31.670048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:30:31.670048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 01:30:31.670048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 01:30:31.670048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 01:30:31.670048 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 01:30:31.672841 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 01:30:31.672841 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 01:30:31.672841 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 01:30:31.672841 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 01:30:31.672841 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 01:30:31.672841 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 01:30:31.672841 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 01:30:31.672841 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 01:30:31.672841 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 01:30:31.672841 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 01:30:31.672841 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 04 01:30:31.672841 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 01:30:31.672841 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 754d7223129e424fbdd07939b5f00ff8. Sep 04 01:30:31.672841 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:30:31.672841 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3437/6851] 10.222.0.30 () {58 vars in 1227 bytes} [Sun Sep 4 01:30:31 2022] GET /identity/v3/domains/754d7223129e424fbdd07939b5f00ff8 => generated 112 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:30:31.674619 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c426c0-b86d-4b4e-9c79-4207c81670d9 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:31.675626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37430cba-1f1d-416b-b745-516803304a65 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:31.688706 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f8c426c0-b86d-4b4e-9c79-4207c81670d9 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:31.798473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-37430cba-1f1d-416b-b745-516803304a65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '776b31b331fc47dcba674a52393feba2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:31.800049 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-37430cba-1f1d-416b-b745-516803304a65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '776b31b331fc47dcba674a52393feba2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:31.816483 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-37430cba-1f1d-416b-b745-516803304a65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '776b31b331fc47dcba674a52393feba2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:31.838235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-37430cba-1f1d-416b-b745-516803304a65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '776b31b331fc47dcba674a52393feba2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:31.839704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-37430cba-1f1d-416b-b745-516803304a65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '776b31b331fc47dcba674a52393feba2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:31.842222 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c426c0-b86d-4b4e-9c79-4207c81670d9 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:31.848927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45da64-d885-418a-b267-8323ccbc6751 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:31.849606 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45da64-d885-418a-b267-8323ccbc6751 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:31.849888 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45da64-d885-418a-b267-8323ccbc6751 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:31.850160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45da64-d885-418a-b267-8323ccbc6751 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:31.854058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ea45da64-d885-418a-b267-8323ccbc6751 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:31.877160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45da64-d885-418a-b267-8323ccbc6751 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:31.878556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45da64-d885-418a-b267-8323ccbc6751 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:31.899132 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3415/6852] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:31 2022] DELETE /identity/v3/users/776b31b331fc47dcba674a52393feba2 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:31.900975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37430cba-1f1d-416b-b745-516803304a65 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:31.913408 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-37430cba-1f1d-416b-b745-516803304a65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:31.934130 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3438/6853] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:30:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:30:31.935819 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45da64-d885-418a-b267-8323ccbc6751 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:31.940984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ea45da64-d885-418a-b267-8323ccbc6751 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:31.967978 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45da64-d885-418a-b267-8323ccbc6751 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:32.047456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98be23c-ebef-432f-b048-f5c383a0398e tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '804b1372719346c1b75b48a8cd828402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6404bdfa77d241c19341d5c811fd63f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:32.048316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98be23c-ebef-432f-b048-f5c383a0398e tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:32.049802 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98be23c-ebef-432f-b048-f5c383a0398e tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:32.050248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98be23c-ebef-432f-b048-f5c383a0398e tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] PATH_INFO: `/v3/users/9b4e74b886f140da971dc93ccd4bc9d8` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:32.075393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98be23c-ebef-432f-b048-f5c383a0398e tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorizing `identity:get_user(user_id=9b4e74b886f140da971dc93ccd4bc9d8)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:32.077582 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98be23c-ebef-432f-b048-f5c383a0398e tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:32.104035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37430cba-1f1d-416b-b745-516803304a65 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:32.109088 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f9c04-7114-4b07-b67a-e346c8210e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:32.109748 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f9c04-7114-4b07-b67a-e346c8210e96 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:32.110030 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f9c04-7114-4b07-b67a-e346c8210e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:32.110601 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f9c04-7114-4b07-b67a-e346c8210e96 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:32.112594 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f9c04-7114-4b07-b67a-e346c8210e96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:32.114286 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f9c04-7114-4b07-b67a-e346c8210e96 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:32.146652 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3416/6854] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:30:31 2022] POST /identity/v3/users => generated 286 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:32.150783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f9c04-7114-4b07-b67a-e346c8210e96 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:32.159742 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:32.168574 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f9c04-7114-4b07-b67a-e346c8210e96 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:32.176415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82613f89-1d3c-4f97-9f53-06a1501cf109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:32.177184 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82613f89-1d3c-4f97-9f53-06a1501cf109 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:32.177488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82613f89-1d3c-4f97-9f53-06a1501cf109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:32.177765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82613f89-1d3c-4f97-9f53-06a1501cf109 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:32.178601 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82613f89-1d3c-4f97-9f53-06a1501cf109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:32.182080 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82613f89-1d3c-4f97-9f53-06a1501cf109 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:32.184743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-e98be23c-ebef-432f-b048-f5c383a0398e tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Could not find user: 9b4e74b886f140da971dc93ccd4bc9d8.: keystone.exception.UserNotFound: Could not find user: 9b4e74b886f140da971dc93ccd4bc9d8. Sep 04 01:30:32.184743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:30:32.184743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:30:32.184743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:30:32.184743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:30:32.184743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:30:32.184743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:30:32.184743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:30:32.184743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:30:32.184743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:30:32.184743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:30:32.184743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:30:32.184743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 04 01:30:32.184743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 04 01:30:32.184743 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 04 01:30:32.186051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 04 01:30:32.186051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:30:32.186051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:30:32.186051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 01:30:32.186051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 01:30:32.186051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 01:30:32.186051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 01:30:32.186051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 01:30:32.186051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 01:30:32.186051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 01:30:32.186051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 01:30:32.186051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 01:30:32.186051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 01:30:32.186051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 01:30:32.186051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 01:30:32.186051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 01:30:32.186051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 01:30:32.187051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 01:30:32.187051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 01:30:32.187051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 01:30:32.187051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 01:30:32.187051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 01:30:32.187051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 01:30:32.187051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 01:30:32.187051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 01:30:32.187051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 01:30:32.187051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 01:30:32.187051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 9b4e74b886f140da971dc93ccd4bc9d8. Sep 04 01:30:32.187051 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:30:32.189298 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3439/6855] 10.222.0.30 () {58 vars in 1221 bytes} [Sun Sep 4 01:30:31 2022] GET /identity/v3/users/9b4e74b886f140da971dc93ccd4bc9d8 => generated 110 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:30:32.195125 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98be23c-ebef-432f-b048-f5c383a0398e tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:32.199716 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3417/6856] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:32.203916 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82613f89-1d3c-4f97-9f53-06a1501cf109 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:32.211532 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98be23c-ebef-432f-b048-f5c383a0398e tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:32.229970 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b526d5-fff5-435f-afa8-c9586a5b00e8 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '804b1372719346c1b75b48a8cd828402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6404bdfa77d241c19341d5c811fd63f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:32.236774 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b526d5-fff5-435f-afa8-c9586a5b00e8 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:32.237531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b526d5-fff5-435f-afa8-c9586a5b00e8 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:32.238958 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b526d5-fff5-435f-afa8-c9586a5b00e8 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] PATH_INFO: `/v3/groups/3a0586ff7e424884b2c9fb76ea857166` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:32.245242 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82613f89-1d3c-4f97-9f53-06a1501cf109 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:32.254448 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64087cb1-0d25-465b-ba48-e37d2d2f1321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:32.255821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64087cb1-0d25-465b-ba48-e37d2d2f1321 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:32.256464 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64087cb1-0d25-465b-ba48-e37d2d2f1321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:32.256901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64087cb1-0d25-465b-ba48-e37d2d2f1321 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:32.257931 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64087cb1-0d25-465b-ba48-e37d2d2f1321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:32.260420 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64087cb1-0d25-465b-ba48-e37d2d2f1321 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:32.260765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b526d5-fff5-435f-afa8-c9586a5b00e8 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorizing `identity:get_group(group_id=3a0586ff7e424884b2c9fb76ea857166)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:32.263019 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-c6b526d5-fff5-435f-afa8-c9586a5b00e8 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:30:32.263019 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:30:32.263019 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:30:32.266124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b526d5-fff5-435f-afa8-c9586a5b00e8 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:32.293537 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3418/6857] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:32.293994 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64087cb1-0d25-465b-ba48-e37d2d2f1321 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:32.296981 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-c6b526d5-fff5-435f-afa8-c9586a5b00e8 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Could not find group: 3a0586ff7e424884b2c9fb76ea857166.: keystone.exception.GroupNotFound: Could not find group: 3a0586ff7e424884b2c9fb76ea857166. Sep 04 01:30:32.296981 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:30:32.296981 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:30:32.296981 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:30:32.296981 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:30:32.296981 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:30:32.296981 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:30:32.296981 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:30:32.296981 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:30:32.296981 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:30:32.296981 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:30:32.296981 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:30:32.296981 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Sep 04 01:30:32.296981 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_group(group_id) Sep 04 01:30:32.296981 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Sep 04 01:30:32.298128 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Sep 04 01:30:32.298128 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:30:32.298128 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:30:32.298128 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 01:30:32.298128 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 01:30:32.298128 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 01:30:32.298128 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 01:30:32.298128 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 01:30:32.298128 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 01:30:32.298128 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 01:30:32.298128 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 01:30:32.298128 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 01:30:32.298128 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 01:30:32.298128 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 01:30:32.298128 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 01:30:32.298128 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 01:30:32.298128 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 01:30:32.299161 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 01:30:32.299161 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 01:30:32.299161 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 01:30:32.299161 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 01:30:32.299161 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Sep 04 01:30:32.299161 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Sep 04 01:30:32.299161 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Sep 04 01:30:32.299161 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Sep 04 01:30:32.299161 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Sep 04 01:30:32.299161 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Sep 04 01:30:32.299161 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 3a0586ff7e424884b2c9fb76ea857166. Sep 04 01:30:32.299161 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:30:32.303561 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3440/6858] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:32 2022] GET /identity/v3/groups/3a0586ff7e424884b2c9fb76ea857166 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Sep 04 01:30:32.307940 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b526d5-fff5-435f-afa8-c9586a5b00e8 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:32.316615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64087cb1-0d25-465b-ba48-e37d2d2f1321 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:32.328445 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b526d5-fff5-435f-afa8-c9586a5b00e8 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:32.340439 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba8d3d-87b4-4173-87aa-c34ee6516c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:32.341028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba8d3d-87b4-4173-87aa-c34ee6516c69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:32.341945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba8d3d-87b4-4173-87aa-c34ee6516c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:32.342228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba8d3d-87b4-4173-87aa-c34ee6516c69 admin admin] PATH_INFO: `/v3/projects/235d5bb9523d488a9bfaae38b5128b0f/users/06a4e1e010db461eb326c57ba3a418bd/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:32.344541 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac980a-dc4c-4846-9759-c0fd6dc5e295 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '804b1372719346c1b75b48a8cd828402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6404bdfa77d241c19341d5c811fd63f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:32.349774 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac980a-dc4c-4846-9759-c0fd6dc5e295 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:32.349774 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac980a-dc4c-4846-9759-c0fd6dc5e295 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:32.349774 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac980a-dc4c-4846-9759-c0fd6dc5e295 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] PATH_INFO: `/v3/groups/3a0586ff7e424884b2c9fb76ea857166` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:32.374254 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac980a-dc4c-4846-9759-c0fd6dc5e295 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 01:30:32.376043 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba8d3d-87b4-4173-87aa-c34ee6516c69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=235d5bb9523d488a9bfaae38b5128b0f, user_id=06a4e1e010db461eb326c57ba3a418bd, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:32.380227 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba8d3d-87b4-4173-87aa-c34ee6516c69 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:32.385815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-b0ac980a-dc4c-4846-9759-c0fd6dc5e295 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Could not find group: 3a0586ff7e424884b2c9fb76ea857166.: keystone.exception.GroupNotFound: Could not find group: 3a0586ff7e424884b2c9fb76ea857166. Sep 04 01:30:32.385815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:30:32.385815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:30:32.385815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:30:32.385815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:30:32.385815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:30:32.385815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:30:32.385815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:30:32.385815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:30:32.385815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:30:32.385815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:30:32.385815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:30:32.385815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Sep 04 01:30:32.385815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Sep 04 01:30:32.386902 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 01:30:32.386902 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 01:30:32.386902 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 01:30:32.386902 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 01:30:32.386902 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:30:32.386902 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:30:32.386902 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 01:30:32.386902 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 01:30:32.386902 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 01:30:32.386902 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 01:30:32.386902 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 01:30:32.386902 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 01:30:32.386902 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 01:30:32.386902 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 01:30:32.386902 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 01:30:32.386902 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 01:30:32.386902 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 01:30:32.387949 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 01:30:32.387949 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 01:30:32.387949 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 01:30:32.387949 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 01:30:32.387949 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 01:30:32.387949 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 01:30:32.387949 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 01:30:32.387949 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Sep 04 01:30:32.387949 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Sep 04 01:30:32.387949 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Sep 04 01:30:32.387949 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Sep 04 01:30:32.387949 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Sep 04 01:30:32.387949 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Sep 04 01:30:32.387949 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 3a0586ff7e424884b2c9fb76ea857166. Sep 04 01:30:32.387949 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:30:32.390236 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3441/6859] 10.222.0.30 () {58 vars in 1227 bytes} [Sun Sep 4 01:30:32 2022] DELETE /identity/v3/groups/3a0586ff7e424884b2c9fb76ea857166 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:30:32.398506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac980a-dc4c-4846-9759-c0fd6dc5e295 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:32.405481 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3419/6860] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:30:32 2022] PUT /identity/v3/projects/235d5bb9523d488a9bfaae38b5128b0f/users/06a4e1e010db461eb326c57ba3a418bd/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:32.417283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4ac5f-070e-41ca-8b4c-7223db5e11e2 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:32.419369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4ac5f-070e-41ca-8b4c-7223db5e11e2 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:32.419668 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4ac5f-070e-41ca-8b4c-7223db5e11e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:32.430458 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac980a-dc4c-4846-9759-c0fd6dc5e295 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:32.520871 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-6db4ac5f-070e-41ca-8b4c-7223db5e11e2 None None] MFA Rules not processed for user `06a4e1e010db461eb326c57ba3a418bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:32.524439 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6db4ac5f-070e-41ca-8b4c-7223db5e11e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:32.634575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eec7fc-8dc2-4482-9e2d-3b8c660b2632 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '804b1372719346c1b75b48a8cd828402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6404bdfa77d241c19341d5c811fd63f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:32.637793 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eec7fc-8dc2-4482-9e2d-3b8c660b2632 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:32.637932 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eec7fc-8dc2-4482-9e2d-3b8c660b2632 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:32.638141 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eec7fc-8dc2-4482-9e2d-3b8c660b2632 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] PATH_INFO: `/v3/users/9b4e74b886f140da971dc93ccd4bc9d8` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:32.671062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eec7fc-8dc2-4482-9e2d-3b8c660b2632 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9b4e74b886f140da971dc93ccd4bc9d8)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:32.673028 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eec7fc-8dc2-4482-9e2d-3b8c660b2632 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:32.678184 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3420/6861] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:32.694777 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4ac5f-070e-41ca-8b4c-7223db5e11e2 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:32.700794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6db4ac5f-070e-41ca-8b4c-7223db5e11e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:32.715536 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-97eec7fc-8dc2-4482-9e2d-3b8c660b2632 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Could not find user: 9b4e74b886f140da971dc93ccd4bc9d8.: keystone.exception.UserNotFound: Could not find user: 9b4e74b886f140da971dc93ccd4bc9d8. Sep 04 01:30:32.715536 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:30:32.715536 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:30:32.715536 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:30:32.715536 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:30:32.715536 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:30:32.715536 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:30:32.715536 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:30:32.715536 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:30:32.715536 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:30:32.715536 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:30:32.715536 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:30:32.715536 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Sep 04 01:30:32.715536 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Sep 04 01:30:32.716498 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:30:32.716498 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:30:32.716498 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 01:30:32.716498 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 01:30:32.716498 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 01:30:32.716498 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 01:30:32.716498 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Sep 04 01:30:32.716498 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Sep 04 01:30:32.716498 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:30:32.716498 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:30:32.716498 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 01:30:32.716498 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 01:30:32.716498 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 01:30:32.716498 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 01:30:32.716498 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 01:30:32.716498 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 01:30:32.716498 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 01:30:32.716498 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 01:30:32.718047 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 01:30:32.718047 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 01:30:32.718047 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 01:30:32.718047 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 01:30:32.718047 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 01:30:32.718047 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 01:30:32.718047 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 01:30:32.718047 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 01:30:32.718047 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 01:30:32.718047 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 01:30:32.718047 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 04 01:30:32.718047 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 04 01:30:32.718047 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 04 01:30:32.718047 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 04 01:30:32.718047 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 04 01:30:32.718047 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 04 01:30:32.718047 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 9b4e74b886f140da971dc93ccd4bc9d8. Sep 04 01:30:32.718047 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:30:32.721100 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3442/6862] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:32 2022] DELETE /identity/v3/users/9b4e74b886f140da971dc93ccd4bc9d8 => generated 110 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:30:32.725231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eec7fc-8dc2-4482-9e2d-3b8c660b2632 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:32.761146 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eec7fc-8dc2-4482-9e2d-3b8c660b2632 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:32.772725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f5cc3-f5e8-4b3b-ab57-a35169f87485 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '804b1372719346c1b75b48a8cd828402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6404bdfa77d241c19341d5c811fd63f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:32.773825 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f5cc3-f5e8-4b3b-ab57-a35169f87485 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:32.774341 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f5cc3-f5e8-4b3b-ab57-a35169f87485 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:32.774865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f5cc3-f5e8-4b3b-ab57-a35169f87485 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] PATH_INFO: `/v3/domains/754d7223129e424fbdd07939b5f00ff8` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:32.786342 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:32.792037 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48f5cc3-f5e8-4b3b-ab57-a35169f87485 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 01:30:32.801101 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-e48f5cc3-f5e8-4b3b-ab57-a35169f87485 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Could not find domain: 754d7223129e424fbdd07939b5f00ff8.: keystone.exception.DomainNotFound: Could not find domain: 754d7223129e424fbdd07939b5f00ff8. Sep 04 01:30:32.801101 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:30:32.801101 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 04 01:30:32.801101 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 04 01:30:32.801101 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 01:30:32.801101 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 01:30:32.801101 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 01:30:32.801101 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 01:30:32.801101 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 754d7223129e424fbdd07939b5f00ff8. Sep 04 01:30:32.801101 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:30:32.801101 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:30:32.801101 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:30:32.801101 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:30:32.801101 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:30:32.801101 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:30:32.801101 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:30:32.802324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:30:32.802324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:30:32.802324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:30:32.802324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:30:32.802324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:30:32.802324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:30:32.802324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:30:32.802324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 04 01:30:32.802324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 04 01:30:32.802324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 01:30:32.802324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 01:30:32.802324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 01:30:32.802324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 01:30:32.802324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:30:32.802324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:30:32.802324 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 01:30:32.803270 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 01:30:32.803270 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 01:30:32.803270 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 01:30:32.803270 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 01:30:32.803270 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 01:30:32.803270 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 01:30:32.803270 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 01:30:32.803270 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 01:30:32.803270 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 01:30:32.803270 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 01:30:32.803270 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 01:30:32.803270 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 01:30:32.803270 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 01:30:32.803270 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 04 01:30:32.803270 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 01:30:32.803270 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 754d7223129e424fbdd07939b5f00ff8. Sep 04 01:30:32.803270 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:30:32.809383 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3443/6863] 10.222.0.30 () {60 vars in 1249 bytes} [Sun Sep 4 01:30:32 2022] PATCH /identity/v3/domains/754d7223129e424fbdd07939b5f00ff8 => generated 112 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:30:32.811646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f5cc3-f5e8-4b3b-ab57-a35169f87485 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:32.834243 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f5cc3-f5e8-4b3b-ab57-a35169f87485 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:32.853576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c9629-2369-4196-92f1-04c16a5182e2 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '804b1372719346c1b75b48a8cd828402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6404bdfa77d241c19341d5c811fd63f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:32.854836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c9629-2369-4196-92f1-04c16a5182e2 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:32.855135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c9629-2369-4196-92f1-04c16a5182e2 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:32.858947 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c9629-2369-4196-92f1-04c16a5182e2 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:32.859310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c9629-2369-4196-92f1-04c16a5182e2 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:32.862406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4ac5f-070e-41ca-8b4c-7223db5e11e2 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:32.863154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c9629-2369-4196-92f1-04c16a5182e2 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:32.870654 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa14d9-1487-4c4c-a8b1-84746bf0dee9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:32.871292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa14d9-1487-4c4c-a8b1-84746bf0dee9 service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:32.871577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa14d9-1487-4c4c-a8b1-84746bf0dee9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:32.871856 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa14d9-1487-4c4c-a8b1-84746bf0dee9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:32.894336 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa14d9-1487-4c4c-a8b1-84746bf0dee9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:32.895442 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa14d9-1487-4c4c-a8b1-84746bf0dee9 service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:32.898044 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3444/6864] 10.222.0.30 () {58 vars in 1128 bytes} [Sun Sep 4 01:30:32 2022] GET /identity/v3/domains => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:32.899501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c9629-2369-4196-92f1-04c16a5182e2 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:32.901545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ca6c9629-2369-4196-92f1-04c16a5182e2 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:32.930372 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3421/6865] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:30:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:30:32.931283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa14d9-1487-4c4c-a8b1-84746bf0dee9 service cinder] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:32.960487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa14d9-1487-4c4c-a8b1-84746bf0dee9 service cinder] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:32.982196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a7d3a-b261-48ee-b8d0-fe4f00c2a3d6 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '804b1372719346c1b75b48a8cd828402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6404bdfa77d241c19341d5c811fd63f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:32.983025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a7d3a-b261-48ee-b8d0-fe4f00c2a3d6 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:32.983311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a7d3a-b261-48ee-b8d0-fe4f00c2a3d6 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:32.983594 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a7d3a-b261-48ee-b8d0-fe4f00c2a3d6 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:32.984406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a7d3a-b261-48ee-b8d0-fe4f00c2a3d6 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:30:32.985628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a7d3a-b261-48ee-b8d0-fe4f00c2a3d6 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:33.010519 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a7d3a-b261-48ee-b8d0-fe4f00c2a3d6 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:33.077045 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3422/6866] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:30:32 2022] GET /identity/v3/domains?enabled=True => generated 1096 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:33.077045 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a7d3a-b261-48ee-b8d0-fe4f00c2a3d6 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:33.078741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-fd1a7d3a-b261-48ee-b8d0-fe4f00c2a3d6 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:33.095983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c9629-2369-4196-92f1-04c16a5182e2 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:33.103257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c3f2e-e12f-44a6-9846-bdf6d2483af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:33.103911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c3f2e-e12f-44a6-9846-bdf6d2483af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:33.104198 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c3f2e-e12f-44a6-9846-bdf6d2483af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:33.104485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c3f2e-e12f-44a6-9846-bdf6d2483af3 admin admin] PATH_INFO: `/v3/projects/3949d553f6b3436182e40a5f800e056b` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:33.105710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c3f2e-e12f-44a6-9846-bdf6d2483af3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3949d553f6b3436182e40a5f800e056b)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:33.107710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c3f2e-e12f-44a6-9846-bdf6d2483af3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:33.108570 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a7d3a-b261-48ee-b8d0-fe4f00c2a3d6 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:33.142837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5473b-18df-42cb-ae3e-a83d9b4e6ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:33.144281 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5473b-18df-42cb-ae3e-a83d9b4e6ed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:33.144645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5473b-18df-42cb-ae3e-a83d9b4e6ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:33.145003 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5473b-18df-42cb-ae3e-a83d9b4e6ed9 admin admin] PATH_INFO: `/v3/projects/d07274c87c09468fa3ec11d8a46ad2e0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:33.147800 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5473b-18df-42cb-ae3e-a83d9b4e6ed9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d07274c87c09468fa3ec11d8a46ad2e0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:33.150002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5473b-18df-42cb-ae3e-a83d9b4e6ed9 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:33.227714 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a48c3f2e-e12f-44a6-9846-bdf6d2483af3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3949d553f6b3436182e40a5f800e056b', 'request_id': 'req-a48c3f2e-e12f-44a6-9846-bdf6d2483af3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:33.238918 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a48c3f2e-e12f-44a6-9846-bdf6d2483af3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3949d553f6b3436182e40a5f800e056b', 'request_id': 'req-a48c3f2e-e12f-44a6-9846-bdf6d2483af3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:33.257291 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a48c3f2e-e12f-44a6-9846-bdf6d2483af3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3949d553f6b3436182e40a5f800e056b', 'request_id': 'req-a48c3f2e-e12f-44a6-9846-bdf6d2483af3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:33.262257 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:33.276061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a48c3f2e-e12f-44a6-9846-bdf6d2483af3 admin admin] The token cache is being invalidate because project 3949d553f6b3436182e40a5f800e056b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:30:33.276392 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a48c3f2e-e12f-44a6-9846-bdf6d2483af3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:33.278287 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a48c3f2e-e12f-44a6-9846-bdf6d2483af3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:33.282761 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3445/6867] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:30:32 2022] DELETE /identity/v3/projects/3949d553f6b3436182e40a5f800e056b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:33.283657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c3f2e-e12f-44a6-9846-bdf6d2483af3 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:33.286431 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a48c3f2e-e12f-44a6-9846-bdf6d2483af3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:33.317539 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-bdc5473b-18df-42cb-ae3e-a83d9b4e6ed9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd07274c87c09468fa3ec11d8a46ad2e0', 'request_id': 'req-bdc5473b-18df-42cb-ae3e-a83d9b4e6ed9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:33.349092 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-bdc5473b-18df-42cb-ae3e-a83d9b4e6ed9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd07274c87c09468fa3ec11d8a46ad2e0', 'request_id': 'req-bdc5473b-18df-42cb-ae3e-a83d9b4e6ed9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:33.370452 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-bdc5473b-18df-42cb-ae3e-a83d9b4e6ed9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd07274c87c09468fa3ec11d8a46ad2e0', 'request_id': 'req-bdc5473b-18df-42cb-ae3e-a83d9b4e6ed9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:33.411946 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-bdc5473b-18df-42cb-ae3e-a83d9b4e6ed9 admin admin] The token cache is being invalidate because project d07274c87c09468fa3ec11d8a46ad2e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:30:33.414498 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-bdc5473b-18df-42cb-ae3e-a83d9b4e6ed9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:33.417728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-bdc5473b-18df-42cb-ae3e-a83d9b4e6ed9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:33.426261 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3423/6868] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:30:33 2022] DELETE /identity/v3/projects/d07274c87c09468fa3ec11d8a46ad2e0 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:33.428008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5473b-18df-42cb-ae3e-a83d9b4e6ed9 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:33.432500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bdc5473b-18df-42cb-ae3e-a83d9b4e6ed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:33.434032 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c3f2e-e12f-44a6-9846-bdf6d2483af3 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:33.477172 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:33.542514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a28a6b-4105-4f3c-96a7-610ed66a2fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:33.543432 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a28a6b-4105-4f3c-96a7-610ed66a2fed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:33.543721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a28a6b-4105-4f3c-96a7-610ed66a2fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:33.543997 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a28a6b-4105-4f3c-96a7-610ed66a2fed admin admin] PATH_INFO: `/v3/users/06a4e1e010db461eb326c57ba3a418bd` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:33.545180 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a28a6b-4105-4f3c-96a7-610ed66a2fed admin admin] RBAC: Authorizing `identity:delete_user(user_id=06a4e1e010db461eb326c57ba3a418bd)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:33.547169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a28a6b-4105-4f3c-96a7-610ed66a2fed admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:33.590348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5473b-18df-42cb-ae3e-a83d9b4e6ed9 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:33.595976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd3627-fe1c-4d2b-915d-477a8184d920 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '804b1372719346c1b75b48a8cd828402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6404bdfa77d241c19341d5c811fd63f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:33.597556 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd3627-fe1c-4d2b-915d-477a8184d920 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:33.599213 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd3627-fe1c-4d2b-915d-477a8184d920 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:33.599721 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd3627-fe1c-4d2b-915d-477a8184d920 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:33.600679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd3627-fe1c-4d2b-915d-477a8184d920 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-1645165643) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:30:33.601174 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd3627-fe1c-4d2b-915d-477a8184d920 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:33.603150 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd3627-fe1c-4d2b-915d-477a8184d920 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:33.627682 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e3a28a6b-4105-4f3c-96a7-610ed66a2fed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06a4e1e010db461eb326c57ba3a418bd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:33.627682 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e3a28a6b-4105-4f3c-96a7-610ed66a2fed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06a4e1e010db461eb326c57ba3a418bd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:33.637715 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3424/6869] 10.222.0.30 () {58 vars in 1199 bytes} [Sun Sep 4 01:30:33 2022] GET /identity/v3/domains?name=tempest-test_domain-1645165643 => generated 409 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:33.638055 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e3a28a6b-4105-4f3c-96a7-610ed66a2fed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06a4e1e010db461eb326c57ba3a418bd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:33.639265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbb7db-4c3d-4a65-bc82-97b9e149db38 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:33.639564 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbb7db-4c3d-4a65-bc82-97b9e149db38 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:33.640209 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbb7db-4c3d-4a65-bc82-97b9e149db38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:33.672230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e3a28a6b-4105-4f3c-96a7-610ed66a2fed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06a4e1e010db461eb326c57ba3a418bd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:33.672230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e3a28a6b-4105-4f3c-96a7-610ed66a2fed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06a4e1e010db461eb326c57ba3a418bd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:33.672539 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-dcfbb7db-4c3d-4a65-bc82-97b9e149db38 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:33.672539 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-dcfbb7db-4c3d-4a65-bc82-97b9e149db38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:33.691760 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3425/6870] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:33.696049 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3446/6871] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:33 2022] DELETE /identity/v3/users/06a4e1e010db461eb326c57ba3a418bd => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:33.696156 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbb7db-4c3d-4a65-bc82-97b9e149db38 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:33.696239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a28a6b-4105-4f3c-96a7-610ed66a2fed admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:33.696239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e3a28a6b-4105-4f3c-96a7-610ed66a2fed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:33.696404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-dcfbb7db-4c3d-4a65-bc82-97b9e149db38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:33.710432 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbb7db-4c3d-4a65-bc82-97b9e149db38 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:33.784688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a28a6b-4105-4f3c-96a7-610ed66a2fed admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:33.790462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb0b0b-b2ff-4aa5-82f4-e7fe1706452d tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '804b1372719346c1b75b48a8cd828402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6404bdfa77d241c19341d5c811fd63f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:33.791305 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642548f-6d4d-4162-b414-9c7e9e6b23fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:33.791985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb0b0b-b2ff-4aa5-82f4-e7fe1706452d tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:33.792339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb0b0b-b2ff-4aa5-82f4-e7fe1706452d tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:33.792687 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb0b0b-b2ff-4aa5-82f4-e7fe1706452d tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] PATH_INFO: `/v3/domains/754d7223129e424fbdd07939b5f00ff8` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:33.795115 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642548f-6d4d-4162-b414-9c7e9e6b23fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:33.795418 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642548f-6d4d-4162-b414-9c7e9e6b23fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:33.795691 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642548f-6d4d-4162-b414-9c7e9e6b23fb admin admin] PATH_INFO: `/v3/users/9a4c861028c740a8b5097eb5eb64d3a8` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:33.801830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb0b0b-b2ff-4aa5-82f4-e7fe1706452d tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 01:30:33.803955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642548f-6d4d-4162-b414-9c7e9e6b23fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a4c861028c740a8b5097eb5eb64d3a8)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:33.807574 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642548f-6d4d-4162-b414-9c7e9e6b23fb admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:33.807704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-12fb0b0b-b2ff-4aa5-82f4-e7fe1706452d tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Could not find domain: 754d7223129e424fbdd07939b5f00ff8.: keystone.exception.DomainNotFound: Could not find domain: 754d7223129e424fbdd07939b5f00ff8. Sep 04 01:30:33.807704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:30:33.807704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 04 01:30:33.807704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 04 01:30:33.807704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 01:30:33.807704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 01:30:33.807704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 01:30:33.807704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 01:30:33.807704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 754d7223129e424fbdd07939b5f00ff8. Sep 04 01:30:33.807704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:30:33.807704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:30:33.807704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:30:33.807704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:30:33.807704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:30:33.807704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:30:33.807704 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:30:33.808700 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:30:33.808700 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:30:33.808700 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:30:33.808700 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:30:33.808700 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:30:33.808700 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:30:33.808700 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:30:33.808700 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 04 01:30:33.808700 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 04 01:30:33.808700 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 01:30:33.808700 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 01:30:33.808700 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 01:30:33.808700 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 01:30:33.808700 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:30:33.808700 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:30:33.808700 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 01:30:33.809745 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 01:30:33.809745 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 01:30:33.809745 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 01:30:33.809745 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 01:30:33.809745 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 01:30:33.809745 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 01:30:33.809745 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 01:30:33.809745 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 01:30:33.809745 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 01:30:33.809745 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 01:30:33.809745 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 01:30:33.809745 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 01:30:33.809745 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 01:30:33.809745 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 04 01:30:33.809745 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 01:30:33.809745 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 754d7223129e424fbdd07939b5f00ff8. Sep 04 01:30:33.809745 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:30:33.810750 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3447/6872] 10.222.0.30 () {60 vars in 1249 bytes} [Sun Sep 4 01:30:33 2022] PATCH /identity/v3/domains/754d7223129e424fbdd07939b5f00ff8 => generated 112 bytes in 116 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:30:33.810750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e53308-a327-439f-b5ec-3104befc8923 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:33.810885 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e53308-a327-439f-b5ec-3104befc8923 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:33.812066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e53308-a327-439f-b5ec-3104befc8923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:33.839317 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-60e53308-a327-439f-b5ec-3104befc8923 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:33.840717 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-60e53308-a327-439f-b5ec-3104befc8923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:33.870977 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3448/6873] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:33.870977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac13cc-530c-4b78-a834-3479ffd483c0 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:33.870977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac13cc-530c-4b78-a834-3479ffd483c0 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:33.870977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac13cc-530c-4b78-a834-3479ffd483c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:33.897535 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-45ac13cc-530c-4b78-a834-3479ffd483c0 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:33.899160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-45ac13cc-530c-4b78-a834-3479ffd483c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:33.902014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b642548f-6d4d-4162-b414-9c7e9e6b23fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a4c861028c740a8b5097eb5eb64d3a8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:33.902742 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b642548f-6d4d-4162-b414-9c7e9e6b23fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a4c861028c740a8b5097eb5eb64d3a8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:33.906645 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:33.909522 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3449/6874] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:33.910296 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac13cc-530c-4b78-a834-3479ffd483c0 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:33.914582 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b642548f-6d4d-4162-b414-9c7e9e6b23fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a4c861028c740a8b5097eb5eb64d3a8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:33.915274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-45ac13cc-530c-4b78-a834-3479ffd483c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:33.933927 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b642548f-6d4d-4162-b414-9c7e9e6b23fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a4c861028c740a8b5097eb5eb64d3a8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:33.934774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b642548f-6d4d-4162-b414-9c7e9e6b23fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a4c861028c740a8b5097eb5eb64d3a8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:33.938765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac13cc-530c-4b78-a834-3479ffd483c0 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:33.945554 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cbc27-4c7d-4655-88c0-9c309fa8b613 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '804b1372719346c1b75b48a8cd828402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6404bdfa77d241c19341d5c811fd63f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:33.946271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cbc27-4c7d-4655-88c0-9c309fa8b613 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:33.946595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cbc27-4c7d-4655-88c0-9c309fa8b613 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:33.946876 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cbc27-4c7d-4655-88c0-9c309fa8b613 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] PATH_INFO: `/v3/domains/11c5afdd5ca340958b04fc972175962c` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:33.959118 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8cbc27-4c7d-4655-88c0-9c309fa8b613 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=11c5afdd5ca340958b04fc972175962c)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:33.960765 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3426/6875] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:33 2022] DELETE /identity/v3/users/9a4c861028c740a8b5097eb5eb64d3a8 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:33.963794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8cbc27-4c7d-4655-88c0-9c309fa8b613 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:33.963906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642548f-6d4d-4162-b414-9c7e9e6b23fb admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:33.965116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b642548f-6d4d-4162-b414-9c7e9e6b23fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:33.981256 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:34.024285 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3450/6876] 10.222.0.30 () {60 vars in 1249 bytes} [Sun Sep 4 01:30:33 2022] PATCH /identity/v3/domains/11c5afdd5ca340958b04fc972175962c => generated 277 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:34.024285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cbc27-4c7d-4655-88c0-9c309fa8b613 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:34.024285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4e8cbc27-4c7d-4655-88c0-9c309fa8b613 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:34.072382 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642548f-6d4d-4162-b414-9c7e9e6b23fb admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:34.079782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6c94b-b88c-4b2f-b830-80efa5d8dee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:34.080412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6c94b-b88c-4b2f-b830-80efa5d8dee5 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:34.080694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6c94b-b88c-4b2f-b830-80efa5d8dee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:34.081788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6c94b-b88c-4b2f-b830-80efa5d8dee5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:34.082453 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc6c94b-b88c-4b2f-b830-80efa5d8dee5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:30:34.082757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc6c94b-b88c-4b2f-b830-80efa5d8dee5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:34.084751 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc6c94b-b88c-4b2f-b830-80efa5d8dee5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:34.102367 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3427/6877] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:34.103241 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6c94b-b88c-4b2f-b830-80efa5d8dee5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:34.118972 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cbc27-4c7d-4655-88c0-9c309fa8b613 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:34.196575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6c94b-b88c-4b2f-b830-80efa5d8dee5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:34.204193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313f219-de6f-4115-a520-933c7721c936 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '804b1372719346c1b75b48a8cd828402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6404bdfa77d241c19341d5c811fd63f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:34.205164 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313f219-de6f-4115-a520-933c7721c936 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:34.205705 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313f219-de6f-4115-a520-933c7721c936 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:34.206134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313f219-de6f-4115-a520-933c7721c936 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] PATH_INFO: `/v3/domains/11c5afdd5ca340958b04fc972175962c` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:34.218888 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc9fab-445c-4f1b-b7fd-e27352f9de31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:34.219976 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc9fab-445c-4f1b-b7fd-e27352f9de31 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:34.220076 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc9fab-445c-4f1b-b7fd-e27352f9de31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:34.220877 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc9fab-445c-4f1b-b7fd-e27352f9de31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:34.235160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc9fab-445c-4f1b-b7fd-e27352f9de31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:34.237278 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc9fab-445c-4f1b-b7fd-e27352f9de31 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:34.238723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5313f219-de6f-4115-a520-933c7721c936 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=11c5afdd5ca340958b04fc972175962c)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:34.239874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5313f219-de6f-4115-a520-933c7721c936 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:34.252557 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3451/6878] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:30:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:30:34.253997 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc9fab-445c-4f1b-b7fd-e27352f9de31 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:34.267482 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc9fab-445c-4f1b-b7fd-e27352f9de31 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:34.280136 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42c8db-3981-4c83-b980-0428ed1521ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:34.280737 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5313f219-de6f-4115-a520-933c7721c936 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '11c5afdd5ca340958b04fc972175962c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:34.281030 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42c8db-3981-4c83-b980-0428ed1521ba admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:34.282088 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42c8db-3981-4c83-b980-0428ed1521ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:34.282088 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42c8db-3981-4c83-b980-0428ed1521ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:34.282542 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42c8db-3981-4c83-b980-0428ed1521ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:34.286700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42c8db-3981-4c83-b980-0428ed1521ba admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:34.304180 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5313f219-de6f-4115-a520-933c7721c936 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '11c5afdd5ca340958b04fc972175962c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:34.371517 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3452/6879] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:30:34 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:34.375344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42c8db-3981-4c83-b980-0428ed1521ba admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:34.400314 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:34.464413 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5313f219-de6f-4115-a520-933c7721c936 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11c5afdd5ca340958b04fc972175962c', 'request_id': 'req-5313f219-de6f-4115-a520-933c7721c936'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:34.476738 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5313f219-de6f-4115-a520-933c7721c936 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11c5afdd5ca340958b04fc972175962c', 'request_id': 'req-5313f219-de6f-4115-a520-933c7721c936'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:34.485939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5313f219-de6f-4115-a520-933c7721c936 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11c5afdd5ca340958b04fc972175962c', 'request_id': 'req-5313f219-de6f-4115-a520-933c7721c936'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:34.509639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5313f219-de6f-4115-a520-933c7721c936 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] The token cache is being invalidate because project 11c5afdd5ca340958b04fc972175962c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:30:34.510103 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5313f219-de6f-4115-a520-933c7721c936 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:34.510786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5313f219-de6f-4115-a520-933c7721c936 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:34.523605 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5313f219-de6f-4115-a520-933c7721c936 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '11c5afdd5ca340958b04fc972175962c', 'request_id': 'req-5313f219-de6f-4115-a520-933c7721c936'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:34.524238 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42c8db-3981-4c83-b980-0428ed1521ba admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:34.524976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5313f219-de6f-4115-a520-933c7721c936 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '11c5afdd5ca340958b04fc972175962c', 'request_id': 'req-5313f219-de6f-4115-a520-933c7721c936'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:34.526161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5313f219-de6f-4115-a520-933c7721c936 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '11c5afdd5ca340958b04fc972175962c', 'request_id': 'req-5313f219-de6f-4115-a520-933c7721c936'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:34.542036 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3428/6880] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:30:34 2022] DELETE /identity/v3/domains/11c5afdd5ca340958b04fc972175962c => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:34.546522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313f219-de6f-4115-a520-933c7721c936 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:34.548213 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5313f219-de6f-4115-a520-933c7721c936 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:34.583119 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:34.679482 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313f219-de6f-4115-a520-933c7721c936 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:34.686867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854ce00-e54b-49be-b564-51fb08d83b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:34.687931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854ce00-e54b-49be-b564-51fb08d83b20 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:34.688651 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854ce00-e54b-49be-b564-51fb08d83b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:34.689168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854ce00-e54b-49be-b564-51fb08d83b20 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:34.690078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854ce00-e54b-49be-b564-51fb08d83b20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:34.692467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854ce00-e54b-49be-b564-51fb08d83b20 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:34.702639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c32fe-bbba-45f1-8196-796724eee1b2 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '804b1372719346c1b75b48a8cd828402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6404bdfa77d241c19341d5c811fd63f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:34.713154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c32fe-bbba-45f1-8196-796724eee1b2 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:34.713550 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c32fe-bbba-45f1-8196-796724eee1b2 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:34.714632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c32fe-bbba-45f1-8196-796724eee1b2 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] PATH_INFO: `/v3/domains/c7a8fce2eddc4a39a1a83e9e46cacbde` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:34.728884 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3453/6881] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:30:34 2022] POST /identity/v3/users => generated 293 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:34.730229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854ce00-e54b-49be-b564-51fb08d83b20 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:34.734446 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b854ce00-e54b-49be-b564-51fb08d83b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:34.739563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c32fe-bbba-45f1-8196-796724eee1b2 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c7a8fce2eddc4a39a1a83e9e46cacbde)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:34.742096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c32fe-bbba-45f1-8196-796724eee1b2 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:34.752303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854ce00-e54b-49be-b564-51fb08d83b20 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:34.762868 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16900ec4-7fd3-477e-a1cb-96e76d55362d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:34.763746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16900ec4-7fd3-477e-a1cb-96e76d55362d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:34.764031 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16900ec4-7fd3-477e-a1cb-96e76d55362d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:34.764719 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16900ec4-7fd3-477e-a1cb-96e76d55362d admin admin] PATH_INFO: `/v3/projects/a1dd5932f7234a10bef4cb388cf1efe4` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:34.766050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16900ec4-7fd3-477e-a1cb-96e76d55362d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1dd5932f7234a10bef4cb388cf1efe4)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:34.768938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16900ec4-7fd3-477e-a1cb-96e76d55362d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:34.791035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ab3c32fe-bbba-45f1-8196-796724eee1b2 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c7a8fce2eddc4a39a1a83e9e46cacbde'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:34.794340 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ab3c32fe-bbba-45f1-8196-796724eee1b2 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c7a8fce2eddc4a39a1a83e9e46cacbde'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:34.865124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-16900ec4-7fd3-477e-a1cb-96e76d55362d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1dd5932f7234a10bef4cb388cf1efe4', 'request_id': 'req-16900ec4-7fd3-477e-a1cb-96e76d55362d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:34.873813 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ab3c32fe-bbba-45f1-8196-796724eee1b2 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c7a8fce2eddc4a39a1a83e9e46cacbde'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:34.874729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ab3c32fe-bbba-45f1-8196-796724eee1b2 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c7a8fce2eddc4a39a1a83e9e46cacbde'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:34.879101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-16900ec4-7fd3-477e-a1cb-96e76d55362d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1dd5932f7234a10bef4cb388cf1efe4', 'request_id': 'req-16900ec4-7fd3-477e-a1cb-96e76d55362d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:34.883545 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3429/6882] 10.222.0.30 () {60 vars in 1249 bytes} [Sun Sep 4 01:30:34 2022] PATCH /identity/v3/domains/c7a8fce2eddc4a39a1a83e9e46cacbde => generated 278 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:34.884557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c32fe-bbba-45f1-8196-796724eee1b2 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:34.890555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-16900ec4-7fd3-477e-a1cb-96e76d55362d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1dd5932f7234a10bef4cb388cf1efe4', 'request_id': 'req-16900ec4-7fd3-477e-a1cb-96e76d55362d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:34.891886 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ab3c32fe-bbba-45f1-8196-796724eee1b2 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:34.914701 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-16900ec4-7fd3-477e-a1cb-96e76d55362d admin admin] The token cache is being invalidate because project a1dd5932f7234a10bef4cb388cf1efe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:30:34.925571 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-16900ec4-7fd3-477e-a1cb-96e76d55362d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:34.926681 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-16900ec4-7fd3-477e-a1cb-96e76d55362d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:34.933817 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3454/6883] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:30:34 2022] DELETE /identity/v3/projects/a1dd5932f7234a10bef4cb388cf1efe4 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:34.935057 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16900ec4-7fd3-477e-a1cb-96e76d55362d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:34.936820 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-16900ec4-7fd3-477e-a1cb-96e76d55362d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:35.009540 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:35.016780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c32fe-bbba-45f1-8196-796724eee1b2 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:35.044496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16900ec4-7fd3-477e-a1cb-96e76d55362d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:35.049919 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95364d-5f4d-4770-89ad-2c5778bd0c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:35.050786 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95364d-5f4d-4770-89ad-2c5778bd0c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:35.051284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95364d-5f4d-4770-89ad-2c5778bd0c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:35.051716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95364d-5f4d-4770-89ad-2c5778bd0c0d admin admin] PATH_INFO: `/v3/projects/235d5bb9523d488a9bfaae38b5128b0f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:35.053226 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95364d-5f4d-4770-89ad-2c5778bd0c0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=235d5bb9523d488a9bfaae38b5128b0f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:35.062484 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95364d-5f4d-4770-89ad-2c5778bd0c0d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:35.089749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807ab9b-09c3-489d-8aff-fda76578a3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:35.090692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807ab9b-09c3-489d-8aff-fda76578a3fd admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:35.091084 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807ab9b-09c3-489d-8aff-fda76578a3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:35.091939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807ab9b-09c3-489d-8aff-fda76578a3fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:35.092909 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807ab9b-09c3-489d-8aff-fda76578a3fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:35.095838 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807ab9b-09c3-489d-8aff-fda76578a3fd admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:35.113193 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3430/6884] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:35.114552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807ab9b-09c3-489d-8aff-fda76578a3fd admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:35.115852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d807ab9b-09c3-489d-8aff-fda76578a3fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:35.121045 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:35.137182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ed95364d-5f4d-4770-89ad-2c5778bd0c0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '235d5bb9523d488a9bfaae38b5128b0f', 'request_id': 'req-ed95364d-5f4d-4770-89ad-2c5778bd0c0d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:35.147269 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ed95364d-5f4d-4770-89ad-2c5778bd0c0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '235d5bb9523d488a9bfaae38b5128b0f', 'request_id': 'req-ed95364d-5f4d-4770-89ad-2c5778bd0c0d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:35.154296 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ed95364d-5f4d-4770-89ad-2c5778bd0c0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '235d5bb9523d488a9bfaae38b5128b0f', 'request_id': 'req-ed95364d-5f4d-4770-89ad-2c5778bd0c0d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:35.171672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ed95364d-5f4d-4770-89ad-2c5778bd0c0d admin admin] The token cache is being invalidate because project 235d5bb9523d488a9bfaae38b5128b0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:30:35.172220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ed95364d-5f4d-4770-89ad-2c5778bd0c0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:35.173071 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ed95364d-5f4d-4770-89ad-2c5778bd0c0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:35.174862 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3455/6885] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:30:34 2022] DELETE /identity/v3/projects/235d5bb9523d488a9bfaae38b5128b0f => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:35.176490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4848f0-c727-4e62-b142-88da074b404a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:35.177009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4848f0-c727-4e62-b142-88da074b404a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:35.177427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4848f0-c727-4e62-b142-88da074b404a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:35.202029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-cc4848f0-c727-4e62-b142-88da074b404a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:35.204357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-cc4848f0-c727-4e62-b142-88da074b404a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:35.214007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807ab9b-09c3-489d-8aff-fda76578a3fd admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:35.270968 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3456/6886] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:35.271960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4848f0-c727-4e62-b142-88da074b404a None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:35.273404 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-cc4848f0-c727-4e62-b142-88da074b404a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:35.284967 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae1f42-4115-4075-96cf-a2d365459186 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '804b1372719346c1b75b48a8cd828402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6404bdfa77d241c19341d5c811fd63f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:35.285648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae1f42-4115-4075-96cf-a2d365459186 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:35.285929 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae1f42-4115-4075-96cf-a2d365459186 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:35.286321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae1f42-4115-4075-96cf-a2d365459186 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] PATH_INFO: `/v3/domains/c7a8fce2eddc4a39a1a83e9e46cacbde` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:35.287566 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4848f0-c727-4e62-b142-88da074b404a None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:35.292554 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068efd25-46e8-47f6-961c-eb12f059eaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:35.293420 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068efd25-46e8-47f6-961c-eb12f059eaad admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:35.293789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068efd25-46e8-47f6-961c-eb12f059eaad admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:35.294300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068efd25-46e8-47f6-961c-eb12f059eaad admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:35.294947 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068efd25-46e8-47f6-961c-eb12f059eaad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:35.296550 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068efd25-46e8-47f6-961c-eb12f059eaad admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:35.300415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae1f42-4115-4075-96cf-a2d365459186 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c7a8fce2eddc4a39a1a83e9e46cacbde)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:35.302128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae1f42-4115-4075-96cf-a2d365459186 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:35.307745 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3457/6887] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:35.308993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a741cb-4232-4d45-bd17-e718b168deab None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:35.309516 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a741cb-4232-4d45-bd17-e718b168deab None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:35.309628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a741cb-4232-4d45-bd17-e718b168deab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:35.330176 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-75ae1f42-4115-4075-96cf-a2d365459186 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c7a8fce2eddc4a39a1a83e9e46cacbde'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:35.334038 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-42a741cb-4232-4d45-bd17-e718b168deab None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:35.335295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-42a741cb-4232-4d45-bd17-e718b168deab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:35.341246 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-75ae1f42-4115-4075-96cf-a2d365459186 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c7a8fce2eddc4a39a1a83e9e46cacbde'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:35.346039 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3458/6888] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:35.346405 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540e2ca-944d-4fec-9301-a73ed9b71d5a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:35.346706 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540e2ca-944d-4fec-9301-a73ed9b71d5a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:35.347055 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540e2ca-944d-4fec-9301-a73ed9b71d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:35.359471 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:35.373752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a540e2ca-944d-4fec-9301-a73ed9b71d5a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:35.375060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a540e2ca-944d-4fec-9301-a73ed9b71d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:35.433640 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-75ae1f42-4115-4075-96cf-a2d365459186 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7a8fce2eddc4a39a1a83e9e46cacbde', 'request_id': 'req-75ae1f42-4115-4075-96cf-a2d365459186'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:35.473628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-75ae1f42-4115-4075-96cf-a2d365459186 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7a8fce2eddc4a39a1a83e9e46cacbde', 'request_id': 'req-75ae1f42-4115-4075-96cf-a2d365459186'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:35.486200 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-75ae1f42-4115-4075-96cf-a2d365459186 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7a8fce2eddc4a39a1a83e9e46cacbde', 'request_id': 'req-75ae1f42-4115-4075-96cf-a2d365459186'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:35.516877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-75ae1f42-4115-4075-96cf-a2d365459186 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] The token cache is being invalidate because project c7a8fce2eddc4a39a1a83e9e46cacbde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:30:35.517940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-75ae1f42-4115-4075-96cf-a2d365459186 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:35.519464 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-75ae1f42-4115-4075-96cf-a2d365459186 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:35.524111 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3459/6889] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:35.524776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540e2ca-944d-4fec-9301-a73ed9b71d5a None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:35.540098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-75ae1f42-4115-4075-96cf-a2d365459186 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c7a8fce2eddc4a39a1a83e9e46cacbde', 'request_id': 'req-75ae1f42-4115-4075-96cf-a2d365459186'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:35.544614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-75ae1f42-4115-4075-96cf-a2d365459186 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c7a8fce2eddc4a39a1a83e9e46cacbde', 'request_id': 'req-75ae1f42-4115-4075-96cf-a2d365459186'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:35.546480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-75ae1f42-4115-4075-96cf-a2d365459186 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c7a8fce2eddc4a39a1a83e9e46cacbde', 'request_id': 'req-75ae1f42-4115-4075-96cf-a2d365459186'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:35.550971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540e2ca-944d-4fec-9301-a73ed9b71d5a None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:35.567124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056d199-388d-4945-b8fc-0d1d59d3db2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:35.567840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056d199-388d-4945-b8fc-0d1d59d3db2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:35.568125 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056d199-388d-4945-b8fc-0d1d59d3db2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:35.568584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056d199-388d-4945-b8fc-0d1d59d3db2b admin admin] PATH_INFO: `/v3/projects/c9f42e7a98f0424d82d92ba257365f73/users/9312d416958a4d30a2169e2626159795/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:35.571063 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3431/6890] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:30:35 2022] DELETE /identity/v3/domains/c7a8fce2eddc4a39a1a83e9e46cacbde => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:35.572699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cebb4fa-1a0c-48b3-a8e3-754f5a7bc10e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:35.573344 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cebb4fa-1a0c-48b3-a8e3-754f5a7bc10e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:35.574091 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cebb4fa-1a0c-48b3-a8e3-754f5a7bc10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:35.602099 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-0cebb4fa-1a0c-48b3-a8e3-754f5a7bc10e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:35.603059 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0cebb4fa-1a0c-48b3-a8e3-754f5a7bc10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:35.612563 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056d199-388d-4945-b8fc-0d1d59d3db2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9f42e7a98f0424d82d92ba257365f73, user_id=9312d416958a4d30a2169e2626159795, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:35.616181 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3432/6891] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:35.616181 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cebb4fa-1a0c-48b3-a8e3-754f5a7bc10e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:35.616478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056d199-388d-4945-b8fc-0d1d59d3db2b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:35.616589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0cebb4fa-1a0c-48b3-a8e3-754f5a7bc10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:35.646586 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3460/6892] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:30:35 2022] PUT /identity/v3/projects/c9f42e7a98f0424d82d92ba257365f73/users/9312d416958a4d30a2169e2626159795/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:35.647616 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056d199-388d-4945-b8fc-0d1d59d3db2b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:35.649085 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cebb4fa-1a0c-48b3-a8e3-754f5a7bc10e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:35.649832 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8056d199-388d-4945-b8fc-0d1d59d3db2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:35.690042 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:35.745869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056d199-388d-4945-b8fc-0d1d59d3db2b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:35.765217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee34bc-dddb-4239-a615-a1365aabb8ad tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '804b1372719346c1b75b48a8cd828402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6404bdfa77d241c19341d5c811fd63f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:35.767644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee34bc-dddb-4239-a615-a1365aabb8ad tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:35.768985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee34bc-dddb-4239-a615-a1365aabb8ad tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:35.769336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee34bc-dddb-4239-a615-a1365aabb8ad tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] PATH_INFO: `/v3/domains/1dc607075aad497fa3156c6b6f4045dd` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:35.788262 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0953f3-a351-4461-88b1-44444ece9bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:35.788851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee34bc-dddb-4239-a615-a1365aabb8ad tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1dc607075aad497fa3156c6b6f4045dd)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:35.789012 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0953f3-a351-4461-88b1-44444ece9bcf admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:35.789297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0953f3-a351-4461-88b1-44444ece9bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:35.789601 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0953f3-a351-4461-88b1-44444ece9bcf admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:35.790272 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0953f3-a351-4461-88b1-44444ece9bcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:30:35.790579 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0953f3-a351-4461-88b1-44444ece9bcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:35.790698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee34bc-dddb-4239-a615-a1365aabb8ad tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:35.792373 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0953f3-a351-4461-88b1-44444ece9bcf admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:35.807689 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3433/6893] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:35.808551 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0953f3-a351-4461-88b1-44444ece9bcf admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:35.822406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-41ee34bc-dddb-4239-a615-a1365aabb8ad tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1dc607075aad497fa3156c6b6f4045dd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:35.824128 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-41ee34bc-dddb-4239-a615-a1365aabb8ad tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1dc607075aad497fa3156c6b6f4045dd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:35.824794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0953f3-a351-4461-88b1-44444ece9bcf admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:35.863122 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-41ee34bc-dddb-4239-a615-a1365aabb8ad tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1dc607075aad497fa3156c6b6f4045dd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:35.863868 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-41ee34bc-dddb-4239-a615-a1365aabb8ad tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1dc607075aad497fa3156c6b6f4045dd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:35.869228 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3461/6894] 10.222.0.30 () {60 vars in 1249 bytes} [Sun Sep 4 01:30:35 2022] PATCH /identity/v3/domains/1dc607075aad497fa3156c6b6f4045dd => generated 278 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:35.870608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c0b2c-c91a-42a3-a6d3-6367549f7bf8 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:35.870900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c0b2c-c91a-42a3-a6d3-6367549f7bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:35.871181 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c0b2c-c91a-42a3-a6d3-6367549f7bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:35.904821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ae87f-22c2-45db-b473-37a41b165228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:35.905505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ae87f-22c2-45db-b473-37a41b165228 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:35.905758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ae87f-22c2-45db-b473-37a41b165228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:35.906059 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ae87f-22c2-45db-b473-37a41b165228 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:35.906272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-043c0b2c-c91a-42a3-a6d3-6367549f7bf8 None None] MFA Rules not processed for user `9312d416958a4d30a2169e2626159795`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:35.906689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ae87f-22c2-45db-b473-37a41b165228 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:30:35.907029 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ae87f-22c2-45db-b473-37a41b165228 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:35.907565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-043c0b2c-c91a-42a3-a6d3-6367549f7bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:35.908767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ae87f-22c2-45db-b473-37a41b165228 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:35.931793 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3434/6895] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:35.932958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ae87f-22c2-45db-b473-37a41b165228 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:35.936632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a87ae87f-22c2-45db-b473-37a41b165228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:35.955837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ae87f-22c2-45db-b473-37a41b165228 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:35.959682 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:35.962907 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516b6e5-3e3a-4789-9c11-141515e1545a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:35.964056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516b6e5-3e3a-4789-9c11-141515e1545a admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:35.964056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516b6e5-3e3a-4789-9c11-141515e1545a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:35.964056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516b6e5-3e3a-4789-9c11-141515e1545a admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:35.965080 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516b6e5-3e3a-4789-9c11-141515e1545a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:35.968786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516b6e5-3e3a-4789-9c11-141515e1545a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:36.017546 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3462/6896] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:36.017546 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c0b2c-c91a-42a3-a6d3-6367549f7bf8 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:36.018887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-043c0b2c-c91a-42a3-a6d3-6367549f7bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:36.047426 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3435/6897] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:30:35 2022] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:36.049088 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516b6e5-3e3a-4789-9c11-141515e1545a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:36.055783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1516b6e5-3e3a-4789-9c11-141515e1545a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:36.166101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c0b2c-c91a-42a3-a6d3-6367549f7bf8 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:36.181623 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516b6e5-3e3a-4789-9c11-141515e1545a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:36.190353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff06c6-840e-4aa5-acdf-a34d63f8f345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:36.191446 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff06c6-840e-4aa5-acdf-a34d63f8f345 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:36.191937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff06c6-840e-4aa5-acdf-a34d63f8f345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:36.192436 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff06c6-840e-4aa5-acdf-a34d63f8f345 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:36.193119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff06c6-840e-4aa5-acdf-a34d63f8f345 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:36.195128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff06c6-840e-4aa5-acdf-a34d63f8f345 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:36.196954 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:36.260944 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3436/6898] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:30:36 2022] POST /identity/v3/projects => generated 399 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:36.261944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff06c6-840e-4aa5-acdf-a34d63f8f345 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:36.263939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-31ff06c6-840e-4aa5-acdf-a34d63f8f345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:36.300247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a42f8-dc60-4805-ac23-3f080fe5b497 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '804b1372719346c1b75b48a8cd828402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6404bdfa77d241c19341d5c811fd63f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:36.301229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a42f8-dc60-4805-ac23-3f080fe5b497 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:36.301738 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a42f8-dc60-4805-ac23-3f080fe5b497 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:36.302779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a42f8-dc60-4805-ac23-3f080fe5b497 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] PATH_INFO: `/v3/domains/1dc607075aad497fa3156c6b6f4045dd` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:36.364275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a42f8-dc60-4805-ac23-3f080fe5b497 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1dc607075aad497fa3156c6b6f4045dd)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:36.367635 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a42f8-dc60-4805-ac23-3f080fe5b497 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:36.372242 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff06c6-840e-4aa5-acdf-a34d63f8f345 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:36.383969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c698f03-eeec-4397-9fd0-c707dbd10a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:36.384997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c698f03-eeec-4397-9fd0-c707dbd10a0d admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:36.385837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c698f03-eeec-4397-9fd0-c707dbd10a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:36.386272 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c698f03-eeec-4397-9fd0-c707dbd10a0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:36.386945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c698f03-eeec-4397-9fd0-c707dbd10a0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:36.389265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c698f03-eeec-4397-9fd0-c707dbd10a0d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:36.404201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-292a42f8-dc60-4805-ac23-3f080fe5b497 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1dc607075aad497fa3156c6b6f4045dd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:36.416635 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-292a42f8-dc60-4805-ac23-3f080fe5b497 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1dc607075aad497fa3156c6b6f4045dd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:36.444044 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3437/6899] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:30:36 2022] POST /identity/v3/projects => generated 387 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:36.445799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c698f03-eeec-4397-9fd0-c707dbd10a0d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:36.476667 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-292a42f8-dc60-4805-ac23-3f080fe5b497 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dc607075aad497fa3156c6b6f4045dd', 'request_id': 'req-292a42f8-dc60-4805-ac23-3f080fe5b497'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:36.489598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-292a42f8-dc60-4805-ac23-3f080fe5b497 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dc607075aad497fa3156c6b6f4045dd', 'request_id': 'req-292a42f8-dc60-4805-ac23-3f080fe5b497'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:36.510517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-292a42f8-dc60-4805-ac23-3f080fe5b497 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dc607075aad497fa3156c6b6f4045dd', 'request_id': 'req-292a42f8-dc60-4805-ac23-3f080fe5b497'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:36.523620 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-292a42f8-dc60-4805-ac23-3f080fe5b497 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] The token cache is being invalidate because project 1dc607075aad497fa3156c6b6f4045dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:30:36.523916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-292a42f8-dc60-4805-ac23-3f080fe5b497 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:36.524435 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:36.524624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-292a42f8-dc60-4805-ac23-3f080fe5b497 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:36.535932 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-292a42f8-dc60-4805-ac23-3f080fe5b497 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1dc607075aad497fa3156c6b6f4045dd', 'request_id': 'req-292a42f8-dc60-4805-ac23-3f080fe5b497'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:36.536829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-292a42f8-dc60-4805-ac23-3f080fe5b497 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1dc607075aad497fa3156c6b6f4045dd', 'request_id': 'req-292a42f8-dc60-4805-ac23-3f080fe5b497'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:36.537550 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-292a42f8-dc60-4805-ac23-3f080fe5b497 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1dc607075aad497fa3156c6b6f4045dd', 'request_id': 'req-292a42f8-dc60-4805-ac23-3f080fe5b497'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:36.542415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c698f03-eeec-4397-9fd0-c707dbd10a0d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:36.554258 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3463/6900] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:30:36 2022] DELETE /identity/v3/domains/1dc607075aad497fa3156c6b6f4045dd => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:36.555556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a42f8-dc60-4805-ac23-3f080fe5b497 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:36.557034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-292a42f8-dc60-4805-ac23-3f080fe5b497 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:36.628285 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d058688-16d0-4c96-ba5b-620b2758cea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:36.628902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d058688-16d0-4c96-ba5b-620b2758cea4 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:36.629186 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d058688-16d0-4c96-ba5b-620b2758cea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:36.629457 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d058688-16d0-4c96-ba5b-620b2758cea4 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:36.630092 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d058688-16d0-4c96-ba5b-620b2758cea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:36.632233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d058688-16d0-4c96-ba5b-620b2758cea4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:36.645948 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:36.653215 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a42f8-dc60-4805-ac23-3f080fe5b497 tempest-DomainsTestJSON-853496197 tempest-DomainsTestJSON-853496197-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:36.663312 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3438/6901] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:30:36 2022] POST /identity/v3/users => generated 284 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:36.664134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d058688-16d0-4c96-ba5b-620b2758cea4 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:36.668522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4d058688-16d0-4c96-ba5b-620b2758cea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:36.669917 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ef4d7-4100-45b8-9042-88e4571a76a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:36.670539 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ef4d7-4100-45b8-9042-88e4571a76a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:36.670814 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ef4d7-4100-45b8-9042-88e4571a76a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:36.671122 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ef4d7-4100-45b8-9042-88e4571a76a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:36.671822 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ef4d7-4100-45b8-9042-88e4571a76a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:36.674178 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ef4d7-4100-45b8-9042-88e4571a76a0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:36.691494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d058688-16d0-4c96-ba5b-620b2758cea4 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:36.698292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a2be5-b8c3-4de4-8a48-095a38af4e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:36.698484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a2be5-b8c3-4de4-8a48-095a38af4e92 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:36.699309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a2be5-b8c3-4de4-8a48-095a38af4e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:36.699309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a2be5-b8c3-4de4-8a48-095a38af4e92 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:36.699685 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a2be5-b8c3-4de4-8a48-095a38af4e92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:36.701898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a2be5-b8c3-4de4-8a48-095a38af4e92 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:36.709510 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3464/6902] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:30:36 2022] POST /identity/v3/users => generated 300 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:36.710697 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ef4d7-4100-45b8-9042-88e4571a76a0 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:36.712759 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1c4ef4d7-4100-45b8-9042-88e4571a76a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:36.730412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ef4d7-4100-45b8-9042-88e4571a76a0 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:36.734409 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3439/6903] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:30:36 2022] POST /identity/v3/users => generated 300 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:36.734894 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a2be5-b8c3-4de4-8a48-095a38af4e92 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:36.737845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e95a2be5-b8c3-4de4-8a48-095a38af4e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:36.743032 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2967f6cf-7116-4682-a5c5-d25f60db5c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:36.743696 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967f6cf-7116-4682-a5c5-d25f60db5c7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:36.743967 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967f6cf-7116-4682-a5c5-d25f60db5c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:36.744243 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967f6cf-7116-4682-a5c5-d25f60db5c7b admin admin] PATH_INFO: `/v3/users/8269be51c14e443aac2b146a04be754e` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:36.745497 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2967f6cf-7116-4682-a5c5-d25f60db5c7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8269be51c14e443aac2b146a04be754e)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:36.749012 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2967f6cf-7116-4682-a5c5-d25f60db5c7b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:36.754969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a2be5-b8c3-4de4-8a48-095a38af4e92 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:36.761060 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983774f-3535-41b4-a4e3-b428fe7a9664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:36.762812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983774f-3535-41b4-a4e3-b428fe7a9664 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:36.762812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983774f-3535-41b4-a4e3-b428fe7a9664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:36.762812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983774f-3535-41b4-a4e3-b428fe7a9664 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:36.763347 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983774f-3535-41b4-a4e3-b428fe7a9664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:36.765475 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983774f-3535-41b4-a4e3-b428fe7a9664 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:36.781347 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3440/6904] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:36.782534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983774f-3535-41b4-a4e3-b428fe7a9664 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:36.794471 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983774f-3535-41b4-a4e3-b428fe7a9664 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:36.801520 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b966a-4cef-43ea-a5c6-5115e94db4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:36.802493 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b966a-4cef-43ea-a5c6-5115e94db4bd admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:36.802875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b966a-4cef-43ea-a5c6-5115e94db4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:36.803220 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b966a-4cef-43ea-a5c6-5115e94db4bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:36.804160 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b966a-4cef-43ea-a5c6-5115e94db4bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:36.806254 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b966a-4cef-43ea-a5c6-5115e94db4bd admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:36.821400 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3441/6905] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:36.823490 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b966a-4cef-43ea-a5c6-5115e94db4bd admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:36.835731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2967f6cf-7116-4682-a5c5-d25f60db5c7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8269be51c14e443aac2b146a04be754e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:36.835906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b966a-4cef-43ea-a5c6-5115e94db4bd admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:36.836796 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2967f6cf-7116-4682-a5c5-d25f60db5c7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8269be51c14e443aac2b146a04be754e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:36.843012 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72896d25-30c6-4eeb-ac57-623c73c9302c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:36.843778 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72896d25-30c6-4eeb-ac57-623c73c9302c admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:36.844077 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72896d25-30c6-4eeb-ac57-623c73c9302c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:36.844352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72896d25-30c6-4eeb-ac57-623c73c9302c admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:36.845310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72896d25-30c6-4eeb-ac57-623c73c9302c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:36.847214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72896d25-30c6-4eeb-ac57-623c73c9302c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:36.848515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2967f6cf-7116-4682-a5c5-d25f60db5c7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8269be51c14e443aac2b146a04be754e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:36.859709 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3442/6906] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:36.861465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72896d25-30c6-4eeb-ac57-623c73c9302c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:36.864099 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-72896d25-30c6-4eeb-ac57-623c73c9302c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:36.866426 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2967f6cf-7116-4682-a5c5-d25f60db5c7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8269be51c14e443aac2b146a04be754e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:36.867654 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2967f6cf-7116-4682-a5c5-d25f60db5c7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8269be51c14e443aac2b146a04be754e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:36.887604 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72896d25-30c6-4eeb-ac57-623c73c9302c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:36.892450 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b023f4-741a-4735-b5f2-b5db16c84a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:36.893062 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b023f4-741a-4735-b5f2-b5db16c84a7b admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:36.893343 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b023f4-741a-4735-b5f2-b5db16c84a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:36.893652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b023f4-741a-4735-b5f2-b5db16c84a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:36.894292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b023f4-741a-4735-b5f2-b5db16c84a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:36.895878 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b023f4-741a-4735-b5f2-b5db16c84a7b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:36.906433 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3465/6907] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:36 2022] DELETE /identity/v3/users/8269be51c14e443aac2b146a04be754e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:36.907866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2967f6cf-7116-4682-a5c5-d25f60db5c7b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:36.910639 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3443/6908] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:36.912014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b023f4-741a-4735-b5f2-b5db16c84a7b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:36.914864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2967f6cf-7116-4682-a5c5-d25f60db5c7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:36.915208 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b9b023f4-741a-4735-b5f2-b5db16c84a7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:36.938833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b023f4-741a-4735-b5f2-b5db16c84a7b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:37.010129 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2967f6cf-7116-4682-a5c5-d25f60db5c7b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:37.015077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0caf94-e7d3-45cd-afd1-f41c33a47089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:37.015893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0caf94-e7d3-45cd-afd1-f41c33a47089 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:37.016350 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0caf94-e7d3-45cd-afd1-f41c33a47089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:37.016789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0caf94-e7d3-45cd-afd1-f41c33a47089 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:37.017656 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0caf94-e7d3-45cd-afd1-f41c33a47089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:37.019417 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0caf94-e7d3-45cd-afd1-f41c33a47089 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:37.025472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910fee7-c013-4b25-9b19-8ded920f40de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:37.026182 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910fee7-c013-4b25-9b19-8ded920f40de admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:37.026462 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910fee7-c013-4b25-9b19-8ded920f40de admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:37.026735 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910fee7-c013-4b25-9b19-8ded920f40de admin admin] PATH_INFO: `/v3/projects/d3c9e00556b643ddbbc8ac8cf314b419/users/9743e659ad504d028b992c4831d4b47e/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:37.034798 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3466/6909] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:37.036134 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24db099-6367-42a8-98e2-8fe37ed817a5 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:37.036429 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24db099-6367-42a8-98e2-8fe37ed817a5 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:37.036692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24db099-6367-42a8-98e2-8fe37ed817a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:37.045495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910fee7-c013-4b25-9b19-8ded920f40de admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3c9e00556b643ddbbc8ac8cf314b419, user_id=9743e659ad504d028b992c4831d4b47e, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:37.049073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910fee7-c013-4b25-9b19-8ded920f40de admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:37.057750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-d24db099-6367-42a8-98e2-8fe37ed817a5 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:37.059011 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d24db099-6367-42a8-98e2-8fe37ed817a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:37.065219 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3444/6910] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:30:36 2022] PUT /identity/v3/projects/d3c9e00556b643ddbbc8ac8cf314b419/users/9743e659ad504d028b992c4831d4b47e/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:37.065811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910fee7-c013-4b25-9b19-8ded920f40de admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:37.079502 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:37.113705 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:37.128550 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3467/6911] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:37.129375 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24db099-6367-42a8-98e2-8fe37ed817a5 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:37.140095 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24db099-6367-42a8-98e2-8fe37ed817a5 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:37.146498 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d7a89-2679-420a-8b12-1a66e2a8f5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:37.147021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910fee7-c013-4b25-9b19-8ded920f40de admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:37.147151 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d7a89-2679-420a-8b12-1a66e2a8f5c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:37.147434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d7a89-2679-420a-8b12-1a66e2a8f5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:37.147711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d7a89-2679-420a-8b12-1a66e2a8f5c0 admin admin] PATH_INFO: `/v3/projects/c96f0d071cac438e8885a4b10887db3e/users/e43e07f017224984b5458f1c4aaaee10/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:37.152312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ceb03-90e4-4db2-b74e-c298c3937a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:37.152979 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ceb03-90e4-4db2-b74e-c298c3937a0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:37.153256 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ceb03-90e4-4db2-b74e-c298c3937a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:37.153562 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ceb03-90e4-4db2-b74e-c298c3937a0b admin admin] PATH_INFO: `/v3/projects/eb2ec4247d254ff7a8abec85839e9646/users/01611ff1d1a6458f9e8012e20a087acb/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:37.168168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d7a89-2679-420a-8b12-1a66e2a8f5c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c96f0d071cac438e8885a4b10887db3e, user_id=e43e07f017224984b5458f1c4aaaee10, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:37.170586 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92ceb03-90e4-4db2-b74e-c298c3937a0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb2ec4247d254ff7a8abec85839e9646, user_id=01611ff1d1a6458f9e8012e20a087acb, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:37.171003 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d7a89-2679-420a-8b12-1a66e2a8f5c0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:37.175957 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92ceb03-90e4-4db2-b74e-c298c3937a0b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:37.187292 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3468/6912] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:30:37 2022] PUT /identity/v3/projects/c96f0d071cac438e8885a4b10887db3e/users/e43e07f017224984b5458f1c4aaaee10/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:37.188123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d7a89-2679-420a-8b12-1a66e2a8f5c0 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:37.189687 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3445/6913] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:30:37 2022] PUT /identity/v3/projects/eb2ec4247d254ff7a8abec85839e9646/users/01611ff1d1a6458f9e8012e20a087acb/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:37.201663 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ceb03-90e4-4db2-b74e-c298c3937a0b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:37.201663 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a92ceb03-90e4-4db2-b74e-c298c3937a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:37.279886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d7a89-2679-420a-8b12-1a66e2a8f5c0 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:37.286771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ceb03-90e4-4db2-b74e-c298c3937a0b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:37.295815 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ed4ea-9bd0-48a6-bf28-3f51bc116d32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:37.297167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ed4ea-9bd0-48a6-bf28-3f51bc116d32 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:37.297638 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ed4ea-9bd0-48a6-bf28-3f51bc116d32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:37.298962 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ed4ea-9bd0-48a6-bf28-3f51bc116d32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:37.371655 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857278c-4421-4811-a54c-4e662d15ab57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:37.372309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857278c-4421-4811-a54c-4e662d15ab57 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:37.372585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857278c-4421-4811-a54c-4e662d15ab57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:37.372854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857278c-4421-4811-a54c-4e662d15ab57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:37.373728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857278c-4421-4811-a54c-4e662d15ab57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:37.375398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857278c-4421-4811-a54c-4e662d15ab57 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:37.388112 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3469/6914] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:37.391739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2d6f0-b585-4eb0-bf74-8c0224897e7f None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:37.392558 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2d6f0-b585-4eb0-bf74-8c0224897e7f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:37.392829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2d6f0-b585-4eb0-bf74-8c0224897e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:37.418923 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ed4ea-9bd0-48a6-bf28-3f51bc116d32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:37.420073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ed4ea-9bd0-48a6-bf28-3f51bc116d32 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:37.442885 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-05a2d6f0-b585-4eb0-bf74-8c0224897e7f None None] MFA Rules not processed for user `e43e07f017224984b5458f1c4aaaee10`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:37.445718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-05a2d6f0-b585-4eb0-bf74-8c0224897e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:37.455360 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3446/6915] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:30:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:30:37.457990 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6dcd2-f426-4059-a31d-d631274ae798 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:37.462140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6dcd2-f426-4059-a31d-d631274ae798 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:37.462417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6dcd2-f426-4059-a31d-d631274ae798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:37.502557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e9f6dcd2-f426-4059-a31d-d631274ae798 None None] MFA Rules not processed for user `01611ff1d1a6458f9e8012e20a087acb`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:37.504285 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e9f6dcd2-f426-4059-a31d-d631274ae798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:37.591142 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:37.641013 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3470/6916] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:37 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:37.643740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2d6f0-b585-4eb0-bf74-8c0224897e7f None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:37.655884 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:37.668359 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3447/6917] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:37.668359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6dcd2-f426-4059-a31d-d631274ae798 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:37.668359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e9f6dcd2-f426-4059-a31d-d631274ae798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:37.679635 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2d6f0-b585-4eb0-bf74-8c0224897e7f None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:37.695842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65afdd7-15e7-4510-82b8-6bc2fbbd87c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:37.696915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65afdd7-15e7-4510-82b8-6bc2fbbd87c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:37.697424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65afdd7-15e7-4510-82b8-6bc2fbbd87c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:37.697949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65afdd7-15e7-4510-82b8-6bc2fbbd87c8 admin admin] PATH_INFO: `/v3/projects/d3c9e00556b643ddbbc8ac8cf314b419/users/9743e659ad504d028b992c4831d4b47e/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:37.702824 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65afdd7-15e7-4510-82b8-6bc2fbbd87c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3c9e00556b643ddbbc8ac8cf314b419, user_id=9743e659ad504d028b992c4831d4b47e, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:37.707321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65afdd7-15e7-4510-82b8-6bc2fbbd87c8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:37.740824 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3471/6918] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:30:37 2022] PUT /identity/v3/projects/d3c9e00556b643ddbbc8ac8cf314b419/users/9743e659ad504d028b992c4831d4b47e/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:37.743728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65afdd7-15e7-4510-82b8-6bc2fbbd87c8 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:37.762192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6dcd2-f426-4059-a31d-d631274ae798 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:37.877715 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1052912-f64c-4ccd-9f40-9517533b9beb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:37.879287 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1052912-f64c-4ccd-9f40-9517533b9beb service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:37.880149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1052912-f64c-4ccd-9f40-9517533b9beb service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:37.880939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1052912-f64c-4ccd-9f40-9517533b9beb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:37.979083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65afdd7-15e7-4510-82b8-6bc2fbbd87c8 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:37.990075 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bac1b-93dc-4397-b7c2-50f7839321a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:37.990708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bac1b-93dc-4397-b7c2-50f7839321a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:37.991062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bac1b-93dc-4397-b7c2-50f7839321a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:37.991336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bac1b-93dc-4397-b7c2-50f7839321a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:37.991983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5bac1b-93dc-4397-b7c2-50f7839321a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:37.994421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5bac1b-93dc-4397-b7c2-50f7839321a2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:38.072678 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3472/6919] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:30:37 2022] POST /identity/v3/projects => generated 367 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:38.076451 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4eb8f-a2ba-4317-855d-6047130ab088 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:38.077131 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4eb8f-a2ba-4317-855d-6047130ab088 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:38.077845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4eb8f-a2ba-4317-855d-6047130ab088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:38.120551 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1052912-f64c-4ccd-9f40-9517533b9beb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:38.122028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1052912-f64c-4ccd-9f40-9517533b9beb service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:38.154751 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3448/6920] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:30:37 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:30:38.155523 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1052912-f64c-4ccd-9f40-9517533b9beb service cinder] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:38.161967 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-d9d4eb8f-a2ba-4317-855d-6047130ab088 None None] MFA Rules not processed for user `9743e659ad504d028b992c4831d4b47e`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:38.164674 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d9d4eb8f-a2ba-4317-855d-6047130ab088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:38.181720 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1052912-f64c-4ccd-9f40-9517533b9beb service cinder] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:38.314423 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3473/6921] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:38 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:38.332015 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:38.353916 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a821c8-3008-474f-aac9-e5530730bda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:38.354539 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a821c8-3008-474f-aac9-e5530730bda5 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:38.354825 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a821c8-3008-474f-aac9-e5530730bda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:38.355099 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a821c8-3008-474f-aac9-e5530730bda5 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:38.355865 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a821c8-3008-474f-aac9-e5530730bda5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:38.358250 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a821c8-3008-474f-aac9-e5530730bda5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:38.408015 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3449/6922] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:30:38 2022] POST /identity/v3/users => generated 290 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:38.411739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4eb8f-a2ba-4317-855d-6047130ab088 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:38.427018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a821c8-3008-474f-aac9-e5530730bda5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:38.429035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4eb8f-a2ba-4317-855d-6047130ab088 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:38.449805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf8290-1878-431f-abee-6fd875d07c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:38.451253 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf8290-1878-431f-abee-6fd875d07c18 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:38.452505 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf8290-1878-431f-abee-6fd875d07c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:38.453166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf8290-1878-431f-abee-6fd875d07c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:38.454144 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf8290-1878-431f-abee-6fd875d07c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:38.458866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf8290-1878-431f-abee-6fd875d07c18 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:38.483098 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3474/6923] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:38.496711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf8290-1878-431f-abee-6fd875d07c18 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:38.528496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf8290-1878-431f-abee-6fd875d07c18 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:38.547577 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feca3ce-f5d3-4c62-a712-6ef295f93665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:38.549124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feca3ce-f5d3-4c62-a712-6ef295f93665 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:38.549723 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feca3ce-f5d3-4c62-a712-6ef295f93665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:38.550226 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feca3ce-f5d3-4c62-a712-6ef295f93665 admin admin] PATH_INFO: `/v3/projects/3ae8e609352648fabb4699ef5f485af5/users/6543e6cb46134b42855baf844375d50a/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:38.585062 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a821c8-3008-474f-aac9-e5530730bda5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:38.597034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feca3ce-f5d3-4c62-a712-6ef295f93665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ae8e609352648fabb4699ef5f485af5, user_id=6543e6cb46134b42855baf844375d50a, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:38.600611 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feca3ce-f5d3-4c62-a712-6ef295f93665 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:38.601404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be302a9b-072c-40f7-a67c-d6504047b255 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:38.603871 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be302a9b-072c-40f7-a67c-d6504047b255 service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:38.606661 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be302a9b-072c-40f7-a67c-d6504047b255 service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:38.606804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be302a9b-072c-40f7-a67c-d6504047b255 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:38.643213 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be302a9b-072c-40f7-a67c-d6504047b255 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:38.648334 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3475/6924] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:30:38 2022] PUT /identity/v3/projects/3ae8e609352648fabb4699ef5f485af5/users/6543e6cb46134b42855baf844375d50a/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:38.648506 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be302a9b-072c-40f7-a67c-d6504047b255 service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:38.649536 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feca3ce-f5d3-4c62-a712-6ef295f93665 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:38.699955 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3450/6925] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:30:38 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:30:38.701356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be302a9b-072c-40f7-a67c-d6504047b255 service cinder] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:38.704592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-be302a9b-072c-40f7-a67c-d6504047b255 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:38.738362 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be302a9b-072c-40f7-a67c-d6504047b255 service cinder] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:38.748884 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:38.871719 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feca3ce-f5d3-4c62-a712-6ef295f93665 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:38.890757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252ff30-8bfd-4db4-a44c-00817b4c0a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:38.891770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252ff30-8bfd-4db4-a44c-00817b4c0a79 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:38.892093 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252ff30-8bfd-4db4-a44c-00817b4c0a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:38.892357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252ff30-8bfd-4db4-a44c-00817b4c0a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:38.892997 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252ff30-8bfd-4db4-a44c-00817b4c0a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:38.895104 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252ff30-8bfd-4db4-a44c-00817b4c0a79 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:38.951130 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3476/6926] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:38.952041 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252ff30-8bfd-4db4-a44c-00817b4c0a79 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:38.953331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59de1c-4c42-4a34-89f8-a191f0565cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:38.955465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59de1c-4c42-4a34-89f8-a191f0565cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:38.955906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59de1c-4c42-4a34-89f8-a191f0565cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:38.956262 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59de1c-4c42-4a34-89f8-a191f0565cc8 admin admin] PATH_INFO: `/v3/projects/8e0c441964d14c18ba98a2fdb784b108` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:38.963540 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59de1c-4c42-4a34-89f8-a191f0565cc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e0c441964d14c18ba98a2fdb784b108)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:38.966053 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59de1c-4c42-4a34-89f8-a191f0565cc8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:38.983876 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252ff30-8bfd-4db4-a44c-00817b4c0a79 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:39.002966 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275cb64-f7b4-4508-9580-377a6ea52c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:39.003611 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275cb64-f7b4-4508-9580-377a6ea52c12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:39.003893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275cb64-f7b4-4508-9580-377a6ea52c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:39.004160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275cb64-f7b4-4508-9580-377a6ea52c12 admin admin] PATH_INFO: `/v3/users/9312d416958a4d30a2169e2626159795` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:39.008442 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6275cb64-f7b4-4508-9580-377a6ea52c12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9312d416958a4d30a2169e2626159795)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:39.010430 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6275cb64-f7b4-4508-9580-377a6ea52c12 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:39.152800 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ae59de1c-4c42-4a34-89f8-a191f0565cc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e0c441964d14c18ba98a2fdb784b108', 'request_id': 'req-ae59de1c-4c42-4a34-89f8-a191f0565cc8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:39.166585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ae59de1c-4c42-4a34-89f8-a191f0565cc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e0c441964d14c18ba98a2fdb784b108', 'request_id': 'req-ae59de1c-4c42-4a34-89f8-a191f0565cc8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:39.187088 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ae59de1c-4c42-4a34-89f8-a191f0565cc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e0c441964d14c18ba98a2fdb784b108', 'request_id': 'req-ae59de1c-4c42-4a34-89f8-a191f0565cc8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:39.210618 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6275cb64-f7b4-4508-9580-377a6ea52c12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9312d416958a4d30a2169e2626159795'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:39.211338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6275cb64-f7b4-4508-9580-377a6ea52c12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9312d416958a4d30a2169e2626159795'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:39.232288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ae59de1c-4c42-4a34-89f8-a191f0565cc8 admin admin] The token cache is being invalidate because project 8e0c441964d14c18ba98a2fdb784b108 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:30:39.233775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ae59de1c-4c42-4a34-89f8-a191f0565cc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:39.234678 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6275cb64-f7b4-4508-9580-377a6ea52c12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9312d416958a4d30a2169e2626159795'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:39.236788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ae59de1c-4c42-4a34-89f8-a191f0565cc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:39.243774 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3451/6927] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:30:38 2022] DELETE /identity/v3/projects/8e0c441964d14c18ba98a2fdb784b108 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:39.244640 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59de1c-4c42-4a34-89f8-a191f0565cc8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:39.252638 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ae59de1c-4c42-4a34-89f8-a191f0565cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:39.253987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6275cb64-f7b4-4508-9580-377a6ea52c12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9312d416958a4d30a2169e2626159795'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:39.261306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6275cb64-f7b4-4508-9580-377a6ea52c12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9312d416958a4d30a2169e2626159795'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:39.296059 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:39.334695 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3477/6928] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:38 2022] DELETE /identity/v3/users/9312d416958a4d30a2169e2626159795 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:39.335422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275cb64-f7b4-4508-9580-377a6ea52c12 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:39.338637 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6275cb64-f7b4-4508-9580-377a6ea52c12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:39.494623 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59de1c-4c42-4a34-89f8-a191f0565cc8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:39.568303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275cb64-f7b4-4508-9580-377a6ea52c12 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:39.592769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc592e-2d75-45d0-9533-3b8c4e73f543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:39.593643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc592e-2d75-45d0-9533-3b8c4e73f543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:39.594023 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc592e-2d75-45d0-9533-3b8c4e73f543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:39.594386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc592e-2d75-45d0-9533-3b8c4e73f543 admin admin] PATH_INFO: `/v3/users/804b1372719346c1b75b48a8cd828402` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:39.598262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc592e-2d75-45d0-9533-3b8c4e73f543 admin admin] RBAC: Authorizing `identity:delete_user(user_id=804b1372719346c1b75b48a8cd828402)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:39.600333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc592e-2d75-45d0-9533-3b8c4e73f543 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:39.704347 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:39.706520 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c1fe3-0c5d-439f-9e04-8953d97dcd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:39.709835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c1fe3-0c5d-439f-9e04-8953d97dcd34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:39.710542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c1fe3-0c5d-439f-9e04-8953d97dcd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:39.710833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c1fe3-0c5d-439f-9e04-8953d97dcd34 admin admin] PATH_INFO: `/v3/projects/3ae8e609352648fabb4699ef5f485af5/users/6543e6cb46134b42855baf844375d50a/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:39.718224 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c1fe3-0c5d-439f-9e04-8953d97dcd34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ae8e609352648fabb4699ef5f485af5, user_id=6543e6cb46134b42855baf844375d50a, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:39.741030 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-debc592e-2d75-45d0-9533-3b8c4e73f543 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '804b1372719346c1b75b48a8cd828402'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:39.742284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-debc592e-2d75-45d0-9533-3b8c4e73f543 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '804b1372719346c1b75b48a8cd828402'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:39.756074 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c1fe3-0c5d-439f-9e04-8953d97dcd34 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:39.758955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-debc592e-2d75-45d0-9533-3b8c4e73f543 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '804b1372719346c1b75b48a8cd828402'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:39.776305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-debc592e-2d75-45d0-9533-3b8c4e73f543 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '804b1372719346c1b75b48a8cd828402'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:39.777040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-debc592e-2d75-45d0-9533-3b8c4e73f543 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '804b1372719346c1b75b48a8cd828402'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:39.829970 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3452/6929] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:30:39 2022] PUT /identity/v3/projects/3ae8e609352648fabb4699ef5f485af5/users/6543e6cb46134b42855baf844375d50a/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:39.831668 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f706465-c553-4512-9aae-b825b6820a13 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:39.831974 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f706465-c553-4512-9aae-b825b6820a13 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:39.836586 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f706465-c553-4512-9aae-b825b6820a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:39.838762 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3478/6930] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:39 2022] DELETE /identity/v3/users/804b1372719346c1b75b48a8cd828402 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:39.840842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f091d6-96a1-4e17-b9bc-1c857b3bf06c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:39.841354 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f091d6-96a1-4e17-b9bc-1c857b3bf06c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:39.841873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f091d6-96a1-4e17-b9bc-1c857b3bf06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:39.887527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-7f706465-c553-4512-9aae-b825b6820a13 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:39.892701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7f706465-c553-4512-9aae-b825b6820a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:39.936251 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-15f091d6-96a1-4e17-b9bc-1c857b3bf06c None None] MFA Rules not processed for user `6543e6cb46134b42855baf844375d50a`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:39.937670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-15f091d6-96a1-4e17-b9bc-1c857b3bf06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:40.065209 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3453/6931] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:40.082066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f706465-c553-4512-9aae-b825b6820a13 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:40.089648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7f706465-c553-4512-9aae-b825b6820a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:40.096271 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3479/6932] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:39 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:40.097369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f091d6-96a1-4e17-b9bc-1c857b3bf06c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:40.120572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f091d6-96a1-4e17-b9bc-1c857b3bf06c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:40.135398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2752a36-aa38-4048-a2f3-7170215a6591 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6543e6cb46134b42855baf844375d50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae8e609352648fabb4699ef5f485af5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:40.136096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2752a36-aa38-4048-a2f3-7170215a6591 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:40.136400 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2752a36-aa38-4048-a2f3-7170215a6591 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:40.136683 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2752a36-aa38-4048-a2f3-7170215a6591 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:40.137369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2752a36-aa38-4048-a2f3-7170215a6591 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:40.139252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2752a36-aa38-4048-a2f3-7170215a6591 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:40.211164 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:40.212034 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3480/6933] 10.222.0.30 () {60 vars in 1149 bytes} [Sun Sep 4 01:30:40 2022] POST /identity/v3/domains => generated 276 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:40.219439 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2752a36-aa38-4048-a2f3-7170215a6591 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:40.220829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f706465-c553-4512-9aae-b825b6820a13 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:40.373578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1bf76-d7fe-4590-9e45-2f668e04bbcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:40.374218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1bf76-d7fe-4590-9e45-2f668e04bbcf service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:40.374502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1bf76-d7fe-4590-9e45-2f668e04bbcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:40.374779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1bf76-d7fe-4590-9e45-2f668e04bbcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:40.399623 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2752a36-aa38-4048-a2f3-7170215a6591 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:40.419445 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255c112-b8bd-483a-b5b4-0600a39ed321 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6543e6cb46134b42855baf844375d50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae8e609352648fabb4699ef5f485af5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:40.420335 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255c112-b8bd-483a-b5b4-0600a39ed321 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:40.421232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255c112-b8bd-483a-b5b4-0600a39ed321 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:40.421850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255c112-b8bd-483a-b5b4-0600a39ed321 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:40.422648 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255c112-b8bd-483a-b5b4-0600a39ed321 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:40.425308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255c112-b8bd-483a-b5b4-0600a39ed321 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:40.502499 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3481/6934] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:30:40 2022] POST /identity/v3/users => generated 347 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:40.505998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255c112-b8bd-483a-b5b4-0600a39ed321 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:40.527795 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255c112-b8bd-483a-b5b4-0600a39ed321 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:40.528711 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1bf76-d7fe-4590-9e45-2f668e04bbcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:40.530254 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1bf76-d7fe-4590-9e45-2f668e04bbcf service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:40.536257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88289bcc-54d5-41b7-a3eb-9396fc9247c1 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6543e6cb46134b42855baf844375d50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae8e609352648fabb4699ef5f485af5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:40.536995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88289bcc-54d5-41b7-a3eb-9396fc9247c1 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:40.537373 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88289bcc-54d5-41b7-a3eb-9396fc9247c1 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:40.537767 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88289bcc-54d5-41b7-a3eb-9396fc9247c1 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:40.538813 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88289bcc-54d5-41b7-a3eb-9396fc9247c1 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:40.542489 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88289bcc-54d5-41b7-a3eb-9396fc9247c1 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:40.546906 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3454/6935] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:30:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:30:40.565781 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:40.597232 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3482/6936] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:30:40 2022] POST /identity/v3/users => generated 324 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:40.601256 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1bf76-d7fe-4590-9e45-2f668e04bbcf service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:40.619768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1bf76-d7fe-4590-9e45-2f668e04bbcf service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:40.653997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86af558-182d-4cb6-8a9b-466c4f6cbead tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6543e6cb46134b42855baf844375d50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae8e609352648fabb4699ef5f485af5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:40.654827 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86af558-182d-4cb6-8a9b-466c4f6cbead tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:40.655705 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86af558-182d-4cb6-8a9b-466c4f6cbead tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:40.656060 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86af558-182d-4cb6-8a9b-466c4f6cbead tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] PATH_INFO: `/v3/users/b30e61ece7df4b2890f31502441c8e6d` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:40.672561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88289bcc-54d5-41b7-a3eb-9396fc9247c1 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:40.675670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-88289bcc-54d5-41b7-a3eb-9396fc9247c1 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:40.730716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88289bcc-54d5-41b7-a3eb-9396fc9247c1 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:40.739677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba0451-720a-44bb-a0bf-c5454aca640d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:40.740340 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba0451-720a-44bb-a0bf-c5454aca640d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:40.740618 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba0451-720a-44bb-a0bf-c5454aca640d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:40.740889 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba0451-720a-44bb-a0bf-c5454aca640d admin admin] PATH_INFO: `/v3/projects/6404bdfa77d241c19341d5c811fd63f4` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:40.742654 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba0451-720a-44bb-a0bf-c5454aca640d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6404bdfa77d241c19341d5c811fd63f4)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:40.754919 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba0451-720a-44bb-a0bf-c5454aca640d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:40.757466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86af558-182d-4cb6-8a9b-466c4f6cbead tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: Authorizing `identity:get_user(user_id=b30e61ece7df4b2890f31502441c8e6d)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:40.771907 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86af558-182d-4cb6-8a9b-466c4f6cbead tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:40.781073 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3455/6937] 10.222.0.30 () {58 vars in 1221 bytes} [Sun Sep 4 01:30:40 2022] GET /identity/v3/users/b30e61ece7df4b2890f31502441c8e6d => generated 347 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:40.788072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86af558-182d-4cb6-8a9b-466c4f6cbead tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:40.817937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86af558-182d-4cb6-8a9b-466c4f6cbead tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:40.858664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ccf6b-c081-4e9a-82e8-5ef81d952299 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6543e6cb46134b42855baf844375d50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae8e609352648fabb4699ef5f485af5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:40.859436 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ccf6b-c081-4e9a-82e8-5ef81d952299 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:40.862943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ccf6b-c081-4e9a-82e8-5ef81d952299 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:40.864468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ccf6b-c081-4e9a-82e8-5ef81d952299 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:40.864468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ccf6b-c081-4e9a-82e8-5ef81d952299 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: Adding query filter params (domain_id=7bdff0b2e2f54e4e8ab4d40cd6f493e6) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:30:40.864692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ccf6b-c081-4e9a-82e8-5ef81d952299 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:40.867170 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ccf6b-c081-4e9a-82e8-5ef81d952299 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:40.914517 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3456/6938] 10.222.0.30 () {58 vars in 1207 bytes} [Sun Sep 4 01:30:40 2022] GET /identity/v3/users?domain_id=7bdff0b2e2f54e4e8ab4d40cd6f493e6 => generated 484 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:40.917165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ccf6b-c081-4e9a-82e8-5ef81d952299 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:40.924698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4fba0451-720a-44bb-a0bf-c5454aca640d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6404bdfa77d241c19341d5c811fd63f4', 'request_id': 'req-4fba0451-720a-44bb-a0bf-c5454aca640d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:40.944444 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4fba0451-720a-44bb-a0bf-c5454aca640d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6404bdfa77d241c19341d5c811fd63f4', 'request_id': 'req-4fba0451-720a-44bb-a0bf-c5454aca640d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:40.959007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ccf6b-c081-4e9a-82e8-5ef81d952299 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:40.960587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4fba0451-720a-44bb-a0bf-c5454aca640d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6404bdfa77d241c19341d5c811fd63f4', 'request_id': 'req-4fba0451-720a-44bb-a0bf-c5454aca640d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:40.989640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4fba0451-720a-44bb-a0bf-c5454aca640d admin admin] The token cache is being invalidate because project 6404bdfa77d241c19341d5c811fd63f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:30:40.992739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4fba0451-720a-44bb-a0bf-c5454aca640d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:40.999645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4fba0451-720a-44bb-a0bf-c5454aca640d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:41.015217 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3483/6939] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:30:40 2022] DELETE /identity/v3/projects/6404bdfa77d241c19341d5c811fd63f4 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:41.020131 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f3ac4-ce9f-4161-ba01-e4307e11b24d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:41.021078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f3ac4-ce9f-4161-ba01-e4307e11b24d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:41.021565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f3ac4-ce9f-4161-ba01-e4307e11b24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:41.163953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c87f3ac4-ce9f-4161-ba01-e4307e11b24d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:41.177858 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c87f3ac4-ce9f-4161-ba01-e4307e11b24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:41.185084 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de52099-f21b-4701-a1d7-64676be20f8a tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6543e6cb46134b42855baf844375d50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae8e609352648fabb4699ef5f485af5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:41.185758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de52099-f21b-4701-a1d7-64676be20f8a tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:41.186046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de52099-f21b-4701-a1d7-64676be20f8a tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:41.186321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de52099-f21b-4701-a1d7-64676be20f8a tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:41.187002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de52099-f21b-4701-a1d7-64676be20f8a tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:41.191025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de52099-f21b-4701-a1d7-64676be20f8a tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:41.240472 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3457/6940] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:40 2022] GET /identity/v3/users => generated 8058 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:41.244991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de52099-f21b-4701-a1d7-64676be20f8a tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:41.253941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2de52099-f21b-4701-a1d7-64676be20f8a tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:41.301010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de52099-f21b-4701-a1d7-64676be20f8a tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:41.318504 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6a787-2b70-4672-804a-2799a2cbd59a tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6543e6cb46134b42855baf844375d50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae8e609352648fabb4699ef5f485af5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:41.319637 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6a787-2b70-4672-804a-2799a2cbd59a tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:41.320868 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6a787-2b70-4672-804a-2799a2cbd59a tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:41.321310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6a787-2b70-4672-804a-2799a2cbd59a tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:41.322204 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c6a787-2b70-4672-804a-2799a2cbd59a tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: Adding query filter params (name=tempest-test_user-810714972) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:30:41.324323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c6a787-2b70-4672-804a-2799a2cbd59a tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:41.332337 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c6a787-2b70-4672-804a-2799a2cbd59a tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:41.361770 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3484/6941] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:41.363739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd98e1-810a-4347-ab42-2529fc908496 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:41.364033 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd98e1-810a-4347-ab42-2529fc908496 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:41.364434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd98e1-810a-4347-ab42-2529fc908496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:41.423193 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3458/6942] 10.222.0.30 () {58 vars in 1187 bytes} [Sun Sep 4 01:30:41 2022] GET /identity/v3/users?name=tempest-test_user-810714972 => generated 474 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:41.424055 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c5bd98e1-810a-4347-ab42-2529fc908496 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:41.425061 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6a787-2b70-4672-804a-2799a2cbd59a tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:41.426694 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c5bd98e1-810a-4347-ab42-2529fc908496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:41.471063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6a787-2b70-4672-804a-2799a2cbd59a tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:41.474790 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3485/6943] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:30:41.476781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd98e1-810a-4347-ab42-2529fc908496 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:41.486990 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342b19d-8a87-4548-bc68-36839db89538 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6543e6cb46134b42855baf844375d50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae8e609352648fabb4699ef5f485af5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:41.488214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342b19d-8a87-4548-bc68-36839db89538 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:41.492187 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342b19d-8a87-4548-bc68-36839db89538 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:41.492659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342b19d-8a87-4548-bc68-36839db89538 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:41.493595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342b19d-8a87-4548-bc68-36839db89538 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:30:41.494079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342b19d-8a87-4548-bc68-36839db89538 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:41.498783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342b19d-8a87-4548-bc68-36839db89538 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:41.505906 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd98e1-810a-4347-ab42-2529fc908496 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:41.511663 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:41.520174 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034fe53-b720-4b16-999b-feade8092c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:41.520799 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034fe53-b720-4b16-999b-feade8092c38 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:41.521081 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034fe53-b720-4b16-999b-feade8092c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:41.521362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034fe53-b720-4b16-999b-feade8092c38 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:41.522045 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034fe53-b720-4b16-999b-feade8092c38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:30:41.522353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034fe53-b720-4b16-999b-feade8092c38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:41.523974 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034fe53-b720-4b16-999b-feade8092c38 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:41.531735 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3459/6944] 10.222.0.30 () {58 vars in 1149 bytes} [Sun Sep 4 01:30:41 2022] GET /identity/v3/users?enabled=False => generated 432 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:41.537370 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342b19d-8a87-4548-bc68-36839db89538 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:41.558860 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3486/6945] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:41.561035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342b19d-8a87-4548-bc68-36839db89538 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:41.562473 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034fe53-b720-4b16-999b-feade8092c38 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:41.581456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034fe53-b720-4b16-999b-feade8092c38 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:41.586424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a693c-75d2-4917-a56e-0125f95a3a32 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6543e6cb46134b42855baf844375d50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae8e609352648fabb4699ef5f485af5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:41.591246 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e7ced-67e1-43f1-ac6a-1c3888321a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:41.592212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e7ced-67e1-43f1-ac6a-1c3888321a73 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:41.592591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e7ced-67e1-43f1-ac6a-1c3888321a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:41.592785 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e7ced-67e1-43f1-ac6a-1c3888321a73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:41.593479 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e7ced-67e1-43f1-ac6a-1c3888321a73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:41.595915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e7ced-67e1-43f1-ac6a-1c3888321a73 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:41.612649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a693c-75d2-4917-a56e-0125f95a3a32 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:41.613048 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a693c-75d2-4917-a56e-0125f95a3a32 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:41.613537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a693c-75d2-4917-a56e-0125f95a3a32 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] PATH_INFO: `/v3/users/96580649a7304238804bffbd1cd75505` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:41.638278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a693c-75d2-4917-a56e-0125f95a3a32 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: Authorizing `identity:delete_user(user_id=96580649a7304238804bffbd1cd75505)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:41.641465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a693c-75d2-4917-a56e-0125f95a3a32 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:41.705760 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3487/6946] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:30:41 2022] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:30:41.705760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e7ced-67e1-43f1-ac6a-1c3888321a73 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:41.710271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fd3e7ced-67e1-43f1-ac6a-1c3888321a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:41.776388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-264a693c-75d2-4917-a56e-0125f95a3a32 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96580649a7304238804bffbd1cd75505'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:41.777777 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-264a693c-75d2-4917-a56e-0125f95a3a32 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96580649a7304238804bffbd1cd75505'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:41.804120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-264a693c-75d2-4917-a56e-0125f95a3a32 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96580649a7304238804bffbd1cd75505'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:41.815878 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:41.817615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-264a693c-75d2-4917-a56e-0125f95a3a32 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96580649a7304238804bffbd1cd75505'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:41.818428 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-264a693c-75d2-4917-a56e-0125f95a3a32 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96580649a7304238804bffbd1cd75505'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:41.848675 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3460/6947] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:41 2022] DELETE /identity/v3/users/96580649a7304238804bffbd1cd75505 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:41.849695 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a693c-75d2-4917-a56e-0125f95a3a32 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:41.852046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-264a693c-75d2-4917-a56e-0125f95a3a32 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:41.890058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e7ced-67e1-43f1-ac6a-1c3888321a73 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:41.934907 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a693c-75d2-4917-a56e-0125f95a3a32 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:41.943687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c6769-2bcb-4fc2-b717-231345050e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:41.944819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c6769-2bcb-4fc2-b717-231345050e37 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:41.945147 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c6769-2bcb-4fc2-b717-231345050e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:41.945502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c6769-2bcb-4fc2-b717-231345050e37 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:41.946397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c6769-2bcb-4fc2-b717-231345050e37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:41.951097 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c6769-2bcb-4fc2-b717-231345050e37 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:41.996760 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3461/6948] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:30:41 2022] POST /identity/v3/users => generated 294 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:42.003125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c6769-2bcb-4fc2-b717-231345050e37 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:42.004578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e61c6769-2bcb-4fc2-b717-231345050e37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:42.034815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fd2d6-45cf-4776-82df-86512528b8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:42.037775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fd2d6-45cf-4776-82df-86512528b8bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:42.038295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fd2d6-45cf-4776-82df-86512528b8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:42.038783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fd2d6-45cf-4776-82df-86512528b8bc admin admin] PATH_INFO: `/v3/projects/c9f42e7a98f0424d82d92ba257365f73` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:42.040278 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fd2d6-45cf-4776-82df-86512528b8bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9f42e7a98f0424d82d92ba257365f73)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:42.043376 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fd2d6-45cf-4776-82df-86512528b8bc admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:42.121565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-875fd2d6-45cf-4776-82df-86512528b8bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9f42e7a98f0424d82d92ba257365f73', 'request_id': 'req-875fd2d6-45cf-4776-82df-86512528b8bc'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:42.130833 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:42.136028 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-875fd2d6-45cf-4776-82df-86512528b8bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9f42e7a98f0424d82d92ba257365f73', 'request_id': 'req-875fd2d6-45cf-4776-82df-86512528b8bc'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:42.165574 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-875fd2d6-45cf-4776-82df-86512528b8bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9f42e7a98f0424d82d92ba257365f73', 'request_id': 'req-875fd2d6-45cf-4776-82df-86512528b8bc'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:42.182650 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c6769-2bcb-4fc2-b717-231345050e37 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:42.183087 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-875fd2d6-45cf-4776-82df-86512528b8bc admin admin] The token cache is being invalidate because project c9f42e7a98f0424d82d92ba257365f73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:30:42.183386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-875fd2d6-45cf-4776-82df-86512528b8bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:42.184252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-875fd2d6-45cf-4776-82df-86512528b8bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:42.186522 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3488/6949] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:30:41 2022] DELETE /identity/v3/projects/c9f42e7a98f0424d82d92ba257365f73 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:42.187478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fd2d6-45cf-4776-82df-86512528b8bc admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:42.190272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-875fd2d6-45cf-4776-82df-86512528b8bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:42.309945 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fd2d6-45cf-4776-82df-86512528b8bc admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:42.336088 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de197c4f-93b5-438f-bdf3-b0542d0862e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:42.338318 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de197c4f-93b5-438f-bdf3-b0542d0862e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:42.340029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de197c4f-93b5-438f-bdf3-b0542d0862e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:42.341312 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de197c4f-93b5-438f-bdf3-b0542d0862e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:42.343096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba911ec-512c-407f-b324-e5883e1e0c07 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6543e6cb46134b42855baf844375d50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae8e609352648fabb4699ef5f485af5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:42.344290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de197c4f-93b5-438f-bdf3-b0542d0862e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:42.346350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba911ec-512c-407f-b324-e5883e1e0c07 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:42.346741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba911ec-512c-407f-b324-e5883e1e0c07 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:42.347109 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba911ec-512c-407f-b324-e5883e1e0c07 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] PATH_INFO: `/v3/users/b30e61ece7df4b2890f31502441c8e6d` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:42.349397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de197c4f-93b5-438f-bdf3-b0542d0862e3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:42.349839 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba911ec-512c-407f-b324-e5883e1e0c07 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b30e61ece7df4b2890f31502441c8e6d)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:42.354095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba911ec-512c-407f-b324-e5883e1e0c07 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:42.372517 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3489/6950] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:42.373836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de197c4f-93b5-438f-bdf3-b0542d0862e3 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:42.375684 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-de197c4f-93b5-438f-bdf3-b0542d0862e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:42.394986 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:42.413475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de197c4f-93b5-438f-bdf3-b0542d0862e3 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:42.425244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64678d3-7f0c-4002-9ae8-485992c69096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:42.426105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64678d3-7f0c-4002-9ae8-485992c69096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:42.426606 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64678d3-7f0c-4002-9ae8-485992c69096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:42.427059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64678d3-7f0c-4002-9ae8-485992c69096 admin admin] PATH_INFO: `/v3/users/9743e659ad504d028b992c4831d4b47e` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:42.428658 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64678d3-7f0c-4002-9ae8-485992c69096 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9743e659ad504d028b992c4831d4b47e)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:42.431451 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64678d3-7f0c-4002-9ae8-485992c69096 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:42.491819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dba911ec-512c-407f-b324-e5883e1e0c07 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b30e61ece7df4b2890f31502441c8e6d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:42.493057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dba911ec-512c-407f-b324-e5883e1e0c07 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b30e61ece7df4b2890f31502441c8e6d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:42.502480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dba911ec-512c-407f-b324-e5883e1e0c07 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b30e61ece7df4b2890f31502441c8e6d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:42.513608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dba911ec-512c-407f-b324-e5883e1e0c07 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b30e61ece7df4b2890f31502441c8e6d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:42.514350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dba911ec-512c-407f-b324-e5883e1e0c07 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b30e61ece7df4b2890f31502441c8e6d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:42.545922 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3462/6951] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:41 2022] DELETE /identity/v3/users/b30e61ece7df4b2890f31502441c8e6d => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:42.547265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba911ec-512c-407f-b324-e5883e1e0c07 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:42.549414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-dba911ec-512c-407f-b324-e5883e1e0c07 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:42.569234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a64678d3-7f0c-4002-9ae8-485992c69096 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9743e659ad504d028b992c4831d4b47e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:42.571812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a64678d3-7f0c-4002-9ae8-485992c69096 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9743e659ad504d028b992c4831d4b47e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:42.612689 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a64678d3-7f0c-4002-9ae8-485992c69096 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9743e659ad504d028b992c4831d4b47e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:42.632271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a64678d3-7f0c-4002-9ae8-485992c69096 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9743e659ad504d028b992c4831d4b47e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:42.632703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a64678d3-7f0c-4002-9ae8-485992c69096 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9743e659ad504d028b992c4831d4b47e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:42.680144 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3490/6952] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:42 2022] DELETE /identity/v3/users/9743e659ad504d028b992c4831d4b47e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:42.680734 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64678d3-7f0c-4002-9ae8-485992c69096 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:42.697895 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a64678d3-7f0c-4002-9ae8-485992c69096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:42.749112 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba911ec-512c-407f-b324-e5883e1e0c07 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:42.800693 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:42.886991 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64678d3-7f0c-4002-9ae8-485992c69096 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:42.898570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10acce-3e4d-48cd-ace5-77a1959fec15 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6543e6cb46134b42855baf844375d50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae8e609352648fabb4699ef5f485af5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:42.899525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10acce-3e4d-48cd-ace5-77a1959fec15 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:42.900033 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10acce-3e4d-48cd-ace5-77a1959fec15 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:42.900534 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10acce-3e4d-48cd-ace5-77a1959fec15 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] PATH_INFO: `/v3/domains/7bdff0b2e2f54e4e8ab4d40cd6f493e6` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:42.902256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10acce-3e4d-48cd-ace5-77a1959fec15 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=7bdff0b2e2f54e4e8ab4d40cd6f493e6)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:42.904133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10acce-3e4d-48cd-ace5-77a1959fec15 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:42.936883 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4a10acce-3e4d-48cd-ace5-77a1959fec15 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7bdff0b2e2f54e4e8ab4d40cd6f493e6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:42.938579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4a10acce-3e4d-48cd-ace5-77a1959fec15 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7bdff0b2e2f54e4e8ab4d40cd6f493e6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:42.941963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4e41a-8923-4415-86ae-5078c17b92f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:42.942603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4e41a-8923-4415-86ae-5078c17b92f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:42.942886 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4e41a-8923-4415-86ae-5078c17b92f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:42.943168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4e41a-8923-4415-86ae-5078c17b92f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:42.946011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b4e41a-8923-4415-86ae-5078c17b92f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:42.948615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b4e41a-8923-4415-86ae-5078c17b92f5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:42.989823 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3463/6953] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:42.990392 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4a10acce-3e4d-48cd-ace5-77a1959fec15 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7bdff0b2e2f54e4e8ab4d40cd6f493e6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:42.991932 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4a10acce-3e4d-48cd-ace5-77a1959fec15 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7bdff0b2e2f54e4e8ab4d40cd6f493e6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:42.996235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4e41a-8923-4415-86ae-5078c17b92f5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:42.999454 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3491/6954] 10.222.0.30 () {60 vars in 1249 bytes} [Sun Sep 4 01:30:42 2022] PATCH /identity/v3/domains/7bdff0b2e2f54e4e8ab4d40cd6f493e6 => generated 277 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:43.002000 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-51b4e41a-8923-4415-86ae-5078c17b92f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:43.003215 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10acce-3e4d-48cd-ace5-77a1959fec15 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:43.004993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4a10acce-3e4d-48cd-ace5-77a1959fec15 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:43.027129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4e41a-8923-4415-86ae-5078c17b92f5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:43.103461 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85084d30-2d6d-4a6b-8153-88f54a16dc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:43.104748 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85084d30-2d6d-4a6b-8153-88f54a16dc35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:43.105030 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85084d30-2d6d-4a6b-8153-88f54a16dc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:43.105305 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85084d30-2d6d-4a6b-8153-88f54a16dc35 admin admin] PATH_INFO: `/v3/projects/d6afd8a92a1b4bce8d9945c1385fb406/users/2e54f4b3fd0f4f77b3fdd0416ef39de9/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:43.119627 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:43.139561 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85084d30-2d6d-4a6b-8153-88f54a16dc35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6afd8a92a1b4bce8d9945c1385fb406, user_id=2e54f4b3fd0f4f77b3fdd0416ef39de9, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:43.145834 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85084d30-2d6d-4a6b-8153-88f54a16dc35 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:43.163299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10acce-3e4d-48cd-ace5-77a1959fec15 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:43.175366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbca85-7276-4241-a119-4f70f4da7a29 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6543e6cb46134b42855baf844375d50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae8e609352648fabb4699ef5f485af5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:43.177858 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3464/6955] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:30:42 2022] PUT /identity/v3/projects/d6afd8a92a1b4bce8d9945c1385fb406/users/2e54f4b3fd0f4f77b3fdd0416ef39de9/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:43.187789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbca85-7276-4241-a119-4f70f4da7a29 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:43.187789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbca85-7276-4241-a119-4f70f4da7a29 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:43.187789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbca85-7276-4241-a119-4f70f4da7a29 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] PATH_INFO: `/v3/domains/7bdff0b2e2f54e4e8ab4d40cd6f493e6` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:43.190608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b180d23-cb9a-4c7e-987a-051734781636 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:43.192994 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b180d23-cb9a-4c7e-987a-051734781636 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:43.193487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b180d23-cb9a-4c7e-987a-051734781636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:43.229653 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bbca85-7276-4241-a119-4f70f4da7a29 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7bdff0b2e2f54e4e8ab4d40cd6f493e6)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:43.237182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bbca85-7276-4241-a119-4f70f4da7a29 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:43.276331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-6b180d23-cb9a-4c7e-987a-051734781636 None None] MFA Rules not processed for user `2e54f4b3fd0f4f77b3fdd0416ef39de9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:43.277673 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6b180d23-cb9a-4c7e-987a-051734781636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:43.292483 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-78bbca85-7276-4241-a119-4f70f4da7a29 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7bdff0b2e2f54e4e8ab4d40cd6f493e6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:43.346562 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-78bbca85-7276-4241-a119-4f70f4da7a29 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7bdff0b2e2f54e4e8ab4d40cd6f493e6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:43.504120 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3465/6956] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:43.505740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b180d23-cb9a-4c7e-987a-051734781636 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:43.512680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-78bbca85-7276-4241-a119-4f70f4da7a29 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bdff0b2e2f54e4e8ab4d40cd6f493e6', 'request_id': 'req-78bbca85-7276-4241-a119-4f70f4da7a29'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:43.539213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-78bbca85-7276-4241-a119-4f70f4da7a29 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bdff0b2e2f54e4e8ab4d40cd6f493e6', 'request_id': 'req-78bbca85-7276-4241-a119-4f70f4da7a29'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:43.547673 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-78bbca85-7276-4241-a119-4f70f4da7a29 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bdff0b2e2f54e4e8ab4d40cd6f493e6', 'request_id': 'req-78bbca85-7276-4241-a119-4f70f4da7a29'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:43.566138 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:43.580152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-78bbca85-7276-4241-a119-4f70f4da7a29 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] The token cache is being invalidate because project 7bdff0b2e2f54e4e8ab4d40cd6f493e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:30:43.580461 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-78bbca85-7276-4241-a119-4f70f4da7a29 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:43.581248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-78bbca85-7276-4241-a119-4f70f4da7a29 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:43.591936 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-78bbca85-7276-4241-a119-4f70f4da7a29 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7bdff0b2e2f54e4e8ab4d40cd6f493e6', 'request_id': 'req-78bbca85-7276-4241-a119-4f70f4da7a29'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:43.592998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-78bbca85-7276-4241-a119-4f70f4da7a29 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7bdff0b2e2f54e4e8ab4d40cd6f493e6', 'request_id': 'req-78bbca85-7276-4241-a119-4f70f4da7a29'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:43.594861 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-78bbca85-7276-4241-a119-4f70f4da7a29 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7bdff0b2e2f54e4e8ab4d40cd6f493e6', 'request_id': 'req-78bbca85-7276-4241-a119-4f70f4da7a29'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:43.619689 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3492/6957] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:30:43 2022] DELETE /identity/v3/domains/7bdff0b2e2f54e4e8ab4d40cd6f493e6 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:43.624954 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b180d23-cb9a-4c7e-987a-051734781636 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:43.636152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbca85-7276-4241-a119-4f70f4da7a29 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:43.640625 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-78bbca85-7276-4241-a119-4f70f4da7a29 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:43.738840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38a1ef-acf9-43c8-b7b0-badd7004a6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:43.739744 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38a1ef-acf9-43c8-b7b0-badd7004a6c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:43.740327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38a1ef-acf9-43c8-b7b0-badd7004a6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:43.740806 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38a1ef-acf9-43c8-b7b0-badd7004a6c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:43.741741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38a1ef-acf9-43c8-b7b0-badd7004a6c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:43.744695 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38a1ef-acf9-43c8-b7b0-badd7004a6c9 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:43.804113 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3466/6958] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:30:43 2022] POST /identity/v3/projects => generated 385 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:43.807070 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38a1ef-acf9-43c8-b7b0-badd7004a6c9 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:43.810068 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6f38a1ef-acf9-43c8-b7b0-badd7004a6c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:43.830271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbca85-7276-4241-a119-4f70f4da7a29 tempest-UsersV3TestJSON-1089734404 tempest-UsersV3TestJSON-1089734404-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:43.868691 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:43.963937 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ad1aa-03b5-472e-b250-dd24a5624c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:43.964917 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ad1aa-03b5-472e-b250-dd24a5624c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:43.965449 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ad1aa-03b5-472e-b250-dd24a5624c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:43.965735 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ad1aa-03b5-472e-b250-dd24a5624c4d admin admin] PATH_INFO: `/v3/users/01611ff1d1a6458f9e8012e20a087acb` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:43.970772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ad1aa-03b5-472e-b250-dd24a5624c4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=01611ff1d1a6458f9e8012e20a087acb)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:43.972942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38a1ef-acf9-43c8-b7b0-badd7004a6c9 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:43.974600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ad1aa-03b5-472e-b250-dd24a5624c4d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:43.983678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bda532-9386-488a-bb78-b1e274aca96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:43.984316 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bda532-9386-488a-bb78-b1e274aca96f admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:43.984600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bda532-9386-488a-bb78-b1e274aca96f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:43.984877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bda532-9386-488a-bb78-b1e274aca96f admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:43.986758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bda532-9386-488a-bb78-b1e274aca96f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:43.991298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bda532-9386-488a-bb78-b1e274aca96f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:44.064307 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3467/6959] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:30:43 2022] POST /identity/v3/users => generated 299 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:30:44.068270 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bda532-9386-488a-bb78-b1e274aca96f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:44.076401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c8bda532-9386-488a-bb78-b1e274aca96f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:44.097930 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bda532-9386-488a-bb78-b1e274aca96f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:44.098609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e11ad1aa-03b5-472e-b250-dd24a5624c4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01611ff1d1a6458f9e8012e20a087acb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:44.100462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e11ad1aa-03b5-472e-b250-dd24a5624c4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01611ff1d1a6458f9e8012e20a087acb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:44.105794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e688e-4be2-447f-92a5-4b213792a2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:44.106844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e688e-4be2-447f-92a5-4b213792a2b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:44.106844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e688e-4be2-447f-92a5-4b213792a2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:44.107121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e688e-4be2-447f-92a5-4b213792a2b3 admin admin] PATH_INFO: `/v3/projects/d3c9e00556b643ddbbc8ac8cf314b419` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:44.112063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e688e-4be2-447f-92a5-4b213792a2b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3c9e00556b643ddbbc8ac8cf314b419)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:44.114178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e688e-4be2-447f-92a5-4b213792a2b3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:44.114479 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e11ad1aa-03b5-472e-b250-dd24a5624c4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01611ff1d1a6458f9e8012e20a087acb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:44.125696 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e11ad1aa-03b5-472e-b250-dd24a5624c4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01611ff1d1a6458f9e8012e20a087acb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:44.127270 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e11ad1aa-03b5-472e-b250-dd24a5624c4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01611ff1d1a6458f9e8012e20a087acb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:44.160161 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3493/6960] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:43 2022] DELETE /identity/v3/users/01611ff1d1a6458f9e8012e20a087acb => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:44.162479 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ad1aa-03b5-472e-b250-dd24a5624c4d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:44.165284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e11ad1aa-03b5-472e-b250-dd24a5624c4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:44.201357 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:44.203416 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-381e688e-4be2-447f-92a5-4b213792a2b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3c9e00556b643ddbbc8ac8cf314b419', 'request_id': 'req-381e688e-4be2-447f-92a5-4b213792a2b3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:44.223996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-381e688e-4be2-447f-92a5-4b213792a2b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3c9e00556b643ddbbc8ac8cf314b419', 'request_id': 'req-381e688e-4be2-447f-92a5-4b213792a2b3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:44.231606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-381e688e-4be2-447f-92a5-4b213792a2b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3c9e00556b643ddbbc8ac8cf314b419', 'request_id': 'req-381e688e-4be2-447f-92a5-4b213792a2b3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:44.260739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-381e688e-4be2-447f-92a5-4b213792a2b3 admin admin] The token cache is being invalidate because project d3c9e00556b643ddbbc8ac8cf314b419 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:30:44.261037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-381e688e-4be2-447f-92a5-4b213792a2b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:44.263117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-381e688e-4be2-447f-92a5-4b213792a2b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:44.266749 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3468/6961] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:30:44 2022] DELETE /identity/v3/projects/d3c9e00556b643ddbbc8ac8cf314b419 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:44.268014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecedf84-df77-411e-9e0a-4125732ffd7e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:44.268301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecedf84-df77-411e-9e0a-4125732ffd7e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:44.268577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecedf84-df77-411e-9e0a-4125732ffd7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:44.304715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ad1aa-03b5-472e-b250-dd24a5624c4d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:44.319993 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-0ecedf84-df77-411e-9e0a-4125732ffd7e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:44.321530 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0ecedf84-df77-411e-9e0a-4125732ffd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:44.407493 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:44.420491 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35abb839-283e-4e83-9c8f-3673fe3e1350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:44.421117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abb839-283e-4e83-9c8f-3673fe3e1350 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:44.421390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abb839-283e-4e83-9c8f-3673fe3e1350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:44.421688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abb839-283e-4e83-9c8f-3673fe3e1350 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:44.423883 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35abb839-283e-4e83-9c8f-3673fe3e1350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:44.426262 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3469/6962] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:44.427643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295e35a-52dd-476b-892f-03924164ce36 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:44.427996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295e35a-52dd-476b-892f-03924164ce36 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:44.428275 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295e35a-52dd-476b-892f-03924164ce36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:44.431449 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35abb839-283e-4e83-9c8f-3673fe3e1350 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:44.460634 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3494/6963] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:44.461533 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35abb839-283e-4e83-9c8f-3673fe3e1350 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:44.461710 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e295e35a-52dd-476b-892f-03924164ce36 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:44.463066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e295e35a-52dd-476b-892f-03924164ce36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:44.467856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-35abb839-283e-4e83-9c8f-3673fe3e1350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:44.479776 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3470/6964] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:44.487929 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295e35a-52dd-476b-892f-03924164ce36 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:44.490569 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e295e35a-52dd-476b-892f-03924164ce36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:44.522823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295e35a-52dd-476b-892f-03924164ce36 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:44.541157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c394af-3655-4da3-b17b-7f51fcd48171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:44.541896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c394af-3655-4da3-b17b-7f51fcd48171 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:44.542178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c394af-3655-4da3-b17b-7f51fcd48171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:44.542452 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c394af-3655-4da3-b17b-7f51fcd48171 admin admin] PATH_INFO: `/v3/projects/190e2ca692b742ceb9889c9fb385682b/users/52b03baba26342fe8210adaeff61dc50/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:44.561859 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c394af-3655-4da3-b17b-7f51fcd48171 admin admin] RBAC: Authorizing `identity:create_grant(project_id=190e2ca692b742ceb9889c9fb385682b, user_id=52b03baba26342fe8210adaeff61dc50, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:44.564687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c394af-3655-4da3-b17b-7f51fcd48171 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:44.577628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35abb839-283e-4e83-9c8f-3673fe3e1350 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:44.584541 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3471/6965] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:30:44 2022] PUT /identity/v3/projects/190e2ca692b742ceb9889c9fb385682b/users/52b03baba26342fe8210adaeff61dc50/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:44.585962 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580713be-23df-4ecc-a96b-04a4911e3bbb None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:44.586252 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580713be-23df-4ecc-a96b-04a4911e3bbb None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:44.586732 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580713be-23df-4ecc-a96b-04a4911e3bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:44.612610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-580713be-23df-4ecc-a96b-04a4911e3bbb None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:44.614581 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-580713be-23df-4ecc-a96b-04a4911e3bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:44.689206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf187aaa-38a8-4d2d-b53f-1b6361b128e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:44.689864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf187aaa-38a8-4d2d-b53f-1b6361b128e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:44.690480 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf187aaa-38a8-4d2d-b53f-1b6361b128e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:44.690769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf187aaa-38a8-4d2d-b53f-1b6361b128e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:44.699134 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3472/6966] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:44.699978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580713be-23df-4ecc-a96b-04a4911e3bbb None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:44.712450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf187aaa-38a8-4d2d-b53f-1b6361b128e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:44.717692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf187aaa-38a8-4d2d-b53f-1b6361b128e2 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:44.733305 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580713be-23df-4ecc-a96b-04a4911e3bbb None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:44.747199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b4bc4-1e45-40b4-9c3c-30c6f4b95963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:44.747830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b4bc4-1e45-40b4-9c3c-30c6f4b95963 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:44.748110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b4bc4-1e45-40b4-9c3c-30c6f4b95963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:44.748384 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b4bc4-1e45-40b4-9c3c-30c6f4b95963 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:44.749048 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90b4bc4-1e45-40b4-9c3c-30c6f4b95963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:44.750685 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90b4bc4-1e45-40b4-9c3c-30c6f4b95963 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:44.752353 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3495/6967] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:30:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:30:44.753525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf187aaa-38a8-4d2d-b53f-1b6361b128e2 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:44.853770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf187aaa-38a8-4d2d-b53f-1b6361b128e2 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:44.857118 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3473/6968] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:44.863829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b4bc4-1e45-40b4-9c3c-30c6f4b95963 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:44.883537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa999534-f853-4012-9ea5-e3c4684136a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:44.891141 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa999534-f853-4012-9ea5-e3c4684136a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:44.893911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa999534-f853-4012-9ea5-e3c4684136a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:44.894200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa999534-f853-4012-9ea5-e3c4684136a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:44.899338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa999534-f853-4012-9ea5-e3c4684136a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:30:44.901496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa999534-f853-4012-9ea5-e3c4684136a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:44.910696 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa999534-f853-4012-9ea5-e3c4684136a7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:44.924214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b4bc4-1e45-40b4-9c3c-30c6f4b95963 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:44.938273 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d624b79-3af5-4c9b-af58-17b354aab2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:44.941892 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d624b79-3af5-4c9b-af58-17b354aab2d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:44.942430 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d624b79-3af5-4c9b-af58-17b354aab2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:44.943192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d624b79-3af5-4c9b-af58-17b354aab2d1 admin admin] PATH_INFO: `/v3/projects/190e2ca692b742ceb9889c9fb385682b/users/52b03baba26342fe8210adaeff61dc50/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:44.948275 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d624b79-3af5-4c9b-af58-17b354aab2d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=190e2ca692b742ceb9889c9fb385682b, user_id=52b03baba26342fe8210adaeff61dc50, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:44.952159 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d624b79-3af5-4c9b-af58-17b354aab2d1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:44.959265 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3496/6969] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:44.960203 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa999534-f853-4012-9ea5-e3c4684136a7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:44.993797 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3474/6970] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:30:44 2022] PUT /identity/v3/projects/190e2ca692b742ceb9889c9fb385682b/users/52b03baba26342fe8210adaeff61dc50/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:45.003590 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa999534-f853-4012-9ea5-e3c4684136a7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:45.005577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d8f35-d4be-4049-ab5a-7e9f6bb315a8 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:45.005805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d8f35-d4be-4049-ab5a-7e9f6bb315a8 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:45.005980 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d8f35-d4be-4049-ab5a-7e9f6bb315a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:45.100070 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b31d8f35-d4be-4049-ab5a-7e9f6bb315a8 None None] MFA Rules not processed for user `52b03baba26342fe8210adaeff61dc50`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:45.104649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b31d8f35-d4be-4049-ab5a-7e9f6bb315a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:45.129191 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:45.356877 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3ccaf-186c-44ec-8956-79898b9e636d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:45.358159 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3ccaf-186c-44ec-8956-79898b9e636d admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:45.361371 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3ccaf-186c-44ec-8956-79898b9e636d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:45.363990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3ccaf-186c-44ec-8956-79898b9e636d admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:45.366561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3ccaf-186c-44ec-8956-79898b9e636d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:45.378183 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3ccaf-186c-44ec-8956-79898b9e636d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:45.382206 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3475/6971] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:45.387349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d8f35-d4be-4049-ab5a-7e9f6bb315a8 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:45.406950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d8f35-d4be-4049-ab5a-7e9f6bb315a8 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:45.415621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b17ae-e9a2-4ee7-b5a8-3d441a0d3cb6 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52b03baba26342fe8210adaeff61dc50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e2ca692b742ceb9889c9fb385682b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:45.417063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b17ae-e9a2-4ee7-b5a8-3d441a0d3cb6 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:45.423769 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b17ae-e9a2-4ee7-b5a8-3d441a0d3cb6 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:45.424885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b17ae-e9a2-4ee7-b5a8-3d441a0d3cb6 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:45.425902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b17ae-e9a2-4ee7-b5a8-3d441a0d3cb6 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:45.427826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b17ae-e9a2-4ee7-b5a8-3d441a0d3cb6 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:45.472442 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3476/6972] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:30:45 2022] POST /identity/v3/services => generated 289 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:30:45.477263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b17ae-e9a2-4ee7-b5a8-3d441a0d3cb6 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:45.484404 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3497/6973] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:30:44 2022] POST /identity/v3/projects => generated 383 bytes in 522 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:45.485765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3ccaf-186c-44ec-8956-79898b9e636d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:45.528091 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b17ae-e9a2-4ee7-b5a8-3d441a0d3cb6 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:45.561568 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:45.635674 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3ccaf-186c-44ec-8956-79898b9e636d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:45.636940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a41a4-fd11-4962-af34-662b00874321 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52b03baba26342fe8210adaeff61dc50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e2ca692b742ceb9889c9fb385682b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:45.637984 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a41a4-fd11-4962-af34-662b00874321 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:45.638510 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a41a4-fd11-4962-af34-662b00874321 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:45.638964 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a41a4-fd11-4962-af34-662b00874321 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:45.640087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a41a4-fd11-4962-af34-662b00874321 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:45.642145 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a41a4-fd11-4962-af34-662b00874321 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:45.658593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2fa58-7069-4ed8-93df-e6d855abf942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:45.659213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2fa58-7069-4ed8-93df-e6d855abf942 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:45.659519 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2fa58-7069-4ed8-93df-e6d855abf942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:45.659818 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2fa58-7069-4ed8-93df-e6d855abf942 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:45.664777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-6f4a41a4-fd11-4962-af34-662b00874321 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Sep 04 01:30:45.664777 n-d-master-1 devstack@keystone.service[81825]: Failed validating 'type' in schema['properties']['enabled']: Sep 04 01:30:45.664777 n-d-master-1 devstack@keystone.service[81825]: {'enum': [True, False, None], 'type': 'boolean'} Sep 04 01:30:45.664777 n-d-master-1 devstack@keystone.service[81825]: On instance['enabled']: Sep 04 01:30:45.664777 n-d-master-1 devstack@keystone.service[81825]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Sep 04 01:30:45.664777 n-d-master-1 devstack@keystone.service[81825]: Failed validating 'type' in schema['properties']['enabled']: Sep 04 01:30:45.664777 n-d-master-1 devstack@keystone.service[81825]: {'enum': [True, False, None], 'type': 'boolean'} Sep 04 01:30:45.664777 n-d-master-1 devstack@keystone.service[81825]: On instance['enabled']: Sep 04 01:30:45.664777 n-d-master-1 devstack@keystone.service[81825]: 'False' Sep 04 01:30:45.664777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:30:45.664777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 04 01:30:45.664777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 04 01:30:45.664777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 04 01:30:45.664777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise error Sep 04 01:30:45.664777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Sep 04 01:30:45.664777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:30:45.664777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 04 01:30:45.664777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 04 01:30:45.664777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:30:45.664777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application On instance['enabled']: Sep 04 01:30:45.664777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application 'False' Sep 04 01:30:45.664777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:30:45.664777 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:30:45.666610 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:30:45.666610 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:30:45.666610 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:30:45.666610 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:30:45.666610 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:30:45.666610 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:30:45.666610 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:30:45.666610 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:30:45.666610 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:30:45.666610 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:30:45.666610 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:30:45.666610 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:30:45.666610 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Sep 04 01:30:45.666610 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Sep 04 01:30:45.666610 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 04 01:30:45.666610 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 04 01:30:45.666610 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 04 01:30:45.667964 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 04 01:30:45.667964 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Sep 04 01:30:45.667964 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:30:45.667964 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 04 01:30:45.667964 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 04 01:30:45.667964 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:30:45.667964 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application On instance['enabled']: Sep 04 01:30:45.667964 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application 'False' Sep 04 01:30:45.667964 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:30:45.674484 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2fa58-7069-4ed8-93df-e6d855abf942 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:45.674686 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3477/6974] 10.222.0.30 () {60 vars in 1156 bytes} [Sun Sep 4 01:30:45 2022] POST /identity/v3/endpoints => generated 283 bytes in 193 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 04 01:30:45.674885 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2fa58-7069-4ed8-93df-e6d855abf942 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:45.676750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1dd0d4-f515-4c2b-9f2a-23a4616558cf None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:45.677039 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1dd0d4-f515-4c2b-9f2a-23a4616558cf None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:45.677318 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1dd0d4-f515-4c2b-9f2a-23a4616558cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:45.721574 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-3c1dd0d4-f515-4c2b-9f2a-23a4616558cf None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:45.722968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3c1dd0d4-f515-4c2b-9f2a-23a4616558cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:45.730392 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3498/6975] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:30:45 2022] POST /identity/v3/users => generated 292 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:45.731053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2fa58-7069-4ed8-93df-e6d855abf942 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:45.749968 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2fa58-7069-4ed8-93df-e6d855abf942 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:45.756938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc9b23-bd5e-4aa5-b2c5-6b7a89921a56 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52b03baba26342fe8210adaeff61dc50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e2ca692b742ceb9889c9fb385682b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:45.757670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc9b23-bd5e-4aa5-b2c5-6b7a89921a56 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:45.758978 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc9b23-bd5e-4aa5-b2c5-6b7a89921a56 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:45.759258 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc9b23-bd5e-4aa5-b2c5-6b7a89921a56 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:45.760077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc9b23-bd5e-4aa5-b2c5-6b7a89921a56 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:45.763959 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc9b23-bd5e-4aa5-b2c5-6b7a89921a56 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:45.779031 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-06cc9b23-bd5e-4aa5-b2c5-6b7a89921a56 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Sep 04 01:30:45.779031 n-d-master-1 devstack@keystone.service[81824]: Failed validating 'type' in schema['properties']['enabled']: Sep 04 01:30:45.779031 n-d-master-1 devstack@keystone.service[81824]: {'enum': [True, False, None], 'type': 'boolean'} Sep 04 01:30:45.779031 n-d-master-1 devstack@keystone.service[81824]: On instance['enabled']: Sep 04 01:30:45.779031 n-d-master-1 devstack@keystone.service[81824]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Sep 04 01:30:45.779031 n-d-master-1 devstack@keystone.service[81824]: Failed validating 'type' in schema['properties']['enabled']: Sep 04 01:30:45.779031 n-d-master-1 devstack@keystone.service[81824]: {'enum': [True, False, None], 'type': 'boolean'} Sep 04 01:30:45.779031 n-d-master-1 devstack@keystone.service[81824]: On instance['enabled']: Sep 04 01:30:45.779031 n-d-master-1 devstack@keystone.service[81824]: 'True' Sep 04 01:30:45.779031 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:30:45.779031 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 04 01:30:45.779031 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 04 01:30:45.779031 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 04 01:30:45.779031 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise error Sep 04 01:30:45.779031 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Sep 04 01:30:45.779031 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:30:45.779031 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 04 01:30:45.779031 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 04 01:30:45.779031 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:30:45.779031 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application On instance['enabled']: Sep 04 01:30:45.779031 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application 'True' Sep 04 01:30:45.779031 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:30:45.779031 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:30:45.780767 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:30:45.780767 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:30:45.780767 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:30:45.780767 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:30:45.780767 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:30:45.780767 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:30:45.780767 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:30:45.780767 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:30:45.780767 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:30:45.780767 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:30:45.780767 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:30:45.780767 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:30:45.780767 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Sep 04 01:30:45.780767 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Sep 04 01:30:45.780767 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 04 01:30:45.780767 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 04 01:30:45.780767 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 04 01:30:45.781979 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 04 01:30:45.781979 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Sep 04 01:30:45.781979 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:30:45.781979 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 04 01:30:45.781979 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 04 01:30:45.781979 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:30:45.781979 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application On instance['enabled']: Sep 04 01:30:45.781979 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application 'True' Sep 04 01:30:45.781979 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:30:45.786888 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3499/6976] 10.222.0.30 () {60 vars in 1156 bytes} [Sun Sep 4 01:30:45 2022] POST /identity/v3/endpoints => generated 281 bytes in 52 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 04 01:30:45.786888 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc9b23-bd5e-4aa5-b2c5-6b7a89921a56 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:45.818363 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc9b23-bd5e-4aa5-b2c5-6b7a89921a56 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:45.838758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558d5d9-1cb1-48a9-8293-be5791879b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:45.839784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558d5d9-1cb1-48a9-8293-be5791879b92 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:45.840117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558d5d9-1cb1-48a9-8293-be5791879b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:45.856048 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558d5d9-1cb1-48a9-8293-be5791879b92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:45.857877 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8558d5d9-1cb1-48a9-8293-be5791879b92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:45.878360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8558d5d9-1cb1-48a9-8293-be5791879b92 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:45.890821 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3478/6977] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:30:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:45.891884 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1dd0d4-f515-4c2b-9f2a-23a4616558cf None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:45.908531 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1dd0d4-f515-4c2b-9f2a-23a4616558cf None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:45.913706 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3500/6978] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:45.915921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558d5d9-1cb1-48a9-8293-be5791879b92 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:45.922575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf0524-be4a-4955-aa81-4c8d5ddeee41 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52b03baba26342fe8210adaeff61dc50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e2ca692b742ceb9889c9fb385682b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:45.924616 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8558d5d9-1cb1-48a9-8293-be5791879b92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:45.925844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf0524-be4a-4955-aa81-4c8d5ddeee41 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:45.926969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf0524-be4a-4955-aa81-4c8d5ddeee41 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:45.927669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf0524-be4a-4955-aa81-4c8d5ddeee41 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:45.930757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf0524-be4a-4955-aa81-4c8d5ddeee41 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:45.934124 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf0524-be4a-4955-aa81-4c8d5ddeee41 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:45.957460 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558d5d9-1cb1-48a9-8293-be5791879b92 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:45.971821 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa832a85-ae62-4648-8f7e-568f191a4090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:45.972660 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa832a85-ae62-4648-8f7e-568f191a4090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:45.972945 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa832a85-ae62-4648-8f7e-568f191a4090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:45.973292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa832a85-ae62-4648-8f7e-568f191a4090 admin admin] PATH_INFO: `/v3/projects/eb2ec4247d254ff7a8abec85839e9646` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:45.974773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa832a85-ae62-4648-8f7e-568f191a4090 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb2ec4247d254ff7a8abec85839e9646)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:45.977872 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-25cf0524-be4a-4955-aa81-4c8d5ddeee41 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1026237596. To ensure interoperability, identifiers should be a valid uuid. Sep 04 01:30:45.977872 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 04 01:30:45.977872 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:30:45.980878 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa832a85-ae62-4648-8f7e-568f191a4090 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:45.992348 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:46.058920 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3479/6979] 10.222.0.30 () {60 vars in 1156 bytes} [Sun Sep 4 01:30:45 2022] POST /identity/v3/endpoints => generated 361 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:46.059795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf0524-be4a-4955-aa81-4c8d5ddeee41 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:46.063429 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-25cf0524-be4a-4955-aa81-4c8d5ddeee41 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:46.120829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fa832a85-ae62-4648-8f7e-568f191a4090 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb2ec4247d254ff7a8abec85839e9646', 'request_id': 'req-fa832a85-ae62-4648-8f7e-568f191a4090'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:46.130657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fa832a85-ae62-4648-8f7e-568f191a4090 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb2ec4247d254ff7a8abec85839e9646', 'request_id': 'req-fa832a85-ae62-4648-8f7e-568f191a4090'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:46.138164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fa832a85-ae62-4648-8f7e-568f191a4090 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb2ec4247d254ff7a8abec85839e9646', 'request_id': 'req-fa832a85-ae62-4648-8f7e-568f191a4090'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:46.151266 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fa832a85-ae62-4648-8f7e-568f191a4090 admin admin] The token cache is being invalidate because project eb2ec4247d254ff7a8abec85839e9646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:30:46.151812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fa832a85-ae62-4648-8f7e-568f191a4090 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:46.152647 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fa832a85-ae62-4648-8f7e-568f191a4090 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:46.154736 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3501/6980] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:30:45 2022] DELETE /identity/v3/projects/eb2ec4247d254ff7a8abec85839e9646 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:46.155770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa832a85-ae62-4648-8f7e-568f191a4090 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:46.166201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fa832a85-ae62-4648-8f7e-568f191a4090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:46.241516 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf0524-be4a-4955-aa81-4c8d5ddeee41 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:46.302364 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa832a85-ae62-4648-8f7e-568f191a4090 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:46.335323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f7f7c-6fab-467c-9d5e-a6678ef70df7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:46.336232 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f7f7c-6fab-467c-9d5e-a6678ef70df7 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:46.336352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74b596-0a23-421a-990f-cf5f82e4bbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:46.336837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f7f7c-6fab-467c-9d5e-a6678ef70df7 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:46.337016 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74b596-0a23-421a-990f-cf5f82e4bbd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:46.337271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74b596-0a23-421a-990f-cf5f82e4bbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:46.337599 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74b596-0a23-421a-990f-cf5f82e4bbd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:46.338130 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f7f7c-6fab-467c-9d5e-a6678ef70df7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:46.338298 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd74b596-0a23-421a-990f-cf5f82e4bbd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:46.340440 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd74b596-0a23-421a-990f-cf5f82e4bbd7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:46.341048 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-557f7f7c-6fab-467c-9d5e-a6678ef70df7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:46.342024 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:46.366895 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3502/6981] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:46.369984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74b596-0a23-421a-990f-cf5f82e4bbd7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:46.390375 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fd74b596-0a23-421a-990f-cf5f82e4bbd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:46.533422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74b596-0a23-421a-990f-cf5f82e4bbd7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:46.539086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7aad3b-55db-4523-a9f1-f456c3997791 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52b03baba26342fe8210adaeff61dc50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e2ca692b742ceb9889c9fb385682b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:46.540587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7aad3b-55db-4523-a9f1-f456c3997791 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:46.541039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7aad3b-55db-4523-a9f1-f456c3997791 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:46.541506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7aad3b-55db-4523-a9f1-f456c3997791 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] PATH_INFO: `/v3/regions/tempest-region-1026237596` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:46.542105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f7f7c-6fab-467c-9d5e-a6678ef70df7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:46.543022 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7aad3b-55db-4523-a9f1-f456c3997791 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1026237596)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:46.544276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7aad3b-55db-4523-a9f1-f456c3997791 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:46.546830 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3503/6982] 10.222.0.30 () {58 vars in 1206 bytes} [Sun Sep 4 01:30:46 2022] GET /identity/v3/regions/tempest-region-1026237596 => generated 180 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:46.547856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7aad3b-55db-4523-a9f1-f456c3997791 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:46.550388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f7f7c-6fab-467c-9d5e-a6678ef70df7 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:46.556147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ba7aad3b-55db-4523-a9f1-f456c3997791 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:46.571775 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3480/6983] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:30:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:30:46.573773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f7f7c-6fab-467c-9d5e-a6678ef70df7 service swift] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:46.585364 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7aad3b-55db-4523-a9f1-f456c3997791 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:46.596741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f7f7c-6fab-467c-9d5e-a6678ef70df7 service swift] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:46.598082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5323f-3b9b-4b60-ac92-ec7e7a3054ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:46.598743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5323f-3b9b-4b60-ac92-ec7e7a3054ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:46.599026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5323f-3b9b-4b60-ac92-ec7e7a3054ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:46.599302 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5323f-3b9b-4b60-ac92-ec7e7a3054ea admin admin] PATH_INFO: `/v3/users/6543e6cb46134b42855baf844375d50a` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:46.603744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5323f-3b9b-4b60-ac92-ec7e7a3054ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=6543e6cb46134b42855baf844375d50a)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:46.605800 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5323f-3b9b-4b60-ac92-ec7e7a3054ea admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:46.612340 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea0f17-3963-4883-b30e-08c0746fa616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:46.613336 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea0f17-3963-4883-b30e-08c0746fa616 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:46.613653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea0f17-3963-4883-b30e-08c0746fa616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:46.613934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea0f17-3963-4883-b30e-08c0746fa616 admin admin] PATH_INFO: `/v3/projects/f64538d201454f2dbb9cbfe06fbbe834/users/838ad8281d3c429cacad76aa9f2f31e5/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:46.701236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea0f17-3963-4883-b30e-08c0746fa616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f64538d201454f2dbb9cbfe06fbbe834, user_id=838ad8281d3c429cacad76aa9f2f31e5, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:46.712932 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea0f17-3963-4883-b30e-08c0746fa616 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:46.727274 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:46.772015 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3481/6984] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:30:46 2022] PUT /identity/v3/projects/f64538d201454f2dbb9cbfe06fbbe834/users/838ad8281d3c429cacad76aa9f2f31e5/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:46.773427 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea0f17-3963-4883-b30e-08c0746fa616 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:46.823522 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-edf5323f-3b9b-4b60-ac92-ec7e7a3054ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6543e6cb46134b42855baf844375d50a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:46.830936 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-edf5323f-3b9b-4b60-ac92-ec7e7a3054ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6543e6cb46134b42855baf844375d50a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:46.868319 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-edf5323f-3b9b-4b60-ac92-ec7e7a3054ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6543e6cb46134b42855baf844375d50a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:46.887881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-edf5323f-3b9b-4b60-ac92-ec7e7a3054ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6543e6cb46134b42855baf844375d50a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:46.888996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-edf5323f-3b9b-4b60-ac92-ec7e7a3054ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6543e6cb46134b42855baf844375d50a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:46.951549 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea0f17-3963-4883-b30e-08c0746fa616 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:46.959590 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f427588-2435-430d-92d8-b919b0bcf72e tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52b03baba26342fe8210adaeff61dc50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e2ca692b742ceb9889c9fb385682b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:46.960554 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f427588-2435-430d-92d8-b919b0bcf72e tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:46.961196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f427588-2435-430d-92d8-b919b0bcf72e tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:46.961658 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f427588-2435-430d-92d8-b919b0bcf72e tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] PATH_INFO: `/v3/endpoints/2a29e68e5db747ecb5a2f79713d8627f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:46.971095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f427588-2435-430d-92d8-b919b0bcf72e tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=2a29e68e5db747ecb5a2f79713d8627f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:46.974806 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3504/6985] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:46 2022] DELETE /identity/v3/users/6543e6cb46134b42855baf844375d50a => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:46.978376 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687736f-3b3e-4719-af07-ff96f29dfd1d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:46.978689 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687736f-3b3e-4719-af07-ff96f29dfd1d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:46.978962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687736f-3b3e-4719-af07-ff96f29dfd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:46.991046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f427588-2435-430d-92d8-b919b0bcf72e tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:47.021017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-1f427588-2435-430d-92d8-b919b0bcf72e tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Sep 04 01:30:47.021017 n-d-master-1 devstack@keystone.service[81825]: Failed validating 'type' in schema['properties']['enabled']: Sep 04 01:30:47.021017 n-d-master-1 devstack@keystone.service[81825]: {'enum': [True, False, None], 'type': 'boolean'} Sep 04 01:30:47.021017 n-d-master-1 devstack@keystone.service[81825]: On instance['enabled']: Sep 04 01:30:47.021017 n-d-master-1 devstack@keystone.service[81825]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Sep 04 01:30:47.021017 n-d-master-1 devstack@keystone.service[81825]: Failed validating 'type' in schema['properties']['enabled']: Sep 04 01:30:47.021017 n-d-master-1 devstack@keystone.service[81825]: {'enum': [True, False, None], 'type': 'boolean'} Sep 04 01:30:47.021017 n-d-master-1 devstack@keystone.service[81825]: On instance['enabled']: Sep 04 01:30:47.021017 n-d-master-1 devstack@keystone.service[81825]: 'False' Sep 04 01:30:47.021017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:30:47.021017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 04 01:30:47.021017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 04 01:30:47.021017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 04 01:30:47.021017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise error Sep 04 01:30:47.021017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Sep 04 01:30:47.021017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:30:47.021017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 04 01:30:47.021017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 04 01:30:47.021017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:30:47.021017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application On instance['enabled']: Sep 04 01:30:47.021017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application 'False' Sep 04 01:30:47.021017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:30:47.021017 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:30:47.022866 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:30:47.022866 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:30:47.022866 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:30:47.022866 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:30:47.022866 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:30:47.022866 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:30:47.022866 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:30:47.022866 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:30:47.022866 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:30:47.022866 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:30:47.022866 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:30:47.022866 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:30:47.022866 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Sep 04 01:30:47.022866 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Sep 04 01:30:47.022866 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 04 01:30:47.022866 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 04 01:30:47.022866 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 04 01:30:47.024145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 04 01:30:47.024145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Sep 04 01:30:47.024145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:30:47.024145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 04 01:30:47.024145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 04 01:30:47.024145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:30:47.024145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application On instance['enabled']: Sep 04 01:30:47.024145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application 'False' Sep 04 01:30:47.024145 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:30:47.030336 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3482/6986] 10.222.0.30 () {60 vars in 1255 bytes} [Sun Sep 4 01:30:46 2022] PATCH /identity/v3/endpoints/2a29e68e5db747ecb5a2f79713d8627f => generated 283 bytes in 255 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 04 01:30:47.031508 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f427588-2435-430d-92d8-b919b0bcf72e tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:47.038540 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1f427588-2435-430d-92d8-b919b0bcf72e tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:47.073308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f427588-2435-430d-92d8-b919b0bcf72e tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:47.106078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-1687736f-3b3e-4719-af07-ff96f29dfd1d None None] MFA Rules not processed for user `838ad8281d3c429cacad76aa9f2f31e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:47.113089 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1687736f-3b3e-4719-af07-ff96f29dfd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:47.243650 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93801015-a4e0-4d90-99ed-7317384384dc tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52b03baba26342fe8210adaeff61dc50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e2ca692b742ceb9889c9fb385682b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:47.244296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93801015-a4e0-4d90-99ed-7317384384dc tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:47.244578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93801015-a4e0-4d90-99ed-7317384384dc tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:47.244851 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93801015-a4e0-4d90-99ed-7317384384dc tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] PATH_INFO: `/v3/endpoints/2a29e68e5db747ecb5a2f79713d8627f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:47.246244 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93801015-a4e0-4d90-99ed-7317384384dc tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=2a29e68e5db747ecb5a2f79713d8627f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:47.247867 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93801015-a4e0-4d90-99ed-7317384384dc tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:47.260649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-93801015-a4e0-4d90-99ed-7317384384dc tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '2a29e68e5db747ecb5a2f79713d8627f', 'request_id': 'req-93801015-a4e0-4d90-99ed-7317384384dc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:47.283484 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:47.289055 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3483/6987] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Sep 4 01:30:47 2022] DELETE /identity/v3/endpoints/2a29e68e5db747ecb5a2f79713d8627f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:47.290211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93801015-a4e0-4d90-99ed-7317384384dc tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:47.320409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93801015-a4e0-4d90-99ed-7317384384dc tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:47.342135 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c709a78-9f11-46dd-b71c-078704bb86e8 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52b03baba26342fe8210adaeff61dc50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e2ca692b742ceb9889c9fb385682b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:47.346193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c709a78-9f11-46dd-b71c-078704bb86e8 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:47.348398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c709a78-9f11-46dd-b71c-078704bb86e8 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:47.348862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c709a78-9f11-46dd-b71c-078704bb86e8 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] PATH_INFO: `/v3/regions/tempest-region-1026237596` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:47.350265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c709a78-9f11-46dd-b71c-078704bb86e8 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1026237596)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:47.353322 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c709a78-9f11-46dd-b71c-078704bb86e8 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:47.367053 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3505/6988] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:46 2022] POST /identity/v3/auth/tokens => generated 3394 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:47.370488 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687736f-3b3e-4719-af07-ff96f29dfd1d None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:47.372711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1687736f-3b3e-4719-af07-ff96f29dfd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:47.401843 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3484/6989] 10.222.0.30 () {58 vars in 1209 bytes} [Sun Sep 4 01:30:47 2022] DELETE /identity/v3/regions/tempest-region-1026237596 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:47.406868 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c709a78-9f11-46dd-b71c-078704bb86e8 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:47.468026 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c709a78-9f11-46dd-b71c-078704bb86e8 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:47.498194 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc7833-672f-4fef-bca6-5b8e90d5db26 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52b03baba26342fe8210adaeff61dc50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e2ca692b742ceb9889c9fb385682b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:47.499016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc7833-672f-4fef-bca6-5b8e90d5db26 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:47.499427 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc7833-672f-4fef-bca6-5b8e90d5db26 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:47.499734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc7833-672f-4fef-bca6-5b8e90d5db26 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:47.500583 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc7833-672f-4fef-bca6-5b8e90d5db26 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:47.506118 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc7833-672f-4fef-bca6-5b8e90d5db26 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:47.561145 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-92bc7833-672f-4fef-bca6-5b8e90d5db26 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1897517015. To ensure interoperability, identifiers should be a valid uuid. Sep 04 01:30:47.561145 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 04 01:30:47.561145 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:30:47.605775 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3485/6990] 10.222.0.30 () {60 vars in 1156 bytes} [Sun Sep 4 01:30:47 2022] POST /identity/v3/endpoints => generated 360 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:47.609377 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc7833-672f-4fef-bca6-5b8e90d5db26 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:47.633607 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:47.659541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc7833-672f-4fef-bca6-5b8e90d5db26 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:47.668595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127c276-8d4c-45e0-b579-ba9aac2d32cb tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52b03baba26342fe8210adaeff61dc50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e2ca692b742ceb9889c9fb385682b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:47.669248 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127c276-8d4c-45e0-b579-ba9aac2d32cb tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:47.669578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127c276-8d4c-45e0-b579-ba9aac2d32cb tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:47.669855 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127c276-8d4c-45e0-b579-ba9aac2d32cb tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] PATH_INFO: `/v3/regions/tempest-region-1897517015` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:47.670452 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8127c276-8d4c-45e0-b579-ba9aac2d32cb tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1897517015)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:47.671535 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8127c276-8d4c-45e0-b579-ba9aac2d32cb tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:47.676335 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3486/6991] 10.222.0.30 () {58 vars in 1206 bytes} [Sun Sep 4 01:30:47 2022] GET /identity/v3/regions/tempest-region-1897517015 => generated 180 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:47.682443 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127c276-8d4c-45e0-b579-ba9aac2d32cb tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:47.698598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687736f-3b3e-4719-af07-ff96f29dfd1d None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:47.701989 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127c276-8d4c-45e0-b579-ba9aac2d32cb tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:47.715851 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c8474-b359-4358-a81b-ad1b2c755297 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52b03baba26342fe8210adaeff61dc50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e2ca692b742ceb9889c9fb385682b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:47.716502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c8474-b359-4358-a81b-ad1b2c755297 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:47.716780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c8474-b359-4358-a81b-ad1b2c755297 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:47.717051 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c8474-b359-4358-a81b-ad1b2c755297 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] PATH_INFO: `/v3/endpoints/7635aca611994c32bf6c66899cc3f6a0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:47.731349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c8474-b359-4358-a81b-ad1b2c755297 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=7635aca611994c32bf6c66899cc3f6a0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:47.732884 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c8474-b359-4358-a81b-ad1b2c755297 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:47.746807 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-df5c8474-b359-4358-a81b-ad1b2c755297 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Sep 04 01:30:47.746807 n-d-master-1 devstack@keystone.service[81825]: Failed validating 'type' in schema['properties']['enabled']: Sep 04 01:30:47.746807 n-d-master-1 devstack@keystone.service[81825]: {'enum': [True, False, None], 'type': 'boolean'} Sep 04 01:30:47.746807 n-d-master-1 devstack@keystone.service[81825]: On instance['enabled']: Sep 04 01:30:47.746807 n-d-master-1 devstack@keystone.service[81825]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Sep 04 01:30:47.746807 n-d-master-1 devstack@keystone.service[81825]: Failed validating 'type' in schema['properties']['enabled']: Sep 04 01:30:47.746807 n-d-master-1 devstack@keystone.service[81825]: {'enum': [True, False, None], 'type': 'boolean'} Sep 04 01:30:47.746807 n-d-master-1 devstack@keystone.service[81825]: On instance['enabled']: Sep 04 01:30:47.746807 n-d-master-1 devstack@keystone.service[81825]: 'True' Sep 04 01:30:47.746807 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:30:47.746807 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 04 01:30:47.746807 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 04 01:30:47.746807 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 04 01:30:47.746807 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise error Sep 04 01:30:47.746807 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Sep 04 01:30:47.746807 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:30:47.746807 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 04 01:30:47.746807 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 04 01:30:47.746807 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:30:47.746807 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application On instance['enabled']: Sep 04 01:30:47.746807 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application 'True' Sep 04 01:30:47.746807 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:30:47.746807 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:30:47.748602 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:30:47.748602 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:30:47.748602 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:30:47.748602 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:30:47.748602 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:30:47.748602 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:30:47.748602 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:30:47.748602 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:30:47.748602 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:30:47.748602 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:30:47.748602 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:30:47.748602 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:30:47.748602 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Sep 04 01:30:47.748602 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Sep 04 01:30:47.748602 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 04 01:30:47.748602 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 04 01:30:47.748602 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 04 01:30:47.749869 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 04 01:30:47.749869 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Sep 04 01:30:47.749869 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:30:47.749869 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 04 01:30:47.749869 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 04 01:30:47.749869 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:30:47.749869 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application On instance['enabled']: Sep 04 01:30:47.749869 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application 'True' Sep 04 01:30:47.749869 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:30:47.754860 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3487/6992] 10.222.0.30 () {60 vars in 1255 bytes} [Sun Sep 4 01:30:47 2022] PATCH /identity/v3/endpoints/7635aca611994c32bf6c66899cc3f6a0 => generated 281 bytes in 72 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 04 01:30:47.755677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c8474-b359-4358-a81b-ad1b2c755297 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:47.788723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c8474-b359-4358-a81b-ad1b2c755297 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:47.793198 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984b0fa-46d3-4963-a2e8-df876b1644f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:47.796720 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984b0fa-46d3-4963-a2e8-df876b1644f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:47.797198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b826196-c146-4703-a823-b7146dc5bdd0 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52b03baba26342fe8210adaeff61dc50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e2ca692b742ceb9889c9fb385682b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:47.797660 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984b0fa-46d3-4963-a2e8-df876b1644f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:47.798504 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b826196-c146-4703-a823-b7146dc5bdd0 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:47.798783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b826196-c146-4703-a823-b7146dc5bdd0 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:47.799082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b826196-c146-4703-a823-b7146dc5bdd0 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] PATH_INFO: `/v3/endpoints/7635aca611994c32bf6c66899cc3f6a0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:47.799774 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984b0fa-46d3-4963-a2e8-df876b1644f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:47.801162 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b984b0fa-46d3-4963-a2e8-df876b1644f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:47.805917 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b826196-c146-4703-a823-b7146dc5bdd0 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=7635aca611994c32bf6c66899cc3f6a0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:47.807707 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b826196-c146-4703-a823-b7146dc5bdd0 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:47.807900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b984b0fa-46d3-4963-a2e8-df876b1644f2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:47.843499 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6b826196-c146-4703-a823-b7146dc5bdd0 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '7635aca611994c32bf6c66899cc3f6a0', 'request_id': 'req-6b826196-c146-4703-a823-b7146dc5bdd0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:47.861908 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3488/6993] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Sep 4 01:30:47 2022] DELETE /identity/v3/endpoints/7635aca611994c32bf6c66899cc3f6a0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:47.867565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b826196-c146-4703-a823-b7146dc5bdd0 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:47.894069 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3506/6994] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:30:47 2022] POST /identity/v3/projects => generated 383 bytes in 524 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:47.898524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984b0fa-46d3-4963-a2e8-df876b1644f2 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:47.913151 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b984b0fa-46d3-4963-a2e8-df876b1644f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:47.972652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b826196-c146-4703-a823-b7146dc5bdd0 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:48.106013 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984b0fa-46d3-4963-a2e8-df876b1644f2 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:48.129766 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543e569-ff44-4b09-b787-9afdf833d208 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52b03baba26342fe8210adaeff61dc50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e2ca692b742ceb9889c9fb385682b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:48.130614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543e569-ff44-4b09-b787-9afdf833d208 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:48.132803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543e569-ff44-4b09-b787-9afdf833d208 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:48.133174 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543e569-ff44-4b09-b787-9afdf833d208 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] PATH_INFO: `/v3/regions/tempest-region-1897517015` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:48.133937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543e569-ff44-4b09-b787-9afdf833d208 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1897517015)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:48.137702 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543e569-ff44-4b09-b787-9afdf833d208 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:48.145230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42dea2-9b96-48b2-8323-997d0292f949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:48.145985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42dea2-9b96-48b2-8323-997d0292f949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:48.147890 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42dea2-9b96-48b2-8323-997d0292f949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:48.148229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42dea2-9b96-48b2-8323-997d0292f949 admin admin] PATH_INFO: `/v3/projects/3ae8e609352648fabb4699ef5f485af5` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:48.150790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42dea2-9b96-48b2-8323-997d0292f949 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ae8e609352648fabb4699ef5f485af5)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:48.154610 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42dea2-9b96-48b2-8323-997d0292f949 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:48.181512 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3489/6995] 10.222.0.30 () {58 vars in 1209 bytes} [Sun Sep 4 01:30:47 2022] DELETE /identity/v3/regions/tempest-region-1897517015 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:30:48.181512 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543e569-ff44-4b09-b787-9afdf833d208 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:48.221398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543e569-ff44-4b09-b787-9afdf833d208 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:48.234793 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-cb42dea2-9b96-48b2-8323-997d0292f949 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ae8e609352648fabb4699ef5f485af5', 'request_id': 'req-cb42dea2-9b96-48b2-8323-997d0292f949'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:48.244038 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:48.257143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-cb42dea2-9b96-48b2-8323-997d0292f949 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ae8e609352648fabb4699ef5f485af5', 'request_id': 'req-cb42dea2-9b96-48b2-8323-997d0292f949'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:48.271546 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-cb42dea2-9b96-48b2-8323-997d0292f949 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ae8e609352648fabb4699ef5f485af5', 'request_id': 'req-cb42dea2-9b96-48b2-8323-997d0292f949'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:48.332347 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-cb42dea2-9b96-48b2-8323-997d0292f949 admin admin] The token cache is being invalidate because project 3ae8e609352648fabb4699ef5f485af5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:30:48.338591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-cb42dea2-9b96-48b2-8323-997d0292f949 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:48.342084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-cb42dea2-9b96-48b2-8323-997d0292f949 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:48.346366 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3507/6996] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:30:47 2022] DELETE /identity/v3/projects/3ae8e609352648fabb4699ef5f485af5 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:48.346534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c6e9e-176a-49c5-b927-8a998ed3b9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:48.346534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c6e9e-176a-49c5-b927-8a998ed3b9c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:48.346534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c6e9e-176a-49c5-b927-8a998ed3b9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:48.346838 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42dea2-9b96-48b2-8323-997d0292f949 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:48.346936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c6e9e-176a-49c5-b927-8a998ed3b9c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:48.347561 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c6e9e-176a-49c5-b927-8a998ed3b9c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:48.348109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-cb42dea2-9b96-48b2-8323-997d0292f949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:48.350764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c6e9e-176a-49c5-b927-8a998ed3b9c0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:48.409527 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3490/6997] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:30:48 2022] POST /identity/v3/users => generated 298 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:48.413189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811ac8d-4b40-4aa5-992c-533b90f5364e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:48.413832 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811ac8d-4b40-4aa5-992c-533b90f5364e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:48.414124 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811ac8d-4b40-4aa5-992c-533b90f5364e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:48.483865 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e811ac8d-4b40-4aa5-992c-533b90f5364e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:48.491196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e811ac8d-4b40-4aa5-992c-533b90f5364e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:48.521541 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3491/6998] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:48 2022] POST /identity/v3/auth/tokens => generated 3373 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:48.521541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811ac8d-4b40-4aa5-992c-533b90f5364e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:48.527299 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e811ac8d-4b40-4aa5-992c-533b90f5364e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:48.531033 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42dea2-9b96-48b2-8323-997d0292f949 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:48.550397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811ac8d-4b40-4aa5-992c-533b90f5364e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:48.566026 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f1033-262c-48c1-9266-832dca01f6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:48.570746 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f1033-262c-48c1-9266-832dca01f6bc admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:48.573334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f1033-262c-48c1-9266-832dca01f6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:48.574204 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f1033-262c-48c1-9266-832dca01f6bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:48.575518 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f1033-262c-48c1-9266-832dca01f6bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:48.578751 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f1033-262c-48c1-9266-832dca01f6bc admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:48.590693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e680a-c35a-439d-824f-af2ff7e96232 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52b03baba26342fe8210adaeff61dc50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '190e2ca692b742ceb9889c9fb385682b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:48.591270 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e680a-c35a-439d-824f-af2ff7e96232 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:48.591508 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e680a-c35a-439d-824f-af2ff7e96232 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:48.591781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e680a-c35a-439d-824f-af2ff7e96232 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] PATH_INFO: `/v3/services/0d52d9689314432b884b8953fd7a29e8` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:48.592373 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e680a-c35a-439d-824f-af2ff7e96232 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: Authorizing `identity:delete_service(service_id=0d52d9689314432b884b8953fd7a29e8)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:48.594056 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e680a-c35a-439d-824f-af2ff7e96232 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:48.604554 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3492/6999] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:48.607687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe2774-3a8b-4fc9-a9d1-126488beeb6f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:48.608141 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe2774-3a8b-4fc9-a9d1-126488beeb6f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:48.608598 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe2774-3a8b-4fc9-a9d1-126488beeb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:48.622084 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:48.635562 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3508/7000] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:30:48 2022] DELETE /identity/v3/services/0d52d9689314432b884b8953fd7a29e8 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:48.636406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e680a-c35a-439d-824f-af2ff7e96232 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:48.643282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-defe2774-3a8b-4fc9-a9d1-126488beeb6f None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:48.647046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-defe2774-3a8b-4fc9-a9d1-126488beeb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:48.675286 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3493/7001] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:48.677414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe2774-3a8b-4fc9-a9d1-126488beeb6f None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:48.681340 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-defe2774-3a8b-4fc9-a9d1-126488beeb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:48.682278 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e680a-c35a-439d-824f-af2ff7e96232 tempest-EndpointsNegativeTestJSON-895337877 tempest-EndpointsNegativeTestJSON-895337877-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:48.695552 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdc83e-ebff-467e-9cdd-678e416fd1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:48.696268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdc83e-ebff-467e-9cdd-678e416fd1b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:48.696555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdc83e-ebff-467e-9cdd-678e416fd1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:48.696830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdc83e-ebff-467e-9cdd-678e416fd1b1 admin admin] PATH_INFO: `/v3/projects/16443fc235c64819beb07372242d40a8/users/f1533c193bc64e75a2fc75bb99d9a271/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:48.699489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe2774-3a8b-4fc9-a9d1-126488beeb6f None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:48.706524 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f4ddf-364a-4501-840c-09375297e6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:48.708615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f4ddf-364a-4501-840c-09375297e6bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:48.708901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f4ddf-364a-4501-840c-09375297e6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:48.709178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f4ddf-364a-4501-840c-09375297e6bc admin admin] PATH_INFO: `/v3/users/2e54f4b3fd0f4f77b3fdd0416ef39de9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:48.710452 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f4ddf-364a-4501-840c-09375297e6bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e54f4b3fd0f4f77b3fdd0416ef39de9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:48.714938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f4ddf-364a-4501-840c-09375297e6bc admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:48.736254 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cdc83e-ebff-467e-9cdd-678e416fd1b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16443fc235c64819beb07372242d40a8, user_id=f1533c193bc64e75a2fc75bb99d9a271, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:48.740281 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cdc83e-ebff-467e-9cdd-678e416fd1b1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:48.789196 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3509/7002] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:30:48 2022] PUT /identity/v3/projects/16443fc235c64819beb07372242d40a8/users/f1533c193bc64e75a2fc75bb99d9a271/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:48.790337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdc83e-ebff-467e-9cdd-678e416fd1b1 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:48.800307 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-870f4ddf-364a-4501-840c-09375297e6bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e54f4b3fd0f4f77b3fdd0416ef39de9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:48.807937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-870f4ddf-364a-4501-840c-09375297e6bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e54f4b3fd0f4f77b3fdd0416ef39de9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:48.823215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-870f4ddf-364a-4501-840c-09375297e6bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e54f4b3fd0f4f77b3fdd0416ef39de9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:48.856783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-870f4ddf-364a-4501-840c-09375297e6bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e54f4b3fd0f4f77b3fdd0416ef39de9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:48.858189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-870f4ddf-364a-4501-840c-09375297e6bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e54f4b3fd0f4f77b3fdd0416ef39de9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:48.951161 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3494/7003] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:48 2022] DELETE /identity/v3/users/2e54f4b3fd0f4f77b3fdd0416ef39de9 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:48.955977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f4ddf-364a-4501-840c-09375297e6bc admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:48.962079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-870f4ddf-364a-4501-840c-09375297e6bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:49.004155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdc83e-ebff-467e-9cdd-678e416fd1b1 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:49.092189 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:49.182588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f4ddf-364a-4501-840c-09375297e6bc admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:49.191690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e1525-c9a0-44ae-a0e3-0b44e3064808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:49.192302 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e1525-c9a0-44ae-a0e3-0b44e3064808 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:49.192587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e1525-c9a0-44ae-a0e3-0b44e3064808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:49.192868 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e1525-c9a0-44ae-a0e3-0b44e3064808 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:49.193569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e1525-c9a0-44ae-a0e3-0b44e3064808 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:30:49.193879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e1525-c9a0-44ae-a0e3-0b44e3064808 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:49.195759 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e1525-c9a0-44ae-a0e3-0b44e3064808 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:49.196648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e9102-439b-4615-8b42-0e295ad95f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:49.197617 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e9102-439b-4615-8b42-0e295ad95f58 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:49.200457 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e9102-439b-4615-8b42-0e295ad95f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:49.200825 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e9102-439b-4615-8b42-0e295ad95f58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:49.201831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e9102-439b-4615-8b42-0e295ad95f58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:49.206988 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e9102-439b-4615-8b42-0e295ad95f58 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:49.222580 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3510/7004] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:49.223802 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5ec45-d28e-42f2-9cfd-08e3d2c2114d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:49.224092 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5ec45-d28e-42f2-9cfd-08e3d2c2114d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:49.224391 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5ec45-d28e-42f2-9cfd-08e3d2c2114d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:49.234488 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3495/7005] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:49.237306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e9102-439b-4615-8b42-0e295ad95f58 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:49.247154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f58e9102-439b-4615-8b42-0e295ad95f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:49.266051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-49e5ec45-d28e-42f2-9cfd-08e3d2c2114d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:49.267956 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-49e5ec45-d28e-42f2-9cfd-08e3d2c2114d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:49.283752 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3511/7006] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:49.284697 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5ec45-d28e-42f2-9cfd-08e3d2c2114d None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:49.296633 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e9102-439b-4615-8b42-0e295ad95f58 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:49.298288 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5ec45-d28e-42f2-9cfd-08e3d2c2114d None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:49.314969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214f5dd-24a2-4b1f-99d9-e1f99bb59c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:49.315400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17350f89-e8e0-4783-9647-b09a4f7be9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:49.315648 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214f5dd-24a2-4b1f-99d9-e1f99bb59c8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:49.315930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214f5dd-24a2-4b1f-99d9-e1f99bb59c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:49.316238 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17350f89-e8e0-4783-9647-b09a4f7be9fc admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:49.316619 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17350f89-e8e0-4783-9647-b09a4f7be9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:49.316989 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17350f89-e8e0-4783-9647-b09a4f7be9fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:49.317840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17350f89-e8e0-4783-9647-b09a4f7be9fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:49.319828 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17350f89-e8e0-4783-9647-b09a4f7be9fc admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:49.322652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214f5dd-24a2-4b1f-99d9-e1f99bb59c8f admin admin] PATH_INFO: `/v3/projects/16443fc235c64819beb07372242d40a8/users/f1533c193bc64e75a2fc75bb99d9a271/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:49.326682 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214f5dd-24a2-4b1f-99d9-e1f99bb59c8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=16443fc235c64819beb07372242d40a8, user_id=f1533c193bc64e75a2fc75bb99d9a271, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:49.333920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214f5dd-24a2-4b1f-99d9-e1f99bb59c8f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:49.357556 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3512/7007] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:30:49 2022] PUT /identity/v3/projects/16443fc235c64819beb07372242d40a8/users/f1533c193bc64e75a2fc75bb99d9a271/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:49.357556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214f5dd-24a2-4b1f-99d9-e1f99bb59c8f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:49.357556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9214f5dd-24a2-4b1f-99d9-e1f99bb59c8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:49.429192 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3496/7008] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:30:49 2022] POST /identity/v3/projects => generated 365 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:49.434267 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34c1ec-c8e6-4dff-80e3-749c8dbc98b1 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:49.434687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34c1ec-c8e6-4dff-80e3-749c8dbc98b1 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:49.435581 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34c1ec-c8e6-4dff-80e3-749c8dbc98b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:49.455800 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214f5dd-24a2-4b1f-99d9-e1f99bb59c8f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:49.514514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-ff34c1ec-c8e6-4dff-80e3-749c8dbc98b1 None None] MFA Rules not processed for user `f1533c193bc64e75a2fc75bb99d9a271`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:49.515818 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ff34c1ec-c8e6-4dff-80e3-749c8dbc98b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:49.564083 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:49.569648 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7850a-ebe4-4bcc-a15d-81364e457675 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:49.570338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7850a-ebe4-4bcc-a15d-81364e457675 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:49.570697 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7850a-ebe4-4bcc-a15d-81364e457675 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:49.571026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7850a-ebe4-4bcc-a15d-81364e457675 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:49.695715 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3497/7009] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:49 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:49.696767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34c1ec-c8e6-4dff-80e3-749c8dbc98b1 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:49.756889 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7850a-ebe4-4bcc-a15d-81364e457675 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:49.759030 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7850a-ebe4-4bcc-a15d-81364e457675 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:49.768960 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:49.776268 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3513/7010] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:30:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:30:49.777245 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7850a-ebe4-4bcc-a15d-81364e457675 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:49.779256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-15e7850a-ebe4-4bcc-a15d-81364e457675 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:49.828739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34c1ec-c8e6-4dff-80e3-749c8dbc98b1 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:49.835020 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c93f39-05f7-410b-bcb9-b9c1994fc1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:49.835591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c93f39-05f7-410b-bcb9-b9c1994fc1bf admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:49.835874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c93f39-05f7-410b-bcb9-b9c1994fc1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:49.836146 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c93f39-05f7-410b-bcb9-b9c1994fc1bf admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:49.836777 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c93f39-05f7-410b-bcb9-b9c1994fc1bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:49.839180 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c93f39-05f7-410b-bcb9-b9c1994fc1bf admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:49.882012 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3498/7011] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:30:49 2022] POST /identity/v3/users => generated 283 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:49.882012 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c93f39-05f7-410b-bcb9-b9c1994fc1bf admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:49.897682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c93f39-05f7-410b-bcb9-b9c1994fc1bf admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:49.904631 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881f9ee-42e8-47d4-81db-4d4c94cc29c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:49.905331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881f9ee-42e8-47d4-81db-4d4c94cc29c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:49.905680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881f9ee-42e8-47d4-81db-4d4c94cc29c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:49.905955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881f9ee-42e8-47d4-81db-4d4c94cc29c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:49.906527 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7850a-ebe4-4bcc-a15d-81364e457675 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:49.906715 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881f9ee-42e8-47d4-81db-4d4c94cc29c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:49.908490 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881f9ee-42e8-47d4-81db-4d4c94cc29c9 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:49.911482 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4c43c-8958-47fa-8ca9-b48b19d90f8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:49.912517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4c43c-8958-47fa-8ca9-b48b19d90f8b service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:49.912800 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4c43c-8958-47fa-8ca9-b48b19d90f8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:49.913195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4c43c-8958-47fa-8ca9-b48b19d90f8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:49.923996 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3499/7012] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:30:49.926096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4c43c-8958-47fa-8ca9-b48b19d90f8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:49.927192 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4c43c-8958-47fa-8ca9-b48b19d90f8b service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:49.927750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881f9ee-42e8-47d4-81db-4d4c94cc29c9 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:49.940463 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3514/7013] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:30:49 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:30:49.950104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881f9ee-42e8-47d4-81db-4d4c94cc29c9 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:49.962534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fab45c-4779-4cc0-8872-af530ef2a37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:49.963376 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fab45c-4779-4cc0-8872-af530ef2a37e admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:49.964267 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fab45c-4779-4cc0-8872-af530ef2a37e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:49.964698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fab45c-4779-4cc0-8872-af530ef2a37e admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:49.965806 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fab45c-4779-4cc0-8872-af530ef2a37e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:49.967515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fab45c-4779-4cc0-8872-af530ef2a37e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:49.982787 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3500/7014] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:30:49.984140 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4c43c-8958-47fa-8ca9-b48b19d90f8b service cinder] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:49.996336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4c43c-8958-47fa-8ca9-b48b19d90f8b service cinder] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:50.001919 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a4b62-ef59-4f5c-a282-783da2c96d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:50.002718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a4b62-ef59-4f5c-a282-783da2c96d54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:50.003071 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a4b62-ef59-4f5c-a282-783da2c96d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:50.003410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a4b62-ef59-4f5c-a282-783da2c96d54 admin admin] PATH_INFO: `/v3/projects/8eb778d2278c4b68b18b1134b9ce5c0a/users/b9be06124d024f47b55a25f9417376cb/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:50.059459 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a4b62-ef59-4f5c-a282-783da2c96d54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eb778d2278c4b68b18b1134b9ce5c0a, user_id=b9be06124d024f47b55a25f9417376cb, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:50.061007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a4b62-ef59-4f5c-a282-783da2c96d54 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:50.069743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fab45c-4779-4cc0-8872-af530ef2a37e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:50.083643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fab45c-4779-4cc0-8872-af530ef2a37e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:50.090309 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3515/7015] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:30:49 2022] PUT /identity/v3/projects/8eb778d2278c4b68b18b1134b9ce5c0a/users/b9be06124d024f47b55a25f9417376cb/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:50.100619 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f54b8b-c487-4727-89d0-ed48fd9a54fc None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:50.100912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f54b8b-c487-4727-89d0-ed48fd9a54fc None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:50.101170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f54b8b-c487-4727-89d0-ed48fd9a54fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:50.134675 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-d3f54b8b-c487-4727-89d0-ed48fd9a54fc None None] MFA Rules not processed for user `b9be06124d024f47b55a25f9417376cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:50.137206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d3f54b8b-c487-4727-89d0-ed48fd9a54fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:50.168484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e73b3-e321-4bd0-8cb0-40cfcf1cb650 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:50.169196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e73b3-e321-4bd0-8cb0-40cfcf1cb650 service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:50.169510 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e73b3-e321-4bd0-8cb0-40cfcf1cb650 service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:50.169755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e73b3-e321-4bd0-8cb0-40cfcf1cb650 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:50.171837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-597e73b3-e321-4bd0-8cb0-40cfcf1cb650 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:50.221006 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:50.225859 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3516/7016] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:50.226711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f54b8b-c487-4727-89d0-ed48fd9a54fc None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:50.228001 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d3f54b8b-c487-4727-89d0-ed48fd9a54fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:50.242202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e73b3-e321-4bd0-8cb0-40cfcf1cb650 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:50.243835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e73b3-e321-4bd0-8cb0-40cfcf1cb650 service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:50.267354 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3501/7017] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:30:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:30:50.268434 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e73b3-e321-4bd0-8cb0-40cfcf1cb650 service cinder] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:50.314841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f54b8b-c487-4727-89d0-ed48fd9a54fc None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:50.320916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899acd1f-e627-47b2-b103-9285a1b10fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:50.321834 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899acd1f-e627-47b2-b103-9285a1b10fee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:50.322190 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899acd1f-e627-47b2-b103-9285a1b10fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:50.322522 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899acd1f-e627-47b2-b103-9285a1b10fee admin admin] PATH_INFO: `/v3/projects/d6afd8a92a1b4bce8d9945c1385fb406` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:50.323854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899acd1f-e627-47b2-b103-9285a1b10fee admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6afd8a92a1b4bce8d9945c1385fb406)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:50.326885 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899acd1f-e627-47b2-b103-9285a1b10fee admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:50.329456 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:50.362329 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e73b3-e321-4bd0-8cb0-40cfcf1cb650 service cinder] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:50.367674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b1961-6e51-4dc1-b7c6-6f3ca99dbad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:50.368353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b1961-6e51-4dc1-b7c6-6f3ca99dbad9 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:50.368636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b1961-6e51-4dc1-b7c6-6f3ca99dbad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:50.368930 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b1961-6e51-4dc1-b7c6-6f3ca99dbad9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:50.369602 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b1961-6e51-4dc1-b7c6-6f3ca99dbad9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:50.371514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b1961-6e51-4dc1-b7c6-6f3ca99dbad9 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:50.396339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-899acd1f-e627-47b2-b103-9285a1b10fee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6afd8a92a1b4bce8d9945c1385fb406', 'request_id': 'req-899acd1f-e627-47b2-b103-9285a1b10fee'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:50.406468 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3502/7018] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:30:50 2022] POST /identity/v3/projects => generated 367 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:50.410258 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-899acd1f-e627-47b2-b103-9285a1b10fee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6afd8a92a1b4bce8d9945c1385fb406', 'request_id': 'req-899acd1f-e627-47b2-b103-9285a1b10fee'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:50.411530 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b1961-6e51-4dc1-b7c6-6f3ca99dbad9 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:50.418827 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-899acd1f-e627-47b2-b103-9285a1b10fee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6afd8a92a1b4bce8d9945c1385fb406', 'request_id': 'req-899acd1f-e627-47b2-b103-9285a1b10fee'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:50.433904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-899acd1f-e627-47b2-b103-9285a1b10fee admin admin] The token cache is being invalidate because project d6afd8a92a1b4bce8d9945c1385fb406 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:30:50.434406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-899acd1f-e627-47b2-b103-9285a1b10fee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:50.435159 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-899acd1f-e627-47b2-b103-9285a1b10fee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:50.439940 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3517/7019] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:30:50 2022] DELETE /identity/v3/projects/d6afd8a92a1b4bce8d9945c1385fb406 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:50.445821 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899acd1f-e627-47b2-b103-9285a1b10fee admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:50.455074 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-899acd1f-e627-47b2-b103-9285a1b10fee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:50.534375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b1961-6e51-4dc1-b7c6-6f3ca99dbad9 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:50.552146 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899acd1f-e627-47b2-b103-9285a1b10fee admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:50.558308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42ece3-d040-4d6e-a2a0-2d7712c33390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:50.559110 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42ece3-d040-4d6e-a2a0-2d7712c33390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:50.559235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12272ec2-80da-49d5-a615-525153fba6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:50.559396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42ece3-d040-4d6e-a2a0-2d7712c33390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:50.559772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12272ec2-80da-49d5-a615-525153fba6b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:50.559939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42ece3-d040-4d6e-a2a0-2d7712c33390 admin admin] PATH_INFO: `/v3/users/52b03baba26342fe8210adaeff61dc50` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:50.560059 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12272ec2-80da-49d5-a615-525153fba6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:50.560310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12272ec2-80da-49d5-a615-525153fba6b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:50.561076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12272ec2-80da-49d5-a615-525153fba6b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:50.561489 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42ece3-d040-4d6e-a2a0-2d7712c33390 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52b03baba26342fe8210adaeff61dc50)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:50.563931 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12272ec2-80da-49d5-a615-525153fba6b2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:50.564650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42ece3-d040-4d6e-a2a0-2d7712c33390 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:50.596725 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3503/7020] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:30:50 2022] POST /identity/v3/users => generated 290 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:50.597797 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12272ec2-80da-49d5-a615-525153fba6b2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:50.599784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-12272ec2-80da-49d5-a615-525153fba6b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:50.615895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12272ec2-80da-49d5-a615-525153fba6b2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:50.621029 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952f714-bdad-4c4a-94aa-bc879259134f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:50.621787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952f714-bdad-4c4a-94aa-bc879259134f admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:50.622149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952f714-bdad-4c4a-94aa-bc879259134f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:50.622538 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952f714-bdad-4c4a-94aa-bc879259134f admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:50.623255 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952f714-bdad-4c4a-94aa-bc879259134f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:50.625177 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952f714-bdad-4c4a-94aa-bc879259134f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:50.629888 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4a42ece3-d040-4d6e-a2a0-2d7712c33390 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52b03baba26342fe8210adaeff61dc50'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:50.631029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4a42ece3-d040-4d6e-a2a0-2d7712c33390 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52b03baba26342fe8210adaeff61dc50'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:50.640628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4a42ece3-d040-4d6e-a2a0-2d7712c33390 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52b03baba26342fe8210adaeff61dc50'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:50.641244 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3504/7021] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:50.653826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952f714-bdad-4c4a-94aa-bc879259134f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:50.658075 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4a42ece3-d040-4d6e-a2a0-2d7712c33390 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52b03baba26342fe8210adaeff61dc50'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:50.659065 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2952f714-bdad-4c4a-94aa-bc879259134f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:50.659733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4a42ece3-d040-4d6e-a2a0-2d7712c33390 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52b03baba26342fe8210adaeff61dc50'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:50.675459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952f714-bdad-4c4a-94aa-bc879259134f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:50.693604 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eabf63-8f23-4712-a4f7-12d8f8422b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:50.694213 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3518/7022] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:50 2022] DELETE /identity/v3/users/52b03baba26342fe8210adaeff61dc50 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:50.697170 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eabf63-8f23-4712-a4f7-12d8f8422b06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:50.697618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eabf63-8f23-4712-a4f7-12d8f8422b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:50.697814 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eabf63-8f23-4712-a4f7-12d8f8422b06 admin admin] PATH_INFO: `/v3/projects/4f57aead0af847e98b83d30ffcc3d59b/users/fa55fe9abcc0463d934089d9dff4a5e4/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:50.733141 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eabf63-8f23-4712-a4f7-12d8f8422b06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f57aead0af847e98b83d30ffcc3d59b, user_id=fa55fe9abcc0463d934089d9dff4a5e4, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:50.736182 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eabf63-8f23-4712-a4f7-12d8f8422b06 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:50.772580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42ece3-d040-4d6e-a2a0-2d7712c33390 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:50.773240 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3505/7023] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:30:50 2022] PUT /identity/v3/projects/4f57aead0af847e98b83d30ffcc3d59b/users/fa55fe9abcc0463d934089d9dff4a5e4/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:50.793756 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:50.984834 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42ece3-d040-4d6e-a2a0-2d7712c33390 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:51.146057 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ff3c5-564b-412c-be55-41d5605d3aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:51.149696 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ff3c5-564b-412c-be55-41d5605d3aeb admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:51.150071 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ff3c5-564b-412c-be55-41d5605d3aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:51.150347 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ff3c5-564b-412c-be55-41d5605d3aeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:51.151031 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ff3c5-564b-412c-be55-41d5605d3aeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:51.159898 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ff3c5-564b-412c-be55-41d5605d3aeb admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:51.197513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eabf63-8f23-4712-a4f7-12d8f8422b06 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:51.207775 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3519/7024] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:51.211738 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eabf63-8f23-4712-a4f7-12d8f8422b06 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:51.228356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675f6bf-f650-40f9-877a-4bbbdad523b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:51.228950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675f6bf-f650-40f9-877a-4bbbdad523b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:51.229287 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675f6bf-f650-40f9-877a-4bbbdad523b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:51.229600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675f6bf-f650-40f9-877a-4bbbdad523b0 admin admin] PATH_INFO: `/v3/projects/4f57aead0af847e98b83d30ffcc3d59b/users/fa55fe9abcc0463d934089d9dff4a5e4/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:51.231737 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675f6bf-f650-40f9-877a-4bbbdad523b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f57aead0af847e98b83d30ffcc3d59b, user_id=fa55fe9abcc0463d934089d9dff4a5e4, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:51.234448 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675f6bf-f650-40f9-877a-4bbbdad523b0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:51.259704 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:51.299134 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bff33-ec18-4349-8bc9-97e40278ea2a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:51.299717 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bff33-ec18-4349-8bc9-97e40278ea2a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:51.300172 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bff33-ec18-4349-8bc9-97e40278ea2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:51.303052 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3506/7025] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:30:51 2022] PUT /identity/v3/projects/4f57aead0af847e98b83d30ffcc3d59b/users/fa55fe9abcc0463d934089d9dff4a5e4/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:51.374860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-783bff33-ec18-4349-8bc9-97e40278ea2a None None] MFA Rules not processed for user `fa55fe9abcc0463d934089d9dff4a5e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:51.376688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-783bff33-ec18-4349-8bc9-97e40278ea2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:51.557236 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3520/7026] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:51 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:51.563370 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675f6bf-f650-40f9-877a-4bbbdad523b0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:51.579140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675f6bf-f650-40f9-877a-4bbbdad523b0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:51.594319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3d650-f46a-40c0-97b9-ade0471a647f tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa55fe9abcc0463d934089d9dff4a5e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f57aead0af847e98b83d30ffcc3d59b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:51.595929 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3d650-f46a-40c0-97b9-ade0471a647f tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:51.596472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3d650-f46a-40c0-97b9-ade0471a647f tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:51.596955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3d650-f46a-40c0-97b9-ade0471a647f tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] PATH_INFO: `/v3/regions` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:51.597943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3d650-f46a-40c0-97b9-ade0471a647f tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:51.599370 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-8bb3d650-f46a-40c0-97b9-ade0471a647f tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:30:51.599370 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:30:51.599370 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:30:51.600839 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3d650-f46a-40c0-97b9-ade0471a647f tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:51.643219 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3507/7027] 10.222.0.30 () {60 vars in 1149 bytes} [Sun Sep 4 01:30:51 2022] POST /identity/v3/regions => generated 224 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:51.651159 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783bff33-ec18-4349-8bc9-97e40278ea2a None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:51.680525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3d650-f46a-40c0-97b9-ade0471a647f tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:51.682470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783bff33-ec18-4349-8bc9-97e40278ea2a None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:51.684924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8bb3d650-f46a-40c0-97b9-ade0471a647f tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:51.729751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5362a-fd03-4338-80d9-a56ee478b6ce tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa55fe9abcc0463d934089d9dff4a5e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f57aead0af847e98b83d30ffcc3d59b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:51.734108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5362a-fd03-4338-80d9-a56ee478b6ce tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:51.735585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5362a-fd03-4338-80d9-a56ee478b6ce tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:51.736763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5362a-fd03-4338-80d9-a56ee478b6ce tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] PATH_INFO: `/v3/regions` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:51.739948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee5362a-fd03-4338-80d9-a56ee478b6ce tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:51.741695 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-dee5362a-fd03-4338-80d9-a56ee478b6ce tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:30:51.741695 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:30:51.741695 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:30:51.745736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee5362a-fd03-4338-80d9-a56ee478b6ce tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:51.792690 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3521/7028] 10.222.0.30 () {60 vars in 1149 bytes} [Sun Sep 4 01:30:51 2022] POST /identity/v3/regions => generated 224 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:51.794207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5362a-fd03-4338-80d9-a56ee478b6ce tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:51.867520 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:51.886329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5362a-fd03-4338-80d9-a56ee478b6ce tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:51.900978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3d650-f46a-40c0-97b9-ade0471a647f tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:51.903061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90043ddd-7157-48f1-9407-fd128f68877d tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa55fe9abcc0463d934089d9dff4a5e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f57aead0af847e98b83d30ffcc3d59b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:51.903790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90043ddd-7157-48f1-9407-fd128f68877d tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:51.904160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90043ddd-7157-48f1-9407-fd128f68877d tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:51.904501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90043ddd-7157-48f1-9407-fd128f68877d tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] PATH_INFO: `/v3/regions/ab98e2d7-2c3c-40dd-bbc2-0fee31225416` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:51.905235 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90043ddd-7157-48f1-9407-fd128f68877d tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: Authorizing `identity:create_region(region_id=ab98e2d7-2c3c-40dd-bbc2-0fee31225416)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:51.909397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90043ddd-7157-48f1-9407-fd128f68877d tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:51.936868 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337dad20-9890-4523-bc27-12a0de517e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:51.937696 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337dad20-9890-4523-bc27-12a0de517e91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:51.939380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337dad20-9890-4523-bc27-12a0de517e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:51.939685 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337dad20-9890-4523-bc27-12a0de517e91 admin admin] PATH_INFO: `/v3/projects/190e2ca692b742ceb9889c9fb385682b` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:51.941358 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337dad20-9890-4523-bc27-12a0de517e91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=190e2ca692b742ceb9889c9fb385682b)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:51.944656 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337dad20-9890-4523-bc27-12a0de517e91 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:51.955988 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3522/7029] 10.222.0.30 () {60 vars in 1259 bytes} [Sun Sep 4 01:30:51 2022] PUT /identity/v3/regions/ab98e2d7-2c3c-40dd-bbc2-0fee31225416 => generated 231 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:51.957195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90043ddd-7157-48f1-9407-fd128f68877d tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:52.004497 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90043ddd-7157-48f1-9407-fd128f68877d tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:52.009742 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-337dad20-9890-4523-bc27-12a0de517e91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '190e2ca692b742ceb9889c9fb385682b', 'request_id': 'req-337dad20-9890-4523-bc27-12a0de517e91'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:52.021801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-337dad20-9890-4523-bc27-12a0de517e91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '190e2ca692b742ceb9889c9fb385682b', 'request_id': 'req-337dad20-9890-4523-bc27-12a0de517e91'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:52.035018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-337dad20-9890-4523-bc27-12a0de517e91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '190e2ca692b742ceb9889c9fb385682b', 'request_id': 'req-337dad20-9890-4523-bc27-12a0de517e91'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:52.055273 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-337dad20-9890-4523-bc27-12a0de517e91 admin admin] The token cache is being invalidate because project 190e2ca692b742ceb9889c9fb385682b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:30:52.055801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-337dad20-9890-4523-bc27-12a0de517e91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:52.056718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-337dad20-9890-4523-bc27-12a0de517e91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:52.061764 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3508/7030] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:30:51 2022] DELETE /identity/v3/projects/190e2ca692b742ceb9889c9fb385682b => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:52.063982 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b33011-b592-4298-84ba-223fa0fcd161 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:52.064341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b33011-b592-4298-84ba-223fa0fcd161 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:52.064680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b33011-b592-4298-84ba-223fa0fcd161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:52.096034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-89b33011-b592-4298-84ba-223fa0fcd161 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:52.098250 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-89b33011-b592-4298-84ba-223fa0fcd161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:52.126731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b84d14-c42c-4bdd-b250-18d32a73a2f5 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa55fe9abcc0463d934089d9dff4a5e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f57aead0af847e98b83d30ffcc3d59b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:52.129645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b84d14-c42c-4bdd-b250-18d32a73a2f5 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:52.130174 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b84d14-c42c-4bdd-b250-18d32a73a2f5 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:52.130694 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b84d14-c42c-4bdd-b250-18d32a73a2f5 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] PATH_INFO: `/v3/regions/ab98e2d7-2c3c-40dd-bbc2-0fee31225416` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:52.131494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b84d14-c42c-4bdd-b250-18d32a73a2f5 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: Authorizing `identity:delete_region(region_id=ab98e2d7-2c3c-40dd-bbc2-0fee31225416)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:52.134216 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b84d14-c42c-4bdd-b250-18d32a73a2f5 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:52.174922 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:52.180122 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3523/7031] 10.222.0.30 () {58 vars in 1242 bytes} [Sun Sep 4 01:30:51 2022] DELETE /identity/v3/regions/ab98e2d7-2c3c-40dd-bbc2-0fee31225416 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:52.181671 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b84d14-c42c-4bdd-b250-18d32a73a2f5 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:52.186887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-08b84d14-c42c-4bdd-b250-18d32a73a2f5 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:52.233743 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3509/7032] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:52.235813 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c810e10-7b0e-4e0c-9fe0-1b875a67d82e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:52.236170 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c810e10-7b0e-4e0c-9fe0-1b875a67d82e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:52.236813 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c810e10-7b0e-4e0c-9fe0-1b875a67d82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:52.242562 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b84d14-c42c-4bdd-b250-18d32a73a2f5 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:52.258448 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09405a80-2857-4a5b-ab21-53f1c2a1a33c tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa55fe9abcc0463d934089d9dff4a5e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f57aead0af847e98b83d30ffcc3d59b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:52.259213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09405a80-2857-4a5b-ab21-53f1c2a1a33c tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:52.260298 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09405a80-2857-4a5b-ab21-53f1c2a1a33c tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:52.260588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09405a80-2857-4a5b-ab21-53f1c2a1a33c tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] PATH_INFO: `/v3/regions` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:52.262379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09405a80-2857-4a5b-ab21-53f1c2a1a33c tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:52.267607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09405a80-2857-4a5b-ab21-53f1c2a1a33c tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:52.281568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5c810e10-7b0e-4e0c-9fe0-1b875a67d82e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:52.282936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5c810e10-7b0e-4e0c-9fe0-1b875a67d82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:52.318035 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3510/7033] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:30:52.318236 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3524/7034] 10.222.0.30 () {60 vars in 1150 bytes} [Sun Sep 4 01:30:52 2022] POST /identity/v3/regions => generated 253 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:52.323121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c810e10-7b0e-4e0c-9fe0-1b875a67d82e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:52.325579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09405a80-2857-4a5b-ab21-53f1c2a1a33c tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:52.365334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c810e10-7b0e-4e0c-9fe0-1b875a67d82e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:52.420442 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09405a80-2857-4a5b-ab21-53f1c2a1a33c tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:52.430747 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122fcb57-dc0a-4edf-853d-440f06f00220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:52.432012 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fcb57-dc0a-4edf-853d-440f06f00220 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:52.432012 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fcb57-dc0a-4edf-853d-440f06f00220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:52.432012 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fcb57-dc0a-4edf-853d-440f06f00220 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:52.434544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122fcb57-dc0a-4edf-853d-440f06f00220 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:30:52.434544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122fcb57-dc0a-4edf-853d-440f06f00220 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:52.437926 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b464c-e8dd-4942-937b-c718cf6b16b5 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa55fe9abcc0463d934089d9dff4a5e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f57aead0af847e98b83d30ffcc3d59b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:52.439321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b464c-e8dd-4942-937b-c718cf6b16b5 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:52.439596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b464c-e8dd-4942-937b-c718cf6b16b5 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:52.439925 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b464c-e8dd-4942-937b-c718cf6b16b5 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] PATH_INFO: `/v3/regions/f7df71828e4f48449c0a3bd7a8fff289` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:52.441635 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b464c-e8dd-4942-937b-c718cf6b16b5 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: Authorizing `identity:update_region(region_id=f7df71828e4f48449c0a3bd7a8fff289)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:52.444175 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-dc5b464c-e8dd-4942-937b-c718cf6b16b5 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:30:52.444175 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:30:52.444175 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:30:52.446195 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122fcb57-dc0a-4edf-853d-440f06f00220 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:52.447592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b464c-e8dd-4942-937b-c718cf6b16b5 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:52.492447 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3511/7035] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:52.494711 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122fcb57-dc0a-4edf-853d-440f06f00220 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:52.510962 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3525/7036] 10.222.0.30 () {60 vars in 1250 bytes} [Sun Sep 4 01:30:52 2022] PATCH /identity/v3/regions/f7df71828e4f48449c0a3bd7a8fff289 => generated 254 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:52.515821 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b464c-e8dd-4942-937b-c718cf6b16b5 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:52.520527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122fcb57-dc0a-4edf-853d-440f06f00220 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:52.566181 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b464c-e8dd-4942-937b-c718cf6b16b5 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:52.566454 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6ac6a-bdbf-4fa1-a9d6-5aefa3bf05c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:52.568307 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6ac6a-bdbf-4fa1-a9d6-5aefa3bf05c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:52.568772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6ac6a-bdbf-4fa1-a9d6-5aefa3bf05c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:52.569194 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6ac6a-bdbf-4fa1-a9d6-5aefa3bf05c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:52.570543 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e6ac6a-bdbf-4fa1-a9d6-5aefa3bf05c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:52.575861 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e6ac6a-bdbf-4fa1-a9d6-5aefa3bf05c2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:52.582729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9512996-bf31-44ba-a087-4d8e13ab1883 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa55fe9abcc0463d934089d9dff4a5e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f57aead0af847e98b83d30ffcc3d59b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:52.583392 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9512996-bf31-44ba-a087-4d8e13ab1883 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:52.583685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9512996-bf31-44ba-a087-4d8e13ab1883 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:52.583961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9512996-bf31-44ba-a087-4d8e13ab1883 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] PATH_INFO: `/v3/regions/f7df71828e4f48449c0a3bd7a8fff289` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:52.584715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9512996-bf31-44ba-a087-4d8e13ab1883 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: Authorizing `identity:get_region(region_id=f7df71828e4f48449c0a3bd7a8fff289)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:52.588262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9512996-bf31-44ba-a087-4d8e13ab1883 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:52.609730 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3526/7037] 10.222.0.30 () {58 vars in 1227 bytes} [Sun Sep 4 01:30:52 2022] GET /identity/v3/regions/f7df71828e4f48449c0a3bd7a8fff289 => generated 254 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:52.612155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9512996-bf31-44ba-a087-4d8e13ab1883 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:52.632722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9512996-bf31-44ba-a087-4d8e13ab1883 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:52.644655 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a305a6-c286-46ec-97e0-b1076b7b10af tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa55fe9abcc0463d934089d9dff4a5e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f57aead0af847e98b83d30ffcc3d59b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:52.645496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a305a6-c286-46ec-97e0-b1076b7b10af tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:52.646209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a305a6-c286-46ec-97e0-b1076b7b10af tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:52.646488 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a305a6-c286-46ec-97e0-b1076b7b10af tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] PATH_INFO: `/v3/regions/f7df71828e4f48449c0a3bd7a8fff289` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:52.647095 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a305a6-c286-46ec-97e0-b1076b7b10af tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: Authorizing `identity:delete_region(region_id=f7df71828e4f48449c0a3bd7a8fff289)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:52.652148 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a305a6-c286-46ec-97e0-b1076b7b10af tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:52.667804 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3512/7038] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:30:52 2022] POST /identity/v3/projects => generated 369 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:52.670941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6ac6a-bdbf-4fa1-a9d6-5aefa3bf05c2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:52.731799 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3527/7039] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:30:52 2022] DELETE /identity/v3/regions/f7df71828e4f48449c0a3bd7a8fff289 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:30:52.738182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a305a6-c286-46ec-97e0-b1076b7b10af tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:52.826207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a305a6-c286-46ec-97e0-b1076b7b10af tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:52.901339 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:52.910396 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6ac6a-bdbf-4fa1-a9d6-5aefa3bf05c2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:52.979637 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e969884-baf8-456f-a7ac-f3c96ecee4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:52.981733 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e969884-baf8-456f-a7ac-f3c96ecee4ad admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:52.984158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e969884-baf8-456f-a7ac-f3c96ecee4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:52.985887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e969884-baf8-456f-a7ac-f3c96ecee4ad admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:52.989186 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e969884-baf8-456f-a7ac-f3c96ecee4ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:53.009790 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e969884-baf8-456f-a7ac-f3c96ecee4ad admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:53.067042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23681c19-b05b-48d2-85e9-9bdd74de7472 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa55fe9abcc0463d934089d9dff4a5e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f57aead0af847e98b83d30ffcc3d59b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:53.067748 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23681c19-b05b-48d2-85e9-9bdd74de7472 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:53.068071 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23681c19-b05b-48d2-85e9-9bdd74de7472 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:53.068371 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23681c19-b05b-48d2-85e9-9bdd74de7472 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] PATH_INFO: `/v3/regions` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:53.068987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23681c19-b05b-48d2-85e9-9bdd74de7472 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:53.070168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23681c19-b05b-48d2-85e9-9bdd74de7472 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:53.089021 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3528/7040] 10.222.0.30 () {58 vars in 1128 bytes} [Sun Sep 4 01:30:52 2022] GET /identity/v3/regions => generated 670 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:53.093186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23681c19-b05b-48d2-85e9-9bdd74de7472 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:53.101130 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3513/7041] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:30:52 2022] POST /identity/v3/users => generated 285 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:53.109667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e969884-baf8-456f-a7ac-f3c96ecee4ad admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:53.124762 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e969884-baf8-456f-a7ac-f3c96ecee4ad admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:53.125612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23681c19-b05b-48d2-85e9-9bdd74de7472 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:53.130711 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aae93e-09b8-48c7-9866-27fb07fd5dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:53.131347 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aae93e-09b8-48c7-9866-27fb07fd5dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:53.131656 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aae93e-09b8-48c7-9866-27fb07fd5dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:53.131980 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aae93e-09b8-48c7-9866-27fb07fd5dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:53.132811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aae93e-09b8-48c7-9866-27fb07fd5dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:53.134470 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aae93e-09b8-48c7-9866-27fb07fd5dd2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:53.139149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89751896-4ca3-465b-8959-fae2a8908615 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa55fe9abcc0463d934089d9dff4a5e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f57aead0af847e98b83d30ffcc3d59b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:53.140231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89751896-4ca3-465b-8959-fae2a8908615 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:53.140814 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89751896-4ca3-465b-8959-fae2a8908615 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:53.141333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89751896-4ca3-465b-8959-fae2a8908615 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] PATH_INFO: `/v3/regions/f7df71828e4f48449c0a3bd7a8fff289` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:53.142347 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89751896-4ca3-465b-8959-fae2a8908615 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: Authorizing `identity:delete_region(region_id=f7df71828e4f48449c0a3bd7a8fff289)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:53.144406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89751896-4ca3-465b-8959-fae2a8908615 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:53.157681 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-89751896-4ca3-465b-8959-fae2a8908615 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] Could not find region: f7df71828e4f48449c0a3bd7a8fff289.: keystone.exception.RegionNotFound: Could not find region: f7df71828e4f48449c0a3bd7a8fff289. Sep 04 01:30:53.157681 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:30:53.157681 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Sep 04 01:30:53.157681 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Sep 04 01:30:53.157681 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Sep 04 01:30:53.157681 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Sep 04 01:30:53.157681 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Sep 04 01:30:53.157681 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Sep 04 01:30:53.157681 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: f7df71828e4f48449c0a3bd7a8fff289. Sep 04 01:30:53.157681 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:30:53.157681 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:30:53.157681 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:30:53.157681 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:30:53.157681 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:30:53.157681 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:30:53.157681 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:30:53.158819 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:30:53.158819 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:30:53.158819 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:30:53.158819 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:30:53.158819 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:30:53.158819 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:30:53.158819 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:30:53.158819 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Sep 04 01:30:53.158819 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Sep 04 01:30:53.158819 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:30:53.158819 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:30:53.158819 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Sep 04 01:30:53.158819 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Sep 04 01:30:53.158819 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: f7df71828e4f48449c0a3bd7a8fff289. Sep 04 01:30:53.158819 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:30:53.162379 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3529/7042] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:30:53 2022] DELETE /identity/v3/regions/f7df71828e4f48449c0a3bd7a8fff289 => generated 112 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:30:53.165810 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3514/7043] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:53.170246 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89751896-4ca3-465b-8959-fae2a8908615 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:53.170820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aae93e-09b8-48c7-9866-27fb07fd5dd2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:53.203760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aae93e-09b8-48c7-9866-27fb07fd5dd2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:53.204163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89751896-4ca3-465b-8959-fae2a8908615 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:53.211106 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f28c4b-3400-4cd7-a86f-5977738c0ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:53.211872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f28c4b-3400-4cd7-a86f-5977738c0ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:53.212365 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f28c4b-3400-4cd7-a86f-5977738c0ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:53.212365 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f28c4b-3400-4cd7-a86f-5977738c0ab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:53.213065 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f28c4b-3400-4cd7-a86f-5977738c0ab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:53.214784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f28c4b-3400-4cd7-a86f-5977738c0ab0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:53.215458 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f0c54-d0f4-468f-92ea-037302fb3e35 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa55fe9abcc0463d934089d9dff4a5e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f57aead0af847e98b83d30ffcc3d59b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:53.216334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f0c54-d0f4-468f-92ea-037302fb3e35 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:53.216815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f0c54-d0f4-468f-92ea-037302fb3e35 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:53.217196 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f0c54-d0f4-468f-92ea-037302fb3e35 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] PATH_INFO: `/v3/regions` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:53.220212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f0c54-d0f4-468f-92ea-037302fb3e35 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:53.221368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f0c54-d0f4-468f-92ea-037302fb3e35 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:53.232690 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3530/7044] 10.222.0.30 () {58 vars in 1128 bytes} [Sun Sep 4 01:30:53 2022] GET /identity/v3/regions => generated 670 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:30:53.240183 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f0c54-d0f4-468f-92ea-037302fb3e35 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:53.249864 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3515/7045] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:53.261695 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f28c4b-3400-4cd7-a86f-5977738c0ab0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:53.274433 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f0c54-d0f4-468f-92ea-037302fb3e35 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:53.278043 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f28c4b-3400-4cd7-a86f-5977738c0ab0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:53.289632 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016a5cf-3d0a-48c4-a5d6-2f9810ae60cf tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa55fe9abcc0463d934089d9dff4a5e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f57aead0af847e98b83d30ffcc3d59b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:53.289875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e20f4-6204-47f4-bed4-f9e0e0682f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:53.290728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e20f4-6204-47f4-bed4-f9e0e0682f3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:53.291812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016a5cf-3d0a-48c4-a5d6-2f9810ae60cf tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:53.292518 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e20f4-6204-47f4-bed4-f9e0e0682f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:53.293302 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e20f4-6204-47f4-bed4-f9e0e0682f3a admin admin] PATH_INFO: `/v3/projects/af4a52a10110442b835c79430b970a7b/users/59b929785d8e447c8a4d3db8f06fdd23/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:53.293934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016a5cf-3d0a-48c4-a5d6-2f9810ae60cf tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:53.294368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016a5cf-3d0a-48c4-a5d6-2f9810ae60cf tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] PATH_INFO: `/v3/regions` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:53.295586 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016a5cf-3d0a-48c4-a5d6-2f9810ae60cf tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:53.301030 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016a5cf-3d0a-48c4-a5d6-2f9810ae60cf tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:53.333838 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e20f4-6204-47f4-bed4-f9e0e0682f3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=af4a52a10110442b835c79430b970a7b, user_id=59b929785d8e447c8a4d3db8f06fdd23, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:53.336974 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e20f4-6204-47f4-bed4-f9e0e0682f3a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:53.376496 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3531/7046] 10.222.0.30 () {60 vars in 1150 bytes} [Sun Sep 4 01:30:53 2022] POST /identity/v3/regions => generated 253 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:53.378088 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016a5cf-3d0a-48c4-a5d6-2f9810ae60cf tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:53.393508 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3516/7047] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:30:53 2022] PUT /identity/v3/projects/af4a52a10110442b835c79430b970a7b/users/59b929785d8e447c8a4d3db8f06fdd23/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:30:53.477545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016a5cf-3d0a-48c4-a5d6-2f9810ae60cf tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:53.497685 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff6d62-df89-410b-951a-b866dfb2bc1a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:53.498250 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff6d62-df89-410b-951a-b866dfb2bc1a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:53.498675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff6d62-df89-410b-951a-b866dfb2bc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:53.590510 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e3ff6d62-df89-410b-951a-b866dfb2bc1a None None] MFA Rules not processed for user `59b929785d8e447c8a4d3db8f06fdd23`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:53.592304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e3ff6d62-df89-410b-951a-b866dfb2bc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:53.607929 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5df44-d04c-440d-8848-29237dd6cdbf tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa55fe9abcc0463d934089d9dff4a5e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f57aead0af847e98b83d30ffcc3d59b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:53.609865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5df44-d04c-440d-8848-29237dd6cdbf tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:53.611385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5df44-d04c-440d-8848-29237dd6cdbf tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:53.611935 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5df44-d04c-440d-8848-29237dd6cdbf tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] PATH_INFO: `/v3/regions` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:53.613346 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:53.616162 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5df44-d04c-440d-8848-29237dd6cdbf tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: Adding query filter params (parent_region_id=db49010b6d1f4bee94140c0cfa4d69d5) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:30:53.617716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5df44-d04c-440d-8848-29237dd6cdbf tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:53.621729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5df44-d04c-440d-8848-29237dd6cdbf tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:53.641858 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3532/7048] 10.222.0.30 () {58 vars in 1227 bytes} [Sun Sep 4 01:30:53 2022] GET /identity/v3/regions?parent_region_id=db49010b6d1f4bee94140c0cfa4d69d5 => generated 399 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:30:53.645372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5df44-d04c-440d-8848-29237dd6cdbf tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:53.664245 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5df44-d04c-440d-8848-29237dd6cdbf tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:53.671889 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb604c78-f2cf-4b09-a837-c49f1090e1ff tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa55fe9abcc0463d934089d9dff4a5e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f57aead0af847e98b83d30ffcc3d59b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:53.676032 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb604c78-f2cf-4b09-a837-c49f1090e1ff tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:53.676963 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb604c78-f2cf-4b09-a837-c49f1090e1ff tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:53.678436 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb604c78-f2cf-4b09-a837-c49f1090e1ff tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] PATH_INFO: `/v3/regions/39541fb461fe4856918a85d7487f5fbd` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:53.679294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb604c78-f2cf-4b09-a837-c49f1090e1ff tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: Authorizing `identity:delete_region(region_id=39541fb461fe4856918a85d7487f5fbd)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:53.684144 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb604c78-f2cf-4b09-a837-c49f1090e1ff tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:53.716986 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3517/7049] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:30:53.722641 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff6d62-df89-410b-951a-b866dfb2bc1a None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:53.728964 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3533/7050] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:30:53 2022] DELETE /identity/v3/regions/39541fb461fe4856918a85d7487f5fbd => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:53.730994 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb604c78-f2cf-4b09-a837-c49f1090e1ff tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:53.758998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb604c78-f2cf-4b09-a837-c49f1090e1ff tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:53.767424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa94cf3-4834-4934-a482-b616da882ce2 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa55fe9abcc0463d934089d9dff4a5e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f57aead0af847e98b83d30ffcc3d59b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:53.768641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa94cf3-4834-4934-a482-b616da882ce2 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:53.769182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa94cf3-4834-4934-a482-b616da882ce2 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:53.769768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa94cf3-4834-4934-a482-b616da882ce2 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] PATH_INFO: `/v3/regions/91b683ba8dc440188e30714f3ba1ace2` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:53.770640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa94cf3-4834-4934-a482-b616da882ce2 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: Authorizing `identity:delete_region(region_id=91b683ba8dc440188e30714f3ba1ace2)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:53.773236 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa94cf3-4834-4934-a482-b616da882ce2 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:53.802839 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3534/7051] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:30:53 2022] DELETE /identity/v3/regions/91b683ba8dc440188e30714f3ba1ace2 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:53.807295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa94cf3-4834-4934-a482-b616da882ce2 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:53.832314 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:53.838907 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa94cf3-4834-4934-a482-b616da882ce2 tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:53.850356 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4987d-f04d-4e71-9632-bf461daa74aa tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa55fe9abcc0463d934089d9dff4a5e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f57aead0af847e98b83d30ffcc3d59b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:53.851310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4987d-f04d-4e71-9632-bf461daa74aa tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:53.851746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4987d-f04d-4e71-9632-bf461daa74aa tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:53.852127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4987d-f04d-4e71-9632-bf461daa74aa tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] PATH_INFO: `/v3/regions/db49010b6d1f4bee94140c0cfa4d69d5` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:53.852822 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c4987d-f04d-4e71-9632-bf461daa74aa tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: Authorizing `identity:delete_region(region_id=db49010b6d1f4bee94140c0cfa4d69d5)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:53.856516 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c4987d-f04d-4e71-9632-bf461daa74aa tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:53.905884 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3535/7052] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:30:53 2022] DELETE /identity/v3/regions/db49010b6d1f4bee94140c0cfa4d69d5 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:30:53.907274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4987d-f04d-4e71-9632-bf461daa74aa tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:53.911756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-48c4987d-f04d-4e71-9632-bf461daa74aa tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:54.046367 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff6d62-df89-410b-951a-b866dfb2bc1a None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:54.073725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4987d-f04d-4e71-9632-bf461daa74aa tempest-RegionsTestJSON-1120299913 tempest-RegionsTestJSON-1120299913-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:54.082158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d045ab-f14b-4b9b-80a5-31ee26dbb04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:54.082364 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631921e-4cef-40c9-8cb4-a91fd3694546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:54.082800 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d045ab-f14b-4b9b-80a5-31ee26dbb04e admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:54.083079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d045ab-f14b-4b9b-80a5-31ee26dbb04e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:54.083380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d045ab-f14b-4b9b-80a5-31ee26dbb04e admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:54.083518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631921e-4cef-40c9-8cb4-a91fd3694546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:54.083894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631921e-4cef-40c9-8cb4-a91fd3694546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:54.084119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d045ab-f14b-4b9b-80a5-31ee26dbb04e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:54.084360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631921e-4cef-40c9-8cb4-a91fd3694546 admin admin] PATH_INFO: `/v3/users/b9be06124d024f47b55a25f9417376cb` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:54.085866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631921e-4cef-40c9-8cb4-a91fd3694546 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9be06124d024f47b55a25f9417376cb)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:54.088178 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631921e-4cef-40c9-8cb4-a91fd3694546 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:54.096750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d045ab-f14b-4b9b-80a5-31ee26dbb04e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:54.172976 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6631921e-4cef-40c9-8cb4-a91fd3694546 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9be06124d024f47b55a25f9417376cb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:54.175766 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6631921e-4cef-40c9-8cb4-a91fd3694546 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9be06124d024f47b55a25f9417376cb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:54.189861 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3518/7053] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:30:53 2022] POST /identity/v3/projects => generated 369 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:54.190752 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d045ab-f14b-4b9b-80a5-31ee26dbb04e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:54.194404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-58d045ab-f14b-4b9b-80a5-31ee26dbb04e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:54.204330 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6631921e-4cef-40c9-8cb4-a91fd3694546 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9be06124d024f47b55a25f9417376cb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:54.234226 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6631921e-4cef-40c9-8cb4-a91fd3694546 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9be06124d024f47b55a25f9417376cb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:54.235153 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6631921e-4cef-40c9-8cb4-a91fd3694546 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9be06124d024f47b55a25f9417376cb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:54.276136 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3536/7054] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:53 2022] DELETE /identity/v3/users/b9be06124d024f47b55a25f9417376cb => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:30:54.276875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631921e-4cef-40c9-8cb4-a91fd3694546 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:54.280447 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6631921e-4cef-40c9-8cb4-a91fd3694546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:54.337298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d045ab-f14b-4b9b-80a5-31ee26dbb04e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:54.400939 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:54.420028 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:54.425781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631921e-4cef-40c9-8cb4-a91fd3694546 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:54.440564 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c5f8d-aa70-45c6-9c62-8fdb0ca1f2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:54.443391 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c5f8d-aa70-45c6-9c62-8fdb0ca1f2ed admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:54.444908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c5f8d-aa70-45c6-9c62-8fdb0ca1f2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:54.445541 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c5f8d-aa70-45c6-9c62-8fdb0ca1f2ed admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:54.446261 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c5f8d-aa70-45c6-9c62-8fdb0ca1f2ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:54.452324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c5f8d-aa70-45c6-9c62-8fdb0ca1f2ed admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:54.476972 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a439ca-f7f9-499e-b9c2-ad93cb748359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:54.477818 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a439ca-f7f9-499e-b9c2-ad93cb748359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:54.478227 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a439ca-f7f9-499e-b9c2-ad93cb748359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:54.478617 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a439ca-f7f9-499e-b9c2-ad93cb748359 admin admin] PATH_INFO: `/v3/users/e43e07f017224984b5458f1c4aaaee10` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:54.480074 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a439ca-f7f9-499e-b9c2-ad93cb748359 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e43e07f017224984b5458f1c4aaaee10)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:54.483449 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a439ca-f7f9-499e-b9c2-ad93cb748359 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:54.503988 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3537/7055] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:30:54 2022] POST /identity/v3/users => generated 291 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:54.518905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0396e6-2d00-4357-a75d-fc2d7417a2c4 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:54.522104 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0396e6-2d00-4357-a75d-fc2d7417a2c4 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:54.523826 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0396e6-2d00-4357-a75d-fc2d7417a2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:54.604698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ef0396e6-2d00-4357-a75d-fc2d7417a2c4 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:54.607895 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ef0396e6-2d00-4357-a75d-fc2d7417a2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:54.632136 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a3a439ca-f7f9-499e-b9c2-ad93cb748359 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e43e07f017224984b5458f1c4aaaee10'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:54.633494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a3a439ca-f7f9-499e-b9c2-ad93cb748359 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e43e07f017224984b5458f1c4aaaee10'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:54.635380 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3538/7056] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:54.649573 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0396e6-2d00-4357-a75d-fc2d7417a2c4 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:54.665291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a3a439ca-f7f9-499e-b9c2-ad93cb748359 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e43e07f017224984b5458f1c4aaaee10'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:54.671146 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0396e6-2d00-4357-a75d-fc2d7417a2c4 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:54.682988 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a3a439ca-f7f9-499e-b9c2-ad93cb748359 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e43e07f017224984b5458f1c4aaaee10'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:54.684346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a3a439ca-f7f9-499e-b9c2-ad93cb748359 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e43e07f017224984b5458f1c4aaaee10'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:54.708986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f478e4-d40e-4b03-b91b-570c530d7d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:54.715678 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f478e4-d40e-4b03-b91b-570c530d7d0b admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:54.717042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f478e4-d40e-4b03-b91b-570c530d7d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:54.718799 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f478e4-d40e-4b03-b91b-570c530d7d0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:54.720872 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f478e4-d40e-4b03-b91b-570c530d7d0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:54.724328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f478e4-d40e-4b03-b91b-570c530d7d0b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:54.757263 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3519/7057] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:54 2022] DELETE /identity/v3/users/e43e07f017224984b5458f1c4aaaee10 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:54.758096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a439ca-f7f9-499e-b9c2-ad93cb748359 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:54.758553 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3539/7058] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:54.760366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccef63c-4427-421c-ba67-4aaa865f8214 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:54.764544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a3a439ca-f7f9-499e-b9c2-ad93cb748359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:54.765246 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccef63c-4427-421c-ba67-4aaa865f8214 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:54.767776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccef63c-4427-421c-ba67-4aaa865f8214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:54.847386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-7ccef63c-4427-421c-ba67-4aaa865f8214 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:54.853159 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7ccef63c-4427-421c-ba67-4aaa865f8214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:54.979741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a439ca-f7f9-499e-b9c2-ad93cb748359 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:54.988533 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871de83-e249-42a9-9ed1-1abc27b31783 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:54.989709 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871de83-e249-42a9-9ed1-1abc27b31783 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:54.991960 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871de83-e249-42a9-9ed1-1abc27b31783 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:54.992483 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871de83-e249-42a9-9ed1-1abc27b31783 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:54.998700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9871de83-e249-42a9-9ed1-1abc27b31783 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:55.080638 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3540/7059] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:55.084273 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccef63c-4427-421c-ba67-4aaa865f8214 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:55.086723 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7ccef63c-4427-421c-ba67-4aaa865f8214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:55.121483 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccef63c-4427-421c-ba67-4aaa865f8214 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:55.139886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9ac49-f070-4613-ae8c-3cc71039ae7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:55.144264 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9ac49-f070-4613-ae8c-3cc71039ae7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:55.144264 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9ac49-f070-4613-ae8c-3cc71039ae7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:55.144264 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9ac49-f070-4613-ae8c-3cc71039ae7a admin admin] PATH_INFO: `/v3/projects/11b7f778bfc74f3badf26985a25fc2b9/users/fded86f8c22b47c2a144d7c51d718df8/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:55.194907 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9ac49-f070-4613-ae8c-3cc71039ae7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=11b7f778bfc74f3badf26985a25fc2b9, user_id=fded86f8c22b47c2a144d7c51d718df8, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:55.197624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9ac49-f070-4613-ae8c-3cc71039ae7a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:55.204710 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:55.215473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871de83-e249-42a9-9ed1-1abc27b31783 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:55.218250 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871de83-e249-42a9-9ed1-1abc27b31783 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:55.233112 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3541/7060] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:30:55 2022] PUT /identity/v3/projects/11b7f778bfc74f3badf26985a25fc2b9/users/fded86f8c22b47c2a144d7c51d718df8/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:55.233797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9ac49-f070-4613-ae8c-3cc71039ae7a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:55.256158 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3520/7061] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:30:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:30:55.257235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871de83-e249-42a9-9ed1-1abc27b31783 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:55.267878 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871de83-e249-42a9-9ed1-1abc27b31783 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:55.350090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c537f-013c-4220-92f2-b9d6b5f61abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:55.350635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c537f-013c-4220-92f2-b9d6b5f61abf admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:55.350920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c537f-013c-4220-92f2-b9d6b5f61abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:55.351189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c537f-013c-4220-92f2-b9d6b5f61abf admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:55.351839 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c537f-013c-4220-92f2-b9d6b5f61abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:55.353662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c537f-013c-4220-92f2-b9d6b5f61abf admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:55.375292 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3521/7062] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:55.378532 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c537f-013c-4220-92f2-b9d6b5f61abf admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:55.423469 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c537f-013c-4220-92f2-b9d6b5f61abf admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:55.443875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54318e6-6720-4489-ae8d-cea691a2a7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:55.444940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54318e6-6720-4489-ae8d-cea691a2a7b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:55.447063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54318e6-6720-4489-ae8d-cea691a2a7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:55.449800 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54318e6-6720-4489-ae8d-cea691a2a7b9 admin admin] PATH_INFO: `/v3/projects/11b7f778bfc74f3badf26985a25fc2b9/users/fded86f8c22b47c2a144d7c51d718df8/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:55.462386 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54318e6-6720-4489-ae8d-cea691a2a7b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11b7f778bfc74f3badf26985a25fc2b9, user_id=fded86f8c22b47c2a144d7c51d718df8, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:55.466432 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9ac49-f070-4613-ae8c-3cc71039ae7a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:55.472396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5c3b4-f4c1-49d5-88e7-47d28853f02b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:55.473182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5c3b4-f4c1-49d5-88e7-47d28853f02b service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:55.473371 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5c3b4-f4c1-49d5-88e7-47d28853f02b service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:55.473700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5c3b4-f4c1-49d5-88e7-47d28853f02b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:55.475322 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54318e6-6720-4489-ae8d-cea691a2a7b9 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:55.488169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5c3b4-f4c1-49d5-88e7-47d28853f02b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:55.490724 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5c3b4-f4c1-49d5-88e7-47d28853f02b service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:55.504414 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3542/7063] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:30:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:30:55.519726 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3522/7064] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:30:55 2022] PUT /identity/v3/projects/11b7f778bfc74f3badf26985a25fc2b9/users/fded86f8c22b47c2a144d7c51d718df8/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:55.532595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b10f6-4069-442b-8a51-f2b3dadb9fe3 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:55.532860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b10f6-4069-442b-8a51-f2b3dadb9fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:55.533428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b10f6-4069-442b-8a51-f2b3dadb9fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:55.615821 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-8d2b10f6-4069-442b-8a51-f2b3dadb9fe3 None None] MFA Rules not processed for user `fded86f8c22b47c2a144d7c51d718df8`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:55.618157 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8d2b10f6-4069-442b-8a51-f2b3dadb9fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:55.725230 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54318e6-6720-4489-ae8d-cea691a2a7b9 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:55.727651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a54318e6-6720-4489-ae8d-cea691a2a7b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:55.745226 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:55.839616 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3543/7065] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:55.844737 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b10f6-4069-442b-8a51-f2b3dadb9fe3 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:55.871750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b10f6-4069-442b-8a51-f2b3dadb9fe3 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:55.892091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458df87-5dc3-479e-82da-63e3daf5dd8d tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fded86f8c22b47c2a144d7c51d718df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b7f778bfc74f3badf26985a25fc2b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:55.892841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458df87-5dc3-479e-82da-63e3daf5dd8d tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:55.893102 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458df87-5dc3-479e-82da-63e3daf5dd8d tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:55.893381 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458df87-5dc3-479e-82da-63e3daf5dd8d tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:55.894139 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458df87-5dc3-479e-82da-63e3daf5dd8d tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:55.896821 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458df87-5dc3-479e-82da-63e3daf5dd8d tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:55.972984 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3544/7066] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:30:55 2022] POST /identity/v3/projects => generated 359 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:30:55.976824 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458df87-5dc3-479e-82da-63e3daf5dd8d tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:56.113593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458df87-5dc3-479e-82da-63e3daf5dd8d tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:56.124470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53d2c2-6c83-4b95-bea9-e3b6e4e33a72 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fded86f8c22b47c2a144d7c51d718df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b7f778bfc74f3badf26985a25fc2b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:56.126330 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53d2c2-6c83-4b95-bea9-e3b6e4e33a72 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:56.128503 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53d2c2-6c83-4b95-bea9-e3b6e4e33a72 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:56.129030 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53d2c2-6c83-4b95-bea9-e3b6e4e33a72 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:56.134445 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53d2c2-6c83-4b95-bea9-e3b6e4e33a72 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:56.136614 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53d2c2-6c83-4b95-bea9-e3b6e4e33a72 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:56.145180 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54318e6-6720-4489-ae8d-cea691a2a7b9 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:56.199568 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3545/7067] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:30:55 2022] POST /identity/v3/users => generated 373 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:56.205286 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53d2c2-6c83-4b95-bea9-e3b6e4e33a72 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:56.246934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53d2c2-6c83-4b95-bea9-e3b6e4e33a72 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:56.260065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4733cd-a383-42b4-9888-d3c47c049bf6 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fded86f8c22b47c2a144d7c51d718df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b7f778bfc74f3badf26985a25fc2b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:56.261227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4733cd-a383-42b4-9888-d3c47c049bf6 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:56.265695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4733cd-a383-42b4-9888-d3c47c049bf6 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:56.275879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4733cd-a383-42b4-9888-d3c47c049bf6 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:56.285277 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4733cd-a383-42b4-9888-d3c47c049bf6 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:30:56.286582 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4733cd-a383-42b4-9888-d3c47c049bf6 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:56.293978 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4733cd-a383-42b4-9888-d3c47c049bf6 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:56.339899 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e916aa-ddb3-44e7-ad44-019454bc12a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:56.340562 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e916aa-ddb3-44e7-ad44-019454bc12a9 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:56.343448 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e916aa-ddb3-44e7-ad44-019454bc12a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:56.343841 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e916aa-ddb3-44e7-ad44-019454bc12a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:56.349737 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-58e916aa-ddb3-44e7-ad44-019454bc12a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:56.373951 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3546/7068] 10.222.0.30 () {58 vars in 1157 bytes} [Sun Sep 4 01:30:56 2022] GET /identity/v3/users?domain_id=default => generated 7758 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:56.378216 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4733cd-a383-42b4-9888-d3c47c049bf6 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:56.386546 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:56.401382 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e916aa-ddb3-44e7-ad44-019454bc12a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:56.403162 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e916aa-ddb3-44e7-ad44-019454bc12a9 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:56.404482 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4733cd-a383-42b4-9888-d3c47c049bf6 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:56.417207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11ab81-ffaf-418e-9ac9-ecad67e6f976 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fded86f8c22b47c2a144d7c51d718df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b7f778bfc74f3badf26985a25fc2b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:56.419084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11ab81-ffaf-418e-9ac9-ecad67e6f976 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:56.421274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11ab81-ffaf-418e-9ac9-ecad67e6f976 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:56.421804 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11ab81-ffaf-418e-9ac9-ecad67e6f976 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] PATH_INFO: `/v3/users/8f211434133441178b97be2611a4003a` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:56.482882 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3523/7069] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:30:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 758 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:30:56.491946 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11ab81-ffaf-418e-9ac9-ecad67e6f976 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] RBAC: Authorizing `identity:update_user(user_id=8f211434133441178b97be2611a4003a)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:56.494117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11ab81-ffaf-418e-9ac9-ecad67e6f976 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:56.619457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ef11ab81-ffaf-418e-9ac9-ecad67e6f976 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '8f211434133441178b97be2611a4003a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:56.631881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ef11ab81-ffaf-418e-9ac9-ecad67e6f976 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] Invalidating the token cache because user 8f211434133441178b97be2611a4003a was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:30:56.632962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ef11ab81-ffaf-418e-9ac9-ecad67e6f976 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:56.634219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ef11ab81-ffaf-418e-9ac9-ecad67e6f976 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:56.641712 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3547/7070] 10.222.0.30 () {60 vars in 1244 bytes} [Sun Sep 4 01:30:56 2022] PATCH /identity/v3/users/8f211434133441178b97be2611a4003a => generated 488 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:30:56.643088 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f83ca7-6b51-4044-b30b-661829497738 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:56.646626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f83ca7-6b51-4044-b30b-661829497738 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:56.646626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f83ca7-6b51-4044-b30b-661829497738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:56.648142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11ab81-ffaf-418e-9ac9-ecad67e6f976 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:56.658578 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ef11ab81-ffaf-418e-9ac9-ecad67e6f976 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:56.690796 n-d-master-1 devstack@keystone.service[81825]: WARNING keystone.auth.plugins.core [None req-e6f83ca7-6b51-4044-b30b-661829497738 None None] User is disabled: 8f211434133441178b97be2611a4003a: AssertionError: User is disabled: 8f211434133441178b97be2611a4003a Sep 04 01:30:56.722666 n-d-master-1 devstack@keystone.service[81825]: WARNING keystone.server.flask.application [None req-e6f83ca7-6b51-4044-b30b-661829497738 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.30: keystone.exception.Unauthorized: The request you have made requires authentication. Sep 04 01:30:56.727352 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3524/7071] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:56 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 82 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Sep 04 01:30:56.727352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f83ca7-6b51-4044-b30b-661829497738 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:56.728442 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e6f83ca7-6b51-4044-b30b-661829497738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:56.796833 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:56.836146 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11ab81-ffaf-418e-9ac9-ecad67e6f976 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:56.844691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0ebd5-87ee-4626-94cf-06f43e57fb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:56.845386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0ebd5-87ee-4626-94cf-06f43e57fb79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:56.845786 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0ebd5-87ee-4626-94cf-06f43e57fb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:56.846385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0ebd5-87ee-4626-94cf-06f43e57fb79 admin admin] PATH_INFO: `/v3/projects/8eb778d2278c4b68b18b1134b9ce5c0a` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:56.850041 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0ebd5-87ee-4626-94cf-06f43e57fb79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eb778d2278c4b68b18b1134b9ce5c0a)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:56.868523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0ebd5-87ee-4626-94cf-06f43e57fb79 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:56.944779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0ff0ebd5-87ee-4626-94cf-06f43e57fb79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eb778d2278c4b68b18b1134b9ce5c0a', 'request_id': 'req-0ff0ebd5-87ee-4626-94cf-06f43e57fb79'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:56.967233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0ff0ebd5-87ee-4626-94cf-06f43e57fb79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eb778d2278c4b68b18b1134b9ce5c0a', 'request_id': 'req-0ff0ebd5-87ee-4626-94cf-06f43e57fb79'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:56.982285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0ff0ebd5-87ee-4626-94cf-06f43e57fb79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eb778d2278c4b68b18b1134b9ce5c0a', 'request_id': 'req-0ff0ebd5-87ee-4626-94cf-06f43e57fb79'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:57.002507 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f83ca7-6b51-4044-b30b-661829497738 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:57.013508 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0ff0ebd5-87ee-4626-94cf-06f43e57fb79 admin admin] The token cache is being invalidate because project 8eb778d2278c4b68b18b1134b9ce5c0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:30:57.013866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0ff0ebd5-87ee-4626-94cf-06f43e57fb79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:57.014573 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0ff0ebd5-87ee-4626-94cf-06f43e57fb79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:57.020907 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3548/7072] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:30:56 2022] DELETE /identity/v3/projects/8eb778d2278c4b68b18b1134b9ce5c0a => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:57.021972 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0ebd5-87ee-4626-94cf-06f43e57fb79 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:57.023546 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0ff0ebd5-87ee-4626-94cf-06f43e57fb79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:57.150084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0ebd5-87ee-4626-94cf-06f43e57fb79 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:57.152735 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984e792-0b57-4832-93fb-681d0cc4b27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:57.153823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984e792-0b57-4832-93fb-681d0cc4b27d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:57.153823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984e792-0b57-4832-93fb-681d0cc4b27d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:57.154001 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984e792-0b57-4832-93fb-681d0cc4b27d admin admin] PATH_INFO: `/v3/projects/c96f0d071cac438e8885a4b10887db3e` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:57.157341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984e792-0b57-4832-93fb-681d0cc4b27d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c96f0d071cac438e8885a4b10887db3e)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:57.160166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984e792-0b57-4832-93fb-681d0cc4b27d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:57.164492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62555082-4e1b-4f32-b2c3-c5cc2d200c26 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fded86f8c22b47c2a144d7c51d718df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b7f778bfc74f3badf26985a25fc2b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:57.165743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62555082-4e1b-4f32-b2c3-c5cc2d200c26 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:57.166261 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62555082-4e1b-4f32-b2c3-c5cc2d200c26 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:57.166627 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62555082-4e1b-4f32-b2c3-c5cc2d200c26 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] PATH_INFO: `/v3/users/8f211434133441178b97be2611a4003a` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:57.201165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62555082-4e1b-4f32-b2c3-c5cc2d200c26 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8f211434133441178b97be2611a4003a)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:57.204177 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62555082-4e1b-4f32-b2c3-c5cc2d200c26 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:57.319329 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7984e792-0b57-4832-93fb-681d0cc4b27d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c96f0d071cac438e8885a4b10887db3e', 'request_id': 'req-7984e792-0b57-4832-93fb-681d0cc4b27d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:57.323389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-62555082-4e1b-4f32-b2c3-c5cc2d200c26 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f211434133441178b97be2611a4003a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:57.327984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-62555082-4e1b-4f32-b2c3-c5cc2d200c26 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f211434133441178b97be2611a4003a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:57.330218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7984e792-0b57-4832-93fb-681d0cc4b27d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c96f0d071cac438e8885a4b10887db3e', 'request_id': 'req-7984e792-0b57-4832-93fb-681d0cc4b27d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:57.354429 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-62555082-4e1b-4f32-b2c3-c5cc2d200c26 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f211434133441178b97be2611a4003a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:57.355790 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7984e792-0b57-4832-93fb-681d0cc4b27d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c96f0d071cac438e8885a4b10887db3e', 'request_id': 'req-7984e792-0b57-4832-93fb-681d0cc4b27d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:57.381085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-62555082-4e1b-4f32-b2c3-c5cc2d200c26 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f211434133441178b97be2611a4003a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:57.382528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-62555082-4e1b-4f32-b2c3-c5cc2d200c26 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f211434133441178b97be2611a4003a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:57.392440 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7984e792-0b57-4832-93fb-681d0cc4b27d admin admin] The token cache is being invalidate because project c96f0d071cac438e8885a4b10887db3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:30:57.392744 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7984e792-0b57-4832-93fb-681d0cc4b27d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:57.396204 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7984e792-0b57-4832-93fb-681d0cc4b27d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:57.398235 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:57.400614 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3525/7073] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:30:56 2022] DELETE /identity/v3/projects/c96f0d071cac438e8885a4b10887db3e => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:57.401597 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984e792-0b57-4832-93fb-681d0cc4b27d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:57.405964 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7984e792-0b57-4832-93fb-681d0cc4b27d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:57.455872 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3549/7074] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:57 2022] DELETE /identity/v3/users/8f211434133441178b97be2611a4003a => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:57.464482 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cfd24e-a6bd-46f2-bcfc-0f69b367ab1e None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:57.465089 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cfd24e-a6bd-46f2-bcfc-0f69b367ab1e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:57.465659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cfd24e-a6bd-46f2-bcfc-0f69b367ab1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:57.481678 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:57.500142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-00cfd24e-a6bd-46f2-bcfc-0f69b367ab1e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:57.501869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-00cfd24e-a6bd-46f2-bcfc-0f69b367ab1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:57.574860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984e792-0b57-4832-93fb-681d0cc4b27d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:57.660995 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3550/7075] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:57.662305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cfd24e-a6bd-46f2-bcfc-0f69b367ab1e None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:57.664145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-00cfd24e-a6bd-46f2-bcfc-0f69b367ab1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:57.689260 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2778f81a-788b-4ff0-b0ba-bf6766c997de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:57.690777 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778f81a-788b-4ff0-b0ba-bf6766c997de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:57.691112 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778f81a-788b-4ff0-b0ba-bf6766c997de admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:57.694496 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778f81a-788b-4ff0-b0ba-bf6766c997de admin admin] PATH_INFO: `/v3/users/fa55fe9abcc0463d934089d9dff4a5e4` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:57.696180 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2778f81a-788b-4ff0-b0ba-bf6766c997de admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa55fe9abcc0463d934089d9dff4a5e4)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:57.701128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2778f81a-788b-4ff0-b0ba-bf6766c997de admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:57.831212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2778f81a-788b-4ff0-b0ba-bf6766c997de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa55fe9abcc0463d934089d9dff4a5e4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:57.832254 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2778f81a-788b-4ff0-b0ba-bf6766c997de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa55fe9abcc0463d934089d9dff4a5e4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:57.834925 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cfd24e-a6bd-46f2-bcfc-0f69b367ab1e None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:57.844124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a5244-3a84-4df6-aa7d-989c5300cfdf tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fded86f8c22b47c2a144d7c51d718df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b7f778bfc74f3badf26985a25fc2b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:57.845621 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a5244-3a84-4df6-aa7d-989c5300cfdf tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:57.845990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a5244-3a84-4df6-aa7d-989c5300cfdf tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:57.846273 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a5244-3a84-4df6-aa7d-989c5300cfdf tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] PATH_INFO: `/v3/projects/bccf277a15864e07b6ae0b3c6545bb61` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:57.850338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a5244-3a84-4df6-aa7d-989c5300cfdf tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bccf277a15864e07b6ae0b3c6545bb61)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:57.852316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a5244-3a84-4df6-aa7d-989c5300cfdf tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:57.870387 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2778f81a-788b-4ff0-b0ba-bf6766c997de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa55fe9abcc0463d934089d9dff4a5e4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:57.896983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2778f81a-788b-4ff0-b0ba-bf6766c997de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa55fe9abcc0463d934089d9dff4a5e4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:57.897852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2778f81a-788b-4ff0-b0ba-bf6766c997de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa55fe9abcc0463d934089d9dff4a5e4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:57.990264 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3526/7076] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:57 2022] DELETE /identity/v3/users/fa55fe9abcc0463d934089d9dff4a5e4 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:57.992674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928ca7b-a676-4c82-b726-9740d22b9791 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:57.993243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928ca7b-a676-4c82-b726-9740d22b9791 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:57.994578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928ca7b-a676-4c82-b726-9740d22b9791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:57.996626 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-735a5244-3a84-4df6-aa7d-989c5300cfdf tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bccf277a15864e07b6ae0b3c6545bb61', 'request_id': 'req-735a5244-3a84-4df6-aa7d-989c5300cfdf'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:58.019938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-735a5244-3a84-4df6-aa7d-989c5300cfdf tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bccf277a15864e07b6ae0b3c6545bb61', 'request_id': 'req-735a5244-3a84-4df6-aa7d-989c5300cfdf'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:58.042900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-735a5244-3a84-4df6-aa7d-989c5300cfdf tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bccf277a15864e07b6ae0b3c6545bb61', 'request_id': 'req-735a5244-3a84-4df6-aa7d-989c5300cfdf'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:58.074057 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-735a5244-3a84-4df6-aa7d-989c5300cfdf tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] The token cache is being invalidate because project bccf277a15864e07b6ae0b3c6545bb61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:30:58.083000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-735a5244-3a84-4df6-aa7d-989c5300cfdf tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:58.084960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-735a5244-3a84-4df6-aa7d-989c5300cfdf tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:58.086228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-1928ca7b-a676-4c82-b726-9740d22b9791 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:58.091625 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3551/7077] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:30:57 2022] DELETE /identity/v3/projects/bccf277a15864e07b6ae0b3c6545bb61 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:58.092673 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a5244-3a84-4df6-aa7d-989c5300cfdf tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:58.094635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1928ca7b-a676-4c82-b726-9740d22b9791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:58.098444 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-735a5244-3a84-4df6-aa7d-989c5300cfdf tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:58.156706 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:58.297597 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:58.323387 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3527/7078] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:58.328174 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928ca7b-a676-4c82-b726-9740d22b9791 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:58.339069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a5244-3a84-4df6-aa7d-989c5300cfdf tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:58.345036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928ca7b-a676-4c82-b726-9740d22b9791 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:58.355624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1be71-f3e5-4085-a155-a5281e2371cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:58.357116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1be71-f3e5-4085-a155-a5281e2371cf admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:58.357940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1be71-f3e5-4085-a155-a5281e2371cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:58.357940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1be71-f3e5-4085-a155-a5281e2371cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:58.358392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c1be71-f3e5-4085-a155-a5281e2371cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:30:58.358703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c1be71-f3e5-4085-a155-a5281e2371cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:58.362524 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c1be71-f3e5-4085-a155-a5281e2371cf admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:58.383389 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3528/7079] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:30:58.393360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1be71-f3e5-4085-a155-a5281e2371cf admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:58.409734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1be71-f3e5-4085-a155-a5281e2371cf admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:58.415764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f648d5d-849d-4b7b-8fc1-a7d9a2e52ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:58.416671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f648d5d-849d-4b7b-8fc1-a7d9a2e52ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:58.417117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f648d5d-849d-4b7b-8fc1-a7d9a2e52ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:58.417539 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f648d5d-849d-4b7b-8fc1-a7d9a2e52ba6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:58.418334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f648d5d-849d-4b7b-8fc1-a7d9a2e52ba6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:58.420410 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f648d5d-849d-4b7b-8fc1-a7d9a2e52ba6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:58.508661 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3529/7080] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:30:58 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:58.509826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f648d5d-849d-4b7b-8fc1-a7d9a2e52ba6 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:58.527524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123777b-fbe6-45ed-b629-5c2466fc1b87 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fded86f8c22b47c2a144d7c51d718df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11b7f778bfc74f3badf26985a25fc2b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:58.528161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123777b-fbe6-45ed-b629-5c2466fc1b87 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:58.528442 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123777b-fbe6-45ed-b629-5c2466fc1b87 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:58.528718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123777b-fbe6-45ed-b629-5c2466fc1b87 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:58.530669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2123777b-fbe6-45ed-b629-5c2466fc1b87 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:58.532777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2123777b-fbe6-45ed-b629-5c2466fc1b87 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:58.566422 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-2123777b-fbe6-45ed-b629-5c2466fc1b87 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] Could not find domain: f3384f8857c24af1affdd71cdd520daa.: keystone.exception.DomainNotFound: Could not find domain: f3384f8857c24af1affdd71cdd520daa. Sep 04 01:30:58.566422 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:30:58.566422 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 04 01:30:58.566422 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 04 01:30:58.566422 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 01:30:58.566422 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 01:30:58.566422 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 01:30:58.566422 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 01:30:58.566422 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f3384f8857c24af1affdd71cdd520daa. Sep 04 01:30:58.566422 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:30:58.566422 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:30:58.566422 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:30:58.566422 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:30:58.566422 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:30:58.566422 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:30:58.566422 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:30:58.567808 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:30:58.567808 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:30:58.567808 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:30:58.567808 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:30:58.567808 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:30:58.567808 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:30:58.567808 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:30:58.567808 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 04 01:30:58.567808 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 04 01:30:58.567808 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:30:58.567808 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:30:58.567808 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 01:30:58.567808 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 01:30:58.567808 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 04 01:30:58.567808 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 01:30:58.567808 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Sep 04 01:30:58.567808 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Sep 04 01:30:58.569040 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:30:58.569040 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:30:58.569040 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 01:30:58.569040 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 01:30:58.569040 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 01:30:58.569040 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 01:30:58.569040 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 01:30:58.569040 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 01:30:58.569040 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 01:30:58.569040 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 01:30:58.569040 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 01:30:58.569040 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 01:30:58.569040 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 01:30:58.569040 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 01:30:58.569040 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 01:30:58.569040 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 01:30:58.569040 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 04 01:30:58.574366 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 01:30:58.574366 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f3384f8857c24af1affdd71cdd520daa. Sep 04 01:30:58.574366 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:30:58.574366 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3552/7081] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:30:58 2022] POST /identity/v3/users => generated 112 bytes in 477 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:30:58.574366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123777b-fbe6-45ed-b629-5c2466fc1b87 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:58.578059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2123777b-fbe6-45ed-b629-5c2466fc1b87 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:58.606074 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123777b-fbe6-45ed-b629-5c2466fc1b87 tempest-UsersNegativeTest-476313246 tempest-UsersNegativeTest-476313246-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:58.635019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f648d5d-849d-4b7b-8fc1-a7d9a2e52ba6 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:58.640925 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb47e95-d588-490c-8a50-d282ad5f92d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:58.642659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb47e95-d588-490c-8a50-d282ad5f92d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:58.643116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb47e95-d588-490c-8a50-d282ad5f92d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:58.643568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb47e95-d588-490c-8a50-d282ad5f92d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:58.644464 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb47e95-d588-490c-8a50-d282ad5f92d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:58.646729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb47e95-d588-490c-8a50-d282ad5f92d3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:58.685360 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3530/7082] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:30:58 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:58.690668 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb47e95-d588-490c-8a50-d282ad5f92d3 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:58.717894 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb47e95-d588-490c-8a50-d282ad5f92d3 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:58.730066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8774bb6-5a92-45dc-b049-605a520b4ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:58.730927 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8774bb6-5a92-45dc-b049-605a520b4ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:58.731134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8774bb6-5a92-45dc-b049-605a520b4ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:58.731434 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8774bb6-5a92-45dc-b049-605a520b4ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:58.734651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8774bb6-5a92-45dc-b049-605a520b4ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:58.741816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8774bb6-5a92-45dc-b049-605a520b4ea0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:58.770826 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa117957-8eb3-4f34-a7ca-9c6afca21080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:58.777874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa117957-8eb3-4f34-a7ca-9c6afca21080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:58.778296 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa117957-8eb3-4f34-a7ca-9c6afca21080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:58.778479 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa117957-8eb3-4f34-a7ca-9c6afca21080 admin admin] PATH_INFO: `/v3/users/59b929785d8e447c8a4d3db8f06fdd23` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:58.779482 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3531/7083] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:58.780671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8774bb6-5a92-45dc-b049-605a520b4ea0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:58.782669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa117957-8eb3-4f34-a7ca-9c6afca21080 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59b929785d8e447c8a4d3db8f06fdd23)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:58.789190 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa117957-8eb3-4f34-a7ca-9c6afca21080 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:58.803275 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8774bb6-5a92-45dc-b049-605a520b4ea0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:58.819820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f684f-9783-4662-b511-e5a8a5c471f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:58.820441 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f684f-9783-4662-b511-e5a8a5c471f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:58.823777 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f684f-9783-4662-b511-e5a8a5c471f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:58.824082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f684f-9783-4662-b511-e5a8a5c471f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:58.825043 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f684f-9783-4662-b511-e5a8a5c471f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:58.831120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f684f-9783-4662-b511-e5a8a5c471f5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:58.873543 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3532/7084] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:30:58.877301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f684f-9783-4662-b511-e5a8a5c471f5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:58.902137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f684f-9783-4662-b511-e5a8a5c471f5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:58.910770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-aa117957-8eb3-4f34-a7ca-9c6afca21080 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59b929785d8e447c8a4d3db8f06fdd23'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:58.912528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-aa117957-8eb3-4f34-a7ca-9c6afca21080 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59b929785d8e447c8a4d3db8f06fdd23'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:58.914708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3613098a-ac9b-4902-bf97-100fe34b45a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:58.915504 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613098a-ac9b-4902-bf97-100fe34b45a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:58.915784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613098a-ac9b-4902-bf97-100fe34b45a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:58.916113 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613098a-ac9b-4902-bf97-100fe34b45a7 admin admin] PATH_INFO: `/v3/projects/412f6ecdb3114b01881850717de700bb/users/3153fef46b654b4d9d4f6876b51b602a/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:58.935359 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-aa117957-8eb3-4f34-a7ca-9c6afca21080 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59b929785d8e447c8a4d3db8f06fdd23'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:58.949371 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-aa117957-8eb3-4f34-a7ca-9c6afca21080 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59b929785d8e447c8a4d3db8f06fdd23'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:58.950103 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-aa117957-8eb3-4f34-a7ca-9c6afca21080 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59b929785d8e447c8a4d3db8f06fdd23'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:58.951578 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:58.956009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3613098a-ac9b-4902-bf97-100fe34b45a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=412f6ecdb3114b01881850717de700bb, user_id=3153fef46b654b4d9d4f6876b51b602a, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:58.973259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3613098a-ac9b-4902-bf97-100fe34b45a7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:59.006615 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3553/7085] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:58 2022] DELETE /identity/v3/users/59b929785d8e447c8a4d3db8f06fdd23 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:30:59.010083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa117957-8eb3-4f34-a7ca-9c6afca21080 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:59.021446 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3533/7086] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:30:58 2022] PUT /identity/v3/projects/412f6ecdb3114b01881850717de700bb/users/3153fef46b654b4d9d4f6876b51b602a/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:59.022953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-aa117957-8eb3-4f34-a7ca-9c6afca21080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:59.025288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43f754-3130-4bb3-ab60-d98f3c64cc26 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:59.025605 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43f754-3130-4bb3-ab60-d98f3c64cc26 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:59.025936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43f754-3130-4bb3-ab60-d98f3c64cc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:59.067409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-0b43f754-3130-4bb3-ab60-d98f3c64cc26 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:59.073946 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0b43f754-3130-4bb3-ab60-d98f3c64cc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:59.154501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa117957-8eb3-4f34-a7ca-9c6afca21080 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:59.161003 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460e348-1ed1-428b-9edc-92896580cdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:59.161918 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460e348-1ed1-428b-9edc-92896580cdb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:59.162254 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460e348-1ed1-428b-9edc-92896580cdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:59.165987 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:59.183907 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460e348-1ed1-428b-9edc-92896580cdb1 admin admin] PATH_INFO: `/v3/projects/4f57aead0af847e98b83d30ffcc3d59b` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:59.191920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460e348-1ed1-428b-9edc-92896580cdb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f57aead0af847e98b83d30ffcc3d59b)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:59.207397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460e348-1ed1-428b-9edc-92896580cdb1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:59.228158 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3534/7087] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:59.228158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986feb5-46dd-4307-b9f8-147c2640df85 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:59.228158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986feb5-46dd-4307-b9f8-147c2640df85 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:59.228158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986feb5-46dd-4307-b9f8-147c2640df85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:59.306412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-9986feb5-46dd-4307-b9f8-147c2640df85 None None] MFA Rules not processed for user `3153fef46b654b4d9d4f6876b51b602a`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:59.314703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9986feb5-46dd-4307-b9f8-147c2640df85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:59.360044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f460e348-1ed1-428b-9edc-92896580cdb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f57aead0af847e98b83d30ffcc3d59b', 'request_id': 'req-f460e348-1ed1-428b-9edc-92896580cdb1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:59.377419 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f460e348-1ed1-428b-9edc-92896580cdb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f57aead0af847e98b83d30ffcc3d59b', 'request_id': 'req-f460e348-1ed1-428b-9edc-92896580cdb1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:59.392542 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f460e348-1ed1-428b-9edc-92896580cdb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f57aead0af847e98b83d30ffcc3d59b', 'request_id': 'req-f460e348-1ed1-428b-9edc-92896580cdb1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:59.422168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f460e348-1ed1-428b-9edc-92896580cdb1 admin admin] The token cache is being invalidate because project 4f57aead0af847e98b83d30ffcc3d59b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:30:59.423064 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f460e348-1ed1-428b-9edc-92896580cdb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:59.430577 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f460e348-1ed1-428b-9edc-92896580cdb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:59.432569 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3554/7088] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:30:59 2022] DELETE /identity/v3/projects/4f57aead0af847e98b83d30ffcc3d59b => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:59.433186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460e348-1ed1-428b-9edc-92896580cdb1 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:59.445489 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f460e348-1ed1-428b-9edc-92896580cdb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:59.504571 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3535/7089] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:59.505580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986feb5-46dd-4307-b9f8-147c2640df85 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:59.507797 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9986feb5-46dd-4307-b9f8-147c2640df85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:59.598769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460e348-1ed1-428b-9edc-92896580cdb1 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:59.599118 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986feb5-46dd-4307-b9f8-147c2640df85 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:59.604306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d94f00-8824-4dd2-9fbd-018dd2daae4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:59.605005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d94f00-8824-4dd2-9fbd-018dd2daae4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:59.605293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d94f00-8824-4dd2-9fbd-018dd2daae4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:59.605603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d94f00-8824-4dd2-9fbd-018dd2daae4a admin admin] PATH_INFO: `/v3/users/838ad8281d3c429cacad76aa9f2f31e5` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:59.606087 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5531c-6286-410e-bac8-d20cec7d2a99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:59.606778 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d94f00-8824-4dd2-9fbd-018dd2daae4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=838ad8281d3c429cacad76aa9f2f31e5)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:59.606908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5531c-6286-410e-bac8-d20cec7d2a99 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:59.607270 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5531c-6286-410e-bac8-d20cec7d2a99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:59.607608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5531c-6286-410e-bac8-d20cec7d2a99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:59.608777 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d94f00-8824-4dd2-9fbd-018dd2daae4a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:59.610628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ebe5531c-6286-410e-bac8-d20cec7d2a99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:59.633493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5531c-6286-410e-bac8-d20cec7d2a99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:59.635169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5531c-6286-410e-bac8-d20cec7d2a99 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:59.649550 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3555/7090] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:30:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:30:59.651005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae311b3-d829-4fa2-b7a2-3a36f9164727 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:59.651671 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae311b3-d829-4fa2-b7a2-3a36f9164727 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:59.652132 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae311b3-d829-4fa2-b7a2-3a36f9164727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:59.677531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-aae311b3-d829-4fa2-b7a2-3a36f9164727 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:59.678851 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-79d94f00-8824-4dd2-9fbd-018dd2daae4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '838ad8281d3c429cacad76aa9f2f31e5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:59.679269 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-aae311b3-d829-4fa2-b7a2-3a36f9164727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:59.679523 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-79d94f00-8824-4dd2-9fbd-018dd2daae4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '838ad8281d3c429cacad76aa9f2f31e5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:59.688532 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3556/7091] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:59.689772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae311b3-d829-4fa2-b7a2-3a36f9164727 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:59.698232 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-79d94f00-8824-4dd2-9fbd-018dd2daae4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '838ad8281d3c429cacad76aa9f2f31e5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:59.708347 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-aae311b3-d829-4fa2-b7a2-3a36f9164727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:59.709768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-79d94f00-8824-4dd2-9fbd-018dd2daae4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '838ad8281d3c429cacad76aa9f2f31e5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:59.710621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-79d94f00-8824-4dd2-9fbd-018dd2daae4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '838ad8281d3c429cacad76aa9f2f31e5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:30:59.744085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae311b3-d829-4fa2-b7a2-3a36f9164727 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:30:59.745393 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3536/7092] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:30:59 2022] DELETE /identity/v3/users/838ad8281d3c429cacad76aa9f2f31e5 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:30:59.747226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f271912-2d94-44b7-b0f5-7c6f8609946f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:59.747548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f271912-2d94-44b7-b0f5-7c6f8609946f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:59.748408 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f271912-2d94-44b7-b0f5-7c6f8609946f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:59.751626 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:59.788921 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-6f271912-2d94-44b7-b0f5-7c6f8609946f None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:59.790363 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6f271912-2d94-44b7-b0f5-7c6f8609946f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:30:59.796784 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:30:59.862225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc33835-3830-4d46-9bc5-8d4c5b945573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:30:59.862988 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc33835-3830-4d46-9bc5-8d4c5b945573 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:59.863340 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc33835-3830-4d46-9bc5-8d4c5b945573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:59.863619 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc33835-3830-4d46-9bc5-8d4c5b945573 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:59.864257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc33835-3830-4d46-9bc5-8d4c5b945573 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:30:59.866369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc33835-3830-4d46-9bc5-8d4c5b945573 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:30:59.905537 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3537/7093] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:30:59.913774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2c097-00f7-49e5-8194-afc7d3b845b3 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:30:59.914075 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2c097-00f7-49e5-8194-afc7d3b845b3 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:30:59.914340 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2c097-00f7-49e5-8194-afc7d3b845b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:30:59.938951 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3557/7094] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:30:59 2022] POST /identity/v3/projects => generated 389 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:30:59.939824 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc33835-3830-4d46-9bc5-8d4c5b945573 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:30:59.949842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-03e2c097-00f7-49e5-8194-afc7d3b845b3 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:30:59.953034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-03e2c097-00f7-49e5-8194-afc7d3b845b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:00.053559 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3538/7095] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:00.054834 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2c097-00f7-49e5-8194-afc7d3b845b3 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:00.066743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2c097-00f7-49e5-8194-afc7d3b845b3 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:00.072542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcca6b-877e-48a6-a81c-d2b8816a246e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:00.073232 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcca6b-877e-48a6-a81c-d2b8816a246e admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:00.073827 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcca6b-877e-48a6-a81c-d2b8816a246e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:00.074115 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcca6b-877e-48a6-a81c-d2b8816a246e admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:00.074880 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdcca6b-877e-48a6-a81c-d2b8816a246e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:00.077788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdcca6b-877e-48a6-a81c-d2b8816a246e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:00.080237 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc33835-3830-4d46-9bc5-8d4c5b945573 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:00.091038 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab9e16-3c54-4bb0-bb15-98b8987dba3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:00.091475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab9e16-3c54-4bb0-bb15-98b8987dba3f admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:00.091879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab9e16-3c54-4bb0-bb15-98b8987dba3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:00.092209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab9e16-3c54-4bb0-bb15-98b8987dba3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:00.093046 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab9e16-3c54-4bb0-bb15-98b8987dba3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:31:00.093386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab9e16-3c54-4bb0-bb15-98b8987dba3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:00.095869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab9e16-3c54-4bb0-bb15-98b8987dba3f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:00.105073 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3539/7096] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:31:00 2022] POST /identity/v3/users => generated 295 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:31:00.107398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcca6b-877e-48a6-a81c-d2b8816a246e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:00.110341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3cdcca6b-877e-48a6-a81c-d2b8816a246e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:00.111602 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3558/7097] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:31:00.112538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab9e16-3c54-4bb0-bb15-98b8987dba3f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:00.117489 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-09ab9e16-3c54-4bb0-bb15-98b8987dba3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:00.133474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab9e16-3c54-4bb0-bb15-98b8987dba3f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:00.139692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee359ab1-b5b2-4ae2-ad32-e39dff96c69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:00.140490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee359ab1-b5b2-4ae2-ad32-e39dff96c69f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:00.140778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee359ab1-b5b2-4ae2-ad32-e39dff96c69f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:00.141636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee359ab1-b5b2-4ae2-ad32-e39dff96c69f admin admin] PATH_INFO: `/v3/projects/af4a52a10110442b835c79430b970a7b` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:00.142842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee359ab1-b5b2-4ae2-ad32-e39dff96c69f admin admin] RBAC: Authorizing `identity:delete_project(project_id=af4a52a10110442b835c79430b970a7b)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:00.145094 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee359ab1-b5b2-4ae2-ad32-e39dff96c69f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:00.229758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ee359ab1-b5b2-4ae2-ad32-e39dff96c69f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af4a52a10110442b835c79430b970a7b', 'request_id': 'req-ee359ab1-b5b2-4ae2-ad32-e39dff96c69f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:00.231273 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcca6b-877e-48a6-a81c-d2b8816a246e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:00.243145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ee359ab1-b5b2-4ae2-ad32-e39dff96c69f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af4a52a10110442b835c79430b970a7b', 'request_id': 'req-ee359ab1-b5b2-4ae2-ad32-e39dff96c69f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:00.251973 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ee359ab1-b5b2-4ae2-ad32-e39dff96c69f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af4a52a10110442b835c79430b970a7b', 'request_id': 'req-ee359ab1-b5b2-4ae2-ad32-e39dff96c69f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:00.264403 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ee359ab1-b5b2-4ae2-ad32-e39dff96c69f admin admin] The token cache is being invalidate because project af4a52a10110442b835c79430b970a7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:31:00.264812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ee359ab1-b5b2-4ae2-ad32-e39dff96c69f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:00.265565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ee359ab1-b5b2-4ae2-ad32-e39dff96c69f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:00.268262 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3559/7098] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:31:00 2022] DELETE /identity/v3/projects/af4a52a10110442b835c79430b970a7b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:00.268788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee359ab1-b5b2-4ae2-ad32-e39dff96c69f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:00.270308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ee359ab1-b5b2-4ae2-ad32-e39dff96c69f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:00.284992 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:00.311815 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:00.321684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff46b9-75d2-4421-9473-0de015e959e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:00.322685 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff46b9-75d2-4421-9473-0de015e959e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:00.323250 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff46b9-75d2-4421-9473-0de015e959e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:00.325683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff46b9-75d2-4421-9473-0de015e959e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:00.329731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-fdff46b9-75d2-4421-9473-0de015e959e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:00.375979 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee359ab1-b5b2-4ae2-ad32-e39dff96c69f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:00.381664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030053d2-8ea5-4a2e-b0db-2037d6e6b003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:00.382478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030053d2-8ea5-4a2e-b0db-2037d6e6b003 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:00.382829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030053d2-8ea5-4a2e-b0db-2037d6e6b003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:00.383176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030053d2-8ea5-4a2e-b0db-2037d6e6b003 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:00.383935 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030053d2-8ea5-4a2e-b0db-2037d6e6b003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:00.385716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030053d2-8ea5-4a2e-b0db-2037d6e6b003 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:00.405928 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3560/7099] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:31:00.406529 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030053d2-8ea5-4a2e-b0db-2037d6e6b003 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:00.410377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-030053d2-8ea5-4a2e-b0db-2037d6e6b003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:00.420977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff46b9-75d2-4421-9473-0de015e959e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:00.423171 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff46b9-75d2-4421-9473-0de015e959e5 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:00.426191 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030053d2-8ea5-4a2e-b0db-2037d6e6b003 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:00.444450 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3540/7100] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:31:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:31:00.445519 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e0b22-89bd-4b24-87d8-a46cd7b4d6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:00.446245 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e0b22-89bd-4b24-87d8-a46cd7b4d6ea admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:00.446774 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e0b22-89bd-4b24-87d8-a46cd7b4d6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:00.447135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e0b22-89bd-4b24-87d8-a46cd7b4d6ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:00.447593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff46b9-75d2-4421-9473-0de015e959e5 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:00.447908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e0b22-89bd-4b24-87d8-a46cd7b4d6ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:00.450267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e0b22-89bd-4b24-87d8-a46cd7b4d6ea admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:00.451134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-fdff46b9-75d2-4421-9473-0de015e959e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:00.486138 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff46b9-75d2-4421-9473-0de015e959e5 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:00.498494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1cf3a-fdec-4199-a083-fa5c2233a6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:00.500191 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1cf3a-fdec-4199-a083-fa5c2233a6bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:00.500966 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1cf3a-fdec-4199-a083-fa5c2233a6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:00.501464 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3561/7101] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:31:00 2022] POST /identity/v3/projects => generated 357 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:31:00.502162 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1cf3a-fdec-4199-a083-fa5c2233a6bd admin admin] PATH_INFO: `/v3/users/fded86f8c22b47c2a144d7c51d718df8` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:00.502596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e0b22-89bd-4b24-87d8-a46cd7b4d6ea admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:00.505901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a1cf3a-fdec-4199-a083-fa5c2233a6bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=fded86f8c22b47c2a144d7c51d718df8)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:00.510621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a1cf3a-fdec-4199-a083-fa5c2233a6bd admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:00.634659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-58a1cf3a-fdec-4199-a083-fa5c2233a6bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fded86f8c22b47c2a144d7c51d718df8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:00.636590 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-58a1cf3a-fdec-4199-a083-fa5c2233a6bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fded86f8c22b47c2a144d7c51d718df8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:00.642526 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e0b22-89bd-4b24-87d8-a46cd7b4d6ea admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:00.648056 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82757e35-c1f8-4c83-b3cd-f69bb31c25d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:00.648746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82757e35-c1f8-4c83-b3cd-f69bb31c25d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:00.649111 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82757e35-c1f8-4c83-b3cd-f69bb31c25d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:00.649473 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82757e35-c1f8-4c83-b3cd-f69bb31c25d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:00.650366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82757e35-c1f8-4c83-b3cd-f69bb31c25d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:00.652677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82757e35-c1f8-4c83-b3cd-f69bb31c25d7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:00.666476 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3562/7102] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:31:00.668169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82757e35-c1f8-4c83-b3cd-f69bb31c25d7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:00.669277 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-58a1cf3a-fdec-4199-a083-fa5c2233a6bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fded86f8c22b47c2a144d7c51d718df8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:00.671202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-82757e35-c1f8-4c83-b3cd-f69bb31c25d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:00.693019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-58a1cf3a-fdec-4199-a083-fa5c2233a6bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fded86f8c22b47c2a144d7c51d718df8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:00.694632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-58a1cf3a-fdec-4199-a083-fa5c2233a6bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fded86f8c22b47c2a144d7c51d718df8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:00.730897 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82757e35-c1f8-4c83-b3cd-f69bb31c25d7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:00.742738 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3541/7103] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:31:00 2022] DELETE /identity/v3/users/fded86f8c22b47c2a144d7c51d718df8 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:00.743817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1cf3a-fdec-4199-a083-fa5c2233a6bd admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:00.745592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f86f7-b243-49b4-a4a2-7c3d69cda135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:00.747032 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f86f7-b243-49b4-a4a2-7c3d69cda135 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:00.747157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-58a1cf3a-fdec-4199-a083-fa5c2233a6bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:00.747530 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f86f7-b243-49b4-a4a2-7c3d69cda135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:00.748025 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f86f7-b243-49b4-a4a2-7c3d69cda135 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:00.749201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f86f7-b243-49b4-a4a2-7c3d69cda135 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:00.752985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f86f7-b243-49b4-a4a2-7c3d69cda135 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:00.806803 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3563/7104] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:31:00 2022] POST /identity/v3/users => generated 279 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:31:00.808660 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f86f7-b243-49b4-a4a2-7c3d69cda135 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:00.832424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f86f7-b243-49b4-a4a2-7c3d69cda135 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:00.838360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1cf3a-fdec-4199-a083-fa5c2233a6bd admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:00.841904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ace2a9-8846-41fb-94c7-9de84baf5165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:00.843142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ace2a9-8846-41fb-94c7-9de84baf5165 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:00.843334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730fea2-bd83-48cf-a608-d64716332a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:00.843624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ace2a9-8846-41fb-94c7-9de84baf5165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:00.844142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ace2a9-8846-41fb-94c7-9de84baf5165 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:00.844325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730fea2-bd83-48cf-a608-d64716332a3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:00.844494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730fea2-bd83-48cf-a608-d64716332a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:00.844950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730fea2-bd83-48cf-a608-d64716332a3a admin admin] PATH_INFO: `/v3/projects/c6825500b19e4e5d9f053ec1a2f312b6/users/afd5b6b9f15b4b34ac2db948b0d8c9c8/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:00.845616 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ace2a9-8846-41fb-94c7-9de84baf5165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:00.849129 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ace2a9-8846-41fb-94c7-9de84baf5165 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:00.861735 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730fea2-bd83-48cf-a608-d64716332a3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6825500b19e4e5d9f053ec1a2f312b6, user_id=afd5b6b9f15b4b34ac2db948b0d8c9c8, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:00.871576 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730fea2-bd83-48cf-a608-d64716332a3a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:00.874237 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:00.880773 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3564/7105] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:31:00.887343 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ace2a9-8846-41fb-94c7-9de84baf5165 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:00.910863 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3542/7106] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:31:00 2022] PUT /identity/v3/projects/c6825500b19e4e5d9f053ec1a2f312b6/users/afd5b6b9f15b4b34ac2db948b0d8c9c8/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:00.920860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f69b83-f810-4b28-a961-c0863d919eb6 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:00.921097 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f69b83-f810-4b28-a961-c0863d919eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:00.921478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f69b83-f810-4b28-a961-c0863d919eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:00.923505 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ace2a9-8846-41fb-94c7-9de84baf5165 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:00.956729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a7f69b83-f810-4b28-a961-c0863d919eb6 None None] MFA Rules not processed for user `afd5b6b9f15b4b34ac2db948b0d8c9c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:00.959186 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a7f69b83-f810-4b28-a961-c0863d919eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:01.001157 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:01.019115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a5877-636d-47e0-8396-ac0700ca3781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:01.019905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a5877-636d-47e0-8396-ac0700ca3781 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:01.020188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a5877-636d-47e0-8396-ac0700ca3781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:01.020595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a5877-636d-47e0-8396-ac0700ca3781 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:01.021660 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9a5877-636d-47e0-8396-ac0700ca3781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:01.024178 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9a5877-636d-47e0-8396-ac0700ca3781 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:01.049824 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3543/7107] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:31:01.050579 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f69b83-f810-4b28-a961-c0863d919eb6 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:01.055960 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3565/7108] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:31:01.060210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a5877-636d-47e0-8396-ac0700ca3781 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:01.067850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f69b83-f810-4b28-a961-c0863d919eb6 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:01.072748 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a5877-636d-47e0-8396-ac0700ca3781 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:01.075557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0336cb-9946-4d91-b5d1-84988a89d126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:01.076354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0336cb-9946-4d91-b5d1-84988a89d126 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:01.076832 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0336cb-9946-4d91-b5d1-84988a89d126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:01.077171 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0336cb-9946-4d91-b5d1-84988a89d126 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:01.078002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0336cb-9946-4d91-b5d1-84988a89d126 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:01.080713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0336cb-9946-4d91-b5d1-84988a89d126 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:01.081851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f858a5-d7d4-4cf9-9346-bac7f80b957b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:01.082691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f858a5-d7d4-4cf9-9346-bac7f80b957b admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:01.083077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f858a5-d7d4-4cf9-9346-bac7f80b957b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:01.083456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f858a5-d7d4-4cf9-9346-bac7f80b957b admin admin] PATH_INFO: `/v3/projects/b4b8f99f950c4dd0a80a22a222b19381/users/588275c3f8a94d868f3b4296f1b3892e/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:01.100863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f858a5-d7d4-4cf9-9346-bac7f80b957b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4b8f99f950c4dd0a80a22a222b19381, user_id=588275c3f8a94d868f3b4296f1b3892e, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:01.103847 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f858a5-d7d4-4cf9-9346-bac7f80b957b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:01.121741 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3544/7109] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:31:01 2022] POST /identity/v3/projects => generated 389 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:31:01.125074 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0336cb-9946-4d91-b5d1-84988a89d126 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:01.129514 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3566/7110] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:31:01 2022] PUT /identity/v3/projects/b4b8f99f950c4dd0a80a22a222b19381/users/588275c3f8a94d868f3b4296f1b3892e/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:01.134084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a4c0c-e198-4a31-bdfa-77dbb019dc9b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:01.135110 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a4c0c-e198-4a31-bdfa-77dbb019dc9b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:01.135766 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a4c0c-e198-4a31-bdfa-77dbb019dc9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:01.171920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-090a4c0c-e198-4a31-bdfa-77dbb019dc9b None None] MFA Rules not processed for user `588275c3f8a94d868f3b4296f1b3892e`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:01.173329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-090a4c0c-e198-4a31-bdfa-77dbb019dc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:01.209352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0336cb-9946-4d91-b5d1-84988a89d126 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:01.216009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6242630-6ee1-4e7f-8df8-f35fdfb2507c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:01.216427 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6242630-6ee1-4e7f-8df8-f35fdfb2507c admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:01.216855 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6242630-6ee1-4e7f-8df8-f35fdfb2507c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:01.217139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6242630-6ee1-4e7f-8df8-f35fdfb2507c admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:01.218175 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6242630-6ee1-4e7f-8df8-f35fdfb2507c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:01.221207 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6242630-6ee1-4e7f-8df8-f35fdfb2507c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:01.254254 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3545/7111] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:31:01 2022] POST /identity/v3/users => generated 301 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:31:01.255178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6242630-6ee1-4e7f-8df8-f35fdfb2507c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:01.257251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f6242630-6ee1-4e7f-8df8-f35fdfb2507c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:01.276224 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6242630-6ee1-4e7f-8df8-f35fdfb2507c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:01.282075 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5a3c9-7407-4a05-92b1-1f9871f9f875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:01.282750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5a3c9-7407-4a05-92b1-1f9871f9f875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:01.283027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5a3c9-7407-4a05-92b1-1f9871f9f875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:01.283297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5a3c9-7407-4a05-92b1-1f9871f9f875 admin admin] PATH_INFO: `/v3/projects/f64538d201454f2dbb9cbfe06fbbe834` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:01.284427 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed5a3c9-7407-4a05-92b1-1f9871f9f875 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f64538d201454f2dbb9cbfe06fbbe834)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:01.286389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed5a3c9-7407-4a05-92b1-1f9871f9f875 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:01.313992 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3567/7112] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:01 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:01.313992 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a4c0c-e198-4a31-bdfa-77dbb019dc9b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:01.328148 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a4c0c-e198-4a31-bdfa-77dbb019dc9b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:01.340435 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:INSERT=5,keystone:SELECT=92,keystone:DELETE=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:01.345825 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4ed5a3c9-7407-4a05-92b1-1f9871f9f875 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f64538d201454f2dbb9cbfe06fbbe834', 'request_id': 'req-4ed5a3c9-7407-4a05-92b1-1f9871f9f875'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:01.355972 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4ed5a3c9-7407-4a05-92b1-1f9871f9f875 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f64538d201454f2dbb9cbfe06fbbe834', 'request_id': 'req-4ed5a3c9-7407-4a05-92b1-1f9871f9f875'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:01.364507 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4ed5a3c9-7407-4a05-92b1-1f9871f9f875 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f64538d201454f2dbb9cbfe06fbbe834', 'request_id': 'req-4ed5a3c9-7407-4a05-92b1-1f9871f9f875'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:01.379128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4ed5a3c9-7407-4a05-92b1-1f9871f9f875 admin admin] The token cache is being invalidate because project f64538d201454f2dbb9cbfe06fbbe834 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:31:01.379483 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4ed5a3c9-7407-4a05-92b1-1f9871f9f875 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:01.380637 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4ed5a3c9-7407-4a05-92b1-1f9871f9f875 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:01.383163 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3546/7113] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:31:01 2022] DELETE /identity/v3/projects/f64538d201454f2dbb9cbfe06fbbe834 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:01.384874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83604e-a993-4058-ad7e-9ce581c965e3 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:01.385737 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83604e-a993-4058-ad7e-9ce581c965e3 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:01.385737 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83604e-a993-4058-ad7e-9ce581c965e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:01.405742 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd0f19-c2eb-498a-88a7-3badd55d04cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:01.407399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd0f19-c2eb-498a-88a7-3badd55d04cf admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:01.407783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd0f19-c2eb-498a-88a7-3badd55d04cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:01.407971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd0f19-c2eb-498a-88a7-3badd55d04cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:01.408726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd0f19-c2eb-498a-88a7-3badd55d04cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:01.410479 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd0f19-c2eb-498a-88a7-3badd55d04cf admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:01.411943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-bf83604e-a993-4058-ad7e-9ce581c965e3 None None] MFA Rules not processed for user `588275c3f8a94d868f3b4296f1b3892e`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:01.418725 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bf83604e-a993-4058-ad7e-9ce581c965e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:01.422624 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3547/7114] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:01 2022] POST /identity/v3/auth/tokens => generated 344 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 01:31:01.424800 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3568/7115] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:31:01.430084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa962f-467a-48fe-ae0a-917492e9e1b9 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:01.430372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa962f-467a-48fe-ae0a-917492e9e1b9 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:01.430644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa962f-467a-48fe-ae0a-917492e9e1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:01.436367 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf83604e-a993-4058-ad7e-9ce581c965e3 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:01.438484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bf83604e-a993-4058-ad7e-9ce581c965e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:01.459802 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf83604e-a993-4058-ad7e-9ce581c965e3 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:01.472761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cbbba-b5a8-45c6-bfa8-3640f0770e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:01.474024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cbbba-b5a8-45c6-bfa8-3640f0770e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:01.474436 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cbbba-b5a8-45c6-bfa8-3640f0770e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:01.474785 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cbbba-b5a8-45c6-bfa8-3640f0770e7c admin admin] PATH_INFO: `/v3/users/f1533c193bc64e75a2fc75bb99d9a271` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:01.476742 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484cbbba-b5a8-45c6-bfa8-3640f0770e7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1533c193bc64e75a2fc75bb99d9a271)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:01.479076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484cbbba-b5a8-45c6-bfa8-3640f0770e7c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:01.481405 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-2faa962f-467a-48fe-ae0a-917492e9e1b9 None None] MFA Rules not processed for user `588275c3f8a94d868f3b4296f1b3892e`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:01.482722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2faa962f-467a-48fe-ae0a-917492e9e1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:01.490122 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3569/7116] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:01 2022] POST /identity/v3/auth/tokens => generated 344 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 01:31:01.490122 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa962f-467a-48fe-ae0a-917492e9e1b9 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:01.490122 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2faa962f-467a-48fe-ae0a-917492e9e1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:01.510164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa962f-467a-48fe-ae0a-917492e9e1b9 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:01.518641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62d90f-47af-4700-b4d1-1a517c83ece4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:01.519304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62d90f-47af-4700-b4d1-1a517c83ece4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:01.519583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62d90f-47af-4700-b4d1-1a517c83ece4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:01.519855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62d90f-47af-4700-b4d1-1a517c83ece4 admin admin] PATH_INFO: `/v3/projects/893f44e89d5d4fba9d56bb91584266a1/users/5fe1649ed55541508bbcfc1c206144d3/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:01.542151 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d62d90f-47af-4700-b4d1-1a517c83ece4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=893f44e89d5d4fba9d56bb91584266a1, user_id=5fe1649ed55541508bbcfc1c206144d3, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:01.544847 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d62d90f-47af-4700-b4d1-1a517c83ece4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:01.545467 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-484cbbba-b5a8-45c6-bfa8-3640f0770e7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1533c193bc64e75a2fc75bb99d9a271'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:01.546360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-484cbbba-b5a8-45c6-bfa8-3640f0770e7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1533c193bc64e75a2fc75bb99d9a271'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:01.556387 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-484cbbba-b5a8-45c6-bfa8-3640f0770e7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1533c193bc64e75a2fc75bb99d9a271'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:01.560443 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3570/7117] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:31:01 2022] PUT /identity/v3/projects/893f44e89d5d4fba9d56bb91584266a1/users/5fe1649ed55541508bbcfc1c206144d3/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:01.561423 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62d90f-47af-4700-b4d1-1a517c83ece4 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:01.563017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4d62d90f-47af-4700-b4d1-1a517c83ece4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:01.568977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-484cbbba-b5a8-45c6-bfa8-3640f0770e7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1533c193bc64e75a2fc75bb99d9a271'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:01.569697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-484cbbba-b5a8-45c6-bfa8-3640f0770e7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1533c193bc64e75a2fc75bb99d9a271'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:01.587739 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:01.598336 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3548/7118] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:31:01 2022] DELETE /identity/v3/users/f1533c193bc64e75a2fc75bb99d9a271 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:01.602682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cbbba-b5a8-45c6-bfa8-3640f0770e7c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:01.604125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-484cbbba-b5a8-45c6-bfa8-3640f0770e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:01.657507 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62d90f-47af-4700-b4d1-1a517c83ece4 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:01.684835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cbbba-b5a8-45c6-bfa8-3640f0770e7c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:01.690203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a2272-63bb-49d4-9586-9d4c2b3df67e tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '588275c3f8a94d868f3b4296f1b3892e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4b8f99f950c4dd0a80a22a222b19381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:01.691350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a2272-63bb-49d4-9586-9d4c2b3df67e tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] REQUEST_METHOD: `HEAD` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:01.692479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a2272-63bb-49d4-9586-9d4c2b3df67e tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:01.692479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a2272-63bb-49d4-9586-9d4c2b3df67e tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:01.694382 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c31a2272-63bb-49d4-9586-9d4c2b3df67e tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:01.705544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a2272-63bb-49d4-9586-9d4c2b3df67e tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] RBAC: Authorizing `identity:check_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:01.707571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a2272-63bb-49d4-9586-9d4c2b3df67e tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:01.714553 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3549/7119] 10.222.0.30 () {56 vars in 1264 bytes} [Sun Sep 4 01:31:01 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Sep 04 01:31:01.715301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a2272-63bb-49d4-9586-9d4c2b3df67e tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:01.716572 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c31a2272-63bb-49d4-9586-9d4c2b3df67e tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:01.730879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25a0c1-deb1-49f6-be14-46794ac40a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:01.731562 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25a0c1-deb1-49f6-be14-46794ac40a31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:01.731992 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25a0c1-deb1-49f6-be14-46794ac40a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:01.732119 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25a0c1-deb1-49f6-be14-46794ac40a31 admin admin] PATH_INFO: `/v3/projects/11b7f778bfc74f3badf26985a25fc2b9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:01.734170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25a0c1-deb1-49f6-be14-46794ac40a31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11b7f778bfc74f3badf26985a25fc2b9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:01.736218 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25a0c1-deb1-49f6-be14-46794ac40a31 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:01.769543 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:01.800335 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9c25a0c1-deb1-49f6-be14-46794ac40a31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11b7f778bfc74f3badf26985a25fc2b9', 'request_id': 'req-9c25a0c1-deb1-49f6-be14-46794ac40a31'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:01.802004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a2272-63bb-49d4-9586-9d4c2b3df67e tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:01.810351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9c25a0c1-deb1-49f6-be14-46794ac40a31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11b7f778bfc74f3badf26985a25fc2b9', 'request_id': 'req-9c25a0c1-deb1-49f6-be14-46794ac40a31'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:01.820033 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9c25a0c1-deb1-49f6-be14-46794ac40a31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11b7f778bfc74f3badf26985a25fc2b9', 'request_id': 'req-9c25a0c1-deb1-49f6-be14-46794ac40a31'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:01.834261 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9c25a0c1-deb1-49f6-be14-46794ac40a31 admin admin] The token cache is being invalidate because project 11b7f778bfc74f3badf26985a25fc2b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:31:01.834565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9c25a0c1-deb1-49f6-be14-46794ac40a31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:01.835363 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9c25a0c1-deb1-49f6-be14-46794ac40a31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:01.838146 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3571/7120] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:31:01 2022] DELETE /identity/v3/projects/11b7f778bfc74f3badf26985a25fc2b9 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:01.838768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25a0c1-deb1-49f6-be14-46794ac40a31 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:01.840146 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9c25a0c1-deb1-49f6-be14-46794ac40a31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:01.880453 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7921c82-51c1-44ad-97d8-c706bb7dc9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:01.880981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7921c82-51c1-44ad-97d8-c706bb7dc9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:01.881265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7921c82-51c1-44ad-97d8-c706bb7dc9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:01.883034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7921c82-51c1-44ad-97d8-c706bb7dc9d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:01.883034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7921c82-51c1-44ad-97d8-c706bb7dc9d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:01.883812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7921c82-51c1-44ad-97d8-c706bb7dc9d4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:01.912301 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3550/7121] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:31:01.913664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951c35e-e6f2-4dfc-a949-fe27429bb962 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:01.914693 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951c35e-e6f2-4dfc-a949-fe27429bb962 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:01.914981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951c35e-e6f2-4dfc-a949-fe27429bb962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:01.942840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25a0c1-deb1-49f6-be14-46794ac40a31 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:01.944727 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-8951c35e-e6f2-4dfc-a949-fe27429bb962 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:01.946391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8951c35e-e6f2-4dfc-a949-fe27429bb962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:01.952900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26473c41-9610-4721-9890-6f848e05503c tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '588275c3f8a94d868f3b4296f1b3892e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4b8f99f950c4dd0a80a22a222b19381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:01.954303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26473c41-9610-4721-9890-6f848e05503c tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:01.954588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26473c41-9610-4721-9890-6f848e05503c tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:01.954865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26473c41-9610-4721-9890-6f848e05503c tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:01.965612 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3551/7122] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:01.965841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-26473c41-9610-4721-9890-6f848e05503c tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:01.965937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951c35e-e6f2-4dfc-a949-fe27429bb962 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:01.965937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8951c35e-e6f2-4dfc-a949-fe27429bb962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:01.968099 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:01.974888 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26473c41-9610-4721-9890-6f848e05503c tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:01.976679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26473c41-9610-4721-9890-6f848e05503c tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:01.980174 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951c35e-e6f2-4dfc-a949-fe27429bb962 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:01.992390 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3572/7123] 10.222.0.30 () {56 vars in 1263 bytes} [Sun Sep 4 01:31:01 2022] GET /identity/v3/auth/tokens => generated 344 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 04 01:31:01.994334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff31301-c6db-4bc6-aaa0-12dc6eefedd8 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:01.994474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3a6be-d13b-46f3-a77f-31fc69aba8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:01.994812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff31301-c6db-4bc6-aaa0-12dc6eefedd8 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:01.995030 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff31301-c6db-4bc6-aaa0-12dc6eefedd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:01.995385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3a6be-d13b-46f3-a77f-31fc69aba8fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:01.995871 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3a6be-d13b-46f3-a77f-31fc69aba8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:01.996350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3a6be-d13b-46f3-a77f-31fc69aba8fa admin admin] PATH_INFO: `/v3/projects/893f44e89d5d4fba9d56bb91584266a1/users/5fe1649ed55541508bbcfc1c206144d3/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:01.998871 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3a6be-d13b-46f3-a77f-31fc69aba8fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=893f44e89d5d4fba9d56bb91584266a1, user_id=5fe1649ed55541508bbcfc1c206144d3, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:02.003182 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3a6be-d13b-46f3-a77f-31fc69aba8fa admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:02.016666 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3552/7124] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:31:01 2022] PUT /identity/v3/projects/893f44e89d5d4fba9d56bb91584266a1/users/5fe1649ed55541508bbcfc1c206144d3/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:02.020848 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-3ff31301-c6db-4bc6-aaa0-12dc6eefedd8 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:02.022240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3ff31301-c6db-4bc6-aaa0-12dc6eefedd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:02.026860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3a6be-d13b-46f3-a77f-31fc69aba8fa admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:02.099086 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3a6be-d13b-46f3-a77f-31fc69aba8fa admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:02.109423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28cfc51-ca61-40eb-8864-d6576b910296 tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '588275c3f8a94d868f3b4296f1b3892e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4b8f99f950c4dd0a80a22a222b19381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:02.110897 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cfc51-ca61-40eb-8864-d6576b910296 tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:02.111282 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3573/7125] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:02.111793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cfc51-ca61-40eb-8864-d6576b910296 tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:02.112103 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cfc51-ca61-40eb-8864-d6576b910296 tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:02.114508 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5be742-b472-473f-ba4a-04313d944e22 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:02.114508 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5be742-b472-473f-ba4a-04313d944e22 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:02.114508 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5be742-b472-473f-ba4a-04313d944e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:02.120405 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28cfc51-ca61-40eb-8864-d6576b910296 tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:02.122761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28cfc51-ca61-40eb-8864-d6576b910296 tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:02.146054 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3553/7126] 10.222.0.30 () {56 vars in 1266 bytes} [Sun Sep 4 01:31:02 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:02.147076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28cfc51-ca61-40eb-8864-d6576b910296 tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:02.163946 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-0e5be742-b472-473f-ba4a-04313d944e22 None None] MFA Rules not processed for user `5fe1649ed55541508bbcfc1c206144d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:02.165502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28cfc51-ca61-40eb-8864-d6576b910296 tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:02.175276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0e5be742-b472-473f-ba4a-04313d944e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:02.178579 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c4790-9a2d-4217-b0ed-59547a1faff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:02.179382 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c4790-9a2d-4217-b0ed-59547a1faff9 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:02.179771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c4790-9a2d-4217-b0ed-59547a1faff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:02.180549 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c4790-9a2d-4217-b0ed-59547a1faff9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:02.181085 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c4790-9a2d-4217-b0ed-59547a1faff9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:31:02.181397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c4790-9a2d-4217-b0ed-59547a1faff9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:02.183058 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c4790-9a2d-4217-b0ed-59547a1faff9 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:02.196409 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3554/7127] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:31:02.201122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c4790-9a2d-4217-b0ed-59547a1faff9 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:02.204157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b50c4790-9a2d-4217-b0ed-59547a1faff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:02.223311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c4790-9a2d-4217-b0ed-59547a1faff9 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:02.229797 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5a30a-5918-4867-86b2-a0431622d9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:02.230580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5a30a-5918-4867-86b2-a0431622d9a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:02.231008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5a30a-5918-4867-86b2-a0431622d9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:02.231290 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5a30a-5918-4867-86b2-a0431622d9a8 admin admin] PATH_INFO: `/v3/projects/16443fc235c64819beb07372242d40a8` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:02.232483 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c5a30a-5918-4867-86b2-a0431622d9a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16443fc235c64819beb07372242d40a8)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:02.234836 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c5a30a-5918-4867-86b2-a0431622d9a8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:02.282623 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:02.282799 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3574/7128] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:02 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:02.284307 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5be742-b472-473f-ba4a-04313d944e22 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:02.301121 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5be742-b472-473f-ba4a-04313d944e22 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:02.302695 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d3c5a30a-5918-4867-86b2-a0431622d9a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16443fc235c64819beb07372242d40a8', 'request_id': 'req-d3c5a30a-5918-4867-86b2-a0431622d9a8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:02.312126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d3c5a30a-5918-4867-86b2-a0431622d9a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16443fc235c64819beb07372242d40a8', 'request_id': 'req-d3c5a30a-5918-4867-86b2-a0431622d9a8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:02.320307 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d3c5a30a-5918-4867-86b2-a0431622d9a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16443fc235c64819beb07372242d40a8', 'request_id': 'req-d3c5a30a-5918-4867-86b2-a0431622d9a8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:02.336619 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d3c5a30a-5918-4867-86b2-a0431622d9a8 admin admin] The token cache is being invalidate because project 16443fc235c64819beb07372242d40a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:31:02.336942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d3c5a30a-5918-4867-86b2-a0431622d9a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:02.337637 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d3c5a30a-5918-4867-86b2-a0431622d9a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:02.339180 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3555/7129] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:31:02 2022] DELETE /identity/v3/projects/16443fc235c64819beb07372242d40a8 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:02.340120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5a30a-5918-4867-86b2-a0431622d9a8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:02.341357 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d3c5a30a-5918-4867-86b2-a0431622d9a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:02.366899 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a0e50-9270-40ff-85fa-2f3e0504f532 tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '588275c3f8a94d868f3b4296f1b3892e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4b8f99f950c4dd0a80a22a222b19381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:02.367685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a0e50-9270-40ff-85fa-2f3e0504f532 tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] REQUEST_METHOD: `HEAD` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:02.368202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a0e50-9270-40ff-85fa-2f3e0504f532 tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:02.368603 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a0e50-9270-40ff-85fa-2f3e0504f532 tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:02.370848 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c86a0e50-9270-40ff-85fa-2f3e0504f532 tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:02.409606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5a30a-5918-4867-86b2-a0431622d9a8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:02.413837 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-c86a0e50-9270-40ff-85fa-2f3e0504f532 tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Sep 04 01:31:02.413837 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:31:02.413837 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:31:02.413837 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:31:02.413837 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:31:02.413837 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:31:02.413837 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:31:02.413837 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:31:02.413837 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:31:02.413837 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:31:02.413837 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:31:02.413837 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:31:02.413837 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Sep 04 01:31:02.413837 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Sep 04 01:31:02.413837 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Sep 04 01:31:02.415366 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Sep 04 01:31:02.415366 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Sep 04 01:31:02.415366 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Sep 04 01:31:02.415366 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:31:02.415366 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:31:02.415366 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Sep 04 01:31:02.415366 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Sep 04 01:31:02.415366 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Sep 04 01:31:02.415366 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self.check_revocation(token) Sep 04 01:31:02.415366 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:31:02.415366 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:31:02.415366 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Sep 04 01:31:02.415366 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Sep 04 01:31:02.415366 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:31:02.415366 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:31:02.415366 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Sep 04 01:31:02.415366 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Sep 04 01:31:02.416686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:31:02.416686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:31:02.416686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Sep 04 01:31:02.416686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Sep 04 01:31:02.416686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Sep 04 01:31:02.416686 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:31:02.416686 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3575/7130] 10.222.0.30 () {56 vars in 1264 bytes} [Sun Sep 4 01:31:02 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 132 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Sep 04 01:31:02.416686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a0e50-9270-40ff-85fa-2f3e0504f532 tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:02.417538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c86a0e50-9270-40ff-85fa-2f3e0504f532 tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:02.418597 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c73ac-680f-47e7-81fe-0947e526d4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:02.419397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c73ac-680f-47e7-81fe-0947e526d4ce admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:02.419833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c73ac-680f-47e7-81fe-0947e526d4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:02.420585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c73ac-680f-47e7-81fe-0947e526d4ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:02.421473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c73ac-680f-47e7-81fe-0947e526d4ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:02.423736 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c73ac-680f-47e7-81fe-0947e526d4ce admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:02.455132 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:02.470058 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3556/7131] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:31:02 2022] POST /identity/v3/projects => generated 365 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:31:02.471607 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d76f9-b67d-493f-9b1e-30ac4af3e808 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:02.472107 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d76f9-b67d-493f-9b1e-30ac4af3e808 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:02.472670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d76f9-b67d-493f-9b1e-30ac4af3e808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:02.496125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-937d76f9-b67d-493f-9b1e-30ac4af3e808 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:02.497481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-937d76f9-b67d-493f-9b1e-30ac4af3e808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:02.513222 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a0e50-9270-40ff-85fa-2f3e0504f532 tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:02.567650 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3557/7132] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:02.569610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042e07e-5aee-41f4-82e3-07ea56a31444 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:02.569897 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042e07e-5aee-41f4-82e3-07ea56a31444 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:02.570171 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042e07e-5aee-41f4-82e3-07ea56a31444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:02.589270 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595673a-4fd7-4a07-8d31-4f1bf185ec08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:02.590303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595673a-4fd7-4a07-8d31-4f1bf185ec08 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:02.590634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595673a-4fd7-4a07-8d31-4f1bf185ec08 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:02.590912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595673a-4fd7-4a07-8d31-4f1bf185ec08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:02.591614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-6042e07e-5aee-41f4-82e3-07ea56a31444 None None] MFA Rules not processed for user `588275c3f8a94d868f3b4296f1b3892e`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:02.592702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7595673a-4fd7-4a07-8d31-4f1bf185ec08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:02.592971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6042e07e-5aee-41f4-82e3-07ea56a31444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:02.596224 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3558/7133] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:02 2022] POST /identity/v3/auth/tokens => generated 344 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 01:31:02.597246 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042e07e-5aee-41f4-82e3-07ea56a31444 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:02.614578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042e07e-5aee-41f4-82e3-07ea56a31444 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:02.623037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880f916-1322-4444-9f0c-210205c7234d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:02.624713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880f916-1322-4444-9f0c-210205c7234d admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:02.626282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880f916-1322-4444-9f0c-210205c7234d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:02.626282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880f916-1322-4444-9f0c-210205c7234d admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:02.626919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880f916-1322-4444-9f0c-210205c7234d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:02.628835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880f916-1322-4444-9f0c-210205c7234d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:02.657352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595673a-4fd7-4a07-8d31-4f1bf185ec08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:02.659625 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595673a-4fd7-4a07-8d31-4f1bf185ec08 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:02.664093 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3559/7134] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:31:02 2022] POST /identity/v3/users => generated 283 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:31:02.664093 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f11a4-1302-4cbc-a0d6-c02de190a2db None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:02.664344 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f11a4-1302-4cbc-a0d6-c02de190a2db None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:02.665044 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f11a4-1302-4cbc-a0d6-c02de190a2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:02.672981 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3576/7135] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:31:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:31:02.674063 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595673a-4fd7-4a07-8d31-4f1bf185ec08 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:02.675753 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7595673a-4fd7-4a07-8d31-4f1bf185ec08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:02.687173 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c49f11a4-1302-4cbc-a0d6-c02de190a2db None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:02.689045 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c49f11a4-1302-4cbc-a0d6-c02de190a2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:02.698236 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3560/7136] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:02.701716 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f11a4-1302-4cbc-a0d6-c02de190a2db None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:02.709412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f11a4-1302-4cbc-a0d6-c02de190a2db None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:02.714784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacfb2b-aadc-4395-ad76-6b72ea23f262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:02.715320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacfb2b-aadc-4395-ad76-6b72ea23f262 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:02.715595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacfb2b-aadc-4395-ad76-6b72ea23f262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:02.715877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacfb2b-aadc-4395-ad76-6b72ea23f262 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:02.716497 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aacfb2b-aadc-4395-ad76-6b72ea23f262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:02.718126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aacfb2b-aadc-4395-ad76-6b72ea23f262 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:02.730223 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3561/7137] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:31:02.731532 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319821ab-7d38-4753-9dd8-737ae7c86305 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:02.731731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319821ab-7d38-4753-9dd8-737ae7c86305 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:02.731994 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319821ab-7d38-4753-9dd8-737ae7c86305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:02.748903 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:02.758113 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-319821ab-7d38-4753-9dd8-737ae7c86305 None None] MFA Rules not processed for user `3734668c07164b759f9084fdcccf7d36`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:02.760050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595673a-4fd7-4a07-8d31-4f1bf185ec08 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:02.760489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-319821ab-7d38-4753-9dd8-737ae7c86305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:02.767800 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971eb0ba-4dfd-45c3-bc6c-6f832d3ce8cd tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '588275c3f8a94d868f3b4296f1b3892e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4b8f99f950c4dd0a80a22a222b19381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:02.767991 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971eb0ba-4dfd-45c3-bc6c-6f832d3ce8cd tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:02.768114 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971eb0ba-4dfd-45c3-bc6c-6f832d3ce8cd tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:02.768361 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971eb0ba-4dfd-45c3-bc6c-6f832d3ce8cd tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:02.772944 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:02.775834 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971eb0ba-4dfd-45c3-bc6c-6f832d3ce8cd tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:02.778176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971eb0ba-4dfd-45c3-bc6c-6f832d3ce8cd tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:02.789372 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3577/7138] 10.222.0.30 () {56 vars in 1263 bytes} [Sun Sep 4 01:31:02 2022] GET /identity/v3/auth/tokens => generated 344 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 04 01:31:02.789372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971eb0ba-4dfd-45c3-bc6c-6f832d3ce8cd tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:02.797728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971eb0ba-4dfd-45c3-bc6c-6f832d3ce8cd tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:02.803082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3786a5-6e05-4b97-bd8d-d1ab34ab28ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:02.803753 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3786a5-6e05-4b97-bd8d-d1ab34ab28ba admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:02.804121 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3786a5-6e05-4b97-bd8d-d1ab34ab28ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:02.804403 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3786a5-6e05-4b97-bd8d-d1ab34ab28ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:02.805043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3786a5-6e05-4b97-bd8d-d1ab34ab28ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:31:02.805353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3786a5-6e05-4b97-bd8d-d1ab34ab28ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:02.806983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3786a5-6e05-4b97-bd8d-d1ab34ab28ba admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:02.820133 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3578/7139] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:31:02.820808 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3786a5-6e05-4b97-bd8d-d1ab34ab28ba admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:02.831694 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3786a5-6e05-4b97-bd8d-d1ab34ab28ba admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:02.837054 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d535d-0bf4-4b74-8e9d-44bc1c8ab33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:02.837751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d535d-0bf4-4b74-8e9d-44bc1c8ab33a admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:02.838062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d535d-0bf4-4b74-8e9d-44bc1c8ab33a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:02.838334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d535d-0bf4-4b74-8e9d-44bc1c8ab33a admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:02.838969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d535d-0bf4-4b74-8e9d-44bc1c8ab33a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:02.840802 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d535d-0bf4-4b74-8e9d-44bc1c8ab33a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:02.857207 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3562/7140] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:02.857413 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3579/7141] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:31:02.857413 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d535d-0bf4-4b74-8e9d-44bc1c8ab33a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:02.857629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319821ab-7d38-4753-9dd8-737ae7c86305 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:02.873150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d535d-0bf4-4b74-8e9d-44bc1c8ab33a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:02.875974 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319821ab-7d38-4753-9dd8-737ae7c86305 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:02.883313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4c10b-55ef-47d6-9a28-c5a1ea8c883c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:02.883932 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4c10b-55ef-47d6-9a28-c5a1ea8c883c admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:02.884208 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4c10b-55ef-47d6-9a28-c5a1ea8c883c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:02.884440 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069cc7e7-b368-4787-82b6-37a0a36cace3 tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '588275c3f8a94d868f3b4296f1b3892e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4b8f99f950c4dd0a80a22a222b19381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:02.884862 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4c10b-55ef-47d6-9a28-c5a1ea8c883c admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:02.885056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069cc7e7-b368-4787-82b6-37a0a36cace3 tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:02.885340 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069cc7e7-b368-4787-82b6-37a0a36cace3 tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:02.885588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4c10b-55ef-47d6-9a28-c5a1ea8c883c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:02.885716 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069cc7e7-b368-4787-82b6-37a0a36cace3 tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:02.887924 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4c10b-55ef-47d6-9a28-c5a1ea8c883c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:02.892888 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069cc7e7-b368-4787-82b6-37a0a36cace3 tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:02.894442 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069cc7e7-b368-4787-82b6-37a0a36cace3 tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:02.914910 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3563/7142] 10.222.0.30 () {56 vars in 1266 bytes} [Sun Sep 4 01:31:02 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:02.915927 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069cc7e7-b368-4787-82b6-37a0a36cace3 tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:02.933580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069cc7e7-b368-4787-82b6-37a0a36cace3 tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:02.940835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867c9cb-bd79-4680-8cc2-12c3e7abde88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:02.942257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867c9cb-bd79-4680-8cc2-12c3e7abde88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:02.942832 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867c9cb-bd79-4680-8cc2-12c3e7abde88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:02.943483 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867c9cb-bd79-4680-8cc2-12c3e7abde88 admin admin] PATH_INFO: `/v3/projects/677216d406d6461eacb54fc24adb8aab/users/9ec0efeb68664a8cb83dc8311b4f5be2/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:02.951246 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3580/7143] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:31:02 2022] POST /identity/v3/projects => generated 361 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:31:02.952524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4c10b-55ef-47d6-9a28-c5a1ea8c883c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:02.964012 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867c9cb-bd79-4680-8cc2-12c3e7abde88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=677216d406d6461eacb54fc24adb8aab, user_id=9ec0efeb68664a8cb83dc8311b4f5be2, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:02.968262 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867c9cb-bd79-4680-8cc2-12c3e7abde88 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:02.991139 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3564/7144] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:31:02 2022] PUT /identity/v3/projects/677216d406d6461eacb54fc24adb8aab/users/9ec0efeb68664a8cb83dc8311b4f5be2/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:02.992390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867c9cb-bd79-4680-8cc2-12c3e7abde88 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:03.034552 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4c10b-55ef-47d6-9a28-c5a1ea8c883c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:03.108544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867c9cb-bd79-4680-8cc2-12c3e7abde88 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:03.120938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb4865-e3b2-42a3-91ff-5a4e240d8fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:03.121600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb4865-e3b2-42a3-91ff-5a4e240d8fef admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:03.122241 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb4865-e3b2-42a3-91ff-5a4e240d8fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:03.122590 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb4865-e3b2-42a3-91ff-5a4e240d8fef admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:03.123168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb4865-e3b2-42a3-91ff-5a4e240d8fef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:03.126648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb4865-e3b2-42a3-91ff-5a4e240d8fef admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:03.147783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bfd05e-eab0-440d-87be-ceb57354df5d tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '588275c3f8a94d868f3b4296f1b3892e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4b8f99f950c4dd0a80a22a222b19381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:03.148612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfd05e-eab0-440d-87be-ceb57354df5d tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:03.149015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfd05e-eab0-440d-87be-ceb57354df5d tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:03.149540 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfd05e-eab0-440d-87be-ceb57354df5d tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:03.152749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a6bfd05e-eab0-440d-87be-ceb57354df5d tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:03.154693 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3565/7145] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:31:02 2022] POST /identity/v3/users => generated 281 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:31:03.159049 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81e759-4591-4d3c-8c91-e488e7a05007 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:03.159341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81e759-4591-4d3c-8c91-e488e7a05007 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:03.159619 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81e759-4591-4d3c-8c91-e488e7a05007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:03.170845 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-a6bfd05e-eab0-440d-87be-ceb57354df5d tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Sep 04 01:31:03.170845 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:31:03.170845 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:31:03.170845 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:31:03.170845 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:31:03.170845 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:31:03.170845 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:31:03.170845 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:31:03.170845 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:31:03.170845 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:31:03.170845 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:31:03.170845 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:31:03.170845 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Sep 04 01:31:03.170845 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Sep 04 01:31:03.170845 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Sep 04 01:31:03.171951 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Sep 04 01:31:03.171951 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Sep 04 01:31:03.171951 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Sep 04 01:31:03.171951 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:31:03.171951 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:31:03.171951 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Sep 04 01:31:03.171951 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Sep 04 01:31:03.171951 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Sep 04 01:31:03.171951 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self.check_revocation(token) Sep 04 01:31:03.171951 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:31:03.171951 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:31:03.171951 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Sep 04 01:31:03.171951 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Sep 04 01:31:03.171951 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:31:03.171951 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:31:03.171951 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Sep 04 01:31:03.171951 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Sep 04 01:31:03.177685 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:31:03.177685 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:31:03.177685 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Sep 04 01:31:03.177685 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Sep 04 01:31:03.177685 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Sep 04 01:31:03.177685 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:31:03.177685 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3581/7146] 10.222.0.30 () {56 vars in 1263 bytes} [Sun Sep 4 01:31:02 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 01:31:03.177685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bfd05e-eab0-440d-87be-ceb57354df5d tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:03.186707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bfd05e-eab0-440d-87be-ceb57354df5d tempest-TokensV3Test-94492391 tempest-TokensV3Test-94492391-project] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:03.192489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-df81e759-4591-4d3c-8c91-e488e7a05007 None None] MFA Rules not processed for user `9ec0efeb68664a8cb83dc8311b4f5be2`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:03.193158 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b54059-a9b9-4dde-94a9-f1ab59a32210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:03.193787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-df81e759-4591-4d3c-8c91-e488e7a05007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:03.193957 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b54059-a9b9-4dde-94a9-f1ab59a32210 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:03.194290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b54059-a9b9-4dde-94a9-f1ab59a32210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:03.194629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b54059-a9b9-4dde-94a9-f1ab59a32210 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:03.195437 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b54059-a9b9-4dde-94a9-f1ab59a32210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:03.197106 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b54059-a9b9-4dde-94a9-f1ab59a32210 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:03.209188 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3582/7147] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:31:03.210139 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b54059-a9b9-4dde-94a9-f1ab59a32210 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:03.211884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-61b54059-a9b9-4dde-94a9-f1ab59a32210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:03.228740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b54059-a9b9-4dde-94a9-f1ab59a32210 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:03.233513 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0e8cf-6721-411f-8500-3c4f9a794363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:03.234141 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0e8cf-6721-411f-8500-3c4f9a794363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:03.234420 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0e8cf-6721-411f-8500-3c4f9a794363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:03.235246 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0e8cf-6721-411f-8500-3c4f9a794363 admin admin] PATH_INFO: `/v3/users/588275c3f8a94d868f3b4296f1b3892e` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:03.236640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0e8cf-6721-411f-8500-3c4f9a794363 admin admin] RBAC: Authorizing `identity:delete_user(user_id=588275c3f8a94d868f3b4296f1b3892e)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:03.238583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0e8cf-6721-411f-8500-3c4f9a794363 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:03.242478 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:03.299118 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3566/7148] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:03.300542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81e759-4591-4d3c-8c91-e488e7a05007 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:03.322899 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81e759-4591-4d3c-8c91-e488e7a05007 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:03.330345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab63834-45e6-4538-8ebd-f16bffa3582d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:03.331217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab63834-45e6-4538-8ebd-f16bffa3582d admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:03.331751 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab63834-45e6-4538-8ebd-f16bffa3582d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:03.332481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab63834-45e6-4538-8ebd-f16bffa3582d admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:03.333577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab63834-45e6-4538-8ebd-f16bffa3582d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:03.336122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab63834-45e6-4538-8ebd-f16bffa3582d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:03.342317 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-62e0e8cf-6721-411f-8500-3c4f9a794363 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '588275c3f8a94d868f3b4296f1b3892e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:03.343067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-62e0e8cf-6721-411f-8500-3c4f9a794363 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '588275c3f8a94d868f3b4296f1b3892e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:03.345146 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:03.353460 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3567/7149] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:31:03.357130 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab63834-45e6-4538-8ebd-f16bffa3582d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:03.357606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bab63834-45e6-4538-8ebd-f16bffa3582d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:03.372086 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab63834-45e6-4538-8ebd-f16bffa3582d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:03.376546 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-62e0e8cf-6721-411f-8500-3c4f9a794363 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '588275c3f8a94d868f3b4296f1b3892e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:03.377366 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58431212-2653-4444-9fad-c8060b8c41a6 tempest-TestApiDiscovery-25139545 tempest-TestApiDiscovery-25139545-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec0efeb68664a8cb83dc8311b4f5be2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677216d406d6461eacb54fc24adb8aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:03.378030 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58431212-2653-4444-9fad-c8060b8c41a6 tempest-TestApiDiscovery-25139545 tempest-TestApiDiscovery-25139545-project] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:03.378322 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58431212-2653-4444-9fad-c8060b8c41a6 tempest-TestApiDiscovery-25139545 tempest-TestApiDiscovery-25139545-project] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:03.378629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58431212-2653-4444-9fad-c8060b8c41a6 tempest-TestApiDiscovery-25139545 tempest-TestApiDiscovery-25139545-project] PATH_INFO: `/v3` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:03.384410 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3568/7150] 10.222.0.30 () {58 vars in 1104 bytes} [Sun Sep 4 01:31:03 2022] GET /identity/v3 => generated 255 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:31:03.385155 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58431212-2653-4444-9fad-c8060b8c41a6 tempest-TestApiDiscovery-25139545 tempest-TestApiDiscovery-25139545-project] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:03.387557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-58431212-2653-4444-9fad-c8060b8c41a6 tempest-TestApiDiscovery-25139545 tempest-TestApiDiscovery-25139545-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:03.391344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-62e0e8cf-6721-411f-8500-3c4f9a794363 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '588275c3f8a94d868f3b4296f1b3892e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:03.392037 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-62e0e8cf-6721-411f-8500-3c4f9a794363 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '588275c3f8a94d868f3b4296f1b3892e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:03.410117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58431212-2653-4444-9fad-c8060b8c41a6 tempest-TestApiDiscovery-25139545 tempest-TestApiDiscovery-25139545-project] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:03.416735 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46fa46-2564-4682-9acd-0fedc89e5de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:03.417420 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46fa46-2564-4682-9acd-0fedc89e5de5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:03.417772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46fa46-2564-4682-9acd-0fedc89e5de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:03.418063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46fa46-2564-4682-9acd-0fedc89e5de5 admin admin] PATH_INFO: `/v3/projects/f6021f818cc644daa7d17d304c8a2db6/users/52fbd40cb4034750a56a85b24457d71b/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:03.431855 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3583/7151] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:31:03 2022] DELETE /identity/v3/users/588275c3f8a94d868f3b4296f1b3892e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:03.432589 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0e8cf-6721-411f-8500-3c4f9a794363 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:03.443432 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46fa46-2564-4682-9acd-0fedc89e5de5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6021f818cc644daa7d17d304c8a2db6, user_id=52fbd40cb4034750a56a85b24457d71b, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:03.446601 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46fa46-2564-4682-9acd-0fedc89e5de5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:03.469966 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3569/7152] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:31:03 2022] PUT /identity/v3/projects/f6021f818cc644daa7d17d304c8a2db6/users/52fbd40cb4034750a56a85b24457d71b/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:03.471494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80380eb-5038-4077-9696-b2b26f3f6318 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:03.471903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80380eb-5038-4077-9696-b2b26f3f6318 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:03.472112 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80380eb-5038-4077-9696-b2b26f3f6318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:03.519059 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c80380eb-5038-4077-9696-b2b26f3f6318 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:03.520585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c80380eb-5038-4077-9696-b2b26f3f6318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:03.535769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0e8cf-6721-411f-8500-3c4f9a794363 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:03.646181 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3570/7153] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:03.647499 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03722b6d-ef14-4cb1-942d-05af9c42a1af None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:03.647789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03722b6d-ef14-4cb1-942d-05af9c42a1af None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:03.648068 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03722b6d-ef14-4cb1-942d-05af9c42a1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:03.657599 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0419fa-2f26-400b-a337-db545a2a43e0 tempest-TestApiDiscovery-25139545 tempest-TestApiDiscovery-25139545-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec0efeb68664a8cb83dc8311b4f5be2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677216d406d6461eacb54fc24adb8aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:03.658231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0419fa-2f26-400b-a337-db545a2a43e0 tempest-TestApiDiscovery-25139545 tempest-TestApiDiscovery-25139545-project] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:03.658518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0419fa-2f26-400b-a337-db545a2a43e0 tempest-TestApiDiscovery-25139545 tempest-TestApiDiscovery-25139545-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:03.658797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0419fa-2f26-400b-a337-db545a2a43e0 tempest-TestApiDiscovery-25139545 tempest-TestApiDiscovery-25139545-project] PATH_INFO: `/v3` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:03.668114 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3584/7154] 10.222.0.30 () {58 vars in 1104 bytes} [Sun Sep 4 01:31:03 2022] GET /identity/v3 => generated 255 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:31:03.669045 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0419fa-2f26-400b-a337-db545a2a43e0 tempest-TestApiDiscovery-25139545 tempest-TestApiDiscovery-25139545-project] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:03.692612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0419fa-2f26-400b-a337-db545a2a43e0 tempest-TestApiDiscovery-25139545 tempest-TestApiDiscovery-25139545-project] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:03.706240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30d549-bdd1-404c-84e9-cef2df577f51 tempest-TestApiDiscovery-25139545 tempest-TestApiDiscovery-25139545-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec0efeb68664a8cb83dc8311b4f5be2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677216d406d6461eacb54fc24adb8aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:03.706880 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30d549-bdd1-404c-84e9-cef2df577f51 tempest-TestApiDiscovery-25139545 tempest-TestApiDiscovery-25139545-project] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:03.707169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30d549-bdd1-404c-84e9-cef2df577f51 tempest-TestApiDiscovery-25139545 tempest-TestApiDiscovery-25139545-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:03.707445 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30d549-bdd1-404c-84e9-cef2df577f51 tempest-TestApiDiscovery-25139545 tempest-TestApiDiscovery-25139545-project] PATH_INFO: `/v3` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:03.709418 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3585/7155] 10.222.0.30 () {58 vars in 1104 bytes} [Sun Sep 4 01:31:03 2022] GET /identity/v3 => generated 255 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:31:03.710255 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30d549-bdd1-404c-84e9-cef2df577f51 tempest-TestApiDiscovery-25139545 tempest-TestApiDiscovery-25139545-project] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:03.714260 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ae30d549-bdd1-404c-84e9-cef2df577f51 tempest-TestApiDiscovery-25139545 tempest-TestApiDiscovery-25139545-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:03.715636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-03722b6d-ef14-4cb1-942d-05af9c42a1af None None] MFA Rules not processed for user `52fbd40cb4034750a56a85b24457d71b`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:03.733662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-03722b6d-ef14-4cb1-942d-05af9c42a1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:03.805879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30d549-bdd1-404c-84e9-cef2df577f51 tempest-TestApiDiscovery-25139545 tempest-TestApiDiscovery-25139545-project] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:03.809804 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c602d9-070b-4e95-aa5f-d8c0dda42025 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:03.810438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c602d9-070b-4e95-aa5f-d8c0dda42025 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:03.810718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c602d9-070b-4e95-aa5f-d8c0dda42025 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:03.810991 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c602d9-070b-4e95-aa5f-d8c0dda42025 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:03.826612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c602d9-070b-4e95-aa5f-d8c0dda42025 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:03.830307 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c602d9-070b-4e95-aa5f-d8c0dda42025 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:03.841620 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3571/7156] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:03.843209 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3878735-ade3-4149-b841-434e6529ede0 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:03.844650 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3878735-ade3-4149-b841-434e6529ede0 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:03.845211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3878735-ade3-4149-b841-434e6529ede0 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:03.847066 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3572/7157] 10.222.0.30 () {56 vars in 895 bytes} [Sun Sep 4 01:31:03 2022] GET /identity/ => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:31:03.852172 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3586/7158] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:31:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:31:03.852330 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0fd269-8917-45ac-acc7-b02e41689280 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:03.852882 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0fd269-8917-45ac-acc7-b02e41689280 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:03.853653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0fd269-8917-45ac-acc7-b02e41689280 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:03.860540 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3573/7159] 10.222.0.30 () {56 vars in 895 bytes} [Sun Sep 4 01:31:03 2022] GET /identity/ => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:31:03.863772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c602d9-070b-4e95-aa5f-d8c0dda42025 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:03.865208 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a2c602d9-070b-4e95-aa5f-d8c0dda42025 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:03.879189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c602d9-070b-4e95-aa5f-d8c0dda42025 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:03.884401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe2b9a-53a0-4290-bdba-61290230a307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:03.885049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe2b9a-53a0-4290-bdba-61290230a307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:03.885330 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe2b9a-53a0-4290-bdba-61290230a307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:03.885654 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe2b9a-53a0-4290-bdba-61290230a307 admin admin] PATH_INFO: `/v3/users/9ec0efeb68664a8cb83dc8311b4f5be2` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:03.887002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe2b9a-53a0-4290-bdba-61290230a307 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ec0efeb68664a8cb83dc8311b4f5be2)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:03.887973 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0fd269-8917-45ac-acc7-b02e41689280 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:03.889006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe2b9a-53a0-4290-bdba-61290230a307 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:03.889751 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6f0fd269-8917-45ac-acc7-b02e41689280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:03.913761 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:03.948916 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:03.993129 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3abe2b9a-53a0-4290-bdba-61290230a307 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ec0efeb68664a8cb83dc8311b4f5be2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:03.993921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3abe2b9a-53a0-4290-bdba-61290230a307 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ec0efeb68664a8cb83dc8311b4f5be2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:04.004958 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3abe2b9a-53a0-4290-bdba-61290230a307 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ec0efeb68664a8cb83dc8311b4f5be2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:04.022638 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3abe2b9a-53a0-4290-bdba-61290230a307 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ec0efeb68664a8cb83dc8311b4f5be2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:04.026420 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3abe2b9a-53a0-4290-bdba-61290230a307 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ec0efeb68664a8cb83dc8311b4f5be2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:04.048236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0fd269-8917-45ac-acc7-b02e41689280 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:04.060572 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372bd88-2e06-4937-8292-996b0905ef39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:04.061230 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372bd88-2e06-4937-8292-996b0905ef39 service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:04.064725 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372bd88-2e06-4937-8292-996b0905ef39 service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:04.065035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372bd88-2e06-4937-8292-996b0905ef39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:04.070573 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c372bd88-2e06-4937-8292-996b0905ef39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:04.077557 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3587/7160] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:31:03 2022] DELETE /identity/v3/users/9ec0efeb68664a8cb83dc8311b4f5be2 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:04.082318 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa81f4f-74b8-4cfc-b016-7d85338534a9 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:04.083628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa81f4f-74b8-4cfc-b016-7d85338534a9 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:04.084467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa81f4f-74b8-4cfc-b016-7d85338534a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:04.101482 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c372bd88-2e06-4937-8292-996b0905ef39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:04.107328 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c372bd88-2e06-4937-8292-996b0905ef39 service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:04.116925 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-3aa81f4f-74b8-4cfc-b016-7d85338534a9 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:04.119088 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3aa81f4f-74b8-4cfc-b016-7d85338534a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:04.129647 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3574/7161] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:31:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:31:04.143454 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372bd88-2e06-4937-8292-996b0905ef39 service cinder] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:04.144939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c372bd88-2e06-4937-8292-996b0905ef39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:04.159682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372bd88-2e06-4937-8292-996b0905ef39 service cinder] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:04.209939 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3588/7162] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:04.216567 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa81f4f-74b8-4cfc-b016-7d85338534a9 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:04.218109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3aa81f4f-74b8-4cfc-b016-7d85338534a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:04.307271 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923bf12-41ea-401f-9ee6-d7c67f6522a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:04.308401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923bf12-41ea-401f-9ee6-d7c67f6522a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:04.308774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923bf12-41ea-401f-9ee6-d7c67f6522a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:04.310000 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923bf12-41ea-401f-9ee6-d7c67f6522a5 admin admin] PATH_INFO: `/v3/users/52fbd40cb4034750a56a85b24457d71b` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:04.313769 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923bf12-41ea-401f-9ee6-d7c67f6522a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52fbd40cb4034750a56a85b24457d71b)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:04.318593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923bf12-41ea-401f-9ee6-d7c67f6522a5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:04.374080 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa81f4f-74b8-4cfc-b016-7d85338534a9 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:04.384237 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e3125-59a2-48ad-afc6-edc54c4c4a92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:04.385317 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e3125-59a2-48ad-afc6-edc54c4c4a92 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:04.386022 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e3125-59a2-48ad-afc6-edc54c4c4a92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:04.386685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e3125-59a2-48ad-afc6-edc54c4c4a92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:04.401360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328e3125-59a2-48ad-afc6-edc54c4c4a92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:04.402756 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7923bf12-41ea-401f-9ee6-d7c67f6522a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52fbd40cb4034750a56a85b24457d71b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:04.403494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7923bf12-41ea-401f-9ee6-d7c67f6522a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52fbd40cb4034750a56a85b24457d71b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:04.403901 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328e3125-59a2-48ad-afc6-edc54c4c4a92 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:04.414655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7923bf12-41ea-401f-9ee6-d7c67f6522a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52fbd40cb4034750a56a85b24457d71b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:04.431179 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7923bf12-41ea-401f-9ee6-d7c67f6522a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52fbd40cb4034750a56a85b24457d71b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:04.432041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7923bf12-41ea-401f-9ee6-d7c67f6522a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52fbd40cb4034750a56a85b24457d71b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:04.436314 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3589/7163] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:31:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:31:04.478944 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3575/7164] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:31:04 2022] DELETE /identity/v3/users/52fbd40cb4034750a56a85b24457d71b => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:04.485218 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5aa2e-d4ae-40dd-a77c-fc1fce1cc94b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:04.485543 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5aa2e-d4ae-40dd-a77c-fc1fce1cc94b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:04.486171 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5aa2e-d4ae-40dd-a77c-fc1fce1cc94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:04.516693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-cdf5aa2e-d4ae-40dd-a77c-fc1fce1cc94b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:04.517743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-cdf5aa2e-d4ae-40dd-a77c-fc1fce1cc94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:04.589955 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:04.631561 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3590/7165] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:04.649815 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923bf12-41ea-401f-9ee6-d7c67f6522a5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:04.651723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7923bf12-41ea-401f-9ee6-d7c67f6522a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:04.750218 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:04.791038 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923bf12-41ea-401f-9ee6-d7c67f6522a5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:04.803169 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda2766-8fec-40a6-b40e-41e11f4c9363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:04.804368 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda2766-8fec-40a6-b40e-41e11f4c9363 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:04.804739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda2766-8fec-40a6-b40e-41e11f4c9363 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:04.805024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda2766-8fec-40a6-b40e-41e11f4c9363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:04.816730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5aa2e-d4ae-40dd-a77c-fc1fce1cc94b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:04.818536 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-cdf5aa2e-d4ae-40dd-a77c-fc1fce1cc94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:04.831352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda2766-8fec-40a6-b40e-41e11f4c9363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:04.836494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda2766-8fec-40a6-b40e-41e11f4c9363 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:04.843760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5aa2e-d4ae-40dd-a77c-fc1fce1cc94b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:04.858147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b3f06-6ead-44a2-bb02-7d3ec5d4e124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:04.860337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b3f06-6ead-44a2-bb02-7d3ec5d4e124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:04.860973 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b3f06-6ead-44a2-bb02-7d3ec5d4e124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:04.861836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b3f06-6ead-44a2-bb02-7d3ec5d4e124 admin admin] PATH_INFO: `/v3/projects/677216d406d6461eacb54fc24adb8aab` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:04.863792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b3f06-6ead-44a2-bb02-7d3ec5d4e124 admin admin] RBAC: Authorizing `identity:delete_project(project_id=677216d406d6461eacb54fc24adb8aab)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:04.866703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b3f06-6ead-44a2-bb02-7d3ec5d4e124 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:04.877768 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3576/7166] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:31:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:31:04.879693 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda2766-8fec-40a6-b40e-41e11f4c9363 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:04.886531 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2fda2766-8fec-40a6-b40e-41e11f4c9363 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:04.930649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda2766-8fec-40a6-b40e-41e11f4c9363 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:04.944674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d71b1-2ee3-476e-ac3d-a35860964c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:04.946568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d71b1-2ee3-476e-ac3d-a35860964c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:04.947263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d71b1-2ee3-476e-ac3d-a35860964c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:04.949163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d71b1-2ee3-476e-ac3d-a35860964c38 admin admin] PATH_INFO: `/v3/projects/b4b8f99f950c4dd0a80a22a222b19381` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:04.952571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d71b1-2ee3-476e-ac3d-a35860964c38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4b8f99f950c4dd0a80a22a222b19381)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:04.955054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d71b1-2ee3-476e-ac3d-a35860964c38 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:04.973695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-471b3f06-6ead-44a2-bb02-7d3ec5d4e124 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '677216d406d6461eacb54fc24adb8aab', 'request_id': 'req-471b3f06-6ead-44a2-bb02-7d3ec5d4e124'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:04.989052 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-471b3f06-6ead-44a2-bb02-7d3ec5d4e124 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '677216d406d6461eacb54fc24adb8aab', 'request_id': 'req-471b3f06-6ead-44a2-bb02-7d3ec5d4e124'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:05.002377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-471b3f06-6ead-44a2-bb02-7d3ec5d4e124 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '677216d406d6461eacb54fc24adb8aab', 'request_id': 'req-471b3f06-6ead-44a2-bb02-7d3ec5d4e124'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:05.040222 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-471b3f06-6ead-44a2-bb02-7d3ec5d4e124 admin admin] The token cache is being invalidate because project 677216d406d6461eacb54fc24adb8aab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:31:05.040556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-471b3f06-6ead-44a2-bb02-7d3ec5d4e124 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:05.041713 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-471b3f06-6ead-44a2-bb02-7d3ec5d4e124 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:05.048718 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3591/7167] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:31:04 2022] DELETE /identity/v3/projects/677216d406d6461eacb54fc24adb8aab => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:31:05.051187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd4eca-9523-45c6-b2cb-71ced52f6e88 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:05.052766 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd4eca-9523-45c6-b2cb-71ced52f6e88 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:05.053096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd4eca-9523-45c6-b2cb-71ced52f6e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:05.075544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-951d71b1-2ee3-476e-ac3d-a35860964c38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4b8f99f950c4dd0a80a22a222b19381', 'request_id': 'req-951d71b1-2ee3-476e-ac3d-a35860964c38'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:05.089696 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-951d71b1-2ee3-476e-ac3d-a35860964c38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4b8f99f950c4dd0a80a22a222b19381', 'request_id': 'req-951d71b1-2ee3-476e-ac3d-a35860964c38'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:05.099166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e5fd4eca-9523-45c6-b2cb-71ced52f6e88 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:05.100967 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e5fd4eca-9523-45c6-b2cb-71ced52f6e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:05.104455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-951d71b1-2ee3-476e-ac3d-a35860964c38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4b8f99f950c4dd0a80a22a222b19381', 'request_id': 'req-951d71b1-2ee3-476e-ac3d-a35860964c38'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:05.131775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-951d71b1-2ee3-476e-ac3d-a35860964c38 admin admin] The token cache is being invalidate because project b4b8f99f950c4dd0a80a22a222b19381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:31:05.132057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-951d71b1-2ee3-476e-ac3d-a35860964c38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:05.132829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-951d71b1-2ee3-476e-ac3d-a35860964c38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:05.142272 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3577/7168] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:31:04 2022] DELETE /identity/v3/projects/b4b8f99f950c4dd0a80a22a222b19381 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:05.144107 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37e1fc-372c-4f64-ad0b-6d25340b3277 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:05.144453 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37e1fc-372c-4f64-ad0b-6d25340b3277 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:05.144763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37e1fc-372c-4f64-ad0b-6d25340b3277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:05.197260 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-1b37e1fc-372c-4f64-ad0b-6d25340b3277 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:05.199678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1b37e1fc-372c-4f64-ad0b-6d25340b3277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:05.285211 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3592/7169] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:05.290752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f40ae0-475c-4a68-bdef-a662c47a43d2 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:05.290937 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f40ae0-475c-4a68-bdef-a662c47a43d2 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:05.295151 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f40ae0-475c-4a68-bdef-a662c47a43d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:05.326217 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3578/7170] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:31:05.349658 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72148315-d3df-4958-9653-398f8ae58e0a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:05.350463 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72148315-d3df-4958-9653-398f8ae58e0a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:05.351028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72148315-d3df-4958-9653-398f8ae58e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:05.381953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-f2f40ae0-475c-4a68-bdef-a662c47a43d2 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:05.397058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f2f40ae0-475c-4a68-bdef-a662c47a43d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:05.413374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-72148315-d3df-4958-9653-398f8ae58e0a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:05.417288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-72148315-d3df-4958-9653-398f8ae58e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:05.429236 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3593/7171] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:05.436758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f40ae0-475c-4a68-bdef-a662c47a43d2 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:05.451557 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3579/7172] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:31:05.456521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72148315-d3df-4958-9653-398f8ae58e0a None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:05.456785 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f40ae0-475c-4a68-bdef-a662c47a43d2 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:05.477825 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72148315-d3df-4958-9653-398f8ae58e0a None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:05.484894 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66935090-448c-4c77-b0ee-fd835c6525e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:05.485657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271deea8-7f76-47b2-b5b6-9d74c2f257ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:05.486104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66935090-448c-4c77-b0ee-fd835c6525e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:05.486588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271deea8-7f76-47b2-b5b6-9d74c2f257ef admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:05.486884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271deea8-7f76-47b2-b5b6-9d74c2f257ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:05.487138 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66935090-448c-4c77-b0ee-fd835c6525e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:05.487261 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271deea8-7f76-47b2-b5b6-9d74c2f257ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:05.488112 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271deea8-7f76-47b2-b5b6-9d74c2f257ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:31:05.488112 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271deea8-7f76-47b2-b5b6-9d74c2f257ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:05.488437 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66935090-448c-4c77-b0ee-fd835c6525e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:05.489252 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66935090-448c-4c77-b0ee-fd835c6525e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:31:05.489743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271deea8-7f76-47b2-b5b6-9d74c2f257ef admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:05.489898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66935090-448c-4c77-b0ee-fd835c6525e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:05.492628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66935090-448c-4c77-b0ee-fd835c6525e7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:05.513896 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3580/7173] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:31:05.516511 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66935090-448c-4c77-b0ee-fd835c6525e7 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:05.528741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66935090-448c-4c77-b0ee-fd835c6525e7 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:05.529805 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3594/7174] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:31:05.530713 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271deea8-7f76-47b2-b5b6-9d74c2f257ef admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:05.536022 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a276b1-1c2d-4b3d-a386-ea44252030b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:05.537040 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a276b1-1c2d-4b3d-a386-ea44252030b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:05.537554 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a276b1-1c2d-4b3d-a386-ea44252030b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:05.539045 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a276b1-1c2d-4b3d-a386-ea44252030b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:05.539045 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a276b1-1c2d-4b3d-a386-ea44252030b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:05.543121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a276b1-1c2d-4b3d-a386-ea44252030b6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:05.553643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271deea8-7f76-47b2-b5b6-9d74c2f257ef admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:05.586540 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac223d-d4c5-4e6f-b74c-91efd5d0d586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:05.587204 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac223d-d4c5-4e6f-b74c-91efd5d0d586 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:05.587500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac223d-d4c5-4e6f-b74c-91efd5d0d586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:05.589247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac223d-d4c5-4e6f-b74c-91efd5d0d586 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:05.590090 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac223d-d4c5-4e6f-b74c-91efd5d0d586 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:05.594214 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac223d-d4c5-4e6f-b74c-91efd5d0d586 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:05.612801 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3581/7175] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:31:05 2022] POST /identity/v3/projects => generated 369 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:31:05.614804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a276b1-1c2d-4b3d-a386-ea44252030b6 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:05.617987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-35a276b1-1c2d-4b3d-a386-ea44252030b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:05.678104 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3595/7176] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:31:05 2022] POST /identity/v3/projects => generated 381 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:31:05.681809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac223d-d4c5-4e6f-b74c-91efd5d0d586 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:05.683528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8bac223d-d4c5-4e6f-b74c-91efd5d0d586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:05.715178 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:05.721377 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:05.767826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a276b1-1c2d-4b3d-a386-ea44252030b6 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:05.791378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac223d-d4c5-4e6f-b74c-91efd5d0d586 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:05.796538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d6145-591c-4d60-a8a2-645bc8ada9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:05.797125 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d6145-591c-4d60-a8a2-645bc8ada9da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:05.797408 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d6145-591c-4d60-a8a2-645bc8ada9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:05.797705 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d6145-591c-4d60-a8a2-645bc8ada9da admin admin] PATH_INFO: `/v3/projects/f6021f818cc644daa7d17d304c8a2db6` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:05.798874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d6145-591c-4d60-a8a2-645bc8ada9da admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6021f818cc644daa7d17d304c8a2db6)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:05.800784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d6145-591c-4d60-a8a2-645bc8ada9da admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:05.850819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274d48c-19e4-4a38-ab5a-31e092899dce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:05.852422 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274d48c-19e4-4a38-ab5a-31e092899dce service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:05.853045 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274d48c-19e4-4a38-ab5a-31e092899dce service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:05.853535 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274d48c-19e4-4a38-ab5a-31e092899dce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:05.858203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9274d48c-19e4-4a38-ab5a-31e092899dce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:05.862494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-cb0d6145-591c-4d60-a8a2-645bc8ada9da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6021f818cc644daa7d17d304c8a2db6', 'request_id': 'req-cb0d6145-591c-4d60-a8a2-645bc8ada9da'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:05.873218 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-cb0d6145-591c-4d60-a8a2-645bc8ada9da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6021f818cc644daa7d17d304c8a2db6', 'request_id': 'req-cb0d6145-591c-4d60-a8a2-645bc8ada9da'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:05.881349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9274d48c-19e4-4a38-ab5a-31e092899dce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:05.882954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-cb0d6145-591c-4d60-a8a2-645bc8ada9da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6021f818cc644daa7d17d304c8a2db6', 'request_id': 'req-cb0d6145-591c-4d60-a8a2-645bc8ada9da'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:05.883731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9274d48c-19e4-4a38-ab5a-31e092899dce service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:05.898039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-cb0d6145-591c-4d60-a8a2-645bc8ada9da admin admin] The token cache is being invalidate because project f6021f818cc644daa7d17d304c8a2db6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:31:05.898326 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-cb0d6145-591c-4d60-a8a2-645bc8ada9da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:05.899020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-cb0d6145-591c-4d60-a8a2-645bc8ada9da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:05.900780 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3596/7177] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:31:05 2022] DELETE /identity/v3/projects/f6021f818cc644daa7d17d304c8a2db6 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:05.901753 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d6145-591c-4d60-a8a2-645bc8ada9da admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:05.905289 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3582/7178] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:31:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:31:05.906852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274d48c-19e4-4a38-ab5a-31e092899dce service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:05.915962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-cb0d6145-591c-4d60-a8a2-645bc8ada9da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:05.930920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274d48c-19e4-4a38-ab5a-31e092899dce service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:06.008043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d6145-591c-4d60-a8a2-645bc8ada9da admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:06.013200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aaf9ba-a763-4afe-a0d2-03fb041262bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:06.013839 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aaf9ba-a763-4afe-a0d2-03fb041262bf admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:06.014117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aaf9ba-a763-4afe-a0d2-03fb041262bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:06.014387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aaf9ba-a763-4afe-a0d2-03fb041262bf admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:06.015017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aaf9ba-a763-4afe-a0d2-03fb041262bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:06.017019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aaf9ba-a763-4afe-a0d2-03fb041262bf admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:06.019501 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56cdc8-a7c2-4cee-a936-6c4acfa1bc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:06.020172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56cdc8-a7c2-4cee-a936-6c4acfa1bc7c admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:06.020458 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56cdc8-a7c2-4cee-a936-6c4acfa1bc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:06.020729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56cdc8-a7c2-4cee-a936-6c4acfa1bc7c admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:06.021414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56cdc8-a7c2-4cee-a936-6c4acfa1bc7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:06.023823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56cdc8-a7c2-4cee-a936-6c4acfa1bc7c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:06.042597 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3597/7179] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:31:05 2022] POST /identity/v3/users => generated 285 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:31:06.044217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5023d-91c5-4944-9b95-c0865c83f825 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:06.044863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5023d-91c5-4944-9b95-c0865c83f825 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:06.045345 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5023d-91c5-4944-9b95-c0865c83f825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:06.063690 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3583/7180] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:31:05 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:31:06.064483 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56cdc8-a7c2-4cee-a936-6c4acfa1bc7c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:06.069084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-dde5023d-91c5-4944-9b95-c0865c83f825 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:06.070422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-dde5023d-91c5-4944-9b95-c0865c83f825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:06.077119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56cdc8-a7c2-4cee-a936-6c4acfa1bc7c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:06.093730 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3598/7181] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:06.093730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5023d-91c5-4944-9b95-c0865c83f825 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:06.093730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-dde5023d-91c5-4944-9b95-c0865c83f825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:06.102158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5fb15-6a4c-4bbe-9024-5ed8cf160cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:06.102601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5023d-91c5-4944-9b95-c0865c83f825 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:06.102794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5fb15-6a4c-4bbe-9024-5ed8cf160cdd admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:06.105636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5fb15-6a4c-4bbe-9024-5ed8cf160cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:06.106007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5fb15-6a4c-4bbe-9024-5ed8cf160cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:06.106744 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb5fb15-6a4c-4bbe-9024-5ed8cf160cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:06.108477 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb5fb15-6a4c-4bbe-9024-5ed8cf160cdd admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:06.112882 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113f169-8c1e-45d9-b2b2-ae9ca22553a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:06.113671 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113f169-8c1e-45d9-b2b2-ae9ca22553a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:06.114081 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113f169-8c1e-45d9-b2b2-ae9ca22553a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:06.114362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113f169-8c1e-45d9-b2b2-ae9ca22553a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:06.115118 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c113f169-8c1e-45d9-b2b2-ae9ca22553a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:06.117327 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c113f169-8c1e-45d9-b2b2-ae9ca22553a4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:06.121913 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3584/7182] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:31:06.123211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36f1ad-d296-497e-9c37-2fe15c35b471 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:06.123505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36f1ad-d296-497e-9c37-2fe15c35b471 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:06.123782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36f1ad-d296-497e-9c37-2fe15c35b471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:06.134071 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3599/7183] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:31:06.134071 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113f169-8c1e-45d9-b2b2-ae9ca22553a4 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:06.134670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c113f169-8c1e-45d9-b2b2-ae9ca22553a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:06.144829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-1a36f1ad-d296-497e-9c37-2fe15c35b471 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:06.146071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1a36f1ad-d296-497e-9c37-2fe15c35b471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:06.157925 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3585/7184] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:06.157925 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36f1ad-d296-497e-9c37-2fe15c35b471 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:06.170468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36f1ad-d296-497e-9c37-2fe15c35b471 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:06.174019 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:06.177339 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496056b-556d-4c8b-95f4-b4ada79f4571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:06.178222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496056b-556d-4c8b-95f4-b4ada79f4571 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:06.178677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496056b-556d-4c8b-95f4-b4ada79f4571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:06.179115 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496056b-556d-4c8b-95f4-b4ada79f4571 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:06.179955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8496056b-556d-4c8b-95f4-b4ada79f4571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:06.182185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8496056b-556d-4c8b-95f4-b4ada79f4571 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:06.198838 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3586/7185] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:31:06.199851 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496056b-556d-4c8b-95f4-b4ada79f4571 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:06.216003 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496056b-556d-4c8b-95f4-b4ada79f4571 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:06.220339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113f169-8c1e-45d9-b2b2-ae9ca22553a4 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:06.223408 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36226c19-7d2b-455e-a8ad-38314f9bdbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:06.224086 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36226c19-7d2b-455e-a8ad-38314f9bdbbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:06.224375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36226c19-7d2b-455e-a8ad-38314f9bdbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:06.224831 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef8c35-1c53-479c-b399-3039f4477b0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:06.225154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36226c19-7d2b-455e-a8ad-38314f9bdbbb admin admin] PATH_INFO: `/v3/projects/526c1b88ca60470ebeaf5e0a56642cfd/users/27bde243ea094be295fbb8e4555cde54/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:06.225911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef8c35-1c53-479c-b399-3039f4477b0a service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:06.226700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef8c35-1c53-479c-b399-3039f4477b0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:06.226700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef8c35-1c53-479c-b399-3039f4477b0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:06.229202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5aef8c35-1c53-479c-b399-3039f4477b0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:06.246604 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36226c19-7d2b-455e-a8ad-38314f9bdbbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=526c1b88ca60470ebeaf5e0a56642cfd, user_id=27bde243ea094be295fbb8e4555cde54, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:06.249728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36226c19-7d2b-455e-a8ad-38314f9bdbbb admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:06.270223 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3587/7186] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:31:06 2022] PUT /identity/v3/projects/526c1b88ca60470ebeaf5e0a56642cfd/users/27bde243ea094be295fbb8e4555cde54/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:06.271207 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36226c19-7d2b-455e-a8ad-38314f9bdbbb admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:06.301382 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:06.321296 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef8c35-1c53-479c-b399-3039f4477b0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:06.323018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef8c35-1c53-479c-b399-3039f4477b0a service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:06.335800 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3600/7187] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:31:06 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:31:06.336750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef8c35-1c53-479c-b399-3039f4477b0a service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:06.349982 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36226c19-7d2b-455e-a8ad-38314f9bdbbb admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:06.356666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb50a4-74bb-45ad-9d46-da2a04f0118d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:06.357360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb50a4-74bb-45ad-9d46-da2a04f0118d admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:06.357733 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb50a4-74bb-45ad-9d46-da2a04f0118d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:06.358075 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb50a4-74bb-45ad-9d46-da2a04f0118d admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:06.358899 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb50a4-74bb-45ad-9d46-da2a04f0118d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:31:06.359445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb50a4-74bb-45ad-9d46-da2a04f0118d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:06.360538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef8c35-1c53-479c-b399-3039f4477b0a service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:06.361177 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb50a4-74bb-45ad-9d46-da2a04f0118d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:06.374208 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c5688-0fb6-4faf-87f0-81b974f65ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:06.374978 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c5688-0fb6-4faf-87f0-81b974f65ad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:06.375978 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c5688-0fb6-4faf-87f0-81b974f65ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:06.378852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c5688-0fb6-4faf-87f0-81b974f65ad3 admin admin] PATH_INFO: `/v3/projects/058b4dd65527402bbc443d6447f77d5b/users/e1323d8a945047da813294f77be3185e/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:06.385358 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3588/7188] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:31:06.386307 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb50a4-74bb-45ad-9d46-da2a04f0118d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:06.401218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb50a4-74bb-45ad-9d46-da2a04f0118d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:06.409013 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7685dff-e065-4d9d-a878-946b1e0f9dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:06.410120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7685dff-e065-4d9d-a878-946b1e0f9dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:06.410691 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7685dff-e065-4d9d-a878-946b1e0f9dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:06.410968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7685dff-e065-4d9d-a878-946b1e0f9dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:06.411672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7685dff-e065-4d9d-a878-946b1e0f9dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:06.412545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c5688-0fb6-4faf-87f0-81b974f65ad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=058b4dd65527402bbc443d6447f77d5b, user_id=e1323d8a945047da813294f77be3185e, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:06.413275 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7685dff-e065-4d9d-a878-946b1e0f9dc0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:06.417680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c5688-0fb6-4faf-87f0-81b974f65ad3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:06.425538 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3589/7189] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:31:06.427366 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7685dff-e065-4d9d-a878-946b1e0f9dc0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:06.442595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7685dff-e065-4d9d-a878-946b1e0f9dc0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:06.446804 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3601/7190] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:31:06 2022] PUT /identity/v3/projects/058b4dd65527402bbc443d6447f77d5b/users/e1323d8a945047da813294f77be3185e/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:06.447622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c5688-0fb6-4faf-87f0-81b974f65ad3 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:06.536825 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4314eef-da5a-49e5-8d25-723e6628d6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:06.537604 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4314eef-da5a-49e5-8d25-723e6628d6f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:06.537884 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4314eef-da5a-49e5-8d25-723e6628d6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:06.538399 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4314eef-da5a-49e5-8d25-723e6628d6f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:06.539045 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4314eef-da5a-49e5-8d25-723e6628d6f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:06.542811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4314eef-da5a-49e5-8d25-723e6628d6f4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:06.558705 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c5688-0fb6-4faf-87f0-81b974f65ad3 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:06.577679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa3b34-a6b3-479f-829d-4725ed4b7cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:06.578950 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa3b34-a6b3-479f-829d-4725ed4b7cdc admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:06.579577 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa3b34-a6b3-479f-829d-4725ed4b7cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:06.580086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa3b34-a6b3-479f-829d-4725ed4b7cdc admin admin] PATH_INFO: `/v3/projects/526c1b88ca60470ebeaf5e0a56642cfd/users/27bde243ea094be295fbb8e4555cde54/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:06.583222 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa3b34-a6b3-479f-829d-4725ed4b7cdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=526c1b88ca60470ebeaf5e0a56642cfd, user_id=27bde243ea094be295fbb8e4555cde54, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:06.587111 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa3b34-a6b3-479f-829d-4725ed4b7cdc admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:06.600858 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3602/7191] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:31:06 2022] PUT /identity/v3/projects/526c1b88ca60470ebeaf5e0a56642cfd/users/27bde243ea094be295fbb8e4555cde54/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:06.602047 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3590/7192] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:31:06 2022] POST /identity/v3/projects => generated 375 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:31:06.602865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fbc05-52a3-4485-a04b-bb1ca39d7331 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:06.603146 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4314eef-da5a-49e5-8d25-723e6628d6f4 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:06.603521 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fbc05-52a3-4485-a04b-bb1ca39d7331 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:06.604031 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fbc05-52a3-4485-a04b-bb1ca39d7331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:06.662650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-558fbc05-52a3-4485-a04b-bb1ca39d7331 None None] MFA Rules not processed for user `e1323d8a945047da813294f77be3185e`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:06.666455 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-558fbc05-52a3-4485-a04b-bb1ca39d7331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:06.720316 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:06.735656 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4314eef-da5a-49e5-8d25-723e6628d6f4 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:06.747492 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee8259-42ed-4a7a-b2a0-65e675c0384d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:06.750436 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee8259-42ed-4a7a-b2a0-65e675c0384d admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:06.750726 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee8259-42ed-4a7a-b2a0-65e675c0384d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:06.751012 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee8259-42ed-4a7a-b2a0-65e675c0384d admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:06.753416 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdee8259-42ed-4a7a-b2a0-65e675c0384d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:06.760391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdee8259-42ed-4a7a-b2a0-65e675c0384d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:06.768968 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3603/7193] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:06.770818 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3e94d-6e7a-4862-b1fb-42d5ed760c61 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:06.771352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3e94d-6e7a-4862-b1fb-42d5ed760c61 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:06.771869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3e94d-6e7a-4862-b1fb-42d5ed760c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:06.812863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-55b3e94d-6e7a-4862-b1fb-42d5ed760c61 None None] MFA Rules not processed for user `27bde243ea094be295fbb8e4555cde54`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:06.814132 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-55b3e94d-6e7a-4862-b1fb-42d5ed760c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:06.830742 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3591/7194] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:31:06 2022] POST /identity/v3/users => generated 288 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:31:06.839022 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee8259-42ed-4a7a-b2a0-65e675c0384d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:06.865763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee8259-42ed-4a7a-b2a0-65e675c0384d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:06.871284 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5fe024-a8c1-464d-a72f-0a5248490c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:06.872189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fe024-a8c1-464d-a72f-0a5248490c07 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:06.872703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fe024-a8c1-464d-a72f-0a5248490c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:06.873193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fe024-a8c1-464d-a72f-0a5248490c07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:06.874092 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5fe024-a8c1-464d-a72f-0a5248490c07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:06.876638 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5fe024-a8c1-464d-a72f-0a5248490c07 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:06.904719 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:06.921116 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3592/7195] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:31:06 2022] POST /identity/v3/projects => generated 367 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:31:06.922635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5fe024-a8c1-464d-a72f-0a5248490c07 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:06.924998 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3604/7196] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:06 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:06.926034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3e94d-6e7a-4862-b1fb-42d5ed760c61 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:06.937545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3e94d-6e7a-4862-b1fb-42d5ed760c61 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:07.008429 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5fe024-a8c1-464d-a72f-0a5248490c07 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:07.016331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9f3a5-f45d-4ded-a302-13ed85aae749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:07.017130 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9f3a5-f45d-4ded-a302-13ed85aae749 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:07.017538 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9f3a5-f45d-4ded-a302-13ed85aae749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:07.017935 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9f3a5-f45d-4ded-a302-13ed85aae749 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:07.018669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9f3a5-f45d-4ded-a302-13ed85aae749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:07.020580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9f3a5-f45d-4ded-a302-13ed85aae749 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:07.036447 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3593/7197] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:31:07.036447 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9f3a5-f45d-4ded-a302-13ed85aae749 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:07.050229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9f3a5-f45d-4ded-a302-13ed85aae749 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:07.056774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100fefe-1030-4aef-9f13-8fef3de0269a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:07.057585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100fefe-1030-4aef-9f13-8fef3de0269a admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:07.057917 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100fefe-1030-4aef-9f13-8fef3de0269a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:07.058349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100fefe-1030-4aef-9f13-8fef3de0269a admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:07.059134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100fefe-1030-4aef-9f13-8fef3de0269a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:07.061996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100fefe-1030-4aef-9f13-8fef3de0269a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:07.099871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159c624-4d15-4405-a885-cb77b61316bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:07.100954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159c624-4d15-4405-a885-cb77b61316bb admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:07.101845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159c624-4d15-4405-a885-cb77b61316bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:07.102377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159c624-4d15-4405-a885-cb77b61316bb admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:07.103200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159c624-4d15-4405-a885-cb77b61316bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:07.108693 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3594/7198] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:31:07 2022] POST /identity/v3/projects => generated 379 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:31:07.108859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159c624-4d15-4405-a885-cb77b61316bb admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:07.108968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100fefe-1030-4aef-9f13-8fef3de0269a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:07.139875 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3605/7199] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:31:06 2022] POST /identity/v3/users => generated 284 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:31:07.141780 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159c624-4d15-4405-a885-cb77b61316bb admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:07.154003 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159c624-4d15-4405-a885-cb77b61316bb admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:07.183810 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100fefe-1030-4aef-9f13-8fef3de0269a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:07.190932 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b11504-d79c-4031-be8d-34ce6a080ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:07.191720 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b11504-d79c-4031-be8d-34ce6a080ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:07.192070 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b11504-d79c-4031-be8d-34ce6a080ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:07.192628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b11504-d79c-4031-be8d-34ce6a080ab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:07.193494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b11504-d79c-4031-be8d-34ce6a080ab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:07.196764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b11504-d79c-4031-be8d-34ce6a080ab0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:07.219411 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3595/7200] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:31:07.219411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b11504-d79c-4031-be8d-34ce6a080ab0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:07.229822 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:07.237659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b11504-d79c-4031-be8d-34ce6a080ab0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:07.250627 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed724385-cc2d-4aa5-af09-8bc3d9007488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:07.251258 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed724385-cc2d-4aa5-af09-8bc3d9007488 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:07.251875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed724385-cc2d-4aa5-af09-8bc3d9007488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:07.252015 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e4ce6-777d-456a-a3a7-5f687f82b30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:07.252119 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed724385-cc2d-4aa5-af09-8bc3d9007488 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:07.252300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e4ce6-777d-456a-a3a7-5f687f82b30f admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:07.252506 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e4ce6-777d-456a-a3a7-5f687f82b30f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:07.252612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed724385-cc2d-4aa5-af09-8bc3d9007488 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:07.252778 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e4ce6-777d-456a-a3a7-5f687f82b30f admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:07.253846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e4ce6-777d-456a-a3a7-5f687f82b30f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:07.254557 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed724385-cc2d-4aa5-af09-8bc3d9007488 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:07.255059 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e4ce6-777d-456a-a3a7-5f687f82b30f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:07.280105 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3596/7201] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:31:07.281158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e4ce6-777d-456a-a3a7-5f687f82b30f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:07.285600 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3606/7202] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:31:07 2022] POST /identity/v3/users => generated 290 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:31:07.287966 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed724385-cc2d-4aa5-af09-8bc3d9007488 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:07.295393 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e4ce6-777d-456a-a3a7-5f687f82b30f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:07.301258 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b22d6-a6d9-4392-b4f2-5c59d54df96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:07.302057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b22d6-a6d9-4392-b4f2-5c59d54df96a admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:07.302238 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b22d6-a6d9-4392-b4f2-5c59d54df96a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:07.302513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b22d6-a6d9-4392-b4f2-5c59d54df96a admin admin] PATH_INFO: `/v3/projects/8b7ba737d95c4c23a9ebfd5344f3b7ef/users/5dd07f62b0974feda6345df8442b5020/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:07.316351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed724385-cc2d-4aa5-af09-8bc3d9007488 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:07.322108 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b22d6-a6d9-4392-b4f2-5c59d54df96a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b7ba737d95c4c23a9ebfd5344f3b7ef, user_id=5dd07f62b0974feda6345df8442b5020, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:07.325233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b22d6-a6d9-4392-b4f2-5c59d54df96a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:07.328936 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16797b57-6d71-4ac3-b477-8101aa6a7898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:07.329985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16797b57-6d71-4ac3-b477-8101aa6a7898 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:07.331335 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16797b57-6d71-4ac3-b477-8101aa6a7898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:07.331663 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16797b57-6d71-4ac3-b477-8101aa6a7898 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:07.332369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16797b57-6d71-4ac3-b477-8101aa6a7898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:07.336294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16797b57-6d71-4ac3-b477-8101aa6a7898 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:07.357513 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3597/7203] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:31:07 2022] PUT /identity/v3/projects/8b7ba737d95c4c23a9ebfd5344f3b7ef/users/5dd07f62b0974feda6345df8442b5020/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:07.357513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b22d6-a6d9-4392-b4f2-5c59d54df96a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:07.358174 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3607/7204] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:31:07.360164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc0191-3680-425e-a55d-85fec9b83a03 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:07.360755 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc0191-3680-425e-a55d-85fec9b83a03 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:07.360755 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc0191-3680-425e-a55d-85fec9b83a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:07.419792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-3cfc0191-3680-425e-a55d-85fec9b83a03 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:07.422770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3cfc0191-3680-425e-a55d-85fec9b83a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:07.440782 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:07.477019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b22d6-a6d9-4392-b4f2-5c59d54df96a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:07.487943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445efeb-6fde-4d2c-a084-dc08acf15906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:07.487943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445efeb-6fde-4d2c-a084-dc08acf15906 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:07.487943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445efeb-6fde-4d2c-a084-dc08acf15906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:07.487943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445efeb-6fde-4d2c-a084-dc08acf15906 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:07.488788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445efeb-6fde-4d2c-a084-dc08acf15906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:07.490932 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445efeb-6fde-4d2c-a084-dc08acf15906 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:07.506797 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3598/7205] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:31:07.506797 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e8747-ae1d-45ce-be66-9072b7bd3d2b None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:07.506797 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e8747-ae1d-45ce-be66-9072b7bd3d2b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:07.506797 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e8747-ae1d-45ce-be66-9072b7bd3d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:07.545987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b55e8747-ae1d-45ce-be66-9072b7bd3d2b None None] MFA Rules not processed for user `5dd07f62b0974feda6345df8442b5020`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:07.548449 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b55e8747-ae1d-45ce-be66-9072b7bd3d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:07.562293 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3608/7206] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 01:31:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:07.565075 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc0191-3680-425e-a55d-85fec9b83a03 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:07.595018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc0191-3680-425e-a55d-85fec9b83a03 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:07.603805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67512f4-098e-4b8b-9054-1fef6d5365dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:07.604910 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67512f4-098e-4b8b-9054-1fef6d5365dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:07.604910 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67512f4-098e-4b8b-9054-1fef6d5365dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:07.605652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67512f4-098e-4b8b-9054-1fef6d5365dd admin admin] PATH_INFO: `/v3/projects/7a120814562340fb8d8405ebbb7f88b4/users/5c292ed8740c40419e7af6c073857ecd/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:07.647701 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67512f4-098e-4b8b-9054-1fef6d5365dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a120814562340fb8d8405ebbb7f88b4, user_id=5c292ed8740c40419e7af6c073857ecd, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:07.651517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67512f4-098e-4b8b-9054-1fef6d5365dd admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:07.681611 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3609/7207] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:31:07 2022] PUT /identity/v3/projects/7a120814562340fb8d8405ebbb7f88b4/users/5c292ed8740c40419e7af6c073857ecd/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:07.683869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67512f4-098e-4b8b-9054-1fef6d5365dd admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:07.705674 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3599/7208] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:07.706767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e8747-ae1d-45ce-be66-9072b7bd3d2b None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:07.719811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b55e8747-ae1d-45ce-be66-9072b7bd3d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:07.824034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67512f4-098e-4b8b-9054-1fef6d5365dd admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:07.849717 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc835e-d333-4717-80e4-a3835899a103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:07.850612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc835e-d333-4717-80e4-a3835899a103 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:07.852473 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc835e-d333-4717-80e4-a3835899a103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:07.854317 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc835e-d333-4717-80e4-a3835899a103 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:07.855158 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc835e-d333-4717-80e4-a3835899a103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:07.858941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc835e-d333-4717-80e4-a3835899a103 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:07.881471 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3610/7209] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:31:07.886934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b36484-de0e-4781-9744-b315df9e88b4 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:07.887209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b36484-de0e-4781-9744-b315df9e88b4 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:07.887515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b36484-de0e-4781-9744-b315df9e88b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:07.893324 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e8747-ae1d-45ce-be66-9072b7bd3d2b None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:07.945362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c9b36484-de0e-4781-9744-b315df9e88b4 None None] MFA Rules not processed for user `5c292ed8740c40419e7af6c073857ecd`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:07.946771 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c9b36484-de0e-4781-9744-b315df9e88b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:07.975610 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:08.006028 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:08.034152 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1755f0d-e00a-4460-b14c-85aa6e07433a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:08.034947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1755f0d-e00a-4460-b14c-85aa6e07433a service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:08.035323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1755f0d-e00a-4460-b14c-85aa6e07433a service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:08.036518 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1755f0d-e00a-4460-b14c-85aa6e07433a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:08.062684 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3611/7210] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:08.063773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b36484-de0e-4781-9744-b315df9e88b4 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:08.075985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c9b36484-de0e-4781-9744-b315df9e88b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:08.161163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b36484-de0e-4781-9744-b315df9e88b4 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:08.161577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1755f0d-e00a-4460-b14c-85aa6e07433a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:08.163319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1755f0d-e00a-4460-b14c-85aa6e07433a service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:08.167380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744838b-9966-4422-a0ee-238b31b1b980 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:08.168425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744838b-9966-4422-a0ee-238b31b1b980 service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:08.168545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744838b-9966-4422-a0ee-238b31b1b980 service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:08.168721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744838b-9966-4422-a0ee-238b31b1b980 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:08.181424 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3600/7211] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:31:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:31:08.183437 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1755f0d-e00a-4460-b14c-85aa6e07433a service swift] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:08.219681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1755f0d-e00a-4460-b14c-85aa6e07433a service swift] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:08.232095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2669471-9d73-41d4-aad6-6311fe0263eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:08.233054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2669471-9d73-41d4-aad6-6311fe0263eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:08.233255 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2669471-9d73-41d4-aad6-6311fe0263eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:08.233623 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2669471-9d73-41d4-aad6-6311fe0263eb admin admin] PATH_INFO: `/v3/projects/39fbba8224db4b0aa514303915177d96/users/0b6ce31eda044529b6358a16f4a4d852/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:08.280785 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2669471-9d73-41d4-aad6-6311fe0263eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=39fbba8224db4b0aa514303915177d96, user_id=0b6ce31eda044529b6358a16f4a4d852, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:08.286647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2669471-9d73-41d4-aad6-6311fe0263eb admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:08.322922 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3601/7212] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:31:08 2022] PUT /identity/v3/projects/39fbba8224db4b0aa514303915177d96/users/0b6ce31eda044529b6358a16f4a4d852/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:08.323780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2669471-9d73-41d4-aad6-6311fe0263eb admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:08.330657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a2669471-9d73-41d4-aad6-6311fe0263eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:08.452930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0744838b-9966-4422-a0ee-238b31b1b980 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:08.458559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0744838b-9966-4422-a0ee-238b31b1b980 service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:08.488122 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3612/7213] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:31:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:31:08.489588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731caf4-4e15-4e92-9f56-8db97bf87201 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:08.489881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731caf4-4e15-4e92-9f56-8db97bf87201 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:08.490159 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731caf4-4e15-4e92-9f56-8db97bf87201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:08.567077 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2669471-9d73-41d4-aad6-6311fe0263eb admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:08.576343 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab7d79-d040-4df3-8f4d-36a799954593 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efcee9b21ea94b1b8e5c9c5acb35839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:08.578817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab7d79-d040-4df3-8f4d-36a799954593 service glance] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:08.579313 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab7d79-d040-4df3-8f4d-36a799954593 service glance] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:08.590887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab7d79-d040-4df3-8f4d-36a799954593 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:08.642155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-d731caf4-4e15-4e92-9f56-8db97bf87201 None None] MFA Rules not processed for user `0b6ce31eda044529b6358a16f4a4d852`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:08.649481 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d731caf4-4e15-4e92-9f56-8db97bf87201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:08.767677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab7d79-d040-4df3-8f4d-36a799954593 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:08.770495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab7d79-d040-4df3-8f4d-36a799954593 service glance] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:08.820761 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3602/7214] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:31:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:31:08.890443 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3613/7215] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:09.052879 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab7d79-d040-4df3-8f4d-36a799954593 service glance] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:09.069123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab7d79-d040-4df3-8f4d-36a799954593 service glance] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:09.076888 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713b8fe-b25a-4c04-9dbd-33b96af2dccf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efcee9b21ea94b1b8e5c9c5acb35839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:09.079978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713b8fe-b25a-4c04-9dbd-33b96af2dccf service glance] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:09.081714 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713b8fe-b25a-4c04-9dbd-33b96af2dccf service glance] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:09.082210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713b8fe-b25a-4c04-9dbd-33b96af2dccf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:09.117875 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:09.291955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8713b8fe-b25a-4c04-9dbd-33b96af2dccf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:09.292985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731caf4-4e15-4e92-9f56-8db97bf87201 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:09.293450 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8713b8fe-b25a-4c04-9dbd-33b96af2dccf service glance] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:09.294457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d731caf4-4e15-4e92-9f56-8db97bf87201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:09.321825 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3603/7216] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:31:09 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:31:09.339323 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731caf4-4e15-4e92-9f56-8db97bf87201 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:09.368912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b850037-52cd-4274-93ff-ebf9273dbb89 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efcee9b21ea94b1b8e5c9c5acb35839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:09.369598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b850037-52cd-4274-93ff-ebf9273dbb89 service glance] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:09.369890 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b850037-52cd-4274-93ff-ebf9273dbb89 service glance] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:09.370172 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b850037-52cd-4274-93ff-ebf9273dbb89 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:09.385756 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:09.571783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b850037-52cd-4274-93ff-ebf9273dbb89 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:09.590528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b850037-52cd-4274-93ff-ebf9273dbb89 service glance] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:09.633382 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3614/7217] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:31:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:31:11.110211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713b8fe-b25a-4c04-9dbd-33b96af2dccf service glance] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:11.266838 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713b8fe-b25a-4c04-9dbd-33b96af2dccf service glance] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:11.282197 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9befd-d54f-4d26-b3fd-052840a87e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:11.283480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9befd-d54f-4d26-b3fd-052840a87e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:11.284052 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9befd-d54f-4d26-b3fd-052840a87e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:11.284682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9befd-d54f-4d26-b3fd-052840a87e24 admin admin] PATH_INFO: `/v3/users/27bde243ea094be295fbb8e4555cde54` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:11.291953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad9befd-d54f-4d26-b3fd-052840a87e24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27bde243ea094be295fbb8e4555cde54)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:11.295148 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad9befd-d54f-4d26-b3fd-052840a87e24 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:11.388581 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7ad9befd-d54f-4d26-b3fd-052840a87e24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27bde243ea094be295fbb8e4555cde54'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:11.389917 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7ad9befd-d54f-4d26-b3fd-052840a87e24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27bde243ea094be295fbb8e4555cde54'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:11.429955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7ad9befd-d54f-4d26-b3fd-052840a87e24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27bde243ea094be295fbb8e4555cde54'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:11.467268 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7ad9befd-d54f-4d26-b3fd-052840a87e24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27bde243ea094be295fbb8e4555cde54'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:11.469498 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7ad9befd-d54f-4d26-b3fd-052840a87e24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27bde243ea094be295fbb8e4555cde54'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:11.583609 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3604/7218] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:31:11 2022] DELETE /identity/v3/users/27bde243ea094be295fbb8e4555cde54 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:11.588224 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33befd2-6004-495e-a173-2b4a470a4c35 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:11.589187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33befd2-6004-495e-a173-2b4a470a4c35 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:11.589658 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33befd2-6004-495e-a173-2b4a470a4c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:11.664870 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-f33befd2-6004-495e-a173-2b4a470a4c35 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:11.666139 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f33befd2-6004-495e-a173-2b4a470a4c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:11.891884 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3615/7219] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:11.914895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9befd-d54f-4d26-b3fd-052840a87e24 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:11.916332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7ad9befd-d54f-4d26-b3fd-052840a87e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:12.045936 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:12.114736 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9befd-d54f-4d26-b3fd-052840a87e24 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:12.126589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510a738-8acb-4848-ba42-89607d29ab2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:12.127051 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510a738-8acb-4848-ba42-89607d29ab2a service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:12.127671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510a738-8acb-4848-ba42-89607d29ab2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:12.128262 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510a738-8acb-4848-ba42-89607d29ab2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:12.144782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1510a738-8acb-4848-ba42-89607d29ab2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:12.152817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1510a738-8acb-4848-ba42-89607d29ab2a service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:12.175810 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3605/7220] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:31:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:31:12.500380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac15338-0f94-4751-8aad-772da6adc4a0 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:12.501063 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac15338-0f94-4751-8aad-772da6adc4a0 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:12.501732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac15338-0f94-4751-8aad-772da6adc4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:12.554171 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-5ac15338-0f94-4751-8aad-772da6adc4a0 None None] MFA Rules not processed for user `3153fef46b654b4d9d4f6876b51b602a`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:12.563819 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5ac15338-0f94-4751-8aad-772da6adc4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:12.721009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510a738-8acb-4848-ba42-89607d29ab2a service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:12.722338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1510a738-8acb-4848-ba42-89607d29ab2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:12.746090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510a738-8acb-4848-ba42-89607d29ab2a service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:12.758929 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3616/7221] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:12.773842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad03ead-373b-4c8c-842b-a04c04d9e271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:12.774499 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad03ead-373b-4c8c-842b-a04c04d9e271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:12.774781 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad03ead-373b-4c8c-842b-a04c04d9e271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:12.775051 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad03ead-373b-4c8c-842b-a04c04d9e271 admin admin] PATH_INFO: `/v3/users/e1323d8a945047da813294f77be3185e` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:12.779939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad03ead-373b-4c8c-842b-a04c04d9e271 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1323d8a945047da813294f77be3185e)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:12.786852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad03ead-373b-4c8c-842b-a04c04d9e271 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:12.813357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a02e93-3664-49f0-a762-bdb10f5c0e39 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:12.813889 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a02e93-3664-49f0-a762-bdb10f5c0e39 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:12.814043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a02e93-3664-49f0-a762-bdb10f5c0e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:12.886765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-48a02e93-3664-49f0-a762-bdb10f5c0e39 None None] MFA Rules not processed for user `5dd07f62b0974feda6345df8442b5020`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:12.888048 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-48a02e93-3664-49f0-a762-bdb10f5c0e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:12.922033 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-bad03ead-373b-4c8c-842b-a04c04d9e271 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1323d8a945047da813294f77be3185e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:12.925686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-bad03ead-373b-4c8c-842b-a04c04d9e271 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1323d8a945047da813294f77be3185e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:12.949396 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-bad03ead-373b-4c8c-842b-a04c04d9e271 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1323d8a945047da813294f77be3185e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:12.968366 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-bad03ead-373b-4c8c-842b-a04c04d9e271 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1323d8a945047da813294f77be3185e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:12.969812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-bad03ead-373b-4c8c-842b-a04c04d9e271 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1323d8a945047da813294f77be3185e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:12.995931 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3606/7222] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:31:12 2022] DELETE /identity/v3/users/e1323d8a945047da813294f77be3185e => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:12.999387 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1050fa-57d6-4e1c-828d-dd10f9ff3725 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:12.999688 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1050fa-57d6-4e1c-828d-dd10f9ff3725 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:13.000500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1050fa-57d6-4e1c-828d-dd10f9ff3725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:13.031555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-6e1050fa-57d6-4e1c-828d-dd10f9ff3725 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:13.033299 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6e1050fa-57d6-4e1c-828d-dd10f9ff3725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:13.044391 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:13.072728 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3617/7223] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:13.108325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a02e93-3664-49f0-a762-bdb10f5c0e39 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:13.110462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-48a02e93-3664-49f0-a762-bdb10f5c0e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:13.138587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a02e93-3664-49f0-a762-bdb10f5c0e39 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:13.213813 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3607/7224] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:13.273950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1050fa-57d6-4e1c-828d-dd10f9ff3725 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:13.276070 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6e1050fa-57d6-4e1c-828d-dd10f9ff3725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:13.290705 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1561d-3cb5-47cc-bff9-b6be831b7337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:13.291706 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1561d-3cb5-47cc-bff9-b6be831b7337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:13.292020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1561d-3cb5-47cc-bff9-b6be831b7337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:13.292401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1561d-3cb5-47cc-bff9-b6be831b7337 admin admin] PATH_INFO: `/v3/projects/526c1b88ca60470ebeaf5e0a56642cfd` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:13.293823 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1561d-3cb5-47cc-bff9-b6be831b7337 admin admin] RBAC: Authorizing `identity:delete_project(project_id=526c1b88ca60470ebeaf5e0a56642cfd)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:13.296505 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1561d-3cb5-47cc-bff9-b6be831b7337 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:13.382815 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:13.384089 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-36c1561d-3cb5-47cc-bff9-b6be831b7337 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '526c1b88ca60470ebeaf5e0a56642cfd', 'request_id': 'req-36c1561d-3cb5-47cc-bff9-b6be831b7337'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:13.402742 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-36c1561d-3cb5-47cc-bff9-b6be831b7337 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '526c1b88ca60470ebeaf5e0a56642cfd', 'request_id': 'req-36c1561d-3cb5-47cc-bff9-b6be831b7337'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:13.410710 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1050fa-57d6-4e1c-828d-dd10f9ff3725 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:13.420548 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-36c1561d-3cb5-47cc-bff9-b6be831b7337 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '526c1b88ca60470ebeaf5e0a56642cfd', 'request_id': 'req-36c1561d-3cb5-47cc-bff9-b6be831b7337'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:13.459218 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-36c1561d-3cb5-47cc-bff9-b6be831b7337 admin admin] The token cache is being invalidate because project 526c1b88ca60470ebeaf5e0a56642cfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:31:13.459519 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-36c1561d-3cb5-47cc-bff9-b6be831b7337 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:13.460218 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-36c1561d-3cb5-47cc-bff9-b6be831b7337 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:13.468389 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3618/7225] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:31:13 2022] DELETE /identity/v3/projects/526c1b88ca60470ebeaf5e0a56642cfd => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:31:13.470446 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1561d-3cb5-47cc-bff9-b6be831b7337 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:13.474526 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-36c1561d-3cb5-47cc-bff9-b6be831b7337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:13.536526 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc27dd4-7a07-4745-841d-2fd0599c5f4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:13.536859 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc27dd4-7a07-4745-841d-2fd0599c5f4c service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:13.537349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc27dd4-7a07-4745-841d-2fd0599c5f4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:13.537826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc27dd4-7a07-4745-841d-2fd0599c5f4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:13.541844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4dc27dd4-7a07-4745-841d-2fd0599c5f4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:13.696394 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1561d-3cb5-47cc-bff9-b6be831b7337 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:13.712581 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffcd909-cb5a-4276-96cd-5747c7a7c3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:13.719562 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcd909-cb5a-4276-96cd-5747c7a7c3ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:13.721330 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcd909-cb5a-4276-96cd-5747c7a7c3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:13.721860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcd909-cb5a-4276-96cd-5747c7a7c3ac admin admin] PATH_INFO: `/v3/users/0b6ce31eda044529b6358a16f4a4d852` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:13.725967 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffcd909-cb5a-4276-96cd-5747c7a7c3ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b6ce31eda044529b6358a16f4a4d852)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:13.729930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffcd909-cb5a-4276-96cd-5747c7a7c3ac admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:13.802939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc27dd4-7a07-4745-841d-2fd0599c5f4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:13.804439 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc27dd4-7a07-4745-841d-2fd0599c5f4c service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:13.822621 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3608/7226] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:31:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:31:13.827334 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:13.854938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7ffcd909-cb5a-4276-96cd-5747c7a7c3ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b6ce31eda044529b6358a16f4a4d852'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:13.855818 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7ffcd909-cb5a-4276-96cd-5747c7a7c3ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b6ce31eda044529b6358a16f4a4d852'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:13.866196 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7ffcd909-cb5a-4276-96cd-5747c7a7c3ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b6ce31eda044529b6358a16f4a4d852'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:13.885319 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7ffcd909-cb5a-4276-96cd-5747c7a7c3ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b6ce31eda044529b6358a16f4a4d852'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:13.886079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7ffcd909-cb5a-4276-96cd-5747c7a7c3ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b6ce31eda044529b6358a16f4a4d852'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:13.936155 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3619/7227] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:31:13 2022] DELETE /identity/v3/users/0b6ce31eda044529b6358a16f4a4d852 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:14.419633 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc27dd4-7a07-4745-841d-2fd0599c5f4c service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:14.424349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4dc27dd4-7a07-4745-841d-2fd0599c5f4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:14.462668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffcd909-cb5a-4276-96cd-5747c7a7c3ac admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:14.464188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7ffcd909-cb5a-4276-96cd-5747c7a7c3ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:14.703984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffcd909-cb5a-4276-96cd-5747c7a7c3ac admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:14.710552 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d3253-38ad-4bbf-95a6-2dc71a172084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:14.711737 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d3253-38ad-4bbf-95a6-2dc71a172084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:14.712220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d3253-38ad-4bbf-95a6-2dc71a172084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:14.712659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d3253-38ad-4bbf-95a6-2dc71a172084 admin admin] PATH_INFO: `/v3/projects/39fbba8224db4b0aa514303915177d96` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:14.714013 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338d3253-38ad-4bbf-95a6-2dc71a172084 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39fbba8224db4b0aa514303915177d96)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:14.716499 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc27dd4-7a07-4745-841d-2fd0599c5f4c service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:14.725409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338d3253-38ad-4bbf-95a6-2dc71a172084 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:14.797913 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:14.844225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94459a91-b48f-4bb9-9190-80fdb8452919 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:14.845239 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94459a91-b48f-4bb9-9190-80fdb8452919 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:14.845590 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94459a91-b48f-4bb9-9190-80fdb8452919 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:14.845980 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94459a91-b48f-4bb9-9190-80fdb8452919 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:14.850742 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-94459a91-b48f-4bb9-9190-80fdb8452919 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:14.868945 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-338d3253-38ad-4bbf-95a6-2dc71a172084 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39fbba8224db4b0aa514303915177d96', 'request_id': 'req-338d3253-38ad-4bbf-95a6-2dc71a172084'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:14.883372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-338d3253-38ad-4bbf-95a6-2dc71a172084 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39fbba8224db4b0aa514303915177d96', 'request_id': 'req-338d3253-38ad-4bbf-95a6-2dc71a172084'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:14.885930 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94459a91-b48f-4bb9-9190-80fdb8452919 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:14.888397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94459a91-b48f-4bb9-9190-80fdb8452919 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:14.890605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-338d3253-38ad-4bbf-95a6-2dc71a172084 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39fbba8224db4b0aa514303915177d96', 'request_id': 'req-338d3253-38ad-4bbf-95a6-2dc71a172084'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:14.904126 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-338d3253-38ad-4bbf-95a6-2dc71a172084 admin admin] The token cache is being invalidate because project 39fbba8224db4b0aa514303915177d96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:31:14.904601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-338d3253-38ad-4bbf-95a6-2dc71a172084 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:14.905492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-338d3253-38ad-4bbf-95a6-2dc71a172084 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:14.910913 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3620/7228] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:31:14 2022] DELETE /identity/v3/projects/39fbba8224db4b0aa514303915177d96 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:31:14.914850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d3253-38ad-4bbf-95a6-2dc71a172084 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:14.916873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-338d3253-38ad-4bbf-95a6-2dc71a172084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:14.922483 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3609/7229] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:31:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:31:14.923774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94459a91-b48f-4bb9-9190-80fdb8452919 service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:14.928109 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-94459a91-b48f-4bb9-9190-80fdb8452919 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:14.959297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94459a91-b48f-4bb9-9190-80fdb8452919 service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:14.975074 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:15.015905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d3253-38ad-4bbf-95a6-2dc71a172084 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:15.022865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da786dc-9b51-41ee-8479-6f115878f8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:15.024097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da786dc-9b51-41ee-8479-6f115878f8df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:15.024643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da786dc-9b51-41ee-8479-6f115878f8df admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:15.025073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da786dc-9b51-41ee-8479-6f115878f8df admin admin] PATH_INFO: `/v3/projects/058b4dd65527402bbc443d6447f77d5b` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:15.026657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da786dc-9b51-41ee-8479-6f115878f8df admin admin] RBAC: Authorizing `identity:delete_project(project_id=058b4dd65527402bbc443d6447f77d5b)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:15.029602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da786dc-9b51-41ee-8479-6f115878f8df admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:15.110057 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9da786dc-9b51-41ee-8479-6f115878f8df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '058b4dd65527402bbc443d6447f77d5b', 'request_id': 'req-9da786dc-9b51-41ee-8479-6f115878f8df'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:15.111011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046fe73a-3ced-43bf-9590-cf9bcdfb0ea7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:15.112463 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fe73a-3ced-43bf-9590-cf9bcdfb0ea7 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:15.113717 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fe73a-3ced-43bf-9590-cf9bcdfb0ea7 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:15.113717 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fe73a-3ced-43bf-9590-cf9bcdfb0ea7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:15.116014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-046fe73a-3ced-43bf-9590-cf9bcdfb0ea7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:15.128997 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9da786dc-9b51-41ee-8479-6f115878f8df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '058b4dd65527402bbc443d6447f77d5b', 'request_id': 'req-9da786dc-9b51-41ee-8479-6f115878f8df'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:15.135952 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046fe73a-3ced-43bf-9590-cf9bcdfb0ea7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:15.137363 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9da786dc-9b51-41ee-8479-6f115878f8df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '058b4dd65527402bbc443d6447f77d5b', 'request_id': 'req-9da786dc-9b51-41ee-8479-6f115878f8df'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:15.137643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046fe73a-3ced-43bf-9590-cf9bcdfb0ea7 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:15.151547 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3610/7230] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:31:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:31:15.154283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b352c-b012-40ff-a0ff-299cb417352a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:15.154545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b352c-b012-40ff-a0ff-299cb417352a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:15.154884 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b352c-b012-40ff-a0ff-299cb417352a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:15.185850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9da786dc-9b51-41ee-8479-6f115878f8df admin admin] The token cache is being invalidate because project 058b4dd65527402bbc443d6447f77d5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:31:15.189051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9da786dc-9b51-41ee-8479-6f115878f8df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:15.189823 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9da786dc-9b51-41ee-8479-6f115878f8df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:15.191142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-1e5b352c-b012-40ff-a0ff-299cb417352a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:15.191617 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3621/7231] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:31:14 2022] DELETE /identity/v3/projects/058b4dd65527402bbc443d6447f77d5b => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:15.195215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1e5b352c-b012-40ff-a0ff-299cb417352a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:15.198176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da786dc-9b51-41ee-8479-6f115878f8df admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:15.204136 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9da786dc-9b51-41ee-8479-6f115878f8df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:15.327358 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3611/7232] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:15.330452 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511773c-451d-4510-aed4-ee698af8f859 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:15.330831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511773c-451d-4510-aed4-ee698af8f859 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:15.331229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511773c-451d-4510-aed4-ee698af8f859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:15.339055 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da786dc-9b51-41ee-8479-6f115878f8df admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:15.349402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd530d2e-023c-4c5a-951c-28386f0e975a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:15.350226 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd530d2e-023c-4c5a-951c-28386f0e975a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:15.350583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd530d2e-023c-4c5a-951c-28386f0e975a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:15.350936 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd530d2e-023c-4c5a-951c-28386f0e975a admin admin] PATH_INFO: `/v3/users/5c292ed8740c40419e7af6c073857ecd` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:15.352402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd530d2e-023c-4c5a-951c-28386f0e975a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c292ed8740c40419e7af6c073857ecd)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:15.354682 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd530d2e-023c-4c5a-951c-28386f0e975a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:15.360726 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-0511773c-451d-4510-aed4-ee698af8f859 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:15.362556 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0511773c-451d-4510-aed4-ee698af8f859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:15.384745 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3612/7233] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:31:15.389089 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511773c-451d-4510-aed4-ee698af8f859 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:15.404465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511773c-451d-4510-aed4-ee698af8f859 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:15.410643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a58112-323e-4600-a9f9-39d731bfc518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:15.411851 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a58112-323e-4600-a9f9-39d731bfc518 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:15.412197 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a58112-323e-4600-a9f9-39d731bfc518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:15.412540 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a58112-323e-4600-a9f9-39d731bfc518 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:15.413264 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a58112-323e-4600-a9f9-39d731bfc518 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:31:15.413657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a58112-323e-4600-a9f9-39d731bfc518 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:15.415559 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a58112-323e-4600-a9f9-39d731bfc518 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:15.433975 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-cd530d2e-023c-4c5a-951c-28386f0e975a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c292ed8740c40419e7af6c073857ecd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:15.434924 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-cd530d2e-023c-4c5a-951c-28386f0e975a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c292ed8740c40419e7af6c073857ecd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:15.440239 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3613/7234] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:31:15.447786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a58112-323e-4600-a9f9-39d731bfc518 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:15.450733 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a2a58112-323e-4600-a9f9-39d731bfc518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:15.466723 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-cd530d2e-023c-4c5a-951c-28386f0e975a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c292ed8740c40419e7af6c073857ecd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:15.477257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a58112-323e-4600-a9f9-39d731bfc518 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:15.488985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776eb4f-f118-4b7e-9b2a-964daca34fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:15.491569 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776eb4f-f118-4b7e-9b2a-964daca34fd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:15.492603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776eb4f-f118-4b7e-9b2a-964daca34fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:15.493596 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776eb4f-f118-4b7e-9b2a-964daca34fd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:15.494692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776eb4f-f118-4b7e-9b2a-964daca34fd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:15.496984 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776eb4f-f118-4b7e-9b2a-964daca34fd6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:15.502247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-cd530d2e-023c-4c5a-951c-28386f0e975a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c292ed8740c40419e7af6c073857ecd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:15.504431 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-cd530d2e-023c-4c5a-951c-28386f0e975a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c292ed8740c40419e7af6c073857ecd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:15.513779 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:15.552790 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3614/7235] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:31:15 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:31:15.554119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776eb4f-f118-4b7e-9b2a-964daca34fd6 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:15.566335 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3622/7236] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:31:15 2022] DELETE /identity/v3/users/5c292ed8740c40419e7af6c073857ecd => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:15.634535 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:15.771757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776eb4f-f118-4b7e-9b2a-964daca34fd6 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:15.950023 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fcee6-ea11-4a8f-9a46-c6a9caa1faa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:15.950809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fcee6-ea11-4a8f-9a46-c6a9caa1faa5 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:15.951187 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fcee6-ea11-4a8f-9a46-c6a9caa1faa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:15.951555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fcee6-ea11-4a8f-9a46-c6a9caa1faa5 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:15.952420 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7fcee6-ea11-4a8f-9a46-c6a9caa1faa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:15.954982 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7fcee6-ea11-4a8f-9a46-c6a9caa1faa5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:16.039907 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3615/7237] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:31:15 2022] POST /identity/v3/users => generated 292 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:31:16.041865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd530d2e-023c-4c5a-951c-28386f0e975a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:16.071858 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd530d2e-023c-4c5a-951c-28386f0e975a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:16.094057 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af80ad6-a1e3-4425-b388-46286a380d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:16.096002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af80ad6-a1e3-4425-b388-46286a380d4c admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:16.099112 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af80ad6-a1e3-4425-b388-46286a380d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:16.099393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af80ad6-a1e3-4425-b388-46286a380d4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:16.100089 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af80ad6-a1e3-4425-b388-46286a380d4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:16.106124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af80ad6-a1e3-4425-b388-46286a380d4c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:16.142186 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fcee6-ea11-4a8f-9a46-c6a9caa1faa5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:16.144641 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3623/7238] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:31:16.159145 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fcee6-ea11-4a8f-9a46-c6a9caa1faa5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:16.182164 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322e085-5c8c-4e48-8e48-793399d3c8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:16.182820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322e085-5c8c-4e48-8e48-793399d3c8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:16.183105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322e085-5c8c-4e48-8e48-793399d3c8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:16.183376 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322e085-5c8c-4e48-8e48-793399d3c8d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:16.184139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c322e085-5c8c-4e48-8e48-793399d3c8d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:16.185670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c322e085-5c8c-4e48-8e48-793399d3c8d7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:16.217310 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3616/7239] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:31:16.226532 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af80ad6-a1e3-4425-b388-46286a380d4c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:16.240844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af80ad6-a1e3-4425-b388-46286a380d4c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:16.250547 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea1e6c-dd3b-4487-b64a-df0b3203acfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:16.256428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea1e6c-dd3b-4487-b64a-df0b3203acfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:16.257943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea1e6c-dd3b-4487-b64a-df0b3203acfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:16.258459 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea1e6c-dd3b-4487-b64a-df0b3203acfd admin admin] PATH_INFO: `/v3/projects/dca44decdb30415885d559c97223e6d5/users/08c19525e0024047b28c65da81348eb6/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:16.307185 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ea1e6c-dd3b-4487-b64a-df0b3203acfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dca44decdb30415885d559c97223e6d5, user_id=08c19525e0024047b28c65da81348eb6, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:16.310491 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ea1e6c-dd3b-4487-b64a-df0b3203acfd admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:16.353363 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322e085-5c8c-4e48-8e48-793399d3c8d7 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:16.357368 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c322e085-5c8c-4e48-8e48-793399d3c8d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:16.374217 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3624/7240] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:31:16 2022] PUT /identity/v3/projects/dca44decdb30415885d559c97223e6d5/users/08c19525e0024047b28c65da81348eb6/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:16.376121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322e085-5c8c-4e48-8e48-793399d3c8d7 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:16.378765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c5f6b-0a1c-4f3d-80d0-f1a1b1fd9de0 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:16.379106 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c5f6b-0a1c-4f3d-80d0-f1a1b1fd9de0 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:16.379377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c5f6b-0a1c-4f3d-80d0-f1a1b1fd9de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:16.440435 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e90c5f6b-0a1c-4f3d-80d0-f1a1b1fd9de0 None None] MFA Rules not processed for user `08c19525e0024047b28c65da81348eb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:16.441777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e90c5f6b-0a1c-4f3d-80d0-f1a1b1fd9de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:16.491939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad9b58-2b74-4359-ba16-adf7ca48af98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:16.492749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad9b58-2b74-4359-ba16-adf7ca48af98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:16.493130 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad9b58-2b74-4359-ba16-adf7ca48af98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:16.494135 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad9b58-2b74-4359-ba16-adf7ca48af98 admin admin] PATH_INFO: `/v3/projects/7a120814562340fb8d8405ebbb7f88b4` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:16.495536 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad9b58-2b74-4359-ba16-adf7ca48af98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a120814562340fb8d8405ebbb7f88b4)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:16.509320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad9b58-2b74-4359-ba16-adf7ca48af98 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:16.598976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-79ad9b58-2b74-4359-ba16-adf7ca48af98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a120814562340fb8d8405ebbb7f88b4', 'request_id': 'req-79ad9b58-2b74-4359-ba16-adf7ca48af98'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:16.601043 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:16.614682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-79ad9b58-2b74-4359-ba16-adf7ca48af98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a120814562340fb8d8405ebbb7f88b4', 'request_id': 'req-79ad9b58-2b74-4359-ba16-adf7ca48af98'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:16.619575 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3625/7241] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:16.624471 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c5f6b-0a1c-4f3d-80d0-f1a1b1fd9de0 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:16.626177 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-79ad9b58-2b74-4359-ba16-adf7ca48af98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a120814562340fb8d8405ebbb7f88b4', 'request_id': 'req-79ad9b58-2b74-4359-ba16-adf7ca48af98'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:16.638806 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c5f6b-0a1c-4f3d-80d0-f1a1b1fd9de0 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:16.639065 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-79ad9b58-2b74-4359-ba16-adf7ca48af98 admin admin] The token cache is being invalidate because project 7a120814562340fb8d8405ebbb7f88b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:31:16.639320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-79ad9b58-2b74-4359-ba16-adf7ca48af98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:16.640010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-79ad9b58-2b74-4359-ba16-adf7ca48af98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:16.641697 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3617/7242] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:31:16 2022] DELETE /identity/v3/projects/7a120814562340fb8d8405ebbb7f88b4 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:16.647438 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb59a65-6748-4764-a22b-872715f2a6ed None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:16.648382 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb59a65-6748-4764-a22b-872715f2a6ed None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:16.648671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb59a65-6748-4764-a22b-872715f2a6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:16.675558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-ffb59a65-6748-4764-a22b-872715f2a6ed None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:16.676534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ffb59a65-6748-4764-a22b-872715f2a6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:16.726227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcd283-f9c8-4cab-8890-31e7f912f25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:16.726227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcd283-f9c8-4cab-8890-31e7f912f25d admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:16.726227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcd283-f9c8-4cab-8890-31e7f912f25d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:16.726227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcd283-f9c8-4cab-8890-31e7f912f25d admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:16.726561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fcd283-f9c8-4cab-8890-31e7f912f25d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:16.726561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fcd283-f9c8-4cab-8890-31e7f912f25d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:16.751992 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3626/7243] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:31:16 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:31:16.755967 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcd283-f9c8-4cab-8890-31e7f912f25d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:16.758687 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-36fcd283-f9c8-4cab-8890-31e7f912f25d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:16.761621 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3618/7244] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:16.770319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcaab1-7a91-4d32-906f-7876a80f6f36 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:16.770615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcaab1-7a91-4d32-906f-7876a80f6f36 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:16.770890 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcaab1-7a91-4d32-906f-7876a80f6f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:16.791783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c9bcaab1-7a91-4d32-906f-7876a80f6f36 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:16.793013 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c9bcaab1-7a91-4d32-906f-7876a80f6f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:16.795363 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:16.855002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcd283-f9c8-4cab-8890-31e7f912f25d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:16.862514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4036a6c-644d-499e-a3a0-f77fc1bda205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:16.863566 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4036a6c-644d-499e-a3a0-f77fc1bda205 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:16.864030 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4036a6c-644d-499e-a3a0-f77fc1bda205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:16.864465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4036a6c-644d-499e-a3a0-f77fc1bda205 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:16.865371 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4036a6c-644d-499e-a3a0-f77fc1bda205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:16.868195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4036a6c-644d-499e-a3a0-f77fc1bda205 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:16.886182 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3619/7245] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:16.890989 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bcaab1-7a91-4d32-906f-7876a80f6f36 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:16.903892 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bcaab1-7a91-4d32-906f-7876a80f6f36 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:16.908641 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3627/7246] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:31:16 2022] POST /identity/v3/users => generated 298 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:31:16.909941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4036a6c-644d-499e-a3a0-f77fc1bda205 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:16.911007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c414832-7602-4600-9ee0-ad4df0476c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:16.911848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c414832-7602-4600-9ee0-ad4df0476c2a admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:16.912253 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c414832-7602-4600-9ee0-ad4df0476c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:16.913203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c414832-7602-4600-9ee0-ad4df0476c2a admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:16.914120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c414832-7602-4600-9ee0-ad4df0476c2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:31:16.914425 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c414832-7602-4600-9ee0-ad4df0476c2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:16.916134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c414832-7602-4600-9ee0-ad4df0476c2a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:16.925405 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4036a6c-644d-499e-a3a0-f77fc1bda205 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:16.936618 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3620/7247] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:31:16.941985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40def6-a550-413b-bd48-732998885523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:16.942737 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40def6-a550-413b-bd48-732998885523 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:16.943572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40def6-a550-413b-bd48-732998885523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:16.943960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40def6-a550-413b-bd48-732998885523 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:16.944736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40def6-a550-413b-bd48-732998885523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:16.946880 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c414832-7602-4600-9ee0-ad4df0476c2a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:16.947046 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40def6-a550-413b-bd48-732998885523 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:16.969386 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3628/7248] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:31:16.971219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40def6-a550-413b-bd48-732998885523 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:16.988874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c414832-7602-4600-9ee0-ad4df0476c2a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:16.999777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40def6-a550-413b-bd48-732998885523 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:17.006508 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f71a03-c441-45eb-baf0-874f9594fc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:17.007143 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f71a03-c441-45eb-baf0-874f9594fc7c admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:17.008483 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b6fa6-38e5-47de-9bb7-0175899b84ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:17.009320 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b6fa6-38e5-47de-9bb7-0175899b84ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:17.010211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f71a03-c441-45eb-baf0-874f9594fc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:17.010621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f71a03-c441-45eb-baf0-874f9594fc7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:17.011306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f71a03-c441-45eb-baf0-874f9594fc7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:17.013253 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f71a03-c441-45eb-baf0-874f9594fc7c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:17.014167 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b6fa6-38e5-47de-9bb7-0175899b84ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:17.014467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b6fa6-38e5-47de-9bb7-0175899b84ee admin admin] PATH_INFO: `/v3/projects/a33bf58570fc41d7bdf2b307297bb34b/users/32fc44c283ab4a24833db25e2d1a15f6/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:17.053953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b6fa6-38e5-47de-9bb7-0175899b84ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=a33bf58570fc41d7bdf2b307297bb34b, user_id=32fc44c283ab4a24833db25e2d1a15f6, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:17.057173 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b6fa6-38e5-47de-9bb7-0175899b84ee admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:17.071300 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3621/7249] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:31:16 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:31:17.078987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f71a03-c441-45eb-baf0-874f9594fc7c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:17.080236 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3629/7250] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:31:16 2022] PUT /identity/v3/projects/a33bf58570fc41d7bdf2b307297bb34b/users/32fc44c283ab4a24833db25e2d1a15f6/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:17.083980 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b6fa6-38e5-47de-9bb7-0175899b84ee admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:17.136371 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:17.163403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f71a03-c441-45eb-baf0-874f9594fc7c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:17.169716 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba56db-eccd-421c-85ce-9e26158ea735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:17.170592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba56db-eccd-421c-85ce-9e26158ea735 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:17.170801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba56db-eccd-421c-85ce-9e26158ea735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:17.171165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba56db-eccd-421c-85ce-9e26158ea735 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:17.172026 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba56db-eccd-421c-85ce-9e26158ea735 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:17.174076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba56db-eccd-421c-85ce-9e26158ea735 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:17.182996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b6fa6-38e5-47de-9bb7-0175899b84ee admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:17.190232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600c004-568d-4416-ac59-053e9817bd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:17.193850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600c004-568d-4416-ac59-053e9817bd65 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:17.194182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600c004-568d-4416-ac59-053e9817bd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:17.194456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600c004-568d-4416-ac59-053e9817bd65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:17.195415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600c004-568d-4416-ac59-053e9817bd65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:17.197089 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600c004-568d-4416-ac59-053e9817bd65 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:17.203214 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3622/7251] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:31:17 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:31:17.206758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba56db-eccd-421c-85ce-9e26158ea735 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:17.217809 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3630/7252] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:31:17.219268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600c004-568d-4416-ac59-053e9817bd65 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:17.222326 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c600c004-568d-4416-ac59-053e9817bd65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:17.223325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba56db-eccd-421c-85ce-9e26158ea735 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:17.235304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d8eda-e4c9-437c-8d99-a11e7574a14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:17.236185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d8eda-e4c9-437c-8d99-a11e7574a14e admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:17.236609 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d8eda-e4c9-437c-8d99-a11e7574a14e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:17.236840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d8eda-e4c9-437c-8d99-a11e7574a14e admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:17.243261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d8eda-e4c9-437c-8d99-a11e7574a14e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:17.245105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d8eda-e4c9-437c-8d99-a11e7574a14e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:17.257128 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3623/7253] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:31:17.258053 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d8eda-e4c9-437c-8d99-a11e7574a14e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:17.271395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d8eda-e4c9-437c-8d99-a11e7574a14e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:17.294382 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc6e15-d7ee-4853-a701-d484784acde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:17.295078 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc6e15-d7ee-4853-a701-d484784acde6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:17.296498 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc6e15-d7ee-4853-a701-d484784acde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:17.296799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc6e15-d7ee-4853-a701-d484784acde6 admin admin] PATH_INFO: `/v3/projects/a33bf58570fc41d7bdf2b307297bb34b/users/32fc44c283ab4a24833db25e2d1a15f6/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:17.303654 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc6e15-d7ee-4853-a701-d484784acde6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a33bf58570fc41d7bdf2b307297bb34b, user_id=32fc44c283ab4a24833db25e2d1a15f6, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:17.306786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc6e15-d7ee-4853-a701-d484784acde6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:17.341063 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3624/7254] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:31:17 2022] PUT /identity/v3/projects/a33bf58570fc41d7bdf2b307297bb34b/users/32fc44c283ab4a24833db25e2d1a15f6/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:17.346103 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc6e15-d7ee-4853-a701-d484784acde6 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:17.464934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc6e15-d7ee-4853-a701-d484784acde6 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:17.470653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a5ccb-12cd-40a3-81f8-4d30a0e9284e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:17.471280 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a5ccb-12cd-40a3-81f8-4d30a0e9284e admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:17.471667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a5ccb-12cd-40a3-81f8-4d30a0e9284e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:17.471952 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a5ccb-12cd-40a3-81f8-4d30a0e9284e admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:17.472603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a5ccb-12cd-40a3-81f8-4d30a0e9284e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:17.474260 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a5ccb-12cd-40a3-81f8-4d30a0e9284e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:17.480245 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600c004-568d-4416-ac59-053e9817bd65 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:17.491989 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3625/7255] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:31:17.492937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5075d67-5f6f-4d53-b11a-7b14e9076159 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:17.493052 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:17.493140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5075d67-5f6f-4d53-b11a-7b14e9076159 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:17.493140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5075d67-5f6f-4d53-b11a-7b14e9076159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:17.552935 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c5075d67-5f6f-4d53-b11a-7b14e9076159 None None] MFA Rules not processed for user `32fc44c283ab4a24833db25e2d1a15f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:17.555958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c5075d67-5f6f-4d53-b11a-7b14e9076159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:17.597618 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83163f87-9ff3-47cd-b0e0-a27310c402e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:17.598720 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83163f87-9ff3-47cd-b0e0-a27310c402e2 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:17.599392 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83163f87-9ff3-47cd-b0e0-a27310c402e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:17.599670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83163f87-9ff3-47cd-b0e0-a27310c402e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:17.601909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-83163f87-9ff3-47cd-b0e0-a27310c402e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:17.623648 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83163f87-9ff3-47cd-b0e0-a27310c402e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:17.627938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83163f87-9ff3-47cd-b0e0-a27310c402e2 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:17.653735 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3631/7256] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:31:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:31:17.659805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83163f87-9ff3-47cd-b0e0-a27310c402e2 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:17.674435 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3626/7257] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:17 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:17.680996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83163f87-9ff3-47cd-b0e0-a27310c402e2 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:17.686292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26450cbf-b6d7-4e09-9fd7-a81aeaa2ba51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:17.687656 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26450cbf-b6d7-4e09-9fd7-a81aeaa2ba51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:17.688088 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26450cbf-b6d7-4e09-9fd7-a81aeaa2ba51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:17.688466 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26450cbf-b6d7-4e09-9fd7-a81aeaa2ba51 admin admin] PATH_INFO: `/v3/projects/7b2583f2f1a34df3a35c2ef1eb9a50fe/users/d773afa9357b4159903e6de5fa1ba35c/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:17.705463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26450cbf-b6d7-4e09-9fd7-a81aeaa2ba51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b2583f2f1a34df3a35c2ef1eb9a50fe, user_id=d773afa9357b4159903e6de5fa1ba35c, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:17.708625 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26450cbf-b6d7-4e09-9fd7-a81aeaa2ba51 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:17.723637 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5075d67-5f6f-4d53-b11a-7b14e9076159 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:17.725231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c5075d67-5f6f-4d53-b11a-7b14e9076159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:17.732264 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3632/7258] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:31:17 2022] PUT /identity/v3/projects/7b2583f2f1a34df3a35c2ef1eb9a50fe/users/d773afa9357b4159903e6de5fa1ba35c/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:17.745371 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fa50e-ab2a-403a-a1da-c35f3daec29c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:17.746130 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fa50e-ab2a-403a-a1da-c35f3daec29c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:17.746419 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fa50e-ab2a-403a-a1da-c35f3daec29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:17.795938 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:17.815836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-bf9fa50e-ab2a-403a-a1da-c35f3daec29c None None] MFA Rules not processed for user `d773afa9357b4159903e6de5fa1ba35c`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:17.817105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-bf9fa50e-ab2a-403a-a1da-c35f3daec29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:17.832302 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5075d67-5f6f-4d53-b11a-7b14e9076159 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:17.905118 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3633/7259] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:17.908145 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c224362-240a-44f3-b390-4c30d2fce791 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:17.909425 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c224362-240a-44f3-b390-4c30d2fce791 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:17.909740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c224362-240a-44f3-b390-4c30d2fce791 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:17.910017 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c224362-240a-44f3-b390-4c30d2fce791 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:17.910422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9fa50e-ab2a-403a-a1da-c35f3daec29c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:17.912104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9c224362-240a-44f3-b390-4c30d2fce791 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:18.005247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9fa50e-ab2a-403a-a1da-c35f3daec29c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:18.011565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd14807-eb61-4b60-b28a-7af1c45ed95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:18.012925 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd14807-eb61-4b60-b28a-7af1c45ed95b admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:18.014225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd14807-eb61-4b60-b28a-7af1c45ed95b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:18.014500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd14807-eb61-4b60-b28a-7af1c45ed95b admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:18.015332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd14807-eb61-4b60-b28a-7af1c45ed95b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:18.018023 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c224362-240a-44f3-b390-4c30d2fce791 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:18.018726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd14807-eb61-4b60-b28a-7af1c45ed95b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:18.019688 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c224362-240a-44f3-b390-4c30d2fce791 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:18.030844 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:18.037605 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3627/7260] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:31:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:31:18.055015 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3634/7261] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:31:17 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:31:18.059090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c224362-240a-44f3-b390-4c30d2fce791 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:18.080651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c224362-240a-44f3-b390-4c30d2fce791 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:18.181884 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe65d5b-f031-4a44-b0f6-ce3990aba72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:18.182624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe65d5b-f031-4a44-b0f6-ce3990aba72c admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:18.183006 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe65d5b-f031-4a44-b0f6-ce3990aba72c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:18.183592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe65d5b-f031-4a44-b0f6-ce3990aba72c admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:18.184320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe65d5b-f031-4a44-b0f6-ce3990aba72c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:18.186522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe65d5b-f031-4a44-b0f6-ce3990aba72c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:18.230333 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3628/7262] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:31:18 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:31:18.235169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd14807-eb61-4b60-b28a-7af1c45ed95b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:18.250626 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd14807-eb61-4b60-b28a-7af1c45ed95b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:18.256435 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281982c-c17e-49a2-abb2-d0fa4ac42a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:18.257067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281982c-c17e-49a2-abb2-d0fa4ac42a14 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:18.257601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281982c-c17e-49a2-abb2-d0fa4ac42a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:18.257764 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281982c-c17e-49a2-abb2-d0fa4ac42a14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:18.258669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a281982c-c17e-49a2-abb2-d0fa4ac42a14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:18.260703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a281982c-c17e-49a2-abb2-d0fa4ac42a14 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:18.297594 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3635/7263] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:31:18.299212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe65d5b-f031-4a44-b0f6-ce3990aba72c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:18.316532 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe65d5b-f031-4a44-b0f6-ce3990aba72c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:18.345591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff0486-e37f-46e8-8d2a-562a5a8b15d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:18.346123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff0486-e37f-46e8-8d2a-562a5a8b15d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:18.346410 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff0486-e37f-46e8-8d2a-562a5a8b15d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:18.346785 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff0486-e37f-46e8-8d2a-562a5a8b15d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:18.347953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff0486-e37f-46e8-8d2a-562a5a8b15d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:18.349675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff0486-e37f-46e8-8d2a-562a5a8b15d2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:18.381136 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281982c-c17e-49a2-abb2-d0fa4ac42a14 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:18.384776 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3629/7264] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:31:18.401910 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281982c-c17e-49a2-abb2-d0fa4ac42a14 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:18.413254 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00599b-e158-4c1b-bcfe-25dc86bc7ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:18.414184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00599b-e158-4c1b-bcfe-25dc86bc7ef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:18.414509 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00599b-e158-4c1b-bcfe-25dc86bc7ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:18.414789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00599b-e158-4c1b-bcfe-25dc86bc7ef2 admin admin] PATH_INFO: `/v3/projects/c7c63c84f57e4237b82c622101b3afc3/users/1b1159fd9f884ae4b2dea3e1329ad617/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:18.452196 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00599b-e158-4c1b-bcfe-25dc86bc7ef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7c63c84f57e4237b82c622101b3afc3, user_id=1b1159fd9f884ae4b2dea3e1329ad617, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:18.457634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00599b-e158-4c1b-bcfe-25dc86bc7ef2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:18.515942 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3636/7265] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:31:18 2022] PUT /identity/v3/projects/c7c63c84f57e4237b82c622101b3afc3/users/1b1159fd9f884ae4b2dea3e1329ad617/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:18.520073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f15a1a-83da-49c5-bc4a-95093b596378 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:18.520596 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f15a1a-83da-49c5-bc4a-95093b596378 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:18.520809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f15a1a-83da-49c5-bc4a-95093b596378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:18.587224 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-40f15a1a-83da-49c5-bc4a-95093b596378 None None] MFA Rules not processed for user `1b1159fd9f884ae4b2dea3e1329ad617`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:18.591820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-40f15a1a-83da-49c5-bc4a-95093b596378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:18.617110 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:18.728917 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3630/7266] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:18.745114 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00599b-e158-4c1b-bcfe-25dc86bc7ef2 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:18.748993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fd00599b-e158-4c1b-bcfe-25dc86bc7ef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:18.793614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f15a1a-83da-49c5-bc4a-95093b596378 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:18.863857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00599b-e158-4c1b-bcfe-25dc86bc7ef2 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:18.868347 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648b26e-2607-49a8-8ff4-c6efcba27fe8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efcee9b21ea94b1b8e5c9c5acb35839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:18.868965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648b26e-2607-49a8-8ff4-c6efcba27fe8 service glance] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:18.869249 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648b26e-2607-49a8-8ff4-c6efcba27fe8 service glance] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:18.869562 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648b26e-2607-49a8-8ff4-c6efcba27fe8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:18.922312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f15a1a-83da-49c5-bc4a-95093b596378 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:18.926859 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effeeb72-e4a8-4004-907d-bbdd3ff2701b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:18.927370 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effeeb72-e4a8-4004-907d-bbdd3ff2701b service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:18.927884 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effeeb72-e4a8-4004-907d-bbdd3ff2701b service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:18.928259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effeeb72-e4a8-4004-907d-bbdd3ff2701b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:18.955597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648b26e-2607-49a8-8ff4-c6efcba27fe8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:18.957615 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648b26e-2607-49a8-8ff4-c6efcba27fe8 service glance] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:18.969796 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3637/7267] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:31:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:31:19.000774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effeeb72-e4a8-4004-907d-bbdd3ff2701b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:19.002433 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effeeb72-e4a8-4004-907d-bbdd3ff2701b service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:19.014742 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3631/7268] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:31:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:31:19.142504 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648b26e-2607-49a8-8ff4-c6efcba27fe8 service glance] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:19.160099 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648b26e-2607-49a8-8ff4-c6efcba27fe8 service glance] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:19.166719 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01bbe1-3e17-4970-a8a2-3b1dfb4055b5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efcee9b21ea94b1b8e5c9c5acb35839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:19.167441 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01bbe1-3e17-4970-a8a2-3b1dfb4055b5 service glance] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:19.167732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01bbe1-3e17-4970-a8a2-3b1dfb4055b5 service glance] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:19.168054 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01bbe1-3e17-4970-a8a2-3b1dfb4055b5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:19.182077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b01bbe1-3e17-4970-a8a2-3b1dfb4055b5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:19.184735 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b01bbe1-3e17-4970-a8a2-3b1dfb4055b5 service glance] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:19.207900 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3638/7269] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:31:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:31:19.797881 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effeeb72-e4a8-4004-907d-bbdd3ff2701b service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:19.919060 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effeeb72-e4a8-4004-907d-bbdd3ff2701b service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:19.931409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710819b-d425-4414-97d0-8d3b8c9600c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:19.933016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710819b-d425-4414-97d0-8d3b8c9600c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:19.933016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710819b-d425-4414-97d0-8d3b8c9600c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:19.933016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710819b-d425-4414-97d0-8d3b8c9600c4 admin admin] PATH_INFO: `/v3/users/d773afa9357b4159903e6de5fa1ba35c` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:19.934588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9710819b-d425-4414-97d0-8d3b8c9600c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d773afa9357b4159903e6de5fa1ba35c)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:19.937835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9710819b-d425-4414-97d0-8d3b8c9600c4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:19.945232 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:20.025731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01bbe1-3e17-4970-a8a2-3b1dfb4055b5 service glance] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:20.027260 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7b01bbe1-3e17-4970-a8a2-3b1dfb4055b5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:20.109799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9710819b-d425-4414-97d0-8d3b8c9600c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd773afa9357b4159903e6de5fa1ba35c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:20.110959 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9710819b-d425-4414-97d0-8d3b8c9600c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd773afa9357b4159903e6de5fa1ba35c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:20.121709 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9710819b-d425-4414-97d0-8d3b8c9600c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd773afa9357b4159903e6de5fa1ba35c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:20.136025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9710819b-d425-4414-97d0-8d3b8c9600c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd773afa9357b4159903e6de5fa1ba35c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:20.137249 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9710819b-d425-4414-97d0-8d3b8c9600c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd773afa9357b4159903e6de5fa1ba35c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:20.177232 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3632/7270] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:31:19 2022] DELETE /identity/v3/users/d773afa9357b4159903e6de5fa1ba35c => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:20.178475 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710819b-d425-4414-97d0-8d3b8c9600c4 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:20.181369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9710819b-d425-4414-97d0-8d3b8c9600c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:20.195146 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:20.236579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01bbe1-3e17-4970-a8a2-3b1dfb4055b5 service glance] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:20.365985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710819b-d425-4414-97d0-8d3b8c9600c4 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:20.394204 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330f4ee-1a38-436f-9320-48583eef0e2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:20.394661 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330f4ee-1a38-436f-9320-48583eef0e2f service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:20.394943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330f4ee-1a38-436f-9320-48583eef0e2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:20.395211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330f4ee-1a38-436f-9320-48583eef0e2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:20.408290 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0330f4ee-1a38-436f-9320-48583eef0e2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:20.424078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca453e4-679d-4fce-833d-755f44c056e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:20.424078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca453e4-679d-4fce-833d-755f44c056e5 service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:20.424078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca453e4-679d-4fce-833d-755f44c056e5 service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:20.424583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca453e4-679d-4fce-833d-755f44c056e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:20.428189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9ca453e4-679d-4fce-833d-755f44c056e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:20.432146 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0330f4ee-1a38-436f-9320-48583eef0e2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:20.433651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0330f4ee-1a38-436f-9320-48583eef0e2f service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:20.461146 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3633/7271] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:31:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:31:20.462568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45e4f1-8ae4-4c98-b884-a59a938ef7e3 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:20.462866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45e4f1-8ae4-4c98-b884-a59a938ef7e3 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:20.463149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45e4f1-8ae4-4c98-b884-a59a938ef7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:20.473396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca453e4-679d-4fce-833d-755f44c056e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:20.476129 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca453e4-679d-4fce-833d-755f44c056e5 service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:20.504445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-fc45e4f1-8ae4-4c98-b884-a59a938ef7e3 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:20.506303 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3639/7272] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:31:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:31:20.508383 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-fc45e4f1-8ae4-4c98-b884-a59a938ef7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:20.509357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca453e4-679d-4fce-833d-755f44c056e5 service placement] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:20.535569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca453e4-679d-4fce-833d-755f44c056e5 service placement] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:20.546595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a8b99-1146-49e9-a579-7d86755bd000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:20.547861 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a8b99-1146-49e9-a579-7d86755bd000 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:20.548363 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a8b99-1146-49e9-a579-7d86755bd000 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:20.548852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a8b99-1146-49e9-a579-7d86755bd000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:20.570938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a8b99-1146-49e9-a579-7d86755bd000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:20.572754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a8b99-1146-49e9-a579-7d86755bd000 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:20.588770 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3640/7273] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:31:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:31:20.668693 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3634/7274] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:20.719177 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a8b99-1146-49e9-a579-7d86755bd000 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:20.737241 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a8b99-1146-49e9-a579-7d86755bd000 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:20.743195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20d7c0-6df2-42ad-95b6-268fcb9b6073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:20.744837 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20d7c0-6df2-42ad-95b6-268fcb9b6073 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:20.745542 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20d7c0-6df2-42ad-95b6-268fcb9b6073 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:20.746102 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20d7c0-6df2-42ad-95b6-268fcb9b6073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:20.772361 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20d7c0-6df2-42ad-95b6-268fcb9b6073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:20.774223 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20d7c0-6df2-42ad-95b6-268fcb9b6073 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:20.801697 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3641/7275] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:31:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:31:22.670980 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45e4f1-8ae4-4c98-b884-a59a938ef7e3 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:22.674186 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-fc45e4f1-8ae4-4c98-b884-a59a938ef7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:22.690225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45e4f1-8ae4-4c98-b884-a59a938ef7e3 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:22.697311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32bdb38-7110-4069-97fd-ddb71790b6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:22.697801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bdb38-7110-4069-97fd-ddb71790b6c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:22.698082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bdb38-7110-4069-97fd-ddb71790b6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:22.698410 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bdb38-7110-4069-97fd-ddb71790b6c3 admin admin] PATH_INFO: `/v3/projects/7b2583f2f1a34df3a35c2ef1eb9a50fe` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:22.699766 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32bdb38-7110-4069-97fd-ddb71790b6c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b2583f2f1a34df3a35c2ef1eb9a50fe)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:22.703666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32bdb38-7110-4069-97fd-ddb71790b6c3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:22.741732 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:22.829726 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f32bdb38-7110-4069-97fd-ddb71790b6c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b2583f2f1a34df3a35c2ef1eb9a50fe', 'request_id': 'req-f32bdb38-7110-4069-97fd-ddb71790b6c3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:22.831046 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20d7c0-6df2-42ad-95b6-268fcb9b6073 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:22.833318 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6e20d7c0-6df2-42ad-95b6-268fcb9b6073 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:22.883420 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f32bdb38-7110-4069-97fd-ddb71790b6c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b2583f2f1a34df3a35c2ef1eb9a50fe', 'request_id': 'req-f32bdb38-7110-4069-97fd-ddb71790b6c3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:22.899726 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f32bdb38-7110-4069-97fd-ddb71790b6c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b2583f2f1a34df3a35c2ef1eb9a50fe', 'request_id': 'req-f32bdb38-7110-4069-97fd-ddb71790b6c3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:22.933828 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f32bdb38-7110-4069-97fd-ddb71790b6c3 admin admin] The token cache is being invalidate because project 7b2583f2f1a34df3a35c2ef1eb9a50fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:31:22.934265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f32bdb38-7110-4069-97fd-ddb71790b6c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:22.936509 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f32bdb38-7110-4069-97fd-ddb71790b6c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:22.942292 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3635/7276] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:31:22 2022] DELETE /identity/v3/projects/7b2583f2f1a34df3a35c2ef1eb9a50fe => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:22.946669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32bdb38-7110-4069-97fd-ddb71790b6c3 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:22.948463 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f32bdb38-7110-4069-97fd-ddb71790b6c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:23.013268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20d7c0-6df2-42ad-95b6-268fcb9b6073 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:23.115600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32bdb38-7110-4069-97fd-ddb71790b6c3 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:23.125332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4263ad-0de7-4bde-86cd-36858118c6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:23.126227 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4263ad-0de7-4bde-86cd-36858118c6c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:23.126513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4263ad-0de7-4bde-86cd-36858118c6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:23.127072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4263ad-0de7-4bde-86cd-36858118c6c9 admin admin] PATH_INFO: `/v3/users/1b1159fd9f884ae4b2dea3e1329ad617` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:23.129806 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4263ad-0de7-4bde-86cd-36858118c6c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b1159fd9f884ae4b2dea3e1329ad617)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:23.135882 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:23.141028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4263ad-0de7-4bde-86cd-36858118c6c9 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:23.166008 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a4788-093d-4a5a-9a34-aee3311d6ed2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:23.167002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a4788-093d-4a5a-9a34-aee3311d6ed2 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:23.167287 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a4788-093d-4a5a-9a34-aee3311d6ed2 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:23.167562 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a4788-093d-4a5a-9a34-aee3311d6ed2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:23.174957 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-570a4788-093d-4a5a-9a34-aee3311d6ed2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:23.207984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a4788-093d-4a5a-9a34-aee3311d6ed2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:23.209622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a4788-093d-4a5a-9a34-aee3311d6ed2 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:23.239758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ba4263ad-0de7-4bde-86cd-36858118c6c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b1159fd9f884ae4b2dea3e1329ad617'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:23.240863 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ba4263ad-0de7-4bde-86cd-36858118c6c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b1159fd9f884ae4b2dea3e1329ad617'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:23.254097 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ba4263ad-0de7-4bde-86cd-36858118c6c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b1159fd9f884ae4b2dea3e1329ad617'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:23.260120 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3642/7277] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:31:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:31:23.266066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ba4263ad-0de7-4bde-86cd-36858118c6c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b1159fd9f884ae4b2dea3e1329ad617'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:23.267383 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ba4263ad-0de7-4bde-86cd-36858118c6c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b1159fd9f884ae4b2dea3e1329ad617'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:23.294056 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3636/7278] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:31:22 2022] DELETE /identity/v3/users/1b1159fd9f884ae4b2dea3e1329ad617 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:24.177297 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a4788-093d-4a5a-9a34-aee3311d6ed2 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:24.189413 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a4788-093d-4a5a-9a34-aee3311d6ed2 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:24.252055 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dba4fb-eee8-4438-b29c-147ce50ca2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:24.252646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dba4fb-eee8-4438-b29c-147ce50ca2c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:24.252929 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dba4fb-eee8-4438-b29c-147ce50ca2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:24.253206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dba4fb-eee8-4438-b29c-147ce50ca2c7 admin admin] PATH_INFO: `/v3/projects/c7c63c84f57e4237b82c622101b3afc3` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:24.254412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dba4fb-eee8-4438-b29c-147ce50ca2c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7c63c84f57e4237b82c622101b3afc3)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:24.256412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dba4fb-eee8-4438-b29c-147ce50ca2c7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:24.308881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-39dba4fb-eee8-4438-b29c-147ce50ca2c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7c63c84f57e4237b82c622101b3afc3', 'request_id': 'req-39dba4fb-eee8-4438-b29c-147ce50ca2c7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:24.319027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-39dba4fb-eee8-4438-b29c-147ce50ca2c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7c63c84f57e4237b82c622101b3afc3', 'request_id': 'req-39dba4fb-eee8-4438-b29c-147ce50ca2c7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:24.325319 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-39dba4fb-eee8-4438-b29c-147ce50ca2c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7c63c84f57e4237b82c622101b3afc3', 'request_id': 'req-39dba4fb-eee8-4438-b29c-147ce50ca2c7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:24.338690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-39dba4fb-eee8-4438-b29c-147ce50ca2c7 admin admin] The token cache is being invalidate because project c7c63c84f57e4237b82c622101b3afc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:31:24.339059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-39dba4fb-eee8-4438-b29c-147ce50ca2c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:24.340033 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-39dba4fb-eee8-4438-b29c-147ce50ca2c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:24.346750 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3643/7279] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:31:24 2022] DELETE /identity/v3/projects/c7c63c84f57e4237b82c622101b3afc3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:24.350562 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928479b-3550-4a94-8f15-0e1b9e9e8378 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:24.351005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928479b-3550-4a94-8f15-0e1b9e9e8378 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:24.351169 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928479b-3550-4a94-8f15-0e1b9e9e8378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:24.375942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-9928479b-3550-4a94-8f15-0e1b9e9e8378 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:24.377249 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9928479b-3550-4a94-8f15-0e1b9e9e8378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:24.427022 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:24.563706 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3637/7280] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:24.565405 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ebef00-a3d1-404d-926f-5c6387f72a06 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:24.566118 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ebef00-a3d1-404d-926f-5c6387f72a06 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:24.566402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ebef00-a3d1-404d-926f-5c6387f72a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:24.604502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-03ebef00-a3d1-404d-926f-5c6387f72a06 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:24.606383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-03ebef00-a3d1-404d-926f-5c6387f72a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:24.624496 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928479b-3550-4a94-8f15-0e1b9e9e8378 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:24.634813 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3644/7281] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:24.636274 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928479b-3550-4a94-8f15-0e1b9e9e8378 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:24.658612 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7186042-471e-4122-9436-886fa83fc10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:24.659744 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7186042-471e-4122-9436-886fa83fc10b admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:24.660041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7186042-471e-4122-9436-886fa83fc10b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:24.660945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7186042-471e-4122-9436-886fa83fc10b admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:24.661670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7186042-471e-4122-9436-886fa83fc10b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:31:24.661975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7186042-471e-4122-9436-886fa83fc10b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:24.666633 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7186042-471e-4122-9436-886fa83fc10b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:24.684308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ebef00-a3d1-404d-926f-5c6387f72a06 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:24.684970 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3638/7282] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:31:24.696211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ebef00-a3d1-404d-926f-5c6387f72a06 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:24.710080 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30995976-b65d-4389-928f-f88259f0819b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:24.710795 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30995976-b65d-4389-928f-f88259f0819b admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:24.711338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30995976-b65d-4389-928f-f88259f0819b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:24.711686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30995976-b65d-4389-928f-f88259f0819b admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:24.712635 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30995976-b65d-4389-928f-f88259f0819b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:24.718747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30995976-b65d-4389-928f-f88259f0819b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:24.781178 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3645/7283] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:31:24 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:31:24.785468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7186042-471e-4122-9436-886fa83fc10b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:24.802335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7186042-471e-4122-9436-886fa83fc10b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:24.904784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e598c03-b92d-4c31-8222-cbc0fa87d97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:24.906851 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e598c03-b92d-4c31-8222-cbc0fa87d97b admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:24.907334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e598c03-b92d-4c31-8222-cbc0fa87d97b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:24.907799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e598c03-b92d-4c31-8222-cbc0fa87d97b admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:24.908593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e598c03-b92d-4c31-8222-cbc0fa87d97b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:24.912249 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e598c03-b92d-4c31-8222-cbc0fa87d97b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:24.947856 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3639/7284] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:31:24 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:31:24.951598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30995976-b65d-4389-928f-f88259f0819b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:24.970594 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30995976-b65d-4389-928f-f88259f0819b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:24.978025 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6500c65-0096-4441-8e66-da8d7430c69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:24.979229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6500c65-0096-4441-8e66-da8d7430c69a admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:24.980204 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6500c65-0096-4441-8e66-da8d7430c69a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:24.980544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6500c65-0096-4441-8e66-da8d7430c69a admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:24.981614 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6500c65-0096-4441-8e66-da8d7430c69a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:24.983609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6500c65-0096-4441-8e66-da8d7430c69a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:25.000826 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3646/7285] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:31:25.002141 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e598c03-b92d-4c31-8222-cbc0fa87d97b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:25.017829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e598c03-b92d-4c31-8222-cbc0fa87d97b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:25.025105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f24cc-9795-492e-afd4-c08339e146e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:25.026631 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f24cc-9795-492e-afd4-c08339e146e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:25.027134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f24cc-9795-492e-afd4-c08339e146e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:25.027768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f24cc-9795-492e-afd4-c08339e146e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:25.028626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f24cc-9795-492e-afd4-c08339e146e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:25.032005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f24cc-9795-492e-afd4-c08339e146e4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:25.047795 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3640/7286] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:31:25.052150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6500c65-0096-4441-8e66-da8d7430c69a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:25.063628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6500c65-0096-4441-8e66-da8d7430c69a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:25.068937 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cacd76-28b3-4296-af21-6be220a9324f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:25.069625 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cacd76-28b3-4296-af21-6be220a9324f admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:25.069904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cacd76-28b3-4296-af21-6be220a9324f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:25.070176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cacd76-28b3-4296-af21-6be220a9324f admin admin] PATH_INFO: `/v3/projects/3a6cde5a818e449594366553c2cc2e8c/users/af7a85aadf3d4b43a6ac9cb66e25b17b/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:25.089306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cacd76-28b3-4296-af21-6be220a9324f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a6cde5a818e449594366553c2cc2e8c, user_id=af7a85aadf3d4b43a6ac9cb66e25b17b, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:25.092426 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cacd76-28b3-4296-af21-6be220a9324f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:25.110046 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3647/7287] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:31:25 2022] PUT /identity/v3/projects/3a6cde5a818e449594366553c2cc2e8c/users/af7a85aadf3d4b43a6ac9cb66e25b17b/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:25.121847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f2529-6b81-4687-b3db-9ec977c734c1 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:25.122517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f2529-6b81-4687-b3db-9ec977c734c1 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:25.123260 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f2529-6b81-4687-b3db-9ec977c734c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:25.168206 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c30f2529-6b81-4687-b3db-9ec977c734c1 None None] MFA Rules not processed for user `af7a85aadf3d4b43a6ac9cb66e25b17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:25.170037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c30f2529-6b81-4687-b3db-9ec977c734c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:25.248788 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3641/7288] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:25.262884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cacd76-28b3-4296-af21-6be220a9324f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:25.266580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-33cacd76-28b3-4296-af21-6be220a9324f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:25.297611 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:25.393836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cacd76-28b3-4296-af21-6be220a9324f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:25.398942 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3f89f-9036-45da-8260-a4fc58bedc32 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efcee9b21ea94b1b8e5c9c5acb35839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:25.400357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3f89f-9036-45da-8260-a4fc58bedc32 service glance] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:25.400357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3f89f-9036-45da-8260-a4fc58bedc32 service glance] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:25.400575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3f89f-9036-45da-8260-a4fc58bedc32 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:25.413822 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3f89f-9036-45da-8260-a4fc58bedc32 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:25.418820 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3f89f-9036-45da-8260-a4fc58bedc32 service glance] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:25.435062 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3648/7289] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:31:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:31:25.576634 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f2529-6b81-4687-b3db-9ec977c734c1 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:25.601251 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:25.666455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f2529-6b81-4687-b3db-9ec977c734c1 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:25.676032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc23529-acfa-470d-8cd1-f16909e9ef34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:25.677062 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc23529-acfa-470d-8cd1-f16909e9ef34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:25.677568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc23529-acfa-470d-8cd1-f16909e9ef34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:25.678030 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc23529-acfa-470d-8cd1-f16909e9ef34 admin admin] PATH_INFO: `/v3/users/af7a85aadf3d4b43a6ac9cb66e25b17b` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:25.679395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc23529-acfa-470d-8cd1-f16909e9ef34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af7a85aadf3d4b43a6ac9cb66e25b17b)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:25.682111 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc23529-acfa-470d-8cd1-f16909e9ef34 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:25.762973 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2fc23529-acfa-470d-8cd1-f16909e9ef34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af7a85aadf3d4b43a6ac9cb66e25b17b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:25.763765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2fc23529-acfa-470d-8cd1-f16909e9ef34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af7a85aadf3d4b43a6ac9cb66e25b17b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:25.777836 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2fc23529-acfa-470d-8cd1-f16909e9ef34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af7a85aadf3d4b43a6ac9cb66e25b17b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:25.787266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2fc23529-acfa-470d-8cd1-f16909e9ef34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af7a85aadf3d4b43a6ac9cb66e25b17b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:25.788223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2fc23529-acfa-470d-8cd1-f16909e9ef34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af7a85aadf3d4b43a6ac9cb66e25b17b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:25.816702 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3642/7290] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:31:25 2022] DELETE /identity/v3/users/af7a85aadf3d4b43a6ac9cb66e25b17b => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:25.821402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98687d-f2c8-437f-bbbf-74a07b8f8b4a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:25.821969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98687d-f2c8-437f-bbbf-74a07b8f8b4a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:25.822415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98687d-f2c8-437f-bbbf-74a07b8f8b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:25.856076 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-fc98687d-f2c8-437f-bbbf-74a07b8f8b4a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:25.857586 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fc98687d-f2c8-437f-bbbf-74a07b8f8b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:25.962084 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3649/7291] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:26.019437 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc23529-acfa-470d-8cd1-f16909e9ef34 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:26.020894 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2fc23529-acfa-470d-8cd1-f16909e9ef34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:26.197274 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc23529-acfa-470d-8cd1-f16909e9ef34 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:26.201998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8d909-0876-4753-a232-086b0fae263f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:26.204109 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8d909-0876-4753-a232-086b0fae263f service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:26.204386 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8d909-0876-4753-a232-086b0fae263f service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:26.204724 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8d909-0876-4753-a232-086b0fae263f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:26.225296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c8d909-0876-4753-a232-086b0fae263f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:26.227162 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c8d909-0876-4753-a232-086b0fae263f service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:26.242612 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3643/7292] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:31:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:31:27.313867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98687d-f2c8-437f-bbbf-74a07b8f8b4a None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:27.315950 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fc98687d-f2c8-437f-bbbf-74a07b8f8b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:27.336175 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98687d-f2c8-437f-bbbf-74a07b8f8b4a None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:27.351455 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e77d87-46e0-43f1-b668-0759296e1c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:27.352633 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e77d87-46e0-43f1-b668-0759296e1c8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:27.353115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e77d87-46e0-43f1-b668-0759296e1c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:27.353631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e77d87-46e0-43f1-b668-0759296e1c8d admin admin] PATH_INFO: `/v3/projects/3a6cde5a818e449594366553c2cc2e8c` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:27.355753 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e77d87-46e0-43f1-b668-0759296e1c8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a6cde5a818e449594366553c2cc2e8c)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:27.357998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e77d87-46e0-43f1-b668-0759296e1c8d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:27.463220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e2e77d87-46e0-43f1-b668-0759296e1c8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a6cde5a818e449594366553c2cc2e8c', 'request_id': 'req-e2e77d87-46e0-43f1-b668-0759296e1c8d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:27.480510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e2e77d87-46e0-43f1-b668-0759296e1c8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a6cde5a818e449594366553c2cc2e8c', 'request_id': 'req-e2e77d87-46e0-43f1-b668-0759296e1c8d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:27.488198 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e2e77d87-46e0-43f1-b668-0759296e1c8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a6cde5a818e449594366553c2cc2e8c', 'request_id': 'req-e2e77d87-46e0-43f1-b668-0759296e1c8d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:27.535027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e2e77d87-46e0-43f1-b668-0759296e1c8d admin admin] The token cache is being invalidate because project 3a6cde5a818e449594366553c2cc2e8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:31:27.535779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e2e77d87-46e0-43f1-b668-0759296e1c8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:27.536798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e2e77d87-46e0-43f1-b668-0759296e1c8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:27.538685 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3650/7293] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:31:27 2022] DELETE /identity/v3/projects/3a6cde5a818e449594366553c2cc2e8c => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:27.544386 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a39d4-a9a5-4ca5-b38c-26cee5a06e19 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:27.544893 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a39d4-a9a5-4ca5-b38c-26cee5a06e19 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:27.545477 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a39d4-a9a5-4ca5-b38c-26cee5a06e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:27.587019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-670a39d4-a9a5-4ca5-b38c-26cee5a06e19 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:27.590603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-670a39d4-a9a5-4ca5-b38c-26cee5a06e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:27.689374 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:27.725332 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3644/7294] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:27.733285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12425f-cd71-4d06-970a-dcb452b14fee None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:27.734173 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12425f-cd71-4d06-970a-dcb452b14fee None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:27.734489 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12425f-cd71-4d06-970a-dcb452b14fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:27.761472 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-6f12425f-cd71-4d06-970a-dcb452b14fee None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:27.762597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6f12425f-cd71-4d06-970a-dcb452b14fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:27.773484 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3651/7295] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:27.775250 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a39d4-a9a5-4ca5-b38c-26cee5a06e19 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:27.788252 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a39d4-a9a5-4ca5-b38c-26cee5a06e19 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:27.797105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7d3bc-f735-4b22-84fb-4835a7b67d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:27.798020 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7d3bc-f735-4b22-84fb-4835a7b67d0d admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:27.798532 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7d3bc-f735-4b22-84fb-4835a7b67d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:27.798937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7d3bc-f735-4b22-84fb-4835a7b67d0d admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:27.799689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7d3bc-f735-4b22-84fb-4835a7b67d0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:31:27.800217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7d3bc-f735-4b22-84fb-4835a7b67d0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:27.802552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7d3bc-f735-4b22-84fb-4835a7b67d0d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:27.816569 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3645/7296] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:31:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:31:27.820949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12425f-cd71-4d06-970a-dcb452b14fee None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:27.830335 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12425f-cd71-4d06-970a-dcb452b14fee None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:27.835337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f244c-d53b-43a1-b77c-bbda75beb193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:27.835955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f244c-d53b-43a1-b77c-bbda75beb193 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:27.836082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f244c-d53b-43a1-b77c-bbda75beb193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:27.836310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f244c-d53b-43a1-b77c-bbda75beb193 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:27.836948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f244c-d53b-43a1-b77c-bbda75beb193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:27.838896 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f244c-d53b-43a1-b77c-bbda75beb193 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:27.872609 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3652/7297] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:31:27 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:31:27.877297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7d3bc-f735-4b22-84fb-4835a7b67d0d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:27.892575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7d3bc-f735-4b22-84fb-4835a7b67d0d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:27.974125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a3b266-689e-4128-b92e-cba2accab7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:27.974937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3b266-689e-4128-b92e-cba2accab7c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:27.976291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3b266-689e-4128-b92e-cba2accab7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:27.976291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3b266-689e-4128-b92e-cba2accab7c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:27.976291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a3b266-689e-4128-b92e-cba2accab7c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:27.978797 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a3b266-689e-4128-b92e-cba2accab7c6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:28.005668 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3646/7298] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:31:27 2022] POST /identity/v3/users => generated 287 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:31:28.006999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f244c-d53b-43a1-b77c-bbda75beb193 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:28.020334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f244c-d53b-43a1-b77c-bbda75beb193 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:28.028911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76fd4a-5701-4771-b49f-71876ba0c7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:28.029569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76fd4a-5701-4771-b49f-71876ba0c7f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:28.029945 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76fd4a-5701-4771-b49f-71876ba0c7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:28.031139 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76fd4a-5701-4771-b49f-71876ba0c7f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:28.032002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76fd4a-5701-4771-b49f-71876ba0c7f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:28.034244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76fd4a-5701-4771-b49f-71876ba0c7f9 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:28.038000 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:28.057292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a3b266-689e-4128-b92e-cba2accab7c6 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:28.058735 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3653/7299] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:31:28.070945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a3b266-689e-4128-b92e-cba2accab7c6 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:28.079828 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9c505-2ffe-48be-aafb-baf03d984d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:28.080622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9c505-2ffe-48be-aafb-baf03d984d9f admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:28.081025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9c505-2ffe-48be-aafb-baf03d984d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:28.081460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9c505-2ffe-48be-aafb-baf03d984d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:28.082213 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9c505-2ffe-48be-aafb-baf03d984d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:28.083911 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9c505-2ffe-48be-aafb-baf03d984d9f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:28.101087 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3647/7300] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:31:28.103746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76fd4a-5701-4771-b49f-71876ba0c7f9 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:28.119916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76fd4a-5701-4771-b49f-71876ba0c7f9 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:28.128520 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5f521-bdb9-42f3-9ac0-0230dcf576ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:28.129199 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5f521-bdb9-42f3-9ac0-0230dcf576ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:28.129501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5f521-bdb9-42f3-9ac0-0230dcf576ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:28.129778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5f521-bdb9-42f3-9ac0-0230dcf576ad admin admin] PATH_INFO: `/v3/projects/96fb6e8fbfa149c7a0957939487ae2bc/users/530203c169564bffbd94a7d1838a2461/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:28.149227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5f521-bdb9-42f3-9ac0-0230dcf576ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=96fb6e8fbfa149c7a0957939487ae2bc, user_id=530203c169564bffbd94a7d1838a2461, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:28.153470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5f521-bdb9-42f3-9ac0-0230dcf576ad admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:28.179670 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3654/7301] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:31:28 2022] PUT /identity/v3/projects/96fb6e8fbfa149c7a0957939487ae2bc/users/530203c169564bffbd94a7d1838a2461/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:28.191190 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c49e0-69ce-4e65-a012-7b5ee0590b59 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:28.191540 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c49e0-69ce-4e65-a012-7b5ee0590b59 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:28.191743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c49e0-69ce-4e65-a012-7b5ee0590b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:28.238791 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-571c49e0-69ce-4e65-a012-7b5ee0590b59 None None] MFA Rules not processed for user `530203c169564bffbd94a7d1838a2461`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:28.241477 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-571c49e0-69ce-4e65-a012-7b5ee0590b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:28.337101 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3648/7302] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:28.360576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5f521-bdb9-42f3-9ac0-0230dcf576ad admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:28.364421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-57c5f521-bdb9-42f3-9ac0-0230dcf576ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:28.468518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5f521-bdb9-42f3-9ac0-0230dcf576ad admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:28.472124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42bf876-e884-448a-b345-5dfd39f97f57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:28.472752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42bf876-e884-448a-b345-5dfd39f97f57 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:28.473034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42bf876-e884-448a-b345-5dfd39f97f57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:28.473314 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42bf876-e884-448a-b345-5dfd39f97f57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:28.483182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42bf876-e884-448a-b345-5dfd39f97f57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:28.484714 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42bf876-e884-448a-b345-5dfd39f97f57 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:28.495562 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3655/7303] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:31:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:31:33.397592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c49e0-69ce-4e65-a012-7b5ee0590b59 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:33.401898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-571c49e0-69ce-4e65-a012-7b5ee0590b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:33.470255 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:33.510416 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c49e0-69ce-4e65-a012-7b5ee0590b59 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:33.517928 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d815e3-167e-426a-96b8-fdc3a489b8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:33.518747 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d815e3-167e-426a-96b8-fdc3a489b8d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:33.519032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d815e3-167e-426a-96b8-fdc3a489b8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:33.519393 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d815e3-167e-426a-96b8-fdc3a489b8d8 admin admin] PATH_INFO: `/v3/users/08c19525e0024047b28c65da81348eb6` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:33.521093 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d815e3-167e-426a-96b8-fdc3a489b8d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08c19525e0024047b28c65da81348eb6)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:33.529703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d815e3-167e-426a-96b8-fdc3a489b8d8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:33.643089 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-33d815e3-167e-426a-96b8-fdc3a489b8d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08c19525e0024047b28c65da81348eb6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:33.643782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-33d815e3-167e-426a-96b8-fdc3a489b8d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08c19525e0024047b28c65da81348eb6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:33.653523 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-33d815e3-167e-426a-96b8-fdc3a489b8d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08c19525e0024047b28c65da81348eb6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:33.667764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-33d815e3-167e-426a-96b8-fdc3a489b8d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08c19525e0024047b28c65da81348eb6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:33.668811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-33d815e3-167e-426a-96b8-fdc3a489b8d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08c19525e0024047b28c65da81348eb6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:33.708649 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3649/7304] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:31:33 2022] DELETE /identity/v3/users/08c19525e0024047b28c65da81348eb6 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:33.713515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d184ad6-f784-456d-877e-da97de06e413 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:33.714752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d184ad6-f784-456d-877e-da97de06e413 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:33.715128 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d184ad6-f784-456d-877e-da97de06e413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:33.737620 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-1d184ad6-f784-456d-877e-da97de06e413 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:33.739283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1d184ad6-f784-456d-877e-da97de06e413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:33.817206 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3656/7305] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:31:33.864128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d815e3-167e-426a-96b8-fdc3a489b8d8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:33.866990 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-33d815e3-167e-426a-96b8-fdc3a489b8d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:33.966164 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d815e3-167e-426a-96b8-fdc3a489b8d8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:33.971084 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777831a-e929-44fd-ab70-0f576860cea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:33.971803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777831a-e929-44fd-ab70-0f576860cea7 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:33.972228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777831a-e929-44fd-ab70-0f576860cea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:33.972593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777831a-e929-44fd-ab70-0f576860cea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:33.984119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777831a-e929-44fd-ab70-0f576860cea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:33.987116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777831a-e929-44fd-ab70-0f576860cea7 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:33.997547 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3650/7306] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:31:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:31:34.771760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d184ad6-f784-456d-877e-da97de06e413 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:34.774144 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1d184ad6-f784-456d-877e-da97de06e413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:34.791759 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d184ad6-f784-456d-877e-da97de06e413 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:34.798205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ec170-e38e-4d76-9493-a91dbca7b359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:34.798851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ec170-e38e-4d76-9493-a91dbca7b359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:34.799320 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ec170-e38e-4d76-9493-a91dbca7b359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:34.799583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ec170-e38e-4d76-9493-a91dbca7b359 admin admin] PATH_INFO: `/v3/projects/dca44decdb30415885d559c97223e6d5` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:34.800754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ec170-e38e-4d76-9493-a91dbca7b359 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dca44decdb30415885d559c97223e6d5)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:34.803021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ec170-e38e-4d76-9493-a91dbca7b359 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:34.862853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bd4ec170-e38e-4d76-9493-a91dbca7b359 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dca44decdb30415885d559c97223e6d5', 'request_id': 'req-bd4ec170-e38e-4d76-9493-a91dbca7b359'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:34.872213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bd4ec170-e38e-4d76-9493-a91dbca7b359 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dca44decdb30415885d559c97223e6d5', 'request_id': 'req-bd4ec170-e38e-4d76-9493-a91dbca7b359'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:34.879555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bd4ec170-e38e-4d76-9493-a91dbca7b359 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dca44decdb30415885d559c97223e6d5', 'request_id': 'req-bd4ec170-e38e-4d76-9493-a91dbca7b359'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:34.890561 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:34.898134 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bd4ec170-e38e-4d76-9493-a91dbca7b359 admin admin] The token cache is being invalidate because project dca44decdb30415885d559c97223e6d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:31:34.898417 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bd4ec170-e38e-4d76-9493-a91dbca7b359 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:34.899105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bd4ec170-e38e-4d76-9493-a91dbca7b359 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:34.904496 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3657/7307] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:31:34 2022] DELETE /identity/v3/projects/dca44decdb30415885d559c97223e6d5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:34.906106 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777831a-e929-44fd-ab70-0f576860cea7 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:34.916301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777831a-e929-44fd-ab70-0f576860cea7 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:34.981079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd57cd5-0c1f-4920-a39c-6da4a948a03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:34.981329 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd57cd5-0c1f-4920-a39c-6da4a948a03a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:34.981636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd57cd5-0c1f-4920-a39c-6da4a948a03a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:34.981909 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd57cd5-0c1f-4920-a39c-6da4a948a03a admin admin] PATH_INFO: `/v3/users/32fc44c283ab4a24833db25e2d1a15f6` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:34.983037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd57cd5-0c1f-4920-a39c-6da4a948a03a admin admin] RBAC: Authorizing `identity:delete_user(user_id=32fc44c283ab4a24833db25e2d1a15f6)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:34.985005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd57cd5-0c1f-4920-a39c-6da4a948a03a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:34.987076 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:35.044226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cbd57cd5-0c1f-4920-a39c-6da4a948a03a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32fc44c283ab4a24833db25e2d1a15f6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:35.045248 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cbd57cd5-0c1f-4920-a39c-6da4a948a03a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32fc44c283ab4a24833db25e2d1a15f6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:35.053342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cbd57cd5-0c1f-4920-a39c-6da4a948a03a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32fc44c283ab4a24833db25e2d1a15f6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:35.064408 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cbd57cd5-0c1f-4920-a39c-6da4a948a03a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32fc44c283ab4a24833db25e2d1a15f6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:35.065041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cbd57cd5-0c1f-4920-a39c-6da4a948a03a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32fc44c283ab4a24833db25e2d1a15f6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:35.097234 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3651/7308] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:31:34 2022] DELETE /identity/v3/users/32fc44c283ab4a24833db25e2d1a15f6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:35.635124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ec170-e38e-4d76-9493-a91dbca7b359 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:35.636584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-bd4ec170-e38e-4d76-9493-a91dbca7b359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:35.650735 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ec170-e38e-4d76-9493-a91dbca7b359 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:35.715725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ac60c-dfa0-4b51-b5d4-daee05d95c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:35.716384 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ac60c-dfa0-4b51-b5d4-daee05d95c6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:35.716670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ac60c-dfa0-4b51-b5d4-daee05d95c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:35.716949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ac60c-dfa0-4b51-b5d4-daee05d95c6c admin admin] PATH_INFO: `/v3/projects/a33bf58570fc41d7bdf2b307297bb34b` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:35.718233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ac60c-dfa0-4b51-b5d4-daee05d95c6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a33bf58570fc41d7bdf2b307297bb34b)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:35.720183 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ac60c-dfa0-4b51-b5d4-daee05d95c6c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:35.822638 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c82ac60c-dfa0-4b51-b5d4-daee05d95c6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a33bf58570fc41d7bdf2b307297bb34b', 'request_id': 'req-c82ac60c-dfa0-4b51-b5d4-daee05d95c6c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:35.857534 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c82ac60c-dfa0-4b51-b5d4-daee05d95c6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a33bf58570fc41d7bdf2b307297bb34b', 'request_id': 'req-c82ac60c-dfa0-4b51-b5d4-daee05d95c6c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:35.870777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c82ac60c-dfa0-4b51-b5d4-daee05d95c6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a33bf58570fc41d7bdf2b307297bb34b', 'request_id': 'req-c82ac60c-dfa0-4b51-b5d4-daee05d95c6c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:35.893669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c82ac60c-dfa0-4b51-b5d4-daee05d95c6c admin admin] The token cache is being invalidate because project a33bf58570fc41d7bdf2b307297bb34b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:31:35.895084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c82ac60c-dfa0-4b51-b5d4-daee05d95c6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:35.896161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c82ac60c-dfa0-4b51-b5d4-daee05d95c6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:35.920310 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3658/7309] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:31:35 2022] DELETE /identity/v3/projects/a33bf58570fc41d7bdf2b307297bb34b => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:35.923565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df16504-a896-4098-a59b-c627d52dcc61 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:35.924077 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df16504-a896-4098-a59b-c627d52dcc61 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:35.924614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df16504-a896-4098-a59b-c627d52dcc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:35.976104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-9df16504-a896-4098-a59b-c627d52dcc61 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:35.982257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9df16504-a896-4098-a59b-c627d52dcc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:36.148696 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3652/7310] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:36.150510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb948565-9d40-4a63-8012-6ea2f8e6b1f8 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:36.150871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb948565-9d40-4a63-8012-6ea2f8e6b1f8 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:36.151225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb948565-9d40-4a63-8012-6ea2f8e6b1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:36.184104 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-cb948565-9d40-4a63-8012-6ea2f8e6b1f8 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:36.185464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-cb948565-9d40-4a63-8012-6ea2f8e6b1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:36.199640 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3659/7311] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:36.200661 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df16504-a896-4098-a59b-c627d52dcc61 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:36.218700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df16504-a896-4098-a59b-c627d52dcc61 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:36.229460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8844b-f741-4e9c-99be-9d68f12cfa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:36.230101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8844b-f741-4e9c-99be-9d68f12cfa1d admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:36.230389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8844b-f741-4e9c-99be-9d68f12cfa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:36.231302 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8844b-f741-4e9c-99be-9d68f12cfa1d admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:36.231988 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8844b-f741-4e9c-99be-9d68f12cfa1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:31:36.232310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8844b-f741-4e9c-99be-9d68f12cfa1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:36.234685 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8844b-f741-4e9c-99be-9d68f12cfa1d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:36.269412 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3653/7312] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:31:36.271202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb948565-9d40-4a63-8012-6ea2f8e6b1f8 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:36.288163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb948565-9d40-4a63-8012-6ea2f8e6b1f8 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:36.299313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69407262-ffe8-4c1d-9412-499dad15be84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:36.300262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69407262-ffe8-4c1d-9412-499dad15be84 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:36.302565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69407262-ffe8-4c1d-9412-499dad15be84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:36.303278 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69407262-ffe8-4c1d-9412-499dad15be84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:36.304164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69407262-ffe8-4c1d-9412-499dad15be84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:36.306491 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69407262-ffe8-4c1d-9412-499dad15be84 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:36.366650 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3660/7313] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:31:36 2022] POST /identity/v3/projects => generated 393 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:31:36.369975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8844b-f741-4e9c-99be-9d68f12cfa1d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:36.394662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8844b-f741-4e9c-99be-9d68f12cfa1d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:36.495798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9e7c1-3e7d-45f8-a160-4c9244ac819b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:36.497486 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9e7c1-3e7d-45f8-a160-4c9244ac819b admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:36.497993 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9e7c1-3e7d-45f8-a160-4c9244ac819b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:36.499635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9e7c1-3e7d-45f8-a160-4c9244ac819b admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:36.500507 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9e7c1-3e7d-45f8-a160-4c9244ac819b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:36.503297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9e7c1-3e7d-45f8-a160-4c9244ac819b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:36.520090 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:36.543650 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3654/7314] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:31:36 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:31:36.551491 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69407262-ffe8-4c1d-9412-499dad15be84 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:36.572714 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69407262-ffe8-4c1d-9412-499dad15be84 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:36.579419 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5df850-0a33-40b5-adcb-72cd8acbb616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:36.580151 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5df850-0a33-40b5-adcb-72cd8acbb616 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:36.580763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5df850-0a33-40b5-adcb-72cd8acbb616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:36.581142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5df850-0a33-40b5-adcb-72cd8acbb616 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:36.582231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5df850-0a33-40b5-adcb-72cd8acbb616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:36.586735 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5df850-0a33-40b5-adcb-72cd8acbb616 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:36.604769 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3661/7315] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:31:36.607146 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9e7c1-3e7d-45f8-a160-4c9244ac819b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:36.626889 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9e7c1-3e7d-45f8-a160-4c9244ac819b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:36.640597 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4194aca-aff2-4e97-8991-3eb7f2871de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:36.642144 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4194aca-aff2-4e97-8991-3eb7f2871de4 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:36.647825 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4194aca-aff2-4e97-8991-3eb7f2871de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:36.649708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4194aca-aff2-4e97-8991-3eb7f2871de4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:36.650527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4194aca-aff2-4e97-8991-3eb7f2871de4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:36.652380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4194aca-aff2-4e97-8991-3eb7f2871de4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:36.724575 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3655/7316] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:31:36.728487 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5df850-0a33-40b5-adcb-72cd8acbb616 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:36.749830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5df850-0a33-40b5-adcb-72cd8acbb616 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:36.755795 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d0c47-0a24-49e6-bbb4-c026bcd6ceb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:36.756534 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d0c47-0a24-49e6-bbb4-c026bcd6ceb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:36.756830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d0c47-0a24-49e6-bbb4-c026bcd6ceb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:36.757453 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d0c47-0a24-49e6-bbb4-c026bcd6ceb2 admin admin] PATH_INFO: `/v3/projects/807fb108f1de40f89a13ca169313fe64/users/d6e77d91b29d4e7383abd6f9db6b5ed6/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:36.775523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d0c47-0a24-49e6-bbb4-c026bcd6ceb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=807fb108f1de40f89a13ca169313fe64, user_id=d6e77d91b29d4e7383abd6f9db6b5ed6, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:36.778722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d0c47-0a24-49e6-bbb4-c026bcd6ceb2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:36.796552 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3662/7317] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:31:36 2022] PUT /identity/v3/projects/807fb108f1de40f89a13ca169313fe64/users/d6e77d91b29d4e7383abd6f9db6b5ed6/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:36.806696 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de24f0-9e21-469e-a7ce-181b05f70099 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:36.806899 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de24f0-9e21-469e-a7ce-181b05f70099 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:36.807105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de24f0-9e21-469e-a7ce-181b05f70099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:36.889013 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-96de24f0-9e21-469e-a7ce-181b05f70099 None None] MFA Rules not processed for user `d6e77d91b29d4e7383abd6f9db6b5ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:36.891011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-96de24f0-9e21-469e-a7ce-181b05f70099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:36.993486 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3656/7318] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:36.994290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d0c47-0a24-49e6-bbb4-c026bcd6ceb2 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:37.052441 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:37.136244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d0c47-0a24-49e6-bbb4-c026bcd6ceb2 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:37.150290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f243dc3-835a-4189-baa1-6c558fa916ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:37.150558 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f243dc3-835a-4189-baa1-6c558fa916ac admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:37.150818 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f243dc3-835a-4189-baa1-6c558fa916ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:37.151036 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f243dc3-835a-4189-baa1-6c558fa916ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:37.151687 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f243dc3-835a-4189-baa1-6c558fa916ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:37.153800 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f243dc3-835a-4189-baa1-6c558fa916ac admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:37.227842 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3663/7319] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:31:36 2022] POST /identity/v3/projects => generated 391 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:31:37.229584 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de24f0-9e21-469e-a7ce-181b05f70099 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:37.246738 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de24f0-9e21-469e-a7ce-181b05f70099 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:37.347995 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027620e9-72fd-48a2-94d9-641497f1e9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:37.348768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027620e9-72fd-48a2-94d9-641497f1e9fe admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:37.348979 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027620e9-72fd-48a2-94d9-641497f1e9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:37.349288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027620e9-72fd-48a2-94d9-641497f1e9fe admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:37.350016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027620e9-72fd-48a2-94d9-641497f1e9fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:37.359921 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027620e9-72fd-48a2-94d9-641497f1e9fe admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:37.427243 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3657/7320] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:31:37 2022] POST /identity/v3/users => generated 302 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:31:37.431784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f243dc3-835a-4189-baa1-6c558fa916ac admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:37.464955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f243dc3-835a-4189-baa1-6c558fa916ac admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:37.482663 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42a94f-5c52-4326-ad6e-eff73d04fcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:37.483871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42a94f-5c52-4326-ad6e-eff73d04fcf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:37.484383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42a94f-5c52-4326-ad6e-eff73d04fcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:37.484873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42a94f-5c52-4326-ad6e-eff73d04fcf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:37.487397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42a94f-5c52-4326-ad6e-eff73d04fcf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:37.502950 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42a94f-5c52-4326-ad6e-eff73d04fcf3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:37.538228 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3664/7321] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:31:37.542459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027620e9-72fd-48a2-94d9-641497f1e9fe admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:37.555235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027620e9-72fd-48a2-94d9-641497f1e9fe admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:37.586608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2daf2d9-e62b-4de5-9767-a87166cbc00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:37.587311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2daf2d9-e62b-4de5-9767-a87166cbc00d admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:37.587594 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2daf2d9-e62b-4de5-9767-a87166cbc00d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:37.587870 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2daf2d9-e62b-4de5-9767-a87166cbc00d admin admin] PATH_INFO: `/v3/projects/4eb0e47428304a26a8da4e26ac043ae8/users/190fe9fbd2934e1dbcf79d81f79d710b/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:37.631484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2daf2d9-e62b-4de5-9767-a87166cbc00d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eb0e47428304a26a8da4e26ac043ae8, user_id=190fe9fbd2934e1dbcf79d81f79d710b, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:37.651035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2daf2d9-e62b-4de5-9767-a87166cbc00d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:37.689682 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3658/7322] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:31:37 2022] PUT /identity/v3/projects/4eb0e47428304a26a8da4e26ac043ae8/users/190fe9fbd2934e1dbcf79d81f79d710b/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:37.694915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42a94f-5c52-4326-ad6e-eff73d04fcf3 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:37.731271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42a94f-5c52-4326-ad6e-eff73d04fcf3 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:37.860959 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda8cdc-f019-4574-a174-d0d5a1102ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:37.861913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda8cdc-f019-4574-a174-d0d5a1102ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:37.862200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda8cdc-f019-4574-a174-d0d5a1102ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:37.862476 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda8cdc-f019-4574-a174-d0d5a1102ef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:37.863130 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda8cdc-f019-4574-a174-d0d5a1102ef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:37.864762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda8cdc-f019-4574-a174-d0d5a1102ef7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:37.914531 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3665/7323] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:31:37.920149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2daf2d9-e62b-4de5-9767-a87166cbc00d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:37.948101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2daf2d9-e62b-4de5-9767-a87166cbc00d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:37.960089 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ca9cf-2ac8-49bb-bd4f-74dd74d47354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:37.960977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ca9cf-2ac8-49bb-bd4f-74dd74d47354 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:37.961532 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ca9cf-2ac8-49bb-bd4f-74dd74d47354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:37.962023 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ca9cf-2ac8-49bb-bd4f-74dd74d47354 admin admin] PATH_INFO: `/v3/projects/4eb0e47428304a26a8da4e26ac043ae8/users/190fe9fbd2934e1dbcf79d81f79d710b/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:37.964645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ca9cf-2ac8-49bb-bd4f-74dd74d47354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eb0e47428304a26a8da4e26ac043ae8, user_id=190fe9fbd2934e1dbcf79d81f79d710b, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:37.969084 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ca9cf-2ac8-49bb-bd4f-74dd74d47354 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:37.987787 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3659/7324] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:31:37 2022] PUT /identity/v3/projects/4eb0e47428304a26a8da4e26ac043ae8/users/190fe9fbd2934e1dbcf79d81f79d710b/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:37.999275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8142f-4ba5-489c-b9df-678dad32d7b3 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:38.001003 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8142f-4ba5-489c-b9df-678dad32d7b3 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:38.001614 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8142f-4ba5-489c-b9df-678dad32d7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:38.069313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-81b8142f-4ba5-489c-b9df-678dad32d7b3 None None] MFA Rules not processed for user `190fe9fbd2934e1dbcf79d81f79d710b`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:38.072791 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-81b8142f-4ba5-489c-b9df-678dad32d7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:38.268324 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3666/7325] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:37 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:38.287565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ca9cf-2ac8-49bb-bd4f-74dd74d47354 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:38.289311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1e3ca9cf-2ac8-49bb-bd4f-74dd74d47354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:38.377472 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:38.437251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ca9cf-2ac8-49bb-bd4f-74dd74d47354 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:38.459425 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6651951-41d2-4af0-af64-143ddf5dd43f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:38.460827 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6651951-41d2-4af0-af64-143ddf5dd43f service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:38.461172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6651951-41d2-4af0-af64-143ddf5dd43f service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:38.461684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6651951-41d2-4af0-af64-143ddf5dd43f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:38.477706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6651951-41d2-4af0-af64-143ddf5dd43f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:38.479111 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6651951-41d2-4af0-af64-143ddf5dd43f service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:38.492518 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3660/7326] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:31:38 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:31:39.874662 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dab40-2926-452c-a7f7-8d7da70a10b2 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:39.875336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dab40-2926-452c-a7f7-8d7da70a10b2 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:39.875336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dab40-2926-452c-a7f7-8d7da70a10b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:39.933388 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-333dab40-2926-452c-a7f7-8d7da70a10b2 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:39.937256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-333dab40-2926-452c-a7f7-8d7da70a10b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:39.974654 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:40.088970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6651951-41d2-4af0-af64-143ddf5dd43f service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:40.091730 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f6651951-41d2-4af0-af64-143ddf5dd43f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:40.104026 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3667/7327] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:31:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:40.163225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd3d3b-353e-4176-8da0-07922d205dea None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:40.163867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd3d3b-353e-4176-8da0-07922d205dea None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:40.164333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd3d3b-353e-4176-8da0-07922d205dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:40.203860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-77dd3d3b-353e-4176-8da0-07922d205dea None None] MFA Rules not processed for user `ece1d6709f6d480fbaffa3b47f293dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:40.208770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-77dd3d3b-353e-4176-8da0-07922d205dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:40.242253 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6651951-41d2-4af0-af64-143ddf5dd43f service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:40.248251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96b99f-3b16-4c79-a303-90d50e49db6a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:40.249837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96b99f-3b16-4c79-a303-90d50e49db6a service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:40.250616 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96b99f-3b16-4c79-a303-90d50e49db6a service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:40.251098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96b99f-3b16-4c79-a303-90d50e49db6a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:40.260629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e96b99f-3b16-4c79-a303-90d50e49db6a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:40.262620 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e96b99f-3b16-4c79-a303-90d50e49db6a service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:40.275098 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3661/7328] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:31:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 04 01:31:40.354870 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3668/7329] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:31:41.004780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc696906-9f6e-4117-b027-5956f4c1da78 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:41.005328 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc696906-9f6e-4117-b027-5956f4c1da78 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:41.005789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc696906-9f6e-4117-b027-5956f4c1da78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:41.029124 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-dc696906-9f6e-4117-b027-5956f4c1da78 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:41.031689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-dc696906-9f6e-4117-b027-5956f4c1da78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:41.049242 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3662/7330] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 01:31:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:41.056295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd3d3b-353e-4176-8da0-07922d205dea None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:41.102744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd3d3b-353e-4176-8da0-07922d205dea None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:41.111430 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96673f-4be2-4f90-8c7b-7a9ec9ec794b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:41.112278 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96673f-4be2-4f90-8c7b-7a9ec9ec794b service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:41.112736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96673f-4be2-4f90-8c7b-7a9ec9ec794b service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:41.113216 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96673f-4be2-4f90-8c7b-7a9ec9ec794b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:41.123421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96673f-4be2-4f90-8c7b-7a9ec9ec794b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:41.125355 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96673f-4be2-4f90-8c7b-7a9ec9ec794b service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:41.136706 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3669/7331] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:31:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:31:41.596867 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d51bf1-d761-481d-a9b5-c9bdd8d2f7f8 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:41.597862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d51bf1-d761-481d-a9b5-c9bdd8d2f7f8 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:41.598212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d51bf1-d761-481d-a9b5-c9bdd8d2f7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:41.623018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-81d51bf1-d761-481d-a9b5-c9bdd8d2f7f8 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:41.625050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-81d51bf1-d761-481d-a9b5-c9bdd8d2f7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:41.651042 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3663/7332] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:31:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:41.663633 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96673f-4be2-4f90-8c7b-7a9ec9ec794b service swift] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:41.678191 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96673f-4be2-4f90-8c7b-7a9ec9ec794b service swift] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:41.694605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac1d68-40e6-46ac-b56e-6aefc5f38bb8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:41.695741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac1d68-40e6-46ac-b56e-6aefc5f38bb8 service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:41.696268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac1d68-40e6-46ac-b56e-6aefc5f38bb8 service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:41.696747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac1d68-40e6-46ac-b56e-6aefc5f38bb8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:41.720574 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac1d68-40e6-46ac-b56e-6aefc5f38bb8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:41.725363 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac1d68-40e6-46ac-b56e-6aefc5f38bb8 service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:41.752227 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3670/7333] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:31:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:31:42.316270 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b2b88-ff94-4119-8bde-b8d7dfa1b315 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:42.316469 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b2b88-ff94-4119-8bde-b8d7dfa1b315 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:42.318176 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b2b88-ff94-4119-8bde-b8d7dfa1b315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:42.369608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-fa4b2b88-ff94-4119-8bde-b8d7dfa1b315 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:42.371147 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-fa4b2b88-ff94-4119-8bde-b8d7dfa1b315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:42.393427 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3664/7334] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 01:31:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:42.417596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac1d68-40e6-46ac-b56e-6aefc5f38bb8 service swift] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:42.449985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac1d68-40e6-46ac-b56e-6aefc5f38bb8 service swift] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:42.479388 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41bc80-a6ff-4944-b5d9-15ff477a4f03 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:42.482395 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41bc80-a6ff-4944-b5d9-15ff477a4f03 service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:42.482710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41bc80-a6ff-4944-b5d9-15ff477a4f03 service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:42.483603 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41bc80-a6ff-4944-b5d9-15ff477a4f03 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:42.502336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d41bc80-a6ff-4944-b5d9-15ff477a4f03 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:42.504052 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d41bc80-a6ff-4944-b5d9-15ff477a4f03 service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:42.515318 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3671/7335] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:31:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:31:42.784533 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b2b88-ff94-4119-8bde-b8d7dfa1b315 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:42.899844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b2b88-ff94-4119-8bde-b8d7dfa1b315 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:42.919389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98307554-4f85-45ba-bde4-25fe12330e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:42.919910 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98307554-4f85-45ba-bde4-25fe12330e7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:42.920283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98307554-4f85-45ba-bde4-25fe12330e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:42.920645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98307554-4f85-45ba-bde4-25fe12330e7e admin admin] PATH_INFO: `/v3/users/d6e77d91b29d4e7383abd6f9db6b5ed6` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:42.921979 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98307554-4f85-45ba-bde4-25fe12330e7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6e77d91b29d4e7383abd6f9db6b5ed6)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:42.923846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98307554-4f85-45ba-bde4-25fe12330e7e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:43.031116 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:43.038760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-98307554-4f85-45ba-bde4-25fe12330e7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6e77d91b29d4e7383abd6f9db6b5ed6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:43.039720 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-98307554-4f85-45ba-bde4-25fe12330e7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6e77d91b29d4e7383abd6f9db6b5ed6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:43.051604 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-98307554-4f85-45ba-bde4-25fe12330e7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6e77d91b29d4e7383abd6f9db6b5ed6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:43.100465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-98307554-4f85-45ba-bde4-25fe12330e7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6e77d91b29d4e7383abd6f9db6b5ed6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:43.101233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-98307554-4f85-45ba-bde4-25fe12330e7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6e77d91b29d4e7383abd6f9db6b5ed6'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:43.185288 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3665/7336] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:31:42 2022] DELETE /identity/v3/users/d6e77d91b29d4e7383abd6f9db6b5ed6 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:43.190414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f85b4f-daeb-4655-bafe-249544a4e913 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:43.190621 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f85b4f-daeb-4655-bafe-249544a4e913 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:43.190856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f85b4f-daeb-4655-bafe-249544a4e913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:43.221779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-51f85b4f-daeb-4655-bafe-249544a4e913 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:43.224490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-51f85b4f-daeb-4655-bafe-249544a4e913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:43.344043 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3672/7337] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:31:43.360678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98307554-4f85-45ba-bde4-25fe12330e7e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:43.362768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-98307554-4f85-45ba-bde4-25fe12330e7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:43.496215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98307554-4f85-45ba-bde4-25fe12330e7e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:43.509773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9def5b2-e10e-49b7-a31d-a34328deee59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:43.510700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9def5b2-e10e-49b7-a31d-a34328deee59 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:43.511211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9def5b2-e10e-49b7-a31d-a34328deee59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:43.511730 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9def5b2-e10e-49b7-a31d-a34328deee59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:43.530574 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9def5b2-e10e-49b7-a31d-a34328deee59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:43.535979 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9def5b2-e10e-49b7-a31d-a34328deee59 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:43.563784 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3666/7338] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:31:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:31:45.527173 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f85b4f-daeb-4655-bafe-249544a4e913 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:45.528644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-51f85b4f-daeb-4655-bafe-249544a4e913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:45.552477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f85b4f-daeb-4655-bafe-249544a4e913 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:45.562297 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaff39a-af7b-4b5d-8693-528790760769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:45.562946 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaff39a-af7b-4b5d-8693-528790760769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:45.563204 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaff39a-af7b-4b5d-8693-528790760769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:45.563484 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaff39a-af7b-4b5d-8693-528790760769 admin admin] PATH_INFO: `/v3/projects/807fb108f1de40f89a13ca169313fe64` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:45.564653 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaff39a-af7b-4b5d-8693-528790760769 admin admin] RBAC: Authorizing `identity:delete_project(project_id=807fb108f1de40f89a13ca169313fe64)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:45.566622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaff39a-af7b-4b5d-8693-528790760769 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:45.618050 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:45.667452 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-feaff39a-af7b-4b5d-8693-528790760769 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '807fb108f1de40f89a13ca169313fe64', 'request_id': 'req-feaff39a-af7b-4b5d-8693-528790760769'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:45.687937 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-feaff39a-af7b-4b5d-8693-528790760769 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '807fb108f1de40f89a13ca169313fe64', 'request_id': 'req-feaff39a-af7b-4b5d-8693-528790760769'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:45.694817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-feaff39a-af7b-4b5d-8693-528790760769 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '807fb108f1de40f89a13ca169313fe64', 'request_id': 'req-feaff39a-af7b-4b5d-8693-528790760769'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:45.720191 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-feaff39a-af7b-4b5d-8693-528790760769 admin admin] The token cache is being invalidate because project 807fb108f1de40f89a13ca169313fe64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:31:45.722054 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-feaff39a-af7b-4b5d-8693-528790760769 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:45.727231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-feaff39a-af7b-4b5d-8693-528790760769 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:45.735101 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3673/7339] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:31:45 2022] DELETE /identity/v3/projects/807fb108f1de40f89a13ca169313fe64 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:45.736059 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9def5b2-e10e-49b7-a31d-a34328deee59 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:45.753462 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9def5b2-e10e-49b7-a31d-a34328deee59 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:45.907627 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ade122-8b8f-480d-80e9-799189279735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:45.908245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ade122-8b8f-480d-80e9-799189279735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:45.911204 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ade122-8b8f-480d-80e9-799189279735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:45.911527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ade122-8b8f-480d-80e9-799189279735 admin admin] PATH_INFO: `/v3/users/190fe9fbd2934e1dbcf79d81f79d710b` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:45.913628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ade122-8b8f-480d-80e9-799189279735 admin admin] RBAC: Authorizing `identity:delete_user(user_id=190fe9fbd2934e1dbcf79d81f79d710b)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:45.921653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ade122-8b8f-480d-80e9-799189279735 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:46.030483 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-74ade122-8b8f-480d-80e9-799189279735 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '190fe9fbd2934e1dbcf79d81f79d710b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:46.032590 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-74ade122-8b8f-480d-80e9-799189279735 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '190fe9fbd2934e1dbcf79d81f79d710b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:46.045822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-74ade122-8b8f-480d-80e9-799189279735 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '190fe9fbd2934e1dbcf79d81f79d710b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:46.060412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-74ade122-8b8f-480d-80e9-799189279735 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '190fe9fbd2934e1dbcf79d81f79d710b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:46.061700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-74ade122-8b8f-480d-80e9-799189279735 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '190fe9fbd2934e1dbcf79d81f79d710b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:46.064006 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:46.147329 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3667/7340] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:31:45 2022] DELETE /identity/v3/users/190fe9fbd2934e1dbcf79d81f79d710b => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:47.257990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaff39a-af7b-4b5d-8693-528790760769 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:47.260971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-feaff39a-af7b-4b5d-8693-528790760769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:47.316468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaff39a-af7b-4b5d-8693-528790760769 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:47.422415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb71d8-1e10-41dd-9f20-4be2e766f140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:47.423246 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb71d8-1e10-41dd-9f20-4be2e766f140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:47.423693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb71d8-1e10-41dd-9f20-4be2e766f140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:47.424036 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb71d8-1e10-41dd-9f20-4be2e766f140 admin admin] PATH_INFO: `/v3/projects/4eb0e47428304a26a8da4e26ac043ae8` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:47.425379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb71d8-1e10-41dd-9f20-4be2e766f140 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eb0e47428304a26a8da4e26ac043ae8)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:47.427449 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb71d8-1e10-41dd-9f20-4be2e766f140 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:47.512026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-85cb71d8-1e10-41dd-9f20-4be2e766f140 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eb0e47428304a26a8da4e26ac043ae8', 'request_id': 'req-85cb71d8-1e10-41dd-9f20-4be2e766f140'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:47.528068 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-85cb71d8-1e10-41dd-9f20-4be2e766f140 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eb0e47428304a26a8da4e26ac043ae8', 'request_id': 'req-85cb71d8-1e10-41dd-9f20-4be2e766f140'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:47.546464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-85cb71d8-1e10-41dd-9f20-4be2e766f140 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eb0e47428304a26a8da4e26ac043ae8', 'request_id': 'req-85cb71d8-1e10-41dd-9f20-4be2e766f140'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:47.562534 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-85cb71d8-1e10-41dd-9f20-4be2e766f140 admin admin] The token cache is being invalidate because project 4eb0e47428304a26a8da4e26ac043ae8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:31:47.562534 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-85cb71d8-1e10-41dd-9f20-4be2e766f140 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:47.562534 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-85cb71d8-1e10-41dd-9f20-4be2e766f140 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:47.566669 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3674/7341] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:31:47 2022] DELETE /identity/v3/projects/4eb0e47428304a26a8da4e26ac043ae8 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:47.570788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d1eed-8e44-4198-9809-62cc906af4e4 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:47.570788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d1eed-8e44-4198-9809-62cc906af4e4 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:47.570788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d1eed-8e44-4198-9809-62cc906af4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:47.624532 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb71d8-1e10-41dd-9f20-4be2e766f140 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:47.626592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-85cb71d8-1e10-41dd-9f20-4be2e766f140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:47.641463 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-641d1eed-8e44-4198-9809-62cc906af4e4 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:47.645394 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-641d1eed-8e44-4198-9809-62cc906af4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:47.744568 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:47.811263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb71d8-1e10-41dd-9f20-4be2e766f140 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:47.825345 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3668/7342] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:47.827515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbf7a5-25b1-40cd-a496-4b3806165b29 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:47.827802 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbf7a5-25b1-40cd-a496-4b3806165b29 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:47.828080 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbf7a5-25b1-40cd-a496-4b3806165b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:47.828784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f33930-502e-4187-b17c-510461b4afbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:47.829708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f33930-502e-4187-b17c-510461b4afbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:47.830207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f33930-502e-4187-b17c-510461b4afbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:47.830578 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f33930-502e-4187-b17c-510461b4afbc admin admin] PATH_INFO: `/v3/users/5dd07f62b0974feda6345df8442b5020` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:47.832924 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f33930-502e-4187-b17c-510461b4afbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dd07f62b0974feda6345df8442b5020)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:47.836820 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f33930-502e-4187-b17c-510461b4afbc admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:47.869700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-29fbf7a5-25b1-40cd-a496-4b3806165b29 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:47.871011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-29fbf7a5-25b1-40cd-a496-4b3806165b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:47.891379 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3669/7343] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:47.896588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbf7a5-25b1-40cd-a496-4b3806165b29 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:47.908314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbf7a5-25b1-40cd-a496-4b3806165b29 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:47.913675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac84475-3fe9-4324-808f-aeb0bea2086b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:47.914309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac84475-3fe9-4324-808f-aeb0bea2086b admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:47.914716 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac84475-3fe9-4324-808f-aeb0bea2086b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:47.915296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac84475-3fe9-4324-808f-aeb0bea2086b admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:47.916107 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac84475-3fe9-4324-808f-aeb0bea2086b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:31:47.916554 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac84475-3fe9-4324-808f-aeb0bea2086b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:47.918401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac84475-3fe9-4324-808f-aeb0bea2086b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:47.940670 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3670/7344] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:31:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:31:47.944015 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac84475-3fe9-4324-808f-aeb0bea2086b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:47.955815 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac84475-3fe9-4324-808f-aeb0bea2086b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:47.961468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b63ca3-1dec-4578-a295-add317ff2a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:47.962266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b63ca3-1dec-4578-a295-add317ff2a4c admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:47.962651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b63ca3-1dec-4578-a295-add317ff2a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:47.963036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b63ca3-1dec-4578-a295-add317ff2a4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:47.964311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b63ca3-1dec-4578-a295-add317ff2a4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:47.970141 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b63ca3-1dec-4578-a295-add317ff2a4c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:48.025735 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3671/7345] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:31:47 2022] POST /identity/v3/projects => generated 385 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:31:48.027828 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b63ca3-1dec-4578-a295-add317ff2a4c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:48.070357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-03f33930-502e-4187-b17c-510461b4afbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dd07f62b0974feda6345df8442b5020'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:48.072101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-03f33930-502e-4187-b17c-510461b4afbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dd07f62b0974feda6345df8442b5020'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:48.109389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-03f33930-502e-4187-b17c-510461b4afbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dd07f62b0974feda6345df8442b5020'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:48.141170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-03f33930-502e-4187-b17c-510461b4afbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dd07f62b0974feda6345df8442b5020'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:48.142255 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-03f33930-502e-4187-b17c-510461b4afbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dd07f62b0974feda6345df8442b5020'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:48.195756 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3675/7346] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:31:47 2022] DELETE /identity/v3/users/5dd07f62b0974feda6345df8442b5020 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:31:48.199982 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1e1ac-24d5-4bd0-b9ae-8b578dc617f8 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:48.200292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1e1ac-24d5-4bd0-b9ae-8b578dc617f8 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:48.200572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1e1ac-24d5-4bd0-b9ae-8b578dc617f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:48.220293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b63ca3-1dec-4578-a295-add317ff2a4c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:48.257826 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-d0f1e1ac-24d5-4bd0-b9ae-8b578dc617f8 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:48.261165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d0f1e1ac-24d5-4bd0-b9ae-8b578dc617f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:48.391420 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:48.419842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79513a98-63cc-4cec-bb27-294ffca52af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:48.421264 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79513a98-63cc-4cec-bb27-294ffca52af1 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:48.421807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79513a98-63cc-4cec-bb27-294ffca52af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:48.423251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79513a98-63cc-4cec-bb27-294ffca52af1 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:48.425356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79513a98-63cc-4cec-bb27-294ffca52af1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:48.428229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79513a98-63cc-4cec-bb27-294ffca52af1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:48.447151 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3676/7347] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:31:48.472170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1e1ac-24d5-4bd0-b9ae-8b578dc617f8 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:48.476012 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d0f1e1ac-24d5-4bd0-b9ae-8b578dc617f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:48.488396 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3672/7348] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:31:48 2022] POST /identity/v3/users => generated 293 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:31:48.491236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79513a98-63cc-4cec-bb27-294ffca52af1 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:48.495582 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-79513a98-63cc-4cec-bb27-294ffca52af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:48.530923 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79513a98-63cc-4cec-bb27-294ffca52af1 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:48.544373 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306fd04-0b42-4488-bbee-f5b1424f2d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:48.544767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306fd04-0b42-4488-bbee-f5b1424f2d5b admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:48.544987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306fd04-0b42-4488-bbee-f5b1424f2d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:48.545327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306fd04-0b42-4488-bbee-f5b1424f2d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:48.546870 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306fd04-0b42-4488-bbee-f5b1424f2d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:48.551655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306fd04-0b42-4488-bbee-f5b1424f2d5b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:48.577503 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3673/7349] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:31:48.583004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306fd04-0b42-4488-bbee-f5b1424f2d5b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:48.601127 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306fd04-0b42-4488-bbee-f5b1424f2d5b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:48.609997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe276c-b520-497d-8737-df11e5611800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:48.610669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe276c-b520-497d-8737-df11e5611800 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:48.610955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe276c-b520-497d-8737-df11e5611800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:48.611495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe276c-b520-497d-8737-df11e5611800 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:48.612296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe276c-b520-497d-8737-df11e5611800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:48.614141 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe276c-b520-497d-8737-df11e5611800 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:48.627729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1e1ac-24d5-4bd0-b9ae-8b578dc617f8 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:48.636453 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3674/7350] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:31:48.636453 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe276c-b520-497d-8737-df11e5611800 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:48.643921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d1709-2cbf-4e8d-b9a0-fa39e9b3e24e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:48.644747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d1709-2cbf-4e8d-b9a0-fa39e9b3e24e service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:48.645094 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d1709-2cbf-4e8d-b9a0-fa39e9b3e24e service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:48.645293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d1709-2cbf-4e8d-b9a0-fa39e9b3e24e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:48.648237 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe276c-b520-497d-8737-df11e5611800 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:48.653421 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257c9f8-d4a2-4dee-a0bd-1eb017594ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:48.654079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257c9f8-d4a2-4dee-a0bd-1eb017594ab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:48.654364 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257c9f8-d4a2-4dee-a0bd-1eb017594ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:48.655417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257c9f8-d4a2-4dee-a0bd-1eb017594ab1 admin admin] PATH_INFO: `/v3/projects/30b006a0766f406c82b5f32af914f5dc/users/71e7951cc6d1453397f4aa65b43fcff4/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:48.668656 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d1709-2cbf-4e8d-b9a0-fa39e9b3e24e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:48.670817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d1709-2cbf-4e8d-b9a0-fa39e9b3e24e service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:48.679210 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:48.682119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257c9f8-d4a2-4dee-a0bd-1eb017594ab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30b006a0766f406c82b5f32af914f5dc, user_id=71e7951cc6d1453397f4aa65b43fcff4, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:48.685601 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257c9f8-d4a2-4dee-a0bd-1eb017594ab1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:48.692186 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3677/7351] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:31:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:31:48.729731 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3675/7352] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:31:48 2022] PUT /identity/v3/projects/30b006a0766f406c82b5f32af914f5dc/users/71e7951cc6d1453397f4aa65b43fcff4/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:48.729948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ec97a-47d6-4f9c-9970-921b5775af2f None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:48.730171 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ec97a-47d6-4f9c-9970-921b5775af2f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:48.730450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ec97a-47d6-4f9c-9970-921b5775af2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:48.815749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-383ec97a-47d6-4f9c-9970-921b5775af2f None None] MFA Rules not processed for user `71e7951cc6d1453397f4aa65b43fcff4`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:48.817452 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-383ec97a-47d6-4f9c-9970-921b5775af2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:48.974849 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3678/7353] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:31:48.976398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257c9f8-d4a2-4dee-a0bd-1eb017594ab1 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:49.062240 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257c9f8-d4a2-4dee-a0bd-1eb017594ab1 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:49.072889 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0680d0-0653-408f-a1be-b29ec029e53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:49.073678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0680d0-0653-408f-a1be-b29ec029e53e admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:49.074213 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0680d0-0653-408f-a1be-b29ec029e53e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:49.074494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0680d0-0653-408f-a1be-b29ec029e53e admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:49.075288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0680d0-0653-408f-a1be-b29ec029e53e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:49.079098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0680d0-0653-408f-a1be-b29ec029e53e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:49.135857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ec97a-47d6-4f9c-9970-921b5775af2f None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:49.141627 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3676/7354] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:31:48 2022] POST /identity/v3/projects => generated 385 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:31:49.163943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ec97a-47d6-4f9c-9970-921b5775af2f None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:49.314148 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8a9e6-e12c-4fa9-b148-01268c2e6eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:49.315461 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8a9e6-e12c-4fa9-b148-01268c2e6eb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:49.315893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8a9e6-e12c-4fa9-b148-01268c2e6eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:49.316313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8a9e6-e12c-4fa9-b148-01268c2e6eb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:49.317484 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c8a9e6-e12c-4fa9-b148-01268c2e6eb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:49.320871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c8a9e6-e12c-4fa9-b148-01268c2e6eb1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:49.351943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0680d0-0653-408f-a1be-b29ec029e53e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:49.354275 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5d0680d0-0653-408f-a1be-b29ec029e53e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:49.384803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0680d0-0653-408f-a1be-b29ec029e53e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:49.393943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c1826-0cae-4196-b40c-2c85d38ac5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:49.394755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c1826-0cae-4196-b40c-2c85d38ac5be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:49.395101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c1826-0cae-4196-b40c-2c85d38ac5be admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:49.395498 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c1826-0cae-4196-b40c-2c85d38ac5be admin admin] PATH_INFO: `/v3/projects/8b7ba737d95c4c23a9ebfd5344f3b7ef` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:49.396903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c1826-0cae-4196-b40c-2c85d38ac5be admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b7ba737d95c4c23a9ebfd5344f3b7ef)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:49.399046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c1826-0cae-4196-b40c-2c85d38ac5be admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:49.407233 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3679/7355] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:31:49 2022] POST /identity/v3/users => generated 299 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:31:49.410476 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8a9e6-e12c-4fa9-b148-01268c2e6eb1 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:49.429133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8a9e6-e12c-4fa9-b148-01268c2e6eb1 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:49.460005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7953d13-0f55-4ec8-afee-98eb186088cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:49.461044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7953d13-0f55-4ec8-afee-98eb186088cf admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:49.461584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7953d13-0f55-4ec8-afee-98eb186088cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:49.462116 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7953d13-0f55-4ec8-afee-98eb186088cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:49.463173 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7953d13-0f55-4ec8-afee-98eb186088cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:49.465545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7953d13-0f55-4ec8-afee-98eb186088cf admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:49.499489 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3680/7356] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:31:49.501078 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-eb8c1826-0cae-4196-b40c-2c85d38ac5be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b7ba737d95c4c23a9ebfd5344f3b7ef', 'request_id': 'req-eb8c1826-0cae-4196-b40c-2c85d38ac5be'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:49.501804 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7953d13-0f55-4ec8-afee-98eb186088cf admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:49.513302 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-eb8c1826-0cae-4196-b40c-2c85d38ac5be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b7ba737d95c4c23a9ebfd5344f3b7ef', 'request_id': 'req-eb8c1826-0cae-4196-b40c-2c85d38ac5be'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:49.520411 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7953d13-0f55-4ec8-afee-98eb186088cf admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:49.530341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-eb8c1826-0cae-4196-b40c-2c85d38ac5be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b7ba737d95c4c23a9ebfd5344f3b7ef', 'request_id': 'req-eb8c1826-0cae-4196-b40c-2c85d38ac5be'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:49.544979 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:49.569855 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-eb8c1826-0cae-4196-b40c-2c85d38ac5be admin admin] The token cache is being invalidate because project 8b7ba737d95c4c23a9ebfd5344f3b7ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:31:49.570573 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-eb8c1826-0cae-4196-b40c-2c85d38ac5be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:49.571599 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-eb8c1826-0cae-4196-b40c-2c85d38ac5be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:49.575661 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3677/7357] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:31:49 2022] DELETE /identity/v3/projects/8b7ba737d95c4c23a9ebfd5344f3b7ef => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:49.581012 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e99463-29ff-48ce-87e1-3f77ccf9f797 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:49.582032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e99463-29ff-48ce-87e1-3f77ccf9f797 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:49.582556 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e99463-29ff-48ce-87e1-3f77ccf9f797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:49.604627 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ea5cb-80a5-4169-b146-47f79477f819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:49.605323 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ea5cb-80a5-4169-b146-47f79477f819 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:49.605634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ea5cb-80a5-4169-b146-47f79477f819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:49.605908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ea5cb-80a5-4169-b146-47f79477f819 admin admin] PATH_INFO: `/v3/projects/914e82fc09964a9aa1d72e7e2e1bcdd0/users/adf84e8824194c2399e73b3a0d08b530/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:49.623050 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:49.628227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ea5cb-80a5-4169-b146-47f79477f819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=914e82fc09964a9aa1d72e7e2e1bcdd0, user_id=adf84e8824194c2399e73b3a0d08b530, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:49.631265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ea5cb-80a5-4169-b146-47f79477f819 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:49.649988 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3681/7358] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:31:49 2022] PUT /identity/v3/projects/914e82fc09964a9aa1d72e7e2e1bcdd0/users/adf84e8824194c2399e73b3a0d08b530/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:31:49.653257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c2e99463-29ff-48ce-87e1-3f77ccf9f797 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:49.654216 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ea5cb-80a5-4169-b146-47f79477f819 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:49.654584 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c2e99463-29ff-48ce-87e1-3f77ccf9f797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:49.656276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-913ea5cb-80a5-4169-b146-47f79477f819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:49.746914 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ea5cb-80a5-4169-b146-47f79477f819 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:49.753100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f7eb2-5c09-4782-b599-2503e425601d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:49.754876 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f7eb2-5c09-4782-b599-2503e425601d admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:49.755080 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f7eb2-5c09-4782-b599-2503e425601d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:49.755306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f7eb2-5c09-4782-b599-2503e425601d admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:49.756140 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f7eb2-5c09-4782-b599-2503e425601d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:49.758011 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f7eb2-5c09-4782-b599-2503e425601d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:49.769421 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3682/7359] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:31:49.773149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f7eb2-5c09-4782-b599-2503e425601d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:49.781512 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3678/7360] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:31:49.783398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b524f2-524f-48a2-9787-481da9667957 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:49.784076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b524f2-524f-48a2-9787-481da9667957 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:49.784552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b524f2-524f-48a2-9787-481da9667957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:49.789138 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f7eb2-5c09-4782-b599-2503e425601d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:49.796650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4938f-f275-4d88-a65b-b917138cfc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:49.797420 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4938f-f275-4d88-a65b-b917138cfc1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:49.797802 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4938f-f275-4d88-a65b-b917138cfc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:49.798313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4938f-f275-4d88-a65b-b917138cfc1d admin admin] PATH_INFO: `/v3/projects/914e82fc09964a9aa1d72e7e2e1bcdd0/users/adf84e8824194c2399e73b3a0d08b530/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:49.800854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4938f-f275-4d88-a65b-b917138cfc1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=914e82fc09964a9aa1d72e7e2e1bcdd0, user_id=adf84e8824194c2399e73b3a0d08b530, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:49.804161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4938f-f275-4d88-a65b-b917138cfc1d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:49.810197 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a7b524f2-524f-48a2-9787-481da9667957 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:49.811720 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a7b524f2-524f-48a2-9787-481da9667957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:49.828772 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3683/7361] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:31:49 2022] PUT /identity/v3/projects/914e82fc09964a9aa1d72e7e2e1bcdd0/users/adf84e8824194c2399e73b3a0d08b530/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:49.830432 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387c5e6-5eaa-4faf-80cb-d6e1f28d780d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:49.830788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387c5e6-5eaa-4faf-80cb-d6e1f28d780d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:49.831156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387c5e6-5eaa-4faf-80cb-d6e1f28d780d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:49.874312 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-7387c5e6-5eaa-4faf-80cb-d6e1f28d780d None None] MFA Rules not processed for user `adf84e8824194c2399e73b3a0d08b530`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:49.875555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7387c5e6-5eaa-4faf-80cb-d6e1f28d780d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:49.899179 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3679/7362] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:49.900127 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b524f2-524f-48a2-9787-481da9667957 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:49.910514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b524f2-524f-48a2-9787-481da9667957 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:49.915646 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1607d3-cef3-4323-898e-3966de822295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:49.916446 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1607d3-cef3-4323-898e-3966de822295 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:49.916650 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1607d3-cef3-4323-898e-3966de822295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:49.917493 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1607d3-cef3-4323-898e-3966de822295 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:49.917631 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1607d3-cef3-4323-898e-3966de822295 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:31:49.918007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1607d3-cef3-4323-898e-3966de822295 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:49.919760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1607d3-cef3-4323-898e-3966de822295 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:49.934964 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3680/7363] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:31:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:31:49.939412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1607d3-cef3-4323-898e-3966de822295 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:49.950154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1607d3-cef3-4323-898e-3966de822295 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:49.956656 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b896413-4fa3-4221-ac01-d9bccac56a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:49.957271 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b896413-4fa3-4221-ac01-d9bccac56a75 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:49.958280 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b896413-4fa3-4221-ac01-d9bccac56a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:49.958280 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b896413-4fa3-4221-ac01-d9bccac56a75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:49.958500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b896413-4fa3-4221-ac01-d9bccac56a75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:49.960809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b896413-4fa3-4221-ac01-d9bccac56a75 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:49.966011 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3684/7364] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:49.977823 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7387c5e6-5eaa-4faf-80cb-d6e1f28d780d None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:49.979551 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7387c5e6-5eaa-4faf-80cb-d6e1f28d780d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:49.997053 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3681/7365] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:31:49 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:31:50.001717 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b896413-4fa3-4221-ac01-d9bccac56a75 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:50.063597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7387c5e6-5eaa-4faf-80cb-d6e1f28d780d None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:50.075760 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:50.082075 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b896413-4fa3-4221-ac01-d9bccac56a75 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:50.088568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23ad50-4961-489a-b5ec-e23a8b2a020e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:50.089192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23ad50-4961-489a-b5ec-e23a8b2a020e admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:50.089521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23ad50-4961-489a-b5ec-e23a8b2a020e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:50.089804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23ad50-4961-489a-b5ec-e23a8b2a020e admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:50.090444 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23ad50-4961-489a-b5ec-e23a8b2a020e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:50.092904 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23ad50-4961-489a-b5ec-e23a8b2a020e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:50.104420 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:50.123727 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3682/7366] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:31:50 2022] POST /identity/v3/users => generated 290 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:31:50.127417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23ad50-4961-489a-b5ec-e23a8b2a020e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:50.131209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fb075-603f-452f-afb9-8bc3f20a15b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:50.131912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fb075-603f-452f-afb9-8bc3f20a15b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:50.132267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fb075-603f-452f-afb9-8bc3f20a15b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:50.132966 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fb075-603f-452f-afb9-8bc3f20a15b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:50.140129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23ad50-4961-489a-b5ec-e23a8b2a020e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:50.146346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea01c29-e687-44c9-a1fd-0b45cfab4128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:50.146936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea01c29-e687-44c9-a1fd-0b45cfab4128 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:50.147219 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea01c29-e687-44c9-a1fd-0b45cfab4128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:50.147494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea01c29-e687-44c9-a1fd-0b45cfab4128 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:50.148416 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea01c29-e687-44c9-a1fd-0b45cfab4128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:50.149795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea01c29-e687-44c9-a1fd-0b45cfab4128 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:50.163674 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3683/7367] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:31:50.165114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea01c29-e687-44c9-a1fd-0b45cfab4128 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:50.175094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea01c29-e687-44c9-a1fd-0b45cfab4128 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:50.180128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89768dc8-75f3-48b5-953f-054980aede57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:50.180783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89768dc8-75f3-48b5-953f-054980aede57 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:50.181188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89768dc8-75f3-48b5-953f-054980aede57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:50.181523 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89768dc8-75f3-48b5-953f-054980aede57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:50.182130 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89768dc8-75f3-48b5-953f-054980aede57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:50.183821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89768dc8-75f3-48b5-953f-054980aede57 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:50.200886 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3684/7368] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:31:50.207865 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89768dc8-75f3-48b5-953f-054980aede57 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:50.223732 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89768dc8-75f3-48b5-953f-054980aede57 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:50.229920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3213fa-dd33-4951-8afa-f6ec7f1a873e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:50.232050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3213fa-dd33-4951-8afa-f6ec7f1a873e admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:50.232333 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3213fa-dd33-4951-8afa-f6ec7f1a873e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:50.232645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3213fa-dd33-4951-8afa-f6ec7f1a873e admin admin] PATH_INFO: `/v3/projects/57fd344992574c8f9338f1ff20d5a319/users/f39dd2d709374c729d51f7e2cf18300c/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:50.242194 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fb075-603f-452f-afb9-8bc3f20a15b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:50.244032 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fb075-603f-452f-afb9-8bc3f20a15b2 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:50.252125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3213fa-dd33-4951-8afa-f6ec7f1a873e admin admin] RBAC: Authorizing `identity:create_grant(project_id=57fd344992574c8f9338f1ff20d5a319, user_id=f39dd2d709374c729d51f7e2cf18300c, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:50.255899 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3213fa-dd33-4951-8afa-f6ec7f1a873e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:50.256157 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3685/7369] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:31:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:31:50.276311 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3685/7370] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:31:50 2022] PUT /identity/v3/projects/57fd344992574c8f9338f1ff20d5a319/users/f39dd2d709374c729d51f7e2cf18300c/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:50.283144 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ebfde-0046-4f34-8cc0-dfceceffc2b4 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:50.284496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ebfde-0046-4f34-8cc0-dfceceffc2b4 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:50.285471 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ebfde-0046-4f34-8cc0-dfceceffc2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:50.349101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-b50ebfde-0046-4f34-8cc0-dfceceffc2b4 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:50.352218 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b50ebfde-0046-4f34-8cc0-dfceceffc2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:50.460061 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3686/7371] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:31:50.521408 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3213fa-dd33-4951-8afa-f6ec7f1a873e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:50.527543 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2f3213fa-dd33-4951-8afa-f6ec7f1a873e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:50.614050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3213fa-dd33-4951-8afa-f6ec7f1a873e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:50.617901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062787c3-246b-487d-971b-d92a8fc3b6d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:50.618539 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062787c3-246b-487d-971b-d92a8fc3b6d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:50.618821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062787c3-246b-487d-971b-d92a8fc3b6d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:50.619096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062787c3-246b-487d-971b-d92a8fc3b6d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:50.630244 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062787c3-246b-487d-971b-d92a8fc3b6d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:50.631910 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062787c3-246b-487d-971b-d92a8fc3b6d6 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:50.644036 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3686/7372] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:31:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:31:53.887334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ebfde-0046-4f34-8cc0-dfceceffc2b4 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:53.911677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ebfde-0046-4f34-8cc0-dfceceffc2b4 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:53.920911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698d76a-143a-4eaf-9c4a-76aeafcf6112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:53.922526 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698d76a-143a-4eaf-9c4a-76aeafcf6112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:53.923039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698d76a-143a-4eaf-9c4a-76aeafcf6112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:53.923403 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698d76a-143a-4eaf-9c4a-76aeafcf6112 admin admin] PATH_INFO: `/v3/users/71e7951cc6d1453397f4aa65b43fcff4` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:53.925479 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698d76a-143a-4eaf-9c4a-76aeafcf6112 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71e7951cc6d1453397f4aa65b43fcff4)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:53.927670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698d76a-143a-4eaf-9c4a-76aeafcf6112 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:54.032672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2698d76a-143a-4eaf-9c4a-76aeafcf6112 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71e7951cc6d1453397f4aa65b43fcff4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:54.034012 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2698d76a-143a-4eaf-9c4a-76aeafcf6112 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71e7951cc6d1453397f4aa65b43fcff4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:54.054516 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2698d76a-143a-4eaf-9c4a-76aeafcf6112 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71e7951cc6d1453397f4aa65b43fcff4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:54.073493 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:54.085168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2698d76a-143a-4eaf-9c4a-76aeafcf6112 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71e7951cc6d1453397f4aa65b43fcff4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:54.086113 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-2698d76a-143a-4eaf-9c4a-76aeafcf6112 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71e7951cc6d1453397f4aa65b43fcff4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:54.125300 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3687/7373] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:31:53 2022] DELETE /identity/v3/users/71e7951cc6d1453397f4aa65b43fcff4 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:54.126872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae5f9f-1f25-43fa-bb18-726e06670ae1 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:54.127312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae5f9f-1f25-43fa-bb18-726e06670ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:54.127430 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae5f9f-1f25-43fa-bb18-726e06670ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:54.171063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-2aae5f9f-1f25-43fa-bb18-726e06670ae1 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:54.172307 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2aae5f9f-1f25-43fa-bb18-726e06670ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:54.281066 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3687/7374] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:54.292820 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698d76a-143a-4eaf-9c4a-76aeafcf6112 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:54.294560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2698d76a-143a-4eaf-9c4a-76aeafcf6112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:54.433143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698d76a-143a-4eaf-9c4a-76aeafcf6112 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:54.446069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f3774-d148-4353-8cfc-f3f0f1b09ff3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:54.446724 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f3774-d148-4353-8cfc-f3f0f1b09ff3 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:54.447175 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f3774-d148-4353-8cfc-f3f0f1b09ff3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:54.447453 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f3774-d148-4353-8cfc-f3f0f1b09ff3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:54.474788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f3774-d148-4353-8cfc-f3f0f1b09ff3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:54.476482 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f3774-d148-4353-8cfc-f3f0f1b09ff3 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:54.489982 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3688/7375] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:31:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:31:55.071242 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae5f9f-1f25-43fa-bb18-726e06670ae1 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:55.072729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2aae5f9f-1f25-43fa-bb18-726e06670ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:55.112402 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae5f9f-1f25-43fa-bb18-726e06670ae1 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:55.121520 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad55a18-a921-4153-9e76-e06de1ab3fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:55.122191 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad55a18-a921-4153-9e76-e06de1ab3fc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:55.122494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad55a18-a921-4153-9e76-e06de1ab3fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:55.122781 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad55a18-a921-4153-9e76-e06de1ab3fc0 admin admin] PATH_INFO: `/v3/projects/30b006a0766f406c82b5f32af914f5dc` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:55.125002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad55a18-a921-4153-9e76-e06de1ab3fc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30b006a0766f406c82b5f32af914f5dc)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:55.127255 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad55a18-a921-4153-9e76-e06de1ab3fc0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:55.243866 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:INSERT=2,keystone:SELECT=95,keystone:DELETE=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:55.249944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dad55a18-a921-4153-9e76-e06de1ab3fc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30b006a0766f406c82b5f32af914f5dc', 'request_id': 'req-dad55a18-a921-4153-9e76-e06de1ab3fc0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:55.263613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dad55a18-a921-4153-9e76-e06de1ab3fc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30b006a0766f406c82b5f32af914f5dc', 'request_id': 'req-dad55a18-a921-4153-9e76-e06de1ab3fc0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:55.273275 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dad55a18-a921-4153-9e76-e06de1ab3fc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30b006a0766f406c82b5f32af914f5dc', 'request_id': 'req-dad55a18-a921-4153-9e76-e06de1ab3fc0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:55.296785 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dad55a18-a921-4153-9e76-e06de1ab3fc0 admin admin] The token cache is being invalidate because project 30b006a0766f406c82b5f32af914f5dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:31:55.297458 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dad55a18-a921-4153-9e76-e06de1ab3fc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:55.298446 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dad55a18-a921-4153-9e76-e06de1ab3fc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:55.306144 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3688/7376] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:31:55 2022] DELETE /identity/v3/projects/30b006a0766f406c82b5f32af914f5dc => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:55.307385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f3774-d148-4353-8cfc-f3f0f1b09ff3 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:55.323691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f3774-d148-4353-8cfc-f3f0f1b09ff3 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:55.424306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8668d75-9240-4f83-af3d-a92aae99f193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:55.425133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8668d75-9240-4f83-af3d-a92aae99f193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:55.425604 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8668d75-9240-4f83-af3d-a92aae99f193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:55.425987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8668d75-9240-4f83-af3d-a92aae99f193 admin admin] PATH_INFO: `/v3/users/adf84e8824194c2399e73b3a0d08b530` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:55.427362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8668d75-9240-4f83-af3d-a92aae99f193 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adf84e8824194c2399e73b3a0d08b530)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:55.429646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8668d75-9240-4f83-af3d-a92aae99f193 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:55.514945 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a8668d75-9240-4f83-af3d-a92aae99f193 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adf84e8824194c2399e73b3a0d08b530'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:55.515701 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a8668d75-9240-4f83-af3d-a92aae99f193 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adf84e8824194c2399e73b3a0d08b530'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:55.530451 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a8668d75-9240-4f83-af3d-a92aae99f193 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adf84e8824194c2399e73b3a0d08b530'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:55.552849 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a8668d75-9240-4f83-af3d-a92aae99f193 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adf84e8824194c2399e73b3a0d08b530'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:55.553511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a8668d75-9240-4f83-af3d-a92aae99f193 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adf84e8824194c2399e73b3a0d08b530'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:55.593672 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:55.600676 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3689/7377] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:31:55 2022] DELETE /identity/v3/users/adf84e8824194c2399e73b3a0d08b530 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:56.061551 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad55a18-a921-4153-9e76-e06de1ab3fc0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:56.063044 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-dad55a18-a921-4153-9e76-e06de1ab3fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:56.087202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad55a18-a921-4153-9e76-e06de1ab3fc0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:56.156241 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab9cc6-4529-4c03-bcd3-fa57f3b15ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:56.156875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab9cc6-4529-4c03-bcd3-fa57f3b15ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:56.157159 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab9cc6-4529-4c03-bcd3-fa57f3b15ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:56.157488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab9cc6-4529-4c03-bcd3-fa57f3b15ccf admin admin] PATH_INFO: `/v3/projects/914e82fc09964a9aa1d72e7e2e1bcdd0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:56.158651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab9cc6-4529-4c03-bcd3-fa57f3b15ccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=914e82fc09964a9aa1d72e7e2e1bcdd0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:56.160614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab9cc6-4529-4c03-bcd3-fa57f3b15ccf admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:56.222313 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b4ab9cc6-4529-4c03-bcd3-fa57f3b15ccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '914e82fc09964a9aa1d72e7e2e1bcdd0', 'request_id': 'req-b4ab9cc6-4529-4c03-bcd3-fa57f3b15ccf'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:56.242646 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b4ab9cc6-4529-4c03-bcd3-fa57f3b15ccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '914e82fc09964a9aa1d72e7e2e1bcdd0', 'request_id': 'req-b4ab9cc6-4529-4c03-bcd3-fa57f3b15ccf'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:56.251796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b4ab9cc6-4529-4c03-bcd3-fa57f3b15ccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '914e82fc09964a9aa1d72e7e2e1bcdd0', 'request_id': 'req-b4ab9cc6-4529-4c03-bcd3-fa57f3b15ccf'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:56.265049 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b4ab9cc6-4529-4c03-bcd3-fa57f3b15ccf admin admin] The token cache is being invalidate because project 914e82fc09964a9aa1d72e7e2e1bcdd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:31:56.265342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b4ab9cc6-4529-4c03-bcd3-fa57f3b15ccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:56.266102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b4ab9cc6-4529-4c03-bcd3-fa57f3b15ccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:31:56.267634 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3689/7378] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:31:56 2022] DELETE /identity/v3/projects/914e82fc09964a9aa1d72e7e2e1bcdd0 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:56.272891 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97d288-e532-43c2-90df-45ad3bd29f52 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:56.273798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97d288-e532-43c2-90df-45ad3bd29f52 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:56.274095 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97d288-e532-43c2-90df-45ad3bd29f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:56.299016 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-4b97d288-e532-43c2-90df-45ad3bd29f52 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:56.300677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4b97d288-e532-43c2-90df-45ad3bd29f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:56.376711 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3690/7379] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:56.386103 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6549b09-e521-461d-9176-913b749c8190 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:56.386776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6549b09-e521-461d-9176-913b749c8190 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:56.387062 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6549b09-e521-461d-9176-913b749c8190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:56.408734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c6549b09-e521-461d-9176-913b749c8190 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:56.409921 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c6549b09-e521-461d-9176-913b749c8190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:56.418152 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3690/7380] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:56.423123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97d288-e532-43c2-90df-45ad3bd29f52 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:56.433364 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97d288-e532-43c2-90df-45ad3bd29f52 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:56.442607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499b397-744b-49e7-a97b-028fb7cae8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:56.443668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499b397-744b-49e7-a97b-028fb7cae8a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:56.445573 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499b397-744b-49e7-a97b-028fb7cae8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:56.445910 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499b397-744b-49e7-a97b-028fb7cae8a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:56.446680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0499b397-744b-49e7-a97b-028fb7cae8a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:31:56.446989 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0499b397-744b-49e7-a97b-028fb7cae8a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:56.453425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0499b397-744b-49e7-a97b-028fb7cae8a4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:56.472643 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3691/7381] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:31:56.473987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6549b09-e521-461d-9176-913b749c8190 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:56.485119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6549b09-e521-461d-9176-913b749c8190 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:56.490414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666fe60-ca9c-4cca-92d2-d40a014be455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:56.491144 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666fe60-ca9c-4cca-92d2-d40a014be455 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:56.491492 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666fe60-ca9c-4cca-92d2-d40a014be455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:56.491846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666fe60-ca9c-4cca-92d2-d40a014be455 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:56.492548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666fe60-ca9c-4cca-92d2-d40a014be455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:56.494604 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666fe60-ca9c-4cca-92d2-d40a014be455 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:56.531185 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3691/7382] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:31:56 2022] POST /identity/v3/projects => generated 395 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:31:56.533263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499b397-744b-49e7-a97b-028fb7cae8a4 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:56.546002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499b397-744b-49e7-a97b-028fb7cae8a4 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:56.629001 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc855662-a6eb-4677-ae6b-b59a514328f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:56.630382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc855662-a6eb-4677-ae6b-b59a514328f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:56.630790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc855662-a6eb-4677-ae6b-b59a514328f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:56.631588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc855662-a6eb-4677-ae6b-b59a514328f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:56.632373 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc855662-a6eb-4677-ae6b-b59a514328f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:56.638486 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc855662-a6eb-4677-ae6b-b59a514328f6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:56.683193 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3692/7383] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:31:56 2022] POST /identity/v3/users => generated 298 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:31:56.689481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666fe60-ca9c-4cca-92d2-d40a014be455 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:56.703729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666fe60-ca9c-4cca-92d2-d40a014be455 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:56.723716 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e25133-f2d0-4b82-9a7b-61f6c27c6a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:56.724355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e25133-f2d0-4b82-9a7b-61f6c27c6a9d admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:56.724641 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e25133-f2d0-4b82-9a7b-61f6c27c6a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:56.724916 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e25133-f2d0-4b82-9a7b-61f6c27c6a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:56.725600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e25133-f2d0-4b82-9a7b-61f6c27c6a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:56.727210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e25133-f2d0-4b82-9a7b-61f6c27c6a9d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:56.750543 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3692/7384] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:31:56.754730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc855662-a6eb-4677-ae6b-b59a514328f6 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:56.771942 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc855662-a6eb-4677-ae6b-b59a514328f6 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:56.780442 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b749a5-03dc-43d1-ab42-7acbf85072ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:56.781085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b749a5-03dc-43d1-ab42-7acbf85072ea admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:56.781364 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b749a5-03dc-43d1-ab42-7acbf85072ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:56.781669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b749a5-03dc-43d1-ab42-7acbf85072ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:56.782331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b749a5-03dc-43d1-ab42-7acbf85072ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:56.784027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b749a5-03dc-43d1-ab42-7acbf85072ea admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:56.815937 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3693/7385] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:31:56.817429 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e25133-f2d0-4b82-9a7b-61f6c27c6a9d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:56.829893 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e25133-f2d0-4b82-9a7b-61f6c27c6a9d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:56.838411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9ca43-6ddb-415d-bac3-960b5ae57f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:56.839086 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9ca43-6ddb-415d-bac3-960b5ae57f48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:56.839362 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9ca43-6ddb-415d-bac3-960b5ae57f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:56.839633 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9ca43-6ddb-415d-bac3-960b5ae57f48 admin admin] PATH_INFO: `/v3/projects/978d524cb2a24133a9a3a1e9815ba8cf/users/7026839b7ba84669b71a3243af6d610d/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:56.868530 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9ca43-6ddb-415d-bac3-960b5ae57f48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=978d524cb2a24133a9a3a1e9815ba8cf, user_id=7026839b7ba84669b71a3243af6d610d, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:56.872119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9ca43-6ddb-415d-bac3-960b5ae57f48 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:56.889482 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:56.902457 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3693/7386] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:31:56 2022] PUT /identity/v3/projects/978d524cb2a24133a9a3a1e9815ba8cf/users/7026839b7ba84669b71a3243af6d610d/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:31:56.913777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b87fb-10ef-4ec1-a7ea-32396a43166b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:56.914085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b87fb-10ef-4ec1-a7ea-32396a43166b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:56.914332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b87fb-10ef-4ec1-a7ea-32396a43166b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:56.959225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-b81b87fb-10ef-4ec1-a7ea-32396a43166b None None] MFA Rules not processed for user `7026839b7ba84669b71a3243af6d610d`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:31:56.960458 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b81b87fb-10ef-4ec1-a7ea-32396a43166b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:57.061019 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:31:57.075142 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3694/7387] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:31:56 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:31:57.093012 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9ca43-6ddb-415d-bac3-960b5ae57f48 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:57.094866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-18a9ca43-6ddb-415d-bac3-960b5ae57f48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:57.229836 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9ca43-6ddb-415d-bac3-960b5ae57f48 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:57.236515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932257f4-7e99-467b-9b6e-0c669ffdd399 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:57.237259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932257f4-7e99-467b-9b6e-0c669ffdd399 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:57.237683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932257f4-7e99-467b-9b6e-0c669ffdd399 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:57.238058 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932257f4-7e99-467b-9b6e-0c669ffdd399 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:57.268477 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932257f4-7e99-467b-9b6e-0c669ffdd399 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:57.270180 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932257f4-7e99-467b-9b6e-0c669ffdd399 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:57.291011 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3694/7388] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:31:57 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:31:57.454608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b87fb-10ef-4ec1-a7ea-32396a43166b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:31:57.470267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b87fb-10ef-4ec1-a7ea-32396a43166b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:31:57.487490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3de2fb-7ca6-4288-a39a-eeb965eae20c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:31:57.488164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3de2fb-7ca6-4288-a39a-eeb965eae20c service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:31:57.488441 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3de2fb-7ca6-4288-a39a-eeb965eae20c service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:31:57.488912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3de2fb-7ca6-4288-a39a-eeb965eae20c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:31:57.491398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-bf3de2fb-7ca6-4288-a39a-eeb965eae20c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:31:57.636687 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3de2fb-7ca6-4288-a39a-eeb965eae20c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:31:57.638327 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3de2fb-7ca6-4288-a39a-eeb965eae20c service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:31:57.662608 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3695/7389] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:31:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:32:02.683118 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f9034-d373-4599-838e-0880c68aa510 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:02.683728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f9034-d373-4599-838e-0880c68aa510 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:02.683728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f9034-d373-4599-838e-0880c68aa510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:02.721272 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d34f9034-d373-4599-838e-0880c68aa510 None None] MFA Rules not processed for user `f39dd2d709374c729d51f7e2cf18300c`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:32:02.722846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d34f9034-d373-4599-838e-0880c68aa510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:02.824025 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3695/7390] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:32:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:32:02.828914 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3de2fb-7ca6-4288-a39a-eeb965eae20c service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:02.831838 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-bf3de2fb-7ca6-4288-a39a-eeb965eae20c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:02.848977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3de2fb-7ca6-4288-a39a-eeb965eae20c service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:02.866115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7607c6-6fb2-4b53-92ba-388cb0e7534b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:02.867027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7607c6-6fb2-4b53-92ba-388cb0e7534b admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:02.867385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7607c6-6fb2-4b53-92ba-388cb0e7534b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:02.867731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7607c6-6fb2-4b53-92ba-388cb0e7534b admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:02.868962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7607c6-6fb2-4b53-92ba-388cb0e7534b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:02.874186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7607c6-6fb2-4b53-92ba-388cb0e7534b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:02.933296 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3696/7391] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:32:02 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:32:02.937589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f9034-d373-4599-838e-0880c68aa510 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:02.948958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f9034-d373-4599-838e-0880c68aa510 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:03.091907 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d270663-2708-4ef7-b9ca-71431a91d2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:03.092925 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d270663-2708-4ef7-b9ca-71431a91d2c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:03.093692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d270663-2708-4ef7-b9ca-71431a91d2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:03.094903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d270663-2708-4ef7-b9ca-71431a91d2c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:03.095868 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d270663-2708-4ef7-b9ca-71431a91d2c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:03.099239 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d270663-2708-4ef7-b9ca-71431a91d2c6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:03.135717 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3696/7392] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:32:02 2022] POST /identity/v3/users => generated 295 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:32:03.140021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7607c6-6fb2-4b53-92ba-388cb0e7534b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:03.155619 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7607c6-6fb2-4b53-92ba-388cb0e7534b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:03.176952 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a8ad5-0cb6-43e4-b8e6-3d6123f645dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:03.183812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a8ad5-0cb6-43e4-b8e6-3d6123f645dd admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:03.183812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a8ad5-0cb6-43e4-b8e6-3d6123f645dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:03.183812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a8ad5-0cb6-43e4-b8e6-3d6123f645dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:03.188344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a8ad5-0cb6-43e4-b8e6-3d6123f645dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:03.188546 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a8ad5-0cb6-43e4-b8e6-3d6123f645dd admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:03.220712 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3697/7393] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:32:03.225514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d270663-2708-4ef7-b9ca-71431a91d2c6 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:03.242284 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d270663-2708-4ef7-b9ca-71431a91d2c6 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:03.256662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0859f7-ec97-4566-a040-9c283b5efbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:03.257497 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0859f7-ec97-4566-a040-9c283b5efbd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:03.257844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0859f7-ec97-4566-a040-9c283b5efbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:03.258328 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0859f7-ec97-4566-a040-9c283b5efbd8 admin admin] PATH_INFO: `/v3/projects/a7b4961386294601a0d99467e96ad8b2/users/d85306af75f542e0bf49bc908ba92f09/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:03.287751 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0859f7-ec97-4566-a040-9c283b5efbd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7b4961386294601a0d99467e96ad8b2, user_id=d85306af75f542e0bf49bc908ba92f09, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:03.290786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0859f7-ec97-4566-a040-9c283b5efbd8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:03.304409 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:03.321478 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3697/7394] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:32:03 2022] PUT /identity/v3/projects/a7b4961386294601a0d99467e96ad8b2/users/d85306af75f542e0bf49bc908ba92f09/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:03.325780 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a8ad5-0cb6-43e4-b8e6-3d6123f645dd admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:03.357746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a8ad5-0cb6-43e4-b8e6-3d6123f645dd admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:03.503155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbc232-89c3-40df-8db7-207297368301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:03.504241 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbc232-89c3-40df-8db7-207297368301 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:03.505396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbc232-89c3-40df-8db7-207297368301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:03.506262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbc232-89c3-40df-8db7-207297368301 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:03.506948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dbc232-89c3-40df-8db7-207297368301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:03.510288 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dbc232-89c3-40df-8db7-207297368301 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:03.541860 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3698/7395] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:32:03.547381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0859f7-ec97-4566-a040-9c283b5efbd8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:03.561852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0859f7-ec97-4566-a040-9c283b5efbd8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:03.577934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed2540-5eb9-43a7-a7e9-23422b821c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:03.578899 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed2540-5eb9-43a7-a7e9-23422b821c5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:03.579185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed2540-5eb9-43a7-a7e9-23422b821c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:03.579455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed2540-5eb9-43a7-a7e9-23422b821c5b admin admin] PATH_INFO: `/v3/projects/a7b4961386294601a0d99467e96ad8b2/users/d85306af75f542e0bf49bc908ba92f09/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:03.584495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed2540-5eb9-43a7-a7e9-23422b821c5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7b4961386294601a0d99467e96ad8b2, user_id=d85306af75f542e0bf49bc908ba92f09, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:03.587697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed2540-5eb9-43a7-a7e9-23422b821c5b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:03.615304 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3698/7396] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:32:03 2022] PUT /identity/v3/projects/a7b4961386294601a0d99467e96ad8b2/users/d85306af75f542e0bf49bc908ba92f09/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:07.922084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbc232-89c3-40df-8db7-207297368301 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:07.925196 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d8dbc232-89c3-40df-8db7-207297368301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:07.959118 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbc232-89c3-40df-8db7-207297368301 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:08.075240 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:08.099081 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162cb97-2459-4d9c-8333-f047d83fdd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:08.099743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162cb97-2459-4d9c-8333-f047d83fdd55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:08.100026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162cb97-2459-4d9c-8333-f047d83fdd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:08.100301 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162cb97-2459-4d9c-8333-f047d83fdd55 admin admin] PATH_INFO: `/v3/users/2bd410471c2340aa97bbfe8057122303` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:08.102358 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162cb97-2459-4d9c-8333-f047d83fdd55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bd410471c2340aa97bbfe8057122303)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:08.104618 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162cb97-2459-4d9c-8333-f047d83fdd55 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:08.206597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3162cb97-2459-4d9c-8333-f047d83fdd55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bd410471c2340aa97bbfe8057122303'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:08.207595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3162cb97-2459-4d9c-8333-f047d83fdd55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bd410471c2340aa97bbfe8057122303'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:08.228319 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3162cb97-2459-4d9c-8333-f047d83fdd55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bd410471c2340aa97bbfe8057122303'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:08.254038 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3162cb97-2459-4d9c-8333-f047d83fdd55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bd410471c2340aa97bbfe8057122303'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:08.255007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3162cb97-2459-4d9c-8333-f047d83fdd55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bd410471c2340aa97bbfe8057122303'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:08.294253 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3699/7397] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:32:07 2022] DELETE /identity/v3/users/2bd410471c2340aa97bbfe8057122303 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:08.692316 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed2540-5eb9-43a7-a7e9-23422b821c5b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:08.694393 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-43ed2540-5eb9-43a7-a7e9-23422b821c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:08.730548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed2540-5eb9-43a7-a7e9-23422b821c5b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:08.886399 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb0fd0-b765-4a19-9bb6-99575eb9c929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:08.889012 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb0fd0-b765-4a19-9bb6-99575eb9c929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:08.889516 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb0fd0-b765-4a19-9bb6-99575eb9c929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:08.889965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb0fd0-b765-4a19-9bb6-99575eb9c929 admin admin] PATH_INFO: `/v3/projects/960a8911f9c141d89fbde370c945c05f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:08.897566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb0fd0-b765-4a19-9bb6-99575eb9c929 admin admin] RBAC: Authorizing `identity:delete_project(project_id=960a8911f9c141d89fbde370c945c05f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:08.900320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb0fd0-b765-4a19-9bb6-99575eb9c929 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:09.030418 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cbfb0fd0-b765-4a19-9bb6-99575eb9c929 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '960a8911f9c141d89fbde370c945c05f', 'request_id': 'req-cbfb0fd0-b765-4a19-9bb6-99575eb9c929'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:09.047275 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cbfb0fd0-b765-4a19-9bb6-99575eb9c929 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '960a8911f9c141d89fbde370c945c05f', 'request_id': 'req-cbfb0fd0-b765-4a19-9bb6-99575eb9c929'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:09.056768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cbfb0fd0-b765-4a19-9bb6-99575eb9c929 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '960a8911f9c141d89fbde370c945c05f', 'request_id': 'req-cbfb0fd0-b765-4a19-9bb6-99575eb9c929'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:09.082033 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cbfb0fd0-b765-4a19-9bb6-99575eb9c929 admin admin] The token cache is being invalidate because project 960a8911f9c141d89fbde370c945c05f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:32:09.082486 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cbfb0fd0-b765-4a19-9bb6-99575eb9c929 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:09.087657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cbfb0fd0-b765-4a19-9bb6-99575eb9c929 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:09.094138 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3699/7398] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:32:08 2022] DELETE /identity/v3/projects/960a8911f9c141d89fbde370c945c05f => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:09.096125 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e04cf-6e51-467b-9463-a04b80ab9207 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:09.096587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e04cf-6e51-467b-9463-a04b80ab9207 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:09.096703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e04cf-6e51-467b-9463-a04b80ab9207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:09.144101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-2e8e04cf-6e51-467b-9463-a04b80ab9207 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:32:09.148949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2e8e04cf-6e51-467b-9463-a04b80ab9207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:09.326397 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3700/7399] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:32:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:32:09.336762 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29a814-1afe-4a0f-990d-0a6ea2dbbbea None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:09.339347 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29a814-1afe-4a0f-990d-0a6ea2dbbbea None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:09.339787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29a814-1afe-4a0f-990d-0a6ea2dbbbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:09.405167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5c29a814-1afe-4a0f-990d-0a6ea2dbbbea None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:32:09.406508 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5c29a814-1afe-4a0f-990d-0a6ea2dbbbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:09.426705 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3700/7400] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:32:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:32:09.431022 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e04cf-6e51-467b-9463-a04b80ab9207 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:09.442794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e04cf-6e51-467b-9463-a04b80ab9207 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:09.451450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc8d03-17f0-47ec-b544-e256e0df4f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:09.452447 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc8d03-17f0-47ec-b544-e256e0df4f14 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:09.452917 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc8d03-17f0-47ec-b544-e256e0df4f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:09.453549 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc8d03-17f0-47ec-b544-e256e0df4f14 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:09.454641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc8d03-17f0-47ec-b544-e256e0df4f14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:32:09.455109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc8d03-17f0-47ec-b544-e256e0df4f14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:09.457805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc8d03-17f0-47ec-b544-e256e0df4f14 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:09.488680 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3701/7401] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:32:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:32:09.493397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29a814-1afe-4a0f-990d-0a6ea2dbbbea None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:09.507051 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29a814-1afe-4a0f-990d-0a6ea2dbbbea None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:09.514968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f765c7e-37a0-482c-a380-1f2e3ff07e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:09.515902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f765c7e-37a0-482c-a380-1f2e3ff07e10 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:09.516372 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f765c7e-37a0-482c-a380-1f2e3ff07e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:09.516831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f765c7e-37a0-482c-a380-1f2e3ff07e10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:09.517788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f765c7e-37a0-482c-a380-1f2e3ff07e10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:09.520923 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f765c7e-37a0-482c-a380-1f2e3ff07e10 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:09.588937 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3701/7402] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:32:09 2022] POST /identity/v3/projects => generated 367 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:32:09.596203 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc8d03-17f0-47ec-b544-e256e0df4f14 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:09.615892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc8d03-17f0-47ec-b544-e256e0df4f14 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:09.811259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbba634-0815-466e-ac66-41ba273b4bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:09.811962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbba634-0815-466e-ac66-41ba273b4bf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:09.812149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbba634-0815-466e-ac66-41ba273b4bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:09.812393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbba634-0815-466e-ac66-41ba273b4bf9 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:09.814305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbba634-0815-466e-ac66-41ba273b4bf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:09.819102 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbba634-0815-466e-ac66-41ba273b4bf9 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:09.846906 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:09.893252 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f765c7e-37a0-482c-a380-1f2e3ff07e10 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:09.893931 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3702/7403] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:32:09 2022] POST /identity/v3/users => generated 284 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:32:09.911875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f765c7e-37a0-482c-a380-1f2e3ff07e10 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:09.940775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fce56-d6cc-4e2a-a0fd-96529181e5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:09.941843 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fce56-d6cc-4e2a-a0fd-96529181e5d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:09.942700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fce56-d6cc-4e2a-a0fd-96529181e5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:09.943276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fce56-d6cc-4e2a-a0fd-96529181e5d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:09.944154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0fce56-d6cc-4e2a-a0fd-96529181e5d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:09.949090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0fce56-d6cc-4e2a-a0fd-96529181e5d3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:09.977423 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3702/7404] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:32:09.982803 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbba634-0815-466e-ac66-41ba273b4bf9 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:10.003115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbba634-0815-466e-ac66-41ba273b4bf9 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:10.026396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45864dbd-180e-49c8-aa78-037f667b0c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:10.027043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45864dbd-180e-49c8-aa78-037f667b0c35 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:10.027647 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45864dbd-180e-49c8-aa78-037f667b0c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:10.027926 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45864dbd-180e-49c8-aa78-037f667b0c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:10.029108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45864dbd-180e-49c8-aa78-037f667b0c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:10.032246 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45864dbd-180e-49c8-aa78-037f667b0c35 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:10.065933 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3703/7405] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:32:10.070027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fce56-d6cc-4e2a-a0fd-96529181e5d3 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:10.083326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fce56-d6cc-4e2a-a0fd-96529181e5d3 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:10.097004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79d2a2-d3e3-4366-8895-c05f5452b155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:10.097397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79d2a2-d3e3-4366-8895-c05f5452b155 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:10.097715 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79d2a2-d3e3-4366-8895-c05f5452b155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:10.098268 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79d2a2-d3e3-4366-8895-c05f5452b155 admin admin] PATH_INFO: `/v3/projects/90e97c079c954fc9985f1afa8f23fc8b/users/e1059e91c84f4b1793203156ed13953e/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:10.135128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79d2a2-d3e3-4366-8895-c05f5452b155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90e97c079c954fc9985f1afa8f23fc8b, user_id=e1059e91c84f4b1793203156ed13953e, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:10.139479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79d2a2-d3e3-4366-8895-c05f5452b155 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:10.167605 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3703/7406] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:32:10 2022] PUT /identity/v3/projects/90e97c079c954fc9985f1afa8f23fc8b/users/e1059e91c84f4b1793203156ed13953e/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:10.183177 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc261a-2da1-4b05-aadc-4e6c7e793622 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:10.183746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc261a-2da1-4b05-aadc-4e6c7e793622 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:10.183746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc261a-2da1-4b05-aadc-4e6c7e793622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:10.267161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-5ccc261a-2da1-4b05-aadc-4e6c7e793622 None None] MFA Rules not processed for user `e1059e91c84f4b1793203156ed13953e`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:32:10.268409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5ccc261a-2da1-4b05-aadc-4e6c7e793622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:10.472600 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3704/7407] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:32:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:32:10.548180 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79d2a2-d3e3-4366-8895-c05f5452b155 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:10.550583 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1b79d2a2-d3e3-4366-8895-c05f5452b155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:10.581099 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:10.733920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79d2a2-d3e3-4366-8895-c05f5452b155 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:10.746090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22037e-2f6e-4870-b20b-ed9b07ef4f39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:10.746971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22037e-2f6e-4870-b20b-ed9b07ef4f39 service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:10.747913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22037e-2f6e-4870-b20b-ed9b07ef4f39 service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:10.748299 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22037e-2f6e-4870-b20b-ed9b07ef4f39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:10.772357 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22037e-2f6e-4870-b20b-ed9b07ef4f39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:10.781054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22037e-2f6e-4870-b20b-ed9b07ef4f39 service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:10.806205 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3704/7408] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:32:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:32:16.780520 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf8d83-c1f3-482b-8c04-8f42ee4ad57e None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:16.781068 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf8d83-c1f3-482b-8c04-8f42ee4ad57e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:16.781068 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf8d83-c1f3-482b-8c04-8f42ee4ad57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:16.829124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-acdf8d83-c1f3-482b-8c04-8f42ee4ad57e None None] MFA Rules not processed for user `d85306af75f542e0bf49bc908ba92f09`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:32:16.830609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-acdf8d83-c1f3-482b-8c04-8f42ee4ad57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:16.943616 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3705/7409] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:32:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:32:16.957955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22037e-2f6e-4870-b20b-ed9b07ef4f39 service cinder] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:16.959295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8b22037e-2f6e-4870-b20b-ed9b07ef4f39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:16.979878 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22037e-2f6e-4870-b20b-ed9b07ef4f39 service cinder] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:16.988577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085f8a4-126e-478e-b5c4-b54678e278a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:16.989322 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085f8a4-126e-478e-b5c4-b54678e278a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:16.989675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085f8a4-126e-478e-b5c4-b54678e278a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:16.989980 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085f8a4-126e-478e-b5c4-b54678e278a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:17.002862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085f8a4-126e-478e-b5c4-b54678e278a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:17.004962 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085f8a4-126e-478e-b5c4-b54678e278a1 service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:17.027281 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3705/7410] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:32:16 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:32:17.171690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf8d83-c1f3-482b-8c04-8f42ee4ad57e None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:17.200685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf8d83-c1f3-482b-8c04-8f42ee4ad57e None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:17.221905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c9ab1-9604-4a18-998a-ccd60af2cd90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:17.223204 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c9ab1-9604-4a18-998a-ccd60af2cd90 service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:17.223736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c9ab1-9604-4a18-998a-ccd60af2cd90 service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:17.224237 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c9ab1-9604-4a18-998a-ccd60af2cd90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:17.226618 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ef1c9ab1-9604-4a18-998a-ccd60af2cd90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:17.343576 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:17.361723 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c9ab1-9604-4a18-998a-ccd60af2cd90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:17.363386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c9ab1-9604-4a18-998a-ccd60af2cd90 service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:17.374151 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3706/7411] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:32:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:32:20.540218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9fa11-74c1-40d4-bfd7-fc5b07f91bec None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:20.540686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9fa11-74c1-40d4-bfd7-fc5b07f91bec None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:20.540806 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9fa11-74c1-40d4-bfd7-fc5b07f91bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:20.563624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-8bf9fa11-74c1-40d4-bfd7-fc5b07f91bec None None] MFA Rules not processed for user `f39dd2d709374c729d51f7e2cf18300c`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:32:20.564842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8bf9fa11-74c1-40d4-bfd7-fc5b07f91bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:20.573159 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3706/7412] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:32:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:32:20.680295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c9ab1-9604-4a18-998a-ccd60af2cd90 service cinder] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:20.684088 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ef1c9ab1-9604-4a18-998a-ccd60af2cd90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:20.878734 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c9ab1-9604-4a18-998a-ccd60af2cd90 service cinder] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:20.893010 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cddf06-c70e-4332-8931-1dd60a9916e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:20.893704 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cddf06-c70e-4332-8931-1dd60a9916e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:20.893987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cddf06-c70e-4332-8931-1dd60a9916e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:20.894261 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cddf06-c70e-4332-8931-1dd60a9916e8 admin admin] PATH_INFO: `/v3/users/7026839b7ba84669b71a3243af6d610d` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:20.898238 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cddf06-c70e-4332-8931-1dd60a9916e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7026839b7ba84669b71a3243af6d610d)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:20.900202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cddf06-c70e-4332-8931-1dd60a9916e8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:20.992038 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e4cddf06-c70e-4332-8931-1dd60a9916e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7026839b7ba84669b71a3243af6d610d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:20.993896 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e4cddf06-c70e-4332-8931-1dd60a9916e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7026839b7ba84669b71a3243af6d610d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:21.004037 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e4cddf06-c70e-4332-8931-1dd60a9916e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7026839b7ba84669b71a3243af6d610d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:21.023559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e4cddf06-c70e-4332-8931-1dd60a9916e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7026839b7ba84669b71a3243af6d610d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:21.025379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e4cddf06-c70e-4332-8931-1dd60a9916e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7026839b7ba84669b71a3243af6d610d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:21.059794 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3707/7413] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:32:20 2022] DELETE /identity/v3/users/7026839b7ba84669b71a3243af6d610d => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:21.064824 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c07c5-25b9-4515-8f09-5283ae3df865 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:21.065718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c07c5-25b9-4515-8f09-5283ae3df865 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:21.066198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c07c5-25b9-4515-8f09-5283ae3df865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:21.108953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-7a5c07c5-25b9-4515-8f09-5283ae3df865 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:32:21.110651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7a5c07c5-25b9-4515-8f09-5283ae3df865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:21.140326 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cddf06-c70e-4332-8931-1dd60a9916e8 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:21.141880 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e4cddf06-c70e-4332-8931-1dd60a9916e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:21.205608 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3707/7414] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:32:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:32:21.212215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c07c5-25b9-4515-8f09-5283ae3df865 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:21.219463 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7a5c07c5-25b9-4515-8f09-5283ae3df865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:21.266261 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cddf06-c70e-4332-8931-1dd60a9916e8 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:21.277574 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f478d-2e38-4eea-b6e0-c930241beebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:21.278255 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f478d-2e38-4eea-b6e0-c930241beebd service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:21.278540 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f478d-2e38-4eea-b6e0-c930241beebd service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:21.278824 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f478d-2e38-4eea-b6e0-c930241beebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:21.285513 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-045f478d-2e38-4eea-b6e0-c930241beebd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:21.300388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c07c5-25b9-4515-8f09-5283ae3df865 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:21.305595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4710f73-089f-4183-b616-36d7e2005ef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:21.306565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4710f73-089f-4183-b616-36d7e2005ef2 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:21.307080 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4710f73-089f-4183-b616-36d7e2005ef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:21.307598 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4710f73-089f-4183-b616-36d7e2005ef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:21.308557 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f478d-2e38-4eea-b6e0-c930241beebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:21.310714 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f478d-2e38-4eea-b6e0-c930241beebd service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:21.320787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4710f73-089f-4183-b616-36d7e2005ef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:21.323313 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4710f73-089f-4183-b616-36d7e2005ef2 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:21.333334 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3708/7415] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:32:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:32:21.336804 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3708/7416] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:32:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:32:21.890005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f478d-2e38-4eea-b6e0-c930241beebd service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:21.891662 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-045f478d-2e38-4eea-b6e0-c930241beebd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:21.937873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f478d-2e38-4eea-b6e0-c930241beebd service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:21.966321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d173d-a5a1-45fe-9a8c-652316110a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:21.967653 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d173d-a5a1-45fe-9a8c-652316110a80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:21.968159 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d173d-a5a1-45fe-9a8c-652316110a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:21.968597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d173d-a5a1-45fe-9a8c-652316110a80 admin admin] PATH_INFO: `/v3/projects/978d524cb2a24133a9a3a1e9815ba8cf` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:21.970055 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d173d-a5a1-45fe-9a8c-652316110a80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=978d524cb2a24133a9a3a1e9815ba8cf)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:21.972218 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d173d-a5a1-45fe-9a8c-652316110a80 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:21.982390 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:22.053596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-233d173d-a5a1-45fe-9a8c-652316110a80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '978d524cb2a24133a9a3a1e9815ba8cf', 'request_id': 'req-233d173d-a5a1-45fe-9a8c-652316110a80'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:22.067827 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-233d173d-a5a1-45fe-9a8c-652316110a80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '978d524cb2a24133a9a3a1e9815ba8cf', 'request_id': 'req-233d173d-a5a1-45fe-9a8c-652316110a80'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:22.083135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-233d173d-a5a1-45fe-9a8c-652316110a80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '978d524cb2a24133a9a3a1e9815ba8cf', 'request_id': 'req-233d173d-a5a1-45fe-9a8c-652316110a80'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:22.116240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-233d173d-a5a1-45fe-9a8c-652316110a80 admin admin] The token cache is being invalidate because project 978d524cb2a24133a9a3a1e9815ba8cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:32:22.116541 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-233d173d-a5a1-45fe-9a8c-652316110a80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:22.123012 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-233d173d-a5a1-45fe-9a8c-652316110a80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:22.124701 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3709/7417] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:32:21 2022] DELETE /identity/v3/projects/978d524cb2a24133a9a3a1e9815ba8cf => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:22.129797 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717eabd9-15ee-41a5-851b-8d307908ad4d None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:22.130313 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717eabd9-15ee-41a5-851b-8d307908ad4d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:22.130313 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717eabd9-15ee-41a5-851b-8d307908ad4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:22.171472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-717eabd9-15ee-41a5-851b-8d307908ad4d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:32:22.172725 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-717eabd9-15ee-41a5-851b-8d307908ad4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:22.259161 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:22.313128 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3709/7418] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:32:22.320438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0356bb8-52ac-4939-8fb1-02758d475aae None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:22.320729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0356bb8-52ac-4939-8fb1-02758d475aae None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:22.321010 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0356bb8-52ac-4939-8fb1-02758d475aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:22.348688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c0356bb8-52ac-4939-8fb1-02758d475aae None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:32:22.350349 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c0356bb8-52ac-4939-8fb1-02758d475aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:22.366552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717eabd9-15ee-41a5-851b-8d307908ad4d None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:22.378642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717eabd9-15ee-41a5-851b-8d307908ad4d None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:22.379646 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3710/7419] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:32:22.394941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a572bc-a670-43ac-a050-7d9b5b06c945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:22.395188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a572bc-a670-43ac-a050-7d9b5b06c945 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:22.395499 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a572bc-a670-43ac-a050-7d9b5b06c945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:22.395722 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a572bc-a670-43ac-a050-7d9b5b06c945 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:22.396389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a572bc-a670-43ac-a050-7d9b5b06c945 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:32:22.396698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a572bc-a670-43ac-a050-7d9b5b06c945 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:22.398352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a572bc-a670-43ac-a050-7d9b5b06c945 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:22.433067 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3710/7420] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:32:22.438111 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0356bb8-52ac-4939-8fb1-02758d475aae None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:22.466054 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0356bb8-52ac-4939-8fb1-02758d475aae None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:22.471710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d586a8e-d5e7-46da-a6f2-8fda94338555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:22.472434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d586a8e-d5e7-46da-a6f2-8fda94338555 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:22.472718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d586a8e-d5e7-46da-a6f2-8fda94338555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:22.472995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d586a8e-d5e7-46da-a6f2-8fda94338555 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:22.473670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d586a8e-d5e7-46da-a6f2-8fda94338555 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:22.475615 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d586a8e-d5e7-46da-a6f2-8fda94338555 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:22.568896 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3711/7421] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:32:22 2022] POST /identity/v3/projects => generated 387 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:32:22.570350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a572bc-a670-43ac-a050-7d9b5b06c945 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:22.583657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a572bc-a670-43ac-a050-7d9b5b06c945 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:22.778073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096ac6a-c26a-4dc6-8d69-01ad4726088c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:22.778917 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096ac6a-c26a-4dc6-8d69-01ad4726088c admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:22.779205 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096ac6a-c26a-4dc6-8d69-01ad4726088c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:22.779521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096ac6a-c26a-4dc6-8d69-01ad4726088c admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:22.780273 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9096ac6a-c26a-4dc6-8d69-01ad4726088c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:22.782984 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9096ac6a-c26a-4dc6-8d69-01ad4726088c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:22.850103 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3711/7422] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:32:22 2022] POST /identity/v3/users => generated 294 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:32:22.854485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d586a8e-d5e7-46da-a6f2-8fda94338555 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:22.874493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d586a8e-d5e7-46da-a6f2-8fda94338555 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:22.889574 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2c4ba-38fe-4237-b858-835d3322a7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:22.890573 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2c4ba-38fe-4237-b858-835d3322a7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:22.891661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2c4ba-38fe-4237-b858-835d3322a7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:22.896969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2c4ba-38fe-4237-b858-835d3322a7f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:22.898146 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d2c4ba-38fe-4237-b858-835d3322a7f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:22.900432 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d2c4ba-38fe-4237-b858-835d3322a7f4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:22.927580 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3712/7423] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:32:22.928782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096ac6a-c26a-4dc6-8d69-01ad4726088c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:22.944359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096ac6a-c26a-4dc6-8d69-01ad4726088c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:22.954624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e177bc3-1216-4ace-bb2c-f02530434ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:22.955305 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e177bc3-1216-4ace-bb2c-f02530434ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:22.955587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e177bc3-1216-4ace-bb2c-f02530434ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:22.955858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e177bc3-1216-4ace-bb2c-f02530434ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:22.956901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e177bc3-1216-4ace-bb2c-f02530434ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:22.959446 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e177bc3-1216-4ace-bb2c-f02530434ca9 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:22.978412 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3712/7424] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:32:22.979731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2c4ba-38fe-4237-b858-835d3322a7f4 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:22.992033 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2c4ba-38fe-4237-b858-835d3322a7f4 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:23.001905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904954d8-02c9-4c61-b2a5-b20e0d878cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:23.003446 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904954d8-02c9-4c61-b2a5-b20e0d878cbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:23.003917 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904954d8-02c9-4c61-b2a5-b20e0d878cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:23.004373 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904954d8-02c9-4c61-b2a5-b20e0d878cbb admin admin] PATH_INFO: `/v3/projects/8e3510353d97433d9ebb42d65fe2dc98/users/925bce1a0b1e46daa35f05a95cf56c72/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:23.029352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904954d8-02c9-4c61-b2a5-b20e0d878cbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e3510353d97433d9ebb42d65fe2dc98, user_id=925bce1a0b1e46daa35f05a95cf56c72, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:23.033050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904954d8-02c9-4c61-b2a5-b20e0d878cbb admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:23.058211 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3713/7425] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:32:22 2022] PUT /identity/v3/projects/8e3510353d97433d9ebb42d65fe2dc98/users/925bce1a0b1e46daa35f05a95cf56c72/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:23.070023 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5ea2e-7f79-4cdf-8012-d4c4cf05cc9a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:23.070794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5ea2e-7f79-4cdf-8012-d4c4cf05cc9a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:23.071276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5ea2e-7f79-4cdf-8012-d4c4cf05cc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:23.114599 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-8ad5ea2e-7f79-4cdf-8012-d4c4cf05cc9a None None] MFA Rules not processed for user `925bce1a0b1e46daa35f05a95cf56c72`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:32:23.117087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8ad5ea2e-7f79-4cdf-8012-d4c4cf05cc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:23.237663 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3713/7426] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:32:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:32:23.248902 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904954d8-02c9-4c61-b2a5-b20e0d878cbb admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:23.251909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-904954d8-02c9-4c61-b2a5-b20e0d878cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:23.454892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904954d8-02c9-4c61-b2a5-b20e0d878cbb admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:23.465219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5994697-4c08-4aed-9778-25fe0abf39c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:23.466435 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5994697-4c08-4aed-9778-25fe0abf39c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:23.466954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5994697-4c08-4aed-9778-25fe0abf39c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:23.467256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5994697-4c08-4aed-9778-25fe0abf39c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:23.491705 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5994697-4c08-4aed-9778-25fe0abf39c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:23.496938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5994697-4c08-4aed-9778-25fe0abf39c1 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:23.518175 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3714/7427] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:32:23 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:32:33.233374 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=82,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:33.512892 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=74,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:35.642220 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5ea2e-7f79-4cdf-8012-d4c4cf05cc9a None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:35.658287 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5ea2e-7f79-4cdf-8012-d4c4cf05cc9a None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:35.663480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aef4d1-e784-4f9b-bd86-342ff10b1a53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:35.664319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aef4d1-e784-4f9b-bd86-342ff10b1a53 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:35.664820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aef4d1-e784-4f9b-bd86-342ff10b1a53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:35.666518 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aef4d1-e784-4f9b-bd86-342ff10b1a53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:35.669397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-22aef4d1-e784-4f9b-bd86-342ff10b1a53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:35.687381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aef4d1-e784-4f9b-bd86-342ff10b1a53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:35.689852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aef4d1-e784-4f9b-bd86-342ff10b1a53 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:35.709150 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3714/7428] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:32:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:32:36.379974 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5994697-4c08-4aed-9778-25fe0abf39c1 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:36.403783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5994697-4c08-4aed-9778-25fe0abf39c1 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:36.415902 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdce82e-d5ff-4f78-a233-e0903ca10930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:36.416733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdce82e-d5ff-4f78-a233-e0903ca10930 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:36.417169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdce82e-d5ff-4f78-a233-e0903ca10930 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:36.417678 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdce82e-d5ff-4f78-a233-e0903ca10930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:36.422634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0fdce82e-d5ff-4f78-a233-e0903ca10930 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:36.531859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdce82e-d5ff-4f78-a233-e0903ca10930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:36.535736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdce82e-d5ff-4f78-a233-e0903ca10930 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:36.555682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aef4d1-e784-4f9b-bd86-342ff10b1a53 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:36.557479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-22aef4d1-e784-4f9b-bd86-342ff10b1a53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:36.561192 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3715/7429] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:32:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:32:36.648512 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aef4d1-e784-4f9b-bd86-342ff10b1a53 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:36.655401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf10d4-bd97-4f3e-9f85-90bff98c6da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:36.656318 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf10d4-bd97-4f3e-9f85-90bff98c6da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:36.657163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf10d4-bd97-4f3e-9f85-90bff98c6da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:36.657763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf10d4-bd97-4f3e-9f85-90bff98c6da7 admin admin] PATH_INFO: `/v3/users/e1059e91c84f4b1793203156ed13953e` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:36.659193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf10d4-bd97-4f3e-9f85-90bff98c6da7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1059e91c84f4b1793203156ed13953e)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:36.662138 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf10d4-bd97-4f3e-9f85-90bff98c6da7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:36.794884 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ccdf10d4-bd97-4f3e-9f85-90bff98c6da7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1059e91c84f4b1793203156ed13953e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:36.795697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ccdf10d4-bd97-4f3e-9f85-90bff98c6da7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1059e91c84f4b1793203156ed13953e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:36.816728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ccdf10d4-bd97-4f3e-9f85-90bff98c6da7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1059e91c84f4b1793203156ed13953e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:36.830161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ccdf10d4-bd97-4f3e-9f85-90bff98c6da7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1059e91c84f4b1793203156ed13953e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:36.831407 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ccdf10d4-bd97-4f3e-9f85-90bff98c6da7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1059e91c84f4b1793203156ed13953e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:36.866840 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3715/7430] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:32:36 2022] DELETE /identity/v3/users/e1059e91c84f4b1793203156ed13953e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:36.871782 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb42ba-b575-437d-9f57-524793ed8481 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:36.875685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb42ba-b575-437d-9f57-524793ed8481 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:36.876519 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb42ba-b575-437d-9f57-524793ed8481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:36.908726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-84bb42ba-b575-437d-9f57-524793ed8481 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:32:36.911263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-84bb42ba-b575-437d-9f57-524793ed8481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:37.106659 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3716/7431] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:32:37.144779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf10d4-bd97-4f3e-9f85-90bff98c6da7 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:37.147895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ccdf10d4-bd97-4f3e-9f85-90bff98c6da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:37.385515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf10d4-bd97-4f3e-9f85-90bff98c6da7 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:37.395303 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5aa71-0906-4274-b179-af471c589605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:37.395940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5aa71-0906-4274-b179-af471c589605 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:37.396224 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5aa71-0906-4274-b179-af471c589605 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:37.396501 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5aa71-0906-4274-b179-af471c589605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:37.418649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5aa71-0906-4274-b179-af471c589605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:37.421761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5aa71-0906-4274-b179-af471c589605 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:37.453655 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3716/7432] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:32:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:32:38.752867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb42ba-b575-437d-9f57-524793ed8481 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:38.754642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-84bb42ba-b575-437d-9f57-524793ed8481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:38.767790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb42ba-b575-437d-9f57-524793ed8481 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:38.772744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088ce36-c7a3-4fe6-8180-1c67a882129c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:38.773404 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088ce36-c7a3-4fe6-8180-1c67a882129c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:38.773715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088ce36-c7a3-4fe6-8180-1c67a882129c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:38.774153 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088ce36-c7a3-4fe6-8180-1c67a882129c admin admin] PATH_INFO: `/v3/projects/90e97c079c954fc9985f1afa8f23fc8b` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:38.775741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5088ce36-c7a3-4fe6-8180-1c67a882129c admin admin] RBAC: Authorizing `identity:delete_project(project_id=90e97c079c954fc9985f1afa8f23fc8b)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:38.779931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5088ce36-c7a3-4fe6-8180-1c67a882129c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:38.858807 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5088ce36-c7a3-4fe6-8180-1c67a882129c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90e97c079c954fc9985f1afa8f23fc8b', 'request_id': 'req-5088ce36-c7a3-4fe6-8180-1c67a882129c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:38.869912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5088ce36-c7a3-4fe6-8180-1c67a882129c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90e97c079c954fc9985f1afa8f23fc8b', 'request_id': 'req-5088ce36-c7a3-4fe6-8180-1c67a882129c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:38.880397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5088ce36-c7a3-4fe6-8180-1c67a882129c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90e97c079c954fc9985f1afa8f23fc8b', 'request_id': 'req-5088ce36-c7a3-4fe6-8180-1c67a882129c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:38.928163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5088ce36-c7a3-4fe6-8180-1c67a882129c admin admin] The token cache is being invalidate because project 90e97c079c954fc9985f1afa8f23fc8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:32:38.928764 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5088ce36-c7a3-4fe6-8180-1c67a882129c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:38.929923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5088ce36-c7a3-4fe6-8180-1c67a882129c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:38.932018 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3717/7433] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:32:38 2022] DELETE /identity/v3/projects/90e97c079c954fc9985f1afa8f23fc8b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:38.939604 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834501a-e2cd-4b88-aac0-abfca5a9551e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:38.940075 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834501a-e2cd-4b88-aac0-abfca5a9551e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:38.940310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834501a-e2cd-4b88-aac0-abfca5a9551e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:38.975704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b834501a-e2cd-4b88-aac0-abfca5a9551e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:32:38.977740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b834501a-e2cd-4b88-aac0-abfca5a9551e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:38.985066 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:39.067020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f41d4-3a45-4736-92f4-9da8bbfb91a4 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:39.067461 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f41d4-3a45-4736-92f4-9da8bbfb91a4 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:39.068669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f41d4-3a45-4736-92f4-9da8bbfb91a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:39.075813 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3717/7434] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:32:39.097057 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-af3f41d4-3a45-4736-92f4-9da8bbfb91a4 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:32:39.099023 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-af3f41d4-3a45-4736-92f4-9da8bbfb91a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:39.114344 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834501a-e2cd-4b88-aac0-abfca5a9551e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:39.126107 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834501a-e2cd-4b88-aac0-abfca5a9551e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:39.126494 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3718/7435] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:32:39.135141 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a54e4-be24-4ece-a694-751bfd802062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:39.143913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a54e4-be24-4ece-a694-751bfd802062 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:39.147591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a54e4-be24-4ece-a694-751bfd802062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:39.148261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a54e4-be24-4ece-a694-751bfd802062 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:39.149284 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a54e4-be24-4ece-a694-751bfd802062 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:32:39.149844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a54e4-be24-4ece-a694-751bfd802062 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:39.153907 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a54e4-be24-4ece-a694-751bfd802062 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:39.201012 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f41d4-3a45-4736-92f4-9da8bbfb91a4 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:39.207237 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3718/7436] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:32:39.207547 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:39.218967 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f41d4-3a45-4736-92f4-9da8bbfb91a4 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:39.231553 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552239a-1876-438d-acdc-46a4fe3d7308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:39.232278 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552239a-1876-438d-acdc-46a4fe3d7308 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:39.232640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552239a-1876-438d-acdc-46a4fe3d7308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:39.232985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552239a-1876-438d-acdc-46a4fe3d7308 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:39.233730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552239a-1876-438d-acdc-46a4fe3d7308 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:39.239247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552239a-1876-438d-acdc-46a4fe3d7308 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:39.310036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a54e4-be24-4ece-a694-751bfd802062 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:39.320538 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3719/7437] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:32:39 2022] POST /identity/v3/projects => generated 399 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:32:39.324107 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a54e4-be24-4ece-a694-751bfd802062 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:39.410544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411c69b-01c7-4354-b929-4bda15c6152e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:39.411434 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411c69b-01c7-4354-b929-4bda15c6152e admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:39.411656 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411c69b-01c7-4354-b929-4bda15c6152e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:39.420457 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411c69b-01c7-4354-b929-4bda15c6152e admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:39.421268 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411c69b-01c7-4354-b929-4bda15c6152e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:39.423419 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411c69b-01c7-4354-b929-4bda15c6152e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:39.455128 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3719/7438] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:32:39 2022] POST /identity/v3/users => generated 300 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:32:39.458745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552239a-1876-438d-acdc-46a4fe3d7308 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:39.470519 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552239a-1876-438d-acdc-46a4fe3d7308 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:39.476675 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec2479-adb1-4936-826a-ef35e07bc049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:39.477417 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec2479-adb1-4936-826a-ef35e07bc049 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:39.478457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec2479-adb1-4936-826a-ef35e07bc049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:39.478457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec2479-adb1-4936-826a-ef35e07bc049 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:39.478976 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec2479-adb1-4936-826a-ef35e07bc049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:39.481364 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec2479-adb1-4936-826a-ef35e07bc049 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:39.521309 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3720/7439] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:32:39.525291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411c69b-01c7-4354-b929-4bda15c6152e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:39.540046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411c69b-01c7-4354-b929-4bda15c6152e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:39.547632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3d178-1c09-40f2-b388-6889e49e533c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:39.548266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3d178-1c09-40f2-b388-6889e49e533c admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:39.548957 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3d178-1c09-40f2-b388-6889e49e533c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:39.548957 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3d178-1c09-40f2-b388-6889e49e533c admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:39.549581 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3d178-1c09-40f2-b388-6889e49e533c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:39.551345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3d178-1c09-40f2-b388-6889e49e533c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:39.569488 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3720/7440] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:32:39.571254 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec2479-adb1-4936-826a-ef35e07bc049 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:39.584733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec2479-adb1-4936-826a-ef35e07bc049 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:39.591716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84a447-fa35-48a9-85ae-51472ace31ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:39.592494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84a447-fa35-48a9-85ae-51472ace31ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:39.592778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84a447-fa35-48a9-85ae-51472ace31ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:39.593053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84a447-fa35-48a9-85ae-51472ace31ab admin admin] PATH_INFO: `/v3/projects/71379122716d4235b259fadb3cf0e04c/users/f32ddd252ac44f8394fc180738e812e3/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:39.623709 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84a447-fa35-48a9-85ae-51472ace31ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=71379122716d4235b259fadb3cf0e04c, user_id=f32ddd252ac44f8394fc180738e812e3, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:39.626771 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84a447-fa35-48a9-85ae-51472ace31ab admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:39.651933 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3721/7441] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:32:39 2022] PUT /identity/v3/projects/71379122716d4235b259fadb3cf0e04c/users/f32ddd252ac44f8394fc180738e812e3/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:39.664556 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccae0c7-6901-42d6-910d-e90e59d5c872 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:39.664556 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccae0c7-6901-42d6-910d-e90e59d5c872 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:39.664804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccae0c7-6901-42d6-910d-e90e59d5c872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:39.700373 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-3ccae0c7-6901-42d6-910d-e90e59d5c872 None None] MFA Rules not processed for user `f32ddd252ac44f8394fc180738e812e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:32:39.702312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3ccae0c7-6901-42d6-910d-e90e59d5c872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:39.846694 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3721/7442] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:32:39 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:32:39.851003 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84a447-fa35-48a9-85ae-51472ace31ab admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:39.995698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84a447-fa35-48a9-85ae-51472ace31ab admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:40.001894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40cca4-72eb-45c9-850e-3ccf46df319e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:40.002906 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40cca4-72eb-45c9-850e-3ccf46df319e admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:40.003185 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40cca4-72eb-45c9-850e-3ccf46df319e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:40.003451 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40cca4-72eb-45c9-850e-3ccf46df319e admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:40.004104 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca40cca4-72eb-45c9-850e-3ccf46df319e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:40.006112 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca40cca4-72eb-45c9-850e-3ccf46df319e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:40.037901 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3722/7443] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:32:39 2022] POST /identity/v3/projects => generated 403 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:32:40.042157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccae0c7-6901-42d6-910d-e90e59d5c872 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:40.053094 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:40.059219 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccae0c7-6901-42d6-910d-e90e59d5c872 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:40.130167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ddef3-eae9-4984-b1a4-b0110c9ebc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:40.131109 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ddef3-eae9-4984-b1a4-b0110c9ebc29 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:40.131392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ddef3-eae9-4984-b1a4-b0110c9ebc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:40.131665 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ddef3-eae9-4984-b1a4-b0110c9ebc29 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:40.132425 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ddef3-eae9-4984-b1a4-b0110c9ebc29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:40.134526 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ddef3-eae9-4984-b1a4-b0110c9ebc29 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:40.159288 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3722/7444] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:32:40 2022] POST /identity/v3/users => generated 308 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:32:40.163574 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40cca4-72eb-45c9-850e-3ccf46df319e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:40.175797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40cca4-72eb-45c9-850e-3ccf46df319e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:40.180953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3cfde-8a05-4508-805d-6f23f541203b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:40.181626 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3cfde-8a05-4508-805d-6f23f541203b admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:40.181909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3cfde-8a05-4508-805d-6f23f541203b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:40.182186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3cfde-8a05-4508-805d-6f23f541203b admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:40.182842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3cfde-8a05-4508-805d-6f23f541203b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:40.184581 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3cfde-8a05-4508-805d-6f23f541203b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:40.200907 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3723/7445] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:32:40.202215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ddef3-eae9-4984-b1a4-b0110c9ebc29 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:40.213650 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ddef3-eae9-4984-b1a4-b0110c9ebc29 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:40.218881 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e02d7-b5c1-4fc5-9d9d-4304e52ac515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:40.219558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e02d7-b5c1-4fc5-9d9d-4304e52ac515 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:40.219874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e02d7-b5c1-4fc5-9d9d-4304e52ac515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:40.220147 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e02d7-b5c1-4fc5-9d9d-4304e52ac515 admin admin] PATH_INFO: `/v3/projects/cd476b94ed494e348e414270ad221952/users/efc14901740a4d42b14053512db13cf7/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:40.239046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e02d7-b5c1-4fc5-9d9d-4304e52ac515 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd476b94ed494e348e414270ad221952, user_id=efc14901740a4d42b14053512db13cf7, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:40.241788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e02d7-b5c1-4fc5-9d9d-4304e52ac515 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:40.257802 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3723/7446] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:32:40 2022] PUT /identity/v3/projects/cd476b94ed494e348e414270ad221952/users/efc14901740a4d42b14053512db13cf7/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:40.262128 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3cfde-8a05-4508-805d-6f23f541203b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:40.273568 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3cfde-8a05-4508-805d-6f23f541203b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:40.359461 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ca3b4-b6f3-4fe1-9283-f7cc629c4747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:40.360075 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ca3b4-b6f3-4fe1-9283-f7cc629c4747 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:40.360353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ca3b4-b6f3-4fe1-9283-f7cc629c4747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:40.360622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ca3b4-b6f3-4fe1-9283-f7cc629c4747 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:40.361549 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ca3b4-b6f3-4fe1-9283-f7cc629c4747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:40.363762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ca3b4-b6f3-4fe1-9283-f7cc629c4747 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:40.377787 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3724/7447] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:32:40.379383 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e02d7-b5c1-4fc5-9d9d-4304e52ac515 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:40.390988 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e02d7-b5c1-4fc5-9d9d-4304e52ac515 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:40.395622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfad555-86e0-4361-a7ff-83a9b9d696f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:40.396281 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfad555-86e0-4361-a7ff-83a9b9d696f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:40.396559 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfad555-86e0-4361-a7ff-83a9b9d696f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:40.396828 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfad555-86e0-4361-a7ff-83a9b9d696f8 admin admin] PATH_INFO: `/v3/projects/cd476b94ed494e348e414270ad221952/users/efc14901740a4d42b14053512db13cf7/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:40.398826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfad555-86e0-4361-a7ff-83a9b9d696f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd476b94ed494e348e414270ad221952, user_id=efc14901740a4d42b14053512db13cf7, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:40.401450 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfad555-86e0-4361-a7ff-83a9b9d696f8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:40.413807 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3724/7448] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:32:40 2022] PUT /identity/v3/projects/cd476b94ed494e348e414270ad221952/users/efc14901740a4d42b14053512db13cf7/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:32:40.423941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96f780-ad21-43d3-ad7e-c0b60f557b6f None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:40.424324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96f780-ad21-43d3-ad7e-c0b60f557b6f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:40.424608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96f780-ad21-43d3-ad7e-c0b60f557b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:40.463668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-5d96f780-ad21-43d3-ad7e-c0b60f557b6f None None] MFA Rules not processed for user `efc14901740a4d42b14053512db13cf7`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:32:40.465446 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5d96f780-ad21-43d3-ad7e-c0b60f557b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:40.469688 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:40.542007 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3725/7449] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:32:40 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:32:40.547158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfad555-86e0-4361-a7ff-83a9b9d696f8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:40.561447 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfad555-86e0-4361-a7ff-83a9b9d696f8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:40.567558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85928a6a-c2f7-4acb-a88c-9bebe079a0e9 tempest-ApplicationCredentialsV3AdminTest-2084536343 tempest-ApplicationCredentialsV3AdminTest-2084536343-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc14901740a4d42b14053512db13cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd476b94ed494e348e414270ad221952', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:40.568178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85928a6a-c2f7-4acb-a88c-9bebe079a0e9 tempest-ApplicationCredentialsV3AdminTest-2084536343 tempest-ApplicationCredentialsV3AdminTest-2084536343-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:40.568471 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85928a6a-c2f7-4acb-a88c-9bebe079a0e9 tempest-ApplicationCredentialsV3AdminTest-2084536343 tempest-ApplicationCredentialsV3AdminTest-2084536343-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:40.568949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85928a6a-c2f7-4acb-a88c-9bebe079a0e9 tempest-ApplicationCredentialsV3AdminTest-2084536343 tempest-ApplicationCredentialsV3AdminTest-2084536343-project-admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:40.569745 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85928a6a-c2f7-4acb-a88c-9bebe079a0e9 tempest-ApplicationCredentialsV3AdminTest-2084536343 tempest-ApplicationCredentialsV3AdminTest-2084536343-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:40.571350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85928a6a-c2f7-4acb-a88c-9bebe079a0e9 tempest-ApplicationCredentialsV3AdminTest-2084536343 tempest-ApplicationCredentialsV3AdminTest-2084536343-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:40.595281 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3725/7450] 10.222.0.30 () {60 vars in 1143 bytes} [Sun Sep 4 01:32:40 2022] POST /identity/v3/roles => generated 239 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:32:40.596275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96f780-ad21-43d3-ad7e-c0b60f557b6f None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:40.607596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96f780-ad21-43d3-ad7e-c0b60f557b6f None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:40.614153 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283236b-ee26-4261-b38a-ac9a5d251050 tempest-ApplicationCredentialsV3AdminTest-2084536343 tempest-ApplicationCredentialsV3AdminTest-2084536343-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc14901740a4d42b14053512db13cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd476b94ed494e348e414270ad221952', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:40.615141 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283236b-ee26-4261-b38a-ac9a5d251050 tempest-ApplicationCredentialsV3AdminTest-2084536343 tempest-ApplicationCredentialsV3AdminTest-2084536343-project-admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:40.615725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283236b-ee26-4261-b38a-ac9a5d251050 tempest-ApplicationCredentialsV3AdminTest-2084536343 tempest-ApplicationCredentialsV3AdminTest-2084536343-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:40.616241 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283236b-ee26-4261-b38a-ac9a5d251050 tempest-ApplicationCredentialsV3AdminTest-2084536343 tempest-ApplicationCredentialsV3AdminTest-2084536343-project-admin] PATH_INFO: `/v3/projects/71379122716d4235b259fadb3cf0e04c/users/f32ddd252ac44f8394fc180738e812e3/roles/a6ae4baa2f284c4eb742ee24aa52ad02` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:40.618805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283236b-ee26-4261-b38a-ac9a5d251050 tempest-ApplicationCredentialsV3AdminTest-2084536343 tempest-ApplicationCredentialsV3AdminTest-2084536343-project-admin] RBAC: Authorizing `identity:create_grant(project_id=71379122716d4235b259fadb3cf0e04c, user_id=f32ddd252ac44f8394fc180738e812e3, role_id=a6ae4baa2f284c4eb742ee24aa52ad02)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:40.622167 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283236b-ee26-4261-b38a-ac9a5d251050 tempest-ApplicationCredentialsV3AdminTest-2084536343 tempest-ApplicationCredentialsV3AdminTest-2084536343-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:40.641824 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3726/7451] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:32:40 2022] PUT /identity/v3/projects/71379122716d4235b259fadb3cf0e04c/users/f32ddd252ac44f8394fc180738e812e3/roles/a6ae4baa2f284c4eb742ee24aa52ad02 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:40.648644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85928a6a-c2f7-4acb-a88c-9bebe079a0e9 tempest-ApplicationCredentialsV3AdminTest-2084536343 tempest-ApplicationCredentialsV3AdminTest-2084536343-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:40.738599 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85928a6a-c2f7-4acb-a88c-9bebe079a0e9 tempest-ApplicationCredentialsV3AdminTest-2084536343 tempest-ApplicationCredentialsV3AdminTest-2084536343-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:40.794441 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:40.807466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc829f89-ccfb-462b-afcf-fcc2036c2469 tempest-ApplicationCredentialsV3AdminTest-50081467 tempest-ApplicationCredentialsV3AdminTest-50081467-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f32ddd252ac44f8394fc180738e812e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71379122716d4235b259fadb3cf0e04c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'tempest-test_role-702487181'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:40.808355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc829f89-ccfb-462b-afcf-fcc2036c2469 tempest-ApplicationCredentialsV3AdminTest-50081467 tempest-ApplicationCredentialsV3AdminTest-50081467-project] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:40.809406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc829f89-ccfb-462b-afcf-fcc2036c2469 tempest-ApplicationCredentialsV3AdminTest-50081467 tempest-ApplicationCredentialsV3AdminTest-50081467-project] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:40.809657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc829f89-ccfb-462b-afcf-fcc2036c2469 tempest-ApplicationCredentialsV3AdminTest-50081467 tempest-ApplicationCredentialsV3AdminTest-50081467-project] PATH_INFO: `/v3/users/f32ddd252ac44f8394fc180738e812e3/application_credentials` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:40.810796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc829f89-ccfb-462b-afcf-fcc2036c2469 tempest-ApplicationCredentialsV3AdminTest-50081467 tempest-ApplicationCredentialsV3AdminTest-50081467-project] RBAC: Authorizing `identity:create_application_credential(user_id=f32ddd252ac44f8394fc180738e812e3)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:40.811752 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc829f89-ccfb-462b-afcf-fcc2036c2469 tempest-ApplicationCredentialsV3AdminTest-50081467 tempest-ApplicationCredentialsV3AdminTest-50081467-project] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:40.909250 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3726/7452] 10.222.0.30 () {60 vars in 1315 bytes} [Sun Sep 4 01:32:40 2022] POST /identity/v3/users/f32ddd252ac44f8394fc180738e812e3/application_credentials => generated 659 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:32:40.911391 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7378a-7675-4cf7-872b-acad246d290b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:40.911852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7378a-7675-4cf7-872b-acad246d290b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:40.911966 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7378a-7675-4cf7-872b-acad246d290b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:40.944362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-84d7378a-7675-4cf7-872b-acad246d290b None None] MFA Rules not processed for user `f32ddd252ac44f8394fc180738e812e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:32:40.946022 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-84d7378a-7675-4cf7-872b-acad246d290b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:41.092453 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3727/7453] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:32:40 2022] POST /identity/v3/auth/tokens => generated 3392 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Sep 04 01:32:41.096710 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc829f89-ccfb-462b-afcf-fcc2036c2469 tempest-ApplicationCredentialsV3AdminTest-50081467 tempest-ApplicationCredentialsV3AdminTest-50081467-project] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:41.108568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc829f89-ccfb-462b-afcf-fcc2036c2469 tempest-ApplicationCredentialsV3AdminTest-50081467 tempest-ApplicationCredentialsV3AdminTest-50081467-project] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:41.133831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8bc650-f5bd-49ff-9e4c-657373ef3ac9 tempest-ApplicationCredentialsV3AdminTest-50081467 tempest-ApplicationCredentialsV3AdminTest-50081467-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f32ddd252ac44f8394fc180738e812e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71379122716d4235b259fadb3cf0e04c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'tempest-test_role-702487181'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:41.134702 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8bc650-f5bd-49ff-9e4c-657373ef3ac9 tempest-ApplicationCredentialsV3AdminTest-50081467 tempest-ApplicationCredentialsV3AdminTest-50081467-project] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:41.135081 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8bc650-f5bd-49ff-9e4c-657373ef3ac9 tempest-ApplicationCredentialsV3AdminTest-50081467 tempest-ApplicationCredentialsV3AdminTest-50081467-project] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:41.135451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8bc650-f5bd-49ff-9e4c-657373ef3ac9 tempest-ApplicationCredentialsV3AdminTest-50081467 tempest-ApplicationCredentialsV3AdminTest-50081467-project] PATH_INFO: `/v3/users/f32ddd252ac44f8394fc180738e812e3/application_credentials/9efa87fea0794aa690423274f16d423e` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:41.136976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8bc650-f5bd-49ff-9e4c-657373ef3ac9 tempest-ApplicationCredentialsV3AdminTest-50081467 tempest-ApplicationCredentialsV3AdminTest-50081467-project] RBAC: Authorizing `identity:delete_application_credential(user_id=f32ddd252ac44f8394fc180738e812e3, application_credential_id=9efa87fea0794aa690423274f16d423e)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:41.138782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8bc650-f5bd-49ff-9e4c-657373ef3ac9 tempest-ApplicationCredentialsV3AdminTest-50081467 tempest-ApplicationCredentialsV3AdminTest-50081467-project] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:41.162969 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3727/7454] 10.222.0.30 () {58 vars in 1395 bytes} [Sun Sep 4 01:32:41 2022] DELETE /identity/v3/users/f32ddd252ac44f8394fc180738e812e3/application_credentials/9efa87fea0794aa690423274f16d423e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:41.167231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7378a-7675-4cf7-872b-acad246d290b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:41.204125 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:41.249367 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7378a-7675-4cf7-872b-acad246d290b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:41.255189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c79e5a-c9b6-4b9b-9f0a-1fce1d854e66 tempest-ApplicationCredentialsV3AdminTest-2084536343 tempest-ApplicationCredentialsV3AdminTest-2084536343-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc14901740a4d42b14053512db13cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd476b94ed494e348e414270ad221952', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:41.255911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c79e5a-c9b6-4b9b-9f0a-1fce1d854e66 tempest-ApplicationCredentialsV3AdminTest-2084536343 tempest-ApplicationCredentialsV3AdminTest-2084536343-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:41.256194 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c79e5a-c9b6-4b9b-9f0a-1fce1d854e66 tempest-ApplicationCredentialsV3AdminTest-2084536343 tempest-ApplicationCredentialsV3AdminTest-2084536343-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:41.256474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c79e5a-c9b6-4b9b-9f0a-1fce1d854e66 tempest-ApplicationCredentialsV3AdminTest-2084536343 tempest-ApplicationCredentialsV3AdminTest-2084536343-project-admin] PATH_INFO: `/v3/roles/a6ae4baa2f284c4eb742ee24aa52ad02` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:41.258115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c79e5a-c9b6-4b9b-9f0a-1fce1d854e66 tempest-ApplicationCredentialsV3AdminTest-2084536343 tempest-ApplicationCredentialsV3AdminTest-2084536343-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a6ae4baa2f284c4eb742ee24aa52ad02)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:41.259803 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c79e5a-c9b6-4b9b-9f0a-1fce1d854e66 tempest-ApplicationCredentialsV3AdminTest-2084536343 tempest-ApplicationCredentialsV3AdminTest-2084536343-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:41.314162 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-48c79e5a-c9b6-4b9b-9f0a-1fce1d854e66 tempest-ApplicationCredentialsV3AdminTest-2084536343 tempest-ApplicationCredentialsV3AdminTest-2084536343-project-admin] Invalidating the token cache because role a6ae4baa2f284c4eb742ee24aa52ad02 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:32:41.314739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-48c79e5a-c9b6-4b9b-9f0a-1fce1d854e66 tempest-ApplicationCredentialsV3AdminTest-2084536343 tempest-ApplicationCredentialsV3AdminTest-2084536343-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:41.318199 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-48c79e5a-c9b6-4b9b-9f0a-1fce1d854e66 tempest-ApplicationCredentialsV3AdminTest-2084536343 tempest-ApplicationCredentialsV3AdminTest-2084536343-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:41.327863 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3728/7455] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:32:41 2022] DELETE /identity/v3/roles/a6ae4baa2f284c4eb742ee24aa52ad02 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:41.329007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8bc650-f5bd-49ff-9e4c-657373ef3ac9 tempest-ApplicationCredentialsV3AdminTest-50081467 tempest-ApplicationCredentialsV3AdminTest-50081467-project] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:41.331068 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3a8bc650-f5bd-49ff-9e4c-657373ef3ac9 tempest-ApplicationCredentialsV3AdminTest-50081467 tempest-ApplicationCredentialsV3AdminTest-50081467-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:41.413058 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8bc650-f5bd-49ff-9e4c-657373ef3ac9 tempest-ApplicationCredentialsV3AdminTest-50081467 tempest-ApplicationCredentialsV3AdminTest-50081467-project] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:41.500900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cebf8-2745-4280-96c2-ee1b1d8353ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:41.502379 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cebf8-2745-4280-96c2-ee1b1d8353ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:41.502821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cebf8-2745-4280-96c2-ee1b1d8353ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:41.503251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cebf8-2745-4280-96c2-ee1b1d8353ac admin admin] PATH_INFO: `/v3/users/f32ddd252ac44f8394fc180738e812e3` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:41.504697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322cebf8-2745-4280-96c2-ee1b1d8353ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=f32ddd252ac44f8394fc180738e812e3)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:41.506970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322cebf8-2745-4280-96c2-ee1b1d8353ac admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:41.531441 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:41.574009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-322cebf8-2745-4280-96c2-ee1b1d8353ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f32ddd252ac44f8394fc180738e812e3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:41.574754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-322cebf8-2745-4280-96c2-ee1b1d8353ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f32ddd252ac44f8394fc180738e812e3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:41.582842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-322cebf8-2745-4280-96c2-ee1b1d8353ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f32ddd252ac44f8394fc180738e812e3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:41.596513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-322cebf8-2745-4280-96c2-ee1b1d8353ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f32ddd252ac44f8394fc180738e812e3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:41.597908 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-322cebf8-2745-4280-96c2-ee1b1d8353ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f32ddd252ac44f8394fc180738e812e3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:41.622138 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3728/7456] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:32:41 2022] DELETE /identity/v3/users/f32ddd252ac44f8394fc180738e812e3 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:32:41.626845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071f4f5-74e3-41fa-b6c7-153a062cb882 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:41.627140 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071f4f5-74e3-41fa-b6c7-153a062cb882 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:41.627421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071f4f5-74e3-41fa-b6c7-153a062cb882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:41.649837 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-3071f4f5-74e3-41fa-b6c7-153a062cb882 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:32:41.651256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3071f4f5-74e3-41fa-b6c7-153a062cb882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:41.732082 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3729/7457] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:32:41.748801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cebf8-2745-4280-96c2-ee1b1d8353ac admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:41.750949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-322cebf8-2745-4280-96c2-ee1b1d8353ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:41.950178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cebf8-2745-4280-96c2-ee1b1d8353ac admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:41.960491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff54a518-b579-4615-93ad-7b8e56066276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:41.961112 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54a518-b579-4615-93ad-7b8e56066276 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:41.961511 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54a518-b579-4615-93ad-7b8e56066276 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:41.961855 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54a518-b579-4615-93ad-7b8e56066276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:41.973790 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff54a518-b579-4615-93ad-7b8e56066276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:41.975367 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff54a518-b579-4615-93ad-7b8e56066276 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:42.007626 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3729/7458] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:32:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:32:42.540265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071f4f5-74e3-41fa-b6c7-153a062cb882 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:42.541993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3071f4f5-74e3-41fa-b6c7-153a062cb882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:42.567794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071f4f5-74e3-41fa-b6c7-153a062cb882 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:42.572886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1d0cb-1f21-40bf-ba7a-b27d3872700b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:42.573588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1d0cb-1f21-40bf-ba7a-b27d3872700b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:42.573872 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1d0cb-1f21-40bf-ba7a-b27d3872700b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:42.574726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1d0cb-1f21-40bf-ba7a-b27d3872700b admin admin] PATH_INFO: `/v3/projects/71379122716d4235b259fadb3cf0e04c` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:42.582403 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1d0cb-1f21-40bf-ba7a-b27d3872700b admin admin] RBAC: Authorizing `identity:delete_project(project_id=71379122716d4235b259fadb3cf0e04c)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:42.584502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1d0cb-1f21-40bf-ba7a-b27d3872700b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:42.668893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-09b1d0cb-1f21-40bf-ba7a-b27d3872700b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71379122716d4235b259fadb3cf0e04c', 'request_id': 'req-09b1d0cb-1f21-40bf-ba7a-b27d3872700b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:42.680031 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-09b1d0cb-1f21-40bf-ba7a-b27d3872700b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71379122716d4235b259fadb3cf0e04c', 'request_id': 'req-09b1d0cb-1f21-40bf-ba7a-b27d3872700b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:42.689620 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-09b1d0cb-1f21-40bf-ba7a-b27d3872700b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71379122716d4235b259fadb3cf0e04c', 'request_id': 'req-09b1d0cb-1f21-40bf-ba7a-b27d3872700b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:42.708731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-09b1d0cb-1f21-40bf-ba7a-b27d3872700b admin admin] The token cache is being invalidate because project 71379122716d4235b259fadb3cf0e04c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:32:42.709226 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-09b1d0cb-1f21-40bf-ba7a-b27d3872700b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:42.714430 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-09b1d0cb-1f21-40bf-ba7a-b27d3872700b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:42.717706 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3730/7459] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:32:42 2022] DELETE /identity/v3/projects/71379122716d4235b259fadb3cf0e04c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:42.722904 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff54a518-b579-4615-93ad-7b8e56066276 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:42.742808 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff54a518-b579-4615-93ad-7b8e56066276 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:42.823345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748aea41-e359-4184-83ea-ffa62d271dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:42.824321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748aea41-e359-4184-83ea-ffa62d271dd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:42.824801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748aea41-e359-4184-83ea-ffa62d271dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:42.825253 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748aea41-e359-4184-83ea-ffa62d271dd9 admin admin] PATH_INFO: `/v3/users/efc14901740a4d42b14053512db13cf7` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:42.826740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748aea41-e359-4184-83ea-ffa62d271dd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efc14901740a4d42b14053512db13cf7)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:42.828977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748aea41-e359-4184-83ea-ffa62d271dd9 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:42.903837 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:42.919018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-748aea41-e359-4184-83ea-ffa62d271dd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efc14901740a4d42b14053512db13cf7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:42.919966 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-748aea41-e359-4184-83ea-ffa62d271dd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efc14901740a4d42b14053512db13cf7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:42.938103 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-748aea41-e359-4184-83ea-ffa62d271dd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efc14901740a4d42b14053512db13cf7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:42.961031 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-748aea41-e359-4184-83ea-ffa62d271dd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efc14901740a4d42b14053512db13cf7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:42.961751 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-748aea41-e359-4184-83ea-ffa62d271dd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efc14901740a4d42b14053512db13cf7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:42.982278 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3730/7460] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:32:42 2022] DELETE /identity/v3/users/efc14901740a4d42b14053512db13cf7 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:43.902638 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1d0cb-1f21-40bf-ba7a-b27d3872700b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:43.904764 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-09b1d0cb-1f21-40bf-ba7a-b27d3872700b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:43.924077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1d0cb-1f21-40bf-ba7a-b27d3872700b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:43.959364 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:44.070119 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8007f-5d36-45e1-9ceb-4e83861cb0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:44.071136 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8007f-5d36-45e1-9ceb-4e83861cb0b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:44.071593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8007f-5d36-45e1-9ceb-4e83861cb0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:44.072676 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8007f-5d36-45e1-9ceb-4e83861cb0b6 admin admin] PATH_INFO: `/v3/projects/cd476b94ed494e348e414270ad221952` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:44.080652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8007f-5d36-45e1-9ceb-4e83861cb0b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd476b94ed494e348e414270ad221952)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:44.085585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8007f-5d36-45e1-9ceb-4e83861cb0b6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:44.227651 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b1c8007f-5d36-45e1-9ceb-4e83861cb0b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd476b94ed494e348e414270ad221952', 'request_id': 'req-b1c8007f-5d36-45e1-9ceb-4e83861cb0b6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:44.246111 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b1c8007f-5d36-45e1-9ceb-4e83861cb0b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd476b94ed494e348e414270ad221952', 'request_id': 'req-b1c8007f-5d36-45e1-9ceb-4e83861cb0b6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:44.254595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b1c8007f-5d36-45e1-9ceb-4e83861cb0b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd476b94ed494e348e414270ad221952', 'request_id': 'req-b1c8007f-5d36-45e1-9ceb-4e83861cb0b6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:44.281354 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b1c8007f-5d36-45e1-9ceb-4e83861cb0b6 admin admin] The token cache is being invalidate because project cd476b94ed494e348e414270ad221952 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:32:44.281739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b1c8007f-5d36-45e1-9ceb-4e83861cb0b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:44.285776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b1c8007f-5d36-45e1-9ceb-4e83861cb0b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:44.288648 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3731/7461] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:32:43 2022] DELETE /identity/v3/projects/cd476b94ed494e348e414270ad221952 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:44.293946 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366bcd9-f528-4dd5-8ef0-741f2b23833a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:44.294494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366bcd9-f528-4dd5-8ef0-741f2b23833a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:44.294684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366bcd9-f528-4dd5-8ef0-741f2b23833a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:44.334229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a366bcd9-f528-4dd5-8ef0-741f2b23833a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:32:44.335910 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a366bcd9-f528-4dd5-8ef0-741f2b23833a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:44.448670 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3731/7462] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:32:44.455356 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21e7eb-7240-4a2a-a4a5-f3022f3ce8d2 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:44.455846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21e7eb-7240-4a2a-a4a5-f3022f3ce8d2 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:44.456218 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21e7eb-7240-4a2a-a4a5-f3022f3ce8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:44.512231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ba21e7eb-7240-4a2a-a4a5-f3022f3ce8d2 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:32:44.516118 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ba21e7eb-7240-4a2a-a4a5-f3022f3ce8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:44.536404 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3732/7463] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:32:44.536630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366bcd9-f528-4dd5-8ef0-741f2b23833a None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:44.556425 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366bcd9-f528-4dd5-8ef0-741f2b23833a None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:44.561381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d8f80-9709-4e0b-928c-7de60e1f6676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:44.562025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d8f80-9709-4e0b-928c-7de60e1f6676 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:44.562300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d8f80-9709-4e0b-928c-7de60e1f6676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:44.562573 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d8f80-9709-4e0b-928c-7de60e1f6676 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:44.563222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d8f80-9709-4e0b-928c-7de60e1f6676 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:32:44.563523 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d8f80-9709-4e0b-928c-7de60e1f6676 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:44.565145 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d8f80-9709-4e0b-928c-7de60e1f6676 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:44.613511 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3732/7464] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:32:44.618573 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21e7eb-7240-4a2a-a4a5-f3022f3ce8d2 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:44.631116 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21e7eb-7240-4a2a-a4a5-f3022f3ce8d2 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:44.639807 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4095c-8567-47d4-8353-a85e6998973f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:44.641827 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4095c-8567-47d4-8353-a85e6998973f admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:44.642153 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4095c-8567-47d4-8353-a85e6998973f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:44.642485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4095c-8567-47d4-8353-a85e6998973f admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:44.643165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4095c-8567-47d4-8353-a85e6998973f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:44.645285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4095c-8567-47d4-8353-a85e6998973f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:44.751600 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3733/7465] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:32:44 2022] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:32:44.756598 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d8f80-9709-4e0b-928c-7de60e1f6676 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:44.771300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d8f80-9709-4e0b-928c-7de60e1f6676 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:44.928636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bfa60-98e5-412b-889c-056cea556f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:44.929280 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bfa60-98e5-412b-889c-056cea556f86 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:44.929594 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bfa60-98e5-412b-889c-056cea556f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:44.929862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bfa60-98e5-412b-889c-056cea556f86 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:44.930512 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452bfa60-98e5-412b-889c-056cea556f86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:44.931812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4095c-8567-47d4-8353-a85e6998973f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:44.932594 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452bfa60-98e5-412b-889c-056cea556f86 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:44.934387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-63e4095c-8567-47d4-8353-a85e6998973f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:44.960225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4095c-8567-47d4-8353-a85e6998973f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:44.970339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9bf35-4492-4411-b310-17c1699f0f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:44.972049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9bf35-4492-4411-b310-17c1699f0f66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:44.972494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9bf35-4492-4411-b310-17c1699f0f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:44.972921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9bf35-4492-4411-b310-17c1699f0f66 admin admin] PATH_INFO: `/v3/users/925bce1a0b1e46daa35f05a95cf56c72` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:44.974555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9bf35-4492-4411-b310-17c1699f0f66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=925bce1a0b1e46daa35f05a95cf56c72)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:44.979019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9bf35-4492-4411-b310-17c1699f0f66 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:44.989000 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3733/7466] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:32:44 2022] POST /identity/v3/users => generated 289 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:32:44.993290 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bfa60-98e5-412b-889c-056cea556f86 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:45.010708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bfa60-98e5-412b-889c-056cea556f86 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:45.024204 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794ba44-b9ce-434c-a014-a0da930a0dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:45.024842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794ba44-b9ce-434c-a014-a0da930a0dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:45.025121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794ba44-b9ce-434c-a014-a0da930a0dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:45.025390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794ba44-b9ce-434c-a014-a0da930a0dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:45.026187 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5794ba44-b9ce-434c-a014-a0da930a0dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:45.028594 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5794ba44-b9ce-434c-a014-a0da930a0dc7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:45.052897 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3734/7467] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:32:45.055684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794ba44-b9ce-434c-a014-a0da930a0dc7 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:45.077080 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794ba44-b9ce-434c-a014-a0da930a0dc7 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:45.084946 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536c077-81ef-424b-bfdc-9465570df4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:45.086137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536c077-81ef-424b-bfdc-9465570df4e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:45.086137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536c077-81ef-424b-bfdc-9465570df4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:45.086390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536c077-81ef-424b-bfdc-9465570df4e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:45.087009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536c077-81ef-424b-bfdc-9465570df4e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:45.089517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536c077-81ef-424b-bfdc-9465570df4e3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:45.092611 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6eb9bf35-4492-4411-b310-17c1699f0f66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '925bce1a0b1e46daa35f05a95cf56c72'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:45.096883 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6eb9bf35-4492-4411-b310-17c1699f0f66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '925bce1a0b1e46daa35f05a95cf56c72'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:45.104901 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3735/7468] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:32:45.106620 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536c077-81ef-424b-bfdc-9465570df4e3 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:45.108399 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1536c077-81ef-424b-bfdc-9465570df4e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:45.117614 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6eb9bf35-4492-4411-b310-17c1699f0f66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '925bce1a0b1e46daa35f05a95cf56c72'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:45.124791 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536c077-81ef-424b-bfdc-9465570df4e3 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:45.129733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6eb9bf35-4492-4411-b310-17c1699f0f66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '925bce1a0b1e46daa35f05a95cf56c72'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:45.130156 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a47276-a57e-41c4-88c1-d00f6ab9a1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:45.130802 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6eb9bf35-4492-4411-b310-17c1699f0f66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '925bce1a0b1e46daa35f05a95cf56c72'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:45.130924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a47276-a57e-41c4-88c1-d00f6ab9a1ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:45.131105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a47276-a57e-41c4-88c1-d00f6ab9a1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:45.131353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a47276-a57e-41c4-88c1-d00f6ab9a1ef admin admin] PATH_INFO: `/v3/projects/a9a1ba8202d64df386261ea4a7a2d5b3/users/620463544b274e9196e48b581aa490e0/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:45.144843 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:45.151464 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:45.158753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a47276-a57e-41c4-88c1-d00f6ab9a1ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9a1ba8202d64df386261ea4a7a2d5b3, user_id=620463544b274e9196e48b581aa490e0, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:45.163790 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a47276-a57e-41c4-88c1-d00f6ab9a1ef admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:45.175572 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3734/7469] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:32:44 2022] DELETE /identity/v3/users/925bce1a0b1e46daa35f05a95cf56c72 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:45.179929 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab5781-7d60-4d30-8eed-b0e609ffeab0 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:45.180209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab5781-7d60-4d30-8eed-b0e609ffeab0 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:45.180841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab5781-7d60-4d30-8eed-b0e609ffeab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:45.211608 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3736/7470] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:32:45 2022] PUT /identity/v3/projects/a9a1ba8202d64df386261ea4a7a2d5b3/users/620463544b274e9196e48b581aa490e0/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:45.213787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d176b-2e87-490d-8812-f2b0d7a3b198 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:45.214172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d176b-2e87-490d-8812-f2b0d7a3b198 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:45.215196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d176b-2e87-490d-8812-f2b0d7a3b198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:45.220173 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-f7ab5781-7d60-4d30-8eed-b0e609ffeab0 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:32:45.221412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f7ab5781-7d60-4d30-8eed-b0e609ffeab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:45.268693 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5d7d176b-2e87-490d-8812-f2b0d7a3b198 None None] MFA Rules not processed for user `620463544b274e9196e48b581aa490e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:32:45.270104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5d7d176b-2e87-490d-8812-f2b0d7a3b198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:45.335565 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3735/7471] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:32:45.346983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab5781-7d60-4d30-8eed-b0e609ffeab0 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:45.357040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f7ab5781-7d60-4d30-8eed-b0e609ffeab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:45.369698 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3737/7472] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:32:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:32:45.371239 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d176b-2e87-490d-8812-f2b0d7a3b198 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:45.383648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d176b-2e87-490d-8812-f2b0d7a3b198 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:45.390699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0af5f3-333e-42c9-81e6-ab0ead6de171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:45.391703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0af5f3-333e-42c9-81e6-ab0ead6de171 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:45.392202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0af5f3-333e-42c9-81e6-ab0ead6de171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:45.392701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0af5f3-333e-42c9-81e6-ab0ead6de171 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:45.393609 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0af5f3-333e-42c9-81e6-ab0ead6de171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:45.396317 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0af5f3-333e-42c9-81e6-ab0ead6de171 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:45.439682 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3738/7473] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:32:45 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:32:45.456938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0af5f3-333e-42c9-81e6-ab0ead6de171 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:45.488854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab5781-7d60-4d30-8eed-b0e609ffeab0 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:45.574582 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0af5f3-333e-42c9-81e6-ab0ead6de171 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:45.580109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547be5a-baa5-4aea-8a04-06b673b9df76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:45.581605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547be5a-baa5-4aea-8a04-06b673b9df76 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:45.582117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547be5a-baa5-4aea-8a04-06b673b9df76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:45.582622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547be5a-baa5-4aea-8a04-06b673b9df76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:45.598833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547be5a-baa5-4aea-8a04-06b673b9df76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:45.600418 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7271b-6797-45fb-a83b-47e79997530d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:45.601023 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547be5a-baa5-4aea-8a04-06b673b9df76 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:45.601476 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7271b-6797-45fb-a83b-47e79997530d admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:45.601589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7271b-6797-45fb-a83b-47e79997530d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:45.601862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7271b-6797-45fb-a83b-47e79997530d admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:45.602679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7271b-6797-45fb-a83b-47e79997530d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:45.606093 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7271b-6797-45fb-a83b-47e79997530d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:45.616352 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3736/7474] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:32:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:32:45.659822 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3739/7475] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:32:45 2022] POST /identity/v3/users => generated 295 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:32:45.663756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547be5a-baa5-4aea-8a04-06b673b9df76 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:45.679030 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547be5a-baa5-4aea-8a04-06b673b9df76 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:45.693114 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485faa11-94cf-48e4-aaad-d239449d28ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:45.693114 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485faa11-94cf-48e4-aaad-d239449d28ed admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:45.693114 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485faa11-94cf-48e4-aaad-d239449d28ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:45.693114 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485faa11-94cf-48e4-aaad-d239449d28ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:45.693550 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485faa11-94cf-48e4-aaad-d239449d28ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:45.694565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485faa11-94cf-48e4-aaad-d239449d28ed admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:45.713728 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3737/7476] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:32:45.718751 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7271b-6797-45fb-a83b-47e79997530d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:45.739336 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7271b-6797-45fb-a83b-47e79997530d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:45.751219 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5e819-dd7e-4bbf-b634-2a426a7d72cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:45.751924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5e819-dd7e-4bbf-b634-2a426a7d72cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:45.752191 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5e819-dd7e-4bbf-b634-2a426a7d72cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:45.752461 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5e819-dd7e-4bbf-b634-2a426a7d72cd admin admin] PATH_INFO: `/v3/projects/4a91a22eae48436a9c1f7069b805d36c/users/3d339ede543748369b67f29117a4be6c/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:45.786560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5e819-dd7e-4bbf-b634-2a426a7d72cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a91a22eae48436a9c1f7069b805d36c, user_id=3d339ede543748369b67f29117a4be6c, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:45.790919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5e819-dd7e-4bbf-b634-2a426a7d72cd admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:45.820812 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3740/7477] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:32:45 2022] PUT /identity/v3/projects/4a91a22eae48436a9c1f7069b805d36c/users/3d339ede543748369b67f29117a4be6c/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:45.825953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485faa11-94cf-48e4-aaad-d239449d28ed admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:45.843823 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485faa11-94cf-48e4-aaad-d239449d28ed admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:45.913836 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5e819-dd7e-4bbf-b634-2a426a7d72cd admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:45.915672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d7d5e819-dd7e-4bbf-b634-2a426a7d72cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:45.922191 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:45.953379 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:45.991388 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5d2aa-fccc-4e19-aacf-60662b87d850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:45.991950 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5d2aa-fccc-4e19-aacf-60662b87d850 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:45.992197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5d2aa-fccc-4e19-aacf-60662b87d850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:45.992470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5d2aa-fccc-4e19-aacf-60662b87d850 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:45.993116 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5d2aa-fccc-4e19-aacf-60662b87d850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:45.997820 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5d2aa-fccc-4e19-aacf-60662b87d850 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:46.010161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5e819-dd7e-4bbf-b634-2a426a7d72cd admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:46.025265 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3738/7478] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:32:46.029266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434d5a7-0fd1-4f24-b065-d37647d5ea34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:46.030677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434d5a7-0fd1-4f24-b065-d37647d5ea34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:46.031217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434d5a7-0fd1-4f24-b065-d37647d5ea34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:46.031652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434d5a7-0fd1-4f24-b065-d37647d5ea34 admin admin] PATH_INFO: `/v3/projects/8e3510353d97433d9ebb42d65fe2dc98` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:46.033277 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434d5a7-0fd1-4f24-b065-d37647d5ea34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e3510353d97433d9ebb42d65fe2dc98)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:46.036926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434d5a7-0fd1-4f24-b065-d37647d5ea34 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:46.040018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5d2aa-fccc-4e19-aacf-60662b87d850 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:46.060131 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5d2aa-fccc-4e19-aacf-60662b87d850 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:46.070419 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26ac4f-cdae-478c-881e-4ada0ae0e432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:46.071564 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26ac4f-cdae-478c-881e-4ada0ae0e432 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:46.071767 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26ac4f-cdae-478c-881e-4ada0ae0e432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:46.072092 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26ac4f-cdae-478c-881e-4ada0ae0e432 admin admin] PATH_INFO: `/v3/projects/4a91a22eae48436a9c1f7069b805d36c/users/3d339ede543748369b67f29117a4be6c/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:46.078969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26ac4f-cdae-478c-881e-4ada0ae0e432 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a91a22eae48436a9c1f7069b805d36c, user_id=3d339ede543748369b67f29117a4be6c, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:46.085645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26ac4f-cdae-478c-881e-4ada0ae0e432 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:46.114101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6434d5a7-0fd1-4f24-b065-d37647d5ea34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e3510353d97433d9ebb42d65fe2dc98', 'request_id': 'req-6434d5a7-0fd1-4f24-b065-d37647d5ea34'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:46.116897 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3739/7479] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:32:46 2022] PUT /identity/v3/projects/4a91a22eae48436a9c1f7069b805d36c/users/3d339ede543748369b67f29117a4be6c/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:46.129382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c67bbc-2cf0-475a-935e-85478f19825c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:46.131039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c67bbc-2cf0-475a-935e-85478f19825c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:46.131558 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c67bbc-2cf0-475a-935e-85478f19825c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:46.152617 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6434d5a7-0fd1-4f24-b065-d37647d5ea34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e3510353d97433d9ebb42d65fe2dc98', 'request_id': 'req-6434d5a7-0fd1-4f24-b065-d37647d5ea34'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:46.177556 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6434d5a7-0fd1-4f24-b065-d37647d5ea34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e3510353d97433d9ebb42d65fe2dc98', 'request_id': 'req-6434d5a7-0fd1-4f24-b065-d37647d5ea34'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:46.202742 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-78c67bbc-2cf0-475a-935e-85478f19825c None None] MFA Rules not processed for user `3d339ede543748369b67f29117a4be6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:32:46.204069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-78c67bbc-2cf0-475a-935e-85478f19825c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:46.226521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6434d5a7-0fd1-4f24-b065-d37647d5ea34 admin admin] The token cache is being invalidate because project 8e3510353d97433d9ebb42d65fe2dc98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:32:46.231982 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6434d5a7-0fd1-4f24-b065-d37647d5ea34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:46.235601 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6434d5a7-0fd1-4f24-b065-d37647d5ea34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:46.249454 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3741/7480] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:32:45 2022] DELETE /identity/v3/projects/8e3510353d97433d9ebb42d65fe2dc98 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:46.252823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6da34-f176-4b78-8762-7ce4c722e037 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:46.253114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6da34-f176-4b78-8762-7ce4c722e037 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:46.253392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6da34-f176-4b78-8762-7ce4c722e037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:46.322676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-bbe6da34-f176-4b78-8762-7ce4c722e037 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:32:46.324538 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bbe6da34-f176-4b78-8762-7ce4c722e037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:46.370132 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3740/7481] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:32:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:32:46.375405 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c67bbc-2cf0-475a-935e-85478f19825c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:46.388435 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c67bbc-2cf0-475a-935e-85478f19825c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:46.395843 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9dd0b4-536f-4303-bbc1-95a54d98785c tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d339ede543748369b67f29117a4be6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a91a22eae48436a9c1f7069b805d36c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:46.396544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9dd0b4-536f-4303-bbc1-95a54d98785c tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:46.396973 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9dd0b4-536f-4303-bbc1-95a54d98785c tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:46.397695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9dd0b4-536f-4303-bbc1-95a54d98785c tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:46.398071 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9dd0b4-536f-4303-bbc1-95a54d98785c tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:46.400087 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9dd0b4-536f-4303-bbc1-95a54d98785c tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:46.455136 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3741/7482] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:32:46 2022] POST /identity/v3/projects => generated 334 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:32:46.459504 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9dd0b4-536f-4303-bbc1-95a54d98785c tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:46.463892 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3742/7483] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:32:46.472829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af833e5a-dce5-41d4-9d49-b5e0794d375b None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:46.473087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af833e5a-dce5-41d4-9d49-b5e0794d375b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:46.473327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af833e5a-dce5-41d4-9d49-b5e0794d375b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:46.504648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-af833e5a-dce5-41d4-9d49-b5e0794d375b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:32:46.508402 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-af833e5a-dce5-41d4-9d49-b5e0794d375b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:46.559045 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9dd0b4-536f-4303-bbc1-95a54d98785c tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:46.566018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5c281-084a-45ac-8f12-05ab7050ddbd tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d339ede543748369b67f29117a4be6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a91a22eae48436a9c1f7069b805d36c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:46.566802 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5c281-084a-45ac-8f12-05ab7050ddbd tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:46.567079 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:46.567408 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5c281-084a-45ac-8f12-05ab7050ddbd tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:46.567736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5c281-084a-45ac-8f12-05ab7050ddbd tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:46.568322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5c281-084a-45ac-8f12-05ab7050ddbd tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:46.570636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5c281-084a-45ac-8f12-05ab7050ddbd tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:46.591986 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3743/7484] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:32:46.595565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af833e5a-dce5-41d4-9d49-b5e0794d375b None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:46.615192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af833e5a-dce5-41d4-9d49-b5e0794d375b None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:46.616099 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3742/7485] 10.222.0.30 () {60 vars in 1152 bytes} [Sun Sep 4 01:32:46 2022] POST /identity/v3/projects => generated 333 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:32:46.620475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5c281-084a-45ac-8f12-05ab7050ddbd tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:46.633620 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:46.696891 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628dc5f-2e33-45e1-9594-fe3d8b080332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:46.697974 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628dc5f-2e33-45e1-9594-fe3d8b080332 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:46.698443 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628dc5f-2e33-45e1-9594-fe3d8b080332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:46.698916 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628dc5f-2e33-45e1-9594-fe3d8b080332 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:46.699587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628dc5f-2e33-45e1-9594-fe3d8b080332 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:32:46.699887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628dc5f-2e33-45e1-9594-fe3d8b080332 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:46.701552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628dc5f-2e33-45e1-9594-fe3d8b080332 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:46.722147 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3744/7486] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:32:46.727888 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628dc5f-2e33-45e1-9594-fe3d8b080332 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:46.750735 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628dc5f-2e33-45e1-9594-fe3d8b080332 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:46.751821 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5c281-084a-45ac-8f12-05ab7050ddbd tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:46.757350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025f2aa-aa7a-4758-a932-d1154b3e1695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:46.758245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025f2aa-aa7a-4758-a932-d1154b3e1695 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:46.758743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025f2aa-aa7a-4758-a932-d1154b3e1695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:46.759359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025f2aa-aa7a-4758-a932-d1154b3e1695 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:46.759631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d48922-e1dd-42e0-a1a3-86cfdf22e4c7 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d339ede543748369b67f29117a4be6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a91a22eae48436a9c1f7069b805d36c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:46.760633 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d48922-e1dd-42e0-a1a3-86cfdf22e4c7 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:46.760633 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d48922-e1dd-42e0-a1a3-86cfdf22e4c7 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:46.761253 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d025f2aa-aa7a-4758-a932-d1154b3e1695 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:46.761416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d48922-e1dd-42e0-a1a3-86cfdf22e4c7 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:46.762123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d48922-e1dd-42e0-a1a3-86cfdf22e4c7 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:46.764064 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d025f2aa-aa7a-4758-a932-d1154b3e1695 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:46.768288 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d48922-e1dd-42e0-a1a3-86cfdf22e4c7 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:46.810888 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3745/7487] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:32:46 2022] POST /identity/v3/projects => generated 365 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:32:46.815142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025f2aa-aa7a-4758-a932-d1154b3e1695 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:46.856543 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3743/7488] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:32:46 2022] POST /identity/v3/projects => generated 358 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:32:46.857653 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d48922-e1dd-42e0-a1a3-86cfdf22e4c7 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:46.935215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025f2aa-aa7a-4758-a932-d1154b3e1695 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:46.955160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d48922-e1dd-42e0-a1a3-86cfdf22e4c7 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:46.968531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd20d29-1dce-44e6-98e5-02c208cdfe0d tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d339ede543748369b67f29117a4be6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a91a22eae48436a9c1f7069b805d36c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:46.969875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd20d29-1dce-44e6-98e5-02c208cdfe0d tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:46.970408 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd20d29-1dce-44e6-98e5-02c208cdfe0d tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:46.970693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd20d29-1dce-44e6-98e5-02c208cdfe0d tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:46.971396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd20d29-1dce-44e6-98e5-02c208cdfe0d tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:46.976186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd20d29-1dce-44e6-98e5-02c208cdfe0d tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:47.009851 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3744/7489] 10.222.0.30 () {58 vars in 1131 bytes} [Sun Sep 4 01:32:46 2022] GET /identity/v3/projects => generated 7976 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:32:47.012630 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd20d29-1dce-44e6-98e5-02c208cdfe0d tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:47.035714 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd20d29-1dce-44e6-98e5-02c208cdfe0d tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:47.050252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594685f3-b461-4339-83bd-02af4bad1f47 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d339ede543748369b67f29117a4be6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a91a22eae48436a9c1f7069b805d36c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:47.051187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594685f3-b461-4339-83bd-02af4bad1f47 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:47.051472 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594685f3-b461-4339-83bd-02af4bad1f47 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:47.052398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594685f3-b461-4339-83bd-02af4bad1f47 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:47.053681 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594685f3-b461-4339-83bd-02af4bad1f47 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:32:47.055406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594685f3-b461-4339-83bd-02af4bad1f47 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:47.059761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594685f3-b461-4339-83bd-02af4bad1f47 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:47.062822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df77990-2baf-435f-9b42-20e83613c9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:47.063789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df77990-2baf-435f-9b42-20e83613c9ce admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:47.063789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df77990-2baf-435f-9b42-20e83613c9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:47.064002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df77990-2baf-435f-9b42-20e83613c9ce admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:47.066590 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df77990-2baf-435f-9b42-20e83613c9ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:47.073704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df77990-2baf-435f-9b42-20e83613c9ce admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:47.125459 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3745/7490] 10.222.0.30 () {58 vars in 1158 bytes} [Sun Sep 4 01:32:47 2022] GET /identity/v3/projects?enabled=False => generated 445 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:32:47.133115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594685f3-b461-4339-83bd-02af4bad1f47 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:47.135095 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:47.144800 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3746/7491] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:32:46 2022] POST /identity/v3/users => generated 283 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:32:47.145864 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df77990-2baf-435f-9b42-20e83613c9ce admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:47.161220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594685f3-b461-4339-83bd-02af4bad1f47 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:47.163654 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df77990-2baf-435f-9b42-20e83613c9ce admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:47.170598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3607c6-05a1-4081-be42-3afb87860d57 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d339ede543748369b67f29117a4be6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a91a22eae48436a9c1f7069b805d36c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:47.172075 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3607c6-05a1-4081-be42-3afb87860d57 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:47.173063 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3607c6-05a1-4081-be42-3afb87860d57 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:47.173843 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0aa7f-1d35-4f73-9643-5f690d40d612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:47.174219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3607c6-05a1-4081-be42-3afb87860d57 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:47.175582 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0aa7f-1d35-4f73-9643-5f690d40d612 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:47.175984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3607c6-05a1-4081-be42-3afb87860d57 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] RBAC: Adding query filter params (parent_id=695c8895a6ab40928f7d9d1c1af34850) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:32:47.176528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3607c6-05a1-4081-be42-3afb87860d57 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:47.176860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0aa7f-1d35-4f73-9643-5f690d40d612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:47.178992 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3607c6-05a1-4081-be42-3afb87860d57 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:47.179432 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0aa7f-1d35-4f73-9643-5f690d40d612 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:47.180332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0aa7f-1d35-4f73-9643-5f690d40d612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:47.182171 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0aa7f-1d35-4f73-9643-5f690d40d612 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:47.201699 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3747/7492] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:32:47.205301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0aa7f-1d35-4f73-9643-5f690d40d612 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:47.215902 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3746/7493] 10.222.0.30 () {58 vars in 1216 bytes} [Sun Sep 4 01:32:47 2022] GET /identity/v3/projects?parent_id=695c8895a6ab40928f7d9d1c1af34850 => generated 498 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:32:47.220737 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3607c6-05a1-4081-be42-3afb87860d57 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:47.231911 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0aa7f-1d35-4f73-9643-5f690d40d612 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:47.240391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ce07b-23a0-4b50-8f93-35aa799f32d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:47.241027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ce07b-23a0-4b50-8f93-35aa799f32d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:47.241168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3607c6-05a1-4081-be42-3afb87860d57 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:47.241388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ce07b-23a0-4b50-8f93-35aa799f32d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:47.241697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ce07b-23a0-4b50-8f93-35aa799f32d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:47.242399 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ce07b-23a0-4b50-8f93-35aa799f32d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:47.244010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ce07b-23a0-4b50-8f93-35aa799f32d8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:47.247667 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5b091-5649-4e43-a968-13a73e76437f tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d339ede543748369b67f29117a4be6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a91a22eae48436a9c1f7069b805d36c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:47.248586 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5b091-5649-4e43-a968-13a73e76437f tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:47.249062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5b091-5649-4e43-a968-13a73e76437f tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:47.249572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5b091-5649-4e43-a968-13a73e76437f tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] PATH_INFO: `/v3/projects/0b654cc171194778ac651383da7fc4aa` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:47.250919 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5b091-5649-4e43-a968-13a73e76437f tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0b654cc171194778ac651383da7fc4aa)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:47.253274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5b091-5649-4e43-a968-13a73e76437f tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:47.260692 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3748/7494] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:32:47.266393 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ce07b-23a0-4b50-8f93-35aa799f32d8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:47.287430 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ce07b-23a0-4b50-8f93-35aa799f32d8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:47.297327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22052a-e8fe-452f-8db0-05ec740cf1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:47.298277 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22052a-e8fe-452f-8db0-05ec740cf1ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:47.298664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22052a-e8fe-452f-8db0-05ec740cf1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:47.299517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22052a-e8fe-452f-8db0-05ec740cf1ad admin admin] PATH_INFO: `/v3/projects/31ad3698f2ef4c25acec9719f050e576/users/7a016f2cc82e42fb875c65ecb513c08e/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:47.320884 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af22052a-e8fe-452f-8db0-05ec740cf1ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=31ad3698f2ef4c25acec9719f050e576, user_id=7a016f2cc82e42fb875c65ecb513c08e, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:47.324380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af22052a-e8fe-452f-8db0-05ec740cf1ad admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:47.342925 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:47.344815 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3749/7495] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:32:47 2022] PUT /identity/v3/projects/31ad3698f2ef4c25acec9719f050e576/users/7a016f2cc82e42fb875c65ecb513c08e/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:32:47.345139 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-65b5b091-5649-4e43-a968-13a73e76437f tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b654cc171194778ac651383da7fc4aa', 'request_id': 'req-65b5b091-5649-4e43-a968-13a73e76437f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:47.356749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a75133-77a2-4f75-9856-2043b7a13c47 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:47.357462 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a75133-77a2-4f75-9856-2043b7a13c47 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:47.357810 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a75133-77a2-4f75-9856-2043b7a13c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:47.359456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-65b5b091-5649-4e43-a968-13a73e76437f tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b654cc171194778ac651383da7fc4aa', 'request_id': 'req-65b5b091-5649-4e43-a968-13a73e76437f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:47.367704 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-65b5b091-5649-4e43-a968-13a73e76437f tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b654cc171194778ac651383da7fc4aa', 'request_id': 'req-65b5b091-5649-4e43-a968-13a73e76437f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:47.388898 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-65b5b091-5649-4e43-a968-13a73e76437f tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] The token cache is being invalidate because project 0b654cc171194778ac651383da7fc4aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:32:47.389463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-65b5b091-5649-4e43-a968-13a73e76437f tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:47.395773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-65b5b091-5649-4e43-a968-13a73e76437f tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:47.398662 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3747/7496] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:32:47 2022] DELETE /identity/v3/projects/0b654cc171194778ac651383da7fc4aa => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:47.403355 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5b091-5649-4e43-a968-13a73e76437f tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:47.405155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-65b5b091-5649-4e43-a968-13a73e76437f tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:47.421603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-70a75133-77a2-4f75-9856-2043b7a13c47 None None] MFA Rules not processed for user `7a016f2cc82e42fb875c65ecb513c08e`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:32:47.427442 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-70a75133-77a2-4f75-9856-2043b7a13c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:47.519602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5b091-5649-4e43-a968-13a73e76437f tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:47.540482 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3750/7497] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:32:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:32:47.541331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a75133-77a2-4f75-9856-2043b7a13c47 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:47.549034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-70a75133-77a2-4f75-9856-2043b7a13c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:47.605093 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c988b1-1a43-486a-b896-dcbf5a217a68 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d339ede543748369b67f29117a4be6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a91a22eae48436a9c1f7069b805d36c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:47.605605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c988b1-1a43-486a-b896-dcbf5a217a68 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:47.605892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c988b1-1a43-486a-b896-dcbf5a217a68 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:47.606800 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c988b1-1a43-486a-b896-dcbf5a217a68 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] PATH_INFO: `/v3/projects/695c8895a6ab40928f7d9d1c1af34850` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:47.611457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c988b1-1a43-486a-b896-dcbf5a217a68 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] RBAC: Authorizing `identity:delete_project(project_id=695c8895a6ab40928f7d9d1c1af34850)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:47.614874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c988b1-1a43-486a-b896-dcbf5a217a68 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:47.681814 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a75133-77a2-4f75-9856-2043b7a13c47 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:47.715309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-73c988b1-1a43-486a-b896-dcbf5a217a68 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '695c8895a6ab40928f7d9d1c1af34850', 'request_id': 'req-73c988b1-1a43-486a-b896-dcbf5a217a68'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:47.732589 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-73c988b1-1a43-486a-b896-dcbf5a217a68 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '695c8895a6ab40928f7d9d1c1af34850', 'request_id': 'req-73c988b1-1a43-486a-b896-dcbf5a217a68'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:47.746810 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-73c988b1-1a43-486a-b896-dcbf5a217a68 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '695c8895a6ab40928f7d9d1c1af34850', 'request_id': 'req-73c988b1-1a43-486a-b896-dcbf5a217a68'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:47.776257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-73c988b1-1a43-486a-b896-dcbf5a217a68 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] The token cache is being invalidate because project 695c8895a6ab40928f7d9d1c1af34850 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:32:47.778524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-73c988b1-1a43-486a-b896-dcbf5a217a68 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:47.780507 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-73c988b1-1a43-486a-b896-dcbf5a217a68 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:47.784626 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:47.785010 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3748/7498] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:32:47 2022] DELETE /identity/v3/projects/695c8895a6ab40928f7d9d1c1af34850 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:32:47.789652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c988b1-1a43-486a-b896-dcbf5a217a68 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:47.802416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-73c988b1-1a43-486a-b896-dcbf5a217a68 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:47.830212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609468d7-6388-43a2-9349-dbbb80b5ff64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:47.830879 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609468d7-6388-43a2-9349-dbbb80b5ff64 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:47.832219 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609468d7-6388-43a2-9349-dbbb80b5ff64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:47.832219 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609468d7-6388-43a2-9349-dbbb80b5ff64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:47.832704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609468d7-6388-43a2-9349-dbbb80b5ff64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:47.834661 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609468d7-6388-43a2-9349-dbbb80b5ff64 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:47.850025 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:47.901483 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3751/7499] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:32:47 2022] POST /identity/v3/projects => generated 363 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:32:47.904572 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609468d7-6388-43a2-9349-dbbb80b5ff64 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:47.906465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-609468d7-6388-43a2-9349-dbbb80b5ff64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:47.949187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c988b1-1a43-486a-b896-dcbf5a217a68 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:48.039937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609468d7-6388-43a2-9349-dbbb80b5ff64 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:48.051453 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e805b-7c6e-441a-91f9-365004838959 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d339ede543748369b67f29117a4be6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a91a22eae48436a9c1f7069b805d36c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:48.052721 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4bf939-8bfc-492d-8979-007fa14e32cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:48.053203 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e805b-7c6e-441a-91f9-365004838959 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:48.053350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bf939-8bfc-492d-8979-007fa14e32cc admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:48.053649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bf939-8bfc-492d-8979-007fa14e32cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:48.053919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bf939-8bfc-492d-8979-007fa14e32cc admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:48.054169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e805b-7c6e-441a-91f9-365004838959 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:48.054558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4bf939-8bfc-492d-8979-007fa14e32cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:48.054874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e805b-7c6e-441a-91f9-365004838959 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] PATH_INFO: `/v3/projects/3ccdead018a04048863c2665be10baab` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:48.056228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e805b-7c6e-441a-91f9-365004838959 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3ccdead018a04048863c2665be10baab)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:48.056469 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4bf939-8bfc-492d-8979-007fa14e32cc admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:48.060523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e805b-7c6e-441a-91f9-365004838959 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:48.107481 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3752/7500] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:32:47 2022] POST /identity/v3/users => generated 288 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:32:48.110365 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4bf939-8bfc-492d-8979-007fa14e32cc admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:48.130226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4bf939-8bfc-492d-8979-007fa14e32cc admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:48.146041 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-229e805b-7c6e-441a-91f9-365004838959 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ccdead018a04048863c2665be10baab', 'request_id': 'req-229e805b-7c6e-441a-91f9-365004838959'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:48.160365 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-229e805b-7c6e-441a-91f9-365004838959 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ccdead018a04048863c2665be10baab', 'request_id': 'req-229e805b-7c6e-441a-91f9-365004838959'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:48.169577 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-229e805b-7c6e-441a-91f9-365004838959 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ccdead018a04048863c2665be10baab', 'request_id': 'req-229e805b-7c6e-441a-91f9-365004838959'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:48.192225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-229e805b-7c6e-441a-91f9-365004838959 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] The token cache is being invalidate because project 3ccdead018a04048863c2665be10baab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:32:48.192822 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-229e805b-7c6e-441a-91f9-365004838959 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:48.193546 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-229e805b-7c6e-441a-91f9-365004838959 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:48.196110 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3749/7501] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:32:47 2022] DELETE /identity/v3/projects/3ccdead018a04048863c2665be10baab => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:48.201520 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e805b-7c6e-441a-91f9-365004838959 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:48.202923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-229e805b-7c6e-441a-91f9-365004838959 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:48.240662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cfd83-eee1-4803-ac08-f264979de6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:48.242192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cfd83-eee1-4803-ac08-f264979de6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:48.242482 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cfd83-eee1-4803-ac08-f264979de6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:48.242779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cfd83-eee1-4803-ac08-f264979de6e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:48.243453 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786cfd83-eee1-4803-ac08-f264979de6e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:48.250172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786cfd83-eee1-4803-ac08-f264979de6e2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:48.265497 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3753/7502] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:32:48.270033 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cfd83-eee1-4803-ac08-f264979de6e2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:48.273474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-786cfd83-eee1-4803-ac08-f264979de6e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:48.288166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cfd83-eee1-4803-ac08-f264979de6e2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:48.296068 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680cc8ce-61f3-48ec-96f1-50a1cc1b3072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:48.296789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cc8ce-61f3-48ec-96f1-50a1cc1b3072 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:48.297133 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cc8ce-61f3-48ec-96f1-50a1cc1b3072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:48.297513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cc8ce-61f3-48ec-96f1-50a1cc1b3072 admin admin] PATH_INFO: `/v3/projects/e29ac7ad8d3c408e8e97b49dce5916b5/users/46d9673f95074bb987d08205b135b851/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:48.309618 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:48.332601 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680cc8ce-61f3-48ec-96f1-50a1cc1b3072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e29ac7ad8d3c408e8e97b49dce5916b5, user_id=46d9673f95074bb987d08205b135b851, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:48.335907 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680cc8ce-61f3-48ec-96f1-50a1cc1b3072 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:48.336588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e805b-7c6e-441a-91f9-365004838959 tempest-ListProjectsTestJSON-1270637158 tempest-ListProjectsTestJSON-1270637158-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:48.352066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee421fe-119e-471e-9e0e-0825df8bc9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:48.352716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee421fe-119e-471e-9e0e-0825df8bc9cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:48.353111 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee421fe-119e-471e-9e0e-0825df8bc9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:48.353526 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee421fe-119e-471e-9e0e-0825df8bc9cb admin admin] PATH_INFO: `/v3/users/620463544b274e9196e48b581aa490e0` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:48.355133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee421fe-119e-471e-9e0e-0825df8bc9cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=620463544b274e9196e48b581aa490e0)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:48.357727 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee421fe-119e-471e-9e0e-0825df8bc9cb admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:48.392800 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3754/7503] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:32:48 2022] PUT /identity/v3/projects/e29ac7ad8d3c408e8e97b49dce5916b5/users/46d9673f95074bb987d08205b135b851/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:32:48.395325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680cc8ce-61f3-48ec-96f1-50a1cc1b3072 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:48.465414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dee421fe-119e-471e-9e0e-0825df8bc9cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '620463544b274e9196e48b581aa490e0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:48.473986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dee421fe-119e-471e-9e0e-0825df8bc9cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '620463544b274e9196e48b581aa490e0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:48.482133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dee421fe-119e-471e-9e0e-0825df8bc9cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '620463544b274e9196e48b581aa490e0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:48.495390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dee421fe-119e-471e-9e0e-0825df8bc9cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '620463544b274e9196e48b581aa490e0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:48.497840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-dee421fe-119e-471e-9e0e-0825df8bc9cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '620463544b274e9196e48b581aa490e0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:48.508270 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:48.527870 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3750/7504] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:32:48 2022] DELETE /identity/v3/users/620463544b274e9196e48b581aa490e0 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:32:48.536424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adfc29-fe33-4ced-8ac6-86dc6c276f53 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:48.536729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adfc29-fe33-4ced-8ac6-86dc6c276f53 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:48.539214 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adfc29-fe33-4ced-8ac6-86dc6c276f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:48.568813 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680cc8ce-61f3-48ec-96f1-50a1cc1b3072 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:48.594988 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-22adfc29-fe33-4ced-8ac6-86dc6c276f53 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:32:48.596936 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-22adfc29-fe33-4ced-8ac6-86dc6c276f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:48.687588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdbe99-12fd-4a8c-ae00-d84115468513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:48.688351 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdbe99-12fd-4a8c-ae00-d84115468513 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:48.688885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdbe99-12fd-4a8c-ae00-d84115468513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:48.690413 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdbe99-12fd-4a8c-ae00-d84115468513 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:48.691156 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fdbe99-12fd-4a8c-ae00-d84115468513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:48.694110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fdbe99-12fd-4a8c-ae00-d84115468513 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:48.703758 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3751/7505] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:32:48.713780 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3755/7506] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:32:48.718182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22adfc29-fe33-4ced-8ac6-86dc6c276f53 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:48.720554 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-22adfc29-fe33-4ced-8ac6-86dc6c276f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:48.726521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdbe99-12fd-4a8c-ae00-d84115468513 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:48.737015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22adfc29-fe33-4ced-8ac6-86dc6c276f53 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:48.737882 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a0fdbe99-12fd-4a8c-ae00-d84115468513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:48.746247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e19069-695e-4ead-be03-507217dc9d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:48.747229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e19069-695e-4ead-be03-507217dc9d86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:48.747626 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e19069-695e-4ead-be03-507217dc9d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:48.747965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e19069-695e-4ead-be03-507217dc9d86 admin admin] PATH_INFO: `/v3/projects/e29ac7ad8d3c408e8e97b49dce5916b5/users/46d9673f95074bb987d08205b135b851/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:48.751247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e19069-695e-4ead-be03-507217dc9d86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e29ac7ad8d3c408e8e97b49dce5916b5, user_id=46d9673f95074bb987d08205b135b851, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:48.754185 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e19069-695e-4ead-be03-507217dc9d86 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:48.780836 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3752/7507] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:32:48 2022] PUT /identity/v3/projects/e29ac7ad8d3c408e8e97b49dce5916b5/users/46d9673f95074bb987d08205b135b851/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:48.782400 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa27e4a-d3c8-4877-b7f3-f841756ff80d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:48.782684 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa27e4a-d3c8-4877-b7f3-f841756ff80d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:48.782959 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa27e4a-d3c8-4877-b7f3-f841756ff80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:48.838554 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-eaa27e4a-d3c8-4877-b7f3-f841756ff80d None None] MFA Rules not processed for user `46d9673f95074bb987d08205b135b851`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:32:48.841268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-eaa27e4a-d3c8-4877-b7f3-f841756ff80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:48.894093 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdbe99-12fd-4a8c-ae00-d84115468513 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:48.949243 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:48.976427 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d9c3a-592c-4390-aa75-7affba1213df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:48.977142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d9c3a-592c-4390-aa75-7affba1213df service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:48.977697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d9c3a-592c-4390-aa75-7affba1213df service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:48.978105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d9c3a-592c-4390-aa75-7affba1213df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:48.987857 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3753/7508] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:32:48 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:32:48.999842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa27e4a-d3c8-4877-b7f3-f841756ff80d None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:49.003401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-eaa27e4a-d3c8-4877-b7f3-f841756ff80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:49.080071 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:49.107986 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d9c3a-592c-4390-aa75-7affba1213df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:49.109713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d9c3a-592c-4390-aa75-7affba1213df service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:49.110511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa27e4a-d3c8-4877-b7f3-f841756ff80d None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:49.117748 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ccbe4b-ab97-4f4f-821d-3bea909577f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:49.118448 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccbe4b-ab97-4f4f-821d-3bea909577f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:49.118729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccbe4b-ab97-4f4f-821d-3bea909577f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:49.119375 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccbe4b-ab97-4f4f-821d-3bea909577f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:49.134599 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3756/7509] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:32:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:32:49.153506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ccbe4b-ab97-4f4f-821d-3bea909577f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:49.154977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ccbe4b-ab97-4f4f-821d-3bea909577f6 service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:49.190582 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3754/7510] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:32:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:32:49.967828 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d9c3a-592c-4390-aa75-7affba1213df service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:49.985315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d9c3a-592c-4390-aa75-7affba1213df service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:49.992473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97022366-fda4-4708-9319-1aa0e8a021c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:49.993266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97022366-fda4-4708-9319-1aa0e8a021c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:49.993769 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97022366-fda4-4708-9319-1aa0e8a021c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:49.994152 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97022366-fda4-4708-9319-1aa0e8a021c9 admin admin] PATH_INFO: `/v3/users/7a016f2cc82e42fb875c65ecb513c08e` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:49.995478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97022366-fda4-4708-9319-1aa0e8a021c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a016f2cc82e42fb875c65ecb513c08e)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:49.999202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97022366-fda4-4708-9319-1aa0e8a021c9 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:50.063359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-97022366-fda4-4708-9319-1aa0e8a021c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a016f2cc82e42fb875c65ecb513c08e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:50.064790 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-97022366-fda4-4708-9319-1aa0e8a021c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a016f2cc82e42fb875c65ecb513c08e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:50.075521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-97022366-fda4-4708-9319-1aa0e8a021c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a016f2cc82e42fb875c65ecb513c08e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:50.087350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-97022366-fda4-4708-9319-1aa0e8a021c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a016f2cc82e42fb875c65ecb513c08e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:50.088192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-97022366-fda4-4708-9319-1aa0e8a021c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a016f2cc82e42fb875c65ecb513c08e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:50.134904 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3757/7511] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:32:49 2022] DELETE /identity/v3/users/7a016f2cc82e42fb875c65ecb513c08e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:50.136480 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd6880-d835-4750-8a51-0c504ed92e83 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:50.138099 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd6880-d835-4750-8a51-0c504ed92e83 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:50.138586 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd6880-d835-4750-8a51-0c504ed92e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:50.180666 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-abfd6880-d835-4750-8a51-0c504ed92e83 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:32:50.182851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-abfd6880-d835-4750-8a51-0c504ed92e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:50.194280 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97022366-fda4-4708-9319-1aa0e8a021c9 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:50.196010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-97022366-fda4-4708-9319-1aa0e8a021c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:50.291416 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3755/7512] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:32:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:32:50.306813 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd6880-d835-4750-8a51-0c504ed92e83 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:50.308819 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-abfd6880-d835-4750-8a51-0c504ed92e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:50.359026 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97022366-fda4-4708-9319-1aa0e8a021c9 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:50.372880 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c957a48-5754-4f34-94c7-a2a65e801a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:50.374056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c957a48-5754-4f34-94c7-a2a65e801a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:50.375532 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c957a48-5754-4f34-94c7-a2a65e801a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:50.376643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c957a48-5754-4f34-94c7-a2a65e801a2a admin admin] PATH_INFO: `/v3/projects/a9a1ba8202d64df386261ea4a7a2d5b3` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:50.379522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c957a48-5754-4f34-94c7-a2a65e801a2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9a1ba8202d64df386261ea4a7a2d5b3)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:50.382405 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c957a48-5754-4f34-94c7-a2a65e801a2a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:50.424740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd6880-d835-4750-8a51-0c504ed92e83 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:50.436990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c495c-1023-4a33-9b69-d9a898bedf71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:50.438812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c495c-1023-4a33-9b69-d9a898bedf71 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:50.439097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c495c-1023-4a33-9b69-d9a898bedf71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:50.440710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c495c-1023-4a33-9b69-d9a898bedf71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:50.467628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c495c-1023-4a33-9b69-d9a898bedf71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:50.472570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c495c-1023-4a33-9b69-d9a898bedf71 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:50.478007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0c957a48-5754-4f34-94c7-a2a65e801a2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9a1ba8202d64df386261ea4a7a2d5b3', 'request_id': 'req-0c957a48-5754-4f34-94c7-a2a65e801a2a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:50.492532 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3756/7513] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:32:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:32:50.497228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0c957a48-5754-4f34-94c7-a2a65e801a2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9a1ba8202d64df386261ea4a7a2d5b3', 'request_id': 'req-0c957a48-5754-4f34-94c7-a2a65e801a2a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:50.502413 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:50.506203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0c957a48-5754-4f34-94c7-a2a65e801a2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9a1ba8202d64df386261ea4a7a2d5b3', 'request_id': 'req-0c957a48-5754-4f34-94c7-a2a65e801a2a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:50.523915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0c957a48-5754-4f34-94c7-a2a65e801a2a admin admin] The token cache is being invalidate because project a9a1ba8202d64df386261ea4a7a2d5b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:32:50.524203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0c957a48-5754-4f34-94c7-a2a65e801a2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:50.525762 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0c957a48-5754-4f34-94c7-a2a65e801a2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:50.530633 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3758/7514] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:32:50 2022] DELETE /identity/v3/projects/a9a1ba8202d64df386261ea4a7a2d5b3 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:50.531807 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c495c-1023-4a33-9b69-d9a898bedf71 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:50.543828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c495c-1023-4a33-9b69-d9a898bedf71 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:50.573402 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:50.619996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5578c39-25f1-4e92-9d90-3575d1c85a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:50.621203 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5578c39-25f1-4e92-9d90-3575d1c85a0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:50.624352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5578c39-25f1-4e92-9d90-3575d1c85a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:50.624786 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5578c39-25f1-4e92-9d90-3575d1c85a0c admin admin] PATH_INFO: `/v3/users/3d339ede543748369b67f29117a4be6c` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:50.627506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5578c39-25f1-4e92-9d90-3575d1c85a0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d339ede543748369b67f29117a4be6c)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:50.635351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5578c39-25f1-4e92-9d90-3575d1c85a0c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:50.730285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d5578c39-25f1-4e92-9d90-3575d1c85a0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d339ede543748369b67f29117a4be6c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:50.731805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d5578c39-25f1-4e92-9d90-3575d1c85a0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d339ede543748369b67f29117a4be6c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:50.741973 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d5578c39-25f1-4e92-9d90-3575d1c85a0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d339ede543748369b67f29117a4be6c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:50.754425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d5578c39-25f1-4e92-9d90-3575d1c85a0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d339ede543748369b67f29117a4be6c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:50.755385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d5578c39-25f1-4e92-9d90-3575d1c85a0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d339ede543748369b67f29117a4be6c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:50.783926 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3757/7515] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:32:50 2022] DELETE /identity/v3/users/3d339ede543748369b67f29117a4be6c => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:51.584194 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c957a48-5754-4f34-94c7-a2a65e801a2a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:51.586165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0c957a48-5754-4f34-94c7-a2a65e801a2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:51.592467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5578c39-25f1-4e92-9d90-3575d1c85a0c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:51.594027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d5578c39-25f1-4e92-9d90-3575d1c85a0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:51.607049 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c957a48-5754-4f34-94c7-a2a65e801a2a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:51.736070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5578c39-25f1-4e92-9d90-3575d1c85a0c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:51.736425 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91ec7b-7b0e-4ebd-940e-fcf3746c7b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:51.736991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91ec7b-7b0e-4ebd-940e-fcf3746c7b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:51.737267 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91ec7b-7b0e-4ebd-940e-fcf3746c7b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:51.737564 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91ec7b-7b0e-4ebd-940e-fcf3746c7b30 admin admin] PATH_INFO: `/v3/projects/4a91a22eae48436a9c1f7069b805d36c` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:51.740125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b91ec7b-7b0e-4ebd-940e-fcf3746c7b30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a91a22eae48436a9c1f7069b805d36c)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:51.742325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b91ec7b-7b0e-4ebd-940e-fcf3746c7b30 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:51.743412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ea3de-201e-4fc8-b517-8c1dcf149679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:51.744595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ea3de-201e-4fc8-b517-8c1dcf149679 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:51.745095 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ea3de-201e-4fc8-b517-8c1dcf149679 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:51.746387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ea3de-201e-4fc8-b517-8c1dcf149679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:51.749068 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-630ea3de-201e-4fc8-b517-8c1dcf149679 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:51.768995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630ea3de-201e-4fc8-b517-8c1dcf149679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:51.773450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630ea3de-201e-4fc8-b517-8c1dcf149679 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:51.790362 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3758/7516] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:32:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:32:51.819944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1b91ec7b-7b0e-4ebd-940e-fcf3746c7b30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a91a22eae48436a9c1f7069b805d36c', 'request_id': 'req-1b91ec7b-7b0e-4ebd-940e-fcf3746c7b30'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:51.829117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1b91ec7b-7b0e-4ebd-940e-fcf3746c7b30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a91a22eae48436a9c1f7069b805d36c', 'request_id': 'req-1b91ec7b-7b0e-4ebd-940e-fcf3746c7b30'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:51.843312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1b91ec7b-7b0e-4ebd-940e-fcf3746c7b30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a91a22eae48436a9c1f7069b805d36c', 'request_id': 'req-1b91ec7b-7b0e-4ebd-940e-fcf3746c7b30'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:51.866830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1b91ec7b-7b0e-4ebd-940e-fcf3746c7b30 admin admin] The token cache is being invalidate because project 4a91a22eae48436a9c1f7069b805d36c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:32:51.867690 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1b91ec7b-7b0e-4ebd-940e-fcf3746c7b30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:51.869944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1b91ec7b-7b0e-4ebd-940e-fcf3746c7b30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:51.882481 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3827a-1a29-49ed-9ac9-6199c1474810 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:51.884368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3827a-1a29-49ed-9ac9-6199c1474810 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:51.885322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3827a-1a29-49ed-9ac9-6199c1474810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:51.895789 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3759/7517] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:32:51 2022] DELETE /identity/v3/projects/4a91a22eae48436a9c1f7069b805d36c => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:51.928923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-5bb3827a-1a29-49ed-9ac9-6199c1474810 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:32:51.930381 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5bb3827a-1a29-49ed-9ac9-6199c1474810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:51.997324 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:52.030224 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba13964-29e6-45c2-acad-d71460a8f99c None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:52.030489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba13964-29e6-45c2-acad-d71460a8f99c None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:52.030771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba13964-29e6-45c2-acad-d71460a8f99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:52.031176 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3759/7518] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:32:52.072942 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3827a-1a29-49ed-9ac9-6199c1474810 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:52.074912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5bb3827a-1a29-49ed-9ac9-6199c1474810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:52.084727 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-2ba13964-29e6-45c2-acad-d71460a8f99c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:32:52.087443 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2ba13964-29e6-45c2-acad-d71460a8f99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:52.119699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3827a-1a29-49ed-9ac9-6199c1474810 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:52.137364 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3760/7519] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:32:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:32:52.145627 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba13964-29e6-45c2-acad-d71460a8f99c None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:52.149314 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3f5b8-c0b0-4fae-b70d-2679f8d1b12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:52.150202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3f5b8-c0b0-4fae-b70d-2679f8d1b12e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:52.150653 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3f5b8-c0b0-4fae-b70d-2679f8d1b12e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:52.151501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3f5b8-c0b0-4fae-b70d-2679f8d1b12e admin admin] PATH_INFO: `/v3/projects/31ad3698f2ef4c25acec9719f050e576` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:52.154664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3f5b8-c0b0-4fae-b70d-2679f8d1b12e admin admin] RBAC: Authorizing `identity:delete_project(project_id=31ad3698f2ef4c25acec9719f050e576)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:52.157227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3f5b8-c0b0-4fae-b70d-2679f8d1b12e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:52.170904 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba13964-29e6-45c2-acad-d71460a8f99c None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:52.182698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8bb3eb-1e4d-4cf1-952f-0186749868e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:52.184721 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bb3eb-1e4d-4cf1-952f-0186749868e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:52.186022 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bb3eb-1e4d-4cf1-952f-0186749868e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:52.186322 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bb3eb-1e4d-4cf1-952f-0186749868e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:52.188970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8bb3eb-1e4d-4cf1-952f-0186749868e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:32:52.189458 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8bb3eb-1e4d-4cf1-952f-0186749868e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:52.191095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8bb3eb-1e4d-4cf1-952f-0186749868e4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:52.259187 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3761/7520] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:32:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:32:52.260445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8bb3eb-1e4d-4cf1-952f-0186749868e4 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:52.297269 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8bb3eb-1e4d-4cf1-952f-0186749868e4 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:52.321279 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-20c3f5b8-c0b0-4fae-b70d-2679f8d1b12e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31ad3698f2ef4c25acec9719f050e576', 'request_id': 'req-20c3f5b8-c0b0-4fae-b70d-2679f8d1b12e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:52.344026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-20c3f5b8-c0b0-4fae-b70d-2679f8d1b12e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31ad3698f2ef4c25acec9719f050e576', 'request_id': 'req-20c3f5b8-c0b0-4fae-b70d-2679f8d1b12e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:52.354066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-20c3f5b8-c0b0-4fae-b70d-2679f8d1b12e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31ad3698f2ef4c25acec9719f050e576', 'request_id': 'req-20c3f5b8-c0b0-4fae-b70d-2679f8d1b12e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:52.412938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-20c3f5b8-c0b0-4fae-b70d-2679f8d1b12e admin admin] The token cache is being invalidate because project 31ad3698f2ef4c25acec9719f050e576 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:32:52.413962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-20c3f5b8-c0b0-4fae-b70d-2679f8d1b12e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:52.416632 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-20c3f5b8-c0b0-4fae-b70d-2679f8d1b12e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:52.420941 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3760/7521] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:32:52 2022] DELETE /identity/v3/projects/31ad3698f2ef4c25acec9719f050e576 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:52.424487 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3f5b8-c0b0-4fae-b70d-2679f8d1b12e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:52.430805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-20c3f5b8-c0b0-4fae-b70d-2679f8d1b12e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:52.508880 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0c2e9-e9ea-42de-9a69-352872132954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:52.509541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0c2e9-e9ea-42de-9a69-352872132954 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:52.509821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0c2e9-e9ea-42de-9a69-352872132954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:52.510092 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0c2e9-e9ea-42de-9a69-352872132954 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:52.510885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0c2e9-e9ea-42de-9a69-352872132954 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:52.528648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0c2e9-e9ea-42de-9a69-352872132954 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:52.540193 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:52.606873 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3762/7522] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:32:52 2022] POST /identity/v3/projects => generated 375 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:32:52.611471 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0c2e9-e9ea-42de-9a69-352872132954 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:52.611994 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3f5b8-c0b0-4fae-b70d-2679f8d1b12e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:52.618563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5cb0c2e9-e9ea-42de-9a69-352872132954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:52.734663 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0c2e9-e9ea-42de-9a69-352872132954 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:52.749099 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46615fbb-5d30-4ebc-a931-228815377df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:52.749778 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46615fbb-5d30-4ebc-a931-228815377df3 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:52.750177 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46615fbb-5d30-4ebc-a931-228815377df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:52.750339 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46615fbb-5d30-4ebc-a931-228815377df3 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:52.750979 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46615fbb-5d30-4ebc-a931-228815377df3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:52.753426 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46615fbb-5d30-4ebc-a931-228815377df3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:52.777199 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7d4b5-7255-4b50-9ff8-ccb42a0fd51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:52.777763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7d4b5-7255-4b50-9ff8-ccb42a0fd51b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:52.778145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7d4b5-7255-4b50-9ff8-ccb42a0fd51b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:52.778526 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7d4b5-7255-4b50-9ff8-ccb42a0fd51b admin admin] PATH_INFO: `/v3/users/46d9673f95074bb987d08205b135b851` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:52.781921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d7d4b5-7255-4b50-9ff8-ccb42a0fd51b admin admin] RBAC: Authorizing `identity:delete_user(user_id=46d9673f95074bb987d08205b135b851)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:52.784004 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d7d4b5-7255-4b50-9ff8-ccb42a0fd51b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:52.838437 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3763/7523] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:32:52 2022] POST /identity/v3/users => generated 288 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:32:52.842009 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:52.842196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46615fbb-5d30-4ebc-a931-228815377df3 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:52.863244 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46615fbb-5d30-4ebc-a931-228815377df3 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:52.875858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7f60f-7498-4c4d-9014-863a872e96f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:52.876528 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7f60f-7498-4c4d-9014-863a872e96f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:52.876819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7f60f-7498-4c4d-9014-863a872e96f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:52.877205 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7f60f-7498-4c4d-9014-863a872e96f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:52.877748 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7f60f-7498-4c4d-9014-863a872e96f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:52.879396 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7f60f-7498-4c4d-9014-863a872e96f0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:52.899842 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3764/7524] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:32:52.902524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b1d7d4b5-7255-4b50-9ff8-ccb42a0fd51b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46d9673f95074bb987d08205b135b851'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:52.903334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b1d7d4b5-7255-4b50-9ff8-ccb42a0fd51b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46d9673f95074bb987d08205b135b851'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:52.903508 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7f60f-7498-4c4d-9014-863a872e96f0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:52.907213 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-adf7f60f-7498-4c4d-9014-863a872e96f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:52.916337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b1d7d4b5-7255-4b50-9ff8-ccb42a0fd51b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46d9673f95074bb987d08205b135b851'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:52.943447 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b1d7d4b5-7255-4b50-9ff8-ccb42a0fd51b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46d9673f95074bb987d08205b135b851'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:52.945298 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b1d7d4b5-7255-4b50-9ff8-ccb42a0fd51b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46d9673f95074bb987d08205b135b851'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:52.962017 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7f60f-7498-4c4d-9014-863a872e96f0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:52.977398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a949f81-2a19-46b1-b8dc-94a0883441f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:52.978054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a949f81-2a19-46b1-b8dc-94a0883441f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:52.978333 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a949f81-2a19-46b1-b8dc-94a0883441f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:52.978595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a949f81-2a19-46b1-b8dc-94a0883441f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:52.979233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a949f81-2a19-46b1-b8dc-94a0883441f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:52.980936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a949f81-2a19-46b1-b8dc-94a0883441f4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:53.019966 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3761/7525] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:32:52 2022] DELETE /identity/v3/users/46d9673f95074bb987d08205b135b851 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:53.022937 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3765/7526] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:32:53.034547 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7d4b5-7255-4b50-9ff8-ccb42a0fd51b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:53.185925 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7d4b5-7255-4b50-9ff8-ccb42a0fd51b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:53.197915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c430681-4bf3-4b05-b495-b09a0b2c6e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:53.198343 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c430681-4bf3-4b05-b495-b09a0b2c6e32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:53.198761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c430681-4bf3-4b05-b495-b09a0b2c6e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:53.198995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c430681-4bf3-4b05-b495-b09a0b2c6e32 admin admin] PATH_INFO: `/v3/projects/bfe488b56410464cbd3bdd85b3682304/users/454fe7d10c784923874f11f4ccd0e4c5/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:53.234856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c430681-4bf3-4b05-b495-b09a0b2c6e32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfe488b56410464cbd3bdd85b3682304, user_id=454fe7d10c784923874f11f4ccd0e4c5, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:53.239049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c430681-4bf3-4b05-b495-b09a0b2c6e32 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:53.272651 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3762/7527] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:32:53 2022] PUT /identity/v3/projects/bfe488b56410464cbd3bdd85b3682304/users/454fe7d10c784923874f11f4ccd0e4c5/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:53.393367 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1946aa0-b92d-468f-bc55-546294ab466c None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:53.393694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1946aa0-b92d-468f-bc55-546294ab466c None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:53.393981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1946aa0-b92d-468f-bc55-546294ab466c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:53.428235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a1946aa0-b92d-468f-bc55-546294ab466c None None] MFA Rules not processed for user `454fe7d10c784923874f11f4ccd0e4c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:32:53.430449 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a1946aa0-b92d-468f-bc55-546294ab466c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:53.553129 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3766/7528] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:32:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:32:53.558708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c430681-4bf3-4b05-b495-b09a0b2c6e32 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:53.708306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c430681-4bf3-4b05-b495-b09a0b2c6e32 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:53.718681 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e73c34-dd25-47a1-acd6-a125f4d86274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:53.719934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e73c34-dd25-47a1-acd6-a125f4d86274 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:53.723093 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e73c34-dd25-47a1-acd6-a125f4d86274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:53.723844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e73c34-dd25-47a1-acd6-a125f4d86274 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:53.724959 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e73c34-dd25-47a1-acd6-a125f4d86274 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:53.728936 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e73c34-dd25-47a1-acd6-a125f4d86274 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:53.785260 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3763/7529] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:32:53 2022] POST /identity/v3/projects => generated 377 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:32:53.786574 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1946aa0-b92d-468f-bc55-546294ab466c None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:53.806919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1946aa0-b92d-468f-bc55-546294ab466c None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:53.895244 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:53.936294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0571b6-eddc-4c9c-90b4-62f3aa8782d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:53.936950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0571b6-eddc-4c9c-90b4-62f3aa8782d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:53.937239 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0571b6-eddc-4c9c-90b4-62f3aa8782d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:53.937536 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0571b6-eddc-4c9c-90b4-62f3aa8782d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:53.938178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0571b6-eddc-4c9c-90b4-62f3aa8782d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:53.940219 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0571b6-eddc-4c9c-90b4-62f3aa8782d3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:54.015593 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3767/7530] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:32:53 2022] POST /identity/v3/users => generated 295 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:32:54.016887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e73c34-dd25-47a1-acd6-a125f4d86274 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:54.033541 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e73c34-dd25-47a1-acd6-a125f4d86274 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:54.051584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a34e84-7304-4b03-bf17-865713f2ce21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:54.052223 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a34e84-7304-4b03-bf17-865713f2ce21 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:54.052501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a34e84-7304-4b03-bf17-865713f2ce21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:54.052768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a34e84-7304-4b03-bf17-865713f2ce21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:54.053415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a34e84-7304-4b03-bf17-865713f2ce21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:54.055069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a34e84-7304-4b03-bf17-865713f2ce21 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:54.062894 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:54.091019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0571b6-eddc-4c9c-90b4-62f3aa8782d3 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:54.096185 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3764/7531] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:32:54.102966 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0571b6-eddc-4c9c-90b4-62f3aa8782d3 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:54.117347 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902107b-dea0-476d-9ce4-0f5da4b4a099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:54.118056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902107b-dea0-476d-9ce4-0f5da4b4a099 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:54.118331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902107b-dea0-476d-9ce4-0f5da4b4a099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:54.118667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902107b-dea0-476d-9ce4-0f5da4b4a099 admin admin] PATH_INFO: `/v3/projects/a77f2ec3ef544336b2c3909f1f77de04/users/dfb8bfcc56364268a6a2c8acb72c2643/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:54.162084 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7902107b-dea0-476d-9ce4-0f5da4b4a099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a77f2ec3ef544336b2c3909f1f77de04, user_id=dfb8bfcc56364268a6a2c8acb72c2643, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:54.181483 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7902107b-dea0-476d-9ce4-0f5da4b4a099 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:54.196401 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3768/7532] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:32:54 2022] PUT /identity/v3/projects/a77f2ec3ef544336b2c3909f1f77de04/users/dfb8bfcc56364268a6a2c8acb72c2643/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:32:54.200739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a34e84-7304-4b03-bf17-865713f2ce21 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:54.213999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a34e84-7304-4b03-bf17-865713f2ce21 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:54.342941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f94bd-2fe4-465a-bef4-002a3862b85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:54.343938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f94bd-2fe4-465a-bef4-002a3862b85c admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:54.344415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f94bd-2fe4-465a-bef4-002a3862b85c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:54.344850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f94bd-2fe4-465a-bef4-002a3862b85c admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:54.345961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f94bd-2fe4-465a-bef4-002a3862b85c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:54.349370 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f94bd-2fe4-465a-bef4-002a3862b85c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:54.376695 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3765/7533] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:32:54.381247 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902107b-dea0-476d-9ce4-0f5da4b4a099 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:54.397378 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902107b-dea0-476d-9ce4-0f5da4b4a099 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:54.412132 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89b2c5-8add-458a-b4b2-f7cdf369df2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:54.412826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89b2c5-8add-458a-b4b2-f7cdf369df2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:54.413107 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89b2c5-8add-458a-b4b2-f7cdf369df2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:54.413957 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89b2c5-8add-458a-b4b2-f7cdf369df2a admin admin] PATH_INFO: `/v3/projects/a77f2ec3ef544336b2c3909f1f77de04/users/dfb8bfcc56364268a6a2c8acb72c2643/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:54.415604 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa89b2c5-8add-458a-b4b2-f7cdf369df2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a77f2ec3ef544336b2c3909f1f77de04, user_id=dfb8bfcc56364268a6a2c8acb72c2643, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:54.419923 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa89b2c5-8add-458a-b4b2-f7cdf369df2a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:54.455475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64db61-f23f-4ab8-a69e-85ae1e0ed568 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:54.455695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64db61-f23f-4ab8-a69e-85ae1e0ed568 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:54.455982 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64db61-f23f-4ab8-a69e-85ae1e0ed568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:54.458800 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3769/7534] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:32:54 2022] PUT /identity/v3/projects/a77f2ec3ef544336b2c3909f1f77de04/users/dfb8bfcc56364268a6a2c8acb72c2643/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:54.493002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-eb64db61-f23f-4ab8-a69e-85ae1e0ed568 None None] MFA Rules not processed for user `dfb8bfcc56364268a6a2c8acb72c2643`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:32:54.494333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-eb64db61-f23f-4ab8-a69e-85ae1e0ed568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:54.584193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89b2c5-8add-458a-b4b2-f7cdf369df2a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:54.586673 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-fa89b2c5-8add-458a-b4b2-f7cdf369df2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:54.617086 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3766/7535] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:32:54 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:32:54.623672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64db61-f23f-4ab8-a69e-85ae1e0ed568 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:54.643084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64db61-f23f-4ab8-a69e-85ae1e0ed568 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:54.656049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5fff9-1a6c-44a7-8f1a-38e7d8f9cd7d tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfb8bfcc56364268a6a2c8acb72c2643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77f2ec3ef544336b2c3909f1f77de04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:54.657686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5fff9-1a6c-44a7-8f1a-38e7d8f9cd7d tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:54.658884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5fff9-1a6c-44a7-8f1a-38e7d8f9cd7d tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:54.659326 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5fff9-1a6c-44a7-8f1a-38e7d8f9cd7d tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:54.660117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5fff9-1a6c-44a7-8f1a-38e7d8f9cd7d tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:54.662769 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-dbc5fff9-1a6c-44a7-8f1a-38e7d8f9cd7d tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:32:54.662769 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:32:54.662769 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:32:54.664297 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5fff9-1a6c-44a7-8f1a-38e7d8f9cd7d tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:54.701070 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3767/7536] 10.222.0.30 () {60 vars in 1185 bytes} [Sun Sep 4 01:32:54 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:32:54.702560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5fff9-1a6c-44a7-8f1a-38e7d8f9cd7d tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:54.726747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5fff9-1a6c-44a7-8f1a-38e7d8f9cd7d tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:54.733968 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85858d2a-9124-41e1-bc09-ab7d7b4b3d97 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfb8bfcc56364268a6a2c8acb72c2643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77f2ec3ef544336b2c3909f1f77de04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:54.734766 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85858d2a-9124-41e1-bc09-ab7d7b4b3d97 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:54.735193 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85858d2a-9124-41e1-bc09-ab7d7b4b3d97 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:54.735577 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85858d2a-9124-41e1-bc09-ab7d7b4b3d97 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/e6468db7be5b480eae2a17b02f855508` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:54.736543 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85858d2a-9124-41e1-bc09-ab7d7b4b3d97 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=e6468db7be5b480eae2a17b02f855508)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:54.737830 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-85858d2a-9124-41e1-bc09-ab7d7b4b3d97 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:32:54.737830 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:32:54.737830 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:32:54.739006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85858d2a-9124-41e1-bc09-ab7d7b4b3d97 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:54.743537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89b2c5-8add-458a-b4b2-f7cdf369df2a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:54.756558 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3768/7537] 10.222.0.30 () {58 vars in 1263 bytes} [Sun Sep 4 01:32:54 2022] GET /identity/v3/OS-OAUTH1/consumers/e6468db7be5b480eae2a17b02f855508 => generated 221 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:32:54.756780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14748ce-8669-4e23-99ec-f8b7ef2ed494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:54.756780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14748ce-8669-4e23-99ec-f8b7ef2ed494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:54.756780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14748ce-8669-4e23-99ec-f8b7ef2ed494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:54.756780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14748ce-8669-4e23-99ec-f8b7ef2ed494 admin admin] PATH_INFO: `/v3/projects/e29ac7ad8d3c408e8e97b49dce5916b5` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:54.757196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14748ce-8669-4e23-99ec-f8b7ef2ed494 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e29ac7ad8d3c408e8e97b49dce5916b5)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:54.758955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14748ce-8669-4e23-99ec-f8b7ef2ed494 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:54.759509 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85858d2a-9124-41e1-bc09-ab7d7b4b3d97 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:54.779221 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85858d2a-9124-41e1-bc09-ab7d7b4b3d97 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:54.784579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19933995-0ca6-418c-9a1d-0f2bd518cb84 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfb8bfcc56364268a6a2c8acb72c2643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77f2ec3ef544336b2c3909f1f77de04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:54.785631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19933995-0ca6-418c-9a1d-0f2bd518cb84 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:54.786043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19933995-0ca6-418c-9a1d-0f2bd518cb84 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:54.786438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19933995-0ca6-418c-9a1d-0f2bd518cb84 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/e6468db7be5b480eae2a17b02f855508` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:54.787150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19933995-0ca6-418c-9a1d-0f2bd518cb84 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=e6468db7be5b480eae2a17b02f855508)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:54.788294 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-19933995-0ca6-418c-9a1d-0f2bd518cb84 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:32:54.788294 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:32:54.788294 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:32:54.789502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19933995-0ca6-418c-9a1d-0f2bd518cb84 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:54.789887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-19933995-0ca6-418c-9a1d-0f2bd518cb84 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Invalidating token cache because consumer e6468db7be5b480eae2a17b02f855508 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:32:54.790306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-19933995-0ca6-418c-9a1d-0f2bd518cb84 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:54.791143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-19933995-0ca6-418c-9a1d-0f2bd518cb84 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:54.823406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-19933995-0ca6-418c-9a1d-0f2bd518cb84 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'e6468db7be5b480eae2a17b02f855508', 'request_id': 'req-19933995-0ca6-418c-9a1d-0f2bd518cb84'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:54.860593 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3769/7538] 10.222.0.30 () {58 vars in 1266 bytes} [Sun Sep 4 01:32:54 2022] DELETE /identity/v3/OS-OAUTH1/consumers/e6468db7be5b480eae2a17b02f855508 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:54.871175 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19933995-0ca6-418c-9a1d-0f2bd518cb84 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:54.873885 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-19933995-0ca6-418c-9a1d-0f2bd518cb84 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:54.907353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f14748ce-8669-4e23-99ec-f8b7ef2ed494 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e29ac7ad8d3c408e8e97b49dce5916b5', 'request_id': 'req-f14748ce-8669-4e23-99ec-f8b7ef2ed494'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:54.915728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19933995-0ca6-418c-9a1d-0f2bd518cb84 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:54.934670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f14748ce-8669-4e23-99ec-f8b7ef2ed494 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e29ac7ad8d3c408e8e97b49dce5916b5', 'request_id': 'req-f14748ce-8669-4e23-99ec-f8b7ef2ed494'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:54.946955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f14748ce-8669-4e23-99ec-f8b7ef2ed494 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e29ac7ad8d3c408e8e97b49dce5916b5', 'request_id': 'req-f14748ce-8669-4e23-99ec-f8b7ef2ed494'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:54.986670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f14748ce-8669-4e23-99ec-f8b7ef2ed494 admin admin] The token cache is being invalidate because project e29ac7ad8d3c408e8e97b49dce5916b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:32:54.987133 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f14748ce-8669-4e23-99ec-f8b7ef2ed494 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:54.988904 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f14748ce-8669-4e23-99ec-f8b7ef2ed494 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:54.991697 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3770/7539] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:32:54 2022] DELETE /identity/v3/projects/e29ac7ad8d3c408e8e97b49dce5916b5 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:32:54.996332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d90b3c-2d32-4f51-8d8c-7d662507f937 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:54.996749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d90b3c-2d32-4f51-8d8c-7d662507f937 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:54.997769 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d90b3c-2d32-4f51-8d8c-7d662507f937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:55.015077 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:55.052143 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-91d90b3c-2d32-4f51-8d8c-7d662507f937 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:32:55.053662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-91d90b3c-2d32-4f51-8d8c-7d662507f937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:55.097555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a1886-d3ff-4216-882e-2f26a1efaead tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfb8bfcc56364268a6a2c8acb72c2643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77f2ec3ef544336b2c3909f1f77de04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:55.098370 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a1886-d3ff-4216-882e-2f26a1efaead tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:55.098764 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a1886-d3ff-4216-882e-2f26a1efaead tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:55.099151 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a1886-d3ff-4216-882e-2f26a1efaead tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:55.099931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a1886-d3ff-4216-882e-2f26a1efaead tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:55.102190 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:55.103172 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a1886-d3ff-4216-882e-2f26a1efaead tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:55.149945 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3770/7540] 10.222.0.30 () {60 vars in 1185 bytes} [Sun Sep 4 01:32:54 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:32:55.153297 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a1886-d3ff-4216-882e-2f26a1efaead tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:55.156719 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-659a1886-d3ff-4216-882e-2f26a1efaead tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:55.175557 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3771/7541] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:32:55.181712 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a1886-d3ff-4216-882e-2f26a1efaead tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:55.182475 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cfb1b-d19b-4f2b-b5b8-af32d649d6e7 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:55.183166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cfb1b-d19b-4f2b-b5b8-af32d649d6e7 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:55.183572 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cfb1b-d19b-4f2b-b5b8-af32d649d6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:55.207532 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87081d61-cf96-4c08-ab36-94891ed37957 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfb8bfcc56364268a6a2c8acb72c2643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77f2ec3ef544336b2c3909f1f77de04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:55.208293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87081d61-cf96-4c08-ab36-94891ed37957 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:55.208469 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87081d61-cf96-4c08-ab36-94891ed37957 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:55.208935 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87081d61-cf96-4c08-ab36-94891ed37957 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/9733ecaf2c9747dcba2af64c803596c8` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:55.209582 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87081d61-cf96-4c08-ab36-94891ed37957 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=9733ecaf2c9747dcba2af64c803596c8)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:55.211563 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87081d61-cf96-4c08-ab36-94891ed37957 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:55.212042 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-8a0cfb1b-d19b-4f2b-b5b8-af32d649d6e7 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:32:55.213961 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8a0cfb1b-d19b-4f2b-b5b8-af32d649d6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:55.224761 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3772/7542] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:32:55.228987 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3771/7543] 10.222.0.30 () {58 vars in 1263 bytes} [Sun Sep 4 01:32:55 2022] GET /identity/v3/OS-OAUTH1/consumers/9733ecaf2c9747dcba2af64c803596c8 => generated 220 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:32:55.230744 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0cfb1b-d19b-4f2b-b5b8-af32d649d6e7 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:55.230917 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87081d61-cf96-4c08-ab36-94891ed37957 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:55.242943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0cfb1b-d19b-4f2b-b5b8-af32d649d6e7 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:55.248758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87081d61-cf96-4c08-ab36-94891ed37957 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:55.250280 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfcef22-f027-4364-b575-5536a79fb911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:55.251236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcef22-f027-4364-b575-5536a79fb911 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:55.251625 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcef22-f027-4364-b575-5536a79fb911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:55.252153 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcef22-f027-4364-b575-5536a79fb911 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:55.252932 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfcef22-f027-4364-b575-5536a79fb911 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:32:55.253362 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfcef22-f027-4364-b575-5536a79fb911 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:55.255381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfcef22-f027-4364-b575-5536a79fb911 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:55.259929 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde19fb0-2d35-4b25-bc2c-7bc70e11171a tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfb8bfcc56364268a6a2c8acb72c2643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77f2ec3ef544336b2c3909f1f77de04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:55.260767 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde19fb0-2d35-4b25-bc2c-7bc70e11171a tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:55.261729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde19fb0-2d35-4b25-bc2c-7bc70e11171a tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:55.262023 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde19fb0-2d35-4b25-bc2c-7bc70e11171a tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/9733ecaf2c9747dcba2af64c803596c8` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:55.262624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde19fb0-2d35-4b25-bc2c-7bc70e11171a tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=9733ecaf2c9747dcba2af64c803596c8)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:55.267196 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde19fb0-2d35-4b25-bc2c-7bc70e11171a tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:55.267497 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bde19fb0-2d35-4b25-bc2c-7bc70e11171a tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Invalidating token cache because consumer 9733ecaf2c9747dcba2af64c803596c8 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:32:55.267795 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bde19fb0-2d35-4b25-bc2c-7bc70e11171a tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:55.269073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bde19fb0-2d35-4b25-bc2c-7bc70e11171a tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:55.291370 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3773/7544] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:32:55.295978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfcef22-f027-4364-b575-5536a79fb911 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:55.298111 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ddfcef22-f027-4364-b575-5536a79fb911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:55.301149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bde19fb0-2d35-4b25-bc2c-7bc70e11171a tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '9733ecaf2c9747dcba2af64c803596c8', 'request_id': 'req-bde19fb0-2d35-4b25-bc2c-7bc70e11171a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:55.334283 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3772/7545] 10.222.0.30 () {58 vars in 1266 bytes} [Sun Sep 4 01:32:55 2022] DELETE /identity/v3/OS-OAUTH1/consumers/9733ecaf2c9747dcba2af64c803596c8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:55.338988 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde19fb0-2d35-4b25-bc2c-7bc70e11171a tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:55.341110 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-bde19fb0-2d35-4b25-bc2c-7bc70e11171a tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:55.342245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfcef22-f027-4364-b575-5536a79fb911 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:55.356082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91d157-a2ac-4118-a93d-c0c8bbeaee8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:55.356715 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91d157-a2ac-4118-a93d-c0c8bbeaee8d admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:55.357005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91d157-a2ac-4118-a93d-c0c8bbeaee8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:55.357347 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91d157-a2ac-4118-a93d-c0c8bbeaee8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:55.357977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91d157-a2ac-4118-a93d-c0c8bbeaee8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:55.359877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91d157-a2ac-4118-a93d-c0c8bbeaee8d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:55.396833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde19fb0-2d35-4b25-bc2c-7bc70e11171a tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:55.408051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbcc7f1-3936-4108-be65-ca3ad7b0e9c9 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfb8bfcc56364268a6a2c8acb72c2643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77f2ec3ef544336b2c3909f1f77de04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:55.408945 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcc7f1-3936-4108-be65-ca3ad7b0e9c9 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:55.409334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcc7f1-3936-4108-be65-ca3ad7b0e9c9 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:55.409758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcc7f1-3936-4108-be65-ca3ad7b0e9c9 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/9733ecaf2c9747dcba2af64c803596c8` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:55.410592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbcc7f1-3936-4108-be65-ca3ad7b0e9c9 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=9733ecaf2c9747dcba2af64c803596c8)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:55.413973 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbcc7f1-3936-4108-be65-ca3ad7b0e9c9 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:55.427507 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3774/7546] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:32:55 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:32:55.431697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91d157-a2ac-4118-a93d-c0c8bbeaee8d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:55.487121 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-4cbcc7f1-3936-4108-be65-ca3ad7b0e9c9 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Sep 04 01:32:55.487121 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:32:55.487121 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:32:55.487121 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:32:55.487121 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:32:55.487121 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:32:55.487121 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:32:55.487121 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:32:55.487121 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:32:55.487121 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:32:55.487121 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:32:55.487121 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:32:55.487121 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Sep 04 01:32:55.487121 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Sep 04 01:32:55.487121 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Sep 04 01:32:55.488295 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Sep 04 01:32:55.488295 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Sep 04 01:32:55.488295 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Sep 04 01:32:55.488295 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Sep 04 01:32:55.488295 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Sep 04 01:32:55.488295 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Sep 04 01:32:55.488295 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Sep 04 01:32:55.488295 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Sep 04 01:32:55.488295 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:32:55.492355 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3773/7547] 10.222.0.30 () {58 vars in 1263 bytes} [Sun Sep 4 01:32:55 2022] GET /identity/v3/OS-OAUTH1/consumers/9733ecaf2c9747dcba2af64c803596c8 => generated 74 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 01:32:55.501721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbcc7f1-3936-4108-be65-ca3ad7b0e9c9 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:55.526927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbcc7f1-3936-4108-be65-ca3ad7b0e9c9 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:55.613157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91d157-a2ac-4118-a93d-c0c8bbeaee8d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:55.634476 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975cb0e9-5b9d-40e7-9291-30d030616d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:55.635122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cb0e9-5b9d-40e7-9291-30d030616d06 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:55.635404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cb0e9-5b9d-40e7-9291-30d030616d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:55.635678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cb0e9-5b9d-40e7-9291-30d030616d06 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:55.636651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975cb0e9-5b9d-40e7-9291-30d030616d06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:55.638687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975cb0e9-5b9d-40e7-9291-30d030616d06 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:55.711350 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3775/7548] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:32:55 2022] POST /identity/v3/users => generated 289 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:32:55.715450 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975cb0e9-5b9d-40e7-9291-30d030616d06 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:55.719973 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5107ad-2b7d-41ae-b9f4-adb3c2445e63 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfb8bfcc56364268a6a2c8acb72c2643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77f2ec3ef544336b2c3909f1f77de04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:55.721383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5107ad-2b7d-41ae-b9f4-adb3c2445e63 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:55.721833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5107ad-2b7d-41ae-b9f4-adb3c2445e63 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:55.722248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5107ad-2b7d-41ae-b9f4-adb3c2445e63 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/9733ecaf2c9747dcba2af64c803596c8` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:55.725231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5107ad-2b7d-41ae-b9f4-adb3c2445e63 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=9733ecaf2c9747dcba2af64c803596c8)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:55.729692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5107ad-2b7d-41ae-b9f4-adb3c2445e63 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:55.730804 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4f5107ad-2b7d-41ae-b9f4-adb3c2445e63 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Invalidating token cache because consumer 9733ecaf2c9747dcba2af64c803596c8 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:32:55.733049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4f5107ad-2b7d-41ae-b9f4-adb3c2445e63 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:55.735089 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4f5107ad-2b7d-41ae-b9f4-adb3c2445e63 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:55.759987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975cb0e9-5b9d-40e7-9291-30d030616d06 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:55.778343 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-4f5107ad-2b7d-41ae-b9f4-adb3c2445e63 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Sep 04 01:32:55.778343 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:32:55.778343 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:32:55.778343 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:32:55.778343 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:32:55.778343 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:32:55.778343 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:32:55.778343 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:32:55.778343 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:32:55.778343 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:32:55.778343 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:32:55.778343 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:32:55.778343 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Sep 04 01:32:55.778343 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Sep 04 01:32:55.778343 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:32:55.779665 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:32:55.779665 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Sep 04 01:32:55.779665 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Sep 04 01:32:55.779665 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Sep 04 01:32:55.779665 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Sep 04 01:32:55.779665 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Sep 04 01:32:55.779665 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Sep 04 01:32:55.779665 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Sep 04 01:32:55.779665 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Sep 04 01:32:55.779665 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Sep 04 01:32:55.779665 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:32:55.782170 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3774/7549] 10.222.0.30 () {58 vars in 1266 bytes} [Sun Sep 4 01:32:55 2022] DELETE /identity/v3/OS-OAUTH1/consumers/9733ecaf2c9747dcba2af64c803596c8 => generated 74 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 01:32:55.786530 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abbc38-a2d7-4c4e-b2c7-90cc1e6e9935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:55.787173 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abbc38-a2d7-4c4e-b2c7-90cc1e6e9935 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:55.787447 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abbc38-a2d7-4c4e-b2c7-90cc1e6e9935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:55.787837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abbc38-a2d7-4c4e-b2c7-90cc1e6e9935 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:55.788360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abbc38-a2d7-4c4e-b2c7-90cc1e6e9935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:55.788510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5107ad-2b7d-41ae-b9f4-adb3c2445e63 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:55.791565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4f5107ad-2b7d-41ae-b9f4-adb3c2445e63 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:55.794940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abbc38-a2d7-4c4e-b2c7-90cc1e6e9935 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:55.812953 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3776/7550] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:32:55.818443 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abbc38-a2d7-4c4e-b2c7-90cc1e6e9935 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:55.822933 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-11abbc38-a2d7-4c4e-b2c7-90cc1e6e9935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:55.826783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5107ad-2b7d-41ae-b9f4-adb3c2445e63 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:55.842549 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14e613-271e-4150-bcb2-95685f17ecf1 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfb8bfcc56364268a6a2c8acb72c2643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77f2ec3ef544336b2c3909f1f77de04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:55.843361 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14e613-271e-4150-bcb2-95685f17ecf1 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:55.843750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14e613-271e-4150-bcb2-95685f17ecf1 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:55.844139 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14e613-271e-4150-bcb2-95685f17ecf1 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:55.844916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14e613-271e-4150-bcb2-95685f17ecf1 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:55.847352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abbc38-a2d7-4c4e-b2c7-90cc1e6e9935 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:55.850580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14e613-271e-4150-bcb2-95685f17ecf1 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:55.862544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96bfa7-4f06-4694-bfd1-e977b6698c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:55.863182 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96bfa7-4f06-4694-bfd1-e977b6698c07 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:55.863463 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96bfa7-4f06-4694-bfd1-e977b6698c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:55.863732 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96bfa7-4f06-4694-bfd1-e977b6698c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:55.864380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96bfa7-4f06-4694-bfd1-e977b6698c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:55.866018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96bfa7-4f06-4694-bfd1-e977b6698c07 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:55.882326 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3777/7551] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:32:55.883535 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3775/7552] 10.222.0.30 () {60 vars in 1185 bytes} [Sun Sep 4 01:32:55 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:32:55.887484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96bfa7-4f06-4694-bfd1-e977b6698c07 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:55.888817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14e613-271e-4150-bcb2-95685f17ecf1 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:55.914000 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96bfa7-4f06-4694-bfd1-e977b6698c07 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:55.920092 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14e613-271e-4150-bcb2-95685f17ecf1 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:55.934597 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a88e0-73fb-498c-94f4-b060853b7f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:55.935285 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a88e0-73fb-498c-94f4-b060853b7f0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:55.935568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a88e0-73fb-498c-94f4-b060853b7f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:55.935842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a88e0-73fb-498c-94f4-b060853b7f0c admin admin] PATH_INFO: `/v3/projects/0587d6e168554efba62fd4f8e19fb8e3/users/f3fcf5375b454e59b201037d089f9311/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:55.939059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9be51-38bc-4839-b001-a5ceccfb282c tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfb8bfcc56364268a6a2c8acb72c2643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77f2ec3ef544336b2c3909f1f77de04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:55.939685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9be51-38bc-4839-b001-a5ceccfb282c tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:55.939962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9be51-38bc-4839-b001-a5ceccfb282c tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:55.940235 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9be51-38bc-4839-b001-a5ceccfb282c tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:55.940885 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da9be51-38bc-4839-b001-a5ceccfb282c tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:55.942527 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da9be51-38bc-4839-b001-a5ceccfb282c tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:55.981609 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a88e0-73fb-498c-94f4-b060853b7f0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0587d6e168554efba62fd4f8e19fb8e3, user_id=f3fcf5375b454e59b201037d089f9311, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:55.984294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a88e0-73fb-498c-94f4-b060853b7f0c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:55.989271 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3776/7553] 10.222.0.30 () {60 vars in 1185 bytes} [Sun Sep 4 01:32:55 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:32:55.998829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9be51-38bc-4839-b001-a5ceccfb282c tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:56.019042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9be51-38bc-4839-b001-a5ceccfb282c tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:56.029476 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3778/7554] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:32:55 2022] PUT /identity/v3/projects/0587d6e168554efba62fd4f8e19fb8e3/users/f3fcf5375b454e59b201037d089f9311/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:56.036159 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0b08c-63aa-4002-972a-55e584896b75 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:56.037510 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0b08c-63aa-4002-972a-55e584896b75 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:56.040348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0b08c-63aa-4002-972a-55e584896b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:56.114173 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:56.136394 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9163ba-405c-4c06-84bb-4e024d47d06f tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfb8bfcc56364268a6a2c8acb72c2643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77f2ec3ef544336b2c3909f1f77de04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:56.137082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9163ba-405c-4c06-84bb-4e024d47d06f tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:56.137359 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9163ba-405c-4c06-84bb-4e024d47d06f tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:56.137639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9163ba-405c-4c06-84bb-4e024d47d06f tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:56.138231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9163ba-405c-4c06-84bb-4e024d47d06f tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:56.142708 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-fe9163ba-405c-4c06-84bb-4e024d47d06f tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:32:56.142708 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:32:56.142708 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:32:56.143807 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9163ba-405c-4c06-84bb-4e024d47d06f tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:56.164351 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3777/7555] 10.222.0.30 () {58 vars in 1164 bytes} [Sun Sep 4 01:32:55 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 537 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:32:56.165300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9163ba-405c-4c06-84bb-4e024d47d06f tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:56.182281 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9163ba-405c-4c06-84bb-4e024d47d06f tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:56.202740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-3ef0b08c-63aa-4002-972a-55e584896b75 None None] MFA Rules not processed for user `f3fcf5375b454e59b201037d089f9311`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:32:56.209101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3ef0b08c-63aa-4002-972a-55e584896b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:56.226043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34818d5c-1f40-4e0e-aca8-e75bca6e0144 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfb8bfcc56364268a6a2c8acb72c2643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77f2ec3ef544336b2c3909f1f77de04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:56.226979 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34818d5c-1f40-4e0e-aca8-e75bca6e0144 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:56.227788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34818d5c-1f40-4e0e-aca8-e75bca6e0144 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:56.227788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34818d5c-1f40-4e0e-aca8-e75bca6e0144 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/84b1a6f2fb4e40038938a6c1fa8d2507` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:56.228089 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34818d5c-1f40-4e0e-aca8-e75bca6e0144 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=84b1a6f2fb4e40038938a6c1fa8d2507)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:56.229785 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34818d5c-1f40-4e0e-aca8-e75bca6e0144 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:56.230050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-34818d5c-1f40-4e0e-aca8-e75bca6e0144 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Invalidating token cache because consumer 84b1a6f2fb4e40038938a6c1fa8d2507 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:32:56.230322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-34818d5c-1f40-4e0e-aca8-e75bca6e0144 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:56.236350 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-34818d5c-1f40-4e0e-aca8-e75bca6e0144 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:56.256992 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:56.277619 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-34818d5c-1f40-4e0e-aca8-e75bca6e0144 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '84b1a6f2fb4e40038938a6c1fa8d2507', 'request_id': 'req-34818d5c-1f40-4e0e-aca8-e75bca6e0144'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:56.308928 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3778/7556] 10.222.0.30 () {58 vars in 1266 bytes} [Sun Sep 4 01:32:56 2022] DELETE /identity/v3/OS-OAUTH1/consumers/84b1a6f2fb4e40038938a6c1fa8d2507 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:56.310336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34818d5c-1f40-4e0e-aca8-e75bca6e0144 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:56.313758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-34818d5c-1f40-4e0e-aca8-e75bca6e0144 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:56.357056 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34818d5c-1f40-4e0e-aca8-e75bca6e0144 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:56.375538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b52d16-7999-4489-89e1-a29366ecfc3c tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfb8bfcc56364268a6a2c8acb72c2643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77f2ec3ef544336b2c3909f1f77de04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:56.376210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b52d16-7999-4489-89e1-a29366ecfc3c tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:56.376491 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b52d16-7999-4489-89e1-a29366ecfc3c tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:56.382009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b52d16-7999-4489-89e1-a29366ecfc3c tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/1feef97aa8a0495ab99a9c6ec41e5553` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:56.382659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b52d16-7999-4489-89e1-a29366ecfc3c tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=1feef97aa8a0495ab99a9c6ec41e5553)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:56.384324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b52d16-7999-4489-89e1-a29366ecfc3c tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:56.384645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c6b52d16-7999-4489-89e1-a29366ecfc3c tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Invalidating token cache because consumer 1feef97aa8a0495ab99a9c6ec41e5553 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:32:56.391000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c6b52d16-7999-4489-89e1-a29366ecfc3c tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:56.393021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c6b52d16-7999-4489-89e1-a29366ecfc3c tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:56.428449 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c6b52d16-7999-4489-89e1-a29366ecfc3c tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '1feef97aa8a0495ab99a9c6ec41e5553', 'request_id': 'req-c6b52d16-7999-4489-89e1-a29366ecfc3c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:56.436574 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3779/7557] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:32:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:32:56.441221 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0b08c-63aa-4002-972a-55e584896b75 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:56.443981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3ef0b08c-63aa-4002-972a-55e584896b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:56.459289 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3779/7558] 10.222.0.30 () {58 vars in 1266 bytes} [Sun Sep 4 01:32:56 2022] DELETE /identity/v3/OS-OAUTH1/consumers/1feef97aa8a0495ab99a9c6ec41e5553 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:56.467091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b52d16-7999-4489-89e1-a29366ecfc3c tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:56.468533 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c6b52d16-7999-4489-89e1-a29366ecfc3c tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:56.530693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b52d16-7999-4489-89e1-a29366ecfc3c tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:56.559224 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38d5df-1e2c-4a6a-a424-ec1616d3535b tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfb8bfcc56364268a6a2c8acb72c2643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77f2ec3ef544336b2c3909f1f77de04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:56.559707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38d5df-1e2c-4a6a-a424-ec1616d3535b tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:56.559984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38d5df-1e2c-4a6a-a424-ec1616d3535b tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:56.560259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38d5df-1e2c-4a6a-a424-ec1616d3535b tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:56.560932 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38d5df-1e2c-4a6a-a424-ec1616d3535b tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:56.562569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38d5df-1e2c-4a6a-a424-ec1616d3535b tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:56.608317 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3780/7559] 10.222.0.30 () {60 vars in 1185 bytes} [Sun Sep 4 01:32:56 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:32:56.615260 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38d5df-1e2c-4a6a-a424-ec1616d3535b tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:56.652703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38d5df-1e2c-4a6a-a424-ec1616d3535b tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:56.671651 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa00db-0386-4bf0-b27a-362db6987cf6 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfb8bfcc56364268a6a2c8acb72c2643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77f2ec3ef544336b2c3909f1f77de04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:56.672311 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa00db-0386-4bf0-b27a-362db6987cf6 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:56.672589 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa00db-0386-4bf0-b27a-362db6987cf6 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:56.672856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa00db-0386-4bf0-b27a-362db6987cf6 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/98015778130847edb585cfab78591d3e` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:56.674083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa00db-0386-4bf0-b27a-362db6987cf6 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=98015778130847edb585cfab78591d3e)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:56.674613 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-09fa00db-0386-4bf0-b27a-362db6987cf6 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:32:56.674613 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:32:56.674613 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:32:56.675523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa00db-0386-4bf0-b27a-362db6987cf6 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:56.701887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0b08c-63aa-4002-972a-55e584896b75 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:56.716416 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3781/7560] 10.222.0.30 () {60 vars in 1285 bytes} [Sun Sep 4 01:32:56 2022] PATCH /identity/v3/OS-OAUTH1/consumers/98015778130847edb585cfab78591d3e => generated 221 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:32:56.722368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa00db-0386-4bf0-b27a-362db6987cf6 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:56.724464 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f4f11-540d-4e95-b323-e50b86ff3f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:56.725115 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f4f11-540d-4e95-b323-e50b86ff3f03 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:56.725397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f4f11-540d-4e95-b323-e50b86ff3f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:56.725732 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f4f11-540d-4e95-b323-e50b86ff3f03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:56.726355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f4f11-540d-4e95-b323-e50b86ff3f03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:56.728337 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f4f11-540d-4e95-b323-e50b86ff3f03 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:56.747885 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa00db-0386-4bf0-b27a-362db6987cf6 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:56.753650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9813a41-69d7-496d-a3c1-cdc02ebdbf25 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfb8bfcc56364268a6a2c8acb72c2643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77f2ec3ef544336b2c3909f1f77de04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:56.754403 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9813a41-69d7-496d-a3c1-cdc02ebdbf25 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:56.754754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9813a41-69d7-496d-a3c1-cdc02ebdbf25 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:56.755101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9813a41-69d7-496d-a3c1-cdc02ebdbf25 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/98015778130847edb585cfab78591d3e` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:56.755781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9813a41-69d7-496d-a3c1-cdc02ebdbf25 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=98015778130847edb585cfab78591d3e)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:56.757523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9813a41-69d7-496d-a3c1-cdc02ebdbf25 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:56.767749 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3782/7561] 10.222.0.30 () {58 vars in 1263 bytes} [Sun Sep 4 01:32:56 2022] GET /identity/v3/OS-OAUTH1/consumers/98015778130847edb585cfab78591d3e => generated 221 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:32:56.768869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9813a41-69d7-496d-a3c1-cdc02ebdbf25 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:56.781870 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9813a41-69d7-496d-a3c1-cdc02ebdbf25 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:56.787239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf7ea6-5a4e-456b-8afe-80b482a5e4b1 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfb8bfcc56364268a6a2c8acb72c2643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77f2ec3ef544336b2c3909f1f77de04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:56.787983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf7ea6-5a4e-456b-8afe-80b482a5e4b1 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:56.788409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf7ea6-5a4e-456b-8afe-80b482a5e4b1 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:56.788646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf7ea6-5a4e-456b-8afe-80b482a5e4b1 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/98015778130847edb585cfab78591d3e` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:56.789315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf7ea6-5a4e-456b-8afe-80b482a5e4b1 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=98015778130847edb585cfab78591d3e)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:56.791465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf7ea6-5a4e-456b-8afe-80b482a5e4b1 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:56.791789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9fbf7ea6-5a4e-456b-8afe-80b482a5e4b1 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Invalidating token cache because consumer 98015778130847edb585cfab78591d3e has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:32:56.792190 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9fbf7ea6-5a4e-456b-8afe-80b482a5e4b1 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:56.792995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9fbf7ea6-5a4e-456b-8afe-80b482a5e4b1 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:56.809721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9fbf7ea6-5a4e-456b-8afe-80b482a5e4b1 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '98015778130847edb585cfab78591d3e', 'request_id': 'req-9fbf7ea6-5a4e-456b-8afe-80b482a5e4b1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:56.819139 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3780/7562] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:32:56 2022] POST /identity/v3/projects => generated 375 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:32:56.825545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f4f11-540d-4e95-b323-e50b86ff3f03 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:56.828492 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d88f4f11-540d-4e95-b323-e50b86ff3f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:56.836179 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3783/7563] 10.222.0.30 () {58 vars in 1266 bytes} [Sun Sep 4 01:32:56 2022] DELETE /identity/v3/OS-OAUTH1/consumers/98015778130847edb585cfab78591d3e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:56.841874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf7ea6-5a4e-456b-8afe-80b482a5e4b1 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:56.844498 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9fbf7ea6-5a4e-456b-8afe-80b482a5e4b1 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:56.882955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf7ea6-5a4e-456b-8afe-80b482a5e4b1 tempest-OAUTHConsumersV3Test-1540323731 tempest-OAUTHConsumersV3Test-1540323731-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:57.042773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df3b3d-597c-4a84-87ac-c8210c79e5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:57.044191 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df3b3d-597c-4a84-87ac-c8210c79e5e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:57.044923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df3b3d-597c-4a84-87ac-c8210c79e5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:57.046636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df3b3d-597c-4a84-87ac-c8210c79e5e3 admin admin] PATH_INFO: `/v3/users/454fe7d10c784923874f11f4ccd0e4c5` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:57.051100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df3b3d-597c-4a84-87ac-c8210c79e5e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=454fe7d10c784923874f11f4ccd0e4c5)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:57.054937 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df3b3d-597c-4a84-87ac-c8210c79e5e3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:57.064675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f4f11-540d-4e95-b323-e50b86ff3f03 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:57.081964 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f831b8-52a2-4cac-a44a-f087e03982dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:57.082904 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f831b8-52a2-4cac-a44a-f087e03982dc admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:57.083288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f831b8-52a2-4cac-a44a-f087e03982dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:57.083672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f831b8-52a2-4cac-a44a-f087e03982dc admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:57.084415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f831b8-52a2-4cac-a44a-f087e03982dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:57.089061 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f831b8-52a2-4cac-a44a-f087e03982dc admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:57.140602 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=84,keystone:DELETE=11,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:57.147943 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3781/7564] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:32:56 2022] POST /identity/v3/users => generated 294 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:32:57.153390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f831b8-52a2-4cac-a44a-f087e03982dc admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:57.182430 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-28df3b3d-597c-4a84-87ac-c8210c79e5e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '454fe7d10c784923874f11f4ccd0e4c5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:57.184659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-28df3b3d-597c-4a84-87ac-c8210c79e5e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '454fe7d10c784923874f11f4ccd0e4c5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:57.195905 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f831b8-52a2-4cac-a44a-f087e03982dc admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:57.212223 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-28df3b3d-597c-4a84-87ac-c8210c79e5e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '454fe7d10c784923874f11f4ccd0e4c5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:57.213042 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7711a63-a717-4c76-874f-f9066ff669d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:57.213727 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7711a63-a717-4c76-874f-f9066ff669d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:57.220528 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7711a63-a717-4c76-874f-f9066ff669d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:57.220843 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7711a63-a717-4c76-874f-f9066ff669d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:57.223403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7711a63-a717-4c76-874f-f9066ff669d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:57.229925 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7711a63-a717-4c76-874f-f9066ff669d1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:57.244268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-28df3b3d-597c-4a84-87ac-c8210c79e5e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '454fe7d10c784923874f11f4ccd0e4c5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:57.244987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-28df3b3d-597c-4a84-87ac-c8210c79e5e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '454fe7d10c784923874f11f4ccd0e4c5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:32:57.268631 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3782/7565] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:32:57.272285 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7711a63-a717-4c76-874f-f9066ff669d1 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:57.276969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c7711a63-a717-4c76-874f-f9066ff669d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:57.294806 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3784/7566] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:32:56 2022] DELETE /identity/v3/users/454fe7d10c784923874f11f4ccd0e4c5 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:57.299597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42de22d-9aad-475f-92d9-85788cb8f26e None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:57.299885 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42de22d-9aad-475f-92d9-85788cb8f26e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:57.300162 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42de22d-9aad-475f-92d9-85788cb8f26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:57.320392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7711a63-a717-4c76-874f-f9066ff669d1 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:57.371931 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:57.380222 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-b42de22d-9aad-475f-92d9-85788cb8f26e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:32:57.386915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b42de22d-9aad-475f-92d9-85788cb8f26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:57.470620 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138217e6-396f-4ebe-a185-4aadc66c4821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:57.471607 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138217e6-396f-4ebe-a185-4aadc66c4821 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:57.471607 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138217e6-396f-4ebe-a185-4aadc66c4821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:57.471873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138217e6-396f-4ebe-a185-4aadc66c4821 admin admin] PATH_INFO: `/v3/projects/11ae348848164f95aebe0797516cc3cf/users/3638271391bf4f18abb09cf6f856150d/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:57.527643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138217e6-396f-4ebe-a185-4aadc66c4821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11ae348848164f95aebe0797516cc3cf, user_id=3638271391bf4f18abb09cf6f856150d, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:57.528932 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138217e6-396f-4ebe-a185-4aadc66c4821 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:57.529515 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3785/7567] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:32:57.556341 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3783/7568] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:32:57 2022] PUT /identity/v3/projects/11ae348848164f95aebe0797516cc3cf/users/3638271391bf4f18abb09cf6f856150d/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:32:57.557609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42de22d-9aad-475f-92d9-85788cb8f26e None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:57.569238 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42de22d-9aad-475f-92d9-85788cb8f26e None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:57.645581 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cb33b-b2b6-4504-97c0-04c2cf446824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:57.646213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cb33b-b2b6-4504-97c0-04c2cf446824 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:57.646622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cb33b-b2b6-4504-97c0-04c2cf446824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:57.646901 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cb33b-b2b6-4504-97c0-04c2cf446824 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:57.647553 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cb33b-b2b6-4504-97c0-04c2cf446824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:57.649286 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cb33b-b2b6-4504-97c0-04c2cf446824 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:57.661499 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3786/7569] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:32:57.664713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138217e6-396f-4ebe-a185-4aadc66c4821 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:57.695819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138217e6-396f-4ebe-a185-4aadc66c4821 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:57.698491 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cb33b-b2b6-4504-97c0-04c2cf446824 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:57.700402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c39cb33b-b2b6-4504-97c0-04c2cf446824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:57.703859 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c8f40-3d6e-4432-8757-680dfb6cec85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:57.705169 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c8f40-3d6e-4432-8757-680dfb6cec85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:57.705639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c8f40-3d6e-4432-8757-680dfb6cec85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:57.711562 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c8f40-3d6e-4432-8757-680dfb6cec85 admin admin] PATH_INFO: `/v3/projects/11ae348848164f95aebe0797516cc3cf/users/3638271391bf4f18abb09cf6f856150d/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:57.715784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c8f40-3d6e-4432-8757-680dfb6cec85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11ae348848164f95aebe0797516cc3cf, user_id=3638271391bf4f18abb09cf6f856150d, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:57.720120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c8f40-3d6e-4432-8757-680dfb6cec85 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:57.756091 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3784/7570] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:32:57 2022] PUT /identity/v3/projects/11ae348848164f95aebe0797516cc3cf/users/3638271391bf4f18abb09cf6f856150d/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:32:57.758566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a61805-e68f-4b68-a19d-2480edcf2a66 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:57.759015 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a61805-e68f-4b68-a19d-2480edcf2a66 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:57.759477 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a61805-e68f-4b68-a19d-2480edcf2a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:57.795538 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-57a61805-e68f-4b68-a19d-2480edcf2a66 None None] MFA Rules not processed for user `3638271391bf4f18abb09cf6f856150d`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:32:57.797714 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-57a61805-e68f-4b68-a19d-2480edcf2a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:57.826492 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:57.838070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cb33b-b2b6-4504-97c0-04c2cf446824 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:57.943229 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3785/7571] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:32:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:32:57.957368 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a61805-e68f-4b68-a19d-2480edcf2a66 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:32:57.959303 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-57a61805-e68f-4b68-a19d-2480edcf2a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:57.989395 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55731245-6ec7-4d80-9b80-b94dc073a282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:57.990207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55731245-6ec7-4d80-9b80-b94dc073a282 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:57.990957 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55731245-6ec7-4d80-9b80-b94dc073a282 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:57.990957 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55731245-6ec7-4d80-9b80-b94dc073a282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:58.076289 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a61805-e68f-4b68-a19d-2480edcf2a66 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:32:58.091075 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2128f64-936f-43b3-8165-368944f1677a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:32:58.092027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2128f64-936f-43b3-8165-368944f1677a service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:32:58.092307 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2128f64-936f-43b3-8165-368944f1677a service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:32:58.092580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2128f64-936f-43b3-8165-368944f1677a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:32:58.097983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f2128f64-936f-43b3-8165-368944f1677a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:32:58.130486 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55731245-6ec7-4d80-9b80-b94dc073a282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:58.132627 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55731245-6ec7-4d80-9b80-b94dc073a282 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:58.164977 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3787/7572] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:32:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:32:58.184159 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:32:58.254015 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2128f64-936f-43b3-8165-368944f1677a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:32:58.256213 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2128f64-936f-43b3-8165-368944f1677a service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:32:58.269743 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3786/7573] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:32:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:33:00.513571 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55731245-6ec7-4d80-9b80-b94dc073a282 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:00.516239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-55731245-6ec7-4d80-9b80-b94dc073a282 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:00.544015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55731245-6ec7-4d80-9b80-b94dc073a282 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:00.558946 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d54e6-d64a-441c-b990-21ddbef6e2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:00.559677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d54e6-d64a-441c-b990-21ddbef6e2b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:00.559970 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d54e6-d64a-441c-b990-21ddbef6e2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:00.560317 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d54e6-d64a-441c-b990-21ddbef6e2b0 admin admin] PATH_INFO: `/v3/projects/bfe488b56410464cbd3bdd85b3682304` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:00.562450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d54e6-d64a-441c-b990-21ddbef6e2b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfe488b56410464cbd3bdd85b3682304)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:00.569802 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d54e6-d64a-441c-b990-21ddbef6e2b0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:00.650180 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fe8d54e6-d64a-441c-b990-21ddbef6e2b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfe488b56410464cbd3bdd85b3682304', 'request_id': 'req-fe8d54e6-d64a-441c-b990-21ddbef6e2b0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:00.662799 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fe8d54e6-d64a-441c-b990-21ddbef6e2b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfe488b56410464cbd3bdd85b3682304', 'request_id': 'req-fe8d54e6-d64a-441c-b990-21ddbef6e2b0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:00.674605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fe8d54e6-d64a-441c-b990-21ddbef6e2b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfe488b56410464cbd3bdd85b3682304', 'request_id': 'req-fe8d54e6-d64a-441c-b990-21ddbef6e2b0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:00.689198 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fe8d54e6-d64a-441c-b990-21ddbef6e2b0 admin admin] The token cache is being invalidate because project bfe488b56410464cbd3bdd85b3682304 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:33:00.690152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fe8d54e6-d64a-441c-b990-21ddbef6e2b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:00.690389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fe8d54e6-d64a-441c-b990-21ddbef6e2b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:00.692328 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3788/7574] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:33:00 2022] DELETE /identity/v3/projects/bfe488b56410464cbd3bdd85b3682304 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:00.696353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2128f64-936f-43b3-8165-368944f1677a service cinder] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:00.708343 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2128f64-936f-43b3-8165-368944f1677a service cinder] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:00.777978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602cc799-16da-4769-844a-9e795b67e8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:00.779129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cc799-16da-4769-844a-9e795b67e8cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:00.779129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cc799-16da-4769-844a-9e795b67e8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:00.779413 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cc799-16da-4769-844a-9e795b67e8cb admin admin] PATH_INFO: `/v3/users/dfb8bfcc56364268a6a2c8acb72c2643` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:00.780866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cc799-16da-4769-844a-9e795b67e8cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfb8bfcc56364268a6a2c8acb72c2643)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:00.783018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cc799-16da-4769-844a-9e795b67e8cb admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:00.838281 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-602cc799-16da-4769-844a-9e795b67e8cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfb8bfcc56364268a6a2c8acb72c2643'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:00.839147 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-602cc799-16da-4769-844a-9e795b67e8cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfb8bfcc56364268a6a2c8acb72c2643'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:00.848066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-602cc799-16da-4769-844a-9e795b67e8cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfb8bfcc56364268a6a2c8acb72c2643'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:00.858538 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-602cc799-16da-4769-844a-9e795b67e8cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfb8bfcc56364268a6a2c8acb72c2643'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:00.859605 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-602cc799-16da-4769-844a-9e795b67e8cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfb8bfcc56364268a6a2c8acb72c2643'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:00.885522 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3787/7575] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:33:00 2022] DELETE /identity/v3/users/dfb8bfcc56364268a6a2c8acb72c2643 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:01.726567 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d54e6-d64a-441c-b990-21ddbef6e2b0 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:01.728068 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fe8d54e6-d64a-441c-b990-21ddbef6e2b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:01.762686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d54e6-d64a-441c-b990-21ddbef6e2b0 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:01.851199 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:01.916389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d4854-2198-44b2-bde0-570b19ab5edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:01.917560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d4854-2198-44b2-bde0-570b19ab5edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:01.918133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d4854-2198-44b2-bde0-570b19ab5edb admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:01.918763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d4854-2198-44b2-bde0-570b19ab5edb admin admin] PATH_INFO: `/v3/projects/a77f2ec3ef544336b2c3909f1f77de04` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:01.921834 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d4854-2198-44b2-bde0-570b19ab5edb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a77f2ec3ef544336b2c3909f1f77de04)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:01.924328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d4854-2198-44b2-bde0-570b19ab5edb admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:02.042616 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-441d4854-2198-44b2-bde0-570b19ab5edb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a77f2ec3ef544336b2c3909f1f77de04', 'request_id': 'req-441d4854-2198-44b2-bde0-570b19ab5edb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:02.065758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-441d4854-2198-44b2-bde0-570b19ab5edb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a77f2ec3ef544336b2c3909f1f77de04', 'request_id': 'req-441d4854-2198-44b2-bde0-570b19ab5edb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:02.073040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-441d4854-2198-44b2-bde0-570b19ab5edb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a77f2ec3ef544336b2c3909f1f77de04', 'request_id': 'req-441d4854-2198-44b2-bde0-570b19ab5edb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:02.100739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-441d4854-2198-44b2-bde0-570b19ab5edb admin admin] The token cache is being invalidate because project a77f2ec3ef544336b2c3909f1f77de04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:33:02.101074 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-441d4854-2198-44b2-bde0-570b19ab5edb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:02.101989 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-441d4854-2198-44b2-bde0-570b19ab5edb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:02.110427 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3789/7576] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:33:01 2022] DELETE /identity/v3/projects/a77f2ec3ef544336b2c3909f1f77de04 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:02.119808 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da70d6d-b9fa-4d74-bea2-ce03c29a554c None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:02.120919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da70d6d-b9fa-4d74-bea2-ce03c29a554c None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:02.121010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da70d6d-b9fa-4d74-bea2-ce03c29a554c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:02.190534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-4da70d6d-b9fa-4d74-bea2-ce03c29a554c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:02.191861 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4da70d6d-b9fa-4d74-bea2-ce03c29a554c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:02.261336 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:02.297934 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3788/7577] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:02.303721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57bc29-4c24-4bdd-8418-b2ab3d06bd76 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:02.304074 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57bc29-4c24-4bdd-8418-b2ab3d06bd76 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:02.304425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57bc29-4c24-4bdd-8418-b2ab3d06bd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:02.337506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-5a57bc29-4c24-4bdd-8418-b2ab3d06bd76 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:02.338972 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5a57bc29-4c24-4bdd-8418-b2ab3d06bd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:02.353649 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3790/7578] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:02.358362 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da70d6d-b9fa-4d74-bea2-ce03c29a554c None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:02.375146 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da70d6d-b9fa-4d74-bea2-ce03c29a554c None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:02.384765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15864b2-5815-42ae-8266-fc37404c4d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:02.385535 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15864b2-5815-42ae-8266-fc37404c4d0b admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:02.387120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15864b2-5815-42ae-8266-fc37404c4d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:02.388625 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15864b2-5815-42ae-8266-fc37404c4d0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:02.389835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15864b2-5815-42ae-8266-fc37404c4d0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:33:02.391687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15864b2-5815-42ae-8266-fc37404c4d0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:02.398074 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15864b2-5815-42ae-8266-fc37404c4d0b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:02.425215 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3789/7579] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:33:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:33:02.429770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57bc29-4c24-4bdd-8418-b2ab3d06bd76 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:02.457555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57bc29-4c24-4bdd-8418-b2ab3d06bd76 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:02.462344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f11b6-aad0-457e-85b2-b51fc238b2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:02.463040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f11b6-aad0-457e-85b2-b51fc238b2c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:02.464610 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f11b6-aad0-457e-85b2-b51fc238b2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:02.464979 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f11b6-aad0-457e-85b2-b51fc238b2c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:02.465730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f11b6-aad0-457e-85b2-b51fc238b2c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:02.467723 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f11b6-aad0-457e-85b2-b51fc238b2c9 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:02.505835 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3791/7580] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:33:02 2022] POST /identity/v3/projects => generated 393 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:02.509860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15864b2-5815-42ae-8266-fc37404c4d0b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:02.525278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15864b2-5815-42ae-8266-fc37404c4d0b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:02.671190 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991972b-5d4a-4823-8d26-c7a1a0946ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:02.673488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991972b-5d4a-4823-8d26-c7a1a0946ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:02.673488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991972b-5d4a-4823-8d26-c7a1a0946ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:02.673488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991972b-5d4a-4823-8d26-c7a1a0946ee8 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:02.673488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991972b-5d4a-4823-8d26-c7a1a0946ee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:02.679735 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991972b-5d4a-4823-8d26-c7a1a0946ee8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:02.767367 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3790/7581] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:33:02 2022] POST /identity/v3/users => generated 303 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:33:02.768508 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f11b6-aad0-457e-85b2-b51fc238b2c9 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:02.786480 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f11b6-aad0-457e-85b2-b51fc238b2c9 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:02.800791 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339a507-4139-45d1-b532-cfd6870a761b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:02.801909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339a507-4139-45d1-b532-cfd6870a761b admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:02.802353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339a507-4139-45d1-b532-cfd6870a761b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:02.804038 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339a507-4139-45d1-b532-cfd6870a761b admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:02.805151 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339a507-4139-45d1-b532-cfd6870a761b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:02.810413 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339a507-4139-45d1-b532-cfd6870a761b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:02.839264 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3792/7582] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:33:02.843421 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991972b-5d4a-4823-8d26-c7a1a0946ee8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:02.866807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991972b-5d4a-4823-8d26-c7a1a0946ee8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:02.871922 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ef2a0-8e53-4f9e-8215-beff7dd02021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:02.872607 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ef2a0-8e53-4f9e-8215-beff7dd02021 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:02.872887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ef2a0-8e53-4f9e-8215-beff7dd02021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:02.873167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ef2a0-8e53-4f9e-8215-beff7dd02021 admin admin] PATH_INFO: `/v3/projects/72f290a8cb6b44f0a026a16ae77c1748/users/d3df0c295108482e846e5c428ae2e697/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:02.905117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ef2a0-8e53-4f9e-8215-beff7dd02021 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72f290a8cb6b44f0a026a16ae77c1748, user_id=d3df0c295108482e846e5c428ae2e697, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:02.907822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ef2a0-8e53-4f9e-8215-beff7dd02021 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:02.938601 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3791/7583] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:33:02 2022] PUT /identity/v3/projects/72f290a8cb6b44f0a026a16ae77c1748/users/d3df0c295108482e846e5c428ae2e697/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:02.944966 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339a507-4139-45d1-b532-cfd6870a761b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:02.973454 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339a507-4139-45d1-b532-cfd6870a761b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:03.250441 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614aa04d-d1f6-4f94-8b6a-a19b332c07dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:03.251748 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614aa04d-d1f6-4f94-8b6a-a19b332c07dc admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:03.252409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614aa04d-d1f6-4f94-8b6a-a19b332c07dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:03.253055 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614aa04d-d1f6-4f94-8b6a-a19b332c07dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:03.254368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614aa04d-d1f6-4f94-8b6a-a19b332c07dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:03.257388 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614aa04d-d1f6-4f94-8b6a-a19b332c07dc admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:03.271122 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3793/7584] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:33:03.275901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ef2a0-8e53-4f9e-8215-beff7dd02021 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:03.294005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ef2a0-8e53-4f9e-8215-beff7dd02021 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:03.305255 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c09af-2da1-4b9d-92cf-3e95701904a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:03.305947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c09af-2da1-4b9d-92cf-3e95701904a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:03.306327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c09af-2da1-4b9d-92cf-3e95701904a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:03.306720 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c09af-2da1-4b9d-92cf-3e95701904a2 admin admin] PATH_INFO: `/v3/projects/72f290a8cb6b44f0a026a16ae77c1748/users/d3df0c295108482e846e5c428ae2e697/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:03.313404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c09af-2da1-4b9d-92cf-3e95701904a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72f290a8cb6b44f0a026a16ae77c1748, user_id=d3df0c295108482e846e5c428ae2e697, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:03.317224 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c09af-2da1-4b9d-92cf-3e95701904a2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:03.377203 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3792/7585] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:33:03 2022] PUT /identity/v3/projects/72f290a8cb6b44f0a026a16ae77c1748/users/d3df0c295108482e846e5c428ae2e697/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:03.388116 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e3cc5-3110-4db6-8e32-59fae5d0b339 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:03.388650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e3cc5-3110-4db6-8e32-59fae5d0b339 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:03.389019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e3cc5-3110-4db6-8e32-59fae5d0b339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:03.447651 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ff4e3cc5-3110-4db6-8e32-59fae5d0b339 None None] MFA Rules not processed for user `d3df0c295108482e846e5c428ae2e697`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:03.450916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ff4e3cc5-3110-4db6-8e32-59fae5d0b339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:03.474484 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:03.612432 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3794/7586] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:03 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:03.619202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c09af-2da1-4b9d-92cf-3e95701904a2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:04.041892 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c09af-2da1-4b9d-92cf-3e95701904a2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:04.048698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a2b07-6439-4303-9d4f-365bce1db3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:04.049421 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a2b07-6439-4303-9d4f-365bce1db3f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:04.049641 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a2b07-6439-4303-9d4f-365bce1db3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:04.049869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a2b07-6439-4303-9d4f-365bce1db3f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:04.050503 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a2b07-6439-4303-9d4f-365bce1db3f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:04.052415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a2b07-6439-4303-9d4f-365bce1db3f1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:04.084905 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3793/7587] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:33:03 2022] POST /identity/v3/projects => generated 391 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:04.088806 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e3cc5-3110-4db6-8e32-59fae5d0b339 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:04.101722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e3cc5-3110-4db6-8e32-59fae5d0b339 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:04.172585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a2be5-0468-4756-86ec-8c17eb7d7ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:04.173351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a2be5-0468-4756-86ec-8c17eb7d7ffd admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:04.173794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a2be5-0468-4756-86ec-8c17eb7d7ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:04.174164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a2be5-0468-4756-86ec-8c17eb7d7ffd admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:04.174902 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a2be5-0468-4756-86ec-8c17eb7d7ffd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:04.177011 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a2be5-0468-4756-86ec-8c17eb7d7ffd admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:04.205844 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3795/7588] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:33:04 2022] POST /identity/v3/users => generated 296 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:33:04.209889 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a2b07-6439-4303-9d4f-365bce1db3f1 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:04.224124 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a2b07-6439-4303-9d4f-365bce1db3f1 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:04.230394 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c17ea7-0b03-4d1b-be90-10011eed80b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:04.231234 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c17ea7-0b03-4d1b-be90-10011eed80b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:04.231658 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c17ea7-0b03-4d1b-be90-10011eed80b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:04.232058 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c17ea7-0b03-4d1b-be90-10011eed80b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:04.232882 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c17ea7-0b03-4d1b-be90-10011eed80b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:04.234681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c17ea7-0b03-4d1b-be90-10011eed80b7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:04.251366 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3794/7589] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:33:04.255056 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a2be5-0468-4756-86ec-8c17eb7d7ffd admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:04.268579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a2be5-0468-4756-86ec-8c17eb7d7ffd admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:04.275024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13d630-5ac8-4b28-868a-1db1e8b14de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:04.275894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13d630-5ac8-4b28-868a-1db1e8b14de2 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:04.276408 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13d630-5ac8-4b28-868a-1db1e8b14de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:04.276831 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13d630-5ac8-4b28-868a-1db1e8b14de2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:04.277781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13d630-5ac8-4b28-868a-1db1e8b14de2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:04.280351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13d630-5ac8-4b28-868a-1db1e8b14de2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:04.293038 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3796/7590] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:33:04.298566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c17ea7-0b03-4d1b-be90-10011eed80b7 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:04.304858 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:04.312614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c17ea7-0b03-4d1b-be90-10011eed80b7 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:04.319643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15196015-d94c-4c02-90a2-a9282ce4e398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:04.320967 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15196015-d94c-4c02-90a2-a9282ce4e398 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:04.321364 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15196015-d94c-4c02-90a2-a9282ce4e398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:04.321889 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15196015-d94c-4c02-90a2-a9282ce4e398 admin admin] PATH_INFO: `/v3/projects/5524b8f2fcee49f08a13849bf5d8a5e7/users/04fd5fcff0a04e5f831269f8e2b6505b/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:04.341718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15196015-d94c-4c02-90a2-a9282ce4e398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5524b8f2fcee49f08a13849bf5d8a5e7, user_id=04fd5fcff0a04e5f831269f8e2b6505b, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:04.345170 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15196015-d94c-4c02-90a2-a9282ce4e398 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:04.376710 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3795/7591] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:33:04 2022] PUT /identity/v3/projects/5524b8f2fcee49f08a13849bf5d8a5e7/users/04fd5fcff0a04e5f831269f8e2b6505b/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:04.387643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bdd25-9a14-4999-85fd-e693adf91d72 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:04.388041 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bdd25-9a14-4999-85fd-e693adf91d72 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:04.388986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bdd25-9a14-4999-85fd-e693adf91d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:04.429273 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-763bdd25-9a14-4999-85fd-e693adf91d72 None None] MFA Rules not processed for user `04fd5fcff0a04e5f831269f8e2b6505b`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:04.430677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-763bdd25-9a14-4999-85fd-e693adf91d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:04.493050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15196015-d94c-4c02-90a2-a9282ce4e398 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:04.496429 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-15196015-d94c-4c02-90a2-a9282ce4e398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:04.621414 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3797/7592] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:04 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:04.657736 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15196015-d94c-4c02-90a2-a9282ce4e398 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:04.661782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27bb93-58cb-4e44-a2fc-da59ccf1d214 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:04.662417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27bb93-58cb-4e44-a2fc-da59ccf1d214 service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:04.662700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27bb93-58cb-4e44-a2fc-da59ccf1d214 service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:04.663184 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27bb93-58cb-4e44-a2fc-da59ccf1d214 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:04.666435 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bdd25-9a14-4999-85fd-e693adf91d72 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:04.666435 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-763bdd25-9a14-4999-85fd-e693adf91d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:04.685916 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2f27bb93-58cb-4e44-a2fc-da59ccf1d214 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:04.708135 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:04.860152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bdd25-9a14-4999-85fd-e693adf91d72 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:04.865295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34f244-27ae-471a-89fd-e54b8b18f5fd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efcee9b21ea94b1b8e5c9c5acb35839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:04.866416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34f244-27ae-471a-89fd-e54b8b18f5fd service glance] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:04.866700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34f244-27ae-471a-89fd-e54b8b18f5fd service glance] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:04.866956 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34f244-27ae-471a-89fd-e54b8b18f5fd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:04.891669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f27bb93-58cb-4e44-a2fc-da59ccf1d214 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:04.893454 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f27bb93-58cb-4e44-a2fc-da59ccf1d214 service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:04.925702 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3796/7593] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:33:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:33:04.942380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34f244-27ae-471a-89fd-e54b8b18f5fd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:04.944050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34f244-27ae-471a-89fd-e54b8b18f5fd service glance] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:04.955453 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3798/7594] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:33:04 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:33:06.234684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db877b34-de48-4066-8cae-2fd966ee719d None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:06.235291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db877b34-de48-4066-8cae-2fd966ee719d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:06.239057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db877b34-de48-4066-8cae-2fd966ee719d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:06.270755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-db877b34-de48-4066-8cae-2fd966ee719d None None] MFA Rules not processed for user `3153fef46b654b4d9d4f6876b51b602a`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:06.272154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-db877b34-de48-4066-8cae-2fd966ee719d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:06.277092 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34f244-27ae-471a-89fd-e54b8b18f5fd service glance] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:06.279648 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9c34f244-27ae-471a-89fd-e54b8b18f5fd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:06.456673 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3797/7595] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:06.480024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34f244-27ae-471a-89fd-e54b8b18f5fd service glance] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:06.488207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91056df0-b392-4feb-af34-a65159a0f45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:06.488207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91056df0-b392-4feb-af34-a65159a0f45d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:06.488207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91056df0-b392-4feb-af34-a65159a0f45d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:06.488207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91056df0-b392-4feb-af34-a65159a0f45d admin admin] PATH_INFO: `/v3/users/3734668c07164b759f9084fdcccf7d36` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:06.490079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91056df0-b392-4feb-af34-a65159a0f45d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3734668c07164b759f9084fdcccf7d36)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:06.492357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91056df0-b392-4feb-af34-a65159a0f45d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:06.609938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-91056df0-b392-4feb-af34-a65159a0f45d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3734668c07164b759f9084fdcccf7d36'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:06.611163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-91056df0-b392-4feb-af34-a65159a0f45d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3734668c07164b759f9084fdcccf7d36'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:06.618506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-91056df0-b392-4feb-af34-a65159a0f45d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3734668c07164b759f9084fdcccf7d36'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:06.623600 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:06.646384 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-91056df0-b392-4feb-af34-a65159a0f45d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3734668c07164b759f9084fdcccf7d36'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:06.647152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-91056df0-b392-4feb-af34-a65159a0f45d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3734668c07164b759f9084fdcccf7d36'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:06.673937 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3799/7596] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:33:06 2022] DELETE /identity/v3/users/3734668c07164b759f9084fdcccf7d36 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:06.815860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db877b34-de48-4066-8cae-2fd966ee719d None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:06.841816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db877b34-de48-4066-8cae-2fd966ee719d None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:06.962503 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:07.026852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d265a8-b2ea-4d5a-a4b4-98b98d259b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:07.027693 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d265a8-b2ea-4d5a-a4b4-98b98d259b10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:07.027972 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d265a8-b2ea-4d5a-a4b4-98b98d259b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:07.028247 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d265a8-b2ea-4d5a-a4b4-98b98d259b10 admin admin] PATH_INFO: `/v3/users/d3df0c295108482e846e5c428ae2e697` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:07.030491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d265a8-b2ea-4d5a-a4b4-98b98d259b10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3df0c295108482e846e5c428ae2e697)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:07.035667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d265a8-b2ea-4d5a-a4b4-98b98d259b10 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:07.135743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e2d265a8-b2ea-4d5a-a4b4-98b98d259b10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3df0c295108482e846e5c428ae2e697'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:07.136454 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e2d265a8-b2ea-4d5a-a4b4-98b98d259b10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3df0c295108482e846e5c428ae2e697'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:07.152733 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e2d265a8-b2ea-4d5a-a4b4-98b98d259b10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3df0c295108482e846e5c428ae2e697'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:07.178587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e2d265a8-b2ea-4d5a-a4b4-98b98d259b10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3df0c295108482e846e5c428ae2e697'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:07.178737 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e2d265a8-b2ea-4d5a-a4b4-98b98d259b10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3df0c295108482e846e5c428ae2e697'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:07.228500 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3798/7597] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:33:06 2022] DELETE /identity/v3/users/d3df0c295108482e846e5c428ae2e697 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:07.230296 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143c78c-8923-4def-b30b-be05fb82c447 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:07.230577 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143c78c-8923-4def-b30b-be05fb82c447 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:07.230858 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143c78c-8923-4def-b30b-be05fb82c447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:07.290804 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e143c78c-8923-4def-b30b-be05fb82c447 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:07.303595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e143c78c-8923-4def-b30b-be05fb82c447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:07.357953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d265a8-b2ea-4d5a-a4b4-98b98d259b10 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:07.359639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e2d265a8-b2ea-4d5a-a4b4-98b98d259b10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:07.508735 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3800/7598] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:07.516596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143c78c-8923-4def-b30b-be05fb82c447 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:07.519596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e143c78c-8923-4def-b30b-be05fb82c447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:07.572488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d265a8-b2ea-4d5a-a4b4-98b98d259b10 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:07.588973 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19c2db-8ab2-41e0-a8da-612b26298a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:07.591212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19c2db-8ab2-41e0-a8da-612b26298a78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:07.591491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19c2db-8ab2-41e0-a8da-612b26298a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:07.591762 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19c2db-8ab2-41e0-a8da-612b26298a78 admin admin] PATH_INFO: `/v3/projects/9a8bafab6be64fe1be010e4385039b09` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:07.595741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19c2db-8ab2-41e0-a8da-612b26298a78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a8bafab6be64fe1be010e4385039b09)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:07.609605 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19c2db-8ab2-41e0-a8da-612b26298a78 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:07.691544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143c78c-8923-4def-b30b-be05fb82c447 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:07.708785 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fc0f0-c7b2-4f4c-bda1-efd36df5c57a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:07.709419 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fc0f0-c7b2-4f4c-bda1-efd36df5c57a service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:07.709716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fc0f0-c7b2-4f4c-bda1-efd36df5c57a service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:07.709986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fc0f0-c7b2-4f4c-bda1-efd36df5c57a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:07.733388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4f19c2db-8ab2-41e0-a8da-612b26298a78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a8bafab6be64fe1be010e4385039b09', 'request_id': 'req-4f19c2db-8ab2-41e0-a8da-612b26298a78'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:07.739529 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:07.742948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1fc0f0-c7b2-4f4c-bda1-efd36df5c57a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:07.745971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1fc0f0-c7b2-4f4c-bda1-efd36df5c57a service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:07.749193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4f19c2db-8ab2-41e0-a8da-612b26298a78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a8bafab6be64fe1be010e4385039b09', 'request_id': 'req-4f19c2db-8ab2-41e0-a8da-612b26298a78'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:07.759587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4f19c2db-8ab2-41e0-a8da-612b26298a78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a8bafab6be64fe1be010e4385039b09', 'request_id': 'req-4f19c2db-8ab2-41e0-a8da-612b26298a78'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:07.773484 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3801/7599] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:33:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:33:07.803123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4f19c2db-8ab2-41e0-a8da-612b26298a78 admin admin] The token cache is being invalidate because project 9a8bafab6be64fe1be010e4385039b09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:33:07.803655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4f19c2db-8ab2-41e0-a8da-612b26298a78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:07.805250 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4f19c2db-8ab2-41e0-a8da-612b26298a78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:07.808885 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3799/7600] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:33:07 2022] DELETE /identity/v3/projects/9a8bafab6be64fe1be010e4385039b09 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:07.816264 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708927e0-39a8-43d0-8746-ac5c5415d986 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:07.817577 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708927e0-39a8-43d0-8746-ac5c5415d986 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:07.820225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708927e0-39a8-43d0-8746-ac5c5415d986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:07.874447 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-708927e0-39a8-43d0-8746-ac5c5415d986 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:07.879864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-708927e0-39a8-43d0-8746-ac5c5415d986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:08.275435 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3802/7601] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:08.277484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d499c6f-c11a-4112-9d79-4bd1df7dbc8b None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:08.278104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d499c6f-c11a-4112-9d79-4bd1df7dbc8b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:08.278104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d499c6f-c11a-4112-9d79-4bd1df7dbc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:08.325499 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-8d499c6f-c11a-4112-9d79-4bd1df7dbc8b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:08.326754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8d499c6f-c11a-4112-9d79-4bd1df7dbc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:08.354691 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3800/7602] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:08.356382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708927e0-39a8-43d0-8746-ac5c5415d986 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:08.371880 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708927e0-39a8-43d0-8746-ac5c5415d986 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:08.390560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdfe23-c384-4dd2-955e-9b3ac9251d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:08.391414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdfe23-c384-4dd2-955e-9b3ac9251d17 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:08.391928 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdfe23-c384-4dd2-955e-9b3ac9251d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:08.392134 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdfe23-c384-4dd2-955e-9b3ac9251d17 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:08.392812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cdfe23-c384-4dd2-955e-9b3ac9251d17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:33:08.393119 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cdfe23-c384-4dd2-955e-9b3ac9251d17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:08.394806 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cdfe23-c384-4dd2-955e-9b3ac9251d17 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:08.433356 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3803/7603] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:33:08.434627 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d499c6f-c11a-4112-9d79-4bd1df7dbc8b None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:08.445939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d499c6f-c11a-4112-9d79-4bd1df7dbc8b None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:08.465290 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d40b1-eae0-4c1c-b5b1-e9f6e18231e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:08.466023 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d40b1-eae0-4c1c-b5b1-e9f6e18231e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:08.466660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d40b1-eae0-4c1c-b5b1-e9f6e18231e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:08.466660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d40b1-eae0-4c1c-b5b1-e9f6e18231e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:08.467193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d40b1-eae0-4c1c-b5b1-e9f6e18231e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:08.469087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d40b1-eae0-4c1c-b5b1-e9f6e18231e6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:08.532500 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3801/7604] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:33:08 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:08.536406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdfe23-c384-4dd2-955e-9b3ac9251d17 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:08.544258 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:08.554720 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdfe23-c384-4dd2-955e-9b3ac9251d17 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:08.724265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d6c0a-d9e1-4305-b098-4f5cd22cef3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:08.724817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d6c0a-d9e1-4305-b098-4f5cd22cef3a admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:08.725093 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d6c0a-d9e1-4305-b098-4f5cd22cef3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:08.725363 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d6c0a-d9e1-4305-b098-4f5cd22cef3a admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:08.726039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d6c0a-d9e1-4305-b098-4f5cd22cef3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:08.736942 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d6c0a-d9e1-4305-b098-4f5cd22cef3a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:08.804500 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3804/7605] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:33:08 2022] POST /identity/v3/users => generated 289 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:33:08.805467 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d40b1-eae0-4c1c-b5b1-e9f6e18231e6 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:08.819629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d40b1-eae0-4c1c-b5b1-e9f6e18231e6 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:08.843004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d6bcc-226d-4a2a-b39a-119839824b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:08.845180 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d6bcc-226d-4a2a-b39a-119839824b28 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:08.845521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d6bcc-226d-4a2a-b39a-119839824b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:08.845845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d6bcc-226d-4a2a-b39a-119839824b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:08.849770 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29d6bcc-226d-4a2a-b39a-119839824b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:08.855356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29d6bcc-226d-4a2a-b39a-119839824b28 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:08.882941 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3802/7606] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:33:08.884775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d6c0a-d9e1-4305-b098-4f5cd22cef3a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:08.903167 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d6c0a-d9e1-4305-b098-4f5cd22cef3a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:08.919710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8bd72-3117-43e9-938e-296b2e873acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:08.922028 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8bd72-3117-43e9-938e-296b2e873acd admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:08.922199 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8bd72-3117-43e9-938e-296b2e873acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:08.922422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8bd72-3117-43e9-938e-296b2e873acd admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:08.922986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8bd72-3117-43e9-938e-296b2e873acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:08.925467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8bd72-3117-43e9-938e-296b2e873acd admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:08.945969 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3805/7607] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:33:08.947557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d6bcc-226d-4a2a-b39a-119839824b28 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:08.988443 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d6bcc-226d-4a2a-b39a-119839824b28 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:09.011104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8900688-713f-46de-a135-d4c6ab80bbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:09.011901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8900688-713f-46de-a135-d4c6ab80bbe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:09.012399 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8900688-713f-46de-a135-d4c6ab80bbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:09.012959 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8900688-713f-46de-a135-d4c6ab80bbe0 admin admin] PATH_INFO: `/v3/projects/be42857300594461ab29a592932c0dac/users/e2e7bed11a2f4d2684fa1ded80ad24a1/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:09.028268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8bd72-3117-43e9-938e-296b2e873acd admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:09.030254 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1ec8bd72-3117-43e9-938e-296b2e873acd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:09.059347 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8900688-713f-46de-a135-d4c6ab80bbe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be42857300594461ab29a592932c0dac, user_id=e2e7bed11a2f4d2684fa1ded80ad24a1, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:09.060272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8bd72-3117-43e9-938e-296b2e873acd admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:09.063961 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8900688-713f-46de-a135-d4c6ab80bbe0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:09.081214 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8f78c-8942-4ac1-8e23-9ec361dafbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:09.081845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8f78c-8942-4ac1-8e23-9ec361dafbd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:09.084470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8f78c-8942-4ac1-8e23-9ec361dafbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:09.085325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8f78c-8942-4ac1-8e23-9ec361dafbd7 admin admin] PATH_INFO: `/v3/projects/72f290a8cb6b44f0a026a16ae77c1748` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:09.086926 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b8f78c-8942-4ac1-8e23-9ec361dafbd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72f290a8cb6b44f0a026a16ae77c1748)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:09.095929 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b8f78c-8942-4ac1-8e23-9ec361dafbd7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:09.099216 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3803/7608] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:33:08 2022] PUT /identity/v3/projects/be42857300594461ab29a592932c0dac/users/e2e7bed11a2f4d2684fa1ded80ad24a1/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:09.109695 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d41eb0-3530-4671-9c71-7078194e1562 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:09.109980 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d41eb0-3530-4671-9c71-7078194e1562 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:09.110261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d41eb0-3530-4671-9c71-7078194e1562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:09.180308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-36d41eb0-3530-4671-9c71-7078194e1562 None None] MFA Rules not processed for user `e2e7bed11a2f4d2684fa1ded80ad24a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:09.181557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-36d41eb0-3530-4671-9c71-7078194e1562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:09.231883 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e9b8f78c-8942-4ac1-8e23-9ec361dafbd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72f290a8cb6b44f0a026a16ae77c1748', 'request_id': 'req-e9b8f78c-8942-4ac1-8e23-9ec361dafbd7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:09.251256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e9b8f78c-8942-4ac1-8e23-9ec361dafbd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72f290a8cb6b44f0a026a16ae77c1748', 'request_id': 'req-e9b8f78c-8942-4ac1-8e23-9ec361dafbd7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:09.278608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e9b8f78c-8942-4ac1-8e23-9ec361dafbd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72f290a8cb6b44f0a026a16ae77c1748', 'request_id': 'req-e9b8f78c-8942-4ac1-8e23-9ec361dafbd7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:09.305953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e9b8f78c-8942-4ac1-8e23-9ec361dafbd7 admin admin] The token cache is being invalidate because project 72f290a8cb6b44f0a026a16ae77c1748 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:33:09.306702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e9b8f78c-8942-4ac1-8e23-9ec361dafbd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:09.313401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e9b8f78c-8942-4ac1-8e23-9ec361dafbd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:09.318042 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3806/7609] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:33:09 2022] DELETE /identity/v3/projects/72f290a8cb6b44f0a026a16ae77c1748 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:33:09.322231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8f78c-8942-4ac1-8e23-9ec361dafbd7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:09.325592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e9b8f78c-8942-4ac1-8e23-9ec361dafbd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:09.399341 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3804/7610] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:33:09.400460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d41eb0-3530-4671-9c71-7078194e1562 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:09.402156 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-36d41eb0-3530-4671-9c71-7078194e1562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:09.544232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8f78c-8942-4ac1-8e23-9ec361dafbd7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:09.550371 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d41eb0-3530-4671-9c71-7078194e1562 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:09.555488 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87914e2-d65f-4d2a-8028-1a7f0a7e6d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:09.556496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87914e2-d65f-4d2a-8028-1a7f0a7e6d20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:09.557415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87914e2-d65f-4d2a-8028-1a7f0a7e6d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:09.558519 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87914e2-d65f-4d2a-8028-1a7f0a7e6d20 admin admin] PATH_INFO: `/v3/users/04fd5fcff0a04e5f831269f8e2b6505b` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:09.560900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87914e2-d65f-4d2a-8028-1a7f0a7e6d20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04fd5fcff0a04e5f831269f8e2b6505b)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:09.564212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87914e2-d65f-4d2a-8028-1a7f0a7e6d20 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:09.565217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16313594-7aa3-4b1e-af4e-7f0b6047f4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:09.566211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16313594-7aa3-4b1e-af4e-7f0b6047f4be admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:09.566768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16313594-7aa3-4b1e-af4e-7f0b6047f4be admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:09.569057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16313594-7aa3-4b1e-af4e-7f0b6047f4be admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:09.570364 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16313594-7aa3-4b1e-af4e-7f0b6047f4be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:09.572534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16313594-7aa3-4b1e-af4e-7f0b6047f4be admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:09.593961 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:09.603285 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:09.632319 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3805/7611] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:33:09 2022] POST /identity/v3/projects => generated 377 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:09.637166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16313594-7aa3-4b1e-af4e-7f0b6047f4be admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:09.699677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a87914e2-d65f-4d2a-8028-1a7f0a7e6d20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04fd5fcff0a04e5f831269f8e2b6505b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:09.701834 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a87914e2-d65f-4d2a-8028-1a7f0a7e6d20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04fd5fcff0a04e5f831269f8e2b6505b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:09.728846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a87914e2-d65f-4d2a-8028-1a7f0a7e6d20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04fd5fcff0a04e5f831269f8e2b6505b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:09.747791 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a87914e2-d65f-4d2a-8028-1a7f0a7e6d20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04fd5fcff0a04e5f831269f8e2b6505b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:09.748628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a87914e2-d65f-4d2a-8028-1a7f0a7e6d20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04fd5fcff0a04e5f831269f8e2b6505b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:09.812430 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3807/7612] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:33:09 2022] DELETE /identity/v3/users/04fd5fcff0a04e5f831269f8e2b6505b => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:09.867031 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16313594-7aa3-4b1e-af4e-7f0b6047f4be admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:10.142882 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce0453-2162-4325-85fe-6f9669bd2b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:10.143847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce0453-2162-4325-85fe-6f9669bd2b37 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:10.144392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce0453-2162-4325-85fe-6f9669bd2b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:10.144877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce0453-2162-4325-85fe-6f9669bd2b37 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:10.145805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce0453-2162-4325-85fe-6f9669bd2b37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:10.148016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce0453-2162-4325-85fe-6f9669bd2b37 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:10.203570 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3806/7613] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:33:09 2022] POST /identity/v3/users => generated 295 bytes in 567 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:10.205956 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87914e2-d65f-4d2a-8028-1a7f0a7e6d20 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:10.207571 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a87914e2-d65f-4d2a-8028-1a7f0a7e6d20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:10.245515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87914e2-d65f-4d2a-8028-1a7f0a7e6d20 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:10.253128 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b6722a-9c03-4a07-9fa4-57f806e37727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:10.255645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6722a-9c03-4a07-9fa4-57f806e37727 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:10.257322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6722a-9c03-4a07-9fa4-57f806e37727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:10.257852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6722a-9c03-4a07-9fa4-57f806e37727 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:10.261390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b6722a-9c03-4a07-9fa4-57f806e37727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:10.264421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b6722a-9c03-4a07-9fa4-57f806e37727 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:10.310284 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce0453-2162-4325-85fe-6f9669bd2b37 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:10.310797 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3808/7614] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:33:10.326989 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce0453-2162-4325-85fe-6f9669bd2b37 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:10.356734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44d75b-64df-4d29-8810-43bfe64da5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:10.362778 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44d75b-64df-4d29-8810-43bfe64da5c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:10.369524 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44d75b-64df-4d29-8810-43bfe64da5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:10.369953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44d75b-64df-4d29-8810-43bfe64da5c7 admin admin] PATH_INFO: `/v3/projects/d9891c9c0bce4d82a38b82cb464c4d98/users/0d2afb0481b14a04be8d83a39e98db35/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:10.472433 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44d75b-64df-4d29-8810-43bfe64da5c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9891c9c0bce4d82a38b82cb464c4d98, user_id=0d2afb0481b14a04be8d83a39e98db35, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:10.490009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44d75b-64df-4d29-8810-43bfe64da5c7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:10.545783 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3807/7615] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:33:10 2022] PUT /identity/v3/projects/d9891c9c0bce4d82a38b82cb464c4d98/users/0d2afb0481b14a04be8d83a39e98db35/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:10.550540 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b6722a-9c03-4a07-9fa4-57f806e37727 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:10.578954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b6722a-9c03-4a07-9fa4-57f806e37727 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:10.771580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154602c-e0bb-438c-893d-e2744e18735c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:10.772209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154602c-e0bb-438c-893d-e2744e18735c admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:10.772638 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154602c-e0bb-438c-893d-e2744e18735c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:10.772914 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154602c-e0bb-438c-893d-e2744e18735c admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:10.779900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7154602c-e0bb-438c-893d-e2744e18735c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:10.789922 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7154602c-e0bb-438c-893d-e2744e18735c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:10.835698 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3809/7616] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:33:10.836921 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44d75b-64df-4d29-8810-43bfe64da5c7 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:10.860304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44d75b-64df-4d29-8810-43bfe64da5c7 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:10.886901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2966387-ded8-4314-88c6-216969b5382e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:10.887870 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2966387-ded8-4314-88c6-216969b5382e admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:10.888476 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2966387-ded8-4314-88c6-216969b5382e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:10.889008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2966387-ded8-4314-88c6-216969b5382e admin admin] PATH_INFO: `/v3/projects/d9891c9c0bce4d82a38b82cb464c4d98/users/0d2afb0481b14a04be8d83a39e98db35/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:10.896871 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2966387-ded8-4314-88c6-216969b5382e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9891c9c0bce4d82a38b82cb464c4d98, user_id=0d2afb0481b14a04be8d83a39e98db35, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:10.904208 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2966387-ded8-4314-88c6-216969b5382e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:10.949470 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3808/7617] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:33:10 2022] PUT /identity/v3/projects/d9891c9c0bce4d82a38b82cb464c4d98/users/0d2afb0481b14a04be8d83a39e98db35/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:11.058548 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092740e-9396-4c32-b1c1-2de5a314373a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:11.059076 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092740e-9396-4c32-b1c1-2de5a314373a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:11.059765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092740e-9396-4c32-b1c1-2de5a314373a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:11.134310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a092740e-9396-4c32-b1c1-2de5a314373a None None] MFA Rules not processed for user `0d2afb0481b14a04be8d83a39e98db35`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:11.156898 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a092740e-9396-4c32-b1c1-2de5a314373a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:11.410083 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:11.436687 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3810/7618] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:33:11.438913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2966387-ded8-4314-88c6-216969b5382e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:11.439081 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092740e-9396-4c32-b1c1-2de5a314373a None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:11.447647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d2966387-ded8-4314-88c6-216969b5382e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:11.453499 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092740e-9396-4c32-b1c1-2de5a314373a None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:11.465877 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec738788-616a-4bb2-8d0f-d168840c4f1a tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2afb0481b14a04be8d83a39e98db35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9891c9c0bce4d82a38b82cb464c4d98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:11.466703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec738788-616a-4bb2-8d0f-d168840c4f1a tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:11.467212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec738788-616a-4bb2-8d0f-d168840c4f1a tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:11.467612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec738788-616a-4bb2-8d0f-d168840c4f1a tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:11.468374 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec738788-616a-4bb2-8d0f-d168840c4f1a tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:11.472668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec738788-616a-4bb2-8d0f-d168840c4f1a tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:11.514120 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3811/7619] 10.222.0.30 () {60 vars in 1149 bytes} [Sun Sep 4 01:33:11 2022] POST /identity/v3/domains => generated 246 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:33:11.518494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec738788-616a-4bb2-8d0f-d168840c4f1a tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:11.543210 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:11.560924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2966387-ded8-4314-88c6-216969b5382e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:11.739778 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee458aae-f41e-4df1-a666-540276afb0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:11.741211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee458aae-f41e-4df1-a666-540276afb0eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:11.741732 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee458aae-f41e-4df1-a666-540276afb0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:11.742236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee458aae-f41e-4df1-a666-540276afb0eb admin admin] PATH_INFO: `/v3/projects/5524b8f2fcee49f08a13849bf5d8a5e7` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:11.748583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec738788-616a-4bb2-8d0f-d168840c4f1a tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:11.752136 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee458aae-f41e-4df1-a666-540276afb0eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5524b8f2fcee49f08a13849bf5d8a5e7)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:11.763138 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee458aae-f41e-4df1-a666-540276afb0eb admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:11.763866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f4681-6fe2-4b1b-aed7-86b7a3aacc78 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2afb0481b14a04be8d83a39e98db35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9891c9c0bce4d82a38b82cb464c4d98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:11.764542 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f4681-6fe2-4b1b-aed7-86b7a3aacc78 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:11.765325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f4681-6fe2-4b1b-aed7-86b7a3aacc78 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:11.765767 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f4681-6fe2-4b1b-aed7-86b7a3aacc78 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:11.766572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f4681-6fe2-4b1b-aed7-86b7a3aacc78 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:11.769865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f4681-6fe2-4b1b-aed7-86b7a3aacc78 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:11.862927 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3812/7620] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:33:11 2022] POST /identity/v3/projects => generated 408 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:11.867657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f4681-6fe2-4b1b-aed7-86b7a3aacc78 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:11.944856 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ee458aae-f41e-4df1-a666-540276afb0eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5524b8f2fcee49f08a13849bf5d8a5e7', 'request_id': 'req-ee458aae-f41e-4df1-a666-540276afb0eb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:11.968540 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ee458aae-f41e-4df1-a666-540276afb0eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5524b8f2fcee49f08a13849bf5d8a5e7', 'request_id': 'req-ee458aae-f41e-4df1-a666-540276afb0eb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:11.989990 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ee458aae-f41e-4df1-a666-540276afb0eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5524b8f2fcee49f08a13849bf5d8a5e7', 'request_id': 'req-ee458aae-f41e-4df1-a666-540276afb0eb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:12.027658 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ee458aae-f41e-4df1-a666-540276afb0eb admin admin] The token cache is being invalidate because project 5524b8f2fcee49f08a13849bf5d8a5e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:33:12.029817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ee458aae-f41e-4df1-a666-540276afb0eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:12.033934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ee458aae-f41e-4df1-a666-540276afb0eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:12.038483 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3809/7621] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:33:11 2022] DELETE /identity/v3/projects/5524b8f2fcee49f08a13849bf5d8a5e7 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:12.044261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c0bd8-52b0-4f4f-aa6d-f840b8704f56 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:12.044589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c0bd8-52b0-4f4f-aa6d-f840b8704f56 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:12.044801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c0bd8-52b0-4f4f-aa6d-f840b8704f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:12.118780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-3b5c0bd8-52b0-4f4f-aa6d-f840b8704f56 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:12.120590 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3b5c0bd8-52b0-4f4f-aa6d-f840b8704f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:12.134494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f4681-6fe2-4b1b-aed7-86b7a3aacc78 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:12.340002 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3810/7622] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:12.348365 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef914132-6c37-475f-9374-6ab1080cce2d None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:12.348647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef914132-6c37-475f-9374-6ab1080cce2d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:12.348923 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef914132-6c37-475f-9374-6ab1080cce2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:12.401625 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-ef914132-6c37-475f-9374-6ab1080cce2d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:12.402852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ef914132-6c37-475f-9374-6ab1080cce2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:12.408427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa44168-f889-4a4c-9b3d-1c24d9088bb7 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2afb0481b14a04be8d83a39e98db35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9891c9c0bce4d82a38b82cb464c4d98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:12.410567 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa44168-f889-4a4c-9b3d-1c24d9088bb7 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:12.411173 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa44168-f889-4a4c-9b3d-1c24d9088bb7 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:12.411703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa44168-f889-4a4c-9b3d-1c24d9088bb7 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:12.412609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa44168-f889-4a4c-9b3d-1c24d9088bb7 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:12.422360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa44168-f889-4a4c-9b3d-1c24d9088bb7 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:12.457622 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:12.462004 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3811/7623] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:12.463281 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef914132-6c37-475f-9374-6ab1080cce2d None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:12.501834 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3813/7624] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:33:11 2022] POST /identity/v3/users => generated 347 bytes in 635 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:33:12.502649 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa44168-f889-4a4c-9b3d-1c24d9088bb7 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:12.507635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef914132-6c37-475f-9374-6ab1080cce2d None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:12.515493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-faa44168-f889-4a4c-9b3d-1c24d9088bb7 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:12.545814 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2803fb4-f85d-4775-880e-5cc4a6f805df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:12.546342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2803fb4-f85d-4775-880e-5cc4a6f805df admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:12.546626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2803fb4-f85d-4775-880e-5cc4a6f805df admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:12.546946 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2803fb4-f85d-4775-880e-5cc4a6f805df admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:12.547565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2803fb4-f85d-4775-880e-5cc4a6f805df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:33:12.553409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2803fb4-f85d-4775-880e-5cc4a6f805df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:12.555574 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2803fb4-f85d-4775-880e-5cc4a6f805df admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:12.564089 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa44168-f889-4a4c-9b3d-1c24d9088bb7 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:12.578945 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c977289-cebb-437c-b23f-47e7c69532e0 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2afb0481b14a04be8d83a39e98db35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9891c9c0bce4d82a38b82cb464c4d98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:12.580045 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c977289-cebb-437c-b23f-47e7c69532e0 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:12.580345 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c977289-cebb-437c-b23f-47e7c69532e0 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:12.580623 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c977289-cebb-437c-b23f-47e7c69532e0 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:12.581361 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c977289-cebb-437c-b23f-47e7c69532e0 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:12.584233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c977289-cebb-437c-b23f-47e7c69532e0 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:12.623293 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3812/7625] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:33:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:33:12.623835 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3814/7626] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:33:12.626813 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c977289-cebb-437c-b23f-47e7c69532e0 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:12.628299 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2803fb4-f85d-4775-880e-5cc4a6f805df admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:12.656770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c977289-cebb-437c-b23f-47e7c69532e0 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:12.665645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2803fb4-f85d-4775-880e-5cc4a6f805df admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:12.674117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41216b49-f423-4072-be71-ba575a29d923 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2afb0481b14a04be8d83a39e98db35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9891c9c0bce4d82a38b82cb464c4d98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:12.676137 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41216b49-f423-4072-be71-ba575a29d923 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:12.679990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41216b49-f423-4072-be71-ba575a29d923 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:12.680902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f3663-714b-41f3-b6d0-e0c6cbefc22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:12.681664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41216b49-f423-4072-be71-ba575a29d923 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] PATH_INFO: `/v3/projects/0334eb6c96b345c8a16e2e54a124cc08/users/33e182a36e4946368ec5f8d153409047/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:12.683717 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f3663-714b-41f3-b6d0-e0c6cbefc22b admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:12.684256 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f3663-714b-41f3-b6d0-e0c6cbefc22b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:12.685635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f3663-714b-41f3-b6d0-e0c6cbefc22b admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:12.688453 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f3663-714b-41f3-b6d0-e0c6cbefc22b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:12.691985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f3663-714b-41f3-b6d0-e0c6cbefc22b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:12.732872 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41216b49-f423-4072-be71-ba575a29d923 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0334eb6c96b345c8a16e2e54a124cc08, user_id=33e182a36e4946368ec5f8d153409047, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:12.733614 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:12.740217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41216b49-f423-4072-be71-ba575a29d923 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:12.823181 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3813/7627] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:33:12 2022] POST /identity/v3/projects => generated 373 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:12.823667 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3815/7628] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:33:12 2022] PUT /identity/v3/projects/0334eb6c96b345c8a16e2e54a124cc08/users/33e182a36e4946368ec5f8d153409047/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:12.827995 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f3663-714b-41f3-b6d0-e0c6cbefc22b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:12.829723 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bfe9c-405d-4e4d-95b9-36ac6a47cab3 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:12.834005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bfe9c-405d-4e4d-95b9-36ac6a47cab3 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:12.835186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bfe9c-405d-4e4d-95b9-36ac6a47cab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:13.023919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f3663-714b-41f3-b6d0-e0c6cbefc22b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:13.039490 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1d601-500a-41d2-b2d4-43e574d1e200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:13.040129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1d601-500a-41d2-b2d4-43e574d1e200 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:13.040408 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1d601-500a-41d2-b2d4-43e574d1e200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:13.040676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1d601-500a-41d2-b2d4-43e574d1e200 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:13.044340 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1d601-500a-41d2-b2d4-43e574d1e200 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:13.047287 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1d601-500a-41d2-b2d4-43e574d1e200 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:13.098677 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3814/7629] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:33:12 2022] POST /identity/v3/users => generated 287 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:13.105706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1d601-500a-41d2-b2d4-43e574d1e200 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:13.117800 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c91bfe9c-405d-4e4d-95b9-36ac6a47cab3 None None] MFA Rules not processed for user `33e182a36e4946368ec5f8d153409047`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:13.125170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c91bfe9c-405d-4e4d-95b9-36ac6a47cab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:13.133190 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1d601-500a-41d2-b2d4-43e574d1e200 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:13.142374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878c955-272c-4f00-9421-dd2e57db3acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:13.143436 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878c955-272c-4f00-9421-dd2e57db3acd admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:13.143845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878c955-272c-4f00-9421-dd2e57db3acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:13.144233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878c955-272c-4f00-9421-dd2e57db3acd admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:13.145016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9878c955-272c-4f00-9421-dd2e57db3acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:13.146884 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9878c955-272c-4f00-9421-dd2e57db3acd admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:13.162718 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3815/7630] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:33:13.166006 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3816/7631] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:12 2022] POST /identity/v3/auth/tokens => generated 3361 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:13.167606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878c955-272c-4f00-9421-dd2e57db3acd admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:13.175943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06378e-184d-4c07-8394-3c8cf1ee9fd4 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:13.176258 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06378e-184d-4c07-8394-3c8cf1ee9fd4 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:13.176532 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06378e-184d-4c07-8394-3c8cf1ee9fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:13.183455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878c955-272c-4f00-9421-dd2e57db3acd admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:13.191067 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7df359-0d12-4df8-8808-aa146a7de0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:13.192161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7df359-0d12-4df8-8808-aa146a7de0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:13.192666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7df359-0d12-4df8-8808-aa146a7de0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:13.193211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7df359-0d12-4df8-8808-aa146a7de0e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:13.194146 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7df359-0d12-4df8-8808-aa146a7de0e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:13.197253 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7df359-0d12-4df8-8808-aa146a7de0e2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:13.215019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ec06378e-184d-4c07-8394-3c8cf1ee9fd4 None None] MFA Rules not processed for user `33e182a36e4946368ec5f8d153409047`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:13.217065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ec06378e-184d-4c07-8394-3c8cf1ee9fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:13.225246 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3816/7632] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:33:13.230074 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7df359-0d12-4df8-8808-aa146a7de0e2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:13.240469 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3817/7633] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:13 2022] POST /identity/v3/auth/tokens => generated 3361 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:33:13.244518 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7df359-0d12-4df8-8808-aa146a7de0e2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:13.247443 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec06378e-184d-4c07-8394-3c8cf1ee9fd4 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:13.263557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d070cc31-95df-4b61-ac19-0d93ba4a3a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:13.264253 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070cc31-95df-4b61-ac19-0d93ba4a3a88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:13.265740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070cc31-95df-4b61-ac19-0d93ba4a3a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:13.265993 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070cc31-95df-4b61-ac19-0d93ba4a3a88 admin admin] PATH_INFO: `/v3/projects/656ead3c0673462d8d82a95491a41158/users/fd1d17e0f2014f6f8c616714710bb59d/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:13.282528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec06378e-184d-4c07-8394-3c8cf1ee9fd4 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:13.289042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd70f7-8a48-4369-9afa-76682d75796b tempest-test_project-280965522 tempest-user-621080000] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33e182a36e4946368ec5f8d153409047', 'user_domain_id': '83bb7869eb704bb39ea0c04213fa894e', 'system_scope': None, 'project_id': '0334eb6c96b345c8a16e2e54a124cc08', 'project_domain_id': '83bb7869eb704bb39ea0c04213fa894e', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:13.290305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd70f7-8a48-4369-9afa-76682d75796b tempest-test_project-280965522 tempest-user-621080000] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:13.290845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd70f7-8a48-4369-9afa-76682d75796b tempest-test_project-280965522 tempest-user-621080000] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:13.291270 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd70f7-8a48-4369-9afa-76682d75796b tempest-test_project-280965522 tempest-user-621080000] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:13.303437 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd70f7-8a48-4369-9afa-76682d75796b tempest-test_project-280965522 tempest-user-621080000] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:13.305865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd70f7-8a48-4369-9afa-76682d75796b tempest-test_project-280965522 tempest-user-621080000] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:13.317477 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d070cc31-95df-4b61-ac19-0d93ba4a3a88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=656ead3c0673462d8d82a95491a41158, user_id=fd1d17e0f2014f6f8c616714710bb59d, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:13.324346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d070cc31-95df-4b61-ac19-0d93ba4a3a88 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:13.333930 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3818/7634] 10.222.0.30 () {56 vars in 1284 bytes} [Sun Sep 4 01:33:13 2022] GET /identity/v3/auth/tokens => generated 3361 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:33:13.340474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd70f7-8a48-4369-9afa-76682d75796b tempest-test_project-280965522 tempest-user-621080000] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:13.363058 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3817/7635] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:33:13 2022] PUT /identity/v3/projects/656ead3c0673462d8d82a95491a41158/users/fd1d17e0f2014f6f8c616714710bb59d/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:33:13.374858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02164c69-b910-49c3-9fec-3640db43a500 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:13.375369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02164c69-b910-49c3-9fec-3640db43a500 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:13.375648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02164c69-b910-49c3-9fec-3640db43a500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:13.449681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-02164c69-b910-49c3-9fec-3640db43a500 None None] MFA Rules not processed for user `fd1d17e0f2014f6f8c616714710bb59d`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:13.451028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-02164c69-b910-49c3-9fec-3640db43a500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:13.465747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd70f7-8a48-4369-9afa-76682d75796b tempest-test_project-280965522 tempest-user-621080000] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:13.495653 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:13.592150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e456ed-e38c-41ce-9432-09f145c848b9 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2afb0481b14a04be8d83a39e98db35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9891c9c0bce4d82a38b82cb464c4d98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:13.596559 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3818/7636] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:33:13.596741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e456ed-e38c-41ce-9432-09f145c848b9 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:13.596741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e456ed-e38c-41ce-9432-09f145c848b9 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:13.596741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e456ed-e38c-41ce-9432-09f145c848b9 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] PATH_INFO: `/v3/users/33e182a36e4946368ec5f8d153409047` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:13.596741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e456ed-e38c-41ce-9432-09f145c848b9 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] RBAC: Authorizing `identity:delete_user(user_id=33e182a36e4946368ec5f8d153409047)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:13.606696 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02164c69-b910-49c3-9fec-3640db43a500 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:13.607036 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e456ed-e38c-41ce-9432-09f145c848b9 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:13.610920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-02164c69-b910-49c3-9fec-3640db43a500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:13.660559 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:13.673565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f5e456ed-e38c-41ce-9432-09f145c848b9 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33e182a36e4946368ec5f8d153409047'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:13.674294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f5e456ed-e38c-41ce-9432-09f145c848b9 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33e182a36e4946368ec5f8d153409047'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:13.682661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f5e456ed-e38c-41ce-9432-09f145c848b9 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33e182a36e4946368ec5f8d153409047'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:13.708469 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f5e456ed-e38c-41ce-9432-09f145c848b9 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33e182a36e4946368ec5f8d153409047'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:13.709425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f5e456ed-e38c-41ce-9432-09f145c848b9 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33e182a36e4946368ec5f8d153409047'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:13.727449 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02164c69-b910-49c3-9fec-3640db43a500 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:13.747164 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10413a94-2abe-4f7d-8c80-93284cd8c108 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efcee9b21ea94b1b8e5c9c5acb35839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:13.747164 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10413a94-2abe-4f7d-8c80-93284cd8c108 service glance] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:13.747538 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10413a94-2abe-4f7d-8c80-93284cd8c108 service glance] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:13.747538 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10413a94-2abe-4f7d-8c80-93284cd8c108 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:13.753493 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3819/7637] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:33:13 2022] DELETE /identity/v3/users/33e182a36e4946368ec5f8d153409047 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:13.754922 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-10413a94-2abe-4f7d-8c80-93284cd8c108 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:13.756107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e456ed-e38c-41ce-9432-09f145c848b9 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:13.761744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f5e456ed-e38c-41ce-9432-09f145c848b9 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:13.776491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10413a94-2abe-4f7d-8c80-93284cd8c108 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:13.778935 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10413a94-2abe-4f7d-8c80-93284cd8c108 service glance] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:13.806380 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3819/7638] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:33:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:33:13.851139 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e456ed-e38c-41ce-9432-09f145c848b9 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:13.858009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989e352-6d1d-417f-aa10-803cb78a5f15 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2afb0481b14a04be8d83a39e98db35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9891c9c0bce4d82a38b82cb464c4d98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:13.859746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989e352-6d1d-417f-aa10-803cb78a5f15 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:13.859746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989e352-6d1d-417f-aa10-803cb78a5f15 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:13.859746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989e352-6d1d-417f-aa10-803cb78a5f15 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] PATH_INFO: `/v3/projects/0334eb6c96b345c8a16e2e54a124cc08` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:13.864551 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b989e352-6d1d-417f-aa10-803cb78a5f15 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0334eb6c96b345c8a16e2e54a124cc08)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:13.866861 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b989e352-6d1d-417f-aa10-803cb78a5f15 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:13.938507 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:13.951251 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b989e352-6d1d-417f-aa10-803cb78a5f15 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0334eb6c96b345c8a16e2e54a124cc08', 'request_id': 'req-b989e352-6d1d-417f-aa10-803cb78a5f15'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:13.970827 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b989e352-6d1d-417f-aa10-803cb78a5f15 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0334eb6c96b345c8a16e2e54a124cc08', 'request_id': 'req-b989e352-6d1d-417f-aa10-803cb78a5f15'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:13.981187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b989e352-6d1d-417f-aa10-803cb78a5f15 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0334eb6c96b345c8a16e2e54a124cc08', 'request_id': 'req-b989e352-6d1d-417f-aa10-803cb78a5f15'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:13.997953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b989e352-6d1d-417f-aa10-803cb78a5f15 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] The token cache is being invalidate because project 0334eb6c96b345c8a16e2e54a124cc08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:33:13.998667 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b989e352-6d1d-417f-aa10-803cb78a5f15 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:13.999730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b989e352-6d1d-417f-aa10-803cb78a5f15 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:14.005623 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3820/7639] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:33:13 2022] DELETE /identity/v3/projects/0334eb6c96b345c8a16e2e54a124cc08 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:14.006948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10413a94-2abe-4f7d-8c80-93284cd8c108 service glance] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:14.040498 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10413a94-2abe-4f7d-8c80-93284cd8c108 service glance] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:14.142054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c14bb-8826-4c25-839b-bba9827f1597 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2afb0481b14a04be8d83a39e98db35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9891c9c0bce4d82a38b82cb464c4d98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:14.142807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c14bb-8826-4c25-839b-bba9827f1597 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:14.143154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c14bb-8826-4c25-839b-bba9827f1597 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:14.143504 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c14bb-8826-4c25-839b-bba9827f1597 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] PATH_INFO: `/v3/domains/83bb7869eb704bb39ea0c04213fa894e` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:14.146015 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c14bb-8826-4c25-839b-bba9827f1597 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=83bb7869eb704bb39ea0c04213fa894e)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:14.147376 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c14bb-8826-4c25-839b-bba9827f1597 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:14.177618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-652c14bb-8826-4c25-839b-bba9827f1597 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '83bb7869eb704bb39ea0c04213fa894e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:14.178480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-652c14bb-8826-4c25-839b-bba9827f1597 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '83bb7869eb704bb39ea0c04213fa894e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:14.223711 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-652c14bb-8826-4c25-839b-bba9827f1597 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '83bb7869eb704bb39ea0c04213fa894e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:14.224389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-652c14bb-8826-4c25-839b-bba9827f1597 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '83bb7869eb704bb39ea0c04213fa894e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:14.227877 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3820/7640] 10.222.0.30 () {60 vars in 1249 bytes} [Sun Sep 4 01:33:14 2022] PATCH /identity/v3/domains/83bb7869eb704bb39ea0c04213fa894e => generated 247 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:33:14.231845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989e352-6d1d-417f-aa10-803cb78a5f15 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:14.233573 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b989e352-6d1d-417f-aa10-803cb78a5f15 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:14.250826 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989e352-6d1d-417f-aa10-803cb78a5f15 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:14.395045 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c13f2-3681-405b-9849-3852ec0c7ee0 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2afb0481b14a04be8d83a39e98db35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9891c9c0bce4d82a38b82cb464c4d98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:14.396104 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c13f2-3681-405b-9849-3852ec0c7ee0 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:14.397756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c13f2-3681-405b-9849-3852ec0c7ee0 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:14.398199 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c13f2-3681-405b-9849-3852ec0c7ee0 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] PATH_INFO: `/v3/domains/83bb7869eb704bb39ea0c04213fa894e` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:14.426970 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c13f2-3681-405b-9849-3852ec0c7ee0 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=83bb7869eb704bb39ea0c04213fa894e)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:14.430512 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c13f2-3681-405b-9849-3852ec0c7ee0 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:14.482736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-691c13f2-3681-405b-9849-3852ec0c7ee0 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '83bb7869eb704bb39ea0c04213fa894e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:14.519073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-691c13f2-3681-405b-9849-3852ec0c7ee0 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '83bb7869eb704bb39ea0c04213fa894e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:14.528345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941dc4a-e2ad-4735-9c4d-30f20b3ced4e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:14.528750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941dc4a-e2ad-4735-9c4d-30f20b3ced4e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:14.529122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941dc4a-e2ad-4735-9c4d-30f20b3ced4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:14.566921 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e941dc4a-e2ad-4735-9c4d-30f20b3ced4e None None] MFA Rules not processed for user `f39dd2d709374c729d51f7e2cf18300c`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:14.568512 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e941dc4a-e2ad-4735-9c4d-30f20b3ced4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:14.629675 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-691c13f2-3681-405b-9849-3852ec0c7ee0 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83bb7869eb704bb39ea0c04213fa894e', 'request_id': 'req-691c13f2-3681-405b-9849-3852ec0c7ee0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:14.648283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-691c13f2-3681-405b-9849-3852ec0c7ee0 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83bb7869eb704bb39ea0c04213fa894e', 'request_id': 'req-691c13f2-3681-405b-9849-3852ec0c7ee0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:14.655027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-691c13f2-3681-405b-9849-3852ec0c7ee0 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83bb7869eb704bb39ea0c04213fa894e', 'request_id': 'req-691c13f2-3681-405b-9849-3852ec0c7ee0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:14.680839 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3821/7641] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:14.703941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-691c13f2-3681-405b-9849-3852ec0c7ee0 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] The token cache is being invalidate because project 83bb7869eb704bb39ea0c04213fa894e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:33:14.704235 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-691c13f2-3681-405b-9849-3852ec0c7ee0 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:14.704913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-691c13f2-3681-405b-9849-3852ec0c7ee0 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:14.722886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-691c13f2-3681-405b-9849-3852ec0c7ee0 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '83bb7869eb704bb39ea0c04213fa894e', 'request_id': 'req-691c13f2-3681-405b-9849-3852ec0c7ee0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:14.724591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-691c13f2-3681-405b-9849-3852ec0c7ee0 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '83bb7869eb704bb39ea0c04213fa894e', 'request_id': 'req-691c13f2-3681-405b-9849-3852ec0c7ee0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:14.726095 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-691c13f2-3681-405b-9849-3852ec0c7ee0 tempest-TestDefaultProjectId-1758231945 tempest-TestDefaultProjectId-1758231945-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '83bb7869eb704bb39ea0c04213fa894e', 'request_id': 'req-691c13f2-3681-405b-9849-3852ec0c7ee0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:14.740329 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3821/7642] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:33:14 2022] DELETE /identity/v3/domains/83bb7869eb704bb39ea0c04213fa894e => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:33:14.747432 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941dc4a-e2ad-4735-9c4d-30f20b3ced4e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:14.750691 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e941dc4a-e2ad-4735-9c4d-30f20b3ced4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:14.875202 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:14.927265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941dc4a-e2ad-4735-9c4d-30f20b3ced4e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:15.049741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c05fe0-83e4-4839-9d5b-3ae8fb0fcff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:15.050250 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c05fe0-83e4-4839-9d5b-3ae8fb0fcff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:15.050672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c05fe0-83e4-4839-9d5b-3ae8fb0fcff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:15.051469 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c05fe0-83e4-4839-9d5b-3ae8fb0fcff5 admin admin] PATH_INFO: `/v3/users/e2e7bed11a2f4d2684fa1ded80ad24a1` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:15.053083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c05fe0-83e4-4839-9d5b-3ae8fb0fcff5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2e7bed11a2f4d2684fa1ded80ad24a1)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:15.057848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c05fe0-83e4-4839-9d5b-3ae8fb0fcff5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:15.122229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-89c05fe0-83e4-4839-9d5b-3ae8fb0fcff5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2e7bed11a2f4d2684fa1ded80ad24a1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:15.122957 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-89c05fe0-83e4-4839-9d5b-3ae8fb0fcff5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2e7bed11a2f4d2684fa1ded80ad24a1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:15.132114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-89c05fe0-83e4-4839-9d5b-3ae8fb0fcff5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2e7bed11a2f4d2684fa1ded80ad24a1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:15.176201 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-89c05fe0-83e4-4839-9d5b-3ae8fb0fcff5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2e7bed11a2f4d2684fa1ded80ad24a1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:15.176718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-89c05fe0-83e4-4839-9d5b-3ae8fb0fcff5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2e7bed11a2f4d2684fa1ded80ad24a1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:15.214908 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3822/7643] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:33:14 2022] DELETE /identity/v3/users/e2e7bed11a2f4d2684fa1ded80ad24a1 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:15.216740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b67c46-4b71-46be-a0c4-5712d4e70898 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:15.217274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b67c46-4b71-46be-a0c4-5712d4e70898 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:15.217274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b67c46-4b71-46be-a0c4-5712d4e70898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:15.230711 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:15.264166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-05b67c46-4b71-46be-a0c4-5712d4e70898 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:15.265474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-05b67c46-4b71-46be-a0c4-5712d4e70898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:15.333255 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c05fe0-83e4-4839-9d5b-3ae8fb0fcff5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:15.335006 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-89c05fe0-83e4-4839-9d5b-3ae8fb0fcff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:15.424051 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3822/7644] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:15.459966 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b67c46-4b71-46be-a0c4-5712d4e70898 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:15.461721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-05b67c46-4b71-46be-a0c4-5712d4e70898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:15.472834 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c05fe0-83e4-4839-9d5b-3ae8fb0fcff5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:15.485049 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9370604-16b7-448c-9d02-258254fde899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:15.488742 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9370604-16b7-448c-9d02-258254fde899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:15.489603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9370604-16b7-448c-9d02-258254fde899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:15.490091 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9370604-16b7-448c-9d02-258254fde899 admin admin] PATH_INFO: `/v3/users/fd1d17e0f2014f6f8c616714710bb59d` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:15.492509 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9370604-16b7-448c-9d02-258254fde899 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd1d17e0f2014f6f8c616714710bb59d)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:15.496049 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9370604-16b7-448c-9d02-258254fde899 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:15.509080 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:15.642496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b67c46-4b71-46be-a0c4-5712d4e70898 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:15.647771 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762e5d8-ee29-4ba1-894f-91e1d550d4b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:15.648660 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762e5d8-ee29-4ba1-894f-91e1d550d4b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:15.663333 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c9370604-16b7-448c-9d02-258254fde899 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd1d17e0f2014f6f8c616714710bb59d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:15.664602 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c9370604-16b7-448c-9d02-258254fde899 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd1d17e0f2014f6f8c616714710bb59d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:15.672277 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762e5d8-ee29-4ba1-894f-91e1d550d4b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:15.674998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762e5d8-ee29-4ba1-894f-91e1d550d4b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:15.680083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c9370604-16b7-448c-9d02-258254fde899 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd1d17e0f2014f6f8c616714710bb59d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:15.693990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3762e5d8-ee29-4ba1-894f-91e1d550d4b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:15.695810 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c9370604-16b7-448c-9d02-258254fde899 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd1d17e0f2014f6f8c616714710bb59d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:15.696523 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c9370604-16b7-448c-9d02-258254fde899 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd1d17e0f2014f6f8c616714710bb59d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:15.741002 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3823/7645] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:33:15 2022] DELETE /identity/v3/users/fd1d17e0f2014f6f8c616714710bb59d => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:15.744303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3762e5d8-ee29-4ba1-894f-91e1d550d4b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:15.746565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3762e5d8-ee29-4ba1-894f-91e1d550d4b5 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:15.752397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8083f32-d70a-494c-93e7-e9d51b2f03e0 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:15.753011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8083f32-d70a-494c-93e7-e9d51b2f03e0 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:15.753011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8083f32-d70a-494c-93e7-e9d51b2f03e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:15.793036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e8083f32-d70a-494c-93e7-e9d51b2f03e0 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:15.795413 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e8083f32-d70a-494c-93e7-e9d51b2f03e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:15.795670 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3823/7646] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:33:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:33:15.904375 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3824/7647] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:15.939519 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762e5d8-ee29-4ba1-894f-91e1d550d4b5 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:15.941784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3762e5d8-ee29-4ba1-894f-91e1d550d4b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:15.971728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762e5d8-ee29-4ba1-894f-91e1d550d4b5 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:16.062625 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deebb54f-3ab1-4dd4-9aa6-9b288e91c713 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:16.063483 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebb54f-3ab1-4dd4-9aa6-9b288e91c713 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:16.063626 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebb54f-3ab1-4dd4-9aa6-9b288e91c713 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:16.064174 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebb54f-3ab1-4dd4-9aa6-9b288e91c713 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:16.081613 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deebb54f-3ab1-4dd4-9aa6-9b288e91c713 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:16.083822 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deebb54f-3ab1-4dd4-9aa6-9b288e91c713 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:16.102503 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3824/7648] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:33:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:33:16.644810 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8083f32-d70a-494c-93e7-e9d51b2f03e0 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:16.647399 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e8083f32-d70a-494c-93e7-e9d51b2f03e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:16.661372 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8083f32-d70a-494c-93e7-e9d51b2f03e0 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:16.674245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385673dc-119a-4639-9b34-ba0d53fb1d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:16.675214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385673dc-119a-4639-9b34-ba0d53fb1d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:16.675699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385673dc-119a-4639-9b34-ba0d53fb1d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:16.677283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385673dc-119a-4639-9b34-ba0d53fb1d4c admin admin] PATH_INFO: `/v3/projects/be42857300594461ab29a592932c0dac` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:16.680054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385673dc-119a-4639-9b34-ba0d53fb1d4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=be42857300594461ab29a592932c0dac)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:16.701942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385673dc-119a-4639-9b34-ba0d53fb1d4c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:16.727382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deebb54f-3ab1-4dd4-9aa6-9b288e91c713 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:16.730673 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-deebb54f-3ab1-4dd4-9aa6-9b288e91c713 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:16.773247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deebb54f-3ab1-4dd4-9aa6-9b288e91c713 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:16.778960 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-385673dc-119a-4639-9b34-ba0d53fb1d4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be42857300594461ab29a592932c0dac', 'request_id': 'req-385673dc-119a-4639-9b34-ba0d53fb1d4c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:16.790489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-385673dc-119a-4639-9b34-ba0d53fb1d4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be42857300594461ab29a592932c0dac', 'request_id': 'req-385673dc-119a-4639-9b34-ba0d53fb1d4c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:16.798338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-385673dc-119a-4639-9b34-ba0d53fb1d4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be42857300594461ab29a592932c0dac', 'request_id': 'req-385673dc-119a-4639-9b34-ba0d53fb1d4c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:16.827156 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-385673dc-119a-4639-9b34-ba0d53fb1d4c admin admin] The token cache is being invalidate because project be42857300594461ab29a592932c0dac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:33:16.827482 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-385673dc-119a-4639-9b34-ba0d53fb1d4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:16.829533 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-385673dc-119a-4639-9b34-ba0d53fb1d4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:16.831505 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3825/7649] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:33:16 2022] DELETE /identity/v3/projects/be42857300594461ab29a592932c0dac => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:16.835364 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385673dc-119a-4639-9b34-ba0d53fb1d4c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:16.839210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-385673dc-119a-4639-9b34-ba0d53fb1d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:16.849629 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:16.893349 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:16.917216 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201af70-c144-482b-a84b-cb80890af51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:16.919770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201af70-c144-482b-a84b-cb80890af51e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:16.921284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201af70-c144-482b-a84b-cb80890af51e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:16.921710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201af70-c144-482b-a84b-cb80890af51e admin admin] PATH_INFO: `/v3/projects/656ead3c0673462d8d82a95491a41158` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:16.928128 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201af70-c144-482b-a84b-cb80890af51e admin admin] RBAC: Authorizing `identity:delete_project(project_id=656ead3c0673462d8d82a95491a41158)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:16.932004 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201af70-c144-482b-a84b-cb80890af51e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:17.017153 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385673dc-119a-4639-9b34-ba0d53fb1d4c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:17.028521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b1f00-e730-40bd-9d98-dd212b5f898f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:17.029181 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b1f00-e730-40bd-9d98-dd212b5f898f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:17.031237 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b1f00-e730-40bd-9d98-dd212b5f898f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:17.032602 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b1f00-e730-40bd-9d98-dd212b5f898f admin admin] PATH_INFO: `/v3/users/0d2afb0481b14a04be8d83a39e98db35` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:17.034206 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b1f00-e730-40bd-9d98-dd212b5f898f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d2afb0481b14a04be8d83a39e98db35)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:17.039351 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b1f00-e730-40bd-9d98-dd212b5f898f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:17.068795 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7201af70-c144-482b-a84b-cb80890af51e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '656ead3c0673462d8d82a95491a41158', 'request_id': 'req-7201af70-c144-482b-a84b-cb80890af51e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:17.085734 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7201af70-c144-482b-a84b-cb80890af51e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '656ead3c0673462d8d82a95491a41158', 'request_id': 'req-7201af70-c144-482b-a84b-cb80890af51e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:17.097900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7201af70-c144-482b-a84b-cb80890af51e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '656ead3c0673462d8d82a95491a41158', 'request_id': 'req-7201af70-c144-482b-a84b-cb80890af51e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:17.141179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7201af70-c144-482b-a84b-cb80890af51e admin admin] The token cache is being invalidate because project 656ead3c0673462d8d82a95491a41158 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:33:17.141507 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7201af70-c144-482b-a84b-cb80890af51e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:17.145483 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7201af70-c144-482b-a84b-cb80890af51e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:17.153822 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3825/7650] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:33:16 2022] DELETE /identity/v3/projects/656ead3c0673462d8d82a95491a41158 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:17.163516 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d9995-5054-43ab-b485-9db596e17700 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:17.164367 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d9995-5054-43ab-b485-9db596e17700 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:17.164901 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d9995-5054-43ab-b485-9db596e17700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:17.176846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ed1b1f00-e730-40bd-9d98-dd212b5f898f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d2afb0481b14a04be8d83a39e98db35'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:17.178412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ed1b1f00-e730-40bd-9d98-dd212b5f898f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d2afb0481b14a04be8d83a39e98db35'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:17.240804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ed1b1f00-e730-40bd-9d98-dd212b5f898f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d2afb0481b14a04be8d83a39e98db35'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:17.264687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ed1b1f00-e730-40bd-9d98-dd212b5f898f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d2afb0481b14a04be8d83a39e98db35'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:17.265745 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ed1b1f00-e730-40bd-9d98-dd212b5f898f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d2afb0481b14a04be8d83a39e98db35'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:17.274733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-7a3d9995-5054-43ab-b485-9db596e17700 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:17.278191 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7a3d9995-5054-43ab-b485-9db596e17700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:17.297217 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3826/7651] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:33:16 2022] DELETE /identity/v3/users/0d2afb0481b14a04be8d83a39e98db35 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:17.428748 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3826/7652] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:17.440716 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f69ff4-2fa2-4822-b8a8-c942a0ffc41c None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:17.441015 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f69ff4-2fa2-4822-b8a8-c942a0ffc41c None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:17.441296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f69ff4-2fa2-4822-b8a8-c942a0ffc41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:17.475718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e5f69ff4-2fa2-4822-b8a8-c942a0ffc41c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:17.477120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e5f69ff4-2fa2-4822-b8a8-c942a0ffc41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:17.562897 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3827/7653] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:17.568998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d9995-5054-43ab-b485-9db596e17700 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:17.583784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d9995-5054-43ab-b485-9db596e17700 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:17.590384 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd779b65-4f2c-4166-ab79-c45574782a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:17.591069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd779b65-4f2c-4166-ab79-c45574782a6b admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:17.591916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd779b65-4f2c-4166-ab79-c45574782a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:17.592206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd779b65-4f2c-4166-ab79-c45574782a6b admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:17.593194 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd779b65-4f2c-4166-ab79-c45574782a6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:33:17.593540 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd779b65-4f2c-4166-ab79-c45574782a6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:17.595423 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd779b65-4f2c-4166-ab79-c45574782a6b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:17.616955 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3827/7654] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:33:17.624082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f69ff4-2fa2-4822-b8a8-c942a0ffc41c None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:17.636850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f69ff4-2fa2-4822-b8a8-c942a0ffc41c None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:17.647871 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82175861-e707-4b81-9651-7f85c55819c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:17.648657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82175861-e707-4b81-9651-7f85c55819c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:17.649476 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82175861-e707-4b81-9651-7f85c55819c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:17.650166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82175861-e707-4b81-9651-7f85c55819c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:17.650480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82175861-e707-4b81-9651-7f85c55819c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:17.654438 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82175861-e707-4b81-9651-7f85c55819c5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:17.701690 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3828/7655] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:33:17 2022] POST /identity/v3/projects => generated 411 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:17.702721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd779b65-4f2c-4166-ab79-c45574782a6b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:17.719747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd779b65-4f2c-4166-ab79-c45574782a6b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:17.847766 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7dd99-d81a-4cc8-8148-e71bdfebdbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:17.849130 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7dd99-d81a-4cc8-8148-e71bdfebdbe0 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:17.849543 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7dd99-d81a-4cc8-8148-e71bdfebdbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:17.850209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7dd99-d81a-4cc8-8148-e71bdfebdbe0 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:17.851032 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7dd99-d81a-4cc8-8148-e71bdfebdbe0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:17.853235 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7dd99-d81a-4cc8-8148-e71bdfebdbe0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:17.874004 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:17.883930 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3828/7656] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:33:17 2022] POST /identity/v3/users => generated 306 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:17.891602 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82175861-e707-4b81-9651-7f85c55819c5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:17.898033 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:17.905135 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82175861-e707-4b81-9651-7f85c55819c5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:17.912329 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d54946-3f5f-4bd3-b2b2-483eb1dabe87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:17.913283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d54946-3f5f-4bd3-b2b2-483eb1dabe87 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:17.913740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d54946-3f5f-4bd3-b2b2-483eb1dabe87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:17.914161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d54946-3f5f-4bd3-b2b2-483eb1dabe87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:17.915196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d54946-3f5f-4bd3-b2b2-483eb1dabe87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:17.917277 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d54946-3f5f-4bd3-b2b2-483eb1dabe87 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:17.937914 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3829/7657] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:33:17.939313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7dd99-d81a-4cc8-8148-e71bdfebdbe0 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:17.955795 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7dd99-d81a-4cc8-8148-e71bdfebdbe0 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:17.983622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485685d8-2abb-48ca-a72d-f67785898034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:17.984259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485685d8-2abb-48ca-a72d-f67785898034 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:17.984642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485685d8-2abb-48ca-a72d-f67785898034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:17.984812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485685d8-2abb-48ca-a72d-f67785898034 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:17.985716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485685d8-2abb-48ca-a72d-f67785898034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:17.987772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485685d8-2abb-48ca-a72d-f67785898034 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:18.013509 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3829/7658] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:33:18.016278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d54946-3f5f-4bd3-b2b2-483eb1dabe87 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:18.032872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d54946-3f5f-4bd3-b2b2-483eb1dabe87 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:18.057810 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db3129-293d-4ac1-bfff-76aba68cca7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:18.060080 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db3129-293d-4ac1-bfff-76aba68cca7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:18.061123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db3129-293d-4ac1-bfff-76aba68cca7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:18.062973 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db3129-293d-4ac1-bfff-76aba68cca7f admin admin] PATH_INFO: `/v3/projects/b65247f660cd4e4e8df18a0977bf8d8e/users/975fd6a669c3415e81ad7e59bb6be3b3/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:18.104172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db3129-293d-4ac1-bfff-76aba68cca7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b65247f660cd4e4e8df18a0977bf8d8e, user_id=975fd6a669c3415e81ad7e59bb6be3b3, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:18.107731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db3129-293d-4ac1-bfff-76aba68cca7f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:18.139240 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3830/7659] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:33:18 2022] PUT /identity/v3/projects/b65247f660cd4e4e8df18a0977bf8d8e/users/975fd6a669c3415e81ad7e59bb6be3b3/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:18.154195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499cd113-3d9d-43f1-821d-fd19ae866cfc None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:18.154493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499cd113-3d9d-43f1-821d-fd19ae866cfc None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:18.155304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499cd113-3d9d-43f1-821d-fd19ae866cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:18.192796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db3129-293d-4ac1-bfff-76aba68cca7f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:18.196625 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-85db3129-293d-4ac1-bfff-76aba68cca7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:18.212834 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-499cd113-3d9d-43f1-821d-fd19ae866cfc None None] MFA Rules not processed for user `975fd6a669c3415e81ad7e59bb6be3b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:18.214780 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-499cd113-3d9d-43f1-821d-fd19ae866cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:18.318933 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db3129-293d-4ac1-bfff-76aba68cca7f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:18.338525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3146b868-59da-4732-b716-7b1db9157218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:18.342198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146b868-59da-4732-b716-7b1db9157218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:18.343073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146b868-59da-4732-b716-7b1db9157218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:18.343624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146b868-59da-4732-b716-7b1db9157218 admin admin] PATH_INFO: `/v3/projects/d9891c9c0bce4d82a38b82cb464c4d98` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:18.347764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3146b868-59da-4732-b716-7b1db9157218 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9891c9c0bce4d82a38b82cb464c4d98)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:18.353587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3146b868-59da-4732-b716-7b1db9157218 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:18.390592 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3830/7660] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:18 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:18.394583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499cd113-3d9d-43f1-821d-fd19ae866cfc None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:18.425137 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499cd113-3d9d-43f1-821d-fd19ae866cfc None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:18.434649 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a1cd0-d0c1-4d4e-bbd8-8076c06526b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:18.435276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a1cd0-d0c1-4d4e-bbd8-8076c06526b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:18.435561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a1cd0-d0c1-4d4e-bbd8-8076c06526b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:18.435836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a1cd0-d0c1-4d4e-bbd8-8076c06526b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:18.436490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a1cd0-d0c1-4d4e-bbd8-8076c06526b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:18.444391 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a1cd0-d0c1-4d4e-bbd8-8076c06526b1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:18.485887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3146b868-59da-4732-b716-7b1db9157218 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9891c9c0bce4d82a38b82cb464c4d98', 'request_id': 'req-3146b868-59da-4732-b716-7b1db9157218'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:18.501105 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3831/7661] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:33:18 2022] POST /identity/v3/projects => generated 411 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:18.506499 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a1cd0-d0c1-4d4e-bbd8-8076c06526b1 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:18.524366 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3146b868-59da-4732-b716-7b1db9157218 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9891c9c0bce4d82a38b82cb464c4d98', 'request_id': 'req-3146b868-59da-4732-b716-7b1db9157218'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:18.559128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3146b868-59da-4732-b716-7b1db9157218 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9891c9c0bce4d82a38b82cb464c4d98', 'request_id': 'req-3146b868-59da-4732-b716-7b1db9157218'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:18.585566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3146b868-59da-4732-b716-7b1db9157218 admin admin] The token cache is being invalidate because project d9891c9c0bce4d82a38b82cb464c4d98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:33:18.585881 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3146b868-59da-4732-b716-7b1db9157218 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:18.587834 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3146b868-59da-4732-b716-7b1db9157218 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:18.592139 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3831/7662] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:33:18 2022] DELETE /identity/v3/projects/d9891c9c0bce4d82a38b82cb464c4d98 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:18.597486 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f34fa-5d18-4e10-878b-ada7be76ef29 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:18.597650 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f34fa-5d18-4e10-878b-ada7be76ef29 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:18.597900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f34fa-5d18-4e10-878b-ada7be76ef29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:18.629376 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a71f34fa-5d18-4e10-878b-ada7be76ef29 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:18.631435 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a71f34fa-5d18-4e10-878b-ada7be76ef29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:18.657125 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a1cd0-d0c1-4d4e-bbd8-8076c06526b1 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:18.660511 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3832/7663] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:18.665305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a9293-a69d-4f13-ad5f-6d0daece317e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:18.665983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a9293-a69d-4f13-ad5f-6d0daece317e admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:18.666306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a9293-a69d-4f13-ad5f-6d0daece317e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:18.666587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a9293-a69d-4f13-ad5f-6d0daece317e admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:18.667997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07625103-dbba-4b6d-81e6-8820098fe59a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:18.668277 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07625103-dbba-4b6d-81e6-8820098fe59a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:18.668547 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07625103-dbba-4b6d-81e6-8820098fe59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:18.670224 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a9293-a69d-4f13-ad5f-6d0daece317e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:18.673556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a9293-a69d-4f13-ad5f-6d0daece317e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:18.688594 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-07625103-dbba-4b6d-81e6-8820098fe59a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:18.690272 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-07625103-dbba-4b6d-81e6-8820098fe59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:18.702470 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3833/7664] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:33:18.706681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07625103-dbba-4b6d-81e6-8820098fe59a None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:18.711755 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3832/7665] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:33:18 2022] POST /identity/v3/users => generated 312 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:18.716616 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a9293-a69d-4f13-ad5f-6d0daece317e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:18.719026 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07625103-dbba-4b6d-81e6-8820098fe59a None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:18.720731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-353a9293-a69d-4f13-ad5f-6d0daece317e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:18.724807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399bbc7-08dd-4401-a25a-0d9c3afb2ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:18.725670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399bbc7-08dd-4401-a25a-0d9c3afb2ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:18.726185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399bbc7-08dd-4401-a25a-0d9c3afb2ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:18.726720 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399bbc7-08dd-4401-a25a-0d9c3afb2ab8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:18.727378 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399bbc7-08dd-4401-a25a-0d9c3afb2ab8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:33:18.727681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399bbc7-08dd-4401-a25a-0d9c3afb2ab8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:18.729389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399bbc7-08dd-4401-a25a-0d9c3afb2ab8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:18.743232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a9293-a69d-4f13-ad5f-6d0daece317e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:18.750225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c340232-daed-4860-8be0-bc4776ee59fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:18.751539 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c340232-daed-4860-8be0-bc4776ee59fd admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:18.752112 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c340232-daed-4860-8be0-bc4776ee59fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:18.752602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c340232-daed-4860-8be0-bc4776ee59fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:18.753762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c340232-daed-4860-8be0-bc4776ee59fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:18.756292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c340232-daed-4860-8be0-bc4776ee59fd admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:18.764331 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3834/7666] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:33:18.768795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399bbc7-08dd-4401-a25a-0d9c3afb2ab8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:18.774386 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3833/7667] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:33:18.778625 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c340232-daed-4860-8be0-bc4776ee59fd admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:18.784182 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399bbc7-08dd-4401-a25a-0d9c3afb2ab8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:18.792573 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c7fe7-eef9-477c-9dc5-d03f9266edeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:18.793207 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c7fe7-eef9-477c-9dc5-d03f9266edeb admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:18.793770 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c7fe7-eef9-477c-9dc5-d03f9266edeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:18.794048 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c7fe7-eef9-477c-9dc5-d03f9266edeb admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:18.795078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c340232-daed-4860-8be0-bc4776ee59fd admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:18.795348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c7fe7-eef9-477c-9dc5-d03f9266edeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:18.799419 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c7fe7-eef9-477c-9dc5-d03f9266edeb admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:18.807967 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be923f4f-6e2c-4a14-9c1b-2b2659e8c544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:18.809243 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be923f4f-6e2c-4a14-9c1b-2b2659e8c544 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:18.809900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be923f4f-6e2c-4a14-9c1b-2b2659e8c544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:18.810561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be923f4f-6e2c-4a14-9c1b-2b2659e8c544 admin admin] PATH_INFO: `/v3/projects/283b3256c40f43d9949f174bc879e020/users/a741c1be56564f9cbfeecf8d99bc5730/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:18.855816 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be923f4f-6e2c-4a14-9c1b-2b2659e8c544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=283b3256c40f43d9949f174bc879e020, user_id=a741c1be56564f9cbfeecf8d99bc5730, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:18.866172 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3835/7668] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:33:18 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:18.870745 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c7fe7-eef9-477c-9dc5-d03f9266edeb admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:18.879305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be923f4f-6e2c-4a14-9c1b-2b2659e8c544 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:18.885411 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:18.914811 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3834/7669] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:33:18 2022] PUT /identity/v3/projects/283b3256c40f43d9949f174bc879e020/users/a741c1be56564f9cbfeecf8d99bc5730/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:18.918708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be923f4f-6e2c-4a14-9c1b-2b2659e8c544 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:18.934723 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:19.073810 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c7fe7-eef9-477c-9dc5-d03f9266edeb admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:19.119899 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be923f4f-6e2c-4a14-9c1b-2b2659e8c544 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:19.130651 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4e0c7-5958-49f5-881e-ca16dbe8927c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:19.131470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4e0c7-5958-49f5-881e-ca16dbe8927c admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:19.133937 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4e0c7-5958-49f5-881e-ca16dbe8927c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:19.134391 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4e0c7-5958-49f5-881e-ca16dbe8927c admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:19.135893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4e0c7-5958-49f5-881e-ca16dbe8927c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:19.138059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4e0c7-5958-49f5-881e-ca16dbe8927c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:19.155223 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3835/7670] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:33:19.163586 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4e0c7-5958-49f5-881e-ca16dbe8927c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:19.191350 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4e0c7-5958-49f5-881e-ca16dbe8927c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:19.204864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1682455-a18a-4e9b-8798-d9e88ae54114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:19.205847 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1682455-a18a-4e9b-8798-d9e88ae54114 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:19.205847 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1682455-a18a-4e9b-8798-d9e88ae54114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:19.206092 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1682455-a18a-4e9b-8798-d9e88ae54114 admin admin] PATH_INFO: `/v3/projects/283b3256c40f43d9949f174bc879e020/users/a741c1be56564f9cbfeecf8d99bc5730/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:19.210241 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1682455-a18a-4e9b-8798-d9e88ae54114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=283b3256c40f43d9949f174bc879e020, user_id=a741c1be56564f9cbfeecf8d99bc5730, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:19.213389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1682455-a18a-4e9b-8798-d9e88ae54114 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:19.254973 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3836/7671] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:33:19 2022] PUT /identity/v3/projects/283b3256c40f43d9949f174bc879e020/users/a741c1be56564f9cbfeecf8d99bc5730/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:19.257066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31134c39-3905-438a-939b-5104089927f1 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:19.257066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31134c39-3905-438a-939b-5104089927f1 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:19.257066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31134c39-3905-438a-939b-5104089927f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:19.261708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1c724-9030-492a-9aee-c326d2990dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:19.262352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1c724-9030-492a-9aee-c326d2990dad admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:19.263793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1c724-9030-492a-9aee-c326d2990dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:19.264241 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1c724-9030-492a-9aee-c326d2990dad admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:19.265730 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1c724-9030-492a-9aee-c326d2990dad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:19.270953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1c724-9030-492a-9aee-c326d2990dad admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:19.312508 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-31134c39-3905-438a-939b-5104089927f1 None None] MFA Rules not processed for user `a741c1be56564f9cbfeecf8d99bc5730`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:19.314032 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3836/7672] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:33:18 2022] POST /identity/v3/users => generated 292 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:33:19.314197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-31134c39-3905-438a-939b-5104089927f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:19.315775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1c724-9030-492a-9aee-c326d2990dad admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:19.338141 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1c724-9030-492a-9aee-c326d2990dad admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:19.466890 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3837/7673] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:19 2022] POST /identity/v3/auth/tokens => generated 3355 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:19.483615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08e3da-1371-4676-af74-ce4475f4d295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:19.484388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08e3da-1371-4676-af74-ce4475f4d295 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:19.484762 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08e3da-1371-4676-af74-ce4475f4d295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:19.485103 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08e3da-1371-4676-af74-ce4475f4d295 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:19.486105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08e3da-1371-4676-af74-ce4475f4d295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:19.487948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08e3da-1371-4676-af74-ce4475f4d295 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:19.488376 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31134c39-3905-438a-939b-5104089927f1 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:19.490268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-31134c39-3905-438a-939b-5104089927f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:19.503007 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3837/7674] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:33:19.504821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08e3da-1371-4676-af74-ce4475f4d295 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:19.516763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08e3da-1371-4676-af74-ce4475f4d295 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:19.521826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abb6be-9cff-4267-82ad-1272df4654ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:19.522916 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abb6be-9cff-4267-82ad-1272df4654ee admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:19.523198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abb6be-9cff-4267-82ad-1272df4654ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:19.523585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abb6be-9cff-4267-82ad-1272df4654ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:19.524228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abb6be-9cff-4267-82ad-1272df4654ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:19.526037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abb6be-9cff-4267-82ad-1272df4654ee admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:19.545824 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3838/7675] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:33:19.549614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abb6be-9cff-4267-82ad-1272df4654ee admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:19.583422 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abb6be-9cff-4267-82ad-1272df4654ee admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:19.595745 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e6f68-a826-47e5-9479-496d260df9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:19.596568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e6f68-a826-47e5-9479-496d260df9fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:19.596853 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e6f68-a826-47e5-9479-496d260df9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:19.597707 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e6f68-a826-47e5-9479-496d260df9fd admin admin] PATH_INFO: `/v3/projects/a7a7e657f490417891d8cfa2550303cf/users/17db63b173bd478a93045e52747c4580/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:19.621185 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31134c39-3905-438a-939b-5104089927f1 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:19.628086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e20a4b-7afc-4e71-b246-4cb8a3d3b57c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:19.628906 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e20a4b-7afc-4e71-b246-4cb8a3d3b57c service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:19.629372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e20a4b-7afc-4e71-b246-4cb8a3d3b57c service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:19.630640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e20a4b-7afc-4e71-b246-4cb8a3d3b57c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:19.643045 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e6f68-a826-47e5-9479-496d260df9fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a7e657f490417891d8cfa2550303cf, user_id=17db63b173bd478a93045e52747c4580, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:19.651629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e20a4b-7afc-4e71-b246-4cb8a3d3b57c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:19.653107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e20a4b-7afc-4e71-b246-4cb8a3d3b57c service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:19.675903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e6f68-a826-47e5-9479-496d260df9fd admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:19.680777 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3838/7676] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:33:19 2022] GET /identity/v3/auth/tokens => generated 3355 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:33:19.731465 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3839/7677] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:33:19 2022] PUT /identity/v3/projects/a7a7e657f490417891d8cfa2550303cf/users/17db63b173bd478a93045e52747c4580/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:19.742886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c56fe7-b12d-4d1b-b196-90910843a790 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:19.743223 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c56fe7-b12d-4d1b-b196-90910843a790 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:19.743442 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c56fe7-b12d-4d1b-b196-90910843a790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:19.801706 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-78c56fe7-b12d-4d1b-b196-90910843a790 None None] MFA Rules not processed for user `17db63b173bd478a93045e52747c4580`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:19.803227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-78c56fe7-b12d-4d1b-b196-90910843a790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:19.824498 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:19.923574 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3839/7678] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:19.925222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e6f68-a826-47e5-9479-496d260df9fd admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:19.936416 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:20.007787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e6f68-a826-47e5-9479-496d260df9fd admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:20.013096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f097050-14f1-40e8-8a20-7991a56e0152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:20.014018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f097050-14f1-40e8-8a20-7991a56e0152 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:20.014450 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f097050-14f1-40e8-8a20-7991a56e0152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:20.014733 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f097050-14f1-40e8-8a20-7991a56e0152 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:20.015383 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f097050-14f1-40e8-8a20-7991a56e0152 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:20.017495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f097050-14f1-40e8-8a20-7991a56e0152 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:20.069637 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3840/7679] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:33:19 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:20.073797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c56fe7-b12d-4d1b-b196-90910843a790 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:20.088628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c56fe7-b12d-4d1b-b196-90910843a790 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:20.192094 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028669c-7e0f-4a54-b040-d8f6cc75475e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:20.193050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028669c-7e0f-4a54-b040-d8f6cc75475e admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:20.193356 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028669c-7e0f-4a54-b040-d8f6cc75475e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:20.193641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028669c-7e0f-4a54-b040-d8f6cc75475e admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:20.194308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028669c-7e0f-4a54-b040-d8f6cc75475e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:20.196664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028669c-7e0f-4a54-b040-d8f6cc75475e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:20.264858 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3840/7680] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:33:20 2022] POST /identity/v3/users => generated 298 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:20.270004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f097050-14f1-40e8-8a20-7991a56e0152 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:20.289967 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f097050-14f1-40e8-8a20-7991a56e0152 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:20.300398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c00c4d-1edb-4945-b395-1777bafe6d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:20.301023 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c00c4d-1edb-4945-b395-1777bafe6d5f admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:20.301305 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c00c4d-1edb-4945-b395-1777bafe6d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:20.301645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c00c4d-1edb-4945-b395-1777bafe6d5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:20.302297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c00c4d-1edb-4945-b395-1777bafe6d5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:20.303894 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c00c4d-1edb-4945-b395-1777bafe6d5f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:20.330042 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3841/7681] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:33:20.335074 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028669c-7e0f-4a54-b040-d8f6cc75475e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:20.351737 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028669c-7e0f-4a54-b040-d8f6cc75475e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:20.369600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01b6cc-b510-48fa-bef3-cf1e41afc983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:20.370644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01b6cc-b510-48fa-bef3-cf1e41afc983 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:20.371061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01b6cc-b510-48fa-bef3-cf1e41afc983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:20.371434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01b6cc-b510-48fa-bef3-cf1e41afc983 admin admin] PATH_INFO: `/v3/projects/e3ad2b0fc24e44ab89a6ae950f5eabb8/users/95366b0c8ec3420bb94dd711669e5dee/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:20.392622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01b6cc-b510-48fa-bef3-cf1e41afc983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ad2b0fc24e44ab89a6ae950f5eabb8, user_id=95366b0c8ec3420bb94dd711669e5dee, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:20.396265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01b6cc-b510-48fa-bef3-cf1e41afc983 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:20.429194 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3841/7682] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:33:20 2022] PUT /identity/v3/projects/e3ad2b0fc24e44ab89a6ae950f5eabb8/users/95366b0c8ec3420bb94dd711669e5dee/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:20.431126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c00c4d-1edb-4945-b395-1777bafe6d5f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:20.464147 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c00c4d-1edb-4945-b395-1777bafe6d5f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:20.587525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21654c27-e304-4df2-9452-68b22c06f365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:20.588949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21654c27-e304-4df2-9452-68b22c06f365 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:20.589356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21654c27-e304-4df2-9452-68b22c06f365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:20.590028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21654c27-e304-4df2-9452-68b22c06f365 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:20.590561 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21654c27-e304-4df2-9452-68b22c06f365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:20.592472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21654c27-e304-4df2-9452-68b22c06f365 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:20.605071 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3842/7683] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:33:20.612277 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01b6cc-b510-48fa-bef3-cf1e41afc983 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:20.626625 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01b6cc-b510-48fa-bef3-cf1e41afc983 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:20.635859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17732e05-75da-40dd-bc91-b5d585b005c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:20.637467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17732e05-75da-40dd-bc91-b5d585b005c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:20.638226 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17732e05-75da-40dd-bc91-b5d585b005c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:20.638947 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17732e05-75da-40dd-bc91-b5d585b005c1 admin admin] PATH_INFO: `/v3/projects/e3ad2b0fc24e44ab89a6ae950f5eabb8/users/95366b0c8ec3420bb94dd711669e5dee/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:20.649962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17732e05-75da-40dd-bc91-b5d585b005c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ad2b0fc24e44ab89a6ae950f5eabb8, user_id=95366b0c8ec3420bb94dd711669e5dee, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:20.661758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17732e05-75da-40dd-bc91-b5d585b005c1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:20.684614 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3842/7684] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:33:20 2022] PUT /identity/v3/projects/e3ad2b0fc24e44ab89a6ae950f5eabb8/users/95366b0c8ec3420bb94dd711669e5dee/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:20.695676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718bdb4-209c-4d83-85de-4678fe89be87 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:20.696608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718bdb4-209c-4d83-85de-4678fe89be87 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:20.697060 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718bdb4-209c-4d83-85de-4678fe89be87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:20.750936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-0718bdb4-209c-4d83-85de-4678fe89be87 None None] MFA Rules not processed for user `95366b0c8ec3420bb94dd711669e5dee`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:20.752956 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0718bdb4-209c-4d83-85de-4678fe89be87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:20.939842 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3843/7685] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:20 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:20.945411 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17732e05-75da-40dd-bc91-b5d585b005c1 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:20.964082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17732e05-75da-40dd-bc91-b5d585b005c1 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:20.971027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69602fc3-b59d-4617-a807-778f2cad5e18 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95366b0c8ec3420bb94dd711669e5dee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3ad2b0fc24e44ab89a6ae950f5eabb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:20.971371 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69602fc3-b59d-4617-a807-778f2cad5e18 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:20.971590 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69602fc3-b59d-4617-a807-778f2cad5e18 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:20.971948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69602fc3-b59d-4617-a807-778f2cad5e18 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:20.973300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69602fc3-b59d-4617-a807-778f2cad5e18 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:20.975772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69602fc3-b59d-4617-a807-778f2cad5e18 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:20.985237 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-69602fc3-b59d-4617-a807-778f2cad5e18 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Invalid input for field 'name': '' is too short Sep 04 01:33:20.985237 n-d-master-1 devstack@keystone.service[81824]: Failed validating 'minLength' in schema['properties']['name']: Sep 04 01:33:20.985237 n-d-master-1 devstack@keystone.service[81824]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 04 01:33:20.985237 n-d-master-1 devstack@keystone.service[81824]: On instance['name']: Sep 04 01:33:20.985237 n-d-master-1 devstack@keystone.service[81824]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Sep 04 01:33:20.985237 n-d-master-1 devstack@keystone.service[81824]: Failed validating 'minLength' in schema['properties']['name']: Sep 04 01:33:20.985237 n-d-master-1 devstack@keystone.service[81824]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 04 01:33:20.985237 n-d-master-1 devstack@keystone.service[81824]: On instance['name']: Sep 04 01:33:20.985237 n-d-master-1 devstack@keystone.service[81824]: '' Sep 04 01:33:20.985237 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:33:20.985237 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 04 01:33:20.985237 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 04 01:33:20.985237 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 04 01:33:20.985237 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise error Sep 04 01:33:20.985237 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Sep 04 01:33:20.985237 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:33:20.985237 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Sep 04 01:33:20.985237 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 04 01:33:20.985237 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:33:20.985237 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application On instance['name']: Sep 04 01:33:20.985237 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application '' Sep 04 01:33:20.985237 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:33:20.985237 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:33:20.987440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:33:20.987440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:33:20.987440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:33:20.987440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:33:20.987440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:33:20.987440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:33:20.987440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:33:20.987440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:33:20.987440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:33:20.987440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:33:20.987440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:33:20.987440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:33:20.987440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Sep 04 01:33:20.987440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Sep 04 01:33:20.987440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 04 01:33:20.987440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 04 01:33:20.987440 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 04 01:33:20.989362 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 04 01:33:20.989362 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Sep 04 01:33:20.989362 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:33:20.989362 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Sep 04 01:33:20.989362 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 04 01:33:20.989362 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:33:20.989362 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application On instance['name']: Sep 04 01:33:20.989362 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application '' Sep 04 01:33:20.989362 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:33:20.995045 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718bdb4-209c-4d83-85de-4678fe89be87 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:21.001576 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:21.009090 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3843/7686] 10.222.0.30 () {60 vars in 1149 bytes} [Sun Sep 4 01:33:20 2022] POST /identity/v3/domains => generated 283 bytes in 63 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 04 01:33:21.018391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718bdb4-209c-4d83-85de-4678fe89be87 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:21.031505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d75fc-7454-4b51-9b33-81618e9691bc tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95366b0c8ec3420bb94dd711669e5dee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3ad2b0fc24e44ab89a6ae950f5eabb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:21.031505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d75fc-7454-4b51-9b33-81618e9691bc tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:21.031811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d75fc-7454-4b51-9b33-81618e9691bc tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:21.032046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d75fc-7454-4b51-9b33-81618e9691bc tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:21.034687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d75fc-7454-4b51-9b33-81618e9691bc tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:21.037366 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d75fc-7454-4b51-9b33-81618e9691bc tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:21.048918 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-c16d75fc-7454-4b51-9b33-81618e9691bc tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 04 01:33:21.048918 n-d-master-1 devstack@keystone.service[81825]: Failed validating 'maxLength' in schema['properties']['name']: Sep 04 01:33:21.048918 n-d-master-1 devstack@keystone.service[81825]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 04 01:33:21.048918 n-d-master-1 devstack@keystone.service[81825]: On instance['name']: Sep 04 01:33:21.048918 n-d-master-1 devstack@keystone.service[81825]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 04 01:33:21.048918 n-d-master-1 devstack@keystone.service[81825]: Failed validating 'maxLength' in schema['properties']['name']: Sep 04 01:33:21.048918 n-d-master-1 devstack@keystone.service[81825]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 04 01:33:21.048918 n-d-master-1 devstack@keystone.service[81825]: On instance['name']: Sep 04 01:33:21.048918 n-d-master-1 devstack@keystone.service[81825]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 04 01:33:21.048918 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:33:21.048918 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 04 01:33:21.048918 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 04 01:33:21.048918 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 04 01:33:21.048918 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise error Sep 04 01:33:21.048918 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 04 01:33:21.048918 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:33:21.048918 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Sep 04 01:33:21.048918 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 04 01:33:21.048918 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:33:21.050789 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application On instance['name']: Sep 04 01:33:21.050789 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 04 01:33:21.050789 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:33:21.050789 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:33:21.050789 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:33:21.050789 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:33:21.050789 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:33:21.050789 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:33:21.050789 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:33:21.050789 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:33:21.050789 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:33:21.050789 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:33:21.050789 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:33:21.050789 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:33:21.050789 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:33:21.050789 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:33:21.050789 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Sep 04 01:33:21.050789 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Sep 04 01:33:21.057975 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 04 01:33:21.057975 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 04 01:33:21.057975 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 04 01:33:21.057975 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 04 01:33:21.057975 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 04 01:33:21.057975 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:33:21.057975 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Sep 04 01:33:21.057975 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 04 01:33:21.057975 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:33:21.057975 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application On instance['name']: Sep 04 01:33:21.057975 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 04 01:33:21.057975 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:33:21.057975 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3844/7687] 10.222.0.30 () {60 vars in 1149 bytes} [Sun Sep 4 01:33:20 2022] POST /identity/v3/domains => generated 412 bytes in 58 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 04 01:33:21.061389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69602fc3-b59d-4617-a807-778f2cad5e18 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:21.073670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69602fc3-b59d-4617-a807-778f2cad5e18 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:21.078858 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99cef4-c25a-4143-bca9-8d61889a7743 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95366b0c8ec3420bb94dd711669e5dee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3ad2b0fc24e44ab89a6ae950f5eabb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:21.080228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99cef4-c25a-4143-bca9-8d61889a7743 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:21.080883 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99cef4-c25a-4143-bca9-8d61889a7743 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:21.081272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99cef4-c25a-4143-bca9-8d61889a7743 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:21.082109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99cef4-c25a-4143-bca9-8d61889a7743 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:21.083849 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99cef4-c25a-4143-bca9-8d61889a7743 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:21.117899 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3844/7688] 10.222.0.30 () {60 vars in 1149 bytes} [Sun Sep 4 01:33:21 2022] POST /identity/v3/domains => generated 277 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:21.118900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d75fc-7454-4b51-9b33-81618e9691bc tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:21.137298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d75fc-7454-4b51-9b33-81618e9691bc tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:21.262324 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96f78c-a803-4c68-98d1-568d3d7b4f24 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95366b0c8ec3420bb94dd711669e5dee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3ad2b0fc24e44ab89a6ae950f5eabb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:21.263198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96f78c-a803-4c68-98d1-568d3d7b4f24 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:21.263829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96f78c-a803-4c68-98d1-568d3d7b4f24 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:21.264440 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96f78c-a803-4c68-98d1-568d3d7b4f24 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] PATH_INFO: `/v3/domains/7218a1e5c58e45dfa9358711a99e58e4` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:21.290566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad96f78c-a803-4c68-98d1-568d3d7b4f24 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7218a1e5c58e45dfa9358711a99e58e4)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:21.294669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad96f78c-a803-4c68-98d1-568d3d7b4f24 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:21.318618 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-ad96f78c-a803-4c68-98d1-568d3d7b4f24 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Sep 04 01:33:21.318618 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:33:21.318618 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:33:21.318618 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:33:21.318618 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:33:21.318618 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:33:21.318618 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:33:21.318618 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:33:21.318618 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:33:21.318618 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:33:21.318618 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:33:21.318618 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:33:21.318618 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Sep 04 01:33:21.318618 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Sep 04 01:33:21.321246 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:33:21.321246 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:33:21.321246 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Sep 04 01:33:21.321246 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Sep 04 01:33:21.321246 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Sep 04 01:33:21.321246 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Sep 04 01:33:21.321246 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Sep 04 01:33:21.321246 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:33:21.321246 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3845/7689] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:33:21 2022] DELETE /identity/v3/domains/7218a1e5c58e45dfa9358711a99e58e4 => generated 120 bytes in 202 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Sep 04 01:33:21.325296 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99cef4-c25a-4143-bca9-8d61889a7743 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:21.341276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99cef4-c25a-4143-bca9-8d61889a7743 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:21.356403 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ff121-8e05-474d-878d-3ce4826bc7ba tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95366b0c8ec3420bb94dd711669e5dee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3ad2b0fc24e44ab89a6ae950f5eabb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:21.357240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ff121-8e05-474d-878d-3ce4826bc7ba tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:21.357681 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ff121-8e05-474d-878d-3ce4826bc7ba tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:21.358223 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ff121-8e05-474d-878d-3ce4826bc7ba tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] PATH_INFO: `/v3/domains/7218a1e5c58e45dfa9358711a99e58e4` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:21.363109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ff121-8e05-474d-878d-3ce4826bc7ba tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=7218a1e5c58e45dfa9358711a99e58e4)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:21.365097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ff121-8e05-474d-878d-3ce4826bc7ba tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:21.422188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a49ff121-8e05-474d-878d-3ce4826bc7ba tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7218a1e5c58e45dfa9358711a99e58e4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:21.424734 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a49ff121-8e05-474d-878d-3ce4826bc7ba tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7218a1e5c58e45dfa9358711a99e58e4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:21.496913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a49ff121-8e05-474d-878d-3ce4826bc7ba tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7218a1e5c58e45dfa9358711a99e58e4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:21.499589 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a49ff121-8e05-474d-878d-3ce4826bc7ba tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7218a1e5c58e45dfa9358711a99e58e4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:21.506643 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3845/7690] 10.222.0.30 () {60 vars in 1249 bytes} [Sun Sep 4 01:33:21 2022] PATCH /identity/v3/domains/7218a1e5c58e45dfa9358711a99e58e4 => generated 278 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:33:21.507634 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96f78c-a803-4c68-98d1-568d3d7b4f24 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:21.511063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ad96f78c-a803-4c68-98d1-568d3d7b4f24 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:21.535123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96f78c-a803-4c68-98d1-568d3d7b4f24 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:21.699208 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2a51e-b64b-444a-bd73-48030f757cff tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95366b0c8ec3420bb94dd711669e5dee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3ad2b0fc24e44ab89a6ae950f5eabb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:21.700507 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2a51e-b64b-444a-bd73-48030f757cff tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:21.701070 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2a51e-b64b-444a-bd73-48030f757cff tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:21.701555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2a51e-b64b-444a-bd73-48030f757cff tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] PATH_INFO: `/v3/domains/7218a1e5c58e45dfa9358711a99e58e4` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:21.741796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2a51e-b64b-444a-bd73-48030f757cff tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7218a1e5c58e45dfa9358711a99e58e4)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:21.750743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2a51e-b64b-444a-bd73-48030f757cff tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:21.806197 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3be2a51e-b64b-444a-bd73-48030f757cff tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7218a1e5c58e45dfa9358711a99e58e4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:21.831651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3be2a51e-b64b-444a-bd73-48030f757cff tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7218a1e5c58e45dfa9358711a99e58e4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:21.919337 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3be2a51e-b64b-444a-bd73-48030f757cff tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7218a1e5c58e45dfa9358711a99e58e4', 'request_id': 'req-3be2a51e-b64b-444a-bd73-48030f757cff'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:21.922301 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:21.938946 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3be2a51e-b64b-444a-bd73-48030f757cff tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7218a1e5c58e45dfa9358711a99e58e4', 'request_id': 'req-3be2a51e-b64b-444a-bd73-48030f757cff'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:21.950692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3be2a51e-b64b-444a-bd73-48030f757cff tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7218a1e5c58e45dfa9358711a99e58e4', 'request_id': 'req-3be2a51e-b64b-444a-bd73-48030f757cff'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:21.973909 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3be2a51e-b64b-444a-bd73-48030f757cff tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] The token cache is being invalidate because project 7218a1e5c58e45dfa9358711a99e58e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:33:21.974267 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3be2a51e-b64b-444a-bd73-48030f757cff tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:21.975473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3be2a51e-b64b-444a-bd73-48030f757cff tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:21.988420 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3be2a51e-b64b-444a-bd73-48030f757cff tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7218a1e5c58e45dfa9358711a99e58e4', 'request_id': 'req-3be2a51e-b64b-444a-bd73-48030f757cff'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:21.989324 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3be2a51e-b64b-444a-bd73-48030f757cff tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7218a1e5c58e45dfa9358711a99e58e4', 'request_id': 'req-3be2a51e-b64b-444a-bd73-48030f757cff'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:21.990019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3be2a51e-b64b-444a-bd73-48030f757cff tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7218a1e5c58e45dfa9358711a99e58e4', 'request_id': 'req-3be2a51e-b64b-444a-bd73-48030f757cff'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:22.006891 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ff121-8e05-474d-878d-3ce4826bc7ba tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:22.008255 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3846/7691] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:33:21 2022] DELETE /identity/v3/domains/7218a1e5c58e45dfa9358711a99e58e4 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:33:22.014444 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:UPDATE=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:22.021602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ff121-8e05-474d-878d-3ce4826bc7ba tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:22.122824 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124afc1e-0517-4010-ac3f-af56609c1511 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95366b0c8ec3420bb94dd711669e5dee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3ad2b0fc24e44ab89a6ae950f5eabb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:22.123492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124afc1e-0517-4010-ac3f-af56609c1511 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:22.123779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124afc1e-0517-4010-ac3f-af56609c1511 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:22.124055 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124afc1e-0517-4010-ac3f-af56609c1511 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] PATH_INFO: `/v3/domains/f67c3f6be1064407b9f36820209eaa5a` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:22.145321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124afc1e-0517-4010-ac3f-af56609c1511 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 01:33:22.154828 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-124afc1e-0517-4010-ac3f-af56609c1511 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Could not find domain: f67c3f6be1064407b9f36820209eaa5a.: keystone.exception.DomainNotFound: Could not find domain: f67c3f6be1064407b9f36820209eaa5a. Sep 04 01:33:22.154828 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:33:22.154828 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 04 01:33:22.154828 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 04 01:33:22.154828 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 01:33:22.154828 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 01:33:22.154828 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 01:33:22.154828 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 01:33:22.154828 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f67c3f6be1064407b9f36820209eaa5a. Sep 04 01:33:22.154828 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:33:22.154828 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:33:22.154828 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:33:22.154828 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:33:22.154828 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:33:22.154828 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:33:22.155979 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:33:22.155979 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:33:22.155979 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:33:22.155979 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:33:22.155979 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:33:22.155979 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:33:22.155979 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:33:22.155979 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:33:22.155979 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Sep 04 01:33:22.155979 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Sep 04 01:33:22.155979 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 01:33:22.155979 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 01:33:22.155979 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 01:33:22.155979 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 01:33:22.155979 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:33:22.155979 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:33:22.157074 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 01:33:22.157074 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 01:33:22.157074 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 01:33:22.157074 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 01:33:22.157074 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 01:33:22.157074 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application with Lock( Sep 04 01:33:22.157074 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 01:33:22.157074 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self._enter() Sep 04 01:33:22.157074 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 01:33:22.157074 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 01:33:22.157074 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 01:33:22.157074 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.creator() Sep 04 01:33:22.157074 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 01:33:22.157074 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application created_value = creator( Sep 04 01:33:22.157074 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 04 01:33:22.157074 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 01:33:22.157074 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f67c3f6be1064407b9f36820209eaa5a. Sep 04 01:33:22.158300 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:33:22.162818 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2a51e-b64b-444a-bd73-48030f757cff tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:22.163135 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3846/7692] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:33:22 2022] DELETE /identity/v3/domains/f67c3f6be1064407b9f36820209eaa5a => generated 112 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:33:22.164297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3be2a51e-b64b-444a-bd73-48030f757cff tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:22.183512 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2a51e-b64b-444a-bd73-48030f757cff tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:22.191029 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e72e35-146d-40e3-b32c-936189e0b825 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95366b0c8ec3420bb94dd711669e5dee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3ad2b0fc24e44ab89a6ae950f5eabb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:22.191675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e72e35-146d-40e3-b32c-936189e0b825 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:22.192007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e72e35-146d-40e3-b32c-936189e0b825 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:22.192350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e72e35-146d-40e3-b32c-936189e0b825 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:22.193033 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e72e35-146d-40e3-b32c-936189e0b825 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:22.197709 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e72e35-146d-40e3-b32c-936189e0b825 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:22.226064 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124afc1e-0517-4010-ac3f-af56609c1511 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:22.226276 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3847/7693] 10.222.0.30 () {60 vars in 1149 bytes} [Sun Sep 4 01:33:22 2022] POST /identity/v3/domains => generated 253 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:33:22.241061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124afc1e-0517-4010-ac3f-af56609c1511 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:22.310436 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c8396-edb4-4291-b974-d893ae0c7b86 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95366b0c8ec3420bb94dd711669e5dee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3ad2b0fc24e44ab89a6ae950f5eabb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:22.311639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c8396-edb4-4291-b974-d893ae0c7b86 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:22.312297 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c8396-edb4-4291-b974-d893ae0c7b86 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:22.312957 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c8396-edb4-4291-b974-d893ae0c7b86 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:22.313845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c8396-edb4-4291-b974-d893ae0c7b86 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:22.315646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c8396-edb4-4291-b974-d893ae0c7b86 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:22.325340 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.sql.core [None req-d58c8396-edb4-4291-b974-d893ae0c7b86 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1448005237' for key 'project.ixu_project_name_domain_id'") Sep 04 01:33:22.325340 n-d-master-1 devstack@keystone.service[81824]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 04 01:33:22.325340 n-d-master-1 devstack@keystone.service[81824]: [parameters: {'id': 'df22ed715cce4f24873bd98573f3d654', 'name': 'tempest-domain-dup-1448005237', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Sep 04 01:33:22.325340 n-d-master-1 devstack@keystone.service[81824]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81824) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 04 01:33:22.344913 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-d58c8396-edb4-4291-b974-d893ae0c7b86 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1448005237.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1448005237. Sep 04 01:33:22.344913 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:33:22.344913 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 04 01:33:22.344913 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 04 01:33:22.344913 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 04 01:33:22.344913 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 04 01:33:22.344913 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 04 01:33:22.344913 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application result = self._query(query) Sep 04 01:33:22.344913 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 04 01:33:22.344913 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application conn.query(q) Sep 04 01:33:22.344913 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 04 01:33:22.344913 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 04 01:33:22.344913 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 04 01:33:22.346285 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application result.read() Sep 04 01:33:22.346285 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 04 01:33:22.346285 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 04 01:33:22.346285 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 04 01:33:22.346285 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 04 01:33:22.346285 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 04 01:33:22.346285 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 04 01:33:22.346285 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 04 01:33:22.346285 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 04 01:33:22.346285 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-1448005237' for key 'project.ixu_project_name_domain_id'") Sep 04 01:33:22.346285 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:33:22.346285 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 04 01:33:22.346285 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:33:22.346285 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:33:22.346285 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 04 01:33:22.346285 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 04 01:33:22.346285 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 04 01:33:22.346285 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 04 01:33:22.347831 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 04 01:33:22.347831 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application next(self.gen) Sep 04 01:33:22.347831 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 04 01:33:22.347831 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application yield resource Sep 04 01:33:22.347831 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 04 01:33:22.347831 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application next(self.gen) Sep 04 01:33:22.347831 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 04 01:33:22.347831 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self.session.rollback() Sep 04 01:33:22.347831 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 04 01:33:22.347831 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self.force_reraise() Sep 04 01:33:22.347831 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 04 01:33:22.347831 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise self.value Sep 04 01:33:22.347831 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 04 01:33:22.347831 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 04 01:33:22.347831 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 04 01:33:22.347831 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application session.commit() Sep 04 01:33:22.347831 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 04 01:33:22.349812 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 04 01:33:22.349812 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 04 01:33:22.349812 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._prepare_impl() Sep 04 01:33:22.349812 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 04 01:33:22.349812 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self.session.flush() Sep 04 01:33:22.349812 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 04 01:33:22.349812 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._flush(objects) Sep 04 01:33:22.349812 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 04 01:33:22.349812 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 04 01:33:22.349812 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 04 01:33:22.349812 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application compat.raise_( Sep 04 01:33:22.349812 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 04 01:33:22.349812 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception Sep 04 01:33:22.349812 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 04 01:33:22.349812 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application flush_context.execute() Sep 04 01:33:22.349812 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 04 01:33:22.349812 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rec.execute(self) Sep 04 01:33:22.351719 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 04 01:33:22.351719 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 04 01:33:22.351719 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 04 01:33:22.351719 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 04 01:33:22.351719 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 04 01:33:22.351719 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 04 01:33:22.351719 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 04 01:33:22.351719 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 04 01:33:22.351719 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 04 01:33:22.351719 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 04 01:33:22.351719 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 04 01:33:22.351719 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 04 01:33:22.351719 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 04 01:33:22.351719 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 04 01:33:22.351719 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 04 01:33:22.353405 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 04 01:33:22.353405 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 04 01:33:22.353405 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception Sep 04 01:33:22.353405 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 04 01:33:22.353405 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 04 01:33:22.353405 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 04 01:33:22.353405 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 04 01:33:22.353405 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 04 01:33:22.353405 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application result = self._query(query) Sep 04 01:33:22.353405 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 04 01:33:22.353405 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application conn.query(q) Sep 04 01:33:22.353405 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 04 01:33:22.353405 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 04 01:33:22.353405 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 04 01:33:22.353405 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application result.read() Sep 04 01:33:22.353405 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 04 01:33:22.353405 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 04 01:33:22.355713 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 04 01:33:22.355713 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 04 01:33:22.355713 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 04 01:33:22.355713 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 04 01:33:22.355713 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 04 01:33:22.355713 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 04 01:33:22.355713 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1448005237' for key 'project.ixu_project_name_domain_id'") Sep 04 01:33:22.355713 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 04 01:33:22.355713 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [parameters: {'id': 'df22ed715cce4f24873bd98573f3d654', 'name': 'tempest-domain-dup-1448005237', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Sep 04 01:33:22.355713 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 04 01:33:22.355713 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:33:22.355713 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:33:22.355713 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:33:22.355713 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:33:22.359659 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 04 01:33:22.359659 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 04 01:33:22.359659 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 04 01:33:22.359659 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 04 01:33:22.359659 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-1448005237. Sep 04 01:33:22.359659 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:33:22.359659 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:33:22.359659 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:33:22.359659 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:33:22.359659 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:33:22.359659 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:33:22.359659 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:33:22.359659 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:33:22.359659 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:33:22.359659 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:33:22.359659 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:33:22.359659 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:33:22.361815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:33:22.361815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:33:22.361815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Sep 04 01:33:22.361815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Sep 04 01:33:22.361815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:33:22.361815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:33:22.361815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Sep 04 01:33:22.361815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Sep 04 01:33:22.361815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:33:22.361815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:33:22.361815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 04 01:33:22.361815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 04 01:33:22.361815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1448005237. Sep 04 01:33:22.361815 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:33:22.370285 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e72e35-146d-40e3-b32c-936189e0b825 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:22.371770 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3847/7694] 10.222.0.30 () {60 vars in 1149 bytes} [Sun Sep 4 01:33:22 2022] POST /identity/v3/domains => generated 212 bytes in 146 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 04 01:33:22.386060 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e72e35-146d-40e3-b32c-936189e0b825 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:22.401564 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac6b6f-be36-4aae-83e7-e09a109e7ef5 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95366b0c8ec3420bb94dd711669e5dee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3ad2b0fc24e44ab89a6ae950f5eabb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:22.402478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac6b6f-be36-4aae-83e7-e09a109e7ef5 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:22.403022 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac6b6f-be36-4aae-83e7-e09a109e7ef5 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:22.404111 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac6b6f-be36-4aae-83e7-e09a109e7ef5 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] PATH_INFO: `/v3/domains/0752a59c1c8f4e9981d591a43fc15a25` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:22.418583 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac6b6f-be36-4aae-83e7-e09a109e7ef5 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0752a59c1c8f4e9981d591a43fc15a25)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:22.420973 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac6b6f-be36-4aae-83e7-e09a109e7ef5 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:22.468722 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-21ac6b6f-be36-4aae-83e7-e09a109e7ef5 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0752a59c1c8f4e9981d591a43fc15a25'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:22.469807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-21ac6b6f-be36-4aae-83e7-e09a109e7ef5 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0752a59c1c8f4e9981d591a43fc15a25'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:22.504078 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-21ac6b6f-be36-4aae-83e7-e09a109e7ef5 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0752a59c1c8f4e9981d591a43fc15a25'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:22.505031 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-21ac6b6f-be36-4aae-83e7-e09a109e7ef5 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0752a59c1c8f4e9981d591a43fc15a25'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:22.513134 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c8396-edb4-4291-b974-d893ae0c7b86 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:22.515300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d58c8396-edb4-4291-b974-d893ae0c7b86 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:22.516899 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3848/7695] 10.222.0.30 () {60 vars in 1249 bytes} [Sun Sep 4 01:33:22 2022] PATCH /identity/v3/domains/0752a59c1c8f4e9981d591a43fc15a25 => generated 254 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:33:22.531173 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c8396-edb4-4291-b974-d893ae0c7b86 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:22.646281 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fba86e-4708-463c-8458-06e3b8cd59e0 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95366b0c8ec3420bb94dd711669e5dee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3ad2b0fc24e44ab89a6ae950f5eabb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:22.647092 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fba86e-4708-463c-8458-06e3b8cd59e0 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:22.647381 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fba86e-4708-463c-8458-06e3b8cd59e0 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:22.647758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fba86e-4708-463c-8458-06e3b8cd59e0 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] PATH_INFO: `/v3/domains/0752a59c1c8f4e9981d591a43fc15a25` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:22.681878 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fba86e-4708-463c-8458-06e3b8cd59e0 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0752a59c1c8f4e9981d591a43fc15a25)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:22.683554 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fba86e-4708-463c-8458-06e3b8cd59e0 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:22.747475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-70fba86e-4708-463c-8458-06e3b8cd59e0 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0752a59c1c8f4e9981d591a43fc15a25'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:22.773392 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-70fba86e-4708-463c-8458-06e3b8cd59e0 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0752a59c1c8f4e9981d591a43fc15a25'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:22.777350 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:22.884415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-70fba86e-4708-463c-8458-06e3b8cd59e0 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0752a59c1c8f4e9981d591a43fc15a25', 'request_id': 'req-70fba86e-4708-463c-8458-06e3b8cd59e0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:22.907708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-70fba86e-4708-463c-8458-06e3b8cd59e0 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0752a59c1c8f4e9981d591a43fc15a25', 'request_id': 'req-70fba86e-4708-463c-8458-06e3b8cd59e0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:22.926626 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-70fba86e-4708-463c-8458-06e3b8cd59e0 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0752a59c1c8f4e9981d591a43fc15a25', 'request_id': 'req-70fba86e-4708-463c-8458-06e3b8cd59e0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:22.971363 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-70fba86e-4708-463c-8458-06e3b8cd59e0 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] The token cache is being invalidate because project 0752a59c1c8f4e9981d591a43fc15a25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:33:22.971666 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-70fba86e-4708-463c-8458-06e3b8cd59e0 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:22.972456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-70fba86e-4708-463c-8458-06e3b8cd59e0 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:22.992725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-70fba86e-4708-463c-8458-06e3b8cd59e0 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0752a59c1c8f4e9981d591a43fc15a25', 'request_id': 'req-70fba86e-4708-463c-8458-06e3b8cd59e0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:22.993866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-70fba86e-4708-463c-8458-06e3b8cd59e0 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0752a59c1c8f4e9981d591a43fc15a25', 'request_id': 'req-70fba86e-4708-463c-8458-06e3b8cd59e0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:22.995859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-70fba86e-4708-463c-8458-06e3b8cd59e0 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0752a59c1c8f4e9981d591a43fc15a25', 'request_id': 'req-70fba86e-4708-463c-8458-06e3b8cd59e0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:23.020921 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac6b6f-be36-4aae-83e7-e09a109e7ef5 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:23.021515 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3848/7696] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:33:22 2022] DELETE /identity/v3/domains/0752a59c1c8f4e9981d591a43fc15a25 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:23.032189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac6b6f-be36-4aae-83e7-e09a109e7ef5 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:23.197685 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c1995-ac99-452a-9766-5bd48f8d718b tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95366b0c8ec3420bb94dd711669e5dee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3ad2b0fc24e44ab89a6ae950f5eabb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:23.198652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c1995-ac99-452a-9766-5bd48f8d718b tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:23.199096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c1995-ac99-452a-9766-5bd48f8d718b tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:23.200726 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c1995-ac99-452a-9766-5bd48f8d718b tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] PATH_INFO: `/v3/domains/7218a1e5c58e45dfa9358711a99e58e4` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:23.213355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c1995-ac99-452a-9766-5bd48f8d718b tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 04 01:33:23.219968 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-fe0c1995-ac99-452a-9766-5bd48f8d718b tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Could not find domain: 7218a1e5c58e45dfa9358711a99e58e4.: keystone.exception.DomainNotFound: Could not find domain: 7218a1e5c58e45dfa9358711a99e58e4. Sep 04 01:33:23.219968 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:33:23.219968 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 04 01:33:23.219968 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 04 01:33:23.219968 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 04 01:33:23.219968 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 04 01:33:23.219968 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 04 01:33:23.219968 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 04 01:33:23.219968 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 7218a1e5c58e45dfa9358711a99e58e4. Sep 04 01:33:23.219968 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:33:23.219968 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:33:23.219968 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:33:23.219968 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:33:23.219968 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:33:23.219968 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:33:23.221208 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:33:23.221208 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:33:23.221208 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:33:23.221208 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:33:23.221208 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:33:23.221208 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:33:23.221208 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:33:23.221208 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:33:23.221208 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 04 01:33:23.221208 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 04 01:33:23.221208 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 04 01:33:23.221208 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 04 01:33:23.221208 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 04 01:33:23.221208 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 04 01:33:23.221208 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:33:23.221208 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:33:23.222462 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 01:33:23.222462 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 01:33:23.222462 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 01:33:23.222462 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 01:33:23.222462 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 01:33:23.222462 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 01:33:23.222462 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 01:33:23.222462 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 01:33:23.222462 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 01:33:23.222462 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 01:33:23.222462 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 01:33:23.222462 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 01:33:23.222462 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 01:33:23.222462 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 01:33:23.222462 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 04 01:33:23.222462 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 04 01:33:23.222462 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 7218a1e5c58e45dfa9358711a99e58e4. Sep 04 01:33:23.223802 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:33:23.225554 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3849/7697] 10.222.0.30 () {60 vars in 1249 bytes} [Sun Sep 4 01:33:23 2022] PATCH /identity/v3/domains/7218a1e5c58e45dfa9358711a99e58e4 => generated 112 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:33:23.229865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fba86e-4708-463c-8458-06e3b8cd59e0 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:23.231394 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-70fba86e-4708-463c-8458-06e3b8cd59e0 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:23.264021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c1995-ac99-452a-9766-5bd48f8d718b tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:23.266217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-fe0c1995-ac99-452a-9766-5bd48f8d718b tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:23.334752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fba86e-4708-463c-8458-06e3b8cd59e0 tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:23.340187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1990e-dc68-46d4-a135-4a6744755310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:23.340839 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1990e-dc68-46d4-a135-4a6744755310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:23.341518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1990e-dc68-46d4-a135-4a6744755310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:23.341753 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1990e-dc68-46d4-a135-4a6744755310 admin admin] PATH_INFO: `/v3/users/17db63b173bd478a93045e52747c4580` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:23.343115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b1990e-dc68-46d4-a135-4a6744755310 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17db63b173bd478a93045e52747c4580)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:23.345222 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b1990e-dc68-46d4-a135-4a6744755310 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:23.453461 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:23.464973 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-78b1990e-dc68-46d4-a135-4a6744755310 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17db63b173bd478a93045e52747c4580'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:23.465994 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-78b1990e-dc68-46d4-a135-4a6744755310 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17db63b173bd478a93045e52747c4580'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:23.470980 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c1995-ac99-452a-9766-5bd48f8d718b tempest-DomainsNegativeTestJSON-1956640050 tempest-DomainsNegativeTestJSON-1956640050-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:23.492037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f07b6b-4bfe-4e9e-b3a0-7cdfecc910d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:23.493535 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f07b6b-4bfe-4e9e-b3a0-7cdfecc910d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:23.496975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f07b6b-4bfe-4e9e-b3a0-7cdfecc910d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:23.497831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f07b6b-4bfe-4e9e-b3a0-7cdfecc910d4 admin admin] PATH_INFO: `/v3/users/530203c169564bffbd94a7d1838a2461` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:23.501683 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-78b1990e-dc68-46d4-a135-4a6744755310 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17db63b173bd478a93045e52747c4580'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:23.501931 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f07b6b-4bfe-4e9e-b3a0-7cdfecc910d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=530203c169564bffbd94a7d1838a2461)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:23.503830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f07b6b-4bfe-4e9e-b3a0-7cdfecc910d4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:23.517344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-78b1990e-dc68-46d4-a135-4a6744755310 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17db63b173bd478a93045e52747c4580'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:23.518233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-78b1990e-dc68-46d4-a135-4a6744755310 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17db63b173bd478a93045e52747c4580'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:23.547488 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=77,keystone:DELETE=21,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:23.570540 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3849/7698] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:33:23 2022] DELETE /identity/v3/users/17db63b173bd478a93045e52747c4580 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:23.577635 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1b7ed-f437-4c0a-8049-fdbbd0875a0c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:23.577929 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1b7ed-f437-4c0a-8049-fdbbd0875a0c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:23.578287 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1b7ed-f437-4c0a-8049-fdbbd0875a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:23.660030 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c1a1b7ed-f437-4c0a-8049-fdbbd0875a0c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:23.672816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e7f07b6b-4bfe-4e9e-b3a0-7cdfecc910d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '530203c169564bffbd94a7d1838a2461'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:23.673790 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e7f07b6b-4bfe-4e9e-b3a0-7cdfecc910d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '530203c169564bffbd94a7d1838a2461'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:23.675792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c1a1b7ed-f437-4c0a-8049-fdbbd0875a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:23.708085 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e7f07b6b-4bfe-4e9e-b3a0-7cdfecc910d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '530203c169564bffbd94a7d1838a2461'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:23.725170 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e7f07b6b-4bfe-4e9e-b3a0-7cdfecc910d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '530203c169564bffbd94a7d1838a2461'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:23.726039 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e7f07b6b-4bfe-4e9e-b3a0-7cdfecc910d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '530203c169564bffbd94a7d1838a2461'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:23.804437 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3850/7699] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:33:23 2022] DELETE /identity/v3/users/530203c169564bffbd94a7d1838a2461 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:23.809590 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b555d5-8b7c-4b34-b7f8-2a27e7dd3e31 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:23.810311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b555d5-8b7c-4b34-b7f8-2a27e7dd3e31 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:23.810810 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b555d5-8b7c-4b34-b7f8-2a27e7dd3e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:23.874419 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3850/7700] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:23.880335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-17b555d5-8b7c-4b34-b7f8-2a27e7dd3e31 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:23.881719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-17b555d5-8b7c-4b34-b7f8-2a27e7dd3e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:23.902454 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1b7ed-f437-4c0a-8049-fdbbd0875a0c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:23.904481 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c1a1b7ed-f437-4c0a-8049-fdbbd0875a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:24.052977 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3851/7701] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:24.068012 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b555d5-8b7c-4b34-b7f8-2a27e7dd3e31 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:24.069648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-17b555d5-8b7c-4b34-b7f8-2a27e7dd3e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:24.095328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1b7ed-f437-4c0a-8049-fdbbd0875a0c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:24.193834 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bfcd0-79ab-45eb-8006-14f143aac85c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:24.194971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bfcd0-79ab-45eb-8006-14f143aac85c service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:24.195105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bfcd0-79ab-45eb-8006-14f143aac85c service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:24.195210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b555d5-8b7c-4b34-b7f8-2a27e7dd3e31 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:24.198350 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bfcd0-79ab-45eb-8006-14f143aac85c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:24.216342 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34bfcd0-79ab-45eb-8006-14f143aac85c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:24.217863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34bfcd0-79ab-45eb-8006-14f143aac85c service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:24.222631 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569f45c-848c-4293-80fd-fc7b87f80fc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:24.223406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569f45c-848c-4293-80fd-fc7b87f80fc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:24.223694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569f45c-848c-4293-80fd-fc7b87f80fc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:24.224102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569f45c-848c-4293-80fd-fc7b87f80fc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:24.229962 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3851/7702] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:33:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:33:24.265552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c569f45c-848c-4293-80fd-fc7b87f80fc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:24.267011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c569f45c-848c-4293-80fd-fc7b87f80fc2 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:24.288769 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3852/7703] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:33:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:33:24.576418 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bfcd0-79ab-45eb-8006-14f143aac85c service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:24.578774 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c34bfcd0-79ab-45eb-8006-14f143aac85c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:24.607436 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bfcd0-79ab-45eb-8006-14f143aac85c service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:24.615860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc848a6-5666-4ce2-aaa3-8c670de433de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:24.616887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc848a6-5666-4ce2-aaa3-8c670de433de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:24.617340 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc848a6-5666-4ce2-aaa3-8c670de433de admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:24.618443 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc848a6-5666-4ce2-aaa3-8c670de433de admin admin] PATH_INFO: `/v3/users/975fd6a669c3415e81ad7e59bb6be3b3` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:24.621285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc848a6-5666-4ce2-aaa3-8c670de433de admin admin] RBAC: Authorizing `identity:delete_user(user_id=975fd6a669c3415e81ad7e59bb6be3b3)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:24.627644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc848a6-5666-4ce2-aaa3-8c670de433de admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:24.729402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7fc848a6-5666-4ce2-aaa3-8c670de433de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '975fd6a669c3415e81ad7e59bb6be3b3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:24.731478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7fc848a6-5666-4ce2-aaa3-8c670de433de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '975fd6a669c3415e81ad7e59bb6be3b3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:24.741909 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:24.772584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7fc848a6-5666-4ce2-aaa3-8c670de433de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '975fd6a669c3415e81ad7e59bb6be3b3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:24.787270 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569f45c-848c-4293-80fd-fc7b87f80fc2 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:24.789527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c569f45c-848c-4293-80fd-fc7b87f80fc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:24.811331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7fc848a6-5666-4ce2-aaa3-8c670de433de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '975fd6a669c3415e81ad7e59bb6be3b3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:24.812483 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7fc848a6-5666-4ce2-aaa3-8c670de433de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '975fd6a669c3415e81ad7e59bb6be3b3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:24.821228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569f45c-848c-4293-80fd-fc7b87f80fc2 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:24.833585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96182a0-fada-43eb-a2fc-c7a6e9a095bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:24.837468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96182a0-fada-43eb-a2fc-c7a6e9a095bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:24.837468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96182a0-fada-43eb-a2fc-c7a6e9a095bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:24.839568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96182a0-fada-43eb-a2fc-c7a6e9a095bc admin admin] PATH_INFO: `/v3/projects/96fb6e8fbfa149c7a0957939487ae2bc` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:24.841350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96182a0-fada-43eb-a2fc-c7a6e9a095bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=96fb6e8fbfa149c7a0957939487ae2bc)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:24.845183 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96182a0-fada-43eb-a2fc-c7a6e9a095bc admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:24.855862 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3852/7704] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:33:24 2022] DELETE /identity/v3/users/975fd6a669c3415e81ad7e59bb6be3b3 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:24.860314 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8013663-a8c1-4582-b0b3-cace6fde7b3a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:24.861528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8013663-a8c1-4582-b0b3-cace6fde7b3a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:24.862026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8013663-a8c1-4582-b0b3-cace6fde7b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:24.878785 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:24.914206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a8013663-a8c1-4582-b0b3-cace6fde7b3a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:24.915681 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a8013663-a8c1-4582-b0b3-cace6fde7b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:24.943098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e96182a0-fada-43eb-a2fc-c7a6e9a095bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96fb6e8fbfa149c7a0957939487ae2bc', 'request_id': 'req-e96182a0-fada-43eb-a2fc-c7a6e9a095bc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:24.954095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e96182a0-fada-43eb-a2fc-c7a6e9a095bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96fb6e8fbfa149c7a0957939487ae2bc', 'request_id': 'req-e96182a0-fada-43eb-a2fc-c7a6e9a095bc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:24.961794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e96182a0-fada-43eb-a2fc-c7a6e9a095bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96fb6e8fbfa149c7a0957939487ae2bc', 'request_id': 'req-e96182a0-fada-43eb-a2fc-c7a6e9a095bc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:24.977849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e96182a0-fada-43eb-a2fc-c7a6e9a095bc admin admin] The token cache is being invalidate because project 96fb6e8fbfa149c7a0957939487ae2bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:33:24.977849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e96182a0-fada-43eb-a2fc-c7a6e9a095bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:24.979394 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e96182a0-fada-43eb-a2fc-c7a6e9a095bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:24.981971 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3853/7705] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:33:24 2022] DELETE /identity/v3/projects/96fb6e8fbfa149c7a0957939487ae2bc => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:24.982970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96182a0-fada-43eb-a2fc-c7a6e9a095bc admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:24.984959 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e96182a0-fada-43eb-a2fc-c7a6e9a095bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:25.007998 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3853/7706] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:33:25.007998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa8592-4693-43ef-80ec-2e9039f3314b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:25.007998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa8592-4693-43ef-80ec-2e9039f3314b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:25.007998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa8592-4693-43ef-80ec-2e9039f3314b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:25.032043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a9fa8592-4693-43ef-80ec-2e9039f3314b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:25.033563 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a9fa8592-4693-43ef-80ec-2e9039f3314b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:25.044555 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3854/7707] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:25.045675 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa8592-4693-43ef-80ec-2e9039f3314b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:25.047001 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a9fa8592-4693-43ef-80ec-2e9039f3314b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:25.108451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96182a0-fada-43eb-a2fc-c7a6e9a095bc admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:25.122752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa8592-4693-43ef-80ec-2e9039f3314b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:25.125368 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f102ee-acd9-4bcf-85ae-2ffab43b3369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:25.126209 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f102ee-acd9-4bcf-85ae-2ffab43b3369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:25.126488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f102ee-acd9-4bcf-85ae-2ffab43b3369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:25.126841 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f102ee-acd9-4bcf-85ae-2ffab43b3369 admin admin] PATH_INFO: `/v3/projects/a7a7e657f490417891d8cfa2550303cf` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:25.128273 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a233d40-036f-41bc-8886-85112e22a95b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:25.128440 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f102ee-acd9-4bcf-85ae-2ffab43b3369 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7a7e657f490417891d8cfa2550303cf)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:25.129228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a233d40-036f-41bc-8886-85112e22a95b service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:25.129999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a233d40-036f-41bc-8886-85112e22a95b service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:25.130394 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a233d40-036f-41bc-8886-85112e22a95b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:25.130637 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f102ee-acd9-4bcf-85ae-2ffab43b3369 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:25.145833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a233d40-036f-41bc-8886-85112e22a95b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:25.147986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a233d40-036f-41bc-8886-85112e22a95b service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:25.160222 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3855/7708] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:33:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:33:25.162024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061125e-8585-4438-b1e6-9a322c51df92 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:25.162547 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061125e-8585-4438-b1e6-9a322c51df92 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:25.163100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061125e-8585-4438-b1e6-9a322c51df92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:25.191394 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-9061125e-8585-4438-b1e6-9a322c51df92 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:25.193313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9061125e-8585-4438-b1e6-9a322c51df92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:25.206114 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3856/7709] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:25.210348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061125e-8585-4438-b1e6-9a322c51df92 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:25.240544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061125e-8585-4438-b1e6-9a322c51df92 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:25.272278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-24f102ee-acd9-4bcf-85ae-2ffab43b3369 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7a7e657f490417891d8cfa2550303cf', 'request_id': 'req-24f102ee-acd9-4bcf-85ae-2ffab43b3369'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:25.295045 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-24f102ee-acd9-4bcf-85ae-2ffab43b3369 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7a7e657f490417891d8cfa2550303cf', 'request_id': 'req-24f102ee-acd9-4bcf-85ae-2ffab43b3369'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:25.306998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-24f102ee-acd9-4bcf-85ae-2ffab43b3369 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7a7e657f490417891d8cfa2550303cf', 'request_id': 'req-24f102ee-acd9-4bcf-85ae-2ffab43b3369'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:25.340294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-24f102ee-acd9-4bcf-85ae-2ffab43b3369 admin admin] The token cache is being invalidate because project a7a7e657f490417891d8cfa2550303cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:33:25.345315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-24f102ee-acd9-4bcf-85ae-2ffab43b3369 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:25.347011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-24f102ee-acd9-4bcf-85ae-2ffab43b3369 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:25.351558 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3854/7710] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:33:24 2022] DELETE /identity/v3/projects/a7a7e657f490417891d8cfa2550303cf => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:25.357729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f102ee-acd9-4bcf-85ae-2ffab43b3369 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:25.362010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-24f102ee-acd9-4bcf-85ae-2ffab43b3369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:25.396565 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:25.409912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e773a78-b5bf-4fbb-b063-af358249cbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:25.411091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e773a78-b5bf-4fbb-b063-af358249cbc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:25.411221 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e773a78-b5bf-4fbb-b063-af358249cbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:25.412574 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e773a78-b5bf-4fbb-b063-af358249cbc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:25.413348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e773a78-b5bf-4fbb-b063-af358249cbc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:33:25.414247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e773a78-b5bf-4fbb-b063-af358249cbc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:25.418402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e773a78-b5bf-4fbb-b063-af358249cbc5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:25.452217 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:25.474534 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3857/7711] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:33:25.475955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e773a78-b5bf-4fbb-b063-af358249cbc5 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:25.478915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1e773a78-b5bf-4fbb-b063-af358249cbc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:25.507449 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e773a78-b5bf-4fbb-b063-af358249cbc5 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:25.515785 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c700c-50e5-4cdf-809b-9cfd175fb3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:25.516411 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c700c-50e5-4cdf-809b-9cfd175fb3ae admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:25.516690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c700c-50e5-4cdf-809b-9cfd175fb3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:25.516961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c700c-50e5-4cdf-809b-9cfd175fb3ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:25.518037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f102ee-acd9-4bcf-85ae-2ffab43b3369 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:25.519406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c700c-50e5-4cdf-809b-9cfd175fb3ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:25.526897 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c700c-50e5-4cdf-809b-9cfd175fb3ae admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:25.530873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06c97c-baaf-496b-a2fa-fb6a250db81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:25.542059 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06c97c-baaf-496b-a2fa-fb6a250db81c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:25.542346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06c97c-baaf-496b-a2fa-fb6a250db81c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:25.542619 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06c97c-baaf-496b-a2fa-fb6a250db81c admin admin] PATH_INFO: `/v3/users/95366b0c8ec3420bb94dd711669e5dee` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:25.546027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06c97c-baaf-496b-a2fa-fb6a250db81c admin admin] RBAC: Authorizing `identity:delete_user(user_id=95366b0c8ec3420bb94dd711669e5dee)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:25.548010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06c97c-baaf-496b-a2fa-fb6a250db81c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:25.578492 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3858/7712] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:33:25 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:33:25.593265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c700c-50e5-4cdf-809b-9cfd175fb3ae admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:25.646539 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2a06c97c-baaf-496b-a2fa-fb6a250db81c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95366b0c8ec3420bb94dd711669e5dee'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:25.647260 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2a06c97c-baaf-496b-a2fa-fb6a250db81c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95366b0c8ec3420bb94dd711669e5dee'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:25.665755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2a06c97c-baaf-496b-a2fa-fb6a250db81c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95366b0c8ec3420bb94dd711669e5dee'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:25.689404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2a06c97c-baaf-496b-a2fa-fb6a250db81c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95366b0c8ec3420bb94dd711669e5dee'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:25.690499 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2a06c97c-baaf-496b-a2fa-fb6a250db81c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95366b0c8ec3420bb94dd711669e5dee'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:25.716382 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3855/7713] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:33:25 2022] DELETE /identity/v3/users/95366b0c8ec3420bb94dd711669e5dee => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:25.795810 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c700c-50e5-4cdf-809b-9cfd175fb3ae admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:25.890883 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb20b5e-8474-4bc3-9dc9-d847ac1adcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:25.892216 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb20b5e-8474-4bc3-9dc9-d847ac1adcf7 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:25.892723 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb20b5e-8474-4bc3-9dc9-d847ac1adcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:25.893543 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb20b5e-8474-4bc3-9dc9-d847ac1adcf7 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:25.894437 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb20b5e-8474-4bc3-9dc9-d847ac1adcf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:25.897049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb20b5e-8474-4bc3-9dc9-d847ac1adcf7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:25.919690 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06c97c-baaf-496b-a2fa-fb6a250db81c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:25.921634 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2a06c97c-baaf-496b-a2fa-fb6a250db81c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:25.949272 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06c97c-baaf-496b-a2fa-fb6a250db81c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:25.951185 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3859/7714] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:33:25 2022] POST /identity/v3/users => generated 290 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:25.956817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb20b5e-8474-4bc3-9dc9-d847ac1adcf7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:25.962196 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8bb20b5e-8474-4bc3-9dc9-d847ac1adcf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:25.967757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462270c5-35b7-4cf2-830d-7688b07a0670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:25.968668 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462270c5-35b7-4cf2-830d-7688b07a0670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:25.968947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462270c5-35b7-4cf2-830d-7688b07a0670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:25.969218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462270c5-35b7-4cf2-830d-7688b07a0670 admin admin] PATH_INFO: `/v3/projects/b65247f660cd4e4e8df18a0977bf8d8e` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:26.002927 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462270c5-35b7-4cf2-830d-7688b07a0670 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b65247f660cd4e4e8df18a0977bf8d8e)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:26.006623 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462270c5-35b7-4cf2-830d-7688b07a0670 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:26.041693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb20b5e-8474-4bc3-9dc9-d847ac1adcf7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:26.058275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc59e04-c5aa-4997-ac7a-c0dbb391b98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:26.059366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc59e04-c5aa-4997-ac7a-c0dbb391b98d admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:26.060121 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc59e04-c5aa-4997-ac7a-c0dbb391b98d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:26.060693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc59e04-c5aa-4997-ac7a-c0dbb391b98d admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:26.061478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc59e04-c5aa-4997-ac7a-c0dbb391b98d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:26.063191 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc59e04-c5aa-4997-ac7a-c0dbb391b98d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:26.080147 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3860/7715] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:33:26.090241 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc59e04-c5aa-4997-ac7a-c0dbb391b98d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:26.093612 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-462270c5-35b7-4cf2-830d-7688b07a0670 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b65247f660cd4e4e8df18a0977bf8d8e', 'request_id': 'req-462270c5-35b7-4cf2-830d-7688b07a0670'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:26.111356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-462270c5-35b7-4cf2-830d-7688b07a0670 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b65247f660cd4e4e8df18a0977bf8d8e', 'request_id': 'req-462270c5-35b7-4cf2-830d-7688b07a0670'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:26.121882 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-462270c5-35b7-4cf2-830d-7688b07a0670 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b65247f660cd4e4e8df18a0977bf8d8e', 'request_id': 'req-462270c5-35b7-4cf2-830d-7688b07a0670'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:26.128847 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc59e04-c5aa-4997-ac7a-c0dbb391b98d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:26.137564 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-462270c5-35b7-4cf2-830d-7688b07a0670 admin admin] The token cache is being invalidate because project b65247f660cd4e4e8df18a0977bf8d8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:33:26.137935 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-462270c5-35b7-4cf2-830d-7688b07a0670 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:26.138671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-462270c5-35b7-4cf2-830d-7688b07a0670 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:26.140238 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3856/7716] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:33:25 2022] DELETE /identity/v3/projects/b65247f660cd4e4e8df18a0977bf8d8e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:26.144727 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462270c5-35b7-4cf2-830d-7688b07a0670 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:26.146971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-462270c5-35b7-4cf2-830d-7688b07a0670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:26.215795 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:26.262793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462270c5-35b7-4cf2-830d-7688b07a0670 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:26.269099 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82c23c-25ec-48f6-a9a5-b7504c963c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:26.270257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82c23c-25ec-48f6-a9a5-b7504c963c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:26.270257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82c23c-25ec-48f6-a9a5-b7504c963c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:26.270660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82c23c-25ec-48f6-a9a5-b7504c963c14 admin admin] PATH_INFO: `/v3/users/a741c1be56564f9cbfeecf8d99bc5730` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:26.271910 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82c23c-25ec-48f6-a9a5-b7504c963c14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a741c1be56564f9cbfeecf8d99bc5730)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:26.275027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82c23c-25ec-48f6-a9a5-b7504c963c14 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:26.288170 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:26.311101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8eeca-a26a-4885-82d7-88a6c338ff1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:26.311728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8eeca-a26a-4885-82d7-88a6c338ff1d admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:26.312007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8eeca-a26a-4885-82d7-88a6c338ff1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:26.312281 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8eeca-a26a-4885-82d7-88a6c338ff1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:26.312927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8eeca-a26a-4885-82d7-88a6c338ff1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:26.314604 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8eeca-a26a-4885-82d7-88a6c338ff1d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:26.332800 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3861/7717] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:33:26.341018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8eeca-a26a-4885-82d7-88a6c338ff1d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:26.346616 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1be8eeca-a26a-4885-82d7-88a6c338ff1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:26.372457 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ac82c23c-25ec-48f6-a9a5-b7504c963c14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a741c1be56564f9cbfeecf8d99bc5730'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:26.374892 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ac82c23c-25ec-48f6-a9a5-b7504c963c14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a741c1be56564f9cbfeecf8d99bc5730'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:26.380881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8eeca-a26a-4885-82d7-88a6c338ff1d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:26.391983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ac82c23c-25ec-48f6-a9a5-b7504c963c14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a741c1be56564f9cbfeecf8d99bc5730'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:26.395599 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d71c5-5c22-4e38-bd91-f7c089d996e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:26.396471 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d71c5-5c22-4e38-bd91-f7c089d996e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:26.396757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d71c5-5c22-4e38-bd91-f7c089d996e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:26.397034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d71c5-5c22-4e38-bd91-f7c089d996e0 admin admin] PATH_INFO: `/v3/projects/1d3c5cd8b39049a990b6b56a16b80996/users/2ea30e165a2845d6b9e5e8a8e9dd4c61/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:26.403567 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ac82c23c-25ec-48f6-a9a5-b7504c963c14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a741c1be56564f9cbfeecf8d99bc5730'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:26.405966 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ac82c23c-25ec-48f6-a9a5-b7504c963c14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a741c1be56564f9cbfeecf8d99bc5730'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:26.442992 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d71c5-5c22-4e38-bd91-f7c089d996e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3c5cd8b39049a990b6b56a16b80996, user_id=2ea30e165a2845d6b9e5e8a8e9dd4c61, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:26.452245 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3857/7718] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:33:26 2022] DELETE /identity/v3/users/a741c1be56564f9cbfeecf8d99bc5730 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:33:26.452960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d71c5-5c22-4e38-bd91-f7c089d996e0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:26.456224 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82c23c-25ec-48f6-a9a5-b7504c963c14 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:26.457967 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ac82c23c-25ec-48f6-a9a5-b7504c963c14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:26.497800 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3862/7719] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:33:26 2022] PUT /identity/v3/projects/1d3c5cd8b39049a990b6b56a16b80996/users/2ea30e165a2845d6b9e5e8a8e9dd4c61/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:26.507891 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa61ae9-14c0-457f-8c83-47b210b4e222 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:26.508178 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa61ae9-14c0-457f-8c83-47b210b4e222 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:26.508458 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa61ae9-14c0-457f-8c83-47b210b4e222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:26.550314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82c23c-25ec-48f6-a9a5-b7504c963c14 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:26.568271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-4fa61ae9-14c0-457f-8c83-47b210b4e222 None None] MFA Rules not processed for user `2ea30e165a2845d6b9e5e8a8e9dd4c61`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:26.569682 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4fa61ae9-14c0-457f-8c83-47b210b4e222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:26.615325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b9e4f-f73c-4eb3-ac76-c1afe44eee47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:26.616225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b9e4f-f73c-4eb3-ac76-c1afe44eee47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:26.616225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b9e4f-f73c-4eb3-ac76-c1afe44eee47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:26.616475 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b9e4f-f73c-4eb3-ac76-c1afe44eee47 admin admin] PATH_INFO: `/v3/projects/e3ad2b0fc24e44ab89a6ae950f5eabb8` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:26.617761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b9e4f-f73c-4eb3-ac76-c1afe44eee47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3ad2b0fc24e44ab89a6ae950f5eabb8)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:26.620432 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b9e4f-f73c-4eb3-ac76-c1afe44eee47 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:26.622131 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:26.711004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-389b9e4f-f73c-4eb3-ac76-c1afe44eee47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3ad2b0fc24e44ab89a6ae950f5eabb8', 'request_id': 'req-389b9e4f-f73c-4eb3-ac76-c1afe44eee47'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:26.727933 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3863/7720] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:33:26.733493 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-389b9e4f-f73c-4eb3-ac76-c1afe44eee47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3ad2b0fc24e44ab89a6ae950f5eabb8', 'request_id': 'req-389b9e4f-f73c-4eb3-ac76-c1afe44eee47'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:26.747610 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa61ae9-14c0-457f-8c83-47b210b4e222 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:26.749135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4fa61ae9-14c0-457f-8c83-47b210b4e222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:26.758619 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-389b9e4f-f73c-4eb3-ac76-c1afe44eee47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3ad2b0fc24e44ab89a6ae950f5eabb8', 'request_id': 'req-389b9e4f-f73c-4eb3-ac76-c1afe44eee47'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:26.774797 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-389b9e4f-f73c-4eb3-ac76-c1afe44eee47 admin admin] The token cache is being invalidate because project e3ad2b0fc24e44ab89a6ae950f5eabb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:33:26.776312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-389b9e4f-f73c-4eb3-ac76-c1afe44eee47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:26.777255 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-389b9e4f-f73c-4eb3-ac76-c1afe44eee47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:26.779007 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3858/7721] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:33:26 2022] DELETE /identity/v3/projects/e3ad2b0fc24e44ab89a6ae950f5eabb8 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:26.784679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24eac99-e891-4270-b221-65027e8cc04b None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:26.785506 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24eac99-e891-4270-b221-65027e8cc04b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:26.786334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24eac99-e891-4270-b221-65027e8cc04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:26.813935 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-f24eac99-e891-4270-b221-65027e8cc04b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:26.815737 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f24eac99-e891-4270-b221-65027e8cc04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:26.895998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa61ae9-14c0-457f-8c83-47b210b4e222 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:26.906970 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3859/7722] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:26.914687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9bdb6-ef84-4266-8f6b-8cd77caf5017 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:26.915104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9bdb6-ef84-4266-8f6b-8cd77caf5017 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:26.915484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9bdb6-ef84-4266-8f6b-8cd77caf5017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:26.943313 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-ebe9bdb6-ef84-4266-8f6b-8cd77caf5017 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:26.944974 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ebe9bdb6-ef84-4266-8f6b-8cd77caf5017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:26.956050 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3860/7723] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:26.961171 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe9bdb6-ef84-4266-8f6b-8cd77caf5017 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:26.975524 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe9bdb6-ef84-4266-8f6b-8cd77caf5017 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:26.981951 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84418f81-f583-463d-b1f0-8cdb3aa28215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:26.982814 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84418f81-f583-463d-b1f0-8cdb3aa28215 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:26.983161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84418f81-f583-463d-b1f0-8cdb3aa28215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:26.983556 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84418f81-f583-463d-b1f0-8cdb3aa28215 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:26.984674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84418f81-f583-463d-b1f0-8cdb3aa28215 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:33:26.984674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84418f81-f583-463d-b1f0-8cdb3aa28215 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:26.986630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84418f81-f583-463d-b1f0-8cdb3aa28215 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:27.015881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567f9c0-e2bd-4d32-a12d-1da73d4cc074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:27.015881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567f9c0-e2bd-4d32-a12d-1da73d4cc074 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:27.015881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567f9c0-e2bd-4d32-a12d-1da73d4cc074 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:27.016309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567f9c0-e2bd-4d32-a12d-1da73d4cc074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:27.016998 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3861/7724] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:33:27.018125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84418f81-f583-463d-b1f0-8cdb3aa28215 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:27.021357 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-84418f81-f583-463d-b1f0-8cdb3aa28215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:27.026028 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5567f9c0-e2bd-4d32-a12d-1da73d4cc074 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:27.046284 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84418f81-f583-463d-b1f0-8cdb3aa28215 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:27.056188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9b65b-3171-4311-96a2-a1cb160f0f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:27.057725 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9b65b-3171-4311-96a2-a1cb160f0f4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:27.057926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9b65b-3171-4311-96a2-a1cb160f0f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:27.058466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9b65b-3171-4311-96a2-a1cb160f0f4a admin admin] PATH_INFO: `/v3/projects/283b3256c40f43d9949f174bc879e020` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:27.061731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9b65b-3171-4311-96a2-a1cb160f0f4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=283b3256c40f43d9949f174bc879e020)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:27.063948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9b65b-3171-4311-96a2-a1cb160f0f4a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:27.068909 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:27.153130 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5567f9c0-e2bd-4d32-a12d-1da73d4cc074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:27.155168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5567f9c0-e2bd-4d32-a12d-1da73d4cc074 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:27.163340 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-23a9b65b-3171-4311-96a2-a1cb160f0f4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '283b3256c40f43d9949f174bc879e020', 'request_id': 'req-23a9b65b-3171-4311-96a2-a1cb160f0f4a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:27.174389 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3864/7725] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:33:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:33:27.177392 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567f9c0-e2bd-4d32-a12d-1da73d4cc074 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:27.187140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-23a9b65b-3171-4311-96a2-a1cb160f0f4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '283b3256c40f43d9949f174bc879e020', 'request_id': 'req-23a9b65b-3171-4311-96a2-a1cb160f0f4a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:27.193711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567f9c0-e2bd-4d32-a12d-1da73d4cc074 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:27.203918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-23a9b65b-3171-4311-96a2-a1cb160f0f4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '283b3256c40f43d9949f174bc879e020', 'request_id': 'req-23a9b65b-3171-4311-96a2-a1cb160f0f4a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:27.208279 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:27.250367 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-23a9b65b-3171-4311-96a2-a1cb160f0f4a admin admin] The token cache is being invalidate because project 283b3256c40f43d9949f174bc879e020 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:33:27.250593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-23a9b65b-3171-4311-96a2-a1cb160f0f4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:27.254397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-23a9b65b-3171-4311-96a2-a1cb160f0f4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:27.260750 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3862/7726] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:33:27 2022] DELETE /identity/v3/projects/283b3256c40f43d9949f174bc879e020 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:27.262189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40bd19-717a-4219-b4e8-510cf40ab42b None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:27.262465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40bd19-717a-4219-b4e8-510cf40ab42b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:27.262741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40bd19-717a-4219-b4e8-510cf40ab42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:27.323207 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-1f40bd19-717a-4219-b4e8-510cf40ab42b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:27.325039 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1f40bd19-717a-4219-b4e8-510cf40ab42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:27.360788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3e7a5-897f-4856-a708-6e80fd3f512f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:27.367223 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3e7a5-897f-4856-a708-6e80fd3f512f admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:27.367526 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3e7a5-897f-4856-a708-6e80fd3f512f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:27.381902 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3e7a5-897f-4856-a708-6e80fd3f512f admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:27.382751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3e7a5-897f-4856-a708-6e80fd3f512f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:27.391479 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3e7a5-897f-4856-a708-6e80fd3f512f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:27.412274 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3863/7727] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:27.420034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd2c18-37d4-4668-91b3-b8a0a12055df None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:27.420324 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd2c18-37d4-4668-91b3-b8a0a12055df None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:27.420597 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd2c18-37d4-4668-91b3-b8a0a12055df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:27.481764 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3865/7728] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:33:27 2022] POST /identity/v3/projects => generated 367 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:27.490228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3e7a5-897f-4856-a708-6e80fd3f512f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:27.493391 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6bf3e7a5-897f-4856-a708-6e80fd3f512f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:27.500621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-95fd2c18-37d4-4668-91b3-b8a0a12055df None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:27.502361 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-95fd2c18-37d4-4668-91b3-b8a0a12055df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:27.619585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3e7a5-897f-4856-a708-6e80fd3f512f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:27.640213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a7fbd-48cf-4986-b8a1-f39717bab9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:27.641961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a7fbd-48cf-4986-b8a1-f39717bab9e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:27.642251 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a7fbd-48cf-4986-b8a1-f39717bab9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:27.642543 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a7fbd-48cf-4986-b8a1-f39717bab9e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:27.643208 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a7fbd-48cf-4986-b8a1-f39717bab9e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:27.648491 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3864/7729] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:33:27.652760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd2c18-37d4-4668-91b3-b8a0a12055df None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:27.653018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a7fbd-48cf-4986-b8a1-f39717bab9e1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:27.664561 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd2c18-37d4-4668-91b3-b8a0a12055df None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:27.672213 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20a014-cbac-43e0-bcda-bf8ca5e256d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:27.673121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20a014-cbac-43e0-bcda-bf8ca5e256d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:27.673660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20a014-cbac-43e0-bcda-bf8ca5e256d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:27.674373 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20a014-cbac-43e0-bcda-bf8ca5e256d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:27.675358 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef20a014-cbac-43e0-bcda-bf8ca5e256d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:33:27.675888 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef20a014-cbac-43e0-bcda-bf8ca5e256d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:27.677883 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef20a014-cbac-43e0-bcda-bf8ca5e256d5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:27.678456 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3866/7730] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:33:27 2022] POST /identity/v3/users => generated 284 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:27.683913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a7fbd-48cf-4986-b8a1-f39717bab9e1 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:27.696697 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a7fbd-48cf-4986-b8a1-f39717bab9e1 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:27.700771 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3865/7731] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:33:27.705708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20a014-cbac-43e0-bcda-bf8ca5e256d5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:27.706973 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7542bc0-c9ed-494d-9730-6a859cf3a02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:27.707921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7542bc0-c9ed-494d-9730-6a859cf3a02c admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:27.709502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7542bc0-c9ed-494d-9730-6a859cf3a02c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:27.709502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7542bc0-c9ed-494d-9730-6a859cf3a02c admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:27.710361 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7542bc0-c9ed-494d-9730-6a859cf3a02c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:27.712193 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7542bc0-c9ed-494d-9730-6a859cf3a02c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:27.723004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20a014-cbac-43e0-bcda-bf8ca5e256d5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:27.729809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c601b04-05e4-4a1d-b9ed-b7c87ee0b6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:27.730387 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3867/7732] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:33:27.730545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c601b04-05e4-4a1d-b9ed-b7c87ee0b6fc admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:27.730685 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c601b04-05e4-4a1d-b9ed-b7c87ee0b6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:27.730956 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c601b04-05e4-4a1d-b9ed-b7c87ee0b6fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:27.731616 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c601b04-05e4-4a1d-b9ed-b7c87ee0b6fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:27.733786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c601b04-05e4-4a1d-b9ed-b7c87ee0b6fc admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:27.734979 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7542bc0-c9ed-494d-9730-6a859cf3a02c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:27.751827 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7542bc0-c9ed-494d-9730-6a859cf3a02c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:27.762220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc7fdc-e315-4d21-901c-57694a9a989e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:27.764032 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc7fdc-e315-4d21-901c-57694a9a989e admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:27.764188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc7fdc-e315-4d21-901c-57694a9a989e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:27.765531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc7fdc-e315-4d21-901c-57694a9a989e admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:27.767627 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc7fdc-e315-4d21-901c-57694a9a989e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:27.772155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc7fdc-e315-4d21-901c-57694a9a989e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:27.782677 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3866/7733] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:33:27 2022] POST /identity/v3/projects => generated 381 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:33:27.784978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c601b04-05e4-4a1d-b9ed-b7c87ee0b6fc admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:27.802141 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3868/7734] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:33:27.822330 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc7fdc-e315-4d21-901c-57694a9a989e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:27.833257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc7fdc-e315-4d21-901c-57694a9a989e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:27.852061 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:27.880090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c601b04-05e4-4a1d-b9ed-b7c87ee0b6fc admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:27.884742 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10baf3a0-889f-4f22-bdb3-4b00c7129a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:27.885479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10baf3a0-889f-4f22-bdb3-4b00c7129a64 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:27.885810 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10baf3a0-889f-4f22-bdb3-4b00c7129a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:27.885940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10baf3a0-889f-4f22-bdb3-4b00c7129a64 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:27.886545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10baf3a0-889f-4f22-bdb3-4b00c7129a64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:27.889167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10baf3a0-889f-4f22-bdb3-4b00c7129a64 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:27.898256 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:27.922333 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3867/7735] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:33:27 2022] POST /identity/v3/users => generated 291 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:27.923280 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10baf3a0-889f-4f22-bdb3-4b00c7129a64 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:27.936385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10baf3a0-889f-4f22-bdb3-4b00c7129a64 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:27.937894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ebc20-ec4e-4eba-a177-4e9c6f7a4b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:27.938805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ebc20-ec4e-4eba-a177-4e9c6f7a4b30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:27.939226 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ebc20-ec4e-4eba-a177-4e9c6f7a4b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:27.939650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ebc20-ec4e-4eba-a177-4e9c6f7a4b30 admin admin] PATH_INFO: `/v3/projects/6c151a8f2c6a43e88c830b4b37f8ac85/users/d7c33f1afa08484a8925f61d5eb8a3ef/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:27.941165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b181f-06b3-41b7-bf56-8244c8f58b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:27.942074 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b181f-06b3-41b7-bf56-8244c8f58b12 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:27.942366 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b181f-06b3-41b7-bf56-8244c8f58b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:27.942760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b181f-06b3-41b7-bf56-8244c8f58b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:27.943409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b181f-06b3-41b7-bf56-8244c8f58b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:27.946556 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b181f-06b3-41b7-bf56-8244c8f58b12 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:27.963870 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3868/7736] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:33:27.965356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b181f-06b3-41b7-bf56-8244c8f58b12 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:27.967996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ebc20-ec4e-4eba-a177-4e9c6f7a4b30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c151a8f2c6a43e88c830b4b37f8ac85, user_id=d7c33f1afa08484a8925f61d5eb8a3ef, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:27.973678 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ebc20-ec4e-4eba-a177-4e9c6f7a4b30 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:27.978891 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b181f-06b3-41b7-bf56-8244c8f58b12 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:27.996553 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf3830-bc73-4827-ba48-41876552d6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:27.997411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf3830-bc73-4827-ba48-41876552d6f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:27.997754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf3830-bc73-4827-ba48-41876552d6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:27.998033 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf3830-bc73-4827-ba48-41876552d6f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:27.998790 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf3830-bc73-4827-ba48-41876552d6f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:28.000432 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3869/7737] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:33:27 2022] PUT /identity/v3/projects/6c151a8f2c6a43e88c830b4b37f8ac85/users/d7c33f1afa08484a8925f61d5eb8a3ef/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:28.000571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf3830-bc73-4827-ba48-41876552d6f6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:28.008107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597637b8-660d-4ff9-8df7-b0057ddb3b3d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:28.008634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597637b8-660d-4ff9-8df7-b0057ddb3b3d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:28.009100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597637b8-660d-4ff9-8df7-b0057ddb3b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:28.015158 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3869/7738] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:33:28.019442 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf3830-bc73-4827-ba48-41876552d6f6 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:28.031808 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf3830-bc73-4827-ba48-41876552d6f6 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:28.061498 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-597637b8-660d-4ff9-8df7-b0057ddb3b3d None None] MFA Rules not processed for user `d7c33f1afa08484a8925f61d5eb8a3ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:28.062879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-597637b8-660d-4ff9-8df7-b0057ddb3b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:28.104404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d0251-f0df-46f7-accc-fad245d59a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:28.105214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d0251-f0df-46f7-accc-fad245d59a2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:28.105625 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d0251-f0df-46f7-accc-fad245d59a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:28.106044 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d0251-f0df-46f7-accc-fad245d59a2e admin admin] PATH_INFO: `/v3/projects/abfc3f66b7bb4d31a2f6e4a308da0bc0/users/dfa9ddef7fa54d079b2199d79eea3183/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:28.126616 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d0251-f0df-46f7-accc-fad245d59a2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=abfc3f66b7bb4d31a2f6e4a308da0bc0, user_id=dfa9ddef7fa54d079b2199d79eea3183, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:28.130252 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d0251-f0df-46f7-accc-fad245d59a2e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:28.142685 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3870/7739] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:28.143755 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597637b8-660d-4ff9-8df7-b0057ddb3b3d None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:28.152269 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3870/7740] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:33:28 2022] PUT /identity/v3/projects/abfc3f66b7bb4d31a2f6e4a308da0bc0/users/dfa9ddef7fa54d079b2199d79eea3183/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:33:28.157467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597637b8-660d-4ff9-8df7-b0057ddb3b3d None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:28.165055 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4412f-7881-4417-af1c-b36b482bbe2a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:28.166647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4412f-7881-4417-af1c-b36b482bbe2a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:28.167831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4412f-7881-4417-af1c-b36b482bbe2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:28.216778 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d5e4412f-7881-4417-af1c-b36b482bbe2a None None] MFA Rules not processed for user `dfa9ddef7fa54d079b2199d79eea3183`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:28.218023 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d5e4412f-7881-4417-af1c-b36b482bbe2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:28.224548 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41654e-cf8e-4bd8-8361-47319ad00cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:28.225224 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41654e-cf8e-4bd8-8361-47319ad00cbe admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:28.225535 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41654e-cf8e-4bd8-8361-47319ad00cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:28.225812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41654e-cf8e-4bd8-8361-47319ad00cbe admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:28.226485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff41654e-cf8e-4bd8-8361-47319ad00cbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:28.229017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff41654e-cf8e-4bd8-8361-47319ad00cbe admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:28.260959 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3871/7741] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:33:28 2022] POST /identity/v3/projects => generated 369 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:28.262565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41654e-cf8e-4bd8-8361-47319ad00cbe admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:28.288729 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:28.297826 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3871/7742] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:28.298872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4412f-7881-4417-af1c-b36b482bbe2a None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:28.313991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4412f-7881-4417-af1c-b36b482bbe2a None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:28.346603 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41654e-cf8e-4bd8-8361-47319ad00cbe admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:28.353027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0cc18-34a0-4e95-8b0e-00deb3abc535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:28.354293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0cc18-34a0-4e95-8b0e-00deb3abc535 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:28.354570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0cc18-34a0-4e95-8b0e-00deb3abc535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:28.354841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0cc18-34a0-4e95-8b0e-00deb3abc535 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:28.355468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0cc18-34a0-4e95-8b0e-00deb3abc535 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:28.357409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0cc18-34a0-4e95-8b0e-00deb3abc535 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:28.360318 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:28.386072 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3872/7743] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:33:28 2022] POST /identity/v3/users => generated 291 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:33:28.387240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0cc18-34a0-4e95-8b0e-00deb3abc535 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:28.394353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957a29e-f84a-451f-8e3d-0e81f93892fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:28.395085 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957a29e-f84a-451f-8e3d-0e81f93892fb admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:28.395460 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957a29e-f84a-451f-8e3d-0e81f93892fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:28.395829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957a29e-f84a-451f-8e3d-0e81f93892fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:28.396565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b957a29e-f84a-451f-8e3d-0e81f93892fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:28.398794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b957a29e-f84a-451f-8e3d-0e81f93892fb admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:28.411410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0cc18-34a0-4e95-8b0e-00deb3abc535 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:28.418650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f29a9b-24b6-4550-ab6f-b2ee85489d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:28.419606 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f29a9b-24b6-4550-ab6f-b2ee85489d05 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:28.420720 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f29a9b-24b6-4550-ab6f-b2ee85489d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:28.420720 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f29a9b-24b6-4550-ab6f-b2ee85489d05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:28.421182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f29a9b-24b6-4550-ab6f-b2ee85489d05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:28.423911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f29a9b-24b6-4550-ab6f-b2ee85489d05 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:28.435476 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3872/7744] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:33:28 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:28.440363 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3873/7745] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:33:28.445289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f29a9b-24b6-4550-ab6f-b2ee85489d05 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:28.450976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957a29e-f84a-451f-8e3d-0e81f93892fb admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:28.461027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f29a9b-24b6-4550-ab6f-b2ee85489d05 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:28.541231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957a29e-f84a-451f-8e3d-0e81f93892fb admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:28.546626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595a1ed-8946-4511-897d-b3f8a15f5182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:28.547385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595a1ed-8946-4511-897d-b3f8a15f5182 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:28.547670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595a1ed-8946-4511-897d-b3f8a15f5182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:28.547952 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595a1ed-8946-4511-897d-b3f8a15f5182 admin admin] PATH_INFO: `/v3/projects/68b1f4ed6b274d9fa49177483da3011e/users/038371d112e445b68012500922c42742/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:28.586588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eecb97-84b3-44ed-ae64-d7d6809ce294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:28.587381 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eecb97-84b3-44ed-ae64-d7d6809ce294 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:28.589856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eecb97-84b3-44ed-ae64-d7d6809ce294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:28.590780 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eecb97-84b3-44ed-ae64-d7d6809ce294 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:28.609617 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0595a1ed-8946-4511-897d-b3f8a15f5182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68b1f4ed6b274d9fa49177483da3011e, user_id=038371d112e445b68012500922c42742, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:28.609617 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0595a1ed-8946-4511-897d-b3f8a15f5182 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:28.620980 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eecb97-84b3-44ed-ae64-d7d6809ce294 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:28.620980 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eecb97-84b3-44ed-ae64-d7d6809ce294 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:28.633083 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3873/7746] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:33:28 2022] PUT /identity/v3/projects/68b1f4ed6b274d9fa49177483da3011e/users/038371d112e445b68012500922c42742/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:28.638636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595a1ed-8946-4511-897d-b3f8a15f5182 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:28.673466 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3874/7747] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:33:28 2022] POST /identity/v3/users => generated 292 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:28.674760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eecb97-84b3-44ed-ae64-d7d6809ce294 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:28.707779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eecb97-84b3-44ed-ae64-d7d6809ce294 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:28.820963 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98745230-a2ae-4eb7-8e10-37b339dd7175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:28.821612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98745230-a2ae-4eb7-8e10-37b339dd7175 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:28.821892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98745230-a2ae-4eb7-8e10-37b339dd7175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:28.822777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98745230-a2ae-4eb7-8e10-37b339dd7175 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:28.823487 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98745230-a2ae-4eb7-8e10-37b339dd7175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:28.825136 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98745230-a2ae-4eb7-8e10-37b339dd7175 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:28.841868 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3875/7748] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:33:28.842730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98745230-a2ae-4eb7-8e10-37b339dd7175 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:28.843003 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595a1ed-8946-4511-897d-b3f8a15f5182 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:28.854874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98745230-a2ae-4eb7-8e10-37b339dd7175 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:28.861120 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c961f6-6a84-4098-8b2d-8aee024db4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:28.861334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13086c1d-c19c-4600-adaf-acc67452a8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:28.862343 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c961f6-6a84-4098-8b2d-8aee024db4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:28.862502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13086c1d-c19c-4600-adaf-acc67452a8dd admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:28.862502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13086c1d-c19c-4600-adaf-acc67452a8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:28.862694 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c961f6-6a84-4098-8b2d-8aee024db4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:28.862793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13086c1d-c19c-4600-adaf-acc67452a8dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:28.862879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c961f6-6a84-4098-8b2d-8aee024db4f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:28.863155 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13086c1d-c19c-4600-adaf-acc67452a8dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:28.863348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c961f6-6a84-4098-8b2d-8aee024db4f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:28.865136 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c961f6-6a84-4098-8b2d-8aee024db4f4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:28.873806 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13086c1d-c19c-4600-adaf-acc67452a8dd admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:28.903414 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3876/7749] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:33:28.904907 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c961f6-6a84-4098-8b2d-8aee024db4f4 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:28.927906 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3874/7750] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:33:28.930217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13086c1d-c19c-4600-adaf-acc67452a8dd admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:28.941305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c961f6-6a84-4098-8b2d-8aee024db4f4 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:28.966704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13086c1d-c19c-4600-adaf-acc67452a8dd admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:28.969785 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779dad2-958e-4172-936c-beeb90b5c00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:28.971856 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab46de-6c0d-4e86-be9d-0d2d3198c7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:28.972427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779dad2-958e-4172-936c-beeb90b5c00f admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:28.972722 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab46de-6c0d-4e86-be9d-0d2d3198c7fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:28.972861 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779dad2-958e-4172-936c-beeb90b5c00f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:28.973155 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab46de-6c0d-4e86-be9d-0d2d3198c7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:28.973909 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab46de-6c0d-4e86-be9d-0d2d3198c7fd admin admin] PATH_INFO: `/v3/projects/68b1f4ed6b274d9fa49177483da3011e/users/038371d112e445b68012500922c42742/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:28.974168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779dad2-958e-4172-936c-beeb90b5c00f admin admin] PATH_INFO: `/v3/projects/5454d1c206a1465d804e697abcd92e83/users/8d55c1e3205f40949ad95dd81f78ab6f/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:28.976117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab46de-6c0d-4e86-be9d-0d2d3198c7fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=68b1f4ed6b274d9fa49177483da3011e, user_id=038371d112e445b68012500922c42742, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:28.979046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab46de-6c0d-4e86-be9d-0d2d3198c7fd admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:28.993097 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:29.001506 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3875/7751] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:33:28 2022] PUT /identity/v3/projects/68b1f4ed6b274d9fa49177483da3011e/users/038371d112e445b68012500922c42742/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:29.005637 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779dad2-958e-4172-936c-beeb90b5c00f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5454d1c206a1465d804e697abcd92e83, user_id=8d55c1e3205f40949ad95dd81f78ab6f, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:29.008836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779dad2-958e-4172-936c-beeb90b5c00f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:29.017094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d1308-839a-4f4c-8fac-315957d0fb2a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:29.017918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d1308-839a-4f4c-8fac-315957d0fb2a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:29.018611 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d1308-839a-4f4c-8fac-315957d0fb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:29.045940 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3877/7752] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:33:28 2022] PUT /identity/v3/projects/5454d1c206a1465d804e697abcd92e83/users/8d55c1e3205f40949ad95dd81f78ab6f/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:29.069491 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddcbfa-3e81-490a-b665-9ad0763f7394 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:29.070300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddcbfa-3e81-490a-b665-9ad0763f7394 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:29.070892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddcbfa-3e81-490a-b665-9ad0763f7394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:29.077640 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-3b1d1308-839a-4f4c-8fac-315957d0fb2a None None] MFA Rules not processed for user `038371d112e445b68012500922c42742`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:29.080866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3b1d1308-839a-4f4c-8fac-315957d0fb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:29.126636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a8ddcbfa-3e81-490a-b665-9ad0763f7394 None None] MFA Rules not processed for user `8d55c1e3205f40949ad95dd81f78ab6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:29.128399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a8ddcbfa-3e81-490a-b665-9ad0763f7394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:29.147716 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:29.273778 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3876/7753] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:29 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:33:29.275572 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d1308-839a-4f4c-8fac-315957d0fb2a None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:29.287011 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3878/7754] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:29.292952 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d1308-839a-4f4c-8fac-315957d0fb2a None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:29.293809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ddcbfa-3e81-490a-b665-9ad0763f7394 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:29.301255 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff3aa8-b038-4062-8865-be70d84a6fd7 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038371d112e445b68012500922c42742', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68b1f4ed6b274d9fa49177483da3011e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:29.301916 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff3aa8-b038-4062-8865-be70d84a6fd7 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:29.302200 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff3aa8-b038-4062-8865-be70d84a6fd7 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:29.302480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff3aa8-b038-4062-8865-be70d84a6fd7 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:29.303199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff3aa8-b038-4062-8865-be70d84a6fd7 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:29.304817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff3aa8-b038-4062-8865-be70d84a6fd7 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:29.340215 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3877/7755] 10.222.0.30 () {60 vars in 1152 bytes} [Sun Sep 4 01:33:29 2022] POST /identity/v3/services => generated 241 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:29.341463 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff3aa8-b038-4062-8865-be70d84a6fd7 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:29.387289 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff3aa8-b038-4062-8865-be70d84a6fd7 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:29.401538 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67950bf5-79a6-4837-882d-97de9ec829f8 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038371d112e445b68012500922c42742', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68b1f4ed6b274d9fa49177483da3011e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:29.403804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67950bf5-79a6-4837-882d-97de9ec829f8 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:29.405051 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67950bf5-79a6-4837-882d-97de9ec829f8 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:29.405680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67950bf5-79a6-4837-882d-97de9ec829f8 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] PATH_INFO: `/v3/services/507abba8b6da4b57b5d98c55ad74debb` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:29.406431 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67950bf5-79a6-4837-882d-97de9ec829f8 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: Authorizing `identity:delete_service(service_id=507abba8b6da4b57b5d98c55ad74debb)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:29.410262 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67950bf5-79a6-4837-882d-97de9ec829f8 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:29.418601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ddcbfa-3e81-490a-b665-9ad0763f7394 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:29.467909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d1cd6-1507-432f-a0a9-9a025d0859ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:29.469729 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3878/7756] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:33:29 2022] DELETE /identity/v3/services/507abba8b6da4b57b5d98c55ad74debb => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:29.474621 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d1cd6-1507-432f-a0a9-9a025d0859ee admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:29.474947 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d1cd6-1507-432f-a0a9-9a025d0859ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:29.475353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d1cd6-1507-432f-a0a9-9a025d0859ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:29.476036 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d1cd6-1507-432f-a0a9-9a025d0859ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:29.479790 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67950bf5-79a6-4837-882d-97de9ec829f8 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:29.483747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d1cd6-1507-432f-a0a9-9a025d0859ee admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:29.521160 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67950bf5-79a6-4837-882d-97de9ec829f8 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:29.527305 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeaad97-48d2-4bb9-b929-effd303a234b tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038371d112e445b68012500922c42742', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68b1f4ed6b274d9fa49177483da3011e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:29.528103 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeaad97-48d2-4bb9-b929-effd303a234b tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:29.528581 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeaad97-48d2-4bb9-b929-effd303a234b tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:29.531359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeaad97-48d2-4bb9-b929-effd303a234b tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:29.533462 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeaad97-48d2-4bb9-b929-effd303a234b tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:29.535145 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeaad97-48d2-4bb9-b929-effd303a234b tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:29.564216 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3879/7757] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:33:29 2022] POST /identity/v3/projects => generated 381 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:29.565262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d1cd6-1507-432f-a0a9-9a025d0859ee admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:29.583211 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3879/7758] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:33:29 2022] POST /identity/v3/services => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:29.588187 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeaad97-48d2-4bb9-b929-effd303a234b tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:29.641201 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeaad97-48d2-4bb9-b929-effd303a234b tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:29.781862 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:29.823086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d1cd6-1507-432f-a0a9-9a025d0859ee admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:29.823693 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20436fa8-b201-4be7-8ab8-273514609f35 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038371d112e445b68012500922c42742', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68b1f4ed6b274d9fa49177483da3011e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:29.825122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20436fa8-b201-4be7-8ab8-273514609f35 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:29.825636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20436fa8-b201-4be7-8ab8-273514609f35 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:29.825873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20436fa8-b201-4be7-8ab8-273514609f35 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] PATH_INFO: `/v3/services/fc1a89b68934438b8a2097c16ee5c597` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:29.826579 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20436fa8-b201-4be7-8ab8-273514609f35 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: Authorizing `identity:update_service(service_id=fc1a89b68934438b8a2097c16ee5c597)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:29.828438 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-20436fa8-b201-4be7-8ab8-273514609f35 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:33:29.828438 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:33:29.828438 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:33:29.829350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20436fa8-b201-4be7-8ab8-273514609f35 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:29.882996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271097c-3246-4909-a512-9cee886c10f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:29.884063 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3880/7759] 10.222.0.30 () {60 vars in 1252 bytes} [Sun Sep 4 01:33:29 2022] PATCH /identity/v3/services/fc1a89b68934438b8a2097c16ee5c597 => generated 281 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:33:29.884900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271097c-3246-4909-a512-9cee886c10f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:29.885400 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271097c-3246-4909-a512-9cee886c10f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:29.885944 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271097c-3246-4909-a512-9cee886c10f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:29.886800 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271097c-3246-4909-a512-9cee886c10f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:29.888976 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271097c-3246-4909-a512-9cee886c10f6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:29.892929 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20436fa8-b201-4be7-8ab8-273514609f35 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:29.928301 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3880/7760] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:33:29 2022] POST /identity/v3/users => generated 297 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:29.932124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271097c-3246-4909-a512-9cee886c10f6 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:29.940340 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20436fa8-b201-4be7-8ab8-273514609f35 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:29.977285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271097c-3246-4909-a512-9cee886c10f6 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:29.977480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea52194-9c55-4e62-8cb8-d44b59fb9ca7 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038371d112e445b68012500922c42742', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68b1f4ed6b274d9fa49177483da3011e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:29.978356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea52194-9c55-4e62-8cb8-d44b59fb9ca7 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:29.980521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea52194-9c55-4e62-8cb8-d44b59fb9ca7 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:29.982768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea52194-9c55-4e62-8cb8-d44b59fb9ca7 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] PATH_INFO: `/v3/services/fc1a89b68934438b8a2097c16ee5c597` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:29.985723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea52194-9c55-4e62-8cb8-d44b59fb9ca7 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: Authorizing `identity:get_service(service_id=fc1a89b68934438b8a2097c16ee5c597)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:29.987717 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-1ea52194-9c55-4e62-8cb8-d44b59fb9ca7 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:33:29.987717 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:33:29.987717 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:33:29.989315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea52194-9c55-4e62-8cb8-d44b59fb9ca7 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:30.005037 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3881/7761] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:33:29 2022] GET /identity/v3/services/fc1a89b68934438b8a2097c16ee5c597 => generated 281 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:33:30.006088 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea52194-9c55-4e62-8cb8-d44b59fb9ca7 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:30.009117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1ea52194-9c55-4e62-8cb8-d44b59fb9ca7 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:30.022143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fba761-ded3-48aa-8df6-ca300c937f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:30.027293 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:30.027773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fba761-ded3-48aa-8df6-ca300c937f06 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:30.028614 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fba761-ded3-48aa-8df6-ca300c937f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:30.029126 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fba761-ded3-48aa-8df6-ca300c937f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:30.031105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fba761-ded3-48aa-8df6-ca300c937f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:30.035385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fba761-ded3-48aa-8df6-ca300c937f06 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:30.067304 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3881/7762] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:33:30.069136 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fba761-ded3-48aa-8df6-ca300c937f06 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:30.100244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fba761-ded3-48aa-8df6-ca300c937f06 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:30.106188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4d15b-82a1-4de6-a357-66005cf16cf8 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038371d112e445b68012500922c42742', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68b1f4ed6b274d9fa49177483da3011e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:30.106832 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4d15b-82a1-4de6-a357-66005cf16cf8 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:30.107115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4d15b-82a1-4de6-a357-66005cf16cf8 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:30.107390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4d15b-82a1-4de6-a357-66005cf16cf8 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] PATH_INFO: `/v3/services/fc1a89b68934438b8a2097c16ee5c597` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:30.107984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4d15b-82a1-4de6-a357-66005cf16cf8 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: Authorizing `identity:delete_service(service_id=fc1a89b68934438b8a2097c16ee5c597)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:30.109748 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4d15b-82a1-4de6-a357-66005cf16cf8 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:30.154412 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3882/7763] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:33:30 2022] DELETE /identity/v3/services/fc1a89b68934438b8a2097c16ee5c597 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:30.154412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4d15b-82a1-4de6-a357-66005cf16cf8 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:30.159536 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea52194-9c55-4e62-8cb8-d44b59fb9ca7 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:30.183852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4d15b-82a1-4de6-a357-66005cf16cf8 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:30.186782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c5fb6-ac0d-4040-ba2b-0de8802c57a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:30.187401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c5fb6-ac0d-4040-ba2b-0de8802c57a2 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:30.187675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c5fb6-ac0d-4040-ba2b-0de8802c57a2 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:30.187943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c5fb6-ac0d-4040-ba2b-0de8802c57a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:30.190630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ce8c5fb6-ac0d-4040-ba2b-0de8802c57a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:30.193535 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1fef2-7ae9-4517-9ff2-f35b65454b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:30.194259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1fef2-7ae9-4517-9ff2-f35b65454b32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:30.194555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1fef2-7ae9-4517-9ff2-f35b65454b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:30.194815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1fef2-7ae9-4517-9ff2-f35b65454b32 admin admin] PATH_INFO: `/v3/projects/f25602c79b7d402dacc2c4fbfd77c5a0/users/a70d0975eabc4aca80200adf8cd66444/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:30.214174 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c5fb6-ac0d-4040-ba2b-0de8802c57a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:30.216721 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c5fb6-ac0d-4040-ba2b-0de8802c57a2 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:30.229685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1fef2-7ae9-4517-9ff2-f35b65454b32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f25602c79b7d402dacc2c4fbfd77c5a0, user_id=a70d0975eabc4aca80200adf8cd66444, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:30.232752 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3882/7764] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:33:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:33:30.233801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c5fb6-ac0d-4040-ba2b-0de8802c57a2 service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:30.237477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1fef2-7ae9-4517-9ff2-f35b65454b32 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:30.264708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c5fb6-ac0d-4040-ba2b-0de8802c57a2 service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:30.272210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356473ce-c257-4530-8024-37791eb6b6a1 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038371d112e445b68012500922c42742', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68b1f4ed6b274d9fa49177483da3011e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:30.273164 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356473ce-c257-4530-8024-37791eb6b6a1 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:30.273856 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356473ce-c257-4530-8024-37791eb6b6a1 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:30.274417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356473ce-c257-4530-8024-37791eb6b6a1 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] PATH_INFO: `/v3/services/fc1a89b68934438b8a2097c16ee5c597` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:30.274939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356473ce-c257-4530-8024-37791eb6b6a1 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: Authorizing `identity:get_service(service_id=fc1a89b68934438b8a2097c16ee5c597)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:30.277472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356473ce-c257-4530-8024-37791eb6b6a1 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:30.288790 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-356473ce-c257-4530-8024-37791eb6b6a1 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] Could not find service: fc1a89b68934438b8a2097c16ee5c597.: keystone.exception.ServiceNotFound: Could not find service: fc1a89b68934438b8a2097c16ee5c597. Sep 04 01:33:30.288790 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:33:30.288790 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 04 01:33:30.288790 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 04 01:33:30.288790 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 04 01:33:30.288790 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 04 01:33:30.288790 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 04 01:33:30.288790 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 01:33:30.288790 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: fc1a89b68934438b8a2097c16ee5c597. Sep 04 01:33:30.288790 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:33:30.288790 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 04 01:33:30.288790 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:33:30.288790 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:33:30.288790 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:33:30.288790 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:33:30.290328 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:33:30.290328 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:33:30.290328 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:33:30.290328 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:33:30.290328 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:33:30.290328 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:33:30.290328 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:33:30.290328 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:33:30.290328 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 04 01:33:30.290328 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 04 01:33:30.290328 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 04 01:33:30.290328 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 04 01:33:30.290328 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:33:30.290328 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:33:30.290328 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 04 01:33:30.290328 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 04 01:33:30.291698 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 04 01:33:30.291698 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.get_or_create( Sep 04 01:33:30.291698 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 04 01:33:30.291698 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application with Lock( Sep 04 01:33:30.291698 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 04 01:33:30.291698 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self._enter() Sep 04 01:33:30.291698 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 04 01:33:30.291698 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 04 01:33:30.291698 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 04 01:33:30.291698 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.creator() Sep 04 01:33:30.291698 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 04 01:33:30.291698 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application created_value = creator( Sep 04 01:33:30.291698 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 04 01:33:30.291698 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 04 01:33:30.291698 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: fc1a89b68934438b8a2097c16ee5c597. Sep 04 01:33:30.291698 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:33:30.293648 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3883/7765] 10.222.0.30 () {58 vars in 1230 bytes} [Sun Sep 4 01:33:30 2022] GET /identity/v3/services/fc1a89b68934438b8a2097c16ee5c597 => generated 113 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:33:30.301136 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356473ce-c257-4530-8024-37791eb6b6a1 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:30.306081 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3883/7766] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:33:30 2022] PUT /identity/v3/projects/f25602c79b7d402dacc2c4fbfd77c5a0/users/a70d0975eabc4aca80200adf8cd66444/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:30.310783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1fef2-7ae9-4517-9ff2-f35b65454b32 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:30.315577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356473ce-c257-4530-8024-37791eb6b6a1 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:30.395672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d26327-7bb5-4ed3-97bf-2ab3ec5a83cc tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038371d112e445b68012500922c42742', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68b1f4ed6b274d9fa49177483da3011e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:30.396563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d26327-7bb5-4ed3-97bf-2ab3ec5a83cc tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:30.397196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d26327-7bb5-4ed3-97bf-2ab3ec5a83cc tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:30.397605 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d26327-7bb5-4ed3-97bf-2ab3ec5a83cc tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:30.398463 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d26327-7bb5-4ed3-97bf-2ab3ec5a83cc tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:30.401311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d26327-7bb5-4ed3-97bf-2ab3ec5a83cc tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:30.428412 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3884/7767] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:33:30 2022] POST /identity/v3/services => generated 273 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:30.432793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d26327-7bb5-4ed3-97bf-2ab3ec5a83cc tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:30.438423 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1fef2-7ae9-4517-9ff2-f35b65454b32 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:30.476692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d26327-7bb5-4ed3-97bf-2ab3ec5a83cc tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:30.482700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f785d3e-79e5-493d-9c16-6cbacacfa633 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038371d112e445b68012500922c42742', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68b1f4ed6b274d9fa49177483da3011e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:30.483326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f785d3e-79e5-493d-9c16-6cbacacfa633 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:30.483612 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f785d3e-79e5-493d-9c16-6cbacacfa633 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:30.483890 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f785d3e-79e5-493d-9c16-6cbacacfa633 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:30.484543 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f785d3e-79e5-493d-9c16-6cbacacfa633 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:30.486954 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f785d3e-79e5-493d-9c16-6cbacacfa633 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:30.495338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420aa8df-fc5a-477c-99df-66f9e155d51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:30.495972 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420aa8df-fc5a-477c-99df-66f9e155d51d admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:30.496253 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420aa8df-fc5a-477c-99df-66f9e155d51d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:30.496552 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420aa8df-fc5a-477c-99df-66f9e155d51d admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:30.497172 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420aa8df-fc5a-477c-99df-66f9e155d51d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:30.500688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420aa8df-fc5a-477c-99df-66f9e155d51d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:30.527601 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3884/7768] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:33:30.528530 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420aa8df-fc5a-477c-99df-66f9e155d51d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:30.541865 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3885/7769] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:33:30 2022] POST /identity/v3/services => generated 275 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:30.544220 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f785d3e-79e5-493d-9c16-6cbacacfa633 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:30.550165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420aa8df-fc5a-477c-99df-66f9e155d51d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:30.585054 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a571071-7533-45c5-b70e-d56f17567a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:30.585815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a571071-7533-45c5-b70e-d56f17567a14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:30.586100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a571071-7533-45c5-b70e-d56f17567a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:30.586377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a571071-7533-45c5-b70e-d56f17567a14 admin admin] PATH_INFO: `/v3/projects/f25602c79b7d402dacc2c4fbfd77c5a0/users/a70d0975eabc4aca80200adf8cd66444/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:30.589111 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f785d3e-79e5-493d-9c16-6cbacacfa633 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:30.590180 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a571071-7533-45c5-b70e-d56f17567a14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f25602c79b7d402dacc2c4fbfd77c5a0, user_id=a70d0975eabc4aca80200adf8cd66444, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:30.594486 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a571071-7533-45c5-b70e-d56f17567a14 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:30.602692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760465f4-09f8-4304-b483-c0be6204a3ba tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038371d112e445b68012500922c42742', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68b1f4ed6b274d9fa49177483da3011e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:30.604101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760465f4-09f8-4304-b483-c0be6204a3ba tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:30.604386 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760465f4-09f8-4304-b483-c0be6204a3ba tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:30.604661 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760465f4-09f8-4304-b483-c0be6204a3ba tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:30.605318 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760465f4-09f8-4304-b483-c0be6204a3ba tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:30.607520 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760465f4-09f8-4304-b483-c0be6204a3ba tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:30.621563 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3885/7770] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:33:30 2022] PUT /identity/v3/projects/f25602c79b7d402dacc2c4fbfd77c5a0/users/a70d0975eabc4aca80200adf8cd66444/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:30.632451 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9ec34-8429-40dc-81df-6cb72f264ec3 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:30.632758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9ec34-8429-40dc-81df-6cb72f264ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:30.633360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9ec34-8429-40dc-81df-6cb72f264ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:30.651341 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3886/7771] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:33:30 2022] POST /identity/v3/services => generated 275 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:30.658575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760465f4-09f8-4304-b483-c0be6204a3ba tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:30.698285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-78a9ec34-8429-40dc-81df-6cb72f264ec3 None None] MFA Rules not processed for user `a70d0975eabc4aca80200adf8cd66444`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:30.699515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-78a9ec34-8429-40dc-81df-6cb72f264ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:30.702610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760465f4-09f8-4304-b483-c0be6204a3ba tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:30.710369 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:30.720481 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:30.802973 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b842b3-3533-4b2d-b44c-4770aef1a391 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038371d112e445b68012500922c42742', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68b1f4ed6b274d9fa49177483da3011e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:30.805887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b842b3-3533-4b2d-b44c-4770aef1a391 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:30.806149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b842b3-3533-4b2d-b44c-4770aef1a391 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:30.806989 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b842b3-3533-4b2d-b44c-4770aef1a391 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:30.807621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b842b3-3533-4b2d-b44c-4770aef1a391 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:30.808648 n-d-master-1 devstack@keystone.service[81825]: WARNING py.warnings [None req-57b842b3-3533-4b2d-b44c-4770aef1a391 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:33:30.808648 n-d-master-1 devstack@keystone.service[81825]: warnings.warn(msg) Sep 04 01:33:30.808648 n-d-master-1 devstack@keystone.service[81825]: Sep 04 01:33:30.810825 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b842b3-3533-4b2d-b44c-4770aef1a391 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:30.832131 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3887/7772] 10.222.0.30 () {58 vars in 1131 bytes} [Sun Sep 4 01:33:30 2022] GET /identity/v3/services => generated 2978 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:33:30.837390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b842b3-3533-4b2d-b44c-4770aef1a391 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:30.851367 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3886/7773] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:30 2022] POST /identity/v3/auth/tokens => generated 3827 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:30.861733 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b842b3-3533-4b2d-b44c-4770aef1a391 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:30.868300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909fb7e-1c7d-4940-9480-4ae3de7b6890 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038371d112e445b68012500922c42742', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68b1f4ed6b274d9fa49177483da3011e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:30.869666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909fb7e-1c7d-4940-9480-4ae3de7b6890 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:30.870035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909fb7e-1c7d-4940-9480-4ae3de7b6890 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:30.870373 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909fb7e-1c7d-4940-9480-4ae3de7b6890 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:30.871221 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909fb7e-1c7d-4940-9480-4ae3de7b6890 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-134506874) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:33:30.871590 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909fb7e-1c7d-4940-9480-4ae3de7b6890 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:30.873294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909fb7e-1c7d-4940-9480-4ae3de7b6890 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:30.874533 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9ec34-8429-40dc-81df-6cb72f264ec3 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:30.879853 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3888/7774] 10.222.0.30 () {58 vars in 1220 bytes} [Sun Sep 4 01:33:30 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-134506874 => generated 415 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:33:30.882629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-78a9ec34-8429-40dc-81df-6cb72f264ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:30.900079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909fb7e-1c7d-4940-9480-4ae3de7b6890 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:30.921453 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909fb7e-1c7d-4940-9480-4ae3de7b6890 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:30.929355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae0c1f-3cc7-4c25-9157-7be523837ad8 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038371d112e445b68012500922c42742', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68b1f4ed6b274d9fa49177483da3011e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:30.930440 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae0c1f-3cc7-4c25-9157-7be523837ad8 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:30.931009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae0c1f-3cc7-4c25-9157-7be523837ad8 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:30.931931 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae0c1f-3cc7-4c25-9157-7be523837ad8 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:30.932647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae0c1f-3cc7-4c25-9157-7be523837ad8 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1028518759) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:33:30.933024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae0c1f-3cc7-4c25-9157-7be523837ad8 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:30.935191 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae0c1f-3cc7-4c25-9157-7be523837ad8 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:30.942475 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3889/7775] 10.222.0.30 () {58 vars in 1222 bytes} [Sun Sep 4 01:33:30 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1028518759 => generated 418 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:33:30.947298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae0c1f-3cc7-4c25-9157-7be523837ad8 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:30.992101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae0c1f-3cc7-4c25-9157-7be523837ad8 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:31.030906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62305334-b028-468d-8ffe-48dafdf4dcaf tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038371d112e445b68012500922c42742', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68b1f4ed6b274d9fa49177483da3011e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:31.031092 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62305334-b028-468d-8ffe-48dafdf4dcaf tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:31.031327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62305334-b028-468d-8ffe-48dafdf4dcaf tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:31.031578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62305334-b028-468d-8ffe-48dafdf4dcaf tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] PATH_INFO: `/v3/services` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:31.032218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62305334-b028-468d-8ffe-48dafdf4dcaf tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1719226558) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:33:31.032525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62305334-b028-468d-8ffe-48dafdf4dcaf tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:31.034493 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62305334-b028-468d-8ffe-48dafdf4dcaf tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:31.046544 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3890/7776] 10.222.0.30 () {58 vars in 1222 bytes} [Sun Sep 4 01:33:30 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1719226558 => generated 418 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:33:31.047623 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62305334-b028-468d-8ffe-48dafdf4dcaf tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:31.062061 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62305334-b028-468d-8ffe-48dafdf4dcaf tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:31.068400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802c643-8da6-4765-ad31-9f9198e1b3d7 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038371d112e445b68012500922c42742', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68b1f4ed6b274d9fa49177483da3011e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:31.070704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802c643-8da6-4765-ad31-9f9198e1b3d7 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:31.070704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802c643-8da6-4765-ad31-9f9198e1b3d7 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:31.070704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802c643-8da6-4765-ad31-9f9198e1b3d7 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] PATH_INFO: `/v3/services/178f307e2b1a4f6292276f68cd558eae` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:31.071025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802c643-8da6-4765-ad31-9f9198e1b3d7 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: Authorizing `identity:delete_service(service_id=178f307e2b1a4f6292276f68cd558eae)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:31.072515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802c643-8da6-4765-ad31-9f9198e1b3d7 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:31.104307 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9ec34-8429-40dc-81df-6cb72f264ec3 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:31.117777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c276a-6068-447e-8325-cfe058bf055b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:31.118903 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c276a-6068-447e-8325-cfe058bf055b service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:31.119195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c276a-6068-447e-8325-cfe058bf055b service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:31.119472 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c276a-6068-447e-8325-cfe058bf055b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:31.123807 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3891/7777] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:33:31 2022] DELETE /identity/v3/services/178f307e2b1a4f6292276f68cd558eae => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:31.133182 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802c643-8da6-4765-ad31-9f9198e1b3d7 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:31.187730 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802c643-8da6-4765-ad31-9f9198e1b3d7 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:31.193541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bebe1e-0988-4a68-9b39-22d20f832e65 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038371d112e445b68012500922c42742', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68b1f4ed6b274d9fa49177483da3011e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:31.195144 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bebe1e-0988-4a68-9b39-22d20f832e65 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:31.195461 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bebe1e-0988-4a68-9b39-22d20f832e65 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:31.195799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bebe1e-0988-4a68-9b39-22d20f832e65 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] PATH_INFO: `/v3/services/a5acde573519475192b252e0c1e6b79a` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:31.196366 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bebe1e-0988-4a68-9b39-22d20f832e65 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: Authorizing `identity:delete_service(service_id=a5acde573519475192b252e0c1e6b79a)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:31.199350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bebe1e-0988-4a68-9b39-22d20f832e65 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:31.237647 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3892/7778] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:33:31 2022] DELETE /identity/v3/services/a5acde573519475192b252e0c1e6b79a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:31.243596 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bebe1e-0988-4a68-9b39-22d20f832e65 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:31.281661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c276a-6068-447e-8325-cfe058bf055b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:31.285501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c276a-6068-447e-8325-cfe058bf055b service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:31.308200 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bebe1e-0988-4a68-9b39-22d20f832e65 tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:31.336628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a72b3-bf0c-42ad-b9f7-34431ab2526c tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038371d112e445b68012500922c42742', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68b1f4ed6b274d9fa49177483da3011e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:31.338161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a72b3-bf0c-42ad-b9f7-34431ab2526c tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:31.338442 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a72b3-bf0c-42ad-b9f7-34431ab2526c tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:31.338713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a72b3-bf0c-42ad-b9f7-34431ab2526c tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] PATH_INFO: `/v3/services/65175a426f9b423ca52c9afc2dde80eb` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:31.339308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a72b3-bf0c-42ad-b9f7-34431ab2526c tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: Authorizing `identity:delete_service(service_id=65175a426f9b423ca52c9afc2dde80eb)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:31.344331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a72b3-bf0c-42ad-b9f7-34431ab2526c tempest-ServicesTestJSON-1014740928 tempest-ServicesTestJSON-1014740928-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:31.357968 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3887/7779] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:33:30 2022] GET /identity/v3/auth/tokens => generated 3424 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:33:31.399830 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3893/7780] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:33:31 2022] DELETE /identity/v3/services/65175a426f9b423ca52c9afc2dde80eb => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:31.408834 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c276a-6068-447e-8325-cfe058bf055b service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:31.532962 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:31.591480 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c276a-6068-447e-8325-cfe058bf055b service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:31.618615 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7b376-f3d1-4625-8dc1-63e4d3ab0945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:31.619243 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7b376-f3d1-4625-8dc1-63e4d3ab0945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:31.619518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7b376-f3d1-4625-8dc1-63e4d3ab0945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:31.620295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7b376-f3d1-4625-8dc1-63e4d3ab0945 admin admin] PATH_INFO: `/v3/users/d7c33f1afa08484a8925f61d5eb8a3ef` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:31.623130 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7b376-f3d1-4625-8dc1-63e4d3ab0945 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7c33f1afa08484a8925f61d5eb8a3ef)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:31.625128 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7b376-f3d1-4625-8dc1-63e4d3ab0945 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:31.714210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ffa7b376-f3d1-4625-8dc1-63e4d3ab0945 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7c33f1afa08484a8925f61d5eb8a3ef'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:31.715388 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ffa7b376-f3d1-4625-8dc1-63e4d3ab0945 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7c33f1afa08484a8925f61d5eb8a3ef'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:31.726069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ffa7b376-f3d1-4625-8dc1-63e4d3ab0945 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7c33f1afa08484a8925f61d5eb8a3ef'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:31.739478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ffa7b376-f3d1-4625-8dc1-63e4d3ab0945 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7c33f1afa08484a8925f61d5eb8a3ef'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:31.745980 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ffa7b376-f3d1-4625-8dc1-63e4d3ab0945 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7c33f1afa08484a8925f61d5eb8a3ef'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:31.780476 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3888/7781] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:33:31 2022] DELETE /identity/v3/users/d7c33f1afa08484a8925f61d5eb8a3ef => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:31.781719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca28b8f-79c4-4946-96e9-0f67eb5273fd None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:31.782013 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca28b8f-79c4-4946-96e9-0f67eb5273fd None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:31.782319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca28b8f-79c4-4946-96e9-0f67eb5273fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:31.809947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-eca28b8f-79c4-4946-96e9-0f67eb5273fd None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:31.811569 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-eca28b8f-79c4-4946-96e9-0f67eb5273fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:31.863234 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:31.883890 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3894/7782] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:31.896054 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7b376-f3d1-4625-8dc1-63e4d3ab0945 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:31.898571 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ffa7b376-f3d1-4625-8dc1-63e4d3ab0945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:31.997686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7b376-f3d1-4625-8dc1-63e4d3ab0945 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:32.002489 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647af1a8-caa9-4b17-93d0-b5047b50baa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:32.003340 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647af1a8-caa9-4b17-93d0-b5047b50baa2 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:32.003739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647af1a8-caa9-4b17-93d0-b5047b50baa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:32.004110 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647af1a8-caa9-4b17-93d0-b5047b50baa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:32.016162 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647af1a8-caa9-4b17-93d0-b5047b50baa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:32.017837 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647af1a8-caa9-4b17-93d0-b5047b50baa2 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:32.031741 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3889/7783] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:33:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:33:33.343047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca28b8f-79c4-4946-96e9-0f67eb5273fd None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:33.344760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-eca28b8f-79c4-4946-96e9-0f67eb5273fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:33.362819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca28b8f-79c4-4946-96e9-0f67eb5273fd None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:33.368386 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c806f-c0ad-43d0-97af-5d3bdbacca08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:33.369632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c806f-c0ad-43d0-97af-5d3bdbacca08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:33.369910 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c806f-c0ad-43d0-97af-5d3bdbacca08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:33.370183 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c806f-c0ad-43d0-97af-5d3bdbacca08 admin admin] PATH_INFO: `/v3/projects/6c151a8f2c6a43e88c830b4b37f8ac85` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:33.371449 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43c806f-c0ad-43d0-97af-5d3bdbacca08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c151a8f2c6a43e88c830b4b37f8ac85)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:33.374580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43c806f-c0ad-43d0-97af-5d3bdbacca08 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:33.469901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f43c806f-c0ad-43d0-97af-5d3bdbacca08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c151a8f2c6a43e88c830b4b37f8ac85', 'request_id': 'req-f43c806f-c0ad-43d0-97af-5d3bdbacca08'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:33.496529 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f43c806f-c0ad-43d0-97af-5d3bdbacca08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c151a8f2c6a43e88c830b4b37f8ac85', 'request_id': 'req-f43c806f-c0ad-43d0-97af-5d3bdbacca08'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:33.507996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f43c806f-c0ad-43d0-97af-5d3bdbacca08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c151a8f2c6a43e88c830b4b37f8ac85', 'request_id': 'req-f43c806f-c0ad-43d0-97af-5d3bdbacca08'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:33.527513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f43c806f-c0ad-43d0-97af-5d3bdbacca08 admin admin] The token cache is being invalidate because project 6c151a8f2c6a43e88c830b4b37f8ac85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:33:33.528034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f43c806f-c0ad-43d0-97af-5d3bdbacca08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:33.528798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f43c806f-c0ad-43d0-97af-5d3bdbacca08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:33.533465 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3895/7784] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:33:33 2022] DELETE /identity/v3/projects/6c151a8f2c6a43e88c830b4b37f8ac85 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:33.534986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647af1a8-caa9-4b17-93d0-b5047b50baa2 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:33.547768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647af1a8-caa9-4b17-93d0-b5047b50baa2 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:33.620803 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:33.703576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be174962-723c-4352-9b66-68cfcb36bdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:33.704570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be174962-723c-4352-9b66-68cfcb36bdda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:33.706217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be174962-723c-4352-9b66-68cfcb36bdda admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:33.707653 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be174962-723c-4352-9b66-68cfcb36bdda admin admin] PATH_INFO: `/v3/users/038371d112e445b68012500922c42742` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:33.710385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be174962-723c-4352-9b66-68cfcb36bdda admin admin] RBAC: Authorizing `identity:delete_user(user_id=038371d112e445b68012500922c42742)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:33.719643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be174962-723c-4352-9b66-68cfcb36bdda admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:33.836270 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-be174962-723c-4352-9b66-68cfcb36bdda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '038371d112e445b68012500922c42742'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:33.837825 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-be174962-723c-4352-9b66-68cfcb36bdda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '038371d112e445b68012500922c42742'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:33.851512 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-be174962-723c-4352-9b66-68cfcb36bdda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '038371d112e445b68012500922c42742'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:33.867261 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-be174962-723c-4352-9b66-68cfcb36bdda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '038371d112e445b68012500922c42742'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:33.868180 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-be174962-723c-4352-9b66-68cfcb36bdda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '038371d112e445b68012500922c42742'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:33.910639 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3890/7785] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:33:33 2022] DELETE /identity/v3/users/038371d112e445b68012500922c42742 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:35.158871 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c806f-c0ad-43d0-97af-5d3bdbacca08 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:35.161648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f43c806f-c0ad-43d0-97af-5d3bdbacca08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:35.177376 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c806f-c0ad-43d0-97af-5d3bdbacca08 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:35.302324 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7567e7-6696-4d36-9fc6-d8cd4c494d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:35.303863 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7567e7-6696-4d36-9fc6-d8cd4c494d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:35.304180 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7567e7-6696-4d36-9fc6-d8cd4c494d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:35.304424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7567e7-6696-4d36-9fc6-d8cd4c494d38 admin admin] PATH_INFO: `/v3/projects/68b1f4ed6b274d9fa49177483da3011e` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:35.308009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7567e7-6696-4d36-9fc6-d8cd4c494d38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68b1f4ed6b274d9fa49177483da3011e)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:35.313328 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7567e7-6696-4d36-9fc6-d8cd4c494d38 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:35.418424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6c7567e7-6696-4d36-9fc6-d8cd4c494d38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68b1f4ed6b274d9fa49177483da3011e', 'request_id': 'req-6c7567e7-6696-4d36-9fc6-d8cd4c494d38'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:35.433375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6c7567e7-6696-4d36-9fc6-d8cd4c494d38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68b1f4ed6b274d9fa49177483da3011e', 'request_id': 'req-6c7567e7-6696-4d36-9fc6-d8cd4c494d38'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:35.441582 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6c7567e7-6696-4d36-9fc6-d8cd4c494d38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68b1f4ed6b274d9fa49177483da3011e', 'request_id': 'req-6c7567e7-6696-4d36-9fc6-d8cd4c494d38'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:35.461095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6c7567e7-6696-4d36-9fc6-d8cd4c494d38 admin admin] The token cache is being invalidate because project 68b1f4ed6b274d9fa49177483da3011e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:33:35.461810 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6c7567e7-6696-4d36-9fc6-d8cd4c494d38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:35.463622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6c7567e7-6696-4d36-9fc6-d8cd4c494d38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:35.466452 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3896/7786] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:33:35 2022] DELETE /identity/v3/projects/68b1f4ed6b274d9fa49177483da3011e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:35.471342 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c9aab-9d1b-480b-97b1-4d535f247744 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:35.471873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c9aab-9d1b-480b-97b1-4d535f247744 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:35.471873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c9aab-9d1b-480b-97b1-4d535f247744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:35.515364 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-825c9aab-9d1b-480b-97b1-4d535f247744 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:35.517703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-825c9aab-9d1b-480b-97b1-4d535f247744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:35.628535 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3891/7787] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:35.629994 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf2266-8273-4614-9efd-a24a20c33c13 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:35.630296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf2266-8273-4614-9efd-a24a20c33c13 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:35.631150 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf2266-8273-4614-9efd-a24a20c33c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:35.642386 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:35.657985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-adcf2266-8273-4614-9efd-a24a20c33c13 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:35.659675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-adcf2266-8273-4614-9efd-a24a20c33c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:35.689012 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c9aab-9d1b-480b-97b1-4d535f247744 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:35.698178 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3897/7788] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:35.702002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c9aab-9d1b-480b-97b1-4d535f247744 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:35.713561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636beefa-6df3-4433-a37b-e4e6ca95d997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:35.714371 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636beefa-6df3-4433-a37b-e4e6ca95d997 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:35.714665 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636beefa-6df3-4433-a37b-e4e6ca95d997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:35.714942 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636beefa-6df3-4433-a37b-e4e6ca95d997 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:35.715663 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636beefa-6df3-4433-a37b-e4e6ca95d997 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:33:35.715965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636beefa-6df3-4433-a37b-e4e6ca95d997 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:35.718987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636beefa-6df3-4433-a37b-e4e6ca95d997 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:35.736438 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3892/7789] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:33:35.741053 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf2266-8273-4614-9efd-a24a20c33c13 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:35.750818 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf2266-8273-4614-9efd-a24a20c33c13 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:35.755837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5282f31-6a1f-4f39-86fd-612cdb94b3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:35.756451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5282f31-6a1f-4f39-86fd-612cdb94b3dd admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:35.756733 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5282f31-6a1f-4f39-86fd-612cdb94b3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:35.757004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5282f31-6a1f-4f39-86fd-612cdb94b3dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:35.757662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5282f31-6a1f-4f39-86fd-612cdb94b3dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:35.759620 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5282f31-6a1f-4f39-86fd-612cdb94b3dd admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:35.823721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636beefa-6df3-4433-a37b-e4e6ca95d997 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:35.826012 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3898/7790] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:33:35 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:35.840683 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636beefa-6df3-4433-a37b-e4e6ca95d997 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:35.943475 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:35.997644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209165f-3991-482d-8004-1e21e2517b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:36.000217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209165f-3991-482d-8004-1e21e2517b46 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:36.000777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209165f-3991-482d-8004-1e21e2517b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:36.001370 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209165f-3991-482d-8004-1e21e2517b46 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:36.002315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3209165f-3991-482d-8004-1e21e2517b46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:36.005150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3209165f-3991-482d-8004-1e21e2517b46 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:36.066427 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5282f31-6a1f-4f39-86fd-612cdb94b3dd admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:36.075830 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3893/7791] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:33:35 2022] POST /identity/v3/users => generated 287 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:36.081946 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5282f31-6a1f-4f39-86fd-612cdb94b3dd admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:36.095627 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc313b-854f-496d-a003-211e1bf6a3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:36.095627 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc313b-854f-496d-a003-211e1bf6a3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:36.095627 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc313b-854f-496d-a003-211e1bf6a3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:36.095627 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc313b-854f-496d-a003-211e1bf6a3c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:36.096166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc313b-854f-496d-a003-211e1bf6a3c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:36.097756 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc313b-854f-496d-a003-211e1bf6a3c0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:36.118274 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3899/7792] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:33:36.118902 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209165f-3991-482d-8004-1e21e2517b46 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:36.132995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209165f-3991-482d-8004-1e21e2517b46 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:36.174915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e900bd4-5a6a-4799-9d08-7af1d0954c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:36.180484 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e900bd4-5a6a-4799-9d08-7af1d0954c04 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:36.180484 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e900bd4-5a6a-4799-9d08-7af1d0954c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:36.180484 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e900bd4-5a6a-4799-9d08-7af1d0954c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:36.180829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e900bd4-5a6a-4799-9d08-7af1d0954c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:36.182987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e900bd4-5a6a-4799-9d08-7af1d0954c04 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:36.207337 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc313b-854f-496d-a003-211e1bf6a3c0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:36.207850 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3894/7793] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:33:36.221422 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc313b-854f-496d-a003-211e1bf6a3c0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:36.236349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e540f4-b770-49d1-b12a-fea095486226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:36.237035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e540f4-b770-49d1-b12a-fea095486226 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:36.237308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e540f4-b770-49d1-b12a-fea095486226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:36.237773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e540f4-b770-49d1-b12a-fea095486226 admin admin] PATH_INFO: `/v3/projects/a6be4faa951f4b0bbd6027ce916e48b1/users/cb7b150285f24321a9d7971f45fa8369/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:36.273025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e540f4-b770-49d1-b12a-fea095486226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6be4faa951f4b0bbd6027ce916e48b1, user_id=cb7b150285f24321a9d7971f45fa8369, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:36.275847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e540f4-b770-49d1-b12a-fea095486226 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:36.313594 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3900/7794] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:33:36 2022] PUT /identity/v3/projects/a6be4faa951f4b0bbd6027ce916e48b1/users/cb7b150285f24321a9d7971f45fa8369/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:36.324694 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d2a0f-578e-4fa1-babc-068f10350f84 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:36.325038 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d2a0f-578e-4fa1-babc-068f10350f84 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:36.325252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d2a0f-578e-4fa1-babc-068f10350f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:36.423237 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-6d3d2a0f-578e-4fa1-babc-068f10350f84 None None] MFA Rules not processed for user `cb7b150285f24321a9d7971f45fa8369`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:36.424907 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6d3d2a0f-578e-4fa1-babc-068f10350f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:36.616036 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3895/7795] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:36.621923 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e540f4-b770-49d1-b12a-fea095486226 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:36.634573 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e540f4-b770-49d1-b12a-fea095486226 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:36.645503 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac5c2d-b922-45aa-8e09-2aec8c217837 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb7b150285f24321a9d7971f45fa8369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6be4faa951f4b0bbd6027ce916e48b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:36.647431 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac5c2d-b922-45aa-8e09-2aec8c217837 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:36.648136 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac5c2d-b922-45aa-8e09-2aec8c217837 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:36.648656 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac5c2d-b922-45aa-8e09-2aec8c217837 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] PATH_INFO: `/v3/users/cb7b150285f24321a9d7971f45fa8369/password` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:36.761873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-b0ac5c2d-b922-45aa-8e09-2aec8c217837 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cb7b150285f24321a9d7971f45fa8369'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:36.774745 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3901/7796] 10.222.0.30 () {60 vars in 1269 bytes} [Sun Sep 4 01:33:36 2022] POST /identity/v3/users/cb7b150285f24321a9d7971f45fa8369/password => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:37.777910 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8e70f-8901-470d-8710-91e5617cc470 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:37.778430 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8e70f-8901-470d-8710-91e5617cc470 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:37.778551 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8e70f-8901-470d-8710-91e5617cc470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:37.826698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-5df8e70f-8901-470d-8710-91e5617cc470 None None] MFA Rules not processed for user `cb7b150285f24321a9d7971f45fa8369`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:37.830360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5df8e70f-8901-470d-8710-91e5617cc470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:37.840107 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3896/7797] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:37 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 01:33:37.842202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2954c-d542-4969-9a5e-ff4369356d89 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:37.842732 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2954c-d542-4969-9a5e-ff4369356d89 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:37.843028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2954c-d542-4969-9a5e-ff4369356d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:37.891270 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-56c2954c-d542-4969-9a5e-ff4369356d89 None None] MFA Rules not processed for user `cb7b150285f24321a9d7971f45fa8369`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:37.892513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-56c2954c-d542-4969-9a5e-ff4369356d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:37.905401 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3902/7798] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:37.907077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8e70f-8901-470d-8710-91e5617cc470 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:37.928145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8e70f-8901-470d-8710-91e5617cc470 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:37.940431 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13267be-9dd6-415e-8beb-4d02ecd018ba tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb7b150285f24321a9d7971f45fa8369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6be4faa951f4b0bbd6027ce916e48b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:37.941578 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13267be-9dd6-415e-8beb-4d02ecd018ba tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:37.942029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13267be-9dd6-415e-8beb-4d02ecd018ba tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:37.943123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13267be-9dd6-415e-8beb-4d02ecd018ba tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] PATH_INFO: `/v3/users/cb7b150285f24321a9d7971f45fa8369/password` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:38.114637 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-f13267be-9dd6-415e-8beb-4d02ecd018ba tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Sep 04 01:33:38.114637 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:33:38.114637 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:33:38.114637 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:33:38.114637 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:33:38.114637 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:33:38.114637 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:33:38.114637 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:33:38.114637 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:33:38.114637 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:33:38.114637 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:33:38.114637 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:33:38.114637 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Sep 04 01:33:38.115776 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(*args, **kwargs) Sep 04 01:33:38.115776 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Sep 04 01:33:38.115776 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Sep 04 01:33:38.115776 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:33:38.115776 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:33:38.115776 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 01:33:38.115776 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 01:33:38.115776 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Sep 04 01:33:38.115776 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Sep 04 01:33:38.115776 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Sep 04 01:33:38.115776 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Sep 04 01:33:38.115776 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Sep 04 01:33:38.115776 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Sep 04 01:33:38.115776 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Sep 04 01:33:38.115776 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:33:38.116877 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3897/7799] 10.222.0.30 () {60 vars in 1269 bytes} [Sun Sep 4 01:33:37 2022] POST /identity/v3/users/cb7b150285f24321a9d7971f45fa8369/password => generated 188 bytes in 209 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 04 01:33:38.120183 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2954c-d542-4969-9a5e-ff4369356d89 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:38.133918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2954c-d542-4969-9a5e-ff4369356d89 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:38.147445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37fad62-7071-4b2c-8c7a-9ff15e2514b3 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb7b150285f24321a9d7971f45fa8369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6be4faa951f4b0bbd6027ce916e48b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:38.148215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37fad62-7071-4b2c-8c7a-9ff15e2514b3 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:38.148508 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37fad62-7071-4b2c-8c7a-9ff15e2514b3 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:38.148787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37fad62-7071-4b2c-8c7a-9ff15e2514b3 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] PATH_INFO: `/v3/users/cb7b150285f24321a9d7971f45fa8369/password` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:38.264251 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-d37fad62-7071-4b2c-8c7a-9ff15e2514b3 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Sep 04 01:33:38.264251 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:33:38.264251 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:33:38.264251 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:33:38.264251 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:33:38.264251 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:33:38.264251 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:33:38.264251 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:33:38.264251 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:33:38.264251 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:33:38.264251 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:33:38.264251 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:33:38.264251 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Sep 04 01:33:38.265312 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(*args, **kwargs) Sep 04 01:33:38.265312 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Sep 04 01:33:38.265312 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Sep 04 01:33:38.265312 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:33:38.265312 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:33:38.265312 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 04 01:33:38.265312 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 04 01:33:38.265312 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Sep 04 01:33:38.265312 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Sep 04 01:33:38.265312 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Sep 04 01:33:38.265312 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Sep 04 01:33:38.265312 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Sep 04 01:33:38.265312 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Sep 04 01:33:38.265312 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Sep 04 01:33:38.265312 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:33:38.270074 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3903/7800] 10.222.0.30 () {60 vars in 1269 bytes} [Sun Sep 4 01:33:38 2022] POST /identity/v3/users/cb7b150285f24321a9d7971f45fa8369/password => generated 188 bytes in 147 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 04 01:33:38.270178 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13267be-9dd6-415e-8beb-4d02ecd018ba tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:38.283189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13267be-9dd6-415e-8beb-4d02ecd018ba tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:38.296990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a39c6-0e34-426d-bde6-1dcb68123fe4 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb7b150285f24321a9d7971f45fa8369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6be4faa951f4b0bbd6027ce916e48b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:38.297991 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a39c6-0e34-426d-bde6-1dcb68123fe4 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:38.298282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a39c6-0e34-426d-bde6-1dcb68123fe4 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:38.298561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a39c6-0e34-426d-bde6-1dcb68123fe4 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] PATH_INFO: `/v3/users/cb7b150285f24321a9d7971f45fa8369/password` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:38.402777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c35a39c6-0e34-426d-bde6-1dcb68123fe4 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cb7b150285f24321a9d7971f45fa8369'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:38.427373 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3898/7801] 10.222.0.30 () {60 vars in 1269 bytes} [Sun Sep 4 01:33:38 2022] POST /identity/v3/users/cb7b150285f24321a9d7971f45fa8369/password => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:39.432769 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c0ddd-1f8a-44bc-8483-45e09f6c7d52 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:39.435004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c0ddd-1f8a-44bc-8483-45e09f6c7d52 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:39.435299 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c0ddd-1f8a-44bc-8483-45e09f6c7d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:39.471488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e63c0ddd-1f8a-44bc-8483-45e09f6c7d52 None None] MFA Rules not processed for user `cb7b150285f24321a9d7971f45fa8369`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:39.472922 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e63c0ddd-1f8a-44bc-8483-45e09f6c7d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:39.483466 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3904/7802] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:39 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 01:33:39.489917 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea5df7-2f45-4ae5-97fa-20b5b830e1e9 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:39.490453 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea5df7-2f45-4ae5-97fa-20b5b830e1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:39.490453 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea5df7-2f45-4ae5-97fa-20b5b830e1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:39.539119 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-27ea5df7-2f45-4ae5-97fa-20b5b830e1e9 None None] MFA Rules not processed for user `cb7b150285f24321a9d7971f45fa8369`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:39.541594 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-27ea5df7-2f45-4ae5-97fa-20b5b830e1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:39.555463 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3899/7803] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:39.560601 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c0ddd-1f8a-44bc-8483-45e09f6c7d52 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:39.589680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c0ddd-1f8a-44bc-8483-45e09f6c7d52 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:39.604094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4c837-f907-40ad-8d79-1e963fc9c329 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb7b150285f24321a9d7971f45fa8369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6be4faa951f4b0bbd6027ce916e48b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:39.605047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4c837-f907-40ad-8d79-1e963fc9c329 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:39.605519 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4c837-f907-40ad-8d79-1e963fc9c329 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:39.606042 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4c837-f907-40ad-8d79-1e963fc9c329 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] PATH_INFO: `/v3/users/cb7b150285f24321a9d7971f45fa8369/password` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:39.695897 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c7c4c837-f907-40ad-8d79-1e963fc9c329 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cb7b150285f24321a9d7971f45fa8369'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:39.728882 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3905/7804] 10.222.0.30 () {60 vars in 1269 bytes} [Sun Sep 4 01:33:39 2022] POST /identity/v3/users/cb7b150285f24321a9d7971f45fa8369/password => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:40.733881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b9df2-6bdc-4539-b305-d5ff88208119 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:40.734902 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b9df2-6bdc-4539-b305-d5ff88208119 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:40.735645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b9df2-6bdc-4539-b305-d5ff88208119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:40.779287 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e91b9df2-6bdc-4539-b305-d5ff88208119 None None] MFA Rules not processed for user `cb7b150285f24321a9d7971f45fa8369`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:40.782441 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e91b9df2-6bdc-4539-b305-d5ff88208119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:40.791861 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3900/7805] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:40 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 01:33:40.796654 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec5dcf-de46-43cd-8ea3-6cb391620f27 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:40.797550 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec5dcf-de46-43cd-8ea3-6cb391620f27 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:40.798006 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec5dcf-de46-43cd-8ea3-6cb391620f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:40.825641 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-21ec5dcf-de46-43cd-8ea3-6cb391620f27 None None] MFA Rules not processed for user `cb7b150285f24321a9d7971f45fa8369`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:40.826923 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-21ec5dcf-de46-43cd-8ea3-6cb391620f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:40.835530 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3906/7806] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:33:40.840666 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b9df2-6bdc-4539-b305-d5ff88208119 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:40.859777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b9df2-6bdc-4539-b305-d5ff88208119 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:40.865369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688290f-551b-4faa-ad5f-cb45e885a0af tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb7b150285f24321a9d7971f45fa8369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6be4faa951f4b0bbd6027ce916e48b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:40.866323 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688290f-551b-4faa-ad5f-cb45e885a0af tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:40.866773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688290f-551b-4faa-ad5f-cb45e885a0af tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:40.867212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688290f-551b-4faa-ad5f-cb45e885a0af tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] PATH_INFO: `/v3/users/cb7b150285f24321a9d7971f45fa8369/password` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:41.202582 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7688290f-551b-4faa-ad5f-cb45e885a0af tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cb7b150285f24321a9d7971f45fa8369'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:41.217512 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3901/7807] 10.222.0.30 () {60 vars in 1269 bytes} [Sun Sep 4 01:33:40 2022] POST /identity/v3/users/cb7b150285f24321a9d7971f45fa8369/password => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:41.536596 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec5dcf-de46-43cd-8ea3-6cb391620f27 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:41.538312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-21ec5dcf-de46-43cd-8ea3-6cb391620f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:41.666966 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:INSERT=6,keystone:UPDATE=2,keystone:DELETE=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:41.769518 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec5dcf-de46-43cd-8ea3-6cb391620f27 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:41.784139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e081d9-211c-4e7f-9f89-c7f21884129a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:41.791126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e081d9-211c-4e7f-9f89-c7f21884129a service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:41.791698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e081d9-211c-4e7f-9f89-c7f21884129a service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:41.792141 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e081d9-211c-4e7f-9f89-c7f21884129a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:41.798120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-08e081d9-211c-4e7f-9f89-c7f21884129a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:41.969572 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e081d9-211c-4e7f-9f89-c7f21884129a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:41.971286 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e081d9-211c-4e7f-9f89-c7f21884129a service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:42.021794 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3907/7808] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:33:41 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:33:42.224127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7155b-3bc0-432c-a8a0-a13bf8e34665 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:42.224690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7155b-3bc0-432c-a8a0-a13bf8e34665 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:42.225757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7155b-3bc0-432c-a8a0-a13bf8e34665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:42.236469 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=88,keystone:INSERT=7,keystone:UPDATE=2,keystone:DELETE=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:42.257200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-17c7155b-3bc0-432c-a8a0-a13bf8e34665 None None] MFA Rules not processed for user `cb7b150285f24321a9d7971f45fa8369`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:42.261565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-17c7155b-3bc0-432c-a8a0-a13bf8e34665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:42.267524 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3902/7809] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:42 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 01:33:42.273225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a04768-412c-4c22-a8e4-9f8574cc93a3 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:42.274053 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a04768-412c-4c22-a8e4-9f8574cc93a3 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:42.276339 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a04768-412c-4c22-a8e4-9f8574cc93a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:42.310304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a0a04768-412c-4c22-a8e4-9f8574cc93a3 None None] MFA Rules not processed for user `cb7b150285f24321a9d7971f45fa8369`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:42.312722 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a0a04768-412c-4c22-a8e4-9f8574cc93a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:42.324932 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3908/7810] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:42.328970 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7155b-3bc0-432c-a8a0-a13bf8e34665 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:42.359691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7155b-3bc0-432c-a8a0-a13bf8e34665 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:42.391466 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a730524-beaf-4d07-8b7e-6ba40a2a397f tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb7b150285f24321a9d7971f45fa8369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6be4faa951f4b0bbd6027ce916e48b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:42.392135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a730524-beaf-4d07-8b7e-6ba40a2a397f tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:42.392419 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a730524-beaf-4d07-8b7e-6ba40a2a397f tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:42.392695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a730524-beaf-4d07-8b7e-6ba40a2a397f tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] PATH_INFO: `/v3/users/cb7b150285f24321a9d7971f45fa8369/password` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:42.489396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6a730524-beaf-4d07-8b7e-6ba40a2a397f tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cb7b150285f24321a9d7971f45fa8369'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:42.507333 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3903/7811] 10.222.0.30 () {60 vars in 1269 bytes} [Sun Sep 4 01:33:42 2022] POST /identity/v3/users/cb7b150285f24321a9d7971f45fa8369/password => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:43.512589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bde349-4c4b-42a8-a145-d29cd2bf0620 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:43.513083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bde349-4c4b-42a8-a145-d29cd2bf0620 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:43.513186 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bde349-4c4b-42a8-a145-d29cd2bf0620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:43.556603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d1bde349-4c4b-42a8-a145-d29cd2bf0620 None None] MFA Rules not processed for user `cb7b150285f24321a9d7971f45fa8369`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:43.558019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d1bde349-4c4b-42a8-a145-d29cd2bf0620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:43.561415 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3909/7812] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:43 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 01:33:44.487365 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a730524-beaf-4d07-8b7e-6ba40a2a397f tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:44.489379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6a730524-beaf-4d07-8b7e-6ba40a2a397f tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:44.567787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f7939-ad85-467b-826d-6a710e0d6ca4 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:44.568354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f7939-ad85-467b-826d-6a710e0d6ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:44.568354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f7939-ad85-467b-826d-6a710e0d6ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:44.600642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a730524-beaf-4d07-8b7e-6ba40a2a397f tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:44.601807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-7a1f7939-ad85-467b-826d-6a710e0d6ca4 None None] MFA Rules not processed for user `cb7b150285f24321a9d7971f45fa8369`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:44.605982 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7a1f7939-ad85-467b-826d-6a710e0d6ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:44.608944 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e2461-4186-4c1e-b4af-c1af557070aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:44.609752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e2461-4186-4c1e-b4af-c1af557070aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:44.610029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e2461-4186-4c1e-b4af-c1af557070aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:44.610545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e2461-4186-4c1e-b4af-c1af557070aa admin admin] PATH_INFO: `/v3/users/f3fcf5375b454e59b201037d089f9311` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:44.611836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e2461-4186-4c1e-b4af-c1af557070aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3fcf5375b454e59b201037d089f9311)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:44.614548 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e2461-4186-4c1e-b4af-c1af557070aa admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:44.615296 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3910/7813] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:44.625864 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c104fa6-7070-45af-bdf3-7349924d97d1 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:44.626399 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c104fa6-7070-45af-bdf3-7349924d97d1 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:44.626903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c104fa6-7070-45af-bdf3-7349924d97d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:44.667708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-7c104fa6-7070-45af-bdf3-7349924d97d1 None None] MFA Rules not processed for user `cb7b150285f24321a9d7971f45fa8369`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:44.669793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7c104fa6-7070-45af-bdf3-7349924d97d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:44.691574 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3911/7814] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:44 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 04 01:33:44.698441 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab35f6-1bd3-410d-b0ce-ec9cc5b0ff3a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:44.698749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab35f6-1bd3-410d-b0ce-ec9cc5b0ff3a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:44.699019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab35f6-1bd3-410d-b0ce-ec9cc5b0ff3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:44.703557 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ff2e2461-4186-4c1e-b4af-c1af557070aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3fcf5375b454e59b201037d089f9311'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:44.704527 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ff2e2461-4186-4c1e-b4af-c1af557070aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3fcf5375b454e59b201037d089f9311'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:44.726290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ff2e2461-4186-4c1e-b4af-c1af557070aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3fcf5375b454e59b201037d089f9311'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:44.744853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ff2e2461-4186-4c1e-b4af-c1af557070aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3fcf5375b454e59b201037d089f9311'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:44.745873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ff2e2461-4186-4c1e-b4af-c1af557070aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3fcf5375b454e59b201037d089f9311'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:44.784225 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3904/7815] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:33:44 2022] DELETE /identity/v3/users/f3fcf5375b454e59b201037d089f9311 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:44.789561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d45cee-3347-4fa8-9d9f-97111a261db9 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:44.790691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d45cee-3347-4fa8-9d9f-97111a261db9 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:44.791278 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d45cee-3347-4fa8-9d9f-97111a261db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:44.816638 n-d-master-1 devstack@keystone.service[81825]: WARNING keystone.server.flask.application [None req-6dab35f6-1bd3-410d-b0ce-ec9cc5b0ff3a None None] Authorization failed. The request you have made requires authentication. from 10.222.0.30: keystone.exception.Unauthorized: The request you have made requires authentication. Sep 04 01:33:44.818802 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3912/7816] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:44 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 122 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Sep 04 01:33:44.822762 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2ee23-4ed7-48fc-9620-140a486deb3e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:44.823346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2ee23-4ed7-48fc-9620-140a486deb3e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:44.823947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2ee23-4ed7-48fc-9620-140a486deb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:44.836670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-95d45cee-3347-4fa8-9d9f-97111a261db9 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:44.838496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-95d45cee-3347-4fa8-9d9f-97111a261db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:44.911360 n-d-master-1 devstack@keystone.service[81825]: WARNING keystone.server.flask.application [None req-9eb2ee23-4ed7-48fc-9620-140a486deb3e None None] Authorization failed. The request you have made requires authentication. from 10.222.0.30: keystone.exception.Unauthorized: The request you have made requires authentication. Sep 04 01:33:44.913754 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3913/7817] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:44 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 92 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Sep 04 01:33:44.918222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e8879-1364-4a58-87d9-4f2704f49bd7 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:44.918853 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e8879-1364-4a58-87d9-4f2704f49bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:44.919344 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e8879-1364-4a58-87d9-4f2704f49bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:44.931404 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=84,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=12 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:44.952389 n-d-master-1 devstack@keystone.service[81825]: WARNING keystone.server.flask.application [None req-c12e8879-1364-4a58-87d9-4f2704f49bd7 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.30: keystone.exception.Unauthorized: The request you have made requires authentication. Sep 04 01:33:44.955156 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3914/7818] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:44 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 38 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Sep 04 01:33:44.980901 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3905/7819] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:44.993852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e8879-1364-4a58-87d9-4f2704f49bd7 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:44.996364 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c12e8879-1364-4a58-87d9-4f2704f49bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:45.139186 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e8879-1364-4a58-87d9-4f2704f49bd7 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:45.145140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a857ad8-21ab-4dd5-846e-55eaf1d9c9ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:45.145857 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a857ad8-21ab-4dd5-846e-55eaf1d9c9ec service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:45.146597 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a857ad8-21ab-4dd5-846e-55eaf1d9c9ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:45.147078 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a857ad8-21ab-4dd5-846e-55eaf1d9c9ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:45.161476 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:UPDATE=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:45.164341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a857ad8-21ab-4dd5-846e-55eaf1d9c9ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:45.166066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a857ad8-21ab-4dd5-846e-55eaf1d9c9ec service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:45.180278 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3915/7820] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:33:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:33:45.583955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d45cee-3347-4fa8-9d9f-97111a261db9 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:45.586088 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-95d45cee-3347-4fa8-9d9f-97111a261db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:45.612452 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d45cee-3347-4fa8-9d9f-97111a261db9 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:45.621237 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b580a0-2f09-4572-b20a-7a4fff7d1feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:45.623171 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b580a0-2f09-4572-b20a-7a4fff7d1feb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:45.623547 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b580a0-2f09-4572-b20a-7a4fff7d1feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:45.623908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b580a0-2f09-4572-b20a-7a4fff7d1feb admin admin] PATH_INFO: `/v3/projects/0587d6e168554efba62fd4f8e19fb8e3` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:45.625244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b580a0-2f09-4572-b20a-7a4fff7d1feb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0587d6e168554efba62fd4f8e19fb8e3)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:45.627585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b580a0-2f09-4572-b20a-7a4fff7d1feb admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:45.707958 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c8b580a0-2f09-4572-b20a-7a4fff7d1feb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0587d6e168554efba62fd4f8e19fb8e3', 'request_id': 'req-c8b580a0-2f09-4572-b20a-7a4fff7d1feb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:45.723989 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c8b580a0-2f09-4572-b20a-7a4fff7d1feb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0587d6e168554efba62fd4f8e19fb8e3', 'request_id': 'req-c8b580a0-2f09-4572-b20a-7a4fff7d1feb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:45.735669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c8b580a0-2f09-4572-b20a-7a4fff7d1feb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0587d6e168554efba62fd4f8e19fb8e3', 'request_id': 'req-c8b580a0-2f09-4572-b20a-7a4fff7d1feb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:45.752353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c8b580a0-2f09-4572-b20a-7a4fff7d1feb admin admin] The token cache is being invalidate because project 0587d6e168554efba62fd4f8e19fb8e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:33:45.753033 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c8b580a0-2f09-4572-b20a-7a4fff7d1feb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:45.753955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c8b580a0-2f09-4572-b20a-7a4fff7d1feb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:45.757039 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3906/7821] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:33:45 2022] DELETE /identity/v3/projects/0587d6e168554efba62fd4f8e19fb8e3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:45.761056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a857ad8-21ab-4dd5-846e-55eaf1d9c9ec service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:45.773807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a857ad8-21ab-4dd5-846e-55eaf1d9c9ec service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:45.857147 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e92897-b9d8-40ac-9fe7-bda4f09c9f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:45.871146 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e92897-b9d8-40ac-9fe7-bda4f09c9f89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:45.879517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e92897-b9d8-40ac-9fe7-bda4f09c9f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:45.879517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e92897-b9d8-40ac-9fe7-bda4f09c9f89 admin admin] PATH_INFO: `/v3/users/3638271391bf4f18abb09cf6f856150d` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:45.879517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e92897-b9d8-40ac-9fe7-bda4f09c9f89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3638271391bf4f18abb09cf6f856150d)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:45.879517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e92897-b9d8-40ac-9fe7-bda4f09c9f89 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:45.996373 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-13e92897-b9d8-40ac-9fe7-bda4f09c9f89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3638271391bf4f18abb09cf6f856150d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:45.997387 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-13e92897-b9d8-40ac-9fe7-bda4f09c9f89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3638271391bf4f18abb09cf6f856150d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:46.007243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-13e92897-b9d8-40ac-9fe7-bda4f09c9f89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3638271391bf4f18abb09cf6f856150d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:46.025966 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-13e92897-b9d8-40ac-9fe7-bda4f09c9f89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3638271391bf4f18abb09cf6f856150d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:46.027246 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-13e92897-b9d8-40ac-9fe7-bda4f09c9f89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3638271391bf4f18abb09cf6f856150d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:46.055288 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3916/7822] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:33:45 2022] DELETE /identity/v3/users/3638271391bf4f18abb09cf6f856150d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:46.912610 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b580a0-2f09-4572-b20a-7a4fff7d1feb admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:46.914654 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c8b580a0-2f09-4572-b20a-7a4fff7d1feb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:46.998942 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b580a0-2f09-4572-b20a-7a4fff7d1feb admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:47.017008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e92897-b9d8-40ac-9fe7-bda4f09c9f89 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:47.021782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-13e92897-b9d8-40ac-9fe7-bda4f09c9f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:47.067054 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0a79d-5b33-431d-ac2e-4b4ca7382f74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:47.067740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0a79d-5b33-431d-ac2e-4b4ca7382f74 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:47.068084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0a79d-5b33-431d-ac2e-4b4ca7382f74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:47.068420 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0a79d-5b33-431d-ac2e-4b4ca7382f74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:47.070793 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-71f0a79d-5b33-431d-ac2e-4b4ca7382f74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:47.124681 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:47.151531 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e92897-b9d8-40ac-9fe7-bda4f09c9f89 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:47.159769 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344ea17-06c5-48f9-a1cd-9c39dbabc41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:47.160417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344ea17-06c5-48f9-a1cd-9c39dbabc41c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:47.160704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344ea17-06c5-48f9-a1cd-9c39dbabc41c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:47.160980 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344ea17-06c5-48f9-a1cd-9c39dbabc41c admin admin] PATH_INFO: `/v3/projects/11ae348848164f95aebe0797516cc3cf` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:47.163207 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344ea17-06c5-48f9-a1cd-9c39dbabc41c admin admin] RBAC: Authorizing `identity:delete_project(project_id=11ae348848164f95aebe0797516cc3cf)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:47.167002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344ea17-06c5-48f9-a1cd-9c39dbabc41c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:47.181305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0a79d-5b33-431d-ac2e-4b4ca7382f74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:47.183332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0a79d-5b33-431d-ac2e-4b4ca7382f74 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:47.198715 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:47.207944 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3907/7823] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:33:46 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:33:47.242262 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a344ea17-06c5-48f9-a1cd-9c39dbabc41c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11ae348848164f95aebe0797516cc3cf', 'request_id': 'req-a344ea17-06c5-48f9-a1cd-9c39dbabc41c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:47.251123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a344ea17-06c5-48f9-a1cd-9c39dbabc41c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11ae348848164f95aebe0797516cc3cf', 'request_id': 'req-a344ea17-06c5-48f9-a1cd-9c39dbabc41c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:47.257341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a344ea17-06c5-48f9-a1cd-9c39dbabc41c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11ae348848164f95aebe0797516cc3cf', 'request_id': 'req-a344ea17-06c5-48f9-a1cd-9c39dbabc41c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:47.276717 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a344ea17-06c5-48f9-a1cd-9c39dbabc41c admin admin] The token cache is being invalidate because project 11ae348848164f95aebe0797516cc3cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:33:47.277326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a344ea17-06c5-48f9-a1cd-9c39dbabc41c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:47.279178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a344ea17-06c5-48f9-a1cd-9c39dbabc41c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:47.284672 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3917/7824] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:33:47 2022] DELETE /identity/v3/projects/11ae348848164f95aebe0797516cc3cf => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:47.286524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07d77b-32ee-4fba-90d7-4f21d45bc6c1 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:47.287045 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07d77b-32ee-4fba-90d7-4f21d45bc6c1 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:47.287529 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07d77b-32ee-4fba-90d7-4f21d45bc6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:47.312645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-2e07d77b-32ee-4fba-90d7-4f21d45bc6c1 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:47.313897 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2e07d77b-32ee-4fba-90d7-4f21d45bc6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:47.386476 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3908/7825] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:47.395253 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66d867-0914-457b-badd-80eabe781465 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:47.395790 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66d867-0914-457b-badd-80eabe781465 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:47.396225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66d867-0914-457b-badd-80eabe781465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:47.417639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-fa66d867-0914-457b-badd-80eabe781465 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:47.419489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-fa66d867-0914-457b-badd-80eabe781465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:47.432283 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3918/7826] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:47.433560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07d77b-32ee-4fba-90d7-4f21d45bc6c1 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:47.448024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07d77b-32ee-4fba-90d7-4f21d45bc6c1 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:47.458645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be8487-6421-4d09-8a1b-a9fb7bea4962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:47.459457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be8487-6421-4d09-8a1b-a9fb7bea4962 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:47.459731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be8487-6421-4d09-8a1b-a9fb7bea4962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:47.460562 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be8487-6421-4d09-8a1b-a9fb7bea4962 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:47.461401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be8487-6421-4d09-8a1b-a9fb7bea4962 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:33:47.461760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be8487-6421-4d09-8a1b-a9fb7bea4962 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:47.464283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be8487-6421-4d09-8a1b-a9fb7bea4962 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:47.477634 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3909/7827] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:33:47.483005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66d867-0914-457b-badd-80eabe781465 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:47.498938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66d867-0914-457b-badd-80eabe781465 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:47.513157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93970440-6098-4564-a6d6-2576aeb92ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:47.513931 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93970440-6098-4564-a6d6-2576aeb92ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:47.514277 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93970440-6098-4564-a6d6-2576aeb92ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:47.514469 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93970440-6098-4564-a6d6-2576aeb92ed5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:47.515105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93970440-6098-4564-a6d6-2576aeb92ed5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:47.519930 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93970440-6098-4564-a6d6-2576aeb92ed5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:47.561863 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3919/7828] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:33:47 2022] POST /identity/v3/projects => generated 369 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:47.565031 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be8487-6421-4d09-8a1b-a9fb7bea4962 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:47.575999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be8487-6421-4d09-8a1b-a9fb7bea4962 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:47.682869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a92ae-d360-41f7-aae6-1902fd718868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:47.683677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a92ae-d360-41f7-aae6-1902fd718868 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:47.684244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a92ae-d360-41f7-aae6-1902fd718868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:47.684599 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a92ae-d360-41f7-aae6-1902fd718868 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:47.685562 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a92ae-d360-41f7-aae6-1902fd718868 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:47.687518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a92ae-d360-41f7-aae6-1902fd718868 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:47.717130 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3910/7829] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:33:47 2022] POST /identity/v3/users => generated 285 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:47.721145 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93970440-6098-4564-a6d6-2576aeb92ed5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:47.742894 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93970440-6098-4564-a6d6-2576aeb92ed5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:47.750006 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5f159-d2a8-4e92-8294-cdaff034720d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:47.750247 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5f159-d2a8-4e92-8294-cdaff034720d admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:47.750506 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5f159-d2a8-4e92-8294-cdaff034720d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:47.750781 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5f159-d2a8-4e92-8294-cdaff034720d admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:47.752569 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d5f159-d2a8-4e92-8294-cdaff034720d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:47.754305 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d5f159-d2a8-4e92-8294-cdaff034720d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:47.770961 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3920/7830] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:33:47.776188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a92ae-d360-41f7-aae6-1902fd718868 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:47.790592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a92ae-d360-41f7-aae6-1902fd718868 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:47.796989 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9fb5b6-0e6e-4cdc-aab6-824ee39149dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:47.797642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fb5b6-0e6e-4cdc-aab6-824ee39149dc admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:47.797919 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fb5b6-0e6e-4cdc-aab6-824ee39149dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:47.798188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fb5b6-0e6e-4cdc-aab6-824ee39149dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:47.799135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9fb5b6-0e6e-4cdc-aab6-824ee39149dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:47.801310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9fb5b6-0e6e-4cdc-aab6-824ee39149dc admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:47.823119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5f159-d2a8-4e92-8294-cdaff034720d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:47.835159 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3911/7831] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:33:47.837812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5f159-d2a8-4e92-8294-cdaff034720d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:47.844820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15c004-b46e-4dd2-bd7a-76ff5e75890a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:47.845583 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15c004-b46e-4dd2-bd7a-76ff5e75890a admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:47.845916 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15c004-b46e-4dd2-bd7a-76ff5e75890a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:47.846195 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15c004-b46e-4dd2-bd7a-76ff5e75890a admin admin] PATH_INFO: `/v3/projects/1fafd22d8d0a402da6ee810814c27b34/users/617cb6338bf24ab48f63df60e872274f/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:47.872047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b15c004-b46e-4dd2-bd7a-76ff5e75890a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fafd22d8d0a402da6ee810814c27b34, user_id=617cb6338bf24ab48f63df60e872274f, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:47.876603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b15c004-b46e-4dd2-bd7a-76ff5e75890a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:47.904143 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3921/7832] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:33:47 2022] PUT /identity/v3/projects/1fafd22d8d0a402da6ee810814c27b34/users/617cb6338bf24ab48f63df60e872274f/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:47.914255 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4df56f-275c-4a08-9183-708c60d37f5b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:47.914789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4df56f-275c-4a08-9183-708c60d37f5b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:47.914789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4df56f-275c-4a08-9183-708c60d37f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:47.971579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-4d4df56f-275c-4a08-9183-708c60d37f5b None None] MFA Rules not processed for user `617cb6338bf24ab48f63df60e872274f`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:47.973743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4d4df56f-275c-4a08-9183-708c60d37f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:48.012887 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:48.142777 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3912/7833] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:48.147561 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15c004-b46e-4dd2-bd7a-76ff5e75890a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:48.254533 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15c004-b46e-4dd2-bd7a-76ff5e75890a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:48.270316 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62a7d8-5e4e-4bee-861d-ffa0a6844d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:48.271046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62a7d8-5e4e-4bee-861d-ffa0a6844d8d admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:48.273254 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62a7d8-5e4e-4bee-861d-ffa0a6844d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:48.273649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62a7d8-5e4e-4bee-861d-ffa0a6844d8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:48.274482 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c62a7d8-5e4e-4bee-861d-ffa0a6844d8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:48.280991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c62a7d8-5e4e-4bee-861d-ffa0a6844d8d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:48.316335 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3922/7834] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:33:48 2022] POST /identity/v3/projects => generated 369 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:48.320556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4df56f-275c-4a08-9183-708c60d37f5b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:48.344723 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4df56f-275c-4a08-9183-708c60d37f5b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:48.485976 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096778c-4bdf-46c4-abd3-c9384b8a56e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:48.486733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096778c-4bdf-46c4-abd3-c9384b8a56e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:48.487197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096778c-4bdf-46c4-abd3-c9384b8a56e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:48.487554 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096778c-4bdf-46c4-abd3-c9384b8a56e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:48.489068 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096778c-4bdf-46c4-abd3-c9384b8a56e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:48.491359 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096778c-4bdf-46c4-abd3-c9384b8a56e3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:48.538534 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3913/7835] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:33:48 2022] POST /identity/v3/users => generated 291 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:48.540180 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62a7d8-5e4e-4bee-861d-ffa0a6844d8d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:48.550778 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62a7d8-5e4e-4bee-861d-ffa0a6844d8d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:48.556681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc2837-c7d5-42dc-9846-564b60127327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:48.558053 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc2837-c7d5-42dc-9846-564b60127327 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:48.558555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc2837-c7d5-42dc-9846-564b60127327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:48.558986 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc2837-c7d5-42dc-9846-564b60127327 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:48.559876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc2837-c7d5-42dc-9846-564b60127327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:48.562027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc2837-c7d5-42dc-9846-564b60127327 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:48.575403 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3923/7836] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:33:48.579516 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096778c-4bdf-46c4-abd3-c9384b8a56e3 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:48.590148 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096778c-4bdf-46c4-abd3-c9384b8a56e3 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:48.607398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5455399-fa8a-47fe-a082-b721c9d674f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:48.608079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5455399-fa8a-47fe-a082-b721c9d674f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:48.608355 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5455399-fa8a-47fe-a082-b721c9d674f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:48.608631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5455399-fa8a-47fe-a082-b721c9d674f6 admin admin] PATH_INFO: `/v3/projects/cdefcec88bec49fdbd7f7e34f4aedd01/users/5352dddfadd24e93861de98383dfc6b0/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:48.636233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5455399-fa8a-47fe-a082-b721c9d674f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdefcec88bec49fdbd7f7e34f4aedd01, user_id=5352dddfadd24e93861de98383dfc6b0, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:48.640612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5455399-fa8a-47fe-a082-b721c9d674f6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:48.675460 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3914/7837] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:33:48 2022] PUT /identity/v3/projects/cdefcec88bec49fdbd7f7e34f4aedd01/users/5352dddfadd24e93861de98383dfc6b0/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:48.679200 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc2837-c7d5-42dc-9846-564b60127327 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:48.691304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc2837-c7d5-42dc-9846-564b60127327 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:48.704801 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:48.742706 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5455399-fa8a-47fe-a082-b721c9d674f6 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:48.746041 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b5455399-fa8a-47fe-a082-b721c9d674f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:48.763665 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f5c91c-9d28-433a-b51e-dd97a5e7a022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:48.764285 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5c91c-9d28-433a-b51e-dd97a5e7a022 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:48.764568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5c91c-9d28-433a-b51e-dd97a5e7a022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:48.764842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5c91c-9d28-433a-b51e-dd97a5e7a022 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:48.765520 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f5c91c-9d28-433a-b51e-dd97a5e7a022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:48.767117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f5c91c-9d28-433a-b51e-dd97a5e7a022 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:48.780843 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3924/7838] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:33:48.782198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f5c91c-9d28-433a-b51e-dd97a5e7a022 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:48.796679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f5c91c-9d28-433a-b51e-dd97a5e7a022 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:48.808739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44297b2-17a2-4fe6-b1da-ae8947ac8131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:48.809976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44297b2-17a2-4fe6-b1da-ae8947ac8131 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:48.813721 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44297b2-17a2-4fe6-b1da-ae8947ac8131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:48.814024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44297b2-17a2-4fe6-b1da-ae8947ac8131 admin admin] PATH_INFO: `/v3/projects/cdefcec88bec49fdbd7f7e34f4aedd01/users/5352dddfadd24e93861de98383dfc6b0/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:48.822293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44297b2-17a2-4fe6-b1da-ae8947ac8131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdefcec88bec49fdbd7f7e34f4aedd01, user_id=5352dddfadd24e93861de98383dfc6b0, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:48.825274 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44297b2-17a2-4fe6-b1da-ae8947ac8131 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:48.848242 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3925/7839] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:33:48 2022] PUT /identity/v3/projects/cdefcec88bec49fdbd7f7e34f4aedd01/users/5352dddfadd24e93861de98383dfc6b0/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:48.859940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df506c-3884-4b9c-b8ec-4209c4672c75 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:48.860228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df506c-3884-4b9c-b8ec-4209c4672c75 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:48.861391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df506c-3884-4b9c-b8ec-4209c4672c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:48.906147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5455399-fa8a-47fe-a082-b721c9d674f6 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:48.929566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e2df506c-3884-4b9c-b8ec-4209c4672c75 None None] MFA Rules not processed for user `5352dddfadd24e93861de98383dfc6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:48.932785 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e2df506c-3884-4b9c-b8ec-4209c4672c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:48.939489 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:49.011814 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c1e29-01fc-47f5-a869-b0dc0eaa7213 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:49.012450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c1e29-01fc-47f5-a869-b0dc0eaa7213 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:49.012731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c1e29-01fc-47f5-a869-b0dc0eaa7213 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:49.013006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c1e29-01fc-47f5-a869-b0dc0eaa7213 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:49.016994 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6f5c1e29-01fc-47f5-a869-b0dc0eaa7213 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:49.045474 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3926/7840] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:48 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:33:49.057915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df506c-3884-4b9c-b8ec-4209c4672c75 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:49.064314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e2df506c-3884-4b9c-b8ec-4209c4672c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:49.257894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5c1e29-01fc-47f5-a869-b0dc0eaa7213 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:49.260476 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df506c-3884-4b9c-b8ec-4209c4672c75 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:49.261242 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5c1e29-01fc-47f5-a869-b0dc0eaa7213 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:49.268776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e95c3-0dec-429a-a76a-a0533de3a27a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:49.270420 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e95c3-0dec-429a-a76a-a0533de3a27a service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:49.270702 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e95c3-0dec-429a-a76a-a0533de3a27a service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:49.270976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e95c3-0dec-429a-a76a-a0533de3a27a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:49.305229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e95c3-0dec-429a-a76a-a0533de3a27a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:49.306749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e95c3-0dec-429a-a76a-a0533de3a27a service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:49.318831 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3915/7841] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:33:48 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:33:49.369360 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3927/7842] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:33:49 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:33:49.483246 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c1e29-01fc-47f5-a869-b0dc0eaa7213 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:49.499353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c1e29-01fc-47f5-a869-b0dc0eaa7213 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:49.517142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d2a81-a1d6-4cd6-85f4-bb244c4b78c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:49.518077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d2a81-a1d6-4cd6-85f4-bb244c4b78c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:49.518460 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d2a81-a1d6-4cd6-85f4-bb244c4b78c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:49.518985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d2a81-a1d6-4cd6-85f4-bb244c4b78c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:49.694836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d2a81-a1d6-4cd6-85f4-bb244c4b78c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:49.699332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d2a81-a1d6-4cd6-85f4-bb244c4b78c3 service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:49.723340 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3916/7843] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:33:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:33:53.484134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e95c3-0dec-429a-a76a-a0533de3a27a service cinder] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:53.488193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d36e95c3-0dec-429a-a76a-a0533de3a27a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:53.555133 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:53.640583 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e95c3-0dec-429a-a76a-a0533de3a27a service cinder] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:53.646405 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ffba9-9ef8-46fa-9944-3b324f15dc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:53.647071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ffba9-9ef8-46fa-9944-3b324f15dc0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:53.647474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ffba9-9ef8-46fa-9944-3b324f15dc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:53.648437 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ffba9-9ef8-46fa-9944-3b324f15dc0d admin admin] PATH_INFO: `/v3/users/3153fef46b654b4d9d4f6876b51b602a` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:53.649979 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ffba9-9ef8-46fa-9944-3b324f15dc0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3153fef46b654b4d9d4f6876b51b602a)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:53.652960 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ffba9-9ef8-46fa-9944-3b324f15dc0d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:53.803818 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c93ffba9-9ef8-46fa-9944-3b324f15dc0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3153fef46b654b4d9d4f6876b51b602a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:53.804947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c93ffba9-9ef8-46fa-9944-3b324f15dc0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3153fef46b654b4d9d4f6876b51b602a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:53.836697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c93ffba9-9ef8-46fa-9944-3b324f15dc0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3153fef46b654b4d9d4f6876b51b602a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:53.859801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c93ffba9-9ef8-46fa-9944-3b324f15dc0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3153fef46b654b4d9d4f6876b51b602a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:53.860901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c93ffba9-9ef8-46fa-9944-3b324f15dc0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3153fef46b654b4d9d4f6876b51b602a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:53.886487 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3928/7844] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:33:53 2022] DELETE /identity/v3/users/3153fef46b654b4d9d4f6876b51b602a => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:53.890724 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8538c1-c9a7-4186-8ddc-5d24142cb5af None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:53.891231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8538c1-c9a7-4186-8ddc-5d24142cb5af None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:53.891327 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8538c1-c9a7-4186-8ddc-5d24142cb5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:53.923857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-0b8538c1-c9a7-4186-8ddc-5d24142cb5af None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:53.925088 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0b8538c1-c9a7-4186-8ddc-5d24142cb5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:54.012594 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:54.055989 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3917/7845] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:54.078125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ffba9-9ef8-46fa-9944-3b324f15dc0d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:54.079701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c93ffba9-9ef8-46fa-9944-3b324f15dc0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:54.276182 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ffba9-9ef8-46fa-9944-3b324f15dc0d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:54.286285 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7904d0-e48c-4918-a1f6-d5bd752e3569 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:54.287095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7904d0-e48c-4918-a1f6-d5bd752e3569 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:54.287405 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7904d0-e48c-4918-a1f6-d5bd752e3569 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:54.287937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7904d0-e48c-4918-a1f6-d5bd752e3569 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:54.318311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7904d0-e48c-4918-a1f6-d5bd752e3569 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:54.320122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7904d0-e48c-4918-a1f6-d5bd752e3569 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:54.353780 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3929/7846] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:33:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:33:54.530578 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8538c1-c9a7-4186-8ddc-5d24142cb5af None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:54.532139 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0b8538c1-c9a7-4186-8ddc-5d24142cb5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:54.553809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8538c1-c9a7-4186-8ddc-5d24142cb5af None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:54.567749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589cc20-0440-40f4-93cd-7258753a37fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:54.568422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589cc20-0440-40f4-93cd-7258753a37fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:54.568710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589cc20-0440-40f4-93cd-7258753a37fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:54.568992 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589cc20-0440-40f4-93cd-7258753a37fd admin admin] PATH_INFO: `/v3/users/617cb6338bf24ab48f63df60e872274f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:54.570268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4589cc20-0440-40f4-93cd-7258753a37fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=617cb6338bf24ab48f63df60e872274f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:54.572285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4589cc20-0440-40f4-93cd-7258753a37fd admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:54.675129 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4589cc20-0440-40f4-93cd-7258753a37fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '617cb6338bf24ab48f63df60e872274f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:54.675814 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4589cc20-0440-40f4-93cd-7258753a37fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '617cb6338bf24ab48f63df60e872274f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:54.702643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4589cc20-0440-40f4-93cd-7258753a37fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '617cb6338bf24ab48f63df60e872274f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:54.724003 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4589cc20-0440-40f4-93cd-7258753a37fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '617cb6338bf24ab48f63df60e872274f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:54.724648 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4589cc20-0440-40f4-93cd-7258753a37fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '617cb6338bf24ab48f63df60e872274f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:54.771620 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3918/7847] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:33:54 2022] DELETE /identity/v3/users/617cb6338bf24ab48f63df60e872274f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:54.777665 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573cd5c-25b5-4499-b014-0be264078594 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:54.778184 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573cd5c-25b5-4499-b014-0be264078594 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:54.778279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573cd5c-25b5-4499-b014-0be264078594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:54.806713 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589cc20-0440-40f4-93cd-7258753a37fd admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:54.808466 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4589cc20-0440-40f4-93cd-7258753a37fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:54.838323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c573cd5c-25b5-4499-b014-0be264078594 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:54.845082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c573cd5c-25b5-4499-b014-0be264078594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:54.927277 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:54.973569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589cc20-0440-40f4-93cd-7258753a37fd admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:54.988558 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26306bf2-6a02-43c0-9826-60dba780cca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:54.989640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26306bf2-6a02-43c0-9826-60dba780cca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:54.990255 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26306bf2-6a02-43c0-9826-60dba780cca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:54.990758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26306bf2-6a02-43c0-9826-60dba780cca6 admin admin] PATH_INFO: `/v3/projects/412f6ecdb3114b01881850717de700bb` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:54.994494 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3930/7848] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:54.994983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26306bf2-6a02-43c0-9826-60dba780cca6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=412f6ecdb3114b01881850717de700bb)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:55.001187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26306bf2-6a02-43c0-9826-60dba780cca6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:55.075704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573cd5c-25b5-4499-b014-0be264078594 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:55.078027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c573cd5c-25b5-4499-b014-0be264078594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:55.114343 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-26306bf2-6a02-43c0-9826-60dba780cca6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '412f6ecdb3114b01881850717de700bb', 'request_id': 'req-26306bf2-6a02-43c0-9826-60dba780cca6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:55.134383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-26306bf2-6a02-43c0-9826-60dba780cca6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '412f6ecdb3114b01881850717de700bb', 'request_id': 'req-26306bf2-6a02-43c0-9826-60dba780cca6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:55.141927 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:55.144776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-26306bf2-6a02-43c0-9826-60dba780cca6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '412f6ecdb3114b01881850717de700bb', 'request_id': 'req-26306bf2-6a02-43c0-9826-60dba780cca6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:55.171297 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-26306bf2-6a02-43c0-9826-60dba780cca6 admin admin] The token cache is being invalidate because project 412f6ecdb3114b01881850717de700bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:33:55.171596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-26306bf2-6a02-43c0-9826-60dba780cca6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:55.172540 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-26306bf2-6a02-43c0-9826-60dba780cca6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:55.176093 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3919/7849] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:33:54 2022] DELETE /identity/v3/projects/412f6ecdb3114b01881850717de700bb => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:33:55.181618 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26306bf2-6a02-43c0-9826-60dba780cca6 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:55.184305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-26306bf2-6a02-43c0-9826-60dba780cca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:55.225989 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573cd5c-25b5-4499-b014-0be264078594 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:55.290144 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc7dbf-cac7-4182-a4e1-ae5f2d4603e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:55.291211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc7dbf-cac7-4182-a4e1-ae5f2d4603e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:55.291965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc7dbf-cac7-4182-a4e1-ae5f2d4603e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:55.292428 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc7dbf-cac7-4182-a4e1-ae5f2d4603e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:55.295355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-17bc7dbf-cac7-4182-a4e1-ae5f2d4603e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:55.326385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26306bf2-6a02-43c0-9826-60dba780cca6 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:55.347732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ce7f5-6604-45b0-bf84-547dde5fd493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:55.348255 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ce7f5-6604-45b0-bf84-547dde5fd493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:55.348739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ce7f5-6604-45b0-bf84-547dde5fd493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:55.349311 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ce7f5-6604-45b0-bf84-547dde5fd493 admin admin] PATH_INFO: `/v3/users/afd5b6b9f15b4b34ac2db948b0d8c9c8` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:55.355181 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ce7f5-6604-45b0-bf84-547dde5fd493 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afd5b6b9f15b4b34ac2db948b0d8c9c8)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:55.361621 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ce7f5-6604-45b0-bf84-547dde5fd493 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:55.386825 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc7dbf-cac7-4182-a4e1-ae5f2d4603e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:55.388735 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc7dbf-cac7-4182-a4e1-ae5f2d4603e4 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:55.402307 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3931/7850] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:33:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:33:55.519490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-008ce7f5-6604-45b0-bf84-547dde5fd493 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afd5b6b9f15b4b34ac2db948b0d8c9c8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:55.520225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-008ce7f5-6604-45b0-bf84-547dde5fd493 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afd5b6b9f15b4b34ac2db948b0d8c9c8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:55.543092 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-008ce7f5-6604-45b0-bf84-547dde5fd493 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afd5b6b9f15b4b34ac2db948b0d8c9c8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:55.568182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-008ce7f5-6604-45b0-bf84-547dde5fd493 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afd5b6b9f15b4b34ac2db948b0d8c9c8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:55.568985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-008ce7f5-6604-45b0-bf84-547dde5fd493 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afd5b6b9f15b4b34ac2db948b0d8c9c8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:55.603350 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3920/7851] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:33:55 2022] DELETE /identity/v3/users/afd5b6b9f15b4b34ac2db948b0d8c9c8 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:55.968488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac212b8-a4be-4f80-a62d-dcd2510138e1 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:55.969071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac212b8-a4be-4f80-a62d-dcd2510138e1 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:55.969071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac212b8-a4be-4f80-a62d-dcd2510138e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:56.086108 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-eac212b8-a4be-4f80-a62d-dcd2510138e1 None None] MFA Rules not processed for user `cb7b150285f24321a9d7971f45fa8369`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:56.088233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-eac212b8-a4be-4f80-a62d-dcd2510138e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:56.093195 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3932/7852] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:55 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 01:33:56.098446 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ce7f5-6604-45b0-bf84-547dde5fd493 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:56.100699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-008ce7f5-6604-45b0-bf84-547dde5fd493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:56.215548 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ce7f5-6604-45b0-bf84-547dde5fd493 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:56.220357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed838d6-b387-4a25-b184-b4936c7671b6 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb7b150285f24321a9d7971f45fa8369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6be4faa951f4b0bbd6027ce916e48b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:56.221060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed838d6-b387-4a25-b184-b4936c7671b6 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:56.221344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed838d6-b387-4a25-b184-b4936c7671b6 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:56.221650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed838d6-b387-4a25-b184-b4936c7671b6 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] PATH_INFO: `/v3/users/cb7b150285f24321a9d7971f45fa8369/password` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:56.276826 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:56.323875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0ed838d6-b387-4a25-b184-b4936c7671b6 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cb7b150285f24321a9d7971f45fa8369'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:56.334859 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3921/7853] 10.222.0.30 () {60 vars in 1269 bytes} [Sun Sep 4 01:33:56 2022] POST /identity/v3/users/cb7b150285f24321a9d7971f45fa8369/password => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:56.501628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac212b8-a4be-4f80-a62d-dcd2510138e1 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:56.503060 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-eac212b8-a4be-4f80-a62d-dcd2510138e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:56.531257 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:56.569742 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac212b8-a4be-4f80-a62d-dcd2510138e1 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:56.574164 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a678c-6209-47d1-a945-af4d232cca9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:56.574947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a678c-6209-47d1-a945-af4d232cca9d service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:56.575296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a678c-6209-47d1-a945-af4d232cca9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:56.576017 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a678c-6209-47d1-a945-af4d232cca9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:56.579111 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-837a678c-6209-47d1-a945-af4d232cca9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:56.672972 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a678c-6209-47d1-a945-af4d232cca9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:56.674566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a678c-6209-47d1-a945-af4d232cca9d service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:56.704680 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3933/7854] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:33:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:33:56.731800 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed838d6-b387-4a25-b184-b4936c7671b6 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:56.733700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0ed838d6-b387-4a25-b184-b4936c7671b6 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:56.845097 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a678c-6209-47d1-a945-af4d232cca9d service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:56.848621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-837a678c-6209-47d1-a945-af4d232cca9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:56.849914 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed838d6-b387-4a25-b184-b4936c7671b6 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:56.856424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacf337-2f81-4b45-85a7-35d21060acf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:56.856791 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacf337-2f81-4b45-85a7-35d21060acf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:56.857182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacf337-2f81-4b45-85a7-35d21060acf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:56.857786 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacf337-2f81-4b45-85a7-35d21060acf7 admin admin] PATH_INFO: `/v3/projects/c6825500b19e4e5d9f053ec1a2f312b6` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:56.859282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcacf337-2f81-4b45-85a7-35d21060acf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6825500b19e4e5d9f053ec1a2f312b6)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:56.861829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcacf337-2f81-4b45-85a7-35d21060acf7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:56.875480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a678c-6209-47d1-a945-af4d232cca9d service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:56.883672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b278d-aa31-4055-b20e-f5621a97c4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:56.884933 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b278d-aa31-4055-b20e-f5621a97c4a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:56.884933 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b278d-aa31-4055-b20e-f5621a97c4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:56.885190 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b278d-aa31-4055-b20e-f5621a97c4a3 admin admin] PATH_INFO: `/v3/projects/1fafd22d8d0a402da6ee810814c27b34` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:56.886927 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b278d-aa31-4055-b20e-f5621a97c4a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fafd22d8d0a402da6ee810814c27b34)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:56.890406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b278d-aa31-4055-b20e-f5621a97c4a3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:56.976032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-929b278d-aa31-4055-b20e-f5621a97c4a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fafd22d8d0a402da6ee810814c27b34', 'request_id': 'req-929b278d-aa31-4055-b20e-f5621a97c4a3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:56.985996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bcacf337-2f81-4b45-85a7-35d21060acf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6825500b19e4e5d9f053ec1a2f312b6', 'request_id': 'req-bcacf337-2f81-4b45-85a7-35d21060acf7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:56.990056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-929b278d-aa31-4055-b20e-f5621a97c4a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fafd22d8d0a402da6ee810814c27b34', 'request_id': 'req-929b278d-aa31-4055-b20e-f5621a97c4a3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:57.001048 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-929b278d-aa31-4055-b20e-f5621a97c4a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fafd22d8d0a402da6ee810814c27b34', 'request_id': 'req-929b278d-aa31-4055-b20e-f5621a97c4a3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:57.013156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bcacf337-2f81-4b45-85a7-35d21060acf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6825500b19e4e5d9f053ec1a2f312b6', 'request_id': 'req-bcacf337-2f81-4b45-85a7-35d21060acf7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:57.019694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-929b278d-aa31-4055-b20e-f5621a97c4a3 admin admin] The token cache is being invalidate because project 1fafd22d8d0a402da6ee810814c27b34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:33:57.019965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-929b278d-aa31-4055-b20e-f5621a97c4a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:57.020826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-929b278d-aa31-4055-b20e-f5621a97c4a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:57.023176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bcacf337-2f81-4b45-85a7-35d21060acf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6825500b19e4e5d9f053ec1a2f312b6', 'request_id': 'req-bcacf337-2f81-4b45-85a7-35d21060acf7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:57.026168 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3934/7855] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:33:56 2022] DELETE /identity/v3/projects/1fafd22d8d0a402da6ee810814c27b34 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:33:57.027894 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b278d-aa31-4055-b20e-f5621a97c4a3 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:57.029132 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-929b278d-aa31-4055-b20e-f5621a97c4a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:57.046973 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bcacf337-2f81-4b45-85a7-35d21060acf7 admin admin] The token cache is being invalidate because project c6825500b19e4e5d9f053ec1a2f312b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:33:57.047417 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bcacf337-2f81-4b45-85a7-35d21060acf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:57.048432 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bcacf337-2f81-4b45-85a7-35d21060acf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:57.050779 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3922/7856] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:33:56 2022] DELETE /identity/v3/projects/c6825500b19e4e5d9f053ec1a2f312b6 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:57.054846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacf337-2f81-4b45-85a7-35d21060acf7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:57.057078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-bcacf337-2f81-4b45-85a7-35d21060acf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:57.107677 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:57.144327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b278d-aa31-4055-b20e-f5621a97c4a3 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:57.161657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacf337-2f81-4b45-85a7-35d21060acf7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:57.171729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb35ad-5c3d-4377-82a7-47edf15b476e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:57.173321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb35ad-5c3d-4377-82a7-47edf15b476e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:57.173585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb35ad-5c3d-4377-82a7-47edf15b476e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:57.173848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb35ad-5c3d-4377-82a7-47edf15b476e admin admin] PATH_INFO: `/v3/users/5352dddfadd24e93861de98383dfc6b0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:57.175233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb35ad-5c3d-4377-82a7-47edf15b476e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5352dddfadd24e93861de98383dfc6b0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:57.178198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb35ad-5c3d-4377-82a7-47edf15b476e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:57.181611 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb4bea-2a6b-4ea0-960f-04d0ac81e157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:57.182548 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb4bea-2a6b-4ea0-960f-04d0ac81e157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:57.183049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb4bea-2a6b-4ea0-960f-04d0ac81e157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:57.183561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb4bea-2a6b-4ea0-960f-04d0ac81e157 admin admin] PATH_INFO: `/v3/users/5fe1649ed55541508bbcfc1c206144d3` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:57.185083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb4bea-2a6b-4ea0-960f-04d0ac81e157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fe1649ed55541508bbcfc1c206144d3)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:57.187400 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb4bea-2a6b-4ea0-960f-04d0ac81e157 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:57.207317 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=10,keystone:SELECT=86 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:57.256786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c7fb35ad-5c3d-4377-82a7-47edf15b476e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5352dddfadd24e93861de98383dfc6b0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:57.259030 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c7fb35ad-5c3d-4377-82a7-47edf15b476e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5352dddfadd24e93861de98383dfc6b0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:57.269704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c7fb35ad-5c3d-4377-82a7-47edf15b476e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5352dddfadd24e93861de98383dfc6b0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:57.287831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c7fb35ad-5c3d-4377-82a7-47edf15b476e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5352dddfadd24e93861de98383dfc6b0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:57.288839 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c7fb35ad-5c3d-4377-82a7-47edf15b476e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5352dddfadd24e93861de98383dfc6b0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:57.297393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-54eb4bea-2a6b-4ea0-960f-04d0ac81e157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fe1649ed55541508bbcfc1c206144d3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:57.299193 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-54eb4bea-2a6b-4ea0-960f-04d0ac81e157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fe1649ed55541508bbcfc1c206144d3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:57.312078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-54eb4bea-2a6b-4ea0-960f-04d0ac81e157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fe1649ed55541508bbcfc1c206144d3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:57.319805 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3935/7857] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:33:57 2022] DELETE /identity/v3/users/5352dddfadd24e93861de98383dfc6b0 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:57.324010 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-54eb4bea-2a6b-4ea0-960f-04d0ac81e157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fe1649ed55541508bbcfc1c206144d3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:57.325008 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-54eb4bea-2a6b-4ea0-960f-04d0ac81e157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fe1649ed55541508bbcfc1c206144d3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:57.341395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8b68b-776e-4f95-b457-044641951133 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:57.341939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8b68b-776e-4f95-b457-044641951133 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:57.342493 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8b68b-776e-4f95-b457-044641951133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:57.374638 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3923/7858] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:33:57 2022] DELETE /identity/v3/users/5fe1649ed55541508bbcfc1c206144d3 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:57.382498 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-2cb8b68b-776e-4f95-b457-044641951133 None None] MFA Rules not processed for user `cb7b150285f24321a9d7971f45fa8369`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:57.383806 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2cb8b68b-776e-4f95-b457-044641951133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:57.388228 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3936/7859] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:57 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 04 01:33:57.393006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c297896-8e71-4e43-b95e-45ad01762345 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:57.393498 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c297896-8e71-4e43-b95e-45ad01762345 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:57.393874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c297896-8e71-4e43-b95e-45ad01762345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:57.398604 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1c297896-8e71-4e43-b95e-45ad01762345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:57.538227 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application [None req-1c297896-8e71-4e43-b95e-45ad01762345 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Sep 04 01:33:57.538227 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:33:57.538227 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:33:57.538227 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:33:57.538227 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:33:57.538227 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:33:57.538227 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:33:57.538227 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:33:57.538227 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:33:57.538227 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:33:57.538227 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:33:57.538227 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:33:57.538227 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Sep 04 01:33:57.538227 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return f(*args, **kwargs) Sep 04 01:33:57.538227 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Sep 04 01:33:57.538227 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Sep 04 01:33:57.540739 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Sep 04 01:33:57.540739 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Sep 04 01:33:57.540739 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Sep 04 01:33:57.540739 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Sep 04 01:33:57.540739 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Sep 04 01:33:57.540739 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Sep 04 01:33:57.540739 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Sep 04 01:33:57.540739 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Sep 04 01:33:57.540739 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:33:57.540739 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:33:57.540739 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Sep 04 01:33:57.540739 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Sep 04 01:33:57.540739 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Sep 04 01:33:57.540739 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application self.check_revocation(token) Sep 04 01:33:57.540739 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:33:57.540739 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:33:57.542354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Sep 04 01:33:57.542354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Sep 04 01:33:57.542354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:33:57.542354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:33:57.542354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Sep 04 01:33:57.542354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Sep 04 01:33:57.542354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:33:57.542354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:33:57.542354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Sep 04 01:33:57.542354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Sep 04 01:33:57.542354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Sep 04 01:33:57.542354 n-d-master-1 devstack@keystone.service[81824]: ERROR keystone.server.flask.application Sep 04 01:33:57.542354 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3924/7860] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:57 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 04 01:33:57.546147 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df006cd0-498a-4453-936f-c0180e9fef03 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:57.546603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df006cd0-498a-4453-936f-c0180e9fef03 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:57.547044 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df006cd0-498a-4453-936f-c0180e9fef03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:57.599468 n-d-master-1 devstack@keystone.service[81825]: WARNING keystone.server.flask.application [None req-df006cd0-498a-4453-936f-c0180e9fef03 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.30: keystone.exception.Unauthorized: The request you have made requires authentication. Sep 04 01:33:57.601497 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3937/7861] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:57 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 57 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Sep 04 01:33:57.608340 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d6121-2c96-48fa-9560-0e544c594afa None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:57.609012 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d6121-2c96-48fa-9560-0e544c594afa None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:57.609392 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d6121-2c96-48fa-9560-0e544c594afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:57.668208 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-7e6d6121-2c96-48fa-9560-0e544c594afa None None] MFA Rules not processed for user `cb7b150285f24321a9d7971f45fa8369`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:57.670213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7e6d6121-2c96-48fa-9560-0e544c594afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:57.685124 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3925/7862] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:57.685373 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df006cd0-498a-4453-936f-c0180e9fef03 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:57.700070 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df006cd0-498a-4453-936f-c0180e9fef03 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:57.704873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc66bc-d7cd-4b5c-abce-6619099778c7 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb7b150285f24321a9d7971f45fa8369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6be4faa951f4b0bbd6027ce916e48b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:57.706216 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc66bc-d7cd-4b5c-abce-6619099778c7 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:57.706216 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc66bc-d7cd-4b5c-abce-6619099778c7 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:57.706216 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc66bc-d7cd-4b5c-abce-6619099778c7 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] PATH_INFO: `/v3/users/cb7b150285f24321a9d7971f45fa8369/password` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:57.761818 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-62fc66bc-d7cd-4b5c-abce-6619099778c7 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cb7b150285f24321a9d7971f45fa8369'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:57.780804 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3938/7863] 10.222.0.30 () {60 vars in 1269 bytes} [Sun Sep 4 01:33:57 2022] POST /identity/v3/users/cb7b150285f24321a9d7971f45fa8369/password => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:57.808685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d6121-2c96-48fa-9560-0e544c594afa None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:57.814521 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7e6d6121-2c96-48fa-9560-0e544c594afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:57.830970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc66bc-d7cd-4b5c-abce-6619099778c7 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:57.833156 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-62fc66bc-d7cd-4b5c-abce-6619099778c7 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:57.933987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc66bc-d7cd-4b5c-abce-6619099778c7 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:57.934352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d6121-2c96-48fa-9560-0e544c594afa None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:57.939583 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ddc84-4bfe-41d2-8f68-1bad7d0bef04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:57.939798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d4ade-94ce-4ce5-b5a2-ef7e8e7c7ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:57.940538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d4ade-94ce-4ce5-b5a2-ef7e8e7c7ddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:57.940686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ddc84-4bfe-41d2-8f68-1bad7d0bef04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:57.940920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d4ade-94ce-4ce5-b5a2-ef7e8e7c7ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:57.941052 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ddc84-4bfe-41d2-8f68-1bad7d0bef04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:57.941306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d4ade-94ce-4ce5-b5a2-ef7e8e7c7ddb admin admin] PATH_INFO: `/v3/projects/893f44e89d5d4fba9d56bb91584266a1` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:57.941448 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ddc84-4bfe-41d2-8f68-1bad7d0bef04 admin admin] PATH_INFO: `/v3/projects/cdefcec88bec49fdbd7f7e34f4aedd01` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:57.942601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d4ade-94ce-4ce5-b5a2-ef7e8e7c7ddb admin admin] RBAC: Authorizing `identity:delete_project(project_id=893f44e89d5d4fba9d56bb91584266a1)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:57.942828 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ddc84-4bfe-41d2-8f68-1bad7d0bef04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdefcec88bec49fdbd7f7e34f4aedd01)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:57.945202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d4ade-94ce-4ce5-b5a2-ef7e8e7c7ddb admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:57.946440 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ddc84-4bfe-41d2-8f68-1bad7d0bef04 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:57.962420 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=83,keystone:DELETE=12,keystone:INSERT=3,keystone:UPDATE=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:57.995145 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:58.020867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e62d4ade-94ce-4ce5-b5a2-ef7e8e7c7ddb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '893f44e89d5d4fba9d56bb91584266a1', 'request_id': 'req-e62d4ade-94ce-4ce5-b5a2-ef7e8e7c7ddb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:58.034530 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e62d4ade-94ce-4ce5-b5a2-ef7e8e7c7ddb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '893f44e89d5d4fba9d56bb91584266a1', 'request_id': 'req-e62d4ade-94ce-4ce5-b5a2-ef7e8e7c7ddb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:58.037788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0c8ddc84-4bfe-41d2-8f68-1bad7d0bef04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdefcec88bec49fdbd7f7e34f4aedd01', 'request_id': 'req-0c8ddc84-4bfe-41d2-8f68-1bad7d0bef04'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:58.047017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e62d4ade-94ce-4ce5-b5a2-ef7e8e7c7ddb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '893f44e89d5d4fba9d56bb91584266a1', 'request_id': 'req-e62d4ade-94ce-4ce5-b5a2-ef7e8e7c7ddb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:58.051045 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0c8ddc84-4bfe-41d2-8f68-1bad7d0bef04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdefcec88bec49fdbd7f7e34f4aedd01', 'request_id': 'req-0c8ddc84-4bfe-41d2-8f68-1bad7d0bef04'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:58.063075 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0c8ddc84-4bfe-41d2-8f68-1bad7d0bef04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdefcec88bec49fdbd7f7e34f4aedd01', 'request_id': 'req-0c8ddc84-4bfe-41d2-8f68-1bad7d0bef04'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:58.070221 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e62d4ade-94ce-4ce5-b5a2-ef7e8e7c7ddb admin admin] The token cache is being invalidate because project 893f44e89d5d4fba9d56bb91584266a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:33:58.070573 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e62d4ade-94ce-4ce5-b5a2-ef7e8e7c7ddb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:58.071901 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e62d4ade-94ce-4ce5-b5a2-ef7e8e7c7ddb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:58.074400 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3926/7864] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:33:57 2022] DELETE /identity/v3/projects/893f44e89d5d4fba9d56bb91584266a1 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:58.102937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0c8ddc84-4bfe-41d2-8f68-1bad7d0bef04 admin admin] The token cache is being invalidate because project cdefcec88bec49fdbd7f7e34f4aedd01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:33:58.103791 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0c8ddc84-4bfe-41d2-8f68-1bad7d0bef04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:58.107536 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0c8ddc84-4bfe-41d2-8f68-1bad7d0bef04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:58.113603 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3939/7865] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:33:57 2022] DELETE /identity/v3/projects/cdefcec88bec49fdbd7f7e34f4aedd01 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:33:58.119511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db05b1a-4218-45e4-b9cc-e8698eb01147 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:58.120178 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db05b1a-4218-45e4-b9cc-e8698eb01147 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:58.120714 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db05b1a-4218-45e4-b9cc-e8698eb01147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:58.156382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-3db05b1a-4218-45e4-b9cc-e8698eb01147 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:58.158108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3db05b1a-4218-45e4-b9cc-e8698eb01147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:58.363925 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3927/7866] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:33:58.376501 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3699bc3-96ef-420e-85dd-7a83ffecf429 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:58.376877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3699bc3-96ef-420e-85dd-7a83ffecf429 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:58.377158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3699bc3-96ef-420e-85dd-7a83ffecf429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:58.414997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-f3699bc3-96ef-420e-85dd-7a83ffecf429 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:58.416246 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f3699bc3-96ef-420e-85dd-7a83ffecf429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:58.466810 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3940/7867] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:58.471359 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db05b1a-4218-45e4-b9cc-e8698eb01147 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:58.491365 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db05b1a-4218-45e4-b9cc-e8698eb01147 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:58.507595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a397147-c633-4be9-829b-320eb5cbc0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:58.508376 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a397147-c633-4be9-829b-320eb5cbc0c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:58.508729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a397147-c633-4be9-829b-320eb5cbc0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:58.509111 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a397147-c633-4be9-829b-320eb5cbc0c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:58.509888 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a397147-c633-4be9-829b-320eb5cbc0c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:33:58.510270 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a397147-c633-4be9-829b-320eb5cbc0c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:58.512564 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a397147-c633-4be9-829b-320eb5cbc0c7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:58.536310 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3928/7868] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:33:58.541403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3699bc3-96ef-420e-85dd-7a83ffecf429 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:58.560262 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3699bc3-96ef-420e-85dd-7a83ffecf429 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:58.565793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0448a00-78ed-4c07-b10a-168d53459f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:58.566775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0448a00-78ed-4c07-b10a-168d53459f10 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:58.567252 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0448a00-78ed-4c07-b10a-168d53459f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:58.567744 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0448a00-78ed-4c07-b10a-168d53459f10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:58.568593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0448a00-78ed-4c07-b10a-168d53459f10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:58.570860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0448a00-78ed-4c07-b10a-168d53459f10 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:58.630872 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3941/7869] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:33:58 2022] POST /identity/v3/projects => generated 367 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:58.634881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a397147-c633-4be9-829b-320eb5cbc0c7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:58.648596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a397147-c633-4be9-829b-320eb5cbc0c7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:58.721792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10eb09-9ce5-4fae-b422-22c26ef6e97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:58.722409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10eb09-9ce5-4fae-b422-22c26ef6e97f admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:58.722690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10eb09-9ce5-4fae-b422-22c26ef6e97f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:58.722962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10eb09-9ce5-4fae-b422-22c26ef6e97f admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:58.723600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10eb09-9ce5-4fae-b422-22c26ef6e97f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:58.725551 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10eb09-9ce5-4fae-b422-22c26ef6e97f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:58.755763 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3929/7870] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:33:58 2022] POST /identity/v3/users => generated 284 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:33:58.760047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0448a00-78ed-4c07-b10a-168d53459f10 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:58.774877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0448a00-78ed-4c07-b10a-168d53459f10 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:58.786475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30702b-91c1-4642-baee-290702b726f3 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:58.786761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30702b-91c1-4642-baee-290702b726f3 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:58.787110 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30702b-91c1-4642-baee-290702b726f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:58.793947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd1775-7ba5-4c6b-a348-e092af5f9c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:58.794600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd1775-7ba5-4c6b-a348-e092af5f9c62 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:58.794880 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd1775-7ba5-4c6b-a348-e092af5f9c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:58.795153 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd1775-7ba5-4c6b-a348-e092af5f9c62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:58.795810 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd1775-7ba5-4c6b-a348-e092af5f9c62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:58.797417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd1775-7ba5-4c6b-a348-e092af5f9c62 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:58.808610 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-4d30702b-91c1-4642-baee-290702b726f3 None None] MFA Rules not processed for user `cb7b150285f24321a9d7971f45fa8369`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:58.809846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4d30702b-91c1-4642-baee-290702b726f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:58.816156 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3930/7871] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:58 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 01:33:58.818115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a24630-4f05-48e3-aae8-928ab87d071b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:58.818469 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a24630-4f05-48e3-aae8-928ab87d071b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:58.818815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a24630-4f05-48e3-aae8-928ab87d071b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:58.822044 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3942/7872] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:33:58.825831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd1775-7ba5-4c6b-a348-e092af5f9c62 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:58.846095 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a3a24630-4f05-48e3-aae8-928ab87d071b None None] MFA Rules not processed for user `cb7b150285f24321a9d7971f45fa8369`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:58.847393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a3a24630-4f05-48e3-aae8-928ab87d071b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:58.849691 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd1775-7ba5-4c6b-a348-e092af5f9c62 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:58.862674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3a3e8-7f5f-422c-b5ff-d9eac2150445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:58.863726 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3a3e8-7f5f-422c-b5ff-d9eac2150445 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:58.865774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3a3e8-7f5f-422c-b5ff-d9eac2150445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:58.866066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3a3e8-7f5f-422c-b5ff-d9eac2150445 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:58.868480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3a3e8-7f5f-422c-b5ff-d9eac2150445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:58.872438 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3a3e8-7f5f-422c-b5ff-d9eac2150445 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:58.872601 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:58.898086 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3943/7873] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:33:58.903120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3a3e8-7f5f-422c-b5ff-d9eac2150445 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:58.926120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3a3e8-7f5f-422c-b5ff-d9eac2150445 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:58.933034 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3931/7874] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:33:58.934143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a24630-4f05-48e3-aae8-928ab87d071b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:58.941406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74856a31-7d22-43a7-9293-a4589317de7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:58.942443 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74856a31-7d22-43a7-9293-a4589317de7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:58.942831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74856a31-7d22-43a7-9293-a4589317de7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:58.943504 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74856a31-7d22-43a7-9293-a4589317de7b admin admin] PATH_INFO: `/v3/projects/8c92b22ce8834190a5e47252774e1b41/users/9d15fe6d957d4a2198204052eb5e5b8f/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:58.951828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a24630-4f05-48e3-aae8-928ab87d071b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:58.963853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a29a0-6690-4de7-8b07-4c7d0b528ba6 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb7b150285f24321a9d7971f45fa8369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6be4faa951f4b0bbd6027ce916e48b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:58.964668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a29a0-6690-4de7-8b07-4c7d0b528ba6 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:58.965613 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a29a0-6690-4de7-8b07-4c7d0b528ba6 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:58.966163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a29a0-6690-4de7-8b07-4c7d0b528ba6 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] PATH_INFO: `/v3/users/cb7b150285f24321a9d7971f45fa8369/password` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:58.976200 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74856a31-7d22-43a7-9293-a4589317de7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c92b22ce8834190a5e47252774e1b41, user_id=9d15fe6d957d4a2198204052eb5e5b8f, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:58.980513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74856a31-7d22-43a7-9293-a4589317de7b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:59.012101 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3944/7875] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:33:58 2022] PUT /identity/v3/projects/8c92b22ce8834190a5e47252774e1b41/users/9d15fe6d957d4a2198204052eb5e5b8f/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:59.022057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc1f41-91d2-4cea-89f6-ce3d6b363c55 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:59.022432 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc1f41-91d2-4cea-89f6-ce3d6b363c55 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:59.022784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc1f41-91d2-4cea-89f6-ce3d6b363c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:59.063281 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c41a29a0-6690-4de7-8b07-4c7d0b528ba6 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cb7b150285f24321a9d7971f45fa8369'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:33:59.078800 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b3bc1f41-91d2-4cea-89f6-ce3d6b363c55 None None] MFA Rules not processed for user `9d15fe6d957d4a2198204052eb5e5b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:59.084560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b3bc1f41-91d2-4cea-89f6-ce3d6b363c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:33:59.097223 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3932/7876] 10.222.0.30 () {60 vars in 1269 bytes} [Sun Sep 4 01:33:58 2022] POST /identity/v3/users/cb7b150285f24321a9d7971f45fa8369/password => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:59.186385 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3945/7877] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:33:59.190781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a29a0-6690-4de7-8b07-4c7d0b528ba6 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:59.227233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a29a0-6690-4de7-8b07-4c7d0b528ba6 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:59.350874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f73dd-1adf-41ae-9bc0-0920ab4d3f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:59.351583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f73dd-1adf-41ae-9bc0-0920ab4d3f92 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:59.352467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f73dd-1adf-41ae-9bc0-0920ab4d3f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:59.353021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f73dd-1adf-41ae-9bc0-0920ab4d3f92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:59.354629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f73dd-1adf-41ae-9bc0-0920ab4d3f92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:59.358376 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f73dd-1adf-41ae-9bc0-0920ab4d3f92 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:59.397867 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3933/7878] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:33:59 2022] POST /identity/v3/projects => generated 367 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:59.402588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc1f41-91d2-4cea-89f6-ce3d6b363c55 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:59.420194 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc1f41-91d2-4cea-89f6-ce3d6b363c55 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:59.453900 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:59.543304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100eb5f-f438-46a0-823f-6d7641ace87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:59.543941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100eb5f-f438-46a0-823f-6d7641ace87b admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:59.544285 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100eb5f-f438-46a0-823f-6d7641ace87b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:59.544566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100eb5f-f438-46a0-823f-6d7641ace87b admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:59.545222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100eb5f-f438-46a0-823f-6d7641ace87b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:59.547443 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100eb5f-f438-46a0-823f-6d7641ace87b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:59.584969 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3946/7879] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:33:59 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:33:59.588848 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f73dd-1adf-41ae-9bc0-0920ab4d3f92 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:59.601022 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f73dd-1adf-41ae-9bc0-0920ab4d3f92 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:59.606145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf97ee4-8c45-45b9-8ed7-91116aa1943c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:59.607030 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf97ee4-8c45-45b9-8ed7-91116aa1943c admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:59.607382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf97ee4-8c45-45b9-8ed7-91116aa1943c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:59.607720 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf97ee4-8c45-45b9-8ed7-91116aa1943c admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:59.608497 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf97ee4-8c45-45b9-8ed7-91116aa1943c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:59.610641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf97ee4-8c45-45b9-8ed7-91116aa1943c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:59.630745 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3934/7880] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:33:59.630973 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100eb5f-f438-46a0-823f-6d7641ace87b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:59.643865 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100eb5f-f438-46a0-823f-6d7641ace87b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:59.649314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707c9cc-08b3-4a00-87b5-c538a9f567f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:59.650142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707c9cc-08b3-4a00-87b5-c538a9f567f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:59.650492 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707c9cc-08b3-4a00-87b5-c538a9f567f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:59.650894 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707c9cc-08b3-4a00-87b5-c538a9f567f5 admin admin] PATH_INFO: `/v3/projects/d728fffdaf8b42458eeb0a1475329d37/users/d4b8b75e67e54aa7a1ee8e21f74f54d5/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:59.674215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9707c9cc-08b3-4a00-87b5-c538a9f567f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d728fffdaf8b42458eeb0a1475329d37, user_id=d4b8b75e67e54aa7a1ee8e21f74f54d5, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:59.677304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9707c9cc-08b3-4a00-87b5-c538a9f567f5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:59.700774 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3947/7881] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:33:59 2022] PUT /identity/v3/projects/d728fffdaf8b42458eeb0a1475329d37/users/d4b8b75e67e54aa7a1ee8e21f74f54d5/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:59.702178 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf97ee4-8c45-45b9-8ed7-91116aa1943c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:59.714308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf97ee4-8c45-45b9-8ed7-91116aa1943c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:59.777039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478cc99-4671-4f98-80b3-97250c43b05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:59.778166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478cc99-4671-4f98-80b3-97250c43b05c admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:59.778640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478cc99-4671-4f98-80b3-97250c43b05c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:59.779080 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478cc99-4671-4f98-80b3-97250c43b05c admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:59.779995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478cc99-4671-4f98-80b3-97250c43b05c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:59.781883 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478cc99-4671-4f98-80b3-97250c43b05c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:59.797968 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3935/7882] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:33:59.799337 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707c9cc-08b3-4a00-87b5-c538a9f567f5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:33:59.811350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707c9cc-08b3-4a00-87b5-c538a9f567f5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:33:59.817700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3b78c-66e1-464d-a91e-dee4072acde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:33:59.818380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3b78c-66e1-464d-a91e-dee4072acde8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:59.818663 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3b78c-66e1-464d-a91e-dee4072acde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:59.818944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3b78c-66e1-464d-a91e-dee4072acde8 admin admin] PATH_INFO: `/v3/projects/d728fffdaf8b42458eeb0a1475329d37/users/d4b8b75e67e54aa7a1ee8e21f74f54d5/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:59.821566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3b78c-66e1-464d-a91e-dee4072acde8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d728fffdaf8b42458eeb0a1475329d37, user_id=d4b8b75e67e54aa7a1ee8e21f74f54d5, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:33:59.824438 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3b78c-66e1-464d-a91e-dee4072acde8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:33:59.836855 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3948/7883] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:33:59 2022] PUT /identity/v3/projects/d728fffdaf8b42458eeb0a1475329d37/users/d4b8b75e67e54aa7a1ee8e21f74f54d5/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:33:59.849230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd980e-cd97-48eb-804b-b88195875237 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:33:59.849567 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd980e-cd97-48eb-804b-b88195875237 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:33:59.850561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd980e-cd97-48eb-804b-b88195875237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:33:59.868398 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:33:59.911162 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-cebd980e-cd97-48eb-804b-b88195875237 None None] MFA Rules not processed for user `d4b8b75e67e54aa7a1ee8e21f74f54d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:33:59.912844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-cebd980e-cd97-48eb-804b-b88195875237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:00.014397 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3936/7884] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:33:59 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:34:00.028027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3b78c-66e1-464d-a91e-dee4072acde8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:00.030402 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a8c3b78c-66e1-464d-a91e-dee4072acde8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:00.103132 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1bb9a-8d53-4309-ad57-44f6754effd8 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:00.103492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1bb9a-8d53-4309-ad57-44f6754effd8 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:00.103677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1bb9a-8d53-4309-ad57-44f6754effd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:00.135766 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3b78c-66e1-464d-a91e-dee4072acde8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:00.141329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-42c1bb9a-8d53-4309-ad57-44f6754effd8 None None] MFA Rules not processed for user `cb7b150285f24321a9d7971f45fa8369`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:00.144125 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-42c1bb9a-8d53-4309-ad57-44f6754effd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:00.148915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3bb7f-4b31-4107-903a-bf3a2023a811 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:00.149836 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3bb7f-4b31-4107-903a-bf3a2023a811 service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:00.150372 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3bb7f-4b31-4107-903a-bf3a2023a811 service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:00.150926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3bb7f-4b31-4107-903a-bf3a2023a811 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:00.154461 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3937/7885] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:00 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 04 01:34:00.158839 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcff0d9-77ab-471d-b7e8-6ab3ec003c95 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:00.159857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcff0d9-77ab-471d-b7e8-6ab3ec003c95 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:00.162996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcff0d9-77ab-471d-b7e8-6ab3ec003c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:00.180937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3bb7f-4b31-4107-903a-bf3a2023a811 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:00.183010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3bb7f-4b31-4107-903a-bf3a2023a811 service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:00.210671 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-cfcff0d9-77ab-471d-b7e8-6ab3ec003c95 None None] MFA Rules not processed for user `cb7b150285f24321a9d7971f45fa8369`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:00.211826 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3949/7886] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:34:00 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:34:00.212730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-cfcff0d9-77ab-471d-b7e8-6ab3ec003c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:00.298694 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3938/7887] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:00.302767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3bb7f-4b31-4107-903a-bf3a2023a811 service cinder] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:00.318799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3bb7f-4b31-4107-903a-bf3a2023a811 service cinder] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:00.325283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70951c5-98e7-4714-b9ac-b7b4b35e7893 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb7b150285f24321a9d7971f45fa8369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6be4faa951f4b0bbd6027ce916e48b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:00.326315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70951c5-98e7-4714-b9ac-b7b4b35e7893 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:00.327059 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70951c5-98e7-4714-b9ac-b7b4b35e7893 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:00.327717 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70951c5-98e7-4714-b9ac-b7b4b35e7893 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] PATH_INFO: `/v3/users/cb7b150285f24321a9d7971f45fa8369/password` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:00.356252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcff0d9-77ab-471d-b7e8-6ab3ec003c95 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:00.380232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcff0d9-77ab-471d-b7e8-6ab3ec003c95 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:00.389176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f95d4d-346c-4e16-8141-71f429a9ee01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:00.391762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f95d4d-346c-4e16-8141-71f429a9ee01 service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:00.393402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f95d4d-346c-4e16-8141-71f429a9ee01 service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:00.395830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f95d4d-346c-4e16-8141-71f429a9ee01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:00.513095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f70951c5-98e7-4714-b9ac-b7b4b35e7893 tempest-IdentityV3UsersTest-120129850 tempest-IdentityV3UsersTest-120129850-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cb7b150285f24321a9d7971f45fa8369'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:00.526847 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f95d4d-346c-4e16-8141-71f429a9ee01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:00.532109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f95d4d-346c-4e16-8141-71f429a9ee01 service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:00.541796 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3950/7888] 10.222.0.30 () {60 vars in 1269 bytes} [Sun Sep 4 01:34:00 2022] POST /identity/v3/users/cb7b150285f24321a9d7971f45fa8369/password => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:34:00.560508 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3939/7889] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:34:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:34:01.547297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b860e5-699f-4a23-8983-6c41aa57dab3 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:01.547842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b860e5-699f-4a23-8983-6c41aa57dab3 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:01.547842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b860e5-699f-4a23-8983-6c41aa57dab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:01.597244 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b2b860e5-699f-4a23-8983-6c41aa57dab3 None None] MFA Rules not processed for user `cb7b150285f24321a9d7971f45fa8369`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:01.603094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b2b860e5-699f-4a23-8983-6c41aa57dab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:01.615993 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3951/7890] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:01 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 04 01:34:02.618306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f3d6c-8710-4e2c-b926-0acdb7b805d4 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:02.619543 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f3d6c-8710-4e2c-b926-0acdb7b805d4 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:02.620140 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f3d6c-8710-4e2c-b926-0acdb7b805d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:02.670645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-002f3d6c-8710-4e2c-b926-0acdb7b805d4 None None] MFA Rules not processed for user `cb7b150285f24321a9d7971f45fa8369`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:02.674336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-002f3d6c-8710-4e2c-b926-0acdb7b805d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:02.691028 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3940/7891] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:02.697477 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b860e5-699f-4a23-8983-6c41aa57dab3 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:02.698927 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b2b860e5-699f-4a23-8983-6c41aa57dab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:02.760644 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:INSERT=7,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:02.832546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b860e5-699f-4a23-8983-6c41aa57dab3 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:02.841474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdd164-0c7f-400e-a3a7-6c97fb7882ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:02.842563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdd164-0c7f-400e-a3a7-6c97fb7882ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:02.843087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdd164-0c7f-400e-a3a7-6c97fb7882ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:02.843580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdd164-0c7f-400e-a3a7-6c97fb7882ae admin admin] PATH_INFO: `/v3/users/cb7b150285f24321a9d7971f45fa8369` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:02.845668 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fdd164-0c7f-400e-a3a7-6c97fb7882ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb7b150285f24321a9d7971f45fa8369)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:02.848747 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fdd164-0c7f-400e-a3a7-6c97fb7882ae admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:02.978798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c8fdd164-0c7f-400e-a3a7-6c97fb7882ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb7b150285f24321a9d7971f45fa8369'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:02.979801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c8fdd164-0c7f-400e-a3a7-6c97fb7882ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb7b150285f24321a9d7971f45fa8369'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:02.990787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c8fdd164-0c7f-400e-a3a7-6c97fb7882ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb7b150285f24321a9d7971f45fa8369'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:03.006598 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c8fdd164-0c7f-400e-a3a7-6c97fb7882ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb7b150285f24321a9d7971f45fa8369'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:03.007528 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c8fdd164-0c7f-400e-a3a7-6c97fb7882ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb7b150285f24321a9d7971f45fa8369'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:03.032261 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3952/7892] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:34:02 2022] DELETE /identity/v3/users/cb7b150285f24321a9d7971f45fa8369 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:03.036347 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b2d4d-7797-4240-a61f-635acadf85e9 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:03.036866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b2d4d-7797-4240-a61f-635acadf85e9 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:03.037422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b2d4d-7797-4240-a61f-635acadf85e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:03.109371 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c01b2d4d-7797-4240-a61f-635acadf85e9 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:03.114197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c01b2d4d-7797-4240-a61f-635acadf85e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:03.151117 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:03.298147 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3941/7893] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:03.350583 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdd164-0c7f-400e-a3a7-6c97fb7882ae admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:03.352550 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c8fdd164-0c7f-400e-a3a7-6c97fb7882ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:03.521896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdd164-0c7f-400e-a3a7-6c97fb7882ae admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:03.526976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abaae4b-e6d6-4c9c-b40f-6199bd825fba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:03.527617 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abaae4b-e6d6-4c9c-b40f-6199bd825fba service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:03.527893 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abaae4b-e6d6-4c9c-b40f-6199bd825fba service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:03.528162 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abaae4b-e6d6-4c9c-b40f-6199bd825fba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:03.562841 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abaae4b-e6d6-4c9c-b40f-6199bd825fba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:03.568986 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abaae4b-e6d6-4c9c-b40f-6199bd825fba service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:03.613458 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3953/7894] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:34:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:34:05.790672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b2d4d-7797-4240-a61f-635acadf85e9 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:05.800039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c01b2d4d-7797-4240-a61f-635acadf85e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:05.827823 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b2d4d-7797-4240-a61f-635acadf85e9 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:05.864579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455beeaa-f174-4819-bf3e-7c947ff54755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:05.865242 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455beeaa-f174-4819-bf3e-7c947ff54755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:05.865550 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455beeaa-f174-4819-bf3e-7c947ff54755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:05.865822 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455beeaa-f174-4819-bf3e-7c947ff54755 admin admin] PATH_INFO: `/v3/projects/a6be4faa951f4b0bbd6027ce916e48b1` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:05.879530 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455beeaa-f174-4819-bf3e-7c947ff54755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6be4faa951f4b0bbd6027ce916e48b1)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:05.883049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455beeaa-f174-4819-bf3e-7c947ff54755 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:06.085690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-455beeaa-f174-4819-bf3e-7c947ff54755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6be4faa951f4b0bbd6027ce916e48b1', 'request_id': 'req-455beeaa-f174-4819-bf3e-7c947ff54755'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:06.105091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-455beeaa-f174-4819-bf3e-7c947ff54755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6be4faa951f4b0bbd6027ce916e48b1', 'request_id': 'req-455beeaa-f174-4819-bf3e-7c947ff54755'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:06.114903 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-455beeaa-f174-4819-bf3e-7c947ff54755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6be4faa951f4b0bbd6027ce916e48b1', 'request_id': 'req-455beeaa-f174-4819-bf3e-7c947ff54755'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:06.137707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-455beeaa-f174-4819-bf3e-7c947ff54755 admin admin] The token cache is being invalidate because project a6be4faa951f4b0bbd6027ce916e48b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:34:06.137707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-455beeaa-f174-4819-bf3e-7c947ff54755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:06.137707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-455beeaa-f174-4819-bf3e-7c947ff54755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:06.137707 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3942/7895] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:34:05 2022] DELETE /identity/v3/projects/a6be4faa951f4b0bbd6027ce916e48b1 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:06.142819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201111c-86b5-4e7f-8082-cc13a503e927 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:06.143315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201111c-86b5-4e7f-8082-cc13a503e927 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:06.143425 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201111c-86b5-4e7f-8082-cc13a503e927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:06.173352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-6201111c-86b5-4e7f-8082-cc13a503e927 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:06.176482 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6201111c-86b5-4e7f-8082-cc13a503e927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:06.276006 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:06.309484 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3954/7896] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:06.313660 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f3a88-5d52-46d6-bf6c-94e811ed9fe7 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:06.313970 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f3a88-5d52-46d6-bf6c-94e811ed9fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:06.314237 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f3a88-5d52-46d6-bf6c-94e811ed9fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:06.353510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a28f3a88-5d52-46d6-bf6c-94e811ed9fe7 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:06.354753 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a28f3a88-5d52-46d6-bf6c-94e811ed9fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:06.377695 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3943/7897] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:06.378978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201111c-86b5-4e7f-8082-cc13a503e927 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:06.399026 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201111c-86b5-4e7f-8082-cc13a503e927 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:06.427800 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3aa02b-46e2-4118-9a4a-7e62a944f2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:06.429857 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3aa02b-46e2-4118-9a4a-7e62a944f2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:06.430398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3aa02b-46e2-4118-9a4a-7e62a944f2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:06.430947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3aa02b-46e2-4118-9a4a-7e62a944f2d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:06.433229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3aa02b-46e2-4118-9a4a-7e62a944f2d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:34:06.433899 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3aa02b-46e2-4118-9a4a-7e62a944f2d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:06.445922 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3aa02b-46e2-4118-9a4a-7e62a944f2d0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:06.480708 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3955/7898] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:34:06.481763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f3a88-5d52-46d6-bf6c-94e811ed9fe7 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:06.494190 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f3a88-5d52-46d6-bf6c-94e811ed9fe7 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:06.500332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58acad4e-597e-45f6-98f3-9a433bc8489a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:06.501105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58acad4e-597e-45f6-98f3-9a433bc8489a admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:06.501480 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58acad4e-597e-45f6-98f3-9a433bc8489a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:06.501845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58acad4e-597e-45f6-98f3-9a433bc8489a admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:06.502618 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58acad4e-597e-45f6-98f3-9a433bc8489a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:06.504748 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58acad4e-597e-45f6-98f3-9a433bc8489a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:06.570135 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3944/7899] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:34:06 2022] POST /identity/v3/projects => generated 387 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:34:06.574352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3aa02b-46e2-4118-9a4a-7e62a944f2d0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:06.599589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3aa02b-46e2-4118-9a4a-7e62a944f2d0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:06.707570 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1cfb00-c7c2-4b5b-a77c-f759894f36e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:06.710858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1cfb00-c7c2-4b5b-a77c-f759894f36e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:06.710858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1cfb00-c7c2-4b5b-a77c-f759894f36e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:06.710858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1cfb00-c7c2-4b5b-a77c-f759894f36e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:06.710858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1cfb00-c7c2-4b5b-a77c-f759894f36e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:06.714201 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1cfb00-c7c2-4b5b-a77c-f759894f36e0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:06.757406 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3956/7900] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:34:06 2022] POST /identity/v3/users => generated 300 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:34:06.759061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58acad4e-597e-45f6-98f3-9a433bc8489a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:06.772020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58acad4e-597e-45f6-98f3-9a433bc8489a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:06.777814 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be56b99-d741-4e04-a653-3b5f7e8beccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:06.779078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be56b99-d741-4e04-a653-3b5f7e8beccf admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:06.779679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be56b99-d741-4e04-a653-3b5f7e8beccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:06.780211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be56b99-d741-4e04-a653-3b5f7e8beccf admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:06.781336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be56b99-d741-4e04-a653-3b5f7e8beccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:06.783324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be56b99-d741-4e04-a653-3b5f7e8beccf admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:06.802702 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3945/7901] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:34:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:34:06.808434 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1cfb00-c7c2-4b5b-a77c-f759894f36e0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:06.827499 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1cfb00-c7c2-4b5b-a77c-f759894f36e0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:06.835419 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7de0d-b710-4d84-993c-7b2a2b26660c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:06.836312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7de0d-b710-4d84-993c-7b2a2b26660c admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:06.836732 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7de0d-b710-4d84-993c-7b2a2b26660c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:06.837103 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7de0d-b710-4d84-993c-7b2a2b26660c admin admin] PATH_INFO: `/v3/projects/26e5ee0bd4c544e0a7b135999697a043/users/cc9f19d0c95a442a9aa67bc947f5b8ec/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:06.861746 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe7de0d-b710-4d84-993c-7b2a2b26660c admin admin] RBAC: Authorizing `identity:create_grant(project_id=26e5ee0bd4c544e0a7b135999697a043, user_id=cc9f19d0c95a442a9aa67bc947f5b8ec, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:06.878262 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe7de0d-b710-4d84-993c-7b2a2b26660c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:06.909475 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3957/7902] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:34:06 2022] PUT /identity/v3/projects/26e5ee0bd4c544e0a7b135999697a043/users/cc9f19d0c95a442a9aa67bc947f5b8ec/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:06.913406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be56b99-d741-4e04-a653-3b5f7e8beccf admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:06.926517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be56b99-d741-4e04-a653-3b5f7e8beccf admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:07.063133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee19cf-3166-42f9-9729-a610accad3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:07.063759 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee19cf-3166-42f9-9729-a610accad3ff admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:07.064029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee19cf-3166-42f9-9729-a610accad3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:07.065092 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee19cf-3166-42f9-9729-a610accad3ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:07.065782 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee19cf-3166-42f9-9729-a610accad3ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:07.067446 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee19cf-3166-42f9-9729-a610accad3ff admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:07.081229 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:07.091896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7de0d-b710-4d84-993c-7b2a2b26660c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:07.097626 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3946/7903] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:34:06 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:34:07.120102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7de0d-b710-4d84-993c-7b2a2b26660c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:07.126147 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1d035-4324-4670-9973-296a050e9939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:07.127098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1d035-4324-4670-9973-296a050e9939 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:07.127450 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1d035-4324-4670-9973-296a050e9939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:07.127931 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1d035-4324-4670-9973-296a050e9939 admin admin] PATH_INFO: `/v3/projects/26e5ee0bd4c544e0a7b135999697a043/users/cc9f19d0c95a442a9aa67bc947f5b8ec/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:07.130120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1d035-4324-4670-9973-296a050e9939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26e5ee0bd4c544e0a7b135999697a043, user_id=cc9f19d0c95a442a9aa67bc947f5b8ec, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:07.133514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1d035-4324-4670-9973-296a050e9939 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:07.150538 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3958/7904] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:34:07 2022] PUT /identity/v3/projects/26e5ee0bd4c544e0a7b135999697a043/users/cc9f19d0c95a442a9aa67bc947f5b8ec/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:07.161714 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b32fa2-8341-4e65-8d2f-8c4d0e196238 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:07.162411 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b32fa2-8341-4e65-8d2f-8c4d0e196238 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:07.162861 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b32fa2-8341-4e65-8d2f-8c4d0e196238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:07.202127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-48b32fa2-8341-4e65-8d2f-8c4d0e196238 None None] MFA Rules not processed for user `cc9f19d0c95a442a9aa67bc947f5b8ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:07.206485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-48b32fa2-8341-4e65-8d2f-8c4d0e196238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:07.355231 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3947/7905] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:07 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:07.356150 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1d035-4324-4670-9973-296a050e9939 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:07.475785 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1d035-4324-4670-9973-296a050e9939 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:07.484246 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3957ab-72ad-404a-ae6a-277f44580273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:07.485569 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3957ab-72ad-404a-ae6a-277f44580273 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:07.485920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3957ab-72ad-404a-ae6a-277f44580273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:07.486245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3957ab-72ad-404a-ae6a-277f44580273 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:07.487283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3957ab-72ad-404a-ae6a-277f44580273 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:07.489888 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3957ab-72ad-404a-ae6a-277f44580273 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:07.545520 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3959/7906] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:34:07 2022] POST /identity/v3/projects => generated 385 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:34:07.548602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b32fa2-8341-4e65-8d2f-8c4d0e196238 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:07.565884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b32fa2-8341-4e65-8d2f-8c4d0e196238 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:07.736366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b0dd4-6fee-4c3a-b58a-f3d8dd1f4894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:07.737384 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b0dd4-6fee-4c3a-b58a-f3d8dd1f4894 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:07.737697 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b0dd4-6fee-4c3a-b58a-f3d8dd1f4894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:07.737975 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b0dd4-6fee-4c3a-b58a-f3d8dd1f4894 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:07.742675 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b0dd4-6fee-4c3a-b58a-f3d8dd1f4894 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:07.746051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b0dd4-6fee-4c3a-b58a-f3d8dd1f4894 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:07.800831 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3948/7907] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:34:07 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:34:07.805383 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3957ab-72ad-404a-ae6a-277f44580273 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:07.822418 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3957ab-72ad-404a-ae6a-277f44580273 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:07.827514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d1284-0085-4de9-8d40-2951fb508ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:07.828349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d1284-0085-4de9-8d40-2951fb508ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:07.828804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d1284-0085-4de9-8d40-2951fb508ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:07.829251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d1284-0085-4de9-8d40-2951fb508ce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:07.830082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d1284-0085-4de9-8d40-2951fb508ce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:07.831908 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d1284-0085-4de9-8d40-2951fb508ce1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:07.849786 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3960/7908] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:34:07.850116 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b0dd4-6fee-4c3a-b58a-f3d8dd1f4894 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:07.871458 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b0dd4-6fee-4c3a-b58a-f3d8dd1f4894 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:07.890079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a666b8-4247-4717-96c3-22d766658392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:07.892301 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a666b8-4247-4717-96c3-22d766658392 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:07.893346 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a666b8-4247-4717-96c3-22d766658392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:07.894516 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a666b8-4247-4717-96c3-22d766658392 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:07.899042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a666b8-4247-4717-96c3-22d766658392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:07.903378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a666b8-4247-4717-96c3-22d766658392 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:07.936922 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3949/7909] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:34:07.938112 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d1284-0085-4de9-8d40-2951fb508ce1 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:07.947491 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:07.954593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d1284-0085-4de9-8d40-2951fb508ce1 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:07.971337 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1801ea-466d-4874-a5a8-0257f87c8041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:07.972357 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1801ea-466d-4874-a5a8-0257f87c8041 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:07.972882 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1801ea-466d-4874-a5a8-0257f87c8041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:07.973463 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1801ea-466d-4874-a5a8-0257f87c8041 admin admin] PATH_INFO: `/v3/projects/9d9e194f298a429ca97766d84710c7ea/users/53cd6a2c93e14672b52f0c9c52e70ae5/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:08.001544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1801ea-466d-4874-a5a8-0257f87c8041 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d9e194f298a429ca97766d84710c7ea, user_id=53cd6a2c93e14672b52f0c9c52e70ae5, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:08.006264 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1801ea-466d-4874-a5a8-0257f87c8041 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:08.029081 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3961/7910] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:34:07 2022] PUT /identity/v3/projects/9d9e194f298a429ca97766d84710c7ea/users/53cd6a2c93e14672b52f0c9c52e70ae5/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:08.039314 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308b169-870a-4ce1-b6a9-48cc314f8143 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:08.040050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308b169-870a-4ce1-b6a9-48cc314f8143 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:08.040541 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308b169-870a-4ce1-b6a9-48cc314f8143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:08.116456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-f308b169-870a-4ce1-b6a9-48cc314f8143 None None] MFA Rules not processed for user `53cd6a2c93e14672b52f0c9c52e70ae5`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:08.120854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f308b169-870a-4ce1-b6a9-48cc314f8143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:08.265571 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:08.302693 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3950/7911] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:08.307023 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1801ea-466d-4874-a5a8-0257f87c8041 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:08.309263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-fb1801ea-466d-4874-a5a8-0257f87c8041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:08.527359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1801ea-466d-4874-a5a8-0257f87c8041 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:08.531579 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc9047-fe07-4dee-8dbe-4f813db418d2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efcee9b21ea94b1b8e5c9c5acb35839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:08.532263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc9047-fe07-4dee-8dbe-4f813db418d2 service glance] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:08.532604 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc9047-fe07-4dee-8dbe-4f813db418d2 service glance] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:08.532939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc9047-fe07-4dee-8dbe-4f813db418d2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:08.641893 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc9047-fe07-4dee-8dbe-4f813db418d2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:08.645082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc9047-fe07-4dee-8dbe-4f813db418d2 service glance] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:08.683572 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3962/7912] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:34:08 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:34:09.392859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308b169-870a-4ce1-b6a9-48cc314f8143 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:09.394621 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f308b169-870a-4ce1-b6a9-48cc314f8143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:09.594129 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308b169-870a-4ce1-b6a9-48cc314f8143 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:09.609707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3594c-97b2-43af-ae0e-1e12d083a91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:09.611472 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3594c-97b2-43af-ae0e-1e12d083a91c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:09.612620 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3594c-97b2-43af-ae0e-1e12d083a91c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:09.612907 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3594c-97b2-43af-ae0e-1e12d083a91c admin admin] PATH_INFO: `/v3/users/2ea30e165a2845d6b9e5e8a8e9dd4c61` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:09.616416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3594c-97b2-43af-ae0e-1e12d083a91c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ea30e165a2845d6b9e5e8a8e9dd4c61)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:09.620928 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3594c-97b2-43af-ae0e-1e12d083a91c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:09.792747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-89c3594c-97b2-43af-ae0e-1e12d083a91c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ea30e165a2845d6b9e5e8a8e9dd4c61'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:09.793949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-89c3594c-97b2-43af-ae0e-1e12d083a91c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ea30e165a2845d6b9e5e8a8e9dd4c61'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:09.825461 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-89c3594c-97b2-43af-ae0e-1e12d083a91c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ea30e165a2845d6b9e5e8a8e9dd4c61'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:09.855205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-89c3594c-97b2-43af-ae0e-1e12d083a91c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ea30e165a2845d6b9e5e8a8e9dd4c61'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:09.856074 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-89c3594c-97b2-43af-ae0e-1e12d083a91c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ea30e165a2845d6b9e5e8a8e9dd4c61'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:09.907022 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc9047-fe07-4dee-8dbe-4f813db418d2 service glance] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:09.925114 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3951/7913] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:34:09 2022] DELETE /identity/v3/users/2ea30e165a2845d6b9e5e8a8e9dd4c61 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:09.930438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd5880-7f7d-4b35-b853-698acc9eab79 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:09.934688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd5880-7f7d-4b35-b853-698acc9eab79 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:09.935226 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd5880-7f7d-4b35-b853-698acc9eab79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:09.939654 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc9047-fe07-4dee-8dbe-4f813db418d2 service glance] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:09.985943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-dacd5880-7f7d-4b35-b853-698acc9eab79 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:09.987374 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-dacd5880-7f7d-4b35-b853-698acc9eab79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:10.046233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318c91d-d2d5-4a13-a223-04de55a3ea9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:10.047641 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318c91d-d2d5-4a13-a223-04de55a3ea9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:10.048087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318c91d-d2d5-4a13-a223-04de55a3ea9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:10.048536 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318c91d-d2d5-4a13-a223-04de55a3ea9c admin admin] PATH_INFO: `/v3/users/cc9f19d0c95a442a9aa67bc947f5b8ec` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:10.050561 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318c91d-d2d5-4a13-a223-04de55a3ea9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc9f19d0c95a442a9aa67bc947f5b8ec)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:10.052975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318c91d-d2d5-4a13-a223-04de55a3ea9c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:10.091416 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:10.127948 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3952/7914] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:10.151352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0318c91d-d2d5-4a13-a223-04de55a3ea9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc9f19d0c95a442a9aa67bc947f5b8ec'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:10.152897 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0318c91d-d2d5-4a13-a223-04de55a3ea9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc9f19d0c95a442a9aa67bc947f5b8ec'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:10.162286 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd5880-7f7d-4b35-b853-698acc9eab79 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:10.164434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-dacd5880-7f7d-4b35-b853-698acc9eab79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:10.174292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0318c91d-d2d5-4a13-a223-04de55a3ea9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc9f19d0c95a442a9aa67bc947f5b8ec'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:10.198184 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0318c91d-d2d5-4a13-a223-04de55a3ea9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc9f19d0c95a442a9aa67bc947f5b8ec'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:10.199382 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0318c91d-d2d5-4a13-a223-04de55a3ea9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc9f19d0c95a442a9aa67bc947f5b8ec'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:10.203657 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:10.258312 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3963/7915] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:34:09 2022] DELETE /identity/v3/users/cc9f19d0c95a442a9aa67bc947f5b8ec => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:10.263347 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdc10b-5955-424a-b766-e1e29b3927b1 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:10.263953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdc10b-5955-424a-b766-e1e29b3927b1 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:10.264443 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdc10b-5955-424a-b766-e1e29b3927b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:10.319281 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-0afdc10b-5955-424a-b766-e1e29b3927b1 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:10.324978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0afdc10b-5955-424a-b766-e1e29b3927b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:10.342069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd5880-7f7d-4b35-b853-698acc9eab79 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:10.462762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f3c57-3b94-4490-bafa-15ecd5e0f318 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:10.466434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f3c57-3b94-4490-bafa-15ecd5e0f318 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:10.466434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f3c57-3b94-4490-bafa-15ecd5e0f318 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:10.466713 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f3c57-3b94-4490-bafa-15ecd5e0f318 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:10.472811 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-461f3c57-3b94-4490-bafa-15ecd5e0f318 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:10.488245 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3964/7916] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:34:10.499079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f3c57-3b94-4490-bafa-15ecd5e0f318 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:10.500656 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f3c57-3b94-4490-bafa-15ecd5e0f318 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:10.514842 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3953/7917] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:34:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:34:10.520658 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdc10b-5955-424a-b766-e1e29b3927b1 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:10.523835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0afdc10b-5955-424a-b766-e1e29b3927b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:10.552893 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdc10b-5955-424a-b766-e1e29b3927b1 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:10.579506 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29789b2-5fae-408d-a85c-43abcc50567f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:10.583771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29789b2-5fae-408d-a85c-43abcc50567f service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:10.583771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29789b2-5fae-408d-a85c-43abcc50567f service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:10.583771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29789b2-5fae-408d-a85c-43abcc50567f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:10.613053 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29789b2-5fae-408d-a85c-43abcc50567f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:10.620775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29789b2-5fae-408d-a85c-43abcc50567f service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:10.649397 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3965/7918] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:34:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:34:10.719413 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f3c57-3b94-4490-bafa-15ecd5e0f318 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:10.721313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-461f3c57-3b94-4490-bafa-15ecd5e0f318 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:10.748941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f3c57-3b94-4490-bafa-15ecd5e0f318 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:10.767365 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47724c07-272d-4461-ac6c-a86a8a1f2fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:10.768031 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47724c07-272d-4461-ac6c-a86a8a1f2fa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:10.768305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47724c07-272d-4461-ac6c-a86a8a1f2fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:10.768572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47724c07-272d-4461-ac6c-a86a8a1f2fa7 admin admin] PATH_INFO: `/v3/users/dfa9ddef7fa54d079b2199d79eea3183` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:10.776121 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47724c07-272d-4461-ac6c-a86a8a1f2fa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfa9ddef7fa54d079b2199d79eea3183)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:10.778150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47724c07-272d-4461-ac6c-a86a8a1f2fa7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:10.900334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-47724c07-272d-4461-ac6c-a86a8a1f2fa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfa9ddef7fa54d079b2199d79eea3183'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:10.901858 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-47724c07-272d-4461-ac6c-a86a8a1f2fa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfa9ddef7fa54d079b2199d79eea3183'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:10.918814 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-47724c07-272d-4461-ac6c-a86a8a1f2fa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfa9ddef7fa54d079b2199d79eea3183'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:10.932322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-47724c07-272d-4461-ac6c-a86a8a1f2fa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfa9ddef7fa54d079b2199d79eea3183'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:10.934236 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-47724c07-272d-4461-ac6c-a86a8a1f2fa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfa9ddef7fa54d079b2199d79eea3183'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:10.981181 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3954/7919] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:34:10 2022] DELETE /identity/v3/users/dfa9ddef7fa54d079b2199d79eea3183 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:10.986263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449c9e9-c7f3-4d5a-bc6c-9635d84ef71a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:10.987266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449c9e9-c7f3-4d5a-bc6c-9635d84ef71a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:10.987922 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449c9e9-c7f3-4d5a-bc6c-9635d84ef71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:11.038677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b449c9e9-c7f3-4d5a-bc6c-9635d84ef71a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:11.043648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b449c9e9-c7f3-4d5a-bc6c-9635d84ef71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:11.248473 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3966/7920] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:11.269769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47724c07-272d-4461-ac6c-a86a8a1f2fa7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:11.271995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-47724c07-272d-4461-ac6c-a86a8a1f2fa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:11.287204 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449c9e9-c7f3-4d5a-bc6c-9635d84ef71a None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:11.290430 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b449c9e9-c7f3-4d5a-bc6c-9635d84ef71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:11.328081 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449c9e9-c7f3-4d5a-bc6c-9635d84ef71a None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:11.356300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7334a-0075-4180-85a3-ae1369ca5ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:11.362782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7334a-0075-4180-85a3-ae1369ca5ccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:11.363125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7334a-0075-4180-85a3-ae1369ca5ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:11.363409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7334a-0075-4180-85a3-ae1369ca5ccc admin admin] PATH_INFO: `/v3/projects/1d3c5cd8b39049a990b6b56a16b80996` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:11.369197 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7334a-0075-4180-85a3-ae1369ca5ccc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d3c5cd8b39049a990b6b56a16b80996)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:11.374003 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7334a-0075-4180-85a3-ae1369ca5ccc admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:11.452152 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:11.473748 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:11.497428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47724c07-272d-4461-ac6c-a86a8a1f2fa7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:11.533296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-08f7334a-0075-4180-85a3-ae1369ca5ccc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d3c5cd8b39049a990b6b56a16b80996', 'request_id': 'req-08f7334a-0075-4180-85a3-ae1369ca5ccc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:11.551532 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-08f7334a-0075-4180-85a3-ae1369ca5ccc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d3c5cd8b39049a990b6b56a16b80996', 'request_id': 'req-08f7334a-0075-4180-85a3-ae1369ca5ccc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:11.559944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-08f7334a-0075-4180-85a3-ae1369ca5ccc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d3c5cd8b39049a990b6b56a16b80996', 'request_id': 'req-08f7334a-0075-4180-85a3-ae1369ca5ccc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:11.577179 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-08f7334a-0075-4180-85a3-ae1369ca5ccc admin admin] The token cache is being invalidate because project 1d3c5cd8b39049a990b6b56a16b80996 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:34:11.577484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-08f7334a-0075-4180-85a3-ae1369ca5ccc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:11.578348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-08f7334a-0075-4180-85a3-ae1369ca5ccc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:11.580871 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3967/7921] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:34:11 2022] DELETE /identity/v3/projects/1d3c5cd8b39049a990b6b56a16b80996 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:11.581964 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7334a-0075-4180-85a3-ae1369ca5ccc admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:11.584285 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-08f7334a-0075-4180-85a3-ae1369ca5ccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:11.607699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b3c06-92c9-4cf3-8127-87f2bec44a41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:11.608538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b3c06-92c9-4cf3-8127-87f2bec44a41 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:11.608929 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b3c06-92c9-4cf3-8127-87f2bec44a41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:11.610501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b3c06-92c9-4cf3-8127-87f2bec44a41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:11.614820 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3e0b3c06-92c9-4cf3-8127-87f2bec44a41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:11.810745 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7334a-0075-4180-85a3-ae1369ca5ccc admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:11.824844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8243f7b-ca19-49c3-b971-e92669dfd205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:11.826587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8243f7b-ca19-49c3-b971-e92669dfd205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:11.827668 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8243f7b-ca19-49c3-b971-e92669dfd205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:11.827939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8243f7b-ca19-49c3-b971-e92669dfd205 admin admin] PATH_INFO: `/v3/projects/26e5ee0bd4c544e0a7b135999697a043` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:11.831811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8243f7b-ca19-49c3-b971-e92669dfd205 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26e5ee0bd4c544e0a7b135999697a043)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:11.835482 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8243f7b-ca19-49c3-b971-e92669dfd205 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:11.862128 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b3c06-92c9-4cf3-8127-87f2bec44a41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:11.866214 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b3c06-92c9-4cf3-8127-87f2bec44a41 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:11.906723 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3955/7922] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:34:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:34:11.908701 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff9387-e646-4a73-9e95-b0390f43e621 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:11.910805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff9387-e646-4a73-9e95-b0390f43e621 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:11.911207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff9387-e646-4a73-9e95-b0390f43e621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:11.957342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a8243f7b-ca19-49c3-b971-e92669dfd205 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26e5ee0bd4c544e0a7b135999697a043', 'request_id': 'req-a8243f7b-ca19-49c3-b971-e92669dfd205'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:11.962424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-25ff9387-e646-4a73-9e95-b0390f43e621 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:11.968130 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-25ff9387-e646-4a73-9e95-b0390f43e621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:11.973323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a8243f7b-ca19-49c3-b971-e92669dfd205 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26e5ee0bd4c544e0a7b135999697a043', 'request_id': 'req-a8243f7b-ca19-49c3-b971-e92669dfd205'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:11.983944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a8243f7b-ca19-49c3-b971-e92669dfd205 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26e5ee0bd4c544e0a7b135999697a043', 'request_id': 'req-a8243f7b-ca19-49c3-b971-e92669dfd205'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:11.999051 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a8243f7b-ca19-49c3-b971-e92669dfd205 admin admin] The token cache is being invalidate because project 26e5ee0bd4c544e0a7b135999697a043 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:34:11.999798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a8243f7b-ca19-49c3-b971-e92669dfd205 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:11.999993 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a8243f7b-ca19-49c3-b971-e92669dfd205 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:12.001758 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3968/7923] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:34:11 2022] DELETE /identity/v3/projects/26e5ee0bd4c544e0a7b135999697a043 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:12.006694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8243f7b-ca19-49c3-b971-e92669dfd205 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:12.008222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a8243f7b-ca19-49c3-b971-e92669dfd205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:12.076796 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:12.111541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8243f7b-ca19-49c3-b971-e92669dfd205 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:12.118247 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc83b22-1a59-4d0e-a75d-662bcbff467f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:12.118923 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc83b22-1a59-4d0e-a75d-662bcbff467f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:12.119206 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc83b22-1a59-4d0e-a75d-662bcbff467f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:12.119486 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc83b22-1a59-4d0e-a75d-662bcbff467f admin admin] PATH_INFO: `/v3/users/9d15fe6d957d4a2198204052eb5e5b8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:12.120678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc83b22-1a59-4d0e-a75d-662bcbff467f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d15fe6d957d4a2198204052eb5e5b8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:12.122953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc83b22-1a59-4d0e-a75d-662bcbff467f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:12.142565 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3956/7924] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:12.143839 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff9387-e646-4a73-9e95-b0390f43e621 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:12.145708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-25ff9387-e646-4a73-9e95-b0390f43e621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:12.165131 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff9387-e646-4a73-9e95-b0390f43e621 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:12.174337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85443914-995a-46d9-be95-44662847298d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:12.175296 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85443914-995a-46d9-be95-44662847298d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:12.176044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85443914-995a-46d9-be95-44662847298d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:12.176489 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85443914-995a-46d9-be95-44662847298d admin admin] PATH_INFO: `/v3/users/53cd6a2c93e14672b52f0c9c52e70ae5` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:12.178624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85443914-995a-46d9-be95-44662847298d admin admin] RBAC: Authorizing `identity:delete_user(user_id=53cd6a2c93e14672b52f0c9c52e70ae5)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:12.181506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85443914-995a-46d9-be95-44662847298d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:12.237373 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2fc83b22-1a59-4d0e-a75d-662bcbff467f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d15fe6d957d4a2198204052eb5e5b8f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:12.238687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2fc83b22-1a59-4d0e-a75d-662bcbff467f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d15fe6d957d4a2198204052eb5e5b8f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:12.256412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2fc83b22-1a59-4d0e-a75d-662bcbff467f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d15fe6d957d4a2198204052eb5e5b8f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:12.282935 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:12.286162 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2fc83b22-1a59-4d0e-a75d-662bcbff467f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d15fe6d957d4a2198204052eb5e5b8f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:12.287845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2fc83b22-1a59-4d0e-a75d-662bcbff467f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d15fe6d957d4a2198204052eb5e5b8f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:12.294468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-85443914-995a-46d9-be95-44662847298d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53cd6a2c93e14672b52f0c9c52e70ae5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:12.298691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-85443914-995a-46d9-be95-44662847298d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53cd6a2c93e14672b52f0c9c52e70ae5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:12.321612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-85443914-995a-46d9-be95-44662847298d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53cd6a2c93e14672b52f0c9c52e70ae5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:12.331726 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3969/7925] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:34:12 2022] DELETE /identity/v3/users/9d15fe6d957d4a2198204052eb5e5b8f => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:12.333812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5498e5-952d-4065-9e55-0861bc880299 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:12.334489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5498e5-952d-4065-9e55-0861bc880299 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:12.335234 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5498e5-952d-4065-9e55-0861bc880299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:12.336015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-85443914-995a-46d9-be95-44662847298d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53cd6a2c93e14672b52f0c9c52e70ae5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:12.336764 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-85443914-995a-46d9-be95-44662847298d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53cd6a2c93e14672b52f0c9c52e70ae5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:12.373403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-2d5498e5-952d-4065-9e55-0861bc880299 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:12.375093 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2d5498e5-952d-4065-9e55-0861bc880299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:12.390498 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3957/7926] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:34:12 2022] DELETE /identity/v3/users/53cd6a2c93e14672b52f0c9c52e70ae5 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:12.396592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5cc314-d572-4c69-b988-090090eb29d1 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:12.396922 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5cc314-d572-4c69-b988-090090eb29d1 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:12.397338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5cc314-d572-4c69-b988-090090eb29d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:12.441467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-2b5cc314-d572-4c69-b988-090090eb29d1 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:12.442704 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2b5cc314-d572-4c69-b988-090090eb29d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:12.496752 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3970/7927] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:12.497392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5498e5-952d-4065-9e55-0861bc880299 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:12.502786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2d5498e5-952d-4065-9e55-0861bc880299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:12.531108 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5498e5-952d-4065-9e55-0861bc880299 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:12.588588 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3958/7928] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:12.590196 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5cc314-d572-4c69-b988-090090eb29d1 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:12.608797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5cc314-d572-4c69-b988-090090eb29d1 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:12.617806 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3890046-c76f-4564-a6c1-b38656e777c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:12.619346 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3890046-c76f-4564-a6c1-b38656e777c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:12.622188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3890046-c76f-4564-a6c1-b38656e777c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:12.623147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3890046-c76f-4564-a6c1-b38656e777c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:12.624081 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3890046-c76f-4564-a6c1-b38656e777c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:34:12.624798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3890046-c76f-4564-a6c1-b38656e777c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:12.627026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3890046-c76f-4564-a6c1-b38656e777c5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:12.643557 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3959/7929] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:34:12.644937 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3890046-c76f-4564-a6c1-b38656e777c5 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:12.649878 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b3890046-c76f-4564-a6c1-b38656e777c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:12.666491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17689607-ceb5-41c0-800b-1965e1cca56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:12.668153 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17689607-ceb5-41c0-800b-1965e1cca56f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:12.669661 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17689607-ceb5-41c0-800b-1965e1cca56f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:12.669661 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17689607-ceb5-41c0-800b-1965e1cca56f admin admin] PATH_INFO: `/v3/projects/abfc3f66b7bb4d31a2f6e4a308da0bc0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:12.671156 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17689607-ceb5-41c0-800b-1965e1cca56f admin admin] RBAC: Authorizing `identity:delete_project(project_id=abfc3f66b7bb4d31a2f6e4a308da0bc0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:12.676321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17689607-ceb5-41c0-800b-1965e1cca56f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:12.698230 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:12.761842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3890046-c76f-4564-a6c1-b38656e777c5 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:12.767039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43793e55-aabd-4968-9bce-d8fbb54fd581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:12.767678 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43793e55-aabd-4968-9bce-d8fbb54fd581 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:12.767956 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43793e55-aabd-4968-9bce-d8fbb54fd581 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:12.768228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43793e55-aabd-4968-9bce-d8fbb54fd581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:12.811436 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43793e55-aabd-4968-9bce-d8fbb54fd581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:12.813174 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43793e55-aabd-4968-9bce-d8fbb54fd581 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:12.831203 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3960/7930] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:34:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:34:12.832234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43793e55-aabd-4968-9bce-d8fbb54fd581 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:12.844117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43793e55-aabd-4968-9bce-d8fbb54fd581 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:12.846997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-17689607-ceb5-41c0-800b-1965e1cca56f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abfc3f66b7bb4d31a2f6e4a308da0bc0', 'request_id': 'req-17689607-ceb5-41c0-800b-1965e1cca56f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:12.865886 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-17689607-ceb5-41c0-800b-1965e1cca56f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abfc3f66b7bb4d31a2f6e4a308da0bc0', 'request_id': 'req-17689607-ceb5-41c0-800b-1965e1cca56f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:12.877000 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-17689607-ceb5-41c0-800b-1965e1cca56f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abfc3f66b7bb4d31a2f6e4a308da0bc0', 'request_id': 'req-17689607-ceb5-41c0-800b-1965e1cca56f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:12.904656 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-17689607-ceb5-41c0-800b-1965e1cca56f admin admin] The token cache is being invalidate because project abfc3f66b7bb4d31a2f6e4a308da0bc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:34:12.905005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-17689607-ceb5-41c0-800b-1965e1cca56f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:12.907072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-17689607-ceb5-41c0-800b-1965e1cca56f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:12.910106 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3971/7931] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:34:12 2022] DELETE /identity/v3/projects/abfc3f66b7bb4d31a2f6e4a308da0bc0 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:12.914990 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17689607-ceb5-41c0-800b-1965e1cca56f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:12.919490 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-17689607-ceb5-41c0-800b-1965e1cca56f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:12.971768 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:12.988230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3242071-37ef-4ddd-aec4-c43693642d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:12.989543 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3242071-37ef-4ddd-aec4-c43693642d66 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:12.989543 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3242071-37ef-4ddd-aec4-c43693642d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:12.989777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3242071-37ef-4ddd-aec4-c43693642d66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:12.990325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3242071-37ef-4ddd-aec4-c43693642d66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:12.993686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3242071-37ef-4ddd-aec4-c43693642d66 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:13.030021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17689607-ceb5-41c0-800b-1965e1cca56f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:13.035289 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3961/7932] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:34:12 2022] POST /identity/v3/projects => generated 359 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:34:13.035289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3242071-37ef-4ddd-aec4-c43693642d66 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:13.037670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e3242071-37ef-4ddd-aec4-c43693642d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:13.123455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8f6c0-0b76-4105-b8f0-a25ecd65164e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:13.124304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8f6c0-0b76-4105-b8f0-a25ecd65164e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:13.124659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8f6c0-0b76-4105-b8f0-a25ecd65164e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:13.125182 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8f6c0-0b76-4105-b8f0-a25ecd65164e admin admin] PATH_INFO: `/v3/projects/9d9e194f298a429ca97766d84710c7ea` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:13.126508 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8f6c0-0b76-4105-b8f0-a25ecd65164e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d9e194f298a429ca97766d84710c7ea)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:13.128609 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8f6c0-0b76-4105-b8f0-a25ecd65164e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:13.157228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3242071-37ef-4ddd-aec4-c43693642d66 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:13.163879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1686906b-f2e0-4f7a-9a2c-049bfa92e598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:13.165110 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686906b-f2e0-4f7a-9a2c-049bfa92e598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:13.165619 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686906b-f2e0-4f7a-9a2c-049bfa92e598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:13.166123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686906b-f2e0-4f7a-9a2c-049bfa92e598 admin admin] PATH_INFO: `/v3/users/8d55c1e3205f40949ad95dd81f78ab6f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:13.168060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1686906b-f2e0-4f7a-9a2c-049bfa92e598 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d55c1e3205f40949ad95dd81f78ab6f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:13.171846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1686906b-f2e0-4f7a-9a2c-049bfa92e598 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:13.191315 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:13.208590 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0bd8f6c0-0b76-4105-b8f0-a25ecd65164e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d9e194f298a429ca97766d84710c7ea', 'request_id': 'req-0bd8f6c0-0b76-4105-b8f0-a25ecd65164e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:13.223856 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0bd8f6c0-0b76-4105-b8f0-a25ecd65164e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d9e194f298a429ca97766d84710c7ea', 'request_id': 'req-0bd8f6c0-0b76-4105-b8f0-a25ecd65164e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:13.239858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0bd8f6c0-0b76-4105-b8f0-a25ecd65164e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d9e194f298a429ca97766d84710c7ea', 'request_id': 'req-0bd8f6c0-0b76-4105-b8f0-a25ecd65164e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:13.263709 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0bd8f6c0-0b76-4105-b8f0-a25ecd65164e admin admin] The token cache is being invalidate because project 9d9e194f298a429ca97766d84710c7ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:34:13.264078 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0bd8f6c0-0b76-4105-b8f0-a25ecd65164e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:13.264970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0bd8f6c0-0b76-4105-b8f0-a25ecd65164e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:13.267017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1686906b-f2e0-4f7a-9a2c-049bfa92e598 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d55c1e3205f40949ad95dd81f78ab6f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:13.267856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1686906b-f2e0-4f7a-9a2c-049bfa92e598 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d55c1e3205f40949ad95dd81f78ab6f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:13.268260 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3972/7933] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:34:12 2022] DELETE /identity/v3/projects/9d9e194f298a429ca97766d84710c7ea => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:13.270086 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8f6c0-0b76-4105-b8f0-a25ecd65164e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:13.274003 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0bd8f6c0-0b76-4105-b8f0-a25ecd65164e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:13.286248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1686906b-f2e0-4f7a-9a2c-049bfa92e598 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d55c1e3205f40949ad95dd81f78ab6f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:13.303525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1686906b-f2e0-4f7a-9a2c-049bfa92e598 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d55c1e3205f40949ad95dd81f78ab6f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:13.305148 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1686906b-f2e0-4f7a-9a2c-049bfa92e598 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d55c1e3205f40949ad95dd81f78ab6f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:13.339863 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3962/7934] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:34:13 2022] DELETE /identity/v3/users/8d55c1e3205f40949ad95dd81f78ab6f => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:13.340969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1686906b-f2e0-4f7a-9a2c-049bfa92e598 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:13.342503 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1686906b-f2e0-4f7a-9a2c-049bfa92e598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:13.384110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8f6c0-0b76-4105-b8f0-a25ecd65164e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:13.461754 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:13.467822 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1686906b-f2e0-4f7a-9a2c-049bfa92e598 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:13.478828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7ff25-b7b2-418b-9a92-e60b593e07bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:13.479639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7ff25-b7b2-418b-9a92-e60b593e07bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:13.480837 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7ff25-b7b2-418b-9a92-e60b593e07bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:13.481125 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7ff25-b7b2-418b-9a92-e60b593e07bf admin admin] PATH_INFO: `/v3/projects/8c92b22ce8834190a5e47252774e1b41` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:13.482471 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7ff25-b7b2-418b-9a92-e60b593e07bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c92b22ce8834190a5e47252774e1b41)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:13.486232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7ff25-b7b2-418b-9a92-e60b593e07bf admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:13.522873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe0577-627f-444e-8c9b-bd62dbd9434a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:13.523552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe0577-627f-444e-8c9b-bd62dbd9434a admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:13.523831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe0577-627f-444e-8c9b-bd62dbd9434a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:13.524101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe0577-627f-444e-8c9b-bd62dbd9434a admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:13.524742 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe0577-627f-444e-8c9b-bd62dbd9434a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:13.531924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe0577-627f-444e-8c9b-bd62dbd9434a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:13.565785 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-93f7ff25-b7b2-418b-9a92-e60b593e07bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c92b22ce8834190a5e47252774e1b41', 'request_id': 'req-93f7ff25-b7b2-418b-9a92-e60b593e07bf'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:13.592269 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-93f7ff25-b7b2-418b-9a92-e60b593e07bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c92b22ce8834190a5e47252774e1b41', 'request_id': 'req-93f7ff25-b7b2-418b-9a92-e60b593e07bf'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:13.595306 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3973/7935] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:34:13 2022] POST /identity/v3/users => generated 280 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:34:13.597098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee712d-0424-41ff-82ed-552bafc5b565 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:13.597349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee712d-0424-41ff-82ed-552bafc5b565 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:13.597653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee712d-0424-41ff-82ed-552bafc5b565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:13.610696 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-93f7ff25-b7b2-418b-9a92-e60b593e07bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c92b22ce8834190a5e47252774e1b41', 'request_id': 'req-93f7ff25-b7b2-418b-9a92-e60b593e07bf'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:13.629144 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-93f7ff25-b7b2-418b-9a92-e60b593e07bf admin admin] The token cache is being invalidate because project 8c92b22ce8834190a5e47252774e1b41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:34:13.629893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-93f7ff25-b7b2-418b-9a92-e60b593e07bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:13.630931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-93f7ff25-b7b2-418b-9a92-e60b593e07bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:13.633977 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3963/7936] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:34:13 2022] DELETE /identity/v3/projects/8c92b22ce8834190a5e47252774e1b41 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:13.635157 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7ff25-b7b2-418b-9a92-e60b593e07bf admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:13.637322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-93f7ff25-b7b2-418b-9a92-e60b593e07bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:13.647359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c3ee712d-0424-41ff-82ed-552bafc5b565 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:13.648904 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c3ee712d-0424-41ff-82ed-552bafc5b565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:13.764094 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7ff25-b7b2-418b-9a92-e60b593e07bf admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:13.771564 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd401c-3fa0-4b9a-866c-b61fb572de82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:13.772678 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd401c-3fa0-4b9a-866c-b61fb572de82 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:13.773268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd401c-3fa0-4b9a-866c-b61fb572de82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:13.773951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd401c-3fa0-4b9a-866c-b61fb572de82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:13.774892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd401c-3fa0-4b9a-866c-b61fb572de82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:13.776863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd401c-3fa0-4b9a-866c-b61fb572de82 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:13.790479 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3974/7937] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:13.791413 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee712d-0424-41ff-82ed-552bafc5b565 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:13.803780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c3ee712d-0424-41ff-82ed-552bafc5b565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:13.809640 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3964/7938] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:34:13.810595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd401c-3fa0-4b9a-866c-b61fb572de82 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:13.812776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4fcd401c-3fa0-4b9a-866c-b61fb572de82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:13.828639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd401c-3fa0-4b9a-866c-b61fb572de82 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:13.843564 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee712d-0424-41ff-82ed-552bafc5b565 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:13.853216 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf66e99-a325-427f-975a-8da860e4efc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:13.855006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf66e99-a325-427f-975a-8da860e4efc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:13.855407 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf66e99-a325-427f-975a-8da860e4efc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:13.856436 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf66e99-a325-427f-975a-8da860e4efc9 admin admin] PATH_INFO: `/v3/projects/5454d1c206a1465d804e697abcd92e83` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:13.856912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba3a35-95db-47b4-bc6a-15f72aa0ed22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:13.857877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba3a35-95db-47b4-bc6a-15f72aa0ed22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:13.858156 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba3a35-95db-47b4-bc6a-15f72aa0ed22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:13.858451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba3a35-95db-47b4-bc6a-15f72aa0ed22 admin admin] PATH_INFO: `/v3/users/d4b8b75e67e54aa7a1ee8e21f74f54d5` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:13.860398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fba3a35-95db-47b4-bc6a-15f72aa0ed22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4b8b75e67e54aa7a1ee8e21f74f54d5)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:13.864019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf66e99-a325-427f-975a-8da860e4efc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5454d1c206a1465d804e697abcd92e83)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:13.866029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf66e99-a325-427f-975a-8da860e4efc9 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:13.876562 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fba3a35-95db-47b4-bc6a-15f72aa0ed22 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:13.878481 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:13.959281 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2fba3a35-95db-47b4-bc6a-15f72aa0ed22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4b8b75e67e54aa7a1ee8e21f74f54d5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:13.960624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2fba3a35-95db-47b4-bc6a-15f72aa0ed22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4b8b75e67e54aa7a1ee8e21f74f54d5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:13.977591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2fba3a35-95db-47b4-bc6a-15f72aa0ed22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4b8b75e67e54aa7a1ee8e21f74f54d5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:13.990968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2fba3a35-95db-47b4-bc6a-15f72aa0ed22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4b8b75e67e54aa7a1ee8e21f74f54d5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:13.992348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2fba3a35-95db-47b4-bc6a-15f72aa0ed22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4b8b75e67e54aa7a1ee8e21f74f54d5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:13.992960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-edf66e99-a325-427f-975a-8da860e4efc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5454d1c206a1465d804e697abcd92e83', 'request_id': 'req-edf66e99-a325-427f-975a-8da860e4efc9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:14.017066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-edf66e99-a325-427f-975a-8da860e4efc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5454d1c206a1465d804e697abcd92e83', 'request_id': 'req-edf66e99-a325-427f-975a-8da860e4efc9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:14.019435 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3975/7939] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:34:13 2022] DELETE /identity/v3/users/d4b8b75e67e54aa7a1ee8e21f74f54d5 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:14.029405 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c0474-f333-4e5a-84c7-abf3a8f6be8a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:14.029405 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c0474-f333-4e5a-84c7-abf3a8f6be8a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:14.029405 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c0474-f333-4e5a-84c7-abf3a8f6be8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:14.052886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-edf66e99-a325-427f-975a-8da860e4efc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5454d1c206a1465d804e697abcd92e83', 'request_id': 'req-edf66e99-a325-427f-975a-8da860e4efc9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:14.056602 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-248c0474-f333-4e5a-84c7-abf3a8f6be8a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:14.057293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-248c0474-f333-4e5a-84c7-abf3a8f6be8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:14.084297 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-edf66e99-a325-427f-975a-8da860e4efc9 admin admin] The token cache is being invalidate because project 5454d1c206a1465d804e697abcd92e83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:34:14.084297 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-edf66e99-a325-427f-975a-8da860e4efc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:14.090998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-edf66e99-a325-427f-975a-8da860e4efc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:14.093100 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3965/7940] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:34:13 2022] DELETE /identity/v3/projects/5454d1c206a1465d804e697abcd92e83 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:14.094106 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf66e99-a325-427f-975a-8da860e4efc9 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:14.102047 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-edf66e99-a325-427f-975a-8da860e4efc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:14.132646 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:14.153708 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3976/7941] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:14.154784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c0474-f333-4e5a-84c7-abf3a8f6be8a None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:14.159490 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-248c0474-f333-4e5a-84c7-abf3a8f6be8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:14.188546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c0474-f333-4e5a-84c7-abf3a8f6be8a None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:14.195268 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609e099-c237-4842-8f6c-2f59d1e5c330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:14.195885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609e099-c237-4842-8f6c-2f59d1e5c330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:14.196355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609e099-c237-4842-8f6c-2f59d1e5c330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:14.196640 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609e099-c237-4842-8f6c-2f59d1e5c330 admin admin] PATH_INFO: `/v3/users/a70d0975eabc4aca80200adf8cd66444` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:14.200268 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609e099-c237-4842-8f6c-2f59d1e5c330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a70d0975eabc4aca80200adf8cd66444)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:14.201676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609e099-c237-4842-8f6c-2f59d1e5c330 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:14.296725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf66e99-a325-427f-975a-8da860e4efc9 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:14.302954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e5aa1-df32-4eb1-bee8-a2fe968725d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:14.304949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e5aa1-df32-4eb1-bee8-a2fe968725d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:14.305565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e5aa1-df32-4eb1-bee8-a2fe968725d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:14.305948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e5aa1-df32-4eb1-bee8-a2fe968725d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:14.306709 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e5aa1-df32-4eb1-bee8-a2fe968725d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:14.308647 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e5aa1-df32-4eb1-bee8-a2fe968725d8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:14.314841 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1609e099-c237-4842-8f6c-2f59d1e5c330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a70d0975eabc4aca80200adf8cd66444'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:14.316222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1609e099-c237-4842-8f6c-2f59d1e5c330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a70d0975eabc4aca80200adf8cd66444'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:14.336607 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1609e099-c237-4842-8f6c-2f59d1e5c330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a70d0975eabc4aca80200adf8cd66444'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:14.336863 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3966/7942] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:34:14.336863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e5aa1-df32-4eb1-bee8-a2fe968725d8 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:14.344255 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fb1e5aa1-df32-4eb1-bee8-a2fe968725d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:14.358108 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1609e099-c237-4842-8f6c-2f59d1e5c330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a70d0975eabc4aca80200adf8cd66444'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:14.358762 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1609e099-c237-4842-8f6c-2f59d1e5c330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a70d0975eabc4aca80200adf8cd66444'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:14.374066 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:14.381006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e5aa1-df32-4eb1-bee8-a2fe968725d8 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:14.388698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89004c-40c2-4e15-a837-47f90f631dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:14.389516 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89004c-40c2-4e15-a837-47f90f631dcf admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:14.389904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89004c-40c2-4e15-a837-47f90f631dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:14.390284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89004c-40c2-4e15-a837-47f90f631dcf admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:14.391058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89004c-40c2-4e15-a837-47f90f631dcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:34:14.391477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89004c-40c2-4e15-a837-47f90f631dcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:14.394439 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89004c-40c2-4e15-a837-47f90f631dcf admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:14.404350 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3977/7943] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:34:14 2022] DELETE /identity/v3/users/a70d0975eabc4aca80200adf8cd66444 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:14.405426 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609e099-c237-4842-8f6c-2f59d1e5c330 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:14.408945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1609e099-c237-4842-8f6c-2f59d1e5c330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:14.421477 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3967/7944] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:34:14.424043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89004c-40c2-4e15-a837-47f90f631dcf admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:14.457519 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89004c-40c2-4e15-a837-47f90f631dcf admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:14.548132 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8f570-ef9e-4ceb-9c97-501e0d17acfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:14.548791 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8f570-ef9e-4ceb-9c97-501e0d17acfd admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:14.549515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8f570-ef9e-4ceb-9c97-501e0d17acfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:14.550374 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8f570-ef9e-4ceb-9c97-501e0d17acfd admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:14.551033 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8f570-ef9e-4ceb-9c97-501e0d17acfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:14.553704 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8f570-ef9e-4ceb-9c97-501e0d17acfd admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:14.603110 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3968/7945] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:34:14 2022] POST /identity/v3/projects => generated 363 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:34:14.607714 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609e099-c237-4842-8f6c-2f59d1e5c330 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:14.609143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8f570-ef9e-4ceb-9c97-501e0d17acfd admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:14.742547 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8f570-ef9e-4ceb-9c97-501e0d17acfd admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:14.748367 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2db68-3e63-408a-a672-eb2424664da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:14.748819 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2db68-3e63-408a-a672-eb2424664da6 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:14.750804 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2db68-3e63-408a-a672-eb2424664da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:14.751186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2db68-3e63-408a-a672-eb2424664da6 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:14.752856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca2db68-3e63-408a-a672-eb2424664da6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:14.756575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca2db68-3e63-408a-a672-eb2424664da6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:14.794437 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3969/7946] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:34:14 2022] POST /identity/v3/users => generated 282 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:34:14.795372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2db68-3e63-408a-a672-eb2424664da6 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:14.797234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fca2db68-3e63-408a-a672-eb2424664da6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:14.799041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026dacba-c993-421a-beb7-e1800246efb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:14.802101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026dacba-c993-421a-beb7-e1800246efb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:14.804682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026dacba-c993-421a-beb7-e1800246efb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:14.806554 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026dacba-c993-421a-beb7-e1800246efb6 admin admin] PATH_INFO: `/v3/projects/c18b7193cf8240a49d4110413dd3d395/users/b0299e314ac0483f94f842e59ba72e8e/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:14.808369 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:14.813529 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2db68-3e63-408a-a672-eb2424664da6 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:14.840083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026dacba-c993-421a-beb7-e1800246efb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c18b7193cf8240a49d4110413dd3d395, user_id=b0299e314ac0483f94f842e59ba72e8e, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:14.844140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026dacba-c993-421a-beb7-e1800246efb6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:14.848624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b090e-c8c1-45f6-b52d-6f541489426d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:14.849723 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b090e-c8c1-45f6-b52d-6f541489426d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:14.850075 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b090e-c8c1-45f6-b52d-6f541489426d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:14.850417 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b090e-c8c1-45f6-b52d-6f541489426d admin admin] PATH_INFO: `/v3/projects/d728fffdaf8b42458eeb0a1475329d37` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:14.853734 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b090e-c8c1-45f6-b52d-6f541489426d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d728fffdaf8b42458eeb0a1475329d37)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:14.859702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b090e-c8c1-45f6-b52d-6f541489426d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:14.886928 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3978/7947] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:34:14 2022] PUT /identity/v3/projects/c18b7193cf8240a49d4110413dd3d395/users/b0299e314ac0483f94f842e59ba72e8e/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:14.888087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026dacba-c993-421a-beb7-e1800246efb6 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:14.967324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fa3b090e-c8c1-45f6-b52d-6f541489426d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd728fffdaf8b42458eeb0a1475329d37', 'request_id': 'req-fa3b090e-c8c1-45f6-b52d-6f541489426d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:14.982334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fa3b090e-c8c1-45f6-b52d-6f541489426d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd728fffdaf8b42458eeb0a1475329d37', 'request_id': 'req-fa3b090e-c8c1-45f6-b52d-6f541489426d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:14.991954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fa3b090e-c8c1-45f6-b52d-6f541489426d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd728fffdaf8b42458eeb0a1475329d37', 'request_id': 'req-fa3b090e-c8c1-45f6-b52d-6f541489426d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:15.008504 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fa3b090e-c8c1-45f6-b52d-6f541489426d admin admin] The token cache is being invalidate because project d728fffdaf8b42458eeb0a1475329d37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:34:15.009963 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fa3b090e-c8c1-45f6-b52d-6f541489426d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:15.011811 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-fa3b090e-c8c1-45f6-b52d-6f541489426d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:15.014989 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3970/7948] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:34:14 2022] DELETE /identity/v3/projects/d728fffdaf8b42458eeb0a1475329d37 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:15.019837 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9af58-a0d3-41f4-9c2a-284d8a008854 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:15.019837 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9af58-a0d3-41f4-9c2a-284d8a008854 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:15.019837 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9af58-a0d3-41f4-9c2a-284d8a008854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:15.058695 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026dacba-c993-421a-beb7-e1800246efb6 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:15.098266 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:15.103670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-99a9af58-a0d3-41f4-9c2a-284d8a008854 None None] MFA Rules not processed for user `b0299e314ac0483f94f842e59ba72e8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:15.104913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-99a9af58-a0d3-41f4-9c2a-284d8a008854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:15.147489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cddbf-e5cf-4293-b93d-0070e1e76659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:15.148549 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cddbf-e5cf-4293-b93d-0070e1e76659 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:15.148918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cddbf-e5cf-4293-b93d-0070e1e76659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:15.149236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cddbf-e5cf-4293-b93d-0070e1e76659 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:15.150300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36cddbf-e5cf-4293-b93d-0070e1e76659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:15.151970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36cddbf-e5cf-4293-b93d-0070e1e76659 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:15.176614 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3979/7949] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:34:15.180703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccdf76-a2f0-425b-86e9-22c42bc1194f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:15.180703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccdf76-a2f0-425b-86e9-22c42bc1194f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:15.182419 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccdf76-a2f0-425b-86e9-22c42bc1194f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:15.239629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-97ccdf76-a2f0-425b-86e9-22c42bc1194f None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:15.240875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-97ccdf76-a2f0-425b-86e9-22c42bc1194f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:15.261529 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3971/7950] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:15 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:15.262677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9af58-a0d3-41f4-9c2a-284d8a008854 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:15.264434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-99a9af58-a0d3-41f4-9c2a-284d8a008854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:15.281149 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3980/7951] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:15.284961 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ccdf76-a2f0-425b-86e9-22c42bc1194f None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:15.286713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-97ccdf76-a2f0-425b-86e9-22c42bc1194f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:15.295272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9af58-a0d3-41f4-9c2a-284d8a008854 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:15.306114 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50288f72-fa8e-46bb-8592-3b07b4fe43f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:15.306802 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50288f72-fa8e-46bb-8592-3b07b4fe43f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:15.307085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50288f72-fa8e-46bb-8592-3b07b4fe43f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:15.307947 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50288f72-fa8e-46bb-8592-3b07b4fe43f7 admin admin] PATH_INFO: `/v3/projects/f25602c79b7d402dacc2c4fbfd77c5a0` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:15.312055 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50288f72-fa8e-46bb-8592-3b07b4fe43f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f25602c79b7d402dacc2c4fbfd77c5a0)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:15.317828 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ccdf76-a2f0-425b-86e9-22c42bc1194f None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:15.322713 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50288f72-fa8e-46bb-8592-3b07b4fe43f7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:15.338728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e4753-adef-4182-aedc-ee88db53249b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:15.343271 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e4753-adef-4182-aedc-ee88db53249b admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:15.344840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e4753-adef-4182-aedc-ee88db53249b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:15.345907 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e4753-adef-4182-aedc-ee88db53249b admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:15.348489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e4753-adef-4182-aedc-ee88db53249b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:15.353581 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e4753-adef-4182-aedc-ee88db53249b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:15.384226 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3981/7952] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:34:15.385242 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e4753-adef-4182-aedc-ee88db53249b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:15.387241 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-da4e4753-adef-4182-aedc-ee88db53249b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:15.405052 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-50288f72-fa8e-46bb-8592-3b07b4fe43f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f25602c79b7d402dacc2c4fbfd77c5a0', 'request_id': 'req-50288f72-fa8e-46bb-8592-3b07b4fe43f7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:15.421719 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-50288f72-fa8e-46bb-8592-3b07b4fe43f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f25602c79b7d402dacc2c4fbfd77c5a0', 'request_id': 'req-50288f72-fa8e-46bb-8592-3b07b4fe43f7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:15.435576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-50288f72-fa8e-46bb-8592-3b07b4fe43f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f25602c79b7d402dacc2c4fbfd77c5a0', 'request_id': 'req-50288f72-fa8e-46bb-8592-3b07b4fe43f7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:15.455365 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:15.466029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-50288f72-fa8e-46bb-8592-3b07b4fe43f7 admin admin] The token cache is being invalidate because project f25602c79b7d402dacc2c4fbfd77c5a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:34:15.467891 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-50288f72-fa8e-46bb-8592-3b07b4fe43f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:15.470417 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-50288f72-fa8e-46bb-8592-3b07b4fe43f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:15.473069 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3972/7953] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:34:15 2022] DELETE /identity/v3/projects/f25602c79b7d402dacc2c4fbfd77c5a0 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:15.475160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943c1d2-44cb-4eed-aa44-476f8ddb5c20 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:15.475747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943c1d2-44cb-4eed-aa44-476f8ddb5c20 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:15.476897 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943c1d2-44cb-4eed-aa44-476f8ddb5c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:15.519610 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-2943c1d2-44cb-4eed-aa44-476f8ddb5c20 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:15.522861 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2943c1d2-44cb-4eed-aa44-476f8ddb5c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:15.526177 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e4753-adef-4182-aedc-ee88db53249b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:15.609602 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3973/7954] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:15.612432 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943c1d2-44cb-4eed-aa44-476f8ddb5c20 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:15.614193 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2943c1d2-44cb-4eed-aa44-476f8ddb5c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:15.623854 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e307818-19e8-4773-8571-b0ad62ff1e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:15.624470 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e307818-19e8-4773-8571-b0ad62ff1e14 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:15.624756 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e307818-19e8-4773-8571-b0ad62ff1e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:15.625242 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e307818-19e8-4773-8571-b0ad62ff1e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:15.627102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7e307818-19e8-4773-8571-b0ad62ff1e14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:15.635196 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943c1d2-44cb-4eed-aa44-476f8ddb5c20 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:15.649038 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae2667-f13c-4f1b-af5e-fb466803efb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:15.650451 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae2667-f13c-4f1b-af5e-fb466803efb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:15.650983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae2667-f13c-4f1b-af5e-fb466803efb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:15.652394 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae2667-f13c-4f1b-af5e-fb466803efb4 admin admin] PATH_INFO: `/v3/projects/9463ec5771624f25aea3e6b5ecc81558/users/5fbce7891d4a488a8b791ffe620babf7/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:15.683631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae2667-f13c-4f1b-af5e-fb466803efb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9463ec5771624f25aea3e6b5ecc81558, user_id=5fbce7891d4a488a8b791ffe620babf7, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:15.688717 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae2667-f13c-4f1b-af5e-fb466803efb4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:15.711617 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3974/7955] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:34:15 2022] PUT /identity/v3/projects/9463ec5771624f25aea3e6b5ecc81558/users/5fbce7891d4a488a8b791ffe620babf7/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:15.713934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c24ac8-c6c3-4388-9024-8aa77e32f3fe None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:15.714284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c24ac8-c6c3-4388-9024-8aa77e32f3fe None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:15.714622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c24ac8-c6c3-4388-9024-8aa77e32f3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:15.739622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-45c24ac8-c6c3-4388-9024-8aa77e32f3fe None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:15.740940 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-45c24ac8-c6c3-4388-9024-8aa77e32f3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:15.752815 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e307818-19e8-4773-8571-b0ad62ff1e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:15.756539 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e307818-19e8-4773-8571-b0ad62ff1e14 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:15.777470 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3982/7956] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:34:15 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:34:15.779451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e307818-19e8-4773-8571-b0ad62ff1e14 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:15.807430 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e307818-19e8-4773-8571-b0ad62ff1e14 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:15.829813 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3975/7957] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:15.831629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d09394-84ea-479c-ae23-aa12b92201c5 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:15.831983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d09394-84ea-479c-ae23-aa12b92201c5 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:15.832303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d09394-84ea-479c-ae23-aa12b92201c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:15.847761 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:15.874506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-37d09394-84ea-479c-ae23-aa12b92201c5 None None] MFA Rules not processed for user `5fbce7891d4a488a8b791ffe620babf7`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:15.876628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-37d09394-84ea-479c-ae23-aa12b92201c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:15.960285 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6917ba-7580-42e9-a696-6c9130ab48da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:15.962280 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6917ba-7580-42e9-a696-6c9130ab48da admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:15.962720 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6917ba-7580-42e9-a696-6c9130ab48da admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:15.963751 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6917ba-7580-42e9-a696-6c9130ab48da admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:15.965919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6917ba-7580-42e9-a696-6c9130ab48da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:34:15.967648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6917ba-7580-42e9-a696-6c9130ab48da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:15.970721 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3976/7958] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:15.970918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6917ba-7580-42e9-a696-6c9130ab48da admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:15.971907 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c1232-95ca-4192-8555-742c77fb5d9a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:15.972245 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c1232-95ca-4192-8555-742c77fb5d9a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:15.972524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c1232-95ca-4192-8555-742c77fb5d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:15.995311 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:16.001163 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3983/7959] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:34:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:34:16.002323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6917ba-7580-42e9-a696-6c9130ab48da admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:16.013851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e11c1232-95ca-4192-8555-742c77fb5d9a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:16.017404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ff6917ba-7580-42e9-a696-6c9130ab48da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:16.019693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e11c1232-95ca-4192-8555-742c77fb5d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:16.040753 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3977/7960] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:16.041641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c1232-95ca-4192-8555-742c77fb5d9a None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:16.065607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c1232-95ca-4192-8555-742c77fb5d9a None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:16.081639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e815fff-be04-4086-adef-e4d7b7c1ecd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:16.082274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e815fff-be04-4086-adef-e4d7b7c1ecd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:16.083492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e815fff-be04-4086-adef-e4d7b7c1ecd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:16.084124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e815fff-be04-4086-adef-e4d7b7c1ecd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:16.085216 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e815fff-be04-4086-adef-e4d7b7c1ecd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:16.091243 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e815fff-be04-4086-adef-e4d7b7c1ecd4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:16.152315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6917ba-7580-42e9-a696-6c9130ab48da admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:16.160275 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3978/7961] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:34:16 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:34:16.161743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e815fff-be04-4086-adef-e4d7b7c1ecd4 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:16.163305 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f6c83-dd16-435d-ad03-ad210b5846d3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efcee9b21ea94b1b8e5c9c5acb35839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:16.164706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f6c83-dd16-435d-ad03-ad210b5846d3 service glance] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:16.166465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f6c83-dd16-435d-ad03-ad210b5846d3 service glance] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:16.166916 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f6c83-dd16-435d-ad03-ad210b5846d3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:16.179258 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f6c83-dd16-435d-ad03-ad210b5846d3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:16.183997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f6c83-dd16-435d-ad03-ad210b5846d3 service glance] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:16.197127 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3984/7962] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:34:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:34:16.198294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f6c83-dd16-435d-ad03-ad210b5846d3 service glance] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:16.209872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f6c83-dd16-435d-ad03-ad210b5846d3 service glance] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:16.308499 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93574d1a-b2f5-4cc8-b35c-3d097c61042a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:16.309560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93574d1a-b2f5-4cc8-b35c-3d097c61042a admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:16.310008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93574d1a-b2f5-4cc8-b35c-3d097c61042a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:16.310473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93574d1a-b2f5-4cc8-b35c-3d097c61042a admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:16.311291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93574d1a-b2f5-4cc8-b35c-3d097c61042a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:16.313420 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93574d1a-b2f5-4cc8-b35c-3d097c61042a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:16.367692 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3985/7963] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:34:16 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:34:16.372202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93574d1a-b2f5-4cc8-b35c-3d097c61042a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:16.376525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e815fff-be04-4086-adef-e4d7b7c1ecd4 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:16.399634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226a9a7-f60d-41ba-bf6f-b18565fc4daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:16.404558 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226a9a7-f60d-41ba-bf6f-b18565fc4daa admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:16.405000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226a9a7-f60d-41ba-bf6f-b18565fc4daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:16.406356 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226a9a7-f60d-41ba-bf6f-b18565fc4daa admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:16.406919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93574d1a-b2f5-4cc8-b35c-3d097c61042a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:16.407284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226a9a7-f60d-41ba-bf6f-b18565fc4daa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:34:16.407704 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226a9a7-f60d-41ba-bf6f-b18565fc4daa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:16.409502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226a9a7-f60d-41ba-bf6f-b18565fc4daa admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:16.421536 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a46170-6b96-4f2b-a789-fe2f51689061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:16.423349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a46170-6b96-4f2b-a789-fe2f51689061 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:16.423706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a46170-6b96-4f2b-a789-fe2f51689061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:16.423987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a46170-6b96-4f2b-a789-fe2f51689061 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:16.427790 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a46170-6b96-4f2b-a789-fe2f51689061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:16.433425 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a46170-6b96-4f2b-a789-fe2f51689061 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:16.459923 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3979/7964] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:34:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:34:16.464671 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226a9a7-f60d-41ba-bf6f-b18565fc4daa admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:16.469281 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3986/7965] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:34:16.474447 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a46170-6b96-4f2b-a789-fe2f51689061 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:16.495054 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226a9a7-f60d-41ba-bf6f-b18565fc4daa admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:16.499801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a46170-6b96-4f2b-a789-fe2f51689061 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:16.506555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127ad5c-b55d-4fdd-84fd-a2dd41124045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:16.508537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127ad5c-b55d-4fdd-84fd-a2dd41124045 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:16.509324 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127ad5c-b55d-4fdd-84fd-a2dd41124045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:16.509790 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127ad5c-b55d-4fdd-84fd-a2dd41124045 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:16.511620 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127ad5c-b55d-4fdd-84fd-a2dd41124045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:16.512440 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4bc86-2535-471e-8824-3a7c64488cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:16.513171 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4bc86-2535-471e-8824-3a7c64488cca admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:16.514450 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127ad5c-b55d-4fdd-84fd-a2dd41124045 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:16.517053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4bc86-2535-471e-8824-3a7c64488cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:16.517717 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4bc86-2535-471e-8824-3a7c64488cca admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:16.521343 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb4bc86-2535-471e-8824-3a7c64488cca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:16.526061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb4bc86-2535-471e-8824-3a7c64488cca admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:16.534472 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3987/7966] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:34:16.539248 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127ad5c-b55d-4fdd-84fd-a2dd41124045 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:16.556824 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127ad5c-b55d-4fdd-84fd-a2dd41124045 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:16.565402 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b570f-548a-410e-a2e0-c9d375b1eda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:16.567937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b570f-548a-410e-a2e0-c9d375b1eda4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:16.568561 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b570f-548a-410e-a2e0-c9d375b1eda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:16.569066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b570f-548a-410e-a2e0-c9d375b1eda4 admin admin] PATH_INFO: `/v3/projects/00cb2d7dffc245279973812f8d180bc2/users/4027d233553b47c5888b89cef58c1eb8/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:16.612395 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3980/7967] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:34:16 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:34:16.616145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4bc86-2535-471e-8824-3a7c64488cca admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:16.627106 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2b570f-548a-410e-a2e0-c9d375b1eda4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00cb2d7dffc245279973812f8d180bc2, user_id=4027d233553b47c5888b89cef58c1eb8, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:16.644047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2b570f-548a-410e-a2e0-c9d375b1eda4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:16.664868 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:16.670815 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3988/7968] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:34:16 2022] PUT /identity/v3/projects/00cb2d7dffc245279973812f8d180bc2/users/4027d233553b47c5888b89cef58c1eb8/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:16.681283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4bc12-8881-4e2f-ba83-fc24ac43b302 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:16.681658 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4bc12-8881-4e2f-ba83-fc24ac43b302 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:16.681942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4bc12-8881-4e2f-ba83-fc24ac43b302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:16.760717 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b3d4bc12-8881-4e2f-ba83-fc24ac43b302 None None] MFA Rules not processed for user `4027d233553b47c5888b89cef58c1eb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:16.766136 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b3d4bc12-8881-4e2f-ba83-fc24ac43b302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:16.855286 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4bc86-2535-471e-8824-3a7c64488cca admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:16.984210 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3989/7969] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:34:16.985542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4bc12-8881-4e2f-ba83-fc24ac43b302 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:17.049131 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:17.065473 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce0bd1-ff8b-4ff7-b763-7157dd186a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:17.066028 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce0bd1-ff8b-4ff7-b763-7157dd186a46 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:17.066316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce0bd1-ff8b-4ff7-b763-7157dd186a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:17.066691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce0bd1-ff8b-4ff7-b763-7157dd186a46 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:17.067332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce0bd1-ff8b-4ff7-b763-7157dd186a46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:17.072149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce0bd1-ff8b-4ff7-b763-7157dd186a46 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:17.132459 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3981/7970] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:34:16 2022] POST /identity/v3/users => generated 289 bytes in 514 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:34:17.133682 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce0bd1-ff8b-4ff7-b763-7157dd186a46 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:17.167263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4bc12-8881-4e2f-ba83-fc24ac43b302 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:17.181201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce0bd1-ff8b-4ff7-b763-7157dd186a46 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:17.190235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ffe1d-6656-4c72-8b21-b500007b2b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:17.190883 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ffe1d-6656-4c72-8b21-b500007b2b69 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:17.191167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ffe1d-6656-4c72-8b21-b500007b2b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:17.191448 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ffe1d-6656-4c72-8b21-b500007b2b69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:17.192102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ffe1d-6656-4c72-8b21-b500007b2b69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:17.197217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0cec29-97dd-4150-bb64-fa63b3c975d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:17.198344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0cec29-97dd-4150-bb64-fa63b3c975d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:17.198810 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0cec29-97dd-4150-bb64-fa63b3c975d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:17.199250 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0cec29-97dd-4150-bb64-fa63b3c975d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:17.200072 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0cec29-97dd-4150-bb64-fa63b3c975d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:17.202375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ffe1d-6656-4c72-8b21-b500007b2b69 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:17.202614 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0cec29-97dd-4150-bb64-fa63b3c975d2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:17.228835 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3982/7971] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:34:17.230115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0cec29-97dd-4150-bb64-fa63b3c975d2 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:17.261714 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0cec29-97dd-4150-bb64-fa63b3c975d2 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:17.282651 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3990/7972] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:34:16 2022] POST /identity/v3/projects => generated 375 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:34:17.283553 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ffe1d-6656-4c72-8b21-b500007b2b69 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:17.291846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989e115-d5d1-4065-8bb9-d8c8c9800cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:17.292603 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989e115-d5d1-4065-8bb9-d8c8c9800cb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:17.292882 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989e115-d5d1-4065-8bb9-d8c8c9800cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:17.293163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989e115-d5d1-4065-8bb9-d8c8c9800cb0 admin admin] PATH_INFO: `/v3/users/5fbce7891d4a488a8b791ffe620babf7` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:17.295100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989e115-d5d1-4065-8bb9-d8c8c9800cb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fbce7891d4a488a8b791ffe620babf7)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:17.297342 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989e115-d5d1-4065-8bb9-d8c8c9800cb0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:17.441287 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3989e115-d5d1-4065-8bb9-d8c8c9800cb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fbce7891d4a488a8b791ffe620babf7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:17.443412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3989e115-d5d1-4065-8bb9-d8c8c9800cb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fbce7891d4a488a8b791ffe620babf7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:17.468485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3989e115-d5d1-4065-8bb9-d8c8c9800cb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fbce7891d4a488a8b791ffe620babf7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:17.475537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ffe1d-6656-4c72-8b21-b500007b2b69 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:17.483047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36cd124-c810-472f-bdf8-f8fe440f3985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:17.483687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cd124-c810-472f-bdf8-f8fe440f3985 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:17.484126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cd124-c810-472f-bdf8-f8fe440f3985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:17.485860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cd124-c810-472f-bdf8-f8fe440f3985 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:17.486710 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36cd124-c810-472f-bdf8-f8fe440f3985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:17.488493 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36cd124-c810-472f-bdf8-f8fe440f3985 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:17.500687 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3989e115-d5d1-4065-8bb9-d8c8c9800cb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fbce7891d4a488a8b791ffe620babf7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:17.501101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3989e115-d5d1-4065-8bb9-d8c8c9800cb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fbce7891d4a488a8b791ffe620babf7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:17.516046 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3991/7973] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:34:17.517024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36cd124-c810-472f-bdf8-f8fe440f3985 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:17.518852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b36cd124-c810-472f-bdf8-f8fe440f3985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:17.540481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36cd124-c810-472f-bdf8-f8fe440f3985 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:17.545755 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3983/7974] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:34:17 2022] DELETE /identity/v3/users/5fbce7891d4a488a8b791ffe620babf7 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:17.546834 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989e115-d5d1-4065-8bb9-d8c8c9800cb0 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:17.548768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3989e115-d5d1-4065-8bb9-d8c8c9800cb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:17.556444 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:17.693634 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7599071-85ff-4116-9f20-46fd84b57e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:17.694882 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7599071-85ff-4116-9f20-46fd84b57e70 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:17.695295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7599071-85ff-4116-9f20-46fd84b57e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:17.695641 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7599071-85ff-4116-9f20-46fd84b57e70 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:17.696424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7599071-85ff-4116-9f20-46fd84b57e70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:17.704360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7599071-85ff-4116-9f20-46fd84b57e70 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:17.775606 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3992/7975] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:34:17 2022] POST /identity/v3/users => generated 294 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:34:17.776659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa1551-6a28-47ba-989e-f93dbfa96664 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:17.777054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa1551-6a28-47ba-989e-f93dbfa96664 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:17.777645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa1551-6a28-47ba-989e-f93dbfa96664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:17.779100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989e115-d5d1-4065-8bb9-d8c8c9800cb0 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:17.792199 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e431df-ea25-4666-9202-f743848e6983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:17.794646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e431df-ea25-4666-9202-f743848e6983 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:17.795040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e431df-ea25-4666-9202-f743848e6983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:17.795510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e431df-ea25-4666-9202-f743848e6983 admin admin] PATH_INFO: `/v3/projects/b6c11c4f63a843a1975bf2cd98147b3e/users/9f49bf9fa8fc41a69868cf660f4d3af6/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:17.845662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-46fa1551-6a28-47ba-989e-f93dbfa96664 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:17.849845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-46fa1551-6a28-47ba-989e-f93dbfa96664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:17.854450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e431df-ea25-4666-9202-f743848e6983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c11c4f63a843a1975bf2cd98147b3e, user_id=9f49bf9fa8fc41a69868cf660f4d3af6, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:17.857962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e431df-ea25-4666-9202-f743848e6983 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:17.885304 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3993/7976] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:17.889936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa1551-6a28-47ba-989e-f93dbfa96664 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:17.909380 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3984/7977] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:34:17 2022] PUT /identity/v3/projects/b6c11c4f63a843a1975bf2cd98147b3e/users/9f49bf9fa8fc41a69868cf660f4d3af6/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:17.910484 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e431df-ea25-4666-9202-f743848e6983 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:17.915280 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e5e431df-ea25-4666-9202-f743848e6983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:17.934787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa1551-6a28-47ba-989e-f93dbfa96664 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:17.996306 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:18.062630 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e431df-ea25-4666-9202-f743848e6983 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:18.073378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dc703-faf4-4ba8-8a7c-5be33ad24495 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:18.074173 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dc703-faf4-4ba8-8a7c-5be33ad24495 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:18.074551 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dc703-faf4-4ba8-8a7c-5be33ad24495 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:18.075175 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dc703-faf4-4ba8-8a7c-5be33ad24495 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:18.140142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726ba27-863c-4139-9b04-a1dd9d91c237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:18.140785 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726ba27-863c-4139-9b04-a1dd9d91c237 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:18.141071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726ba27-863c-4139-9b04-a1dd9d91c237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:18.141349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726ba27-863c-4139-9b04-a1dd9d91c237 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:18.145374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6726ba27-863c-4139-9b04-a1dd9d91c237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:18.146657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6726ba27-863c-4139-9b04-a1dd9d91c237 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:18.175576 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3994/7978] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:34:18.177106 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c73768-9fa6-461c-ad20-529f6ddd1ac4 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:18.177267 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c73768-9fa6-461c-ad20-529f6ddd1ac4 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:18.177420 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c73768-9fa6-461c-ad20-529f6ddd1ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:18.215463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955dc703-faf4-4ba8-8a7c-5be33ad24495 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:18.218446 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955dc703-faf4-4ba8-8a7c-5be33ad24495 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:18.240641 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3985/7979] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:34:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:34:18.241552 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dc703-faf4-4ba8-8a7c-5be33ad24495 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:18.244968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e2c73768-9fa6-461c-ad20-529f6ddd1ac4 None None] MFA Rules not processed for user `9f49bf9fa8fc41a69868cf660f4d3af6`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:18.246040 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e2c73768-9fa6-461c-ad20-529f6ddd1ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:18.266544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dc703-faf4-4ba8-8a7c-5be33ad24495 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:18.278390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fef392-14bc-4363-8759-56efeee7eeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:18.279321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fef392-14bc-4363-8759-56efeee7eeb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:18.281042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fef392-14bc-4363-8759-56efeee7eeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:18.281858 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fef392-14bc-4363-8759-56efeee7eeb2 admin admin] PATH_INFO: `/v3/projects/f2d17948629e47349888c4d6fc59685c/users/5631fce37f4c4e5d87ed64ae22fe3081/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:18.331369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fef392-14bc-4363-8759-56efeee7eeb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2d17948629e47349888c4d6fc59685c, user_id=5631fce37f4c4e5d87ed64ae22fe3081, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:18.337097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fef392-14bc-4363-8759-56efeee7eeb2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:18.359692 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3986/7980] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:34:18 2022] PUT /identity/v3/projects/f2d17948629e47349888c4d6fc59685c/users/5631fce37f4c4e5d87ed64ae22fe3081/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:18.363920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fef392-14bc-4363-8759-56efeee7eeb2 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:18.486527 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3995/7981] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:18.491086 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c73768-9fa6-461c-ad20-529f6ddd1ac4 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:18.511321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c73768-9fa6-461c-ad20-529f6ddd1ac4 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:18.539696 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fef392-14bc-4363-8759-56efeee7eeb2 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:18.546132 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:18.560054 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a67ab0-5bc0-4e7c-a2eb-987cdb7852d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:18.560713 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a67ab0-5bc0-4e7c-a2eb-987cdb7852d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:18.561001 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a67ab0-5bc0-4e7c-a2eb-987cdb7852d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:18.561281 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a67ab0-5bc0-4e7c-a2eb-987cdb7852d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:18.562226 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a67ab0-5bc0-4e7c-a2eb-987cdb7852d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:18.563755 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a67ab0-5bc0-4e7c-a2eb-987cdb7852d7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:18.590685 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3987/7982] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:34:18.591707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a67ab0-5bc0-4e7c-a2eb-987cdb7852d7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:18.611579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a67ab0-5bc0-4e7c-a2eb-987cdb7852d7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:18.633091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd23e84-0012-4120-960f-1df47244ed1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:18.634213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd23e84-0012-4120-960f-1df47244ed1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:18.634729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd23e84-0012-4120-960f-1df47244ed1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:18.635305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd23e84-0012-4120-960f-1df47244ed1c admin admin] PATH_INFO: `/v3/projects/f2d17948629e47349888c4d6fc59685c/users/5631fce37f4c4e5d87ed64ae22fe3081/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:18.640459 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd23e84-0012-4120-960f-1df47244ed1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2d17948629e47349888c4d6fc59685c, user_id=5631fce37f4c4e5d87ed64ae22fe3081, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:18.645672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd23e84-0012-4120-960f-1df47244ed1c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:18.673577 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3988/7983] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:34:18 2022] PUT /identity/v3/projects/f2d17948629e47349888c4d6fc59685c/users/5631fce37f4c4e5d87ed64ae22fe3081/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:18.686554 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262deb74-02b3-46f1-a412-30c822fff255 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:18.687286 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262deb74-02b3-46f1-a412-30c822fff255 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:18.687765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262deb74-02b3-46f1-a412-30c822fff255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:18.710210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc46179-d421-4009-8351-2be66ef0ebde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:18.711546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc46179-d421-4009-8351-2be66ef0ebde admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:18.711835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc46179-d421-4009-8351-2be66ef0ebde admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:18.712115 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc46179-d421-4009-8351-2be66ef0ebde admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:18.712767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc46179-d421-4009-8351-2be66ef0ebde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:18.717661 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc46179-d421-4009-8351-2be66ef0ebde admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:18.769626 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-262deb74-02b3-46f1-a412-30c822fff255 None None] MFA Rules not processed for user `5631fce37f4c4e5d87ed64ae22fe3081`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:18.774156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-262deb74-02b3-46f1-a412-30c822fff255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:18.809754 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3996/7984] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:34:18 2022] POST /identity/v3/projects => generated 375 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:34:18.814301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc46179-d421-4009-8351-2be66ef0ebde admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:18.858808 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:18.996210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc46179-d421-4009-8351-2be66ef0ebde admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:19.006848 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3989/7985] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:18 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:19.013707 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6ee23-af3c-402c-8276-1669504582a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:19.018282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6ee23-af3c-402c-8276-1669504582a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:19.019612 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6ee23-af3c-402c-8276-1669504582a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:19.019869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262deb74-02b3-46f1-a412-30c822fff255 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:19.020432 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6ee23-af3c-402c-8276-1669504582a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:19.021322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-262deb74-02b3-46f1-a412-30c822fff255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:19.023462 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae6ee23-af3c-402c-8276-1669504582a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:19.029560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae6ee23-af3c-402c-8276-1669504582a0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:19.099531 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3997/7986] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:34:18 2022] POST /identity/v3/users => generated 294 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:34:19.105967 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6ee23-af3c-402c-8276-1669504582a0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:19.138236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6ee23-af3c-402c-8276-1669504582a0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:19.150770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262deb74-02b3-46f1-a412-30c822fff255 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:19.155108 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a81d4c-b6d1-412f-b68d-92c3fffe7ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:19.156688 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a81d4c-b6d1-412f-b68d-92c3fffe7ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:19.160130 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a81d4c-b6d1-412f-b68d-92c3fffe7ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:19.161200 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a81d4c-b6d1-412f-b68d-92c3fffe7ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:19.162931 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a81d4c-b6d1-412f-b68d-92c3fffe7ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:19.170379 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a81d4c-b6d1-412f-b68d-92c3fffe7ee7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:19.202455 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3998/7987] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:34:19.206859 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a81d4c-b6d1-412f-b68d-92c3fffe7ee7 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:19.223620 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a81d4c-b6d1-412f-b68d-92c3fffe7ee7 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:19.232214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79688c-6e46-42f1-b5a1-d91b62208632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:19.232986 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79688c-6e46-42f1-b5a1-d91b62208632 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:19.233342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79688c-6e46-42f1-b5a1-d91b62208632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:19.233707 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79688c-6e46-42f1-b5a1-d91b62208632 admin admin] PATH_INFO: `/v3/projects/0c4aa04f68de423eb31659c641107a78/users/a5e086da07f44f5197ffa918f330c89c/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:19.265580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd79688c-6e46-42f1-b5a1-d91b62208632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c4aa04f68de423eb31659c641107a78, user_id=a5e086da07f44f5197ffa918f330c89c, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:19.272180 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd79688c-6e46-42f1-b5a1-d91b62208632 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:19.284828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2381c6-0f2f-4fa7-9b8f-f1922db063ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:19.293513 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2381c6-0f2f-4fa7-9b8f-f1922db063ce service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:19.293894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2381c6-0f2f-4fa7-9b8f-f1922db063ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:19.294379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2381c6-0f2f-4fa7-9b8f-f1922db063ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:19.297164 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 3999/7988] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:34:19 2022] PUT /identity/v3/projects/0c4aa04f68de423eb31659c641107a78/users/a5e086da07f44f5197ffa918f330c89c/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:19.301325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79688c-6e46-42f1-b5a1-d91b62208632 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:19.302832 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-bd2381c6-0f2f-4fa7-9b8f-f1922db063ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:19.472967 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:19.485521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79688c-6e46-42f1-b5a1-d91b62208632 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:19.494352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2381c6-0f2f-4fa7-9b8f-f1922db063ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:19.496367 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2381c6-0f2f-4fa7-9b8f-f1922db063ce service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:19.504486 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02ceca-bde5-47fe-b920-47d517b082a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:19.505127 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02ceca-bde5-47fe-b920-47d517b082a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:19.509847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02ceca-bde5-47fe-b920-47d517b082a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:19.518014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02ceca-bde5-47fe-b920-47d517b082a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:19.518775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02ceca-bde5-47fe-b920-47d517b082a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:19.520630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02ceca-bde5-47fe-b920-47d517b082a2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:19.527686 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3990/7989] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:34:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:34:19.542338 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4000/7990] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:34:19.547510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2381c6-0f2f-4fa7-9b8f-f1922db063ce service cinder] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:19.566915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2381c6-0f2f-4fa7-9b8f-f1922db063ce service cinder] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:19.574103 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3cd1da-c01d-4488-9158-effcb4db220e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:19.575000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3cd1da-c01d-4488-9158-effcb4db220e admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:19.575544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3cd1da-c01d-4488-9158-effcb4db220e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:19.576474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3cd1da-c01d-4488-9158-effcb4db220e admin admin] PATH_INFO: `/v3/projects/0c4aa04f68de423eb31659c641107a78/users/a5e086da07f44f5197ffa918f330c89c/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:19.582703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3cd1da-c01d-4488-9158-effcb4db220e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c4aa04f68de423eb31659c641107a78, user_id=a5e086da07f44f5197ffa918f330c89c, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:19.585899 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3cd1da-c01d-4488-9158-effcb4db220e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:19.612404 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3991/7991] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:34:19 2022] PUT /identity/v3/projects/0c4aa04f68de423eb31659c641107a78/users/a5e086da07f44f5197ffa918f330c89c/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:34:19.624036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987305a-6301-403a-950f-304476cb02ee None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:19.624385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987305a-6301-403a-950f-304476cb02ee None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:19.624708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987305a-6301-403a-950f-304476cb02ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:19.669174 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e987305a-6301-403a-950f-304476cb02ee None None] MFA Rules not processed for user `a5e086da07f44f5197ffa918f330c89c`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:19.670544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e987305a-6301-403a-950f-304476cb02ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:19.724462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ef61d-4060-49a2-b60f-b7cd7705f16d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:19.725044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ef61d-4060-49a2-b60f-b7cd7705f16d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:19.725595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ef61d-4060-49a2-b60f-b7cd7705f16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:19.778653 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-795ef61d-4060-49a2-b60f-b7cd7705f16d None None] MFA Rules not processed for user `ece1d6709f6d480fbaffa3b47f293dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:19.785238 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-795ef61d-4060-49a2-b60f-b7cd7705f16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:19.854939 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:19.906349 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4001/7992] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:19.907235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987305a-6301-403a-950f-304476cb02ee None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:19.908608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e987305a-6301-403a-950f-304476cb02ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:19.952191 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3992/7993] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:19.952191 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ef61d-4060-49a2-b60f-b7cd7705f16d None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:20.114248 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987305a-6301-403a-950f-304476cb02ee None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:20.136472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d459ab-6431-4967-8acd-751e447d0f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:20.137138 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d459ab-6431-4967-8acd-751e447d0f78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:20.137420 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d459ab-6431-4967-8acd-751e447d0f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:20.137724 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d459ab-6431-4967-8acd-751e447d0f78 admin admin] PATH_INFO: `/v3/projects/9463ec5771624f25aea3e6b5ecc81558` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:20.138888 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d459ab-6431-4967-8acd-751e447d0f78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9463ec5771624f25aea3e6b5ecc81558)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:20.140820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d459ab-6431-4967-8acd-751e447d0f78 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:20.157839 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ef61d-4060-49a2-b60f-b7cd7705f16d None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:20.172975 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cacb0b-29e7-4603-a1c1-6a19ff76f817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:20.174488 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cacb0b-29e7-4603-a1c1-6a19ff76f817 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:20.174775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cacb0b-29e7-4603-a1c1-6a19ff76f817 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:20.176514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cacb0b-29e7-4603-a1c1-6a19ff76f817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:20.212279 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cacb0b-29e7-4603-a1c1-6a19ff76f817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:20.216352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cacb0b-29e7-4603-a1c1-6a19ff76f817 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:20.231222 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3993/7994] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:34:19 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:34:20.248300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-30d459ab-6431-4967-8acd-751e447d0f78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9463ec5771624f25aea3e6b5ecc81558', 'request_id': 'req-30d459ab-6431-4967-8acd-751e447d0f78'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:20.268229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-30d459ab-6431-4967-8acd-751e447d0f78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9463ec5771624f25aea3e6b5ecc81558', 'request_id': 'req-30d459ab-6431-4967-8acd-751e447d0f78'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:20.276467 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-30d459ab-6431-4967-8acd-751e447d0f78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9463ec5771624f25aea3e6b5ecc81558', 'request_id': 'req-30d459ab-6431-4967-8acd-751e447d0f78'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:20.301866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-30d459ab-6431-4967-8acd-751e447d0f78 admin admin] The token cache is being invalidate because project 9463ec5771624f25aea3e6b5ecc81558 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:34:20.302352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-30d459ab-6431-4967-8acd-751e447d0f78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:20.303193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-30d459ab-6431-4967-8acd-751e447d0f78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:20.305646 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4002/7995] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:34:19 2022] DELETE /identity/v3/projects/9463ec5771624f25aea3e6b5ecc81558 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:20.311444 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141c231-2e1d-40d4-ac06-fb8e41cbd57e None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:20.311865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141c231-2e1d-40d4-ac06-fb8e41cbd57e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:20.312231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141c231-2e1d-40d4-ac06-fb8e41cbd57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:20.345783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-6141c231-2e1d-40d4-ac06-fb8e41cbd57e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:20.347448 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6141c231-2e1d-40d4-ac06-fb8e41cbd57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:20.524370 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3994/7996] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:20.526263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de695bf6-05d2-46e1-984e-3a8bcc5692ee None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:20.526564 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de695bf6-05d2-46e1-984e-3a8bcc5692ee None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:20.526846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de695bf6-05d2-46e1-984e-3a8bcc5692ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:20.566490 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-de695bf6-05d2-46e1-984e-3a8bcc5692ee None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:20.573527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-de695bf6-05d2-46e1-984e-3a8bcc5692ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:20.617157 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4003/7997] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:20.620234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141c231-2e1d-40d4-ac06-fb8e41cbd57e None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:20.633302 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141c231-2e1d-40d4-ac06-fb8e41cbd57e None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:20.652286 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44105b58-b230-409e-889b-60c96e273513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:20.653530 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44105b58-b230-409e-889b-60c96e273513 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:20.654381 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44105b58-b230-409e-889b-60c96e273513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:20.655137 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44105b58-b230-409e-889b-60c96e273513 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:20.656585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44105b58-b230-409e-889b-60c96e273513 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:34:20.658156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44105b58-b230-409e-889b-60c96e273513 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:20.665189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44105b58-b230-409e-889b-60c96e273513 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:20.720374 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3995/7998] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:34:20.728389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de695bf6-05d2-46e1-984e-3a8bcc5692ee None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:20.743536 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:20.784348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de695bf6-05d2-46e1-984e-3a8bcc5692ee None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:20.812871 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e37c67-cbde-437f-8f10-dad765e311aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:20.814093 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e37c67-cbde-437f-8f10-dad765e311aa admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:20.814670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e37c67-cbde-437f-8f10-dad765e311aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:20.815263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e37c67-cbde-437f-8f10-dad765e311aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:20.817768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e37c67-cbde-437f-8f10-dad765e311aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:20.821038 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e37c67-cbde-437f-8f10-dad765e311aa admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:20.922777 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4004/7999] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:34:20 2022] POST /identity/v3/projects => generated 369 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:34:20.926859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44105b58-b230-409e-889b-60c96e273513 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:20.951085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44105b58-b230-409e-889b-60c96e273513 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:21.088323 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:21.099011 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952a541-a091-467a-a4ab-692b3bf5f059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:21.099837 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952a541-a091-467a-a4ab-692b3bf5f059 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:21.100366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952a541-a091-467a-a4ab-692b3bf5f059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:21.100741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952a541-a091-467a-a4ab-692b3bf5f059 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:21.102125 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952a541-a091-467a-a4ab-692b3bf5f059 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:21.104669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952a541-a091-467a-a4ab-692b3bf5f059 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:21.149575 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3996/8000] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:34:20 2022] POST /identity/v3/users => generated 285 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:34:21.153848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e37c67-cbde-437f-8f10-dad765e311aa admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:21.195635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e37c67-cbde-437f-8f10-dad765e311aa admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:21.216438 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22a50e-dc0e-4051-a990-f0be89671bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:21.217079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22a50e-dc0e-4051-a990-f0be89671bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:21.217361 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22a50e-dc0e-4051-a990-f0be89671bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:21.217661 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22a50e-dc0e-4051-a990-f0be89671bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:21.218326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22a50e-dc0e-4051-a990-f0be89671bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:21.219940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22a50e-dc0e-4051-a990-f0be89671bf1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:21.267568 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4005/8001] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:34:21.271627 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952a541-a091-467a-a4ab-692b3bf5f059 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:21.287467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952a541-a091-467a-a4ab-692b3bf5f059 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:21.318187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765edf4a-da69-4722-89f9-ab3778271bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:21.319249 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765edf4a-da69-4722-89f9-ab3778271bda admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:21.329198 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765edf4a-da69-4722-89f9-ab3778271bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:21.331064 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765edf4a-da69-4722-89f9-ab3778271bda admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:21.332367 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765edf4a-da69-4722-89f9-ab3778271bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:21.340326 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765edf4a-da69-4722-89f9-ab3778271bda admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:21.422998 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3997/8002] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:34:21.427099 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22a50e-dc0e-4051-a990-f0be89671bf1 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:21.443955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22a50e-dc0e-4051-a990-f0be89671bf1 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:21.471121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd2b10-ffaa-4e5f-9e67-6f009eed9e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:21.471822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd2b10-ffaa-4e5f-9e67-6f009eed9e72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:21.481043 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd2b10-ffaa-4e5f-9e67-6f009eed9e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:21.481378 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd2b10-ffaa-4e5f-9e67-6f009eed9e72 admin admin] PATH_INFO: `/v3/projects/77742607f2704fe5ae315d4a7760528d/users/519e85ccc32f4d458cad27c45d39eacd/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:21.535542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd2b10-ffaa-4e5f-9e67-6f009eed9e72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77742607f2704fe5ae315d4a7760528d, user_id=519e85ccc32f4d458cad27c45d39eacd, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:21.541546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd2b10-ffaa-4e5f-9e67-6f009eed9e72 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:21.580389 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4006/8003] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:34:21 2022] PUT /identity/v3/projects/77742607f2704fe5ae315d4a7760528d/users/519e85ccc32f4d458cad27c45d39eacd/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:34:21.591197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45defb-def9-4767-80d6-ed359080b7b9 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:21.591197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45defb-def9-4767-80d6-ed359080b7b9 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:21.591197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45defb-def9-4767-80d6-ed359080b7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:21.691732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-db45defb-def9-4767-80d6-ed359080b7b9 None None] MFA Rules not processed for user `519e85ccc32f4d458cad27c45d39eacd`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:21.697354 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-db45defb-def9-4767-80d6-ed359080b7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:21.735983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd2b10-ffaa-4e5f-9e67-6f009eed9e72 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:21.737899 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e8dd2b10-ffaa-4e5f-9e67-6f009eed9e72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:22.021893 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd2b10-ffaa-4e5f-9e67-6f009eed9e72 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:22.034484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811cf69c-2ec7-449d-9221-2125a3891ef9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:22.035127 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cf69c-2ec7-449d-9221-2125a3891ef9 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:22.035412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cf69c-2ec7-449d-9221-2125a3891ef9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:22.035970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cf69c-2ec7-449d-9221-2125a3891ef9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:22.037732 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3998/8004] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:22.039353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45defb-def9-4767-80d6-ed359080b7b9 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:22.044479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-811cf69c-2ec7-449d-9221-2125a3891ef9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:22.105134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811cf69c-2ec7-449d-9221-2125a3891ef9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:22.107114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811cf69c-2ec7-449d-9221-2125a3891ef9 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:22.152491 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4007/8005] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:34:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:34:22.242846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45defb-def9-4767-80d6-ed359080b7b9 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:22.262485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad57e06-ae4f-4c96-ac61-5c748a64098f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:22.263039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad57e06-ae4f-4c96-ac61-5c748a64098f admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:22.263315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad57e06-ae4f-4c96-ac61-5c748a64098f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:22.263586 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad57e06-ae4f-4c96-ac61-5c748a64098f admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:22.264231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad57e06-ae4f-4c96-ac61-5c748a64098f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:22.266191 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad57e06-ae4f-4c96-ac61-5c748a64098f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:22.353250 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 3999/8006] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:34:22 2022] POST /identity/v3/projects => generated 369 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:34:22.358108 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811cf69c-2ec7-449d-9221-2125a3891ef9 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:22.388328 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811cf69c-2ec7-449d-9221-2125a3891ef9 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:22.545268 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fa1f3-e610-4d6a-90af-1e570f28b1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:22.546269 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fa1f3-e610-4d6a-90af-1e570f28b1ed admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:22.546547 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fa1f3-e610-4d6a-90af-1e570f28b1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:22.546824 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fa1f3-e610-4d6a-90af-1e570f28b1ed admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:22.547803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fa1f3-e610-4d6a-90af-1e570f28b1ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:22.550753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fa1f3-e610-4d6a-90af-1e570f28b1ed admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:22.585030 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4008/8007] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:34:22 2022] POST /identity/v3/users => generated 291 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:34:22.589689 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad57e06-ae4f-4c96-ac61-5c748a64098f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:22.604253 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad57e06-ae4f-4c96-ac61-5c748a64098f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:22.612513 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e800381-971e-4ca2-87c8-341870985140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:22.614187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e800381-971e-4ca2-87c8-341870985140 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:22.614537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e800381-971e-4ca2-87c8-341870985140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:22.615202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e800381-971e-4ca2-87c8-341870985140 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:22.615940 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e800381-971e-4ca2-87c8-341870985140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:22.617905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e800381-971e-4ca2-87c8-341870985140 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:22.644051 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4000/8008] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:34:22.649121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fa1f3-e610-4d6a-90af-1e570f28b1ed admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:22.660839 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fa1f3-e610-4d6a-90af-1e570f28b1ed admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:22.670383 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63868d5b-37aa-40f7-bffe-dae3a131ccb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:22.671082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63868d5b-37aa-40f7-bffe-dae3a131ccb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:22.671367 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63868d5b-37aa-40f7-bffe-dae3a131ccb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:22.671773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63868d5b-37aa-40f7-bffe-dae3a131ccb6 admin admin] PATH_INFO: `/v3/projects/32afb8a03803440aaa761dbe0c35da3f/users/81ba22a004ec4d85ba56f9385aa9e644/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:22.713335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63868d5b-37aa-40f7-bffe-dae3a131ccb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32afb8a03803440aaa761dbe0c35da3f, user_id=81ba22a004ec4d85ba56f9385aa9e644, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:22.720042 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63868d5b-37aa-40f7-bffe-dae3a131ccb6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:22.769150 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4009/8009] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:34:22 2022] PUT /identity/v3/projects/32afb8a03803440aaa761dbe0c35da3f/users/81ba22a004ec4d85ba56f9385aa9e644/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:22.769981 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e800381-971e-4ca2-87c8-341870985140 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:22.783415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e800381-971e-4ca2-87c8-341870985140 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:22.908318 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:22.933089 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95cf68-9e30-4215-9cab-f0eecdc2629b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:22.933756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95cf68-9e30-4215-9cab-f0eecdc2629b admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:22.934040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95cf68-9e30-4215-9cab-f0eecdc2629b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:22.936382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95cf68-9e30-4215-9cab-f0eecdc2629b admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:22.941265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95cf68-9e30-4215-9cab-f0eecdc2629b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:22.942972 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95cf68-9e30-4215-9cab-f0eecdc2629b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:22.958605 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4001/8010] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:34:22.963576 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63868d5b-37aa-40f7-bffe-dae3a131ccb6 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:22.979211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63868d5b-37aa-40f7-bffe-dae3a131ccb6 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:22.986060 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fa406-5e57-471d-9bc4-9b61c8453dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:22.987451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fa406-5e57-471d-9bc4-9b61c8453dc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:22.987794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fa406-5e57-471d-9bc4-9b61c8453dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:22.988378 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fa406-5e57-471d-9bc4-9b61c8453dc4 admin admin] PATH_INFO: `/v3/projects/32afb8a03803440aaa761dbe0c35da3f/users/81ba22a004ec4d85ba56f9385aa9e644/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:22.997774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8fa406-5e57-471d-9bc4-9b61c8453dc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32afb8a03803440aaa761dbe0c35da3f, user_id=81ba22a004ec4d85ba56f9385aa9e644, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:23.003204 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8fa406-5e57-471d-9bc4-9b61c8453dc4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:23.026703 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:23.047017 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4010/8011] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:34:22 2022] PUT /identity/v3/projects/32afb8a03803440aaa761dbe0c35da3f/users/81ba22a004ec4d85ba56f9385aa9e644/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:23.050340 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bdb76-0280-44e5-a5e5-0cbf276b7c41 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:23.051587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bdb76-0280-44e5-a5e5-0cbf276b7c41 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:23.052272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bdb76-0280-44e5-a5e5-0cbf276b7c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:23.120096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-0e2bdb76-0280-44e5-a5e5-0cbf276b7c41 None None] MFA Rules not processed for user `81ba22a004ec4d85ba56f9385aa9e644`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:23.124923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0e2bdb76-0280-44e5-a5e5-0cbf276b7c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:23.272003 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4002/8012] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:23.281582 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fa406-5e57-471d-9bc4-9b61c8453dc4 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:23.284554 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4b8fa406-5e57-471d-9bc4-9b61c8453dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:23.379297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fa406-5e57-471d-9bc4-9b61c8453dc4 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:23.389989 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d48a04-ad89-4a2c-99a4-33d17bf7ca01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:23.392019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d48a04-ad89-4a2c-99a4-33d17bf7ca01 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:23.393011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d48a04-ad89-4a2c-99a4-33d17bf7ca01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:23.393291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d48a04-ad89-4a2c-99a4-33d17bf7ca01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:23.419485 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d48a04-ad89-4a2c-99a4-33d17bf7ca01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:23.422743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d48a04-ad89-4a2c-99a4-33d17bf7ca01 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:23.473284 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4011/8013] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:34:23 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:34:25.044708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2bdb76-0280-44e5-a5e5-0cbf276b7c41 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:25.046208 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0e2bdb76-0280-44e5-a5e5-0cbf276b7c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:25.306070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2bdb76-0280-44e5-a5e5-0cbf276b7c41 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:25.323069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7d5c5-12f4-462d-a9a1-f0aab218e186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:25.323738 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7d5c5-12f4-462d-a9a1-f0aab218e186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:25.324019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7d5c5-12f4-462d-a9a1-f0aab218e186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:25.324304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7d5c5-12f4-462d-a9a1-f0aab218e186 admin admin] PATH_INFO: `/v3/users/9f49bf9fa8fc41a69868cf660f4d3af6` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:25.325487 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c7d5c5-12f4-462d-a9a1-f0aab218e186 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f49bf9fa8fc41a69868cf660f4d3af6)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:25.327650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c7d5c5-12f4-462d-a9a1-f0aab218e186 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:25.462039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c5c7d5c5-12f4-462d-a9a1-f0aab218e186 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f49bf9fa8fc41a69868cf660f4d3af6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:25.463134 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c5c7d5c5-12f4-462d-a9a1-f0aab218e186 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f49bf9fa8fc41a69868cf660f4d3af6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:25.486459 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c5c7d5c5-12f4-462d-a9a1-f0aab218e186 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f49bf9fa8fc41a69868cf660f4d3af6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:25.510126 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c5c7d5c5-12f4-462d-a9a1-f0aab218e186 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f49bf9fa8fc41a69868cf660f4d3af6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:25.511192 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c5c7d5c5-12f4-462d-a9a1-f0aab218e186 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f49bf9fa8fc41a69868cf660f4d3af6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:25.513074 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:25.556837 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4003/8014] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:34:25 2022] DELETE /identity/v3/users/9f49bf9fa8fc41a69868cf660f4d3af6 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:25.561213 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f393f72-8fd0-4e84-a4cf-54a2a5b27ee3 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:25.561831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f393f72-8fd0-4e84-a4cf-54a2a5b27ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:25.562042 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f393f72-8fd0-4e84-a4cf-54a2a5b27ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:25.601954 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-6f393f72-8fd0-4e84-a4cf-54a2a5b27ee3 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:25.610352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6f393f72-8fd0-4e84-a4cf-54a2a5b27ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:25.808177 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4012/8015] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:25.832011 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7d5c5-12f4-462d-a9a1-f0aab218e186 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:25.833739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c5c7d5c5-12f4-462d-a9a1-f0aab218e186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:25.970096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7d5c5-12f4-462d-a9a1-f0aab218e186 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:25.976217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988265f-359e-43c7-a3cb-44d42382c473 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:25.976921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988265f-359e-43c7-a3cb-44d42382c473 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:25.977265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988265f-359e-43c7-a3cb-44d42382c473 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:25.977626 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988265f-359e-43c7-a3cb-44d42382c473 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:26.004409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988265f-359e-43c7-a3cb-44d42382c473 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:26.006168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988265f-359e-43c7-a3cb-44d42382c473 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:26.022395 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4004/8016] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:34:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:34:27.271359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f393f72-8fd0-4e84-a4cf-54a2a5b27ee3 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:27.272886 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6f393f72-8fd0-4e84-a4cf-54a2a5b27ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:27.293093 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f393f72-8fd0-4e84-a4cf-54a2a5b27ee3 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:27.304480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1d793-5ac8-4933-8336-1ce516673dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:27.305148 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1d793-5ac8-4933-8336-1ce516673dc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:27.305450 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1d793-5ac8-4933-8336-1ce516673dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:27.305735 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1d793-5ac8-4933-8336-1ce516673dc8 admin admin] PATH_INFO: `/v3/projects/b6c11c4f63a843a1975bf2cd98147b3e` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:27.306900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b1d793-5ac8-4933-8336-1ce516673dc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6c11c4f63a843a1975bf2cd98147b3e)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:27.313308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b1d793-5ac8-4933-8336-1ce516673dc8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:27.427602 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-15b1d793-5ac8-4933-8336-1ce516673dc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6c11c4f63a843a1975bf2cd98147b3e', 'request_id': 'req-15b1d793-5ac8-4933-8336-1ce516673dc8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:27.469571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-15b1d793-5ac8-4933-8336-1ce516673dc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6c11c4f63a843a1975bf2cd98147b3e', 'request_id': 'req-15b1d793-5ac8-4933-8336-1ce516673dc8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:27.495362 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-15b1d793-5ac8-4933-8336-1ce516673dc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6c11c4f63a843a1975bf2cd98147b3e', 'request_id': 'req-15b1d793-5ac8-4933-8336-1ce516673dc8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:27.511059 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-15b1d793-5ac8-4933-8336-1ce516673dc8 admin admin] The token cache is being invalidate because project b6c11c4f63a843a1975bf2cd98147b3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:34:27.511620 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-15b1d793-5ac8-4933-8336-1ce516673dc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:27.512502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-15b1d793-5ac8-4933-8336-1ce516673dc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:27.514571 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4013/8017] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:34:27 2022] DELETE /identity/v3/projects/b6c11c4f63a843a1975bf2cd98147b3e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:27.518294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988265f-359e-43c7-a3cb-44d42382c473 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:27.533490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988265f-359e-43c7-a3cb-44d42382c473 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:27.649166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787172c-b711-4fc1-855e-e635f1dee9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:27.649854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787172c-b711-4fc1-855e-e635f1dee9f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:27.650134 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787172c-b711-4fc1-855e-e635f1dee9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:27.650408 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787172c-b711-4fc1-855e-e635f1dee9f1 admin admin] PATH_INFO: `/v3/users/a5e086da07f44f5197ffa918f330c89c` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:27.654601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787172c-b711-4fc1-855e-e635f1dee9f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5e086da07f44f5197ffa918f330c89c)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:27.656858 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787172c-b711-4fc1-855e-e635f1dee9f1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:27.781086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5787172c-b711-4fc1-855e-e635f1dee9f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5e086da07f44f5197ffa918f330c89c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:27.783368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5787172c-b711-4fc1-855e-e635f1dee9f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5e086da07f44f5197ffa918f330c89c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:27.795269 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5787172c-b711-4fc1-855e-e635f1dee9f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5e086da07f44f5197ffa918f330c89c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:27.812724 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5787172c-b711-4fc1-855e-e635f1dee9f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5e086da07f44f5197ffa918f330c89c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:27.813586 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5787172c-b711-4fc1-855e-e635f1dee9f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5e086da07f44f5197ffa918f330c89c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:27.847384 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4005/8018] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:34:27 2022] DELETE /identity/v3/users/a5e086da07f44f5197ffa918f330c89c => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:28.521549 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1d793-5ac8-4933-8336-1ce516673dc8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:28.523589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-15b1d793-5ac8-4933-8336-1ce516673dc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:28.546473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1d793-5ac8-4933-8336-1ce516673dc8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:28.599452 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:28.661546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ccca15-1a01-4a63-8df8-172ad4062f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:28.662773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ccca15-1a01-4a63-8df8-172ad4062f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:28.671161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ccca15-1a01-4a63-8df8-172ad4062f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:28.671834 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ccca15-1a01-4a63-8df8-172ad4062f7d admin admin] PATH_INFO: `/v3/users/4027d233553b47c5888b89cef58c1eb8` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:28.675509 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ccca15-1a01-4a63-8df8-172ad4062f7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4027d233553b47c5888b89cef58c1eb8)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:28.679431 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ccca15-1a01-4a63-8df8-172ad4062f7d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:28.795392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-58ccca15-1a01-4a63-8df8-172ad4062f7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4027d233553b47c5888b89cef58c1eb8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:28.796523 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-58ccca15-1a01-4a63-8df8-172ad4062f7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4027d233553b47c5888b89cef58c1eb8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:28.807062 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-58ccca15-1a01-4a63-8df8-172ad4062f7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4027d233553b47c5888b89cef58c1eb8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:28.813787 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787172c-b711-4fc1-855e-e635f1dee9f1 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:28.815919 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5787172c-b711-4fc1-855e-e635f1dee9f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:28.828927 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-58ccca15-1a01-4a63-8df8-172ad4062f7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4027d233553b47c5888b89cef58c1eb8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:28.831234 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-58ccca15-1a01-4a63-8df8-172ad4062f7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4027d233553b47c5888b89cef58c1eb8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:28.834252 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:28.854003 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787172c-b711-4fc1-855e-e635f1dee9f1 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:28.869075 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6afe0-17f4-42dd-a9cb-5cfa65a114c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:28.871060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6afe0-17f4-42dd-a9cb-5cfa65a114c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:28.872304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6afe0-17f4-42dd-a9cb-5cfa65a114c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:28.874025 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6afe0-17f4-42dd-a9cb-5cfa65a114c1 admin admin] PATH_INFO: `/v3/projects/0c4aa04f68de423eb31659c641107a78` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:28.876140 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6afe0-17f4-42dd-a9cb-5cfa65a114c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c4aa04f68de423eb31659c641107a78)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:28.880285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6afe0-17f4-42dd-a9cb-5cfa65a114c1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:28.889801 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4014/8019] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:34:28 2022] DELETE /identity/v3/users/4027d233553b47c5888b89cef58c1eb8 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:28.891501 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88929f4-5171-475f-b152-29749c15f67e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:28.892734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88929f4-5171-475f-b152-29749c15f67e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:28.895000 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88929f4-5171-475f-b152-29749c15f67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:28.928504 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c88929f4-5171-475f-b152-29749c15f67e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:28.930870 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c88929f4-5171-475f-b152-29749c15f67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:29.019146 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-98c6afe0-17f4-42dd-a9cb-5cfa65a114c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c4aa04f68de423eb31659c641107a78', 'request_id': 'req-98c6afe0-17f4-42dd-a9cb-5cfa65a114c1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:29.038046 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-98c6afe0-17f4-42dd-a9cb-5cfa65a114c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c4aa04f68de423eb31659c641107a78', 'request_id': 'req-98c6afe0-17f4-42dd-a9cb-5cfa65a114c1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:29.045727 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-98c6afe0-17f4-42dd-a9cb-5cfa65a114c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c4aa04f68de423eb31659c641107a78', 'request_id': 'req-98c6afe0-17f4-42dd-a9cb-5cfa65a114c1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:29.055429 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4015/8020] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:29.065424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88929f4-5171-475f-b152-29749c15f67e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:29.068031 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c88929f4-5171-475f-b152-29749c15f67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:29.073755 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-98c6afe0-17f4-42dd-a9cb-5cfa65a114c1 admin admin] The token cache is being invalidate because project 0c4aa04f68de423eb31659c641107a78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:34:29.074349 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-98c6afe0-17f4-42dd-a9cb-5cfa65a114c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:29.075185 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-98c6afe0-17f4-42dd-a9cb-5cfa65a114c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:29.076851 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4006/8021] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:34:28 2022] DELETE /identity/v3/projects/0c4aa04f68de423eb31659c641107a78 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:29.085821 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41bb27-10bb-481d-a90c-e489fda40700 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:29.086374 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41bb27-10bb-481d-a90c-e489fda40700 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:29.086812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41bb27-10bb-481d-a90c-e489fda40700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:29.134679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-2f41bb27-10bb-481d-a90c-e489fda40700 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:29.136170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2f41bb27-10bb-481d-a90c-e489fda40700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:29.158889 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:29.171218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88929f4-5171-475f-b152-29749c15f67e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:29.250719 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4007/8022] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:29.253366 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15b66d-26d0-45c0-87d2-8ef3acff40b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:29.254552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15b66d-26d0-45c0-87d2-8ef3acff40b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:29.255016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15b66d-26d0-45c0-87d2-8ef3acff40b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:29.255518 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15b66d-26d0-45c0-87d2-8ef3acff40b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:29.258757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2c15b66d-26d0-45c0-87d2-8ef3acff40b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:29.258986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6c2e0-0743-4972-973e-318ecd80a8ae None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:29.259272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6c2e0-0743-4972-973e-318ecd80a8ae None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:29.259550 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6c2e0-0743-4972-973e-318ecd80a8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:29.275093 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15b66d-26d0-45c0-87d2-8ef3acff40b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:29.276971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15b66d-26d0-45c0-87d2-8ef3acff40b1 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:29.301354 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4016/8023] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:34:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:34:29.303519 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-f4a6c2e0-0743-4972-973e-318ecd80a8ae None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:29.304762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f4a6c2e0-0743-4972-973e-318ecd80a8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:29.330385 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4008/8024] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:34:29.335889 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15b66d-26d0-45c0-87d2-8ef3acff40b1 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:29.355939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15b66d-26d0-45c0-87d2-8ef3acff40b1 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:29.372950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710b362-d1fb-4c5c-9eb2-917c6fdda4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:29.375360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710b362-d1fb-4c5c-9eb2-917c6fdda4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:29.375643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710b362-d1fb-4c5c-9eb2-917c6fdda4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:29.377237 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710b362-d1fb-4c5c-9eb2-917c6fdda4c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:29.379411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710b362-d1fb-4c5c-9eb2-917c6fdda4c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:34:29.380644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710b362-d1fb-4c5c-9eb2-917c6fdda4c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:29.388763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710b362-d1fb-4c5c-9eb2-917c6fdda4c4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:29.418331 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4017/8025] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:34:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:34:29.423131 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6c2e0-0743-4972-973e-318ecd80a8ae None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:29.437741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6c2e0-0743-4972-973e-318ecd80a8ae None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:29.462154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157514a0-0aa2-43af-bb1a-ea846e8539a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:29.463023 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157514a0-0aa2-43af-bb1a-ea846e8539a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:29.463560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157514a0-0aa2-43af-bb1a-ea846e8539a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:29.463893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157514a0-0aa2-43af-bb1a-ea846e8539a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:29.464884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157514a0-0aa2-43af-bb1a-ea846e8539a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:29.467056 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157514a0-0aa2-43af-bb1a-ea846e8539a1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:29.560447 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4009/8026] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:34:29 2022] POST /identity/v3/projects => generated 371 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:34:29.565227 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710b362-d1fb-4c5c-9eb2-917c6fdda4c4 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:29.586502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710b362-d1fb-4c5c-9eb2-917c6fdda4c4 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:29.708643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd4bad-1a96-4e2d-bed6-8a3f44bf2d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:29.711009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd4bad-1a96-4e2d-bed6-8a3f44bf2d69 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:29.711414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd4bad-1a96-4e2d-bed6-8a3f44bf2d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:29.711819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd4bad-1a96-4e2d-bed6-8a3f44bf2d69 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:29.712730 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd4bad-1a96-4e2d-bed6-8a3f44bf2d69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:29.720752 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd4bad-1a96-4e2d-bed6-8a3f44bf2d69 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:29.763485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157514a0-0aa2-43af-bb1a-ea846e8539a1 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:29.763702 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4018/8027] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:34:29 2022] POST /identity/v3/users => generated 286 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:34:29.778635 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157514a0-0aa2-43af-bb1a-ea846e8539a1 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:29.806306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc10cf-ec9f-42e1-bfe9-db6552a9bd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:29.807697 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc10cf-ec9f-42e1-bfe9-db6552a9bd25 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:29.808071 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc10cf-ec9f-42e1-bfe9-db6552a9bd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:29.808521 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc10cf-ec9f-42e1-bfe9-db6552a9bd25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:29.811988 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc10cf-ec9f-42e1-bfe9-db6552a9bd25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:29.816095 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc10cf-ec9f-42e1-bfe9-db6552a9bd25 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:29.843492 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd4bad-1a96-4e2d-bed6-8a3f44bf2d69 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:29.844447 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4010/8028] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:34:29.864157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd4bad-1a96-4e2d-bed6-8a3f44bf2d69 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:29.878761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836843a-aac9-4e13-8ed7-4642e5333ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:29.879408 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836843a-aac9-4e13-8ed7-4642e5333ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:29.879691 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836843a-aac9-4e13-8ed7-4642e5333ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:29.879968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836843a-aac9-4e13-8ed7-4642e5333ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:29.880729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836843a-aac9-4e13-8ed7-4642e5333ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:29.883014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836843a-aac9-4e13-8ed7-4642e5333ed1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:29.909588 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4019/8029] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:34:29.912112 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc10cf-ec9f-42e1-bfe9-db6552a9bd25 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:29.928005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc10cf-ec9f-42e1-bfe9-db6552a9bd25 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:29.952291 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf45bcb-b312-4442-b7f4-43f124fcccc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:29.953598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf45bcb-b312-4442-b7f4-43f124fcccc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:29.953987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf45bcb-b312-4442-b7f4-43f124fcccc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:29.954483 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf45bcb-b312-4442-b7f4-43f124fcccc2 admin admin] PATH_INFO: `/v3/projects/39d32337b9d740a4b6ead4518b07cf0f/users/c5a9048a62ce4fe7a4dd29e7c40daaad/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:29.980492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf45bcb-b312-4442-b7f4-43f124fcccc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39d32337b9d740a4b6ead4518b07cf0f, user_id=c5a9048a62ce4fe7a4dd29e7c40daaad, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:29.990938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf45bcb-b312-4442-b7f4-43f124fcccc2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:29.993901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836843a-aac9-4e13-8ed7-4642e5333ed1 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:29.996283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f836843a-aac9-4e13-8ed7-4642e5333ed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:30.024474 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4011/8030] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:34:29 2022] PUT /identity/v3/projects/39d32337b9d740a4b6ead4518b07cf0f/users/c5a9048a62ce4fe7a4dd29e7c40daaad/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:30.035180 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7138759-fda6-48c6-a8dc-1d50e2934e29 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:30.035465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7138759-fda6-48c6-a8dc-1d50e2934e29 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:30.035733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7138759-fda6-48c6-a8dc-1d50e2934e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:30.064821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836843a-aac9-4e13-8ed7-4642e5333ed1 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:30.096711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e7138759-fda6-48c6-a8dc-1d50e2934e29 None None] MFA Rules not processed for user `c5a9048a62ce4fe7a4dd29e7c40daaad`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:30.097981 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e7138759-fda6-48c6-a8dc-1d50e2934e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:30.121242 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:30.185773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec1b0a-b96d-4c14-aa02-60f217d1ee1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:30.186493 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec1b0a-b96d-4c14-aa02-60f217d1ee1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:30.186781 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec1b0a-b96d-4c14-aa02-60f217d1ee1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:30.187106 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec1b0a-b96d-4c14-aa02-60f217d1ee1e admin admin] PATH_INFO: `/v3/projects/00cb2d7dffc245279973812f8d180bc2` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:30.188573 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec1b0a-b96d-4c14-aa02-60f217d1ee1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=00cb2d7dffc245279973812f8d180bc2)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:30.190553 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec1b0a-b96d-4c14-aa02-60f217d1ee1e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:30.204319 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:30.233816 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4012/8031] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:30.245752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7138759-fda6-48c6-a8dc-1d50e2934e29 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:30.250356 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e7138759-fda6-48c6-a8dc-1d50e2934e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:30.265604 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4aec1b0a-b96d-4c14-aa02-60f217d1ee1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00cb2d7dffc245279973812f8d180bc2', 'request_id': 'req-4aec1b0a-b96d-4c14-aa02-60f217d1ee1e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:30.280969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4aec1b0a-b96d-4c14-aa02-60f217d1ee1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00cb2d7dffc245279973812f8d180bc2', 'request_id': 'req-4aec1b0a-b96d-4c14-aa02-60f217d1ee1e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:30.290119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4aec1b0a-b96d-4c14-aa02-60f217d1ee1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00cb2d7dffc245279973812f8d180bc2', 'request_id': 'req-4aec1b0a-b96d-4c14-aa02-60f217d1ee1e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:30.311561 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4aec1b0a-b96d-4c14-aa02-60f217d1ee1e admin admin] The token cache is being invalidate because project 00cb2d7dffc245279973812f8d180bc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:34:30.311771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4aec1b0a-b96d-4c14-aa02-60f217d1ee1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:30.314139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4aec1b0a-b96d-4c14-aa02-60f217d1ee1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:30.316197 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4020/8032] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:34:29 2022] DELETE /identity/v3/projects/00cb2d7dffc245279973812f8d180bc2 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:30.320181 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec1b0a-b96d-4c14-aa02-60f217d1ee1e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:30.325609 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4aec1b0a-b96d-4c14-aa02-60f217d1ee1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:30.372389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7138759-fda6-48c6-a8dc-1d50e2934e29 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:30.460903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec1b0a-b96d-4c14-aa02-60f217d1ee1e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:30.467799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388dbe92-e6d4-4ee2-93cb-7e239fc8d52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:30.468484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dbe92-e6d4-4ee2-93cb-7e239fc8d52e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:30.468954 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dbe92-e6d4-4ee2-93cb-7e239fc8d52e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:30.469239 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dbe92-e6d4-4ee2-93cb-7e239fc8d52e admin admin] PATH_INFO: `/v3/users/5631fce37f4c4e5d87ed64ae22fe3081` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:30.470674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388dbe92-e6d4-4ee2-93cb-7e239fc8d52e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5631fce37f4c4e5d87ed64ae22fe3081)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:30.474727 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388dbe92-e6d4-4ee2-93cb-7e239fc8d52e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:30.511162 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093b381-bd10-4dfa-bcdf-d40a4fb96bf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:30.512506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093b381-bd10-4dfa-bcdf-d40a4fb96bf6 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:30.513001 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093b381-bd10-4dfa-bcdf-d40a4fb96bf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:30.513388 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093b381-bd10-4dfa-bcdf-d40a4fb96bf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:30.516254 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2093b381-bd10-4dfa-bcdf-d40a4fb96bf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:30.558821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-388dbe92-e6d4-4ee2-93cb-7e239fc8d52e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5631fce37f4c4e5d87ed64ae22fe3081'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:30.559543 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-388dbe92-e6d4-4ee2-93cb-7e239fc8d52e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5631fce37f4c4e5d87ed64ae22fe3081'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:30.570716 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-388dbe92-e6d4-4ee2-93cb-7e239fc8d52e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5631fce37f4c4e5d87ed64ae22fe3081'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:30.584541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-388dbe92-e6d4-4ee2-93cb-7e239fc8d52e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5631fce37f4c4e5d87ed64ae22fe3081'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:30.587483 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-388dbe92-e6d4-4ee2-93cb-7e239fc8d52e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5631fce37f4c4e5d87ed64ae22fe3081'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:30.620047 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4021/8033] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:34:30 2022] DELETE /identity/v3/users/5631fce37f4c4e5d87ed64ae22fe3081 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:34:30.645790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093b381-bd10-4dfa-bcdf-d40a4fb96bf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:30.648401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093b381-bd10-4dfa-bcdf-d40a4fb96bf6 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:30.661278 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4013/8034] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:34:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:34:31.911662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388dbe92-e6d4-4ee2-93cb-7e239fc8d52e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:31.913848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-388dbe92-e6d4-4ee2-93cb-7e239fc8d52e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:31.958921 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:32.071458 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388dbe92-e6d4-4ee2-93cb-7e239fc8d52e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:32.099642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a6f19-42f0-443f-a844-cefd674095b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:32.103950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a6f19-42f0-443f-a844-cefd674095b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:32.104240 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a6f19-42f0-443f-a844-cefd674095b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:32.104518 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a6f19-42f0-443f-a844-cefd674095b2 admin admin] PATH_INFO: `/v3/projects/f2d17948629e47349888c4d6fc59685c` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:32.107192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a6f19-42f0-443f-a844-cefd674095b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2d17948629e47349888c4d6fc59685c)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:32.112466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a6f19-42f0-443f-a844-cefd674095b2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:32.244780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-420a6f19-42f0-443f-a844-cefd674095b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2d17948629e47349888c4d6fc59685c', 'request_id': 'req-420a6f19-42f0-443f-a844-cefd674095b2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:32.262439 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-420a6f19-42f0-443f-a844-cefd674095b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2d17948629e47349888c4d6fc59685c', 'request_id': 'req-420a6f19-42f0-443f-a844-cefd674095b2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:32.274085 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-420a6f19-42f0-443f-a844-cefd674095b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2d17948629e47349888c4d6fc59685c', 'request_id': 'req-420a6f19-42f0-443f-a844-cefd674095b2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:32.296006 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-420a6f19-42f0-443f-a844-cefd674095b2 admin admin] The token cache is being invalidate because project f2d17948629e47349888c4d6fc59685c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:34:32.296802 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-420a6f19-42f0-443f-a844-cefd674095b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:32.298292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-420a6f19-42f0-443f-a844-cefd674095b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:32.301093 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4022/8035] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:34:31 2022] DELETE /identity/v3/projects/f2d17948629e47349888c4d6fc59685c => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:32.306628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abb88a-e172-47ea-9859-04fcfbf8f893 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:32.307177 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abb88a-e172-47ea-9859-04fcfbf8f893 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:32.307286 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abb88a-e172-47ea-9859-04fcfbf8f893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:32.337212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-08abb88a-e172-47ea-9859-04fcfbf8f893 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:32.340387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-08abb88a-e172-47ea-9859-04fcfbf8f893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:32.368956 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:32.479026 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4014/8036] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:32.486160 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a346b-1ecd-4412-9f57-0913488500a2 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:32.486731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a346b-1ecd-4412-9f57-0913488500a2 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:32.487482 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a346b-1ecd-4412-9f57-0913488500a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:32.537312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5a0a346b-1ecd-4412-9f57-0913488500a2 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:32.540091 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5a0a346b-1ecd-4412-9f57-0913488500a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:32.566661 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4023/8037] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:32.571545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abb88a-e172-47ea-9859-04fcfbf8f893 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:32.584319 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abb88a-e172-47ea-9859-04fcfbf8f893 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:32.593831 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02409e4-afeb-47b2-8a82-e6067b5f01c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:32.594545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02409e4-afeb-47b2-8a82-e6067b5f01c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:32.594545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02409e4-afeb-47b2-8a82-e6067b5f01c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:32.595038 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02409e4-afeb-47b2-8a82-e6067b5f01c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:32.595528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02409e4-afeb-47b2-8a82-e6067b5f01c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:34:32.596265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02409e4-afeb-47b2-8a82-e6067b5f01c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:32.597673 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02409e4-afeb-47b2-8a82-e6067b5f01c0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:32.622974 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4015/8038] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:34:32.627956 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a346b-1ecd-4412-9f57-0913488500a2 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:32.647694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a346b-1ecd-4412-9f57-0913488500a2 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:32.654733 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ef5fc-68f3-459d-b9c4-7f9f72f86aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:32.655746 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ef5fc-68f3-459d-b9c4-7f9f72f86aa6 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:32.656504 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ef5fc-68f3-459d-b9c4-7f9f72f86aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:32.657329 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ef5fc-68f3-459d-b9c4-7f9f72f86aa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:32.658652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ef5fc-68f3-459d-b9c4-7f9f72f86aa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:32.661179 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ef5fc-68f3-459d-b9c4-7f9f72f86aa6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:32.714030 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4024/8039] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:34:32 2022] POST /identity/v3/projects => generated 365 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:34:32.718211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02409e4-afeb-47b2-8a82-e6067b5f01c0 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:32.737578 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02409e4-afeb-47b2-8a82-e6067b5f01c0 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:32.830896 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aecfc39-3e32-4122-8264-45980995992a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:32.832452 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecfc39-3e32-4122-8264-45980995992a admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:32.832983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecfc39-3e32-4122-8264-45980995992a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:32.833612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecfc39-3e32-4122-8264-45980995992a admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:32.834597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aecfc39-3e32-4122-8264-45980995992a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:32.837114 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aecfc39-3e32-4122-8264-45980995992a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:32.885622 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4016/8040] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:34:32 2022] POST /identity/v3/users => generated 283 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:34:32.887181 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ef5fc-68f3-459d-b9c4-7f9f72f86aa6 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:32.904450 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ef5fc-68f3-459d-b9c4-7f9f72f86aa6 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:32.923033 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c09531-af9b-41ec-b53c-59e44d28eaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:32.924567 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c09531-af9b-41ec-b53c-59e44d28eaf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:32.925035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c09531-af9b-41ec-b53c-59e44d28eaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:32.925520 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c09531-af9b-41ec-b53c-59e44d28eaf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:32.926555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c09531-af9b-41ec-b53c-59e44d28eaf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:32.934281 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c09531-af9b-41ec-b53c-59e44d28eaf8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:32.953040 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4025/8041] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:34:32.953636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aecfc39-3e32-4122-8264-45980995992a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:32.964393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aecfc39-3e32-4122-8264-45980995992a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:32.969240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444a850-b6ac-4a17-b978-e9db2a0d8442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:32.969911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444a850-b6ac-4a17-b978-e9db2a0d8442 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:32.970188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444a850-b6ac-4a17-b978-e9db2a0d8442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:32.970460 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444a850-b6ac-4a17-b978-e9db2a0d8442 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:32.971109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b444a850-b6ac-4a17-b978-e9db2a0d8442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:32.972754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b444a850-b6ac-4a17-b978-e9db2a0d8442 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:32.984594 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4017/8042] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:34:32.989724 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c09531-af9b-41ec-b53c-59e44d28eaf8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:33.001524 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c09531-af9b-41ec-b53c-59e44d28eaf8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:33.007208 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9bf16-41b7-43cc-8208-4c1d9de54b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:33.008305 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9bf16-41b7-43cc-8208-4c1d9de54b05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:33.008591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9bf16-41b7-43cc-8208-4c1d9de54b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:33.009021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9bf16-41b7-43cc-8208-4c1d9de54b05 admin admin] PATH_INFO: `/v3/projects/7afa64c9133b4e58a21724036ff210b3/users/18cd2269e636463f88b5f9d0be72cde1/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:33.026815 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd9bf16-41b7-43cc-8208-4c1d9de54b05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7afa64c9133b4e58a21724036ff210b3, user_id=18cd2269e636463f88b5f9d0be72cde1, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:33.029731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd9bf16-41b7-43cc-8208-4c1d9de54b05 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:33.060052 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4026/8043] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:34:32 2022] PUT /identity/v3/projects/7afa64c9133b4e58a21724036ff210b3/users/18cd2269e636463f88b5f9d0be72cde1/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:33.061277 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853aa10-c14f-43c6-aadc-eae1392b64c0 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:33.061609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853aa10-c14f-43c6-aadc-eae1392b64c0 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:33.061890 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853aa10-c14f-43c6-aadc-eae1392b64c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:33.103886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-5853aa10-c14f-43c6-aadc-eae1392b64c0 None None] MFA Rules not processed for user `18cd2269e636463f88b5f9d0be72cde1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:33.105187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5853aa10-c14f-43c6-aadc-eae1392b64c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:33.193408 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4018/8044] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:33.207479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9bf16-41b7-43cc-8208-4c1d9de54b05 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:33.211981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-acd9bf16-41b7-43cc-8208-4c1d9de54b05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:33.286005 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:33.296806 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9bf16-41b7-43cc-8208-4c1d9de54b05 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:33.302031 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2962b5a-bd6f-40ce-89db-5d6b22effbbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:33.302890 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2962b5a-bd6f-40ce-89db-5d6b22effbbe service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:33.303553 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2962b5a-bd6f-40ce-89db-5d6b22effbbe service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:33.304165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2962b5a-bd6f-40ce-89db-5d6b22effbbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:33.315066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2962b5a-bd6f-40ce-89db-5d6b22effbbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:33.316834 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2962b5a-bd6f-40ce-89db-5d6b22effbbe service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:33.327870 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4027/8045] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:34:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:34:34.376042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853aa10-c14f-43c6-aadc-eae1392b64c0 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:34.378541 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5853aa10-c14f-43c6-aadc-eae1392b64c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:34.412525 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:34.544713 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853aa10-c14f-43c6-aadc-eae1392b64c0 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:34.551936 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72539873-23b1-465b-8572-d68988b071d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:34.552849 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72539873-23b1-465b-8572-d68988b071d9 service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:34.553184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72539873-23b1-465b-8572-d68988b071d9 service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:34.553930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72539873-23b1-465b-8572-d68988b071d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:34.555809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-72539873-23b1-465b-8572-d68988b071d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:34.577143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72539873-23b1-465b-8572-d68988b071d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:34.578861 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72539873-23b1-465b-8572-d68988b071d9 service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:34.618840 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4019/8046] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:34:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:34:34.868963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2962b5a-bd6f-40ce-89db-5d6b22effbbe service cinder] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:34.871172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e2962b5a-bd6f-40ce-89db-5d6b22effbbe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:35.031365 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2962b5a-bd6f-40ce-89db-5d6b22effbbe service cinder] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:35.055078 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c44ea-d79d-4133-ba03-0fee5eeb191d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:35.055078 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c44ea-d79d-4133-ba03-0fee5eeb191d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:35.055078 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c44ea-d79d-4133-ba03-0fee5eeb191d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:35.055078 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c44ea-d79d-4133-ba03-0fee5eeb191d admin admin] PATH_INFO: `/v3/users/b0299e314ac0483f94f842e59ba72e8e` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:35.060477 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c44ea-d79d-4133-ba03-0fee5eeb191d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0299e314ac0483f94f842e59ba72e8e)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:35.064391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c44ea-d79d-4133-ba03-0fee5eeb191d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:35.244798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-814c44ea-d79d-4133-ba03-0fee5eeb191d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0299e314ac0483f94f842e59ba72e8e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:35.245838 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-814c44ea-d79d-4133-ba03-0fee5eeb191d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0299e314ac0483f94f842e59ba72e8e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:35.267116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-814c44ea-d79d-4133-ba03-0fee5eeb191d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0299e314ac0483f94f842e59ba72e8e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:35.286412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-814c44ea-d79d-4133-ba03-0fee5eeb191d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0299e314ac0483f94f842e59ba72e8e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:35.287316 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-814c44ea-d79d-4133-ba03-0fee5eeb191d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0299e314ac0483f94f842e59ba72e8e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:35.319806 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4028/8047] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:34:34 2022] DELETE /identity/v3/users/b0299e314ac0483f94f842e59ba72e8e => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:35.324234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776ac05-602e-4f4a-b114-eb36e72dfcae None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:35.324535 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776ac05-602e-4f4a-b114-eb36e72dfcae None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:35.324784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776ac05-602e-4f4a-b114-eb36e72dfcae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:35.366700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c776ac05-602e-4f4a-b114-eb36e72dfcae None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:35.368826 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c776ac05-602e-4f4a-b114-eb36e72dfcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:35.488749 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4020/8048] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:35.497395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c44ea-d79d-4133-ba03-0fee5eeb191d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:35.498887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-814c44ea-d79d-4133-ba03-0fee5eeb191d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:35.601655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c44ea-d79d-4133-ba03-0fee5eeb191d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:35.609873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e617e2c-36e6-40f0-adb1-b5b468f3afa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:35.610857 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e617e2c-36e6-40f0-adb1-b5b468f3afa2 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:35.611212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e617e2c-36e6-40f0-adb1-b5b468f3afa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:35.611642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e617e2c-36e6-40f0-adb1-b5b468f3afa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:35.625528 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e617e2c-36e6-40f0-adb1-b5b468f3afa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:35.627232 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e617e2c-36e6-40f0-adb1-b5b468f3afa2 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:35.641416 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4029/8049] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:34:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:34:35.943584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776ac05-602e-4f4a-b114-eb36e72dfcae None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:35.945030 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c776ac05-602e-4f4a-b114-eb36e72dfcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:35.967230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776ac05-602e-4f4a-b114-eb36e72dfcae None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:35.974630 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd246af-f661-40ec-8964-fb027c3df0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:35.974754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd246af-f661-40ec-8964-fb027c3df0d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:35.974948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd246af-f661-40ec-8964-fb027c3df0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:35.975704 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd246af-f661-40ec-8964-fb027c3df0d3 admin admin] PATH_INFO: `/v3/projects/c18b7193cf8240a49d4110413dd3d395` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:35.978132 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd246af-f661-40ec-8964-fb027c3df0d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c18b7193cf8240a49d4110413dd3d395)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:35.980061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd246af-f661-40ec-8964-fb027c3df0d3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:36.118655 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7fd246af-f661-40ec-8964-fb027c3df0d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c18b7193cf8240a49d4110413dd3d395', 'request_id': 'req-7fd246af-f661-40ec-8964-fb027c3df0d3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:36.129763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7fd246af-f661-40ec-8964-fb027c3df0d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c18b7193cf8240a49d4110413dd3d395', 'request_id': 'req-7fd246af-f661-40ec-8964-fb027c3df0d3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:36.140686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7fd246af-f661-40ec-8964-fb027c3df0d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c18b7193cf8240a49d4110413dd3d395', 'request_id': 'req-7fd246af-f661-40ec-8964-fb027c3df0d3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:36.174257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7fd246af-f661-40ec-8964-fb027c3df0d3 admin admin] The token cache is being invalidate because project c18b7193cf8240a49d4110413dd3d395 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:34:36.174870 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7fd246af-f661-40ec-8964-fb027c3df0d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:36.175978 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7fd246af-f661-40ec-8964-fb027c3df0d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:36.179214 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4021/8050] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:34:35 2022] DELETE /identity/v3/projects/c18b7193cf8240a49d4110413dd3d395 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:34:36.184597 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ab984-fc7e-4a2e-918b-30e122ba22a4 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:36.185570 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ab984-fc7e-4a2e-918b-30e122ba22a4 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:36.186100 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ab984-fc7e-4a2e-918b-30e122ba22a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:36.216284 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-993ab984-fc7e-4a2e-918b-30e122ba22a4 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:36.218017 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-993ab984-fc7e-4a2e-918b-30e122ba22a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:36.227779 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:36.321287 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4030/8051] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:36.322272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e787b7c-29ca-4356-a490-68ef9b1e4e3e None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:36.322779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e787b7c-29ca-4356-a490-68ef9b1e4e3e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:36.323371 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e787b7c-29ca-4356-a490-68ef9b1e4e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:36.380974 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-7e787b7c-29ca-4356-a490-68ef9b1e4e3e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:36.382685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7e787b7c-29ca-4356-a490-68ef9b1e4e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:36.397444 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4022/8052] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:34:36.401766 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ab984-fc7e-4a2e-918b-30e122ba22a4 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:36.422288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ab984-fc7e-4a2e-918b-30e122ba22a4 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:36.422288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d57b8-3efe-4e0c-a774-3d6b21ea3619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:36.422288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d57b8-3efe-4e0c-a774-3d6b21ea3619 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:36.422288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d57b8-3efe-4e0c-a774-3d6b21ea3619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:36.422822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d57b8-3efe-4e0c-a774-3d6b21ea3619 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:36.423589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d57b8-3efe-4e0c-a774-3d6b21ea3619 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:34:36.423947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d57b8-3efe-4e0c-a774-3d6b21ea3619 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:36.429677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d57b8-3efe-4e0c-a774-3d6b21ea3619 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:36.454604 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e787b7c-29ca-4356-a490-68ef9b1e4e3e None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:36.467680 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4031/8053] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:34:36.469344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e787b7c-29ca-4356-a490-68ef9b1e4e3e None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:36.476696 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c0453-37c6-4212-8276-1aa57ae447c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:36.477461 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c0453-37c6-4212-8276-1aa57ae447c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:36.478801 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c0453-37c6-4212-8276-1aa57ae447c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:36.479190 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c0453-37c6-4212-8276-1aa57ae447c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:36.480587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c0453-37c6-4212-8276-1aa57ae447c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:36.483905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c0453-37c6-4212-8276-1aa57ae447c5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:36.518843 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:36.564167 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4023/8054] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:34:36 2022] POST /identity/v3/projects => generated 357 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:34:36.565694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d57b8-3efe-4e0c-a774-3d6b21ea3619 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:36.579970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d57b8-3efe-4e0c-a774-3d6b21ea3619 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:36.704467 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5063fd-fdcc-43ca-a608-78867024eb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:36.705827 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5063fd-fdcc-43ca-a608-78867024eb86 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:36.706330 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5063fd-fdcc-43ca-a608-78867024eb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:36.706859 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5063fd-fdcc-43ca-a608-78867024eb86 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:36.707713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5063fd-fdcc-43ca-a608-78867024eb86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:36.710713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5063fd-fdcc-43ca-a608-78867024eb86 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:36.755358 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4032/8055] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:34:36 2022] POST /identity/v3/users => generated 279 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:34:36.759693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c0453-37c6-4212-8276-1aa57ae447c5 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:36.780108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c0453-37c6-4212-8276-1aa57ae447c5 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:36.796806 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32332f91-39cf-409e-bb43-fa5a9048abc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:36.798759 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32332f91-39cf-409e-bb43-fa5a9048abc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:36.799069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32332f91-39cf-409e-bb43-fa5a9048abc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:36.800586 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32332f91-39cf-409e-bb43-fa5a9048abc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:36.802353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32332f91-39cf-409e-bb43-fa5a9048abc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:36.808302 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32332f91-39cf-409e-bb43-fa5a9048abc5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:36.837887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5063fd-fdcc-43ca-a608-78867024eb86 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:36.839123 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4024/8056] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:34:36.857292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5063fd-fdcc-43ca-a608-78867024eb86 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:36.865207 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7134d7-a619-49e9-8465-d4bd2e9579b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:36.866671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7134d7-a619-49e9-8465-d4bd2e9579b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:36.867480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7134d7-a619-49e9-8465-d4bd2e9579b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:36.867859 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7134d7-a619-49e9-8465-d4bd2e9579b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:36.868475 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7134d7-a619-49e9-8465-d4bd2e9579b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:36.871276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7134d7-a619-49e9-8465-d4bd2e9579b9 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:36.889258 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4033/8057] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:34:36.891056 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32332f91-39cf-409e-bb43-fa5a9048abc5 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:36.904493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32332f91-39cf-409e-bb43-fa5a9048abc5 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:36.932749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172cb9a-3348-4621-9dc9-1c62aa2e38cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:36.933493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172cb9a-3348-4621-9dc9-1c62aa2e38cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:36.933793 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172cb9a-3348-4621-9dc9-1c62aa2e38cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:36.941064 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172cb9a-3348-4621-9dc9-1c62aa2e38cb admin admin] PATH_INFO: `/v3/projects/485baa95736140d1ab83d0ae4081cd95/users/f14991ed6dab45af892b0872b5cf71b0/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:36.970361 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6172cb9a-3348-4621-9dc9-1c62aa2e38cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=485baa95736140d1ab83d0ae4081cd95, user_id=f14991ed6dab45af892b0872b5cf71b0, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:36.976134 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6172cb9a-3348-4621-9dc9-1c62aa2e38cb admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:36.994682 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4025/8058] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:34:36 2022] PUT /identity/v3/projects/485baa95736140d1ab83d0ae4081cd95/users/f14991ed6dab45af892b0872b5cf71b0/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:37.008772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78bf24-de0c-4aee-936b-0c17b784090e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:37.008772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78bf24-de0c-4aee-936b-0c17b784090e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:37.008772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78bf24-de0c-4aee-936b-0c17b784090e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:37.069385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-6a78bf24-de0c-4aee-936b-0c17b784090e None None] MFA Rules not processed for user `f14991ed6dab45af892b0872b5cf71b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:37.070642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6a78bf24-de0c-4aee-936b-0c17b784090e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:37.176614 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4034/8059] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:37 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:37.177565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172cb9a-3348-4621-9dc9-1c62aa2e38cb admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:37.280607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172cb9a-3348-4621-9dc9-1c62aa2e38cb admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:37.304156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba2942-4df9-41dd-acce-aa1df3fd3f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:37.304794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba2942-4df9-41dd-acce-aa1df3fd3f98 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:37.306604 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba2942-4df9-41dd-acce-aa1df3fd3f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:37.306890 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba2942-4df9-41dd-acce-aa1df3fd3f98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:37.308677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dba2942-4df9-41dd-acce-aa1df3fd3f98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:37.315959 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dba2942-4df9-41dd-acce-aa1df3fd3f98 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:37.387969 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4026/8060] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:34:37 2022] POST /identity/v3/projects => generated 357 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:34:37.393207 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78bf24-de0c-4aee-936b-0c17b784090e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:37.418994 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78bf24-de0c-4aee-936b-0c17b784090e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:37.456001 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:37.613610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7645e-0910-44b9-889c-ec8c0bc5485d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:37.614255 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7645e-0910-44b9-889c-ec8c0bc5485d admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:37.614544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7645e-0910-44b9-889c-ec8c0bc5485d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:37.614812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7645e-0910-44b9-889c-ec8c0bc5485d admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:37.615522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7645e-0910-44b9-889c-ec8c0bc5485d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:37.618623 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7645e-0910-44b9-889c-ec8c0bc5485d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:37.709455 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4035/8061] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:34:37 2022] POST /identity/v3/users => generated 285 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:34:37.710139 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba2942-4df9-41dd-acce-aa1df3fd3f98 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:37.777551 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba2942-4df9-41dd-acce-aa1df3fd3f98 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:37.795938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff07d42-bc5d-4996-b5bd-4f585b0b71f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:37.796567 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff07d42-bc5d-4996-b5bd-4f585b0b71f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:37.796876 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff07d42-bc5d-4996-b5bd-4f585b0b71f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:37.797113 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff07d42-bc5d-4996-b5bd-4f585b0b71f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:37.803142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff07d42-bc5d-4996-b5bd-4f585b0b71f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:37.812874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff07d42-bc5d-4996-b5bd-4f585b0b71f8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:37.852654 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4027/8062] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:34:37.853984 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7645e-0910-44b9-889c-ec8c0bc5485d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:37.869891 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7645e-0910-44b9-889c-ec8c0bc5485d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:37.877881 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8559d75-0580-4ef3-b0bd-eb07a5b7fa59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:37.878629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8559d75-0580-4ef3-b0bd-eb07a5b7fa59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:37.878864 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8559d75-0580-4ef3-b0bd-eb07a5b7fa59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:37.879640 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8559d75-0580-4ef3-b0bd-eb07a5b7fa59 admin admin] PATH_INFO: `/v3/projects/7a93a7ddc39b4a929ae70849e2b7ab16/users/1618d66723d245cc9d505ca1763c5930/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:37.930636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8559d75-0580-4ef3-b0bd-eb07a5b7fa59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a93a7ddc39b4a929ae70849e2b7ab16, user_id=1618d66723d245cc9d505ca1763c5930, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:37.935217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8559d75-0580-4ef3-b0bd-eb07a5b7fa59 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:37.983549 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4036/8063] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:34:37 2022] PUT /identity/v3/projects/7a93a7ddc39b4a929ae70849e2b7ab16/users/1618d66723d245cc9d505ca1763c5930/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:37.985545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff07d42-bc5d-4996-b5bd-4f585b0b71f8 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:38.000733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff07d42-bc5d-4996-b5bd-4f585b0b71f8 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:38.110698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e4743-c15f-431b-8520-1a0fd815d3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:38.111490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e4743-c15f-431b-8520-1a0fd815d3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:38.112016 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e4743-c15f-431b-8520-1a0fd815d3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:38.112357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e4743-c15f-431b-8520-1a0fd815d3a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:38.113299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e4743-c15f-431b-8520-1a0fd815d3a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:38.115264 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e4743-c15f-431b-8520-1a0fd815d3a4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:38.130060 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4028/8064] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:34:38.134022 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8559d75-0580-4ef3-b0bd-eb07a5b7fa59 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:38.162367 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8559d75-0580-4ef3-b0bd-eb07a5b7fa59 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:38.180567 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcec5d3-f087-470e-adcc-1817321b8c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:38.182740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcec5d3-f087-470e-adcc-1817321b8c87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:38.183135 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcec5d3-f087-470e-adcc-1817321b8c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:38.184471 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcec5d3-f087-470e-adcc-1817321b8c87 admin admin] PATH_INFO: `/v3/projects/7a93a7ddc39b4a929ae70849e2b7ab16/users/1618d66723d245cc9d505ca1763c5930/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:38.188705 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcec5d3-f087-470e-adcc-1817321b8c87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a93a7ddc39b4a929ae70849e2b7ab16, user_id=1618d66723d245cc9d505ca1763c5930, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:38.193693 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcec5d3-f087-470e-adcc-1817321b8c87 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:38.258563 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4037/8065] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:34:38 2022] PUT /identity/v3/projects/7a93a7ddc39b4a929ae70849e2b7ab16/users/1618d66723d245cc9d505ca1763c5930/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:38.268324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc5062-ef65-4e5e-bbf7-22c017192868 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:38.268958 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc5062-ef65-4e5e-bbf7-22c017192868 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:38.269491 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc5062-ef65-4e5e-bbf7-22c017192868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:38.371348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-96bc5062-ef65-4e5e-bbf7-22c017192868 None None] MFA Rules not processed for user `1618d66723d245cc9d505ca1763c5930`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:38.372763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-96bc5062-ef65-4e5e-bbf7-22c017192868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:38.394859 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:38.494886 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4029/8066] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:38 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:38.509115 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcec5d3-f087-470e-adcc-1817321b8c87 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:38.512567 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6dcec5d3-f087-470e-adcc-1817321b8c87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:38.541924 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc5062-ef65-4e5e-bbf7-22c017192868 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:38.544058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-96bc5062-ef65-4e5e-bbf7-22c017192868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:38.622463 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcec5d3-f087-470e-adcc-1817321b8c87 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:38.628981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b41a99-cda8-4f08-945c-83973a576e41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:38.629599 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b41a99-cda8-4f08-945c-83973a576e41 service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:38.629981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b41a99-cda8-4f08-945c-83973a576e41 service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:38.630490 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b41a99-cda8-4f08-945c-83973a576e41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:38.644567 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b41a99-cda8-4f08-945c-83973a576e41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:38.648764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b41a99-cda8-4f08-945c-83973a576e41 service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:38.651270 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc5062-ef65-4e5e-bbf7-22c017192868 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:38.659923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957ff40-7f7f-4081-97a2-6211e3104b4d tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ba22a004ec4d85ba56f9385aa9e644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32afb8a03803440aaa761dbe0c35da3f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:38.660711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957ff40-7f7f-4081-97a2-6211e3104b4d tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:38.661770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957ff40-7f7f-4081-97a2-6211e3104b4d tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:38.662224 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957ff40-7f7f-4081-97a2-6211e3104b4d tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:38.663691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b957ff40-7f7f-4081-97a2-6211e3104b4d tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:34:38.664199 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b957ff40-7f7f-4081-97a2-6211e3104b4d tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:38.666060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b957ff40-7f7f-4081-97a2-6211e3104b4d tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:38.666680 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4038/8067] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:34:38 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:34:38.702756 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4030/8068] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:34:38.703697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b41a99-cda8-4f08-945c-83973a576e41 service cinder] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:38.722319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b41a99-cda8-4f08-945c-83973a576e41 service cinder] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:38.732558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc19f84-2ceb-4ef4-acb2-2923becda5b0 tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ba22a004ec4d85ba56f9385aa9e644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32afb8a03803440aaa761dbe0c35da3f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:38.733363 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc19f84-2ceb-4ef4-acb2-2923becda5b0 tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:38.733682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc19f84-2ceb-4ef4-acb2-2923becda5b0 tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:38.734069 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc19f84-2ceb-4ef4-acb2-2923becda5b0 tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:38.737419 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc19f84-2ceb-4ef4-acb2-2923becda5b0 tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:38.741309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc19f84-2ceb-4ef4-acb2-2923becda5b0 tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:38.789123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957ff40-7f7f-4081-97a2-6211e3104b4d tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:38.794785 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b957ff40-7f7f-4081-97a2-6211e3104b4d tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:38.810286 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4039/8069] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:34:38 2022] POST /identity/v3/projects => generated 346 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:34:38.811755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc19f84-2ceb-4ef4-acb2-2923becda5b0 tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:38.827109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957ff40-7f7f-4081-97a2-6211e3104b4d tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:38.906876 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:38.916832 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f4073-2715-467b-8bdf-cfe5b95dab67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:38.918009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f4073-2715-467b-8bdf-cfe5b95dab67 service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:38.918507 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f4073-2715-467b-8bdf-cfe5b95dab67 service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:38.918967 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f4073-2715-467b-8bdf-cfe5b95dab67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:38.959229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc19f84-2ceb-4ef4-acb2-2923becda5b0 tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:38.971721 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4762e3-f8f0-4041-b319-d540519016aa tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ba22a004ec4d85ba56f9385aa9e644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32afb8a03803440aaa761dbe0c35da3f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:38.972380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4762e3-f8f0-4041-b319-d540519016aa tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:38.972604 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4762e3-f8f0-4041-b319-d540519016aa tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:38.972885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4762e3-f8f0-4041-b319-d540519016aa tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:38.973558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4762e3-f8f0-4041-b319-d540519016aa tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:34:38.973863 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4762e3-f8f0-4041-b319-d540519016aa tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:38.975522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4762e3-f8f0-4041-b319-d540519016aa tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:39.008664 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4040/8070] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:34:39.010058 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31778d-a507-410c-9b99-fe0cd1b14ea2 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:39.010583 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31778d-a507-410c-9b99-fe0cd1b14ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:39.010583 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31778d-a507-410c-9b99-fe0cd1b14ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:39.050016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-fb31778d-a507-410c-9b99-fe0cd1b14ea2 None None] MFA Rules not processed for user `f39dd2d709374c729d51f7e2cf18300c`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:39.051398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-fb31778d-a507-410c-9b99-fe0cd1b14ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:39.058650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f4073-2715-467b-8bdf-cfe5b95dab67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:39.060044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f4073-2715-467b-8bdf-cfe5b95dab67 service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:39.087056 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4031/8071] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:34:38 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:34:39.153949 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4041/8072] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:39.894470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f4073-2715-467b-8bdf-cfe5b95dab67 service cinder] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:39.900143 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:39.906589 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f4073-2715-467b-8bdf-cfe5b95dab67 service cinder] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:39.911885 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14337d69-6228-4553-a827-ea36c68f01c3 tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ba22a004ec4d85ba56f9385aa9e644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32afb8a03803440aaa761dbe0c35da3f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:39.913156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14337d69-6228-4553-a827-ea36c68f01c3 tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:39.913737 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14337d69-6228-4553-a827-ea36c68f01c3 tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:39.914488 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14337d69-6228-4553-a827-ea36c68f01c3 tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] PATH_INFO: `/v3/projects/12f0e90f1ec545f1b2291adadf30fd90` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:39.916559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14337d69-6228-4553-a827-ea36c68f01c3 tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] RBAC: Authorizing `identity:delete_project(project_id=12f0e90f1ec545f1b2291adadf30fd90)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:39.918685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14337d69-6228-4553-a827-ea36c68f01c3 tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:39.970087 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-14337d69-6228-4553-a827-ea36c68f01c3 tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12f0e90f1ec545f1b2291adadf30fd90', 'request_id': 'req-14337d69-6228-4553-a827-ea36c68f01c3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:39.980170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-14337d69-6228-4553-a827-ea36c68f01c3 tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12f0e90f1ec545f1b2291adadf30fd90', 'request_id': 'req-14337d69-6228-4553-a827-ea36c68f01c3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:39.987308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-14337d69-6228-4553-a827-ea36c68f01c3 tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12f0e90f1ec545f1b2291adadf30fd90', 'request_id': 'req-14337d69-6228-4553-a827-ea36c68f01c3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:40.002305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-14337d69-6228-4553-a827-ea36c68f01c3 tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] The token cache is being invalidate because project 12f0e90f1ec545f1b2291adadf30fd90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:34:40.002724 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-14337d69-6228-4553-a827-ea36c68f01c3 tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:40.003843 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-14337d69-6228-4553-a827-ea36c68f01c3 tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:40.005516 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4032/8073] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:34:39 2022] DELETE /identity/v3/projects/12f0e90f1ec545f1b2291adadf30fd90 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:40.017817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31778d-a507-410c-9b99-fe0cd1b14ea2 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:40.019262 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-fb31778d-a507-410c-9b99-fe0cd1b14ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:40.083503 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31778d-a507-410c-9b99-fe0cd1b14ea2 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:40.141360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa33c3-5c95-4166-92db-bc3c5efa7820 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:40.142141 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa33c3-5c95-4166-92db-bc3c5efa7820 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:40.142491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa33c3-5c95-4166-92db-bc3c5efa7820 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:40.142835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa33c3-5c95-4166-92db-bc3c5efa7820 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:40.145494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4eaa33c3-5c95-4166-92db-bc3c5efa7820 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:40.193529 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:40.216054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa33c3-5c95-4166-92db-bc3c5efa7820 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:40.218697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa33c3-5c95-4166-92db-bc3c5efa7820 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:40.230516 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4042/8074] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:34:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:34:49.817071 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14337d69-6228-4553-a827-ea36c68f01c3 tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:49.820550 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-14337d69-6228-4553-a827-ea36c68f01c3 tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:49.995583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14337d69-6228-4553-a827-ea36c68f01c3 tempest-RoutersAdminTest-1645109239 tempest-RoutersAdminTest-1645109239-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:50.011636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88682146-67cc-43c8-8ba5-dec8f6fa6768 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:50.022232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88682146-67cc-43c8-8ba5-dec8f6fa6768 service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:50.022232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88682146-67cc-43c8-8ba5-dec8f6fa6768 service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:50.022232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88682146-67cc-43c8-8ba5-dec8f6fa6768 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:50.032924 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-88682146-67cc-43c8-8ba5-dec8f6fa6768 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:50.070306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88682146-67cc-43c8-8ba5-dec8f6fa6768 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:50.073104 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88682146-67cc-43c8-8ba5-dec8f6fa6768 service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:50.125171 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4033/8075] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:34:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:34:50.227356 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=9 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:54.362428 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa33c3-5c95-4166-92db-bc3c5efa7820 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:54.365910 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4eaa33c3-5c95-4166-92db-bc3c5efa7820 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:54.513528 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa33c3-5c95-4166-92db-bc3c5efa7820 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:54.523603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b4733-f210-43ba-878a-88af19291e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:54.524258 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b4733-f210-43ba-878a-88af19291e21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:54.524540 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b4733-f210-43ba-878a-88af19291e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:54.524814 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b4733-f210-43ba-878a-88af19291e21 admin admin] PATH_INFO: `/v3/users/c5a9048a62ce4fe7a4dd29e7c40daaad` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:54.526028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b4733-f210-43ba-878a-88af19291e21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5a9048a62ce4fe7a4dd29e7c40daaad)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:54.528152 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b4733-f210-43ba-878a-88af19291e21 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:54.625054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-375b4733-f210-43ba-878a-88af19291e21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5a9048a62ce4fe7a4dd29e7c40daaad'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:54.628255 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-375b4733-f210-43ba-878a-88af19291e21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5a9048a62ce4fe7a4dd29e7c40daaad'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:54.640839 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-375b4733-f210-43ba-878a-88af19291e21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5a9048a62ce4fe7a4dd29e7c40daaad'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:54.662380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-375b4733-f210-43ba-878a-88af19291e21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5a9048a62ce4fe7a4dd29e7c40daaad'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:54.663020 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-375b4733-f210-43ba-878a-88af19291e21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5a9048a62ce4fe7a4dd29e7c40daaad'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:54.699528 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4043/8076] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:34:54 2022] DELETE /identity/v3/users/c5a9048a62ce4fe7a4dd29e7c40daaad => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:34:54.701316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b95194-bdb2-4642-b8bc-9374f0441f96 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:54.701862 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b95194-bdb2-4642-b8bc-9374f0441f96 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:54.701862 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b95194-bdb2-4642-b8bc-9374f0441f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:54.745078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-32b95194-bdb2-4642-b8bc-9374f0441f96 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:54.747695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-32b95194-bdb2-4642-b8bc-9374f0441f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:54.913824 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4034/8077] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:54.923742 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b4733-f210-43ba-878a-88af19291e21 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:54.925386 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-375b4733-f210-43ba-878a-88af19291e21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:55.100736 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b4733-f210-43ba-878a-88af19291e21 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:55.105961 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7bad1c-10d2-4e12-942b-6e1a468318b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:55.106818 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bad1c-10d2-4e12-942b-6e1a468318b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:55.107339 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bad1c-10d2-4e12-942b-6e1a468318b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:55.107667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bad1c-10d2-4e12-942b-6e1a468318b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:55.123202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7bad1c-10d2-4e12-942b-6e1a468318b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:55.124731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7bad1c-10d2-4e12-942b-6e1a468318b5 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:55.142211 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4044/8078] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:34:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:34:55.491342 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b95194-bdb2-4642-b8bc-9374f0441f96 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:55.495461 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-32b95194-bdb2-4642-b8bc-9374f0441f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:55.529993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b95194-bdb2-4642-b8bc-9374f0441f96 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:55.547349 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56283e96-4a9e-4f0b-b06f-a056688ae57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:55.549262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56283e96-4a9e-4f0b-b06f-a056688ae57b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:55.550917 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56283e96-4a9e-4f0b-b06f-a056688ae57b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:55.551204 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56283e96-4a9e-4f0b-b06f-a056688ae57b admin admin] PATH_INFO: `/v3/projects/39d32337b9d740a4b6ead4518b07cf0f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:55.554485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56283e96-4a9e-4f0b-b06f-a056688ae57b admin admin] RBAC: Authorizing `identity:delete_project(project_id=39d32337b9d740a4b6ead4518b07cf0f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:55.559041 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56283e96-4a9e-4f0b-b06f-a056688ae57b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:55.596305 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:55.716568 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-56283e96-4a9e-4f0b-b06f-a056688ae57b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39d32337b9d740a4b6ead4518b07cf0f', 'request_id': 'req-56283e96-4a9e-4f0b-b06f-a056688ae57b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:55.734208 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-56283e96-4a9e-4f0b-b06f-a056688ae57b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39d32337b9d740a4b6ead4518b07cf0f', 'request_id': 'req-56283e96-4a9e-4f0b-b06f-a056688ae57b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:55.762821 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-56283e96-4a9e-4f0b-b06f-a056688ae57b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39d32337b9d740a4b6ead4518b07cf0f', 'request_id': 'req-56283e96-4a9e-4f0b-b06f-a056688ae57b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:55.837163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-56283e96-4a9e-4f0b-b06f-a056688ae57b admin admin] The token cache is being invalidate because project 39d32337b9d740a4b6ead4518b07cf0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:34:55.837928 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-56283e96-4a9e-4f0b-b06f-a056688ae57b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:55.838966 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-56283e96-4a9e-4f0b-b06f-a056688ae57b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:34:55.845166 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4035/8079] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:34:55 2022] DELETE /identity/v3/projects/39d32337b9d740a4b6ead4518b07cf0f => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:55.853221 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315016f-0aec-4b91-9cff-9cd222d3d951 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:55.854272 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315016f-0aec-4b91-9cff-9cd222d3d951 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:55.854757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315016f-0aec-4b91-9cff-9cd222d3d951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:55.898908 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5315016f-0aec-4b91-9cff-9cd222d3d951 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:55.900266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5315016f-0aec-4b91-9cff-9cd222d3d951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:55.957618 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:34:56.035645 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4045/8080] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:56.043913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb2034-ae09-436b-9c30-da5c103a4881 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:56.044218 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb2034-ae09-436b-9c30-da5c103a4881 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:56.044790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb2034-ae09-436b-9c30-da5c103a4881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:56.103126 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-9ecb2034-ae09-436b-9c30-da5c103a4881 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:56.104525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9ecb2034-ae09-436b-9c30-da5c103a4881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:56.125261 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4036/8081] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:56.129692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315016f-0aec-4b91-9cff-9cd222d3d951 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:56.144144 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315016f-0aec-4b91-9cff-9cd222d3d951 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:56.157656 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30397bac-bf08-4e68-a9c2-0f0242bf6a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:56.158294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30397bac-bf08-4e68-a9c2-0f0242bf6a5e admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:56.158570 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30397bac-bf08-4e68-a9c2-0f0242bf6a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:56.158837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30397bac-bf08-4e68-a9c2-0f0242bf6a5e admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:56.159489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30397bac-bf08-4e68-a9c2-0f0242bf6a5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:34:56.159788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30397bac-bf08-4e68-a9c2-0f0242bf6a5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:56.161384 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30397bac-bf08-4e68-a9c2-0f0242bf6a5e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:56.198127 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4046/8082] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:34:56.202446 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb2034-ae09-436b-9c30-da5c103a4881 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:56.220060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb2034-ae09-436b-9c30-da5c103a4881 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:56.238477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446ad03-105d-4b21-bf3a-56c82ecf1040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:56.239042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446ad03-105d-4b21-bf3a-56c82ecf1040 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:56.239378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446ad03-105d-4b21-bf3a-56c82ecf1040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:56.239654 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446ad03-105d-4b21-bf3a-56c82ecf1040 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:56.240329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446ad03-105d-4b21-bf3a-56c82ecf1040 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:56.242296 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446ad03-105d-4b21-bf3a-56c82ecf1040 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:56.385715 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4037/8083] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:34:56 2022] POST /identity/v3/projects => generated 363 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:34:56.386785 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30397bac-bf08-4e68-a9c2-0f0242bf6a5e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:56.407088 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30397bac-bf08-4e68-a9c2-0f0242bf6a5e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:56.657266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca272315-ea83-4259-ab6d-007ce5117cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:56.667814 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca272315-ea83-4259-ab6d-007ce5117cba admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:56.668399 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca272315-ea83-4259-ab6d-007ce5117cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:56.668844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca272315-ea83-4259-ab6d-007ce5117cba admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:56.669734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca272315-ea83-4259-ab6d-007ce5117cba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:56.676380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca272315-ea83-4259-ab6d-007ce5117cba admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:56.730746 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4047/8084] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:34:56 2022] POST /identity/v3/users => generated 282 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:34:56.735357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446ad03-105d-4b21-bf3a-56c82ecf1040 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:56.756846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446ad03-105d-4b21-bf3a-56c82ecf1040 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:56.768348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e60a8-1a6e-4a16-a694-0165552f1f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:56.769622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e60a8-1a6e-4a16-a694-0165552f1f83 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:56.770200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e60a8-1a6e-4a16-a694-0165552f1f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:56.770690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e60a8-1a6e-4a16-a694-0165552f1f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:56.771887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e60a8-1a6e-4a16-a694-0165552f1f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:56.773870 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e60a8-1a6e-4a16-a694-0165552f1f83 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:56.803759 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4038/8085] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:34:56.826796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca272315-ea83-4259-ab6d-007ce5117cba admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:56.852811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca272315-ea83-4259-ab6d-007ce5117cba admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:56.863502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590d8c7-d3db-455e-9329-0fdd8d3c0af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:56.864467 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590d8c7-d3db-455e-9329-0fdd8d3c0af7 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:56.867246 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590d8c7-d3db-455e-9329-0fdd8d3c0af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:56.867535 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590d8c7-d3db-455e-9329-0fdd8d3c0af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:56.868209 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590d8c7-d3db-455e-9329-0fdd8d3c0af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:56.871062 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590d8c7-d3db-455e-9329-0fdd8d3c0af7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:56.940660 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4048/8086] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:34:56.945713 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e60a8-1a6e-4a16-a694-0165552f1f83 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:56.960671 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e60a8-1a6e-4a16-a694-0165552f1f83 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:56.971363 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad725212-fd4f-490b-9f6f-ef0ade1fd02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:56.972438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad725212-fd4f-490b-9f6f-ef0ade1fd02f admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:56.990069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad725212-fd4f-490b-9f6f-ef0ade1fd02f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:56.995518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad725212-fd4f-490b-9f6f-ef0ade1fd02f admin admin] PATH_INFO: `/v3/projects/9ca8b76713814f91b37b73ebced0ded9/users/2213680600d540938cc5982b413b6104/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:57.069768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad725212-fd4f-490b-9f6f-ef0ade1fd02f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ca8b76713814f91b37b73ebced0ded9, user_id=2213680600d540938cc5982b413b6104, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:57.086292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad725212-fd4f-490b-9f6f-ef0ade1fd02f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:57.130499 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4039/8087] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:34:56 2022] PUT /identity/v3/projects/9ca8b76713814f91b37b73ebced0ded9/users/2213680600d540938cc5982b413b6104/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:34:57.142417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8677a2-3192-4fd2-ad8a-afe2af67f7fb None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:57.142691 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8677a2-3192-4fd2-ad8a-afe2af67f7fb None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:57.143016 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8677a2-3192-4fd2-ad8a-afe2af67f7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:57.219004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-9a8677a2-3192-4fd2-ad8a-afe2af67f7fb None None] MFA Rules not processed for user `2213680600d540938cc5982b413b6104`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:34:57.220243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9a8677a2-3192-4fd2-ad8a-afe2af67f7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:57.362618 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4049/8088] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:34:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:34:57.374606 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad725212-fd4f-490b-9f6f-ef0ade1fd02f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:34:57.376644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ad725212-fd4f-490b-9f6f-ef0ade1fd02f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:34:57.575646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad725212-fd4f-490b-9f6f-ef0ade1fd02f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:34:57.602341 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bca55d-f43b-45b7-b057-5b4c195beefa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:34:57.604419 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bca55d-f43b-45b7-b057-5b4c195beefa service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:34:57.604713 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bca55d-f43b-45b7-b057-5b4c195beefa service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:34:57.605000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bca55d-f43b-45b7-b057-5b4c195beefa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:34:57.632344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bca55d-f43b-45b7-b057-5b4c195beefa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:34:57.641248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bca55d-f43b-45b7-b057-5b4c195beefa service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:34:57.669473 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4040/8089] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:34:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:35:07.353480 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:35:07.650990 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=73,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:35:08.436656 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8677a2-3192-4fd2-ad8a-afe2af67f7fb None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:08.479969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8677a2-3192-4fd2-ad8a-afe2af67f7fb None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:08.500004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee7f89-73e1-4f2b-b4a0-c51cc9e83f54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:08.501115 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee7f89-73e1-4f2b-b4a0-c51cc9e83f54 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:08.501406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee7f89-73e1-4f2b-b4a0-c51cc9e83f54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:08.501713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee7f89-73e1-4f2b-b4a0-c51cc9e83f54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:08.509888 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4aee7f89-73e1-4f2b-b4a0-c51cc9e83f54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:08.733620 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee7f89-73e1-4f2b-b4a0-c51cc9e83f54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:08.735928 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee7f89-73e1-4f2b-b4a0-c51cc9e83f54 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:08.789476 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4050/8090] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:35:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:35:10.363622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bca55d-f43b-45b7-b057-5b4c195beefa service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:10.365776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d9bca55d-f43b-45b7-b057-5b4c195beefa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:10.391409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bca55d-f43b-45b7-b057-5b4c195beefa service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:10.406771 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4bda5-3cf7-4b0e-9ef5-9e237409237f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:10.407671 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4bda5-3cf7-4b0e-9ef5-9e237409237f service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:10.408266 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4bda5-3cf7-4b0e-9ef5-9e237409237f service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:10.408772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4bda5-3cf7-4b0e-9ef5-9e237409237f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:10.410839 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-afc4bda5-3cf7-4b0e-9ef5-9e237409237f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:10.431208 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc4bda5-3cf7-4b0e-9ef5-9e237409237f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:10.432968 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc4bda5-3cf7-4b0e-9ef5-9e237409237f service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:10.475146 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4041/8091] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:35:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:35:13.885048 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee7f89-73e1-4f2b-b4a0-c51cc9e83f54 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:13.887799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4aee7f89-73e1-4f2b-b4a0-c51cc9e83f54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:14.070026 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee7f89-73e1-4f2b-b4a0-c51cc9e83f54 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:14.076010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab5ed98-e6a5-47d0-932f-f560d81f31e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:14.076918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5ed98-e6a5-47d0-932f-f560d81f31e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:14.077361 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5ed98-e6a5-47d0-932f-f560d81f31e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:14.077791 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5ed98-e6a5-47d0-932f-f560d81f31e8 admin admin] PATH_INFO: `/v3/users/f14991ed6dab45af892b0872b5cf71b0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:14.079327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab5ed98-e6a5-47d0-932f-f560d81f31e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f14991ed6dab45af892b0872b5cf71b0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:14.081546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab5ed98-e6a5-47d0-932f-f560d81f31e8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:14.192193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-eab5ed98-e6a5-47d0-932f-f560d81f31e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f14991ed6dab45af892b0872b5cf71b0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:14.196205 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-eab5ed98-e6a5-47d0-932f-f560d81f31e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f14991ed6dab45af892b0872b5cf71b0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:14.213763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-eab5ed98-e6a5-47d0-932f-f560d81f31e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f14991ed6dab45af892b0872b5cf71b0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:14.232178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-eab5ed98-e6a5-47d0-932f-f560d81f31e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f14991ed6dab45af892b0872b5cf71b0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:14.233239 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-eab5ed98-e6a5-47d0-932f-f560d81f31e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f14991ed6dab45af892b0872b5cf71b0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:14.286342 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4051/8092] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:35:13 2022] DELETE /identity/v3/users/f14991ed6dab45af892b0872b5cf71b0 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:35:14.289846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86e3e4-17aa-4d9d-a7f2-1b2ae2186b29 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:14.289846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86e3e4-17aa-4d9d-a7f2-1b2ae2186b29 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:14.290427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86e3e4-17aa-4d9d-a7f2-1b2ae2186b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:14.313615 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-db86e3e4-17aa-4d9d-a7f2-1b2ae2186b29 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:35:14.315282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-db86e3e4-17aa-4d9d-a7f2-1b2ae2186b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:14.419856 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4042/8093] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:35:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:35:14.433556 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab5ed98-e6a5-47d0-932f-f560d81f31e8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:14.435345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-eab5ed98-e6a5-47d0-932f-f560d81f31e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:14.444862 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:35:14.549693 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab5ed98-e6a5-47d0-932f-f560d81f31e8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:14.554472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae1248-da4f-45f0-87ad-8f18c38c3853 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:14.555208 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae1248-da4f-45f0-87ad-8f18c38c3853 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:14.555587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae1248-da4f-45f0-87ad-8f18c38c3853 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:14.555976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae1248-da4f-45f0-87ad-8f18c38c3853 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:14.568310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae1248-da4f-45f0-87ad-8f18c38c3853 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:14.571190 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae1248-da4f-45f0-87ad-8f18c38c3853 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:14.583249 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4052/8094] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:35:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:35:15.585735 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db86e3e4-17aa-4d9d-a7f2-1b2ae2186b29 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:15.587705 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-db86e3e4-17aa-4d9d-a7f2-1b2ae2186b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:15.608860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db86e3e4-17aa-4d9d-a7f2-1b2ae2186b29 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:15.614681 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2372b9-2e85-4be7-b8ef-734cb213d05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:15.615346 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2372b9-2e85-4be7-b8ef-734cb213d05a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:15.615624 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2372b9-2e85-4be7-b8ef-734cb213d05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:15.616069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2372b9-2e85-4be7-b8ef-734cb213d05a admin admin] PATH_INFO: `/v3/projects/485baa95736140d1ab83d0ae4081cd95` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:15.617289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2372b9-2e85-4be7-b8ef-734cb213d05a admin admin] RBAC: Authorizing `identity:delete_project(project_id=485baa95736140d1ab83d0ae4081cd95)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:15.623335 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2372b9-2e85-4be7-b8ef-734cb213d05a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:15.696181 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ce2372b9-2e85-4be7-b8ef-734cb213d05a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '485baa95736140d1ab83d0ae4081cd95', 'request_id': 'req-ce2372b9-2e85-4be7-b8ef-734cb213d05a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:15.708574 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ce2372b9-2e85-4be7-b8ef-734cb213d05a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '485baa95736140d1ab83d0ae4081cd95', 'request_id': 'req-ce2372b9-2e85-4be7-b8ef-734cb213d05a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:15.717903 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ce2372b9-2e85-4be7-b8ef-734cb213d05a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '485baa95736140d1ab83d0ae4081cd95', 'request_id': 'req-ce2372b9-2e85-4be7-b8ef-734cb213d05a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:15.732039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ce2372b9-2e85-4be7-b8ef-734cb213d05a admin admin] The token cache is being invalidate because project 485baa95736140d1ab83d0ae4081cd95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:35:15.732333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ce2372b9-2e85-4be7-b8ef-734cb213d05a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:15.733193 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ce2372b9-2e85-4be7-b8ef-734cb213d05a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:15.735800 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4043/8095] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:35:15 2022] DELETE /identity/v3/projects/485baa95736140d1ab83d0ae4081cd95 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:35:15.740106 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae1248-da4f-45f0-87ad-8f18c38c3853 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:15.753399 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae1248-da4f-45f0-87ad-8f18c38c3853 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:15.829852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9c5b0-f7cd-495c-a52e-631ae361c9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:15.831537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9c5b0-f7cd-495c-a52e-631ae361c9c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:15.832023 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9c5b0-f7cd-495c-a52e-631ae361c9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:15.832512 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9c5b0-f7cd-495c-a52e-631ae361c9c3 admin admin] PATH_INFO: `/v3/users/1618d66723d245cc9d505ca1763c5930` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:15.834761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9c5b0-f7cd-495c-a52e-631ae361c9c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1618d66723d245cc9d505ca1763c5930)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:15.836960 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9c5b0-f7cd-495c-a52e-631ae361c9c3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:15.909800 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f0e9c5b0-f7cd-495c-a52e-631ae361c9c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1618d66723d245cc9d505ca1763c5930'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:15.910563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f0e9c5b0-f7cd-495c-a52e-631ae361c9c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1618d66723d245cc9d505ca1763c5930'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:15.919202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f0e9c5b0-f7cd-495c-a52e-631ae361c9c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1618d66723d245cc9d505ca1763c5930'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:15.929565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f0e9c5b0-f7cd-495c-a52e-631ae361c9c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1618d66723d245cc9d505ca1763c5930'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:15.930805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f0e9c5b0-f7cd-495c-a52e-631ae361c9c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1618d66723d245cc9d505ca1763c5930'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:15.952511 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4053/8096] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:35:15 2022] DELETE /identity/v3/users/1618d66723d245cc9d505ca1763c5930 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:35:16.452849 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2372b9-2e85-4be7-b8ef-734cb213d05a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:16.454466 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ce2372b9-2e85-4be7-b8ef-734cb213d05a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:16.472838 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2372b9-2e85-4be7-b8ef-734cb213d05a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:16.561415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783d80a-b2b5-412f-8603-06230a3b2011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:16.562423 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783d80a-b2b5-412f-8603-06230a3b2011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:16.562900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783d80a-b2b5-412f-8603-06230a3b2011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:16.563500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783d80a-b2b5-412f-8603-06230a3b2011 admin admin] PATH_INFO: `/v3/projects/7a93a7ddc39b4a929ae70849e2b7ab16` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:16.564922 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783d80a-b2b5-412f-8603-06230a3b2011 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a93a7ddc39b4a929ae70849e2b7ab16)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:16.567306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783d80a-b2b5-412f-8603-06230a3b2011 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:16.606531 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:35:16.693954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0783d80a-b2b5-412f-8603-06230a3b2011 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a93a7ddc39b4a929ae70849e2b7ab16', 'request_id': 'req-0783d80a-b2b5-412f-8603-06230a3b2011'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:16.712755 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0783d80a-b2b5-412f-8603-06230a3b2011 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a93a7ddc39b4a929ae70849e2b7ab16', 'request_id': 'req-0783d80a-b2b5-412f-8603-06230a3b2011'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:16.728689 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0783d80a-b2b5-412f-8603-06230a3b2011 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a93a7ddc39b4a929ae70849e2b7ab16', 'request_id': 'req-0783d80a-b2b5-412f-8603-06230a3b2011'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:16.758936 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0783d80a-b2b5-412f-8603-06230a3b2011 admin admin] The token cache is being invalidate because project 7a93a7ddc39b4a929ae70849e2b7ab16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:35:16.759247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0783d80a-b2b5-412f-8603-06230a3b2011 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:16.761850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0783d80a-b2b5-412f-8603-06230a3b2011 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:16.763769 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4044/8097] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:35:16 2022] DELETE /identity/v3/projects/7a93a7ddc39b4a929ae70849e2b7ab16 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:35:16.769238 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b842400-f41b-47cc-9962-2f82c0c5843f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:16.769801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b842400-f41b-47cc-9962-2f82c0c5843f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:16.769987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b842400-f41b-47cc-9962-2f82c0c5843f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:16.796033 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-4b842400-f41b-47cc-9962-2f82c0c5843f None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:35:16.797571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4b842400-f41b-47cc-9962-2f82c0c5843f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:16.844028 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:35:16.923129 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4054/8098] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:35:17.015058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0257b-906c-4254-b3fb-80557278e208 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:17.015460 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0257b-906c-4254-b3fb-80557278e208 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:17.015746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0257b-906c-4254-b3fb-80557278e208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:17.037594 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-9bd0257b-906c-4254-b3fb-80557278e208 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:35:17.039037 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9bd0257b-906c-4254-b3fb-80557278e208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:17.055532 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4045/8099] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:35:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:35:17.059850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b842400-f41b-47cc-9962-2f82c0c5843f None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:17.074152 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b842400-f41b-47cc-9962-2f82c0c5843f None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:17.079339 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7281a9ee-8530-403c-9b78-5cddabc5065c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:17.080113 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281a9ee-8530-403c-9b78-5cddabc5065c admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:17.080681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281a9ee-8530-403c-9b78-5cddabc5065c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:17.081098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281a9ee-8530-403c-9b78-5cddabc5065c admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:17.082098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7281a9ee-8530-403c-9b78-5cddabc5065c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:35:17.082613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7281a9ee-8530-403c-9b78-5cddabc5065c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:17.084873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7281a9ee-8530-403c-9b78-5cddabc5065c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:17.104498 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4055/8100] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:35:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:35:17.108994 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0257b-906c-4254-b3fb-80557278e208 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:17.119828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0257b-906c-4254-b3fb-80557278e208 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:17.128966 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16b4ef-7609-4a10-8de3-339b2b46723f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:17.130680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16b4ef-7609-4a10-8de3-339b2b46723f admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:17.130967 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16b4ef-7609-4a10-8de3-339b2b46723f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:17.131240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16b4ef-7609-4a10-8de3-339b2b46723f admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:17.131949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc16b4ef-7609-4a10-8de3-339b2b46723f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:17.134686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc16b4ef-7609-4a10-8de3-339b2b46723f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:17.172557 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4046/8101] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:35:17 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:35:17.178696 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7281a9ee-8530-403c-9b78-5cddabc5065c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:17.197875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7281a9ee-8530-403c-9b78-5cddabc5065c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:17.269542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d6b58-3519-43b9-8cb3-90adaf06346b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:17.270166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d6b58-3519-43b9-8cb3-90adaf06346b admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:17.271008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d6b58-3519-43b9-8cb3-90adaf06346b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:17.271435 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d6b58-3519-43b9-8cb3-90adaf06346b admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:17.272217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d6b58-3519-43b9-8cb3-90adaf06346b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:17.274067 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d6b58-3519-43b9-8cb3-90adaf06346b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:17.301569 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4056/8102] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:35:17 2022] POST /identity/v3/users => generated 290 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:35:17.306569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16b4ef-7609-4a10-8de3-339b2b46723f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:17.322657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16b4ef-7609-4a10-8de3-339b2b46723f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:17.328484 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4cde1-296d-4340-bc90-77273eb7b78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:17.329614 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4cde1-296d-4340-bc90-77273eb7b78a admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:17.329902 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4cde1-296d-4340-bc90-77273eb7b78a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:17.330175 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4cde1-296d-4340-bc90-77273eb7b78a admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:17.331228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e4cde1-296d-4340-bc90-77273eb7b78a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:17.334132 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e4cde1-296d-4340-bc90-77273eb7b78a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:17.348542 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4047/8103] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:35:17.354091 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d6b58-3519-43b9-8cb3-90adaf06346b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:17.371245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d6b58-3519-43b9-8cb3-90adaf06346b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:17.378483 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c29027-dc1a-45f1-ad8a-accf09211577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:17.379469 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c29027-dc1a-45f1-ad8a-accf09211577 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:17.379469 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c29027-dc1a-45f1-ad8a-accf09211577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:17.380266 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c29027-dc1a-45f1-ad8a-accf09211577 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:17.381054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c29027-dc1a-45f1-ad8a-accf09211577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:17.383120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c29027-dc1a-45f1-ad8a-accf09211577 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:17.402299 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4057/8104] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:35:17.403693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4cde1-296d-4340-bc90-77273eb7b78a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:17.416956 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4cde1-296d-4340-bc90-77273eb7b78a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:17.422027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6580bdc-68d0-4411-8018-0d3ffbf9cecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:17.423028 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6580bdc-68d0-4411-8018-0d3ffbf9cecd admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:17.423306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6580bdc-68d0-4411-8018-0d3ffbf9cecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:17.423580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6580bdc-68d0-4411-8018-0d3ffbf9cecd admin admin] PATH_INFO: `/v3/projects/74983778526a4c5ab0352b7b74ca7906/users/fdf19732b87b42019155c38e63b2fea3/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:17.442995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6580bdc-68d0-4411-8018-0d3ffbf9cecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=74983778526a4c5ab0352b7b74ca7906, user_id=fdf19732b87b42019155c38e63b2fea3, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:17.470003 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6580bdc-68d0-4411-8018-0d3ffbf9cecd admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:17.500710 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4048/8105] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:35:17 2022] PUT /identity/v3/projects/74983778526a4c5ab0352b7b74ca7906/users/fdf19732b87b42019155c38e63b2fea3/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:35:17.512484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25458b26-eed5-476f-bb09-8bfb24dd4751 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:17.513102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25458b26-eed5-476f-bb09-8bfb24dd4751 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:17.513540 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25458b26-eed5-476f-bb09-8bfb24dd4751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:17.564893 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-25458b26-eed5-476f-bb09-8bfb24dd4751 None None] MFA Rules not processed for user `fdf19732b87b42019155c38e63b2fea3`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:35:17.566226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-25458b26-eed5-476f-bb09-8bfb24dd4751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:17.661128 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4058/8106] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:35:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:35:17.666444 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6580bdc-68d0-4411-8018-0d3ffbf9cecd admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:17.766628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6580bdc-68d0-4411-8018-0d3ffbf9cecd admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:17.778294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743e007-cc74-4317-a60b-cdbbaec3e7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:17.779182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743e007-cc74-4317-a60b-cdbbaec3e7b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:17.779481 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743e007-cc74-4317-a60b-cdbbaec3e7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:17.779761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743e007-cc74-4317-a60b-cdbbaec3e7b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:17.780463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743e007-cc74-4317-a60b-cdbbaec3e7b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:17.783697 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743e007-cc74-4317-a60b-cdbbaec3e7b7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:17.816541 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4049/8107] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:35:17 2022] POST /identity/v3/projects => generated 381 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:35:17.820944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25458b26-eed5-476f-bb09-8bfb24dd4751 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:17.833246 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25458b26-eed5-476f-bb09-8bfb24dd4751 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:17.856960 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:35:17.930217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc2ac2-bc11-43ef-a57e-64a113058516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:17.930946 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc2ac2-bc11-43ef-a57e-64a113058516 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:17.931311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc2ac2-bc11-43ef-a57e-64a113058516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:17.931640 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc2ac2-bc11-43ef-a57e-64a113058516 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:17.932482 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dc2ac2-bc11-43ef-a57e-64a113058516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:17.935274 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dc2ac2-bc11-43ef-a57e-64a113058516 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:17.964697 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4059/8108] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:35:17 2022] POST /identity/v3/users => generated 297 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:35:17.969278 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743e007-cc74-4317-a60b-cdbbaec3e7b7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:17.982851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743e007-cc74-4317-a60b-cdbbaec3e7b7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:17.988203 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ccf4d3-e278-45f4-ab34-294c8ac3108e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:17.988827 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ccf4d3-e278-45f4-ab34-294c8ac3108e admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:17.989709 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ccf4d3-e278-45f4-ab34-294c8ac3108e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:17.990011 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ccf4d3-e278-45f4-ab34-294c8ac3108e admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:17.990635 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ccf4d3-e278-45f4-ab34-294c8ac3108e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:17.992241 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ccf4d3-e278-45f4-ab34-294c8ac3108e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:18.008711 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4050/8109] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:35:18.010166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc2ac2-bc11-43ef-a57e-64a113058516 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:18.021962 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc2ac2-bc11-43ef-a57e-64a113058516 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:18.026955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361829b-63a1-4ebf-b0e0-4b30cf6acfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:18.027839 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361829b-63a1-4ebf-b0e0-4b30cf6acfcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:18.028224 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361829b-63a1-4ebf-b0e0-4b30cf6acfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:18.028604 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361829b-63a1-4ebf-b0e0-4b30cf6acfcc admin admin] PATH_INFO: `/v3/projects/511b8592163347d195204f3443fd5a11/users/6a6be5f2632a4a68830a17e3e0736836/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:18.047548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361829b-63a1-4ebf-b0e0-4b30cf6acfcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=511b8592163347d195204f3443fd5a11, user_id=6a6be5f2632a4a68830a17e3e0736836, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:18.050513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361829b-63a1-4ebf-b0e0-4b30cf6acfcc admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:18.067413 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4060/8110] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:35:18 2022] PUT /identity/v3/projects/511b8592163347d195204f3443fd5a11/users/6a6be5f2632a4a68830a17e3e0736836/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:35:18.070706 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ccf4d3-e278-45f4-ab34-294c8ac3108e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:18.080712 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ccf4d3-e278-45f4-ab34-294c8ac3108e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:18.088976 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:35:18.152409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1cd8b8-f9c9-4d32-a838-43832b37634f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:18.153168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1cd8b8-f9c9-4d32-a838-43832b37634f admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:18.153579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1cd8b8-f9c9-4d32-a838-43832b37634f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:18.153952 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1cd8b8-f9c9-4d32-a838-43832b37634f admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:18.154732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1cd8b8-f9c9-4d32-a838-43832b37634f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:18.156436 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1cd8b8-f9c9-4d32-a838-43832b37634f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:18.168064 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4051/8111] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:35:18.172128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361829b-63a1-4ebf-b0e0-4b30cf6acfcc admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:18.184267 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361829b-63a1-4ebf-b0e0-4b30cf6acfcc admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:18.190218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b8b36-635e-4bc6-ada6-1788af62b7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:18.190889 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b8b36-635e-4bc6-ada6-1788af62b7e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:18.191172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b8b36-635e-4bc6-ada6-1788af62b7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:18.191501 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b8b36-635e-4bc6-ada6-1788af62b7e9 admin admin] PATH_INFO: `/v3/projects/511b8592163347d195204f3443fd5a11/users/6a6be5f2632a4a68830a17e3e0736836/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:18.193554 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b8b36-635e-4bc6-ada6-1788af62b7e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=511b8592163347d195204f3443fd5a11, user_id=6a6be5f2632a4a68830a17e3e0736836, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:18.196780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b8b36-635e-4bc6-ada6-1788af62b7e9 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:18.208463 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4061/8112] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:35:18 2022] PUT /identity/v3/projects/511b8592163347d195204f3443fd5a11/users/6a6be5f2632a4a68830a17e3e0736836/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:35:18.218164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f950692-5829-40b1-bfc2-c07811a5b338 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:18.218581 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f950692-5829-40b1-bfc2-c07811a5b338 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:18.218859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f950692-5829-40b1-bfc2-c07811a5b338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:18.250080 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-3f950692-5829-40b1-bfc2-c07811a5b338 None None] MFA Rules not processed for user `6a6be5f2632a4a68830a17e3e0736836`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:35:18.251365 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3f950692-5829-40b1-bfc2-c07811a5b338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:18.379845 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4052/8113] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:35:18 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:35:18.387463 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b8b36-635e-4bc6-ada6-1788af62b7e9 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:18.389312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-db3b8b36-635e-4bc6-ada6-1788af62b7e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:18.498951 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b8b36-635e-4bc6-ada6-1788af62b7e9 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:18.503489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142875b-a980-46f0-873a-e41363fdee86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:18.504107 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142875b-a980-46f0-873a-e41363fdee86 service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:18.504387 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142875b-a980-46f0-873a-e41363fdee86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:18.504704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142875b-a980-46f0-873a-e41363fdee86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:18.515487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142875b-a980-46f0-873a-e41363fdee86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:18.517219 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142875b-a980-46f0-873a-e41363fdee86 service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:18.531854 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4062/8114] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:35:18 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:35:19.102311 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f950692-5829-40b1-bfc2-c07811a5b338 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:19.115938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f950692-5829-40b1-bfc2-c07811a5b338 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:19.130549 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c5c14-f0cc-4c71-b7d8-a84f343ff0c4 tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a6be5f2632a4a68830a17e3e0736836', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '511b8592163347d195204f3443fd5a11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:19.131437 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c5c14-f0cc-4c71-b7d8-a84f343ff0c4 tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:19.132585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c5c14-f0cc-4c71-b7d8-a84f343ff0c4 tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:19.132995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c5c14-f0cc-4c71-b7d8-a84f343ff0c4 tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:19.134540 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c5c14-f0cc-4c71-b7d8-a84f343ff0c4 tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:35:19.134854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c5c14-f0cc-4c71-b7d8-a84f343ff0c4 tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:19.139343 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c5c14-f0cc-4c71-b7d8-a84f343ff0c4 tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:19.165612 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142875b-a980-46f0-873a-e41363fdee86 service cinder] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:19.175817 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4053/8115] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:35:19.175976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142875b-a980-46f0-873a-e41363fdee86 service cinder] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:19.182936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0d4d0-3611-4a64-8e1e-9b027ed51b5c tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a6be5f2632a4a68830a17e3e0736836', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '511b8592163347d195204f3443fd5a11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:19.183577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0d4d0-3611-4a64-8e1e-9b027ed51b5c tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:19.183853 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0d4d0-3611-4a64-8e1e-9b027ed51b5c tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:19.184130 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0d4d0-3611-4a64-8e1e-9b027ed51b5c tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:19.184905 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd0d4d0-3611-4a64-8e1e-9b027ed51b5c tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:19.186873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd0d4d0-3611-4a64-8e1e-9b027ed51b5c tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:19.236914 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c5c14-f0cc-4c71-b7d8-a84f343ff0c4 tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:19.245467 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4063/8116] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:35:19 2022] POST /identity/v3/projects => generated 355 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:35:19.250236 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c5c14-f0cc-4c71-b7d8-a84f343ff0c4 tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:19.329523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820bb716-f5cf-486f-be20-c40a0f5e031e tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a6be5f2632a4a68830a17e3e0736836', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '511b8592163347d195204f3443fd5a11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:19.330150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bb716-f5cf-486f-be20-c40a0f5e031e tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:19.330437 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bb716-f5cf-486f-be20-c40a0f5e031e tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:19.330720 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bb716-f5cf-486f-be20-c40a0f5e031e tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:19.331510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820bb716-f5cf-486f-be20-c40a0f5e031e tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:35:19.331823 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820bb716-f5cf-486f-be20-c40a0f5e031e tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:19.333511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820bb716-f5cf-486f-be20-c40a0f5e031e tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:19.363951 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4054/8117] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:35:19.415622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0d4d0-3611-4a64-8e1e-9b027ed51b5c tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:19.427783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0d4d0-3611-4a64-8e1e-9b027ed51b5c tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:19.432864 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f90509-c033-4c96-b2b5-286a80232b5c tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a6be5f2632a4a68830a17e3e0736836', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '511b8592163347d195204f3443fd5a11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:19.433780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f90509-c033-4c96-b2b5-286a80232b5c tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:19.434172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f90509-c033-4c96-b2b5-286a80232b5c tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:19.434513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f90509-c033-4c96-b2b5-286a80232b5c tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] PATH_INFO: `/v3/projects/fa694574bcd9467eac8589b1a4894898` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:19.436168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f90509-c033-4c96-b2b5-286a80232b5c tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fa694574bcd9467eac8589b1a4894898)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:19.451389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f90509-c033-4c96-b2b5-286a80232b5c tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:19.526115 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-82f90509-c033-4c96-b2b5-286a80232b5c tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa694574bcd9467eac8589b1a4894898', 'request_id': 'req-82f90509-c033-4c96-b2b5-286a80232b5c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:19.528548 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:INSERT=6,keystone:DELETE=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:35:19.541005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-82f90509-c033-4c96-b2b5-286a80232b5c tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa694574bcd9467eac8589b1a4894898', 'request_id': 'req-82f90509-c033-4c96-b2b5-286a80232b5c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:19.551050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-82f90509-c033-4c96-b2b5-286a80232b5c tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa694574bcd9467eac8589b1a4894898', 'request_id': 'req-82f90509-c033-4c96-b2b5-286a80232b5c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:19.569085 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-82f90509-c033-4c96-b2b5-286a80232b5c tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] The token cache is being invalidate because project fa694574bcd9467eac8589b1a4894898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:35:19.569913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-82f90509-c033-4c96-b2b5-286a80232b5c tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:19.570889 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-82f90509-c033-4c96-b2b5-286a80232b5c tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:19.576560 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4064/8118] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:35:19 2022] DELETE /identity/v3/projects/fa694574bcd9467eac8589b1a4894898 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:35:19.903040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820bb716-f5cf-486f-be20-c40a0f5e031e tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:19.905559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-820bb716-f5cf-486f-be20-c40a0f5e031e tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:19.923991 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:35:20.007540 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820bb716-f5cf-486f-be20-c40a0f5e031e tempest-VolumeQuotaClassesTest-2086009139 tempest-VolumeQuotaClassesTest-2086009139-project-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:20.077985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a713a-9a80-457e-891d-9f56b1c7d23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:20.078629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a713a-9a80-457e-891d-9f56b1c7d23a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:20.079051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a713a-9a80-457e-891d-9f56b1c7d23a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:20.079330 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a713a-9a80-457e-891d-9f56b1c7d23a admin admin] PATH_INFO: `/v3/users/fdf19732b87b42019155c38e63b2fea3` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:20.080477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a713a-9a80-457e-891d-9f56b1c7d23a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdf19732b87b42019155c38e63b2fea3)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:20.083588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a713a-9a80-457e-891d-9f56b1c7d23a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:20.147218 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-536a713a-9a80-457e-891d-9f56b1c7d23a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdf19732b87b42019155c38e63b2fea3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:20.148510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-536a713a-9a80-457e-891d-9f56b1c7d23a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdf19732b87b42019155c38e63b2fea3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:20.160616 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-536a713a-9a80-457e-891d-9f56b1c7d23a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdf19732b87b42019155c38e63b2fea3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:20.171258 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-536a713a-9a80-457e-891d-9f56b1c7d23a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdf19732b87b42019155c38e63b2fea3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:20.173714 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-536a713a-9a80-457e-891d-9f56b1c7d23a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdf19732b87b42019155c38e63b2fea3'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:20.202541 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4055/8119] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:35:19 2022] DELETE /identity/v3/users/fdf19732b87b42019155c38e63b2fea3 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:35:20.206846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c4c3a-b604-4a91-a08a-8143383bcf17 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:20.207293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c4c3a-b604-4a91-a08a-8143383bcf17 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:20.208447 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c4c3a-b604-4a91-a08a-8143383bcf17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:20.229489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-860c4c3a-b604-4a91-a08a-8143383bcf17 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:35:20.230728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-860c4c3a-b604-4a91-a08a-8143383bcf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:20.322606 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4065/8120] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:35:20.355014 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a713a-9a80-457e-891d-9f56b1c7d23a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:20.356692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-536a713a-9a80-457e-891d-9f56b1c7d23a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:20.434304 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:35:20.478550 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a713a-9a80-457e-891d-9f56b1c7d23a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:20.483506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88463b-c19c-406d-b990-7d1de9c5151e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:20.484192 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88463b-c19c-406d-b990-7d1de9c5151e service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:20.484482 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88463b-c19c-406d-b990-7d1de9c5151e service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:20.485014 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88463b-c19c-406d-b990-7d1de9c5151e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:20.502485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a88463b-c19c-406d-b990-7d1de9c5151e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:20.505473 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a88463b-c19c-406d-b990-7d1de9c5151e service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:20.537110 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4056/8121] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:35:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:35:21.236087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c4c3a-b604-4a91-a08a-8143383bcf17 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:21.238312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-860c4c3a-b604-4a91-a08a-8143383bcf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:21.251994 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c4c3a-b604-4a91-a08a-8143383bcf17 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:21.258078 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc139b9c-06b4-4ee9-b405-2ff83b014b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:21.259144 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc139b9c-06b4-4ee9-b405-2ff83b014b37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:21.259624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc139b9c-06b4-4ee9-b405-2ff83b014b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:21.260274 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc139b9c-06b4-4ee9-b405-2ff83b014b37 admin admin] PATH_INFO: `/v3/projects/74983778526a4c5ab0352b7b74ca7906` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:21.261740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc139b9c-06b4-4ee9-b405-2ff83b014b37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74983778526a4c5ab0352b7b74ca7906)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:21.264038 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc139b9c-06b4-4ee9-b405-2ff83b014b37 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:21.324535 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-fc139b9c-06b4-4ee9-b405-2ff83b014b37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74983778526a4c5ab0352b7b74ca7906', 'request_id': 'req-fc139b9c-06b4-4ee9-b405-2ff83b014b37'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:21.336938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-fc139b9c-06b4-4ee9-b405-2ff83b014b37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74983778526a4c5ab0352b7b74ca7906', 'request_id': 'req-fc139b9c-06b4-4ee9-b405-2ff83b014b37'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:21.348868 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-fc139b9c-06b4-4ee9-b405-2ff83b014b37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74983778526a4c5ab0352b7b74ca7906', 'request_id': 'req-fc139b9c-06b4-4ee9-b405-2ff83b014b37'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:21.377835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-fc139b9c-06b4-4ee9-b405-2ff83b014b37 admin admin] The token cache is being invalidate because project 74983778526a4c5ab0352b7b74ca7906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:35:21.378283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-fc139b9c-06b4-4ee9-b405-2ff83b014b37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:21.381288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-fc139b9c-06b4-4ee9-b405-2ff83b014b37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:21.386233 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4066/8122] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:35:21 2022] DELETE /identity/v3/projects/74983778526a4c5ab0352b7b74ca7906 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:35:21.387576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88463b-c19c-406d-b990-7d1de9c5151e service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:21.400822 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88463b-c19c-406d-b990-7d1de9c5151e service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:21.519769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2a1d5-926c-47b3-9b62-c523b159ba53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:21.521947 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2a1d5-926c-47b3-9b62-c523b159ba53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:21.523405 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2a1d5-926c-47b3-9b62-c523b159ba53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:21.525524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2a1d5-926c-47b3-9b62-c523b159ba53 admin admin] PATH_INFO: `/v3/users/6a6be5f2632a4a68830a17e3e0736836` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:21.543681 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc2a1d5-926c-47b3-9b62-c523b159ba53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a6be5f2632a4a68830a17e3e0736836)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:21.546582 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc2a1d5-926c-47b3-9b62-c523b159ba53 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:21.622094 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8bc2a1d5-926c-47b3-9b62-c523b159ba53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a6be5f2632a4a68830a17e3e0736836'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:21.622934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8bc2a1d5-926c-47b3-9b62-c523b159ba53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a6be5f2632a4a68830a17e3e0736836'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:21.631019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8bc2a1d5-926c-47b3-9b62-c523b159ba53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a6be5f2632a4a68830a17e3e0736836'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:21.638536 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8bc2a1d5-926c-47b3-9b62-c523b159ba53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a6be5f2632a4a68830a17e3e0736836'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:21.639230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8bc2a1d5-926c-47b3-9b62-c523b159ba53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a6be5f2632a4a68830a17e3e0736836'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:21.658221 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4057/8123] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:35:21 2022] DELETE /identity/v3/users/6a6be5f2632a4a68830a17e3e0736836 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:35:22.700909 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc139b9c-06b4-4ee9-b405-2ff83b014b37 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:22.702520 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-fc139b9c-06b4-4ee9-b405-2ff83b014b37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:22.720914 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc139b9c-06b4-4ee9-b405-2ff83b014b37 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:22.843637 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10ca0d-7312-4885-9c35-36be6637910f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:22.844649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10ca0d-7312-4885-9c35-36be6637910f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:22.845072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10ca0d-7312-4885-9c35-36be6637910f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:22.845569 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10ca0d-7312-4885-9c35-36be6637910f admin admin] PATH_INFO: `/v3/projects/511b8592163347d195204f3443fd5a11` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:22.847630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10ca0d-7312-4885-9c35-36be6637910f admin admin] RBAC: Authorizing `identity:delete_project(project_id=511b8592163347d195204f3443fd5a11)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:22.850810 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10ca0d-7312-4885-9c35-36be6637910f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:22.854401 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:35:22.940404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8b10ca0d-7312-4885-9c35-36be6637910f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '511b8592163347d195204f3443fd5a11', 'request_id': 'req-8b10ca0d-7312-4885-9c35-36be6637910f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:22.957355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8b10ca0d-7312-4885-9c35-36be6637910f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '511b8592163347d195204f3443fd5a11', 'request_id': 'req-8b10ca0d-7312-4885-9c35-36be6637910f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:22.966051 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8b10ca0d-7312-4885-9c35-36be6637910f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '511b8592163347d195204f3443fd5a11', 'request_id': 'req-8b10ca0d-7312-4885-9c35-36be6637910f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:22.986409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8b10ca0d-7312-4885-9c35-36be6637910f admin admin] The token cache is being invalidate because project 511b8592163347d195204f3443fd5a11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:35:22.986709 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8b10ca0d-7312-4885-9c35-36be6637910f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:22.987398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-8b10ca0d-7312-4885-9c35-36be6637910f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:22.989190 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4067/8124] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:35:22 2022] DELETE /identity/v3/projects/511b8592163347d195204f3443fd5a11 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:35:22.993889 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050b319-554f-4bbf-8afd-8563fd0c921a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:22.994339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050b319-554f-4bbf-8afd-8563fd0c921a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:22.994441 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050b319-554f-4bbf-8afd-8563fd0c921a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:23.026965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-b050b319-554f-4bbf-8afd-8563fd0c921a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:35:23.028493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b050b319-554f-4bbf-8afd-8563fd0c921a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:23.150942 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4058/8125] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:35:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:35:23.152722 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5b08d-4b16-41ce-ac3b-1d66baddcbc8 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:23.153010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5b08d-4b16-41ce-ac3b-1d66baddcbc8 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:23.154657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5b08d-4b16-41ce-ac3b-1d66baddcbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:23.195842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-16c5b08d-4b16-41ce-ac3b-1d66baddcbc8 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:35:23.197210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-16c5b08d-4b16-41ce-ac3b-1d66baddcbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:23.219056 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4068/8126] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:35:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:35:23.222412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050b319-554f-4bbf-8afd-8563fd0c921a None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:23.230232 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:35:23.241294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050b319-554f-4bbf-8afd-8563fd0c921a None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:23.261358 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04877dd5-123d-43ed-8ab1-c7c23fb29d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:23.263540 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04877dd5-123d-43ed-8ab1-c7c23fb29d71 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:23.263766 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04877dd5-123d-43ed-8ab1-c7c23fb29d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:23.264037 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04877dd5-123d-43ed-8ab1-c7c23fb29d71 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:23.264805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04877dd5-123d-43ed-8ab1-c7c23fb29d71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:35:23.265080 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04877dd5-123d-43ed-8ab1-c7c23fb29d71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:23.266978 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04877dd5-123d-43ed-8ab1-c7c23fb29d71 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:23.303412 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4059/8127] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:35:23.304569 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5b08d-4b16-41ce-ac3b-1d66baddcbc8 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:23.321526 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5b08d-4b16-41ce-ac3b-1d66baddcbc8 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:23.333729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6709a0b-c0ee-47db-a00b-bcc6f09ad7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:23.336085 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6709a0b-c0ee-47db-a00b-bcc6f09ad7e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:23.338855 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6709a0b-c0ee-47db-a00b-bcc6f09ad7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:23.338855 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6709a0b-c0ee-47db-a00b-bcc6f09ad7e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:23.338855 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6709a0b-c0ee-47db-a00b-bcc6f09ad7e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:23.342588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6709a0b-c0ee-47db-a00b-bcc6f09ad7e8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:23.406270 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4069/8128] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:35:23 2022] POST /identity/v3/projects => generated 399 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:35:23.407968 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04877dd5-123d-43ed-8ab1-c7c23fb29d71 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:23.424043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04877dd5-123d-43ed-8ab1-c7c23fb29d71 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:23.526428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ae4a7-31b3-4bba-83f1-eb0a689b2ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:23.527155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ae4a7-31b3-4bba-83f1-eb0a689b2ad1 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:23.527515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ae4a7-31b3-4bba-83f1-eb0a689b2ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:23.528112 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ae4a7-31b3-4bba-83f1-eb0a689b2ad1 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:23.529396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ae4a7-31b3-4bba-83f1-eb0a689b2ad1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:23.532315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ae4a7-31b3-4bba-83f1-eb0a689b2ad1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:23.575604 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4060/8129] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:35:23 2022] POST /identity/v3/users => generated 300 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:35:23.580630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6709a0b-c0ee-47db-a00b-bcc6f09ad7e8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:23.597356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6709a0b-c0ee-47db-a00b-bcc6f09ad7e8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:23.604613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aefeca-3eb1-409f-b4e6-7da670c7be10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:23.605245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aefeca-3eb1-409f-b4e6-7da670c7be10 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:23.605563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aefeca-3eb1-409f-b4e6-7da670c7be10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:23.605841 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aefeca-3eb1-409f-b4e6-7da670c7be10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:23.606500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aefeca-3eb1-409f-b4e6-7da670c7be10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:23.608483 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aefeca-3eb1-409f-b4e6-7da670c7be10 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:23.626736 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4070/8130] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:35:23.627639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ae4a7-31b3-4bba-83f1-eb0a689b2ad1 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:23.644673 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ae4a7-31b3-4bba-83f1-eb0a689b2ad1 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:23.678936 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8088a-1d15-4726-82eb-4e99a2a3a62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:23.679570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8088a-1d15-4726-82eb-4e99a2a3a62d admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:23.679846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8088a-1d15-4726-82eb-4e99a2a3a62d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:23.680318 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8088a-1d15-4726-82eb-4e99a2a3a62d admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:23.681151 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8088a-1d15-4726-82eb-4e99a2a3a62d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:23.683197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8088a-1d15-4726-82eb-4e99a2a3a62d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:23.717662 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4061/8131] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:35:23.722473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aefeca-3eb1-409f-b4e6-7da670c7be10 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:23.740383 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aefeca-3eb1-409f-b4e6-7da670c7be10 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:23.748274 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a8f0c-b6cb-400e-8358-0b38daed7292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:23.749028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a8f0c-b6cb-400e-8358-0b38daed7292 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:23.749312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a8f0c-b6cb-400e-8358-0b38daed7292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:23.749643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a8f0c-b6cb-400e-8358-0b38daed7292 admin admin] PATH_INFO: `/v3/projects/9f0e37268a4547fea56eeb330dac6304/users/56c12e60a58844218382c1c736958658/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:23.785546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a8f0c-b6cb-400e-8358-0b38daed7292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f0e37268a4547fea56eeb330dac6304, user_id=56c12e60a58844218382c1c736958658, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:23.793135 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a8f0c-b6cb-400e-8358-0b38daed7292 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:23.837468 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4071/8132] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:35:23 2022] PUT /identity/v3/projects/9f0e37268a4547fea56eeb330dac6304/users/56c12e60a58844218382c1c736958658/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:35:23.848794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3de66-2999-4146-a09b-d1994cc5b49e None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:23.849264 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3de66-2999-4146-a09b-d1994cc5b49e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:23.849705 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3de66-2999-4146-a09b-d1994cc5b49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:23.945777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c4f3de66-2999-4146-a09b-d1994cc5b49e None None] MFA Rules not processed for user `56c12e60a58844218382c1c736958658`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:35:23.954470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c4f3de66-2999-4146-a09b-d1994cc5b49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:24.125571 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4062/8133] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:35:23 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:35:24.132570 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a8f0c-b6cb-400e-8358-0b38daed7292 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:24.398130 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a8f0c-b6cb-400e-8358-0b38daed7292 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:24.413481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258975a-ff34-4a40-8f92-1ef250d9c5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:24.416754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258975a-ff34-4a40-8f92-1ef250d9c5bf admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:24.417072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258975a-ff34-4a40-8f92-1ef250d9c5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:24.418090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258975a-ff34-4a40-8f92-1ef250d9c5bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:24.421253 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5258975a-ff34-4a40-8f92-1ef250d9c5bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:24.425891 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5258975a-ff34-4a40-8f92-1ef250d9c5bf admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:24.559216 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4072/8134] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:35:24 2022] POST /identity/v3/projects => generated 399 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:35:24.563433 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3de66-2999-4146-a09b-d1994cc5b49e None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:24.583900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3de66-2999-4146-a09b-d1994cc5b49e None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:24.666247 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:35:24.678764 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a7f87-a7fe-45ec-a8a5-940b4bc7bcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:24.679516 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a7f87-a7fe-45ec-a8a5-940b4bc7bcf7 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:24.679978 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a7f87-a7fe-45ec-a8a5-940b4bc7bcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:24.680259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a7f87-a7fe-45ec-a8a5-940b4bc7bcf7 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:24.681202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a7f87-a7fe-45ec-a8a5-940b4bc7bcf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:24.683205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a7f87-a7fe-45ec-a8a5-940b4bc7bcf7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:24.738483 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4063/8135] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:35:24 2022] POST /identity/v3/users => generated 306 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:35:24.741601 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258975a-ff34-4a40-8f92-1ef250d9c5bf admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:24.764081 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258975a-ff34-4a40-8f92-1ef250d9c5bf admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:24.770655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f68faa-c48c-4261-a11d-977a32d5457b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:24.771523 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f68faa-c48c-4261-a11d-977a32d5457b admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:24.771947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f68faa-c48c-4261-a11d-977a32d5457b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:24.772361 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f68faa-c48c-4261-a11d-977a32d5457b admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:24.773184 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f68faa-c48c-4261-a11d-977a32d5457b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:24.775204 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f68faa-c48c-4261-a11d-977a32d5457b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:24.791484 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4073/8136] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:35:24.795453 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a7f87-a7fe-45ec-a8a5-940b4bc7bcf7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:24.809903 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a7f87-a7fe-45ec-a8a5-940b4bc7bcf7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:24.815767 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a06689-3047-4ed8-b118-686bb65a6f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:24.817879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a06689-3047-4ed8-b118-686bb65a6f28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:24.818339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a06689-3047-4ed8-b118-686bb65a6f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:24.818806 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a06689-3047-4ed8-b118-686bb65a6f28 admin admin] PATH_INFO: `/v3/projects/6928854a84c140708cc82edec5232cd3/users/9e1277e4c8a44241b4e5b1ba14063f0a/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:24.840938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a06689-3047-4ed8-b118-686bb65a6f28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6928854a84c140708cc82edec5232cd3, user_id=9e1277e4c8a44241b4e5b1ba14063f0a, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:24.844280 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a06689-3047-4ed8-b118-686bb65a6f28 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:24.870206 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4064/8137] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:35:24 2022] PUT /identity/v3/projects/6928854a84c140708cc82edec5232cd3/users/9e1277e4c8a44241b4e5b1ba14063f0a/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:35:24.874193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f68faa-c48c-4261-a11d-977a32d5457b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:24.881620 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:35:24.891644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f68faa-c48c-4261-a11d-977a32d5457b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:24.968586 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b6e92-0273-4b32-a831-180a883c717e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:24.969454 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b6e92-0273-4b32-a831-180a883c717e admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:24.969920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b6e92-0273-4b32-a831-180a883c717e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:24.970328 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b6e92-0273-4b32-a831-180a883c717e admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:24.971200 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b6e92-0273-4b32-a831-180a883c717e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:24.972953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b6e92-0273-4b32-a831-180a883c717e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:24.991569 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4074/8138] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:35:24.996991 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a06689-3047-4ed8-b118-686bb65a6f28 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:25.015591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a06689-3047-4ed8-b118-686bb65a6f28 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:25.025555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8681f-6935-46e5-a4af-b7c00ad44798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:25.026006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8681f-6935-46e5-a4af-b7c00ad44798 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:25.026488 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8681f-6935-46e5-a4af-b7c00ad44798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:25.027625 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8681f-6935-46e5-a4af-b7c00ad44798 admin admin] PATH_INFO: `/v3/projects/6928854a84c140708cc82edec5232cd3/users/9e1277e4c8a44241b4e5b1ba14063f0a/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:25.030533 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8681f-6935-46e5-a4af-b7c00ad44798 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6928854a84c140708cc82edec5232cd3, user_id=9e1277e4c8a44241b4e5b1ba14063f0a, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:25.034799 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8681f-6935-46e5-a4af-b7c00ad44798 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:25.073513 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4065/8139] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:35:24 2022] PUT /identity/v3/projects/6928854a84c140708cc82edec5232cd3/users/9e1277e4c8a44241b4e5b1ba14063f0a/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:35:25.083816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33432f-47e0-4e37-ad61-84cda5c210fa None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:25.083816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33432f-47e0-4e37-ad61-84cda5c210fa None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:25.086457 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33432f-47e0-4e37-ad61-84cda5c210fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:25.142288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-9b33432f-47e0-4e37-ad61-84cda5c210fa None None] MFA Rules not processed for user `9e1277e4c8a44241b4e5b1ba14063f0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:35:25.142288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9b33432f-47e0-4e37-ad61-84cda5c210fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:25.247519 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4075/8140] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:35:25 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:35:25.259449 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8681f-6935-46e5-a4af-b7c00ad44798 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:25.261268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-67b8681f-6935-46e5-a4af-b7c00ad44798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:25.351908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8681f-6935-46e5-a4af-b7c00ad44798 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:25.357808 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285c223-a012-454b-b541-1f2dbd3626c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:25.358515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285c223-a012-454b-b541-1f2dbd3626c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:25.359229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285c223-a012-454b-b541-1f2dbd3626c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:25.359514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285c223-a012-454b-b541-1f2dbd3626c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:25.374094 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2285c223-a012-454b-b541-1f2dbd3626c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:25.375241 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2285c223-a012-454b-b541-1f2dbd3626c3 service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:25.390793 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4066/8141] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:35:25 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:35:25.498948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33432f-47e0-4e37-ad61-84cda5c210fa None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:25.514955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33432f-47e0-4e37-ad61-84cda5c210fa None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:25.520102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf993ef-afa7-4d42-af54-c491c5791611 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:25.521004 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf993ef-afa7-4d42-af54-c491c5791611 service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:25.521295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf993ef-afa7-4d42-af54-c491c5791611 service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:25.521799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf993ef-afa7-4d42-af54-c491c5791611 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:25.601061 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf993ef-afa7-4d42-af54-c491c5791611 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:25.602538 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf993ef-afa7-4d42-af54-c491c5791611 service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:25.613507 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4076/8142] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:35:25 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:35:34.076726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285c223-a012-454b-b541-1f2dbd3626c3 service cinder] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:34.218851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285c223-a012-454b-b541-1f2dbd3626c3 service cinder] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:34.226115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f50ab-a7f3-4695-bc10-be5eb3231ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:34.227276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f50ab-a7f3-4695-bc10-be5eb3231ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:34.227782 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f50ab-a7f3-4695-bc10-be5eb3231ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:34.228702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f50ab-a7f3-4695-bc10-be5eb3231ce1 admin admin] PATH_INFO: `/v3/users/56c12e60a58844218382c1c736958658` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:34.230383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377f50ab-a7f3-4695-bc10-be5eb3231ce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56c12e60a58844218382c1c736958658)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:34.233553 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377f50ab-a7f3-4695-bc10-be5eb3231ce1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:34.393686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-377f50ab-a7f3-4695-bc10-be5eb3231ce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56c12e60a58844218382c1c736958658'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:34.395722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-377f50ab-a7f3-4695-bc10-be5eb3231ce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56c12e60a58844218382c1c736958658'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:34.409690 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:35:34.417061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-377f50ab-a7f3-4695-bc10-be5eb3231ce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56c12e60a58844218382c1c736958658'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:34.444300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-377f50ab-a7f3-4695-bc10-be5eb3231ce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56c12e60a58844218382c1c736958658'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:34.445353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-377f50ab-a7f3-4695-bc10-be5eb3231ce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56c12e60a58844218382c1c736958658'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:34.491536 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bf40a-58e0-4c7b-9e56-45a18beb5ee0 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:34.492065 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bf40a-58e0-4c7b-9e56-45a18beb5ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:34.492065 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bf40a-58e0-4c7b-9e56-45a18beb5ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:34.494989 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4067/8143] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:35:34 2022] DELETE /identity/v3/users/56c12e60a58844218382c1c736958658 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:35:34.559379 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-062bf40a-58e0-4c7b-9e56-45a18beb5ee0 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:35:34.564136 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-062bf40a-58e0-4c7b-9e56-45a18beb5ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:34.620925 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:35:34.708320 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4077/8144] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:35:34.731492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f50ab-a7f3-4695-bc10-be5eb3231ce1 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:34.736888 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-377f50ab-a7f3-4695-bc10-be5eb3231ce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:34.869231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f50ab-a7f3-4695-bc10-be5eb3231ce1 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:34.873930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5eb2a-533f-4cf3-ab30-40a5a41e3f17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:34.874561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5eb2a-533f-4cf3-ab30-40a5a41e3f17 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:34.874889 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5eb2a-533f-4cf3-ab30-40a5a41e3f17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:34.875378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5eb2a-533f-4cf3-ab30-40a5a41e3f17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:34.889297 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5eb2a-533f-4cf3-ab30-40a5a41e3f17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:34.891183 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5eb2a-533f-4cf3-ab30-40a5a41e3f17 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:34.912508 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4068/8145] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:35:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:35:35.830110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062bf40a-58e0-4c7b-9e56-45a18beb5ee0 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:35.832143 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-062bf40a-58e0-4c7b-9e56-45a18beb5ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:35.853011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062bf40a-58e0-4c7b-9e56-45a18beb5ee0 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:35.869749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bf9fd-b0c0-45f7-8922-27863af438c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:35.873130 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bf9fd-b0c0-45f7-8922-27863af438c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:35.873409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bf9fd-b0c0-45f7-8922-27863af438c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:35.873709 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bf9fd-b0c0-45f7-8922-27863af438c1 admin admin] PATH_INFO: `/v3/projects/9f0e37268a4547fea56eeb330dac6304` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:35.879499 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1bf9fd-b0c0-45f7-8922-27863af438c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f0e37268a4547fea56eeb330dac6304)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:35.884344 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1bf9fd-b0c0-45f7-8922-27863af438c1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:35.901419 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5eb2a-533f-4cf3-ab30-40a5a41e3f17 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:35.903559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3bc5eb2a-533f-4cf3-ab30-40a5a41e3f17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:35.934170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5eb2a-533f-4cf3-ab30-40a5a41e3f17 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:35.939058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205086a-7fee-416e-aadc-2293776e7fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:35.939691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205086a-7fee-416e-aadc-2293776e7fda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:35.939967 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205086a-7fee-416e-aadc-2293776e7fda admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:35.940296 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205086a-7fee-416e-aadc-2293776e7fda admin admin] PATH_INFO: `/v3/users/519e85ccc32f4d458cad27c45d39eacd` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:35.941770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205086a-7fee-416e-aadc-2293776e7fda admin admin] RBAC: Authorizing `identity:delete_user(user_id=519e85ccc32f4d458cad27c45d39eacd)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:35.944119 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205086a-7fee-416e-aadc-2293776e7fda admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:36.017170 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6b1bf9fd-b0c0-45f7-8922-27863af438c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f0e37268a4547fea56eeb330dac6304', 'request_id': 'req-6b1bf9fd-b0c0-45f7-8922-27863af438c1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:36.043873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6b1bf9fd-b0c0-45f7-8922-27863af438c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f0e37268a4547fea56eeb330dac6304', 'request_id': 'req-6b1bf9fd-b0c0-45f7-8922-27863af438c1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:36.051882 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d205086a-7fee-416e-aadc-2293776e7fda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '519e85ccc32f4d458cad27c45d39eacd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:36.053012 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d205086a-7fee-416e-aadc-2293776e7fda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '519e85ccc32f4d458cad27c45d39eacd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:36.055355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6b1bf9fd-b0c0-45f7-8922-27863af438c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f0e37268a4547fea56eeb330dac6304', 'request_id': 'req-6b1bf9fd-b0c0-45f7-8922-27863af438c1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:36.074168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d205086a-7fee-416e-aadc-2293776e7fda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '519e85ccc32f4d458cad27c45d39eacd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:36.080712 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6b1bf9fd-b0c0-45f7-8922-27863af438c1 admin admin] The token cache is being invalidate because project 9f0e37268a4547fea56eeb330dac6304 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:35:36.081028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6b1bf9fd-b0c0-45f7-8922-27863af438c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:36.082182 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6b1bf9fd-b0c0-45f7-8922-27863af438c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:36.087275 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4078/8146] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:35:35 2022] DELETE /identity/v3/projects/9f0e37268a4547fea56eeb330dac6304 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:35:36.088476 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bf9fd-b0c0-45f7-8922-27863af438c1 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:36.090166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6b1bf9fd-b0c0-45f7-8922-27863af438c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:36.091912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d205086a-7fee-416e-aadc-2293776e7fda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '519e85ccc32f4d458cad27c45d39eacd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:36.092682 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d205086a-7fee-416e-aadc-2293776e7fda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '519e85ccc32f4d458cad27c45d39eacd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:36.130229 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4069/8147] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:35:35 2022] DELETE /identity/v3/users/519e85ccc32f4d458cad27c45d39eacd => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:35:36.136494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea5958-f57c-4058-b635-9bc4433ff731 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:36.136803 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea5958-f57c-4058-b635-9bc4433ff731 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:36.137051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea5958-f57c-4058-b635-9bc4433ff731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:36.186626 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-7fea5958-f57c-4058-b635-9bc4433ff731 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:35:36.188394 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7fea5958-f57c-4058-b635-9bc4433ff731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:36.220894 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bf9fd-b0c0-45f7-8922-27863af438c1 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:36.315824 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:35:36.319494 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:35:36.343952 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd0810-32c3-406d-af51-c2334363c23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:36.346462 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd0810-32c3-406d-af51-c2334363c23d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:36.347915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd0810-32c3-406d-af51-c2334363c23d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:36.348925 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd0810-32c3-406d-af51-c2334363c23d admin admin] PATH_INFO: `/v3/users/9e1277e4c8a44241b4e5b1ba14063f0a` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:36.351959 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd0810-32c3-406d-af51-c2334363c23d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e1277e4c8a44241b4e5b1ba14063f0a)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:36.356107 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd0810-32c3-406d-af51-c2334363c23d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:36.371107 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4070/8148] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:35:36.385168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea5958-f57c-4058-b635-9bc4433ff731 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:36.387711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7fea5958-f57c-4058-b635-9bc4433ff731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:36.450010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6bbd0810-32c3-406d-af51-c2334363c23d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e1277e4c8a44241b4e5b1ba14063f0a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:36.450649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6bbd0810-32c3-406d-af51-c2334363c23d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e1277e4c8a44241b4e5b1ba14063f0a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:36.465345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6bbd0810-32c3-406d-af51-c2334363c23d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e1277e4c8a44241b4e5b1ba14063f0a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:36.484851 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6bbd0810-32c3-406d-af51-c2334363c23d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e1277e4c8a44241b4e5b1ba14063f0a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:36.485072 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea5958-f57c-4058-b635-9bc4433ff731 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:36.488041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6bbd0810-32c3-406d-af51-c2334363c23d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e1277e4c8a44241b4e5b1ba14063f0a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:36.489535 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4afc09-b7b1-48e9-be4b-d9f5a3f06e6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:36.490164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4afc09-b7b1-48e9-be4b-d9f5a3f06e6b service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:36.490447 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4afc09-b7b1-48e9-be4b-d9f5a3f06e6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:36.490720 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4afc09-b7b1-48e9-be4b-d9f5a3f06e6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:36.494154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-eb4afc09-b7b1-48e9-be4b-d9f5a3f06e6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:36.511633 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4afc09-b7b1-48e9-be4b-d9f5a3f06e6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:36.513328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4afc09-b7b1-48e9-be4b-d9f5a3f06e6b service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:36.519175 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4079/8149] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:35:36 2022] DELETE /identity/v3/users/9e1277e4c8a44241b4e5b1ba14063f0a => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:35:36.543626 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4071/8150] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:35:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:35:37.280922 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd0810-32c3-406d-af51-c2334363c23d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:37.283056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6bbd0810-32c3-406d-af51-c2334363c23d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:37.389289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4afc09-b7b1-48e9-be4b-d9f5a3f06e6b service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:37.391062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-eb4afc09-b7b1-48e9-be4b-d9f5a3f06e6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:37.424415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4afc09-b7b1-48e9-be4b-d9f5a3f06e6b service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:37.505703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd0810-32c3-406d-af51-c2334363c23d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:37.522041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722fc7f6-eef1-4b69-9de5-d27b44558788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:37.522712 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fc7f6-eef1-4b69-9de5-d27b44558788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:37.522999 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fc7f6-eef1-4b69-9de5-d27b44558788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:37.523276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fc7f6-eef1-4b69-9de5-d27b44558788 admin admin] PATH_INFO: `/v3/projects/77742607f2704fe5ae315d4a7760528d` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:37.525392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722fc7f6-eef1-4b69-9de5-d27b44558788 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77742607f2704fe5ae315d4a7760528d)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:37.529086 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722fc7f6-eef1-4b69-9de5-d27b44558788 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:37.534107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851ab5c-5e55-4c83-92ad-0883e4ab9ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:37.538560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851ab5c-5e55-4c83-92ad-0883e4ab9ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:37.539288 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851ab5c-5e55-4c83-92ad-0883e4ab9ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:37.539760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851ab5c-5e55-4c83-92ad-0883e4ab9ad1 admin admin] PATH_INFO: `/v3/projects/6928854a84c140708cc82edec5232cd3` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:37.541828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851ab5c-5e55-4c83-92ad-0883e4ab9ad1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6928854a84c140708cc82edec5232cd3)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:37.544558 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851ab5c-5e55-4c83-92ad-0883e4ab9ad1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:37.624624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-722fc7f6-eef1-4b69-9de5-d27b44558788 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77742607f2704fe5ae315d4a7760528d', 'request_id': 'req-722fc7f6-eef1-4b69-9de5-d27b44558788'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:37.640745 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-722fc7f6-eef1-4b69-9de5-d27b44558788 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77742607f2704fe5ae315d4a7760528d', 'request_id': 'req-722fc7f6-eef1-4b69-9de5-d27b44558788'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:37.641623 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7851ab5c-5e55-4c83-92ad-0883e4ab9ad1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6928854a84c140708cc82edec5232cd3', 'request_id': 'req-7851ab5c-5e55-4c83-92ad-0883e4ab9ad1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:37.651703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7851ab5c-5e55-4c83-92ad-0883e4ab9ad1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6928854a84c140708cc82edec5232cd3', 'request_id': 'req-7851ab5c-5e55-4c83-92ad-0883e4ab9ad1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:37.653472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-722fc7f6-eef1-4b69-9de5-d27b44558788 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77742607f2704fe5ae315d4a7760528d', 'request_id': 'req-722fc7f6-eef1-4b69-9de5-d27b44558788'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:37.668690 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-722fc7f6-eef1-4b69-9de5-d27b44558788 admin admin] The token cache is being invalidate because project 77742607f2704fe5ae315d4a7760528d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:35:37.669228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-722fc7f6-eef1-4b69-9de5-d27b44558788 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:37.669694 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7851ab5c-5e55-4c83-92ad-0883e4ab9ad1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6928854a84c140708cc82edec5232cd3', 'request_id': 'req-7851ab5c-5e55-4c83-92ad-0883e4ab9ad1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:37.670383 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-722fc7f6-eef1-4b69-9de5-d27b44558788 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:37.672446 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4080/8151] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:35:37 2022] DELETE /identity/v3/projects/77742607f2704fe5ae315d4a7760528d => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:35:37.676768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722fc7f6-eef1-4b69-9de5-d27b44558788 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:37.679086 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-722fc7f6-eef1-4b69-9de5-d27b44558788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:37.685485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7851ab5c-5e55-4c83-92ad-0883e4ab9ad1 admin admin] The token cache is being invalidate because project 6928854a84c140708cc82edec5232cd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:35:37.685674 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7851ab5c-5e55-4c83-92ad-0883e4ab9ad1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:37.686878 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7851ab5c-5e55-4c83-92ad-0883e4ab9ad1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:37.688703 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:35:37.688905 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4072/8152] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:35:37 2022] DELETE /identity/v3/projects/6928854a84c140708cc82edec5232cd3 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:35:37.695458 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45796b5-d2ff-48ab-ac59-6079f8984536 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:37.695840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45796b5-d2ff-48ab-ac59-6079f8984536 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:37.696354 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45796b5-d2ff-48ab-ac59-6079f8984536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:37.732857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e45796b5-d2ff-48ab-ac59-6079f8984536 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:35:37.736640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e45796b5-d2ff-48ab-ac59-6079f8984536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:37.766608 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:35:37.867108 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722fc7f6-eef1-4b69-9de5-d27b44558788 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:37.875508 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4073/8153] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:35:37.880393 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b4954-21c1-4efb-a048-683d84655527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:37.881758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b4954-21c1-4efb-a048-683d84655527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:37.882747 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b4954-21c1-4efb-a048-683d84655527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:37.883378 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b4954-21c1-4efb-a048-683d84655527 admin admin] PATH_INFO: `/v3/users/81ba22a004ec4d85ba56f9385aa9e644` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:37.885657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b4954-21c1-4efb-a048-683d84655527 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81ba22a004ec4d85ba56f9385aa9e644)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:37.887949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843779e-3166-45b3-b770-de11cdf324c6 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:37.888236 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843779e-3166-45b3-b770-de11cdf324c6 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:37.888778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843779e-3166-45b3-b770-de11cdf324c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:37.892455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b4954-21c1-4efb-a048-683d84655527 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:37.919166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e843779e-3166-45b3-b770-de11cdf324c6 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:35:37.920918 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e843779e-3166-45b3-b770-de11cdf324c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:37.936714 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4074/8154] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:35:37.937832 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843779e-3166-45b3-b770-de11cdf324c6 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:37.956344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843779e-3166-45b3-b770-de11cdf324c6 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:37.967810 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ace4c-6857-4a3d-ab19-5f7e7b89805f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:37.968524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ace4c-6857-4a3d-ab19-5f7e7b89805f admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:37.968945 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ace4c-6857-4a3d-ab19-5f7e7b89805f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:37.969388 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ace4c-6857-4a3d-ab19-5f7e7b89805f admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:37.970151 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ace4c-6857-4a3d-ab19-5f7e7b89805f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:35:37.970508 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ace4c-6857-4a3d-ab19-5f7e7b89805f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:37.973304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ace4c-6857-4a3d-ab19-5f7e7b89805f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:37.987953 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4075/8155] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:35:37.996074 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ace4c-6857-4a3d-ab19-5f7e7b89805f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:38.009031 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7e4b4954-21c1-4efb-a048-683d84655527 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81ba22a004ec4d85ba56f9385aa9e644'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:38.010506 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7e4b4954-21c1-4efb-a048-683d84655527 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81ba22a004ec4d85ba56f9385aa9e644'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:38.012593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ace4c-6857-4a3d-ab19-5f7e7b89805f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:38.024472 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e635415-b1a8-4fa6-ac15-c2217e08be05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:38.027294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e635415-b1a8-4fa6-ac15-c2217e08be05 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:38.027654 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e635415-b1a8-4fa6-ac15-c2217e08be05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:38.028041 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e635415-b1a8-4fa6-ac15-c2217e08be05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:38.028775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e635415-b1a8-4fa6-ac15-c2217e08be05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:38.036288 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e635415-b1a8-4fa6-ac15-c2217e08be05 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:38.038497 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7e4b4954-21c1-4efb-a048-683d84655527 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81ba22a004ec4d85ba56f9385aa9e644'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:38.057756 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7e4b4954-21c1-4efb-a048-683d84655527 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81ba22a004ec4d85ba56f9385aa9e644'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:38.058876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7e4b4954-21c1-4efb-a048-683d84655527 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81ba22a004ec4d85ba56f9385aa9e644'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:38.092438 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4081/8156] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:35:37 2022] DELETE /identity/v3/users/81ba22a004ec4d85ba56f9385aa9e644 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:35:38.105286 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4076/8157] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:35:37 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:35:38.106546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b4954-21c1-4efb-a048-683d84655527 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:38.109212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7e4b4954-21c1-4efb-a048-683d84655527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:38.264720 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b4954-21c1-4efb-a048-683d84655527 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:38.357077 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:35:38.434244 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fa551-36c3-4fb8-822a-45164b06a68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:38.434244 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fa551-36c3-4fb8-822a-45164b06a68d admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:38.434244 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fa551-36c3-4fb8-822a-45164b06a68d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:38.434244 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fa551-36c3-4fb8-822a-45164b06a68d admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:38.434613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07fa551-36c3-4fb8-822a-45164b06a68d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:38.439280 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07fa551-36c3-4fb8-822a-45164b06a68d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:38.500832 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e635415-b1a8-4fa6-ac15-c2217e08be05 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:38.505538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3e635415-b1a8-4fa6-ac15-c2217e08be05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:38.523830 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4082/8158] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:35:38 2022] POST /identity/v3/users => generated 291 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:35:38.529776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fa551-36c3-4fb8-822a-45164b06a68d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:38.542686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e635415-b1a8-4fa6-ac15-c2217e08be05 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:38.546924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fa551-36c3-4fb8-822a-45164b06a68d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:38.560887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd321b3-7089-46a7-ac3a-488fab7c096b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:38.561578 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd321b3-7089-46a7-ac3a-488fab7c096b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:38.561872 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd321b3-7089-46a7-ac3a-488fab7c096b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:38.562155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd321b3-7089-46a7-ac3a-488fab7c096b admin admin] PATH_INFO: `/v3/projects/32afb8a03803440aaa761dbe0c35da3f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:38.565265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad0569-2f4e-449e-91aa-3ab4fa436d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:38.565570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd321b3-7089-46a7-ac3a-488fab7c096b admin admin] RBAC: Authorizing `identity:delete_project(project_id=32afb8a03803440aaa761dbe0c35da3f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:38.565928 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad0569-2f4e-449e-91aa-3ab4fa436d2e admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:38.566278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad0569-2f4e-449e-91aa-3ab4fa436d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:38.567177 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad0569-2f4e-449e-91aa-3ab4fa436d2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:38.567831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad0569-2f4e-449e-91aa-3ab4fa436d2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:38.569420 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad0569-2f4e-449e-91aa-3ab4fa436d2e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:38.569974 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd321b3-7089-46a7-ac3a-488fab7c096b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:38.593624 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4083/8159] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:35:38.597734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad0569-2f4e-449e-91aa-3ab4fa436d2e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:38.634715 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad0569-2f4e-449e-91aa-3ab4fa436d2e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:38.690463 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860c93d-efd4-4748-8afa-05029b7b298a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:38.693734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860c93d-efd4-4748-8afa-05029b7b298a admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:38.711297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860c93d-efd4-4748-8afa-05029b7b298a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:38.711967 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860c93d-efd4-4748-8afa-05029b7b298a admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:38.713345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860c93d-efd4-4748-8afa-05029b7b298a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:38.715254 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860c93d-efd4-4748-8afa-05029b7b298a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:38.732271 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4084/8160] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:35:38.739444 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860c93d-efd4-4748-8afa-05029b7b298a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:38.758808 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860c93d-efd4-4748-8afa-05029b7b298a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:38.825823 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9fd321b3-7089-46a7-ac3a-488fab7c096b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32afb8a03803440aaa761dbe0c35da3f', 'request_id': 'req-9fd321b3-7089-46a7-ac3a-488fab7c096b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:38.848684 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9fd321b3-7089-46a7-ac3a-488fab7c096b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32afb8a03803440aaa761dbe0c35da3f', 'request_id': 'req-9fd321b3-7089-46a7-ac3a-488fab7c096b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:38.860700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9fd321b3-7089-46a7-ac3a-488fab7c096b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32afb8a03803440aaa761dbe0c35da3f', 'request_id': 'req-9fd321b3-7089-46a7-ac3a-488fab7c096b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:38.892408 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9fd321b3-7089-46a7-ac3a-488fab7c096b admin admin] The token cache is being invalidate because project 32afb8a03803440aaa761dbe0c35da3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:35:38.892751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9fd321b3-7089-46a7-ac3a-488fab7c096b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:38.894233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9fd321b3-7089-46a7-ac3a-488fab7c096b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:38.900538 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4077/8161] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:35:38 2022] DELETE /identity/v3/projects/32afb8a03803440aaa761dbe0c35da3f => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:35:38.902352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088247d3-dcf7-4ee2-8075-3b3846d7283f None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:38.902640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088247d3-dcf7-4ee2-8075-3b3846d7283f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:38.902922 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088247d3-dcf7-4ee2-8075-3b3846d7283f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:38.928949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d68acf-d6a1-43fe-a40d-c26a08f485a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:38.929784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d68acf-d6a1-43fe-a40d-c26a08f485a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:38.930068 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d68acf-d6a1-43fe-a40d-c26a08f485a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:38.930352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d68acf-d6a1-43fe-a40d-c26a08f485a7 admin admin] PATH_INFO: `/v3/projects/665ef246be894c0f85faffd59a27d147/users/0445a2200b19414f98a685f0bc1282d6/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:38.959826 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-088247d3-dcf7-4ee2-8075-3b3846d7283f None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:35:38.961112 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-088247d3-dcf7-4ee2-8075-3b3846d7283f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:38.962993 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d68acf-d6a1-43fe-a40d-c26a08f485a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=665ef246be894c0f85faffd59a27d147, user_id=0445a2200b19414f98a685f0bc1282d6, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:38.967830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d68acf-d6a1-43fe-a40d-c26a08f485a7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:38.985615 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4078/8162] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:35:38.987257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da978aea-cbd7-4232-9b4a-d1c37a220a6d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:38.987737 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da978aea-cbd7-4232-9b4a-d1c37a220a6d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:38.988046 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da978aea-cbd7-4232-9b4a-d1c37a220a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:39.026047 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4085/8163] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:35:38 2022] PUT /identity/v3/projects/665ef246be894c0f85faffd59a27d147/users/0445a2200b19414f98a685f0bc1282d6/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:35:39.029879 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead3cb5-be50-4a33-8330-e807c5f4b6c1 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:39.030176 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead3cb5-be50-4a33-8330-e807c5f4b6c1 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:39.030456 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead3cb5-be50-4a33-8330-e807c5f4b6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:39.032669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-da978aea-cbd7-4232-9b4a-d1c37a220a6d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:35:39.033913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-da978aea-cbd7-4232-9b4a-d1c37a220a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:39.103019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-bead3cb5-be50-4a33-8330-e807c5f4b6c1 None None] MFA Rules not processed for user `0445a2200b19414f98a685f0bc1282d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:35:39.104267 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bead3cb5-be50-4a33-8330-e807c5f4b6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:39.206662 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4086/8164] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:35:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:35:39.220158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead3cb5-be50-4a33-8330-e807c5f4b6c1 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:39.222005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bead3cb5-be50-4a33-8330-e807c5f4b6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:39.224137 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:35:39.255362 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:35:39.274287 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4079/8165] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:35:39.278695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da978aea-cbd7-4232-9b4a-d1c37a220a6d None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:39.313904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da978aea-cbd7-4232-9b4a-d1c37a220a6d None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:39.322833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f058d-4995-4118-af5a-1c2c911b42a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:39.323412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f058d-4995-4118-af5a-1c2c911b42a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:39.323695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f058d-4995-4118-af5a-1c2c911b42a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:39.323960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f058d-4995-4118-af5a-1c2c911b42a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:39.324616 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025f058d-4995-4118-af5a-1c2c911b42a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:35:39.324994 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025f058d-4995-4118-af5a-1c2c911b42a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:39.326936 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025f058d-4995-4118-af5a-1c2c911b42a8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:39.383787 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4080/8166] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:35:39.390162 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f058d-4995-4118-af5a-1c2c911b42a8 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:39.398110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead3cb5-be50-4a33-8330-e807c5f4b6c1 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:39.407810 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f058d-4995-4118-af5a-1c2c911b42a8 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:39.412322 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4c5aa-9920-4c55-a0da-ca61c74ed366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:39.415301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4c5aa-9920-4c55-a0da-ca61c74ed366 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:39.416046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4c5aa-9920-4c55-a0da-ca61c74ed366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:39.416969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4c5aa-9920-4c55-a0da-ca61c74ed366 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:39.418624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4c5aa-9920-4c55-a0da-ca61c74ed366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:39.424413 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f893d8-7928-45aa-bb1b-c4350dd23157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:39.426600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4c5aa-9920-4c55-a0da-ca61c74ed366 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:39.427853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f893d8-7928-45aa-bb1b-c4350dd23157 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:39.428557 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f893d8-7928-45aa-bb1b-c4350dd23157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:39.430315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f893d8-7928-45aa-bb1b-c4350dd23157 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:39.432160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f893d8-7928-45aa-bb1b-c4350dd23157 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:39.436220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f893d8-7928-45aa-bb1b-c4350dd23157 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:39.498636 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4087/8167] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:35:39 2022] POST /identity/v3/projects => generated 381 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:35:39.504910 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4c5aa-9920-4c55-a0da-ca61c74ed366 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:39.515826 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4081/8168] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:35:39 2022] POST /identity/v3/projects => generated 381 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:35:39.517933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f893d8-7928-45aa-bb1b-c4350dd23157 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:39.646087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4c5aa-9920-4c55-a0da-ca61c74ed366 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:39.735956 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f893d8-7928-45aa-bb1b-c4350dd23157 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:39.750374 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a987f50-056d-477d-92a3-b7ef991bce20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:39.750715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a987f50-056d-477d-92a3-b7ef991bce20 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:39.751043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a987f50-056d-477d-92a3-b7ef991bce20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:39.751259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a987f50-056d-477d-92a3-b7ef991bce20 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:39.754024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a987f50-056d-477d-92a3-b7ef991bce20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:39.756322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a987f50-056d-477d-92a3-b7ef991bce20 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:39.792328 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c96ae-fd1c-4617-bfd5-f5df8a99c140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:39.797918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c96ae-fd1c-4617-bfd5-f5df8a99c140 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:39.799257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c96ae-fd1c-4617-bfd5-f5df8a99c140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:39.799603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c96ae-fd1c-4617-bfd5-f5df8a99c140 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:39.800301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c96ae-fd1c-4617-bfd5-f5df8a99c140 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:39.805116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c96ae-fd1c-4617-bfd5-f5df8a99c140 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:39.830567 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4082/8169] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:35:39 2022] POST /identity/v3/users => generated 291 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:35:39.836498 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a987f50-056d-477d-92a3-b7ef991bce20 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:39.866160 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4088/8170] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:35:39 2022] POST /identity/v3/users => generated 297 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:35:39.869997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c96ae-fd1c-4617-bfd5-f5df8a99c140 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:39.875544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a987f50-056d-477d-92a3-b7ef991bce20 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:39.888257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f334a13-61fc-463b-aad9-b37bf8b2c133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:39.890114 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f334a13-61fc-463b-aad9-b37bf8b2c133 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:39.890406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f334a13-61fc-463b-aad9-b37bf8b2c133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:39.890684 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f334a13-61fc-463b-aad9-b37bf8b2c133 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:39.891350 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f334a13-61fc-463b-aad9-b37bf8b2c133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:39.897210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f334a13-61fc-463b-aad9-b37bf8b2c133 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:39.897529 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c96ae-fd1c-4617-bfd5-f5df8a99c140 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:39.912533 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc10a1-f102-4c32-9a73-3999e98f8342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:39.913171 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc10a1-f102-4c32-9a73-3999e98f8342 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:39.913486 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc10a1-f102-4c32-9a73-3999e98f8342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:39.913766 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc10a1-f102-4c32-9a73-3999e98f8342 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:39.914428 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc10a1-f102-4c32-9a73-3999e98f8342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:39.917274 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc10a1-f102-4c32-9a73-3999e98f8342 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:39.923397 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4083/8171] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:35:39.930817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f334a13-61fc-463b-aad9-b37bf8b2c133 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:39.942694 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4089/8172] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:35:39.943686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc10a1-f102-4c32-9a73-3999e98f8342 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:39.958196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc10a1-f102-4c32-9a73-3999e98f8342 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:39.969717 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c4f1c-9c02-48ff-8699-1795de474a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:39.971297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c4f1c-9c02-48ff-8699-1795de474a3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:39.971692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c4f1c-9c02-48ff-8699-1795de474a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:39.971972 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c4f1c-9c02-48ff-8699-1795de474a3a admin admin] PATH_INFO: `/v3/projects/c836e8752cb940128a1ad0d8a9107ea6/users/a8d2470f3d2f476db8ac4131d50684ef/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:39.987770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f334a13-61fc-463b-aad9-b37bf8b2c133 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:40.009339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca264d79-d216-4a70-bda0-a96d20af9256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:40.012484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c4f1c-9c02-48ff-8699-1795de474a3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c836e8752cb940128a1ad0d8a9107ea6, user_id=a8d2470f3d2f476db8ac4131d50684ef, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:40.013569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca264d79-d216-4a70-bda0-a96d20af9256 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:40.013977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca264d79-d216-4a70-bda0-a96d20af9256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:40.014261 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca264d79-d216-4a70-bda0-a96d20af9256 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:40.014947 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca264d79-d216-4a70-bda0-a96d20af9256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:40.020390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c4f1c-9c02-48ff-8699-1795de474a3a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:40.023453 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca264d79-d216-4a70-bda0-a96d20af9256 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:40.034098 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:35:40.069105 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4090/8173] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:35:39 2022] PUT /identity/v3/projects/c836e8752cb940128a1ad0d8a9107ea6/users/a8d2470f3d2f476db8ac4131d50684ef/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:35:40.078741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c4f1c-9c02-48ff-8699-1795de474a3a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:40.078955 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4084/8174] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:35:40.081412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca264d79-d216-4a70-bda0-a96d20af9256 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:40.114450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca264d79-d216-4a70-bda0-a96d20af9256 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:40.217813 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c4f1c-9c02-48ff-8699-1795de474a3a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:40.231536 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57826f39-0cd2-4eb2-b218-d08fbbccae56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:40.232356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57826f39-0cd2-4eb2-b218-d08fbbccae56 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:40.233049 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57826f39-0cd2-4eb2-b218-d08fbbccae56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:40.235431 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57826f39-0cd2-4eb2-b218-d08fbbccae56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:40.236817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57826f39-0cd2-4eb2-b218-d08fbbccae56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:40.241111 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57826f39-0cd2-4eb2-b218-d08fbbccae56 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:40.258470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cafcfd7-53d2-418f-96c9-23e593f7ee5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:40.259124 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4091/8175] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:35:40.262556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafcfd7-53d2-418f-96c9-23e593f7ee5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:40.263829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57826f39-0cd2-4eb2-b218-d08fbbccae56 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:40.264514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafcfd7-53d2-418f-96c9-23e593f7ee5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:40.265667 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafcfd7-53d2-418f-96c9-23e593f7ee5d admin admin] PATH_INFO: `/v3/projects/28df50e5920b4b9b97474d46b25caeaf/users/73473faef3264f2498034ad3dda8f3f7/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:40.296059 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57826f39-0cd2-4eb2-b218-d08fbbccae56 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:40.301899 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cafcfd7-53d2-418f-96c9-23e593f7ee5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=28df50e5920b4b9b97474d46b25caeaf, user_id=73473faef3264f2498034ad3dda8f3f7, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:40.304441 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b8507-7695-431c-b859-2e0c0c952165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:40.305127 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b8507-7695-431c-b859-2e0c0c952165 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:40.305411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b8507-7695-431c-b859-2e0c0c952165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:40.305717 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b8507-7695-431c-b859-2e0c0c952165 admin admin] PATH_INFO: `/v3/projects/c836e8752cb940128a1ad0d8a9107ea6/users/a8d2470f3d2f476db8ac4131d50684ef/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:40.307122 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cafcfd7-53d2-418f-96c9-23e593f7ee5d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:40.313522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367b8507-7695-431c-b859-2e0c0c952165 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c836e8752cb940128a1ad0d8a9107ea6, user_id=a8d2470f3d2f476db8ac4131d50684ef, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:40.313522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367b8507-7695-431c-b859-2e0c0c952165 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:40.358793 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4092/8176] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:35:40 2022] PUT /identity/v3/projects/c836e8752cb940128a1ad0d8a9107ea6/users/a8d2470f3d2f476db8ac4131d50684ef/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:35:40.370423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafc459-8fcb-48ba-aa08-910e36786aaf None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:40.370938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafc459-8fcb-48ba-aa08-910e36786aaf None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:40.371353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafc459-8fcb-48ba-aa08-910e36786aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:40.382219 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4085/8177] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:35:40 2022] PUT /identity/v3/projects/28df50e5920b4b9b97474d46b25caeaf/users/73473faef3264f2498034ad3dda8f3f7/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:35:40.394768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a08390-a4cc-4b32-b9a0-affe74b79c8d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:40.395133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a08390-a4cc-4b32-b9a0-affe74b79c8d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:40.395507 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a08390-a4cc-4b32-b9a0-affe74b79c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:40.442298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-daafc459-8fcb-48ba-aa08-910e36786aaf None None] MFA Rules not processed for user `a8d2470f3d2f476db8ac4131d50684ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:35:40.442771 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:35:40.443928 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-daafc459-8fcb-48ba-aa08-910e36786aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:40.473475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-67a08390-a4cc-4b32-b9a0-affe74b79c8d None None] MFA Rules not processed for user `73473faef3264f2498034ad3dda8f3f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:35:40.473475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-67a08390-a4cc-4b32-b9a0-affe74b79c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:40.612589 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4086/8178] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:35:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:35:40.621168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a08390-a4cc-4b32-b9a0-affe74b79c8d None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:40.622891 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-67a08390-a4cc-4b32-b9a0-affe74b79c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:40.629327 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4093/8179] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:35:40 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:35:40.648706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daafc459-8fcb-48ba-aa08-910e36786aaf None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:40.650175 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-daafc459-8fcb-48ba-aa08-910e36786aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:40.801886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a08390-a4cc-4b32-b9a0-affe74b79c8d None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:40.811754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287b211-8962-4d04-a600-afcc4b94c630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:40.812620 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287b211-8962-4d04-a600-afcc4b94c630 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:40.812905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287b211-8962-4d04-a600-afcc4b94c630 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:40.813192 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287b211-8962-4d04-a600-afcc4b94c630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:40.821398 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daafc459-8fcb-48ba-aa08-910e36786aaf None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:40.826076 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287b211-8962-4d04-a600-afcc4b94c630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:40.827540 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287b211-8962-4d04-a600-afcc4b94c630 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:40.832849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12817c0-b30f-4b5d-8e0b-ead2eda38c56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:40.833644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12817c0-b30f-4b5d-8e0b-ead2eda38c56 service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:40.833927 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12817c0-b30f-4b5d-8e0b-ead2eda38c56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:40.834198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12817c0-b30f-4b5d-8e0b-ead2eda38c56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:40.857583 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4087/8180] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:35:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:35:40.861218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12817c0-b30f-4b5d-8e0b-ead2eda38c56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:40.863699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12817c0-b30f-4b5d-8e0b-ead2eda38c56 service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:40.902714 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4094/8181] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:35:40 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:35:41.486478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287b211-8962-4d04-a600-afcc4b94c630 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:41.675234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287b211-8962-4d04-a600-afcc4b94c630 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:41.685919 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09dbf6-eb4a-421c-8bae-719e8750e55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:41.687421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09dbf6-eb4a-421c-8bae-719e8750e55c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:41.688492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09dbf6-eb4a-421c-8bae-719e8750e55c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:41.689551 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09dbf6-eb4a-421c-8bae-719e8750e55c admin admin] PATH_INFO: `/v3/users/0445a2200b19414f98a685f0bc1282d6` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:41.692431 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09dbf6-eb4a-421c-8bae-719e8750e55c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0445a2200b19414f98a685f0bc1282d6)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:41.696609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09dbf6-eb4a-421c-8bae-719e8750e55c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:41.821960 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:35:41.825769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3d09dbf6-eb4a-421c-8bae-719e8750e55c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0445a2200b19414f98a685f0bc1282d6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:41.827438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3d09dbf6-eb4a-421c-8bae-719e8750e55c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0445a2200b19414f98a685f0bc1282d6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:41.841468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3d09dbf6-eb4a-421c-8bae-719e8750e55c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0445a2200b19414f98a685f0bc1282d6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:41.876101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3d09dbf6-eb4a-421c-8bae-719e8750e55c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0445a2200b19414f98a685f0bc1282d6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:41.879813 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3d09dbf6-eb4a-421c-8bae-719e8750e55c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0445a2200b19414f98a685f0bc1282d6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:41.935001 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4088/8182] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:35:41 2022] DELETE /identity/v3/users/0445a2200b19414f98a685f0bc1282d6 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:35:41.937107 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12baacf-941b-4540-9cab-77634523fe45 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:41.937898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12baacf-941b-4540-9cab-77634523fe45 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:41.938338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12baacf-941b-4540-9cab-77634523fe45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:41.953837 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:35:41.963994 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-f12baacf-941b-4540-9cab-77634523fe45 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:35:41.965256 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f12baacf-941b-4540-9cab-77634523fe45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:42.055969 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4095/8183] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:35:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:35:42.069476 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09dbf6-eb4a-421c-8bae-719e8750e55c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:42.072012 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3d09dbf6-eb4a-421c-8bae-719e8750e55c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:42.230693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09dbf6-eb4a-421c-8bae-719e8750e55c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:42.241826 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fdcafd-9b0c-4de2-ba9b-3691ce6953f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:42.242607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdcafd-9b0c-4de2-ba9b-3691ce6953f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:42.243007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdcafd-9b0c-4de2-ba9b-3691ce6953f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:42.243377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdcafd-9b0c-4de2-ba9b-3691ce6953f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:42.275638 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fdcafd-9b0c-4de2-ba9b-3691ce6953f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:42.277260 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fdcafd-9b0c-4de2-ba9b-3691ce6953f7 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:42.298846 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4089/8184] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:35:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:35:43.539137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12baacf-941b-4540-9cab-77634523fe45 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:43.542032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f12baacf-941b-4540-9cab-77634523fe45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:43.555216 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12baacf-941b-4540-9cab-77634523fe45 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:43.562982 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c836e-4065-48d6-a134-7f18c149d8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:43.564577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c836e-4065-48d6-a134-7f18c149d8a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:43.565157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c836e-4065-48d6-a134-7f18c149d8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:43.565623 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c836e-4065-48d6-a134-7f18c149d8a3 admin admin] PATH_INFO: `/v3/projects/665ef246be894c0f85faffd59a27d147` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:43.567051 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c836e-4065-48d6-a134-7f18c149d8a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=665ef246be894c0f85faffd59a27d147)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:43.569309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c836e-4065-48d6-a134-7f18c149d8a3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:43.648744 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1a6c836e-4065-48d6-a134-7f18c149d8a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '665ef246be894c0f85faffd59a27d147', 'request_id': 'req-1a6c836e-4065-48d6-a134-7f18c149d8a3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:43.663365 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1a6c836e-4065-48d6-a134-7f18c149d8a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '665ef246be894c0f85faffd59a27d147', 'request_id': 'req-1a6c836e-4065-48d6-a134-7f18c149d8a3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:43.674515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1a6c836e-4065-48d6-a134-7f18c149d8a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '665ef246be894c0f85faffd59a27d147', 'request_id': 'req-1a6c836e-4065-48d6-a134-7f18c149d8a3'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:43.691755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1a6c836e-4065-48d6-a134-7f18c149d8a3 admin admin] The token cache is being invalidate because project 665ef246be894c0f85faffd59a27d147 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:35:43.692055 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1a6c836e-4065-48d6-a134-7f18c149d8a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:43.692796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1a6c836e-4065-48d6-a134-7f18c149d8a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:43.697792 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4096/8185] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:35:43 2022] DELETE /identity/v3/projects/665ef246be894c0f85faffd59a27d147 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:35:43.699419 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fdcafd-9b0c-4de2-ba9b-3691ce6953f7 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:43.713023 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fdcafd-9b0c-4de2-ba9b-3691ce6953f7 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:43.861379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27b54a-1d5e-4dba-ac49-d907d2d87832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:43.862053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27b54a-1d5e-4dba-ac49-d907d2d87832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:43.862348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27b54a-1d5e-4dba-ac49-d907d2d87832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:43.862594 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27b54a-1d5e-4dba-ac49-d907d2d87832 admin admin] PATH_INFO: `/v3/users/a8d2470f3d2f476db8ac4131d50684ef` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:43.869614 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27b54a-1d5e-4dba-ac49-d907d2d87832 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8d2470f3d2f476db8ac4131d50684ef)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:43.871584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27b54a-1d5e-4dba-ac49-d907d2d87832 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:44.011582 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6d27b54a-1d5e-4dba-ac49-d907d2d87832 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8d2470f3d2f476db8ac4131d50684ef'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:44.016696 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6d27b54a-1d5e-4dba-ac49-d907d2d87832 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8d2470f3d2f476db8ac4131d50684ef'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:44.033069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6d27b54a-1d5e-4dba-ac49-d907d2d87832 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8d2470f3d2f476db8ac4131d50684ef'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:44.067731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6d27b54a-1d5e-4dba-ac49-d907d2d87832 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8d2470f3d2f476db8ac4131d50684ef'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:44.069216 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6d27b54a-1d5e-4dba-ac49-d907d2d87832 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8d2470f3d2f476db8ac4131d50684ef'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:44.077993 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:35:44.111570 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4090/8186] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:35:43 2022] DELETE /identity/v3/users/a8d2470f3d2f476db8ac4131d50684ef => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:35:44.694927 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c836e-4065-48d6-a134-7f18c149d8a3 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:44.696614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1a6c836e-4065-48d6-a134-7f18c149d8a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:44.715076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c836e-4065-48d6-a134-7f18c149d8a3 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:44.848487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70a982-f47c-475c-b881-f72469838d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:44.849156 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70a982-f47c-475c-b881-f72469838d20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:44.849512 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70a982-f47c-475c-b881-f72469838d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:44.849798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70a982-f47c-475c-b881-f72469838d20 admin admin] PATH_INFO: `/v3/projects/c836e8752cb940128a1ad0d8a9107ea6` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:44.851459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70a982-f47c-475c-b881-f72469838d20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c836e8752cb940128a1ad0d8a9107ea6)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:44.860591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70a982-f47c-475c-b881-f72469838d20 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:44.944356 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:35:44.980448 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1f70a982-f47c-475c-b881-f72469838d20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c836e8752cb940128a1ad0d8a9107ea6', 'request_id': 'req-1f70a982-f47c-475c-b881-f72469838d20'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:44.995709 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1f70a982-f47c-475c-b881-f72469838d20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c836e8752cb940128a1ad0d8a9107ea6', 'request_id': 'req-1f70a982-f47c-475c-b881-f72469838d20'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:45.010233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1f70a982-f47c-475c-b881-f72469838d20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c836e8752cb940128a1ad0d8a9107ea6', 'request_id': 'req-1f70a982-f47c-475c-b881-f72469838d20'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:45.041389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1f70a982-f47c-475c-b881-f72469838d20 admin admin] The token cache is being invalidate because project c836e8752cb940128a1ad0d8a9107ea6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:35:45.042677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1f70a982-f47c-475c-b881-f72469838d20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:45.046610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1f70a982-f47c-475c-b881-f72469838d20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:35:45.052048 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4097/8187] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:35:44 2022] DELETE /identity/v3/projects/c836e8752cb940128a1ad0d8a9107ea6 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:35:45.060897 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df7f69-9eae-431f-b1bf-1d8ebaf88892 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:45.061348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df7f69-9eae-431f-b1bf-1d8ebaf88892 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:45.061569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df7f69-9eae-431f-b1bf-1d8ebaf88892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:45.094397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a8df7f69-9eae-431f-b1bf-1d8ebaf88892 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:35:45.096935 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a8df7f69-9eae-431f-b1bf-1d8ebaf88892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:45.260880 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4091/8188] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:35:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:35:45.270127 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78826234-ae6b-42d7-b82f-07ceaa2ec58f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:45.270582 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78826234-ae6b-42d7-b82f-07ceaa2ec58f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:45.270969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78826234-ae6b-42d7-b82f-07ceaa2ec58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:45.312231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-78826234-ae6b-42d7-b82f-07ceaa2ec58f None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:35:45.321711 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-78826234-ae6b-42d7-b82f-07ceaa2ec58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:45.351965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df7f69-9eae-431f-b1bf-1d8ebaf88892 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:45.358306 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4098/8189] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:35:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:35:45.362709 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df7f69-9eae-431f-b1bf-1d8ebaf88892 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:45.367923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7fa9b-a5fc-4c73-b6d7-ab4f932ad355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:45.369428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7fa9b-a5fc-4c73-b6d7-ab4f932ad355 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:45.370005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7fa9b-a5fc-4c73-b6d7-ab4f932ad355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:45.371816 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7fa9b-a5fc-4c73-b6d7-ab4f932ad355 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:45.371816 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec7fa9b-a5fc-4c73-b6d7-ab4f932ad355 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:35:45.371816 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec7fa9b-a5fc-4c73-b6d7-ab4f932ad355 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:45.374021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec7fa9b-a5fc-4c73-b6d7-ab4f932ad355 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:45.413548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78826234-ae6b-42d7-b82f-07ceaa2ec58f None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:45.419784 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4092/8190] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:35:45.423779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78826234-ae6b-42d7-b82f-07ceaa2ec58f None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:45.429163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548dfea5-1b71-4518-9c2c-adcdc124f971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:45.430163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548dfea5-1b71-4518-9c2c-adcdc124f971 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:45.430683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548dfea5-1b71-4518-9c2c-adcdc124f971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:45.431177 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548dfea5-1b71-4518-9c2c-adcdc124f971 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:45.432039 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548dfea5-1b71-4518-9c2c-adcdc124f971 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:45.434336 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548dfea5-1b71-4518-9c2c-adcdc124f971 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:45.496348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7fa9b-a5fc-4c73-b6d7-ab4f932ad355 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:45.497232 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4099/8191] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:35:45 2022] POST /identity/v3/projects => generated 373 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:35:45.520655 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7fa9b-a5fc-4c73-b6d7-ab4f932ad355 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:45.698946 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138ce3a-081e-44e5-af7f-487e18d230f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:45.699740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138ce3a-081e-44e5-af7f-487e18d230f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:45.700156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138ce3a-081e-44e5-af7f-487e18d230f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:45.700503 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138ce3a-081e-44e5-af7f-487e18d230f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:45.701235 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1138ce3a-081e-44e5-af7f-487e18d230f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:45.703548 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1138ce3a-081e-44e5-af7f-487e18d230f6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:45.758961 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548dfea5-1b71-4518-9c2c-adcdc124f971 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:45.759474 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4093/8192] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:35:45 2022] POST /identity/v3/users => generated 287 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:35:45.774433 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548dfea5-1b71-4518-9c2c-adcdc124f971 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:45.789384 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d0caa-d70c-4e6b-81fd-af5f8ef1da15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:45.794873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d0caa-d70c-4e6b-81fd-af5f8ef1da15 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:45.795773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d0caa-d70c-4e6b-81fd-af5f8ef1da15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:45.796985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d0caa-d70c-4e6b-81fd-af5f8ef1da15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:45.800667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d0caa-d70c-4e6b-81fd-af5f8ef1da15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:45.805649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d0caa-d70c-4e6b-81fd-af5f8ef1da15 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:45.833375 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4100/8193] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:35:45.836950 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138ce3a-081e-44e5-af7f-487e18d230f6 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:45.852085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138ce3a-081e-44e5-af7f-487e18d230f6 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:45.864872 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64378abb-1204-4d74-91ec-ef295dde6c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:45.865544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64378abb-1204-4d74-91ec-ef295dde6c1c admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:45.865831 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64378abb-1204-4d74-91ec-ef295dde6c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:45.866107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64378abb-1204-4d74-91ec-ef295dde6c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:45.866760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64378abb-1204-4d74-91ec-ef295dde6c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:45.869829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64378abb-1204-4d74-91ec-ef295dde6c1c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:45.898397 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4094/8194] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:35:45.902843 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d0caa-d70c-4e6b-81fd-af5f8ef1da15 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:45.923122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d0caa-d70c-4e6b-81fd-af5f8ef1da15 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:45.942832 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b22411-cc73-43d1-ac1e-fec41731747e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:45.944231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b22411-cc73-43d1-ac1e-fec41731747e admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:45.944775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b22411-cc73-43d1-ac1e-fec41731747e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:45.945301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b22411-cc73-43d1-ac1e-fec41731747e admin admin] PATH_INFO: `/v3/projects/912b57ac86f34ec989c7e7ba6fe141f0/users/93c8175403734403b6dcba4cba264697/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:45.982707 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b22411-cc73-43d1-ac1e-fec41731747e admin admin] RBAC: Authorizing `identity:create_grant(project_id=912b57ac86f34ec989c7e7ba6fe141f0, user_id=93c8175403734403b6dcba4cba264697, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:45.987237 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b22411-cc73-43d1-ac1e-fec41731747e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:46.016481 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4101/8195] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:35:45 2022] PUT /identity/v3/projects/912b57ac86f34ec989c7e7ba6fe141f0/users/93c8175403734403b6dcba4cba264697/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:35:46.027791 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fa3f8-ae01-4a93-9eed-4b587d36fc97 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:46.028086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fa3f8-ae01-4a93-9eed-4b587d36fc97 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:46.028372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fa3f8-ae01-4a93-9eed-4b587d36fc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:46.094194 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-200fa3f8-ae01-4a93-9eed-4b587d36fc97 None None] MFA Rules not processed for user `93c8175403734403b6dcba4cba264697`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:35:46.096551 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-200fa3f8-ae01-4a93-9eed-4b587d36fc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:46.210453 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:35:46.282182 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4095/8196] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:35:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:35:46.290331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b22411-cc73-43d1-ac1e-fec41731747e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:46.292210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f7b22411-cc73-43d1-ac1e-fec41731747e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:46.385020 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b22411-cc73-43d1-ac1e-fec41731747e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:46.392259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf781d-65bb-4ef6-a6a8-d806bdc72aba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:46.392902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf781d-65bb-4ef6-a6a8-d806bdc72aba service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:46.393226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf781d-65bb-4ef6-a6a8-d806bdc72aba service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:46.393684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf781d-65bb-4ef6-a6a8-d806bdc72aba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:46.407445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf781d-65bb-4ef6-a6a8-d806bdc72aba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:46.410384 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf781d-65bb-4ef6-a6a8-d806bdc72aba service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:46.421878 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4102/8197] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:35:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:35:48.986275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fa3f8-ae01-4a93-9eed-4b587d36fc97 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:48.990595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-200fa3f8-ae01-4a93-9eed-4b587d36fc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:49.137610 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fa3f8-ae01-4a93-9eed-4b587d36fc97 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:49.143012 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0118f2-bdd3-40ca-8baa-b4932d7160ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:49.143644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0118f2-bdd3-40ca-8baa-b4932d7160ee service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:49.144015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0118f2-bdd3-40ca-8baa-b4932d7160ee service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:49.144292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0118f2-bdd3-40ca-8baa-b4932d7160ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:49.162362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3b0118f2-bdd3-40ca-8baa-b4932d7160ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:49.215458 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0118f2-bdd3-40ca-8baa-b4932d7160ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:49.223558 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0118f2-bdd3-40ca-8baa-b4932d7160ee service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:49.278561 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4096/8198] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:35:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:35:49.297107 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a7203-1dfe-4734-9473-caeec5f914b4 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:49.297736 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a7203-1dfe-4734-9473-caeec5f914b4 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:49.297736 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a7203-1dfe-4734-9473-caeec5f914b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:49.397877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-4e9a7203-1dfe-4734-9473-caeec5f914b4 None None] MFA Rules not processed for user `93c8175403734403b6dcba4cba264697`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:35:49.402475 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4e9a7203-1dfe-4734-9473-caeec5f914b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:49.426706 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4103/8199] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:35:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:35:49.657900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0118f2-bdd3-40ca-8baa-b4932d7160ee service placement] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:49.659956 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3b0118f2-bdd3-40ca-8baa-b4932d7160ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:49.891298 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0118f2-bdd3-40ca-8baa-b4932d7160ee service placement] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:49.905470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d0649-0ef6-479a-adeb-5d327e17f7f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:49.906905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d0649-0ef6-479a-adeb-5d327e17f7f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:49.908631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d0649-0ef6-479a-adeb-5d327e17f7f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:49.909089 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d0649-0ef6-479a-adeb-5d327e17f7f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:49.914999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8a7d0649-0ef6-479a-adeb-5d327e17f7f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:49.951996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7d0649-0ef6-479a-adeb-5d327e17f7f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:49.954410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7d0649-0ef6-479a-adeb-5d327e17f7f0 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:49.982802 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4097/8200] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:35:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:35:50.369676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a7203-1dfe-4734-9473-caeec5f914b4 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:50.393235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a7203-1dfe-4734-9473-caeec5f914b4 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:50.410944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f09b7-f6a7-411f-8155-d410bdc20548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:50.412157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f09b7-f6a7-411f-8155-d410bdc20548 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:50.412579 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f09b7-f6a7-411f-8155-d410bdc20548 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:50.412986 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f09b7-f6a7-411f-8155-d410bdc20548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:50.421080 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a99f09b7-f6a7-411f-8155-d410bdc20548 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:50.601771 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:35:50.650159 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f09b7-f6a7-411f-8155-d410bdc20548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:50.652144 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f09b7-f6a7-411f-8155-d410bdc20548 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:50.734949 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4104/8201] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:35:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:35:57.617155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d0649-0ef6-479a-adeb-5d327e17f7f0 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:35:57.620647 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8a7d0649-0ef6-479a-adeb-5d327e17f7f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:57.645359 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d0649-0ef6-479a-adeb-5d327e17f7f0 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:35:57.653865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa389f7-eccf-48cb-8b99-b4af43f02967 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:35:57.655179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa389f7-eccf-48cb-8b99-b4af43f02967 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:35:57.655688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa389f7-eccf-48cb-8b99-b4af43f02967 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:35:57.656350 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa389f7-eccf-48cb-8b99-b4af43f02967 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:35:57.658742 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5aa389f7-eccf-48cb-8b99-b4af43f02967 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:35:57.702391 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa389f7-eccf-48cb-8b99-b4af43f02967 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:35:57.709602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa389f7-eccf-48cb-8b99-b4af43f02967 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:35:57.755858 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4098/8202] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:35:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:36:00.667665 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=10 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:36:04.399725 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f09b7-f6a7-411f-8155-d410bdc20548 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:04.401202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a99f09b7-f6a7-411f-8155-d410bdc20548 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:04.499142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f09b7-f6a7-411f-8155-d410bdc20548 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:04.504798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5faea78-23ed-4c61-9010-04b7cc0a3648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:04.505770 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5faea78-23ed-4c61-9010-04b7cc0a3648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:04.506268 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5faea78-23ed-4c61-9010-04b7cc0a3648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:04.506994 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5faea78-23ed-4c61-9010-04b7cc0a3648 admin admin] PATH_INFO: `/v3/users/73473faef3264f2498034ad3dda8f3f7` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:04.508920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5faea78-23ed-4c61-9010-04b7cc0a3648 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73473faef3264f2498034ad3dda8f3f7)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:04.514142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5faea78-23ed-4c61-9010-04b7cc0a3648 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:04.585983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e5faea78-23ed-4c61-9010-04b7cc0a3648 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73473faef3264f2498034ad3dda8f3f7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:04.587098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e5faea78-23ed-4c61-9010-04b7cc0a3648 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73473faef3264f2498034ad3dda8f3f7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:04.603451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e5faea78-23ed-4c61-9010-04b7cc0a3648 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73473faef3264f2498034ad3dda8f3f7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:04.618327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e5faea78-23ed-4c61-9010-04b7cc0a3648 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73473faef3264f2498034ad3dda8f3f7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:04.619659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e5faea78-23ed-4c61-9010-04b7cc0a3648 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73473faef3264f2498034ad3dda8f3f7'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:04.653347 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4105/8203] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:36:04 2022] DELETE /identity/v3/users/73473faef3264f2498034ad3dda8f3f7 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:36:04.654096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298753c-91ea-4ace-8f74-d6e3af373436 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:04.654553 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298753c-91ea-4ace-8f74-d6e3af373436 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:04.654643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298753c-91ea-4ace-8f74-d6e3af373436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:04.706786 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e298753c-91ea-4ace-8f74-d6e3af373436 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:36:04.708028 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e298753c-91ea-4ace-8f74-d6e3af373436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:04.888665 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:36:04.927815 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4099/8204] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:36:04.942902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5faea78-23ed-4c61-9010-04b7cc0a3648 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:04.944380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e5faea78-23ed-4c61-9010-04b7cc0a3648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:05.075664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5faea78-23ed-4c61-9010-04b7cc0a3648 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:05.079745 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49382bc1-611b-4160-8942-fd1c4c31d690 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:05.080594 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49382bc1-611b-4160-8942-fd1c4c31d690 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:05.081882 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49382bc1-611b-4160-8942-fd1c4c31d690 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:05.082339 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49382bc1-611b-4160-8942-fd1c4c31d690 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:05.093270 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49382bc1-611b-4160-8942-fd1c4c31d690 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:05.095327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49382bc1-611b-4160-8942-fd1c4c31d690 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:05.110023 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4106/8205] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:36:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:36:05.406314 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e298753c-91ea-4ace-8f74-d6e3af373436 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:05.426127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e298753c-91ea-4ace-8f74-d6e3af373436 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:05.435079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5c64b-5ac5-47eb-9e04-af805358c2d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:05.435649 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5c64b-5ac5-47eb-9e04-af805358c2d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:05.435928 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5c64b-5ac5-47eb-9e04-af805358c2d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:05.436201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5c64b-5ac5-47eb-9e04-af805358c2d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:05.454834 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b3b5c64b-5ac5-47eb-9e04-af805358c2d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:05.476726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5c64b-5ac5-47eb-9e04-af805358c2d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:05.479359 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5c64b-5ac5-47eb-9e04-af805358c2d1 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:05.504985 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4100/8206] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:36:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:36:05.634228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49382bc1-611b-4160-8942-fd1c4c31d690 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:05.636495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-49382bc1-611b-4160-8942-fd1c4c31d690 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:05.656236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49382bc1-611b-4160-8942-fd1c4c31d690 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:05.683070 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b0b28-778e-4991-9245-d73329c01733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:05.684588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b0b28-778e-4991-9245-d73329c01733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:05.685212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b0b28-778e-4991-9245-d73329c01733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:05.697551 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b0b28-778e-4991-9245-d73329c01733 admin admin] PATH_INFO: `/v3/projects/28df50e5920b4b9b97474d46b25caeaf` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:05.707290 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b0b28-778e-4991-9245-d73329c01733 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28df50e5920b4b9b97474d46b25caeaf)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:05.710719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b0b28-778e-4991-9245-d73329c01733 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:05.761925 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:36:05.823875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6d2b0b28-778e-4991-9245-d73329c01733 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28df50e5920b4b9b97474d46b25caeaf', 'request_id': 'req-6d2b0b28-778e-4991-9245-d73329c01733'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:05.840662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6d2b0b28-778e-4991-9245-d73329c01733 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28df50e5920b4b9b97474d46b25caeaf', 'request_id': 'req-6d2b0b28-778e-4991-9245-d73329c01733'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:05.848989 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6d2b0b28-778e-4991-9245-d73329c01733 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28df50e5920b4b9b97474d46b25caeaf', 'request_id': 'req-6d2b0b28-778e-4991-9245-d73329c01733'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:05.884863 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6d2b0b28-778e-4991-9245-d73329c01733 admin admin] The token cache is being invalidate because project 28df50e5920b4b9b97474d46b25caeaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:36:05.885357 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6d2b0b28-778e-4991-9245-d73329c01733 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:05.886985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6d2b0b28-778e-4991-9245-d73329c01733 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:05.889293 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4107/8207] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:36:05 2022] DELETE /identity/v3/projects/28df50e5920b4b9b97474d46b25caeaf => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:36:05.896983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b7ee6-ae4a-4c16-9017-dd3da494f05e None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:05.897547 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b7ee6-ae4a-4c16-9017-dd3da494f05e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:05.897547 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b7ee6-ae4a-4c16-9017-dd3da494f05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:05.957022 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-bf1b7ee6-ae4a-4c16-9017-dd3da494f05e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:36:05.959756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-bf1b7ee6-ae4a-4c16-9017-dd3da494f05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:06.177674 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4101/8208] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:36:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:36:06.269316 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61490b21-9beb-4d56-aa70-137f61a8d601 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:06.269316 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61490b21-9beb-4d56-aa70-137f61a8d601 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:06.269758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61490b21-9beb-4d56-aa70-137f61a8d601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:06.290534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-61490b21-9beb-4d56-aa70-137f61a8d601 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:36:06.291754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-61490b21-9beb-4d56-aa70-137f61a8d601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:06.301146 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4108/8209] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:36:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:36:06.305757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b7ee6-ae4a-4c16-9017-dd3da494f05e None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:06.321277 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b7ee6-ae4a-4c16-9017-dd3da494f05e None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:06.334200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de93845a-717b-49f4-8ea9-90f5b01e2f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:06.334781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93845a-717b-49f4-8ea9-90f5b01e2f87 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:06.335186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93845a-717b-49f4-8ea9-90f5b01e2f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:06.335564 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93845a-717b-49f4-8ea9-90f5b01e2f87 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:06.336251 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de93845a-717b-49f4-8ea9-90f5b01e2f87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:36:06.336865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de93845a-717b-49f4-8ea9-90f5b01e2f87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:06.342163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de93845a-717b-49f4-8ea9-90f5b01e2f87 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:06.389476 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4102/8210] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:36:06.392412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61490b21-9beb-4d56-aa70-137f61a8d601 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:06.404547 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61490b21-9beb-4d56-aa70-137f61a8d601 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:06.418874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd5d1c-5096-410f-9a8a-285c4562fd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:06.423871 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd5d1c-5096-410f-9a8a-285c4562fd5a admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:06.426889 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd5d1c-5096-410f-9a8a-285c4562fd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:06.429153 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd5d1c-5096-410f-9a8a-285c4562fd5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:06.430846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd5d1c-5096-410f-9a8a-285c4562fd5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:06.434026 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd5d1c-5096-410f-9a8a-285c4562fd5a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:06.514132 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4109/8211] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:36:06 2022] POST /identity/v3/projects => generated 359 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:36:06.519239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de93845a-717b-49f4-8ea9-90f5b01e2f87 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:06.532777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de93845a-717b-49f4-8ea9-90f5b01e2f87 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:06.684135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18086cff-e3ca-4b3d-b0bd-db0804d393e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:06.684757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18086cff-e3ca-4b3d-b0bd-db0804d393e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:06.685048 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18086cff-e3ca-4b3d-b0bd-db0804d393e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:06.685316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18086cff-e3ca-4b3d-b0bd-db0804d393e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:06.686274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18086cff-e3ca-4b3d-b0bd-db0804d393e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:06.688215 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18086cff-e3ca-4b3d-b0bd-db0804d393e1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:06.722966 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4103/8212] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:36:06 2022] POST /identity/v3/users => generated 280 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:36:06.726737 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd5d1c-5096-410f-9a8a-285c4562fd5a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:06.739923 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd5d1c-5096-410f-9a8a-285c4562fd5a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:06.745333 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db01a7-75cf-4736-9c23-315e05a8c973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:06.746586 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db01a7-75cf-4736-9c23-315e05a8c973 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:06.746770 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db01a7-75cf-4736-9c23-315e05a8c973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:06.747049 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db01a7-75cf-4736-9c23-315e05a8c973 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:06.747719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db01a7-75cf-4736-9c23-315e05a8c973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:06.749677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db01a7-75cf-4736-9c23-315e05a8c973 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:06.762849 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4110/8213] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:36:06.768492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18086cff-e3ca-4b3d-b0bd-db0804d393e1 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:06.780734 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18086cff-e3ca-4b3d-b0bd-db0804d393e1 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:06.786587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2257fa4-8d93-4c21-ade2-e21e574bd9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:06.787238 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2257fa4-8d93-4c21-ade2-e21e574bd9b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:06.787523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2257fa4-8d93-4c21-ade2-e21e574bd9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:06.787808 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2257fa4-8d93-4c21-ade2-e21e574bd9b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:06.788627 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2257fa4-8d93-4c21-ade2-e21e574bd9b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:06.790653 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2257fa4-8d93-4c21-ade2-e21e574bd9b2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:06.807286 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4104/8214] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:36:06.811939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db01a7-75cf-4736-9c23-315e05a8c973 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:06.832324 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db01a7-75cf-4736-9c23-315e05a8c973 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:06.857990 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8e376-bbe1-4be6-8909-414b03bd211a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:06.858690 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8e376-bbe1-4be6-8909-414b03bd211a admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:06.858974 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8e376-bbe1-4be6-8909-414b03bd211a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:06.859652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8e376-bbe1-4be6-8909-414b03bd211a admin admin] PATH_INFO: `/v3/projects/a6557617859a483a97310f11df4da446/users/2e6f0bd46a504e5795eef35ff854cc90/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:06.903010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8e376-bbe1-4be6-8909-414b03bd211a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6557617859a483a97310f11df4da446, user_id=2e6f0bd46a504e5795eef35ff854cc90, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:06.909283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8e376-bbe1-4be6-8909-414b03bd211a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:06.954068 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4111/8215] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:36:06 2022] PUT /identity/v3/projects/a6557617859a483a97310f11df4da446/users/2e6f0bd46a504e5795eef35ff854cc90/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:36:06.970676 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21fc6e-1bcc-4c02-b1f0-234297049535 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:06.971250 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21fc6e-1bcc-4c02-b1f0-234297049535 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:06.972216 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21fc6e-1bcc-4c02-b1f0-234297049535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:07.024022 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-fb21fc6e-1bcc-4c02-b1f0-234297049535 None None] MFA Rules not processed for user `2e6f0bd46a504e5795eef35ff854cc90`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:36:07.025372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fb21fc6e-1bcc-4c02-b1f0-234297049535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:07.114666 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:36:07.172281 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4105/8216] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:36:06 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:36:07.182892 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8e376-bbe1-4be6-8909-414b03bd211a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:07.184868 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-46a8e376-bbe1-4be6-8909-414b03bd211a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:07.290360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8e376-bbe1-4be6-8909-414b03bd211a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:07.296297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d14afe-6fe2-4b8c-bf12-072f9528cf1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:07.296931 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d14afe-6fe2-4b8c-bf12-072f9528cf1e service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:07.297215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d14afe-6fe2-4b8c-bf12-072f9528cf1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:07.297510 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d14afe-6fe2-4b8c-bf12-072f9528cf1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:07.314830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d14afe-6fe2-4b8c-bf12-072f9528cf1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:07.316350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d14afe-6fe2-4b8c-bf12-072f9528cf1e service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:07.344332 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4112/8217] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:36:07 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:36:10.525193 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21fc6e-1bcc-4c02-b1f0-234297049535 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:10.526953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fb21fc6e-1bcc-4c02-b1f0-234297049535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:10.691693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21fc6e-1bcc-4c02-b1f0-234297049535 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:10.700669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfc04f-ef52-42b0-9aac-c8c823834f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:10.702083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfc04f-ef52-42b0-9aac-c8c823834f5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:10.702512 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfc04f-ef52-42b0-9aac-c8c823834f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:10.702946 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfc04f-ef52-42b0-9aac-c8c823834f5f admin admin] PATH_INFO: `/v3/users/18cd2269e636463f88b5f9d0be72cde1` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:10.705165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacfc04f-ef52-42b0-9aac-c8c823834f5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=18cd2269e636463f88b5f9d0be72cde1)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:10.708372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacfc04f-ef52-42b0-9aac-c8c823834f5f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:10.809066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-eacfc04f-ef52-42b0-9aac-c8c823834f5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18cd2269e636463f88b5f9d0be72cde1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:10.811119 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-eacfc04f-ef52-42b0-9aac-c8c823834f5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18cd2269e636463f88b5f9d0be72cde1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:10.821044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-eacfc04f-ef52-42b0-9aac-c8c823834f5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18cd2269e636463f88b5f9d0be72cde1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:10.833160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-eacfc04f-ef52-42b0-9aac-c8c823834f5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18cd2269e636463f88b5f9d0be72cde1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:10.834299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-eacfc04f-ef52-42b0-9aac-c8c823834f5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18cd2269e636463f88b5f9d0be72cde1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:10.884550 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4106/8218] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:36:10 2022] DELETE /identity/v3/users/18cd2269e636463f88b5f9d0be72cde1 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:36:10.886546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c4467-703a-4e50-8d90-5d0649503170 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:10.887014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c4467-703a-4e50-8d90-5d0649503170 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:10.887413 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c4467-703a-4e50-8d90-5d0649503170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:10.932973 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-299c4467-703a-4e50-8d90-5d0649503170 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:36:10.937593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-299c4467-703a-4e50-8d90-5d0649503170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:11.044499 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:36:11.068774 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4113/8219] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:36:11.094954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfc04f-ef52-42b0-9aac-c8c823834f5f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:11.097649 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-eacfc04f-ef52-42b0-9aac-c8c823834f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:11.331932 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfc04f-ef52-42b0-9aac-c8c823834f5f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:11.343402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256f94f-9e34-42ba-b334-5936936d9148 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:11.344192 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256f94f-9e34-42ba-b334-5936936d9148 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:11.344575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256f94f-9e34-42ba-b334-5936936d9148 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:11.344960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256f94f-9e34-42ba-b334-5936936d9148 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:11.366993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256f94f-9e34-42ba-b334-5936936d9148 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:11.368725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256f94f-9e34-42ba-b334-5936936d9148 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:11.382445 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4107/8220] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:36:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:36:12.528888 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c4467-703a-4e50-8d90-5d0649503170 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:12.530753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-299c4467-703a-4e50-8d90-5d0649503170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:12.556670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c4467-703a-4e50-8d90-5d0649503170 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:12.568590 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720cf52b-ef1f-4100-beb8-829c95775a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:12.571815 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cf52b-ef1f-4100-beb8-829c95775a91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:12.572129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cf52b-ef1f-4100-beb8-829c95775a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:12.573996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cf52b-ef1f-4100-beb8-829c95775a91 admin admin] PATH_INFO: `/v3/projects/7afa64c9133b4e58a21724036ff210b3` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:12.578265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720cf52b-ef1f-4100-beb8-829c95775a91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7afa64c9133b4e58a21724036ff210b3)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:12.582909 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720cf52b-ef1f-4100-beb8-829c95775a91 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:12.699839 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-720cf52b-ef1f-4100-beb8-829c95775a91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7afa64c9133b4e58a21724036ff210b3', 'request_id': 'req-720cf52b-ef1f-4100-beb8-829c95775a91'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:12.725135 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-720cf52b-ef1f-4100-beb8-829c95775a91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7afa64c9133b4e58a21724036ff210b3', 'request_id': 'req-720cf52b-ef1f-4100-beb8-829c95775a91'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:12.734122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-720cf52b-ef1f-4100-beb8-829c95775a91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7afa64c9133b4e58a21724036ff210b3', 'request_id': 'req-720cf52b-ef1f-4100-beb8-829c95775a91'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:12.762699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-720cf52b-ef1f-4100-beb8-829c95775a91 admin admin] The token cache is being invalidate because project 7afa64c9133b4e58a21724036ff210b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:36:12.762999 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-720cf52b-ef1f-4100-beb8-829c95775a91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:12.763870 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-720cf52b-ef1f-4100-beb8-829c95775a91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:12.769800 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4114/8221] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:36:12 2022] DELETE /identity/v3/projects/7afa64c9133b4e58a21724036ff210b3 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:36:12.771550 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841606a4-aaeb-4b6f-bbb8-456513626010 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:12.772005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841606a4-aaeb-4b6f-bbb8-456513626010 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:12.772377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841606a4-aaeb-4b6f-bbb8-456513626010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:12.795555 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:36:12.847941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-841606a4-aaeb-4b6f-bbb8-456513626010 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:36:12.849217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-841606a4-aaeb-4b6f-bbb8-456513626010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:13.036054 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4108/8222] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:36:13.041262 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441ff6c-16a7-4148-b6bb-ff28d1d8300e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:13.041905 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441ff6c-16a7-4148-b6bb-ff28d1d8300e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:13.042109 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441ff6c-16a7-4148-b6bb-ff28d1d8300e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:13.090019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5441ff6c-16a7-4148-b6bb-ff28d1d8300e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:36:13.091315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5441ff6c-16a7-4148-b6bb-ff28d1d8300e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:13.106142 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4115/8223] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:36:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:36:13.107145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841606a4-aaeb-4b6f-bbb8-456513626010 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:13.120704 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841606a4-aaeb-4b6f-bbb8-456513626010 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:13.136970 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2490cc8-1115-40ec-9d76-a6f02818f75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:13.137626 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2490cc8-1115-40ec-9d76-a6f02818f75e admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:13.138431 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2490cc8-1115-40ec-9d76-a6f02818f75e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:13.138719 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2490cc8-1115-40ec-9d76-a6f02818f75e admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:13.139598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2490cc8-1115-40ec-9d76-a6f02818f75e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:36:13.140180 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2490cc8-1115-40ec-9d76-a6f02818f75e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:13.142077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2490cc8-1115-40ec-9d76-a6f02818f75e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:13.162326 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4109/8224] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:36:13.163387 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441ff6c-16a7-4148-b6bb-ff28d1d8300e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:13.189123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441ff6c-16a7-4148-b6bb-ff28d1d8300e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:13.208335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4fd6f-26a9-4bbd-a58c-1b72afebf4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:13.209135 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4fd6f-26a9-4bbd-a58c-1b72afebf4ee admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:13.209420 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4fd6f-26a9-4bbd-a58c-1b72afebf4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:13.209717 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4fd6f-26a9-4bbd-a58c-1b72afebf4ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:13.210389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4fd6f-26a9-4bbd-a58c-1b72afebf4ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:13.212365 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4fd6f-26a9-4bbd-a58c-1b72afebf4ee admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:13.288643 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4116/8225] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:36:13 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:36:13.293428 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2490cc8-1115-40ec-9d76-a6f02818f75e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:13.321141 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2490cc8-1115-40ec-9d76-a6f02818f75e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:13.488390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10d768-478f-46cc-a849-4d6b09d6ff46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:13.489783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10d768-478f-46cc-a849-4d6b09d6ff46 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:13.490061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10d768-478f-46cc-a849-4d6b09d6ff46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:13.490329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10d768-478f-46cc-a849-4d6b09d6ff46 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:13.490974 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10d768-478f-46cc-a849-4d6b09d6ff46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:13.498383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10d768-478f-46cc-a849-4d6b09d6ff46 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:13.551962 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4110/8226] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:36:13 2022] POST /identity/v3/users => generated 293 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:36:13.555807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4fd6f-26a9-4bbd-a58c-1b72afebf4ee admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:13.576190 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4fd6f-26a9-4bbd-a58c-1b72afebf4ee admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:13.590751 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e17835-9c20-4cf8-8359-89e2a79ed217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:13.591724 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e17835-9c20-4cf8-8359-89e2a79ed217 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:13.592445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e17835-9c20-4cf8-8359-89e2a79ed217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:13.592908 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e17835-9c20-4cf8-8359-89e2a79ed217 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:13.593794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e17835-9c20-4cf8-8359-89e2a79ed217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:13.596167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e17835-9c20-4cf8-8359-89e2a79ed217 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:13.624988 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10d768-478f-46cc-a849-4d6b09d6ff46 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:13.625690 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4117/8227] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:36:13.642082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10d768-478f-46cc-a849-4d6b09d6ff46 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:13.657385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26360a3f-dfb6-4537-995c-bcf2ce633a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:13.657721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26360a3f-dfb6-4537-995c-bcf2ce633a37 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:13.658007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26360a3f-dfb6-4537-995c-bcf2ce633a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:13.658282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26360a3f-dfb6-4537-995c-bcf2ce633a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:13.659824 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26360a3f-dfb6-4537-995c-bcf2ce633a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:13.662238 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26360a3f-dfb6-4537-995c-bcf2ce633a37 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:13.685732 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4111/8228] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:36:13.690299 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e17835-9c20-4cf8-8359-89e2a79ed217 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:13.709086 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e17835-9c20-4cf8-8359-89e2a79ed217 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:13.723006 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36231c95-dc08-432a-89e2-821ccabb9e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:13.724076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36231c95-dc08-432a-89e2-821ccabb9e1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:13.724554 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36231c95-dc08-432a-89e2-821ccabb9e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:13.725019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36231c95-dc08-432a-89e2-821ccabb9e1e admin admin] PATH_INFO: `/v3/projects/de165aa9eac140f486975260ca08b689/users/c323222b63b149c5b25105d3d51ccb70/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:13.757320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36231c95-dc08-432a-89e2-821ccabb9e1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=de165aa9eac140f486975260ca08b689, user_id=c323222b63b149c5b25105d3d51ccb70, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:13.767781 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36231c95-dc08-432a-89e2-821ccabb9e1e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:13.793308 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4118/8229] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:36:13 2022] PUT /identity/v3/projects/de165aa9eac140f486975260ca08b689/users/c323222b63b149c5b25105d3d51ccb70/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:36:13.804415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b905b-7e69-4c98-ba9d-0c6cb036b463 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:13.804967 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b905b-7e69-4c98-ba9d-0c6cb036b463 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:13.805189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b905b-7e69-4c98-ba9d-0c6cb036b463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:13.869357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-808b905b-7e69-4c98-ba9d-0c6cb036b463 None None] MFA Rules not processed for user `c323222b63b149c5b25105d3d51ccb70`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:36:13.871342 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-808b905b-7e69-4c98-ba9d-0c6cb036b463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:14.024724 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:36:14.042328 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36231c95-dc08-432a-89e2-821ccabb9e1e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:14.042900 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4112/8230] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:36:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:36:14.207705 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36231c95-dc08-432a-89e2-821ccabb9e1e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:14.223321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8462b-d812-4771-9742-defc49dcfdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:14.223959 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8462b-d812-4771-9742-defc49dcfdc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:14.224241 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8462b-d812-4771-9742-defc49dcfdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:14.224515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8462b-d812-4771-9742-defc49dcfdc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:14.225462 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8462b-d812-4771-9742-defc49dcfdc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:14.227542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8462b-d812-4771-9742-defc49dcfdc7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:14.251605 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:36:14.292832 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4119/8231] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:36:14 2022] POST /identity/v3/projects => generated 387 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:36:14.296836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b905b-7e69-4c98-ba9d-0c6cb036b463 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:14.312401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b905b-7e69-4c98-ba9d-0c6cb036b463 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:14.436025 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b630ecc-73bb-42c1-93f3-d7d5337f187b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:14.442277 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b630ecc-73bb-42c1-93f3-d7d5337f187b admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:14.442872 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b630ecc-73bb-42c1-93f3-d7d5337f187b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:14.444412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b630ecc-73bb-42c1-93f3-d7d5337f187b admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:14.447751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b630ecc-73bb-42c1-93f3-d7d5337f187b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:14.466455 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b630ecc-73bb-42c1-93f3-d7d5337f187b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:14.531311 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4113/8232] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:36:14 2022] POST /identity/v3/users => generated 301 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:36:14.531801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8462b-d812-4771-9742-defc49dcfdc7 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:14.546533 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8462b-d812-4771-9742-defc49dcfdc7 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:14.552861 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b0d37-bb24-44aa-8f90-ee2c86710730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:14.553717 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b0d37-bb24-44aa-8f90-ee2c86710730 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:14.554170 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b0d37-bb24-44aa-8f90-ee2c86710730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:14.554592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b0d37-bb24-44aa-8f90-ee2c86710730 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:14.555845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b0d37-bb24-44aa-8f90-ee2c86710730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:14.558804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b0d37-bb24-44aa-8f90-ee2c86710730 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:14.591814 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b630ecc-73bb-42c1-93f3-d7d5337f187b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:14.599575 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4120/8233] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:36:14.612360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b630ecc-73bb-42c1-93f3-d7d5337f187b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:14.618510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965437fe-bdb8-4337-9f86-8f65c88a5a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:14.619430 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965437fe-bdb8-4337-9f86-8f65c88a5a3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:14.619871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965437fe-bdb8-4337-9f86-8f65c88a5a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:14.620459 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965437fe-bdb8-4337-9f86-8f65c88a5a3b admin admin] PATH_INFO: `/v3/projects/c4aac47421924b01bf7cbfbedaf60f65/users/ba8e14402a62465f96965d670002d960/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:14.664182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965437fe-bdb8-4337-9f86-8f65c88a5a3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4aac47421924b01bf7cbfbedaf60f65, user_id=ba8e14402a62465f96965d670002d960, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:14.678918 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965437fe-bdb8-4337-9f86-8f65c88a5a3b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:14.710747 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4114/8234] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:36:14 2022] PUT /identity/v3/projects/c4aac47421924b01bf7cbfbedaf60f65/users/ba8e14402a62465f96965d670002d960/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:36:14.720943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6d11a-7187-45f5-a60c-72786d24fc8c None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:14.721281 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6d11a-7187-45f5-a60c-72786d24fc8c None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:14.721600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6d11a-7187-45f5-a60c-72786d24fc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:14.808701 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-03d6d11a-7187-45f5-a60c-72786d24fc8c None None] MFA Rules not processed for user `ba8e14402a62465f96965d670002d960`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:36:14.809953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-03d6d11a-7187-45f5-a60c-72786d24fc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:14.959089 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4121/8235] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:36:14 2022] POST /identity/v3/auth/tokens => generated 3271 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:36:14.987627 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965437fe-bdb8-4337-9f86-8f65c88a5a3b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:14.990806 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-965437fe-bdb8-4337-9f86-8f65c88a5a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:15.186394 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965437fe-bdb8-4337-9f86-8f65c88a5a3b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:15.198195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d0c9f-031d-4f86-9318-9762f9b83615 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:15.199152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d0c9f-031d-4f86-9318-9762f9b83615 service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:15.199442 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d0c9f-031d-4f86-9318-9762f9b83615 service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:15.200310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d0c9f-031d-4f86-9318-9762f9b83615 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:15.217602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3d0c9f-031d-4f86-9318-9762f9b83615 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:15.217602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3d0c9f-031d-4f86-9318-9762f9b83615 service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:15.250979 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4115/8236] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:36:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 680 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:36:16.775558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6d11a-7187-45f5-a60c-72786d24fc8c None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:16.991728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6d11a-7187-45f5-a60c-72786d24fc8c None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:16.997334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52445d5-d2fe-4e92-b4a6-c856ec074eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:16.998387 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52445d5-d2fe-4e92-b4a6-c856ec074eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:16.999064 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52445d5-d2fe-4e92-b4a6-c856ec074eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:16.999495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52445d5-d2fe-4e92-b4a6-c856ec074eed admin admin] PATH_INFO: `/v3/users/c323222b63b149c5b25105d3d51ccb70` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:17.000971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52445d5-d2fe-4e92-b4a6-c856ec074eed admin admin] RBAC: Authorizing `identity:delete_user(user_id=c323222b63b149c5b25105d3d51ccb70)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:17.004080 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52445d5-d2fe-4e92-b4a6-c856ec074eed admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:17.092903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a52445d5-d2fe-4e92-b4a6-c856ec074eed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c323222b63b149c5b25105d3d51ccb70'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:17.093785 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a52445d5-d2fe-4e92-b4a6-c856ec074eed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c323222b63b149c5b25105d3d51ccb70'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:17.119492 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a52445d5-d2fe-4e92-b4a6-c856ec074eed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c323222b63b149c5b25105d3d51ccb70'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:17.140598 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a52445d5-d2fe-4e92-b4a6-c856ec074eed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c323222b63b149c5b25105d3d51ccb70'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:17.142876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a52445d5-d2fe-4e92-b4a6-c856ec074eed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c323222b63b149c5b25105d3d51ccb70'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:17.161157 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:36:17.215199 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4122/8237] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:36:16 2022] DELETE /identity/v3/users/c323222b63b149c5b25105d3d51ccb70 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:36:17.219578 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2b889-7cb1-44df-801a-67acb04538f7 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:17.220045 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2b889-7cb1-44df-801a-67acb04538f7 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:17.220148 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2b889-7cb1-44df-801a-67acb04538f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:17.261500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-d5e2b889-7cb1-44df-801a-67acb04538f7 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:36:17.270262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d5e2b889-7cb1-44df-801a-67acb04538f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:17.364289 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:36:17.449537 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4116/8238] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:36:17.457272 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52445d5-d2fe-4e92-b4a6-c856ec074eed admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:17.461291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a52445d5-d2fe-4e92-b4a6-c856ec074eed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:17.643368 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52445d5-d2fe-4e92-b4a6-c856ec074eed admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:17.648131 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c9ffe-248d-45de-9cc1-4cfd07116703 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:17.649075 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c9ffe-248d-45de-9cc1-4cfd07116703 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:17.649597 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c9ffe-248d-45de-9cc1-4cfd07116703 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:17.650055 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c9ffe-248d-45de-9cc1-4cfd07116703 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:17.682419 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c9ffe-248d-45de-9cc1-4cfd07116703 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:17.684254 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c9ffe-248d-45de-9cc1-4cfd07116703 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:17.724406 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4123/8239] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:36:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:36:18.338655 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2b889-7cb1-44df-801a-67acb04538f7 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:18.340122 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d5e2b889-7cb1-44df-801a-67acb04538f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:18.380131 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2b889-7cb1-44df-801a-67acb04538f7 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:18.413283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51410c-5910-4d6f-93dc-96817699a185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:18.413991 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51410c-5910-4d6f-93dc-96817699a185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:18.414270 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51410c-5910-4d6f-93dc-96817699a185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:18.414988 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51410c-5910-4d6f-93dc-96817699a185 admin admin] PATH_INFO: `/v3/projects/de165aa9eac140f486975260ca08b689` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:18.416311 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c51410c-5910-4d6f-93dc-96817699a185 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de165aa9eac140f486975260ca08b689)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:18.418284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c51410c-5910-4d6f-93dc-96817699a185 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:18.561265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1c51410c-5910-4d6f-93dc-96817699a185 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de165aa9eac140f486975260ca08b689', 'request_id': 'req-1c51410c-5910-4d6f-93dc-96817699a185'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:18.580884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1c51410c-5910-4d6f-93dc-96817699a185 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de165aa9eac140f486975260ca08b689', 'request_id': 'req-1c51410c-5910-4d6f-93dc-96817699a185'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:18.588222 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1c51410c-5910-4d6f-93dc-96817699a185 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de165aa9eac140f486975260ca08b689', 'request_id': 'req-1c51410c-5910-4d6f-93dc-96817699a185'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:18.637679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1c51410c-5910-4d6f-93dc-96817699a185 admin admin] The token cache is being invalidate because project de165aa9eac140f486975260ca08b689 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:36:18.637951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1c51410c-5910-4d6f-93dc-96817699a185 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:18.642291 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-1c51410c-5910-4d6f-93dc-96817699a185 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:18.647383 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4117/8240] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:36:18 2022] DELETE /identity/v3/projects/de165aa9eac140f486975260ca08b689 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:36:18.651839 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c9ffe-248d-45de-9cc1-4cfd07116703 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:18.681145 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c9ffe-248d-45de-9cc1-4cfd07116703 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:18.903693 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7055495-ccc6-4f17-a1d1-5cee6b11882f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:18.904388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7055495-ccc6-4f17-a1d1-5cee6b11882f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:18.904674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7055495-ccc6-4f17-a1d1-5cee6b11882f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:18.905122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7055495-ccc6-4f17-a1d1-5cee6b11882f admin admin] PATH_INFO: `/v3/users/ba8e14402a62465f96965d670002d960` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:18.912184 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7055495-ccc6-4f17-a1d1-5cee6b11882f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba8e14402a62465f96965d670002d960)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:18.914228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7055495-ccc6-4f17-a1d1-5cee6b11882f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:19.031572 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c7055495-ccc6-4f17-a1d1-5cee6b11882f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba8e14402a62465f96965d670002d960'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:19.032600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c7055495-ccc6-4f17-a1d1-5cee6b11882f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba8e14402a62465f96965d670002d960'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:19.052230 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c7055495-ccc6-4f17-a1d1-5cee6b11882f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba8e14402a62465f96965d670002d960'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:19.068442 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c7055495-ccc6-4f17-a1d1-5cee6b11882f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba8e14402a62465f96965d670002d960'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:19.069048 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c7055495-ccc6-4f17-a1d1-5cee6b11882f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba8e14402a62465f96965d670002d960'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:19.099949 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4124/8241] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:36:18 2022] DELETE /identity/v3/users/ba8e14402a62465f96965d670002d960 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:36:19.981912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51410c-5910-4d6f-93dc-96817699a185 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:19.984794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1c51410c-5910-4d6f-93dc-96817699a185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:20.000657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51410c-5910-4d6f-93dc-96817699a185 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:20.136105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76f466-8afb-4eca-b377-6b2363c278a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:20.136761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76f466-8afb-4eca-b377-6b2363c278a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:20.137041 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76f466-8afb-4eca-b377-6b2363c278a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:20.137318 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76f466-8afb-4eca-b377-6b2363c278a9 admin admin] PATH_INFO: `/v3/projects/c4aac47421924b01bf7cbfbedaf60f65` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:20.141104 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76f466-8afb-4eca-b377-6b2363c278a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4aac47421924b01bf7cbfbedaf60f65)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:20.144033 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76f466-8afb-4eca-b377-6b2363c278a9 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:20.218691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0d76f466-8afb-4eca-b377-6b2363c278a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4aac47421924b01bf7cbfbedaf60f65', 'request_id': 'req-0d76f466-8afb-4eca-b377-6b2363c278a9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:20.232655 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0d76f466-8afb-4eca-b377-6b2363c278a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4aac47421924b01bf7cbfbedaf60f65', 'request_id': 'req-0d76f466-8afb-4eca-b377-6b2363c278a9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:20.243937 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:36:20.247535 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0d76f466-8afb-4eca-b377-6b2363c278a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4aac47421924b01bf7cbfbedaf60f65', 'request_id': 'req-0d76f466-8afb-4eca-b377-6b2363c278a9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:20.269818 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0d76f466-8afb-4eca-b377-6b2363c278a9 admin admin] The token cache is being invalidate because project c4aac47421924b01bf7cbfbedaf60f65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:36:20.273175 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0d76f466-8afb-4eca-b377-6b2363c278a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:20.274495 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0d76f466-8afb-4eca-b377-6b2363c278a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:20.280800 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4118/8242] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:36:19 2022] DELETE /identity/v3/projects/c4aac47421924b01bf7cbfbedaf60f65 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:36:20.282758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4129704-2bbe-46bc-92f0-33d85826fb0d None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:20.283312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4129704-2bbe-46bc-92f0-33d85826fb0d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:20.283407 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4129704-2bbe-46bc-92f0-33d85826fb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:20.321246 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c4129704-2bbe-46bc-92f0-33d85826fb0d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:36:20.328454 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c4129704-2bbe-46bc-92f0-33d85826fb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:20.335929 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:36:20.472756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7a200-6b0d-4a1f-adb5-4f7d4776a090 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:20.473602 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4125/8243] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:36:20.474064 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7a200-6b0d-4a1f-adb5-4f7d4776a090 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:20.474420 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7a200-6b0d-4a1f-adb5-4f7d4776a090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:20.510063 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-f1b7a200-6b0d-4a1f-adb5-4f7d4776a090 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:36:20.514585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f1b7a200-6b0d-4a1f-adb5-4f7d4776a090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:20.534009 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4119/8244] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:36:20.539083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4129704-2bbe-46bc-92f0-33d85826fb0d None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:20.550981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4129704-2bbe-46bc-92f0-33d85826fb0d None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:20.565271 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281c9c2-6550-4852-8767-6aaa54eab19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:20.565936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281c9c2-6550-4852-8767-6aaa54eab19c admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:20.566319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281c9c2-6550-4852-8767-6aaa54eab19c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:20.566472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281c9c2-6550-4852-8767-6aaa54eab19c admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:20.567134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8281c9c2-6550-4852-8767-6aaa54eab19c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:36:20.572702 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8281c9c2-6550-4852-8767-6aaa54eab19c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:20.576462 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8281c9c2-6550-4852-8767-6aaa54eab19c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:20.617168 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4126/8245] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:36:20.618379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7a200-6b0d-4a1f-adb5-4f7d4776a090 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:20.629904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7a200-6b0d-4a1f-adb5-4f7d4776a090 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:20.641570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fc48a-d425-4034-bd8e-9a62cc06a987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:20.642195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fc48a-d425-4034-bd8e-9a62cc06a987 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:20.642538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fc48a-d425-4034-bd8e-9a62cc06a987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:20.642815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fc48a-d425-4034-bd8e-9a62cc06a987 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:20.643523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444fc48a-d425-4034-bd8e-9a62cc06a987 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:20.648201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444fc48a-d425-4034-bd8e-9a62cc06a987 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:20.702989 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4120/8246] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:36:20 2022] POST /identity/v3/projects => generated 373 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:36:20.706205 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281c9c2-6550-4852-8767-6aaa54eab19c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:20.720655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281c9c2-6550-4852-8767-6aaa54eab19c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:20.868580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579c47c-df5f-4771-8280-77fe2728e914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:20.871113 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579c47c-df5f-4771-8280-77fe2728e914 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:20.871405 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579c47c-df5f-4771-8280-77fe2728e914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:20.871683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579c47c-df5f-4771-8280-77fe2728e914 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:20.872335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2579c47c-df5f-4771-8280-77fe2728e914 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:20.874345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2579c47c-df5f-4771-8280-77fe2728e914 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:20.913977 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4127/8247] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:36:20 2022] POST /identity/v3/users => generated 287 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:36:20.918404 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fc48a-d425-4034-bd8e-9a62cc06a987 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:20.941125 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fc48a-d425-4034-bd8e-9a62cc06a987 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:20.966122 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132eeba-6c52-4d29-88bd-6bfdc7d02193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:20.968047 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132eeba-6c52-4d29-88bd-6bfdc7d02193 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:20.968331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132eeba-6c52-4d29-88bd-6bfdc7d02193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:20.969741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132eeba-6c52-4d29-88bd-6bfdc7d02193 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:20.970456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132eeba-6c52-4d29-88bd-6bfdc7d02193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:20.974731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132eeba-6c52-4d29-88bd-6bfdc7d02193 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:21.007387 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4121/8248] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:36:21.015678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579c47c-df5f-4771-8280-77fe2728e914 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:21.035658 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579c47c-df5f-4771-8280-77fe2728e914 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:21.044260 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a71f6d-47c7-4f2c-b76d-7c082b1a2331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:21.046552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a71f6d-47c7-4f2c-b76d-7c082b1a2331 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:21.047065 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a71f6d-47c7-4f2c-b76d-7c082b1a2331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:21.047486 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a71f6d-47c7-4f2c-b76d-7c082b1a2331 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:21.048344 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a71f6d-47c7-4f2c-b76d-7c082b1a2331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:21.051455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a71f6d-47c7-4f2c-b76d-7c082b1a2331 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:21.072758 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4128/8249] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:36:21.077324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132eeba-6c52-4d29-88bd-6bfdc7d02193 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:21.090920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132eeba-6c52-4d29-88bd-6bfdc7d02193 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:21.102774 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0adb2-5dbe-4b2b-8cba-5729354fac3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:21.103464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0adb2-5dbe-4b2b-8cba-5729354fac3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:21.103742 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0adb2-5dbe-4b2b-8cba-5729354fac3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:21.104014 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0adb2-5dbe-4b2b-8cba-5729354fac3a admin admin] PATH_INFO: `/v3/projects/d315d287f5584f4f83558b6d9cd68a4e/users/caa1565f8d9a41cd8632bfe08f9f1c38/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:21.137233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0adb2-5dbe-4b2b-8cba-5729354fac3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d315d287f5584f4f83558b6d9cd68a4e, user_id=caa1565f8d9a41cd8632bfe08f9f1c38, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:21.139686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0adb2-5dbe-4b2b-8cba-5729354fac3a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:21.166957 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4122/8250] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:36:21 2022] PUT /identity/v3/projects/d315d287f5584f4f83558b6d9cd68a4e/users/caa1565f8d9a41cd8632bfe08f9f1c38/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:36:21.171920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5893d-6734-422b-b4fe-a5b6b13d4c8a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:21.172211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5893d-6734-422b-b4fe-a5b6b13d4c8a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:21.172482 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5893d-6734-422b-b4fe-a5b6b13d4c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:21.216999 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-52d5893d-6734-422b-b4fe-a5b6b13d4c8a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:36:21.218989 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-52d5893d-6734-422b-b4fe-a5b6b13d4c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:21.351262 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4129/8251] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:36:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:36:21.383104 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0adb2-5dbe-4b2b-8cba-5729354fac3a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:21.385313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-bda0adb2-5dbe-4b2b-8cba-5729354fac3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:21.514361 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0adb2-5dbe-4b2b-8cba-5729354fac3a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:21.522556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f92af7-b6e1-4161-89e6-5d94b30b1eef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:21.523252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f92af7-b6e1-4161-89e6-5d94b30b1eef service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:21.524190 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f92af7-b6e1-4161-89e6-5d94b30b1eef service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:21.524190 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f92af7-b6e1-4161-89e6-5d94b30b1eef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:21.538007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f92af7-b6e1-4161-89e6-5d94b30b1eef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:21.542381 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f92af7-b6e1-4161-89e6-5d94b30b1eef service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:21.569241 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4123/8252] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:36:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:36:26.019769 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5893d-6734-422b-b4fe-a5b6b13d4c8a None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:26.021968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-52d5893d-6734-422b-b4fe-a5b6b13d4c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:26.065101 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:36:26.231571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5893d-6734-422b-b4fe-a5b6b13d4c8a None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:26.237743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fda398-911d-44e5-bf92-16379cbcc1d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:26.238503 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fda398-911d-44e5-bf92-16379cbcc1d9 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:26.238697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fda398-911d-44e5-bf92-16379cbcc1d9 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:26.238911 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fda398-911d-44e5-bf92-16379cbcc1d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:26.240681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-20fda398-911d-44e5-bf92-16379cbcc1d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:26.262597 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fda398-911d-44e5-bf92-16379cbcc1d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:26.270136 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fda398-911d-44e5-bf92-16379cbcc1d9 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:26.310927 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4130/8253] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:36:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:36:27.863017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d8aa6-413e-4288-b4b9-b9047038bdf3 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:27.864306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d8aa6-413e-4288-b4b9-b9047038bdf3 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:27.864767 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d8aa6-413e-4288-b4b9-b9047038bdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:27.915353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-913d8aa6-413e-4288-b4b9-b9047038bdf3 None None] MFA Rules not processed for user `f39dd2d709374c729d51f7e2cf18300c`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:36:27.916559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-913d8aa6-413e-4288-b4b9-b9047038bdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:28.060680 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4124/8254] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:36:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:36:29.598165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fda398-911d-44e5-bf92-16379cbcc1d9 service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:29.627308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fda398-911d-44e5-bf92-16379cbcc1d9 service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:29.645527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dcea49-1e01-437f-b266-ac46d936ea5d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:29.647918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dcea49-1e01-437f-b266-ac46d936ea5d service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:29.648760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dcea49-1e01-437f-b266-ac46d936ea5d service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:29.649587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dcea49-1e01-437f-b266-ac46d936ea5d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:29.653837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b4dcea49-1e01-437f-b266-ac46d936ea5d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:29.687811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dcea49-1e01-437f-b266-ac46d936ea5d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:29.690895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dcea49-1e01-437f-b266-ac46d936ea5d service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:29.709562 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4131/8255] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:36:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:36:31.525337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d8aa6-413e-4288-b4b9-b9047038bdf3 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:31.527065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-913d8aa6-413e-4288-b4b9-b9047038bdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:31.546469 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d8aa6-413e-4288-b4b9-b9047038bdf3 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:31.559394 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df74998-115b-4e29-8410-a794dab61d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:31.560433 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df74998-115b-4e29-8410-a794dab61d58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:31.560866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df74998-115b-4e29-8410-a794dab61d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:31.561416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df74998-115b-4e29-8410-a794dab61d58 admin admin] PATH_INFO: `/v3/users/2e6f0bd46a504e5795eef35ff854cc90` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:31.562947 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df74998-115b-4e29-8410-a794dab61d58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e6f0bd46a504e5795eef35ff854cc90)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:31.565859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df74998-115b-4e29-8410-a794dab61d58 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:31.607087 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:36:31.658732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3df74998-115b-4e29-8410-a794dab61d58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e6f0bd46a504e5795eef35ff854cc90'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:31.659831 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3df74998-115b-4e29-8410-a794dab61d58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e6f0bd46a504e5795eef35ff854cc90'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:31.682042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3df74998-115b-4e29-8410-a794dab61d58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e6f0bd46a504e5795eef35ff854cc90'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:31.713046 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3df74998-115b-4e29-8410-a794dab61d58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e6f0bd46a504e5795eef35ff854cc90'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:31.713710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3df74998-115b-4e29-8410-a794dab61d58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e6f0bd46a504e5795eef35ff854cc90'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:31.748289 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4125/8256] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:36:31 2022] DELETE /identity/v3/users/2e6f0bd46a504e5795eef35ff854cc90 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:36:31.752963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95e663-0fe9-434b-9a88-e7b4ed196e8a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:31.753651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95e663-0fe9-434b-9a88-e7b4ed196e8a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:31.754026 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95e663-0fe9-434b-9a88-e7b4ed196e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:31.787463 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-4c95e663-0fe9-434b-9a88-e7b4ed196e8a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:36:31.789173 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4c95e663-0fe9-434b-9a88-e7b4ed196e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:31.895572 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4132/8257] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:36:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:36:31.938581 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df74998-115b-4e29-8410-a794dab61d58 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:31.940942 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3df74998-115b-4e29-8410-a794dab61d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:32.069016 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df74998-115b-4e29-8410-a794dab61d58 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:32.073337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75370896-d504-40d7-8fab-807ca772ee5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:32.074343 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75370896-d504-40d7-8fab-807ca772ee5e service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:32.075560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75370896-d504-40d7-8fab-807ca772ee5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:32.075997 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75370896-d504-40d7-8fab-807ca772ee5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:32.110923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75370896-d504-40d7-8fab-807ca772ee5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:32.112648 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75370896-d504-40d7-8fab-807ca772ee5e service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:32.138420 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4126/8258] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:36:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:36:32.912671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95e663-0fe9-434b-9a88-e7b4ed196e8a None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:32.914350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4c95e663-0fe9-434b-9a88-e7b4ed196e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:32.939564 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95e663-0fe9-434b-9a88-e7b4ed196e8a None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:32.952227 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbdbd1-8529-412c-979a-9917c4e88998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:32.954584 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbdbd1-8529-412c-979a-9917c4e88998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:32.954899 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbdbd1-8529-412c-979a-9917c4e88998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:32.955184 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbdbd1-8529-412c-979a-9917c4e88998 admin admin] PATH_INFO: `/v3/projects/a6557617859a483a97310f11df4da446` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:32.959347 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dbdbd1-8529-412c-979a-9917c4e88998 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6557617859a483a97310f11df4da446)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:32.962848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dbdbd1-8529-412c-979a-9917c4e88998 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:33.060332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-76dbdbd1-8529-412c-979a-9917c4e88998 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6557617859a483a97310f11df4da446', 'request_id': 'req-76dbdbd1-8529-412c-979a-9917c4e88998'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:33.078859 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-76dbdbd1-8529-412c-979a-9917c4e88998 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6557617859a483a97310f11df4da446', 'request_id': 'req-76dbdbd1-8529-412c-979a-9917c4e88998'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:33.097856 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-76dbdbd1-8529-412c-979a-9917c4e88998 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6557617859a483a97310f11df4da446', 'request_id': 'req-76dbdbd1-8529-412c-979a-9917c4e88998'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:33.116976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-76dbdbd1-8529-412c-979a-9917c4e88998 admin admin] The token cache is being invalidate because project a6557617859a483a97310f11df4da446 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:36:33.117618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-76dbdbd1-8529-412c-979a-9917c4e88998 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:33.118645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-76dbdbd1-8529-412c-979a-9917c4e88998 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:33.120928 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4133/8259] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:36:32 2022] DELETE /identity/v3/projects/a6557617859a483a97310f11df4da446 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:36:33.125661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98b72f-903a-4c9f-b598-f6ea6d24980c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:33.127161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98b72f-903a-4c9f-b598-f6ea6d24980c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:33.127643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98b72f-903a-4c9f-b598-f6ea6d24980c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:33.159400 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ea98b72f-903a-4c9f-b598-f6ea6d24980c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:36:33.161901 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ea98b72f-903a-4c9f-b598-f6ea6d24980c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:33.341764 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4127/8260] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:36:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:36:33.348943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54ccc8-c3bf-4325-90ec-c49765a96559 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:33.349626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54ccc8-c3bf-4325-90ec-c49765a96559 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:33.350371 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54ccc8-c3bf-4325-90ec-c49765a96559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:33.377666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-6e54ccc8-c3bf-4325-90ec-c49765a96559 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:36:33.395575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6e54ccc8-c3bf-4325-90ec-c49765a96559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:33.415686 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4134/8261] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:36:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:36:33.419644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98b72f-903a-4c9f-b598-f6ea6d24980c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:33.437224 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98b72f-903a-4c9f-b598-f6ea6d24980c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:33.465657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c1712-261b-4c4a-9164-a73f1c704671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:33.466961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c1712-261b-4c4a-9164-a73f1c704671 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:33.467824 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c1712-261b-4c4a-9164-a73f1c704671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:33.468665 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c1712-261b-4c4a-9164-a73f1c704671 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:33.471370 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c1712-261b-4c4a-9164-a73f1c704671 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:36:33.471928 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c1712-261b-4c4a-9164-a73f1c704671 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:33.473692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c1712-261b-4c4a-9164-a73f1c704671 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:33.515050 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4128/8262] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:36:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:36:33.518843 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54ccc8-c3bf-4325-90ec-c49765a96559 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:33.535089 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54ccc8-c3bf-4325-90ec-c49765a96559 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:33.546369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1bea9-a59c-4f68-9843-9c5b2cdefce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:33.548891 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1bea9-a59c-4f68-9843-9c5b2cdefce6 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:33.549339 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1bea9-a59c-4f68-9843-9c5b2cdefce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:33.552569 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1bea9-a59c-4f68-9843-9c5b2cdefce6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:33.553514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff1bea9-a59c-4f68-9843-9c5b2cdefce6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:33.558886 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff1bea9-a59c-4f68-9843-9c5b2cdefce6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:33.575442 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:36:33.660173 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4135/8263] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:36:33 2022] POST /identity/v3/projects => generated 387 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:36:33.664487 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c1712-261b-4c4a-9164-a73f1c704671 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:33.684220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c1712-261b-4c4a-9164-a73f1c704671 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:33.776525 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:36:33.842516 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa63e95-f078-4151-8b70-206b4b9cd762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:33.843258 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa63e95-f078-4151-8b70-206b4b9cd762 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:33.843546 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa63e95-f078-4151-8b70-206b4b9cd762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:33.843818 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa63e95-f078-4151-8b70-206b4b9cd762 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:33.844727 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa63e95-f078-4151-8b70-206b4b9cd762 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:33.848642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa63e95-f078-4151-8b70-206b4b9cd762 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:33.915270 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4129/8264] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:36:33 2022] POST /identity/v3/users => generated 294 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:36:33.918326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1bea9-a59c-4f68-9843-9c5b2cdefce6 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:33.940406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1bea9-a59c-4f68-9843-9c5b2cdefce6 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:33.956047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee24a6f-49ca-414d-93c4-6b32e9db2ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:33.957060 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee24a6f-49ca-414d-93c4-6b32e9db2ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:33.957515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee24a6f-49ca-414d-93c4-6b32e9db2ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:33.959397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee24a6f-49ca-414d-93c4-6b32e9db2ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:33.963177 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee24a6f-49ca-414d-93c4-6b32e9db2ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:33.970041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee24a6f-49ca-414d-93c4-6b32e9db2ca2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:34.005647 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4136/8265] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:36:34.009086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa63e95-f078-4151-8b70-206b4b9cd762 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:34.021963 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa63e95-f078-4151-8b70-206b4b9cd762 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:34.044447 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad51ce-19f4-4dd8-bb82-9a3fd1897b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:34.047836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad51ce-19f4-4dd8-bb82-9a3fd1897b45 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:34.049406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad51ce-19f4-4dd8-bb82-9a3fd1897b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:34.050262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad51ce-19f4-4dd8-bb82-9a3fd1897b45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:34.051186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad51ce-19f4-4dd8-bb82-9a3fd1897b45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:34.060057 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad51ce-19f4-4dd8-bb82-9a3fd1897b45 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:34.093177 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4130/8266] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:36:34.097967 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee24a6f-49ca-414d-93c4-6b32e9db2ca2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:34.114154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee24a6f-49ca-414d-93c4-6b32e9db2ca2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:34.129336 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bbc4cd-f00d-4217-a8b7-f97bed4bc2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:34.130190 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbc4cd-f00d-4217-a8b7-f97bed4bc2a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:34.130476 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbc4cd-f00d-4217-a8b7-f97bed4bc2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:34.133551 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbc4cd-f00d-4217-a8b7-f97bed4bc2a3 admin admin] PATH_INFO: `/v3/projects/9fea4069f4d74e628600493703adf1fe/users/c69b357d05574ba68207419024eb0c8b/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:34.186674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bbc4cd-f00d-4217-a8b7-f97bed4bc2a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fea4069f4d74e628600493703adf1fe, user_id=c69b357d05574ba68207419024eb0c8b, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:34.194024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bbc4cd-f00d-4217-a8b7-f97bed4bc2a3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:34.234453 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4137/8267] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:36:34 2022] PUT /identity/v3/projects/9fea4069f4d74e628600493703adf1fe/users/c69b357d05574ba68207419024eb0c8b/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:36:34.245836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5561e4d-3de6-40e8-b82a-238ed26abdbc None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:34.248321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5561e4d-3de6-40e8-b82a-238ed26abdbc None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:34.248805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5561e4d-3de6-40e8-b82a-238ed26abdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:34.342987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-b5561e4d-3de6-40e8-b82a-238ed26abdbc None None] MFA Rules not processed for user `c69b357d05574ba68207419024eb0c8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:36:34.349091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b5561e4d-3de6-40e8-b82a-238ed26abdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:34.551075 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4131/8268] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:36:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:36:34.552231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bbc4cd-f00d-4217-a8b7-f97bed4bc2a3 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:34.800904 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bbc4cd-f00d-4217-a8b7-f97bed4bc2a3 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:34.831154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761251b-b398-4829-822b-d94017794f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:34.832710 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761251b-b398-4829-822b-d94017794f61 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:34.833359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761251b-b398-4829-822b-d94017794f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:34.833804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761251b-b398-4829-822b-d94017794f61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:34.834596 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a761251b-b398-4829-822b-d94017794f61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:34.837071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a761251b-b398-4829-822b-d94017794f61 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:34.946112 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4138/8269] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:36:34 2022] POST /identity/v3/projects => generated 387 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:36:34.951262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5561e4d-3de6-40e8-b82a-238ed26abdbc None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:34.969109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5561e4d-3de6-40e8-b82a-238ed26abdbc None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:35.150328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732f3ad-aebc-4708-ba21-dec5990a9f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:35.151216 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732f3ad-aebc-4708-ba21-dec5990a9f24 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:35.151646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732f3ad-aebc-4708-ba21-dec5990a9f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:35.152081 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732f3ad-aebc-4708-ba21-dec5990a9f24 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:35.152861 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732f3ad-aebc-4708-ba21-dec5990a9f24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:35.155004 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732f3ad-aebc-4708-ba21-dec5990a9f24 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:35.201962 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4132/8270] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:36:34 2022] POST /identity/v3/users => generated 294 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:36:35.202906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761251b-b398-4829-822b-d94017794f61 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:35.222579 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761251b-b398-4829-822b-d94017794f61 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:35.235651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf339e8-0073-47db-adce-3bc15d84352b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:35.236536 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf339e8-0073-47db-adce-3bc15d84352b admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:35.236961 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf339e8-0073-47db-adce-3bc15d84352b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:35.237387 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf339e8-0073-47db-adce-3bc15d84352b admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:35.238220 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf339e8-0073-47db-adce-3bc15d84352b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:35.240022 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf339e8-0073-47db-adce-3bc15d84352b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:35.265888 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4139/8271] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:36:35.271009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732f3ad-aebc-4708-ba21-dec5990a9f24 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:35.284228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732f3ad-aebc-4708-ba21-dec5990a9f24 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:35.304679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c0076-a0ff-47f1-a760-050a26ab77de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:35.305760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c0076-a0ff-47f1-a760-050a26ab77de admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:35.306219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c0076-a0ff-47f1-a760-050a26ab77de admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:35.306803 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c0076-a0ff-47f1-a760-050a26ab77de admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:35.307865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c0076-a0ff-47f1-a760-050a26ab77de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:35.312737 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c0076-a0ff-47f1-a760-050a26ab77de admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:35.335337 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf339e8-0073-47db-adce-3bc15d84352b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:35.343172 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4133/8272] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:36:35.347243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf339e8-0073-47db-adce-3bc15d84352b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:35.354308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e122534-ce42-43dd-aeb9-a959de60fdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:35.355179 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e122534-ce42-43dd-aeb9-a959de60fdbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:35.355425 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e122534-ce42-43dd-aeb9-a959de60fdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:35.355760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e122534-ce42-43dd-aeb9-a959de60fdbb admin admin] PATH_INFO: `/v3/projects/50105ea770bd422fb5bb1dd264757e21/users/be800bf894fa472490ffa2a883bb5e07/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:35.365386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058444d-1ba2-48fb-9e82-fb1323dba996 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:35.366201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058444d-1ba2-48fb-9e82-fb1323dba996 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:35.366314 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058444d-1ba2-48fb-9e82-fb1323dba996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:35.456617 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e058444d-1ba2-48fb-9e82-fb1323dba996 None None] MFA Rules not processed for user `caa1565f8d9a41cd8632bfe08f9f1c38`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:36:35.461851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e058444d-1ba2-48fb-9e82-fb1323dba996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:35.491018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e122534-ce42-43dd-aeb9-a959de60fdbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=50105ea770bd422fb5bb1dd264757e21, user_id=be800bf894fa472490ffa2a883bb5e07, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:35.493024 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:36:35.510720 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e122534-ce42-43dd-aeb9-a959de60fdbb admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:35.591786 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4140/8273] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:36:35 2022] PUT /identity/v3/projects/50105ea770bd422fb5bb1dd264757e21/users/be800bf894fa472490ffa2a883bb5e07/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:36:35.593270 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab87a8-fd64-4cfc-aae9-a6513d457cf3 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:35.593555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab87a8-fd64-4cfc-aae9-a6513d457cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:35.597128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab87a8-fd64-4cfc-aae9-a6513d457cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:35.661213 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-54ab87a8-fd64-4cfc-aae9-a6513d457cf3 None None] MFA Rules not processed for user `be800bf894fa472490ffa2a883bb5e07`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:36:35.668491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-54ab87a8-fd64-4cfc-aae9-a6513d457cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:35.692288 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4134/8274] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:36:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:36:35.695930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058444d-1ba2-48fb-9e82-fb1323dba996 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:35.699713 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e058444d-1ba2-48fb-9e82-fb1323dba996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:35.766649 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058444d-1ba2-48fb-9e82-fb1323dba996 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:35.922241 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:36:35.976045 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4141/8275] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:36:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:36:35.987643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab87a8-fd64-4cfc-aae9-a6513d457cf3 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:35.992523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390367e-1c8a-4f21-a932-84640bfaaf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:35.993154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390367e-1c8a-4f21-a932-84640bfaaf0f admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:35.994197 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390367e-1c8a-4f21-a932-84640bfaaf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:35.994518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390367e-1c8a-4f21-a932-84640bfaaf0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:35.995571 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d390367e-1c8a-4f21-a932-84640bfaaf0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:35.998098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d390367e-1c8a-4f21-a932-84640bfaaf0f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:36.025702 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab87a8-fd64-4cfc-aae9-a6513d457cf3 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:36.043118 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b7575-c951-4f32-a499-0b9764f95fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:36.043959 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b7575-c951-4f32-a499-0b9764f95fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:36.044896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b7575-c951-4f32-a499-0b9764f95fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:36.045188 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b7575-c951-4f32-a499-0b9764f95fb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:36.046363 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b7575-c951-4f32-a499-0b9764f95fb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:36.049624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b7575-c951-4f32-a499-0b9764f95fb6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:36.065545 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4135/8276] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:36:35 2022] POST /identity/v3/projects => generated 371 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:36:36.070986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390367e-1c8a-4f21-a932-84640bfaaf0f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:36.136195 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4142/8277] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:36:35 2022] POST /identity/v3/projects => generated 387 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:36:36.139825 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b7575-c951-4f32-a499-0b9764f95fb6 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:36.239220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390367e-1c8a-4f21-a932-84640bfaaf0f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:36.286046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b7575-c951-4f32-a499-0b9764f95fb6 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:36.302708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5019c-63c8-4839-a656-a5e618db6ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:36.303331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5019c-63c8-4839-a656-a5e618db6ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:36.303613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5019c-63c8-4839-a656-a5e618db6ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:36.304158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5019c-63c8-4839-a656-a5e618db6ff1 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:36.304843 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5019c-63c8-4839-a656-a5e618db6ff1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:36.308045 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5019c-63c8-4839-a656-a5e618db6ff1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:36.357550 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:36:36.381284 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4143/8278] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:36:36 2022] POST /identity/v3/users => generated 300 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:36:36.397794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5019c-63c8-4839-a656-a5e618db6ff1 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:36.427238 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e3747-61c8-48d1-ab56-555654bb03d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:36.432378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e3747-61c8-48d1-ab56-555654bb03d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:36.437114 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e3747-61c8-48d1-ab56-555654bb03d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:36.464391 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e3747-61c8-48d1-ab56-555654bb03d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:36.466974 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e3747-61c8-48d1-ab56-555654bb03d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:36.470438 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5019c-63c8-4839-a656-a5e618db6ff1 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:36.473478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e3747-61c8-48d1-ab56-555654bb03d8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:36.490454 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111dadce-4075-4f52-b5d2-c2c5230dc205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:36.491163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111dadce-4075-4f52-b5d2-c2c5230dc205 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:36.491572 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111dadce-4075-4f52-b5d2-c2c5230dc205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:36.491873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111dadce-4075-4f52-b5d2-c2c5230dc205 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:36.492532 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111dadce-4075-4f52-b5d2-c2c5230dc205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:36.494795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111dadce-4075-4f52-b5d2-c2c5230dc205 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:36.518532 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4144/8279] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:36:36.522801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111dadce-4075-4f52-b5d2-c2c5230dc205 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:36.540925 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111dadce-4075-4f52-b5d2-c2c5230dc205 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:36.559308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6d8e0-68a2-4118-9d9f-b156eb099bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:36.560259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6d8e0-68a2-4118-9d9f-b156eb099bfc admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:36.560455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6d8e0-68a2-4118-9d9f-b156eb099bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:36.562050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6d8e0-68a2-4118-9d9f-b156eb099bfc admin admin] PATH_INFO: `/v3/projects/5330a5b748924ab5bf96fc8ace6ae9e1/users/22cc9fd70830416193f7482b365dbdc4/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:36.562171 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4136/8280] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:36:36 2022] POST /identity/v3/users => generated 292 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:36:36.565033 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e3747-61c8-48d1-ab56-555654bb03d8 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:36.598391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6d8e0-68a2-4118-9d9f-b156eb099bfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5330a5b748924ab5bf96fc8ace6ae9e1, user_id=22cc9fd70830416193f7482b365dbdc4, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:36.601159 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6d8e0-68a2-4118-9d9f-b156eb099bfc admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:36.609817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e3747-61c8-48d1-ab56-555654bb03d8 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:36.624266 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179d1ae-3174-4391-96a3-2346bf1f043c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:36.624907 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179d1ae-3174-4391-96a3-2346bf1f043c admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:36.625184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179d1ae-3174-4391-96a3-2346bf1f043c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:36.625539 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179d1ae-3174-4391-96a3-2346bf1f043c admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:36.629270 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179d1ae-3174-4391-96a3-2346bf1f043c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:36.633390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179d1ae-3174-4391-96a3-2346bf1f043c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:36.652155 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4145/8281] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:36:36 2022] PUT /identity/v3/projects/5330a5b748924ab5bf96fc8ace6ae9e1/users/22cc9fd70830416193f7482b365dbdc4/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:36:36.653136 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6d8e0-68a2-4118-9d9f-b156eb099bfc admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:36.655603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f7b6d8e0-68a2-4118-9d9f-b156eb099bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:36.675597 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4137/8282] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:36:36.675597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179d1ae-3174-4391-96a3-2346bf1f043c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:36.703228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179d1ae-3174-4391-96a3-2346bf1f043c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:36.845098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6d8e0-68a2-4118-9d9f-b156eb099bfc admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:36.855604 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092be800-dbda-4567-84d4-66f6911cf8b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:36.860634 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092be800-dbda-4567-84d4-66f6911cf8b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:36.861794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092be800-dbda-4567-84d4-66f6911cf8b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:36.862675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092be800-dbda-4567-84d4-66f6911cf8b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:36.867951 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-092be800-dbda-4567-84d4-66f6911cf8b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:36.889164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2880f-d1ac-4384-a5cf-53b0d0da7754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:36.889998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2880f-d1ac-4384-a5cf-53b0d0da7754 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:36.890410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2880f-d1ac-4384-a5cf-53b0d0da7754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:36.890777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2880f-d1ac-4384-a5cf-53b0d0da7754 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:36.891638 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2880f-d1ac-4384-a5cf-53b0d0da7754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:36.893721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2880f-d1ac-4384-a5cf-53b0d0da7754 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:36.915330 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4138/8283] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:36:36.919092 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2880f-d1ac-4384-a5cf-53b0d0da7754 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:36.921526 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092be800-dbda-4567-84d4-66f6911cf8b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:36.923690 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092be800-dbda-4567-84d4-66f6911cf8b6 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:36.943318 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2880f-d1ac-4384-a5cf-53b0d0da7754 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:36.959973 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5eb29-b4a5-4174-b8bf-32bbe624931b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:36.960599 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5eb29-b4a5-4174-b8bf-32bbe624931b admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:36.960882 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5eb29-b4a5-4174-b8bf-32bbe624931b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:36.961158 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5eb29-b4a5-4174-b8bf-32bbe624931b admin admin] PATH_INFO: `/v3/projects/e321d156e3604108a0dd1abb1a7f7ea7/users/996c06f2f2844892ab3598e9c1e9da08/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:36.961362 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4146/8284] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:36:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:36:36.967393 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092be800-dbda-4567-84d4-66f6911cf8b6 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:37.002913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092be800-dbda-4567-84d4-66f6911cf8b6 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:37.009392 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d5eb29-b4a5-4174-b8bf-32bbe624931b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e321d156e3604108a0dd1abb1a7f7ea7, user_id=996c06f2f2844892ab3598e9c1e9da08, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:37.012120 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d5eb29-b4a5-4174-b8bf-32bbe624931b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:37.018154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f313fa-7626-42df-9e38-c1c717e1f04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:37.018844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f313fa-7626-42df-9e38-c1c717e1f04c admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:37.019123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f313fa-7626-42df-9e38-c1c717e1f04c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:37.019399 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f313fa-7626-42df-9e38-c1c717e1f04c admin admin] PATH_INFO: `/v3/projects/5330a5b748924ab5bf96fc8ace6ae9e1/users/22cc9fd70830416193f7482b365dbdc4/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:37.025144 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f313fa-7626-42df-9e38-c1c717e1f04c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5330a5b748924ab5bf96fc8ace6ae9e1, user_id=22cc9fd70830416193f7482b365dbdc4, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:37.029698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f313fa-7626-42df-9e38-c1c717e1f04c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:37.055608 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4139/8285] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:36:36 2022] PUT /identity/v3/projects/e321d156e3604108a0dd1abb1a7f7ea7/users/996c06f2f2844892ab3598e9c1e9da08/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:36:37.056965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5eb29-b4a5-4174-b8bf-32bbe624931b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:37.077214 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4147/8286] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:36:36 2022] PUT /identity/v3/projects/5330a5b748924ab5bf96fc8ace6ae9e1/users/22cc9fd70830416193f7482b365dbdc4/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:36:37.082668 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02229a-5c96-4f52-bdf6-21b351ce5bba None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:37.082953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02229a-5c96-4f52-bdf6-21b351ce5bba None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:37.083227 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02229a-5c96-4f52-bdf6-21b351ce5bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:37.160462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5eb29-b4a5-4174-b8bf-32bbe624931b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:37.212313 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:36:37.223576 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:36:37.232782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-be02229a-5c96-4f52-bdf6-21b351ce5bba None None] MFA Rules not processed for user `22cc9fd70830416193f7482b365dbdc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:36:37.236157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-be02229a-5c96-4f52-bdf6-21b351ce5bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:37.236650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194df84-d499-41ea-9549-d09302dfe489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:37.237635 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194df84-d499-41ea-9549-d09302dfe489 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:37.238074 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194df84-d499-41ea-9549-d09302dfe489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:37.238348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194df84-d499-41ea-9549-d09302dfe489 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:37.239001 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194df84-d499-41ea-9549-d09302dfe489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:37.240828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194df84-d499-41ea-9549-d09302dfe489 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:37.259122 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4140/8287] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:36:37.265966 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194df84-d499-41ea-9549-d09302dfe489 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:37.308345 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194df84-d499-41ea-9549-d09302dfe489 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:37.321352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288098f-c6c0-4d04-a625-c0740b84a604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:37.322331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288098f-c6c0-4d04-a625-c0740b84a604 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:37.322331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288098f-c6c0-4d04-a625-c0740b84a604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:37.323077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288098f-c6c0-4d04-a625-c0740b84a604 admin admin] PATH_INFO: `/v3/projects/e321d156e3604108a0dd1abb1a7f7ea7/users/996c06f2f2844892ab3598e9c1e9da08/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:37.334579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288098f-c6c0-4d04-a625-c0740b84a604 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e321d156e3604108a0dd1abb1a7f7ea7, user_id=996c06f2f2844892ab3598e9c1e9da08, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:37.337193 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288098f-c6c0-4d04-a625-c0740b84a604 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:37.342324 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4148/8288] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:36:37 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:36:37.351873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02229a-5c96-4f52-bdf6-21b351ce5bba None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:37.354098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-be02229a-5c96-4f52-bdf6-21b351ce5bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:37.364705 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4141/8289] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:36:37 2022] PUT /identity/v3/projects/e321d156e3604108a0dd1abb1a7f7ea7/users/996c06f2f2844892ab3598e9c1e9da08/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:36:37.493236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02229a-5c96-4f52-bdf6-21b351ce5bba None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:37.696905 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17ab20-91f9-4e15-8c6b-44649f4d3998 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:37.703902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17ab20-91f9-4e15-8c6b-44649f4d3998 service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:37.706963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17ab20-91f9-4e15-8c6b-44649f4d3998 service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:37.708172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17ab20-91f9-4e15-8c6b-44649f4d3998 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:37.914225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17ab20-91f9-4e15-8c6b-44649f4d3998 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:37.916703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17ab20-91f9-4e15-8c6b-44649f4d3998 service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:37.944882 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4149/8290] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:36:37 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:36:39.903082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288098f-c6c0-4d04-a625-c0740b84a604 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:39.926025 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288098f-c6c0-4d04-a625-c0740b84a604 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:39.938722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55dd24-bef9-4d5a-b6e8-7be83262f2bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:39.938722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55dd24-bef9-4d5a-b6e8-7be83262f2bd service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:39.941113 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55dd24-bef9-4d5a-b6e8-7be83262f2bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:39.941113 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55dd24-bef9-4d5a-b6e8-7be83262f2bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:40.208657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a55dd24-bef9-4d5a-b6e8-7be83262f2bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:40.210124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a55dd24-bef9-4d5a-b6e8-7be83262f2bd service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:40.258334 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4142/8291] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:36:39 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:36:41.258899 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17ab20-91f9-4e15-8c6b-44649f4d3998 service cinder] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:41.260476 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8a17ab20-91f9-4e15-8c6b-44649f4d3998 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:41.269291 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:36:41.472277 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17ab20-91f9-4e15-8c6b-44649f4d3998 service cinder] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:41.497215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd39c6-3ca8-468f-9a6d-39766a576d38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:41.498698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd39c6-3ca8-468f-9a6d-39766a576d38 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:41.499189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd39c6-3ca8-468f-9a6d-39766a576d38 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:41.499613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd39c6-3ca8-468f-9a6d-39766a576d38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:41.524541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d2fd39c6-3ca8-468f-9a6d-39766a576d38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:41.623397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd39c6-3ca8-468f-9a6d-39766a576d38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:41.629598 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd39c6-3ca8-468f-9a6d-39766a576d38 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:41.694505 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4150/8292] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:36:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:36:50.232767 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=43,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:36:51.559631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55dd24-bef9-4d5a-b6e8-7be83262f2bd service cinder] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:51.562826 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7a55dd24-bef9-4d5a-b6e8-7be83262f2bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:51.669968 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=32 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:36:51.697329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55dd24-bef9-4d5a-b6e8-7be83262f2bd service cinder] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:51.709212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0626601-3e1e-4ee4-9d66-c03905bf3b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:51.710445 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0626601-3e1e-4ee4-9d66-c03905bf3b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:51.719759 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0626601-3e1e-4ee4-9d66-c03905bf3b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:51.724011 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0626601-3e1e-4ee4-9d66-c03905bf3b2a admin admin] PATH_INFO: `/v3/users/2213680600d540938cc5982b413b6104` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:51.728651 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0626601-3e1e-4ee4-9d66-c03905bf3b2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2213680600d540938cc5982b413b6104)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:51.736960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0626601-3e1e-4ee4-9d66-c03905bf3b2a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:51.809026 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812948a7-a173-433d-9c95-8701a7e981f3 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:51.809694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812948a7-a173-433d-9c95-8701a7e981f3 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:51.810173 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812948a7-a173-433d-9c95-8701a7e981f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:51.842397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e0626601-3e1e-4ee4-9d66-c03905bf3b2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2213680600d540938cc5982b413b6104'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:51.843155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e0626601-3e1e-4ee4-9d66-c03905bf3b2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2213680600d540938cc5982b413b6104'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:51.849958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-812948a7-a173-433d-9c95-8701a7e981f3 None None] MFA Rules not processed for user `ece1d6709f6d480fbaffa3b47f293dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:36:51.852145 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-812948a7-a173-433d-9c95-8701a7e981f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:51.860352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e0626601-3e1e-4ee4-9d66-c03905bf3b2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2213680600d540938cc5982b413b6104'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:51.880613 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e0626601-3e1e-4ee4-9d66-c03905bf3b2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2213680600d540938cc5982b413b6104'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:51.881537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-e0626601-3e1e-4ee4-9d66-c03905bf3b2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2213680600d540938cc5982b413b6104'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:51.916850 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4143/8293] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:36:51 2022] DELETE /identity/v3/users/2213680600d540938cc5982b413b6104 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:36:51.921226 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ab861-e3c2-47ec-8b6c-18c18b4be0cf None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:51.921934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ab861-e3c2-47ec-8b6c-18c18b4be0cf None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:51.922459 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ab861-e3c2-47ec-8b6c-18c18b4be0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:51.982734 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ae1ab861-e3c2-47ec-8b6c-18c18b4be0cf None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:36:51.987767 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ae1ab861-e3c2-47ec-8b6c-18c18b4be0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:51.993734 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4151/8294] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:36:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:36:52.199240 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4144/8295] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:36:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:36:52.220502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812948a7-a173-433d-9c95-8701a7e981f3 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:52.222062 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-812948a7-a173-433d-9c95-8701a7e981f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:52.261175 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172e016-a034-4101-8030-6e7bda89167f None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:52.261544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172e016-a034-4101-8030-6e7bda89167f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:52.261786 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172e016-a034-4101-8030-6e7bda89167f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:52.337761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c172e016-a034-4101-8030-6e7bda89167f None None] MFA Rules not processed for user `996c06f2f2844892ab3598e9c1e9da08`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:36:52.339053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c172e016-a034-4101-8030-6e7bda89167f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:52.360914 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:36:52.412344 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812948a7-a173-433d-9c95-8701a7e981f3 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:52.536769 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4145/8296] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:36:52 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:36:52.553375 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172e016-a034-4101-8030-6e7bda89167f None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:52.555480 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c172e016-a034-4101-8030-6e7bda89167f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:52.570727 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2bfb37-4776-4d23-b241-f9bbc236202f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:52.571645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bfb37-4776-4d23-b241-f9bbc236202f service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:52.572270 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bfb37-4776-4d23-b241-f9bbc236202f service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:52.572725 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bfb37-4776-4d23-b241-f9bbc236202f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:52.603946 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2bfb37-4776-4d23-b241-f9bbc236202f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:52.609412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2bfb37-4776-4d23-b241-f9bbc236202f service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:52.661912 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4152/8297] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:36:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:36:52.732029 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2bfb37-4776-4d23-b241-f9bbc236202f service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:52.734457 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3f2bfb37-4776-4d23-b241-f9bbc236202f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:52.815254 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172e016-a034-4101-8030-6e7bda89167f None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:52.830121 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663e9c4-06a5-4d88-bed4-b0218f1e6b13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:52.830515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663e9c4-06a5-4d88-bed4-b0218f1e6b13 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:52.830794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663e9c4-06a5-4d88-bed4-b0218f1e6b13 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:52.831638 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663e9c4-06a5-4d88-bed4-b0218f1e6b13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:52.839394 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b663e9c4-06a5-4d88-bed4-b0218f1e6b13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:52.912991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2bfb37-4776-4d23-b241-f9bbc236202f service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:52.927601 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d117d-4457-46ea-92e6-19368816e00b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:52.928597 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d117d-4457-46ea-92e6-19368816e00b service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:52.929126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d117d-4457-46ea-92e6-19368816e00b service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:52.930322 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d117d-4457-46ea-92e6-19368816e00b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:52.934877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9f0d117d-4457-46ea-92e6-19368816e00b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:52.944648 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663e9c4-06a5-4d88-bed4-b0218f1e6b13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:52.948126 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663e9c4-06a5-4d88-bed4-b0218f1e6b13 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:52.985839 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:36:52.998078 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4146/8298] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:36:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:36:53.040143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663e9c4-06a5-4d88-bed4-b0218f1e6b13 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:53.042268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b663e9c4-06a5-4d88-bed4-b0218f1e6b13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:53.079004 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663e9c4-06a5-4d88-bed4-b0218f1e6b13 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:53.086950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d117d-4457-46ea-92e6-19368816e00b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:53.088779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d117d-4457-46ea-92e6-19368816e00b service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:53.090461 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5c4ac-8e8e-4acd-8f57-49fe86b2a367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:53.091126 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5c4ac-8e8e-4acd-8f57-49fe86b2a367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:53.091571 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5c4ac-8e8e-4acd-8f57-49fe86b2a367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:53.091847 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5c4ac-8e8e-4acd-8f57-49fe86b2a367 admin admin] PATH_INFO: `/v3/projects/9ca8b76713814f91b37b73ebced0ded9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:53.097739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5c4ac-8e8e-4acd-8f57-49fe86b2a367 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ca8b76713814f91b37b73ebced0ded9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:53.102455 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5c4ac-8e8e-4acd-8f57-49fe86b2a367 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:53.103400 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4153/8299] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:36:52 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:36:53.221914 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:36:53.247221 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a0f5c4ac-8e8e-4acd-8f57-49fe86b2a367 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ca8b76713814f91b37b73ebced0ded9', 'request_id': 'req-a0f5c4ac-8e8e-4acd-8f57-49fe86b2a367'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:53.271633 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a0f5c4ac-8e8e-4acd-8f57-49fe86b2a367 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ca8b76713814f91b37b73ebced0ded9', 'request_id': 'req-a0f5c4ac-8e8e-4acd-8f57-49fe86b2a367'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:53.279369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a0f5c4ac-8e8e-4acd-8f57-49fe86b2a367 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ca8b76713814f91b37b73ebced0ded9', 'request_id': 'req-a0f5c4ac-8e8e-4acd-8f57-49fe86b2a367'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:53.310290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a0f5c4ac-8e8e-4acd-8f57-49fe86b2a367 admin admin] The token cache is being invalidate because project 9ca8b76713814f91b37b73ebced0ded9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:36:53.310952 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a0f5c4ac-8e8e-4acd-8f57-49fe86b2a367 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:53.311946 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a0f5c4ac-8e8e-4acd-8f57-49fe86b2a367 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:36:53.315799 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4147/8300] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:36:53 2022] DELETE /identity/v3/projects/9ca8b76713814f91b37b73ebced0ded9 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:36:53.320500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badc06b-eeda-46da-b044-a9345b143ae4 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:53.321064 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badc06b-eeda-46da-b044-a9345b143ae4 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:53.321580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badc06b-eeda-46da-b044-a9345b143ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:53.359678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-1badc06b-eeda-46da-b044-a9345b143ae4 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:36:53.366350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1badc06b-eeda-46da-b044-a9345b143ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:53.537508 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4154/8301] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:36:53.538940 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001091f7-fc52-4072-a380-09ae0835ae94 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:53.539227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001091f7-fc52-4072-a380-09ae0835ae94 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:53.539500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001091f7-fc52-4072-a380-09ae0835ae94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:53.597284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-001091f7-fc52-4072-a380-09ae0835ae94 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:36:53.598505 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-001091f7-fc52-4072-a380-09ae0835ae94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:53.659877 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4148/8302] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:36:53.664300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1badc06b-eeda-46da-b044-a9345b143ae4 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:53.678875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1badc06b-eeda-46da-b044-a9345b143ae4 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:53.698871 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b49ff-098d-4130-ae0a-98cccff65f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:53.699623 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b49ff-098d-4130-ae0a-98cccff65f3a admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:53.700009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b49ff-098d-4130-ae0a-98cccff65f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:53.702419 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b49ff-098d-4130-ae0a-98cccff65f3a admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:53.703212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b49ff-098d-4130-ae0a-98cccff65f3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:36:53.706872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b49ff-098d-4130-ae0a-98cccff65f3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:53.713565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b49ff-098d-4130-ae0a-98cccff65f3a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:53.761597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001091f7-fc52-4072-a380-09ae0835ae94 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:53.772107 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4155/8303] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:36:53.775021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001091f7-fc52-4072-a380-09ae0835ae94 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:53.786699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca013ee1-b52b-44cb-8bca-722e09231246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:53.787533 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca013ee1-b52b-44cb-8bca-722e09231246 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:53.787990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca013ee1-b52b-44cb-8bca-722e09231246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:53.788493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca013ee1-b52b-44cb-8bca-722e09231246 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:53.790017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca013ee1-b52b-44cb-8bca-722e09231246 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:53.792107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca013ee1-b52b-44cb-8bca-722e09231246 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:53.856482 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4149/8304] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:36:53 2022] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:36:53.861751 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b49ff-098d-4130-ae0a-98cccff65f3a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:53.872634 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b49ff-098d-4130-ae0a-98cccff65f3a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:54.102895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd08024-6174-4352-b389-dd203d29fd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:54.105104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd08024-6174-4352-b389-dd203d29fd66 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:54.105592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd08024-6174-4352-b389-dd203d29fd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:54.112070 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd08024-6174-4352-b389-dd203d29fd66 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:54.112952 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd08024-6174-4352-b389-dd203d29fd66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:54.116613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd08024-6174-4352-b389-dd203d29fd66 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:54.202992 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca013ee1-b52b-44cb-8bca-722e09231246 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:54.215875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca013ee1-b52b-44cb-8bca-722e09231246 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:54.219901 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4156/8305] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:36:53 2022] POST /identity/v3/users => generated 284 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:36:54.238387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13a5cb-4e72-417e-97b0-be84270b0d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:54.239484 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13a5cb-4e72-417e-97b0-be84270b0d46 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:54.239769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13a5cb-4e72-417e-97b0-be84270b0d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:54.240044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13a5cb-4e72-417e-97b0-be84270b0d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:54.240712 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13a5cb-4e72-417e-97b0-be84270b0d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:54.242402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13a5cb-4e72-417e-97b0-be84270b0d46 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:54.281373 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4150/8306] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:36:54.283310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd08024-6174-4352-b389-dd203d29fd66 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:54.296939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd08024-6174-4352-b389-dd203d29fd66 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:54.312347 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b51bfc-28e1-4a86-a2ae-db96164e41b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:54.314869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b51bfc-28e1-4a86-a2ae-db96164e41b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:54.315400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b51bfc-28e1-4a86-a2ae-db96164e41b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:54.316312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b51bfc-28e1-4a86-a2ae-db96164e41b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:54.318480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b51bfc-28e1-4a86-a2ae-db96164e41b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:54.321689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b51bfc-28e1-4a86-a2ae-db96164e41b2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:54.355888 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13a5cb-4e72-417e-97b0-be84270b0d46 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:54.357372 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4157/8307] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:36:54.376137 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13a5cb-4e72-417e-97b0-be84270b0d46 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:54.391726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6064f-ed07-4b2d-a6ee-8679814ba247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:54.394192 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6064f-ed07-4b2d-a6ee-8679814ba247 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:54.395397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6064f-ed07-4b2d-a6ee-8679814ba247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:54.395397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6064f-ed07-4b2d-a6ee-8679814ba247 admin admin] PATH_INFO: `/v3/projects/3f87ce1d8dd9474fb7b9fc728b8b0c81/users/97c85c756ae74d01abe71f0f29413f8a/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:54.474745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6064f-ed07-4b2d-a6ee-8679814ba247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f87ce1d8dd9474fb7b9fc728b8b0c81, user_id=97c85c756ae74d01abe71f0f29413f8a, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:54.488676 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6064f-ed07-4b2d-a6ee-8679814ba247 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:54.524241 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4151/8308] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:36:54 2022] PUT /identity/v3/projects/3f87ce1d8dd9474fb7b9fc728b8b0c81/users/97c85c756ae74d01abe71f0f29413f8a/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:36:54.534896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48df6a2-5555-4371-9707-b44b62a8a228 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:54.535187 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48df6a2-5555-4371-9707-b44b62a8a228 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:54.535464 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48df6a2-5555-4371-9707-b44b62a8a228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:54.587680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b48df6a2-5555-4371-9707-b44b62a8a228 None None] MFA Rules not processed for user `97c85c756ae74d01abe71f0f29413f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:36:54.591777 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b48df6a2-5555-4371-9707-b44b62a8a228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:54.633924 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:36:54.758146 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4158/8309] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:36:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:36:54.769658 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6064f-ed07-4b2d-a6ee-8679814ba247 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:36:54.771388 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ded6064f-ed07-4b2d-a6ee-8679814ba247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:55.018589 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6064f-ed07-4b2d-a6ee-8679814ba247 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:36:55.027599 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ee6db-55b9-4642-a686-b08bc9337e42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:36:55.028240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ee6db-55b9-4642-a686-b08bc9337e42 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:55.028972 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ee6db-55b9-4642-a686-b08bc9337e42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:55.029217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ee6db-55b9-4642-a686-b08bc9337e42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:55.051645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ee6db-55b9-4642-a686-b08bc9337e42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:36:55.053248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ee6db-55b9-4642-a686-b08bc9337e42 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:36:55.091640 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4152/8310] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:36:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:36:56.438614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf1dad-bf70-4003-a06d-a205a1de20d1 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:36:56.439187 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf1dad-bf70-4003-a06d-a205a1de20d1 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:36:56.439187 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf1dad-bf70-4003-a06d-a205a1de20d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:36:56.507493 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-abdf1dad-bf70-4003-a06d-a205a1de20d1 None None] MFA Rules not processed for user `caa1565f8d9a41cd8632bfe08f9f1c38`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:36:56.510818 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-abdf1dad-bf70-4003-a06d-a205a1de20d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:36:56.622119 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4159/8311] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:36:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:37:00.605401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ee6db-55b9-4642-a686-b08bc9337e42 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:37:00.607540 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b43ee6db-55b9-4642-a686-b08bc9337e42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:37:00.714012 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf1dad-bf70-4003-a06d-a205a1de20d1 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:37:00.715612 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-abdf1dad-bf70-4003-a06d-a205a1de20d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:37:00.817870 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ee6db-55b9-4642-a686-b08bc9337e42 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:37:00.825422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8549020-17b4-4d72-a485-33b8de53926d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:37:00.826736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8549020-17b4-4d72-a485-33b8de53926d service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:37:00.827171 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8549020-17b4-4d72-a485-33b8de53926d service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:37:00.827816 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8549020-17b4-4d72-a485-33b8de53926d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:37:00.830744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e8549020-17b4-4d72-a485-33b8de53926d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:37:00.840208 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:37:00.880241 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf1dad-bf70-4003-a06d-a205a1de20d1 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:37:00.892779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462c964-e220-49f6-a38d-16d3b8ff99cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:37:00.893606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462c964-e220-49f6-a38d-16d3b8ff99cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:37:00.893982 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462c964-e220-49f6-a38d-16d3b8ff99cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:37:00.894512 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462c964-e220-49f6-a38d-16d3b8ff99cd admin admin] PATH_INFO: `/v3/users/c69b357d05574ba68207419024eb0c8b` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:37:00.895919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9462c964-e220-49f6-a38d-16d3b8ff99cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c69b357d05574ba68207419024eb0c8b)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:37:00.898149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9462c964-e220-49f6-a38d-16d3b8ff99cd admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:37:00.957308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8549020-17b4-4d72-a485-33b8de53926d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:37:00.959335 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8549020-17b4-4d72-a485-33b8de53926d service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:37:00.973108 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4153/8312] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:37:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 659 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 04 01:37:01.013131 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9462c964-e220-49f6-a38d-16d3b8ff99cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c69b357d05574ba68207419024eb0c8b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:37:01.015281 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9462c964-e220-49f6-a38d-16d3b8ff99cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c69b357d05574ba68207419024eb0c8b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:37:01.031873 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9462c964-e220-49f6-a38d-16d3b8ff99cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c69b357d05574ba68207419024eb0c8b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:37:01.041976 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:37:01.075070 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9462c964-e220-49f6-a38d-16d3b8ff99cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c69b357d05574ba68207419024eb0c8b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:37:01.076712 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9462c964-e220-49f6-a38d-16d3b8ff99cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c69b357d05574ba68207419024eb0c8b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:37:01.147198 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4160/8313] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:37:00 2022] DELETE /identity/v3/users/c69b357d05574ba68207419024eb0c8b => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:37:01.150306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da8481-8003-4416-94c4-b17a9b047c18 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:37:01.150593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da8481-8003-4416-94c4-b17a9b047c18 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:37:01.150867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da8481-8003-4416-94c4-b17a9b047c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:37:01.197642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-04da8481-8003-4416-94c4-b17a9b047c18 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:37:01.204798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-04da8481-8003-4416-94c4-b17a9b047c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:37:01.285809 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4154/8314] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:37:01.377115 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462c964-e220-49f6-a38d-16d3b8ff99cd admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:37:01.378614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9462c964-e220-49f6-a38d-16d3b8ff99cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:37:01.499568 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da8481-8003-4416-94c4-b17a9b047c18 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:37:01.502279 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-04da8481-8003-4416-94c4-b17a9b047c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:37:01.518686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462c964-e220-49f6-a38d-16d3b8ff99cd admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:37:01.527876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eee8a4-7482-4242-a0eb-7ed5cda2da33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:37:01.528521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eee8a4-7482-4242-a0eb-7ed5cda2da33 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:37:01.528799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eee8a4-7482-4242-a0eb-7ed5cda2da33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:37:01.529075 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eee8a4-7482-4242-a0eb-7ed5cda2da33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:37:01.585120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eee8a4-7482-4242-a0eb-7ed5cda2da33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:37:01.592263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eee8a4-7482-4242-a0eb-7ed5cda2da33 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:37:01.619796 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4161/8315] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:37:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:37:01.662744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da8481-8003-4416-94c4-b17a9b047c18 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:37:01.679303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f728b-3898-4916-979b-388f9e7ce31b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:37:01.680074 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f728b-3898-4916-979b-388f9e7ce31b service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:37:01.680486 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f728b-3898-4916-979b-388f9e7ce31b service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:37:01.680891 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f728b-3898-4916-979b-388f9e7ce31b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:37:01.689005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d93f728b-3898-4916-979b-388f9e7ce31b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:37:01.730867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f728b-3898-4916-979b-388f9e7ce31b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:37:01.732919 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f728b-3898-4916-979b-388f9e7ce31b service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:37:01.799411 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4155/8316] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:37:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:37:02.801205 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eee8a4-7482-4242-a0eb-7ed5cda2da33 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:37:02.803323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a3eee8a4-7482-4242-a0eb-7ed5cda2da33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:37:02.895170 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eee8a4-7482-4242-a0eb-7ed5cda2da33 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:37:02.956776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7888bb-d3b4-4190-81b3-00950ff210ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:37:02.957814 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7888bb-d3b4-4190-81b3-00950ff210ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:37:02.960108 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7888bb-d3b4-4190-81b3-00950ff210ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:37:02.960587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7888bb-d3b4-4190-81b3-00950ff210ee admin admin] PATH_INFO: `/v3/projects/9fea4069f4d74e628600493703adf1fe` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:37:02.965850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7888bb-d3b4-4190-81b3-00950ff210ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fea4069f4d74e628600493703adf1fe)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:37:02.968064 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7888bb-d3b4-4190-81b3-00950ff210ee admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:37:03.084254 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7a7888bb-d3b4-4190-81b3-00950ff210ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fea4069f4d74e628600493703adf1fe', 'request_id': 'req-7a7888bb-d3b4-4190-81b3-00950ff210ee'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:37:03.118302 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7a7888bb-d3b4-4190-81b3-00950ff210ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fea4069f4d74e628600493703adf1fe', 'request_id': 'req-7a7888bb-d3b4-4190-81b3-00950ff210ee'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:37:03.129014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7a7888bb-d3b4-4190-81b3-00950ff210ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fea4069f4d74e628600493703adf1fe', 'request_id': 'req-7a7888bb-d3b4-4190-81b3-00950ff210ee'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:37:03.163669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7a7888bb-d3b4-4190-81b3-00950ff210ee admin admin] The token cache is being invalidate because project 9fea4069f4d74e628600493703adf1fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:37:03.164084 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7a7888bb-d3b4-4190-81b3-00950ff210ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:37:03.165129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7a7888bb-d3b4-4190-81b3-00950ff210ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:37:03.168895 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4162/8317] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:37:02 2022] DELETE /identity/v3/projects/9fea4069f4d74e628600493703adf1fe => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:37:03.174265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f728b-3898-4916-979b-388f9e7ce31b service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:37:03.191272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f728b-3898-4916-979b-388f9e7ce31b service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:37:03.253351 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:37:03.324578 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80965d3f-970b-4604-b658-7aa94078bf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:37:03.325395 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80965d3f-970b-4604-b658-7aa94078bf4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:37:03.325708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80965d3f-970b-4604-b658-7aa94078bf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:37:03.325987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80965d3f-970b-4604-b658-7aa94078bf4a admin admin] PATH_INFO: `/v3/users/be800bf894fa472490ffa2a883bb5e07` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:37:03.327833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80965d3f-970b-4604-b658-7aa94078bf4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=be800bf894fa472490ffa2a883bb5e07)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:37:03.330453 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80965d3f-970b-4604-b658-7aa94078bf4a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:37:03.434249 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-80965d3f-970b-4604-b658-7aa94078bf4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be800bf894fa472490ffa2a883bb5e07'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:37:03.435959 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-80965d3f-970b-4604-b658-7aa94078bf4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be800bf894fa472490ffa2a883bb5e07'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:37:03.468070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-80965d3f-970b-4604-b658-7aa94078bf4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be800bf894fa472490ffa2a883bb5e07'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:37:03.504297 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-80965d3f-970b-4604-b658-7aa94078bf4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be800bf894fa472490ffa2a883bb5e07'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:37:03.505094 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-80965d3f-970b-4604-b658-7aa94078bf4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be800bf894fa472490ffa2a883bb5e07'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:37:03.532509 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4156/8318] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:37:03 2022] DELETE /identity/v3/users/be800bf894fa472490ffa2a883bb5e07 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:37:05.267933 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7888bb-d3b4-4190-81b3-00950ff210ee admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:37:05.269644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7a7888bb-d3b4-4190-81b3-00950ff210ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:37:05.295887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7888bb-d3b4-4190-81b3-00950ff210ee admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:37:05.423364 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd39d25-a3d8-4020-afc6-adab407820fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:37:05.426139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd39d25-a3d8-4020-afc6-adab407820fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:37:05.426450 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd39d25-a3d8-4020-afc6-adab407820fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:37:05.426733 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd39d25-a3d8-4020-afc6-adab407820fb admin admin] PATH_INFO: `/v3/projects/50105ea770bd422fb5bb1dd264757e21` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:37:05.430045 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd39d25-a3d8-4020-afc6-adab407820fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=50105ea770bd422fb5bb1dd264757e21)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:37:05.432241 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd39d25-a3d8-4020-afc6-adab407820fb admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:37:05.456023 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:37:05.581984 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4fd39d25-a3d8-4020-afc6-adab407820fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50105ea770bd422fb5bb1dd264757e21', 'request_id': 'req-4fd39d25-a3d8-4020-afc6-adab407820fb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:37:05.627809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4fd39d25-a3d8-4020-afc6-adab407820fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50105ea770bd422fb5bb1dd264757e21', 'request_id': 'req-4fd39d25-a3d8-4020-afc6-adab407820fb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:37:05.636498 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4fd39d25-a3d8-4020-afc6-adab407820fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50105ea770bd422fb5bb1dd264757e21', 'request_id': 'req-4fd39d25-a3d8-4020-afc6-adab407820fb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:37:05.657879 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4fd39d25-a3d8-4020-afc6-adab407820fb admin admin] The token cache is being invalidate because project 50105ea770bd422fb5bb1dd264757e21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:37:05.658224 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4fd39d25-a3d8-4020-afc6-adab407820fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:37:05.661754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4fd39d25-a3d8-4020-afc6-adab407820fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:37:05.668065 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4163/8319] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:37:05 2022] DELETE /identity/v3/projects/50105ea770bd422fb5bb1dd264757e21 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:37:05.669368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80965d3f-970b-4604-b658-7aa94078bf4a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:37:05.670850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-80965d3f-970b-4604-b658-7aa94078bf4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:37:05.705569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80965d3f-970b-4604-b658-7aa94078bf4a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:37:05.799774 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5e72b-ae8d-42ae-a7e1-989f9cc0537d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:37:05.800437 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5e72b-ae8d-42ae-a7e1-989f9cc0537d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:37:05.800718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5e72b-ae8d-42ae-a7e1-989f9cc0537d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:37:05.800995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5e72b-ae8d-42ae-a7e1-989f9cc0537d admin admin] PATH_INFO: `/v3/users/22cc9fd70830416193f7482b365dbdc4` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:37:05.802183 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5e72b-ae8d-42ae-a7e1-989f9cc0537d admin admin] RBAC: Authorizing `identity:delete_user(user_id=22cc9fd70830416193f7482b365dbdc4)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:37:05.804626 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5e72b-ae8d-42ae-a7e1-989f9cc0537d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:37:05.883925 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0da5e72b-ae8d-42ae-a7e1-989f9cc0537d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22cc9fd70830416193f7482b365dbdc4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:37:05.884617 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0da5e72b-ae8d-42ae-a7e1-989f9cc0537d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22cc9fd70830416193f7482b365dbdc4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:37:05.892410 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:37:05.896132 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0da5e72b-ae8d-42ae-a7e1-989f9cc0537d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22cc9fd70830416193f7482b365dbdc4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:37:05.912794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0da5e72b-ae8d-42ae-a7e1-989f9cc0537d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22cc9fd70830416193f7482b365dbdc4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:37:05.913557 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0da5e72b-ae8d-42ae-a7e1-989f9cc0537d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22cc9fd70830416193f7482b365dbdc4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:37:05.944424 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4157/8320] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:37:05 2022] DELETE /identity/v3/users/22cc9fd70830416193f7482b365dbdc4 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:37:06.371365 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd39d25-a3d8-4020-afc6-adab407820fb admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:37:06.373021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4fd39d25-a3d8-4020-afc6-adab407820fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:37:06.395783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd39d25-a3d8-4020-afc6-adab407820fb admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:37:06.504305 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951fb9e-bb30-4b5d-af44-72e93ec48d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:37:06.504884 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951fb9e-bb30-4b5d-af44-72e93ec48d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:37:06.505172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951fb9e-bb30-4b5d-af44-72e93ec48d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:37:06.505480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951fb9e-bb30-4b5d-af44-72e93ec48d4b admin admin] PATH_INFO: `/v3/projects/5330a5b748924ab5bf96fc8ace6ae9e1` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:37:06.506643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951fb9e-bb30-4b5d-af44-72e93ec48d4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5330a5b748924ab5bf96fc8ace6ae9e1)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:37:06.508978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951fb9e-bb30-4b5d-af44-72e93ec48d4b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:37:06.586428 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6951fb9e-bb30-4b5d-af44-72e93ec48d4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5330a5b748924ab5bf96fc8ace6ae9e1', 'request_id': 'req-6951fb9e-bb30-4b5d-af44-72e93ec48d4b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:37:06.609448 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6951fb9e-bb30-4b5d-af44-72e93ec48d4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5330a5b748924ab5bf96fc8ace6ae9e1', 'request_id': 'req-6951fb9e-bb30-4b5d-af44-72e93ec48d4b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:37:06.617748 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6951fb9e-bb30-4b5d-af44-72e93ec48d4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5330a5b748924ab5bf96fc8ace6ae9e1', 'request_id': 'req-6951fb9e-bb30-4b5d-af44-72e93ec48d4b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:37:06.632439 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6951fb9e-bb30-4b5d-af44-72e93ec48d4b admin admin] The token cache is being invalidate because project 5330a5b748924ab5bf96fc8ace6ae9e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:37:06.632742 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6951fb9e-bb30-4b5d-af44-72e93ec48d4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:37:06.633985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6951fb9e-bb30-4b5d-af44-72e93ec48d4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:37:06.635378 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4164/8321] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:37:06 2022] DELETE /identity/v3/projects/5330a5b748924ab5bf96fc8ace6ae9e1 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:37:06.642706 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fae18c-264e-4aeb-9a6b-caf79aaf39f1 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:37:06.645011 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fae18c-264e-4aeb-9a6b-caf79aaf39f1 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:37:06.645779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fae18c-264e-4aeb-9a6b-caf79aaf39f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:37:06.686088 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-f2fae18c-264e-4aeb-9a6b-caf79aaf39f1 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:37:06.690788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f2fae18c-264e-4aeb-9a6b-caf79aaf39f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:37:06.800215 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4158/8322] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:37:06.808614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73474ca-e00b-40f9-84f8-d810fd2af28b None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:37:06.808900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73474ca-e00b-40f9-84f8-d810fd2af28b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:37:06.809177 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73474ca-e00b-40f9-84f8-d810fd2af28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:37:06.846110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e73474ca-e00b-40f9-84f8-d810fd2af28b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:37:06.846110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e73474ca-e00b-40f9-84f8-d810fd2af28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:37:06.869850 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4165/8323] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:37:06.869958 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fae18c-264e-4aeb-9a6b-caf79aaf39f1 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:37:06.884119 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fae18c-264e-4aeb-9a6b-caf79aaf39f1 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:37:06.899453 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df49312-30af-40de-9949-371aa0e8e9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:37:06.900325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df49312-30af-40de-9949-371aa0e8e9d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:37:06.900750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df49312-30af-40de-9949-371aa0e8e9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:37:06.901167 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df49312-30af-40de-9949-371aa0e8e9d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:37:06.903287 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df49312-30af-40de-9949-371aa0e8e9d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:37:06.903804 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df49312-30af-40de-9949-371aa0e8e9d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:37:06.906958 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df49312-30af-40de-9949-371aa0e8e9d6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:37:06.925941 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4159/8324] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:37:06.931905 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73474ca-e00b-40f9-84f8-d810fd2af28b None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:37:06.945781 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73474ca-e00b-40f9-84f8-d810fd2af28b None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:37:06.951803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0316cb-f57f-4b0c-aaa4-3fc2f464fadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:37:06.953882 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0316cb-f57f-4b0c-aaa4-3fc2f464fadb admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:37:06.954375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0316cb-f57f-4b0c-aaa4-3fc2f464fadb admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:37:06.954856 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0316cb-f57f-4b0c-aaa4-3fc2f464fadb admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:37:06.955682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0316cb-f57f-4b0c-aaa4-3fc2f464fadb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:37:06.958691 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0316cb-f57f-4b0c-aaa4-3fc2f464fadb admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:37:06.981044 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:37:07.004013 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4166/8325] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:37:06 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:37:07.008256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df49312-30af-40de-9949-371aa0e8e9d6 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:37:07.021082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df49312-30af-40de-9949-371aa0e8e9d6 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:37:07.133874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c642d8f-c231-4d07-849a-e7778cab2b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:37:07.135453 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c642d8f-c231-4d07-849a-e7778cab2b18 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:37:07.135884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c642d8f-c231-4d07-849a-e7778cab2b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:37:07.136470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c642d8f-c231-4d07-849a-e7778cab2b18 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:37:07.137275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c642d8f-c231-4d07-849a-e7778cab2b18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:37:07.143886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c642d8f-c231-4d07-849a-e7778cab2b18 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:37:07.183247 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4160/8326] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:37:07 2022] POST /identity/v3/users => generated 287 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:37:07.189047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0316cb-f57f-4b0c-aaa4-3fc2f464fadb admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:37:07.205647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0316cb-f57f-4b0c-aaa4-3fc2f464fadb admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:37:07.223770 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdda994-ea52-45fa-9604-4c6b389b79d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:37:07.224198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdda994-ea52-45fa-9604-4c6b389b79d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:37:07.224479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdda994-ea52-45fa-9604-4c6b389b79d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:37:07.224747 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdda994-ea52-45fa-9604-4c6b389b79d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:37:07.225630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdda994-ea52-45fa-9604-4c6b389b79d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:37:07.237665 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdda994-ea52-45fa-9604-4c6b389b79d7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:37:07.269181 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c642d8f-c231-4d07-849a-e7778cab2b18 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:37:07.283855 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4167/8327] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:37:07.317355 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c642d8f-c231-4d07-849a-e7778cab2b18 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:37:07.335772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c7dc5-3d6d-4df0-a4b6-11784153b8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:37:07.336445 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c7dc5-3d6d-4df0-a4b6-11784153b8b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:37:07.336781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c7dc5-3d6d-4df0-a4b6-11784153b8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:37:07.337344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c7dc5-3d6d-4df0-a4b6-11784153b8b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:37:07.338696 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c7dc5-3d6d-4df0-a4b6-11784153b8b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:37:07.345335 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c7dc5-3d6d-4df0-a4b6-11784153b8b6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:37:07.371487 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4161/8328] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:37:07.372367 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdda994-ea52-45fa-9604-4c6b389b79d7 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:37:07.395237 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdda994-ea52-45fa-9604-4c6b389b79d7 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:37:07.404297 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ff61c-8f87-48b5-bc36-fb8246d06d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:37:07.404988 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ff61c-8f87-48b5-bc36-fb8246d06d06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:37:07.405273 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ff61c-8f87-48b5-bc36-fb8246d06d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:37:07.405569 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ff61c-8f87-48b5-bc36-fb8246d06d06 admin admin] PATH_INFO: `/v3/projects/a74ad855454a4163a47e1be6c5db0982/users/48e884e3014d4bfe96176123f06bda79/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:37:07.459129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ff61c-8f87-48b5-bc36-fb8246d06d06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a74ad855454a4163a47e1be6c5db0982, user_id=48e884e3014d4bfe96176123f06bda79, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:37:07.462226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ff61c-8f87-48b5-bc36-fb8246d06d06 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:37:07.492167 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4168/8329] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:37:07 2022] PUT /identity/v3/projects/a74ad855454a4163a47e1be6c5db0982/users/48e884e3014d4bfe96176123f06bda79/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:37:07.498373 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317f215-d421-45b5-8c80-ed847c60dc30 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:37:07.498659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317f215-d421-45b5-8c80-ed847c60dc30 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:37:07.498933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317f215-d421-45b5-8c80-ed847c60dc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:37:07.530333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-0317f215-d421-45b5-8c80-ed847c60dc30 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:37:07.533522 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0317f215-d421-45b5-8c80-ed847c60dc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:37:07.613043 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:37:07.671471 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4162/8330] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:37:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:37:07.687739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ff61c-8f87-48b5-bc36-fb8246d06d06 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:37:07.689578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6e8ff61c-8f87-48b5-bc36-fb8246d06d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:37:07.814113 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ff61c-8f87-48b5-bc36-fb8246d06d06 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:37:07.818611 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4a9ee-fb46-482e-8ad8-40af2f425c4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:37:07.819233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4a9ee-fb46-482e-8ad8-40af2f425c4d service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:37:07.819513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4a9ee-fb46-482e-8ad8-40af2f425c4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:37:07.819788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4a9ee-fb46-482e-8ad8-40af2f425c4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:37:07.836797 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4a9ee-fb46-482e-8ad8-40af2f425c4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:37:07.838773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4a9ee-fb46-482e-8ad8-40af2f425c4d service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:37:07.851833 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4169/8331] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:37:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:37:08.393157 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd92ccd-2799-45ef-8f34-ac8a40d22ecd None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:37:08.393849 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd92ccd-2799-45ef-8f34-ac8a40d22ecd None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:37:08.393849 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd92ccd-2799-45ef-8f34-ac8a40d22ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:37:08.503033 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-8dd92ccd-2799-45ef-8f34-ac8a40d22ecd None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:37:08.504273 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8dd92ccd-2799-45ef-8f34-ac8a40d22ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:37:08.693530 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4163/8332] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:37:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:37:08.781910 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4a9ee-fb46-482e-8ad8-40af2f425c4d service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:37:08.785563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-dea4a9ee-fb46-482e-8ad8-40af2f425c4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:37:08.894504 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4a9ee-fb46-482e-8ad8-40af2f425c4d service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:37:08.900925 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015cf2e6-3b4f-4488-9076-7b3dac765fd0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:37:08.901748 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015cf2e6-3b4f-4488-9076-7b3dac765fd0 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:37:08.902030 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015cf2e6-3b4f-4488-9076-7b3dac765fd0 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:37:08.902305 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015cf2e6-3b4f-4488-9076-7b3dac765fd0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:37:08.912988 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015cf2e6-3b4f-4488-9076-7b3dac765fd0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:37:08.915030 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015cf2e6-3b4f-4488-9076-7b3dac765fd0 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:37:08.929547 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4170/8333] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:37:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:37:09.123569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e05b65-8280-4f9e-8373-3f57bef19b18 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:37:09.124036 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e05b65-8280-4f9e-8373-3f57bef19b18 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:37:09.124416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e05b65-8280-4f9e-8373-3f57bef19b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:37:09.188721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-81e05b65-8280-4f9e-8373-3f57bef19b18 None None] MFA Rules not processed for user `48e884e3014d4bfe96176123f06bda79`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:37:09.190504 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-81e05b65-8280-4f9e-8373-3f57bef19b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:37:09.436695 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4164/8334] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:37:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:37:09.441605 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015cf2e6-3b4f-4488-9076-7b3dac765fd0 service swift] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:37:09.473304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015cf2e6-3b4f-4488-9076-7b3dac765fd0 service swift] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:37:09.496199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5e337-fcd5-4d29-a794-6b69d1d96d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:37:09.499130 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5e337-fcd5-4d29-a794-6b69d1d96d84 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:37:09.499505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5e337-fcd5-4d29-a794-6b69d1d96d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:37:09.500781 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5e337-fcd5-4d29-a794-6b69d1d96d84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:37:09.503578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae5e337-fcd5-4d29-a794-6b69d1d96d84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:37:09.505765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae5e337-fcd5-4d29-a794-6b69d1d96d84 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:37:09.592372 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4171/8335] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:37:09 2022] POST /identity/v3/projects => generated 371 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:37:09.598179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e05b65-8280-4f9e-8373-3f57bef19b18 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:37:09.621863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e05b65-8280-4f9e-8373-3f57bef19b18 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:37:09.674657 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:37:09.704053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728719e3-98f6-4f91-86b4-3a3bcb3cbc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:37:09.704750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728719e3-98f6-4f91-86b4-3a3bcb3cbc82 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:37:09.705035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728719e3-98f6-4f91-86b4-3a3bcb3cbc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:37:09.705314 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728719e3-98f6-4f91-86b4-3a3bcb3cbc82 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:37:09.705994 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728719e3-98f6-4f91-86b4-3a3bcb3cbc82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:37:09.708137 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728719e3-98f6-4f91-86b4-3a3bcb3cbc82 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:37:09.736794 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4165/8336] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:37:09 2022] POST /identity/v3/users => generated 292 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:37:09.740949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5e337-fcd5-4d29-a794-6b69d1d96d84 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:37:09.752129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5e337-fcd5-4d29-a794-6b69d1d96d84 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:37:09.756755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf988e-b599-428b-8ee8-da7d8a80f414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:37:09.757367 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf988e-b599-428b-8ee8-da7d8a80f414 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:37:09.757679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf988e-b599-428b-8ee8-da7d8a80f414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:37:09.757957 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf988e-b599-428b-8ee8-da7d8a80f414 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:37:09.758595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf988e-b599-428b-8ee8-da7d8a80f414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:37:09.760184 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf988e-b599-428b-8ee8-da7d8a80f414 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:37:09.774925 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4172/8337] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:37:09.776078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728719e3-98f6-4f91-86b4-3a3bcb3cbc82 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:37:09.786865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728719e3-98f6-4f91-86b4-3a3bcb3cbc82 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:37:09.794230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde8b76-60bc-4cf2-9269-69380b20fb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:37:09.795365 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde8b76-60bc-4cf2-9269-69380b20fb39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:37:09.795627 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde8b76-60bc-4cf2-9269-69380b20fb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:37:09.795953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde8b76-60bc-4cf2-9269-69380b20fb39 admin admin] PATH_INFO: `/v3/projects/fd25ba636f874720a103225539e70d93/users/0b228d3b6ce84758bd823c4e1dac39d1/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:37:09.853587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde8b76-60bc-4cf2-9269-69380b20fb39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd25ba636f874720a103225539e70d93, user_id=0b228d3b6ce84758bd823c4e1dac39d1, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:37:09.860555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde8b76-60bc-4cf2-9269-69380b20fb39 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:37:09.904116 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4166/8338] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:37:09 2022] PUT /identity/v3/projects/fd25ba636f874720a103225539e70d93/users/0b228d3b6ce84758bd823c4e1dac39d1/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:37:09.906579 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf988e-b599-428b-8ee8-da7d8a80f414 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:37:09.950031 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf988e-b599-428b-8ee8-da7d8a80f414 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:37:10.097036 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:37:10.226903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e36f32-cef9-4beb-9e10-7761a94962d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:37:10.227794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e36f32-cef9-4beb-9e10-7761a94962d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:37:10.228219 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e36f32-cef9-4beb-9e10-7761a94962d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:37:10.228635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e36f32-cef9-4beb-9e10-7761a94962d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:37:10.229473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e36f32-cef9-4beb-9e10-7761a94962d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:37:10.231912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e36f32-cef9-4beb-9e10-7761a94962d8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:37:10.274425 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4173/8339] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:37:10.278620 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde8b76-60bc-4cf2-9269-69380b20fb39 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:37:10.290323 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde8b76-60bc-4cf2-9269-69380b20fb39 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:37:10.295277 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380b926-9d1b-42df-915b-7ab5ea175680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:37:10.295958 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380b926-9d1b-42df-915b-7ab5ea175680 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:37:10.296240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380b926-9d1b-42df-915b-7ab5ea175680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:37:10.297044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380b926-9d1b-42df-915b-7ab5ea175680 admin admin] PATH_INFO: `/v3/projects/fd25ba636f874720a103225539e70d93/users/0b228d3b6ce84758bd823c4e1dac39d1/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:37:10.299056 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c380b926-9d1b-42df-915b-7ab5ea175680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd25ba636f874720a103225539e70d93, user_id=0b228d3b6ce84758bd823c4e1dac39d1, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:37:10.301795 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c380b926-9d1b-42df-915b-7ab5ea175680 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:37:10.315144 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4167/8340] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:37:10 2022] PUT /identity/v3/projects/fd25ba636f874720a103225539e70d93/users/0b228d3b6ce84758bd823c4e1dac39d1/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:37:10.462790 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c567bf-4f68-4379-a441-51b7b52a9b93 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:37:10.463076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c567bf-4f68-4379-a441-51b7b52a9b93 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:37:10.463439 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c567bf-4f68-4379-a441-51b7b52a9b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:37:10.513858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-71c567bf-4f68-4379-a441-51b7b52a9b93 None None] MFA Rules not processed for user `f39dd2d709374c729d51f7e2cf18300c`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:37:10.515815 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-71c567bf-4f68-4379-a441-51b7b52a9b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:37:10.688777 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4174/8341] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:37:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:37:12.924354 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52a134-93af-4915-bb50-71fdf0dc6229 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:37:12.924873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52a134-93af-4915-bb50-71fdf0dc6229 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:37:12.924873 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52a134-93af-4915-bb50-71fdf0dc6229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:37:13.005320 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-5d52a134-93af-4915-bb50-71fdf0dc6229 None None] MFA Rules not processed for user `0b228d3b6ce84758bd823c4e1dac39d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:37:13.006798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5d52a134-93af-4915-bb50-71fdf0dc6229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:37:13.137490 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4168/8342] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:37:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:37:13.145705 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850f5b4-f1b1-4993-bdb7-98f340754819 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:37:13.146124 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850f5b4-f1b1-4993-bdb7-98f340754819 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:37:13.146444 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850f5b4-f1b1-4993-bdb7-98f340754819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:37:13.174465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c850f5b4-f1b1-4993-bdb7-98f340754819 None None] MFA Rules not processed for user `48e884e3014d4bfe96176123f06bda79`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:37:13.175824 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c850f5b4-f1b1-4993-bdb7-98f340754819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:37:13.277355 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4175/8343] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:37:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:37:13.290069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52a134-93af-4915-bb50-71fdf0dc6229 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:37:13.291082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5d52a134-93af-4915-bb50-71fdf0dc6229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:37:13.458753 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52a134-93af-4915-bb50-71fdf0dc6229 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:37:13.472106 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba7d21-48ff-424f-9ecd-cdaf531637b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:37:13.472741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba7d21-48ff-424f-9ecd-cdaf531637b7 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:37:13.473020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba7d21-48ff-424f-9ecd-cdaf531637b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:37:13.473291 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba7d21-48ff-424f-9ecd-cdaf531637b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:37:13.491988 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba7d21-48ff-424f-9ecd-cdaf531637b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:37:13.493766 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba7d21-48ff-424f-9ecd-cdaf531637b7 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:37:13.500022 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:37:13.534878 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4169/8344] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:37:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:37:17.559359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850f5b4-f1b1-4993-bdb7-98f340754819 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:37:17.703555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850f5b4-f1b1-4993-bdb7-98f340754819 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:37:17.709037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454cab3-e4df-483a-8500-28681f5dd5bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:37:17.709884 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454cab3-e4df-483a-8500-28681f5dd5bf service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:37:17.710309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454cab3-e4df-483a-8500-28681f5dd5bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:37:17.710725 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454cab3-e4df-483a-8500-28681f5dd5bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:37:17.714541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8454cab3-e4df-483a-8500-28681f5dd5bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:37:17.732775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8454cab3-e4df-483a-8500-28681f5dd5bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:37:17.736226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8454cab3-e4df-483a-8500-28681f5dd5bf service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:37:17.751404 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4176/8345] 10.222.0.30 () {60 vars in 1396 bytes} [Sun Sep 4 01:37:17 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3256 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:37:21.704678 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba7d21-48ff-424f-9ecd-cdaf531637b7 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:37:21.725165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba7d21-48ff-424f-9ecd-cdaf531637b7 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:37:21.731219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f79410-0156-42a9-ac87-087a31f94501 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:37:21.731940 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f79410-0156-42a9-ac87-087a31f94501 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:37:21.732299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f79410-0156-42a9-ac87-087a31f94501 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:37:21.732670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f79410-0156-42a9-ac87-087a31f94501 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:37:21.738375 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-56f79410-0156-42a9-ac87-087a31f94501 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:37:21.841824 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f79410-0156-42a9-ac87-087a31f94501 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:37:21.844299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f79410-0156-42a9-ac87-087a31f94501 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:37:21.855548 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4170/8346] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:37:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:37:27.742599 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:37:31.850233 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=30 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:37:33.672555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454cab3-e4df-483a-8500-28681f5dd5bf service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:37:33.674102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8454cab3-e4df-483a-8500-28681f5dd5bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:37:33.754654 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454cab3-e4df-483a-8500-28681f5dd5bf service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:37:33.758633 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76d584-e756-4a08-a05e-1c535ece65c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:37:33.759529 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76d584-e756-4a08-a05e-1c535ece65c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:37:33.760058 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76d584-e756-4a08-a05e-1c535ece65c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:37:33.760482 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76d584-e756-4a08-a05e-1c535ece65c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:37:33.770894 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76d584-e756-4a08-a05e-1c535ece65c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:37:33.772575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76d584-e756-4a08-a05e-1c535ece65c8 service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:37:33.796261 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4177/8347] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:37:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:37:43.778754 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=26 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:38:20.458487 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f79410-0156-42a9-ac87-087a31f94501 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:20.618772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f79410-0156-42a9-ac87-087a31f94501 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:20.624473 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7875b7-2531-4d92-9fce-9292b5877b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:20.625352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7875b7-2531-4d92-9fce-9292b5877b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:20.625819 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7875b7-2531-4d92-9fce-9292b5877b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:20.626258 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7875b7-2531-4d92-9fce-9292b5877b8a admin admin] PATH_INFO: `/v3/users/48e884e3014d4bfe96176123f06bda79` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:20.627587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7875b7-2531-4d92-9fce-9292b5877b8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=48e884e3014d4bfe96176123f06bda79)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:20.629783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7875b7-2531-4d92-9fce-9292b5877b8a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:20.692941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ac7875b7-2531-4d92-9fce-9292b5877b8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48e884e3014d4bfe96176123f06bda79'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:20.693642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ac7875b7-2531-4d92-9fce-9292b5877b8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48e884e3014d4bfe96176123f06bda79'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:20.703018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ac7875b7-2531-4d92-9fce-9292b5877b8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48e884e3014d4bfe96176123f06bda79'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:20.717123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ac7875b7-2531-4d92-9fce-9292b5877b8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48e884e3014d4bfe96176123f06bda79'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:20.717628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ac7875b7-2531-4d92-9fce-9292b5877b8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48e884e3014d4bfe96176123f06bda79'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:20.774701 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4171/8348] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:38:20 2022] DELETE /identity/v3/users/48e884e3014d4bfe96176123f06bda79 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:38:21.212789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76d584-e756-4a08-a05e-1c535ece65c8 service cinder] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:21.335754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76d584-e756-4a08-a05e-1c535ece65c8 service cinder] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:21.518129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143fe64-39c9-4a1d-b92a-4ff9fe596dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:21.519503 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143fe64-39c9-4a1d-b92a-4ff9fe596dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:21.519791 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143fe64-39c9-4a1d-b92a-4ff9fe596dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:21.520070 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143fe64-39c9-4a1d-b92a-4ff9fe596dcf admin admin] PATH_INFO: `/v3/projects/a74ad855454a4163a47e1be6c5db0982` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:21.521970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0143fe64-39c9-4a1d-b92a-4ff9fe596dcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a74ad855454a4163a47e1be6c5db0982)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:21.524932 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0143fe64-39c9-4a1d-b92a-4ff9fe596dcf admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:21.662167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0143fe64-39c9-4a1d-b92a-4ff9fe596dcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a74ad855454a4163a47e1be6c5db0982', 'request_id': 'req-0143fe64-39c9-4a1d-b92a-4ff9fe596dcf'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:21.684259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0143fe64-39c9-4a1d-b92a-4ff9fe596dcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a74ad855454a4163a47e1be6c5db0982', 'request_id': 'req-0143fe64-39c9-4a1d-b92a-4ff9fe596dcf'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:21.711251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0143fe64-39c9-4a1d-b92a-4ff9fe596dcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a74ad855454a4163a47e1be6c5db0982', 'request_id': 'req-0143fe64-39c9-4a1d-b92a-4ff9fe596dcf'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:21.748962 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0143fe64-39c9-4a1d-b92a-4ff9fe596dcf admin admin] The token cache is being invalidate because project a74ad855454a4163a47e1be6c5db0982 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:38:21.751357 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0143fe64-39c9-4a1d-b92a-4ff9fe596dcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:21.751357 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0143fe64-39c9-4a1d-b92a-4ff9fe596dcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:21.755152 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4178/8349] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:38:21 2022] DELETE /identity/v3/projects/a74ad855454a4163a47e1be6c5db0982 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:38:21.756234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7875b7-2531-4d92-9fce-9292b5877b8a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:21.758517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ac7875b7-2531-4d92-9fce-9292b5877b8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:21.807081 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7875b7-2531-4d92-9fce-9292b5877b8a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:21.913039 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:38:21.952142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8146ea-c1a4-4a6d-bcfd-76d3bb6d6d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:21.954363 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8146ea-c1a4-4a6d-bcfd-76d3bb6d6d4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:21.955703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8146ea-c1a4-4a6d-bcfd-76d3bb6d6d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:21.956044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8146ea-c1a4-4a6d-bcfd-76d3bb6d6d4e admin admin] PATH_INFO: `/v3/users/0b228d3b6ce84758bd823c4e1dac39d1` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:21.959230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8146ea-c1a4-4a6d-bcfd-76d3bb6d6d4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b228d3b6ce84758bd823c4e1dac39d1)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:21.962886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8146ea-c1a4-4a6d-bcfd-76d3bb6d6d4e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:22.131065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ab8146ea-c1a4-4a6d-bcfd-76d3bb6d6d4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b228d3b6ce84758bd823c4e1dac39d1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:22.131799 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ab8146ea-c1a4-4a6d-bcfd-76d3bb6d6d4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b228d3b6ce84758bd823c4e1dac39d1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:22.165044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ab8146ea-c1a4-4a6d-bcfd-76d3bb6d6d4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b228d3b6ce84758bd823c4e1dac39d1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:22.191539 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ab8146ea-c1a4-4a6d-bcfd-76d3bb6d6d4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b228d3b6ce84758bd823c4e1dac39d1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:22.193456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ab8146ea-c1a4-4a6d-bcfd-76d3bb6d6d4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b228d3b6ce84758bd823c4e1dac39d1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:22.272536 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4172/8350] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:38:21 2022] DELETE /identity/v3/users/0b228d3b6ce84758bd823c4e1dac39d1 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:38:22.599245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143fe64-39c9-4a1d-b92a-4ff9fe596dcf admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:22.601104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0143fe64-39c9-4a1d-b92a-4ff9fe596dcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:22.637800 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143fe64-39c9-4a1d-b92a-4ff9fe596dcf admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:22.809708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fea5f-0964-4a54-adbe-f4e59cd89a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:22.810661 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fea5f-0964-4a54-adbe-f4e59cd89a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:22.811040 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fea5f-0964-4a54-adbe-f4e59cd89a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:22.811609 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fea5f-0964-4a54-adbe-f4e59cd89a99 admin admin] PATH_INFO: `/v3/projects/fd25ba636f874720a103225539e70d93` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:22.812969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0fea5f-0964-4a54-adbe-f4e59cd89a99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd25ba636f874720a103225539e70d93)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:22.820673 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0fea5f-0964-4a54-adbe-f4e59cd89a99 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:22.835913 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:38:22.956176 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ca0fea5f-0964-4a54-adbe-f4e59cd89a99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd25ba636f874720a103225539e70d93', 'request_id': 'req-ca0fea5f-0964-4a54-adbe-f4e59cd89a99'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:22.970380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ca0fea5f-0964-4a54-adbe-f4e59cd89a99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd25ba636f874720a103225539e70d93', 'request_id': 'req-ca0fea5f-0964-4a54-adbe-f4e59cd89a99'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:22.978302 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ca0fea5f-0964-4a54-adbe-f4e59cd89a99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd25ba636f874720a103225539e70d93', 'request_id': 'req-ca0fea5f-0964-4a54-adbe-f4e59cd89a99'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:22.996317 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ca0fea5f-0964-4a54-adbe-f4e59cd89a99 admin admin] The token cache is being invalidate because project fd25ba636f874720a103225539e70d93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:38:22.996753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ca0fea5f-0964-4a54-adbe-f4e59cd89a99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:22.998003 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-ca0fea5f-0964-4a54-adbe-f4e59cd89a99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:23.003704 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4179/8351] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:38:22 2022] DELETE /identity/v3/projects/fd25ba636f874720a103225539e70d93 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:38:23.005894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3e01f-2c12-4cb8-b1d6-b1aa3826c7b1 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:23.006660 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3e01f-2c12-4cb8-b1d6-b1aa3826c7b1 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:23.007082 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3e01f-2c12-4cb8-b1d6-b1aa3826c7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:23.060941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-80b3e01f-2c12-4cb8-b1d6-b1aa3826c7b1 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:38:23.062902 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-80b3e01f-2c12-4cb8-b1d6-b1aa3826c7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:23.201015 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4173/8352] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:38:23.209670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5100c03-5137-4364-8798-c8e317748795 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:23.209964 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5100c03-5137-4364-8798-c8e317748795 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:23.210236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5100c03-5137-4364-8798-c8e317748795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:23.249766 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-f5100c03-5137-4364-8798-c8e317748795 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:38:23.251098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f5100c03-5137-4364-8798-c8e317748795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:23.271850 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4180/8353] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:38:23.273363 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3e01f-2c12-4cb8-b1d6-b1aa3826c7b1 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:23.293825 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3e01f-2c12-4cb8-b1d6-b1aa3826c7b1 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:23.324131 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29ffcb-47b3-426c-aed7-41c938958b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:23.325703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29ffcb-47b3-426c-aed7-41c938958b59 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:23.326362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29ffcb-47b3-426c-aed7-41c938958b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:23.326855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29ffcb-47b3-426c-aed7-41c938958b59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:23.327750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d29ffcb-47b3-426c-aed7-41c938958b59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:38:23.328546 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d29ffcb-47b3-426c-aed7-41c938958b59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:23.330452 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d29ffcb-47b3-426c-aed7-41c938958b59 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:23.362991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5100c03-5137-4364-8798-c8e317748795 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:23.366274 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4174/8354] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:38:23.380094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5100c03-5137-4364-8798-c8e317748795 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:23.394645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61efd81-ff88-4f9a-ab90-b530224d2d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:23.395497 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61efd81-ff88-4f9a-ab90-b530224d2d90 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:23.395581 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61efd81-ff88-4f9a-ab90-b530224d2d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:23.395796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61efd81-ff88-4f9a-ab90-b530224d2d90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:23.396448 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61efd81-ff88-4f9a-ab90-b530224d2d90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:23.398387 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61efd81-ff88-4f9a-ab90-b530224d2d90 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:23.455765 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4181/8355] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:38:23 2022] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:38:23.466927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29ffcb-47b3-426c-aed7-41c938958b59 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:23.485333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29ffcb-47b3-426c-aed7-41c938958b59 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:23.562963 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:38:23.592433 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ba6ac-c595-41ea-b732-71094c74e23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:23.593583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ba6ac-c595-41ea-b732-71094c74e23d admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:23.593887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ba6ac-c595-41ea-b732-71094c74e23d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:23.594401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ba6ac-c595-41ea-b732-71094c74e23d admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:23.596101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ba6ac-c595-41ea-b732-71094c74e23d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:23.599013 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ba6ac-c595-41ea-b732-71094c74e23d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:23.638160 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61efd81-ff88-4f9a-ab90-b530224d2d90 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:23.638688 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4175/8356] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:38:23 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:38:23.654666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61efd81-ff88-4f9a-ab90-b530224d2d90 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:23.665009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cac0d5-037c-4796-aec2-95a0ceb5fb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:23.665747 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cac0d5-037c-4796-aec2-95a0ceb5fb86 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:23.666104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cac0d5-037c-4796-aec2-95a0ceb5fb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:23.666448 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cac0d5-037c-4796-aec2-95a0ceb5fb86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:23.667163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cac0d5-037c-4796-aec2-95a0ceb5fb86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:23.668892 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cac0d5-037c-4796-aec2-95a0ceb5fb86 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:23.693367 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4182/8357] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:38:23.697907 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ba6ac-c595-41ea-b732-71094c74e23d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:23.716780 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ba6ac-c595-41ea-b732-71094c74e23d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:23.737160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491390e-1e7b-482a-85a2-4a88a8650442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:23.742435 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491390e-1e7b-482a-85a2-4a88a8650442 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:23.742728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491390e-1e7b-482a-85a2-4a88a8650442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:23.743014 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491390e-1e7b-482a-85a2-4a88a8650442 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:23.743692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3491390e-1e7b-482a-85a2-4a88a8650442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:23.745470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3491390e-1e7b-482a-85a2-4a88a8650442 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:23.786831 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4176/8358] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:38:23.788149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cac0d5-037c-4796-aec2-95a0ceb5fb86 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:23.800553 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cac0d5-037c-4796-aec2-95a0ceb5fb86 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:23.820730 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15d0c0-504e-4284-8e42-509fcef15491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:23.822074 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15d0c0-504e-4284-8e42-509fcef15491 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:23.823686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15d0c0-504e-4284-8e42-509fcef15491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:23.824201 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15d0c0-504e-4284-8e42-509fcef15491 admin admin] PATH_INFO: `/v3/projects/4d097650ffaa483abd607c5b9fa25aaa/users/b3027ab5e44945549170da00350327b0/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:23.860479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15d0c0-504e-4284-8e42-509fcef15491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d097650ffaa483abd607c5b9fa25aaa, user_id=b3027ab5e44945549170da00350327b0, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:23.863560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15d0c0-504e-4284-8e42-509fcef15491 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:23.890640 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4183/8359] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:38:23 2022] PUT /identity/v3/projects/4d097650ffaa483abd607c5b9fa25aaa/users/b3027ab5e44945549170da00350327b0/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:38:23.904556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24067a1-34e6-4203-8bf8-c94903711078 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:23.905091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24067a1-34e6-4203-8bf8-c94903711078 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:23.905590 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24067a1-34e6-4203-8bf8-c94903711078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:23.987581 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-b24067a1-34e6-4203-8bf8-c94903711078 None None] MFA Rules not processed for user `b3027ab5e44945549170da00350327b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:38:23.988673 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b24067a1-34e6-4203-8bf8-c94903711078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:24.180660 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4177/8360] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:38:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:38:24.183830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15d0c0-504e-4284-8e42-509fcef15491 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:24.318912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15d0c0-504e-4284-8e42-509fcef15491 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:24.335413 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697afe9-db95-40dd-af90-9753a5a45616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:24.336071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697afe9-db95-40dd-af90-9753a5a45616 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:24.336348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697afe9-db95-40dd-af90-9753a5a45616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:24.336615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697afe9-db95-40dd-af90-9753a5a45616 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:24.342102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1697afe9-db95-40dd-af90-9753a5a45616 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:24.344168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1697afe9-db95-40dd-af90-9753a5a45616 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:24.414177 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4184/8361] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:38:24 2022] POST /identity/v3/projects => generated 383 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:38:24.416770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24067a1-34e6-4203-8bf8-c94903711078 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:24.440680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24067a1-34e6-4203-8bf8-c94903711078 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:24.577632 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52deb956-9f3e-4428-bf75-6e7074282116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:24.580029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52deb956-9f3e-4428-bf75-6e7074282116 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:24.580998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52deb956-9f3e-4428-bf75-6e7074282116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:24.581863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52deb956-9f3e-4428-bf75-6e7074282116 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:24.583175 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52deb956-9f3e-4428-bf75-6e7074282116 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:24.594939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52deb956-9f3e-4428-bf75-6e7074282116 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:24.640482 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4178/8362] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:38:24 2022] POST /identity/v3/users => generated 298 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:38:24.640751 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697afe9-db95-40dd-af90-9753a5a45616 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:24.667080 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697afe9-db95-40dd-af90-9753a5a45616 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:24.689371 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe585b-04c7-435d-a633-2881c8c0226a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:24.694562 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe585b-04c7-435d-a633-2881c8c0226a admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:24.695712 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe585b-04c7-435d-a633-2881c8c0226a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:24.697232 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe585b-04c7-435d-a633-2881c8c0226a admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:24.698170 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe585b-04c7-435d-a633-2881c8c0226a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:24.706243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe585b-04c7-435d-a633-2881c8c0226a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:24.741124 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4185/8363] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:38:24.745572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52deb956-9f3e-4428-bf75-6e7074282116 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:24.766670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52deb956-9f3e-4428-bf75-6e7074282116 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:24.776640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d124016-392e-4afe-ba4d-dd0e5ba49fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:24.778067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d124016-392e-4afe-ba4d-dd0e5ba49fa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:24.778437 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d124016-392e-4afe-ba4d-dd0e5ba49fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:24.779293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d124016-392e-4afe-ba4d-dd0e5ba49fa6 admin admin] PATH_INFO: `/v3/projects/667ebfdfe4514c96bebb511917b4849c/users/ac561459ac664bee9c71760b027b68d4/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:24.814684 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d124016-392e-4afe-ba4d-dd0e5ba49fa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=667ebfdfe4514c96bebb511917b4849c, user_id=ac561459ac664bee9c71760b027b68d4, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:24.817453 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d124016-392e-4afe-ba4d-dd0e5ba49fa6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:24.853535 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4179/8364] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:38:24 2022] PUT /identity/v3/projects/667ebfdfe4514c96bebb511917b4849c/users/ac561459ac664bee9c71760b027b68d4/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:38:24.858187 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe585b-04c7-435d-a633-2881c8c0226a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:24.873577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe585b-04c7-435d-a633-2881c8c0226a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:24.879054 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:38:24.978442 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7efacd-81ad-4643-b717-81889c960ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:24.979089 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7efacd-81ad-4643-b717-81889c960ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:24.979367 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7efacd-81ad-4643-b717-81889c960ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:24.979629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7efacd-81ad-4643-b717-81889c960ea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:24.980852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7efacd-81ad-4643-b717-81889c960ea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:24.982782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7efacd-81ad-4643-b717-81889c960ea1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:24.997921 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4186/8365] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:38:25.002693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d124016-392e-4afe-ba4d-dd0e5ba49fa6 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:25.018385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d124016-392e-4afe-ba4d-dd0e5ba49fa6 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:25.034016 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efec92-8bc2-4fea-a389-5e5c086dc6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:25.034702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efec92-8bc2-4fea-a389-5e5c086dc6bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:25.034981 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efec92-8bc2-4fea-a389-5e5c086dc6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:25.035253 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efec92-8bc2-4fea-a389-5e5c086dc6bf admin admin] PATH_INFO: `/v3/projects/667ebfdfe4514c96bebb511917b4849c/users/ac561459ac664bee9c71760b027b68d4/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:25.037404 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efec92-8bc2-4fea-a389-5e5c086dc6bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=667ebfdfe4514c96bebb511917b4849c, user_id=ac561459ac664bee9c71760b027b68d4, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:25.040094 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efec92-8bc2-4fea-a389-5e5c086dc6bf admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:25.068960 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4180/8366] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:38:25 2022] PUT /identity/v3/projects/667ebfdfe4514c96bebb511917b4849c/users/ac561459ac664bee9c71760b027b68d4/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:38:25.082371 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda06670-2e44-4fb3-9d17-cfb4ccd3d926 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:25.082671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda06670-2e44-4fb3-9d17-cfb4ccd3d926 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:25.082934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda06670-2e44-4fb3-9d17-cfb4ccd3d926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:25.196173 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-bda06670-2e44-4fb3-9d17-cfb4ccd3d926 None None] MFA Rules not processed for user `ac561459ac664bee9c71760b027b68d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:38:25.197490 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bda06670-2e44-4fb3-9d17-cfb4ccd3d926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:25.388715 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4187/8367] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:38:25 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:38:25.399895 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efec92-8bc2-4fea-a389-5e5c086dc6bf admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:25.402034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-75efec92-8bc2-4fea-a389-5e5c086dc6bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:25.410695 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:38:25.578457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efec92-8bc2-4fea-a389-5e5c086dc6bf admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:25.591971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3bf77-6091-4371-b650-d2ea28f1fba3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:25.592617 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3bf77-6091-4371-b650-d2ea28f1fba3 service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:25.592897 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3bf77-6091-4371-b650-d2ea28f1fba3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:25.593169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3bf77-6091-4371-b650-d2ea28f1fba3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:25.733650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d3bf77-6091-4371-b650-d2ea28f1fba3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:25.735645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d3bf77-6091-4371-b650-d2ea28f1fba3 service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:25.755392 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4181/8368] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:38:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:38:31.577813 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb01d3c-cb60-40de-99a7-854592f926a9 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:31.578272 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb01d3c-cb60-40de-99a7-854592f926a9 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:31.578545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb01d3c-cb60-40de-99a7-854592f926a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:31.637139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-6cb01d3c-cb60-40de-99a7-854592f926a9 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:38:31.640724 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6cb01d3c-cb60-40de-99a7-854592f926a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:31.699908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3bf77-6091-4371-b650-d2ea28f1fba3 service cinder] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:31.706915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-94d3bf77-6091-4371-b650-d2ea28f1fba3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:31.839108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3bf77-6091-4371-b650-d2ea28f1fba3 service cinder] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:31.844457 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4188/8369] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 01:38:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:38:31.854999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600975fa-4798-4605-ad78-9d513d2d8510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:31.856465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600975fa-4798-4605-ad78-9d513d2d8510 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:31.856745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600975fa-4798-4605-ad78-9d513d2d8510 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:31.857018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600975fa-4798-4605-ad78-9d513d2d8510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:31.859600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-600975fa-4798-4605-ad78-9d513d2d8510 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:31.886427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600975fa-4798-4605-ad78-9d513d2d8510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:31.887957 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600975fa-4798-4605-ad78-9d513d2d8510 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:31.912540 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4182/8370] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:38:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:38:31.941173 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb01d3c-cb60-40de-99a7-854592f926a9 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:31.943372 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6cb01d3c-cb60-40de-99a7-854592f926a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:32.051495 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:38:32.157963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb01d3c-cb60-40de-99a7-854592f926a9 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:32.171735 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830260f-e7e7-448e-873e-60e8f9f19207 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:32.172833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830260f-e7e7-448e-873e-60e8f9f19207 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:32.173340 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830260f-e7e7-448e-873e-60e8f9f19207 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:32.176208 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830260f-e7e7-448e-873e-60e8f9f19207 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:32.207790 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830260f-e7e7-448e-873e-60e8f9f19207 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:32.210087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830260f-e7e7-448e-873e-60e8f9f19207 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:32.229086 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4189/8371] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:38:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:38:34.701065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600975fa-4798-4605-ad78-9d513d2d8510 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:34.713910 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600975fa-4798-4605-ad78-9d513d2d8510 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:34.722294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1276d26-e168-415a-9247-cea8aa726833 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:34.724631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1276d26-e168-415a-9247-cea8aa726833 service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:34.724631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1276d26-e168-415a-9247-cea8aa726833 service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:34.724631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1276d26-e168-415a-9247-cea8aa726833 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:34.764164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1276d26-e168-415a-9247-cea8aa726833 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:34.765954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1276d26-e168-415a-9247-cea8aa726833 service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:34.790463 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4183/8372] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:38:34 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:38:37.662134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830260f-e7e7-448e-873e-60e8f9f19207 service swift] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:37.665790 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7830260f-e7e7-448e-873e-60e8f9f19207 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:37.818781 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830260f-e7e7-448e-873e-60e8f9f19207 service swift] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:37.825463 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b32863-57c4-4634-9ac6-ddc6384720a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:37.826779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b32863-57c4-4634-9ac6-ddc6384720a1 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:37.827335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b32863-57c4-4634-9ac6-ddc6384720a1 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:37.828686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b32863-57c4-4634-9ac6-ddc6384720a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:37.830703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-10b32863-57c4-4634-9ac6-ddc6384720a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:37.851770 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b32863-57c4-4634-9ac6-ddc6384720a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:37.866995 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b32863-57c4-4634-9ac6-ddc6384720a1 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:37.891023 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4190/8373] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:38:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:38:42.978409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1276d26-e168-415a-9247-cea8aa726833 service cinder] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:42.980688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a1276d26-e168-415a-9247-cea8aa726833 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:43.003079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1276d26-e168-415a-9247-cea8aa726833 service cinder] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:43.007556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f94d97-0714-4627-9264-981140354d6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:43.008194 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f94d97-0714-4627-9264-981140354d6e service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:43.008474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f94d97-0714-4627-9264-981140354d6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:43.008749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f94d97-0714-4627-9264-981140354d6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:43.011363 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-77f94d97-0714-4627-9264-981140354d6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:43.081015 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:38:43.168488 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f94d97-0714-4627-9264-981140354d6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:43.170283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f94d97-0714-4627-9264-981140354d6e service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:43.192701 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4184/8374] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:38:42 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:38:46.523972 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b32863-57c4-4634-9ac6-ddc6384720a1 service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:46.526033 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-10b32863-57c4-4634-9ac6-ddc6384720a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:46.645257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b32863-57c4-4634-9ac6-ddc6384720a1 service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:46.650211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b98d2e-9fe8-44b0-90c0-ca099769c9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:46.651037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b98d2e-9fe8-44b0-90c0-ca099769c9fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:46.651958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b98d2e-9fe8-44b0-90c0-ca099769c9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:46.651958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b98d2e-9fe8-44b0-90c0-ca099769c9fe admin admin] PATH_INFO: `/v3/users/97c85c756ae74d01abe71f0f29413f8a` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:46.652829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b98d2e-9fe8-44b0-90c0-ca099769c9fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=97c85c756ae74d01abe71f0f29413f8a)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:46.654932 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b98d2e-9fe8-44b0-90c0-ca099769c9fe admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:46.763952 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:38:46.780366 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-73b98d2e-9fe8-44b0-90c0-ca099769c9fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97c85c756ae74d01abe71f0f29413f8a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:46.782768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-73b98d2e-9fe8-44b0-90c0-ca099769c9fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97c85c756ae74d01abe71f0f29413f8a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:46.805734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-73b98d2e-9fe8-44b0-90c0-ca099769c9fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97c85c756ae74d01abe71f0f29413f8a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:46.824255 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-73b98d2e-9fe8-44b0-90c0-ca099769c9fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97c85c756ae74d01abe71f0f29413f8a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:46.826195 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-73b98d2e-9fe8-44b0-90c0-ca099769c9fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97c85c756ae74d01abe71f0f29413f8a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:46.871331 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4191/8375] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:38:46 2022] DELETE /identity/v3/users/97c85c756ae74d01abe71f0f29413f8a => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:38:46.875551 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88073c-d7f9-412a-a143-a0c72064eab1 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:46.876022 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88073c-d7f9-412a-a143-a0c72064eab1 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:46.876177 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88073c-d7f9-412a-a143-a0c72064eab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:46.911910 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-2e88073c-d7f9-412a-a143-a0c72064eab1 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:38:46.913287 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2e88073c-d7f9-412a-a143-a0c72064eab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:47.073184 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4185/8376] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:38:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:38:47.110331 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b98d2e-9fe8-44b0-90c0-ca099769c9fe admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:47.111858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-73b98d2e-9fe8-44b0-90c0-ca099769c9fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:47.264802 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b98d2e-9fe8-44b0-90c0-ca099769c9fe admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:47.283041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752132cd-d13a-40fd-a892-16470dd699fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:47.283995 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752132cd-d13a-40fd-a892-16470dd699fa service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:47.284437 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752132cd-d13a-40fd-a892-16470dd699fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:47.284865 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752132cd-d13a-40fd-a892-16470dd699fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:47.311676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752132cd-d13a-40fd-a892-16470dd699fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:47.313151 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752132cd-d13a-40fd-a892-16470dd699fa service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:47.348345 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4192/8377] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:38:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:38:47.757160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88073c-d7f9-412a-a143-a0c72064eab1 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:47.759293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2e88073c-d7f9-412a-a143-a0c72064eab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:47.784259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88073c-d7f9-412a-a143-a0c72064eab1 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:47.790174 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29189b-5c9e-489a-99c9-af086b8693ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:47.791451 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29189b-5c9e-489a-99c9-af086b8693ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:47.791451 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29189b-5c9e-489a-99c9-af086b8693ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:47.791451 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29189b-5c9e-489a-99c9-af086b8693ad admin admin] PATH_INFO: `/v3/projects/3f87ce1d8dd9474fb7b9fc728b8b0c81` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:47.799215 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29189b-5c9e-489a-99c9-af086b8693ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f87ce1d8dd9474fb7b9fc728b8b0c81)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:47.801482 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29189b-5c9e-489a-99c9-af086b8693ad admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:47.880915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752132cd-d13a-40fd-a892-16470dd699fa service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:47.883945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-752132cd-d13a-40fd-a892-16470dd699fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:47.899275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8c29189b-5c9e-489a-99c9-af086b8693ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f87ce1d8dd9474fb7b9fc728b8b0c81', 'request_id': 'req-8c29189b-5c9e-489a-99c9-af086b8693ad'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:47.900849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752132cd-d13a-40fd-a892-16470dd699fa service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:47.935509 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8c29189b-5c9e-489a-99c9-af086b8693ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f87ce1d8dd9474fb7b9fc728b8b0c81', 'request_id': 'req-8c29189b-5c9e-489a-99c9-af086b8693ad'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:47.951026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8c29189b-5c9e-489a-99c9-af086b8693ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f87ce1d8dd9474fb7b9fc728b8b0c81', 'request_id': 'req-8c29189b-5c9e-489a-99c9-af086b8693ad'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:47.983390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591179e-b970-4484-a703-89b99a45d3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:47.983902 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8c29189b-5c9e-489a-99c9-af086b8693ad admin admin] The token cache is being invalidate because project 3f87ce1d8dd9474fb7b9fc728b8b0c81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:38:47.985005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8c29189b-5c9e-489a-99c9-af086b8693ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:47.985975 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-8c29189b-5c9e-489a-99c9-af086b8693ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:47.990348 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4186/8378] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:38:47 2022] DELETE /identity/v3/projects/3f87ce1d8dd9474fb7b9fc728b8b0c81 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:38:47.994387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965877f3-ff4b-4a8c-a937-6fe11f1cb0bb None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:47.994926 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965877f3-ff4b-4a8c-a937-6fe11f1cb0bb None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:47.995395 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965877f3-ff4b-4a8c-a937-6fe11f1cb0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:47.995856 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591179e-b970-4484-a703-89b99a45d3ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:47.996231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591179e-b970-4484-a703-89b99a45d3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:47.996505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591179e-b970-4484-a703-89b99a45d3ae admin admin] PATH_INFO: `/v3/users/b3027ab5e44945549170da00350327b0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:48.008003 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591179e-b970-4484-a703-89b99a45d3ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3027ab5e44945549170da00350327b0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:48.011794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591179e-b970-4484-a703-89b99a45d3ae admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:48.023755 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-965877f3-ff4b-4a8c-a937-6fe11f1cb0bb None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:38:48.024998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-965877f3-ff4b-4a8c-a937-6fe11f1cb0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:48.037085 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4187/8379] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:38:48.051593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0e114-e9ff-4b6a-b09c-168e039f5a76 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:48.052032 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0e114-e9ff-4b6a-b09c-168e039f5a76 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:48.052133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0e114-e9ff-4b6a-b09c-168e039f5a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:48.099366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-95e0e114-e9ff-4b6a-b09c-168e039f5a76 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:38:48.100951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-95e0e114-e9ff-4b6a-b09c-168e039f5a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:48.111521 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4188/8380] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:38:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:38:48.116026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e0e114-e9ff-4b6a-b09c-168e039f5a76 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:48.127337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e0e114-e9ff-4b6a-b09c-168e039f5a76 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:48.138671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5591179e-b970-4484-a703-89b99a45d3ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3027ab5e44945549170da00350327b0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:48.141020 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5591179e-b970-4484-a703-89b99a45d3ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3027ab5e44945549170da00350327b0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:48.148499 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df39f78-024e-49ec-89b5-d3668d173e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:48.149722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df39f78-024e-49ec-89b5-d3668d173e13 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:48.150363 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df39f78-024e-49ec-89b5-d3668d173e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:48.150936 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df39f78-024e-49ec-89b5-d3668d173e13 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:48.152840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df39f78-024e-49ec-89b5-d3668d173e13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:38:48.153606 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df39f78-024e-49ec-89b5-d3668d173e13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:48.162774 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df39f78-024e-49ec-89b5-d3668d173e13 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:48.167223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5591179e-b970-4484-a703-89b99a45d3ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3027ab5e44945549170da00350327b0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:48.181341 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4189/8381] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:38:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:38:48.185746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df39f78-024e-49ec-89b5-d3668d173e13 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:48.185937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5591179e-b970-4484-a703-89b99a45d3ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3027ab5e44945549170da00350327b0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:48.186700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5591179e-b970-4484-a703-89b99a45d3ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3027ab5e44945549170da00350327b0'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:48.188313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7df39f78-024e-49ec-89b5-d3668d173e13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:48.189510 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:38:48.216965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df39f78-024e-49ec-89b5-d3668d173e13 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:48.224052 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e214f-b575-408a-84ba-9ab22205df45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:48.225020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e214f-b575-408a-84ba-9ab22205df45 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:48.225547 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e214f-b575-408a-84ba-9ab22205df45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:48.226033 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e214f-b575-408a-84ba-9ab22205df45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:48.226911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e214f-b575-408a-84ba-9ab22205df45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:48.229267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e214f-b575-408a-84ba-9ab22205df45 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:48.238135 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:38:48.247264 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4193/8382] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:38:47 2022] DELETE /identity/v3/users/b3027ab5e44945549170da00350327b0 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:38:48.253868 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237678c-72eb-4e0b-9be3-b998585bbb7d None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:48.255553 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237678c-72eb-4e0b-9be3-b998585bbb7d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:48.256226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237678c-72eb-4e0b-9be3-b998585bbb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:48.298108 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4190/8383] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:38:48 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:38:48.299683 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e214f-b575-408a-84ba-9ab22205df45 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:48.319268 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c237678c-72eb-4e0b-9be3-b998585bbb7d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:38:48.322465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c237678c-72eb-4e0b-9be3-b998585bbb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:48.439247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e214f-b575-408a-84ba-9ab22205df45 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:48.450022 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15759305-7249-4024-b2a8-2d215f6f6373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:48.450661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15759305-7249-4024-b2a8-2d215f6f6373 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:48.450942 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15759305-7249-4024-b2a8-2d215f6f6373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:48.451625 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15759305-7249-4024-b2a8-2d215f6f6373 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:48.452285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15759305-7249-4024-b2a8-2d215f6f6373 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:48.466114 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15759305-7249-4024-b2a8-2d215f6f6373 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:48.479826 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4194/8384] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:38:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:38:48.491328 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c237678c-72eb-4e0b-9be3-b998585bbb7d None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:48.494587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c237678c-72eb-4e0b-9be3-b998585bbb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:48.541501 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4191/8385] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:38:48 2022] POST /identity/v3/users => generated 292 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:38:48.548385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15759305-7249-4024-b2a8-2d215f6f6373 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:48.583880 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15759305-7249-4024-b2a8-2d215f6f6373 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:48.595680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028bf7ac-4779-406a-ab73-8eb2ff663f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:48.596360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bf7ac-4779-406a-ab73-8eb2ff663f92 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:48.597381 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bf7ac-4779-406a-ab73-8eb2ff663f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:48.597705 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bf7ac-4779-406a-ab73-8eb2ff663f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:48.598414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028bf7ac-4779-406a-ab73-8eb2ff663f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:48.600308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028bf7ac-4779-406a-ab73-8eb2ff663f92 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:48.618608 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4192/8386] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:38:48.619775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028bf7ac-4779-406a-ab73-8eb2ff663f92 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:48.634556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028bf7ac-4779-406a-ab73-8eb2ff663f92 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:48.643906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c237678c-72eb-4e0b-9be3-b998585bbb7d None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:48.647901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239b5a1-df75-45cd-a58b-dcf55b65eea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:48.648520 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239b5a1-df75-45cd-a58b-dcf55b65eea1 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:48.648798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239b5a1-df75-45cd-a58b-dcf55b65eea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:48.648917 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89766c0-f940-44a2-938c-1a5a32852d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:48.649144 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239b5a1-df75-45cd-a58b-dcf55b65eea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:48.650377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89766c0-f940-44a2-938c-1a5a32852d0e admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:48.650676 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89766c0-f940-44a2-938c-1a5a32852d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:48.650957 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89766c0-f940-44a2-938c-1a5a32852d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:48.658083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89766c0-f940-44a2-938c-1a5a32852d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:48.659400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239b5a1-df75-45cd-a58b-dcf55b65eea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:48.660658 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89766c0-f940-44a2-938c-1a5a32852d0e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:48.660847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239b5a1-df75-45cd-a58b-dcf55b65eea1 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:48.673088 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4195/8387] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:38:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:38:48.691520 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4193/8388] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:38:48.698667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239b5a1-df75-45cd-a58b-dcf55b65eea1 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:48.710144 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239b5a1-df75-45cd-a58b-dcf55b65eea1 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:48.715155 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1414801-13c8-423e-bad8-bb87a4a458d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:48.715835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1414801-13c8-423e-bad8-bb87a4a458d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:48.716118 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1414801-13c8-423e-bad8-bb87a4a458d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:48.716389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1414801-13c8-423e-bad8-bb87a4a458d8 admin admin] PATH_INFO: `/v3/projects/c9b16c560caf4d19b09f5b7189be3d90/users/b5eb3c37fa76402d9a065d8f7d480cf9/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:48.756994 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1414801-13c8-423e-bad8-bb87a4a458d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9b16c560caf4d19b09f5b7189be3d90, user_id=b5eb3c37fa76402d9a065d8f7d480cf9, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:48.764642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1414801-13c8-423e-bad8-bb87a4a458d8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:48.793950 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4196/8389] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:38:48 2022] PUT /identity/v3/projects/c9b16c560caf4d19b09f5b7189be3d90/users/b5eb3c37fa76402d9a065d8f7d480cf9/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:38:48.805060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c02577-36ca-4c8e-b253-c557b3194e3a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:48.805375 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c02577-36ca-4c8e-b253-c557b3194e3a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:48.805648 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c02577-36ca-4c8e-b253-c557b3194e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:48.881068 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-66c02577-36ca-4c8e-b253-c557b3194e3a None None] MFA Rules not processed for user `b5eb3c37fa76402d9a065d8f7d480cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:38:48.883183 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-66c02577-36ca-4c8e-b253-c557b3194e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:49.002535 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4194/8390] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:38:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:38:49.019744 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1414801-13c8-423e-bad8-bb87a4a458d8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:49.021573 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e1414801-13c8-423e-bad8-bb87a4a458d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:49.135191 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1414801-13c8-423e-bad8-bb87a4a458d8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:49.142956 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a511df-b9a0-4f51-84da-93704680a73a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:49.143600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a511df-b9a0-4f51-84da-93704680a73a service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:49.143882 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a511df-b9a0-4f51-84da-93704680a73a service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:49.144158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a511df-b9a0-4f51-84da-93704680a73a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:49.155138 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a511df-b9a0-4f51-84da-93704680a73a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:49.156886 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a511df-b9a0-4f51-84da-93704680a73a service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:49.168790 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4197/8391] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:38:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:38:49.264414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c02577-36ca-4c8e-b253-c557b3194e3a None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:49.266219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-66c02577-36ca-4c8e-b253-c557b3194e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:49.379338 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:38:49.418292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c02577-36ca-4c8e-b253-c557b3194e3a None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:49.424919 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c2870f-1a06-4df3-a914-8dc8b11940cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:49.426105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2870f-1a06-4df3-a914-8dc8b11940cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:49.427046 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2870f-1a06-4df3-a914-8dc8b11940cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:49.427576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2870f-1a06-4df3-a914-8dc8b11940cd admin admin] PATH_INFO: `/v3/projects/4d097650ffaa483abd607c5b9fa25aaa` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:49.429298 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c2870f-1a06-4df3-a914-8dc8b11940cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d097650ffaa483abd607c5b9fa25aaa)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:49.432297 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c2870f-1a06-4df3-a914-8dc8b11940cd admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:49.570399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a1c2870f-1a06-4df3-a914-8dc8b11940cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d097650ffaa483abd607c5b9fa25aaa', 'request_id': 'req-a1c2870f-1a06-4df3-a914-8dc8b11940cd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:49.591523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a1c2870f-1a06-4df3-a914-8dc8b11940cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d097650ffaa483abd607c5b9fa25aaa', 'request_id': 'req-a1c2870f-1a06-4df3-a914-8dc8b11940cd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:49.607567 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a1c2870f-1a06-4df3-a914-8dc8b11940cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d097650ffaa483abd607c5b9fa25aaa', 'request_id': 'req-a1c2870f-1a06-4df3-a914-8dc8b11940cd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:49.640602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a1c2870f-1a06-4df3-a914-8dc8b11940cd admin admin] The token cache is being invalidate because project 4d097650ffaa483abd607c5b9fa25aaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:38:49.640921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a1c2870f-1a06-4df3-a914-8dc8b11940cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:49.641625 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-a1c2870f-1a06-4df3-a914-8dc8b11940cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:49.653121 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4195/8392] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:38:49 2022] DELETE /identity/v3/projects/4d097650ffaa483abd607c5b9fa25aaa => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:38:49.653334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a511df-b9a0-4f51-84da-93704680a73a service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:49.663075 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:38:49.668515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a511df-b9a0-4f51-84da-93704680a73a service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:49.770983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a457b-4f2b-4555-9162-a41df05d0ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:49.770983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a457b-4f2b-4555-9162-a41df05d0ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:49.771302 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a457b-4f2b-4555-9162-a41df05d0ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:49.771394 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a457b-4f2b-4555-9162-a41df05d0ea5 admin admin] PATH_INFO: `/v3/users/ac561459ac664bee9c71760b027b68d4` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:49.784157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a457b-4f2b-4555-9162-a41df05d0ea5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac561459ac664bee9c71760b027b68d4)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:49.784157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a457b-4f2b-4555-9162-a41df05d0ea5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:49.900353 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-736a457b-4f2b-4555-9162-a41df05d0ea5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac561459ac664bee9c71760b027b68d4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:49.901276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-736a457b-4f2b-4555-9162-a41df05d0ea5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac561459ac664bee9c71760b027b68d4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:49.933589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-736a457b-4f2b-4555-9162-a41df05d0ea5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac561459ac664bee9c71760b027b68d4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:49.952168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-736a457b-4f2b-4555-9162-a41df05d0ea5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac561459ac664bee9c71760b027b68d4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:49.952813 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-736a457b-4f2b-4555-9162-a41df05d0ea5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac561459ac664bee9c71760b027b68d4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:49.999731 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4198/8393] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:38:49 2022] DELETE /identity/v3/users/ac561459ac664bee9c71760b027b68d4 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:38:50.738583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c2870f-1a06-4df3-a914-8dc8b11940cd admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:50.740285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a1c2870f-1a06-4df3-a914-8dc8b11940cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:50.771972 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c2870f-1a06-4df3-a914-8dc8b11940cd admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:50.935768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941adfe4-282d-4b72-8048-21a78bb7f9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:50.937342 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941adfe4-282d-4b72-8048-21a78bb7f9a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:50.938575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941adfe4-282d-4b72-8048-21a78bb7f9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:50.939681 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941adfe4-282d-4b72-8048-21a78bb7f9a4 admin admin] PATH_INFO: `/v3/projects/667ebfdfe4514c96bebb511917b4849c` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:50.946308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941adfe4-282d-4b72-8048-21a78bb7f9a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=667ebfdfe4514c96bebb511917b4849c)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:50.950368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941adfe4-282d-4b72-8048-21a78bb7f9a4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:51.058306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-941adfe4-282d-4b72-8048-21a78bb7f9a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '667ebfdfe4514c96bebb511917b4849c', 'request_id': 'req-941adfe4-282d-4b72-8048-21a78bb7f9a4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:51.068641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-941adfe4-282d-4b72-8048-21a78bb7f9a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '667ebfdfe4514c96bebb511917b4849c', 'request_id': 'req-941adfe4-282d-4b72-8048-21a78bb7f9a4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:51.085802 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-941adfe4-282d-4b72-8048-21a78bb7f9a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '667ebfdfe4514c96bebb511917b4849c', 'request_id': 'req-941adfe4-282d-4b72-8048-21a78bb7f9a4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:51.125839 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-941adfe4-282d-4b72-8048-21a78bb7f9a4 admin admin] The token cache is being invalidate because project 667ebfdfe4514c96bebb511917b4849c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:38:51.126364 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-941adfe4-282d-4b72-8048-21a78bb7f9a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:51.127765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-941adfe4-282d-4b72-8048-21a78bb7f9a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:51.139598 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4196/8394] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:38:50 2022] DELETE /identity/v3/projects/667ebfdfe4514c96bebb511917b4849c => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:38:51.141348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9581670-1134-4ca4-8669-cd2c3046aaf7 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:51.141845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9581670-1134-4ca4-8669-cd2c3046aaf7 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:51.141943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9581670-1134-4ca4-8669-cd2c3046aaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:51.202586 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a9581670-1134-4ca4-8669-cd2c3046aaf7 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:38:51.203840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a9581670-1134-4ca4-8669-cd2c3046aaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:51.426422 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4199/8395] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:38:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:38:51.435311 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae35629-5370-474c-9241-f42905dd27ee None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:51.435828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae35629-5370-474c-9241-f42905dd27ee None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:51.436286 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae35629-5370-474c-9241-f42905dd27ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:51.454792 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:38:51.482556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-bae35629-5370-474c-9241-f42905dd27ee None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:38:51.490320 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-bae35629-5370-474c-9241-f42905dd27ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:51.503654 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4197/8396] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:38:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:38:51.507912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9581670-1134-4ca4-8669-cd2c3046aaf7 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:51.525025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9581670-1134-4ca4-8669-cd2c3046aaf7 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:51.544505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e671e7-ccce-43cc-9213-fb44178949e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:51.547829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e671e7-ccce-43cc-9213-fb44178949e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:51.548117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e671e7-ccce-43cc-9213-fb44178949e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:51.548395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e671e7-ccce-43cc-9213-fb44178949e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:51.552676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e671e7-ccce-43cc-9213-fb44178949e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:38:51.553041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e671e7-ccce-43cc-9213-fb44178949e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:51.558014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e671e7-ccce-43cc-9213-fb44178949e0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:51.596363 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4200/8397] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:38:51.600926 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae35629-5370-474c-9241-f42905dd27ee None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:51.612522 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae35629-5370-474c-9241-f42905dd27ee None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:51.619166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1a12a-998f-45bb-93a2-ade28d59ef94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:51.619858 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1a12a-998f-45bb-93a2-ade28d59ef94 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:51.620171 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1a12a-998f-45bb-93a2-ade28d59ef94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:51.620448 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1a12a-998f-45bb-93a2-ade28d59ef94 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:51.621159 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d1a12a-998f-45bb-93a2-ade28d59ef94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:51.623453 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d1a12a-998f-45bb-93a2-ade28d59ef94 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:51.666903 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4198/8398] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:38:51 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:38:51.671281 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e671e7-ccce-43cc-9213-fb44178949e0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:51.686868 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e671e7-ccce-43cc-9213-fb44178949e0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:51.709714 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:38:51.847165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0db395-00a3-401f-a124-0b631f917aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:51.847997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0db395-00a3-401f-a124-0b631f917aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:51.848384 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0db395-00a3-401f-a124-0b631f917aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:51.848763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0db395-00a3-401f-a124-0b631f917aa2 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:51.850626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0db395-00a3-401f-a124-0b631f917aa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:51.854834 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0db395-00a3-401f-a124-0b631f917aa2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:51.903454 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4201/8399] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:38:51 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:38:51.907520 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1a12a-998f-45bb-93a2-ade28d59ef94 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:51.921047 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1a12a-998f-45bb-93a2-ade28d59ef94 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:51.933470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d316c8-734d-4970-8182-6d4d453c0fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:51.935581 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d316c8-734d-4970-8182-6d4d453c0fcf admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:51.937410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d316c8-734d-4970-8182-6d4d453c0fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:51.937951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d316c8-734d-4970-8182-6d4d453c0fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:51.940761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d316c8-734d-4970-8182-6d4d453c0fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:51.942912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d316c8-734d-4970-8182-6d4d453c0fcf admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:51.969223 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4199/8400] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:38:51.973623 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0db395-00a3-401f-a124-0b631f917aa2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:51.988205 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0db395-00a3-401f-a124-0b631f917aa2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:52.001999 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca960d01-5934-495c-b6b3-73dd78446ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:52.003596 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca960d01-5934-495c-b6b3-73dd78446ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:52.004079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca960d01-5934-495c-b6b3-73dd78446ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:52.004505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca960d01-5934-495c-b6b3-73dd78446ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:52.005468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca960d01-5934-495c-b6b3-73dd78446ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:52.007955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca960d01-5934-495c-b6b3-73dd78446ef9 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:52.036215 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4202/8401] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:38:52.038071 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d316c8-734d-4970-8182-6d4d453c0fcf admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:52.051102 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d316c8-734d-4970-8182-6d4d453c0fcf admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:52.056640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303574e4-f357-4bb4-aaf0-d68c6949425f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:52.058100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303574e4-f357-4bb4-aaf0-d68c6949425f admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:52.058534 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303574e4-f357-4bb4-aaf0-d68c6949425f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:52.059440 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303574e4-f357-4bb4-aaf0-d68c6949425f admin admin] PATH_INFO: `/v3/projects/362f0513be124389abf7102a306dcfb9/users/49bd2c54e1404c54b3fb99c51e0038f8/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:52.084114 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303574e4-f357-4bb4-aaf0-d68c6949425f admin admin] RBAC: Authorizing `identity:create_grant(project_id=362f0513be124389abf7102a306dcfb9, user_id=49bd2c54e1404c54b3fb99c51e0038f8, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:52.087817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303574e4-f357-4bb4-aaf0-d68c6949425f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:52.113488 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4200/8402] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:38:52 2022] PUT /identity/v3/projects/362f0513be124389abf7102a306dcfb9/users/49bd2c54e1404c54b3fb99c51e0038f8/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:38:52.129477 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd301f-6851-454b-be7f-bf6b398a389c None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:52.129877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd301f-6851-454b-be7f-bf6b398a389c None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:52.130280 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd301f-6851-454b-be7f-bf6b398a389c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:52.203330 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-12cd301f-6851-454b-be7f-bf6b398a389c None None] MFA Rules not processed for user `49bd2c54e1404c54b3fb99c51e0038f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:38:52.208227 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-12cd301f-6851-454b-be7f-bf6b398a389c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:52.368487 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4203/8403] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:38:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:38:52.373225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303574e4-f357-4bb4-aaf0-d68c6949425f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:52.510078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303574e4-f357-4bb4-aaf0-d68c6949425f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:52.519333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3a8c8-b219-4c43-a07b-0510137dec4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:52.519938 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3a8c8-b219-4c43-a07b-0510137dec4e admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:52.520247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3a8c8-b219-4c43-a07b-0510137dec4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:52.520458 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3a8c8-b219-4c43-a07b-0510137dec4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:52.521158 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca3a8c8-b219-4c43-a07b-0510137dec4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:52.523410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca3a8c8-b219-4c43-a07b-0510137dec4e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:52.584796 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4201/8404] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:38:52 2022] POST /identity/v3/projects => generated 383 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:38:52.585991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd301f-6851-454b-be7f-bf6b398a389c None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:52.612800 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd301f-6851-454b-be7f-bf6b398a389c None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:52.819880 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a8fa8-bd72-4948-8e5e-a544043cb2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:52.820417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a8fa8-bd72-4948-8e5e-a544043cb2c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:52.820700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a8fa8-bd72-4948-8e5e-a544043cb2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:52.820974 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a8fa8-bd72-4948-8e5e-a544043cb2c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:52.821656 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a8fa8-bd72-4948-8e5e-a544043cb2c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:52.835752 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a8fa8-bd72-4948-8e5e-a544043cb2c6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:52.900612 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4204/8405] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:38:52 2022] POST /identity/v3/users => generated 292 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:38:52.902776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3a8c8-b219-4c43-a07b-0510137dec4e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:52.916588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3a8c8-b219-4c43-a07b-0510137dec4e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:52.930301 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21060997-79e6-4cdc-a3ae-1045f265cb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:52.930834 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21060997-79e6-4cdc-a3ae-1045f265cb33 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:52.931138 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21060997-79e6-4cdc-a3ae-1045f265cb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:52.931416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21060997-79e6-4cdc-a3ae-1045f265cb33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:52.932098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21060997-79e6-4cdc-a3ae-1045f265cb33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:52.934442 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21060997-79e6-4cdc-a3ae-1045f265cb33 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:52.987771 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4202/8406] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:38:52.992147 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a8fa8-bd72-4948-8e5e-a544043cb2c6 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:53.014771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a8fa8-bd72-4948-8e5e-a544043cb2c6 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:53.033504 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7538176-b5dd-498b-adfb-f11cac9de472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:53.034135 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7538176-b5dd-498b-adfb-f11cac9de472 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:53.034417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7538176-b5dd-498b-adfb-f11cac9de472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:53.034692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7538176-b5dd-498b-adfb-f11cac9de472 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:53.039585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7538176-b5dd-498b-adfb-f11cac9de472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:53.041233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7538176-b5dd-498b-adfb-f11cac9de472 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:53.055093 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:38:53.082479 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4205/8407] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:38:53.083641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21060997-79e6-4cdc-a3ae-1045f265cb33 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:53.096482 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21060997-79e6-4cdc-a3ae-1045f265cb33 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:53.122065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ba272-b2c3-4c91-8b2f-b392c4b93dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:53.122065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ba272-b2c3-4c91-8b2f-b392c4b93dcf admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:53.122065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ba272-b2c3-4c91-8b2f-b392c4b93dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:53.122466 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ba272-b2c3-4c91-8b2f-b392c4b93dcf admin admin] PATH_INFO: `/v3/projects/5291e2c4358a443c99cc6e1e55a26e61/users/8428e7ff3ddf4bb58154c82ea8b7c2e2/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:53.202895 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ba272-b2c3-4c91-8b2f-b392c4b93dcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5291e2c4358a443c99cc6e1e55a26e61, user_id=8428e7ff3ddf4bb58154c82ea8b7c2e2, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:53.211785 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ba272-b2c3-4c91-8b2f-b392c4b93dcf admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:53.271298 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4203/8408] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:38:53 2022] PUT /identity/v3/projects/5291e2c4358a443c99cc6e1e55a26e61/users/8428e7ff3ddf4bb58154c82ea8b7c2e2/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:38:53.284073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30903ac0-c19f-4a87-8331-6fe7c424ea59 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:53.285108 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30903ac0-c19f-4a87-8331-6fe7c424ea59 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:53.285584 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30903ac0-c19f-4a87-8331-6fe7c424ea59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:53.351457 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-30903ac0-c19f-4a87-8331-6fe7c424ea59 None None] MFA Rules not processed for user `8428e7ff3ddf4bb58154c82ea8b7c2e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:38:53.353665 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-30903ac0-c19f-4a87-8331-6fe7c424ea59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:53.484036 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ba272-b2c3-4c91-8b2f-b392c4b93dcf admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:53.484282 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4206/8409] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:38:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:38:53.621499 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:38:53.662103 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ba272-b2c3-4c91-8b2f-b392c4b93dcf admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:53.671595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e5911-344a-4fb6-a60c-72ecd7c256cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:53.672411 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e5911-344a-4fb6-a60c-72ecd7c256cf admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:53.672695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e5911-344a-4fb6-a60c-72ecd7c256cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:53.676708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e5911-344a-4fb6-a60c-72ecd7c256cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:53.677968 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e5911-344a-4fb6-a60c-72ecd7c256cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:53.680963 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e5911-344a-4fb6-a60c-72ecd7c256cf admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:53.757464 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30903ac0-c19f-4a87-8331-6fe7c424ea59 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:53.773212 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4204/8410] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:38:53 2022] POST /identity/v3/projects => generated 385 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:38:53.795811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30903ac0-c19f-4a87-8331-6fe7c424ea59 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:54.042082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d1d08-928c-485b-8b2f-771a4933b8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:54.047681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d1d08-928c-485b-8b2f-771a4933b8c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:54.050265 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d1d08-928c-485b-8b2f-771a4933b8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:54.050715 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d1d08-928c-485b-8b2f-771a4933b8c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:54.053090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d1d08-928c-485b-8b2f-771a4933b8c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:54.070438 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d1d08-928c-485b-8b2f-771a4933b8c0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:54.140557 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4207/8411] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:38:53 2022] POST /identity/v3/users => generated 299 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:38:54.144669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e5911-344a-4fb6-a60c-72ecd7c256cf admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:54.160856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e5911-344a-4fb6-a60c-72ecd7c256cf admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:54.176079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c8e7f-a007-4b2f-a2db-0aac95b932b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:54.177262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c8e7f-a007-4b2f-a2db-0aac95b932b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:54.177910 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c8e7f-a007-4b2f-a2db-0aac95b932b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:54.178400 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c8e7f-a007-4b2f-a2db-0aac95b932b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:54.180085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c8e7f-a007-4b2f-a2db-0aac95b932b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:54.182096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c8e7f-a007-4b2f-a2db-0aac95b932b2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:54.222775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d1d08-928c-485b-8b2f-771a4933b8c0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:54.231064 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4205/8412] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:38:54.240318 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d1d08-928c-485b-8b2f-771a4933b8c0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:54.249369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf8c50-b736-4d18-9289-bb0eeb3b58b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:54.257667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf8c50-b736-4d18-9289-bb0eeb3b58b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:54.257975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf8c50-b736-4d18-9289-bb0eeb3b58b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:54.258428 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf8c50-b736-4d18-9289-bb0eeb3b58b7 admin admin] PATH_INFO: `/v3/projects/20353d3dcaf34835b27416d81dec259f/users/82ac663de3974df7b8d023c6c2e1b07c/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:54.295399 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf8c50-b736-4d18-9289-bb0eeb3b58b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20353d3dcaf34835b27416d81dec259f, user_id=82ac663de3974df7b8d023c6c2e1b07c, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:54.298261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf8c50-b736-4d18-9289-bb0eeb3b58b7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:54.339105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c8e7f-a007-4b2f-a2db-0aac95b932b2 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:54.340180 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4208/8413] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:38:54 2022] PUT /identity/v3/projects/20353d3dcaf34835b27416d81dec259f/users/82ac663de3974df7b8d023c6c2e1b07c/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:38:54.357412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c8e7f-a007-4b2f-a2db-0aac95b932b2 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:54.462406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b119d6b-2ec2-4e02-acda-f61e54d3a29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:54.463509 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b119d6b-2ec2-4e02-acda-f61e54d3a29d admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:54.464472 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b119d6b-2ec2-4e02-acda-f61e54d3a29d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:54.464892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b119d6b-2ec2-4e02-acda-f61e54d3a29d admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:54.465730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b119d6b-2ec2-4e02-acda-f61e54d3a29d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:54.468397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b119d6b-2ec2-4e02-acda-f61e54d3a29d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:54.506094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf8c50-b736-4d18-9289-bb0eeb3b58b7 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:54.514148 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4206/8414] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:38:54.519320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf8c50-b736-4d18-9289-bb0eeb3b58b7 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:54.533309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48dc88-9ef1-4471-a823-5fc98974e83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:54.534579 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48dc88-9ef1-4471-a823-5fc98974e83b admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:54.535031 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48dc88-9ef1-4471-a823-5fc98974e83b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:54.535514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48dc88-9ef1-4471-a823-5fc98974e83b admin admin] PATH_INFO: `/v3/projects/20353d3dcaf34835b27416d81dec259f/users/82ac663de3974df7b8d023c6c2e1b07c/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:54.537890 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a48dc88-9ef1-4471-a823-5fc98974e83b admin admin] RBAC: Authorizing `identity:create_grant(project_id=20353d3dcaf34835b27416d81dec259f, user_id=82ac663de3974df7b8d023c6c2e1b07c, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:54.541608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a48dc88-9ef1-4471-a823-5fc98974e83b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:54.566785 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4209/8415] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:38:54 2022] PUT /identity/v3/projects/20353d3dcaf34835b27416d81dec259f/users/82ac663de3974df7b8d023c6c2e1b07c/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:38:54.567233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb89b62-fac5-43ed-9ec5-0706cab407e8 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:54.567429 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb89b62-fac5-43ed-9ec5-0706cab407e8 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:54.567711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb89b62-fac5-43ed-9ec5-0706cab407e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:54.646900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-cbb89b62-fac5-43ed-9ec5-0706cab407e8 None None] MFA Rules not processed for user `82ac663de3974df7b8d023c6c2e1b07c`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:38:54.648154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-cbb89b62-fac5-43ed-9ec5-0706cab407e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:54.790919 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4207/8416] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:38:54 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:38:54.810085 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48dc88-9ef1-4471-a823-5fc98974e83b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:54.813023 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1a48dc88-9ef1-4471-a823-5fc98974e83b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:54.938877 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:38:54.969491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48dc88-9ef1-4471-a823-5fc98974e83b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:54.974312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79313c-0fcc-4c62-b463-04755152cd00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:54.975145 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79313c-0fcc-4c62-b463-04755152cd00 service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:54.975576 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79313c-0fcc-4c62-b463-04755152cd00 service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:54.976613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79313c-0fcc-4c62-b463-04755152cd00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:55.071073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79313c-0fcc-4c62-b463-04755152cd00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:55.072511 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79313c-0fcc-4c62-b463-04755152cd00 service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:55.085344 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4210/8417] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:38:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:38:57.386097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb89b62-fac5-43ed-9ec5-0706cab407e8 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:57.389412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-cbb89b62-fac5-43ed-9ec5-0706cab407e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:57.579383 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:38:57.630238 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb89b62-fac5-43ed-9ec5-0706cab407e8 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:57.638193 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b6c8e-a46d-4122-a12e-cfcec8924262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:57.639096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b6c8e-a46d-4122-a12e-cfcec8924262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:57.639524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b6c8e-a46d-4122-a12e-cfcec8924262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:57.639974 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b6c8e-a46d-4122-a12e-cfcec8924262 admin admin] PATH_INFO: `/v3/users/ece1d6709f6d480fbaffa3b47f293dcb` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:57.643897 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b6c8e-a46d-4122-a12e-cfcec8924262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ece1d6709f6d480fbaffa3b47f293dcb)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:57.647362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b6c8e-a46d-4122-a12e-cfcec8924262 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:57.816062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c32b6c8e-a46d-4122-a12e-cfcec8924262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ece1d6709f6d480fbaffa3b47f293dcb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:57.816778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c32b6c8e-a46d-4122-a12e-cfcec8924262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ece1d6709f6d480fbaffa3b47f293dcb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:57.834683 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c32b6c8e-a46d-4122-a12e-cfcec8924262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ece1d6709f6d480fbaffa3b47f293dcb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:57.859158 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c32b6c8e-a46d-4122-a12e-cfcec8924262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ece1d6709f6d480fbaffa3b47f293dcb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:57.859805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c32b6c8e-a46d-4122-a12e-cfcec8924262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ece1d6709f6d480fbaffa3b47f293dcb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:57.931189 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4208/8418] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:38:57 2022] DELETE /identity/v3/users/ece1d6709f6d480fbaffa3b47f293dcb => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:38:57.932545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562fc58-76d3-4581-94f9-77d5d6ff0243 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:57.933344 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562fc58-76d3-4581-94f9-77d5d6ff0243 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:57.933815 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562fc58-76d3-4581-94f9-77d5d6ff0243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:58.013803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-f562fc58-76d3-4581-94f9-77d5d6ff0243 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:38:58.018082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f562fc58-76d3-4581-94f9-77d5d6ff0243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:58.203353 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4211/8419] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:38:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:38:58.213828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b6c8e-a46d-4122-a12e-cfcec8924262 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:58.215321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c32b6c8e-a46d-4122-a12e-cfcec8924262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:58.346545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b6c8e-a46d-4122-a12e-cfcec8924262 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:58.361101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4adf96-333b-4492-b49f-499b52b788a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:58.363932 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4adf96-333b-4492-b49f-499b52b788a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:58.366031 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4adf96-333b-4492-b49f-499b52b788a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:58.366773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4adf96-333b-4492-b49f-499b52b788a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:58.397784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4adf96-333b-4492-b49f-499b52b788a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:58.408285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4adf96-333b-4492-b49f-499b52b788a0 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:58.451268 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4209/8420] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:38:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:38:58.795989 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562fc58-76d3-4581-94f9-77d5d6ff0243 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:58.800283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f562fc58-76d3-4581-94f9-77d5d6ff0243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:58.832648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562fc58-76d3-4581-94f9-77d5d6ff0243 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:58.844761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc60a9-fd9b-4230-af5e-ab0eb8b22ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:58.846192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc60a9-fd9b-4230-af5e-ab0eb8b22ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:58.847053 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc60a9-fd9b-4230-af5e-ab0eb8b22ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:58.847769 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc60a9-fd9b-4230-af5e-ab0eb8b22ffd admin admin] PATH_INFO: `/v3/projects/5f680bdbe357495d8f22cd14d454d17c` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:58.849628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc60a9-fd9b-4230-af5e-ab0eb8b22ffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f680bdbe357495d8f22cd14d454d17c)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:58.852036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc60a9-fd9b-4230-af5e-ab0eb8b22ffd admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:58.967961 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dcbc60a9-fd9b-4230-af5e-ab0eb8b22ffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f680bdbe357495d8f22cd14d454d17c', 'request_id': 'req-dcbc60a9-fd9b-4230-af5e-ab0eb8b22ffd'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:58.978882 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dcbc60a9-fd9b-4230-af5e-ab0eb8b22ffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f680bdbe357495d8f22cd14d454d17c', 'request_id': 'req-dcbc60a9-fd9b-4230-af5e-ab0eb8b22ffd'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:59.021544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dcbc60a9-fd9b-4230-af5e-ab0eb8b22ffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f680bdbe357495d8f22cd14d454d17c', 'request_id': 'req-dcbc60a9-fd9b-4230-af5e-ab0eb8b22ffd'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:59.113401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dcbc60a9-fd9b-4230-af5e-ab0eb8b22ffd admin admin] The token cache is being invalidate because project 5f680bdbe357495d8f22cd14d454d17c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:38:59.117196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dcbc60a9-fd9b-4230-af5e-ab0eb8b22ffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:59.118920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dcbc60a9-fd9b-4230-af5e-ab0eb8b22ffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:59.122277 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4212/8421] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:38:58 2022] DELETE /identity/v3/projects/5f680bdbe357495d8f22cd14d454d17c => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:38:59.126063 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4adf96-333b-4492-b49f-499b52b788a0 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:59.145343 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4adf96-333b-4492-b49f-499b52b788a0 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:59.319413 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a8334-ea77-4fd8-b03b-e4c9f859dac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:59.320692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a8334-ea77-4fd8-b03b-e4c9f859dac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:59.321180 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a8334-ea77-4fd8-b03b-e4c9f859dac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:59.321693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a8334-ea77-4fd8-b03b-e4c9f859dac8 admin admin] PATH_INFO: `/v3/users/a064da3c57b44f54ba4e070ba77e0afe` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:59.326097 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:38:59.356996 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a8334-ea77-4fd8-b03b-e4c9f859dac8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a064da3c57b44f54ba4e070ba77e0afe)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:38:59.376289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a8334-ea77-4fd8-b03b-e4c9f859dac8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:38:59.538514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d90a8334-ea77-4fd8-b03b-e4c9f859dac8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a064da3c57b44f54ba4e070ba77e0afe'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:59.540508 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d90a8334-ea77-4fd8-b03b-e4c9f859dac8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a064da3c57b44f54ba4e070ba77e0afe'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:59.559352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d90a8334-ea77-4fd8-b03b-e4c9f859dac8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a064da3c57b44f54ba4e070ba77e0afe'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:59.584602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d90a8334-ea77-4fd8-b03b-e4c9f859dac8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a064da3c57b44f54ba4e070ba77e0afe'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:59.585849 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d90a8334-ea77-4fd8-b03b-e4c9f859dac8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a064da3c57b44f54ba4e070ba77e0afe'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:38:59.591741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc60a9-fd9b-4230-af5e-ab0eb8b22ffd admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:38:59.594844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-dcbc60a9-fd9b-4230-af5e-ab0eb8b22ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:38:59.611987 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:38:59.624331 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4210/8422] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:38:59 2022] DELETE /identity/v3/users/a064da3c57b44f54ba4e070ba77e0afe => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:38:59.754652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc60a9-fd9b-4230-af5e-ab0eb8b22ffd admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:38:59.870905 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddceffc3-7cd5-4db0-8e5a-1cb4db27229b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:38:59.871560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddceffc3-7cd5-4db0-8e5a-1cb4db27229b service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:38:59.871842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddceffc3-7cd5-4db0-8e5a-1cb4db27229b service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:38:59.872113 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddceffc3-7cd5-4db0-8e5a-1cb4db27229b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:38:59.877168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ddceffc3-7cd5-4db0-8e5a-1cb4db27229b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:00.002753 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a8334-ea77-4fd8-b03b-e4c9f859dac8 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:00.004249 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d90a8334-ea77-4fd8-b03b-e4c9f859dac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:00.076414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddceffc3-7cd5-4db0-8e5a-1cb4db27229b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:00.077922 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddceffc3-7cd5-4db0-8e5a-1cb4db27229b service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:00.109712 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4213/8423] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:38:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:39:00.166374 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a8334-ea77-4fd8-b03b-e4c9f859dac8 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:00.179389 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2a108-d644-4f10-96cc-dee1b445e8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:00.180888 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2a108-d644-4f10-96cc-dee1b445e8e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:00.181339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2a108-d644-4f10-96cc-dee1b445e8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:00.182149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2a108-d644-4f10-96cc-dee1b445e8e2 admin admin] PATH_INFO: `/v3/projects/f877a330dfc74574a8fc989032408cdf` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:00.199304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2a108-d644-4f10-96cc-dee1b445e8e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f877a330dfc74574a8fc989032408cdf)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:00.202994 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2a108-d644-4f10-96cc-dee1b445e8e2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:00.326841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-74a2a108-d644-4f10-96cc-dee1b445e8e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f877a330dfc74574a8fc989032408cdf', 'request_id': 'req-74a2a108-d644-4f10-96cc-dee1b445e8e2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:00.348458 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-74a2a108-d644-4f10-96cc-dee1b445e8e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f877a330dfc74574a8fc989032408cdf', 'request_id': 'req-74a2a108-d644-4f10-96cc-dee1b445e8e2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:00.355100 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:00.358954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-74a2a108-d644-4f10-96cc-dee1b445e8e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f877a330dfc74574a8fc989032408cdf', 'request_id': 'req-74a2a108-d644-4f10-96cc-dee1b445e8e2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:00.398237 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-74a2a108-d644-4f10-96cc-dee1b445e8e2 admin admin] The token cache is being invalidate because project f877a330dfc74574a8fc989032408cdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:39:00.398503 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-74a2a108-d644-4f10-96cc-dee1b445e8e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:00.399426 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-74a2a108-d644-4f10-96cc-dee1b445e8e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:00.410619 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4211/8424] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:39:00 2022] DELETE /identity/v3/projects/f877a330dfc74574a8fc989032408cdf => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:39:00.417479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10072cf9-38f2-40ee-bf22-7f6edd8e6798 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:00.417877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10072cf9-38f2-40ee-bf22-7f6edd8e6798 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:00.418140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10072cf9-38f2-40ee-bf22-7f6edd8e6798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:00.492691 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-10072cf9-38f2-40ee-bf22-7f6edd8e6798 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:00.494356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-10072cf9-38f2-40ee-bf22-7f6edd8e6798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:00.594400 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4214/8425] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:39:00.603500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca3220-3916-48a2-a3ec-253260ead26c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:00.604767 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca3220-3916-48a2-a3ec-253260ead26c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:00.604874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca3220-3916-48a2-a3ec-253260ead26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:00.640952 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-bdca3220-3916-48a2-a3ec-253260ead26c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:00.642797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-bdca3220-3916-48a2-a3ec-253260ead26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:00.659420 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4212/8426] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:39:00.660639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10072cf9-38f2-40ee-bf22-7f6edd8e6798 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:00.683932 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10072cf9-38f2-40ee-bf22-7f6edd8e6798 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:00.706383 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660e9a9-30d3-411b-9393-a3dec8dcebf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:00.707039 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660e9a9-30d3-411b-9393-a3dec8dcebf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:00.707324 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660e9a9-30d3-411b-9393-a3dec8dcebf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:00.708807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660e9a9-30d3-411b-9393-a3dec8dcebf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:00.709515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9660e9a9-30d3-411b-9393-a3dec8dcebf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:39:00.709830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9660e9a9-30d3-411b-9393-a3dec8dcebf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:00.711505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9660e9a9-30d3-411b-9393-a3dec8dcebf5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:00.741825 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:00.766739 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4215/8427] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:39:00.771407 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca3220-3916-48a2-a3ec-253260ead26c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:00.787390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca3220-3916-48a2-a3ec-253260ead26c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:00.804530 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845f432-3513-476f-a26b-8304acf5a4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:00.805183 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845f432-3513-476f-a26b-8304acf5a4aa admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:00.805484 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845f432-3513-476f-a26b-8304acf5a4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:00.805759 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845f432-3513-476f-a26b-8304acf5a4aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:00.806437 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845f432-3513-476f-a26b-8304acf5a4aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:00.808948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845f432-3513-476f-a26b-8304acf5a4aa admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:00.900195 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4213/8428] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:39:00 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:39:00.916233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660e9a9-30d3-411b-9393-a3dec8dcebf5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:00.931862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660e9a9-30d3-411b-9393-a3dec8dcebf5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:01.102296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb202f72-a94c-42ae-b6d9-5b14f5929bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:01.102914 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb202f72-a94c-42ae-b6d9-5b14f5929bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:01.103164 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb202f72-a94c-42ae-b6d9-5b14f5929bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:01.103422 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb202f72-a94c-42ae-b6d9-5b14f5929bd6 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:01.104795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb202f72-a94c-42ae-b6d9-5b14f5929bd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:01.107680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb202f72-a94c-42ae-b6d9-5b14f5929bd6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:01.140097 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4216/8429] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:39:00 2022] POST /identity/v3/users => generated 292 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:39:01.141374 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845f432-3513-476f-a26b-8304acf5a4aa admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:01.154357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845f432-3513-476f-a26b-8304acf5a4aa admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:01.170918 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a4938-8f99-4a65-9ac9-29d6f1eb35de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:01.172016 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a4938-8f99-4a65-9ac9-29d6f1eb35de admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:01.172016 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a4938-8f99-4a65-9ac9-29d6f1eb35de admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:01.172311 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a4938-8f99-4a65-9ac9-29d6f1eb35de admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:01.173217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a4938-8f99-4a65-9ac9-29d6f1eb35de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:01.174853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a4938-8f99-4a65-9ac9-29d6f1eb35de admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:01.203255 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4214/8430] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:39:01.207261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb202f72-a94c-42ae-b6d9-5b14f5929bd6 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:01.220771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb202f72-a94c-42ae-b6d9-5b14f5929bd6 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:01.251329 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0a32c-9e2e-435a-bb71-026f83110c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:01.255605 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0a32c-9e2e-435a-bb71-026f83110c07 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:01.255898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0a32c-9e2e-435a-bb71-026f83110c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:01.256192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0a32c-9e2e-435a-bb71-026f83110c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:01.256956 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe0a32c-9e2e-435a-bb71-026f83110c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:01.258459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe0a32c-9e2e-435a-bb71-026f83110c07 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:01.276944 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4217/8431] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:39:01.283919 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a4938-8f99-4a65-9ac9-29d6f1eb35de admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:01.296344 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0a32c-9e2e-435a-bb71-026f83110c07 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:01.302492 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bfe0a32c-9e2e-435a-bb71-026f83110c07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:01.304332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a4938-8f99-4a65-9ac9-29d6f1eb35de admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:01.315614 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11f9b3-d6f0-4aed-a9d2-61ad3add5bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:01.316288 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11f9b3-d6f0-4aed-a9d2-61ad3add5bc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:01.316636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11f9b3-d6f0-4aed-a9d2-61ad3add5bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:01.316915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11f9b3-d6f0-4aed-a9d2-61ad3add5bc4 admin admin] PATH_INFO: `/v3/projects/1c0db481d05a42dc92a590006af6e759/users/85eb224d8c1e420685eacc747b4f240d/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:01.366544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11f9b3-d6f0-4aed-a9d2-61ad3add5bc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c0db481d05a42dc92a590006af6e759, user_id=85eb224d8c1e420685eacc747b4f240d, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:01.370928 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11f9b3-d6f0-4aed-a9d2-61ad3add5bc4 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:01.409496 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4215/8432] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:39:01 2022] PUT /identity/v3/projects/1c0db481d05a42dc92a590006af6e759/users/85eb224d8c1e420685eacc747b4f240d/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:39:01.416406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edded2-5f65-46da-ba9a-03932dfb0b8c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:01.417384 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edded2-5f65-46da-ba9a-03932dfb0b8c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:01.417975 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edded2-5f65-46da-ba9a-03932dfb0b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:01.493168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0a32c-9e2e-435a-bb71-026f83110c07 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:01.496381 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-82edded2-5f65-46da-ba9a-03932dfb0b8c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:01.501994 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-82edded2-5f65-46da-ba9a-03932dfb0b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:01.625301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949877e-62c3-4357-907d-d2d34c32a7b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:01.625948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949877e-62c3-4357-907d-d2d34c32a7b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:01.626230 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949877e-62c3-4357-907d-d2d34c32a7b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:01.626500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949877e-62c3-4357-907d-d2d34c32a7b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:01.631051 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9949877e-62c3-4357-907d-d2d34c32a7b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:01.671604 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4216/8433] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:39:01.677255 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82edded2-5f65-46da-ba9a-03932dfb0b8c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:01.679782 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-82edded2-5f65-46da-ba9a-03932dfb0b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:01.733498 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:01.771151 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949877e-62c3-4357-907d-d2d34c32a7b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:01.772933 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949877e-62c3-4357-907d-d2d34c32a7b2 service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:01.794629 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4218/8434] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:39:01 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:39:01.826153 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82edded2-5f65-46da-ba9a-03932dfb0b8c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:01.837826 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d04f1c-bc11-4340-b0be-9e855b0c2007 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:01.838927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d04f1c-bc11-4340-b0be-9e855b0c2007 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:01.839358 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d04f1c-bc11-4340-b0be-9e855b0c2007 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:01.839788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d04f1c-bc11-4340-b0be-9e855b0c2007 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:01.860770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d04f1c-bc11-4340-b0be-9e855b0c2007 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:01.862803 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d04f1c-bc11-4340-b0be-9e855b0c2007 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:01.891204 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4217/8435] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:39:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:39:10.850475 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7f8a0-df59-4440-9c85-11b241a61e0e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:10.851041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7f8a0-df59-4440-9c85-11b241a61e0e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:10.851041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7f8a0-df59-4440-9c85-11b241a61e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:10.908428 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-61e7f8a0-df59-4440-9c85-11b241a61e0e None None] MFA Rules not processed for user `85eb224d8c1e420685eacc747b4f240d`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:10.910103 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-61e7f8a0-df59-4440-9c85-11b241a61e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:11.067483 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4219/8436] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:39:11.068511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d04f1c-bc11-4340-b0be-9e855b0c2007 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:11.085601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d04f1c-bc11-4340-b0be-9e855b0c2007 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:11.100395 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13863b-1c50-4738-a16f-e507d9192504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:11.101026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13863b-1c50-4738-a16f-e507d9192504 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:11.101303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13863b-1c50-4738-a16f-e507d9192504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:11.101611 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13863b-1c50-4738-a16f-e507d9192504 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:11.102393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a13863b-1c50-4738-a16f-e507d9192504 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:11.105167 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a13863b-1c50-4738-a16f-e507d9192504 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:11.153131 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:11.177899 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4218/8437] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:39:11 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:39:11.182305 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7f8a0-df59-4440-9c85-11b241a61e0e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:11.200845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7f8a0-df59-4440-9c85-11b241a61e0e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:11.340416 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edeba91-bd32-4647-b6d9-34cb79d60cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:11.346731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edeba91-bd32-4647-b6d9-34cb79d60cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:11.348624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edeba91-bd32-4647-b6d9-34cb79d60cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:11.349167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edeba91-bd32-4647-b6d9-34cb79d60cf3 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:11.350892 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edeba91-bd32-4647-b6d9-34cb79d60cf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:11.357410 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edeba91-bd32-4647-b6d9-34cb79d60cf3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:11.414165 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4220/8438] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:39:11 2022] POST /identity/v3/users => generated 298 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:39:11.419894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13863b-1c50-4738-a16f-e507d9192504 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:11.480724 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13863b-1c50-4738-a16f-e507d9192504 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:11.488175 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f340d54-57ce-4000-8f97-e68b34ac60b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:11.488816 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f340d54-57ce-4000-8f97-e68b34ac60b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:11.489278 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f340d54-57ce-4000-8f97-e68b34ac60b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:11.489589 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f340d54-57ce-4000-8f97-e68b34ac60b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:11.490256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f340d54-57ce-4000-8f97-e68b34ac60b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:11.492013 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f340d54-57ce-4000-8f97-e68b34ac60b1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:11.546805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edeba91-bd32-4647-b6d9-34cb79d60cf3 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:11.549806 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4219/8439] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:39:11.562584 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edeba91-bd32-4647-b6d9-34cb79d60cf3 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:11.569569 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e7381-8ed3-4b54-8336-a224dea4a546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:11.570708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e7381-8ed3-4b54-8336-a224dea4a546 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:11.571142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e7381-8ed3-4b54-8336-a224dea4a546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:11.571561 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e7381-8ed3-4b54-8336-a224dea4a546 admin admin] PATH_INFO: `/v3/projects/b45095a91a994ef79c60acd8e475d7a5/users/530be482a72c4746b5b449cb1be6cdff/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:11.603343 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e7381-8ed3-4b54-8336-a224dea4a546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b45095a91a994ef79c60acd8e475d7a5, user_id=530be482a72c4746b5b449cb1be6cdff, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:11.607240 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e7381-8ed3-4b54-8336-a224dea4a546 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:11.635050 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4221/8440] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:39:11 2022] PUT /identity/v3/projects/b45095a91a994ef79c60acd8e475d7a5/users/530be482a72c4746b5b449cb1be6cdff/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:39:11.638852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f340d54-57ce-4000-8f97-e68b34ac60b1 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:11.664225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f340d54-57ce-4000-8f97-e68b34ac60b1 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:11.788262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53b66d-2be8-4f8d-a988-d39b09ea2dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:11.788896 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53b66d-2be8-4f8d-a988-d39b09ea2dbe admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:11.789178 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53b66d-2be8-4f8d-a988-d39b09ea2dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:11.789517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53b66d-2be8-4f8d-a988-d39b09ea2dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:11.790169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53b66d-2be8-4f8d-a988-d39b09ea2dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:11.792531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53b66d-2be8-4f8d-a988-d39b09ea2dbe admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:11.828274 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e7381-8ed3-4b54-8336-a224dea4a546 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:11.828521 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4220/8441] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:39:11.842885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e7381-8ed3-4b54-8336-a224dea4a546 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:11.858594 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50391b-71f0-4165-92fd-bfaf22781785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:11.873305 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50391b-71f0-4165-92fd-bfaf22781785 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:11.873700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50391b-71f0-4165-92fd-bfaf22781785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:11.873980 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50391b-71f0-4165-92fd-bfaf22781785 admin admin] PATH_INFO: `/v3/projects/b45095a91a994ef79c60acd8e475d7a5/users/530be482a72c4746b5b449cb1be6cdff/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:11.876142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50391b-71f0-4165-92fd-bfaf22781785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b45095a91a994ef79c60acd8e475d7a5, user_id=530be482a72c4746b5b449cb1be6cdff, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:11.878872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50391b-71f0-4165-92fd-bfaf22781785 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:11.921376 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4222/8442] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:39:11 2022] PUT /identity/v3/projects/b45095a91a994ef79c60acd8e475d7a5/users/530be482a72c4746b5b449cb1be6cdff/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:39:12.342075 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d0c74-4686-4444-99d1-997adbd8e7d4 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:12.343661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d0c74-4686-4444-99d1-997adbd8e7d4 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:12.344233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d0c74-4686-4444-99d1-997adbd8e7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:12.393251 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-3a1d0c74-4686-4444-99d1-997adbd8e7d4 None None] MFA Rules not processed for user `f39dd2d709374c729d51f7e2cf18300c`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:12.396057 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3a1d0c74-4686-4444-99d1-997adbd8e7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:12.562871 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4221/8443] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:39:15.000166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50391b-71f0-4165-92fd-bfaf22781785 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:15.002040 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ed50391b-71f0-4165-92fd-bfaf22781785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:15.075957 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:15.235375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50391b-71f0-4165-92fd-bfaf22781785 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:15.242446 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f26103-ae62-49bb-9cee-f3b642745b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:15.243519 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f26103-ae62-49bb-9cee-f3b642745b26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:15.244527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f26103-ae62-49bb-9cee-f3b642745b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:15.245034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f26103-ae62-49bb-9cee-f3b642745b26 admin admin] PATH_INFO: `/v3/users/49bd2c54e1404c54b3fb99c51e0038f8` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:15.246626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f26103-ae62-49bb-9cee-f3b642745b26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49bd2c54e1404c54b3fb99c51e0038f8)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:15.249369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f26103-ae62-49bb-9cee-f3b642745b26 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:15.348354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-57f26103-ae62-49bb-9cee-f3b642745b26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49bd2c54e1404c54b3fb99c51e0038f8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:15.350565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-57f26103-ae62-49bb-9cee-f3b642745b26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49bd2c54e1404c54b3fb99c51e0038f8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:15.370650 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-57f26103-ae62-49bb-9cee-f3b642745b26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49bd2c54e1404c54b3fb99c51e0038f8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:15.387913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-57f26103-ae62-49bb-9cee-f3b642745b26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49bd2c54e1404c54b3fb99c51e0038f8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:15.389105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-57f26103-ae62-49bb-9cee-f3b642745b26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49bd2c54e1404c54b3fb99c51e0038f8'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:15.434080 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4223/8444] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:39:14 2022] DELETE /identity/v3/users/49bd2c54e1404c54b3fb99c51e0038f8 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:39:15.440011 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a55b0-45da-43ff-9f58-0832066cbe50 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:15.440521 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a55b0-45da-43ff-9f58-0832066cbe50 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:15.440733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a55b0-45da-43ff-9f58-0832066cbe50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:15.505495 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-1f3a55b0-45da-43ff-9f58-0832066cbe50 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:15.507911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1f3a55b0-45da-43ff-9f58-0832066cbe50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:15.741885 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4222/8445] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:39:15.753254 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f26103-ae62-49bb-9cee-f3b642745b26 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:15.756496 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-57f26103-ae62-49bb-9cee-f3b642745b26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:15.891695 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f26103-ae62-49bb-9cee-f3b642745b26 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:15.905220 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06c008-b304-4f7a-9284-f2087b49bc30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:15.906341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06c008-b304-4f7a-9284-f2087b49bc30 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:15.908912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06c008-b304-4f7a-9284-f2087b49bc30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:15.910743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06c008-b304-4f7a-9284-f2087b49bc30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:15.943394 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06c008-b304-4f7a-9284-f2087b49bc30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:15.947931 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06c008-b304-4f7a-9284-f2087b49bc30 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:15.970372 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4224/8446] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:39:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:39:16.706562 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a55b0-45da-43ff-9f58-0832066cbe50 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:16.708669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1f3a55b0-45da-43ff-9f58-0832066cbe50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:16.744865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a55b0-45da-43ff-9f58-0832066cbe50 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:16.757511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb14234-3af8-4bf8-85dc-4f57819144fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:16.758530 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb14234-3af8-4bf8-85dc-4f57819144fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:16.759176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb14234-3af8-4bf8-85dc-4f57819144fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:16.760240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb14234-3af8-4bf8-85dc-4f57819144fd admin admin] PATH_INFO: `/v3/projects/362f0513be124389abf7102a306dcfb9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:16.761946 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb14234-3af8-4bf8-85dc-4f57819144fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=362f0513be124389abf7102a306dcfb9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:16.765249 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb14234-3af8-4bf8-85dc-4f57819144fd admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:16.846549 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:16.916322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9cb14234-3af8-4bf8-85dc-4f57819144fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '362f0513be124389abf7102a306dcfb9', 'request_id': 'req-9cb14234-3af8-4bf8-85dc-4f57819144fd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:16.930299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9cb14234-3af8-4bf8-85dc-4f57819144fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '362f0513be124389abf7102a306dcfb9', 'request_id': 'req-9cb14234-3af8-4bf8-85dc-4f57819144fd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:16.940939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9cb14234-3af8-4bf8-85dc-4f57819144fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '362f0513be124389abf7102a306dcfb9', 'request_id': 'req-9cb14234-3af8-4bf8-85dc-4f57819144fd'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:16.977094 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9cb14234-3af8-4bf8-85dc-4f57819144fd admin admin] The token cache is being invalidate because project 362f0513be124389abf7102a306dcfb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:39:16.977483 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9cb14234-3af8-4bf8-85dc-4f57819144fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:16.978517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9cb14234-3af8-4bf8-85dc-4f57819144fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:16.981489 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4223/8447] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:39:16 2022] DELETE /identity/v3/projects/362f0513be124389abf7102a306dcfb9 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:39:16.985914 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06c008-b304-4f7a-9284-f2087b49bc30 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:17.000648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06c008-b304-4f7a-9284-f2087b49bc30 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:17.132968 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:17.219741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13c5a8-3821-4630-9e80-63e94e31964b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:17.220544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13c5a8-3821-4630-9e80-63e94e31964b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:17.220969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13c5a8-3821-4630-9e80-63e94e31964b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:17.221349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13c5a8-3821-4630-9e80-63e94e31964b admin admin] PATH_INFO: `/v3/users/8428e7ff3ddf4bb58154c82ea8b7c2e2` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:17.223955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a13c5a8-3821-4630-9e80-63e94e31964b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8428e7ff3ddf4bb58154c82ea8b7c2e2)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:17.237653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a13c5a8-3821-4630-9e80-63e94e31964b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:17.341097 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5a13c5a8-3821-4630-9e80-63e94e31964b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8428e7ff3ddf4bb58154c82ea8b7c2e2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:17.342548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5a13c5a8-3821-4630-9e80-63e94e31964b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8428e7ff3ddf4bb58154c82ea8b7c2e2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:17.362244 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5a13c5a8-3821-4630-9e80-63e94e31964b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8428e7ff3ddf4bb58154c82ea8b7c2e2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:17.391812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5a13c5a8-3821-4630-9e80-63e94e31964b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8428e7ff3ddf4bb58154c82ea8b7c2e2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:17.393414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5a13c5a8-3821-4630-9e80-63e94e31964b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8428e7ff3ddf4bb58154c82ea8b7c2e2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:17.443181 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4225/8448] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:39:16 2022] DELETE /identity/v3/users/8428e7ff3ddf4bb58154c82ea8b7c2e2 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:39:18.828505 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb14234-3af8-4bf8-85dc-4f57819144fd admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:18.830263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9cb14234-3af8-4bf8-85dc-4f57819144fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:18.855921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb14234-3af8-4bf8-85dc-4f57819144fd admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:19.005408 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d7e7a-6a72-41d0-8e5b-4dfa411b764c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:19.006791 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d7e7a-6a72-41d0-8e5b-4dfa411b764c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:19.007233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d7e7a-6a72-41d0-8e5b-4dfa411b764c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:19.007698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d7e7a-6a72-41d0-8e5b-4dfa411b764c admin admin] PATH_INFO: `/v3/projects/5291e2c4358a443c99cc6e1e55a26e61` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:19.009045 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d7e7a-6a72-41d0-8e5b-4dfa411b764c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5291e2c4358a443c99cc6e1e55a26e61)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:19.011779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d7e7a-6a72-41d0-8e5b-4dfa411b764c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:19.110842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-db3d7e7a-6a72-41d0-8e5b-4dfa411b764c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5291e2c4358a443c99cc6e1e55a26e61', 'request_id': 'req-db3d7e7a-6a72-41d0-8e5b-4dfa411b764c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:19.122035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-db3d7e7a-6a72-41d0-8e5b-4dfa411b764c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5291e2c4358a443c99cc6e1e55a26e61', 'request_id': 'req-db3d7e7a-6a72-41d0-8e5b-4dfa411b764c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:19.139826 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-db3d7e7a-6a72-41d0-8e5b-4dfa411b764c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5291e2c4358a443c99cc6e1e55a26e61', 'request_id': 'req-db3d7e7a-6a72-41d0-8e5b-4dfa411b764c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:19.166890 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-db3d7e7a-6a72-41d0-8e5b-4dfa411b764c admin admin] The token cache is being invalidate because project 5291e2c4358a443c99cc6e1e55a26e61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:39:19.167192 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-db3d7e7a-6a72-41d0-8e5b-4dfa411b764c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:19.168593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-db3d7e7a-6a72-41d0-8e5b-4dfa411b764c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:19.176067 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4224/8449] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:39:18 2022] DELETE /identity/v3/projects/5291e2c4358a443c99cc6e1e55a26e61 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:39:19.177560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13c5a8-3821-4630-9e80-63e94e31964b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:19.179425 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5a13c5a8-3821-4630-9e80-63e94e31964b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:19.203124 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13c5a8-3821-4630-9e80-63e94e31964b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:19.362966 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10231d7-0d69-457b-b3a8-c3ea15de24bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:19.367005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10231d7-0d69-457b-b3a8-c3ea15de24bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:19.368327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10231d7-0d69-457b-b3a8-c3ea15de24bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:19.369551 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10231d7-0d69-457b-b3a8-c3ea15de24bb admin admin] PATH_INFO: `/v3/users/82ac663de3974df7b8d023c6c2e1b07c` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:19.375780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10231d7-0d69-457b-b3a8-c3ea15de24bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=82ac663de3974df7b8d023c6c2e1b07c)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:19.386271 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10231d7-0d69-457b-b3a8-c3ea15de24bb admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:19.529568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f10231d7-0d69-457b-b3a8-c3ea15de24bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82ac663de3974df7b8d023c6c2e1b07c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:19.538643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f10231d7-0d69-457b-b3a8-c3ea15de24bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82ac663de3974df7b8d023c6c2e1b07c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:19.566163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f10231d7-0d69-457b-b3a8-c3ea15de24bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82ac663de3974df7b8d023c6c2e1b07c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:19.596475 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f10231d7-0d69-457b-b3a8-c3ea15de24bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82ac663de3974df7b8d023c6c2e1b07c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:19.597137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f10231d7-0d69-457b-b3a8-c3ea15de24bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82ac663de3974df7b8d023c6c2e1b07c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:19.602420 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:19.648081 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4226/8450] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:39:19 2022] DELETE /identity/v3/users/82ac663de3974df7b8d023c6c2e1b07c => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:39:21.042799 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d7e7a-6a72-41d0-8e5b-4dfa411b764c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:21.044890 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-db3d7e7a-6a72-41d0-8e5b-4dfa411b764c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:21.075830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d7e7a-6a72-41d0-8e5b-4dfa411b764c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:21.161484 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:21.214376 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3012b7-060d-475b-b35f-3cfa1ab4ed88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:21.215804 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3012b7-060d-475b-b35f-3cfa1ab4ed88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:21.216290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3012b7-060d-475b-b35f-3cfa1ab4ed88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:21.216721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3012b7-060d-475b-b35f-3cfa1ab4ed88 admin admin] PATH_INFO: `/v3/projects/20353d3dcaf34835b27416d81dec259f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:21.218924 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3012b7-060d-475b-b35f-3cfa1ab4ed88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20353d3dcaf34835b27416d81dec259f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:21.233277 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3012b7-060d-475b-b35f-3cfa1ab4ed88 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:21.324033 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0d3012b7-060d-475b-b35f-3cfa1ab4ed88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20353d3dcaf34835b27416d81dec259f', 'request_id': 'req-0d3012b7-060d-475b-b35f-3cfa1ab4ed88'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:21.345382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0d3012b7-060d-475b-b35f-3cfa1ab4ed88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20353d3dcaf34835b27416d81dec259f', 'request_id': 'req-0d3012b7-060d-475b-b35f-3cfa1ab4ed88'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:21.354146 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0d3012b7-060d-475b-b35f-3cfa1ab4ed88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20353d3dcaf34835b27416d81dec259f', 'request_id': 'req-0d3012b7-060d-475b-b35f-3cfa1ab4ed88'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:21.380815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0d3012b7-060d-475b-b35f-3cfa1ab4ed88 admin admin] The token cache is being invalidate because project 20353d3dcaf34835b27416d81dec259f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:39:21.383413 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0d3012b7-060d-475b-b35f-3cfa1ab4ed88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:21.384976 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0d3012b7-060d-475b-b35f-3cfa1ab4ed88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:21.389303 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4225/8451] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:39:21 2022] DELETE /identity/v3/projects/20353d3dcaf34835b27416d81dec259f => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:39:21.394009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55582b28-c7d1-4083-a730-0f57be33029b None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:21.394891 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55582b28-c7d1-4083-a730-0f57be33029b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:21.395391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55582b28-c7d1-4083-a730-0f57be33029b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:21.550085 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-55582b28-c7d1-4083-a730-0f57be33029b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:21.555572 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-55582b28-c7d1-4083-a730-0f57be33029b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:21.791242 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4227/8452] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:39:21.799303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9b804-4690-4436-be70-cfa8a3dacb69 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:21.799673 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9b804-4690-4436-be70-cfa8a3dacb69 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:21.800025 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9b804-4690-4436-be70-cfa8a3dacb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:21.850848 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-2ec9b804-4690-4436-be70-cfa8a3dacb69 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:21.852097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2ec9b804-4690-4436-be70-cfa8a3dacb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:21.865787 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4226/8453] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:39:21.875424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55582b28-c7d1-4083-a730-0f57be33029b None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:21.908774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55582b28-c7d1-4083-a730-0f57be33029b None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:21.924126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728cf9e-81f8-45e4-b77a-8db585d6d4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:21.925162 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728cf9e-81f8-45e4-b77a-8db585d6d4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:21.925699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728cf9e-81f8-45e4-b77a-8db585d6d4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:21.926198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728cf9e-81f8-45e4-b77a-8db585d6d4a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:21.927060 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728cf9e-81f8-45e4-b77a-8db585d6d4a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:39:21.927708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728cf9e-81f8-45e4-b77a-8db585d6d4a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:21.929802 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728cf9e-81f8-45e4-b77a-8db585d6d4a3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:21.958879 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4228/8454] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:39:21.963658 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9b804-4690-4436-be70-cfa8a3dacb69 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:21.983267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9b804-4690-4436-be70-cfa8a3dacb69 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:21.993828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab59f90-4df0-46cd-a14f-9dce1667bdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:21.994463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab59f90-4df0-46cd-a14f-9dce1667bdf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:21.994744 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab59f90-4df0-46cd-a14f-9dce1667bdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:21.995016 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab59f90-4df0-46cd-a14f-9dce1667bdf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:21.995679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab59f90-4df0-46cd-a14f-9dce1667bdf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:21.997647 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab59f90-4df0-46cd-a14f-9dce1667bdf0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:22.112281 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4227/8455] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:39:21 2022] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:39:22.116579 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728cf9e-81f8-45e4-b77a-8db585d6d4a3 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:22.132754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728cf9e-81f8-45e4-b77a-8db585d6d4a3 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:22.339071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96caf501-9753-47a8-a506-ded1a31f586a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:22.340423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96caf501-9753-47a8-a506-ded1a31f586a admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:22.340952 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96caf501-9753-47a8-a506-ded1a31f586a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:22.341368 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96caf501-9753-47a8-a506-ded1a31f586a admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:22.345782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96caf501-9753-47a8-a506-ded1a31f586a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:22.363018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96caf501-9753-47a8-a506-ded1a31f586a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:22.413872 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4229/8456] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:39:22 2022] POST /identity/v3/users => generated 288 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:39:22.417511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab59f90-4df0-46cd-a14f-9dce1667bdf0 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:22.444525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab59f90-4df0-46cd-a14f-9dce1667bdf0 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:22.472366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d4104-d3bb-4531-a82a-9f1c788fcfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:22.472366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d4104-d3bb-4531-a82a-9f1c788fcfcd admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:22.473915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d4104-d3bb-4531-a82a-9f1c788fcfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:22.474323 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d4104-d3bb-4531-a82a-9f1c788fcfcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:22.477579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d4104-d3bb-4531-a82a-9f1c788fcfcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:22.479452 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d4104-d3bb-4531-a82a-9f1c788fcfcd admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:22.513169 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96caf501-9753-47a8-a506-ded1a31f586a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:22.524241 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4228/8457] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:39:22.533913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96caf501-9753-47a8-a506-ded1a31f586a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:22.546352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8410e6e-3e93-4729-9590-510153fa0b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:22.547682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8410e6e-3e93-4729-9590-510153fa0b8a admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:22.548944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8410e6e-3e93-4729-9590-510153fa0b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:22.551279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8410e6e-3e93-4729-9590-510153fa0b8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:22.552105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8410e6e-3e93-4729-9590-510153fa0b8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:22.556855 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8410e6e-3e93-4729-9590-510153fa0b8a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:22.593641 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4230/8458] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:39:22.598374 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d4104-d3bb-4531-a82a-9f1c788fcfcd admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:22.615451 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d4104-d3bb-4531-a82a-9f1c788fcfcd admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:22.630852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc8770-4887-434f-a75a-4b2d7f54a3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:22.635643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc8770-4887-434f-a75a-4b2d7f54a3d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:22.635643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc8770-4887-434f-a75a-4b2d7f54a3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:22.635643 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc8770-4887-434f-a75a-4b2d7f54a3d1 admin admin] PATH_INFO: `/v3/projects/5f52b9467bcc4f02a9c3ca667dd19398/users/0ec032a1c31644a0827369e5982444d2/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:22.690752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfc8770-4887-434f-a75a-4b2d7f54a3d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f52b9467bcc4f02a9c3ca667dd19398, user_id=0ec032a1c31644a0827369e5982444d2, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:22.701120 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfc8770-4887-434f-a75a-4b2d7f54a3d1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:22.749300 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4229/8459] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:39:22 2022] PUT /identity/v3/projects/5f52b9467bcc4f02a9c3ca667dd19398/users/0ec032a1c31644a0827369e5982444d2/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:39:22.760592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cf4fd-36e0-45ca-89c1-a8d29b8e9f65 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:22.761795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cf4fd-36e0-45ca-89c1-a8d29b8e9f65 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:22.762150 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cf4fd-36e0-45ca-89c1-a8d29b8e9f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:22.826332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-3e2cf4fd-36e0-45ca-89c1-a8d29b8e9f65 None None] MFA Rules not processed for user `0ec032a1c31644a0827369e5982444d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:22.828013 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3e2cf4fd-36e0-45ca-89c1-a8d29b8e9f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:22.863438 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:22.959578 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4231/8460] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:39:22.971500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc8770-4887-434f-a75a-4b2d7f54a3d1 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:22.973912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1dfc8770-4887-434f-a75a-4b2d7f54a3d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:23.189424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc8770-4887-434f-a75a-4b2d7f54a3d1 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:23.199932 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2489e-21e1-4b71-aaff-1c83fa0a73fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:23.202496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2489e-21e1-4b71-aaff-1c83fa0a73fe service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:23.202797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2489e-21e1-4b71-aaff-1c83fa0a73fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:23.203077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2489e-21e1-4b71-aaff-1c83fa0a73fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:23.232332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f2489e-21e1-4b71-aaff-1c83fa0a73fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:23.234677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f2489e-21e1-4b71-aaff-1c83fa0a73fe service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:23.245132 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:23.258594 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4230/8461] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:39:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:39:23.267091 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2cf4fd-36e0-45ca-89c1-a8d29b8e9f65 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:23.269153 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3e2cf4fd-36e0-45ca-89c1-a8d29b8e9f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:23.498292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2cf4fd-36e0-45ca-89c1-a8d29b8e9f65 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:23.511663 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abcb14d-04a3-4751-8468-706b738e8eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:23.512958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abcb14d-04a3-4751-8468-706b738e8eb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:23.513636 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abcb14d-04a3-4751-8468-706b738e8eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:23.514113 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abcb14d-04a3-4751-8468-706b738e8eb3 admin admin] PATH_INFO: `/v3/users/b5eb3c37fa76402d9a065d8f7d480cf9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:23.516717 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abcb14d-04a3-4751-8468-706b738e8eb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5eb3c37fa76402d9a065d8f7d480cf9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:23.521590 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abcb14d-04a3-4751-8468-706b738e8eb3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:23.619052 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2abcb14d-04a3-4751-8468-706b738e8eb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5eb3c37fa76402d9a065d8f7d480cf9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:23.621184 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2abcb14d-04a3-4751-8468-706b738e8eb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5eb3c37fa76402d9a065d8f7d480cf9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:23.637897 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2abcb14d-04a3-4751-8468-706b738e8eb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5eb3c37fa76402d9a065d8f7d480cf9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:23.657657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2abcb14d-04a3-4751-8468-706b738e8eb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5eb3c37fa76402d9a065d8f7d480cf9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:23.659235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2abcb14d-04a3-4751-8468-706b738e8eb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5eb3c37fa76402d9a065d8f7d480cf9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:23.710904 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4232/8462] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:39:23 2022] DELETE /identity/v3/users/b5eb3c37fa76402d9a065d8f7d480cf9 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:39:23.715149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c30769-c944-42ad-8a59-70d14a1be7b3 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:23.715552 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c30769-c944-42ad-8a59-70d14a1be7b3 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:23.715929 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c30769-c944-42ad-8a59-70d14a1be7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:23.769075 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-91c30769-c944-42ad-8a59-70d14a1be7b3 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:23.772055 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-91c30769-c944-42ad-8a59-70d14a1be7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:23.929494 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4231/8463] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:39:23.943161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abcb14d-04a3-4751-8468-706b738e8eb3 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:23.946014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2abcb14d-04a3-4751-8468-706b738e8eb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:24.042359 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:24.071890 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abcb14d-04a3-4751-8468-706b738e8eb3 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:24.084501 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5da0e0-955d-440d-bfa1-e8a05a583913 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:24.085558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5da0e0-955d-440d-bfa1-e8a05a583913 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:24.086046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5da0e0-955d-440d-bfa1-e8a05a583913 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:24.086592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5da0e0-955d-440d-bfa1-e8a05a583913 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:24.099561 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5da0e0-955d-440d-bfa1-e8a05a583913 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:24.101659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5da0e0-955d-440d-bfa1-e8a05a583913 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:24.117230 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4233/8464] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:39:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:39:24.405166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c30769-c944-42ad-8a59-70d14a1be7b3 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:24.408289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-91c30769-c944-42ad-8a59-70d14a1be7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:24.435673 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c30769-c944-42ad-8a59-70d14a1be7b3 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:24.454169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8fc35-e1a2-4c92-bcef-75d6ec679f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:24.456190 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8fc35-e1a2-4c92-bcef-75d6ec679f8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:24.461322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8fc35-e1a2-4c92-bcef-75d6ec679f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:24.462910 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8fc35-e1a2-4c92-bcef-75d6ec679f8c admin admin] PATH_INFO: `/v3/projects/c9b16c560caf4d19b09f5b7189be3d90` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:24.466326 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb8fc35-e1a2-4c92-bcef-75d6ec679f8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9b16c560caf4d19b09f5b7189be3d90)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:24.470535 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb8fc35-e1a2-4c92-bcef-75d6ec679f8c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:24.607523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-abb8fc35-e1a2-4c92-bcef-75d6ec679f8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9b16c560caf4d19b09f5b7189be3d90', 'request_id': 'req-abb8fc35-e1a2-4c92-bcef-75d6ec679f8c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:24.622480 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-abb8fc35-e1a2-4c92-bcef-75d6ec679f8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9b16c560caf4d19b09f5b7189be3d90', 'request_id': 'req-abb8fc35-e1a2-4c92-bcef-75d6ec679f8c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:24.633512 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-abb8fc35-e1a2-4c92-bcef-75d6ec679f8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9b16c560caf4d19b09f5b7189be3d90', 'request_id': 'req-abb8fc35-e1a2-4c92-bcef-75d6ec679f8c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:24.669270 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-abb8fc35-e1a2-4c92-bcef-75d6ec679f8c admin admin] The token cache is being invalidate because project c9b16c560caf4d19b09f5b7189be3d90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:39:24.670058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-abb8fc35-e1a2-4c92-bcef-75d6ec679f8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:24.671176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-abb8fc35-e1a2-4c92-bcef-75d6ec679f8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:24.674143 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4232/8465] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:39:24 2022] DELETE /identity/v3/projects/c9b16c560caf4d19b09f5b7189be3d90 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:39:24.679329 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a6fda-9b21-4864-ac59-adf36874c724 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:24.679895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a6fda-9b21-4864-ac59-adf36874c724 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:24.679895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a6fda-9b21-4864-ac59-adf36874c724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:24.724081 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-694a6fda-9b21-4864-ac59-adf36874c724 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:24.725521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-694a6fda-9b21-4864-ac59-adf36874c724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:24.901537 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4234/8466] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:39:24.911185 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02b0fb-517a-4eaf-8b0d-66417cb6f77e None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:24.911467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02b0fb-517a-4eaf-8b0d-66417cb6f77e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:24.911740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02b0fb-517a-4eaf-8b0d-66417cb6f77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:24.960942 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ad02b0fb-517a-4eaf-8b0d-66417cb6f77e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:24.962208 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ad02b0fb-517a-4eaf-8b0d-66417cb6f77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:24.984661 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4233/8467] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:39:24.988052 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a6fda-9b21-4864-ac59-adf36874c724 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:25.003777 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a6fda-9b21-4864-ac59-adf36874c724 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:25.010215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95da3b-1174-4415-93df-7ef09303d578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:25.011791 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95da3b-1174-4415-93df-7ef09303d578 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:25.012225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95da3b-1174-4415-93df-7ef09303d578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:25.012647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95da3b-1174-4415-93df-7ef09303d578 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:25.013529 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95da3b-1174-4415-93df-7ef09303d578 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:39:25.013981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95da3b-1174-4415-93df-7ef09303d578 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:25.016421 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95da3b-1174-4415-93df-7ef09303d578 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:25.040779 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4235/8468] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:39:25.045054 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02b0fb-517a-4eaf-8b0d-66417cb6f77e None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:25.065668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02b0fb-517a-4eaf-8b0d-66417cb6f77e None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:25.073344 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53088626-c95e-40db-aab3-f9b4abec3afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:25.074283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53088626-c95e-40db-aab3-f9b4abec3afa admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:25.074750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53088626-c95e-40db-aab3-f9b4abec3afa admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:25.075203 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53088626-c95e-40db-aab3-f9b4abec3afa admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:25.076359 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53088626-c95e-40db-aab3-f9b4abec3afa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:25.080109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53088626-c95e-40db-aab3-f9b4abec3afa admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:25.149691 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4234/8469] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:39:25 2022] POST /identity/v3/projects => generated 403 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:39:25.155043 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95da3b-1174-4415-93df-7ef09303d578 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:25.171932 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95da3b-1174-4415-93df-7ef09303d578 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:25.314961 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110d498-7eb7-463c-becf-fa6a0cfa6610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:25.315589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110d498-7eb7-463c-becf-fa6a0cfa6610 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:25.315870 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110d498-7eb7-463c-becf-fa6a0cfa6610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:25.316126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110d498-7eb7-463c-becf-fa6a0cfa6610 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:25.316770 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f110d498-7eb7-463c-becf-fa6a0cfa6610 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:25.319216 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f110d498-7eb7-463c-becf-fa6a0cfa6610 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:25.363525 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4236/8470] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:39:25 2022] POST /identity/v3/users => generated 302 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:39:25.367521 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53088626-c95e-40db-aab3-f9b4abec3afa admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:25.383844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53088626-c95e-40db-aab3-f9b4abec3afa admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:25.414202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d37554-6ff6-45a2-a07b-4562b02abd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:25.415621 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d37554-6ff6-45a2-a07b-4562b02abd86 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:25.416056 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d37554-6ff6-45a2-a07b-4562b02abd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:25.416736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d37554-6ff6-45a2-a07b-4562b02abd86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:25.417573 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d37554-6ff6-45a2-a07b-4562b02abd86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:25.420642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d37554-6ff6-45a2-a07b-4562b02abd86 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:25.449792 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4235/8471] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:39:25.453784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110d498-7eb7-463c-becf-fa6a0cfa6610 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:25.482113 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110d498-7eb7-463c-becf-fa6a0cfa6610 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:25.498496 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7043090-7779-4926-9733-6a88a7e3f97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:25.499133 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7043090-7779-4926-9733-6a88a7e3f97a admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:25.499412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7043090-7779-4926-9733-6a88a7e3f97a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:25.499692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7043090-7779-4926-9733-6a88a7e3f97a admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:25.500345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7043090-7779-4926-9733-6a88a7e3f97a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:25.502008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7043090-7779-4926-9733-6a88a7e3f97a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:25.523334 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4237/8472] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:39:25.528347 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d37554-6ff6-45a2-a07b-4562b02abd86 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:25.549313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d37554-6ff6-45a2-a07b-4562b02abd86 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:25.567699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480587ac-32db-45ae-8b07-b91a00fbf85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:25.568824 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480587ac-32db-45ae-8b07-b91a00fbf85f admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:25.569300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480587ac-32db-45ae-8b07-b91a00fbf85f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:25.569740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480587ac-32db-45ae-8b07-b91a00fbf85f admin admin] PATH_INFO: `/v3/projects/2d7836839581404383f9c0b9dd0878e9/users/40a5d51bd4a94b1f8a6237028abfcfa4/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:25.609740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480587ac-32db-45ae-8b07-b91a00fbf85f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d7836839581404383f9c0b9dd0878e9, user_id=40a5d51bd4a94b1f8a6237028abfcfa4, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:25.615232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480587ac-32db-45ae-8b07-b91a00fbf85f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:25.659230 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4236/8473] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:39:25 2022] PUT /identity/v3/projects/2d7836839581404383f9c0b9dd0878e9/users/40a5d51bd4a94b1f8a6237028abfcfa4/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:39:25.660920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e9cba-fee8-49f8-b0d7-50a97eccba5b None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:25.661232 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e9cba-fee8-49f8-b0d7-50a97eccba5b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:25.661508 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e9cba-fee8-49f8-b0d7-50a97eccba5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:25.711214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-132e9cba-fee8-49f8-b0d7-50a97eccba5b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:25.712182 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-132e9cba-fee8-49f8-b0d7-50a97eccba5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:25.822757 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:25.844850 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4238/8474] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:39:25.854506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480587ac-32db-45ae-8b07-b91a00fbf85f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:25.856278 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-480587ac-32db-45ae-8b07-b91a00fbf85f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:25.894185 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:25.982582 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480587ac-32db-45ae-8b07-b91a00fbf85f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:25.996809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a202cbd-93d9-4929-a724-72871e219776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:25.997486 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a202cbd-93d9-4929-a724-72871e219776 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:25.997837 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a202cbd-93d9-4929-a724-72871e219776 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:25.998111 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a202cbd-93d9-4929-a724-72871e219776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:26.017721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a202cbd-93d9-4929-a724-72871e219776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:26.020377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a202cbd-93d9-4929-a724-72871e219776 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:26.059251 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4237/8475] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:39:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:39:28.007032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5eb758-3756-4507-a0b4-b468cb893601 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:28.007665 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5eb758-3756-4507-a0b4-b468cb893601 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:28.008014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5eb758-3756-4507-a0b4-b468cb893601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:28.093810 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-9e5eb758-3756-4507-a0b4-b468cb893601 None None] MFA Rules not processed for user `40a5d51bd4a94b1f8a6237028abfcfa4`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:28.095290 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9e5eb758-3756-4507-a0b4-b468cb893601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:28.222357 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4239/8476] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:28 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:39:28.227108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a202cbd-93d9-4929-a724-72871e219776 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:28.241819 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a202cbd-93d9-4929-a724-72871e219776 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:28.280132 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf8ab1-29bc-4f1e-acfb-d0cd2b3b9d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:28.284271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf8ab1-29bc-4f1e-acfb-d0cd2b3b9d48 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:28.284271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf8ab1-29bc-4f1e-acfb-d0cd2b3b9d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:28.284271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf8ab1-29bc-4f1e-acfb-d0cd2b3b9d48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:28.290752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf8ab1-29bc-4f1e-acfb-d0cd2b3b9d48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:28.292875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf8ab1-29bc-4f1e-acfb-d0cd2b3b9d48 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:28.381660 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4238/8477] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:39:28 2022] POST /identity/v3/projects => generated 405 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:39:28.385195 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5eb758-3756-4507-a0b4-b468cb893601 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:28.411983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5eb758-3756-4507-a0b4-b468cb893601 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:28.483743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ab6c7-1232-41d0-8130-7a39808fb6ce None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:28.484034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ab6c7-1232-41d0-8130-7a39808fb6ce None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:28.484315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ab6c7-1232-41d0-8130-7a39808fb6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:28.568977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c20ab6c7-1232-41d0-8130-7a39808fb6ce None None] MFA Rules not processed for user `530be482a72c4746b5b449cb1be6cdff`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:28.573110 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c20ab6c7-1232-41d0-8130-7a39808fb6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:28.575053 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42aa35-4ab4-40bb-84f5-dfd6a8835bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:28.576196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42aa35-4ab4-40bb-84f5-dfd6a8835bf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:28.576645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42aa35-4ab4-40bb-84f5-dfd6a8835bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:28.577417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42aa35-4ab4-40bb-84f5-dfd6a8835bf1 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:28.578758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d42aa35-4ab4-40bb-84f5-dfd6a8835bf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:28.582998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d42aa35-4ab4-40bb-84f5-dfd6a8835bf1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:28.625761 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4240/8478] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:39:28 2022] POST /identity/v3/users => generated 309 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:39:28.630550 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42aa35-4ab4-40bb-84f5-dfd6a8835bf1 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:28.653321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42aa35-4ab4-40bb-84f5-dfd6a8835bf1 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:28.654785 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4239/8479] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:28 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:39:28.668413 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ab6c7-1232-41d0-8130-7a39808fb6ce None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:28.670169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c20ab6c7-1232-41d0-8130-7a39808fb6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:28.671949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253550f-4566-4d94-8a7d-737041a38482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:28.672773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253550f-4566-4d94-8a7d-737041a38482 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:28.673166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253550f-4566-4d94-8a7d-737041a38482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:28.673674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253550f-4566-4d94-8a7d-737041a38482 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:28.674427 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253550f-4566-4d94-8a7d-737041a38482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:28.676384 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253550f-4566-4d94-8a7d-737041a38482 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:28.691600 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4241/8480] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:39:28.692780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253550f-4566-4d94-8a7d-737041a38482 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:28.704314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253550f-4566-4d94-8a7d-737041a38482 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:28.710373 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbdee3-534b-40a8-90fb-49c173657e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:28.711578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbdee3-534b-40a8-90fb-49c173657e7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:28.711960 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbdee3-534b-40a8-90fb-49c173657e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:28.713001 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbdee3-534b-40a8-90fb-49c173657e7d admin admin] PATH_INFO: `/v3/projects/078a68d52a8b43ab98d533c7f1f54652/users/60398ba2ee5c439791872dc1b798b2e4/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:28.733348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fbdee3-534b-40a8-90fb-49c173657e7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=078a68d52a8b43ab98d533c7f1f54652, user_id=60398ba2ee5c439791872dc1b798b2e4, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:28.737625 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fbdee3-534b-40a8-90fb-49c173657e7d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:28.754359 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ab6c7-1232-41d0-8130-7a39808fb6ce None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:28.757716 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4242/8481] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:39:28 2022] PUT /identity/v3/projects/078a68d52a8b43ab98d533c7f1f54652/users/60398ba2ee5c439791872dc1b798b2e4/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:39:28.762801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbdee3-534b-40a8-90fb-49c173657e7d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:28.814103 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:28.830293 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:28.840445 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f311a-ad8d-4262-ae6b-1c89a90762bc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efcee9b21ea94b1b8e5c9c5acb35839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:28.842994 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f311a-ad8d-4262-ae6b-1c89a90762bc service glance] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:28.844228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f311a-ad8d-4262-ae6b-1c89a90762bc service glance] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:28.844514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f311a-ad8d-4262-ae6b-1c89a90762bc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:28.846986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c08f311a-ad8d-4262-ae6b-1c89a90762bc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:28.859525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbdee3-534b-40a8-90fb-49c173657e7d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:28.864718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66921f36-8a87-495b-adb7-5aefc69d87b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:28.865601 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66921f36-8a87-495b-adb7-5aefc69d87b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:28.865737 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66921f36-8a87-495b-adb7-5aefc69d87b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:28.866027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66921f36-8a87-495b-adb7-5aefc69d87b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:28.866676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66921f36-8a87-495b-adb7-5aefc69d87b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:28.868588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66921f36-8a87-495b-adb7-5aefc69d87b3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:28.883614 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4243/8482] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:39:28.884495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66921f36-8a87-495b-adb7-5aefc69d87b3 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:28.895589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66921f36-8a87-495b-adb7-5aefc69d87b3 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:28.902282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec940fd-0f48-4a46-aea2-0ebadf8977c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:28.902961 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec940fd-0f48-4a46-aea2-0ebadf8977c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:28.903240 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec940fd-0f48-4a46-aea2-0ebadf8977c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:28.903756 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec940fd-0f48-4a46-aea2-0ebadf8977c4 admin admin] PATH_INFO: `/v3/projects/078a68d52a8b43ab98d533c7f1f54652/users/60398ba2ee5c439791872dc1b798b2e4/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:28.905907 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec940fd-0f48-4a46-aea2-0ebadf8977c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=078a68d52a8b43ab98d533c7f1f54652, user_id=60398ba2ee5c439791872dc1b798b2e4, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:28.909301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec940fd-0f48-4a46-aea2-0ebadf8977c4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:28.922243 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4244/8483] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:39:28 2022] PUT /identity/v3/projects/078a68d52a8b43ab98d533c7f1f54652/users/60398ba2ee5c439791872dc1b798b2e4/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:39:28.929920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f311a-ad8d-4262-ae6b-1c89a90762bc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:28.931790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f311a-ad8d-4262-ae6b-1c89a90762bc service glance] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:28.943432 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4240/8484] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:39:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:39:30.039628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a02856-d36c-4091-a0bc-c384fb0b1518 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:30.041756 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a02856-d36c-4091-a0bc-c384fb0b1518 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:30.042907 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a02856-d36c-4091-a0bc-c384fb0b1518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:30.083752 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-62a02856-d36c-4091-a0bc-c384fb0b1518 None None] MFA Rules not processed for user `60398ba2ee5c439791872dc1b798b2e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:30.085375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-62a02856-d36c-4091-a0bc-c384fb0b1518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:30.199131 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4245/8485] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:30 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:39:32.013530 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f311a-ad8d-4262-ae6b-1c89a90762bc service glance] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:32.030854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f311a-ad8d-4262-ae6b-1c89a90762bc service glance] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:32.138983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b7ec2-3e43-41ee-9412-307e38722879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:32.139631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b7ec2-3e43-41ee-9412-307e38722879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:32.139977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b7ec2-3e43-41ee-9412-307e38722879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:32.140254 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b7ec2-3e43-41ee-9412-307e38722879 admin admin] PATH_INFO: `/v3/users/40a5d51bd4a94b1f8a6237028abfcfa4` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:32.141745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b7ec2-3e43-41ee-9412-307e38722879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40a5d51bd4a94b1f8a6237028abfcfa4)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:32.143684 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b7ec2-3e43-41ee-9412-307e38722879 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:32.231702 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-347b7ec2-3e43-41ee-9412-307e38722879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40a5d51bd4a94b1f8a6237028abfcfa4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:32.232508 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-347b7ec2-3e43-41ee-9412-307e38722879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40a5d51bd4a94b1f8a6237028abfcfa4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:32.252322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-347b7ec2-3e43-41ee-9412-307e38722879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40a5d51bd4a94b1f8a6237028abfcfa4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:32.268377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-347b7ec2-3e43-41ee-9412-307e38722879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40a5d51bd4a94b1f8a6237028abfcfa4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:32.269647 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-347b7ec2-3e43-41ee-9412-307e38722879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40a5d51bd4a94b1f8a6237028abfcfa4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:32.325798 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4241/8486] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:39:32 2022] DELETE /identity/v3/users/40a5d51bd4a94b1f8a6237028abfcfa4 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:39:32.666186 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a02856-d36c-4091-a0bc-c384fb0b1518 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:32.682567 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a02856-d36c-4091-a0bc-c384fb0b1518 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:32.827885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715f4a3-9012-4682-950c-1ffa802a14f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:32.828803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715f4a3-9012-4682-950c-1ffa802a14f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:32.829096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715f4a3-9012-4682-950c-1ffa802a14f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:32.829591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715f4a3-9012-4682-950c-1ffa802a14f1 admin admin] PATH_INFO: `/v3/projects/2d7836839581404383f9c0b9dd0878e9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:32.830743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715f4a3-9012-4682-950c-1ffa802a14f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d7836839581404383f9c0b9dd0878e9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:32.832933 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715f4a3-9012-4682-950c-1ffa802a14f1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:32.924008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3715f4a3-9012-4682-950c-1ffa802a14f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d7836839581404383f9c0b9dd0878e9', 'request_id': 'req-3715f4a3-9012-4682-950c-1ffa802a14f1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:32.934592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3715f4a3-9012-4682-950c-1ffa802a14f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d7836839581404383f9c0b9dd0878e9', 'request_id': 'req-3715f4a3-9012-4682-950c-1ffa802a14f1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:32.936473 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:32.944308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3715f4a3-9012-4682-950c-1ffa802a14f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d7836839581404383f9c0b9dd0878e9', 'request_id': 'req-3715f4a3-9012-4682-950c-1ffa802a14f1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:32.958571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3715f4a3-9012-4682-950c-1ffa802a14f1 admin admin] The token cache is being invalidate because project 2d7836839581404383f9c0b9dd0878e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:39:32.959204 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3715f4a3-9012-4682-950c-1ffa802a14f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:32.960389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-3715f4a3-9012-4682-950c-1ffa802a14f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:32.963359 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4246/8487] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:39:32 2022] DELETE /identity/v3/projects/2d7836839581404383f9c0b9dd0878e9 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:39:32.967006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b7ec2-3e43-41ee-9412-307e38722879 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:32.968474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-347b7ec2-3e43-41ee-9412-307e38722879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:32.988440 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b7ec2-3e43-41ee-9412-307e38722879 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:33.016891 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:33.112279 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a054f8-6163-4585-9a52-44cc50ff2d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:33.113134 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a054f8-6163-4585-9a52-44cc50ff2d1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:33.113565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a054f8-6163-4585-9a52-44cc50ff2d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:33.113707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a054f8-6163-4585-9a52-44cc50ff2d1f admin admin] PATH_INFO: `/v3/users/60398ba2ee5c439791872dc1b798b2e4` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:33.114942 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a054f8-6163-4585-9a52-44cc50ff2d1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=60398ba2ee5c439791872dc1b798b2e4)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:33.117505 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a054f8-6163-4585-9a52-44cc50ff2d1f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:33.201735 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-82a054f8-6163-4585-9a52-44cc50ff2d1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60398ba2ee5c439791872dc1b798b2e4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:33.218432 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-82a054f8-6163-4585-9a52-44cc50ff2d1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60398ba2ee5c439791872dc1b798b2e4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:33.225266 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-82a054f8-6163-4585-9a52-44cc50ff2d1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60398ba2ee5c439791872dc1b798b2e4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:33.240327 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-82a054f8-6163-4585-9a52-44cc50ff2d1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60398ba2ee5c439791872dc1b798b2e4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:33.241176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-82a054f8-6163-4585-9a52-44cc50ff2d1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60398ba2ee5c439791872dc1b798b2e4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:33.266220 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4242/8488] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:39:32 2022] DELETE /identity/v3/users/60398ba2ee5c439791872dc1b798b2e4 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:39:33.504162 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715f4a3-9012-4682-950c-1ffa802a14f1 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:33.506121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3715f4a3-9012-4682-950c-1ffa802a14f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:33.520506 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715f4a3-9012-4682-950c-1ffa802a14f1 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:33.612825 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7fa0ea-96f0-49a4-b862-edea8e62d591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:33.613634 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fa0ea-96f0-49a4-b862-edea8e62d591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:33.613913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fa0ea-96f0-49a4-b862-edea8e62d591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:33.614184 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fa0ea-96f0-49a4-b862-edea8e62d591 admin admin] PATH_INFO: `/v3/projects/078a68d52a8b43ab98d533c7f1f54652` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:33.615442 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7fa0ea-96f0-49a4-b862-edea8e62d591 admin admin] RBAC: Authorizing `identity:delete_project(project_id=078a68d52a8b43ab98d533c7f1f54652)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:33.617628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7fa0ea-96f0-49a4-b862-edea8e62d591 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:33.691159 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-eb7fa0ea-96f0-49a4-b862-edea8e62d591 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '078a68d52a8b43ab98d533c7f1f54652', 'request_id': 'req-eb7fa0ea-96f0-49a4-b862-edea8e62d591'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:33.703013 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-eb7fa0ea-96f0-49a4-b862-edea8e62d591 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '078a68d52a8b43ab98d533c7f1f54652', 'request_id': 'req-eb7fa0ea-96f0-49a4-b862-edea8e62d591'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:33.711193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-eb7fa0ea-96f0-49a4-b862-edea8e62d591 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '078a68d52a8b43ab98d533c7f1f54652', 'request_id': 'req-eb7fa0ea-96f0-49a4-b862-edea8e62d591'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:33.730717 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-eb7fa0ea-96f0-49a4-b862-edea8e62d591 admin admin] The token cache is being invalidate because project 078a68d52a8b43ab98d533c7f1f54652 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:39:33.731612 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-eb7fa0ea-96f0-49a4-b862-edea8e62d591 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:33.732497 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-eb7fa0ea-96f0-49a4-b862-edea8e62d591 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:33.735526 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4247/8489] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:39:33 2022] DELETE /identity/v3/projects/078a68d52a8b43ab98d533c7f1f54652 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:39:33.740231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fab478-4aff-4a13-be86-4e393963194a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:33.740581 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fab478-4aff-4a13-be86-4e393963194a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:33.741131 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fab478-4aff-4a13-be86-4e393963194a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:33.769037 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-58fab478-4aff-4a13-be86-4e393963194a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:33.770434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-58fab478-4aff-4a13-be86-4e393963194a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:33.860786 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4243/8490] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:39:33.976731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a2e3b-ce05-41f1-a01d-6f3193bb1b39 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:33.977027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a2e3b-ce05-41f1-a01d-6f3193bb1b39 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:33.977290 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a2e3b-ce05-41f1-a01d-6f3193bb1b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:34.009667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-7b8a2e3b-ce05-41f1-a01d-6f3193bb1b39 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:34.011092 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7b8a2e3b-ce05-41f1-a01d-6f3193bb1b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:34.019399 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4248/8491] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:39:34.023866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fab478-4aff-4a13-be86-4e393963194a None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:34.035601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fab478-4aff-4a13-be86-4e393963194a None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:34.041696 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc24120-1643-4008-bec4-408f7f13f8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:34.042310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc24120-1643-4008-bec4-408f7f13f8b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:34.042591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc24120-1643-4008-bec4-408f7f13f8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:34.043149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc24120-1643-4008-bec4-408f7f13f8b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:34.043804 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc24120-1643-4008-bec4-408f7f13f8b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:39:34.044106 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc24120-1643-4008-bec4-408f7f13f8b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:34.045740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc24120-1643-4008-bec4-408f7f13f8b5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:34.066699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a2e3b-ce05-41f1-a01d-6f3193bb1b39 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:34.091806 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a2e3b-ce05-41f1-a01d-6f3193bb1b39 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:34.092711 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4244/8492] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:39:34.098106 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300dfd6d-c95e-4ae5-b267-ec55ff44ad77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:34.098733 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300dfd6d-c95e-4ae5-b267-ec55ff44ad77 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:34.099011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300dfd6d-c95e-4ae5-b267-ec55ff44ad77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:34.099364 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300dfd6d-c95e-4ae5-b267-ec55ff44ad77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:34.100003 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300dfd6d-c95e-4ae5-b267-ec55ff44ad77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:34.102369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300dfd6d-c95e-4ae5-b267-ec55ff44ad77 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:34.141281 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc24120-1643-4008-bec4-408f7f13f8b5 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:34.152375 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4249/8493] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:39:34 2022] POST /identity/v3/projects => generated 387 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:39:34.153960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc24120-1643-4008-bec4-408f7f13f8b5 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:34.174804 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:34.287579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be8b41-2d64-4d4b-b721-152f5c4716a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:34.288211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be8b41-2d64-4d4b-b721-152f5c4716a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:34.288492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be8b41-2d64-4d4b-b721-152f5c4716a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:34.288765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be8b41-2d64-4d4b-b721-152f5c4716a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:34.289419 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be8b41-2d64-4d4b-b721-152f5c4716a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:34.292012 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be8b41-2d64-4d4b-b721-152f5c4716a2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:34.361427 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4245/8494] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:39:34 2022] POST /identity/v3/users => generated 294 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:39:34.365367 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300dfd6d-c95e-4ae5-b267-ec55ff44ad77 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:34.391663 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300dfd6d-c95e-4ae5-b267-ec55ff44ad77 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:34.398487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e49c6-7e2c-406c-8a36-1037e9ef625d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:34.399314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e49c6-7e2c-406c-8a36-1037e9ef625d admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:34.400252 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e49c6-7e2c-406c-8a36-1037e9ef625d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:34.400521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e49c6-7e2c-406c-8a36-1037e9ef625d admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:34.401215 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e49c6-7e2c-406c-8a36-1037e9ef625d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:34.402951 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e49c6-7e2c-406c-8a36-1037e9ef625d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:34.418224 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4250/8495] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:39:34.422790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be8b41-2d64-4d4b-b721-152f5c4716a2 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:34.434531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be8b41-2d64-4d4b-b721-152f5c4716a2 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:34.440376 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502d6ac-0031-48da-b801-76b7202f933c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:34.441760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502d6ac-0031-48da-b801-76b7202f933c admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:34.442145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502d6ac-0031-48da-b801-76b7202f933c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:34.442520 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502d6ac-0031-48da-b801-76b7202f933c admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:34.443244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1502d6ac-0031-48da-b801-76b7202f933c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:34.445108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1502d6ac-0031-48da-b801-76b7202f933c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:34.459554 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4246/8496] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:39:34.463990 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e49c6-7e2c-406c-8a36-1037e9ef625d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:34.475127 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e49c6-7e2c-406c-8a36-1037e9ef625d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:34.480473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f458933-79da-44e9-8bd0-eef5a658b2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:34.481268 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f458933-79da-44e9-8bd0-eef5a658b2bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:34.481651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f458933-79da-44e9-8bd0-eef5a658b2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:34.482005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f458933-79da-44e9-8bd0-eef5a658b2bd admin admin] PATH_INFO: `/v3/projects/c03e3e49bdd843eeaaade6fb46f0f0d4/users/fbf18a8dda874d65bf5c95ce7a5b5a0a/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:34.519177 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f458933-79da-44e9-8bd0-eef5a658b2bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c03e3e49bdd843eeaaade6fb46f0f0d4, user_id=fbf18a8dda874d65bf5c95ce7a5b5a0a, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:34.522446 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f458933-79da-44e9-8bd0-eef5a658b2bd admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:34.542651 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4251/8497] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:39:34 2022] PUT /identity/v3/projects/c03e3e49bdd843eeaaade6fb46f0f0d4/users/fbf18a8dda874d65bf5c95ce7a5b5a0a/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:39:34.555849 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01efa7a-dc66-4ea9-bd76-569aa58adc36 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:34.556133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01efa7a-dc66-4ea9-bd76-569aa58adc36 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:34.556417 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01efa7a-dc66-4ea9-bd76-569aa58adc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:34.613374 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-d01efa7a-dc66-4ea9-bd76-569aa58adc36 None None] MFA Rules not processed for user `fbf18a8dda874d65bf5c95ce7a5b5a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:34.614859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d01efa7a-dc66-4ea9-bd76-569aa58adc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:34.762709 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4247/8498] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:39:34.765368 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f458933-79da-44e9-8bd0-eef5a658b2bd admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:34.770954 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:34.859582 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f458933-79da-44e9-8bd0-eef5a658b2bd admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:34.865133 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3cbe50-a550-4cbc-b6d4-218736fce2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:34.865832 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cbe50-a550-4cbc-b6d4-218736fce2c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:34.866119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cbe50-a550-4cbc-b6d4-218736fce2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:34.866395 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cbe50-a550-4cbc-b6d4-218736fce2c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:34.867028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3cbe50-a550-4cbc-b6d4-218736fce2c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:34.869938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3cbe50-a550-4cbc-b6d4-218736fce2c1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:34.913899 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4252/8499] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:39:34 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:39:34.917414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01efa7a-dc66-4ea9-bd76-569aa58adc36 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:34.936578 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01efa7a-dc66-4ea9-bd76-569aa58adc36 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:35.019880 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a17f15-f15c-4c3f-8c86-5fb7e14ac195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:35.020418 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a17f15-f15c-4c3f-8c86-5fb7e14ac195 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:35.020802 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a17f15-f15c-4c3f-8c86-5fb7e14ac195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:35.021217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a17f15-f15c-4c3f-8c86-5fb7e14ac195 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:35.022255 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a17f15-f15c-4c3f-8c86-5fb7e14ac195 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:35.024582 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a17f15-f15c-4c3f-8c86-5fb7e14ac195 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:35.055513 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4248/8500] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:39:34 2022] POST /identity/v3/users => generated 300 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:39:35.057721 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3cbe50-a550-4cbc-b6d4-218736fce2c1 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:35.076262 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3cbe50-a550-4cbc-b6d4-218736fce2c1 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:35.084663 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7735e-71c6-468f-9b85-58d62fc05dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:35.085618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7735e-71c6-468f-9b85-58d62fc05dae admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:35.086241 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7735e-71c6-468f-9b85-58d62fc05dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:35.086684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7735e-71c6-468f-9b85-58d62fc05dae admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:35.087757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7735e-71c6-468f-9b85-58d62fc05dae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:35.089653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7735e-71c6-468f-9b85-58d62fc05dae admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:35.105639 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4253/8501] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:39:35.110086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a17f15-f15c-4c3f-8c86-5fb7e14ac195 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:35.125356 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a17f15-f15c-4c3f-8c86-5fb7e14ac195 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:35.130872 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f45800-0b1f-4d27-8478-928f6a8ea473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:35.131550 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f45800-0b1f-4d27-8478-928f6a8ea473 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:35.131833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f45800-0b1f-4d27-8478-928f6a8ea473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:35.132114 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f45800-0b1f-4d27-8478-928f6a8ea473 admin admin] PATH_INFO: `/v3/projects/80cdc4d21d084dd69f317b04c09f4552/users/9ca305c272e14732aceb702659feb40c/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:35.172486 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f45800-0b1f-4d27-8478-928f6a8ea473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80cdc4d21d084dd69f317b04c09f4552, user_id=9ca305c272e14732aceb702659feb40c, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:35.175403 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f45800-0b1f-4d27-8478-928f6a8ea473 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:35.177728 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:35.196921 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4249/8502] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:39:35 2022] PUT /identity/v3/projects/80cdc4d21d084dd69f317b04c09f4552/users/9ca305c272e14732aceb702659feb40c/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:39:35.200906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7735e-71c6-468f-9b85-58d62fc05dae admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:35.212172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7735e-71c6-468f-9b85-58d62fc05dae admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:35.293133 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00890764-0ed4-437e-989c-1a4446692978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:35.293962 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00890764-0ed4-437e-989c-1a4446692978 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:35.294336 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00890764-0ed4-437e-989c-1a4446692978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:35.294703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00890764-0ed4-437e-989c-1a4446692978 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:35.295670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00890764-0ed4-437e-989c-1a4446692978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:35.297486 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00890764-0ed4-437e-989c-1a4446692978 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:35.310860 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4254/8503] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:39:35.314688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f45800-0b1f-4d27-8478-928f6a8ea473 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:35.328927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f45800-0b1f-4d27-8478-928f6a8ea473 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:35.338921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94963c-7e2b-463e-8933-e9a22c674897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:35.340271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94963c-7e2b-463e-8933-e9a22c674897 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:35.340729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94963c-7e2b-463e-8933-e9a22c674897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:35.341290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94963c-7e2b-463e-8933-e9a22c674897 admin admin] PATH_INFO: `/v3/projects/80cdc4d21d084dd69f317b04c09f4552/users/9ca305c272e14732aceb702659feb40c/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:35.343472 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b94963c-7e2b-463e-8933-e9a22c674897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80cdc4d21d084dd69f317b04c09f4552, user_id=9ca305c272e14732aceb702659feb40c, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:35.346234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b94963c-7e2b-463e-8933-e9a22c674897 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:35.367667 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4250/8504] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:39:35 2022] PUT /identity/v3/projects/80cdc4d21d084dd69f317b04c09f4552/users/9ca305c272e14732aceb702659feb40c/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:39:35.370497 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92fdc8-3413-4900-aaa0-06673aaf4ca7 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:35.370784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92fdc8-3413-4900-aaa0-06673aaf4ca7 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:35.371061 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92fdc8-3413-4900-aaa0-06673aaf4ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:35.455311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-cb92fdc8-3413-4900-aaa0-06673aaf4ca7 None None] MFA Rules not processed for user `9ca305c272e14732aceb702659feb40c`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:35.456909 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-cb92fdc8-3413-4900-aaa0-06673aaf4ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:35.549924 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:35.558053 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4255/8505] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:35 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:39:35.569750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94963c-7e2b-463e-8933-e9a22c674897 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:35.571393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1b94963c-7e2b-463e-8933-e9a22c674897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:35.687607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94963c-7e2b-463e-8933-e9a22c674897 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:35.691841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1aa66e-818f-4d86-8e68-0c80610308e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:35.692532 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1aa66e-818f-4d86-8e68-0c80610308e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:35.692880 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1aa66e-818f-4d86-8e68-0c80610308e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:35.693217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1aa66e-818f-4d86-8e68-0c80610308e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:35.715808 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1aa66e-818f-4d86-8e68-0c80610308e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:35.717402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1aa66e-818f-4d86-8e68-0c80610308e6 service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:35.739629 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4251/8506] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:39:35 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:39:35.995243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92fdc8-3413-4900-aaa0-06673aaf4ca7 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:36.082820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92fdc8-3413-4900-aaa0-06673aaf4ca7 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:36.089333 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b6f82-ee22-492d-b1f6-23fb5a5fc0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:36.090252 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b6f82-ee22-492d-b1f6-23fb5a5fc0b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:36.090687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b6f82-ee22-492d-b1f6-23fb5a5fc0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:36.091437 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b6f82-ee22-492d-b1f6-23fb5a5fc0b8 admin admin] PATH_INFO: `/v3/users/fbf18a8dda874d65bf5c95ce7a5b5a0a` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:36.093234 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b6f82-ee22-492d-b1f6-23fb5a5fc0b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbf18a8dda874d65bf5c95ce7a5b5a0a)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:36.095414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b6f82-ee22-492d-b1f6-23fb5a5fc0b8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:36.162847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-510b6f82-ee22-492d-b1f6-23fb5a5fc0b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbf18a8dda874d65bf5c95ce7a5b5a0a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:36.163532 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-510b6f82-ee22-492d-b1f6-23fb5a5fc0b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbf18a8dda874d65bf5c95ce7a5b5a0a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:36.175808 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-510b6f82-ee22-492d-b1f6-23fb5a5fc0b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbf18a8dda874d65bf5c95ce7a5b5a0a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:36.210524 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-510b6f82-ee22-492d-b1f6-23fb5a5fc0b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbf18a8dda874d65bf5c95ce7a5b5a0a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:36.221466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-510b6f82-ee22-492d-b1f6-23fb5a5fc0b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbf18a8dda874d65bf5c95ce7a5b5a0a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:36.272441 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4256/8507] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:39:35 2022] DELETE /identity/v3/users/fbf18a8dda874d65bf5c95ce7a5b5a0a => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:39:36.276858 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefb388-b1fc-47f2-8ed7-8f0ef901214c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:36.277334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefb388-b1fc-47f2-8ed7-8f0ef901214c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:36.277454 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefb388-b1fc-47f2-8ed7-8f0ef901214c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:36.303189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b6f82-ee22-492d-b1f6-23fb5a5fc0b8 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:36.305070 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-510b6f82-ee22-492d-b1f6-23fb5a5fc0b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:36.307518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-daefb388-b1fc-47f2-8ed7-8f0ef901214c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:36.311164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-daefb388-b1fc-47f2-8ed7-8f0ef901214c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:36.437879 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b6f82-ee22-492d-b1f6-23fb5a5fc0b8 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:36.453905 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c9aa2-2203-401c-b1f9-187026e8611f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:36.455981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c9aa2-2203-401c-b1f9-187026e8611f service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:36.458096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c9aa2-2203-401c-b1f9-187026e8611f service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:36.458480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c9aa2-2203-401c-b1f9-187026e8611f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:36.465354 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d14c9aa2-2203-401c-b1f9-187026e8611f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:36.465548 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4252/8508] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:39:36.472977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefb388-b1fc-47f2-8ed7-8f0ef901214c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:36.474652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-daefb388-b1fc-47f2-8ed7-8f0ef901214c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:36.488342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c9aa2-2203-401c-b1f9-187026e8611f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:36.492937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c9aa2-2203-401c-b1f9-187026e8611f service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:36.515305 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4257/8509] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:39:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:39:36.590188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefb388-b1fc-47f2-8ed7-8f0ef901214c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:36.595386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8a589-976c-4fc5-93a8-48d36c4042ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:36.596024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8a589-976c-4fc5-93a8-48d36c4042ac service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:36.596305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8a589-976c-4fc5-93a8-48d36c4042ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:36.596627 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8a589-976c-4fc5-93a8-48d36c4042ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:36.649065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf8a589-976c-4fc5-93a8-48d36c4042ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:36.650683 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf8a589-976c-4fc5-93a8-48d36c4042ac service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:36.663336 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4253/8510] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:39:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:39:37.119700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c9aa2-2203-401c-b1f9-187026e8611f service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:37.121204 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d14c9aa2-2203-401c-b1f9-187026e8611f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:37.148545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c9aa2-2203-401c-b1f9-187026e8611f service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:37.159066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c359a-e032-4fc4-86c6-9755fe30b86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:37.159582 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c359a-e032-4fc4-86c6-9755fe30b86f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:37.159858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c359a-e032-4fc4-86c6-9755fe30b86f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:37.160130 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c359a-e032-4fc4-86c6-9755fe30b86f admin admin] PATH_INFO: `/v3/projects/c03e3e49bdd843eeaaade6fb46f0f0d4` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:37.166495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c359a-e032-4fc4-86c6-9755fe30b86f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c03e3e49bdd843eeaaade6fb46f0f0d4)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:37.168731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c359a-e032-4fc4-86c6-9755fe30b86f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:37.171428 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:37.250855 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-295c359a-e032-4fc4-86c6-9755fe30b86f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c03e3e49bdd843eeaaade6fb46f0f0d4', 'request_id': 'req-295c359a-e032-4fc4-86c6-9755fe30b86f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:37.264778 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-295c359a-e032-4fc4-86c6-9755fe30b86f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c03e3e49bdd843eeaaade6fb46f0f0d4', 'request_id': 'req-295c359a-e032-4fc4-86c6-9755fe30b86f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:37.275904 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-295c359a-e032-4fc4-86c6-9755fe30b86f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c03e3e49bdd843eeaaade6fb46f0f0d4', 'request_id': 'req-295c359a-e032-4fc4-86c6-9755fe30b86f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:37.290711 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-295c359a-e032-4fc4-86c6-9755fe30b86f admin admin] The token cache is being invalidate because project c03e3e49bdd843eeaaade6fb46f0f0d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:39:37.291390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-295c359a-e032-4fc4-86c6-9755fe30b86f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:37.292587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-295c359a-e032-4fc4-86c6-9755fe30b86f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:37.294672 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4258/8511] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:39:37 2022] DELETE /identity/v3/projects/c03e3e49bdd843eeaaade6fb46f0f0d4 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:39:37.298394 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8a589-976c-4fc5-93a8-48d36c4042ac service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:37.317013 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8a589-976c-4fc5-93a8-48d36c4042ac service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:37.353257 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:37.400877 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc0bb3-2c8e-4a2c-879b-f14c52bf3597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:37.402549 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc0bb3-2c8e-4a2c-879b-f14c52bf3597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:37.403129 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc0bb3-2c8e-4a2c-879b-f14c52bf3597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:37.403614 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc0bb3-2c8e-4a2c-879b-f14c52bf3597 admin admin] PATH_INFO: `/v3/users/9ca305c272e14732aceb702659feb40c` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:37.405188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bc0bb3-2c8e-4a2c-879b-f14c52bf3597 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ca305c272e14732aceb702659feb40c)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:37.407398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bc0bb3-2c8e-4a2c-879b-f14c52bf3597 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:37.471727 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f3bc0bb3-2c8e-4a2c-879b-f14c52bf3597 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ca305c272e14732aceb702659feb40c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:37.472733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f3bc0bb3-2c8e-4a2c-879b-f14c52bf3597 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ca305c272e14732aceb702659feb40c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:37.482229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f3bc0bb3-2c8e-4a2c-879b-f14c52bf3597 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ca305c272e14732aceb702659feb40c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:37.493035 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f3bc0bb3-2c8e-4a2c-879b-f14c52bf3597 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ca305c272e14732aceb702659feb40c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:37.495050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f3bc0bb3-2c8e-4a2c-879b-f14c52bf3597 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ca305c272e14732aceb702659feb40c'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:37.523624 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4254/8512] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:39:37 2022] DELETE /identity/v3/users/9ca305c272e14732aceb702659feb40c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:39:38.074280 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c359a-e032-4fc4-86c6-9755fe30b86f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:38.075777 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-295c359a-e032-4fc4-86c6-9755fe30b86f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:38.096911 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c359a-e032-4fc4-86c6-9755fe30b86f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:38.228443 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6769e3-c05d-485d-9fed-d4d03b547527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:38.232123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6769e3-c05d-485d-9fed-d4d03b547527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:38.232432 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6769e3-c05d-485d-9fed-d4d03b547527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:38.232976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6769e3-c05d-485d-9fed-d4d03b547527 admin admin] PATH_INFO: `/v3/projects/80cdc4d21d084dd69f317b04c09f4552` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:38.234455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6769e3-c05d-485d-9fed-d4d03b547527 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80cdc4d21d084dd69f317b04c09f4552)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:38.243891 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6769e3-c05d-485d-9fed-d4d03b547527 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:38.325923 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5e6769e3-c05d-485d-9fed-d4d03b547527 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80cdc4d21d084dd69f317b04c09f4552', 'request_id': 'req-5e6769e3-c05d-485d-9fed-d4d03b547527'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:38.336312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5e6769e3-c05d-485d-9fed-d4d03b547527 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80cdc4d21d084dd69f317b04c09f4552', 'request_id': 'req-5e6769e3-c05d-485d-9fed-d4d03b547527'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:38.343589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5e6769e3-c05d-485d-9fed-d4d03b547527 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80cdc4d21d084dd69f317b04c09f4552', 'request_id': 'req-5e6769e3-c05d-485d-9fed-d4d03b547527'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:38.356666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5e6769e3-c05d-485d-9fed-d4d03b547527 admin admin] The token cache is being invalidate because project 80cdc4d21d084dd69f317b04c09f4552 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:39:38.356947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5e6769e3-c05d-485d-9fed-d4d03b547527 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:38.360168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5e6769e3-c05d-485d-9fed-d4d03b547527 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:38.362048 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4259/8513] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:39:38 2022] DELETE /identity/v3/projects/80cdc4d21d084dd69f317b04c09f4552 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:39:38.366543 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75d15e-b16c-4dca-b760-c28fd3fbe761 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:38.366961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75d15e-b16c-4dca-b760-c28fd3fbe761 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:38.367080 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75d15e-b16c-4dca-b760-c28fd3fbe761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:38.394489 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-9c75d15e-b16c-4dca-b760-c28fd3fbe761 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:38.396123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9c75d15e-b16c-4dca-b760-c28fd3fbe761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:38.533304 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4255/8514] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:39:38.542592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05b39f-87f4-48c1-ba85-a8020ef5b168 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:38.542950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05b39f-87f4-48c1-ba85-a8020ef5b168 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:38.543127 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05b39f-87f4-48c1-ba85-a8020ef5b168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:38.565385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-1a05b39f-87f4-48c1-ba85-a8020ef5b168 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:38.566658 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1a05b39f-87f4-48c1-ba85-a8020ef5b168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:38.577490 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4260/8515] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:39:38.579655 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c75d15e-b16c-4dca-b760-c28fd3fbe761 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:38.590533 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c75d15e-b16c-4dca-b760-c28fd3fbe761 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:38.595841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd66c2-3ce5-4857-bea0-2010367dfc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:38.596594 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd66c2-3ce5-4857-bea0-2010367dfc83 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:38.596987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd66c2-3ce5-4857-bea0-2010367dfc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:38.598225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd66c2-3ce5-4857-bea0-2010367dfc83 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:38.599111 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fd66c2-3ce5-4857-bea0-2010367dfc83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:39:38.600301 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fd66c2-3ce5-4857-bea0-2010367dfc83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:38.601420 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fd66c2-3ce5-4857-bea0-2010367dfc83 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:38.617167 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4256/8516] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:39:38.621507 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05b39f-87f4-48c1-ba85-a8020ef5b168 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:38.631229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05b39f-87f4-48c1-ba85-a8020ef5b168 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:38.637290 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c01686-fcc7-4cec-9fb0-5e9ea8e1be83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:38.638101 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c01686-fcc7-4cec-9fb0-5e9ea8e1be83 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:38.638574 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c01686-fcc7-4cec-9fb0-5e9ea8e1be83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:38.638856 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c01686-fcc7-4cec-9fb0-5e9ea8e1be83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:38.641110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c01686-fcc7-4cec-9fb0-5e9ea8e1be83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:38.643832 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c01686-fcc7-4cec-9fb0-5e9ea8e1be83 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:38.662424 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:38.689582 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4261/8517] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:39:38 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:39:38.693782 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd66c2-3ce5-4857-bea0-2010367dfc83 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:38.706411 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd66c2-3ce5-4857-bea0-2010367dfc83 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:38.782381 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:38.851877 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1b013-e4b1-4713-9119-eff95d270c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:38.853272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1b013-e4b1-4713-9119-eff95d270c94 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:38.853638 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1b013-e4b1-4713-9119-eff95d270c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:38.853982 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1b013-e4b1-4713-9119-eff95d270c94 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:38.854693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1b013-e4b1-4713-9119-eff95d270c94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:38.859101 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1b013-e4b1-4713-9119-eff95d270c94 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:38.916463 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4257/8518] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:39:38 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:39:38.919198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c01686-fcc7-4cec-9fb0-5e9ea8e1be83 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:38.956744 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c01686-fcc7-4cec-9fb0-5e9ea8e1be83 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:38.970172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731f299-739c-4e18-8a48-84235a43f99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:38.973259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731f299-739c-4e18-8a48-84235a43f99a admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:38.973678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731f299-739c-4e18-8a48-84235a43f99a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:38.973962 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731f299-739c-4e18-8a48-84235a43f99a admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:38.974700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731f299-739c-4e18-8a48-84235a43f99a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:38.979416 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731f299-739c-4e18-8a48-84235a43f99a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:39.009151 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4262/8519] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:39:39.012295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1b013-e4b1-4713-9119-eff95d270c94 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:39.027392 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1b013-e4b1-4713-9119-eff95d270c94 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:39.032894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78adead3-3084-43ff-bc61-e91260dace88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:39.033563 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adead3-3084-43ff-bc61-e91260dace88 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:39.033847 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adead3-3084-43ff-bc61-e91260dace88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:39.034122 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adead3-3084-43ff-bc61-e91260dace88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:39.035168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78adead3-3084-43ff-bc61-e91260dace88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:39.037276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78adead3-3084-43ff-bc61-e91260dace88 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:39.070615 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4258/8520] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:39:39.085912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731f299-739c-4e18-8a48-84235a43f99a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:39.099816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731f299-739c-4e18-8a48-84235a43f99a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:39.105651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89add0-2a58-4ea9-9204-efd21606ffba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:39.106452 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89add0-2a58-4ea9-9204-efd21606ffba admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:39.107210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89add0-2a58-4ea9-9204-efd21606ffba admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:39.108061 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89add0-2a58-4ea9-9204-efd21606ffba admin admin] PATH_INFO: `/v3/projects/72c483e3cc3346f59918891406443ef7/users/6f5a71f0039a4ffabcb0a2389ed30134/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:39.132090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89add0-2a58-4ea9-9204-efd21606ffba admin admin] RBAC: Authorizing `identity:create_grant(project_id=72c483e3cc3346f59918891406443ef7, user_id=6f5a71f0039a4ffabcb0a2389ed30134, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:39.135666 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89add0-2a58-4ea9-9204-efd21606ffba admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:39.195155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b53a48-28db-4a24-81b6-ff26bef23fee None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:39.195443 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b53a48-28db-4a24-81b6-ff26bef23fee None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:39.195723 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b53a48-28db-4a24-81b6-ff26bef23fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:39.203252 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4263/8521] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:39:39 2022] PUT /identity/v3/projects/72c483e3cc3346f59918891406443ef7/users/6f5a71f0039a4ffabcb0a2389ed30134/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:39:39.252383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c7b53a48-28db-4a24-81b6-ff26bef23fee None None] MFA Rules not processed for user `6f5a71f0039a4ffabcb0a2389ed30134`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:39.254046 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c7b53a48-28db-4a24-81b6-ff26bef23fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:39.383973 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4259/8522] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:39:39.384822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89add0-2a58-4ea9-9204-efd21606ffba admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:39.485417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89add0-2a58-4ea9-9204-efd21606ffba admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:39.491506 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c963e-fc0c-489e-aa57-e898e5914195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:39.492330 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c963e-fc0c-489e-aa57-e898e5914195 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:39.493534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c963e-fc0c-489e-aa57-e898e5914195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:39.495759 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c963e-fc0c-489e-aa57-e898e5914195 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:39.510452 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c963e-fc0c-489e-aa57-e898e5914195 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:39.512543 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c963e-fc0c-489e-aa57-e898e5914195 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:39.556783 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4264/8523] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:39:39 2022] POST /identity/v3/projects => generated 385 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:39:39.560852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b53a48-28db-4a24-81b6-ff26bef23fee None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:39.578885 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b53a48-28db-4a24-81b6-ff26bef23fee None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:39.693300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d2ea5-ec4e-4d10-8235-5c3f54c48c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:39.694339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d2ea5-ec4e-4d10-8235-5c3f54c48c8c admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:39.699630 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d2ea5-ec4e-4d10-8235-5c3f54c48c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:39.700132 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d2ea5-ec4e-4d10-8235-5c3f54c48c8c admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:39.701259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d2ea5-ec4e-4d10-8235-5c3f54c48c8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:39.705703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d2ea5-ec4e-4d10-8235-5c3f54c48c8c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:39.744272 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4260/8524] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:39:39 2022] POST /identity/v3/users => generated 299 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:39:39.748312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c963e-fc0c-489e-aa57-e898e5914195 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:39.767602 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c963e-fc0c-489e-aa57-e898e5914195 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:39.783918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33479202-d6be-4663-9cf2-ede03be36677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:39.785148 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33479202-d6be-4663-9cf2-ede03be36677 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:39.785279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33479202-d6be-4663-9cf2-ede03be36677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:39.785621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33479202-d6be-4663-9cf2-ede03be36677 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:39.786566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33479202-d6be-4663-9cf2-ede03be36677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:39.788321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33479202-d6be-4663-9cf2-ede03be36677 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:39.811878 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4265/8525] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:39:39.814663 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d2ea5-ec4e-4d10-8235-5c3f54c48c8c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:39.826900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d2ea5-ec4e-4d10-8235-5c3f54c48c8c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:39.833299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa23968-847f-4805-9672-cd3353d0e842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:39.834723 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa23968-847f-4805-9672-cd3353d0e842 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:39.835175 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa23968-847f-4805-9672-cd3353d0e842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:39.835603 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa23968-847f-4805-9672-cd3353d0e842 admin admin] PATH_INFO: `/v3/projects/37793056b33e4b738eaeea50e4cb7fd1/users/026906202cf040c485b8088cdce7334d/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:39.869686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa23968-847f-4805-9672-cd3353d0e842 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37793056b33e4b738eaeea50e4cb7fd1, user_id=026906202cf040c485b8088cdce7334d, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:39.873125 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa23968-847f-4805-9672-cd3353d0e842 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:39.902480 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4261/8526] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:39:39 2022] PUT /identity/v3/projects/37793056b33e4b738eaeea50e4cb7fd1/users/026906202cf040c485b8088cdce7334d/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:39:39.906226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33479202-d6be-4663-9cf2-ede03be36677 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:39.919855 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33479202-d6be-4663-9cf2-ede03be36677 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:40.044941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ad611-8ed4-49bb-88aa-741535dc2825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:40.046280 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ad611-8ed4-49bb-88aa-741535dc2825 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:40.047717 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ad611-8ed4-49bb-88aa-741535dc2825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:40.048157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ad611-8ed4-49bb-88aa-741535dc2825 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:40.049040 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ad611-8ed4-49bb-88aa-741535dc2825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:40.052541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ad611-8ed4-49bb-88aa-741535dc2825 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:40.076666 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4266/8527] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:39:40.081215 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa23968-847f-4805-9672-cd3353d0e842 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:40.100781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa23968-847f-4805-9672-cd3353d0e842 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:40.111573 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfdced7-b94b-4069-93e9-7aa386367014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:40.112603 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdced7-b94b-4069-93e9-7aa386367014 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:40.112950 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdced7-b94b-4069-93e9-7aa386367014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:40.113323 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdced7-b94b-4069-93e9-7aa386367014 admin admin] PATH_INFO: `/v3/projects/37793056b33e4b738eaeea50e4cb7fd1/users/026906202cf040c485b8088cdce7334d/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:40.116633 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfdced7-b94b-4069-93e9-7aa386367014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37793056b33e4b738eaeea50e4cb7fd1, user_id=026906202cf040c485b8088cdce7334d, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:40.119802 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfdced7-b94b-4069-93e9-7aa386367014 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:40.123686 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:40.150862 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4262/8528] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:39:40 2022] PUT /identity/v3/projects/37793056b33e4b738eaeea50e4cb7fd1/users/026906202cf040c485b8088cdce7334d/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:39:40.162067 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff01d57-c7eb-471e-bea2-1c9fdfd74c26 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:40.162662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff01d57-c7eb-471e-bea2-1c9fdfd74c26 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:40.163162 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff01d57-c7eb-471e-bea2-1c9fdfd74c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:40.209484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-eff01d57-c7eb-471e-bea2-1c9fdfd74c26 None None] MFA Rules not processed for user `026906202cf040c485b8088cdce7334d`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:40.210446 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-eff01d57-c7eb-471e-bea2-1c9fdfd74c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:40.241734 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:40.351139 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4267/8529] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:40 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:39:40.368770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfdced7-b94b-4069-93e9-7aa386367014 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:40.370893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9cfdced7-b94b-4069-93e9-7aa386367014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:40.510601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfdced7-b94b-4069-93e9-7aa386367014 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:40.514276 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c02f55-6172-4ce0-b5b3-5778cd42bd88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:40.514934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c02f55-6172-4ce0-b5b3-5778cd42bd88 service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:40.515218 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c02f55-6172-4ce0-b5b3-5778cd42bd88 service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:40.515489 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c02f55-6172-4ce0-b5b3-5778cd42bd88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:40.532948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c02f55-6172-4ce0-b5b3-5778cd42bd88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:40.534450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c02f55-6172-4ce0-b5b3-5778cd42bd88 service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:40.546603 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4263/8530] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:39:40 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:39:41.335907 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff01d57-c7eb-471e-bea2-1c9fdfd74c26 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:41.337357 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-eff01d57-c7eb-471e-bea2-1c9fdfd74c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:41.466822 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c02f55-6172-4ce0-b5b3-5778cd42bd88 service cinder] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:41.519029 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff01d57-c7eb-471e-bea2-1c9fdfd74c26 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:41.536609 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c15f7b-47a1-4cc4-9dd1-e33179e9b6b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:41.537244 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c15f7b-47a1-4cc4-9dd1-e33179e9b6b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:41.537544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c15f7b-47a1-4cc4-9dd1-e33179e9b6b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:41.537818 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c15f7b-47a1-4cc4-9dd1-e33179e9b6b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:41.541985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c4c15f7b-47a1-4cc4-9dd1-e33179e9b6b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:41.610219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c02f55-6172-4ce0-b5b3-5778cd42bd88 service cinder] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:41.616355 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2346ea9-f538-4dab-8aab-adc95ea9efbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:41.617399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2346ea9-f538-4dab-8aab-adc95ea9efbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:41.617961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2346ea9-f538-4dab-8aab-adc95ea9efbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:41.618295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2346ea9-f538-4dab-8aab-adc95ea9efbf admin admin] PATH_INFO: `/v3/users/6f5a71f0039a4ffabcb0a2389ed30134` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:41.620194 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2346ea9-f538-4dab-8aab-adc95ea9efbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f5a71f0039a4ffabcb0a2389ed30134)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:41.622421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2346ea9-f538-4dab-8aab-adc95ea9efbf admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:41.645388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c15f7b-47a1-4cc4-9dd1-e33179e9b6b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:41.650550 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c15f7b-47a1-4cc4-9dd1-e33179e9b6b3 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:41.695499 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f2346ea9-f538-4dab-8aab-adc95ea9efbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f5a71f0039a4ffabcb0a2389ed30134'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:41.696220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f2346ea9-f538-4dab-8aab-adc95ea9efbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f5a71f0039a4ffabcb0a2389ed30134'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:41.705716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f2346ea9-f538-4dab-8aab-adc95ea9efbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f5a71f0039a4ffabcb0a2389ed30134'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:41.713856 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4268/8531] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:39:41 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:39:41.717252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f2346ea9-f538-4dab-8aab-adc95ea9efbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f5a71f0039a4ffabcb0a2389ed30134'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:41.718086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f2346ea9-f538-4dab-8aab-adc95ea9efbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f5a71f0039a4ffabcb0a2389ed30134'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:41.749554 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba974083-b7b6-4b4c-a17b-2ce149123766 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:41.749842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba974083-b7b6-4b4c-a17b-2ce149123766 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:41.750116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba974083-b7b6-4b4c-a17b-2ce149123766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:41.753390 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4264/8532] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:39:41 2022] DELETE /identity/v3/users/6f5a71f0039a4ffabcb0a2389ed30134 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:39:41.785337 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-ba974083-b7b6-4b4c-a17b-2ce149123766 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:41.786985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ba974083-b7b6-4b4c-a17b-2ce149123766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:41.919115 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:41.948293 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4269/8533] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:39:41.969083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2346ea9-f538-4dab-8aab-adc95ea9efbf admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:41.971379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f2346ea9-f538-4dab-8aab-adc95ea9efbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:42.006330 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:42.106781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2346ea9-f538-4dab-8aab-adc95ea9efbf admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:42.111410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36fc012-527e-4f94-b0c8-db4f90c2e88c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:42.112283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fc012-527e-4f94-b0c8-db4f90c2e88c service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:42.112564 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fc012-527e-4f94-b0c8-db4f90c2e88c service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:42.112834 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fc012-527e-4f94-b0c8-db4f90c2e88c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:42.127750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36fc012-527e-4f94-b0c8-db4f90c2e88c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:42.129930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36fc012-527e-4f94-b0c8-db4f90c2e88c service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:42.143278 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4265/8534] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:39:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:39:42.945137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba974083-b7b6-4b4c-a17b-2ce149123766 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:42.947209 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ba974083-b7b6-4b4c-a17b-2ce149123766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:42.978577 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba974083-b7b6-4b4c-a17b-2ce149123766 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:42.994925 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadddd1-a50d-48cc-b70f-61224b29fb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:42.995488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadddd1-a50d-48cc-b70f-61224b29fb1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:42.997689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadddd1-a50d-48cc-b70f-61224b29fb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:42.997985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadddd1-a50d-48cc-b70f-61224b29fb1d admin admin] PATH_INFO: `/v3/projects/72c483e3cc3346f59918891406443ef7` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:43.001949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afadddd1-a50d-48cc-b70f-61224b29fb1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=72c483e3cc3346f59918891406443ef7)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:43.010046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afadddd1-a50d-48cc-b70f-61224b29fb1d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:43.152119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-afadddd1-a50d-48cc-b70f-61224b29fb1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72c483e3cc3346f59918891406443ef7', 'request_id': 'req-afadddd1-a50d-48cc-b70f-61224b29fb1d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:43.174242 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-afadddd1-a50d-48cc-b70f-61224b29fb1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72c483e3cc3346f59918891406443ef7', 'request_id': 'req-afadddd1-a50d-48cc-b70f-61224b29fb1d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:43.185943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-afadddd1-a50d-48cc-b70f-61224b29fb1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72c483e3cc3346f59918891406443ef7', 'request_id': 'req-afadddd1-a50d-48cc-b70f-61224b29fb1d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:43.207940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-afadddd1-a50d-48cc-b70f-61224b29fb1d admin admin] The token cache is being invalidate because project 72c483e3cc3346f59918891406443ef7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:39:43.209025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-afadddd1-a50d-48cc-b70f-61224b29fb1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:43.214599 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-afadddd1-a50d-48cc-b70f-61224b29fb1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:43.216843 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4270/8535] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:39:42 2022] DELETE /identity/v3/projects/72c483e3cc3346f59918891406443ef7 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:39:43.220785 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36fc012-527e-4f94-b0c8-db4f90c2e88c service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:43.236767 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36fc012-527e-4f94-b0c8-db4f90c2e88c service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:43.372120 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6fc44-1349-4f92-aca7-0f09440b32cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:43.372775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6fc44-1349-4f92-aca7-0f09440b32cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:43.373058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6fc44-1349-4f92-aca7-0f09440b32cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:43.373331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6fc44-1349-4f92-aca7-0f09440b32cd admin admin] PATH_INFO: `/v3/users/026906202cf040c485b8088cdce7334d` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:43.374844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6fc44-1349-4f92-aca7-0f09440b32cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=026906202cf040c485b8088cdce7334d)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:43.376805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6fc44-1349-4f92-aca7-0f09440b32cd admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:43.463110 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b5f6fc44-1349-4f92-aca7-0f09440b32cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '026906202cf040c485b8088cdce7334d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:43.464587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b5f6fc44-1349-4f92-aca7-0f09440b32cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '026906202cf040c485b8088cdce7334d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:43.484499 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b5f6fc44-1349-4f92-aca7-0f09440b32cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '026906202cf040c485b8088cdce7334d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:43.507809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b5f6fc44-1349-4f92-aca7-0f09440b32cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '026906202cf040c485b8088cdce7334d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:43.508580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-b5f6fc44-1349-4f92-aca7-0f09440b32cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '026906202cf040c485b8088cdce7334d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:43.546489 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4266/8536] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:39:43 2022] DELETE /identity/v3/users/026906202cf040c485b8088cdce7334d => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:39:44.269671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadddd1-a50d-48cc-b70f-61224b29fb1d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:44.272588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-afadddd1-a50d-48cc-b70f-61224b29fb1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:44.299981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadddd1-a50d-48cc-b70f-61224b29fb1d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:44.431473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c8cb8-ac93-4911-a54a-8ca3fa0c5cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:44.432545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c8cb8-ac93-4911-a54a-8ca3fa0c5cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:44.432983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c8cb8-ac93-4911-a54a-8ca3fa0c5cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:44.433394 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c8cb8-ac93-4911-a54a-8ca3fa0c5cc2 admin admin] PATH_INFO: `/v3/projects/37793056b33e4b738eaeea50e4cb7fd1` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:44.436959 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c8cb8-ac93-4911-a54a-8ca3fa0c5cc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37793056b33e4b738eaeea50e4cb7fd1)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:44.441223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c8cb8-ac93-4911-a54a-8ca3fa0c5cc2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:44.578326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-482c8cb8-ac93-4911-a54a-8ca3fa0c5cc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37793056b33e4b738eaeea50e4cb7fd1', 'request_id': 'req-482c8cb8-ac93-4911-a54a-8ca3fa0c5cc2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:44.610192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-482c8cb8-ac93-4911-a54a-8ca3fa0c5cc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37793056b33e4b738eaeea50e4cb7fd1', 'request_id': 'req-482c8cb8-ac93-4911-a54a-8ca3fa0c5cc2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:44.623896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-482c8cb8-ac93-4911-a54a-8ca3fa0c5cc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37793056b33e4b738eaeea50e4cb7fd1', 'request_id': 'req-482c8cb8-ac93-4911-a54a-8ca3fa0c5cc2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:44.650611 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-482c8cb8-ac93-4911-a54a-8ca3fa0c5cc2 admin admin] The token cache is being invalidate because project 37793056b33e4b738eaeea50e4cb7fd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:39:44.650611 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-482c8cb8-ac93-4911-a54a-8ca3fa0c5cc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:44.651975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-482c8cb8-ac93-4911-a54a-8ca3fa0c5cc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:44.654758 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4271/8537] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:39:44 2022] DELETE /identity/v3/projects/37793056b33e4b738eaeea50e4cb7fd1 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:39:44.659697 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2910c-bc67-45e4-a069-752b3cd29be6 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:44.660863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2910c-bc67-45e4-a069-752b3cd29be6 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:44.661498 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2910c-bc67-45e4-a069-752b3cd29be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:44.688939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-d3d2910c-bc67-45e4-a069-752b3cd29be6 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:44.690590 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d3d2910c-bc67-45e4-a069-752b3cd29be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:44.760227 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:44.803832 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4267/8538] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:39:44.812558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e704f7-86e5-414f-a735-4b378fc37466 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:44.812847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e704f7-86e5-414f-a735-4b378fc37466 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:44.813129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e704f7-86e5-414f-a735-4b378fc37466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:44.848170 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:44.856948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c7e704f7-86e5-414f-a735-4b378fc37466 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:44.858476 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c7e704f7-86e5-414f-a735-4b378fc37466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:44.876200 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4272/8539] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:39:44.877610 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2910c-bc67-45e4-a069-752b3cd29be6 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:44.892434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2910c-bc67-45e4-a069-752b3cd29be6 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:44.907370 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755b80e-06f8-48e4-9901-f63636aad896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:44.908015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755b80e-06f8-48e4-9901-f63636aad896 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:44.908295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755b80e-06f8-48e4-9901-f63636aad896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:44.908571 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755b80e-06f8-48e4-9901-f63636aad896 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:44.909232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f755b80e-06f8-48e4-9901-f63636aad896 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:39:44.909588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f755b80e-06f8-48e4-9901-f63636aad896 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:44.911199 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f755b80e-06f8-48e4-9901-f63636aad896 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:44.945578 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4268/8540] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:39:44.946798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e704f7-86e5-414f-a735-4b378fc37466 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:44.960413 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e704f7-86e5-414f-a735-4b378fc37466 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:44.970920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f08cf-33af-4f35-a19c-5c7ed36f89ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:44.972276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f08cf-33af-4f35-a19c-5c7ed36f89ea admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:44.972276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f08cf-33af-4f35-a19c-5c7ed36f89ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:44.975875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f08cf-33af-4f35-a19c-5c7ed36f89ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:44.975875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f08cf-33af-4f35-a19c-5c7ed36f89ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:44.982455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f08cf-33af-4f35-a19c-5c7ed36f89ea admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:45.050337 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4273/8541] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:39:44 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:39:45.051494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755b80e-06f8-48e4-9901-f63636aad896 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:45.062999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755b80e-06f8-48e4-9901-f63636aad896 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:45.187793 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da27e1-ed8d-4658-ad63-10ad0f784c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:45.188592 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da27e1-ed8d-4658-ad63-10ad0f784c7c admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:45.188880 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da27e1-ed8d-4658-ad63-10ad0f784c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:45.189361 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da27e1-ed8d-4658-ad63-10ad0f784c7c admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:45.190040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da27e1-ed8d-4658-ad63-10ad0f784c7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:45.194477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da27e1-ed8d-4658-ad63-10ad0f784c7c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:45.241407 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4269/8542] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:39:45 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:39:45.245290 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f08cf-33af-4f35-a19c-5c7ed36f89ea admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:45.262111 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f08cf-33af-4f35-a19c-5c7ed36f89ea admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:45.269451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799a38e-b34d-43de-8d6d-a33656f54134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:45.270160 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799a38e-b34d-43de-8d6d-a33656f54134 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:45.272881 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799a38e-b34d-43de-8d6d-a33656f54134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:45.273402 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799a38e-b34d-43de-8d6d-a33656f54134 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:45.275009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799a38e-b34d-43de-8d6d-a33656f54134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:45.277116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799a38e-b34d-43de-8d6d-a33656f54134 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:45.291648 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4274/8543] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:39:45.295268 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da27e1-ed8d-4658-ad63-10ad0f784c7c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:45.307699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da27e1-ed8d-4658-ad63-10ad0f784c7c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:45.314316 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7fc22-7a69-4aa0-b19d-7fad8a4799ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:45.315199 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7fc22-7a69-4aa0-b19d-7fad8a4799ed admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:45.315573 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7fc22-7a69-4aa0-b19d-7fad8a4799ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:45.315944 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7fc22-7a69-4aa0-b19d-7fad8a4799ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:45.316688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7fc22-7a69-4aa0-b19d-7fad8a4799ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:45.318427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7fc22-7a69-4aa0-b19d-7fad8a4799ed admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:45.332910 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4270/8544] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:39:45.337286 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799a38e-b34d-43de-8d6d-a33656f54134 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:45.352829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799a38e-b34d-43de-8d6d-a33656f54134 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:45.359320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e337a10-f412-401c-906f-0228c3c1b7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:45.360281 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e337a10-f412-401c-906f-0228c3c1b7db admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:45.361678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e337a10-f412-401c-906f-0228c3c1b7db admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:45.362083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e337a10-f412-401c-906f-0228c3c1b7db admin admin] PATH_INFO: `/v3/projects/88d392c375ec442db82f44fdcf3c6433/users/2c46d7a7ff1f426d8831eed9df6b2c29/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:45.382524 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e337a10-f412-401c-906f-0228c3c1b7db admin admin] RBAC: Authorizing `identity:create_grant(project_id=88d392c375ec442db82f44fdcf3c6433, user_id=2c46d7a7ff1f426d8831eed9df6b2c29, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:45.386777 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e337a10-f412-401c-906f-0228c3c1b7db admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:45.414581 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4275/8545] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:39:45 2022] PUT /identity/v3/projects/88d392c375ec442db82f44fdcf3c6433/users/2c46d7a7ff1f426d8831eed9df6b2c29/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:39:45.425401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1d078-08d5-4da3-a457-90bd577c9734 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:45.426086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1d078-08d5-4da3-a457-90bd577c9734 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:45.426467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1d078-08d5-4da3-a457-90bd577c9734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:45.460006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-f1b1d078-08d5-4da3-a457-90bd577c9734 None None] MFA Rules not processed for user `2c46d7a7ff1f426d8831eed9df6b2c29`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:45.461999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f1b1d078-08d5-4da3-a457-90bd577c9734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:45.544936 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4271/8546] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:39:45.546610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e337a10-f412-401c-906f-0228c3c1b7db admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:45.674163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e337a10-f412-401c-906f-0228c3c1b7db admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:45.679810 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2f9cf-0dd9-45e4-ac0c-8d6e6d25c283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:45.681008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2f9cf-0dd9-45e4-ac0c-8d6e6d25c283 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:45.681289 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2f9cf-0dd9-45e4-ac0c-8d6e6d25c283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:45.681598 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2f9cf-0dd9-45e4-ac0c-8d6e6d25c283 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:45.682259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2f9cf-0dd9-45e4-ac0c-8d6e6d25c283 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:45.684610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2f9cf-0dd9-45e4-ac0c-8d6e6d25c283 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:45.745155 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4276/8547] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:39:45 2022] POST /identity/v3/projects => generated 381 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:39:45.748784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b1d078-08d5-4da3-a457-90bd577c9734 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:45.767457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b1d078-08d5-4da3-a457-90bd577c9734 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:45.844429 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:45.891345 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec4743-0de2-4ca9-9574-daad11215a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:45.891345 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec4743-0de2-4ca9-9574-daad11215a29 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:45.891345 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec4743-0de2-4ca9-9574-daad11215a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:45.891345 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec4743-0de2-4ca9-9574-daad11215a29 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:45.892725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec4743-0de2-4ca9-9574-daad11215a29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:45.897789 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec4743-0de2-4ca9-9574-daad11215a29 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:45.935992 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4272/8548] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:39:45 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:39:45.939518 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2f9cf-0dd9-45e4-ac0c-8d6e6d25c283 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:45.951942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2f9cf-0dd9-45e4-ac0c-8d6e6d25c283 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:45.963621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3a859-7c25-464c-a14a-21fef5b4b2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:45.966456 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3a859-7c25-464c-a14a-21fef5b4b2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:45.967041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3a859-7c25-464c-a14a-21fef5b4b2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:45.968025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3a859-7c25-464c-a14a-21fef5b4b2b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:45.969392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3a859-7c25-464c-a14a-21fef5b4b2b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:45.974401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3a859-7c25-464c-a14a-21fef5b4b2b1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:46.008201 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4277/8549] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:39:46.010126 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec4743-0de2-4ca9-9574-daad11215a29 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:46.025987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec4743-0de2-4ca9-9574-daad11215a29 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:46.037217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a3c1e-21a5-4179-9833-c480ebdc69ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:46.039119 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a3c1e-21a5-4179-9833-c480ebdc69ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:46.039701 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a3c1e-21a5-4179-9833-c480ebdc69ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:46.042434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a3c1e-21a5-4179-9833-c480ebdc69ca admin admin] PATH_INFO: `/v3/projects/65e295fc512b4c0691164cdddd324393/users/382e59e369d9461ba138e30bd6d658c4/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:46.079498 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3a859-7c25-464c-a14a-21fef5b4b2b1 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:46.081834 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bfe3a859-7c25-464c-a14a-21fef5b4b2b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:46.104493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a3c1e-21a5-4179-9833-c480ebdc69ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=65e295fc512b4c0691164cdddd324393, user_id=382e59e369d9461ba138e30bd6d658c4, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:46.114007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3a859-7c25-464c-a14a-21fef5b4b2b1 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:46.115856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a3c1e-21a5-4179-9833-c480ebdc69ca admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:46.128236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b408f80-119e-4173-b54a-6e2b60ddef89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:46.129046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b408f80-119e-4173-b54a-6e2b60ddef89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:46.129332 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b408f80-119e-4173-b54a-6e2b60ddef89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:46.129618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b408f80-119e-4173-b54a-6e2b60ddef89 admin admin] PATH_INFO: `/v3/users/0ec032a1c31644a0827369e5982444d2` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:46.130826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b408f80-119e-4173-b54a-6e2b60ddef89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ec032a1c31644a0827369e5982444d2)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:46.132895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b408f80-119e-4173-b54a-6e2b60ddef89 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:46.158497 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4273/8550] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:39:46 2022] PUT /identity/v3/projects/65e295fc512b4c0691164cdddd324393/users/382e59e369d9461ba138e30bd6d658c4/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:39:46.173205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a3c1e-21a5-4179-9833-c480ebdc69ca admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:46.335487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5b408f80-119e-4173-b54a-6e2b60ddef89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ec032a1c31644a0827369e5982444d2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:46.336273 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5b408f80-119e-4173-b54a-6e2b60ddef89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ec032a1c31644a0827369e5982444d2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:46.356503 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5b408f80-119e-4173-b54a-6e2b60ddef89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ec032a1c31644a0827369e5982444d2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:46.370305 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5b408f80-119e-4173-b54a-6e2b60ddef89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ec032a1c31644a0827369e5982444d2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:46.370984 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5b408f80-119e-4173-b54a-6e2b60ddef89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ec032a1c31644a0827369e5982444d2'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:46.387597 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:46.396838 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a3c1e-21a5-4179-9833-c480ebdc69ca admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:46.409152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80bcb98-4ddd-43d8-b1b3-ce8bfcc0ebb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:46.411337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bcb98-4ddd-43d8-b1b3-ce8bfcc0ebb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:46.411671 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bcb98-4ddd-43d8-b1b3-ce8bfcc0ebb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:46.411952 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bcb98-4ddd-43d8-b1b3-ce8bfcc0ebb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:46.412849 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4278/8551] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:39:46 2022] DELETE /identity/v3/users/0ec032a1c31644a0827369e5982444d2 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:39:46.413037 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80bcb98-4ddd-43d8-b1b3-ce8bfcc0ebb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:46.415374 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80bcb98-4ddd-43d8-b1b3-ce8bfcc0ebb6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:46.417720 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861be4c-8adc-435c-93ee-55ba60cb2dcc None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:46.418005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861be4c-8adc-435c-93ee-55ba60cb2dcc None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:46.418279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861be4c-8adc-435c-93ee-55ba60cb2dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:46.445531 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4274/8552] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:39:46.453343 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80bcb98-4ddd-43d8-b1b3-ce8bfcc0ebb6 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:46.457030 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a80bcb98-4ddd-43d8-b1b3-ce8bfcc0ebb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:46.474107 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-a861be4c-8adc-435c-93ee-55ba60cb2dcc None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:46.475364 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a861be4c-8adc-435c-93ee-55ba60cb2dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:46.500033 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80bcb98-4ddd-43d8-b1b3-ce8bfcc0ebb6 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:46.619624 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4279/8553] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:39:46.628079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861be4c-8adc-435c-93ee-55ba60cb2dcc None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:46.629634 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a861be4c-8adc-435c-93ee-55ba60cb2dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:46.631550 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb0da8-f02c-4152-8a8c-fafdd292552e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:46.632502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb0da8-f02c-4152-8a8c-fafdd292552e admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:46.633764 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb0da8-f02c-4152-8a8c-fafdd292552e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:46.634253 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb0da8-f02c-4152-8a8c-fafdd292552e admin admin] PATH_INFO: `/v3/projects/65e295fc512b4c0691164cdddd324393/users/382e59e369d9461ba138e30bd6d658c4/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:46.640498 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb0da8-f02c-4152-8a8c-fafdd292552e admin admin] RBAC: Authorizing `identity:create_grant(project_id=65e295fc512b4c0691164cdddd324393, user_id=382e59e369d9461ba138e30bd6d658c4, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:46.643551 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb0da8-f02c-4152-8a8c-fafdd292552e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:46.669012 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4275/8554] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:39:46 2022] PUT /identity/v3/projects/65e295fc512b4c0691164cdddd324393/users/382e59e369d9461ba138e30bd6d658c4/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:39:46.682093 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a254d8a-782b-423a-bb89-85b5ea5f32c7 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:46.682915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a254d8a-782b-423a-bb89-85b5ea5f32c7 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:46.683421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a254d8a-782b-423a-bb89-85b5ea5f32c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:46.737679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-7a254d8a-782b-423a-bb89-85b5ea5f32c7 None None] MFA Rules not processed for user `382e59e369d9461ba138e30bd6d658c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:46.739361 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7a254d8a-782b-423a-bb89-85b5ea5f32c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:46.766579 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861be4c-8adc-435c-93ee-55ba60cb2dcc None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:46.778130 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:46.867063 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4276/8555] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:46 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:39:46.880061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a254d8a-782b-423a-bb89-85b5ea5f32c7 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:46.881728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7a254d8a-782b-423a-bb89-85b5ea5f32c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:46.895274 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cea68e-6ce4-4c49-a8e9-6251d342f33b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:46.896015 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cea68e-6ce4-4c49-a8e9-6251d342f33b service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:46.896404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cea68e-6ce4-4c49-a8e9-6251d342f33b service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:46.896704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cea68e-6ce4-4c49-a8e9-6251d342f33b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:46.974953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a254d8a-782b-423a-bb89-85b5ea5f32c7 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:46.983453 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e612a-d09d-474b-9495-678acbd8f2a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:46.984385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e612a-d09d-474b-9495-678acbd8f2a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:46.985057 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e612a-d09d-474b-9495-678acbd8f2a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:46.985768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e612a-d09d-474b-9495-678acbd8f2a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:47.016205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e612a-d09d-474b-9495-678acbd8f2a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:47.022686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e612a-d09d-474b-9495-678acbd8f2a6 service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:47.034784 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:47.039039 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cea68e-6ce4-4c49-a8e9-6251d342f33b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:47.042619 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cea68e-6ce4-4c49-a8e9-6251d342f33b service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:47.057959 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4280/8556] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:39:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:39:47.074691 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4277/8557] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:39:46 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:39:47.224679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cea68e-6ce4-4c49-a8e9-6251d342f33b service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:47.255741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cea68e-6ce4-4c49-a8e9-6251d342f33b service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:47.265573 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a28bc-2541-4d46-a91e-029c069e1125 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:47.267522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a28bc-2541-4d46-a91e-029c069e1125 service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:47.268676 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a28bc-2541-4d46-a91e-029c069e1125 service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:47.270948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a28bc-2541-4d46-a91e-029c069e1125 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:47.273860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e82a28bc-2541-4d46-a91e-029c069e1125 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:47.444685 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82a28bc-2541-4d46-a91e-029c069e1125 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:47.446601 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82a28bc-2541-4d46-a91e-029c069e1125 service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:47.472841 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4281/8558] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:39:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:39:47.730627 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e612a-d09d-474b-9495-678acbd8f2a6 service cinder] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:47.732354 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4e8e612a-d09d-474b-9495-678acbd8f2a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:47.761322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e612a-d09d-474b-9495-678acbd8f2a6 service cinder] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:47.776305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c4b6a-fcbd-453d-a281-e87faca614ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:47.776965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c4b6a-fcbd-453d-a281-e87faca614ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:47.777248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c4b6a-fcbd-453d-a281-e87faca614ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:47.777620 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c4b6a-fcbd-453d-a281-e87faca614ea admin admin] PATH_INFO: `/v3/projects/5f52b9467bcc4f02a9c3ca667dd19398` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:47.788182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c4b6a-fcbd-453d-a281-e87faca614ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f52b9467bcc4f02a9c3ca667dd19398)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:47.792619 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c4b6a-fcbd-453d-a281-e87faca614ea admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:47.931651 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-657c4b6a-fcbd-453d-a281-e87faca614ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f52b9467bcc4f02a9c3ca667dd19398', 'request_id': 'req-657c4b6a-fcbd-453d-a281-e87faca614ea'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:47.937234 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a28bc-2541-4d46-a91e-029c069e1125 service cinder] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:47.950024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-657c4b6a-fcbd-453d-a281-e87faca614ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f52b9467bcc4f02a9c3ca667dd19398', 'request_id': 'req-657c4b6a-fcbd-453d-a281-e87faca614ea'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:47.951420 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a28bc-2541-4d46-a91e-029c069e1125 service cinder] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:47.962638 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-657c4b6a-fcbd-453d-a281-e87faca614ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f52b9467bcc4f02a9c3ca667dd19398', 'request_id': 'req-657c4b6a-fcbd-453d-a281-e87faca614ea'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:47.975561 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-657c4b6a-fcbd-453d-a281-e87faca614ea admin admin] The token cache is being invalidate because project 5f52b9467bcc4f02a9c3ca667dd19398 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:39:47.976170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-657c4b6a-fcbd-453d-a281-e87faca614ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:47.977133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-657c4b6a-fcbd-453d-a281-e87faca614ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:47.979221 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4278/8559] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:39:47 2022] DELETE /identity/v3/projects/5f52b9467bcc4f02a9c3ca667dd19398 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:39:47.984252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94dc26-4c6b-4c20-9b68-a143488617d6 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:47.984740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94dc26-4c6b-4c20-9b68-a143488617d6 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:47.985200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94dc26-4c6b-4c20-9b68-a143488617d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:48.015439 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ba94dc26-4c6b-4c20-9b68-a143488617d6 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:48.016661 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ba94dc26-4c6b-4c20-9b68-a143488617d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:48.056061 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c534a77-4ebb-4121-8634-36a529a06b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:48.056755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c534a77-4ebb-4121-8634-36a529a06b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:48.057040 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c534a77-4ebb-4121-8634-36a529a06b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:48.057318 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c534a77-4ebb-4121-8634-36a529a06b28 admin admin] PATH_INFO: `/v3/users/2c46d7a7ff1f426d8831eed9df6b2c29` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:48.058963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c534a77-4ebb-4121-8634-36a529a06b28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c46d7a7ff1f426d8831eed9df6b2c29)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:48.061478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c534a77-4ebb-4121-8634-36a529a06b28 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:48.072633 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:48.134929 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4279/8560] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:39:48.143377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12c23b-a753-4246-a23f-20a2dc7e4da0 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:48.143680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12c23b-a753-4246-a23f-20a2dc7e4da0 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:48.143930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12c23b-a753-4246-a23f-20a2dc7e4da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:48.158766 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5c534a77-4ebb-4121-8634-36a529a06b28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c46d7a7ff1f426d8831eed9df6b2c29'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:48.160048 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5c534a77-4ebb-4121-8634-36a529a06b28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c46d7a7ff1f426d8831eed9df6b2c29'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:48.172573 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ab12c23b-a753-4246-a23f-20a2dc7e4da0 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:48.174522 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ab12c23b-a753-4246-a23f-20a2dc7e4da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:48.178021 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5c534a77-4ebb-4121-8634-36a529a06b28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c46d7a7ff1f426d8831eed9df6b2c29'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:48.186160 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4280/8561] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:39:48.189247 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5c534a77-4ebb-4121-8634-36a529a06b28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c46d7a7ff1f426d8831eed9df6b2c29'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:48.190025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5c534a77-4ebb-4121-8634-36a529a06b28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c46d7a7ff1f426d8831eed9df6b2c29'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:48.191684 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12c23b-a753-4246-a23f-20a2dc7e4da0 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:48.207635 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12c23b-a753-4246-a23f-20a2dc7e4da0 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:48.216507 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cfa724-6dac-46e8-9de1-ac9c6c375719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:48.217707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfa724-6dac-46e8-9de1-ac9c6c375719 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:48.218372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfa724-6dac-46e8-9de1-ac9c6c375719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:48.218807 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfa724-6dac-46e8-9de1-ac9c6c375719 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:48.219679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cfa724-6dac-46e8-9de1-ac9c6c375719 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:39:48.220088 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cfa724-6dac-46e8-9de1-ac9c6c375719 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:48.221852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cfa724-6dac-46e8-9de1-ac9c6c375719 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:48.222125 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4282/8562] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:39:47 2022] DELETE /identity/v3/users/2c46d7a7ff1f426d8831eed9df6b2c29 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:39:48.229758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412f273-ccac-48fd-9051-bb8c8d955436 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:48.230054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412f273-ccac-48fd-9051-bb8c8d955436 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:48.230333 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412f273-ccac-48fd-9051-bb8c8d955436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:48.241646 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4281/8563] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:39:48.246601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cfa724-6dac-46e8-9de1-ac9c6c375719 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:48.256417 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5412f273-ccac-48fd-9051-bb8c8d955436 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:48.258095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5412f273-ccac-48fd-9051-bb8c8d955436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:48.259376 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cfa724-6dac-46e8-9de1-ac9c6c375719 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:48.271315 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:48.344921 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4283/8564] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:39:48.348808 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec248c31-4674-4cc7-91e0-c86f19de48f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:48.349565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec248c31-4674-4cc7-91e0-c86f19de48f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:48.349960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec248c31-4674-4cc7-91e0-c86f19de48f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:48.350331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec248c31-4674-4cc7-91e0-c86f19de48f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:48.351755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412f273-ccac-48fd-9051-bb8c8d955436 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:48.352810 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec248c31-4674-4cc7-91e0-c86f19de48f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:48.353860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5412f273-ccac-48fd-9051-bb8c8d955436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:48.356944 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec248c31-4674-4cc7-91e0-c86f19de48f8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:48.405565 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4282/8565] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:39:48 2022] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:39:48.408135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec248c31-4674-4cc7-91e0-c86f19de48f8 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:48.447973 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412f273-ccac-48fd-9051-bb8c8d955436 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:48.528824 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49817ab8-dc83-4c06-af20-0d0329c2ece3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:48.530310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49817ab8-dc83-4c06-af20-0d0329c2ece3 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:48.530758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49817ab8-dc83-4c06-af20-0d0329c2ece3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:48.531462 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49817ab8-dc83-4c06-af20-0d0329c2ece3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:48.540039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec248c31-4674-4cc7-91e0-c86f19de48f8 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:48.545089 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33697605-987d-4c5a-9fa4-f90f7e98892e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:48.545729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33697605-987d-4c5a-9fa4-f90f7e98892e admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:48.546010 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33697605-987d-4c5a-9fa4-f90f7e98892e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:48.546282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33697605-987d-4c5a-9fa4-f90f7e98892e admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:48.547249 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33697605-987d-4c5a-9fa4-f90f7e98892e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:48.548864 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49817ab8-dc83-4c06-af20-0d0329c2ece3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:48.549232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33697605-987d-4c5a-9fa4-f90f7e98892e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:48.551285 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49817ab8-dc83-4c06-af20-0d0329c2ece3 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:48.563654 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4284/8566] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:39:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:39:48.582665 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4283/8567] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:39:48 2022] POST /identity/v3/users => generated 291 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:39:48.586383 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49817ab8-dc83-4c06-af20-0d0329c2ece3 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:48.597802 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49817ab8-dc83-4c06-af20-0d0329c2ece3 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:48.604809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51767b8c-65b7-4cee-8826-6bb8108cadc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:48.605720 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51767b8c-65b7-4cee-8826-6bb8108cadc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:48.606015 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51767b8c-65b7-4cee-8826-6bb8108cadc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:48.606289 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51767b8c-65b7-4cee-8826-6bb8108cadc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:48.606947 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51767b8c-65b7-4cee-8826-6bb8108cadc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:48.608821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51767b8c-65b7-4cee-8826-6bb8108cadc7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:48.623771 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4285/8568] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:39:48.627883 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33697605-987d-4c5a-9fa4-f90f7e98892e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:48.656603 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33697605-987d-4c5a-9fa4-f90f7e98892e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:48.669992 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe8929-09fe-400c-a026-27803c382f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:48.671594 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe8929-09fe-400c-a026-27803c382f45 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:48.672729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe8929-09fe-400c-a026-27803c382f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:48.673214 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe8929-09fe-400c-a026-27803c382f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:48.673921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe8929-09fe-400c-a026-27803c382f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:48.675572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe8929-09fe-400c-a026-27803c382f45 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:48.692683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51767b8c-65b7-4cee-8826-6bb8108cadc7 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:48.700465 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4284/8569] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:39:48.705068 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51767b8c-65b7-4cee-8826-6bb8108cadc7 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:48.710994 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff48b90-4579-4d02-8467-116bf6390ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:48.712125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff48b90-4579-4d02-8467-116bf6390ea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:48.712562 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff48b90-4579-4d02-8467-116bf6390ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:48.713756 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff48b90-4579-4d02-8467-116bf6390ea7 admin admin] PATH_INFO: `/v3/projects/03bb90ba4ab241f691d7971f2c98d806/users/7882b11bb83c4278963556f404f10b1f/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:48.738078 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff48b90-4579-4d02-8467-116bf6390ea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03bb90ba4ab241f691d7971f2c98d806, user_id=7882b11bb83c4278963556f404f10b1f, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:48.745492 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff48b90-4579-4d02-8467-116bf6390ea7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:48.775172 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4286/8570] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:39:48 2022] PUT /identity/v3/projects/03bb90ba4ab241f691d7971f2c98d806/users/7882b11bb83c4278963556f404f10b1f/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:39:48.780901 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de97c7c-c301-4e84-b27d-90663318a904 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:48.781195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de97c7c-c301-4e84-b27d-90663318a904 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:48.781512 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de97c7c-c301-4e84-b27d-90663318a904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:48.822412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-6de97c7c-c301-4e84-b27d-90663318a904 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:48.823657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6de97c7c-c301-4e84-b27d-90663318a904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:48.853920 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:48.906723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff48b90-4579-4d02-8467-116bf6390ea7 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:48.908793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6ff48b90-4579-4d02-8467-116bf6390ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:48.921577 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4285/8571] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:39:48.930182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de97c7c-c301-4e84-b27d-90663318a904 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:48.937878 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff48b90-4579-4d02-8467-116bf6390ea7 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:48.949951 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af01cc-dc0d-456d-b136-665ad1f67578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:48.950607 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af01cc-dc0d-456d-b136-665ad1f67578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:48.950889 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af01cc-dc0d-456d-b136-665ad1f67578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:48.951162 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af01cc-dc0d-456d-b136-665ad1f67578 admin admin] PATH_INFO: `/v3/projects/88d392c375ec442db82f44fdcf3c6433` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:48.952660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af01cc-dc0d-456d-b136-665ad1f67578 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88d392c375ec442db82f44fdcf3c6433)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:48.955651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af01cc-dc0d-456d-b136-665ad1f67578 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:49.013971 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:49.021577 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de97c7c-c301-4e84-b27d-90663318a904 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:49.031691 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f5af01cc-dc0d-456d-b136-665ad1f67578 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88d392c375ec442db82f44fdcf3c6433', 'request_id': 'req-f5af01cc-dc0d-456d-b136-665ad1f67578'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:49.041211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f5af01cc-dc0d-456d-b136-665ad1f67578 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88d392c375ec442db82f44fdcf3c6433', 'request_id': 'req-f5af01cc-dc0d-456d-b136-665ad1f67578'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:49.050877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f5af01cc-dc0d-456d-b136-665ad1f67578 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88d392c375ec442db82f44fdcf3c6433', 'request_id': 'req-f5af01cc-dc0d-456d-b136-665ad1f67578'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:49.073542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f5af01cc-dc0d-456d-b136-665ad1f67578 admin admin] The token cache is being invalidate because project 88d392c375ec442db82f44fdcf3c6433 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:39:49.074325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f5af01cc-dc0d-456d-b136-665ad1f67578 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:49.074540 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-f5af01cc-dc0d-456d-b136-665ad1f67578 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:49.080541 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4287/8572] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:39:48 2022] DELETE /identity/v3/projects/88d392c375ec442db82f44fdcf3c6433 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:39:49.082526 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af01cc-dc0d-456d-b136-665ad1f67578 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:49.084736 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f5af01cc-dc0d-456d-b136-665ad1f67578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:49.101983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd452d-8d71-4944-aac4-dd7346728a5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:49.104184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd452d-8d71-4944-aac4-dd7346728a5f service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:49.104776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd452d-8d71-4944-aac4-dd7346728a5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:49.105264 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd452d-8d71-4944-aac4-dd7346728a5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:49.111366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c9fd452d-8d71-4944-aac4-dd7346728a5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:49.171501 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af01cc-dc0d-456d-b136-665ad1f67578 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:49.179567 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306ba03-101e-4661-9dcc-ef11d7269baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:49.180785 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306ba03-101e-4661-9dcc-ef11d7269baf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:49.181033 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306ba03-101e-4661-9dcc-ef11d7269baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:49.181326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306ba03-101e-4661-9dcc-ef11d7269baf admin admin] PATH_INFO: `/v3/users/382e59e369d9461ba138e30bd6d658c4` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:49.182672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e306ba03-101e-4661-9dcc-ef11d7269baf admin admin] RBAC: Authorizing `identity:delete_user(user_id=382e59e369d9461ba138e30bd6d658c4)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:49.185081 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e306ba03-101e-4661-9dcc-ef11d7269baf admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:49.199543 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd452d-8d71-4944-aac4-dd7346728a5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:49.201215 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd452d-8d71-4944-aac4-dd7346728a5f service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:49.212621 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4286/8573] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:39:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:39:49.254838 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e306ba03-101e-4661-9dcc-ef11d7269baf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '382e59e369d9461ba138e30bd6d658c4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:49.255635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e306ba03-101e-4661-9dcc-ef11d7269baf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '382e59e369d9461ba138e30bd6d658c4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:49.266251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e306ba03-101e-4661-9dcc-ef11d7269baf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '382e59e369d9461ba138e30bd6d658c4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:49.275911 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e306ba03-101e-4661-9dcc-ef11d7269baf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '382e59e369d9461ba138e30bd6d658c4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:49.277069 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e306ba03-101e-4661-9dcc-ef11d7269baf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '382e59e369d9461ba138e30bd6d658c4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:49.301270 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4288/8574] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:39:49 2022] DELETE /identity/v3/users/382e59e369d9461ba138e30bd6d658c4 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:39:49.847266 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd452d-8d71-4944-aac4-dd7346728a5f service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:49.866156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd452d-8d71-4944-aac4-dd7346728a5f service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:49.915708 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:49.955402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49675e-b833-4edd-a42e-5d9fd6114d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:49.956476 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49675e-b833-4edd-a42e-5d9fd6114d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:49.956914 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49675e-b833-4edd-a42e-5d9fd6114d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:49.958097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49675e-b833-4edd-a42e-5d9fd6114d7d admin admin] PATH_INFO: `/v3/projects/65e295fc512b4c0691164cdddd324393` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:49.960212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49675e-b833-4edd-a42e-5d9fd6114d7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=65e295fc512b4c0691164cdddd324393)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:49.963013 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49675e-b833-4edd-a42e-5d9fd6114d7d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:50.026379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5d49675e-b833-4edd-a42e-5d9fd6114d7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65e295fc512b4c0691164cdddd324393', 'request_id': 'req-5d49675e-b833-4edd-a42e-5d9fd6114d7d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:50.056004 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5d49675e-b833-4edd-a42e-5d9fd6114d7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65e295fc512b4c0691164cdddd324393', 'request_id': 'req-5d49675e-b833-4edd-a42e-5d9fd6114d7d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:50.063614 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5d49675e-b833-4edd-a42e-5d9fd6114d7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65e295fc512b4c0691164cdddd324393', 'request_id': 'req-5d49675e-b833-4edd-a42e-5d9fd6114d7d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:50.076568 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5d49675e-b833-4edd-a42e-5d9fd6114d7d admin admin] The token cache is being invalidate because project 65e295fc512b4c0691164cdddd324393 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:39:50.076886 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5d49675e-b833-4edd-a42e-5d9fd6114d7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:50.077679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5d49675e-b833-4edd-a42e-5d9fd6114d7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:39:50.079554 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4287/8575] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:39:49 2022] DELETE /identity/v3/projects/65e295fc512b4c0691164cdddd324393 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:39:50.084257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c100d-8264-4371-9000-9fe1b1b3dbed None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:50.084774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c100d-8264-4371-9000-9fe1b1b3dbed None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:50.084885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c100d-8264-4371-9000-9fe1b1b3dbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:50.108029 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-6b4c100d-8264-4371-9000-9fe1b1b3dbed None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:50.109248 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6b4c100d-8264-4371-9000-9fe1b1b3dbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:50.156613 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63acd362-511a-4b1e-9f57-6dbfc8b43140 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:50.156940 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63acd362-511a-4b1e-9f57-6dbfc8b43140 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:50.157168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63acd362-511a-4b1e-9f57-6dbfc8b43140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:50.178871 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:50.194971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-63acd362-511a-4b1e-9f57-6dbfc8b43140 None None] MFA Rules not processed for user `7882b11bb83c4278963556f404f10b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:50.197769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-63acd362-511a-4b1e-9f57-6dbfc8b43140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:50.215410 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4289/8576] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:39:50.217392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffe0df-a394-4172-abd6-2f67dbb2847f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:50.217730 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffe0df-a394-4172-abd6-2f67dbb2847f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:50.218012 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffe0df-a394-4172-abd6-2f67dbb2847f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:50.251131 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-9cffe0df-a394-4172-abd6-2f67dbb2847f None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:50.252689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9cffe0df-a394-4172-abd6-2f67dbb2847f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:50.269230 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4290/8577] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:39:50.270462 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cffe0df-a394-4172-abd6-2f67dbb2847f None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:50.282477 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cffe0df-a394-4172-abd6-2f67dbb2847f None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:50.288230 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6d0a2-10af-4886-a276-8e780c6ab9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:50.292094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6d0a2-10af-4886-a276-8e780c6ab9cb admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:50.292635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6d0a2-10af-4886-a276-8e780c6ab9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:50.293248 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6d0a2-10af-4886-a276-8e780c6ab9cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:50.294159 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6d0a2-10af-4886-a276-8e780c6ab9cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:39:50.294680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6d0a2-10af-4886-a276-8e780c6ab9cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:50.296524 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6d0a2-10af-4886-a276-8e780c6ab9cb admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:50.315399 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4291/8578] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:39:50.316716 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6d0a2-10af-4886-a276-8e780c6ab9cb admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:50.321953 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4288/8579] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:39:50.334023 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6d0a2-10af-4886-a276-8e780c6ab9cb admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:50.334288 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63acd362-511a-4b1e-9f57-6dbfc8b43140 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:50.335877 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-63acd362-511a-4b1e-9f57-6dbfc8b43140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:50.339801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28fffd-9e7d-465a-b498-f5da2724b65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:50.341187 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28fffd-9e7d-465a-b498-f5da2724b65f admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:50.341498 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28fffd-9e7d-465a-b498-f5da2724b65f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:50.341795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28fffd-9e7d-465a-b498-f5da2724b65f admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:50.342507 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28fffd-9e7d-465a-b498-f5da2724b65f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:50.344703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28fffd-9e7d-465a-b498-f5da2724b65f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:50.395089 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4292/8580] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:39:50 2022] POST /identity/v3/projects => generated 375 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:39:50.403179 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28fffd-9e7d-465a-b498-f5da2724b65f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:50.473611 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63acd362-511a-4b1e-9f57-6dbfc8b43140 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:50.480086 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:50.496307 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28fffd-9e7d-465a-b498-f5da2724b65f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:50.502724 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a117df-5d4a-45c5-a9d1-94563f49641a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:50.503346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a117df-5d4a-45c5-a9d1-94563f49641a admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:50.503728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a117df-5d4a-45c5-a9d1-94563f49641a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:50.504009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a117df-5d4a-45c5-a9d1-94563f49641a admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:50.504683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a117df-5d4a-45c5-a9d1-94563f49641a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:50.506902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a117df-5d4a-45c5-a9d1-94563f49641a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:50.538142 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4293/8581] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:39:50 2022] POST /identity/v3/users => generated 288 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:39:50.541912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a117df-5d4a-45c5-a9d1-94563f49641a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:50.544543 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29150923-386c-4dd5-a4fd-466df023ee78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:50.545387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29150923-386c-4dd5-a4fd-466df023ee78 service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:50.545843 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29150923-386c-4dd5-a4fd-466df023ee78 service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:50.546384 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29150923-386c-4dd5-a4fd-466df023ee78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:50.553251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a117df-5d4a-45c5-a9d1-94563f49641a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:50.558970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d07c5-4132-452d-9026-eafaaa9b0367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:50.559760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d07c5-4132-452d-9026-eafaaa9b0367 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:50.560158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d07c5-4132-452d-9026-eafaaa9b0367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:50.560630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d07c5-4132-452d-9026-eafaaa9b0367 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:50.561381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d07c5-4132-452d-9026-eafaaa9b0367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:50.563124 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d07c5-4132-452d-9026-eafaaa9b0367 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:50.577258 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4294/8582] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:39:50.580931 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d07c5-4132-452d-9026-eafaaa9b0367 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:50.592555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d07c5-4132-452d-9026-eafaaa9b0367 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:50.599776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f937f81-db10-4a82-9200-a353f4b2180c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:50.600657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f937f81-db10-4a82-9200-a353f4b2180c admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:50.601037 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f937f81-db10-4a82-9200-a353f4b2180c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:50.601407 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f937f81-db10-4a82-9200-a353f4b2180c admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:50.602519 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f937f81-db10-4a82-9200-a353f4b2180c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:50.604228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f937f81-db10-4a82-9200-a353f4b2180c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:50.619548 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4295/8583] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:39:50.623737 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f937f81-db10-4a82-9200-a353f4b2180c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:50.624540 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29150923-386c-4dd5-a4fd-466df023ee78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:50.626517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29150923-386c-4dd5-a4fd-466df023ee78 service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:50.637142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f937f81-db10-4a82-9200-a353f4b2180c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:50.639479 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4289/8584] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:39:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:39:50.643772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ad69d-8931-44c6-8f6c-1495149d7534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:50.644810 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ad69d-8931-44c6-8f6c-1495149d7534 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:50.645269 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ad69d-8931-44c6-8f6c-1495149d7534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:50.645928 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ad69d-8931-44c6-8f6c-1495149d7534 admin admin] PATH_INFO: `/v3/projects/07b7d0cdc4de49a2b50260dd581d88d7/users/2f8943cee5c245d3a1073bde69c2d2a9/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:50.665950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ad69d-8931-44c6-8f6c-1495149d7534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07b7d0cdc4de49a2b50260dd581d88d7, user_id=2f8943cee5c245d3a1073bde69c2d2a9, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:50.668965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ad69d-8931-44c6-8f6c-1495149d7534 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:50.687133 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4296/8585] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:39:50 2022] PUT /identity/v3/projects/07b7d0cdc4de49a2b50260dd581d88d7/users/2f8943cee5c245d3a1073bde69c2d2a9/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:39:50.698190 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8759b2-0854-45e2-aa44-ab2ac3ed737c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:50.698544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8759b2-0854-45e2-aa44-ab2ac3ed737c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:50.698762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8759b2-0854-45e2-aa44-ab2ac3ed737c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:50.756850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-9c8759b2-0854-45e2-aa44-ab2ac3ed737c None None] MFA Rules not processed for user `2f8943cee5c245d3a1073bde69c2d2a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:39:50.760338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9c8759b2-0854-45e2-aa44-ab2ac3ed737c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:50.869027 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4290/8586] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:39:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:39:50.882397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ad69d-8931-44c6-8f6c-1495149d7534 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:39:50.884920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ce7ad69d-8931-44c6-8f6c-1495149d7534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:39:50.946847 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:39:50.979019 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ad69d-8931-44c6-8f6c-1495149d7534 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:39:50.986926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36aa24-2df6-4550-82b3-a16fe74ee7d1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efcee9b21ea94b1b8e5c9c5acb35839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:39:50.987635 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36aa24-2df6-4550-82b3-a16fe74ee7d1 service glance] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:39:50.987965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36aa24-2df6-4550-82b3-a16fe74ee7d1 service glance] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:39:50.988241 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36aa24-2df6-4550-82b3-a16fe74ee7d1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:39:51.010095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36aa24-2df6-4550-82b3-a16fe74ee7d1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:39:51.011936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36aa24-2df6-4550-82b3-a16fe74ee7d1 service glance] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:39:51.025069 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4297/8587] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:39:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:40:00.864984 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=77 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:40:01.018988 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=7 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:40:05.558102 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8759b2-0854-45e2-aa44-ab2ac3ed737c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:40:05.561575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9c8759b2-0854-45e2-aa44-ab2ac3ed737c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:40:05.675909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8759b2-0854-45e2-aa44-ab2ac3ed737c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:40:05.705002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d4627-6299-49ad-b140-dcadd9310ba6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:40:05.706593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d4627-6299-49ad-b140-dcadd9310ba6 service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:40:05.708878 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d4627-6299-49ad-b140-dcadd9310ba6 service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:40:05.709862 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d4627-6299-49ad-b140-dcadd9310ba6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:40:05.713232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ce3d4627-6299-49ad-b140-dcadd9310ba6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:40:05.807683 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d4627-6299-49ad-b140-dcadd9310ba6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:40:05.809559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d4627-6299-49ad-b140-dcadd9310ba6 service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:40:05.825986 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4291/8588] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:40:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:40:14.081389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36aa24-2df6-4550-82b3-a16fe74ee7d1 service glance] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:40:14.098884 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36aa24-2df6-4550-82b3-a16fe74ee7d1 service glance] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:40:14.105720 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ba5ed-1cb0-42dd-801f-b45d65fb17c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:40:14.106628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ba5ed-1cb0-42dd-801f-b45d65fb17c8 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:40:14.107063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ba5ed-1cb0-42dd-801f-b45d65fb17c8 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:40:14.107605 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ba5ed-1cb0-42dd-801f-b45d65fb17c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:40:14.188967 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ba5ed-1cb0-42dd-801f-b45d65fb17c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:40:14.191478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ba5ed-1cb0-42dd-801f-b45d65fb17c8 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:40:14.203606 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4298/8589] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:40:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:40:15.819093 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=54 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:40:20.547933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d4627-6299-49ad-b140-dcadd9310ba6 service swift] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:40:20.663927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d4627-6299-49ad-b140-dcadd9310ba6 service swift] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:40:20.688078 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71156ef8-aff2-46a2-a7b9-542257029523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:40:20.688754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71156ef8-aff2-46a2-a7b9-542257029523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:40:20.689041 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71156ef8-aff2-46a2-a7b9-542257029523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:40:20.689319 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71156ef8-aff2-46a2-a7b9-542257029523 admin admin] PATH_INFO: `/v3/users/2f8943cee5c245d3a1073bde69c2d2a9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:40:20.692153 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71156ef8-aff2-46a2-a7b9-542257029523 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f8943cee5c245d3a1073bde69c2d2a9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:40:20.694426 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71156ef8-aff2-46a2-a7b9-542257029523 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:40:20.771230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-71156ef8-aff2-46a2-a7b9-542257029523 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f8943cee5c245d3a1073bde69c2d2a9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:40:20.773335 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-71156ef8-aff2-46a2-a7b9-542257029523 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f8943cee5c245d3a1073bde69c2d2a9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:40:20.781531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-71156ef8-aff2-46a2-a7b9-542257029523 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f8943cee5c245d3a1073bde69c2d2a9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:40:20.817178 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-71156ef8-aff2-46a2-a7b9-542257029523 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f8943cee5c245d3a1073bde69c2d2a9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:40:20.818602 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-71156ef8-aff2-46a2-a7b9-542257029523 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f8943cee5c245d3a1073bde69c2d2a9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:40:20.854760 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4292/8590] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:40:20 2022] DELETE /identity/v3/users/2f8943cee5c245d3a1073bde69c2d2a9 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:40:20.860380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07725b-7f25-433f-9c8f-9b07354272a5 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:40:20.860380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07725b-7f25-433f-9c8f-9b07354272a5 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:40:20.860380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07725b-7f25-433f-9c8f-9b07354272a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:40:20.886639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-1f07725b-7f25-433f-9c8f-9b07354272a5 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:40:20.888025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1f07725b-7f25-433f-9c8f-9b07354272a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:40:20.985796 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4299/8591] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:40:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:40:21.015815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71156ef8-aff2-46a2-a7b9-542257029523 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:40:21.026580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-71156ef8-aff2-46a2-a7b9-542257029523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:40:21.146768 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71156ef8-aff2-46a2-a7b9-542257029523 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:40:21.150959 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ab7de-60b5-4717-8f39-dc4e5bd57c82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:40:21.151579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ab7de-60b5-4717-8f39-dc4e5bd57c82 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:40:21.151851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ab7de-60b5-4717-8f39-dc4e5bd57c82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:40:21.152123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ab7de-60b5-4717-8f39-dc4e5bd57c82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:40:21.161550 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ab7de-60b5-4717-8f39-dc4e5bd57c82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:40:21.163015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ab7de-60b5-4717-8f39-dc4e5bd57c82 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:40:21.172698 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4293/8592] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:40:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:40:21.550554 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07725b-7f25-433f-9c8f-9b07354272a5 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:40:21.551982 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1f07725b-7f25-433f-9c8f-9b07354272a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:40:21.571281 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07725b-7f25-433f-9c8f-9b07354272a5 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:40:21.582221 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1fe3a-aca5-45c2-ab70-24f10477e4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:40:21.582870 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1fe3a-aca5-45c2-ab70-24f10477e4cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:40:21.583150 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1fe3a-aca5-45c2-ab70-24f10477e4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:40:21.583502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1fe3a-aca5-45c2-ab70-24f10477e4cc admin admin] PATH_INFO: `/v3/projects/07b7d0cdc4de49a2b50260dd581d88d7` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:40:21.584626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1fe3a-aca5-45c2-ab70-24f10477e4cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=07b7d0cdc4de49a2b50260dd581d88d7)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:40:21.587245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1fe3a-aca5-45c2-ab70-24f10477e4cc admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:40:21.674574 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-99c1fe3a-aca5-45c2-ab70-24f10477e4cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07b7d0cdc4de49a2b50260dd581d88d7', 'request_id': 'req-99c1fe3a-aca5-45c2-ab70-24f10477e4cc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:40:21.686468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-99c1fe3a-aca5-45c2-ab70-24f10477e4cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07b7d0cdc4de49a2b50260dd581d88d7', 'request_id': 'req-99c1fe3a-aca5-45c2-ab70-24f10477e4cc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:40:21.692725 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-99c1fe3a-aca5-45c2-ab70-24f10477e4cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07b7d0cdc4de49a2b50260dd581d88d7', 'request_id': 'req-99c1fe3a-aca5-45c2-ab70-24f10477e4cc'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:40:21.707114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-99c1fe3a-aca5-45c2-ab70-24f10477e4cc admin admin] The token cache is being invalidate because project 07b7d0cdc4de49a2b50260dd581d88d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:40:21.707376 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-99c1fe3a-aca5-45c2-ab70-24f10477e4cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:40:21.708105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-99c1fe3a-aca5-45c2-ab70-24f10477e4cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:40:21.710584 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4300/8593] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:40:21 2022] DELETE /identity/v3/projects/07b7d0cdc4de49a2b50260dd581d88d7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:40:21.715439 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f6a0a-1467-472f-a2bf-7188be5bcf6f None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:40:21.716263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f6a0a-1467-472f-a2bf-7188be5bcf6f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:40:21.716838 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f6a0a-1467-472f-a2bf-7188be5bcf6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:40:21.740976 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-fe5f6a0a-1467-472f-a2bf-7188be5bcf6f None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:40:21.742524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fe5f6a0a-1467-472f-a2bf-7188be5bcf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:40:21.797868 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:40:21.866594 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4294/8594] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:40:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:40:21.874424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f40a61-e153-4773-9697-0122adc4a88a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:40:21.874914 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f40a61-e153-4773-9697-0122adc4a88a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:40:21.874997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f40a61-e153-4773-9697-0122adc4a88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:40:21.914660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b1f40a61-e153-4773-9697-0122adc4a88a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:40:21.915883 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b1f40a61-e153-4773-9697-0122adc4a88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:40:21.925329 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4301/8595] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:40:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:40:21.929758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f6a0a-1467-472f-a2bf-7188be5bcf6f None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:40:21.939784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f6a0a-1467-472f-a2bf-7188be5bcf6f None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:40:21.944958 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a443f3-2644-46c7-977d-25090fb0d346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:40:21.945659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a443f3-2644-46c7-977d-25090fb0d346 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:40:21.946036 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a443f3-2644-46c7-977d-25090fb0d346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:40:21.946374 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a443f3-2644-46c7-977d-25090fb0d346 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:40:21.947084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a443f3-2644-46c7-977d-25090fb0d346 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:40:21.947459 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a443f3-2644-46c7-977d-25090fb0d346 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:40:21.949127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a443f3-2644-46c7-977d-25090fb0d346 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:40:21.966529 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4295/8596] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:40:21.968075 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f40a61-e153-4773-9697-0122adc4a88a None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:40:21.979389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f40a61-e153-4773-9697-0122adc4a88a None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:40:21.985602 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628083a5-2333-4b2d-a531-363a0d803590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:40:21.986658 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628083a5-2333-4b2d-a531-363a0d803590 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:40:21.987418 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628083a5-2333-4b2d-a531-363a0d803590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:40:21.987706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628083a5-2333-4b2d-a531-363a0d803590 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:40:21.988347 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628083a5-2333-4b2d-a531-363a0d803590 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:40:21.998368 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628083a5-2333-4b2d-a531-363a0d803590 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:40:22.018333 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:40:22.054035 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4302/8597] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:40:21 2022] POST /identity/v3/projects => generated 379 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:40:22.055247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a443f3-2644-46c7-977d-25090fb0d346 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:40:22.073282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a443f3-2644-46c7-977d-25090fb0d346 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:40:22.189538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642397b2-86c9-4ceb-b7ba-2677cdf071f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:40:22.190219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642397b2-86c9-4ceb-b7ba-2677cdf071f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:40:22.190650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642397b2-86c9-4ceb-b7ba-2677cdf071f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:40:22.190987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642397b2-86c9-4ceb-b7ba-2677cdf071f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:40:22.191657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642397b2-86c9-4ceb-b7ba-2677cdf071f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:40:22.193792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642397b2-86c9-4ceb-b7ba-2677cdf071f1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:40:22.222422 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4296/8598] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:40:22 2022] POST /identity/v3/users => generated 290 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:40:22.223706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628083a5-2333-4b2d-a531-363a0d803590 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:40:22.235749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628083a5-2333-4b2d-a531-363a0d803590 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:40:22.240707 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4133c06c-b8b2-493d-8ccd-605f4c842f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:40:22.241917 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133c06c-b8b2-493d-8ccd-605f4c842f24 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:40:22.242199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133c06c-b8b2-493d-8ccd-605f4c842f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:40:22.242512 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133c06c-b8b2-493d-8ccd-605f4c842f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:40:22.243257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4133c06c-b8b2-493d-8ccd-605f4c842f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:40:22.249704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4133c06c-b8b2-493d-8ccd-605f4c842f24 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:40:22.262480 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4303/8599] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:40:22.265819 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642397b2-86c9-4ceb-b7ba-2677cdf071f1 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:40:22.278728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642397b2-86c9-4ceb-b7ba-2677cdf071f1 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:40:22.284758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a11df-1480-417d-bb2c-c3b9fb658237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:40:22.286108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a11df-1480-417d-bb2c-c3b9fb658237 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:40:22.286641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a11df-1480-417d-bb2c-c3b9fb658237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:40:22.287233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a11df-1480-417d-bb2c-c3b9fb658237 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:40:22.288377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a11df-1480-417d-bb2c-c3b9fb658237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:40:22.290552 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a11df-1480-417d-bb2c-c3b9fb658237 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:40:22.308238 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4297/8600] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:40:22.312806 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4133c06c-b8b2-493d-8ccd-605f4c842f24 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:40:22.331571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4133c06c-b8b2-493d-8ccd-605f4c842f24 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:40:22.336944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3835c-31f2-4e3a-8c48-d5cec6c9f8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:40:22.337653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3835c-31f2-4e3a-8c48-d5cec6c9f8de admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:40:22.337938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3835c-31f2-4e3a-8c48-d5cec6c9f8de admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:40:22.338214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3835c-31f2-4e3a-8c48-d5cec6c9f8de admin admin] PATH_INFO: `/v3/projects/d348e214e006488296ca80e1b65744a0/users/33c1cebf8b7d48e5a5b52785d9cf8710/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:40:22.367679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3835c-31f2-4e3a-8c48-d5cec6c9f8de admin admin] RBAC: Authorizing `identity:create_grant(project_id=d348e214e006488296ca80e1b65744a0, user_id=33c1cebf8b7d48e5a5b52785d9cf8710, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:40:22.370913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3835c-31f2-4e3a-8c48-d5cec6c9f8de admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:40:22.385865 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4304/8601] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:40:22 2022] PUT /identity/v3/projects/d348e214e006488296ca80e1b65744a0/users/33c1cebf8b7d48e5a5b52785d9cf8710/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:40:22.396646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857b7ca-6b34-4988-9b79-6fcfcd215f59 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:40:22.397073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857b7ca-6b34-4988-9b79-6fcfcd215f59 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:40:22.397584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857b7ca-6b34-4988-9b79-6fcfcd215f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:40:22.448485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c857b7ca-6b34-4988-9b79-6fcfcd215f59 None None] MFA Rules not processed for user `33c1cebf8b7d48e5a5b52785d9cf8710`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:40:22.452388 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c857b7ca-6b34-4988-9b79-6fcfcd215f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:40:22.557597 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4298/8602] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:40:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:40:22.570989 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3835c-31f2-4e3a-8c48-d5cec6c9f8de admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:40:22.572885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a9b3835c-31f2-4e3a-8c48-d5cec6c9f8de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:40:22.659485 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3835c-31f2-4e3a-8c48-d5cec6c9f8de admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:40:22.666485 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6caafe-5af5-400a-9b11-393c0f8c43e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:40:22.667760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6caafe-5af5-400a-9b11-393c0f8c43e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:40:22.668325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6caafe-5af5-400a-9b11-393c0f8c43e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:40:22.669155 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6caafe-5af5-400a-9b11-393c0f8c43e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:40:22.683067 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6caafe-5af5-400a-9b11-393c0f8c43e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:40:22.685293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6caafe-5af5-400a-9b11-393c0f8c43e2 service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:40:22.705557 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4305/8603] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:40:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:40:32.553577 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:40:32.692776 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=47,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:40:34.840652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857b7ca-6b34-4988-9b79-6fcfcd215f59 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:40:34.844954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c857b7ca-6b34-4988-9b79-6fcfcd215f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:40:35.009270 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857b7ca-6b34-4988-9b79-6fcfcd215f59 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:40:35.014382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0fd1bd-04ae-4d01-badb-6a17e01c208f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:40:35.015007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fd1bd-04ae-4d01-badb-6a17e01c208f service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:40:35.015290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fd1bd-04ae-4d01-badb-6a17e01c208f service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:40:35.015567 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fd1bd-04ae-4d01-badb-6a17e01c208f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:40:35.024917 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0fd1bd-04ae-4d01-badb-6a17e01c208f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:40:35.026548 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0fd1bd-04ae-4d01-badb-6a17e01c208f service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:40:35.035424 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4299/8604] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:40:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 665 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:40:45.032052 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=32 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:40:47.281006 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6caafe-5af5-400a-9b11-393c0f8c43e2 service cinder] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:40:47.293680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6caafe-5af5-400a-9b11-393c0f8c43e2 service cinder] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:40:47.298720 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36938939-f038-4811-a81a-3062efb6f3f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:40:47.299773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36938939-f038-4811-a81a-3062efb6f3f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:40:47.300231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36938939-f038-4811-a81a-3062efb6f3f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:40:47.300674 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36938939-f038-4811-a81a-3062efb6f3f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:40:47.310389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-36938939-f038-4811-a81a-3062efb6f3f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:40:47.403043 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36938939-f038-4811-a81a-3062efb6f3f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:40:47.404525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36938939-f038-4811-a81a-3062efb6f3f2 service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:40:47.415222 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4306/8605] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:40:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:40:57.409453 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=28 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:41:02.074690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e50f5-f65d-463a-b509-6e373638e2a3 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:41:02.075328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e50f5-f65d-463a-b509-6e373638e2a3 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:41:02.075328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e50f5-f65d-463a-b509-6e373638e2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:41:02.105229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-f36e50f5-f65d-463a-b509-6e373638e2a3 None None] MFA Rules not processed for user `7882b11bb83c4278963556f404f10b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:41:02.106502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f36e50f5-f65d-463a-b509-6e373638e2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:41:02.180615 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4300/8606] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:41:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:41:02.240808 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36938939-f038-4811-a81a-3062efb6f3f2 service cinder] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:41:02.243055 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-36938939-f038-4811-a81a-3062efb6f3f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:41:02.323790 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36938939-f038-4811-a81a-3062efb6f3f2 service cinder] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:41:02.331006 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ee6b2-7dc0-4456-bdb9-5d0643bf6ae9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efcee9b21ea94b1b8e5c9c5acb35839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:41:02.331727 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ee6b2-7dc0-4456-bdb9-5d0643bf6ae9 service glance] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:41:02.332161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ee6b2-7dc0-4456-bdb9-5d0643bf6ae9 service glance] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:41:02.332511 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ee6b2-7dc0-4456-bdb9-5d0643bf6ae9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:41:02.334483 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7e5ee6b2-7dc0-4456-bdb9-5d0643bf6ae9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:41:02.509099 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ee6b2-7dc0-4456-bdb9-5d0643bf6ae9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:41:02.510817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ee6b2-7dc0-4456-bdb9-5d0643bf6ae9 service glance] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:41:02.532369 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4307/8607] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:41:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:41:02.768423 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e50f5-f65d-463a-b509-6e373638e2a3 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:41:02.770182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f36e50f5-f65d-463a-b509-6e373638e2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:41:02.857729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e50f5-f65d-463a-b509-6e373638e2a3 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:41:02.863156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc218a-2f3f-4114-ba93-adaeb8ce8cf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:41:02.873542 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc218a-2f3f-4114-ba93-adaeb8ce8cf4 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:41:02.873542 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc218a-2f3f-4114-ba93-adaeb8ce8cf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:41:02.873542 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc218a-2f3f-4114-ba93-adaeb8ce8cf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:41:02.878257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-59dc218a-2f3f-4114-ba93-adaeb8ce8cf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:41:02.904558 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc218a-2f3f-4114-ba93-adaeb8ce8cf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:41:02.906160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc218a-2f3f-4114-ba93-adaeb8ce8cf4 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:41:02.918308 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4301/8608] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:41:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:41:03.448373 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ee6b2-7dc0-4456-bdb9-5d0643bf6ae9 service glance] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:41:03.450185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7e5ee6b2-7dc0-4456-bdb9-5d0643bf6ae9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:41:03.474985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ee6b2-7dc0-4456-bdb9-5d0643bf6ae9 service glance] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:41:03.485138 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba6c2c-629a-4d7d-bca9-e17e4199ba5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:41:03.485928 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba6c2c-629a-4d7d-bca9-e17e4199ba5f service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:41:03.486262 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba6c2c-629a-4d7d-bca9-e17e4199ba5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:41:03.486427 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba6c2c-629a-4d7d-bca9-e17e4199ba5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:41:03.496326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bdba6c2c-629a-4d7d-bca9-e17e4199ba5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:41:03.543841 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba6c2c-629a-4d7d-bca9-e17e4199ba5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:41:03.548246 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba6c2c-629a-4d7d-bca9-e17e4199ba5f service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:41:03.576264 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4308/8609] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:41:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:41:06.707351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc218a-2f3f-4114-ba93-adaeb8ce8cf4 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:41:06.710163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-59dc218a-2f3f-4114-ba93-adaeb8ce8cf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:41:06.738725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc218a-2f3f-4114-ba93-adaeb8ce8cf4 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:41:06.764287 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735b3c2-e654-4865-884f-6aa0b929629f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:41:06.764937 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735b3c2-e654-4865-884f-6aa0b929629f service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:41:06.765221 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735b3c2-e654-4865-884f-6aa0b929629f service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:41:06.765529 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735b3c2-e654-4865-884f-6aa0b929629f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:41:06.768150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9735b3c2-e654-4865-884f-6aa0b929629f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:41:06.789507 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9735b3c2-e654-4865-884f-6aa0b929629f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:41:06.791188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9735b3c2-e654-4865-884f-6aa0b929629f service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:41:06.808498 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4302/8610] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:41:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:41:13.564910 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=68 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:41:16.801947 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=57 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:41:29.673536 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba6c2c-629a-4d7d-bca9-e17e4199ba5f service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:41:29.742002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba6c2c-629a-4d7d-bca9-e17e4199ba5f service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:41:29.746841 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb7be2-6dc9-4612-8db0-40344bff1dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:41:29.747488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb7be2-6dc9-4612-8db0-40344bff1dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:41:29.747768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb7be2-6dc9-4612-8db0-40344bff1dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:41:29.748193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb7be2-6dc9-4612-8db0-40344bff1dc1 admin admin] PATH_INFO: `/v3/users/33c1cebf8b7d48e5a5b52785d9cf8710` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:41:29.749341 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb7be2-6dc9-4612-8db0-40344bff1dc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33c1cebf8b7d48e5a5b52785d9cf8710)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:41:29.751683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb7be2-6dc9-4612-8db0-40344bff1dc1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:41:29.816576 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-67cb7be2-6dc9-4612-8db0-40344bff1dc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33c1cebf8b7d48e5a5b52785d9cf8710'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:41:29.817663 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-67cb7be2-6dc9-4612-8db0-40344bff1dc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33c1cebf8b7d48e5a5b52785d9cf8710'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:41:29.828499 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-67cb7be2-6dc9-4612-8db0-40344bff1dc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33c1cebf8b7d48e5a5b52785d9cf8710'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:41:29.840313 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-67cb7be2-6dc9-4612-8db0-40344bff1dc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33c1cebf8b7d48e5a5b52785d9cf8710'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:41:29.841017 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-67cb7be2-6dc9-4612-8db0-40344bff1dc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33c1cebf8b7d48e5a5b52785d9cf8710'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:41:29.874789 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4309/8611] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:41:29 2022] DELETE /identity/v3/users/33c1cebf8b7d48e5a5b52785d9cf8710 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:41:29.879717 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ac3c7-509a-4c9e-bc16-04781a48ec72 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:41:29.880244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ac3c7-509a-4c9e-bc16-04781a48ec72 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:41:29.880244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ac3c7-509a-4c9e-bc16-04781a48ec72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:41:29.907257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-531ac3c7-509a-4c9e-bc16-04781a48ec72 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:41:29.908828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-531ac3c7-509a-4c9e-bc16-04781a48ec72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:41:29.987872 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4303/8612] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:41:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:41:29.996802 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb7be2-6dc9-4612-8db0-40344bff1dc1 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:41:29.998807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-67cb7be2-6dc9-4612-8db0-40344bff1dc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:41:30.071806 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb7be2-6dc9-4612-8db0-40344bff1dc1 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:41:30.076333 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69572cf7-fd7c-4a4c-946b-57050ef45ee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:41:30.076988 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69572cf7-fd7c-4a4c-946b-57050ef45ee7 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:41:30.077379 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69572cf7-fd7c-4a4c-946b-57050ef45ee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:41:30.077707 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69572cf7-fd7c-4a4c-946b-57050ef45ee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:41:30.090588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69572cf7-fd7c-4a4c-946b-57050ef45ee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:41:30.092203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69572cf7-fd7c-4a4c-946b-57050ef45ee7 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:41:30.109140 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4310/8613] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:41:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:41:30.438970 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ac3c7-509a-4c9e-bc16-04781a48ec72 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:41:30.451402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-531ac3c7-509a-4c9e-bc16-04781a48ec72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:41:30.495315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ac3c7-509a-4c9e-bc16-04781a48ec72 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:41:30.500484 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879ed57-a7cf-4abe-81a9-21258a53f90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:41:30.502075 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879ed57-a7cf-4abe-81a9-21258a53f90a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:41:30.502548 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879ed57-a7cf-4abe-81a9-21258a53f90a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:41:30.503214 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879ed57-a7cf-4abe-81a9-21258a53f90a admin admin] PATH_INFO: `/v3/projects/d348e214e006488296ca80e1b65744a0` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:41:30.504737 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879ed57-a7cf-4abe-81a9-21258a53f90a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d348e214e006488296ca80e1b65744a0)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:41:30.507026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879ed57-a7cf-4abe-81a9-21258a53f90a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:41:30.579386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3879ed57-a7cf-4abe-81a9-21258a53f90a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd348e214e006488296ca80e1b65744a0', 'request_id': 'req-3879ed57-a7cf-4abe-81a9-21258a53f90a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:41:30.594461 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3879ed57-a7cf-4abe-81a9-21258a53f90a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd348e214e006488296ca80e1b65744a0', 'request_id': 'req-3879ed57-a7cf-4abe-81a9-21258a53f90a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:41:30.602609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3879ed57-a7cf-4abe-81a9-21258a53f90a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd348e214e006488296ca80e1b65744a0', 'request_id': 'req-3879ed57-a7cf-4abe-81a9-21258a53f90a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:41:30.616506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3879ed57-a7cf-4abe-81a9-21258a53f90a admin admin] The token cache is being invalidate because project d348e214e006488296ca80e1b65744a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:41:30.616970 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3879ed57-a7cf-4abe-81a9-21258a53f90a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:41:30.617784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3879ed57-a7cf-4abe-81a9-21258a53f90a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:41:30.619668 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4304/8614] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:41:30 2022] DELETE /identity/v3/projects/d348e214e006488296ca80e1b65744a0 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:41:30.626161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa853af3-b0ee-4267-b544-e38dc18deb16 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:41:30.626441 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa853af3-b0ee-4267-b544-e38dc18deb16 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:41:30.626719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa853af3-b0ee-4267-b544-e38dc18deb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:41:30.653025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-aa853af3-b0ee-4267-b544-e38dc18deb16 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:41:30.654311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-aa853af3-b0ee-4267-b544-e38dc18deb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:41:30.673472 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:41:30.733002 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c449a-e0d8-40c5-ae7a-84bfce5f341a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:41:30.733233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c449a-e0d8-40c5-ae7a-84bfce5f341a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:41:30.733532 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c449a-e0d8-40c5-ae7a-84bfce5f341a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:41:30.737861 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4311/8615] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:41:30.762527 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-b34c449a-e0d8-40c5-ae7a-84bfce5f341a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:41:30.763804 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b34c449a-e0d8-40c5-ae7a-84bfce5f341a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:41:30.776314 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4305/8616] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:41:30.781156 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa853af3-b0ee-4267-b544-e38dc18deb16 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:41:30.793445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa853af3-b0ee-4267-b544-e38dc18deb16 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:41:30.798752 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f9732-b0dc-4e8a-bb0b-67357b3eebf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:41:30.799373 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f9732-b0dc-4e8a-bb0b-67357b3eebf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:41:30.799655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f9732-b0dc-4e8a-bb0b-67357b3eebf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:41:30.799973 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f9732-b0dc-4e8a-bb0b-67357b3eebf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:41:30.801208 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f9732-b0dc-4e8a-bb0b-67357b3eebf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:41:30.801585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f9732-b0dc-4e8a-bb0b-67357b3eebf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:41:30.803641 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f9732-b0dc-4e8a-bb0b-67357b3eebf7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:41:30.821753 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4312/8617] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:41:30.822746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c449a-e0d8-40c5-ae7a-84bfce5f341a None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:41:30.833246 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c449a-e0d8-40c5-ae7a-84bfce5f341a None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:41:30.838252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7206281-65ff-4a79-aa7b-47e45d168399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:41:30.839010 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7206281-65ff-4a79-aa7b-47e45d168399 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:41:30.839413 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7206281-65ff-4a79-aa7b-47e45d168399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:41:30.839831 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7206281-65ff-4a79-aa7b-47e45d168399 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:41:30.840480 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7206281-65ff-4a79-aa7b-47e45d168399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:41:30.842568 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7206281-65ff-4a79-aa7b-47e45d168399 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:41:30.875739 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4306/8618] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:41:30 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:41:30.879652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f9732-b0dc-4e8a-bb0b-67357b3eebf7 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:41:30.891326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f9732-b0dc-4e8a-bb0b-67357b3eebf7 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:41:30.968259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b396a81-5283-47b1-a131-9121496d6147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:41:30.969205 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b396a81-5283-47b1-a131-9121496d6147 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:41:30.969703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b396a81-5283-47b1-a131-9121496d6147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:41:30.970168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b396a81-5283-47b1-a131-9121496d6147 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:41:30.971085 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b396a81-5283-47b1-a131-9121496d6147 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:41:30.974552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b396a81-5283-47b1-a131-9121496d6147 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:41:31.007469 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4313/8619] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:41:30 2022] POST /identity/v3/users => generated 288 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:41:31.011205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7206281-65ff-4a79-aa7b-47e45d168399 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:41:31.025105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7206281-65ff-4a79-aa7b-47e45d168399 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:41:31.031184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca34f4-875a-4b14-acee-e9836d1250e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:41:31.032067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca34f4-875a-4b14-acee-e9836d1250e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:41:31.032736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca34f4-875a-4b14-acee-e9836d1250e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:41:31.033323 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca34f4-875a-4b14-acee-e9836d1250e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:41:31.034422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca34f4-875a-4b14-acee-e9836d1250e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:41:31.037547 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca34f4-875a-4b14-acee-e9836d1250e5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:41:31.053335 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4307/8620] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:41:31.057197 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b396a81-5283-47b1-a131-9121496d6147 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:41:31.071041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b396a81-5283-47b1-a131-9121496d6147 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:41:31.076769 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149711b6-c076-4b35-99ef-31b5f1eabc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:41:31.078230 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149711b6-c076-4b35-99ef-31b5f1eabc81 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:41:31.078708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149711b6-c076-4b35-99ef-31b5f1eabc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:41:31.079156 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149711b6-c076-4b35-99ef-31b5f1eabc81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:41:31.080241 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149711b6-c076-4b35-99ef-31b5f1eabc81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:41:31.082934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149711b6-c076-4b35-99ef-31b5f1eabc81 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:41:31.099541 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4314/8621] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:41:31.103414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca34f4-875a-4b14-acee-e9836d1250e5 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:41:31.115416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca34f4-875a-4b14-acee-e9836d1250e5 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:41:31.120680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b0bfc-3faa-4a78-83bb-dee66dadae3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:41:31.121589 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b0bfc-3faa-4a78-83bb-dee66dadae3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:41:31.122041 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b0bfc-3faa-4a78-83bb-dee66dadae3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:41:31.122593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b0bfc-3faa-4a78-83bb-dee66dadae3d admin admin] PATH_INFO: `/v3/projects/99323c281c9b4e398f308a6aac9ef36e/users/be5a9e99fd8e441c974c3cc69c10eade/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:41:31.140397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b0bfc-3faa-4a78-83bb-dee66dadae3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=99323c281c9b4e398f308a6aac9ef36e, user_id=be5a9e99fd8e441c974c3cc69c10eade, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:41:31.143504 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b0bfc-3faa-4a78-83bb-dee66dadae3d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:41:31.159437 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4308/8622] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:41:31 2022] PUT /identity/v3/projects/99323c281c9b4e398f308a6aac9ef36e/users/be5a9e99fd8e441c974c3cc69c10eade/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:41:31.165335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfcd80-693a-45d4-be42-aa79c297873b None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:41:31.165783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfcd80-693a-45d4-be42-aa79c297873b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:41:31.166154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfcd80-693a-45d4-be42-aa79c297873b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:41:31.187423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-10bfcd80-693a-45d4-be42-aa79c297873b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:41:31.189330 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-10bfcd80-693a-45d4-be42-aa79c297873b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:41:31.258392 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4315/8623] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:41:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:41:31.268306 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b0bfc-3faa-4a78-83bb-dee66dadae3d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:41:31.270638 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0d6b0bfc-3faa-4a78-83bb-dee66dadae3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:41:31.294093 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:41:31.338503 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b0bfc-3faa-4a78-83bb-dee66dadae3d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:41:31.342874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb316e-ba6c-4685-8367-cd62011d6700 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:41:31.343825 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb316e-ba6c-4685-8367-cd62011d6700 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:41:31.344369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb316e-ba6c-4685-8367-cd62011d6700 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:41:31.344804 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb316e-ba6c-4685-8367-cd62011d6700 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:41:31.356939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb316e-ba6c-4685-8367-cd62011d6700 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:41:31.358717 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb316e-ba6c-4685-8367-cd62011d6700 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:41:31.361447 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfcd80-693a-45d4-be42-aa79c297873b None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:41:31.370369 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4309/8624] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:41:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:41:31.377950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfcd80-693a-45d4-be42-aa79c297873b None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:41:31.382648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bb6a6-6ba5-4966-96a0-71329b5d0cf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:41:31.383270 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bb6a6-6ba5-4966-96a0-71329b5d0cf9 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:41:31.383551 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bb6a6-6ba5-4966-96a0-71329b5d0cf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:41:31.383828 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bb6a6-6ba5-4966-96a0-71329b5d0cf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:41:31.385783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-522bb6a6-6ba5-4966-96a0-71329b5d0cf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:41:31.399826 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522bb6a6-6ba5-4966-96a0-71329b5d0cf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:41:31.401302 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522bb6a6-6ba5-4966-96a0-71329b5d0cf9 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:41:31.415612 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4316/8625] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:41:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:41:38.428807 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d16406-1b57-4540-8358-c752f82ef394 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:41:38.429323 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d16406-1b57-4540-8358-c752f82ef394 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:41:38.429947 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d16406-1b57-4540-8358-c752f82ef394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:41:38.542718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-40d16406-1b57-4540-8358-c752f82ef394 None None] MFA Rules not processed for user `be5a9e99fd8e441c974c3cc69c10eade`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:41:38.544042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-40d16406-1b57-4540-8358-c752f82ef394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:41:38.698661 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4310/8626] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:41:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:41:38.702931 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bb6a6-6ba5-4966-96a0-71329b5d0cf9 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:41:38.716346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bb6a6-6ba5-4966-96a0-71329b5d0cf9 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:41:38.722560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d8c42-7423-41c3-986c-faed5ea84e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:41:38.722830 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d8c42-7423-41c3-986c-faed5ea84e1c admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:41:38.723155 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d8c42-7423-41c3-986c-faed5ea84e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:41:38.723497 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d8c42-7423-41c3-986c-faed5ea84e1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:41:38.724263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d8c42-7423-41c3-986c-faed5ea84e1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:41:38.726651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d8c42-7423-41c3-986c-faed5ea84e1c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:41:38.746204 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:41:38.775528 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4317/8627] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:41:38 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:41:38.779981 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d16406-1b57-4540-8358-c752f82ef394 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:41:38.796720 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d16406-1b57-4540-8358-c752f82ef394 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:41:38.931985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f9a69-5086-4373-85f3-7539efabae7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:41:38.933058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f9a69-5086-4373-85f3-7539efabae7e admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:41:38.933452 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f9a69-5086-4373-85f3-7539efabae7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:41:38.933842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f9a69-5086-4373-85f3-7539efabae7e admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:41:38.934666 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f9a69-5086-4373-85f3-7539efabae7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:41:38.938604 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f9a69-5086-4373-85f3-7539efabae7e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:41:38.985579 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d8c42-7423-41c3-986c-faed5ea84e1c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:41:38.994196 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4311/8628] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:41:38 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:41:39.003576 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d8c42-7423-41c3-986c-faed5ea84e1c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:41:39.026692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac3eb3-90c8-4d45-8bc7-0e095d41a26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:41:39.028632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac3eb3-90c8-4d45-8bc7-0e095d41a26b admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:41:39.032555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac3eb3-90c8-4d45-8bc7-0e095d41a26b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:41:39.032849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac3eb3-90c8-4d45-8bc7-0e095d41a26b admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:41:39.033878 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac3eb3-90c8-4d45-8bc7-0e095d41a26b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:41:39.036046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac3eb3-90c8-4d45-8bc7-0e095d41a26b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:41:39.049960 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4318/8629] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:41:39.053820 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f9a69-5086-4373-85f3-7539efabae7e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:41:39.072788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f9a69-5086-4373-85f3-7539efabae7e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:41:39.089692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa613f69-7f2a-4253-b62e-64f1ddd1fe4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:41:39.089692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa613f69-7f2a-4253-b62e-64f1ddd1fe4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:41:39.089692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa613f69-7f2a-4253-b62e-64f1ddd1fe4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:41:39.089692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa613f69-7f2a-4253-b62e-64f1ddd1fe4a admin admin] PATH_INFO: `/v3/projects/07bd47c7aec2484a900537f2ccfc52ef/users/33221f649fcc42b4a1395829f4cac8eb/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:41:39.111242 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa613f69-7f2a-4253-b62e-64f1ddd1fe4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=07bd47c7aec2484a900537f2ccfc52ef, user_id=33221f649fcc42b4a1395829f4cac8eb, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:41:39.114694 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa613f69-7f2a-4253-b62e-64f1ddd1fe4a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:41:39.131276 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4312/8630] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:41:39 2022] PUT /identity/v3/projects/07bd47c7aec2484a900537f2ccfc52ef/users/33221f649fcc42b4a1395829f4cac8eb/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:41:39.135346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac3eb3-90c8-4d45-8bc7-0e095d41a26b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:41:39.146817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac3eb3-90c8-4d45-8bc7-0e095d41a26b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:41:39.213052 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c352b-0ab4-401d-a8a2-a15fcc507a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:41:39.214128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c352b-0ab4-401d-a8a2-a15fcc507a45 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:41:39.214503 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c352b-0ab4-401d-a8a2-a15fcc507a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:41:39.217814 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c352b-0ab4-401d-a8a2-a15fcc507a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:41:39.218609 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c352b-0ab4-401d-a8a2-a15fcc507a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:41:39.220662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c352b-0ab4-401d-a8a2-a15fcc507a45 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:41:39.234097 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4319/8631] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:41:39.238283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa613f69-7f2a-4253-b62e-64f1ddd1fe4a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:41:39.250435 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa613f69-7f2a-4253-b62e-64f1ddd1fe4a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:41:39.255946 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef53b4-04a7-4e8c-97ea-efceca542ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:41:39.256632 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef53b4-04a7-4e8c-97ea-efceca542ead admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:41:39.256985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef53b4-04a7-4e8c-97ea-efceca542ead admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:41:39.257178 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef53b4-04a7-4e8c-97ea-efceca542ead admin admin] PATH_INFO: `/v3/projects/07bd47c7aec2484a900537f2ccfc52ef/users/33221f649fcc42b4a1395829f4cac8eb/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:41:39.259326 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef53b4-04a7-4e8c-97ea-efceca542ead admin admin] RBAC: Authorizing `identity:create_grant(project_id=07bd47c7aec2484a900537f2ccfc52ef, user_id=33221f649fcc42b4a1395829f4cac8eb, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:41:39.261885 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef53b4-04a7-4e8c-97ea-efceca542ead admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:41:39.274536 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4313/8632] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:41:39 2022] PUT /identity/v3/projects/07bd47c7aec2484a900537f2ccfc52ef/users/33221f649fcc42b4a1395829f4cac8eb/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:41:40.896073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c352b-0ab4-401d-a8a2-a15fcc507a45 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:41:41.068213 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c352b-0ab4-401d-a8a2-a15fcc507a45 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:41:41.234076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110938c2-8555-4740-9b89-87c65e1c54b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:41:41.235542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110938c2-8555-4740-9b89-87c65e1c54b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:41:41.235987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110938c2-8555-4740-9b89-87c65e1c54b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:41:41.236899 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110938c2-8555-4740-9b89-87c65e1c54b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:41:41.240993 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-110938c2-8555-4740-9b89-87c65e1c54b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:41:41.259981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110938c2-8555-4740-9b89-87c65e1c54b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:41:41.261954 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110938c2-8555-4740-9b89-87c65e1c54b9 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:41:41.281393 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4320/8633] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:41:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:41:49.238491 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8a2cf-3a28-4bf3-9007-af495cff0e9b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:41:49.238982 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8a2cf-3a28-4bf3-9007-af495cff0e9b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:41:49.241134 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8a2cf-3a28-4bf3-9007-af495cff0e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:41:49.255521 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:41:49.305323 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-f9c8a2cf-3a28-4bf3-9007-af495cff0e9b None None] MFA Rules not processed for user `33221f649fcc42b4a1395829f4cac8eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:41:49.306723 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f9c8a2cf-3a28-4bf3-9007-af495cff0e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:41:49.511029 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4314/8634] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:41:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:41:49.517930 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110938c2-8555-4740-9b89-87c65e1c54b9 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:41:49.520961 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-110938c2-8555-4740-9b89-87c65e1c54b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:41:49.629631 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:41:49.679310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110938c2-8555-4740-9b89-87c65e1c54b9 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:41:49.685108 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99880e6-2506-454d-9e86-d3b0331cc95c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:41:49.685765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99880e6-2506-454d-9e86-d3b0331cc95c service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:41:49.686098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99880e6-2506-454d-9e86-d3b0331cc95c service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:41:49.686377 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99880e6-2506-454d-9e86-d3b0331cc95c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:41:49.695628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99880e6-2506-454d-9e86-d3b0331cc95c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:41:49.697229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99880e6-2506-454d-9e86-d3b0331cc95c service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:41:49.710380 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4321/8635] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:41:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:41:49.819570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f412b-4a06-4f2f-8abb-baf748dc143c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:41:49.819946 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f412b-4a06-4f2f-8abb-baf748dc143c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:41:49.820169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f412b-4a06-4f2f-8abb-baf748dc143c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:41:49.841820 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-888f412b-4a06-4f2f-8abb-baf748dc143c None None] MFA Rules not processed for user `be5a9e99fd8e441c974c3cc69c10eade`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:41:49.843086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-888f412b-4a06-4f2f-8abb-baf748dc143c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:41:50.011209 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4315/8636] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:41:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:41:51.201193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99880e6-2506-454d-9e86-d3b0331cc95c service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:41:51.204723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f99880e6-2506-454d-9e86-d3b0331cc95c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:41:51.376971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99880e6-2506-454d-9e86-d3b0331cc95c service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:41:51.383199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51bb98-f190-4a07-8303-b8a294d1f702 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:41:51.384108 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51bb98-f190-4a07-8303-b8a294d1f702 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:41:51.384588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51bb98-f190-4a07-8303-b8a294d1f702 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:41:51.385035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51bb98-f190-4a07-8303-b8a294d1f702 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:41:51.387207 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bc51bb98-f190-4a07-8303-b8a294d1f702 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:41:51.402887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51bb98-f190-4a07-8303-b8a294d1f702 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:41:51.404819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51bb98-f190-4a07-8303-b8a294d1f702 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:41:51.421128 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4322/8637] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:41:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:41:59.258502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864dab0-e34d-46eb-8831-c74e2b4e7038 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:41:59.258960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864dab0-e34d-46eb-8831-c74e2b4e7038 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:41:59.259050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864dab0-e34d-46eb-8831-c74e2b4e7038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:41:59.324890 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-6864dab0-e34d-46eb-8831-c74e2b4e7038 None None] MFA Rules not processed for user `f39dd2d709374c729d51f7e2cf18300c`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:41:59.326544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6864dab0-e34d-46eb-8831-c74e2b4e7038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:41:59.466485 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4316/8638] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:41:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:42:00.589753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51bb98-f190-4a07-8303-b8a294d1f702 service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:42:00.591840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bc51bb98-f190-4a07-8303-b8a294d1f702 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:42:00.752677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51bb98-f190-4a07-8303-b8a294d1f702 service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:42:00.759906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ed79b-c59e-4d11-9c71-bb8ec2e81669 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:42:00.760643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ed79b-c59e-4d11-9c71-bb8ec2e81669 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:42:00.761145 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ed79b-c59e-4d11-9c71-bb8ec2e81669 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:42:00.761415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ed79b-c59e-4d11-9c71-bb8ec2e81669 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:42:00.763344 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c80ed79b-c59e-4d11-9c71-bb8ec2e81669 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:42:00.836576 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:42:00.840734 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ed79b-c59e-4d11-9c71-bb8ec2e81669 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:42:00.842246 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ed79b-c59e-4d11-9c71-bb8ec2e81669 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:42:00.858882 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4323/8639] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 01:42:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 659 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 01:42:01.594655 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864dab0-e34d-46eb-8831-c74e2b4e7038 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:42:01.622932 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864dab0-e34d-46eb-8831-c74e2b4e7038 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:42:01.630647 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc345e66-66b4-4371-9e4b-44951cefb127 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:42:01.631279 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc345e66-66b4-4371-9e4b-44951cefb127 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:42:01.631559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc345e66-66b4-4371-9e4b-44951cefb127 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:42:01.631833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc345e66-66b4-4371-9e4b-44951cefb127 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:42:01.633871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-cc345e66-66b4-4371-9e4b-44951cefb127 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:42:01.674859 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc345e66-66b4-4371-9e4b-44951cefb127 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:42:01.678685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc345e66-66b4-4371-9e4b-44951cefb127 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:42:01.718850 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4317/8640] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:42:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:42:04.572678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f57ae1-e9b3-43db-8a7f-a167f55f6a53 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:42:04.573288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f57ae1-e9b3-43db-8a7f-a167f55f6a53 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:42:04.573288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f57ae1-e9b3-43db-8a7f-a167f55f6a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:42:04.622908 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e3f57ae1-e9b3-43db-8a7f-a167f55f6a53 None None] MFA Rules not processed for user `be5a9e99fd8e441c974c3cc69c10eade`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:42:04.624644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e3f57ae1-e9b3-43db-8a7f-a167f55f6a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:42:04.636343 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4324/8641] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:42:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:42:08.639026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10f3ae-2f53-4f33-aed3-0f631ab8508e None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:42:08.639503 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10f3ae-2f53-4f33-aed3-0f631ab8508e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:42:08.639609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10f3ae-2f53-4f33-aed3-0f631ab8508e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:42:08.663896 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:42:08.671096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ee10f3ae-2f53-4f33-aed3-0f631ab8508e None None] MFA Rules not processed for user `85eb224d8c1e420685eacc747b4f240d`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:42:08.672805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ee10f3ae-2f53-4f33-aed3-0f631ab8508e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:42:08.739746 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4318/8642] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:42:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:42:09.557294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f57ae1-e9b3-43db-8a7f-a167f55f6a53 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:42:09.567835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e3f57ae1-e9b3-43db-8a7f-a167f55f6a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:42:09.603958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f57ae1-e9b3-43db-8a7f-a167f55f6a53 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:42:09.617305 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4c9a34-34de-42b3-bb02-c2c7f96cbddb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:42:09.618257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c9a34-34de-42b3-bb02-c2c7f96cbddb service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:42:09.618723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c9a34-34de-42b3-bb02-c2c7f96cbddb service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:42:09.625054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c9a34-34de-42b3-bb02-c2c7f96cbddb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:42:09.627688 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-dd4c9a34-34de-42b3-bb02-c2c7f96cbddb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:42:09.646547 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4c9a34-34de-42b3-bb02-c2c7f96cbddb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:42:09.648313 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4c9a34-34de-42b3-bb02-c2c7f96cbddb service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:42:09.677976 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4325/8643] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:42:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:42:17.922502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10f3ae-2f53-4f33-aed3-0f631ab8508e None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:42:17.924188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ee10f3ae-2f53-4f33-aed3-0f631ab8508e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:42:17.945498 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10f3ae-2f53-4f33-aed3-0f631ab8508e None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:42:17.951142 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cba5a2-0f9b-46c4-a582-d1df5fe5f065 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:42:17.951764 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cba5a2-0f9b-46c4-a582-d1df5fe5f065 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:42:17.952048 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cba5a2-0f9b-46c4-a582-d1df5fe5f065 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:42:17.952324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cba5a2-0f9b-46c4-a582-d1df5fe5f065 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:42:17.954098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b6cba5a2-0f9b-46c4-a582-d1df5fe5f065 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:42:17.967791 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cba5a2-0f9b-46c4-a582-d1df5fe5f065 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:42:17.969353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cba5a2-0f9b-46c4-a582-d1df5fe5f065 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:42:17.981611 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4319/8644] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:42:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:42:19.664007 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=12 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:42:25.319933 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4c9a34-34de-42b3-bb02-c2c7f96cbddb service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:42:25.340140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4c9a34-34de-42b3-bb02-c2c7f96cbddb service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:42:25.349844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d743f9-d3f7-4a71-98a6-838ce9dfed94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:42:25.351045 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d743f9-d3f7-4a71-98a6-838ce9dfed94 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:42:25.351600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d743f9-d3f7-4a71-98a6-838ce9dfed94 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:42:25.352343 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d743f9-d3f7-4a71-98a6-838ce9dfed94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:42:25.369129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b7d743f9-d3f7-4a71-98a6-838ce9dfed94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:42:25.427132 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d743f9-d3f7-4a71-98a6-838ce9dfed94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:42:25.429650 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d743f9-d3f7-4a71-98a6-838ce9dfed94 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:42:25.465567 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4326/8645] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:42:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:42:27.976418 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=28 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:42:34.888290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbc357-de7a-4102-8100-197bed5e3298 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:42:34.888990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbc357-de7a-4102-8100-197bed5e3298 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:42:34.888990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbc357-de7a-4102-8100-197bed5e3298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:42:34.920179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-dedbc357-de7a-4102-8100-197bed5e3298 None None] MFA Rules not processed for user `7882b11bb83c4278963556f404f10b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:42:34.922421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-dedbc357-de7a-4102-8100-197bed5e3298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:42:35.039716 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4320/8646] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:42:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:42:35.458359 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:42:35.708810 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d743f9-d3f7-4a71-98a6-838ce9dfed94 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:42:35.711394 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b7d743f9-d3f7-4a71-98a6-838ce9dfed94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:42:35.746663 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d743f9-d3f7-4a71-98a6-838ce9dfed94 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:42:35.767027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de195d8e-34ad-4ace-b74a-73376a718798 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:42:35.767659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de195d8e-34ad-4ace-b74a-73376a718798 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:42:35.767942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de195d8e-34ad-4ace-b74a-73376a718798 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:42:35.768210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de195d8e-34ad-4ace-b74a-73376a718798 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:42:35.770115 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-de195d8e-34ad-4ace-b74a-73376a718798 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:42:35.800514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de195d8e-34ad-4ace-b74a-73376a718798 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:42:35.802881 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de195d8e-34ad-4ace-b74a-73376a718798 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:42:35.827957 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4327/8647] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:42:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:42:37.603179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbc357-de7a-4102-8100-197bed5e3298 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:42:37.629213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbc357-de7a-4102-8100-197bed5e3298 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:42:37.644521 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf1776-0c6f-4cb5-96c0-7481e0bd54ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:42:37.645156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf1776-0c6f-4cb5-96c0-7481e0bd54ec service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:42:37.645502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf1776-0c6f-4cb5-96c0-7481e0bd54ec service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:42:37.645978 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf1776-0c6f-4cb5-96c0-7481e0bd54ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:42:37.649742 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5fbf1776-0c6f-4cb5-96c0-7481e0bd54ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:42:37.744382 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf1776-0c6f-4cb5-96c0-7481e0bd54ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:42:37.746125 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf1776-0c6f-4cb5-96c0-7481e0bd54ec service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:42:37.760800 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4321/8648] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:42:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:42:38.075402 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de195d8e-34ad-4ace-b74a-73376a718798 service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:42:38.094201 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de195d8e-34ad-4ace-b74a-73376a718798 service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:42:38.099643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef25bc9-c6ec-4a49-b49a-bff60e4a7acb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:42:38.100269 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef25bc9-c6ec-4a49-b49a-bff60e4a7acb service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:42:38.100599 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef25bc9-c6ec-4a49-b49a-bff60e4a7acb service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:42:38.100874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef25bc9-c6ec-4a49-b49a-bff60e4a7acb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:42:38.103305 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-cef25bc9-c6ec-4a49-b49a-bff60e4a7acb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:42:38.367313 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef25bc9-c6ec-4a49-b49a-bff60e4a7acb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:42:38.367313 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef25bc9-c6ec-4a49-b49a-bff60e4a7acb service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:42:38.367313 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4328/8649] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:42:38 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:42:42.335307 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf1776-0c6f-4cb5-96c0-7481e0bd54ec service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:42:42.448844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf1776-0c6f-4cb5-96c0-7481e0bd54ec service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:42:42.455051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8796aeb-5089-4ef7-bf08-2c294a06fbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:42:42.455956 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8796aeb-5089-4ef7-bf08-2c294a06fbe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:42:42.456411 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8796aeb-5089-4ef7-bf08-2c294a06fbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:42:42.456842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8796aeb-5089-4ef7-bf08-2c294a06fbe0 admin admin] PATH_INFO: `/v3/users/be5a9e99fd8e441c974c3cc69c10eade` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:42:42.458793 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8796aeb-5089-4ef7-bf08-2c294a06fbe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be5a9e99fd8e441c974c3cc69c10eade)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:42:42.460906 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8796aeb-5089-4ef7-bf08-2c294a06fbe0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:42:42.580894 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:42:42.583468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f8796aeb-5089-4ef7-bf08-2c294a06fbe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be5a9e99fd8e441c974c3cc69c10eade'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:42.585802 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f8796aeb-5089-4ef7-bf08-2c294a06fbe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be5a9e99fd8e441c974c3cc69c10eade'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:42.605335 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f8796aeb-5089-4ef7-bf08-2c294a06fbe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be5a9e99fd8e441c974c3cc69c10eade'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:42.630962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f8796aeb-5089-4ef7-bf08-2c294a06fbe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be5a9e99fd8e441c974c3cc69c10eade'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:42.631884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f8796aeb-5089-4ef7-bf08-2c294a06fbe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be5a9e99fd8e441c974c3cc69c10eade'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:42.670980 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4322/8650] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:42:42 2022] DELETE /identity/v3/users/be5a9e99fd8e441c974c3cc69c10eade => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:42:43.733759 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef25bc9-c6ec-4a49-b49a-bff60e4a7acb service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:42:43.752350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef25bc9-c6ec-4a49-b49a-bff60e4a7acb service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:42:43.856651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7b938-8a5e-4f74-a805-56dbdd827d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:42:43.857313 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7b938-8a5e-4f74-a805-56dbdd827d83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:42:43.857628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7b938-8a5e-4f74-a805-56dbdd827d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:42:43.857892 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7b938-8a5e-4f74-a805-56dbdd827d83 admin admin] PATH_INFO: `/v3/projects/99323c281c9b4e398f308a6aac9ef36e` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:42:43.859085 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d7b938-8a5e-4f74-a805-56dbdd827d83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99323c281c9b4e398f308a6aac9ef36e)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:42:43.861601 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d7b938-8a5e-4f74-a805-56dbdd827d83 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:42:43.931554 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-07d7b938-8a5e-4f74-a805-56dbdd827d83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99323c281c9b4e398f308a6aac9ef36e', 'request_id': 'req-07d7b938-8a5e-4f74-a805-56dbdd827d83'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:43.950698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-07d7b938-8a5e-4f74-a805-56dbdd827d83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99323c281c9b4e398f308a6aac9ef36e', 'request_id': 'req-07d7b938-8a5e-4f74-a805-56dbdd827d83'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:43.962632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-07d7b938-8a5e-4f74-a805-56dbdd827d83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99323c281c9b4e398f308a6aac9ef36e', 'request_id': 'req-07d7b938-8a5e-4f74-a805-56dbdd827d83'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:43.980033 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-07d7b938-8a5e-4f74-a805-56dbdd827d83 admin admin] The token cache is being invalidate because project 99323c281c9b4e398f308a6aac9ef36e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:42:43.980301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-07d7b938-8a5e-4f74-a805-56dbdd827d83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:43.981000 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-07d7b938-8a5e-4f74-a805-56dbdd827d83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:43.984128 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4329/8651] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:42:43 2022] DELETE /identity/v3/projects/99323c281c9b4e398f308a6aac9ef36e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:42:43.989379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8796aeb-5089-4ef7-bf08-2c294a06fbe0 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:42:43.991894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f8796aeb-5089-4ef7-bf08-2c294a06fbe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:42:44.015819 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8796aeb-5089-4ef7-bf08-2c294a06fbe0 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:42:44.116640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5d429-7ab3-4d47-a632-db8ddc72c96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:42:44.117699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5d429-7ab3-4d47-a632-db8ddc72c96d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:42:44.118201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5d429-7ab3-4d47-a632-db8ddc72c96d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:42:44.118665 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5d429-7ab3-4d47-a632-db8ddc72c96d admin admin] PATH_INFO: `/v3/users/33221f649fcc42b4a1395829f4cac8eb` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:42:44.120085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5d429-7ab3-4d47-a632-db8ddc72c96d admin admin] RBAC: Authorizing `identity:delete_user(user_id=33221f649fcc42b4a1395829f4cac8eb)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:42:44.122331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5d429-7ab3-4d47-a632-db8ddc72c96d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:42:44.201456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-56e5d429-7ab3-4d47-a632-db8ddc72c96d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33221f649fcc42b4a1395829f4cac8eb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:44.202261 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-56e5d429-7ab3-4d47-a632-db8ddc72c96d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33221f649fcc42b4a1395829f4cac8eb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:44.211376 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-56e5d429-7ab3-4d47-a632-db8ddc72c96d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33221f649fcc42b4a1395829f4cac8eb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:44.222652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-56e5d429-7ab3-4d47-a632-db8ddc72c96d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33221f649fcc42b4a1395829f4cac8eb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:44.224264 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-56e5d429-7ab3-4d47-a632-db8ddc72c96d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33221f649fcc42b4a1395829f4cac8eb'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:44.252523 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4323/8652] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:42:43 2022] DELETE /identity/v3/users/33221f649fcc42b4a1395829f4cac8eb => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:42:44.469906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7b938-8a5e-4f74-a805-56dbdd827d83 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:42:44.471747 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-07d7b938-8a5e-4f74-a805-56dbdd827d83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:42:44.499447 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7b938-8a5e-4f74-a805-56dbdd827d83 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:42:44.510625 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:42:44.597411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73f16a-c3c9-4f79-b87a-51a0b68036e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:42:44.598413 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73f16a-c3c9-4f79-b87a-51a0b68036e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:42:44.598878 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73f16a-c3c9-4f79-b87a-51a0b68036e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:42:44.599329 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73f16a-c3c9-4f79-b87a-51a0b68036e5 admin admin] PATH_INFO: `/v3/projects/07bd47c7aec2484a900537f2ccfc52ef` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:42:44.602414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73f16a-c3c9-4f79-b87a-51a0b68036e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07bd47c7aec2484a900537f2ccfc52ef)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:42:44.606960 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73f16a-c3c9-4f79-b87a-51a0b68036e5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:42:44.711379 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1d73f16a-c3c9-4f79-b87a-51a0b68036e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07bd47c7aec2484a900537f2ccfc52ef', 'request_id': 'req-1d73f16a-c3c9-4f79-b87a-51a0b68036e5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:44.736660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1d73f16a-c3c9-4f79-b87a-51a0b68036e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07bd47c7aec2484a900537f2ccfc52ef', 'request_id': 'req-1d73f16a-c3c9-4f79-b87a-51a0b68036e5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:44.756027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1d73f16a-c3c9-4f79-b87a-51a0b68036e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07bd47c7aec2484a900537f2ccfc52ef', 'request_id': 'req-1d73f16a-c3c9-4f79-b87a-51a0b68036e5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:44.774377 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1d73f16a-c3c9-4f79-b87a-51a0b68036e5 admin admin] The token cache is being invalidate because project 07bd47c7aec2484a900537f2ccfc52ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:42:44.775710 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1d73f16a-c3c9-4f79-b87a-51a0b68036e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:44.780739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-1d73f16a-c3c9-4f79-b87a-51a0b68036e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:44.786502 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4330/8653] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:42:44 2022] DELETE /identity/v3/projects/07bd47c7aec2484a900537f2ccfc52ef => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:42:45.616494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5d429-7ab3-4d47-a632-db8ddc72c96d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:42:45.618634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-56e5d429-7ab3-4d47-a632-db8ddc72c96d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:42:45.710991 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:42:45.755303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5d429-7ab3-4d47-a632-db8ddc72c96d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:42:45.832537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade495dd-c104-45c7-8c26-9fd6d0e2266d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:42:45.833820 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade495dd-c104-45c7-8c26-9fd6d0e2266d service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:42:45.834009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade495dd-c104-45c7-8c26-9fd6d0e2266d service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:42:45.834242 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade495dd-c104-45c7-8c26-9fd6d0e2266d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:42:45.836955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ade495dd-c104-45c7-8c26-9fd6d0e2266d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:42:45.942964 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade495dd-c104-45c7-8c26-9fd6d0e2266d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:42:45.965157 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade495dd-c104-45c7-8c26-9fd6d0e2266d service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:42:45.982791 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4324/8654] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:42:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:42:54.168034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73f16a-c3c9-4f79-b87a-51a0b68036e5 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:42:54.169668 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1d73f16a-c3c9-4f79-b87a-51a0b68036e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:42:54.253018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73f16a-c3c9-4f79-b87a-51a0b68036e5 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:42:54.260068 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda0bef-fdcd-4b50-a776-d9606192e5b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:42:54.260068 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda0bef-fdcd-4b50-a776-d9606192e5b7 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:42:54.260068 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda0bef-fdcd-4b50-a776-d9606192e5b7 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:42:54.260068 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda0bef-fdcd-4b50-a776-d9606192e5b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:42:54.261186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade495dd-c104-45c7-8c26-9fd6d0e2266d service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:42:54.261899 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ecda0bef-fdcd-4b50-a776-d9606192e5b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:42:54.262788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ade495dd-c104-45c7-8c26-9fd6d0e2266d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:42:54.275370 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade495dd-c104-45c7-8c26-9fd6d0e2266d service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:42:54.279745 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda0bef-fdcd-4b50-a776-d9606192e5b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:42:54.280097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a724f-9154-497f-acde-2864679e4c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:42:54.280722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a724f-9154-497f-acde-2864679e4c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:42:54.281049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a724f-9154-497f-acde-2864679e4c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:42:54.281317 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a724f-9154-497f-acde-2864679e4c47 admin admin] PATH_INFO: `/v3/users/caa1565f8d9a41cd8632bfe08f9f1c38` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:42:54.282039 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda0bef-fdcd-4b50-a776-d9606192e5b7 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:42:54.282876 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a724f-9154-497f-acde-2864679e4c47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caa1565f8d9a41cd8632bfe08f9f1c38)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:42:54.284813 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a724f-9154-497f-acde-2864679e4c47 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:42:54.305795 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4331/8655] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:42:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:42:54.341189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-684a724f-9154-497f-acde-2864679e4c47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caa1565f8d9a41cd8632bfe08f9f1c38'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:54.342900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-684a724f-9154-497f-acde-2864679e4c47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caa1565f8d9a41cd8632bfe08f9f1c38'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:54.350032 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-684a724f-9154-497f-acde-2864679e4c47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caa1565f8d9a41cd8632bfe08f9f1c38'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:54.359487 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-684a724f-9154-497f-acde-2864679e4c47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caa1565f8d9a41cd8632bfe08f9f1c38'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:54.360284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-684a724f-9154-497f-acde-2864679e4c47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caa1565f8d9a41cd8632bfe08f9f1c38'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:54.378465 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4325/8656] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:42:54 2022] DELETE /identity/v3/users/caa1565f8d9a41cd8632bfe08f9f1c38 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:42:54.575237 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda0bef-fdcd-4b50-a776-d9606192e5b7 service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:42:54.592675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda0bef-fdcd-4b50-a776-d9606192e5b7 service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:42:54.629175 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:42:54.660073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7b91b-cdd0-42a3-a5f1-dc6185ca056c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:42:54.660630 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7b91b-cdd0-42a3-a5f1-dc6185ca056c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:42:54.660906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7b91b-cdd0-42a3-a5f1-dc6185ca056c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:42:54.661178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7b91b-cdd0-42a3-a5f1-dc6185ca056c admin admin] PATH_INFO: `/v3/projects/d315d287f5584f4f83558b6d9cd68a4e` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:42:54.662323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c7b91b-cdd0-42a3-a5f1-dc6185ca056c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d315d287f5584f4f83558b6d9cd68a4e)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:42:54.664210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c7b91b-cdd0-42a3-a5f1-dc6185ca056c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:42:54.721844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c4c7b91b-cdd0-42a3-a5f1-dc6185ca056c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd315d287f5584f4f83558b6d9cd68a4e', 'request_id': 'req-c4c7b91b-cdd0-42a3-a5f1-dc6185ca056c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:54.730062 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c4c7b91b-cdd0-42a3-a5f1-dc6185ca056c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd315d287f5584f4f83558b6d9cd68a4e', 'request_id': 'req-c4c7b91b-cdd0-42a3-a5f1-dc6185ca056c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:54.743055 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c4c7b91b-cdd0-42a3-a5f1-dc6185ca056c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd315d287f5584f4f83558b6d9cd68a4e', 'request_id': 'req-c4c7b91b-cdd0-42a3-a5f1-dc6185ca056c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:54.754819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c4c7b91b-cdd0-42a3-a5f1-dc6185ca056c admin admin] The token cache is being invalidate because project d315d287f5584f4f83558b6d9cd68a4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:42:54.755258 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c4c7b91b-cdd0-42a3-a5f1-dc6185ca056c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:54.756085 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c4c7b91b-cdd0-42a3-a5f1-dc6185ca056c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:54.757945 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4332/8657] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:42:54 2022] DELETE /identity/v3/projects/d315d287f5584f4f83558b6d9cd68a4e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:42:54.762017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a724f-9154-497f-acde-2864679e4c47 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:42:54.763430 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-684a724f-9154-497f-acde-2864679e4c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:42:54.784032 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a724f-9154-497f-acde-2864679e4c47 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:42:54.803193 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:42:54.853147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043bb9ce-93ed-42d4-8b87-720a902d5960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:42:54.853896 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bb9ce-93ed-42d4-8b87-720a902d5960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:42:54.854247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bb9ce-93ed-42d4-8b87-720a902d5960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:42:54.854590 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bb9ce-93ed-42d4-8b87-720a902d5960 admin admin] PATH_INFO: `/v3/users/996c06f2f2844892ab3598e9c1e9da08` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:42:54.855816 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043bb9ce-93ed-42d4-8b87-720a902d5960 admin admin] RBAC: Authorizing `identity:delete_user(user_id=996c06f2f2844892ab3598e9c1e9da08)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:42:54.858117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043bb9ce-93ed-42d4-8b87-720a902d5960 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:42:54.912522 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-043bb9ce-93ed-42d4-8b87-720a902d5960 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '996c06f2f2844892ab3598e9c1e9da08'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:54.913385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-043bb9ce-93ed-42d4-8b87-720a902d5960 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '996c06f2f2844892ab3598e9c1e9da08'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:54.927972 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-043bb9ce-93ed-42d4-8b87-720a902d5960 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '996c06f2f2844892ab3598e9c1e9da08'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:54.931168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-043bb9ce-93ed-42d4-8b87-720a902d5960 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '996c06f2f2844892ab3598e9c1e9da08'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:54.931866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-043bb9ce-93ed-42d4-8b87-720a902d5960 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '996c06f2f2844892ab3598e9c1e9da08'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:54.950055 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4326/8658] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:42:54 2022] DELETE /identity/v3/users/996c06f2f2844892ab3598e9c1e9da08 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:42:55.127270 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7b91b-cdd0-42a3-a5f1-dc6185ca056c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:42:55.129271 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c4c7b91b-cdd0-42a3-a5f1-dc6185ca056c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:42:55.152197 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7b91b-cdd0-42a3-a5f1-dc6185ca056c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:42:55.212799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c1fc50-cac7-4b00-8880-d4b07bb58fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:42:55.213652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1fc50-cac7-4b00-8880-d4b07bb58fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:42:55.213869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1fc50-cac7-4b00-8880-d4b07bb58fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:42:55.214140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1fc50-cac7-4b00-8880-d4b07bb58fd9 admin admin] PATH_INFO: `/v3/projects/e321d156e3604108a0dd1abb1a7f7ea7` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:42:55.215282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c1fc50-cac7-4b00-8880-d4b07bb58fd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e321d156e3604108a0dd1abb1a7f7ea7)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:42:55.217514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c1fc50-cac7-4b00-8880-d4b07bb58fd9 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:42:55.267641 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-74c1fc50-cac7-4b00-8880-d4b07bb58fd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e321d156e3604108a0dd1abb1a7f7ea7', 'request_id': 'req-74c1fc50-cac7-4b00-8880-d4b07bb58fd9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:55.274852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-74c1fc50-cac7-4b00-8880-d4b07bb58fd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e321d156e3604108a0dd1abb1a7f7ea7', 'request_id': 'req-74c1fc50-cac7-4b00-8880-d4b07bb58fd9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:55.280761 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:42:55.283082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-74c1fc50-cac7-4b00-8880-d4b07bb58fd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e321d156e3604108a0dd1abb1a7f7ea7', 'request_id': 'req-74c1fc50-cac7-4b00-8880-d4b07bb58fd9'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:55.299648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-74c1fc50-cac7-4b00-8880-d4b07bb58fd9 admin admin] The token cache is being invalidate because project e321d156e3604108a0dd1abb1a7f7ea7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:42:55.300009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-74c1fc50-cac7-4b00-8880-d4b07bb58fd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:55.301172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-74c1fc50-cac7-4b00-8880-d4b07bb58fd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:42:55.303072 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4333/8659] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:42:55 2022] DELETE /identity/v3/projects/e321d156e3604108a0dd1abb1a7f7ea7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:43:04.946502 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=44,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:43:05.301313 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:43:14.918629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043bb9ce-93ed-42d4-8b87-720a902d5960 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:43:14.920813 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-043bb9ce-93ed-42d4-8b87-720a902d5960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:43:14.949115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043bb9ce-93ed-42d4-8b87-720a902d5960 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:43:15.015617 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115f0a6-b347-42bc-b147-af6526fe3b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:43:15.016269 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115f0a6-b347-42bc-b147-af6526fe3b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:43:15.016812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115f0a6-b347-42bc-b147-af6526fe3b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:43:15.016936 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115f0a6-b347-42bc-b147-af6526fe3b69 admin admin] PATH_INFO: `/v3/users/93c8175403734403b6dcba4cba264697` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:43:15.018392 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115f0a6-b347-42bc-b147-af6526fe3b69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93c8175403734403b6dcba4cba264697)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:43:15.020396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115f0a6-b347-42bc-b147-af6526fe3b69 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:43:15.076915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f115f0a6-b347-42bc-b147-af6526fe3b69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93c8175403734403b6dcba4cba264697'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:43:15.077650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f115f0a6-b347-42bc-b147-af6526fe3b69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93c8175403734403b6dcba4cba264697'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:43:15.084791 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f115f0a6-b347-42bc-b147-af6526fe3b69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93c8175403734403b6dcba4cba264697'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:43:15.092433 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f115f0a6-b347-42bc-b147-af6526fe3b69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93c8175403734403b6dcba4cba264697'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:43:15.093657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-f115f0a6-b347-42bc-b147-af6526fe3b69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93c8175403734403b6dcba4cba264697'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:43:15.113178 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4327/8660] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:43:14 2022] DELETE /identity/v3/users/93c8175403734403b6dcba4cba264697 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:43:15.118205 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4085cb9-29a0-4722-a7af-58e262fe2f64 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:43:15.118700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4085cb9-29a0-4722-a7af-58e262fe2f64 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:43:15.118819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4085cb9-29a0-4722-a7af-58e262fe2f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:43:15.139809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d4085cb9-29a0-4722-a7af-58e262fe2f64 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:43:15.141227 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d4085cb9-29a0-4722-a7af-58e262fe2f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:43:15.210617 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4334/8661] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:43:15.220823 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115f0a6-b347-42bc-b147-af6526fe3b69 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:43:15.222454 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f115f0a6-b347-42bc-b147-af6526fe3b69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:43:15.289041 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115f0a6-b347-42bc-b147-af6526fe3b69 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:43:15.294937 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67718bad-a502-450c-bb6e-a2d63be53b18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:43:15.295524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67718bad-a502-450c-bb6e-a2d63be53b18 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:43:15.298036 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67718bad-a502-450c-bb6e-a2d63be53b18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:43:15.298036 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67718bad-a502-450c-bb6e-a2d63be53b18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:43:15.308880 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67718bad-a502-450c-bb6e-a2d63be53b18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:43:15.310703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67718bad-a502-450c-bb6e-a2d63be53b18 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:43:15.324067 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4328/8662] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:43:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:43:15.519919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4085cb9-29a0-4722-a7af-58e262fe2f64 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:43:15.521660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d4085cb9-29a0-4722-a7af-58e262fe2f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:43:15.537627 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4085cb9-29a0-4722-a7af-58e262fe2f64 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:43:15.549305 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f57bc-67fe-46d8-bd7c-4bae60274f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:43:15.550469 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f57bc-67fe-46d8-bd7c-4bae60274f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:43:15.551310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f57bc-67fe-46d8-bd7c-4bae60274f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:43:15.551922 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f57bc-67fe-46d8-bd7c-4bae60274f50 admin admin] PATH_INFO: `/v3/projects/912b57ac86f34ec989c7e7ba6fe141f0` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:43:15.563621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f57bc-67fe-46d8-bd7c-4bae60274f50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=912b57ac86f34ec989c7e7ba6fe141f0)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:43:15.567911 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f57bc-67fe-46d8-bd7c-4bae60274f50 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:43:15.632558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c15f57bc-67fe-46d8-bd7c-4bae60274f50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '912b57ac86f34ec989c7e7ba6fe141f0', 'request_id': 'req-c15f57bc-67fe-46d8-bd7c-4bae60274f50'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:43:15.645197 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c15f57bc-67fe-46d8-bd7c-4bae60274f50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '912b57ac86f34ec989c7e7ba6fe141f0', 'request_id': 'req-c15f57bc-67fe-46d8-bd7c-4bae60274f50'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:43:15.652411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c15f57bc-67fe-46d8-bd7c-4bae60274f50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '912b57ac86f34ec989c7e7ba6fe141f0', 'request_id': 'req-c15f57bc-67fe-46d8-bd7c-4bae60274f50'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:43:15.667615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c15f57bc-67fe-46d8-bd7c-4bae60274f50 admin admin] The token cache is being invalidate because project 912b57ac86f34ec989c7e7ba6fe141f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:43:15.669401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c15f57bc-67fe-46d8-bd7c-4bae60274f50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:43:15.670359 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c15f57bc-67fe-46d8-bd7c-4bae60274f50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:43:15.672260 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4335/8663] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:43:15 2022] DELETE /identity/v3/projects/912b57ac86f34ec989c7e7ba6fe141f0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:43:15.678127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb647e-2e9b-49ec-b514-15daff6445fb None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:43:15.678464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb647e-2e9b-49ec-b514-15daff6445fb None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:43:15.678934 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb647e-2e9b-49ec-b514-15daff6445fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:43:15.704202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-3cdb647e-2e9b-49ec-b514-15daff6445fb None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:43:15.705678 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3cdb647e-2e9b-49ec-b514-15daff6445fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:43:15.729789 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:43:15.812936 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4329/8664] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:43:15.820942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13221490-37e2-425c-b0ff-8e1b45888a55 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:43:15.821352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13221490-37e2-425c-b0ff-8e1b45888a55 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:43:15.821556 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13221490-37e2-425c-b0ff-8e1b45888a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:43:15.847838 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-13221490-37e2-425c-b0ff-8e1b45888a55 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:43:15.848542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-13221490-37e2-425c-b0ff-8e1b45888a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:43:15.869520 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4336/8665] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:43:15.870409 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb647e-2e9b-49ec-b514-15daff6445fb None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:43:15.881834 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb647e-2e9b-49ec-b514-15daff6445fb None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:43:15.887891 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f0ae6-f817-420f-8ab1-83abfc762beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:43:15.888484 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f0ae6-f817-420f-8ab1-83abfc762beb admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:43:15.888766 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f0ae6-f817-420f-8ab1-83abfc762beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:43:15.889046 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f0ae6-f817-420f-8ab1-83abfc762beb admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:43:15.889756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f0ae6-f817-420f-8ab1-83abfc762beb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:43:15.890121 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f0ae6-f817-420f-8ab1-83abfc762beb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:43:15.891942 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f0ae6-f817-420f-8ab1-83abfc762beb admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:43:15.913852 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4330/8666] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:43:15.915364 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13221490-37e2-425c-b0ff-8e1b45888a55 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:43:15.930560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13221490-37e2-425c-b0ff-8e1b45888a55 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:43:15.936321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c0657-de24-42e6-8f48-9d20a6fc138a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:43:15.937831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c0657-de24-42e6-8f48-9d20a6fc138a admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:43:15.938312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c0657-de24-42e6-8f48-9d20a6fc138a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:43:15.938614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c0657-de24-42e6-8f48-9d20a6fc138a admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:43:15.939252 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c0657-de24-42e6-8f48-9d20a6fc138a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:43:15.941563 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c0657-de24-42e6-8f48-9d20a6fc138a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:43:15.979417 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4337/8667] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:43:15 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:43:15.986379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f0ae6-f817-420f-8ab1-83abfc762beb admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:43:15.998451 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f0ae6-f817-420f-8ab1-83abfc762beb admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:43:16.081820 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47bb18-9bb5-47ff-ac16-04a823c0efce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:43:16.082621 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47bb18-9bb5-47ff-ac16-04a823c0efce admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:43:16.083314 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47bb18-9bb5-47ff-ac16-04a823c0efce admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:43:16.083629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47bb18-9bb5-47ff-ac16-04a823c0efce admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:43:16.085187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47bb18-9bb5-47ff-ac16-04a823c0efce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:43:16.087622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47bb18-9bb5-47ff-ac16-04a823c0efce admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:43:16.115030 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4331/8668] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:43:15 2022] POST /identity/v3/users => generated 287 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:43:16.118788 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c0657-de24-42e6-8f48-9d20a6fc138a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:43:16.130574 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c0657-de24-42e6-8f48-9d20a6fc138a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:43:16.135403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46fabd-707a-4d50-b1fb-8ebd7c6636c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:43:16.136182 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46fabd-707a-4d50-b1fb-8ebd7c6636c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:43:16.136478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46fabd-707a-4d50-b1fb-8ebd7c6636c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:43:16.136747 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46fabd-707a-4d50-b1fb-8ebd7c6636c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:43:16.137531 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46fabd-707a-4d50-b1fb-8ebd7c6636c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:43:16.139127 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46fabd-707a-4d50-b1fb-8ebd7c6636c0 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:43:16.154904 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4338/8669] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:43:16.157282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47bb18-9bb5-47ff-ac16-04a823c0efce admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:43:16.168066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47bb18-9bb5-47ff-ac16-04a823c0efce admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:43:16.174274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c89da-77ce-4a79-b718-75966af45ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:43:16.174878 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c89da-77ce-4a79-b718-75966af45ead admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:43:16.175156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c89da-77ce-4a79-b718-75966af45ead admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:43:16.175422 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c89da-77ce-4a79-b718-75966af45ead admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:43:16.176058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c89da-77ce-4a79-b718-75966af45ead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:43:16.177784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c89da-77ce-4a79-b718-75966af45ead admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:43:16.190729 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4332/8670] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:43:16.195205 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46fabd-707a-4d50-b1fb-8ebd7c6636c0 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:43:16.206492 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46fabd-707a-4d50-b1fb-8ebd7c6636c0 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:43:16.212517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b7faf5-d569-45c1-b8ec-0c7cc9dedd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:43:16.213514 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7faf5-d569-45c1-b8ec-0c7cc9dedd6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:43:16.213803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7faf5-d569-45c1-b8ec-0c7cc9dedd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:43:16.214080 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7faf5-d569-45c1-b8ec-0c7cc9dedd6c admin admin] PATH_INFO: `/v3/projects/07b5dbffd9e648daae797dfae187f0cf/users/39edb7ede31446eb80f2e510e513afa1/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:43:16.231358 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b7faf5-d569-45c1-b8ec-0c7cc9dedd6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=07b5dbffd9e648daae797dfae187f0cf, user_id=39edb7ede31446eb80f2e510e513afa1, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:43:16.238133 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b7faf5-d569-45c1-b8ec-0c7cc9dedd6c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:43:16.253401 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4339/8671] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:43:16 2022] PUT /identity/v3/projects/07b5dbffd9e648daae797dfae187f0cf/users/39edb7ede31446eb80f2e510e513afa1/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:43:16.267324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0cd116-dea0-42c8-a22c-ec4e40a5f57a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:43:16.267610 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0cd116-dea0-42c8-a22c-ec4e40a5f57a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:43:16.267877 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0cd116-dea0-42c8-a22c-ec4e40a5f57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:43:16.300305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ae0cd116-dea0-42c8-a22c-ec4e40a5f57a None None] MFA Rules not processed for user `39edb7ede31446eb80f2e510e513afa1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:43:16.301797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ae0cd116-dea0-42c8-a22c-ec4e40a5f57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:43:16.391996 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4333/8672] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:43:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:43:16.397517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b7faf5-d569-45c1-b8ec-0c7cc9dedd6c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:43:16.425581 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:43:16.483490 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b7faf5-d569-45c1-b8ec-0c7cc9dedd6c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:43:16.491784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2069c1-c9a3-4b99-bd13-ed70ecad8770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:43:16.492741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2069c1-c9a3-4b99-bd13-ed70ecad8770 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:43:16.493307 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2069c1-c9a3-4b99-bd13-ed70ecad8770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:43:16.493851 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2069c1-c9a3-4b99-bd13-ed70ecad8770 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:43:16.494675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2069c1-c9a3-4b99-bd13-ed70ecad8770 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:43:16.497292 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2069c1-c9a3-4b99-bd13-ed70ecad8770 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:43:16.538754 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4340/8673] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:43:16 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:43:16.540697 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0cd116-dea0-42c8-a22c-ec4e40a5f57a None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:43:16.556058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0cd116-dea0-42c8-a22c-ec4e40a5f57a None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:43:16.575033 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:43:16.665424 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af689e09-efe0-4304-ac0b-7fc9a08e8a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:43:16.666720 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af689e09-efe0-4304-ac0b-7fc9a08e8a68 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:43:16.667209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af689e09-efe0-4304-ac0b-7fc9a08e8a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:43:16.667760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af689e09-efe0-4304-ac0b-7fc9a08e8a68 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:43:16.668975 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af689e09-efe0-4304-ac0b-7fc9a08e8a68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:43:16.672951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af689e09-efe0-4304-ac0b-7fc9a08e8a68 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:43:16.718285 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4334/8674] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:43:16 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:43:16.719075 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2069c1-c9a3-4b99-bd13-ed70ecad8770 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:43:16.743168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2069c1-c9a3-4b99-bd13-ed70ecad8770 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:43:16.752655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa209410-1df8-48b7-b002-889488018b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:43:16.754719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa209410-1df8-48b7-b002-889488018b4a admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:43:16.755384 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa209410-1df8-48b7-b002-889488018b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:43:16.756148 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa209410-1df8-48b7-b002-889488018b4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:43:16.757495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa209410-1df8-48b7-b002-889488018b4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:43:16.761802 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa209410-1df8-48b7-b002-889488018b4a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:43:16.781385 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4341/8675] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:43:16.787983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af689e09-efe0-4304-ac0b-7fc9a08e8a68 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:43:16.804039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af689e09-efe0-4304-ac0b-7fc9a08e8a68 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:43:16.811442 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca9109-c49f-46b6-920b-5c88396aeee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:43:16.812378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca9109-c49f-46b6-920b-5c88396aeee8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:43:16.812672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca9109-c49f-46b6-920b-5c88396aeee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:43:16.813041 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca9109-c49f-46b6-920b-5c88396aeee8 admin admin] PATH_INFO: `/v3/projects/fd05d787007d402badb87a0d4ea0c8c2/users/23ee3d84af96462fa6165f7275010807/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:43:16.863067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca9109-c49f-46b6-920b-5c88396aeee8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd05d787007d402badb87a0d4ea0c8c2, user_id=23ee3d84af96462fa6165f7275010807, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:43:16.866913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca9109-c49f-46b6-920b-5c88396aeee8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:43:16.913485 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4335/8676] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:43:16 2022] PUT /identity/v3/projects/fd05d787007d402badb87a0d4ea0c8c2/users/23ee3d84af96462fa6165f7275010807/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:43:16.917662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa209410-1df8-48b7-b002-889488018b4a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:43:16.931937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa209410-1df8-48b7-b002-889488018b4a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:43:17.042766 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72df23c-f2fe-4bab-bea7-92b5e870d14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:43:17.043650 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72df23c-f2fe-4bab-bea7-92b5e870d14e admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:43:17.044071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72df23c-f2fe-4bab-bea7-92b5e870d14e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:43:17.044568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72df23c-f2fe-4bab-bea7-92b5e870d14e admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:43:17.045474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72df23c-f2fe-4bab-bea7-92b5e870d14e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:43:17.047805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72df23c-f2fe-4bab-bea7-92b5e870d14e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:43:17.061739 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4342/8677] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:43:17.065881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca9109-c49f-46b6-920b-5c88396aeee8 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:43:17.078625 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca9109-c49f-46b6-920b-5c88396aeee8 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:43:17.084738 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1683c5d-8922-4661-9f7a-17d06773cf43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:43:17.085570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1683c5d-8922-4661-9f7a-17d06773cf43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:43:17.085957 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1683c5d-8922-4661-9f7a-17d06773cf43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:43:17.086336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1683c5d-8922-4661-9f7a-17d06773cf43 admin admin] PATH_INFO: `/v3/projects/fd05d787007d402badb87a0d4ea0c8c2/users/23ee3d84af96462fa6165f7275010807/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:43:17.088459 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1683c5d-8922-4661-9f7a-17d06773cf43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd05d787007d402badb87a0d4ea0c8c2, user_id=23ee3d84af96462fa6165f7275010807, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:43:17.091333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1683c5d-8922-4661-9f7a-17d06773cf43 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:43:17.104575 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4336/8678] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:43:17 2022] PUT /identity/v3/projects/fd05d787007d402badb87a0d4ea0c8c2/users/23ee3d84af96462fa6165f7275010807/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:43:17.116731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1da5f-b5d6-48a0-be06-8f69277e91d8 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:43:17.117011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1da5f-b5d6-48a0-be06-8f69277e91d8 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:43:17.117285 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1da5f-b5d6-48a0-be06-8f69277e91d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:43:17.154790 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5fa1da5f-b5d6-48a0-be06-8f69277e91d8 None None] MFA Rules not processed for user `23ee3d84af96462fa6165f7275010807`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:43:17.156815 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5fa1da5f-b5d6-48a0-be06-8f69277e91d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:43:17.235216 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4343/8679] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:43:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:43:17.246593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1683c5d-8922-4661-9f7a-17d06773cf43 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:43:17.248928 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c1683c5d-8922-4661-9f7a-17d06773cf43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:43:17.344277 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1683c5d-8922-4661-9f7a-17d06773cf43 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:43:17.348298 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db218fdf-59fc-4ae3-a99a-37b07c1a3454 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:43:17.348935 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db218fdf-59fc-4ae3-a99a-37b07c1a3454 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:43:17.349267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db218fdf-59fc-4ae3-a99a-37b07c1a3454 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:43:17.349528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db218fdf-59fc-4ae3-a99a-37b07c1a3454 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:43:17.422451 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db218fdf-59fc-4ae3-a99a-37b07c1a3454 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:43:17.424207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db218fdf-59fc-4ae3-a99a-37b07c1a3454 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:43:17.434873 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4337/8680] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:43:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:43:19.835420 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1da5f-b5d6-48a0-be06-8f69277e91d8 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:43:19.851616 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1da5f-b5d6-48a0-be06-8f69277e91d8 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:43:19.857314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91026bf6-fe9b-4f8e-b14d-3399e81f48c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:43:19.858107 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91026bf6-fe9b-4f8e-b14d-3399e81f48c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:43:19.859492 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91026bf6-fe9b-4f8e-b14d-3399e81f48c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:43:19.859857 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91026bf6-fe9b-4f8e-b14d-3399e81f48c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:43:19.877057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91026bf6-fe9b-4f8e-b14d-3399e81f48c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:43:19.879581 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91026bf6-fe9b-4f8e-b14d-3399e81f48c5 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:43:19.892000 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4344/8681] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:43:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:43:25.939077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c35514-5d8b-4c58-84c1-ba05c8d3fda3 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:43:25.939583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c35514-5d8b-4c58-84c1-ba05c8d3fda3 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:43:25.939681 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c35514-5d8b-4c58-84c1-ba05c8d3fda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:43:25.984972 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-15c35514-5d8b-4c58-84c1-ba05c8d3fda3 None None] MFA Rules not processed for user `39edb7ede31446eb80f2e510e513afa1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:43:25.986235 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-15c35514-5d8b-4c58-84c1-ba05c8d3fda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:43:26.011295 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4338/8682] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:43:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:43:29.886054 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:43:35.955620 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=87,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:43:42.136945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91026bf6-fe9b-4f8e-b14d-3399e81f48c5 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:43:42.138612 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-91026bf6-fe9b-4f8e-b14d-3399e81f48c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:43:42.261829 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91026bf6-fe9b-4f8e-b14d-3399e81f48c5 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:43:42.272396 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307aff3-f13a-4ccd-9a03-85a125a08ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:43:42.273056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307aff3-f13a-4ccd-9a03-85a125a08ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:43:42.273335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307aff3-f13a-4ccd-9a03-85a125a08ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:43:42.273687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307aff3-f13a-4ccd-9a03-85a125a08ad4 admin admin] PATH_INFO: `/v3/users/85eb224d8c1e420685eacc747b4f240d` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:43:42.275203 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9307aff3-f13a-4ccd-9a03-85a125a08ad4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85eb224d8c1e420685eacc747b4f240d)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:43:42.277193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9307aff3-f13a-4ccd-9a03-85a125a08ad4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:43:42.355133 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9307aff3-f13a-4ccd-9a03-85a125a08ad4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85eb224d8c1e420685eacc747b4f240d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:43:42.356083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9307aff3-f13a-4ccd-9a03-85a125a08ad4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85eb224d8c1e420685eacc747b4f240d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:43:42.366719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9307aff3-f13a-4ccd-9a03-85a125a08ad4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85eb224d8c1e420685eacc747b4f240d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:43:42.380682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9307aff3-f13a-4ccd-9a03-85a125a08ad4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85eb224d8c1e420685eacc747b4f240d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:43:42.381322 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9307aff3-f13a-4ccd-9a03-85a125a08ad4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85eb224d8c1e420685eacc747b4f240d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:43:42.417631 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4345/8683] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:43:42 2022] DELETE /identity/v3/users/85eb224d8c1e420685eacc747b4f240d => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:43:42.626051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c35514-5d8b-4c58-84c1-ba05c8d3fda3 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:43:42.645403 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c35514-5d8b-4c58-84c1-ba05c8d3fda3 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:43:42.720209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ded5dd-05af-4f83-af10-abc9f3bdb9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:43:42.720731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ded5dd-05af-4f83-af10-abc9f3bdb9f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:43:42.721402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ded5dd-05af-4f83-af10-abc9f3bdb9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:43:42.722137 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ded5dd-05af-4f83-af10-abc9f3bdb9f8 admin admin] PATH_INFO: `/v3/projects/1c0db481d05a42dc92a590006af6e759` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:43:42.723646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ded5dd-05af-4f83-af10-abc9f3bdb9f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c0db481d05a42dc92a590006af6e759)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:43:42.725802 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ded5dd-05af-4f83-af10-abc9f3bdb9f8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:43:42.787811 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-92ded5dd-05af-4f83-af10-abc9f3bdb9f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c0db481d05a42dc92a590006af6e759', 'request_id': 'req-92ded5dd-05af-4f83-af10-abc9f3bdb9f8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:43:42.801284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-92ded5dd-05af-4f83-af10-abc9f3bdb9f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c0db481d05a42dc92a590006af6e759', 'request_id': 'req-92ded5dd-05af-4f83-af10-abc9f3bdb9f8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:43:42.811884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-92ded5dd-05af-4f83-af10-abc9f3bdb9f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c0db481d05a42dc92a590006af6e759', 'request_id': 'req-92ded5dd-05af-4f83-af10-abc9f3bdb9f8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:43:42.824558 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-92ded5dd-05af-4f83-af10-abc9f3bdb9f8 admin admin] The token cache is being invalidate because project 1c0db481d05a42dc92a590006af6e759 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:43:42.824841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-92ded5dd-05af-4f83-af10-abc9f3bdb9f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:43:42.825662 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-92ded5dd-05af-4f83-af10-abc9f3bdb9f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:43:42.830228 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4339/8684] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:43:42 2022] DELETE /identity/v3/projects/1c0db481d05a42dc92a590006af6e759 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:43:42.832100 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307aff3-f13a-4ccd-9a03-85a125a08ad4 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:43:42.834289 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9307aff3-f13a-4ccd-9a03-85a125a08ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:43:42.851024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307aff3-f13a-4ccd-9a03-85a125a08ad4 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:43:42.931087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd64af-e0ae-4dba-91aa-4b4f718e4570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:43:42.931879 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd64af-e0ae-4dba-91aa-4b4f718e4570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:43:42.932106 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd64af-e0ae-4dba-91aa-4b4f718e4570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:43:42.932396 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd64af-e0ae-4dba-91aa-4b4f718e4570 admin admin] PATH_INFO: `/v3/users/530be482a72c4746b5b449cb1be6cdff` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:43:42.933711 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd64af-e0ae-4dba-91aa-4b4f718e4570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=530be482a72c4746b5b449cb1be6cdff)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:43:42.935655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd64af-e0ae-4dba-91aa-4b4f718e4570 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:43:42.954030 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:43:43.006420 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6cdd64af-e0ae-4dba-91aa-4b4f718e4570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '530be482a72c4746b5b449cb1be6cdff'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:43:43.007281 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6cdd64af-e0ae-4dba-91aa-4b4f718e4570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '530be482a72c4746b5b449cb1be6cdff'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:43:43.016794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6cdd64af-e0ae-4dba-91aa-4b4f718e4570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '530be482a72c4746b5b449cb1be6cdff'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:43:43.030424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6cdd64af-e0ae-4dba-91aa-4b4f718e4570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '530be482a72c4746b5b449cb1be6cdff'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:43:43.031468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6cdd64af-e0ae-4dba-91aa-4b4f718e4570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '530be482a72c4746b5b449cb1be6cdff'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:43:43.060537 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4346/8685] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:43:42 2022] DELETE /identity/v3/users/530be482a72c4746b5b449cb1be6cdff => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:43:43.280770 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ded5dd-05af-4f83-af10-abc9f3bdb9f8 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:43:43.283051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-92ded5dd-05af-4f83-af10-abc9f3bdb9f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:43:43.302457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ded5dd-05af-4f83-af10-abc9f3bdb9f8 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:43:43.394089 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519f6bb-f628-4b3c-8279-ecf1650b9f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:43:43.395053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519f6bb-f628-4b3c-8279-ecf1650b9f2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:43:43.395818 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519f6bb-f628-4b3c-8279-ecf1650b9f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:43:43.396336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519f6bb-f628-4b3c-8279-ecf1650b9f2f admin admin] PATH_INFO: `/v3/projects/b45095a91a994ef79c60acd8e475d7a5` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:43:43.397754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6519f6bb-f628-4b3c-8279-ecf1650b9f2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b45095a91a994ef79c60acd8e475d7a5)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:43:43.399780 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6519f6bb-f628-4b3c-8279-ecf1650b9f2f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:43:43.457976 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:43:43.471629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6519f6bb-f628-4b3c-8279-ecf1650b9f2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b45095a91a994ef79c60acd8e475d7a5', 'request_id': 'req-6519f6bb-f628-4b3c-8279-ecf1650b9f2f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:43:43.481194 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6519f6bb-f628-4b3c-8279-ecf1650b9f2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b45095a91a994ef79c60acd8e475d7a5', 'request_id': 'req-6519f6bb-f628-4b3c-8279-ecf1650b9f2f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:43:43.490453 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6519f6bb-f628-4b3c-8279-ecf1650b9f2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b45095a91a994ef79c60acd8e475d7a5', 'request_id': 'req-6519f6bb-f628-4b3c-8279-ecf1650b9f2f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:43:43.502837 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6519f6bb-f628-4b3c-8279-ecf1650b9f2f admin admin] The token cache is being invalidate because project b45095a91a994ef79c60acd8e475d7a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:43:43.503129 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6519f6bb-f628-4b3c-8279-ecf1650b9f2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:43:43.503804 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6519f6bb-f628-4b3c-8279-ecf1650b9f2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:43:43.505422 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4340/8686] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:43:43 2022] DELETE /identity/v3/projects/b45095a91a994ef79c60acd8e475d7a5 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:43:43.651580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd64af-e0ae-4dba-91aa-4b4f718e4570 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:43:43.653194 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6cdd64af-e0ae-4dba-91aa-4b4f718e4570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:43:43.748662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd64af-e0ae-4dba-91aa-4b4f718e4570 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:43:43.827852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca521de-6b03-4522-a7bb-555c8ca3ab55 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:43:43.828662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca521de-6b03-4522-a7bb-555c8ca3ab55 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:43:43.829040 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca521de-6b03-4522-a7bb-555c8ca3ab55 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:43:43.829411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca521de-6b03-4522-a7bb-555c8ca3ab55 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:43:43.831756 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9ca521de-6b03-4522-a7bb-555c8ca3ab55 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:43:43.848877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca521de-6b03-4522-a7bb-555c8ca3ab55 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:43:43.850800 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca521de-6b03-4522-a7bb-555c8ca3ab55 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:43:43.871649 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4347/8687] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:43:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:43:53.499247 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:43:53.862491 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=80,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:44:10.001475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60022f37-69b9-47be-b389-81becbb955a3 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:10.001475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60022f37-69b9-47be-b389-81becbb955a3 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:10.002161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60022f37-69b9-47be-b389-81becbb955a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:10.033751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-60022f37-69b9-47be-b389-81becbb955a3 None None] MFA Rules not processed for user `f39dd2d709374c729d51f7e2cf18300c`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:44:10.034980 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-60022f37-69b9-47be-b389-81becbb955a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:44:10.095591 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4341/8688] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:44:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:44:18.787576 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64bebd-2edb-4a36-929e-85266d7f3ef6 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:18.788087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64bebd-2edb-4a36-929e-85266d7f3ef6 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:18.788918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64bebd-2edb-4a36-929e-85266d7f3ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:18.824065 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-fd64bebd-2edb-4a36-929e-85266d7f3ef6 None None] MFA Rules not processed for user `39edb7ede31446eb80f2e510e513afa1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:44:18.825728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-fd64bebd-2edb-4a36-929e-85266d7f3ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:44:18.900913 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4348/8689] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:44:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:44:19.809728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60022f37-69b9-47be-b389-81becbb955a3 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:19.811311 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-60022f37-69b9-47be-b389-81becbb955a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:44:19.900648 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60022f37-69b9-47be-b389-81becbb955a3 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:19.906219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe3446-5e6d-4de2-9849-a8e54a540252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:19.908228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe3446-5e6d-4de2-9849-a8e54a540252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:19.908511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe3446-5e6d-4de2-9849-a8e54a540252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:19.908794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe3446-5e6d-4de2-9849-a8e54a540252 admin admin] PATH_INFO: `/v3/users/7882b11bb83c4278963556f404f10b1f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:19.910165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe3446-5e6d-4de2-9849-a8e54a540252 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7882b11bb83c4278963556f404f10b1f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:19.912607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe3446-5e6d-4de2-9849-a8e54a540252 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:19.999110 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-22fe3446-5e6d-4de2-9849-a8e54a540252 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7882b11bb83c4278963556f404f10b1f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:19.999793 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-22fe3446-5e6d-4de2-9849-a8e54a540252 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7882b11bb83c4278963556f404f10b1f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:20.027210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-22fe3446-5e6d-4de2-9849-a8e54a540252 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7882b11bb83c4278963556f404f10b1f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:20.038372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-22fe3446-5e6d-4de2-9849-a8e54a540252 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7882b11bb83c4278963556f404f10b1f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:20.042073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-22fe3446-5e6d-4de2-9849-a8e54a540252 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7882b11bb83c4278963556f404f10b1f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:20.070624 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4342/8690] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:44:19 2022] DELETE /identity/v3/users/7882b11bb83c4278963556f404f10b1f => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:44:20.287099 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64bebd-2edb-4a36-929e-85266d7f3ef6 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:20.300217 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64bebd-2edb-4a36-929e-85266d7f3ef6 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:20.402253 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0eab2-e61c-486f-8e24-f58582cc9ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:20.403008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0eab2-e61c-486f-8e24-f58582cc9ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:20.403443 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0eab2-e61c-486f-8e24-f58582cc9ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:20.403813 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0eab2-e61c-486f-8e24-f58582cc9ced admin admin] PATH_INFO: `/v3/projects/03bb90ba4ab241f691d7971f2c98d806` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:20.406114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0eab2-e61c-486f-8e24-f58582cc9ced admin admin] RBAC: Authorizing `identity:delete_project(project_id=03bb90ba4ab241f691d7971f2c98d806)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:20.408719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0eab2-e61c-486f-8e24-f58582cc9ced admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:20.492946 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d3f0eab2-e61c-486f-8e24-f58582cc9ced admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03bb90ba4ab241f691d7971f2c98d806', 'request_id': 'req-d3f0eab2-e61c-486f-8e24-f58582cc9ced'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:20.505082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d3f0eab2-e61c-486f-8e24-f58582cc9ced admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03bb90ba4ab241f691d7971f2c98d806', 'request_id': 'req-d3f0eab2-e61c-486f-8e24-f58582cc9ced'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:20.513343 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d3f0eab2-e61c-486f-8e24-f58582cc9ced admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03bb90ba4ab241f691d7971f2c98d806', 'request_id': 'req-d3f0eab2-e61c-486f-8e24-f58582cc9ced'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:20.527231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d3f0eab2-e61c-486f-8e24-f58582cc9ced admin admin] The token cache is being invalidate because project 03bb90ba4ab241f691d7971f2c98d806 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:44:20.527752 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d3f0eab2-e61c-486f-8e24-f58582cc9ced admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:20.528834 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-d3f0eab2-e61c-486f-8e24-f58582cc9ced admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:20.530445 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4349/8691] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:44:20 2022] DELETE /identity/v3/projects/03bb90ba4ab241f691d7971f2c98d806 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:44:20.536085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a582d5-287e-4ab3-8f06-9b3d79d24b68 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:20.536528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a582d5-287e-4ab3-8f06-9b3d79d24b68 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:20.536809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a582d5-287e-4ab3-8f06-9b3d79d24b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:20.560227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-02a582d5-287e-4ab3-8f06-9b3d79d24b68 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:44:20.561458 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-02a582d5-287e-4ab3-8f06-9b3d79d24b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:44:20.575837 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:44:20.650036 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4343/8692] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:44:20.659449 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae37621-871c-4d89-b982-ba5eeb0564fa None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:20.659738 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae37621-871c-4d89-b982-ba5eeb0564fa None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:20.660041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae37621-871c-4d89-b982-ba5eeb0564fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:20.681090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-aae37621-871c-4d89-b982-ba5eeb0564fa None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:44:20.682334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-aae37621-871c-4d89-b982-ba5eeb0564fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:44:20.690598 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4350/8693] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:44:20.694870 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a582d5-287e-4ab3-8f06-9b3d79d24b68 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:20.705160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a582d5-287e-4ab3-8f06-9b3d79d24b68 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:20.709718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228dffc-381e-45f4-8f26-80819e4d75dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:20.710317 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228dffc-381e-45f4-8f26-80819e4d75dd admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:20.710594 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228dffc-381e-45f4-8f26-80819e4d75dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:20.710867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228dffc-381e-45f4-8f26-80819e4d75dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:20.711507 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228dffc-381e-45f4-8f26-80819e4d75dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:44:20.711815 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228dffc-381e-45f4-8f26-80819e4d75dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:20.713408 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228dffc-381e-45f4-8f26-80819e4d75dd admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:20.726766 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4344/8694] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:44:20.730882 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae37621-871c-4d89-b982-ba5eeb0564fa None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:20.740948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae37621-871c-4d89-b982-ba5eeb0564fa None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:20.745896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5942a-591f-44a2-b748-cbf7599ac756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:20.746441 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5942a-591f-44a2-b748-cbf7599ac756 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:20.746723 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5942a-591f-44a2-b748-cbf7599ac756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:20.746995 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5942a-591f-44a2-b748-cbf7599ac756 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:20.747627 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa5942a-591f-44a2-b748-cbf7599ac756 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:20.749561 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa5942a-591f-44a2-b748-cbf7599ac756 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:20.789524 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4351/8695] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:44:20 2022] POST /identity/v3/projects => generated 391 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:44:20.794705 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228dffc-381e-45f4-8f26-80819e4d75dd admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:20.805727 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228dffc-381e-45f4-8f26-80819e4d75dd admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:20.875987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9455014-fdd6-44ac-86f4-960a68bf4d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:20.876640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9455014-fdd6-44ac-86f4-960a68bf4d46 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:20.876876 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9455014-fdd6-44ac-86f4-960a68bf4d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:20.877179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9455014-fdd6-44ac-86f4-960a68bf4d46 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:20.877848 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9455014-fdd6-44ac-86f4-960a68bf4d46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:20.879852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9455014-fdd6-44ac-86f4-960a68bf4d46 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:20.903149 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4345/8696] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:44:20 2022] POST /identity/v3/users => generated 296 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:44:20.907736 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5942a-591f-44a2-b748-cbf7599ac756 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:20.918431 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5942a-591f-44a2-b748-cbf7599ac756 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:20.923766 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bb5c2-d3a7-47ed-964f-ad32cf69df3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:20.924381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bb5c2-d3a7-47ed-964f-ad32cf69df3a admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:20.924692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bb5c2-d3a7-47ed-964f-ad32cf69df3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:20.924973 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bb5c2-d3a7-47ed-964f-ad32cf69df3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:20.925659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985bb5c2-d3a7-47ed-964f-ad32cf69df3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:20.927283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985bb5c2-d3a7-47ed-964f-ad32cf69df3a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:20.928827 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:44:20.940848 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4352/8697] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:44:20.944404 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9455014-fdd6-44ac-86f4-960a68bf4d46 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:20.957650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9455014-fdd6-44ac-86f4-960a68bf4d46 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:20.962481 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ee57a-03dd-44c2-bfd8-6b93867d6db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:20.963089 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ee57a-03dd-44c2-bfd8-6b93867d6db7 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:20.963785 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ee57a-03dd-44c2-bfd8-6b93867d6db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:20.964003 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ee57a-03dd-44c2-bfd8-6b93867d6db7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:20.965074 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ee57a-03dd-44c2-bfd8-6b93867d6db7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:20.967523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ee57a-03dd-44c2-bfd8-6b93867d6db7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:20.979220 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4346/8698] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:44:20.983318 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bb5c2-d3a7-47ed-964f-ad32cf69df3a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:20.994432 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bb5c2-d3a7-47ed-964f-ad32cf69df3a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:20.999105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb09c1-cf14-4288-9448-78c2afd47d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:20.999698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb09c1-cf14-4288-9448-78c2afd47d8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:20.999983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb09c1-cf14-4288-9448-78c2afd47d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:21.000307 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb09c1-cf14-4288-9448-78c2afd47d8a admin admin] PATH_INFO: `/v3/projects/f474d9762a5a4def9dd2c468e7269612/users/9cbe80e7adb341b8b6d2affd9fd78eb8/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:21.015198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb09c1-cf14-4288-9448-78c2afd47d8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f474d9762a5a4def9dd2c468e7269612, user_id=9cbe80e7adb341b8b6d2affd9fd78eb8, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:21.018013 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb09c1-cf14-4288-9448-78c2afd47d8a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:21.030786 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4353/8699] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:44:20 2022] PUT /identity/v3/projects/f474d9762a5a4def9dd2c468e7269612/users/9cbe80e7adb341b8b6d2affd9fd78eb8/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:44:21.042606 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633777e-040a-41c3-9bde-e3a51fcd9e1e None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:21.042897 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633777e-040a-41c3-9bde-e3a51fcd9e1e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:21.043176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633777e-040a-41c3-9bde-e3a51fcd9e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:21.072622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-d633777e-040a-41c3-9bde-e3a51fcd9e1e None None] MFA Rules not processed for user `9cbe80e7adb341b8b6d2affd9fd78eb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:44:21.073862 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d633777e-040a-41c3-9bde-e3a51fcd9e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:44:21.145426 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4347/8700] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:44:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:44:21.156091 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb09c1-cf14-4288-9448-78c2afd47d8a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:21.158435 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5cfb09c1-cf14-4288-9448-78c2afd47d8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:44:21.229872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb09c1-cf14-4288-9448-78c2afd47d8a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:21.235821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2af96-7da1-40dd-a28d-dc58a16cbdfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:21.236778 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2af96-7da1-40dd-a28d-dc58a16cbdfd service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:21.237057 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2af96-7da1-40dd-a28d-dc58a16cbdfd service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:21.237223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2af96-7da1-40dd-a28d-dc58a16cbdfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:21.247766 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2af96-7da1-40dd-a28d-dc58a16cbdfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:21.249267 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2af96-7da1-40dd-a28d-dc58a16cbdfd service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:21.259884 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4354/8701] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:44:21 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:44:31.142681 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:44:31.255689 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=42,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:44:38.887102 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633777e-040a-41c3-9bde-e3a51fcd9e1e None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:38.966384 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633777e-040a-41c3-9bde-e3a51fcd9e1e None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:38.971906 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaea5c6-ba35-4a2a-9fab-3f37a8900356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:38.972548 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaea5c6-ba35-4a2a-9fab-3f37a8900356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:38.972829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaea5c6-ba35-4a2a-9fab-3f37a8900356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:38.973109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaea5c6-ba35-4a2a-9fab-3f37a8900356 admin admin] PATH_INFO: `/v3/users/9cbe80e7adb341b8b6d2affd9fd78eb8` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:38.974280 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaea5c6-ba35-4a2a-9fab-3f37a8900356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cbe80e7adb341b8b6d2affd9fd78eb8)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:38.976246 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaea5c6-ba35-4a2a-9fab-3f37a8900356 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:39.025534 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-adaea5c6-ba35-4a2a-9fab-3f37a8900356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cbe80e7adb341b8b6d2affd9fd78eb8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:39.026199 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-adaea5c6-ba35-4a2a-9fab-3f37a8900356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cbe80e7adb341b8b6d2affd9fd78eb8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:39.033778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-adaea5c6-ba35-4a2a-9fab-3f37a8900356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cbe80e7adb341b8b6d2affd9fd78eb8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:39.041464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-adaea5c6-ba35-4a2a-9fab-3f37a8900356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cbe80e7adb341b8b6d2affd9fd78eb8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:39.042150 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-adaea5c6-ba35-4a2a-9fab-3f37a8900356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cbe80e7adb341b8b6d2affd9fd78eb8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:39.060439 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4348/8702] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:44:38 2022] DELETE /identity/v3/users/9cbe80e7adb341b8b6d2affd9fd78eb8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:44:39.065065 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae263bc-a07f-401a-b866-a5aac6203fca None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:39.065619 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae263bc-a07f-401a-b866-a5aac6203fca None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:39.065741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae263bc-a07f-401a-b866-a5aac6203fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:39.086894 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-6ae263bc-a07f-401a-b866-a5aac6203fca None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:44:39.088082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6ae263bc-a07f-401a-b866-a5aac6203fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:44:39.149425 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4355/8703] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:44:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:44:39.159935 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaea5c6-ba35-4a2a-9fab-3f37a8900356 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:39.161481 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-adaea5c6-ba35-4a2a-9fab-3f37a8900356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:44:39.232904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaea5c6-ba35-4a2a-9fab-3f37a8900356 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:39.236838 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63a39a-a6e5-4f7d-a7ae-0b9b6b397164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:39.237456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63a39a-a6e5-4f7d-a7ae-0b9b6b397164 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:39.237751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63a39a-a6e5-4f7d-a7ae-0b9b6b397164 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:39.238027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63a39a-a6e5-4f7d-a7ae-0b9b6b397164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:39.247085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63a39a-a6e5-4f7d-a7ae-0b9b6b397164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:39.248503 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63a39a-a6e5-4f7d-a7ae-0b9b6b397164 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:39.257954 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4349/8704] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:44:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:44:39.562757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae263bc-a07f-401a-b866-a5aac6203fca None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:39.566606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6ae263bc-a07f-401a-b866-a5aac6203fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:44:39.584077 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae263bc-a07f-401a-b866-a5aac6203fca None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:39.588917 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a946a-94ee-4451-82f3-6eca57b5e2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:39.589685 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a946a-94ee-4451-82f3-6eca57b5e2c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:39.590041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a946a-94ee-4451-82f3-6eca57b5e2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:39.590387 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a946a-94ee-4451-82f3-6eca57b5e2c5 admin admin] PATH_INFO: `/v3/projects/f474d9762a5a4def9dd2c468e7269612` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:39.592373 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a946a-94ee-4451-82f3-6eca57b5e2c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f474d9762a5a4def9dd2c468e7269612)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:39.594743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a946a-94ee-4451-82f3-6eca57b5e2c5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:39.644439 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4d5a946a-94ee-4451-82f3-6eca57b5e2c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f474d9762a5a4def9dd2c468e7269612', 'request_id': 'req-4d5a946a-94ee-4451-82f3-6eca57b5e2c5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:39.652191 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4d5a946a-94ee-4451-82f3-6eca57b5e2c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f474d9762a5a4def9dd2c468e7269612', 'request_id': 'req-4d5a946a-94ee-4451-82f3-6eca57b5e2c5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:39.659766 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4d5a946a-94ee-4451-82f3-6eca57b5e2c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f474d9762a5a4def9dd2c468e7269612', 'request_id': 'req-4d5a946a-94ee-4451-82f3-6eca57b5e2c5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:39.671275 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4d5a946a-94ee-4451-82f3-6eca57b5e2c5 admin admin] The token cache is being invalidate because project f474d9762a5a4def9dd2c468e7269612 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:44:39.671560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4d5a946a-94ee-4451-82f3-6eca57b5e2c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:39.672237 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-4d5a946a-94ee-4451-82f3-6eca57b5e2c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:39.674398 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4356/8705] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:44:39 2022] DELETE /identity/v3/projects/f474d9762a5a4def9dd2c468e7269612 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:44:39.679707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359dc4a-8f44-49b3-b93c-cfe09384c8f7 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:39.679993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359dc4a-8f44-49b3-b93c-cfe09384c8f7 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:39.680297 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359dc4a-8f44-49b3-b93c-cfe09384c8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:39.699608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-e359dc4a-8f44-49b3-b93c-cfe09384c8f7 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:44:39.700805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e359dc4a-8f44-49b3-b93c-cfe09384c8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:44:39.709602 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:44:39.765003 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4350/8706] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:44:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:44:39.872503 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3be22-ed61-4435-aa99-d80d512d9a61 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:39.872921 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3be22-ed61-4435-aa99-d80d512d9a61 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:39.873306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3be22-ed61-4435-aa99-d80d512d9a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:39.893511 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-89c3be22-ed61-4435-aa99-d80d512d9a61 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:44:39.894722 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-89c3be22-ed61-4435-aa99-d80d512d9a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:44:39.902761 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4357/8707] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:44:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:44:39.907026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359dc4a-8f44-49b3-b93c-cfe09384c8f7 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:39.917522 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359dc4a-8f44-49b3-b93c-cfe09384c8f7 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:39.922299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c588d-0abe-4c90-9eb3-019d2a0f9374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:39.922898 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c588d-0abe-4c90-9eb3-019d2a0f9374 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:39.923179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c588d-0abe-4c90-9eb3-019d2a0f9374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:39.923451 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c588d-0abe-4c90-9eb3-019d2a0f9374 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:39.924727 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c588d-0abe-4c90-9eb3-019d2a0f9374 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:44:39.925030 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c588d-0abe-4c90-9eb3-019d2a0f9374 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:39.926667 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c588d-0abe-4c90-9eb3-019d2a0f9374 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:39.938807 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4351/8708] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:44:39.942445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3be22-ed61-4435-aa99-d80d512d9a61 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:39.952261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3be22-ed61-4435-aa99-d80d512d9a61 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:39.957678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c64fc9-c0b0-4970-b741-5f435f28ce2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:39.958310 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c64fc9-c0b0-4970-b741-5f435f28ce2a admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:39.958590 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c64fc9-c0b0-4970-b741-5f435f28ce2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:39.958863 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c64fc9-c0b0-4970-b741-5f435f28ce2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:39.959520 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c64fc9-c0b0-4970-b741-5f435f28ce2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:39.961470 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c64fc9-c0b0-4970-b741-5f435f28ce2a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:39.992422 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4358/8709] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:44:39 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:44:39.997204 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c588d-0abe-4c90-9eb3-019d2a0f9374 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:40.019185 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c588d-0abe-4c90-9eb3-019d2a0f9374 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:40.076275 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a215b-095c-445d-a74f-ea334ed732ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:40.076882 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a215b-095c-445d-a74f-ea334ed732ed admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:40.077169 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a215b-095c-445d-a74f-ea334ed732ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:40.077462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a215b-095c-445d-a74f-ea334ed732ed admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:40.078110 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a215b-095c-445d-a74f-ea334ed732ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:40.080080 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a215b-095c-445d-a74f-ea334ed732ed admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:40.100790 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4352/8710] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:44:39 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:44:40.105311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c64fc9-c0b0-4970-b741-5f435f28ce2a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:40.116981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c64fc9-c0b0-4970-b741-5f435f28ce2a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:40.121851 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09d19b-8301-4873-a96c-16a775670478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:40.122654 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09d19b-8301-4873-a96c-16a775670478 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:40.122951 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09d19b-8301-4873-a96c-16a775670478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:40.123257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09d19b-8301-4873-a96c-16a775670478 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:40.123891 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09d19b-8301-4873-a96c-16a775670478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:40.125726 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09d19b-8301-4873-a96c-16a775670478 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:40.137118 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4359/8711] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:44:40.141067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a215b-095c-445d-a74f-ea334ed732ed admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:40.151433 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a215b-095c-445d-a74f-ea334ed732ed admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:40.156250 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af825f0-8de9-49af-a7cf-9cb0158627c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:40.156850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af825f0-8de9-49af-a7cf-9cb0158627c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:40.157133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af825f0-8de9-49af-a7cf-9cb0158627c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:40.157454 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af825f0-8de9-49af-a7cf-9cb0158627c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:40.158240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af825f0-8de9-49af-a7cf-9cb0158627c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:40.159849 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af825f0-8de9-49af-a7cf-9cb0158627c0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:40.170705 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4353/8712] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:44:40.175488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09d19b-8301-4873-a96c-16a775670478 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:40.185801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09d19b-8301-4873-a96c-16a775670478 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:40.190960 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b79cd-ccce-440f-b2a7-f582555ac2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:40.191603 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b79cd-ccce-440f-b2a7-f582555ac2bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:40.191879 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b79cd-ccce-440f-b2a7-f582555ac2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:40.192148 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b79cd-ccce-440f-b2a7-f582555ac2bf admin admin] PATH_INFO: `/v3/projects/536886135a7941d89a495164bb4acb5a/users/c01f33f2e0d34f1d8578feac267c37d2/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:40.206261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b79cd-ccce-440f-b2a7-f582555ac2bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=536886135a7941d89a495164bb4acb5a, user_id=c01f33f2e0d34f1d8578feac267c37d2, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:40.208880 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b79cd-ccce-440f-b2a7-f582555ac2bf admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:40.223085 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4360/8713] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:44:40 2022] PUT /identity/v3/projects/536886135a7941d89a495164bb4acb5a/users/c01f33f2e0d34f1d8578feac267c37d2/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:44:40.229338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3dd531-f5ae-4a03-9b67-bd5fa5f1b5cd None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:40.229855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3dd531-f5ae-4a03-9b67-bd5fa5f1b5cd None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:40.230398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3dd531-f5ae-4a03-9b67-bd5fa5f1b5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:40.251296 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-4f3dd531-f5ae-4a03-9b67-bd5fa5f1b5cd None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:44:40.253023 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4f3dd531-f5ae-4a03-9b67-bd5fa5f1b5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:44:40.311740 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4354/8714] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:44:40.321527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b79cd-ccce-440f-b2a7-f582555ac2bf admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:40.323249 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-895b79cd-ccce-440f-b2a7-f582555ac2bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:44:40.344896 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:44:40.387908 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b79cd-ccce-440f-b2a7-f582555ac2bf admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:40.391541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd95a1-6fcb-4fe7-ac88-42680b092450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:40.392148 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd95a1-6fcb-4fe7-ac88-42680b092450 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:40.392458 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd95a1-6fcb-4fe7-ac88-42680b092450 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:40.393358 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd95a1-6fcb-4fe7-ac88-42680b092450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:40.402348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd95a1-6fcb-4fe7-ac88-42680b092450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:40.403772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd95a1-6fcb-4fe7-ac88-42680b092450 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:40.413237 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4361/8715] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:44:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:44:41.221308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3dd531-f5ae-4a03-9b67-bd5fa5f1b5cd None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:41.224016 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4f3dd531-f5ae-4a03-9b67-bd5fa5f1b5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:44:41.250751 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:44:41.340134 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3dd531-f5ae-4a03-9b67-bd5fa5f1b5cd None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:41.346061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729601b-42e0-40d1-aefa-c76195d5be89 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:41.346691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729601b-42e0-40d1-aefa-c76195d5be89 service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:41.346987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729601b-42e0-40d1-aefa-c76195d5be89 service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:41.347278 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729601b-42e0-40d1-aefa-c76195d5be89 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:41.353034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f729601b-42e0-40d1-aefa-c76195d5be89 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:44:41.376460 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729601b-42e0-40d1-aefa-c76195d5be89 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:41.378881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729601b-42e0-40d1-aefa-c76195d5be89 service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:41.396877 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4355/8716] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:44:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:44:44.576837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335910a-4c78-45e7-b51c-531813b89d15 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:44.577329 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335910a-4c78-45e7-b51c-531813b89d15 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:44.577471 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335910a-4c78-45e7-b51c-531813b89d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:44.619964 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-1335910a-4c78-45e7-b51c-531813b89d15 None None] MFA Rules not processed for user `c01f33f2e0d34f1d8578feac267c37d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:44:44.621647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1335910a-4c78-45e7-b51c-531813b89d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:44:44.691152 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4362/8717] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:44:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:44:44.695653 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729601b-42e0-40d1-aefa-c76195d5be89 service placement] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:44.706290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729601b-42e0-40d1-aefa-c76195d5be89 service placement] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:44.710786 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf270c11-996e-4614-8ea0-67941f390751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:44.711383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf270c11-996e-4614-8ea0-67941f390751 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:44.711774 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf270c11-996e-4614-8ea0-67941f390751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:44.711923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf270c11-996e-4614-8ea0-67941f390751 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:44.712552 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf270c11-996e-4614-8ea0-67941f390751 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:44.714499 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf270c11-996e-4614-8ea0-67941f390751 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:44.742072 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4356/8718] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:44:44 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:44:44.746291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335910a-4c78-45e7-b51c-531813b89d15 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:44.758052 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335910a-4c78-45e7-b51c-531813b89d15 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:44.838081 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd591d-5647-48a8-a25f-03fdc2ad5ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:44.838781 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd591d-5647-48a8-a25f-03fdc2ad5ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:44.839062 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd591d-5647-48a8-a25f-03fdc2ad5ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:44.839329 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd591d-5647-48a8-a25f-03fdc2ad5ae3 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:44.839967 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd591d-5647-48a8-a25f-03fdc2ad5ae3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:44.843953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd591d-5647-48a8-a25f-03fdc2ad5ae3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:44.881074 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4363/8719] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:44:44 2022] POST /identity/v3/users => generated 295 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:44:44.885516 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf270c11-996e-4614-8ea0-67941f390751 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:44.897998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf270c11-996e-4614-8ea0-67941f390751 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:44.902840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490d44f-fa41-4089-8abe-35ea753f1823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:44.903461 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490d44f-fa41-4089-8abe-35ea753f1823 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:44.903865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490d44f-fa41-4089-8abe-35ea753f1823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:44.904148 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490d44f-fa41-4089-8abe-35ea753f1823 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:44.904994 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490d44f-fa41-4089-8abe-35ea753f1823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:44.906823 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490d44f-fa41-4089-8abe-35ea753f1823 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:44.920460 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4357/8720] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:44:44.925277 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd591d-5647-48a8-a25f-03fdc2ad5ae3 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:44.936275 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd591d-5647-48a8-a25f-03fdc2ad5ae3 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:44.942031 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b74789-9370-4448-98fd-89f30bb7bea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:44.942657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b74789-9370-4448-98fd-89f30bb7bea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:44.943038 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b74789-9370-4448-98fd-89f30bb7bea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:44.943322 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b74789-9370-4448-98fd-89f30bb7bea6 admin admin] PATH_INFO: `/v3/projects/3f510839da6748e387724d8c0e9c9715/users/d678312d64804ed3920877400e4fbc83/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:44.963295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b74789-9370-4448-98fd-89f30bb7bea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f510839da6748e387724d8c0e9c9715, user_id=d678312d64804ed3920877400e4fbc83, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:44.966474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b74789-9370-4448-98fd-89f30bb7bea6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:44.987859 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4364/8721] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:44:44 2022] PUT /identity/v3/projects/3f510839da6748e387724d8c0e9c9715/users/d678312d64804ed3920877400e4fbc83/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:44:44.992148 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490d44f-fa41-4089-8abe-35ea753f1823 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:45.010008 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490d44f-fa41-4089-8abe-35ea753f1823 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:45.092431 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e9a81-f19d-492e-8343-2b6b6915591d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:45.094270 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e9a81-f19d-492e-8343-2b6b6915591d admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:45.094846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e9a81-f19d-492e-8343-2b6b6915591d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:45.095200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e9a81-f19d-492e-8343-2b6b6915591d admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:45.096539 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e9a81-f19d-492e-8343-2b6b6915591d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:45.098484 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e9a81-f19d-492e-8343-2b6b6915591d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:45.114712 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4358/8722] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:44:45.118625 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b74789-9370-4448-98fd-89f30bb7bea6 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:45.131821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b74789-9370-4448-98fd-89f30bb7bea6 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:45.138237 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc48714-4a17-407a-902b-028aa351c7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:45.139584 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc48714-4a17-407a-902b-028aa351c7e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:45.139584 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc48714-4a17-407a-902b-028aa351c7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:45.139962 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc48714-4a17-407a-902b-028aa351c7e2 admin admin] PATH_INFO: `/v3/projects/3f510839da6748e387724d8c0e9c9715/users/d678312d64804ed3920877400e4fbc83/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:45.142809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc48714-4a17-407a-902b-028aa351c7e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f510839da6748e387724d8c0e9c9715, user_id=d678312d64804ed3920877400e4fbc83, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:45.145848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc48714-4a17-407a-902b-028aa351c7e2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:45.161757 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4365/8723] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:44:45 2022] PUT /identity/v3/projects/3f510839da6748e387724d8c0e9c9715/users/d678312d64804ed3920877400e4fbc83/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:44:49.853799 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c2845-dcb6-4ca1-8a91-112f028b294d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:49.854438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c2845-dcb6-4ca1-8a91-112f028b294d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:49.854438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c2845-dcb6-4ca1-8a91-112f028b294d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:49.889262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-715c2845-dcb6-4ca1-8a91-112f028b294d None None] MFA Rules not processed for user `d678312d64804ed3920877400e4fbc83`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:44:49.890469 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-715c2845-dcb6-4ca1-8a91-112f028b294d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:44:49.950557 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:44:49.974114 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4359/8724] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:44:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:44:49.989616 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc48714-4a17-407a-902b-028aa351c7e2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:49.994771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7fc48714-4a17-407a-902b-028aa351c7e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:44:50.003724 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:44:50.098394 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc48714-4a17-407a-902b-028aa351c7e2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:50.104366 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c76df3-44db-4f21-a12d-6a5e5308ba45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:50.105085 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c76df3-44db-4f21-a12d-6a5e5308ba45 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:50.105368 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c76df3-44db-4f21-a12d-6a5e5308ba45 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:50.106250 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c76df3-44db-4f21-a12d-6a5e5308ba45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:50.117348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c76df3-44db-4f21-a12d-6a5e5308ba45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:50.118985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c76df3-44db-4f21-a12d-6a5e5308ba45 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:50.130534 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4366/8725] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:44:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:44:50.379373 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c2845-dcb6-4ca1-8a91-112f028b294d None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:50.465699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c2845-dcb6-4ca1-8a91-112f028b294d None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:50.472972 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424072e-2d81-45e0-8a40-977ed9e48596 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:50.473641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424072e-2d81-45e0-8a40-977ed9e48596 service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:50.473924 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424072e-2d81-45e0-8a40-977ed9e48596 service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:50.474195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424072e-2d81-45e0-8a40-977ed9e48596 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:50.476338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b424072e-2d81-45e0-8a40-977ed9e48596 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:44:50.496038 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424072e-2d81-45e0-8a40-977ed9e48596 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:50.498039 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424072e-2d81-45e0-8a40-977ed9e48596 service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:50.513353 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4360/8726] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:44:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:44:50.798430 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c76df3-44db-4f21-a12d-6a5e5308ba45 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:50.800886 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d3c76df3-44db-4f21-a12d-6a5e5308ba45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:44:50.827907 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c76df3-44db-4f21-a12d-6a5e5308ba45 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:50.833681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3284e-8ee7-47e2-a316-3df32401ca0a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:50.834324 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3284e-8ee7-47e2-a316-3df32401ca0a service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:50.834606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3284e-8ee7-47e2-a316-3df32401ca0a service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:50.834879 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3284e-8ee7-47e2-a316-3df32401ca0a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:50.836638 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-22a3284e-8ee7-47e2-a316-3df32401ca0a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:44:50.853750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3284e-8ee7-47e2-a316-3df32401ca0a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:50.855374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3284e-8ee7-47e2-a316-3df32401ca0a service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:50.871604 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4367/8727] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:44:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:44:58.259852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424072e-2d81-45e0-8a40-977ed9e48596 service placement] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:58.324810 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424072e-2d81-45e0-8a40-977ed9e48596 service placement] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:58.329756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9af78c-62fe-41c6-8b15-feb0c3c647b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:58.330442 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9af78c-62fe-41c6-8b15-feb0c3c647b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:58.330722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9af78c-62fe-41c6-8b15-feb0c3c647b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:58.330987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9af78c-62fe-41c6-8b15-feb0c3c647b6 admin admin] PATH_INFO: `/v3/users/c01f33f2e0d34f1d8578feac267c37d2` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:58.332154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9af78c-62fe-41c6-8b15-feb0c3c647b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c01f33f2e0d34f1d8578feac267c37d2)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:58.334103 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9af78c-62fe-41c6-8b15-feb0c3c647b6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:58.384425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4e9af78c-62fe-41c6-8b15-feb0c3c647b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c01f33f2e0d34f1d8578feac267c37d2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:58.385202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4e9af78c-62fe-41c6-8b15-feb0c3c647b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c01f33f2e0d34f1d8578feac267c37d2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:58.392662 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4e9af78c-62fe-41c6-8b15-feb0c3c647b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c01f33f2e0d34f1d8578feac267c37d2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:58.402077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4e9af78c-62fe-41c6-8b15-feb0c3c647b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c01f33f2e0d34f1d8578feac267c37d2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:58.402601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4e9af78c-62fe-41c6-8b15-feb0c3c647b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c01f33f2e0d34f1d8578feac267c37d2'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:58.417044 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:44:58.423340 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4361/8728] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:44:58 2022] DELETE /identity/v3/users/c01f33f2e0d34f1d8578feac267c37d2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:44:58.599819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3284e-8ee7-47e2-a316-3df32401ca0a service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:58.610328 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3284e-8ee7-47e2-a316-3df32401ca0a service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:58.668856 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b40b13-1fb9-4d86-a33f-87b92f3b663f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:58.669515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b40b13-1fb9-4d86-a33f-87b92f3b663f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:58.669798 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b40b13-1fb9-4d86-a33f-87b92f3b663f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:58.670071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b40b13-1fb9-4d86-a33f-87b92f3b663f admin admin] PATH_INFO: `/v3/projects/536886135a7941d89a495164bb4acb5a` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:58.671193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b40b13-1fb9-4d86-a33f-87b92f3b663f admin admin] RBAC: Authorizing `identity:delete_project(project_id=536886135a7941d89a495164bb4acb5a)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:58.673149 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b40b13-1fb9-4d86-a33f-87b92f3b663f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:58.726539 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e6b40b13-1fb9-4d86-a33f-87b92f3b663f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '536886135a7941d89a495164bb4acb5a', 'request_id': 'req-e6b40b13-1fb9-4d86-a33f-87b92f3b663f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:58.734083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e6b40b13-1fb9-4d86-a33f-87b92f3b663f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '536886135a7941d89a495164bb4acb5a', 'request_id': 'req-e6b40b13-1fb9-4d86-a33f-87b92f3b663f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:58.740322 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e6b40b13-1fb9-4d86-a33f-87b92f3b663f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '536886135a7941d89a495164bb4acb5a', 'request_id': 'req-e6b40b13-1fb9-4d86-a33f-87b92f3b663f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:58.747416 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:44:58.752862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e6b40b13-1fb9-4d86-a33f-87b92f3b663f admin admin] The token cache is being invalidate because project 536886135a7941d89a495164bb4acb5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:44:58.753335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e6b40b13-1fb9-4d86-a33f-87b92f3b663f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:58.754440 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e6b40b13-1fb9-4d86-a33f-87b92f3b663f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:58.755973 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4368/8729] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:44:58 2022] DELETE /identity/v3/projects/536886135a7941d89a495164bb4acb5a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:44:58.760094 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9af78c-62fe-41c6-8b15-feb0c3c647b6 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:58.761517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4e9af78c-62fe-41c6-8b15-feb0c3c647b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:44:58.775043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9af78c-62fe-41c6-8b15-feb0c3c647b6 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:58.831006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb36ad-e7b2-49f0-bce3-86cdf5ee410d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:58.831651 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb36ad-e7b2-49f0-bce3-86cdf5ee410d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:58.832009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb36ad-e7b2-49f0-bce3-86cdf5ee410d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:58.832348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb36ad-e7b2-49f0-bce3-86cdf5ee410d admin admin] PATH_INFO: `/v3/users/d678312d64804ed3920877400e4fbc83` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:58.833598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdb36ad-e7b2-49f0-bce3-86cdf5ee410d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d678312d64804ed3920877400e4fbc83)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:58.836204 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdb36ad-e7b2-49f0-bce3-86cdf5ee410d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:58.905111 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3fdb36ad-e7b2-49f0-bce3-86cdf5ee410d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd678312d64804ed3920877400e4fbc83'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:58.906120 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3fdb36ad-e7b2-49f0-bce3-86cdf5ee410d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd678312d64804ed3920877400e4fbc83'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:58.913844 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3fdb36ad-e7b2-49f0-bce3-86cdf5ee410d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd678312d64804ed3920877400e4fbc83'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:58.926430 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3fdb36ad-e7b2-49f0-bce3-86cdf5ee410d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd678312d64804ed3920877400e4fbc83'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:58.927284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3fdb36ad-e7b2-49f0-bce3-86cdf5ee410d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd678312d64804ed3920877400e4fbc83'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:58.950663 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4362/8730] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:44:58 2022] DELETE /identity/v3/users/d678312d64804ed3920877400e4fbc83 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:44:59.158542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b40b13-1fb9-4d86-a33f-87b92f3b663f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:59.160166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e6b40b13-1fb9-4d86-a33f-87b92f3b663f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:44:59.175287 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b40b13-1fb9-4d86-a33f-87b92f3b663f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:59.241302 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b0eaf-099a-4fc1-a0b5-04e61591e8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:59.241902 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b0eaf-099a-4fc1-a0b5-04e61591e8f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:59.242183 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b0eaf-099a-4fc1-a0b5-04e61591e8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:59.242457 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b0eaf-099a-4fc1-a0b5-04e61591e8f5 admin admin] PATH_INFO: `/v3/projects/3f510839da6748e387724d8c0e9c9715` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:59.243624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18b0eaf-099a-4fc1-a0b5-04e61591e8f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f510839da6748e387724d8c0e9c9715)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:59.245581 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18b0eaf-099a-4fc1-a0b5-04e61591e8f5 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:59.295751 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a18b0eaf-099a-4fc1-a0b5-04e61591e8f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f510839da6748e387724d8c0e9c9715', 'request_id': 'req-a18b0eaf-099a-4fc1-a0b5-04e61591e8f5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:59.303503 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a18b0eaf-099a-4fc1-a0b5-04e61591e8f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f510839da6748e387724d8c0e9c9715', 'request_id': 'req-a18b0eaf-099a-4fc1-a0b5-04e61591e8f5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:59.309578 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a18b0eaf-099a-4fc1-a0b5-04e61591e8f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f510839da6748e387724d8c0e9c9715', 'request_id': 'req-a18b0eaf-099a-4fc1-a0b5-04e61591e8f5'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:59.321552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a18b0eaf-099a-4fc1-a0b5-04e61591e8f5 admin admin] The token cache is being invalidate because project 3f510839da6748e387724d8c0e9c9715 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:44:59.321837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a18b0eaf-099a-4fc1-a0b5-04e61591e8f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:59.322524 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a18b0eaf-099a-4fc1-a0b5-04e61591e8f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:44:59.324057 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4369/8731] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:44:59 2022] DELETE /identity/v3/projects/3f510839da6748e387724d8c0e9c9715 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:44:59.329067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ec2c6-ce1b-4ffe-ab2a-f419e21e6fe4 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:59.329528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ec2c6-ce1b-4ffe-ab2a-f419e21e6fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:59.329731 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ec2c6-ce1b-4ffe-ab2a-f419e21e6fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:59.350129 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-483ec2c6-ce1b-4ffe-ab2a-f419e21e6fe4 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:44:59.351321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-483ec2c6-ce1b-4ffe-ab2a-f419e21e6fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:44:59.415952 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4363/8732] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:44:59.423772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7bf16-69f6-4136-8683-cd7d70eae6fc None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:59.424917 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7bf16-69f6-4136-8683-cd7d70eae6fc None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:59.425291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7bf16-69f6-4136-8683-cd7d70eae6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:59.452986 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-8af7bf16-69f6-4136-8683-cd7d70eae6fc None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:44:59.454414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8af7bf16-69f6-4136-8683-cd7d70eae6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:44:59.464298 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4370/8733] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:44:59.468610 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ec2c6-ce1b-4ffe-ab2a-f419e21e6fe4 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:59.478651 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ec2c6-ce1b-4ffe-ab2a-f419e21e6fe4 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:59.484346 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849a024-e05b-45ad-b7e3-c7b88a698cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:59.485016 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849a024-e05b-45ad-b7e3-c7b88a698cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:59.485307 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849a024-e05b-45ad-b7e3-c7b88a698cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:59.485605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849a024-e05b-45ad-b7e3-c7b88a698cb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:59.487041 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849a024-e05b-45ad-b7e3-c7b88a698cb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:44:59.487351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849a024-e05b-45ad-b7e3-c7b88a698cb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:59.488977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849a024-e05b-45ad-b7e3-c7b88a698cb8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:59.504240 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4364/8734] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:44:59.508938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7bf16-69f6-4136-8683-cd7d70eae6fc None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:59.518584 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7bf16-69f6-4136-8683-cd7d70eae6fc None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:59.523232 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638ca29-8a47-4b3d-bf6f-aefffee592e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:59.523833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638ca29-8a47-4b3d-bf6f-aefffee592e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:59.524111 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638ca29-8a47-4b3d-bf6f-aefffee592e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:59.524380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638ca29-8a47-4b3d-bf6f-aefffee592e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:59.525005 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d638ca29-8a47-4b3d-bf6f-aefffee592e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:59.526961 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d638ca29-8a47-4b3d-bf6f-aefffee592e9 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:59.563593 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4371/8735] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:44:59 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:44:59.568516 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849a024-e05b-45ad-b7e3-c7b88a698cb8 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:59.575773 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:44:59.580127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849a024-e05b-45ad-b7e3-c7b88a698cb8 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:59.644867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681efcf-10a7-42f4-9643-db81755c1af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:59.645509 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681efcf-10a7-42f4-9643-db81755c1af9 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:59.645792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681efcf-10a7-42f4-9643-db81755c1af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:59.646064 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681efcf-10a7-42f4-9643-db81755c1af9 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:59.646704 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681efcf-10a7-42f4-9643-db81755c1af9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:59.648870 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681efcf-10a7-42f4-9643-db81755c1af9 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:59.676515 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4365/8736] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:44:59 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:44:59.677856 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638ca29-8a47-4b3d-bf6f-aefffee592e9 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:59.690230 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638ca29-8a47-4b3d-bf6f-aefffee592e9 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:59.695761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20308df-6465-4eb8-800a-cd7a42d59dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:59.696529 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20308df-6465-4eb8-800a-cd7a42d59dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:59.696834 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20308df-6465-4eb8-800a-cd7a42d59dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:59.697127 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20308df-6465-4eb8-800a-cd7a42d59dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:59.697789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20308df-6465-4eb8-800a-cd7a42d59dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:59.699469 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20308df-6465-4eb8-800a-cd7a42d59dd4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:59.711122 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4372/8737] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:44:59.715355 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681efcf-10a7-42f4-9643-db81755c1af9 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:59.726544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681efcf-10a7-42f4-9643-db81755c1af9 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:59.731375 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854bdad-9e30-4e3a-a0bd-0c87261e2cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:59.731998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854bdad-9e30-4e3a-a0bd-0c87261e2cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:59.732300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854bdad-9e30-4e3a-a0bd-0c87261e2cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:59.732569 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854bdad-9e30-4e3a-a0bd-0c87261e2cf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:59.733205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854bdad-9e30-4e3a-a0bd-0c87261e2cf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:59.734839 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854bdad-9e30-4e3a-a0bd-0c87261e2cf2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:59.746599 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4366/8738] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:44:59.751276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20308df-6465-4eb8-800a-cd7a42d59dd4 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:59.762664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20308df-6465-4eb8-800a-cd7a42d59dd4 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:59.767605 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0eff3-d6b9-493b-8408-daba4531e4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:59.768283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0eff3-d6b9-493b-8408-daba4531e4fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:59.768561 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0eff3-d6b9-493b-8408-daba4531e4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:59.768840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0eff3-d6b9-493b-8408-daba4531e4fe admin admin] PATH_INFO: `/v3/projects/d3d192bfdcb44a64a510466c11539794/users/528b8b6de46c43ccbccc12def4b30e5d/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:59.784891 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0eff3-d6b9-493b-8408-daba4531e4fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3d192bfdcb44a64a510466c11539794, user_id=528b8b6de46c43ccbccc12def4b30e5d, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:59.787749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0eff3-d6b9-493b-8408-daba4531e4fe admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:59.800845 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4373/8739] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:44:59 2022] PUT /identity/v3/projects/d3d192bfdcb44a64a510466c11539794/users/528b8b6de46c43ccbccc12def4b30e5d/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:44:59.806053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf93ee9-9a2d-42e1-bb22-6ae549a10c3c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:59.806338 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf93ee9-9a2d-42e1-bb22-6ae549a10c3c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:59.806613 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf93ee9-9a2d-42e1-bb22-6ae549a10c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:59.826003 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-faf93ee9-9a2d-42e1-bb22-6ae549a10c3c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:44:59.827218 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-faf93ee9-9a2d-42e1-bb22-6ae549a10c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:44:59.891496 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4367/8740] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:44:59.901285 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0eff3-d6b9-493b-8408-daba4531e4fe admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:44:59.903076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-32d0eff3-d6b9-493b-8408-daba4531e4fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:44:59.933467 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:44:59.968605 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0eff3-d6b9-493b-8408-daba4531e4fe admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:44:59.974949 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1036eec3-0b5b-4692-a557-d5a3335c4c31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:44:59.975686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036eec3-0b5b-4692-a557-d5a3335c4c31 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:44:59.975974 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036eec3-0b5b-4692-a557-d5a3335c4c31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:44:59.976244 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036eec3-0b5b-4692-a557-d5a3335c4c31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:44:59.986364 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1036eec3-0b5b-4692-a557-d5a3335c4c31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:44:59.988374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1036eec3-0b5b-4692-a557-d5a3335c4c31 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:44:59.997944 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4374/8741] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:44:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:45:00.695799 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451f12b-2862-4d5c-9d11-9c32bd89b5f0 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:45:00.696251 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451f12b-2862-4d5c-9d11-9c32bd89b5f0 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:45:00.696418 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451f12b-2862-4d5c-9d11-9c32bd89b5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:45:00.741075 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-f451f12b-2862-4d5c-9d11-9c32bd89b5f0 None None] MFA Rules not processed for user `528b8b6de46c43ccbccc12def4b30e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:45:00.743049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f451f12b-2862-4d5c-9d11-9c32bd89b5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:45:00.828558 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4368/8742] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:45:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:45:00.834073 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1036eec3-0b5b-4692-a557-d5a3335c4c31 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:45:00.847104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1036eec3-0b5b-4692-a557-d5a3335c4c31 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:45:00.852137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6ccb7-59bf-46ec-a614-55bca44c7f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:45:00.853509 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6ccb7-59bf-46ec-a614-55bca44c7f80 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:45:00.853865 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6ccb7-59bf-46ec-a614-55bca44c7f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:45:00.854374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6ccb7-59bf-46ec-a614-55bca44c7f80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:45:00.856169 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c6ccb7-59bf-46ec-a614-55bca44c7f80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:45:00.858375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c6ccb7-59bf-46ec-a614-55bca44c7f80 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:45:00.895215 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4375/8743] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:45:00 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:45:00.899235 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451f12b-2862-4d5c-9d11-9c32bd89b5f0 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:45:00.921194 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451f12b-2862-4d5c-9d11-9c32bd89b5f0 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:45:00.931906 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:45:00.991018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04d749-df63-4363-a3bb-123b3f59d672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:45:00.991640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04d749-df63-4363-a3bb-123b3f59d672 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:45:00.991927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04d749-df63-4363-a3bb-123b3f59d672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:45:00.992202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04d749-df63-4363-a3bb-123b3f59d672 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:45:00.992851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d04d749-df63-4363-a3bb-123b3f59d672 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:45:00.994902 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d04d749-df63-4363-a3bb-123b3f59d672 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:45:01.022120 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4369/8744] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:45:00 2022] POST /identity/v3/users => generated 295 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:45:01.027454 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6ccb7-59bf-46ec-a614-55bca44c7f80 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:45:01.041304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6ccb7-59bf-46ec-a614-55bca44c7f80 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:45:01.046693 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318a672-0331-47bd-b9e1-7a2132015a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:45:01.047611 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318a672-0331-47bd-b9e1-7a2132015a66 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:45:01.048114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318a672-0331-47bd-b9e1-7a2132015a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:45:01.048593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318a672-0331-47bd-b9e1-7a2132015a66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:45:01.050093 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e318a672-0331-47bd-b9e1-7a2132015a66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:45:01.051948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e318a672-0331-47bd-b9e1-7a2132015a66 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:45:01.069909 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4376/8745] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:45:01.074340 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04d749-df63-4363-a3bb-123b3f59d672 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:45:01.085492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04d749-df63-4363-a3bb-123b3f59d672 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:45:01.091386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634d85c-a77c-443f-824e-b117a9d7a353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:45:01.091922 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634d85c-a77c-443f-824e-b117a9d7a353 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:45:01.092230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634d85c-a77c-443f-824e-b117a9d7a353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:45:01.092498 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634d85c-a77c-443f-824e-b117a9d7a353 admin admin] PATH_INFO: `/v3/projects/11be6600ab7a45298323fe8691ec9c45/users/642b36e988b5404dab0f7453e0d02c07/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:45:01.110065 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634d85c-a77c-443f-824e-b117a9d7a353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11be6600ab7a45298323fe8691ec9c45, user_id=642b36e988b5404dab0f7453e0d02c07, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:45:01.113999 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634d85c-a77c-443f-824e-b117a9d7a353 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:45:01.132032 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4370/8746] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:45:01 2022] PUT /identity/v3/projects/11be6600ab7a45298323fe8691ec9c45/users/642b36e988b5404dab0f7453e0d02c07/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:45:01.135927 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318a672-0331-47bd-b9e1-7a2132015a66 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:45:01.148718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318a672-0331-47bd-b9e1-7a2132015a66 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:45:01.222055 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9aee9a-bf70-4c94-a76c-a8c71a8d0e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:45:01.222678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9aee9a-bf70-4c94-a76c-a8c71a8d0e7f admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:45:01.222957 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9aee9a-bf70-4c94-a76c-a8c71a8d0e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:45:01.223233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9aee9a-bf70-4c94-a76c-a8c71a8d0e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:45:01.223874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9aee9a-bf70-4c94-a76c-a8c71a8d0e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:45:01.228090 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9aee9a-bf70-4c94-a76c-a8c71a8d0e7f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:45:01.237092 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4377/8747] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:45:01.241869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634d85c-a77c-443f-824e-b117a9d7a353 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:45:01.252180 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634d85c-a77c-443f-824e-b117a9d7a353 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:45:01.257021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867cf202-77ee-431f-a646-eb6bd04b0e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:45:01.257719 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cf202-77ee-431f-a646-eb6bd04b0e47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:45:01.258005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cf202-77ee-431f-a646-eb6bd04b0e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:45:01.258279 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cf202-77ee-431f-a646-eb6bd04b0e47 admin admin] PATH_INFO: `/v3/projects/11be6600ab7a45298323fe8691ec9c45/users/642b36e988b5404dab0f7453e0d02c07/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:45:01.260212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867cf202-77ee-431f-a646-eb6bd04b0e47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11be6600ab7a45298323fe8691ec9c45, user_id=642b36e988b5404dab0f7453e0d02c07, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:45:01.262935 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867cf202-77ee-431f-a646-eb6bd04b0e47 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:45:01.274067 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4371/8748] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:45:01 2022] PUT /identity/v3/projects/11be6600ab7a45298323fe8691ec9c45/users/642b36e988b5404dab0f7453e0d02c07/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:45:02.227481 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8e8be-8ca7-4c8d-b016-2e3150571955 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:45:02.228312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8e8be-8ca7-4c8d-b016-2e3150571955 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:45:02.228769 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8e8be-8ca7-4c8d-b016-2e3150571955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:45:02.261863 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d0c8e8be-8ca7-4c8d-b016-2e3150571955 None None] MFA Rules not processed for user `642b36e988b5404dab0f7453e0d02c07`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:45:02.263296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d0c8e8be-8ca7-4c8d-b016-2e3150571955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:45:02.343110 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4378/8749] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:45:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:45:02.355018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14ebed-5b36-493d-9fad-e768333a13c0 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:45:02.355518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14ebed-5b36-493d-9fad-e768333a13c0 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:45:02.355588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14ebed-5b36-493d-9fad-e768333a13c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:45:02.376354 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-0b14ebed-5b36-493d-9fad-e768333a13c0 None None] MFA Rules not processed for user `528b8b6de46c43ccbccc12def4b30e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:45:02.377655 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0b14ebed-5b36-493d-9fad-e768333a13c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:45:02.459769 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4372/8750] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:45:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:45:02.501456 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8e8be-8ca7-4c8d-b016-2e3150571955 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:45:02.503502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d0c8e8be-8ca7-4c8d-b016-2e3150571955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:45:02.526052 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:45:02.630407 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8e8be-8ca7-4c8d-b016-2e3150571955 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:45:02.637159 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292696c5-6ce7-440a-b914-5deed21a4c14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:45:02.637898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292696c5-6ce7-440a-b914-5deed21a4c14 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:45:02.638267 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292696c5-6ce7-440a-b914-5deed21a4c14 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:45:02.638653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292696c5-6ce7-440a-b914-5deed21a4c14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:45:02.651781 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292696c5-6ce7-440a-b914-5deed21a4c14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:45:02.653564 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292696c5-6ce7-440a-b914-5deed21a4c14 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:45:02.664491 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4379/8751] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:45:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:45:12.436372 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=63,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:45:12.660296 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=27 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:45:16.741160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760cdaf-ab15-4a7b-89eb-86e972b7168b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:45:16.741693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760cdaf-ab15-4a7b-89eb-86e972b7168b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:45:16.741814 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760cdaf-ab15-4a7b-89eb-86e972b7168b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:45:16.764675 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-6760cdaf-ab15-4a7b-89eb-86e972b7168b None None] MFA Rules not processed for user `39edb7ede31446eb80f2e510e513afa1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:45:16.766125 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6760cdaf-ab15-4a7b-89eb-86e972b7168b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:45:16.832891 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4373/8752] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:45:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:45:26.318898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292696c5-6ce7-440a-b914-5deed21a4c14 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:45:26.383283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292696c5-6ce7-440a-b914-5deed21a4c14 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:45:26.388091 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73868c0-95d4-4895-9c09-d13deeac447c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:45:26.388721 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73868c0-95d4-4895-9c09-d13deeac447c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:45:26.389023 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73868c0-95d4-4895-9c09-d13deeac447c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:45:26.389301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73868c0-95d4-4895-9c09-d13deeac447c admin admin] PATH_INFO: `/v3/users/528b8b6de46c43ccbccc12def4b30e5d` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:45:26.390595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73868c0-95d4-4895-9c09-d13deeac447c admin admin] RBAC: Authorizing `identity:delete_user(user_id=528b8b6de46c43ccbccc12def4b30e5d)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:45:26.392757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73868c0-95d4-4895-9c09-d13deeac447c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:45:26.441789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c73868c0-95d4-4895-9c09-d13deeac447c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '528b8b6de46c43ccbccc12def4b30e5d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:45:26.442393 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c73868c0-95d4-4895-9c09-d13deeac447c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '528b8b6de46c43ccbccc12def4b30e5d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:45:26.450123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c73868c0-95d4-4895-9c09-d13deeac447c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '528b8b6de46c43ccbccc12def4b30e5d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:45:26.458056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c73868c0-95d4-4895-9c09-d13deeac447c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '528b8b6de46c43ccbccc12def4b30e5d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:45:26.458811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c73868c0-95d4-4895-9c09-d13deeac447c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '528b8b6de46c43ccbccc12def4b30e5d'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:45:26.477162 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4380/8753] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:45:26 2022] DELETE /identity/v3/users/528b8b6de46c43ccbccc12def4b30e5d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:45:26.655057 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760cdaf-ab15-4a7b-89eb-86e972b7168b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:45:26.666913 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760cdaf-ab15-4a7b-89eb-86e972b7168b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:45:26.726622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdafdb2-d32a-49be-a02c-9c04d68bab6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:45:26.727184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdafdb2-d32a-49be-a02c-9c04d68bab6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:45:26.727494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdafdb2-d32a-49be-a02c-9c04d68bab6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:45:26.727733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdafdb2-d32a-49be-a02c-9c04d68bab6b admin admin] PATH_INFO: `/v3/projects/d3d192bfdcb44a64a510466c11539794` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:45:26.728846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdafdb2-d32a-49be-a02c-9c04d68bab6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3d192bfdcb44a64a510466c11539794)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:45:26.730839 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdafdb2-d32a-49be-a02c-9c04d68bab6b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:45:26.780473 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5fdafdb2-d32a-49be-a02c-9c04d68bab6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3d192bfdcb44a64a510466c11539794', 'request_id': 'req-5fdafdb2-d32a-49be-a02c-9c04d68bab6b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:45:26.788806 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5fdafdb2-d32a-49be-a02c-9c04d68bab6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3d192bfdcb44a64a510466c11539794', 'request_id': 'req-5fdafdb2-d32a-49be-a02c-9c04d68bab6b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:45:26.795110 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5fdafdb2-d32a-49be-a02c-9c04d68bab6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3d192bfdcb44a64a510466c11539794', 'request_id': 'req-5fdafdb2-d32a-49be-a02c-9c04d68bab6b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:45:26.807881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5fdafdb2-d32a-49be-a02c-9c04d68bab6b admin admin] The token cache is being invalidate because project d3d192bfdcb44a64a510466c11539794 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:45:26.808186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5fdafdb2-d32a-49be-a02c-9c04d68bab6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:45:26.808933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5fdafdb2-d32a-49be-a02c-9c04d68bab6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:45:26.810619 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4374/8754] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:45:26 2022] DELETE /identity/v3/projects/d3d192bfdcb44a64a510466c11539794 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:45:26.814660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73868c0-95d4-4895-9c09-d13deeac447c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:45:26.816402 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c73868c0-95d4-4895-9c09-d13deeac447c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:45:26.830288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73868c0-95d4-4895-9c09-d13deeac447c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:45:26.892033 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b97b9-7573-4d72-ba38-f436c34bbd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:45:26.892722 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b97b9-7573-4d72-ba38-f436c34bbd5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:45:26.893000 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b97b9-7573-4d72-ba38-f436c34bbd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:45:26.893330 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b97b9-7573-4d72-ba38-f436c34bbd5a admin admin] PATH_INFO: `/v3/users/642b36e988b5404dab0f7453e0d02c07` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:45:26.894655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b97b9-7573-4d72-ba38-f436c34bbd5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=642b36e988b5404dab0f7453e0d02c07)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:45:26.896670 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b97b9-7573-4d72-ba38-f436c34bbd5a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:45:26.919637 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:45:26.947178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-683b97b9-7573-4d72-ba38-f436c34bbd5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '642b36e988b5404dab0f7453e0d02c07'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:45:26.947881 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-683b97b9-7573-4d72-ba38-f436c34bbd5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '642b36e988b5404dab0f7453e0d02c07'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:45:26.955242 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-683b97b9-7573-4d72-ba38-f436c34bbd5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '642b36e988b5404dab0f7453e0d02c07'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:45:26.962650 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-683b97b9-7573-4d72-ba38-f436c34bbd5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '642b36e988b5404dab0f7453e0d02c07'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:45:26.963327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-683b97b9-7573-4d72-ba38-f436c34bbd5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '642b36e988b5404dab0f7453e0d02c07'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:45:26.981718 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4381/8755] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:45:26 2022] DELETE /identity/v3/users/642b36e988b5404dab0f7453e0d02c07 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:45:27.183465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdafdb2-d32a-49be-a02c-9c04d68bab6b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:45:27.185158 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5fdafdb2-d32a-49be-a02c-9c04d68bab6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:45:27.204009 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdafdb2-d32a-49be-a02c-9c04d68bab6b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:45:27.245964 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:45:27.278831 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669790cc-a128-4596-b8c9-2f2f79d7bfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:45:27.279511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669790cc-a128-4596-b8c9-2f2f79d7bfd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:45:27.279788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669790cc-a128-4596-b8c9-2f2f79d7bfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:45:27.280102 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669790cc-a128-4596-b8c9-2f2f79d7bfd5 admin admin] PATH_INFO: `/v3/projects/11be6600ab7a45298323fe8691ec9c45` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:45:27.281301 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669790cc-a128-4596-b8c9-2f2f79d7bfd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11be6600ab7a45298323fe8691ec9c45)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:45:27.283509 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669790cc-a128-4596-b8c9-2f2f79d7bfd5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:45:27.332455 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-669790cc-a128-4596-b8c9-2f2f79d7bfd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11be6600ab7a45298323fe8691ec9c45', 'request_id': 'req-669790cc-a128-4596-b8c9-2f2f79d7bfd5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:45:27.341301 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-669790cc-a128-4596-b8c9-2f2f79d7bfd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11be6600ab7a45298323fe8691ec9c45', 'request_id': 'req-669790cc-a128-4596-b8c9-2f2f79d7bfd5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:45:27.348490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-669790cc-a128-4596-b8c9-2f2f79d7bfd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11be6600ab7a45298323fe8691ec9c45', 'request_id': 'req-669790cc-a128-4596-b8c9-2f2f79d7bfd5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:45:27.360808 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-669790cc-a128-4596-b8c9-2f2f79d7bfd5 admin admin] The token cache is being invalidate because project 11be6600ab7a45298323fe8691ec9c45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:45:27.361089 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-669790cc-a128-4596-b8c9-2f2f79d7bfd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:45:27.361747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-669790cc-a128-4596-b8c9-2f2f79d7bfd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:45:27.363517 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4375/8756] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:45:27 2022] DELETE /identity/v3/projects/11be6600ab7a45298323fe8691ec9c45 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:45:36.977986 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:45:37.357834 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=35,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:46:07.219597 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b97b9-7573-4d72-ba38-f436c34bbd5a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:46:07.221719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-683b97b9-7573-4d72-ba38-f436c34bbd5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:46:07.316952 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b97b9-7573-4d72-ba38-f436c34bbd5a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:46:07.413541 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669790cc-a128-4596-b8c9-2f2f79d7bfd5 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:46:07.414927 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-669790cc-a128-4596-b8c9-2f2f79d7bfd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:46:07.416449 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91026792-5a52-41c1-966e-a3054cfbf5d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:46:07.417299 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91026792-5a52-41c1-966e-a3054cfbf5d8 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:46:07.417811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91026792-5a52-41c1-966e-a3054cfbf5d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:46:07.418272 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91026792-5a52-41c1-966e-a3054cfbf5d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:46:07.420579 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-91026792-5a52-41c1-966e-a3054cfbf5d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:46:07.438574 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91026792-5a52-41c1-966e-a3054cfbf5d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:46:07.440604 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91026792-5a52-41c1-966e-a3054cfbf5d8 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:46:07.458124 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4382/8757] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:46:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:46:07.488434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669790cc-a128-4596-b8c9-2f2f79d7bfd5 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:46:07.493060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b18c1a-914a-4fef-9dcf-f5f9b873928c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:46:07.493935 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b18c1a-914a-4fef-9dcf-f5f9b873928c service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:46:07.494315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b18c1a-914a-4fef-9dcf-f5f9b873928c service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:46:07.494669 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b18c1a-914a-4fef-9dcf-f5f9b873928c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:46:07.497054 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c6b18c1a-914a-4fef-9dcf-f5f9b873928c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:46:07.516931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b18c1a-914a-4fef-9dcf-f5f9b873928c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:46:07.518423 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b18c1a-914a-4fef-9dcf-f5f9b873928c service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:46:07.532416 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4376/8758] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:46:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:46:08.717238 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91026792-5a52-41c1-966e-a3054cfbf5d8 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:46:08.718760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-91026792-5a52-41c1-966e-a3054cfbf5d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:46:08.734071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91026792-5a52-41c1-966e-a3054cfbf5d8 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:46:08.737789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40bda59-cd53-4057-a61e-96e862507826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:46:08.738384 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bda59-cd53-4057-a61e-96e862507826 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:46:08.738681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bda59-cd53-4057-a61e-96e862507826 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:46:08.738945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bda59-cd53-4057-a61e-96e862507826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:46:08.741455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a40bda59-cd53-4057-a61e-96e862507826 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:46:08.757707 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40bda59-cd53-4057-a61e-96e862507826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:46:08.759140 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40bda59-cd53-4057-a61e-96e862507826 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:46:08.772899 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4383/8759] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:46:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:46:17.524646 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=26 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:46:18.765287 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=68 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:46:32.681587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b18c1a-914a-4fef-9dcf-f5f9b873928c service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:46:32.693235 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b18c1a-914a-4fef-9dcf-f5f9b873928c service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:46:32.697148 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5558e97-e5b4-4707-83ac-4a72657e531c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:46:32.697857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5558e97-e5b4-4707-83ac-4a72657e531c service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:46:32.698200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5558e97-e5b4-4707-83ac-4a72657e531c service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:46:32.698537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5558e97-e5b4-4707-83ac-4a72657e531c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:46:32.700315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-e5558e97-e5b4-4707-83ac-4a72657e531c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:46:32.766971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5558e97-e5b4-4707-83ac-4a72657e531c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:46:32.768432 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5558e97-e5b4-4707-83ac-4a72657e531c service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:46:32.779862 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4377/8760] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:46:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:46:39.896739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40bda59-cd53-4057-a61e-96e862507826 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:46:39.898837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a40bda59-cd53-4057-a61e-96e862507826 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:46:39.915908 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40bda59-cd53-4057-a61e-96e862507826 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:46:39.920858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a816ffd-c114-4a07-a006-051064a5330b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:46:39.921639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a816ffd-c114-4a07-a006-051064a5330b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:46:39.921924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a816ffd-c114-4a07-a006-051064a5330b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:46:39.922192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a816ffd-c114-4a07-a006-051064a5330b admin admin] PATH_INFO: `/v3/users/f39dd2d709374c729d51f7e2cf18300c` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:46:39.923334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a816ffd-c114-4a07-a006-051064a5330b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f39dd2d709374c729d51f7e2cf18300c)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:46:39.925355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a816ffd-c114-4a07-a006-051064a5330b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:46:39.974055 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2a816ffd-c114-4a07-a006-051064a5330b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f39dd2d709374c729d51f7e2cf18300c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:39.974774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2a816ffd-c114-4a07-a006-051064a5330b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f39dd2d709374c729d51f7e2cf18300c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:39.982565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2a816ffd-c114-4a07-a006-051064a5330b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f39dd2d709374c729d51f7e2cf18300c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:39.996881 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2a816ffd-c114-4a07-a006-051064a5330b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f39dd2d709374c729d51f7e2cf18300c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:39.997588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2a816ffd-c114-4a07-a006-051064a5330b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f39dd2d709374c729d51f7e2cf18300c'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:40.019125 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4384/8761] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:46:39 2022] DELETE /identity/v3/users/f39dd2d709374c729d51f7e2cf18300c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:46:40.193222 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5558e97-e5b4-4707-83ac-4a72657e531c service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:46:40.204966 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5558e97-e5b4-4707-83ac-4a72657e531c service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:46:40.262397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22b5ed-c767-4324-868d-9dd998f46324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:46:40.263021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22b5ed-c767-4324-868d-9dd998f46324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:46:40.263298 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22b5ed-c767-4324-868d-9dd998f46324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:46:40.263575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22b5ed-c767-4324-868d-9dd998f46324 admin admin] PATH_INFO: `/v3/projects/57fd344992574c8f9338f1ff20d5a319` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:46:40.264693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa22b5ed-c767-4324-868d-9dd998f46324 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57fd344992574c8f9338f1ff20d5a319)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:46:40.266629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa22b5ed-c767-4324-868d-9dd998f46324 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:46:40.317040 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-aa22b5ed-c767-4324-868d-9dd998f46324 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57fd344992574c8f9338f1ff20d5a319', 'request_id': 'req-aa22b5ed-c767-4324-868d-9dd998f46324'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:40.324556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-aa22b5ed-c767-4324-868d-9dd998f46324 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57fd344992574c8f9338f1ff20d5a319', 'request_id': 'req-aa22b5ed-c767-4324-868d-9dd998f46324'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:40.330037 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-aa22b5ed-c767-4324-868d-9dd998f46324 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57fd344992574c8f9338f1ff20d5a319', 'request_id': 'req-aa22b5ed-c767-4324-868d-9dd998f46324'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:40.342494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-aa22b5ed-c767-4324-868d-9dd998f46324 admin admin] The token cache is being invalidate because project 57fd344992574c8f9338f1ff20d5a319 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:46:40.342808 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-aa22b5ed-c767-4324-868d-9dd998f46324 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:40.343474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-aa22b5ed-c767-4324-868d-9dd998f46324 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:40.344996 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4378/8762] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:46:40 2022] DELETE /identity/v3/projects/57fd344992574c8f9338f1ff20d5a319 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:46:40.348852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a816ffd-c114-4a07-a006-051064a5330b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:46:40.350864 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2a816ffd-c114-4a07-a006-051064a5330b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:46:40.364936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a816ffd-c114-4a07-a006-051064a5330b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:46:40.423018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8812d-1485-4c91-8019-f12eb8a5c987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:46:40.423654 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8812d-1485-4c91-8019-f12eb8a5c987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:46:40.423929 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8812d-1485-4c91-8019-f12eb8a5c987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:46:40.424202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8812d-1485-4c91-8019-f12eb8a5c987 admin admin] PATH_INFO: `/v3/users/d85306af75f542e0bf49bc908ba92f09` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:46:40.442731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8812d-1485-4c91-8019-f12eb8a5c987 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d85306af75f542e0bf49bc908ba92f09)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:46:40.444868 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8812d-1485-4c91-8019-f12eb8a5c987 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:46:40.498390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e7f8812d-1485-4c91-8019-f12eb8a5c987 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd85306af75f542e0bf49bc908ba92f09'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:40.499079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e7f8812d-1485-4c91-8019-f12eb8a5c987 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd85306af75f542e0bf49bc908ba92f09'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:40.507999 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e7f8812d-1485-4c91-8019-f12eb8a5c987 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd85306af75f542e0bf49bc908ba92f09'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:40.516177 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e7f8812d-1485-4c91-8019-f12eb8a5c987 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd85306af75f542e0bf49bc908ba92f09'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:40.516945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e7f8812d-1485-4c91-8019-f12eb8a5c987 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd85306af75f542e0bf49bc908ba92f09'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:40.518302 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:46:40.540244 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4385/8763] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:46:40 2022] DELETE /identity/v3/users/d85306af75f542e0bf49bc908ba92f09 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:46:40.722399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22b5ed-c767-4324-868d-9dd998f46324 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:46:40.724133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-aa22b5ed-c767-4324-868d-9dd998f46324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:46:40.754258 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22b5ed-c767-4324-868d-9dd998f46324 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:46:40.775161 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:46:40.816628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb38ff2-716b-449a-bd19-31a8fee43266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:46:40.817248 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb38ff2-716b-449a-bd19-31a8fee43266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:46:40.817556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb38ff2-716b-449a-bd19-31a8fee43266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:46:40.817833 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb38ff2-716b-449a-bd19-31a8fee43266 admin admin] PATH_INFO: `/v3/projects/a7b4961386294601a0d99467e96ad8b2` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:46:40.831343 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb38ff2-716b-449a-bd19-31a8fee43266 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7b4961386294601a0d99467e96ad8b2)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:46:40.833538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb38ff2-716b-449a-bd19-31a8fee43266 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:46:40.887232 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5eb38ff2-716b-449a-bd19-31a8fee43266 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7b4961386294601a0d99467e96ad8b2', 'request_id': 'req-5eb38ff2-716b-449a-bd19-31a8fee43266'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:40.895743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5eb38ff2-716b-449a-bd19-31a8fee43266 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7b4961386294601a0d99467e96ad8b2', 'request_id': 'req-5eb38ff2-716b-449a-bd19-31a8fee43266'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:40.905820 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5eb38ff2-716b-449a-bd19-31a8fee43266 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7b4961386294601a0d99467e96ad8b2', 'request_id': 'req-5eb38ff2-716b-449a-bd19-31a8fee43266'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:40.920230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5eb38ff2-716b-449a-bd19-31a8fee43266 admin admin] The token cache is being invalidate because project a7b4961386294601a0d99467e96ad8b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:46:40.920686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5eb38ff2-716b-449a-bd19-31a8fee43266 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:40.921714 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5eb38ff2-716b-449a-bd19-31a8fee43266 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:40.937669 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4379/8764] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:46:40 2022] DELETE /identity/v3/projects/a7b4961386294601a0d99467e96ad8b2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:46:43.441540 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8812d-1485-4c91-8019-f12eb8a5c987 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:46:43.446096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e7f8812d-1485-4c91-8019-f12eb8a5c987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:46:43.459683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8812d-1485-4c91-8019-f12eb8a5c987 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:46:43.516445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a6934-d08d-490a-8e03-cd78d57fd369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:46:43.517114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a6934-d08d-490a-8e03-cd78d57fd369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:46:43.517389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a6934-d08d-490a-8e03-cd78d57fd369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:46:43.517691 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a6934-d08d-490a-8e03-cd78d57fd369 admin admin] PATH_INFO: `/v3/users/39edb7ede31446eb80f2e510e513afa1` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:46:43.518822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a6934-d08d-490a-8e03-cd78d57fd369 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39edb7ede31446eb80f2e510e513afa1)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:46:43.520732 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a6934-d08d-490a-8e03-cd78d57fd369 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:46:43.567884 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9d8a6934-d08d-490a-8e03-cd78d57fd369 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39edb7ede31446eb80f2e510e513afa1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:43.568465 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9d8a6934-d08d-490a-8e03-cd78d57fd369 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39edb7ede31446eb80f2e510e513afa1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:43.575233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9d8a6934-d08d-490a-8e03-cd78d57fd369 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39edb7ede31446eb80f2e510e513afa1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:43.582172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9d8a6934-d08d-490a-8e03-cd78d57fd369 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39edb7ede31446eb80f2e510e513afa1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:43.582833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-9d8a6934-d08d-490a-8e03-cd78d57fd369 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39edb7ede31446eb80f2e510e513afa1'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:43.601333 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4386/8765] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:46:43 2022] DELETE /identity/v3/users/39edb7ede31446eb80f2e510e513afa1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:46:43.605960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2661a-f3dd-44ed-bde1-370aa777ebe1 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:46:43.606427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2661a-f3dd-44ed-bde1-370aa777ebe1 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:46:43.606509 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2661a-f3dd-44ed-bde1-370aa777ebe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:46:43.625767 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-f3b2661a-f3dd-44ed-bde1-370aa777ebe1 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:46:43.626969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f3b2661a-f3dd-44ed-bde1-370aa777ebe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:46:43.686267 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4380/8766] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:46:43.695999 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a6934-d08d-490a-8e03-cd78d57fd369 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:46:43.697450 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9d8a6934-d08d-490a-8e03-cd78d57fd369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:46:43.762102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a6934-d08d-490a-8e03-cd78d57fd369 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:46:43.766162 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1c274-2628-45b2-8ea8-fd10e25327d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:46:43.766806 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1c274-2628-45b2-8ea8-fd10e25327d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:46:43.767083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1c274-2628-45b2-8ea8-fd10e25327d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:46:43.767352 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1c274-2628-45b2-8ea8-fd10e25327d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:46:43.778225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa1c274-2628-45b2-8ea8-fd10e25327d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:46:43.779847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa1c274-2628-45b2-8ea8-fd10e25327d8 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:46:43.790396 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4387/8767] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:46:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:46:43.963539 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2661a-f3dd-44ed-bde1-370aa777ebe1 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:46:43.965210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f3b2661a-f3dd-44ed-bde1-370aa777ebe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:46:43.978891 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2661a-f3dd-44ed-bde1-370aa777ebe1 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:46:43.983639 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f14e9-1c08-4d58-a9d6-cee6afe50ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:46:43.984272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f14e9-1c08-4d58-a9d6-cee6afe50ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:46:43.984552 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f14e9-1c08-4d58-a9d6-cee6afe50ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:46:43.984825 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f14e9-1c08-4d58-a9d6-cee6afe50ef7 admin admin] PATH_INFO: `/v3/projects/07b5dbffd9e648daae797dfae187f0cf` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:46:43.985977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49f14e9-1c08-4d58-a9d6-cee6afe50ef7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07b5dbffd9e648daae797dfae187f0cf)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:46:43.987894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49f14e9-1c08-4d58-a9d6-cee6afe50ef7 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:46:44.030387 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:46:44.036776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c49f14e9-1c08-4d58-a9d6-cee6afe50ef7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07b5dbffd9e648daae797dfae187f0cf', 'request_id': 'req-c49f14e9-1c08-4d58-a9d6-cee6afe50ef7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:44.045724 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c49f14e9-1c08-4d58-a9d6-cee6afe50ef7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07b5dbffd9e648daae797dfae187f0cf', 'request_id': 'req-c49f14e9-1c08-4d58-a9d6-cee6afe50ef7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:44.051329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c49f14e9-1c08-4d58-a9d6-cee6afe50ef7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07b5dbffd9e648daae797dfae187f0cf', 'request_id': 'req-c49f14e9-1c08-4d58-a9d6-cee6afe50ef7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:44.062218 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c49f14e9-1c08-4d58-a9d6-cee6afe50ef7 admin admin] The token cache is being invalidate because project 07b5dbffd9e648daae797dfae187f0cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:46:44.062511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c49f14e9-1c08-4d58-a9d6-cee6afe50ef7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:44.063139 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c49f14e9-1c08-4d58-a9d6-cee6afe50ef7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:44.064614 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4381/8768] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:46:43 2022] DELETE /identity/v3/projects/07b5dbffd9e648daae797dfae187f0cf => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:46:44.068587 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1c274-2628-45b2-8ea8-fd10e25327d8 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:46:44.074039 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:46:44.080327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1c274-2628-45b2-8ea8-fd10e25327d8 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:46:44.136488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18315354-d635-44ce-8bb0-17506e98c214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:46:44.137109 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18315354-d635-44ce-8bb0-17506e98c214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:46:44.137397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18315354-d635-44ce-8bb0-17506e98c214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:46:44.137684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18315354-d635-44ce-8bb0-17506e98c214 admin admin] PATH_INFO: `/v3/users/23ee3d84af96462fa6165f7275010807` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:46:44.138773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18315354-d635-44ce-8bb0-17506e98c214 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23ee3d84af96462fa6165f7275010807)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:46:44.140837 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18315354-d635-44ce-8bb0-17506e98c214 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:46:44.186249 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-18315354-d635-44ce-8bb0-17506e98c214 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23ee3d84af96462fa6165f7275010807'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:44.186908 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-18315354-d635-44ce-8bb0-17506e98c214 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23ee3d84af96462fa6165f7275010807'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:44.194708 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-18315354-d635-44ce-8bb0-17506e98c214 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23ee3d84af96462fa6165f7275010807'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:44.206132 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-18315354-d635-44ce-8bb0-17506e98c214 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23ee3d84af96462fa6165f7275010807'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:44.206835 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-18315354-d635-44ce-8bb0-17506e98c214 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23ee3d84af96462fa6165f7275010807'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:44.224307 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4388/8769] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:46:44 2022] DELETE /identity/v3/users/23ee3d84af96462fa6165f7275010807 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:46:44.490175 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f14e9-1c08-4d58-a9d6-cee6afe50ef7 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:46:44.492464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c49f14e9-1c08-4d58-a9d6-cee6afe50ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:46:44.510484 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f14e9-1c08-4d58-a9d6-cee6afe50ef7 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:46:44.568043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0d279-2c14-4391-9dee-7af8dbc75ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:46:44.568670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0d279-2c14-4391-9dee-7af8dbc75ad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:46:44.569514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0d279-2c14-4391-9dee-7af8dbc75ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:46:44.569787 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0d279-2c14-4391-9dee-7af8dbc75ad8 admin admin] PATH_INFO: `/v3/projects/fd05d787007d402badb87a0d4ea0c8c2` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:46:44.570889 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0d279-2c14-4391-9dee-7af8dbc75ad8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd05d787007d402badb87a0d4ea0c8c2)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:46:44.572856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0d279-2c14-4391-9dee-7af8dbc75ad8 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:46:44.617562 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4ee0d279-2c14-4391-9dee-7af8dbc75ad8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd05d787007d402badb87a0d4ea0c8c2', 'request_id': 'req-4ee0d279-2c14-4391-9dee-7af8dbc75ad8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:44.624616 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4ee0d279-2c14-4391-9dee-7af8dbc75ad8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd05d787007d402badb87a0d4ea0c8c2', 'request_id': 'req-4ee0d279-2c14-4391-9dee-7af8dbc75ad8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:44.630305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4ee0d279-2c14-4391-9dee-7af8dbc75ad8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd05d787007d402badb87a0d4ea0c8c2', 'request_id': 'req-4ee0d279-2c14-4391-9dee-7af8dbc75ad8'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:44.641601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4ee0d279-2c14-4391-9dee-7af8dbc75ad8 admin admin] The token cache is being invalidate because project fd05d787007d402badb87a0d4ea0c8c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:46:44.641883 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4ee0d279-2c14-4391-9dee-7af8dbc75ad8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:44.642503 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-4ee0d279-2c14-4391-9dee-7af8dbc75ad8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:44.643956 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4382/8770] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:46:44 2022] DELETE /identity/v3/projects/fd05d787007d402badb87a0d4ea0c8c2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:46:44.648997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f30392-fa15-4394-b6e7-1cf877ae7b09 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:46:44.649488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f30392-fa15-4394-b6e7-1cf877ae7b09 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:46:44.649590 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f30392-fa15-4394-b6e7-1cf877ae7b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:46:44.668713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e6f30392-fa15-4394-b6e7-1cf877ae7b09 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:46:44.669962 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e6f30392-fa15-4394-b6e7-1cf877ae7b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:46:44.728438 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4389/8771] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:46:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:46:44.736563 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92172002-8bef-44fc-80d0-88b1d2b72b5a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:46:44.736852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92172002-8bef-44fc-80d0-88b1d2b72b5a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:46:44.737121 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92172002-8bef-44fc-80d0-88b1d2b72b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:46:44.757070 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-92172002-8bef-44fc-80d0-88b1d2b72b5a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:46:44.758287 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-92172002-8bef-44fc-80d0-88b1d2b72b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:46:44.766040 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4383/8772] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:46:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:46:44.770115 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f30392-fa15-4394-b6e7-1cf877ae7b09 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:46:44.779860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f30392-fa15-4394-b6e7-1cf877ae7b09 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:46:44.784409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f3aaa-24b4-4579-bb1a-9c9156b42320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:46:44.785003 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f3aaa-24b4-4579-bb1a-9c9156b42320 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:46:44.785283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f3aaa-24b4-4579-bb1a-9c9156b42320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:46:44.785592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f3aaa-24b4-4579-bb1a-9c9156b42320 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:46:44.786232 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f3aaa-24b4-4579-bb1a-9c9156b42320 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:46:44.786534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f3aaa-24b4-4579-bb1a-9c9156b42320 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:46:44.788637 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f3aaa-24b4-4579-bb1a-9c9156b42320 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:46:44.800130 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4390/8773] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:46:44.804975 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92172002-8bef-44fc-80d0-88b1d2b72b5a None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:46:44.814213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92172002-8bef-44fc-80d0-88b1d2b72b5a None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:46:44.820567 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d601b1-6269-4268-8505-c30bcb897cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:46:44.821273 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d601b1-6269-4268-8505-c30bcb897cd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:46:44.821741 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d601b1-6269-4268-8505-c30bcb897cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:46:44.822026 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d601b1-6269-4268-8505-c30bcb897cd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:46:44.822781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d601b1-6269-4268-8505-c30bcb897cd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:46:44.824762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d601b1-6269-4268-8505-c30bcb897cd0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:46:44.853648 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4384/8774] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:46:44 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:46:44.857838 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f3aaa-24b4-4579-bb1a-9c9156b42320 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:46:44.868833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f3aaa-24b4-4579-bb1a-9c9156b42320 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:46:44.873578 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:46:44.930487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad022c4a-5836-45a3-beca-f0d2b5309a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:46:44.931096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad022c4a-5836-45a3-beca-f0d2b5309a15 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:46:44.931377 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad022c4a-5836-45a3-beca-f0d2b5309a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:46:44.931646 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad022c4a-5836-45a3-beca-f0d2b5309a15 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:46:44.932275 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad022c4a-5836-45a3-beca-f0d2b5309a15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:46:44.934364 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad022c4a-5836-45a3-beca-f0d2b5309a15 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:46:44.956063 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4391/8775] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:46:44 2022] POST /identity/v3/users => generated 283 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:46:44.960202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d601b1-6269-4268-8505-c30bcb897cd0 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:46:44.970723 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d601b1-6269-4268-8505-c30bcb897cd0 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:46:44.975874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e3b43-a398-44aa-aac8-3d3bc02b6263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:46:44.976466 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e3b43-a398-44aa-aac8-3d3bc02b6263 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:46:44.976748 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e3b43-a398-44aa-aac8-3d3bc02b6263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:46:44.977023 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e3b43-a398-44aa-aac8-3d3bc02b6263 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:46:44.977691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e3b43-a398-44aa-aac8-3d3bc02b6263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:46:44.979301 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e3b43-a398-44aa-aac8-3d3bc02b6263 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:46:44.989013 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4385/8776] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:46:44.993315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad022c4a-5836-45a3-beca-f0d2b5309a15 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:46:45.003609 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad022c4a-5836-45a3-beca-f0d2b5309a15 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:46:45.008268 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd906fe-1937-4291-9b42-231475c4cc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:46:45.008864 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd906fe-1937-4291-9b42-231475c4cc57 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:46:45.009146 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd906fe-1937-4291-9b42-231475c4cc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:46:45.009421 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd906fe-1937-4291-9b42-231475c4cc57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:46:45.010087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd906fe-1937-4291-9b42-231475c4cc57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:46:45.011677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd906fe-1937-4291-9b42-231475c4cc57 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:46:45.022120 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4392/8777] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:46:45.026105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e3b43-a398-44aa-aac8-3d3bc02b6263 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:46:45.036152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e3b43-a398-44aa-aac8-3d3bc02b6263 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:46:45.041356 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edba4f-7fdc-42b7-89ce-48adeef0f7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:46:45.042023 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edba4f-7fdc-42b7-89ce-48adeef0f7af admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:46:45.042303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edba4f-7fdc-42b7-89ce-48adeef0f7af admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:46:45.042577 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edba4f-7fdc-42b7-89ce-48adeef0f7af admin admin] PATH_INFO: `/v3/projects/17da02b50020439ca659bb5b1ea777ac/users/093e7651ebdb4bb7b342ff53d21271e7/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:46:45.057341 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9edba4f-7fdc-42b7-89ce-48adeef0f7af admin admin] RBAC: Authorizing `identity:create_grant(project_id=17da02b50020439ca659bb5b1ea777ac, user_id=093e7651ebdb4bb7b342ff53d21271e7, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:46:45.060028 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9edba4f-7fdc-42b7-89ce-48adeef0f7af admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:46:45.063031 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:46:45.075238 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4386/8778] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:46:45 2022] PUT /identity/v3/projects/17da02b50020439ca659bb5b1ea777ac/users/093e7651ebdb4bb7b342ff53d21271e7/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:46:45.080226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c5edc-adfc-46b6-9d37-d29051319e2d None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:46:45.080515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c5edc-adfc-46b6-9d37-d29051319e2d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:46:45.080793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c5edc-adfc-46b6-9d37-d29051319e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:46:45.100883 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-f69c5edc-adfc-46b6-9d37-d29051319e2d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:46:45.102114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f69c5edc-adfc-46b6-9d37-d29051319e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:46:45.159229 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4393/8779] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:46:45.169292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edba4f-7fdc-42b7-89ce-48adeef0f7af admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:46:45.171056 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a9edba4f-7fdc-42b7-89ce-48adeef0f7af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:46:45.231715 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edba4f-7fdc-42b7-89ce-48adeef0f7af admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:46:45.235679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc78035-f7b4-404d-866c-56180a93c22e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:46:45.236404 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc78035-f7b4-404d-866c-56180a93c22e service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:46:45.236686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc78035-f7b4-404d-866c-56180a93c22e service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:46:45.236954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc78035-f7b4-404d-866c-56180a93c22e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:46:45.246130 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc78035-f7b4-404d-866c-56180a93c22e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:46:45.247554 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc78035-f7b4-404d-866c-56180a93c22e service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:46:45.256739 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4387/8780] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:46:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:46:49.029478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45d17b-15d9-45b8-8f18-aaaf6dceb899 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:46:49.029478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45d17b-15d9-45b8-8f18-aaaf6dceb899 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:46:49.029991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45d17b-15d9-45b8-8f18-aaaf6dceb899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:46:49.059757 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-9b45d17b-15d9-45b8-8f18-aaaf6dceb899 None None] MFA Rules not processed for user `093e7651ebdb4bb7b342ff53d21271e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:46:49.060969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9b45d17b-15d9-45b8-8f18-aaaf6dceb899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:46:49.139555 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4394/8781] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:46:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:46:49.144124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc78035-f7b4-404d-866c-56180a93c22e service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:46:49.154755 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc78035-f7b4-404d-866c-56180a93c22e service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:46:49.159430 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d6ac24-ad43-45f6-b783-0c3371f78356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:46:49.160043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6ac24-ad43-45f6-b783-0c3371f78356 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:46:49.160320 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6ac24-ad43-45f6-b783-0c3371f78356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:46:49.160591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6ac24-ad43-45f6-b783-0c3371f78356 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:46:49.161240 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d6ac24-ad43-45f6-b783-0c3371f78356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:46:49.163777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d6ac24-ad43-45f6-b783-0c3371f78356 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:46:49.188086 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4388/8782] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:46:49 2022] POST /identity/v3/users => generated 288 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:46:49.192107 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45d17b-15d9-45b8-8f18-aaaf6dceb899 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:46:49.206988 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45d17b-15d9-45b8-8f18-aaaf6dceb899 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:46:49.212130 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a47f30-0ef7-4980-b031-b6aaf24f3582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:46:49.212878 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a47f30-0ef7-4980-b031-b6aaf24f3582 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:46:49.213462 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a47f30-0ef7-4980-b031-b6aaf24f3582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:46:49.213838 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a47f30-0ef7-4980-b031-b6aaf24f3582 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:46:49.214678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a47f30-0ef7-4980-b031-b6aaf24f3582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:46:49.217112 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a47f30-0ef7-4980-b031-b6aaf24f3582 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:46:49.230991 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4395/8783] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:46:49.235098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d6ac24-ad43-45f6-b783-0c3371f78356 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:46:49.246793 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d6ac24-ad43-45f6-b783-0c3371f78356 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:46:49.251695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394fbfe-f5da-4700-8804-0efc12e7526f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:46:49.252464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394fbfe-f5da-4700-8804-0efc12e7526f admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:46:49.252836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394fbfe-f5da-4700-8804-0efc12e7526f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:46:49.253184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394fbfe-f5da-4700-8804-0efc12e7526f admin admin] PATH_INFO: `/v3/system/users/3b99c8fde8a643b2b21e73f21f99a5d5/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:46:49.271075 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394fbfe-f5da-4700-8804-0efc12e7526f admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3b99c8fde8a643b2b21e73f21f99a5d5, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:46:49.272176 n-d-master-1 devstack@keystone.service[81824]: WARNING py.warnings [None req-b394fbfe-f5da-4700-8804-0efc12e7526f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 04 01:46:49.272176 n-d-master-1 devstack@keystone.service[81824]: warnings.warn(msg) Sep 04 01:46:49.272176 n-d-master-1 devstack@keystone.service[81824]: Sep 04 01:46:49.273096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394fbfe-f5da-4700-8804-0efc12e7526f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:46:49.282293 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4389/8784] 10.222.0.30 () {60 vars in 1378 bytes} [Sun Sep 4 01:46:49 2022] PUT /identity/v3/system/users/3b99c8fde8a643b2b21e73f21f99a5d5/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:46:49.293472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56888774-f2e1-4ca4-9d93-7cdf000c5e4f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:46:49.293472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56888774-f2e1-4ca4-9d93-7cdf000c5e4f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:46:49.293745 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56888774-f2e1-4ca4-9d93-7cdf000c5e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:46:49.309116 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:46:49.329046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-56888774-f2e1-4ca4-9d93-7cdf000c5e4f None None] MFA Rules not processed for user `3b99c8fde8a643b2b21e73f21f99a5d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:46:49.331521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-56888774-f2e1-4ca4-9d93-7cdf000c5e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:46:49.426478 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4396/8785] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:46:49 2022] POST /identity/v3/auth/tokens => generated 2415 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 04 01:46:49.431154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394fbfe-f5da-4700-8804-0efc12e7526f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:46:49.544090 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394fbfe-f5da-4700-8804-0efc12e7526f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:46:49.555435 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:46:49.580265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b638d70-201c-4952-9c07-84bd33501f6c None tempest-ImageQuotaTest-1414735402-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b99c8fde8a643b2b21e73f21f99a5d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:46:49.581059 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b638d70-201c-4952-9c07-84bd33501f6c None tempest-ImageQuotaTest-1414735402-system-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:46:49.581337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b638d70-201c-4952-9c07-84bd33501f6c None tempest-ImageQuotaTest-1414735402-system-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:46:49.581644 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b638d70-201c-4952-9c07-84bd33501f6c None tempest-ImageQuotaTest-1414735402-system-admin] PATH_INFO: `/v3/services` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:46:49.582239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b638d70-201c-4952-9c07-84bd33501f6c None tempest-ImageQuotaTest-1414735402-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:46:49.583601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b638d70-201c-4952-9c07-84bd33501f6c None tempest-ImageQuotaTest-1414735402-system-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:46:49.590922 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4390/8786] 10.222.0.30 () {58 vars in 1110 bytes} [Sun Sep 4 01:46:49 2022] GET /identity/v3/services => generated 2191 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:46:49.595525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56888774-f2e1-4ca4-9d93-7cdf000c5e4f None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:46:49.694911 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56888774-f2e1-4ca4-9d93-7cdf000c5e4f None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:46:49.719806 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:46:49.729104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c614fd-18b8-4243-8eb7-639b689249d7 None tempest-ImageQuotaTest-1414735402-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b99c8fde8a643b2b21e73f21f99a5d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:46:49.729758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c614fd-18b8-4243-8eb7-639b689249d7 None tempest-ImageQuotaTest-1414735402-system-admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:46:49.730039 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c614fd-18b8-4243-8eb7-639b689249d7 None tempest-ImageQuotaTest-1414735402-system-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:46:49.730317 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c614fd-18b8-4243-8eb7-639b689249d7 None tempest-ImageQuotaTest-1414735402-system-admin] PATH_INFO: `/v3/limits` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:46:49.730987 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c614fd-18b8-4243-8eb7-639b689249d7 None tempest-ImageQuotaTest-1414735402-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:46:49.732287 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c614fd-18b8-4243-8eb7-639b689249d7 None tempest-ImageQuotaTest-1414735402-system-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:46:49.775084 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application [None req-39c614fd-18b8-4243-8eb7-639b689249d7 None tempest-ImageQuotaTest-1414735402-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Sep 04 01:46:49.775084 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 04 01:46:49.775084 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 04 01:46:49.775084 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 04 01:46:49.775084 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 04 01:46:49.775084 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 04 01:46:49.775084 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 04 01:46:49.775084 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 04 01:46:49.775084 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 04 01:46:49.775084 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 04 01:46:49.775084 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 04 01:46:49.775084 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 04 01:46:49.775084 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Sep 04 01:46:49.775084 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Sep 04 01:46:49.776134 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 04 01:46:49.776134 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 04 01:46:49.776134 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Sep 04 01:46:49.776134 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Sep 04 01:46:49.776134 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 04 01:46:49.776134 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 04 01:46:49.776134 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Sep 04 01:46:49.776134 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Sep 04 01:46:49.776134 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Sep 04 01:46:49.776134 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application raise exception.NoLimitReference Sep 04 01:46:49.776134 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Sep 04 01:46:49.776134 n-d-master-1 devstack@keystone.service[81825]: ERROR keystone.server.flask.application Sep 04 01:46:49.776907 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4397/8787] 10.222.0.30 () {60 vars in 1126 bytes} [Sun Sep 4 01:46:49 2022] POST /identity/v3/limits => generated 124 bytes in 181 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Sep 04 01:46:49.781285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b638d70-201c-4952-9c07-84bd33501f6c None tempest-ImageQuotaTest-1414735402-system-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:46:49.882420 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b638d70-201c-4952-9c07-84bd33501f6c None tempest-ImageQuotaTest-1414735402-system-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:46:49.920032 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1ff1d-3160-4c96-b2b3-fdd47f7a36d8 None tempest-ImageQuotaTest-1414735402-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b99c8fde8a643b2b21e73f21f99a5d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:46:49.920670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1ff1d-3160-4c96-b2b3-fdd47f7a36d8 None tempest-ImageQuotaTest-1414735402-system-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:46:49.920936 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1ff1d-3160-4c96-b2b3-fdd47f7a36d8 None tempest-ImageQuotaTest-1414735402-system-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:46:49.921209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1ff1d-3160-4c96-b2b3-fdd47f7a36d8 None tempest-ImageQuotaTest-1414735402-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:46:49.921864 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e1ff1d-3160-4c96-b2b3-fdd47f7a36d8 None tempest-ImageQuotaTest-1414735402-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:46:49.922954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e1ff1d-3160-4c96-b2b3-fdd47f7a36d8 None tempest-ImageQuotaTest-1414735402-system-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:46:49.930590 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4391/8788] 10.222.0.30 () {58 vars in 1137 bytes} [Sun Sep 4 01:46:49 2022] GET /identity/v3/registered_limits => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:46:49.936890 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c614fd-18b8-4243-8eb7-639b689249d7 None tempest-ImageQuotaTest-1414735402-system-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:46:50.042789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c614fd-18b8-4243-8eb7-639b689249d7 None tempest-ImageQuotaTest-1414735402-system-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:46:50.077807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b92c4-b0d8-44ec-82e3-ade4581101be None tempest-ImageQuotaTest-1414735402-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b99c8fde8a643b2b21e73f21f99a5d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:46:50.078437 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b92c4-b0d8-44ec-82e3-ade4581101be None tempest-ImageQuotaTest-1414735402-system-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:46:50.078712 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b92c4-b0d8-44ec-82e3-ade4581101be None tempest-ImageQuotaTest-1414735402-system-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:46:50.078983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b92c4-b0d8-44ec-82e3-ade4581101be None tempest-ImageQuotaTest-1414735402-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:46:50.079594 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b92c4-b0d8-44ec-82e3-ade4581101be None tempest-ImageQuotaTest-1414735402-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:46:50.080684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b92c4-b0d8-44ec-82e3-ade4581101be None tempest-ImageQuotaTest-1414735402-system-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:46:50.086097 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4398/8789] 10.222.0.30 () {58 vars in 1137 bytes} [Sun Sep 4 01:46:49 2022] GET /identity/v3/registered_limits => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:46:53.431629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1ff1d-3160-4c96-b2b3-fdd47f7a36d8 None tempest-ImageQuotaTest-1414735402-system-admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:46:53.451086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1ff1d-3160-4c96-b2b3-fdd47f7a36d8 None tempest-ImageQuotaTest-1414735402-system-admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:46:53.455799 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f742e3-4252-4ef2-a6a5-ab49183141c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:46:53.456432 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f742e3-4252-4ef2-a6a5-ab49183141c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:46:53.456710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f742e3-4252-4ef2-a6a5-ab49183141c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:46:53.456984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f742e3-4252-4ef2-a6a5-ab49183141c5 admin admin] PATH_INFO: `/v3/users/093e7651ebdb4bb7b342ff53d21271e7` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:46:53.458133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f742e3-4252-4ef2-a6a5-ab49183141c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=093e7651ebdb4bb7b342ff53d21271e7)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:46:53.460060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f742e3-4252-4ef2-a6a5-ab49183141c5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:46:53.497863 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:46:53.508842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d9f742e3-4252-4ef2-a6a5-ab49183141c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '093e7651ebdb4bb7b342ff53d21271e7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:53.509505 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d9f742e3-4252-4ef2-a6a5-ab49183141c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '093e7651ebdb4bb7b342ff53d21271e7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:53.516459 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d9f742e3-4252-4ef2-a6a5-ab49183141c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '093e7651ebdb4bb7b342ff53d21271e7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:53.526247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d9f742e3-4252-4ef2-a6a5-ab49183141c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '093e7651ebdb4bb7b342ff53d21271e7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:53.527116 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d9f742e3-4252-4ef2-a6a5-ab49183141c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '093e7651ebdb4bb7b342ff53d21271e7'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:53.544292 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4392/8790] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:46:53 2022] DELETE /identity/v3/users/093e7651ebdb4bb7b342ff53d21271e7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:46:53.726715 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b92c4-b0d8-44ec-82e3-ade4581101be None tempest-ImageQuotaTest-1414735402-system-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:46:53.728497 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a57b92c4-b0d8-44ec-82e3-ade4581101be None tempest-ImageQuotaTest-1414735402-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:46:53.784292 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=100 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:46:53.798502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b92c4-b0d8-44ec-82e3-ade4581101be None tempest-ImageQuotaTest-1414735402-system-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:46:53.803958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f42e13-5918-4bca-a79e-e9de5ffc97eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:46:53.804593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f42e13-5918-4bca-a79e-e9de5ffc97eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:46:53.804874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f42e13-5918-4bca-a79e-e9de5ffc97eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:46:53.805174 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f42e13-5918-4bca-a79e-e9de5ffc97eb admin admin] PATH_INFO: `/v3/projects/17da02b50020439ca659bb5b1ea777ac` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:46:53.806350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f42e13-5918-4bca-a79e-e9de5ffc97eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=17da02b50020439ca659bb5b1ea777ac)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:46:53.808281 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f42e13-5918-4bca-a79e-e9de5ffc97eb admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:46:53.852699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e0f42e13-5918-4bca-a79e-e9de5ffc97eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17da02b50020439ca659bb5b1ea777ac', 'request_id': 'req-e0f42e13-5918-4bca-a79e-e9de5ffc97eb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:53.859924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e0f42e13-5918-4bca-a79e-e9de5ffc97eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17da02b50020439ca659bb5b1ea777ac', 'request_id': 'req-e0f42e13-5918-4bca-a79e-e9de5ffc97eb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:53.865634 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e0f42e13-5918-4bca-a79e-e9de5ffc97eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17da02b50020439ca659bb5b1ea777ac', 'request_id': 'req-e0f42e13-5918-4bca-a79e-e9de5ffc97eb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:53.877259 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e0f42e13-5918-4bca-a79e-e9de5ffc97eb admin admin] The token cache is being invalidate because project 17da02b50020439ca659bb5b1ea777ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:46:53.877576 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e0f42e13-5918-4bca-a79e-e9de5ffc97eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:53.878212 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-e0f42e13-5918-4bca-a79e-e9de5ffc97eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:53.879679 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4399/8791] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:46:53 2022] DELETE /identity/v3/projects/17da02b50020439ca659bb5b1ea777ac => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:46:53.883801 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f742e3-4252-4ef2-a6a5-ab49183141c5 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:46:53.893887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f742e3-4252-4ef2-a6a5-ab49183141c5 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:46:53.950309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b2900-6a60-4bdf-8994-a96e9e884e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:46:53.950941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b2900-6a60-4bdf-8994-a96e9e884e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:46:53.951226 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b2900-6a60-4bdf-8994-a96e9e884e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:46:53.951502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b2900-6a60-4bdf-8994-a96e9e884e01 admin admin] PATH_INFO: `/v3/users/3b99c8fde8a643b2b21e73f21f99a5d5` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:46:53.952623 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b2900-6a60-4bdf-8994-a96e9e884e01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b99c8fde8a643b2b21e73f21f99a5d5)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:46:53.954596 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b2900-6a60-4bdf-8994-a96e9e884e01 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:46:54.010029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-967b2900-6a60-4bdf-8994-a96e9e884e01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b99c8fde8a643b2b21e73f21f99a5d5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:54.010598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-967b2900-6a60-4bdf-8994-a96e9e884e01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b99c8fde8a643b2b21e73f21f99a5d5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:54.017510 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-967b2900-6a60-4bdf-8994-a96e9e884e01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b99c8fde8a643b2b21e73f21f99a5d5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:54.024762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-967b2900-6a60-4bdf-8994-a96e9e884e01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b99c8fde8a643b2b21e73f21f99a5d5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:54.025380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-967b2900-6a60-4bdf-8994-a96e9e884e01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b99c8fde8a643b2b21e73f21f99a5d5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:46:54.042731 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4393/8792] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:46:53 2022] DELETE /identity/v3/users/3b99c8fde8a643b2b21e73f21f99a5d5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:47:03.689408 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0558cb-8efd-4ee4-8603-6119af4395b0 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:03.689983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0558cb-8efd-4ee4-8603-6119af4395b0 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:03.689983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0558cb-8efd-4ee4-8603-6119af4395b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:03.709211 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-6f0558cb-8efd-4ee4-8603-6119af4395b0 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:47:03.710709 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6f0558cb-8efd-4ee4-8603-6119af4395b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:47:03.771995 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4400/8793] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:47:03.781055 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0502b-6e21-481e-9458-f6a395744782 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:03.781560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0502b-6e21-481e-9458-f6a395744782 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:03.781656 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0502b-6e21-481e-9458-f6a395744782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:03.801729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-18f0502b-6e21-481e-9458-f6a395744782 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:47:03.802947 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-18f0502b-6e21-481e-9458-f6a395744782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:47:03.811297 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4394/8794] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:47:03.816157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0558cb-8efd-4ee4-8603-6119af4395b0 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:47:03.825963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0558cb-8efd-4ee4-8603-6119af4395b0 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:47:03.831305 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ac3cc-232d-49e8-af72-9d61c7b73e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:47:03.831942 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ac3cc-232d-49e8-af72-9d61c7b73e61 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:03.832225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ac3cc-232d-49e8-af72-9d61c7b73e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:03.832503 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ac3cc-232d-49e8-af72-9d61c7b73e61 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:03.833161 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ac3cc-232d-49e8-af72-9d61c7b73e61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:47:03.833495 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ac3cc-232d-49e8-af72-9d61c7b73e61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:47:03.835620 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ac3cc-232d-49e8-af72-9d61c7b73e61 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:47:03.847255 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4401/8795] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 01:47:03.860887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0502b-6e21-481e-9458-f6a395744782 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:47:03.870393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0502b-6e21-481e-9458-f6a395744782 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:47:03.875064 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a867e5-cedf-485c-a4ad-723e0899a8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:47:03.875659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a867e5-cedf-485c-a4ad-723e0899a8d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:03.875941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a867e5-cedf-485c-a4ad-723e0899a8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:03.876217 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a867e5-cedf-485c-a4ad-723e0899a8d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:03.876892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a867e5-cedf-485c-a4ad-723e0899a8d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:47:03.878839 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a867e5-cedf-485c-a4ad-723e0899a8d6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:47:03.893390 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:47:03.911045 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4395/8796] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:47:03 2022] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:47:03.915704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ac3cc-232d-49e8-af72-9d61c7b73e61 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:47:03.926045 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ac3cc-232d-49e8-af72-9d61c7b73e61 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:47:03.982116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d9836-6104-4509-9b27-79365663b762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:47:03.982648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d9836-6104-4509-9b27-79365663b762 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:03.982931 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d9836-6104-4509-9b27-79365663b762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:03.983208 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d9836-6104-4509-9b27-79365663b762 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:03.983821 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d9836-6104-4509-9b27-79365663b762 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:47:03.985767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d9836-6104-4509-9b27-79365663b762 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:47:04.001699 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:47:04.008530 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4402/8797] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:47:03 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:47:04.012716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a867e5-cedf-485c-a4ad-723e0899a8d6 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:47:04.023543 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a867e5-cedf-485c-a4ad-723e0899a8d6 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:47:04.028138 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96539bc7-2eb7-4d49-9971-7da53bffe150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:47:04.028728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96539bc7-2eb7-4d49-9971-7da53bffe150 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:04.029005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96539bc7-2eb7-4d49-9971-7da53bffe150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:04.029271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96539bc7-2eb7-4d49-9971-7da53bffe150 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:04.029941 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96539bc7-2eb7-4d49-9971-7da53bffe150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:47:04.031534 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96539bc7-2eb7-4d49-9971-7da53bffe150 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:47:04.042294 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4396/8798] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:47:04.046119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d9836-6104-4509-9b27-79365663b762 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:47:04.055880 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d9836-6104-4509-9b27-79365663b762 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:47:04.060521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef07209-0fbb-4153-b927-8b1810d556b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:47:04.061103 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef07209-0fbb-4153-b927-8b1810d556b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:04.061377 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef07209-0fbb-4153-b927-8b1810d556b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:04.061675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef07209-0fbb-4153-b927-8b1810d556b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:04.062304 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef07209-0fbb-4153-b927-8b1810d556b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:47:04.063862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef07209-0fbb-4153-b927-8b1810d556b3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:47:04.074326 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4403/8799] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:47:04.078221 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96539bc7-2eb7-4d49-9971-7da53bffe150 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:47:04.088535 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96539bc7-2eb7-4d49-9971-7da53bffe150 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:47:04.093175 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b312eb-5e97-4494-9641-785e95fe9cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:47:04.093876 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b312eb-5e97-4494-9641-785e95fe9cd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:04.094189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b312eb-5e97-4494-9641-785e95fe9cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:04.094468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b312eb-5e97-4494-9641-785e95fe9cd6 admin admin] PATH_INFO: `/v3/projects/6e523b6048144cc38ba018f9a5e501be/users/6cff8ee3db254f45af05c8ff0f702d74/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:04.109339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b312eb-5e97-4494-9641-785e95fe9cd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e523b6048144cc38ba018f9a5e501be, user_id=6cff8ee3db254f45af05c8ff0f702d74, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:47:04.112018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b312eb-5e97-4494-9641-785e95fe9cd6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:47:04.124513 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4397/8800] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:47:04 2022] PUT /identity/v3/projects/6e523b6048144cc38ba018f9a5e501be/users/6cff8ee3db254f45af05c8ff0f702d74/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:47:04.137539 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c03c8a-0839-416f-b558-72c0d2ebb70b None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:04.137828 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c03c8a-0839-416f-b558-72c0d2ebb70b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:04.138104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c03c8a-0839-416f-b558-72c0d2ebb70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:04.166196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-01c03c8a-0839-416f-b558-72c0d2ebb70b None None] MFA Rules not processed for user `6cff8ee3db254f45af05c8ff0f702d74`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:47:04.167431 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-01c03c8a-0839-416f-b558-72c0d2ebb70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:47:04.229679 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4404/8801] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:47:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:47:04.234368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b312eb-5e97-4494-9641-785e95fe9cd6 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:47:04.294452 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b312eb-5e97-4494-9641-785e95fe9cd6 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:47:04.299036 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c157f-1e9b-42eb-838c-a39e9141d9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:47:04.299631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c157f-1e9b-42eb-838c-a39e9141d9db admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:04.299910 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c157f-1e9b-42eb-838c-a39e9141d9db admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:04.300182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c157f-1e9b-42eb-838c-a39e9141d9db admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:04.300812 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c157f-1e9b-42eb-838c-a39e9141d9db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:47:04.302775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c157f-1e9b-42eb-838c-a39e9141d9db admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:47:04.328529 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4398/8802] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:47:04 2022] POST /identity/v3/projects => generated 389 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:47:04.332718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c03c8a-0839-416f-b558-72c0d2ebb70b None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:47:04.344069 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c03c8a-0839-416f-b558-72c0d2ebb70b None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:47:04.398543 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad371f3e-da99-42a6-8548-023e95f0c671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:47:04.399144 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad371f3e-da99-42a6-8548-023e95f0c671 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:04.399424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad371f3e-da99-42a6-8548-023e95f0c671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:04.399698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad371f3e-da99-42a6-8548-023e95f0c671 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:04.400327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad371f3e-da99-42a6-8548-023e95f0c671 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:47:04.402264 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad371f3e-da99-42a6-8548-023e95f0c671 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:47:04.422914 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4405/8803] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:47:04 2022] POST /identity/v3/users => generated 301 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:47:04.426888 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c157f-1e9b-42eb-838c-a39e9141d9db admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:47:04.437377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c157f-1e9b-42eb-838c-a39e9141d9db admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:47:04.442336 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa630d-0e09-48c3-9927-44f7c45899a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:47:04.442962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa630d-0e09-48c3-9927-44f7c45899a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:04.443237 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa630d-0e09-48c3-9927-44f7c45899a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:04.443509 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa630d-0e09-48c3-9927-44f7c45899a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:04.444664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa630d-0e09-48c3-9927-44f7c45899a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:47:04.446354 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa630d-0e09-48c3-9927-44f7c45899a0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:47:04.457348 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4399/8804] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:47:04.462365 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad371f3e-da99-42a6-8548-023e95f0c671 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:47:04.472198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad371f3e-da99-42a6-8548-023e95f0c671 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:47:04.476744 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739982e-847c-44a8-921a-c25040ff8e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:47:04.477388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739982e-847c-44a8-921a-c25040ff8e34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:04.477699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739982e-847c-44a8-921a-c25040ff8e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:04.477969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739982e-847c-44a8-921a-c25040ff8e34 admin admin] PATH_INFO: `/v3/projects/36e13fd544ad4a69acb3443ca9b7c153/users/4525c3bab79d4545951b5236288f993f/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:04.492694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739982e-847c-44a8-921a-c25040ff8e34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36e13fd544ad4a69acb3443ca9b7c153, user_id=4525c3bab79d4545951b5236288f993f, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:47:04.495318 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739982e-847c-44a8-921a-c25040ff8e34 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:47:04.510683 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4406/8805] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:47:04 2022] PUT /identity/v3/projects/36e13fd544ad4a69acb3443ca9b7c153/users/4525c3bab79d4545951b5236288f993f/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:47:04.514780 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa630d-0e09-48c3-9927-44f7c45899a0 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:47:04.527380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa630d-0e09-48c3-9927-44f7c45899a0 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:47:04.593881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d0777-3888-41df-8606-9aedc353f9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:47:04.594491 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d0777-3888-41df-8606-9aedc353f9ab admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:04.594772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d0777-3888-41df-8606-9aedc353f9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:04.595074 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d0777-3888-41df-8606-9aedc353f9ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:04.595713 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d0777-3888-41df-8606-9aedc353f9ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:47:04.597339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d0777-3888-41df-8606-9aedc353f9ab admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:47:04.607095 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4400/8806] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:47:04.611295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739982e-847c-44a8-921a-c25040ff8e34 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:47:04.622445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739982e-847c-44a8-921a-c25040ff8e34 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:47:04.627083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74bbcca-6589-4e13-838e-004e2f1306cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:47:04.627718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74bbcca-6589-4e13-838e-004e2f1306cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:04.628000 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74bbcca-6589-4e13-838e-004e2f1306cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:04.628273 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74bbcca-6589-4e13-838e-004e2f1306cf admin admin] PATH_INFO: `/v3/projects/36e13fd544ad4a69acb3443ca9b7c153/users/4525c3bab79d4545951b5236288f993f/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:04.630210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74bbcca-6589-4e13-838e-004e2f1306cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=36e13fd544ad4a69acb3443ca9b7c153, user_id=4525c3bab79d4545951b5236288f993f, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:47:04.633615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74bbcca-6589-4e13-838e-004e2f1306cf admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:47:04.643646 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4407/8807] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:47:04 2022] PUT /identity/v3/projects/36e13fd544ad4a69acb3443ca9b7c153/users/4525c3bab79d4545951b5236288f993f/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:47:04.653738 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f2577-df7f-4852-a794-622344e0359f None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:04.654055 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f2577-df7f-4852-a794-622344e0359f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:04.654334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f2577-df7f-4852-a794-622344e0359f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:04.681940 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ad3f2577-df7f-4852-a794-622344e0359f None None] MFA Rules not processed for user `4525c3bab79d4545951b5236288f993f`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:47:04.683131 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ad3f2577-df7f-4852-a794-622344e0359f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:47:04.699801 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:47:04.753223 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4401/8808] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:47:04 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:47:04.766749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fa5dd-b500-4e6d-afad-14f9826551ed None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:04.767225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fa5dd-b500-4e6d-afad-14f9826551ed None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:04.767318 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fa5dd-b500-4e6d-afad-14f9826551ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:04.786321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-cb0fa5dd-b500-4e6d-afad-14f9826551ed None None] MFA Rules not processed for user `6cff8ee3db254f45af05c8ff0f702d74`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:47:04.787520 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-cb0fa5dd-b500-4e6d-afad-14f9826551ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:47:04.811290 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:47:04.845525 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4408/8809] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:47:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:47:04.859189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f2577-df7f-4852-a794-622344e0359f None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:47:04.860668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ad3f2577-df7f-4852-a794-622344e0359f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:47:04.938310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f2577-df7f-4852-a794-622344e0359f None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:47:04.944660 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab44c0e-d0f3-4fab-81fd-7ae6267dd2a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:47:04.945290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab44c0e-d0f3-4fab-81fd-7ae6267dd2a6 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:04.945594 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab44c0e-d0f3-4fab-81fd-7ae6267dd2a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:04.945866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab44c0e-d0f3-4fab-81fd-7ae6267dd2a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:04.953635 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab44c0e-d0f3-4fab-81fd-7ae6267dd2a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:47:04.955220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab44c0e-d0f3-4fab-81fd-7ae6267dd2a6 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:47:04.964893 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4402/8810] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:47:04 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:47:05.417250 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fa5dd-b500-4e6d-afad-14f9826551ed None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:47:05.418684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-cb0fa5dd-b500-4e6d-afad-14f9826551ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:47:05.494871 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fa5dd-b500-4e6d-afad-14f9826551ed None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:47:05.499820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84540110-2303-4e3a-a629-508d5fb3b820 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:47:05.500429 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84540110-2303-4e3a-a629-508d5fb3b820 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:05.500711 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84540110-2303-4e3a-a629-508d5fb3b820 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:05.500985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84540110-2303-4e3a-a629-508d5fb3b820 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:05.502824 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-84540110-2303-4e3a-a629-508d5fb3b820 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:47:05.516724 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84540110-2303-4e3a-a629-508d5fb3b820 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:47:05.518316 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84540110-2303-4e3a-a629-508d5fb3b820 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:47:05.531011 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4409/8811] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:47:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:47:07.481628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab44c0e-d0f3-4fab-81fd-7ae6267dd2a6 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:47:07.483474 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-cab44c0e-d0f3-4fab-81fd-7ae6267dd2a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:47:07.546485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab44c0e-d0f3-4fab-81fd-7ae6267dd2a6 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:47:07.550156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d12a9-78a9-4356-9cdf-a90793729bff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:47:07.550786 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d12a9-78a9-4356-9cdf-a90793729bff service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:07.551047 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d12a9-78a9-4356-9cdf-a90793729bff service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:07.551314 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d12a9-78a9-4356-9cdf-a90793729bff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:07.553055 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8e2d12a9-78a9-4356-9cdf-a90793729bff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:47:07.566901 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d12a9-78a9-4356-9cdf-a90793729bff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:47:07.568266 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d12a9-78a9-4356-9cdf-a90793729bff service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:47:07.579493 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4403/8812] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:47:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:47:14.089279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84540110-2303-4e3a-a629-508d5fb3b820 service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:47:14.107250 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84540110-2303-4e3a-a629-508d5fb3b820 service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:47:14.112638 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d12830-b1fa-468a-91eb-fc2acbc25a7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:47:14.113246 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d12830-b1fa-468a-91eb-fc2acbc25a7f service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:14.113557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d12830-b1fa-468a-91eb-fc2acbc25a7f service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:14.113831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d12830-b1fa-468a-91eb-fc2acbc25a7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:14.115682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-98d12830-b1fa-468a-91eb-fc2acbc25a7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:47:14.131171 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d12830-b1fa-468a-91eb-fc2acbc25a7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:47:14.133058 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d12830-b1fa-468a-91eb-fc2acbc25a7f service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:47:14.147334 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4410/8813] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:47:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:47:16.247079 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d12a9-78a9-4356-9cdf-a90793729bff service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:47:16.248472 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8e2d12a9-78a9-4356-9cdf-a90793729bff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:47:16.267256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d12a9-78a9-4356-9cdf-a90793729bff service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:47:16.273384 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d1578-a930-482d-9286-9ab5d5ec5f61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:47:16.274005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d1578-a930-482d-9286-9ab5d5ec5f61 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:16.274284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d1578-a930-482d-9286-9ab5d5ec5f61 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:16.274556 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d1578-a930-482d-9286-9ab5d5ec5f61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:16.282698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d1578-a930-482d-9286-9ab5d5ec5f61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:47:16.284310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d1578-a930-482d-9286-9ab5d5ec5f61 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:47:16.293801 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4404/8814] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:47:16 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:47:16.311344 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ea27d-bb63-417c-89e7-dcaa36e5c560 None None] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:16.311832 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ea27d-bb63-417c-89e7-dcaa36e5c560 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:16.311926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ea27d-bb63-417c-89e7-dcaa36e5c560 None None] PATH_INFO: `/` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:16.313352 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4411/8815] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:47:16.317904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d1578-a930-482d-9286-9ab5d5ec5f61 service nova] Authenticating service token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:47:16.332149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d1578-a930-482d-9286-9ab5d5ec5f61 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:47:16.340945 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d1578-a930-482d-9286-9ab5d5ec5f61 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:47:16.345547 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db4a71-4b12-456c-8a1c-9d1ac41fdb90 tempest-ServersAdminNegativeTestJSON-37194022 tempest-ServersAdminNegativeTestJSON-37194022-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4525c3bab79d4545951b5236288f993f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e13fd544ad4a69acb3443ca9b7c153', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:47:16.346168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db4a71-4b12-456c-8a1c-9d1ac41fdb90 tempest-ServersAdminNegativeTestJSON-37194022 tempest-ServersAdminNegativeTestJSON-37194022-project-admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:16.346448 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db4a71-4b12-456c-8a1c-9d1ac41fdb90 tempest-ServersAdminNegativeTestJSON-37194022 tempest-ServersAdminNegativeTestJSON-37194022-project-admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:16.346720 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db4a71-4b12-456c-8a1c-9d1ac41fdb90 tempest-ServersAdminNegativeTestJSON-37194022 tempest-ServersAdminNegativeTestJSON-37194022-project-admin] PATH_INFO: `/v3/projects/36e13fd544ad4a69acb3443ca9b7c153` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:16.347839 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db4a71-4b12-456c-8a1c-9d1ac41fdb90 tempest-ServersAdminNegativeTestJSON-37194022 tempest-ServersAdminNegativeTestJSON-37194022-project-admin] RBAC: Authorizing `identity:get_project(project_id=36e13fd544ad4a69acb3443ca9b7c153)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:47:16.349650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db4a71-4b12-456c-8a1c-9d1ac41fdb90 tempest-ServersAdminNegativeTestJSON-37194022 tempest-ServersAdminNegativeTestJSON-37194022-project-admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:47:16.351263 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4405/8816] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:47:16 2022] GET /identity/v3/projects/36e13fd544ad4a69acb3443ca9b7c153 => generated 389 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:47:16.504960 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ea27d-bb63-417c-89e7-dcaa36e5c560 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:47:16.519641 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ea27d-bb63-417c-89e7-dcaa36e5c560 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:47:16.523839 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be508fbb-b9ff-46b0-b747-755a64176b31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:47:16.524427 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be508fbb-b9ff-46b0-b747-755a64176b31 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:16.524704 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be508fbb-b9ff-46b0-b747-755a64176b31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:16.524975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be508fbb-b9ff-46b0-b747-755a64176b31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:16.526679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-be508fbb-b9ff-46b0-b747-755a64176b31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:47:16.538323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be508fbb-b9ff-46b0-b747-755a64176b31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:47:16.539724 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be508fbb-b9ff-46b0-b747-755a64176b31 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:47:16.549937 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4412/8817] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:47:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:47:16.705083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe556aa-52a6-458c-8e3a-218efc3afbcc None None] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:16.705399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe556aa-52a6-458c-8e3a-218efc3afbcc None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:16.705712 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe556aa-52a6-458c-8e3a-218efc3afbcc None None] PATH_INFO: `/` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:16.707060 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4406/8818] 10.222.0.30 () {54 vars in 912 bytes} [Sun Sep 4 01:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 04 01:47:16.711848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be508fbb-b9ff-46b0-b747-755a64176b31 service neutron] Authenticating service token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 04 01:47:16.727320 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be508fbb-b9ff-46b0-b747-755a64176b31 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:47:16.736621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be508fbb-b9ff-46b0-b747-755a64176b31 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:47:16.741870 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141de016-400a-4347-9ec1-483d277d71f8 tempest-ServersAdminNegativeTestJSON-37194022 tempest-ServersAdminNegativeTestJSON-37194022-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4525c3bab79d4545951b5236288f993f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e13fd544ad4a69acb3443ca9b7c153', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:47:16.742755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141de016-400a-4347-9ec1-483d277d71f8 tempest-ServersAdminNegativeTestJSON-37194022 tempest-ServersAdminNegativeTestJSON-37194022-project-admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:16.743040 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141de016-400a-4347-9ec1-483d277d71f8 tempest-ServersAdminNegativeTestJSON-37194022 tempest-ServersAdminNegativeTestJSON-37194022-project-admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:16.743314 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141de016-400a-4347-9ec1-483d277d71f8 tempest-ServersAdminNegativeTestJSON-37194022 tempest-ServersAdminNegativeTestJSON-37194022-project-admin] PATH_INFO: `/v3/projects/36e13fd544ad4a69acb3443ca9b7c153` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:16.744436 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141de016-400a-4347-9ec1-483d277d71f8 tempest-ServersAdminNegativeTestJSON-37194022 tempest-ServersAdminNegativeTestJSON-37194022-project-admin] RBAC: Authorizing `identity:get_project(project_id=36e13fd544ad4a69acb3443ca9b7c153)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:47:16.746247 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141de016-400a-4347-9ec1-483d277d71f8 tempest-ServersAdminNegativeTestJSON-37194022 tempest-ServersAdminNegativeTestJSON-37194022-project-admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:47:16.747873 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4413/8819] 10.222.0.30 () {58 vars in 1443 bytes} [Sun Sep 4 01:47:16 2022] GET /identity/v3/projects/36e13fd544ad4a69acb3443ca9b7c153 => generated 389 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:47:16.901721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe556aa-52a6-458c-8e3a-218efc3afbcc None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:47:16.903433 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-dbe556aa-52a6-458c-8e3a-218efc3afbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:47:16.919177 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe556aa-52a6-458c-8e3a-218efc3afbcc None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:47:16.922607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce123056-8780-430e-9d48-801cad2d1888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:47:16.923192 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce123056-8780-430e-9d48-801cad2d1888 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:16.923468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce123056-8780-430e-9d48-801cad2d1888 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:16.923736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce123056-8780-430e-9d48-801cad2d1888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:16.925353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ce123056-8780-430e-9d48-801cad2d1888 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:47:16.937470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce123056-8780-430e-9d48-801cad2d1888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:47:16.938882 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce123056-8780-430e-9d48-801cad2d1888 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:47:16.950156 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4407/8820] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:47:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:47:20.714400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141de016-400a-4347-9ec1-483d277d71f8 tempest-ServersAdminNegativeTestJSON-37194022 tempest-ServersAdminNegativeTestJSON-37194022-project-admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:47:20.776545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141de016-400a-4347-9ec1-483d277d71f8 tempest-ServersAdminNegativeTestJSON-37194022 tempest-ServersAdminNegativeTestJSON-37194022-project-admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:47:20.780981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854c3a0-5a98-402f-964f-48990857d687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:47:20.781643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854c3a0-5a98-402f-964f-48990857d687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:20.781925 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854c3a0-5a98-402f-964f-48990857d687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:20.782196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854c3a0-5a98-402f-964f-48990857d687 admin admin] PATH_INFO: `/v3/users/6cff8ee3db254f45af05c8ff0f702d74` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:20.783316 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854c3a0-5a98-402f-964f-48990857d687 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cff8ee3db254f45af05c8ff0f702d74)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:47:20.785245 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854c3a0-5a98-402f-964f-48990857d687 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:47:20.819570 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:47:20.836351 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0854c3a0-5a98-402f-964f-48990857d687 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cff8ee3db254f45af05c8ff0f702d74'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:47:20.837066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0854c3a0-5a98-402f-964f-48990857d687 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cff8ee3db254f45af05c8ff0f702d74'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:47:20.844252 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0854c3a0-5a98-402f-964f-48990857d687 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cff8ee3db254f45af05c8ff0f702d74'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:47:20.853258 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0854c3a0-5a98-402f-964f-48990857d687 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cff8ee3db254f45af05c8ff0f702d74'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:47:20.854066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-0854c3a0-5a98-402f-964f-48990857d687 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cff8ee3db254f45af05c8ff0f702d74'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:47:20.872454 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4414/8821] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:47:20 2022] DELETE /identity/v3/users/6cff8ee3db254f45af05c8ff0f702d74 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:47:20.876929 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdffe21-1777-4e16-ae9b-0f1ce5cfdb25 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:20.877380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdffe21-1777-4e16-ae9b-0f1ce5cfdb25 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:20.877513 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdffe21-1777-4e16-ae9b-0f1ce5cfdb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:20.891034 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:47:20.896434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-dcdffe21-1777-4e16-ae9b-0f1ce5cfdb25 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:47:20.897863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-dcdffe21-1777-4e16-ae9b-0f1ce5cfdb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:47:20.955089 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4408/8822] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:47:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:47:20.964852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854c3a0-5a98-402f-964f-48990857d687 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:47:20.966362 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0854c3a0-5a98-402f-964f-48990857d687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:47:21.025339 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854c3a0-5a98-402f-964f-48990857d687 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:47:21.028910 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139718f8-1d39-4cc5-9818-ee7d29c6e570 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:47:21.029535 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139718f8-1d39-4cc5-9818-ee7d29c6e570 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:21.029814 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139718f8-1d39-4cc5-9818-ee7d29c6e570 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:21.030083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139718f8-1d39-4cc5-9818-ee7d29c6e570 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:21.039558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139718f8-1d39-4cc5-9818-ee7d29c6e570 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:47:21.040996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139718f8-1d39-4cc5-9818-ee7d29c6e570 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:47:21.050589 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4415/8823] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:47:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:47:21.218606 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdffe21-1777-4e16-ae9b-0f1ce5cfdb25 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:47:21.220154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-dcdffe21-1777-4e16-ae9b-0f1ce5cfdb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:47:21.233584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdffe21-1777-4e16-ae9b-0f1ce5cfdb25 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:47:21.238591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3697fd-f64a-4ecc-a45d-15b4e751482f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:47:21.239228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3697fd-f64a-4ecc-a45d-15b4e751482f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:21.239506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3697fd-f64a-4ecc-a45d-15b4e751482f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:21.239778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3697fd-f64a-4ecc-a45d-15b4e751482f admin admin] PATH_INFO: `/v3/projects/6e523b6048144cc38ba018f9a5e501be` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:21.240949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3697fd-f64a-4ecc-a45d-15b4e751482f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e523b6048144cc38ba018f9a5e501be)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:47:21.243291 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3697fd-f64a-4ecc-a45d-15b4e751482f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:47:21.290166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7a3697fd-f64a-4ecc-a45d-15b4e751482f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e523b6048144cc38ba018f9a5e501be', 'request_id': 'req-7a3697fd-f64a-4ecc-a45d-15b4e751482f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:47:21.297242 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7a3697fd-f64a-4ecc-a45d-15b4e751482f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e523b6048144cc38ba018f9a5e501be', 'request_id': 'req-7a3697fd-f64a-4ecc-a45d-15b4e751482f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:47:21.302693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7a3697fd-f64a-4ecc-a45d-15b4e751482f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e523b6048144cc38ba018f9a5e501be', 'request_id': 'req-7a3697fd-f64a-4ecc-a45d-15b4e751482f'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:47:21.313783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7a3697fd-f64a-4ecc-a45d-15b4e751482f admin admin] The token cache is being invalidate because project 6e523b6048144cc38ba018f9a5e501be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:47:21.314066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7a3697fd-f64a-4ecc-a45d-15b4e751482f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:47:21.314694 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-7a3697fd-f64a-4ecc-a45d-15b4e751482f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:47:21.316177 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4409/8824] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:47:21 2022] DELETE /identity/v3/projects/6e523b6048144cc38ba018f9a5e501be => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:47:21.320330 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139718f8-1d39-4cc5-9818-ee7d29c6e570 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:47:21.329962 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139718f8-1d39-4cc5-9818-ee7d29c6e570 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:47:21.390419 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e12501-6239-405e-a36b-365187ccfd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:47:21.391052 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e12501-6239-405e-a36b-365187ccfd7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:21.391327 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e12501-6239-405e-a36b-365187ccfd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:21.391597 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e12501-6239-405e-a36b-365187ccfd7f admin admin] PATH_INFO: `/v3/users/4525c3bab79d4545951b5236288f993f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:21.392717 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e12501-6239-405e-a36b-365187ccfd7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4525c3bab79d4545951b5236288f993f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:47:21.394678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e12501-6239-405e-a36b-365187ccfd7f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:47:21.440772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-13e12501-6239-405e-a36b-365187ccfd7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4525c3bab79d4545951b5236288f993f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:47:21.441487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-13e12501-6239-405e-a36b-365187ccfd7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4525c3bab79d4545951b5236288f993f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:47:21.446914 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:47:21.450970 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-13e12501-6239-405e-a36b-365187ccfd7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4525c3bab79d4545951b5236288f993f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:47:21.459032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-13e12501-6239-405e-a36b-365187ccfd7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4525c3bab79d4545951b5236288f993f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:47:21.460526 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-13e12501-6239-405e-a36b-365187ccfd7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4525c3bab79d4545951b5236288f993f'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:47:21.478382 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4416/8825] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:47:21 2022] DELETE /identity/v3/users/4525c3bab79d4545951b5236288f993f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:47:21.749207 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3697fd-f64a-4ecc-a45d-15b4e751482f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:47:21.750916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7a3697fd-f64a-4ecc-a45d-15b4e751482f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:47:21.769287 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3697fd-f64a-4ecc-a45d-15b4e751482f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:47:21.828524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973418e-0df3-4ebb-8b89-1a4943a9019a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:47:21.829159 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973418e-0df3-4ebb-8b89-1a4943a9019a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:21.829466 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973418e-0df3-4ebb-8b89-1a4943a9019a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:21.829747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973418e-0df3-4ebb-8b89-1a4943a9019a admin admin] PATH_INFO: `/v3/projects/36e13fd544ad4a69acb3443ca9b7c153` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:21.830865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d973418e-0df3-4ebb-8b89-1a4943a9019a admin admin] RBAC: Authorizing `identity:delete_project(project_id=36e13fd544ad4a69acb3443ca9b7c153)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:47:21.832786 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d973418e-0df3-4ebb-8b89-1a4943a9019a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:47:21.868581 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:47:21.883200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d973418e-0df3-4ebb-8b89-1a4943a9019a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36e13fd544ad4a69acb3443ca9b7c153', 'request_id': 'req-d973418e-0df3-4ebb-8b89-1a4943a9019a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:47:21.890330 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d973418e-0df3-4ebb-8b89-1a4943a9019a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36e13fd544ad4a69acb3443ca9b7c153', 'request_id': 'req-d973418e-0df3-4ebb-8b89-1a4943a9019a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:47:21.895757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d973418e-0df3-4ebb-8b89-1a4943a9019a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36e13fd544ad4a69acb3443ca9b7c153', 'request_id': 'req-d973418e-0df3-4ebb-8b89-1a4943a9019a'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:47:21.906908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d973418e-0df3-4ebb-8b89-1a4943a9019a admin admin] The token cache is being invalidate because project 36e13fd544ad4a69acb3443ca9b7c153 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:47:21.907196 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d973418e-0df3-4ebb-8b89-1a4943a9019a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:47:21.907828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d973418e-0df3-4ebb-8b89-1a4943a9019a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:47:21.909337 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4410/8826] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:47:21 2022] DELETE /identity/v3/projects/36e13fd544ad4a69acb3443ca9b7c153 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:47:21.915372 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4f3f2-1c47-4719-a39c-b9c20b14b6ae None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:21.915836 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4f3f2-1c47-4719-a39c-b9c20b14b6ae None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:21.915953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4f3f2-1c47-4719-a39c-b9c20b14b6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:21.935980 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d2d4f3f2-1c47-4719-a39c-b9c20b14b6ae None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:47:21.937195 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d2d4f3f2-1c47-4719-a39c-b9c20b14b6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:47:21.998285 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4417/8827] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:47:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:47:22.007277 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423248f-e068-4875-b564-b843244519a1 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:22.007565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423248f-e068-4875-b564-b843244519a1 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:22.007849 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423248f-e068-4875-b564-b843244519a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:22.027437 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-4423248f-e068-4875-b564-b843244519a1 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:47:22.028867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4423248f-e068-4875-b564-b843244519a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:47:22.038949 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4411/8828] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:47:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:47:22.043338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4f3f2-1c47-4719-a39c-b9c20b14b6ae None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:47:22.054239 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4f3f2-1c47-4719-a39c-b9c20b14b6ae None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:47:22.058805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd81af-bdeb-4aef-b3cd-4b1b13791a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:47:22.059424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd81af-bdeb-4aef-b3cd-4b1b13791a0d admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:22.059706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd81af-bdeb-4aef-b3cd-4b1b13791a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:22.059979 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd81af-bdeb-4aef-b3cd-4b1b13791a0d admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:22.060651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd81af-bdeb-4aef-b3cd-4b1b13791a0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:47:22.060952 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd81af-bdeb-4aef-b3cd-4b1b13791a0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:47:22.062582 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd81af-bdeb-4aef-b3cd-4b1b13791a0d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:47:22.074792 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4418/8829] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:47:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:47:22.079090 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423248f-e068-4875-b564-b843244519a1 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:47:22.088329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423248f-e068-4875-b564-b843244519a1 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:47:22.092983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54529f9a-cc3e-4217-9d13-67a0070a54a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:47:22.093609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54529f9a-cc3e-4217-9d13-67a0070a54a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:22.093892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54529f9a-cc3e-4217-9d13-67a0070a54a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:22.094165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54529f9a-cc3e-4217-9d13-67a0070a54a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:22.094802 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54529f9a-cc3e-4217-9d13-67a0070a54a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:47:22.096707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54529f9a-cc3e-4217-9d13-67a0070a54a2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:47:22.124137 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4412/8830] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:47:22 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:47:22.128147 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd81af-bdeb-4aef-b3cd-4b1b13791a0d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:47:22.139243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd81af-bdeb-4aef-b3cd-4b1b13791a0d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:47:22.193716 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e5860-7349-4a60-b033-fd67eacf6116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:47:22.194963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e5860-7349-4a60-b033-fd67eacf6116 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:22.195243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e5860-7349-4a60-b033-fd67eacf6116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:22.195517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e5860-7349-4a60-b033-fd67eacf6116 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:22.196166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e5860-7349-4a60-b033-fd67eacf6116 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:47:22.198134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e5860-7349-4a60-b033-fd67eacf6116 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:47:22.219270 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4419/8831] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:47:22 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:47:22.223386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54529f9a-cc3e-4217-9d13-67a0070a54a2 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:47:22.233990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54529f9a-cc3e-4217-9d13-67a0070a54a2 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:47:22.238756 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550dc19-0d30-4c1c-9d1a-35f2cc488ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:47:22.239350 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550dc19-0d30-4c1c-9d1a-35f2cc488ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:22.239634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550dc19-0d30-4c1c-9d1a-35f2cc488ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:22.239910 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550dc19-0d30-4c1c-9d1a-35f2cc488ef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:22.240545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4550dc19-0d30-4c1c-9d1a-35f2cc488ef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:47:22.243066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4550dc19-0d30-4c1c-9d1a-35f2cc488ef3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:47:22.252948 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4413/8832] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:47:22.256857 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e5860-7349-4a60-b033-fd67eacf6116 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:47:22.266749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e5860-7349-4a60-b033-fd67eacf6116 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:47:22.271346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c3194-c990-488d-8743-583c07f938fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:47:22.271936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c3194-c990-488d-8743-583c07f938fd admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:22.272251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c3194-c990-488d-8743-583c07f938fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:22.272524 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c3194-c990-488d-8743-583c07f938fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:22.273155 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c3194-c990-488d-8743-583c07f938fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:47:22.274780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c3194-c990-488d-8743-583c07f938fd admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:47:22.285138 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4420/8833] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:47:22.289716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550dc19-0d30-4c1c-9d1a-35f2cc488ef3 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:47:22.299360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550dc19-0d30-4c1c-9d1a-35f2cc488ef3 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:47:22.304598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65688816-0d7b-437e-8527-051a0665db57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:47:22.305228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65688816-0d7b-437e-8527-051a0665db57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:22.305538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65688816-0d7b-437e-8527-051a0665db57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:22.305814 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65688816-0d7b-437e-8527-051a0665db57 admin admin] PATH_INFO: `/v3/projects/5387133484cf4d3da383bbc034f1ef5d/users/92fc89eece224261a5dcfda6a706e3a4/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:22.320263 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65688816-0d7b-437e-8527-051a0665db57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5387133484cf4d3da383bbc034f1ef5d, user_id=92fc89eece224261a5dcfda6a706e3a4, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:47:22.322920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65688816-0d7b-437e-8527-051a0665db57 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:47:22.335819 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4414/8834] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:47:22 2022] PUT /identity/v3/projects/5387133484cf4d3da383bbc034f1ef5d/users/92fc89eece224261a5dcfda6a706e3a4/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:47:22.340854 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17250251-e5d7-4438-8de3-a156d2fb1794 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:22.341167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17250251-e5d7-4438-8de3-a156d2fb1794 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:22.341462 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17250251-e5d7-4438-8de3-a156d2fb1794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:22.360335 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-17250251-e5d7-4438-8de3-a156d2fb1794 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:47:22.361544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-17250251-e5d7-4438-8de3-a156d2fb1794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:47:22.391313 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:47:22.436447 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4421/8835] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:47:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:47:22.446179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65688816-0d7b-437e-8527-051a0665db57 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:47:22.447907 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-65688816-0d7b-437e-8527-051a0665db57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:47:22.510735 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65688816-0d7b-437e-8527-051a0665db57 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:47:22.514405 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d2b5e-9390-40d8-85a9-cc6634168915 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:47:22.515025 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d2b5e-9390-40d8-85a9-cc6634168915 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:22.515307 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d2b5e-9390-40d8-85a9-cc6634168915 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:22.515584 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d2b5e-9390-40d8-85a9-cc6634168915 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:22.524759 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d2b5e-9390-40d8-85a9-cc6634168915 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:47:22.526241 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d2b5e-9390-40d8-85a9-cc6634168915 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:47:22.535674 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4415/8836] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:47:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:47:26.498397 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13372d9-75dc-4e2b-83c0-ccbdad5df7b8 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:26.498810 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13372d9-75dc-4e2b-83c0-ccbdad5df7b8 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:26.499133 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13372d9-75dc-4e2b-83c0-ccbdad5df7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:26.544383 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d13372d9-75dc-4e2b-83c0-ccbdad5df7b8 None None] MFA Rules not processed for user `92fc89eece224261a5dcfda6a706e3a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:47:26.545825 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d13372d9-75dc-4e2b-83c0-ccbdad5df7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:47:26.611576 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4422/8837] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:47:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:47:26.623225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846c552-2b17-418e-91bd-af0d1c2efb51 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:26.623677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846c552-2b17-418e-91bd-af0d1c2efb51 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:26.623929 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846c552-2b17-418e-91bd-af0d1c2efb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:26.643633 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-9846c552-2b17-418e-91bd-af0d1c2efb51 None None] MFA Rules not processed for user `92fc89eece224261a5dcfda6a706e3a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:47:26.644846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9846c552-2b17-418e-91bd-af0d1c2efb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:47:26.670633 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4416/8838] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:47:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:47:26.682850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13372d9-75dc-4e2b-83c0-ccbdad5df7b8 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:47:26.684276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d13372d9-75dc-4e2b-83c0-ccbdad5df7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:47:26.767168 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13372d9-75dc-4e2b-83c0-ccbdad5df7b8 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:47:26.773639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18bab0-a2e6-4eb0-bd54-6879ef8cb2ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:47:26.774260 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18bab0-a2e6-4eb0-bd54-6879ef8cb2ac service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:26.774537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18bab0-a2e6-4eb0-bd54-6879ef8cb2ac service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:26.774807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18bab0-a2e6-4eb0-bd54-6879ef8cb2ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:26.783771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18bab0-a2e6-4eb0-bd54-6879ef8cb2ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:47:26.785518 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18bab0-a2e6-4eb0-bd54-6879ef8cb2ac service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:47:26.797213 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4423/8839] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:47:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:47:36.638084 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=68,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:47:36.791214 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=77 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:47:38.298541 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846c552-2b17-418e-91bd-af0d1c2efb51 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:47:38.311435 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846c552-2b17-418e-91bd-af0d1c2efb51 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:47:38.315041 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1faab00-8dbe-4823-8c67-10f6a9ff2df8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:47:38.315652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1faab00-8dbe-4823-8c67-10f6a9ff2df8 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:38.315935 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1faab00-8dbe-4823-8c67-10f6a9ff2df8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:38.316211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1faab00-8dbe-4823-8c67-10f6a9ff2df8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:38.317971 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b1faab00-8dbe-4823-8c67-10f6a9ff2df8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:47:38.331051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1faab00-8dbe-4823-8c67-10f6a9ff2df8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:47:38.332504 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1faab00-8dbe-4823-8c67-10f6a9ff2df8 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:47:38.344036 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4417/8840] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:47:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:47:38.433961 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18bab0-a2e6-4eb0-bd54-6879ef8cb2ac service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:47:38.435622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7a18bab0-a2e6-4eb0-bd54-6879ef8cb2ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:47:38.512607 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18bab0-a2e6-4eb0-bd54-6879ef8cb2ac service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:47:38.517547 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6ca82-9784-4647-8e8d-e422f6f7ebc4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:47:38.518147 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6ca82-9784-4647-8e8d-e422f6f7ebc4 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:38.518425 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6ca82-9784-4647-8e8d-e422f6f7ebc4 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:38.518698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6ca82-9784-4647-8e8d-e422f6f7ebc4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:38.520424 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-13d6ca82-9784-4647-8e8d-e422f6f7ebc4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:47:38.535628 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6ca82-9784-4647-8e8d-e422f6f7ebc4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:47:38.537273 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6ca82-9784-4647-8e8d-e422f6f7ebc4 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:47:38.549766 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4424/8841] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:47:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:47:38.723972 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1faab00-8dbe-4823-8c67-10f6a9ff2df8 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:47:38.725943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b1faab00-8dbe-4823-8c67-10f6a9ff2df8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:47:38.738809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1faab00-8dbe-4823-8c67-10f6a9ff2df8 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:47:38.743295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316448eb-8bd9-4aa0-9439-3c8ba52e15d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:47:38.743892 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316448eb-8bd9-4aa0-9439-3c8ba52e15d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:47:38.744165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316448eb-8bd9-4aa0-9439-3c8ba52e15d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:47:38.744433 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316448eb-8bd9-4aa0-9439-3c8ba52e15d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:47:38.746085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-316448eb-8bd9-4aa0-9439-3c8ba52e15d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:47:38.761555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316448eb-8bd9-4aa0-9439-3c8ba52e15d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:47:38.763022 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316448eb-8bd9-4aa0-9439-3c8ba52e15d2 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:47:38.776352 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4418/8842] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:47:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:47:48.542943 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=32 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:47:48.769140 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=12 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:48:07.408705 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6ca82-9784-4647-8e8d-e422f6f7ebc4 service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:48:07.420748 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6ca82-9784-4647-8e8d-e422f6f7ebc4 service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:48:07.424337 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e0f48-8423-4e44-9a33-944e87923423 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:48:07.424964 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e0f48-8423-4e44-9a33-944e87923423 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:48:07.425241 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e0f48-8423-4e44-9a33-944e87923423 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:48:07.425565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e0f48-8423-4e44-9a33-944e87923423 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:48:07.427277 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b69e0f48-8423-4e44-9a33-944e87923423 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:48:07.439868 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e0f48-8423-4e44-9a33-944e87923423 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:48:07.441299 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e0f48-8423-4e44-9a33-944e87923423 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:48:07.452841 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4425/8843] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:48:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:48:07.973186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316448eb-8bd9-4aa0-9439-3c8ba52e15d2 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:48:07.987921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316448eb-8bd9-4aa0-9439-3c8ba52e15d2 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:48:07.993753 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd30fc-b589-47db-8b2d-e5235de99cfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:48:07.994619 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd30fc-b589-47db-8b2d-e5235de99cfb service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:48:07.994900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd30fc-b589-47db-8b2d-e5235de99cfb service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:48:07.995172 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd30fc-b589-47db-8b2d-e5235de99cfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:48:07.996923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1ccd30fc-b589-47db-8b2d-e5235de99cfb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:48:08.013825 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd30fc-b589-47db-8b2d-e5235de99cfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:48:08.015467 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd30fc-b589-47db-8b2d-e5235de99cfb service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:48:08.029897 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4419/8844] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:48:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:48:17.445913 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:48:18.023960 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=6 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:48:18.697022 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e0f48-8423-4e44-9a33-944e87923423 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:48:18.723509 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e0f48-8423-4e44-9a33-944e87923423 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:48:18.739159 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b35cb-e84a-4b60-aa12-9f97b8dd9533 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:48:18.739803 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b35cb-e84a-4b60-aa12-9f97b8dd9533 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:48:18.740082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b35cb-e84a-4b60-aa12-9f97b8dd9533 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:48:18.740755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b35cb-e84a-4b60-aa12-9f97b8dd9533 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:48:18.743740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-191b35cb-e84a-4b60-aa12-9f97b8dd9533 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:48:18.759282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b35cb-e84a-4b60-aa12-9f97b8dd9533 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:48:18.761899 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b35cb-e84a-4b60-aa12-9f97b8dd9533 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:48:18.769907 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd30fc-b589-47db-8b2d-e5235de99cfb service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:48:18.776144 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4426/8845] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:48:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:48:18.782018 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd30fc-b589-47db-8b2d-e5235de99cfb service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:48:18.787708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb90982-bfa7-4d28-ade3-c8d6558a915d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:48:18.787708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb90982-bfa7-4d28-ade3-c8d6558a915d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:48:18.788080 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb90982-bfa7-4d28-ade3-c8d6558a915d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:48:18.788446 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb90982-bfa7-4d28-ade3-c8d6558a915d admin admin] PATH_INFO: `/v3/users/92fc89eece224261a5dcfda6a706e3a4` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:48:18.789709 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb90982-bfa7-4d28-ade3-c8d6558a915d admin admin] RBAC: Authorizing `identity:delete_user(user_id=92fc89eece224261a5dcfda6a706e3a4)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:48:18.791628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb90982-bfa7-4d28-ade3-c8d6558a915d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:48:18.847005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bfb90982-bfa7-4d28-ade3-c8d6558a915d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92fc89eece224261a5dcfda6a706e3a4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:48:18.847656 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bfb90982-bfa7-4d28-ade3-c8d6558a915d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92fc89eece224261a5dcfda6a706e3a4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:48:18.854411 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bfb90982-bfa7-4d28-ade3-c8d6558a915d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92fc89eece224261a5dcfda6a706e3a4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:48:18.861647 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bfb90982-bfa7-4d28-ade3-c8d6558a915d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92fc89eece224261a5dcfda6a706e3a4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:48:18.862265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-bfb90982-bfa7-4d28-ade3-c8d6558a915d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92fc89eece224261a5dcfda6a706e3a4'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:48:18.882348 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4420/8846] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:48:18 2022] DELETE /identity/v3/users/92fc89eece224261a5dcfda6a706e3a4 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:48:19.061537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b35cb-e84a-4b60-aa12-9f97b8dd9533 service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:48:19.075550 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b35cb-e84a-4b60-aa12-9f97b8dd9533 service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:48:19.134810 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1313bd-3717-4bdd-a770-a1729e8d7800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:48:19.135438 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1313bd-3717-4bdd-a770-a1729e8d7800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:48:19.135718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1313bd-3717-4bdd-a770-a1729e8d7800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:48:19.136012 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1313bd-3717-4bdd-a770-a1729e8d7800 admin admin] PATH_INFO: `/v3/projects/5387133484cf4d3da383bbc034f1ef5d` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:48:19.137782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1313bd-3717-4bdd-a770-a1729e8d7800 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5387133484cf4d3da383bbc034f1ef5d)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:48:19.139686 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1313bd-3717-4bdd-a770-a1729e8d7800 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:48:19.185406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7f1313bd-3717-4bdd-a770-a1729e8d7800 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5387133484cf4d3da383bbc034f1ef5d', 'request_id': 'req-7f1313bd-3717-4bdd-a770-a1729e8d7800'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:48:19.191855 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7f1313bd-3717-4bdd-a770-a1729e8d7800 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5387133484cf4d3da383bbc034f1ef5d', 'request_id': 'req-7f1313bd-3717-4bdd-a770-a1729e8d7800'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:48:19.197799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7f1313bd-3717-4bdd-a770-a1729e8d7800 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5387133484cf4d3da383bbc034f1ef5d', 'request_id': 'req-7f1313bd-3717-4bdd-a770-a1729e8d7800'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:48:19.209554 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7f1313bd-3717-4bdd-a770-a1729e8d7800 admin admin] The token cache is being invalidate because project 5387133484cf4d3da383bbc034f1ef5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:48:19.209842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7f1313bd-3717-4bdd-a770-a1729e8d7800 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:48:19.210538 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-7f1313bd-3717-4bdd-a770-a1729e8d7800 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:48:19.211958 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4427/8847] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:48:19 2022] DELETE /identity/v3/projects/5387133484cf4d3da383bbc034f1ef5d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:48:19.216983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe33ee6-9275-4bf5-88f6-271f9a5ac97b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:48:19.217529 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe33ee6-9275-4bf5-88f6-271f9a5ac97b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:48:19.217622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe33ee6-9275-4bf5-88f6-271f9a5ac97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:48:19.236675 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-0fe33ee6-9275-4bf5-88f6-271f9a5ac97b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:48:19.237898 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0fe33ee6-9275-4bf5-88f6-271f9a5ac97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:48:19.296178 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4421/8848] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:48:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:48:19.304103 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ccaf2-5778-44b1-b4c4-503c0eae770d None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:48:19.304455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ccaf2-5778-44b1-b4c4-503c0eae770d None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:48:19.304742 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ccaf2-5778-44b1-b4c4-503c0eae770d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:48:19.325379 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b12ccaf2-5778-44b1-b4c4-503c0eae770d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:48:19.326613 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b12ccaf2-5778-44b1-b4c4-503c0eae770d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:48:19.334633 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4428/8849] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:48:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:48:19.338888 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe33ee6-9275-4bf5-88f6-271f9a5ac97b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:48:19.348680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe33ee6-9275-4bf5-88f6-271f9a5ac97b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:48:19.353262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea05828-f5df-4016-adb3-cbeb7979cf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:48:19.353898 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea05828-f5df-4016-adb3-cbeb7979cf91 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:48:19.354180 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea05828-f5df-4016-adb3-cbeb7979cf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:48:19.354449 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea05828-f5df-4016-adb3-cbeb7979cf91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:48:19.355138 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea05828-f5df-4016-adb3-cbeb7979cf91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:48:19.355441 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea05828-f5df-4016-adb3-cbeb7979cf91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:48:19.357028 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea05828-f5df-4016-adb3-cbeb7979cf91 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:48:19.368318 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4422/8850] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:48:19.373273 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ccaf2-5778-44b1-b4c4-503c0eae770d None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:48:19.382609 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ccaf2-5778-44b1-b4c4-503c0eae770d None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:48:19.387930 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d0774-5715-4584-8adb-917d9c554888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:48:19.388527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d0774-5715-4584-8adb-917d9c554888 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:48:19.388812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d0774-5715-4584-8adb-917d9c554888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:48:19.389086 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d0774-5715-4584-8adb-917d9c554888 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:48:19.389753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d0774-5715-4584-8adb-917d9c554888 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:48:19.391652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d0774-5715-4584-8adb-917d9c554888 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:48:19.420972 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4429/8851] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:48:19 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:48:19.425127 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea05828-f5df-4016-adb3-cbeb7979cf91 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:48:19.435687 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea05828-f5df-4016-adb3-cbeb7979cf91 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:48:19.491469 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11146b20-b49e-409c-b812-4e39687aa30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:48:19.492090 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11146b20-b49e-409c-b812-4e39687aa30d admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:48:19.492415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11146b20-b49e-409c-b812-4e39687aa30d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:48:19.492652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11146b20-b49e-409c-b812-4e39687aa30d admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:48:19.493310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11146b20-b49e-409c-b812-4e39687aa30d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:48:19.496284 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11146b20-b49e-409c-b812-4e39687aa30d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:48:19.504175 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:48:19.520362 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4423/8852] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:48:19 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:48:19.524507 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d0774-5715-4584-8adb-917d9c554888 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:48:19.534758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d0774-5715-4584-8adb-917d9c554888 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:48:19.539284 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afc535-4de8-4e25-94c3-cf948e79bf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:48:19.539877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afc535-4de8-4e25-94c3-cf948e79bf55 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:48:19.540183 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afc535-4de8-4e25-94c3-cf948e79bf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:48:19.540453 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afc535-4de8-4e25-94c3-cf948e79bf55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:48:19.541081 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13afc535-4de8-4e25-94c3-cf948e79bf55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:48:19.543197 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13afc535-4de8-4e25-94c3-cf948e79bf55 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:48:19.552881 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4430/8853] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:48:19.556522 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11146b20-b49e-409c-b812-4e39687aa30d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:48:19.566804 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11146b20-b49e-409c-b812-4e39687aa30d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:48:19.571383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e2f0c-89d1-4c78-ba5c-77b581b295f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:48:19.571970 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e2f0c-89d1-4c78-ba5c-77b581b295f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:48:19.572251 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e2f0c-89d1-4c78-ba5c-77b581b295f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:48:19.572526 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e2f0c-89d1-4c78-ba5c-77b581b295f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:48:19.573155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e2f0c-89d1-4c78-ba5c-77b581b295f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:48:19.574775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e2f0c-89d1-4c78-ba5c-77b581b295f1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:48:19.585183 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4424/8854] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:48:19.589032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afc535-4de8-4e25-94c3-cf948e79bf55 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:48:19.598975 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afc535-4de8-4e25-94c3-cf948e79bf55 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:48:19.603615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031b665-b0c3-4e27-a71a-e59f61c7b7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:48:19.604248 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031b665-b0c3-4e27-a71a-e59f61c7b7ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:48:19.604528 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031b665-b0c3-4e27-a71a-e59f61c7b7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:48:19.605294 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031b665-b0c3-4e27-a71a-e59f61c7b7ad admin admin] PATH_INFO: `/v3/projects/d09bf62b75a243a3a05c952f84ce96dc/users/cb6e4d8f9cab498090e58efefad0725d/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:48:19.620953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031b665-b0c3-4e27-a71a-e59f61c7b7ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=d09bf62b75a243a3a05c952f84ce96dc, user_id=cb6e4d8f9cab498090e58efefad0725d, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:48:19.623641 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031b665-b0c3-4e27-a71a-e59f61c7b7ad admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:48:19.636150 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4431/8855] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:48:19 2022] PUT /identity/v3/projects/d09bf62b75a243a3a05c952f84ce96dc/users/cb6e4d8f9cab498090e58efefad0725d/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:48:19.641109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d9981-a574-4da7-b673-4dc090862f50 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:48:19.641423 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d9981-a574-4da7-b673-4dc090862f50 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:48:19.641729 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d9981-a574-4da7-b673-4dc090862f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:48:19.660259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-676d9981-a574-4da7-b673-4dc090862f50 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:48:19.661509 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-676d9981-a574-4da7-b673-4dc090862f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:48:19.719402 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4425/8856] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:48:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:48:19.728963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031b665-b0c3-4e27-a71a-e59f61c7b7ad admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:48:19.731318 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8031b665-b0c3-4e27-a71a-e59f61c7b7ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:48:19.746437 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:48:19.792071 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031b665-b0c3-4e27-a71a-e59f61c7b7ad admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:48:19.796273 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c93081-c17c-4cf9-bf37-202520310454 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:48:19.796875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c93081-c17c-4cf9-bf37-202520310454 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:48:19.797155 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c93081-c17c-4cf9-bf37-202520310454 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:48:19.797428 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c93081-c17c-4cf9-bf37-202520310454 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:48:19.806344 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c93081-c17c-4cf9-bf37-202520310454 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:48:19.807764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c93081-c17c-4cf9-bf37-202520310454 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:48:19.817635 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4432/8857] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:48:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:48:23.583227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700039cf-784c-4414-99fd-72bd46610a05 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:48:23.583751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700039cf-784c-4414-99fd-72bd46610a05 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:48:23.583950 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700039cf-784c-4414-99fd-72bd46610a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:48:23.635794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-700039cf-784c-4414-99fd-72bd46610a05 None None] MFA Rules not processed for user `cb6e4d8f9cab498090e58efefad0725d`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:48:23.637678 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-700039cf-784c-4414-99fd-72bd46610a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:48:23.721493 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4426/8858] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:48:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:48:23.732367 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b1f38-a65a-41d9-a44f-5b0545645ffb None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:48:23.732912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b1f38-a65a-41d9-a44f-5b0545645ffb None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:48:23.732912 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b1f38-a65a-41d9-a44f-5b0545645ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:48:23.753024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-5f7b1f38-a65a-41d9-a44f-5b0545645ffb None None] MFA Rules not processed for user `cb6e4d8f9cab498090e58efefad0725d`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:48:23.754258 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5f7b1f38-a65a-41d9-a44f-5b0545645ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:48:23.762224 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4433/8859] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:48:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:48:23.778377 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700039cf-784c-4414-99fd-72bd46610a05 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:48:23.779805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-700039cf-784c-4414-99fd-72bd46610a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:48:23.840552 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:48:23.883588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700039cf-784c-4414-99fd-72bd46610a05 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:48:23.889964 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa42453-5226-4c45-8cd0-c43c5162916a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:48:23.890588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa42453-5226-4c45-8cd0-c43c5162916a service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:48:23.890867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa42453-5226-4c45-8cd0-c43c5162916a service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:48:23.891140 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa42453-5226-4c45-8cd0-c43c5162916a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:48:23.899914 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa42453-5226-4c45-8cd0-c43c5162916a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:48:23.901826 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa42453-5226-4c45-8cd0-c43c5162916a service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:48:23.911594 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4427/8860] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:48:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:48:33.747849 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=23 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:48:33.907088 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=18 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:48:49.631891 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b1f38-a65a-41d9-a44f-5b0545645ffb None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:48:49.633290 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5f7b1f38-a65a-41d9-a44f-5b0545645ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:48:49.730468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b1f38-a65a-41d9-a44f-5b0545645ffb None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:48:49.735482 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371bcfda-cc71-4a9a-8b8f-9136e52477fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:48:49.736083 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bcfda-cc71-4a9a-8b8f-9136e52477fd service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:48:49.736360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bcfda-cc71-4a9a-8b8f-9136e52477fd service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:48:49.736631 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bcfda-cc71-4a9a-8b8f-9136e52477fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:48:49.738328 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-371bcfda-cc71-4a9a-8b8f-9136e52477fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:48:49.752350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371bcfda-cc71-4a9a-8b8f-9136e52477fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:48:49.753940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371bcfda-cc71-4a9a-8b8f-9136e52477fd service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:48:49.766588 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4434/8861] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:48:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:48:59.759329 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=44 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:49:15.057576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36c49d-d779-43ad-8371-5df692310428 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:49:15.058119 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36c49d-d779-43ad-8371-5df692310428 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:49:15.058119 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36c49d-d779-43ad-8371-5df692310428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:49:15.077067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-1d36c49d-d779-43ad-8371-5df692310428 None None] MFA Rules not processed for user `cb6e4d8f9cab498090e58efefad0725d`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:49:15.078293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1d36c49d-d779-43ad-8371-5df692310428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:49:15.085077 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4428/8862] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:49:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:49:15.637607 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb378b-7be5-45b1-b88a-b76dcb180d56 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:49:15.638574 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb378b-7be5-45b1-b88a-b76dcb180d56 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:49:15.638936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb378b-7be5-45b1-b88a-b76dcb180d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:49:15.698930 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-0deb378b-7be5-45b1-b88a-b76dcb180d56 None None] MFA Rules not processed for user `f908fda75ef8440cb6a0ef9440127d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:49:15.700169 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0deb378b-7be5-45b1-b88a-b76dcb180d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:49:15.709129 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4435/8863] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Sep 4 01:49:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:49:15.720898 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36c49d-d779-43ad-8371-5df692310428 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:49:15.735241 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36c49d-d779-43ad-8371-5df692310428 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:49:15.740163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3dc154-94d7-414b-9c68-3d9a3c511166 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:49:15.740758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3dc154-94d7-414b-9c68-3d9a3c511166 service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:49:15.741034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3dc154-94d7-414b-9c68-3d9a3c511166 service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:49:15.741304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3dc154-94d7-414b-9c68-3d9a3c511166 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:49:15.750402 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3dc154-94d7-414b-9c68-3d9a3c511166 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:49:15.752110 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3dc154-94d7-414b-9c68-3d9a3c511166 service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:49:15.764292 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4429/8864] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:49:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:49:25.696464 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=17 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:49:25.757988 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=9 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:49:27.889944 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e765c-8599-4bd8-90ca-e890aecd45f4 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:49:27.890792 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e765c-8599-4bd8-90ca-e890aecd45f4 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:49:27.891079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e765c-8599-4bd8-90ca-e890aecd45f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:49:27.912200 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-6f4e765c-8599-4bd8-90ca-e890aecd45f4 None None] MFA Rules not processed for user `f908fda75ef8440cb6a0ef9440127d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:49:27.913420 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6f4e765c-8599-4bd8-90ca-e890aecd45f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:49:27.922714 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4436/8865] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Sep 4 01:49:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:49:27.935106 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3dc154-94d7-414b-9c68-3d9a3c511166 service placement] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:49:27.947908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3dc154-94d7-414b-9c68-3d9a3c511166 service placement] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:49:27.957036 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a2acf-f8cf-4325-ad5e-e95ed3fdc21d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:49:27.957690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a2acf-f8cf-4325-ad5e-e95ed3fdc21d service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:49:27.957965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a2acf-f8cf-4325-ad5e-e95ed3fdc21d service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:49:27.958265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a2acf-f8cf-4325-ad5e-e95ed3fdc21d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:49:27.966973 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a2acf-f8cf-4325-ad5e-e95ed3fdc21d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:49:27.968554 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a2acf-f8cf-4325-ad5e-e95ed3fdc21d service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:49:27.978607 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4430/8866] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:49:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:49:28.277368 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84086c1-a54c-4260-8c82-a47b093bfc35 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:49:28.277679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84086c1-a54c-4260-8c82-a47b093bfc35 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:49:28.277955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84086c1-a54c-4260-8c82-a47b093bfc35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:49:28.297641 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c84086c1-a54c-4260-8c82-a47b093bfc35 None None] MFA Rules not processed for user `f908fda75ef8440cb6a0ef9440127d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:49:28.298836 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c84086c1-a54c-4260-8c82-a47b093bfc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:49:28.307255 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4437/8867] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Sep 4 01:49:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:49:28.319064 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a2acf-f8cf-4325-ad5e-e95ed3fdc21d service placement] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:49:28.332347 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a2acf-f8cf-4325-ad5e-e95ed3fdc21d service placement] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:49:28.337364 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6202756-7c84-40fb-8030-436529b36eb0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:49:28.337991 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6202756-7c84-40fb-8030-436529b36eb0 service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:49:28.338272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6202756-7c84-40fb-8030-436529b36eb0 service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:49:28.338542 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6202756-7c84-40fb-8030-436529b36eb0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:49:28.346559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6202756-7c84-40fb-8030-436529b36eb0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:49:28.348129 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6202756-7c84-40fb-8030-436529b36eb0 service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:49:28.358044 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4431/8868] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:49:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:49:38.292482 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:49:38.353553 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=12 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:49:47.282234 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84086c1-a54c-4260-8c82-a47b093bfc35 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:49:47.295963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84086c1-a54c-4260-8c82-a47b093bfc35 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:49:47.300943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7595f3-4e01-42f2-8dbd-2ecf21c60d2b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:49:47.301575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7595f3-4e01-42f2-8dbd-2ecf21c60d2b service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:49:47.301852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7595f3-4e01-42f2-8dbd-2ecf21c60d2b service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:49:47.302119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7595f3-4e01-42f2-8dbd-2ecf21c60d2b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:49:47.303850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-fe7595f3-4e01-42f2-8dbd-2ecf21c60d2b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:49:47.317862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7595f3-4e01-42f2-8dbd-2ecf21c60d2b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:49:47.319433 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7595f3-4e01-42f2-8dbd-2ecf21c60d2b service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:49:47.331613 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4438/8869] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:49:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:49:57.325672 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:50:10.423141 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6202756-7c84-40fb-8030-436529b36eb0 service placement] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:50:10.435222 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6202756-7c84-40fb-8030-436529b36eb0 service placement] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:50:10.447651 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e1688-4581-4582-a8e5-11a19207289e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:50:10.453307 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e1688-4581-4582-a8e5-11a19207289e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:50:10.453721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e1688-4581-4582-a8e5-11a19207289e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:50:10.453976 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e1688-4581-4582-a8e5-11a19207289e admin admin] PATH_INFO: `/v3/users/cb6e4d8f9cab498090e58efefad0725d` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:50:10.455371 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e1688-4581-4582-a8e5-11a19207289e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb6e4d8f9cab498090e58efefad0725d)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:50:10.457519 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e1688-4581-4582-a8e5-11a19207289e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:50:10.520029 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d65e1688-4581-4582-a8e5-11a19207289e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb6e4d8f9cab498090e58efefad0725d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:50:10.520911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d65e1688-4581-4582-a8e5-11a19207289e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb6e4d8f9cab498090e58efefad0725d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:50:10.528824 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d65e1688-4581-4582-a8e5-11a19207289e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb6e4d8f9cab498090e58efefad0725d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:50:10.536771 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d65e1688-4581-4582-a8e5-11a19207289e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb6e4d8f9cab498090e58efefad0725d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:50:10.537583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-d65e1688-4581-4582-a8e5-11a19207289e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb6e4d8f9cab498090e58efefad0725d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:50:10.555194 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4432/8870] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:50:10 2022] DELETE /identity/v3/users/cb6e4d8f9cab498090e58efefad0725d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:50:10.742236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7595f3-4e01-42f2-8dbd-2ecf21c60d2b service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:50:10.755682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7595f3-4e01-42f2-8dbd-2ecf21c60d2b service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:50:10.828648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdefee-ebdc-4341-a5ff-6d3b0d86b410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:50:10.829406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdefee-ebdc-4341-a5ff-6d3b0d86b410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:50:10.829722 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdefee-ebdc-4341-a5ff-6d3b0d86b410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:50:10.830002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdefee-ebdc-4341-a5ff-6d3b0d86b410 admin admin] PATH_INFO: `/v3/projects/d09bf62b75a243a3a05c952f84ce96dc` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:50:10.831142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcdefee-ebdc-4341-a5ff-6d3b0d86b410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d09bf62b75a243a3a05c952f84ce96dc)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:50:10.833070 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcdefee-ebdc-4341-a5ff-6d3b0d86b410 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:50:10.881822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-efcdefee-ebdc-4341-a5ff-6d3b0d86b410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd09bf62b75a243a3a05c952f84ce96dc', 'request_id': 'req-efcdefee-ebdc-4341-a5ff-6d3b0d86b410'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:50:10.889811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-efcdefee-ebdc-4341-a5ff-6d3b0d86b410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd09bf62b75a243a3a05c952f84ce96dc', 'request_id': 'req-efcdefee-ebdc-4341-a5ff-6d3b0d86b410'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:50:10.895647 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-efcdefee-ebdc-4341-a5ff-6d3b0d86b410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd09bf62b75a243a3a05c952f84ce96dc', 'request_id': 'req-efcdefee-ebdc-4341-a5ff-6d3b0d86b410'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:50:10.919923 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-efcdefee-ebdc-4341-a5ff-6d3b0d86b410 admin admin] The token cache is being invalidate because project d09bf62b75a243a3a05c952f84ce96dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:50:10.920298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-efcdefee-ebdc-4341-a5ff-6d3b0d86b410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:50:10.920932 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-efcdefee-ebdc-4341-a5ff-6d3b0d86b410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:50:10.922704 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4439/8871] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:50:10 2022] DELETE /identity/v3/projects/d09bf62b75a243a3a05c952f84ce96dc => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:50:10.927501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a75b6-f92d-4a45-a225-6e99a5ec1848 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:50:10.927791 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a75b6-f92d-4a45-a225-6e99a5ec1848 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:50:10.928119 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a75b6-f92d-4a45-a225-6e99a5ec1848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:50:10.988887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-da3a75b6-f92d-4a45-a225-6e99a5ec1848 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:50:10.990505 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-da3a75b6-f92d-4a45-a225-6e99a5ec1848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:50:11.052216 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4433/8872] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:50:11.061869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11cdaa-84ee-4026-b306-c95adc37c5fb None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:50:11.062152 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11cdaa-84ee-4026-b306-c95adc37c5fb None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:50:11.062430 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11cdaa-84ee-4026-b306-c95adc37c5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:50:11.082977 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-ea11cdaa-84ee-4026-b306-c95adc37c5fb None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:50:11.084129 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ea11cdaa-84ee-4026-b306-c95adc37c5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:50:11.094062 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4440/8873] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:50:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:50:11.098397 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a75b6-f92d-4a45-a225-6e99a5ec1848 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:50:11.109589 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a75b6-f92d-4a45-a225-6e99a5ec1848 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:50:11.114681 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ee6ee-f72e-4f82-85d3-cccf3b503f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:50:11.115312 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ee6ee-f72e-4f82-85d3-cccf3b503f94 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:50:11.115622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ee6ee-f72e-4f82-85d3-cccf3b503f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:50:11.115854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ee6ee-f72e-4f82-85d3-cccf3b503f94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:50:11.116515 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ee6ee-f72e-4f82-85d3-cccf3b503f94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:50:11.116813 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ee6ee-f72e-4f82-85d3-cccf3b503f94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:50:11.118530 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ee6ee-f72e-4f82-85d3-cccf3b503f94 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:50:11.133486 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4434/8874] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:50:11.137915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11cdaa-84ee-4026-b306-c95adc37c5fb None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:50:11.149208 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11cdaa-84ee-4026-b306-c95adc37c5fb None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:50:11.154936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76b751-1582-4955-bfb3-13a77cdb41ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:50:11.155807 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76b751-1582-4955-bfb3-13a77cdb41ec admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:50:11.156262 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76b751-1582-4955-bfb3-13a77cdb41ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:50:11.156694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76b751-1582-4955-bfb3-13a77cdb41ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:50:11.157558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef76b751-1582-4955-bfb3-13a77cdb41ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:50:11.159918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef76b751-1582-4955-bfb3-13a77cdb41ec admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:50:11.194101 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4441/8875] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:50:11 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:50:11.196164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ee6ee-f72e-4f82-85d3-cccf3b503f94 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:50:11.206695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ee6ee-f72e-4f82-85d3-cccf3b503f94 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:50:11.241753 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:50:11.267867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173399bf-876e-4642-8706-23b8ff9cbf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:50:11.268478 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173399bf-876e-4642-8706-23b8ff9cbf10 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:50:11.268760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173399bf-876e-4642-8706-23b8ff9cbf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:50:11.269034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173399bf-876e-4642-8706-23b8ff9cbf10 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:50:11.269703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173399bf-876e-4642-8706-23b8ff9cbf10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:50:11.271631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173399bf-876e-4642-8706-23b8ff9cbf10 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:50:11.292857 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4435/8876] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:50:11 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:50:11.297653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76b751-1582-4955-bfb3-13a77cdb41ec admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:50:11.308157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76b751-1582-4955-bfb3-13a77cdb41ec admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:50:11.312799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4049cc2-e592-4d77-bbae-d55ce7d2304c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:50:11.313410 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4049cc2-e592-4d77-bbae-d55ce7d2304c admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:50:11.313726 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4049cc2-e592-4d77-bbae-d55ce7d2304c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:50:11.314000 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4049cc2-e592-4d77-bbae-d55ce7d2304c admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:50:11.314640 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4049cc2-e592-4d77-bbae-d55ce7d2304c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:50:11.316813 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4049cc2-e592-4d77-bbae-d55ce7d2304c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:50:11.326151 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4442/8877] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:50:11.330069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173399bf-876e-4642-8706-23b8ff9cbf10 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:50:11.339865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173399bf-876e-4642-8706-23b8ff9cbf10 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:50:11.344951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052b2ad-7c95-4cf4-93ef-f15762a2f5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:50:11.345572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052b2ad-7c95-4cf4-93ef-f15762a2f5ec admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:50:11.345852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052b2ad-7c95-4cf4-93ef-f15762a2f5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:50:11.346122 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052b2ad-7c95-4cf4-93ef-f15762a2f5ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:50:11.346748 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a052b2ad-7c95-4cf4-93ef-f15762a2f5ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:50:11.348342 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a052b2ad-7c95-4cf4-93ef-f15762a2f5ec admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:50:11.358738 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4436/8878] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:50:11.362642 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4049cc2-e592-4d77-bbae-d55ce7d2304c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:50:11.372441 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4049cc2-e592-4d77-bbae-d55ce7d2304c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:50:11.377285 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714dcb3-778b-4f71-8aa5-ccbfa5cafd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:50:11.377969 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714dcb3-778b-4f71-8aa5-ccbfa5cafd5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:50:11.378249 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714dcb3-778b-4f71-8aa5-ccbfa5cafd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:50:11.378525 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714dcb3-778b-4f71-8aa5-ccbfa5cafd5b admin admin] PATH_INFO: `/v3/projects/ad0f5004e53a4e95a18adafc7a5779a8/users/303c7fab2ecf4f3082d279b0ebd215be/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:50:11.392764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714dcb3-778b-4f71-8aa5-ccbfa5cafd5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad0f5004e53a4e95a18adafc7a5779a8, user_id=303c7fab2ecf4f3082d279b0ebd215be, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:50:11.395484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714dcb3-778b-4f71-8aa5-ccbfa5cafd5b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:50:11.408856 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4443/8879] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:50:11 2022] PUT /identity/v3/projects/ad0f5004e53a4e95a18adafc7a5779a8/users/303c7fab2ecf4f3082d279b0ebd215be/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:50:11.413895 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3bc13-e27b-4aed-b43b-93f400b7a928 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:50:11.414180 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3bc13-e27b-4aed-b43b-93f400b7a928 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:50:11.414456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3bc13-e27b-4aed-b43b-93f400b7a928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:50:11.433781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-d9b3bc13-e27b-4aed-b43b-93f400b7a928 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:50:11.435006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d9b3bc13-e27b-4aed-b43b-93f400b7a928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:50:11.494014 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4437/8880] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:50:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:50:11.503533 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e872ff5-200c-4517-ae28-15436ad69f26 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:50:11.503817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e872ff5-200c-4517-ae28-15436ad69f26 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:50:11.504095 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e872ff5-200c-4517-ae28-15436ad69f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:50:11.517821 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:50:11.561024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-6e872ff5-200c-4517-ae28-15436ad69f26 None None] MFA Rules not processed for user `2cdde7a212954a01a2591ad5ac30d049`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:50:11.562278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6e872ff5-200c-4517-ae28-15436ad69f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:50:11.613554 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4444/8881] 10.222.0.30 () {58 vars in 1062 bytes} [Sun Sep 4 01:50:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:50:11.619600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3bc13-e27b-4aed-b43b-93f400b7a928 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:50:11.629597 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3bc13-e27b-4aed-b43b-93f400b7a928 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:50:11.633195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3e6a5-7490-48b5-9de7-92cc4b813858 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:50:11.633823 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3e6a5-7490-48b5-9de7-92cc4b813858 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:50:11.634131 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3e6a5-7490-48b5-9de7-92cc4b813858 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:50:11.634406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3e6a5-7490-48b5-9de7-92cc4b813858 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:50:11.643879 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3e6a5-7490-48b5-9de7-92cc4b813858 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:50:11.645312 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3e6a5-7490-48b5-9de7-92cc4b813858 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:50:11.655261 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4438/8882] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:50:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:50:15.705809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b76faf-d15c-4a94-9b65-1132e04faa54 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:50:15.706799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b76faf-d15c-4a94-9b65-1132e04faa54 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:50:15.706901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b76faf-d15c-4a94-9b65-1132e04faa54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:50:15.754476 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b1b76faf-d15c-4a94-9b65-1132e04faa54 None None] MFA Rules not processed for user `303c7fab2ecf4f3082d279b0ebd215be`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:50:15.754476 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b1b76faf-d15c-4a94-9b65-1132e04faa54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:50:15.853074 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4445/8883] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:50:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:50:15.867499 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3e6a5-7490-48b5-9de7-92cc4b813858 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:50:15.868943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-62d3e6a5-7490-48b5-9de7-92cc4b813858 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:50:15.954069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3e6a5-7490-48b5-9de7-92cc4b813858 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:50:15.959606 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab06c6-8aaf-4276-a15c-c4305610e6a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:50:15.960439 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab06c6-8aaf-4276-a15c-c4305610e6a1 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:50:15.960728 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab06c6-8aaf-4276-a15c-c4305610e6a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:50:15.961003 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab06c6-8aaf-4276-a15c-c4305610e6a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:50:15.970032 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab06c6-8aaf-4276-a15c-c4305610e6a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:50:15.971699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab06c6-8aaf-4276-a15c-c4305610e6a1 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:50:15.981569 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4439/8884] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:50:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:50:17.318193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa84ec-406b-4c18-93cd-095d17a09bfb None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:50:17.318695 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa84ec-406b-4c18-93cd-095d17a09bfb None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:50:17.318802 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa84ec-406b-4c18-93cd-095d17a09bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:50:17.338227 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-9baa84ec-406b-4c18-93cd-095d17a09bfb None None] MFA Rules not processed for user `303c7fab2ecf4f3082d279b0ebd215be`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:50:17.339356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9baa84ec-406b-4c18-93cd-095d17a09bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:50:17.346856 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4446/8885] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:50:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:50:25.977052 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:50:27.333354 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=66 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:51:08.089928 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab06c6-8aaf-4276-a15c-c4305610e6a1 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:51:08.099679 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab06c6-8aaf-4276-a15c-c4305610e6a1 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:51:08.103254 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1df7da-7251-449d-8672-2764f9cb2951 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:51:08.103902 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1df7da-7251-449d-8672-2764f9cb2951 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:51:08.104191 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1df7da-7251-449d-8672-2764f9cb2951 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:51:08.104461 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1df7da-7251-449d-8672-2764f9cb2951 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:51:08.106195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0c1df7da-7251-449d-8672-2764f9cb2951 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:51:08.141366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1df7da-7251-449d-8672-2764f9cb2951 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:51:08.142850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1df7da-7251-449d-8672-2764f9cb2951 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:51:08.156766 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4440/8886] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:51:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:51:09.337709 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1855da5-c82d-4870-8f48-5ad42c75e34e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:51:09.338246 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1855da5-c82d-4870-8f48-5ad42c75e34e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:51:09.338342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1855da5-c82d-4870-8f48-5ad42c75e34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:51:09.359923 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-c1855da5-c82d-4870-8f48-5ad42c75e34e None None] MFA Rules not processed for user `2cdde7a212954a01a2591ad5ac30d049`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:51:09.361121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c1855da5-c82d-4870-8f48-5ad42c75e34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:51:09.367482 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4447/8887] 10.222.0.30 () {58 vars in 1062 bytes} [Sun Sep 4 01:51:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:51:09.373353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1df7da-7251-449d-8672-2764f9cb2951 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:51:09.382128 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1df7da-7251-449d-8672-2764f9cb2951 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:51:09.385699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787eaf39-cc9a-4843-b52d-037ba46a7a5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:51:09.386300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787eaf39-cc9a-4843-b52d-037ba46a7a5b service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:51:09.386580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787eaf39-cc9a-4843-b52d-037ba46a7a5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:51:09.386854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787eaf39-cc9a-4843-b52d-037ba46a7a5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:51:09.388545 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-787eaf39-cc9a-4843-b52d-037ba46a7a5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:51:09.405283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787eaf39-cc9a-4843-b52d-037ba46a7a5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:51:09.406725 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787eaf39-cc9a-4843-b52d-037ba46a7a5b service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:51:09.420248 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4441/8888] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:51:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:51:19.353371 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:51:19.412646 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=20 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:51:30.465355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae43a12-4de5-4a19-9439-b93eb6281979 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:51:30.465827 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae43a12-4de5-4a19-9439-b93eb6281979 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:51:30.465915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae43a12-4de5-4a19-9439-b93eb6281979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:51:30.486226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-7ae43a12-4de5-4a19-9439-b93eb6281979 None None] MFA Rules not processed for user `303c7fab2ecf4f3082d279b0ebd215be`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:51:30.487432 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7ae43a12-4de5-4a19-9439-b93eb6281979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:51:30.494309 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4448/8889] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:51:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:51:40.481270 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:51:40.990283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787eaf39-cc9a-4843-b52d-037ba46a7a5b service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:51:41.005164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787eaf39-cc9a-4843-b52d-037ba46a7a5b service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:51:41.010987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e7579-541c-4f44-96dd-6c6d9968aeee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:51:41.011591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e7579-541c-4f44-96dd-6c6d9968aeee service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:51:41.011872 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e7579-541c-4f44-96dd-6c6d9968aeee service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:51:41.012145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e7579-541c-4f44-96dd-6c6d9968aeee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:51:41.014395 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-744e7579-541c-4f44-96dd-6c6d9968aeee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:51:41.030283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e7579-541c-4f44-96dd-6c6d9968aeee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:51:41.031869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e7579-541c-4f44-96dd-6c6d9968aeee service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:51:41.045104 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4442/8890] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:51:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:51:51.037932 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=6 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:52:36.637799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae43a12-4de5-4a19-9439-b93eb6281979 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:52:36.648240 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae43a12-4de5-4a19-9439-b93eb6281979 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:52:36.651823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565860e-5172-4a3e-b48a-f795568186c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:52:36.652438 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565860e-5172-4a3e-b48a-f795568186c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:52:36.652718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565860e-5172-4a3e-b48a-f795568186c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:52:36.652994 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565860e-5172-4a3e-b48a-f795568186c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:52:36.654721 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d565860e-5172-4a3e-b48a-f795568186c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:52:36.666664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565860e-5172-4a3e-b48a-f795568186c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:52:36.668114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565860e-5172-4a3e-b48a-f795568186c1 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:52:36.678523 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4449/8891] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:52:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:52:43.747707 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e7579-541c-4f44-96dd-6c6d9968aeee service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:52:43.749114 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-744e7579-541c-4f44-96dd-6c6d9968aeee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:52:43.767187 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e7579-541c-4f44-96dd-6c6d9968aeee service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:52:43.772781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37b882-1f60-4feb-ac10-9b8d41d15463 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:52:43.773384 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37b882-1f60-4feb-ac10-9b8d41d15463 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:52:43.773694 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37b882-1f60-4feb-ac10-9b8d41d15463 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:52:43.773962 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37b882-1f60-4feb-ac10-9b8d41d15463 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:52:43.775663 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4a37b882-1f60-4feb-ac10-9b8d41d15463 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:52:43.791242 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a37b882-1f60-4feb-ac10-9b8d41d15463 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:52:43.792824 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a37b882-1f60-4feb-ac10-9b8d41d15463 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:52:43.806162 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4443/8892] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:52:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:52:46.672531 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:52:49.394055 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2358c7-aa61-4808-933d-7210ffff5839 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:52:49.394607 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2358c7-aa61-4808-933d-7210ffff5839 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:52:49.394607 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2358c7-aa61-4808-933d-7210ffff5839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:52:49.413041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-cf2358c7-aa61-4808-933d-7210ffff5839 None None] MFA Rules not processed for user `303c7fab2ecf4f3082d279b0ebd215be`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:52:49.414270 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-cf2358c7-aa61-4808-933d-7210ffff5839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:52:49.421112 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4450/8893] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:52:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:52:49.742297 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37b882-1f60-4feb-ac10-9b8d41d15463 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:52:49.751386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37b882-1f60-4feb-ac10-9b8d41d15463 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:52:49.755171 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0161992-b353-40cc-802c-f0e9c25d1eab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:52:49.755764 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0161992-b353-40cc-802c-f0e9c25d1eab service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:52:49.756044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0161992-b353-40cc-802c-f0e9c25d1eab service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:52:49.756425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0161992-b353-40cc-802c-f0e9c25d1eab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:52:49.758173 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c0161992-b353-40cc-802c-f0e9c25d1eab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:52:49.770888 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0161992-b353-40cc-802c-f0e9c25d1eab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:52:49.772305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0161992-b353-40cc-802c-f0e9c25d1eab service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:52:49.783147 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4444/8894] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:52:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:52:59.408326 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:52:59.776643 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=12 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:53:54.636655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2358c7-aa61-4808-933d-7210ffff5839 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:53:54.638170 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-cf2358c7-aa61-4808-933d-7210ffff5839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:53:54.707713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2358c7-aa61-4808-933d-7210ffff5839 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:53:54.712645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9133b-8e0a-422e-96e9-e6c8c6b95fa7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:53:54.713242 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9133b-8e0a-422e-96e9-e6c8c6b95fa7 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:53:54.713545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9133b-8e0a-422e-96e9-e6c8c6b95fa7 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:53:54.713817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9133b-8e0a-422e-96e9-e6c8c6b95fa7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:53:54.715488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7ab9133b-8e0a-422e-96e9-e6c8c6b95fa7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:53:54.729378 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9133b-8e0a-422e-96e9-e6c8c6b95fa7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:53:54.730952 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9133b-8e0a-422e-96e9-e6c8c6b95fa7 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:53:54.743608 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4451/8895] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:53:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:54:04.736453 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=32 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:54:13.038295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0161992-b353-40cc-802c-f0e9c25d1eab service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:54:13.056054 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0161992-b353-40cc-802c-f0e9c25d1eab service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:54:13.059806 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72eff4-db42-4665-9f9c-45f1b8706a4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:54:13.060421 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72eff4-db42-4665-9f9c-45f1b8706a4d service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:54:13.060727 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72eff4-db42-4665-9f9c-45f1b8706a4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:54:13.061068 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72eff4-db42-4665-9f9c-45f1b8706a4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:54:13.062763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1e72eff4-db42-4665-9f9c-45f1b8706a4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:54:13.077900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72eff4-db42-4665-9f9c-45f1b8706a4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:54:13.079493 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72eff4-db42-4665-9f9c-45f1b8706a4d service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:54:13.090480 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4445/8896] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:54:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:54:13.332887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9133b-8e0a-422e-96e9-e6c8c6b95fa7 service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:54:13.342201 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9133b-8e0a-422e-96e9-e6c8c6b95fa7 service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:54:13.346516 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01713979-8a0a-4634-aa2d-c13706f511a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:54:13.347110 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01713979-8a0a-4634-aa2d-c13706f511a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:54:13.347438 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01713979-8a0a-4634-aa2d-c13706f511a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:54:13.347824 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01713979-8a0a-4634-aa2d-c13706f511a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:54:13.349604 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-01713979-8a0a-4634-aa2d-c13706f511a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:54:13.367362 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01713979-8a0a-4634-aa2d-c13706f511a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:54:13.368865 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01713979-8a0a-4634-aa2d-c13706f511a5 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:54:13.383030 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4452/8897] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:54:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:54:23.084112 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=6 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:54:23.375089 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:54:26.992751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72eff4-db42-4665-9f9c-45f1b8706a4d service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:54:27.001107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72eff4-db42-4665-9f9c-45f1b8706a4d service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:54:27.005020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c29b69-a8dd-43a3-9350-8df1eb4cce1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:54:27.005641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c29b69-a8dd-43a3-9350-8df1eb4cce1c service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:54:27.005921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c29b69-a8dd-43a3-9350-8df1eb4cce1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:54:27.006188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c29b69-a8dd-43a3-9350-8df1eb4cce1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:54:27.007884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-26c29b69-a8dd-43a3-9350-8df1eb4cce1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:54:27.019621 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c29b69-a8dd-43a3-9350-8df1eb4cce1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:54:27.021034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c29b69-a8dd-43a3-9350-8df1eb4cce1c service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:54:27.031260 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4446/8898] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:54:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:54:27.434585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01713979-8a0a-4634-aa2d-c13706f511a5 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:54:27.449135 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01713979-8a0a-4634-aa2d-c13706f511a5 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:54:27.456181 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb739a-69ab-4281-89c8-e772cbb200ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:54:27.456801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb739a-69ab-4281-89c8-e772cbb200ba service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:54:27.457075 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb739a-69ab-4281-89c8-e772cbb200ba service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:54:27.457345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb739a-69ab-4281-89c8-e772cbb200ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:54:27.459121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ccdb739a-69ab-4281-89c8-e772cbb200ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:54:27.474889 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdb739a-69ab-4281-89c8-e772cbb200ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:54:27.476472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdb739a-69ab-4281-89c8-e772cbb200ba service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:54:27.489827 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4453/8899] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:54:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:54:37.025254 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=6 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:54:37.482596 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:54:42.445049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9585a-1b3a-49af-bde6-da2047909179 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:54:42.445560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9585a-1b3a-49af-bde6-da2047909179 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:54:42.445651 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9585a-1b3a-49af-bde6-da2047909179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:54:42.467514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a5c9585a-1b3a-49af-bde6-da2047909179 None None] MFA Rules not processed for user `303c7fab2ecf4f3082d279b0ebd215be`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:54:42.468777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a5c9585a-1b3a-49af-bde6-da2047909179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:54:42.475957 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4447/8900] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:54:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:54:42.799890 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb739a-69ab-4281-89c8-e772cbb200ba service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:54:42.818553 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb739a-69ab-4281-89c8-e772cbb200ba service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:54:42.822119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6113b97-4ef6-461a-be10-7faea558f4b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:54:42.822718 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6113b97-4ef6-461a-be10-7faea558f4b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:54:42.822995 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6113b97-4ef6-461a-be10-7faea558f4b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:54:42.823264 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6113b97-4ef6-461a-be10-7faea558f4b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:54:42.824950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-a6113b97-4ef6-461a-be10-7faea558f4b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:54:42.837216 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6113b97-4ef6-461a-be10-7faea558f4b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:54:42.838656 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6113b97-4ef6-461a-be10-7faea558f4b8 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:54:42.849499 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4454/8901] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:54:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:54:43.187437 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9585a-1b3a-49af-bde6-da2047909179 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:54:43.212761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9585a-1b3a-49af-bde6-da2047909179 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:54:43.217777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33102bcf-220e-4d42-af0b-6419e117f6d1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:54:43.218383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33102bcf-220e-4d42-af0b-6419e117f6d1 service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:54:43.218780 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33102bcf-220e-4d42-af0b-6419e117f6d1 service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:54:43.219061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33102bcf-220e-4d42-af0b-6419e117f6d1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:54:43.221325 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-33102bcf-220e-4d42-af0b-6419e117f6d1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:54:43.233052 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33102bcf-220e-4d42-af0b-6419e117f6d1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:54:43.234783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33102bcf-220e-4d42-af0b-6419e117f6d1 service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:54:43.245084 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4448/8902] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:54:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:54:51.197586 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6113b97-4ef6-461a-be10-7faea558f4b8 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:54:51.212074 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6113b97-4ef6-461a-be10-7faea558f4b8 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:54:51.217053 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26974829-b656-4fa6-8466-ab240820257d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:54:51.217677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26974829-b656-4fa6-8466-ab240820257d service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:54:51.217958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26974829-b656-4fa6-8466-ab240820257d service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:54:51.218228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26974829-b656-4fa6-8466-ab240820257d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:54:51.220146 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-26974829-b656-4fa6-8466-ab240820257d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:54:51.233840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26974829-b656-4fa6-8466-ab240820257d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:54:51.235989 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26974829-b656-4fa6-8466-ab240820257d service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:54:51.248191 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4455/8903] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:54:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:54:53.240836 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=13 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:55:01.241655 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=16 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:55:28.579168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a626ca5-3d25-49c1-9f33-f258336fa1b8 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:55:28.579622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a626ca5-3d25-49c1-9f33-f258336fa1b8 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:55:28.579721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a626ca5-3d25-49c1-9f33-f258336fa1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:55:28.629792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-3a626ca5-3d25-49c1-9f33-f258336fa1b8 None None] MFA Rules not processed for user `9108334da66445c2a0ba438c19850357`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:55:28.631238 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3a626ca5-3d25-49c1-9f33-f258336fa1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:55:28.689512 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4449/8904] 10.222.0.30 () {58 vars in 1061 bytes} [Sun Sep 4 01:55:28 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:55:28.695966 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26974829-b656-4fa6-8466-ab240820257d service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:55:28.704906 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26974829-b656-4fa6-8466-ab240820257d service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:55:28.708392 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c0d93-5180-4b06-9dd7-95d827723a75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:55:28.708979 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c0d93-5180-4b06-9dd7-95d827723a75 service cinder] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:55:28.709253 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c0d93-5180-4b06-9dd7-95d827723a75 service cinder] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:55:28.709558 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c0d93-5180-4b06-9dd7-95d827723a75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:55:28.717728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c0d93-5180-4b06-9dd7-95d827723a75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:55:28.720112 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c0d93-5180-4b06-9dd7-95d827723a75 service cinder] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:55:28.728661 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4456/8905] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:55:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:55:38.686743 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=38 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:55:38.724830 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:55:41.697073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a626ca5-3d25-49c1-9f33-f258336fa1b8 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:55:41.699091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3a626ca5-3d25-49c1-9f33-f258336fa1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:55:41.717004 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a626ca5-3d25-49c1-9f33-f258336fa1b8 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:55:41.722108 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab00fe-32a8-43b7-b693-1931cfb4dc6c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:55:41.722718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab00fe-32a8-43b7-b693-1931cfb4dc6c service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:55:41.723001 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab00fe-32a8-43b7-b693-1931cfb4dc6c service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:55:41.723279 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab00fe-32a8-43b7-b693-1931cfb4dc6c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:55:41.725211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4eab00fe-32a8-43b7-b693-1931cfb4dc6c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:55:41.737928 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab00fe-32a8-43b7-b693-1931cfb4dc6c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:55:41.739550 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab00fe-32a8-43b7-b693-1931cfb4dc6c service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:55:41.749787 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4450/8906] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:55:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:55:41.981991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c0d93-5180-4b06-9dd7-95d827723a75 service cinder] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:55:41.996758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c0d93-5180-4b06-9dd7-95d827723a75 service cinder] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:55:42.001738 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a9890-8617-474e-99e4-da9150362973 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:55:42.002388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a9890-8617-474e-99e4-da9150362973 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:55:42.002667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a9890-8617-474e-99e4-da9150362973 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:55:42.002941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a9890-8617-474e-99e4-da9150362973 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:55:42.004649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-057a9890-8617-474e-99e4-da9150362973 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:55:42.016319 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a9890-8617-474e-99e4-da9150362973 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:55:42.017985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a9890-8617-474e-99e4-da9150362973 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:55:42.027656 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4457/8907] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:55:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:55:51.745529 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=6 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:55:52.023674 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:55:56.829841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de516c4a-9460-4c6f-8b70-1d1a8aac0efd None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:55:56.830445 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de516c4a-9460-4c6f-8b70-1d1a8aac0efd None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:55:56.830445 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de516c4a-9460-4c6f-8b70-1d1a8aac0efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:55:56.851570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-de516c4a-9460-4c6f-8b70-1d1a8aac0efd None None] MFA Rules not processed for user `f908fda75ef8440cb6a0ef9440127d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:55:56.852693 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-de516c4a-9460-4c6f-8b70-1d1a8aac0efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:55:56.862040 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4451/8908] 10.222.0.39 () {58 vars in 1015 bytes} [Sun Sep 4 01:55:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:55:56.874698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a9890-8617-474e-99e4-da9150362973 service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:55:56.889551 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a9890-8617-474e-99e4-da9150362973 service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:55:56.894591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df393d29-eb49-44e8-8672-b5e4a47cfcc7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:55:56.895200 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df393d29-eb49-44e8-8672-b5e4a47cfcc7 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:55:56.895556 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df393d29-eb49-44e8-8672-b5e4a47cfcc7 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:55:56.895820 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df393d29-eb49-44e8-8672-b5e4a47cfcc7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:55:56.904515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df393d29-eb49-44e8-8672-b5e4a47cfcc7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:55:56.906167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df393d29-eb49-44e8-8672-b5e4a47cfcc7 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:55:56.916154 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4458/8909] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:55:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:56:03.782778 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffcf54-df19-48b0-b865-824149a115af None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:56:03.783926 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffcf54-df19-48b0-b865-824149a115af None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:56:03.783926 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffcf54-df19-48b0-b865-824149a115af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:56:03.802877 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ceffcf54-df19-48b0-b865-824149a115af None None] MFA Rules not processed for user `f908fda75ef8440cb6a0ef9440127d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:56:03.804054 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ceffcf54-df19-48b0-b865-824149a115af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:56:03.812420 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4452/8910] 10.222.0.49 () {58 vars in 1015 bytes} [Sun Sep 4 01:56:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:56:03.824573 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df393d29-eb49-44e8-8672-b5e4a47cfcc7 service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:56:03.838076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df393d29-eb49-44e8-8672-b5e4a47cfcc7 service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:56:03.843082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fc3eb-bf8d-45b0-bc28-ae088e637aba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:56:03.843683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fc3eb-bf8d-45b0-bc28-ae088e637aba service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:56:03.843967 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fc3eb-bf8d-45b0-bc28-ae088e637aba service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:56:03.844243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fc3eb-bf8d-45b0-bc28-ae088e637aba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:56:03.853302 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586fc3eb-bf8d-45b0-bc28-ae088e637aba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:56:03.854971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586fc3eb-bf8d-45b0-bc28-ae088e637aba service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:56:03.865022 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4459/8911] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:56:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:56:08.170907 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffcf54-df19-48b0-b865-824149a115af None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:56:08.180068 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffcf54-df19-48b0-b865-824149a115af None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:56:08.183572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fd688-0077-4349-8ebf-d9c7846c3941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:56:08.184157 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fd688-0077-4349-8ebf-d9c7846c3941 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:56:08.184430 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fd688-0077-4349-8ebf-d9c7846c3941 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:56:08.184695 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fd688-0077-4349-8ebf-d9c7846c3941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:56:08.197299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8fd688-0077-4349-8ebf-d9c7846c3941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:56:08.198747 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8fd688-0077-4349-8ebf-d9c7846c3941 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:56:08.222387 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4453/8912] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:56:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:56:09.349756 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fc3eb-bf8d-45b0-bc28-ae088e637aba service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:56:09.358857 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fc3eb-bf8d-45b0-bc28-ae088e637aba service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:56:09.363032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a424a37-deed-4851-93d2-fbcb58865191 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:56:09.363615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a424a37-deed-4851-93d2-fbcb58865191 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:56:09.363892 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a424a37-deed-4851-93d2-fbcb58865191 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:56:09.364162 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a424a37-deed-4851-93d2-fbcb58865191 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:56:09.376606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a424a37-deed-4851-93d2-fbcb58865191 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:56:09.378067 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a424a37-deed-4851-93d2-fbcb58865191 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:56:09.391305 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4460/8913] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:56:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:56:18.219249 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=16 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:56:19.384201 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=18 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:56:45.140949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fd688-0077-4349-8ebf-d9c7846c3941 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:56:45.149627 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fd688-0077-4349-8ebf-d9c7846c3941 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:56:45.153183 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d815c-dd6f-45ea-87d3-e6b49caf318a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:56:45.153813 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d815c-dd6f-45ea-87d3-e6b49caf318a service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:56:45.154094 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d815c-dd6f-45ea-87d3-e6b49caf318a service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:56:45.154365 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d815c-dd6f-45ea-87d3-e6b49caf318a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:56:45.163612 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d815c-dd6f-45ea-87d3-e6b49caf318a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:56:45.164979 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d815c-dd6f-45ea-87d3-e6b49caf318a service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:56:45.184104 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4454/8914] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:56:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:56:48.289429 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a424a37-deed-4851-93d2-fbcb58865191 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:56:48.304659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a424a37-deed-4851-93d2-fbcb58865191 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:56:48.309981 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb61118b-f287-416e-b60f-4022bdab755a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:56:48.310639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61118b-f287-416e-b60f-4022bdab755a service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:56:48.311158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61118b-f287-416e-b60f-4022bdab755a service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:56:48.311505 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61118b-f287-416e-b60f-4022bdab755a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:56:48.313527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bb61118b-f287-416e-b60f-4022bdab755a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:56:48.338729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb61118b-f287-416e-b60f-4022bdab755a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:56:48.342107 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb61118b-f287-416e-b60f-4022bdab755a service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:56:48.354958 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d815c-dd6f-45ea-87d3-e6b49caf318a service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:56:48.367846 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4461/8915] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:56:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:56:48.371133 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d815c-dd6f-45ea-87d3-e6b49caf318a service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:56:48.375905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0cc11-c323-460c-8afe-ad33c1a4fd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:56:48.376536 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0cc11-c323-460c-8afe-ad33c1a4fd95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:56:48.376817 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0cc11-c323-460c-8afe-ad33c1a4fd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:56:48.377094 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0cc11-c323-460c-8afe-ad33c1a4fd95 admin admin] PATH_INFO: `/v3/users/303c7fab2ecf4f3082d279b0ebd215be` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:56:48.378302 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0cc11-c323-460c-8afe-ad33c1a4fd95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=303c7fab2ecf4f3082d279b0ebd215be)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:56:48.380269 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0cc11-c323-460c-8afe-ad33c1a4fd95 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:56:48.427387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-27b0cc11-c323-460c-8afe-ad33c1a4fd95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '303c7fab2ecf4f3082d279b0ebd215be'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:56:48.428043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-27b0cc11-c323-460c-8afe-ad33c1a4fd95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '303c7fab2ecf4f3082d279b0ebd215be'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:56:48.435867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-27b0cc11-c323-460c-8afe-ad33c1a4fd95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '303c7fab2ecf4f3082d279b0ebd215be'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:56:48.441793 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-27b0cc11-c323-460c-8afe-ad33c1a4fd95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '303c7fab2ecf4f3082d279b0ebd215be'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:56:48.442604 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-27b0cc11-c323-460c-8afe-ad33c1a4fd95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '303c7fab2ecf4f3082d279b0ebd215be'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:56:48.460238 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4455/8916] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:56:48 2022] DELETE /identity/v3/users/303c7fab2ecf4f3082d279b0ebd215be => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:56:48.637046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb61118b-f287-416e-b60f-4022bdab755a service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:56:48.649139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb61118b-f287-416e-b60f-4022bdab755a service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:56:48.708006 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29eb4b-ba08-410c-92ed-96d0c453724b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:56:48.708634 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29eb4b-ba08-410c-92ed-96d0c453724b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:56:48.708914 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29eb4b-ba08-410c-92ed-96d0c453724b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:56:48.709184 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29eb4b-ba08-410c-92ed-96d0c453724b admin admin] PATH_INFO: `/v3/projects/ad0f5004e53a4e95a18adafc7a5779a8` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:56:48.710325 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29eb4b-ba08-410c-92ed-96d0c453724b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad0f5004e53a4e95a18adafc7a5779a8)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:56:48.712243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29eb4b-ba08-410c-92ed-96d0c453724b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:56:48.758214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cf29eb4b-ba08-410c-92ed-96d0c453724b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad0f5004e53a4e95a18adafc7a5779a8', 'request_id': 'req-cf29eb4b-ba08-410c-92ed-96d0c453724b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:56:48.765120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cf29eb4b-ba08-410c-92ed-96d0c453724b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad0f5004e53a4e95a18adafc7a5779a8', 'request_id': 'req-cf29eb4b-ba08-410c-92ed-96d0c453724b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:56:48.771288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cf29eb4b-ba08-410c-92ed-96d0c453724b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad0f5004e53a4e95a18adafc7a5779a8', 'request_id': 'req-cf29eb4b-ba08-410c-92ed-96d0c453724b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:56:48.782523 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cf29eb4b-ba08-410c-92ed-96d0c453724b admin admin] The token cache is being invalidate because project ad0f5004e53a4e95a18adafc7a5779a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:56:48.782816 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cf29eb4b-ba08-410c-92ed-96d0c453724b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:56:48.783499 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-cf29eb4b-ba08-410c-92ed-96d0c453724b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:56:48.785512 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4462/8917] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:56:48 2022] DELETE /identity/v3/projects/ad0f5004e53a4e95a18adafc7a5779a8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:56:48.790562 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e5c7d-6c04-4948-955c-61a804ccdb9a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:56:48.790855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e5c7d-6c04-4948-955c-61a804ccdb9a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:56:48.791140 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e5c7d-6c04-4948-955c-61a804ccdb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:56:48.810455 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-c94e5c7d-6c04-4948-955c-61a804ccdb9a None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:56:48.811660 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c94e5c7d-6c04-4948-955c-61a804ccdb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:56:48.869454 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4456/8918] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:56:48.935485 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd8236-a502-43de-b900-0d6b5628fc7f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:56:48.935772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd8236-a502-43de-b900-0d6b5628fc7f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:56:48.936055 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd8236-a502-43de-b900-0d6b5628fc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:56:48.956561 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-66cd8236-a502-43de-b900-0d6b5628fc7f None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:56:48.957799 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-66cd8236-a502-43de-b900-0d6b5628fc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:56:48.965669 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4463/8919] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:56:48.969968 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e5c7d-6c04-4948-955c-61a804ccdb9a None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:56:48.979642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e5c7d-6c04-4948-955c-61a804ccdb9a None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:56:48.984131 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cf252-5601-4555-80b2-e75b89a9033d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:56:48.984724 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cf252-5601-4555-80b2-e75b89a9033d admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:56:48.985001 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cf252-5601-4555-80b2-e75b89a9033d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:56:48.985274 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cf252-5601-4555-80b2-e75b89a9033d admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:56:48.985958 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0cf252-5601-4555-80b2-e75b89a9033d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:56:48.986258 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0cf252-5601-4555-80b2-e75b89a9033d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:56:48.987986 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0cf252-5601-4555-80b2-e75b89a9033d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:56:48.999306 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4457/8920] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:56:49.004011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd8236-a502-43de-b900-0d6b5628fc7f None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:56:49.013696 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd8236-a502-43de-b900-0d6b5628fc7f None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:56:49.018887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72090a69-e7be-462b-9479-f4a7f0f3f5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:56:49.019482 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72090a69-e7be-462b-9479-f4a7f0f3f5d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:56:49.019760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72090a69-e7be-462b-9479-f4a7f0f3f5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:56:49.020030 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72090a69-e7be-462b-9479-f4a7f0f3f5d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:56:49.020664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72090a69-e7be-462b-9479-f4a7f0f3f5d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:56:49.022593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72090a69-e7be-462b-9479-f4a7f0f3f5d2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:56:49.058052 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4464/8921] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:56:49 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:56:49.062181 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cf252-5601-4555-80b2-e75b89a9033d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:56:49.072492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cf252-5601-4555-80b2-e75b89a9033d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:56:49.105256 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:56:49.131360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb034f6c-feb8-4e46-aa61-fed1927e4406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:56:49.131881 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb034f6c-feb8-4e46-aa61-fed1927e4406 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:56:49.132160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb034f6c-feb8-4e46-aa61-fed1927e4406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:56:49.132431 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb034f6c-feb8-4e46-aa61-fed1927e4406 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:56:49.133083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb034f6c-feb8-4e46-aa61-fed1927e4406 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:56:49.135098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb034f6c-feb8-4e46-aa61-fed1927e4406 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:56:49.157542 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4458/8922] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:56:49 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:56:49.161696 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72090a69-e7be-462b-9479-f4a7f0f3f5d2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:56:49.172279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72090a69-e7be-462b-9479-f4a7f0f3f5d2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:56:49.177488 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001fe30-7405-4f63-a2ab-8b5983a4a518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:56:49.178103 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001fe30-7405-4f63-a2ab-8b5983a4a518 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:56:49.178388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001fe30-7405-4f63-a2ab-8b5983a4a518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:56:49.178664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001fe30-7405-4f63-a2ab-8b5983a4a518 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:56:49.179309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001fe30-7405-4f63-a2ab-8b5983a4a518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:56:49.181257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001fe30-7405-4f63-a2ab-8b5983a4a518 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:56:49.194712 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4465/8923] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 01:56:49.196784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb034f6c-feb8-4e46-aa61-fed1927e4406 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:56:49.207620 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb034f6c-feb8-4e46-aa61-fed1927e4406 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:56:49.212372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f711a0-37e8-4fa8-8fe0-c24e3db85c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:56:49.213024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f711a0-37e8-4fa8-8fe0-c24e3db85c3f admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:56:49.213303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f711a0-37e8-4fa8-8fe0-c24e3db85c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:56:49.213601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f711a0-37e8-4fa8-8fe0-c24e3db85c3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:56:49.214236 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f711a0-37e8-4fa8-8fe0-c24e3db85c3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:56:49.215904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f711a0-37e8-4fa8-8fe0-c24e3db85c3f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:56:49.226249 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4459/8924] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:56:49.230455 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001fe30-7405-4f63-a2ab-8b5983a4a518 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:56:49.241307 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001fe30-7405-4f63-a2ab-8b5983a4a518 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:56:49.245861 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b67f7b-8b3d-46d3-9d92-edfdf43754f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:56:49.246706 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b67f7b-8b3d-46d3-9d92-edfdf43754f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:56:49.246985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b67f7b-8b3d-46d3-9d92-edfdf43754f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:56:49.247256 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b67f7b-8b3d-46d3-9d92-edfdf43754f6 admin admin] PATH_INFO: `/v3/projects/8a7b8ead1c1b4333a86ced34ca2884e0/users/4b4a286a277f4fad81f786908f9379d4/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:56:49.265038 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b67f7b-8b3d-46d3-9d92-edfdf43754f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a7b8ead1c1b4333a86ced34ca2884e0, user_id=4b4a286a277f4fad81f786908f9379d4, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:56:49.267865 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b67f7b-8b3d-46d3-9d92-edfdf43754f6 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:56:49.280987 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4466/8925] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:56:49 2022] PUT /identity/v3/projects/8a7b8ead1c1b4333a86ced34ca2884e0/users/4b4a286a277f4fad81f786908f9379d4/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:56:49.286164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c5d7b-0142-43d8-9e78-f6ee1d9c6aa7 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:56:49.286448 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c5d7b-0142-43d8-9e78-f6ee1d9c6aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:56:49.286754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c5d7b-0142-43d8-9e78-f6ee1d9c6aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:56:49.306442 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-804c5d7b-0142-43d8-9e78-f6ee1d9c6aa7 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:56:49.307628 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-804c5d7b-0142-43d8-9e78-f6ee1d9c6aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:56:49.365383 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4460/8926] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:56:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:56:49.375128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b67f7b-8b3d-46d3-9d92-edfdf43754f6 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:56:49.376845 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-06b67f7b-8b3d-46d3-9d92-edfdf43754f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:56:49.384228 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:56:49.435300 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b67f7b-8b3d-46d3-9d92-edfdf43754f6 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:56:49.444529 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f439d-a1f2-4d0f-b2f2-0ac28f0e9f74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:56:49.445533 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f439d-a1f2-4d0f-b2f2-0ac28f0e9f74 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:56:49.445849 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f439d-a1f2-4d0f-b2f2-0ac28f0e9f74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:56:49.446172 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f439d-a1f2-4d0f-b2f2-0ac28f0e9f74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:56:49.456023 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f439d-a1f2-4d0f-b2f2-0ac28f0e9f74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:56:49.457467 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f439d-a1f2-4d0f-b2f2-0ac28f0e9f74 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:56:49.466730 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4467/8927] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:56:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:56:53.540684 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed55179-70c1-4aa1-86bb-c41f29b8ab02 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:56:53.541144 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed55179-70c1-4aa1-86bb-c41f29b8ab02 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:56:53.541259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed55179-70c1-4aa1-86bb-c41f29b8ab02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:56:53.574218 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-0ed55179-70c1-4aa1-86bb-c41f29b8ab02 None None] MFA Rules not processed for user `4b4a286a277f4fad81f786908f9379d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:56:53.575538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0ed55179-70c1-4aa1-86bb-c41f29b8ab02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:56:53.648403 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4461/8928] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:56:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:56:53.660105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c4278-3667-437d-bce3-cdf0fb6c1a76 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:56:53.660606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c4278-3667-437d-bce3-cdf0fb6c1a76 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:56:53.660683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c4278-3667-437d-bce3-cdf0fb6c1a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:56:53.682134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-3b1c4278-3667-437d-bce3-cdf0fb6c1a76 None None] MFA Rules not processed for user `4b4a286a277f4fad81f786908f9379d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:56:53.683459 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3b1c4278-3667-437d-bce3-cdf0fb6c1a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:56:53.690765 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4468/8929] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:56:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:56:53.702622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed55179-70c1-4aa1-86bb-c41f29b8ab02 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:56:53.704722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0ed55179-70c1-4aa1-86bb-c41f29b8ab02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:56:53.757407 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:56:53.786205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed55179-70c1-4aa1-86bb-c41f29b8ab02 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:56:53.791651 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee5fed-c3c4-4089-a8db-e6b18ee5e50a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:56:53.792253 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee5fed-c3c4-4089-a8db-e6b18ee5e50a service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:56:53.792532 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee5fed-c3c4-4089-a8db-e6b18ee5e50a service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:56:53.792801 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee5fed-c3c4-4089-a8db-e6b18ee5e50a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:56:53.800562 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee5fed-c3c4-4089-a8db-e6b18ee5e50a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:56:53.802183 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee5fed-c3c4-4089-a8db-e6b18ee5e50a service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:56:53.810826 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4462/8930] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:56:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:57:03.675616 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=27 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:57:03.806864 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=13 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:57:05.091537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd3824-cd33-48a3-9bf9-95d86b7154a0 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:05.092050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd3824-cd33-48a3-9bf9-95d86b7154a0 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:05.092153 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd3824-cd33-48a3-9bf9-95d86b7154a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:05.111677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-94fd3824-cd33-48a3-9bf9-95d86b7154a0 None None] MFA Rules not processed for user `4b4a286a277f4fad81f786908f9379d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:57:05.112860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-94fd3824-cd33-48a3-9bf9-95d86b7154a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:57:05.119726 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4469/8931] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:57:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:57:15.106801 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:57:26.430490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee5fed-c3c4-4089-a8db-e6b18ee5e50a service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:26.432143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5dee5fed-c3c4-4089-a8db-e6b18ee5e50a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:57:26.507528 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd3824-cd33-48a3-9bf9-95d86b7154a0 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:26.519866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee5fed-c3c4-4089-a8db-e6b18ee5e50a service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:26.520961 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd3824-cd33-48a3-9bf9-95d86b7154a0 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:26.525321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a9881-3edd-4a53-b6e3-443bd185fcb0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:26.525867 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ca240-a686-47e8-8df4-e591cbd59564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:26.526341 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a9881-3edd-4a53-b6e3-443bd185fcb0 service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:26.526501 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ca240-a686-47e8-8df4-e591cbd59564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:26.527034 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ca240-a686-47e8-8df4-e591cbd59564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:26.527385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ca240-a686-47e8-8df4-e591cbd59564 admin admin] PATH_INFO: `/v3/users/4b4a286a277f4fad81f786908f9379d4` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:26.527541 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a9881-3edd-4a53-b6e3-443bd185fcb0 service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:26.527955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a9881-3edd-4a53-b6e3-443bd185fcb0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:26.528652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ca240-a686-47e8-8df4-e591cbd59564 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b4a286a277f4fad81f786908f9379d4)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:26.530211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-252a9881-3edd-4a53-b6e3-443bd185fcb0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:57:26.530844 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ca240-a686-47e8-8df4-e591cbd59564 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:26.554961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a9881-3edd-4a53-b6e3-443bd185fcb0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:26.556593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a9881-3edd-4a53-b6e3-443bd185fcb0 service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:26.570516 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4463/8932] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:57:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:57:26.588939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a85ca240-a686-47e8-8df4-e591cbd59564 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b4a286a277f4fad81f786908f9379d4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:57:26.589629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a85ca240-a686-47e8-8df4-e591cbd59564 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b4a286a277f4fad81f786908f9379d4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:57:26.596651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a85ca240-a686-47e8-8df4-e591cbd59564 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b4a286a277f4fad81f786908f9379d4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:57:26.605143 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a85ca240-a686-47e8-8df4-e591cbd59564 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b4a286a277f4fad81f786908f9379d4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:57:26.605863 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-a85ca240-a686-47e8-8df4-e591cbd59564 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b4a286a277f4fad81f786908f9379d4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:57:26.623436 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4470/8933] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:57:26 2022] DELETE /identity/v3/users/4b4a286a277f4fad81f786908f9379d4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:57:26.793346 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a9881-3edd-4a53-b6e3-443bd185fcb0 service placement] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:26.809518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a9881-3edd-4a53-b6e3-443bd185fcb0 service placement] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:26.870136 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c43613-3892-49a6-a76c-4782ede444d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:26.870769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c43613-3892-49a6-a76c-4782ede444d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:26.871051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c43613-3892-49a6-a76c-4782ede444d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:26.871326 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c43613-3892-49a6-a76c-4782ede444d6 admin admin] PATH_INFO: `/v3/projects/8a7b8ead1c1b4333a86ced34ca2884e0` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:26.872453 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c43613-3892-49a6-a76c-4782ede444d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a7b8ead1c1b4333a86ced34ca2884e0)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:26.874403 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c43613-3892-49a6-a76c-4782ede444d6 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:26.921234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-44c43613-3892-49a6-a76c-4782ede444d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a7b8ead1c1b4333a86ced34ca2884e0', 'request_id': 'req-44c43613-3892-49a6-a76c-4782ede444d6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:57:26.929132 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-44c43613-3892-49a6-a76c-4782ede444d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a7b8ead1c1b4333a86ced34ca2884e0', 'request_id': 'req-44c43613-3892-49a6-a76c-4782ede444d6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:57:26.934552 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-44c43613-3892-49a6-a76c-4782ede444d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a7b8ead1c1b4333a86ced34ca2884e0', 'request_id': 'req-44c43613-3892-49a6-a76c-4782ede444d6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:57:26.945488 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-44c43613-3892-49a6-a76c-4782ede444d6 admin admin] The token cache is being invalidate because project 8a7b8ead1c1b4333a86ced34ca2884e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:57:26.945783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-44c43613-3892-49a6-a76c-4782ede444d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:57:26.946414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-44c43613-3892-49a6-a76c-4782ede444d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:57:26.947896 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4464/8934] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:57:26 2022] DELETE /identity/v3/projects/8a7b8ead1c1b4333a86ced34ca2884e0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:57:26.952936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5fd22-0f0d-44ea-976e-036ef2bd9516 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:26.953224 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5fd22-0f0d-44ea-976e-036ef2bd9516 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:26.953549 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5fd22-0f0d-44ea-976e-036ef2bd9516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:26.974166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-04a5fd22-0f0d-44ea-976e-036ef2bd9516 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:57:26.975361 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-04a5fd22-0f0d-44ea-976e-036ef2bd9516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:57:27.037824 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4471/8935] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:57:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:57:27.045900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c6a78-2450-4ddb-a217-1756ac8b3d9e None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:27.046183 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c6a78-2450-4ddb-a217-1756ac8b3d9e None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:27.046456 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c6a78-2450-4ddb-a217-1756ac8b3d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:27.067056 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-0f6c6a78-2450-4ddb-a217-1756ac8b3d9e None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:57:27.068341 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0f6c6a78-2450-4ddb-a217-1756ac8b3d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:57:27.076172 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4465/8936] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:57:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:57:27.080400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5fd22-0f0d-44ea-976e-036ef2bd9516 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:27.090249 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5fd22-0f0d-44ea-976e-036ef2bd9516 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:27.094783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d47030-9046-41bb-a75a-9cf9c52b5f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:27.095381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d47030-9046-41bb-a75a-9cf9c52b5f3b admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:27.095657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d47030-9046-41bb-a75a-9cf9c52b5f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:27.095945 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d47030-9046-41bb-a75a-9cf9c52b5f3b admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:27.096561 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d47030-9046-41bb-a75a-9cf9c52b5f3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:57:27.096860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d47030-9046-41bb-a75a-9cf9c52b5f3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:27.099007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d47030-9046-41bb-a75a-9cf9c52b5f3b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:27.110669 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4472/8937] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:57:27.115558 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c6a78-2450-4ddb-a217-1756ac8b3d9e None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:27.124750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c6a78-2450-4ddb-a217-1756ac8b3d9e None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:27.129386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b898312-0a1c-48eb-a99f-4005ffc10557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:27.130022 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b898312-0a1c-48eb-a99f-4005ffc10557 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:27.130282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b898312-0a1c-48eb-a99f-4005ffc10557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:27.130550 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b898312-0a1c-48eb-a99f-4005ffc10557 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:27.131170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b898312-0a1c-48eb-a99f-4005ffc10557 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:27.133315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b898312-0a1c-48eb-a99f-4005ffc10557 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:27.144260 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:57:27.163840 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4466/8938] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:57:27 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:57:27.167449 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d47030-9046-41bb-a75a-9cf9c52b5f3b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:27.178453 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d47030-9046-41bb-a75a-9cf9c52b5f3b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:27.236649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9b164-43e1-4f84-a7d1-13f7a09c219f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:27.237271 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9b164-43e1-4f84-a7d1-13f7a09c219f admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:27.237586 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9b164-43e1-4f84-a7d1-13f7a09c219f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:27.237862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9b164-43e1-4f84-a7d1-13f7a09c219f admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:27.238500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9b164-43e1-4f84-a7d1-13f7a09c219f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:27.240963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9b164-43e1-4f84-a7d1-13f7a09c219f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:27.249281 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:57:27.267739 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4473/8939] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:57:27 2022] POST /identity/v3/users => generated 284 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:57:27.271677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b898312-0a1c-48eb-a99f-4005ffc10557 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:27.282726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b898312-0a1c-48eb-a99f-4005ffc10557 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:27.287887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef949477-e3b7-4b13-853f-96279ceefa8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:27.288485 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef949477-e3b7-4b13-853f-96279ceefa8a admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:27.288767 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef949477-e3b7-4b13-853f-96279ceefa8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:27.289067 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef949477-e3b7-4b13-853f-96279ceefa8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:27.289732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef949477-e3b7-4b13-853f-96279ceefa8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:27.291375 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef949477-e3b7-4b13-853f-96279ceefa8a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:27.301215 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4467/8940] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:57:27.305593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9b164-43e1-4f84-a7d1-13f7a09c219f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:27.315610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9b164-43e1-4f84-a7d1-13f7a09c219f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:27.320228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe153e-fca3-49cc-b646-d5ca97933582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:27.320824 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe153e-fca3-49cc-b646-d5ca97933582 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:27.321105 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe153e-fca3-49cc-b646-d5ca97933582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:27.321377 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe153e-fca3-49cc-b646-d5ca97933582 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:27.322047 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe153e-fca3-49cc-b646-d5ca97933582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:27.323638 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe153e-fca3-49cc-b646-d5ca97933582 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:27.334190 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4474/8941] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:57:27.338362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef949477-e3b7-4b13-853f-96279ceefa8a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:27.349124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef949477-e3b7-4b13-853f-96279ceefa8a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:27.353754 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a5f19-e217-4840-8adc-8edb716edd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:27.354390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a5f19-e217-4840-8adc-8edb716edd54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:27.354668 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a5f19-e217-4840-8adc-8edb716edd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:27.354944 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a5f19-e217-4840-8adc-8edb716edd54 admin admin] PATH_INFO: `/v3/projects/bec2a900ecd6447b83439f50b3457341/users/4e0e1e5a38c74234a8c4bac851b93d7a/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:27.369696 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5a5f19-e217-4840-8adc-8edb716edd54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bec2a900ecd6447b83439f50b3457341, user_id=4e0e1e5a38c74234a8c4bac851b93d7a, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:27.372339 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5a5f19-e217-4840-8adc-8edb716edd54 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:27.385304 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4468/8942] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:57:27 2022] PUT /identity/v3/projects/bec2a900ecd6447b83439f50b3457341/users/4e0e1e5a38c74234a8c4bac851b93d7a/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:57:27.396887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c2b0a-6e4d-4adb-9d3c-b91f7a364b5a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:27.397178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c2b0a-6e4d-4adb-9d3c-b91f7a364b5a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:27.397478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c2b0a-6e4d-4adb-9d3c-b91f7a364b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:27.424924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-1e3c2b0a-6e4d-4adb-9d3c-b91f7a364b5a None None] MFA Rules not processed for user `4e0e1e5a38c74234a8c4bac851b93d7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:57:27.426165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1e3c2b0a-6e4d-4adb-9d3c-b91f7a364b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:57:27.489983 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4475/8943] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:57:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:57:27.500140 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a5f19-e217-4840-8adc-8edb716edd54 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:27.502007 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ed5a5f19-e217-4840-8adc-8edb716edd54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:57:27.557963 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a5f19-e217-4840-8adc-8edb716edd54 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:27.561611 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55ee2a-f364-4cc0-94c0-e866ba9b316e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:27.562209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55ee2a-f364-4cc0-94c0-e866ba9b316e service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:27.562483 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55ee2a-f364-4cc0-94c0-e866ba9b316e service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:27.562751 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55ee2a-f364-4cc0-94c0-e866ba9b316e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:27.570820 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55ee2a-f364-4cc0-94c0-e866ba9b316e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:27.572261 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55ee2a-f364-4cc0-94c0-e866ba9b316e service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:27.580916 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4469/8944] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:57:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:57:37.487145 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:57:37.576992 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=44,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:57:39.436900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c2b0a-6e4d-4adb-9d3c-b91f7a364b5a None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:39.509660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c2b0a-6e4d-4adb-9d3c-b91f7a364b5a None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:39.514109 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c70f5d-7839-4ddb-b230-eae064a7ca20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:39.514764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c70f5d-7839-4ddb-b230-eae064a7ca20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:39.515042 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c70f5d-7839-4ddb-b230-eae064a7ca20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:39.515312 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c70f5d-7839-4ddb-b230-eae064a7ca20 admin admin] PATH_INFO: `/v3/users/4e0e1e5a38c74234a8c4bac851b93d7a` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:39.516426 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c70f5d-7839-4ddb-b230-eae064a7ca20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e0e1e5a38c74234a8c4bac851b93d7a)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:39.518393 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c70f5d-7839-4ddb-b230-eae064a7ca20 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:39.564986 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-45c70f5d-7839-4ddb-b230-eae064a7ca20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e0e1e5a38c74234a8c4bac851b93d7a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:57:39.565617 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-45c70f5d-7839-4ddb-b230-eae064a7ca20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e0e1e5a38c74234a8c4bac851b93d7a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:57:39.573049 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-45c70f5d-7839-4ddb-b230-eae064a7ca20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e0e1e5a38c74234a8c4bac851b93d7a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:57:39.580404 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-45c70f5d-7839-4ddb-b230-eae064a7ca20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e0e1e5a38c74234a8c4bac851b93d7a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:57:39.581050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-45c70f5d-7839-4ddb-b230-eae064a7ca20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e0e1e5a38c74234a8c4bac851b93d7a'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:57:39.600052 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4476/8945] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:57:39 2022] DELETE /identity/v3/users/4e0e1e5a38c74234a8c4bac851b93d7a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:57:39.604792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8397516-0e43-412d-bfb4-77156e40874d None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:39.605270 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8397516-0e43-412d-bfb4-77156e40874d None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:39.605365 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8397516-0e43-412d-bfb4-77156e40874d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:39.626072 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a8397516-0e43-412d-bfb4-77156e40874d None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:57:39.627286 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a8397516-0e43-412d-bfb4-77156e40874d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:57:39.686114 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4470/8946] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:57:39.696659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c70f5d-7839-4ddb-b230-eae064a7ca20 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:39.698069 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-45c70f5d-7839-4ddb-b230-eae064a7ca20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:57:39.754010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c70f5d-7839-4ddb-b230-eae064a7ca20 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:39.759687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584fbb5-5e08-4bc7-a13a-09fefca10cb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:39.760303 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584fbb5-5e08-4bc7-a13a-09fefca10cb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:39.760585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584fbb5-5e08-4bc7-a13a-09fefca10cb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:39.760865 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584fbb5-5e08-4bc7-a13a-09fefca10cb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:39.769931 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584fbb5-5e08-4bc7-a13a-09fefca10cb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:39.771365 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584fbb5-5e08-4bc7-a13a-09fefca10cb8 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:39.781147 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4477/8947] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:57:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:57:39.957034 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8397516-0e43-412d-bfb4-77156e40874d None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:39.959201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a8397516-0e43-412d-bfb4-77156e40874d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:57:39.971504 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8397516-0e43-412d-bfb4-77156e40874d None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:39.976567 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab592446-e356-4c74-9b89-ece1e6b6e20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:39.977198 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab592446-e356-4c74-9b89-ece1e6b6e20d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:39.977500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab592446-e356-4c74-9b89-ece1e6b6e20d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:39.977775 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab592446-e356-4c74-9b89-ece1e6b6e20d admin admin] PATH_INFO: `/v3/projects/bec2a900ecd6447b83439f50b3457341` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:39.978920 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab592446-e356-4c74-9b89-ece1e6b6e20d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bec2a900ecd6447b83439f50b3457341)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:39.980825 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab592446-e356-4c74-9b89-ece1e6b6e20d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:40.031406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ab592446-e356-4c74-9b89-ece1e6b6e20d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bec2a900ecd6447b83439f50b3457341', 'request_id': 'req-ab592446-e356-4c74-9b89-ece1e6b6e20d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:57:40.040175 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ab592446-e356-4c74-9b89-ece1e6b6e20d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bec2a900ecd6447b83439f50b3457341', 'request_id': 'req-ab592446-e356-4c74-9b89-ece1e6b6e20d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:57:40.046212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ab592446-e356-4c74-9b89-ece1e6b6e20d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bec2a900ecd6447b83439f50b3457341', 'request_id': 'req-ab592446-e356-4c74-9b89-ece1e6b6e20d'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:57:40.057762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ab592446-e356-4c74-9b89-ece1e6b6e20d admin admin] The token cache is being invalidate because project bec2a900ecd6447b83439f50b3457341 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:57:40.058053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ab592446-e356-4c74-9b89-ece1e6b6e20d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:57:40.058700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-ab592446-e356-4c74-9b89-ece1e6b6e20d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:57:40.060482 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4471/8948] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:57:39 2022] DELETE /identity/v3/projects/bec2a900ecd6447b83439f50b3457341 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:57:40.065472 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c072f-bf67-4e5e-b3f8-a28cde365e68 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:40.065764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c072f-bf67-4e5e-b3f8-a28cde365e68 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:40.066038 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c072f-bf67-4e5e-b3f8-a28cde365e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:40.087408 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d01c072f-bf67-4e5e-b3f8-a28cde365e68 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:57:40.089000 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d01c072f-bf67-4e5e-b3f8-a28cde365e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:57:40.110472 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:57:40.154599 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4478/8949] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:57:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:57:40.162220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00939095-aace-4b97-bc27-4c316f0373c6 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:40.162512 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00939095-aace-4b97-bc27-4c316f0373c6 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:40.162794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00939095-aace-4b97-bc27-4c316f0373c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:40.182727 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-00939095-aace-4b97-bc27-4c316f0373c6 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:57:40.183925 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-00939095-aace-4b97-bc27-4c316f0373c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:57:40.192468 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4472/8950] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:57:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:57:40.196668 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c072f-bf67-4e5e-b3f8-a28cde365e68 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:40.206311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c072f-bf67-4e5e-b3f8-a28cde365e68 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:40.211123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b077cb-4c80-480d-9ac9-fe421659a17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:40.211728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b077cb-4c80-480d-9ac9-fe421659a17e admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:40.212009 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b077cb-4c80-480d-9ac9-fe421659a17e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:40.212281 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b077cb-4c80-480d-9ac9-fe421659a17e admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:40.212924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b077cb-4c80-480d-9ac9-fe421659a17e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:57:40.213225 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b077cb-4c80-480d-9ac9-fe421659a17e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:40.214853 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b077cb-4c80-480d-9ac9-fe421659a17e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:40.226316 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4479/8951] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:57:40.230483 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00939095-aace-4b97-bc27-4c316f0373c6 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:40.240200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00939095-aace-4b97-bc27-4c316f0373c6 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:40.244909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe70688-fbf9-4a97-802b-bc9cc2b0cb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:40.245535 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe70688-fbf9-4a97-802b-bc9cc2b0cb0f admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:40.245822 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe70688-fbf9-4a97-802b-bc9cc2b0cb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:40.246096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe70688-fbf9-4a97-802b-bc9cc2b0cb0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:40.246761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe70688-fbf9-4a97-802b-bc9cc2b0cb0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:40.248670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe70688-fbf9-4a97-802b-bc9cc2b0cb0f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:40.276711 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4473/8952] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:57:40 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:57:40.280872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b077cb-4c80-480d-9ac9-fe421659a17e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:40.290893 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b077cb-4c80-480d-9ac9-fe421659a17e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:40.346362 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a738c-d9dc-41aa-b7f9-181b1e08452e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:40.346968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a738c-d9dc-41aa-b7f9-181b1e08452e admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:40.347251 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a738c-d9dc-41aa-b7f9-181b1e08452e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:40.347550 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a738c-d9dc-41aa-b7f9-181b1e08452e admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:40.348761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a738c-d9dc-41aa-b7f9-181b1e08452e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:40.350715 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a738c-d9dc-41aa-b7f9-181b1e08452e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:40.375002 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4480/8953] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:57:40 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:57:40.377378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe70688-fbf9-4a97-802b-bc9cc2b0cb0f admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:40.387782 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe70688-fbf9-4a97-802b-bc9cc2b0cb0f admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:40.392269 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a011f60-0575-420f-bb24-cd3afff81e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:40.392860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a011f60-0575-420f-bb24-cd3afff81e2e admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:40.393137 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a011f60-0575-420f-bb24-cd3afff81e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:40.393406 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a011f60-0575-420f-bb24-cd3afff81e2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:40.394054 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a011f60-0575-420f-bb24-cd3afff81e2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:40.396138 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a011f60-0575-420f-bb24-cd3afff81e2e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:40.405912 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4474/8954] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:57:40.409627 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a738c-d9dc-41aa-b7f9-181b1e08452e admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:40.420001 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a738c-d9dc-41aa-b7f9-181b1e08452e admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:40.424879 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1220410-70f9-4d9e-be43-3f627b2e0e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:40.425497 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1220410-70f9-4d9e-be43-3f627b2e0e6a admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:40.425783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1220410-70f9-4d9e-be43-3f627b2e0e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:40.426054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1220410-70f9-4d9e-be43-3f627b2e0e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:40.426684 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1220410-70f9-4d9e-be43-3f627b2e0e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:40.428279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1220410-70f9-4d9e-be43-3f627b2e0e6a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:40.438840 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4481/8955] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:57:40.442931 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a011f60-0575-420f-bb24-cd3afff81e2e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:40.453509 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a011f60-0575-420f-bb24-cd3afff81e2e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:40.458863 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535c39e-6005-4abe-b641-1cd04508ab15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:40.459538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535c39e-6005-4abe-b641-1cd04508ab15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:40.459866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535c39e-6005-4abe-b641-1cd04508ab15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:40.460145 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535c39e-6005-4abe-b641-1cd04508ab15 admin admin] PATH_INFO: `/v3/projects/df774dd28a0844b1ada0d0c6c34cf979/users/4a6f5ca8394c4c26bf75058d8a73e047/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:40.480117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535c39e-6005-4abe-b641-1cd04508ab15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df774dd28a0844b1ada0d0c6c34cf979, user_id=4a6f5ca8394c4c26bf75058d8a73e047, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:40.484889 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535c39e-6005-4abe-b641-1cd04508ab15 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:40.500279 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4475/8956] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:57:40 2022] PUT /identity/v3/projects/df774dd28a0844b1ada0d0c6c34cf979/users/4a6f5ca8394c4c26bf75058d8a73e047/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:57:40.512874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28da97e-73de-483b-af58-5e4696e7a540 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:40.513154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28da97e-73de-483b-af58-5e4696e7a540 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:40.513415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28da97e-73de-483b-af58-5e4696e7a540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:40.542268 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b28da97e-73de-483b-af58-5e4696e7a540 None None] MFA Rules not processed for user `4a6f5ca8394c4c26bf75058d8a73e047`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:57:40.543492 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b28da97e-73de-483b-af58-5e4696e7a540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:57:40.607540 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4482/8957] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:57:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:57:40.617722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535c39e-6005-4abe-b641-1cd04508ab15 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:40.619496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1535c39e-6005-4abe-b641-1cd04508ab15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:57:40.641500 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:57:40.677755 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535c39e-6005-4abe-b641-1cd04508ab15 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:40.681324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403ba5f-711b-4d45-83b6-dba948cd7697 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:40.681955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403ba5f-711b-4d45-83b6-dba948cd7697 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:40.682238 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403ba5f-711b-4d45-83b6-dba948cd7697 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:40.682512 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403ba5f-711b-4d45-83b6-dba948cd7697 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:40.690723 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7403ba5f-711b-4d45-83b6-dba948cd7697 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:40.692654 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7403ba5f-711b-4d45-83b6-dba948cd7697 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:40.701298 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4476/8958] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:57:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:57:44.348419 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28da97e-73de-483b-af58-5e4696e7a540 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:44.370319 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:57:44.417618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28da97e-73de-483b-af58-5e4696e7a540 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:44.422182 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e05475-426a-4e2e-869a-9d7ff3554c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:44.422827 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e05475-426a-4e2e-869a-9d7ff3554c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:44.423102 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e05475-426a-4e2e-869a-9d7ff3554c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:44.423376 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e05475-426a-4e2e-869a-9d7ff3554c20 admin admin] PATH_INFO: `/v3/users/4a6f5ca8394c4c26bf75058d8a73e047` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:44.424526 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e05475-426a-4e2e-869a-9d7ff3554c20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a6f5ca8394c4c26bf75058d8a73e047)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:44.426559 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e05475-426a-4e2e-869a-9d7ff3554c20 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:44.478011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c1e05475-426a-4e2e-869a-9d7ff3554c20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a6f5ca8394c4c26bf75058d8a73e047'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:57:44.478661 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c1e05475-426a-4e2e-869a-9d7ff3554c20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a6f5ca8394c4c26bf75058d8a73e047'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:57:44.485680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c1e05475-426a-4e2e-869a-9d7ff3554c20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a6f5ca8394c4c26bf75058d8a73e047'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:57:44.493121 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c1e05475-426a-4e2e-869a-9d7ff3554c20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a6f5ca8394c4c26bf75058d8a73e047'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:57:44.493851 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-c1e05475-426a-4e2e-869a-9d7ff3554c20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a6f5ca8394c4c26bf75058d8a73e047'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:57:44.514310 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4483/8959] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:57:44 2022] DELETE /identity/v3/users/4a6f5ca8394c4c26bf75058d8a73e047 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:57:44.518860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1d0dd-a485-4725-8a2d-ceaf5a7547ce None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:44.519360 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1d0dd-a485-4725-8a2d-ceaf5a7547ce None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:44.519457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1d0dd-a485-4725-8a2d-ceaf5a7547ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:44.539191 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a8b1d0dd-a485-4725-8a2d-ceaf5a7547ce None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:57:44.540310 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a8b1d0dd-a485-4725-8a2d-ceaf5a7547ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:57:44.599762 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4477/8960] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:57:44.609513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e05475-426a-4e2e-869a-9d7ff3554c20 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:44.610941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-c1e05475-426a-4e2e-869a-9d7ff3554c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:57:44.667943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e05475-426a-4e2e-869a-9d7ff3554c20 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:44.671595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a59fb-62f3-4857-8beb-047366a0dfb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:44.672200 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a59fb-62f3-4857-8beb-047366a0dfb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:44.672483 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a59fb-62f3-4857-8beb-047366a0dfb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:44.672749 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a59fb-62f3-4857-8beb-047366a0dfb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:44.682104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a59fb-62f3-4857-8beb-047366a0dfb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:44.683520 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a59fb-62f3-4857-8beb-047366a0dfb9 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:44.693589 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4484/8961] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:57:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:57:44.865664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1d0dd-a485-4725-8a2d-ceaf5a7547ce None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:44.867186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a8b1d0dd-a485-4725-8a2d-ceaf5a7547ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:57:44.880005 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1d0dd-a485-4725-8a2d-ceaf5a7547ce None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:44.886463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7f225-a2cf-4cf1-adfa-281940f47c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:44.886463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7f225-a2cf-4cf1-adfa-281940f47c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:44.886463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7f225-a2cf-4cf1-adfa-281940f47c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:44.886463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7f225-a2cf-4cf1-adfa-281940f47c54 admin admin] PATH_INFO: `/v3/projects/df774dd28a0844b1ada0d0c6c34cf979` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:44.887645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae7f225-a2cf-4cf1-adfa-281940f47c54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df774dd28a0844b1ada0d0c6c34cf979)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:44.889333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae7f225-a2cf-4cf1-adfa-281940f47c54 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:44.945361 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6ae7f225-a2cf-4cf1-adfa-281940f47c54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df774dd28a0844b1ada0d0c6c34cf979', 'request_id': 'req-6ae7f225-a2cf-4cf1-adfa-281940f47c54'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:57:44.953860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6ae7f225-a2cf-4cf1-adfa-281940f47c54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df774dd28a0844b1ada0d0c6c34cf979', 'request_id': 'req-6ae7f225-a2cf-4cf1-adfa-281940f47c54'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:57:44.960717 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6ae7f225-a2cf-4cf1-adfa-281940f47c54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df774dd28a0844b1ada0d0c6c34cf979', 'request_id': 'req-6ae7f225-a2cf-4cf1-adfa-281940f47c54'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:57:44.972237 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6ae7f225-a2cf-4cf1-adfa-281940f47c54 admin admin] The token cache is being invalidate because project df774dd28a0844b1ada0d0c6c34cf979 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:57:44.972526 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6ae7f225-a2cf-4cf1-adfa-281940f47c54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:57:44.973212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-6ae7f225-a2cf-4cf1-adfa-281940f47c54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:57:44.974788 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4478/8962] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:57:44 2022] DELETE /identity/v3/projects/df774dd28a0844b1ada0d0c6c34cf979 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:57:44.980014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecc8b2-73a8-4b62-82a9-490dff2ca1ef None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:44.980334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecc8b2-73a8-4b62-82a9-490dff2ca1ef None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:44.980610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecc8b2-73a8-4b62-82a9-490dff2ca1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:45.001120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-80ecc8b2-73a8-4b62-82a9-490dff2ca1ef None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:57:45.002537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-80ecc8b2-73a8-4b62-82a9-490dff2ca1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:57:45.039067 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:57:45.067220 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4485/8963] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:57:45.074884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a53758-6ee8-469b-9142-e901614dc85c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:45.075174 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a53758-6ee8-469b-9142-e901614dc85c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:45.075451 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a53758-6ee8-469b-9142-e901614dc85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:45.095552 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-84a53758-6ee8-469b-9142-e901614dc85c None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:57:45.096750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-84a53758-6ee8-469b-9142-e901614dc85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:57:45.105456 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4479/8964] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:57:45.109783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ecc8b2-73a8-4b62-82a9-490dff2ca1ef None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:45.121780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ecc8b2-73a8-4b62-82a9-490dff2ca1ef None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:45.126355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de110d30-5d3f-491c-9f75-2059cdfdd1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:45.126956 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de110d30-5d3f-491c-9f75-2059cdfdd1b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:45.127236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de110d30-5d3f-491c-9f75-2059cdfdd1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:45.127506 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de110d30-5d3f-491c-9f75-2059cdfdd1b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:45.128144 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de110d30-5d3f-491c-9f75-2059cdfdd1b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:57:45.128445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de110d30-5d3f-491c-9f75-2059cdfdd1b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:45.130080 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de110d30-5d3f-491c-9f75-2059cdfdd1b3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:45.141992 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4486/8965] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:57:45.146615 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a53758-6ee8-469b-9142-e901614dc85c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:45.155936 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a53758-6ee8-469b-9142-e901614dc85c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:45.161156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fc2fd-29bc-4f2e-9d0c-5a2073989e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:45.161782 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fc2fd-29bc-4f2e-9d0c-5a2073989e45 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:45.162060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fc2fd-29bc-4f2e-9d0c-5a2073989e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:45.162328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fc2fd-29bc-4f2e-9d0c-5a2073989e45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:45.162967 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9fc2fd-29bc-4f2e-9d0c-5a2073989e45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:45.164862 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9fc2fd-29bc-4f2e-9d0c-5a2073989e45 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:45.193748 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4480/8966] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:57:45 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:57:45.198190 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de110d30-5d3f-491c-9f75-2059cdfdd1b3 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:45.208032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de110d30-5d3f-491c-9f75-2059cdfdd1b3 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:45.266655 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fef2ed-c318-4c61-b9c2-f435c70c562f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:45.267262 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fef2ed-c318-4c61-b9c2-f435c70c562f admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:45.267540 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fef2ed-c318-4c61-b9c2-f435c70c562f admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:45.267809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fef2ed-c318-4c61-b9c2-f435c70c562f admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:45.268595 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fef2ed-c318-4c61-b9c2-f435c70c562f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:45.270570 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fef2ed-c318-4c61-b9c2-f435c70c562f admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:45.291331 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4487/8967] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:57:45 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:57:45.295463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fc2fd-29bc-4f2e-9d0c-5a2073989e45 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:45.306368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fc2fd-29bc-4f2e-9d0c-5a2073989e45 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:45.310949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b4560-cfc8-41d6-b63e-a150a94fc1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:45.311551 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b4560-cfc8-41d6-b63e-a150a94fc1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:45.311832 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b4560-cfc8-41d6-b63e-a150a94fc1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:45.312104 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b4560-cfc8-41d6-b63e-a150a94fc1d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:45.312732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5b4560-cfc8-41d6-b63e-a150a94fc1d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:45.314357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5b4560-cfc8-41d6-b63e-a150a94fc1d1 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:45.324295 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4481/8968] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:57:45.328243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fef2ed-c318-4c61-b9c2-f435c70c562f admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:45.338130 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fef2ed-c318-4c61-b9c2-f435c70c562f admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:45.342654 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6018f1-7cab-437f-b87d-91fff8ea02a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:45.343246 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6018f1-7cab-437f-b87d-91fff8ea02a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:45.343520 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6018f1-7cab-437f-b87d-91fff8ea02a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:45.343787 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6018f1-7cab-437f-b87d-91fff8ea02a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:45.344416 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6018f1-7cab-437f-b87d-91fff8ea02a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:45.346036 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6018f1-7cab-437f-b87d-91fff8ea02a8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:45.357046 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4488/8969] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:57:45.360914 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b4560-cfc8-41d6-b63e-a150a94fc1d1 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:45.371567 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b4560-cfc8-41d6-b63e-a150a94fc1d1 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:45.376189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b0f7a-9b97-4d95-9c9d-2e0679bc86c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:45.376830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b0f7a-9b97-4d95-9c9d-2e0679bc86c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:45.377114 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b0f7a-9b97-4d95-9c9d-2e0679bc86c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:45.377411 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b0f7a-9b97-4d95-9c9d-2e0679bc86c3 admin admin] PATH_INFO: `/v3/projects/0d325fd0cca5433bb7c81ed850678fc6/users/2438e353a5c14eeb96cb5750b7cef1be/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:45.379656 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:57:45.394576 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b0f7a-9b97-4d95-9c9d-2e0679bc86c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d325fd0cca5433bb7c81ed850678fc6, user_id=2438e353a5c14eeb96cb5750b7cef1be, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:45.397908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b0f7a-9b97-4d95-9c9d-2e0679bc86c3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:45.410318 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4482/8970] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:57:45 2022] PUT /identity/v3/projects/0d325fd0cca5433bb7c81ed850678fc6/users/2438e353a5c14eeb96cb5750b7cef1be/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:57:45.416018 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485fbf2-cca1-4a1c-96f1-015f8c2b59d0 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:45.416333 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485fbf2-cca1-4a1c-96f1-015f8c2b59d0 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:45.416637 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485fbf2-cca1-4a1c-96f1-015f8c2b59d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:45.435342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d485fbf2-cca1-4a1c-96f1-015f8c2b59d0 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:57:45.436536 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d485fbf2-cca1-4a1c-96f1-015f8c2b59d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:57:45.500208 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4489/8971] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:57:45.510911 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b0f7a-9b97-4d95-9c9d-2e0679bc86c3 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:45.512637 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c28b0f7a-9b97-4d95-9c9d-2e0679bc86c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:57:45.569206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b0f7a-9b97-4d95-9c9d-2e0679bc86c3 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:45.573004 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e9705-285a-4bf7-bc52-3a018a831ad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:45.573634 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e9705-285a-4bf7-bc52-3a018a831ad8 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:45.573966 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e9705-285a-4bf7-bc52-3a018a831ad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:45.574237 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e9705-285a-4bf7-bc52-3a018a831ad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:45.583188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e9705-285a-4bf7-bc52-3a018a831ad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:45.584607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e9705-285a-4bf7-bc52-3a018a831ad8 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:45.593853 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4483/8972] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:57:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:57:49.616486 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc2358-1b57-461c-8ddd-5dd84a452718 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:49.617055 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc2358-1b57-461c-8ddd-5dd84a452718 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:49.617055 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc2358-1b57-461c-8ddd-5dd84a452718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:49.647549 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-f5dc2358-1b57-461c-8ddd-5dd84a452718 None None] MFA Rules not processed for user `2438e353a5c14eeb96cb5750b7cef1be`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:57:49.648860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f5dc2358-1b57-461c-8ddd-5dd84a452718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:57:49.690870 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:57:49.727536 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4490/8973] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:57:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:57:49.732214 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e9705-285a-4bf7-bc52-3a018a831ad8 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:49.742786 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e9705-285a-4bf7-bc52-3a018a831ad8 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:49.747337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3147f1-0c1f-4906-959d-399cae15c79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:49.747948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3147f1-0c1f-4906-959d-399cae15c79d admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:49.748226 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3147f1-0c1f-4906-959d-399cae15c79d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:49.748498 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3147f1-0c1f-4906-959d-399cae15c79d admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:49.749156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3147f1-0c1f-4906-959d-399cae15c79d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:49.751166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3147f1-0c1f-4906-959d-399cae15c79d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:49.780643 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4484/8974] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:57:49 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:57:49.784876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc2358-1b57-461c-8ddd-5dd84a452718 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:49.796922 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc2358-1b57-461c-8ddd-5dd84a452718 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:49.858456 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa9347-9625-4ed7-93a7-f90c884915b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:49.859196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa9347-9625-4ed7-93a7-f90c884915b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:49.859546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa9347-9625-4ed7-93a7-f90c884915b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:49.859891 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa9347-9625-4ed7-93a7-f90c884915b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:49.860610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa9347-9625-4ed7-93a7-f90c884915b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:49.862791 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa9347-9625-4ed7-93a7-f90c884915b2 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:49.886085 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4491/8975] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:57:49 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:57:49.890212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3147f1-0c1f-4906-959d-399cae15c79d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:49.901842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3147f1-0c1f-4906-959d-399cae15c79d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:49.906813 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe5a1a-36cc-42ff-9707-b80e2610a633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:49.907429 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe5a1a-36cc-42ff-9707-b80e2610a633 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:49.907708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe5a1a-36cc-42ff-9707-b80e2610a633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:49.908001 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe5a1a-36cc-42ff-9707-b80e2610a633 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:49.908649 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe5a1a-36cc-42ff-9707-b80e2610a633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:49.910345 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe5a1a-36cc-42ff-9707-b80e2610a633 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:49.921798 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4485/8976] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:57:49.926774 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa9347-9625-4ed7-93a7-f90c884915b2 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:49.937724 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa9347-9625-4ed7-93a7-f90c884915b2 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:49.943268 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b9f8e-cde0-4d84-8d24-ff31fdf6a2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:49.943950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b9f8e-cde0-4d84-8d24-ff31fdf6a2cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:49.944231 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b9f8e-cde0-4d84-8d24-ff31fdf6a2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:49.944507 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b9f8e-cde0-4d84-8d24-ff31fdf6a2cc admin admin] PATH_INFO: `/v3/projects/cc8a24ab36de4b43828e1d2f46dca433/users/da5814932cfc424d81f76245aeafb5cb/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:49.960995 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b9f8e-cde0-4d84-8d24-ff31fdf6a2cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc8a24ab36de4b43828e1d2f46dca433, user_id=da5814932cfc424d81f76245aeafb5cb, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:49.963703 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b9f8e-cde0-4d84-8d24-ff31fdf6a2cc admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:49.979662 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4492/8977] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:57:49 2022] PUT /identity/v3/projects/cc8a24ab36de4b43828e1d2f46dca433/users/da5814932cfc424d81f76245aeafb5cb/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 01:57:49.983432 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe5a1a-36cc-42ff-9707-b80e2610a633 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:49.993871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe5a1a-36cc-42ff-9707-b80e2610a633 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:50.053220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317c37c-8ea5-4d44-bc43-01374e119b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:50.053901 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317c37c-8ea5-4d44-bc43-01374e119b0f admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:50.054212 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317c37c-8ea5-4d44-bc43-01374e119b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:50.054489 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317c37c-8ea5-4d44-bc43-01374e119b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:50.055130 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317c37c-8ea5-4d44-bc43-01374e119b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:50.056738 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317c37c-8ea5-4d44-bc43-01374e119b0f admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:50.067752 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4486/8978] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:57:50.071834 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b9f8e-cde0-4d84-8d24-ff31fdf6a2cc admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:50.083043 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b9f8e-cde0-4d84-8d24-ff31fdf6a2cc admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:50.088160 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100c59b-e318-4fc5-b2a3-ce1ac4dbc2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:50.088823 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100c59b-e318-4fc5-b2a3-ce1ac4dbc2c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:50.089107 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100c59b-e318-4fc5-b2a3-ce1ac4dbc2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:50.089384 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100c59b-e318-4fc5-b2a3-ce1ac4dbc2c4 admin admin] PATH_INFO: `/v3/projects/cc8a24ab36de4b43828e1d2f46dca433/users/da5814932cfc424d81f76245aeafb5cb/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:50.091361 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100c59b-e318-4fc5-b2a3-ce1ac4dbc2c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc8a24ab36de4b43828e1d2f46dca433, user_id=da5814932cfc424d81f76245aeafb5cb, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:50.094094 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100c59b-e318-4fc5-b2a3-ce1ac4dbc2c4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:50.105347 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4493/8979] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:57:50 2022] PUT /identity/v3/projects/cc8a24ab36de4b43828e1d2f46dca433/users/da5814932cfc424d81f76245aeafb5cb/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:57:54.467958 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305d992-3c46-4906-931f-7e8875ab724b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:54.468458 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305d992-3c46-4906-931f-7e8875ab724b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:54.468625 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305d992-3c46-4906-931f-7e8875ab724b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:54.497769 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-8305d992-3c46-4906-931f-7e8875ab724b None None] MFA Rules not processed for user `da5814932cfc424d81f76245aeafb5cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:57:54.498989 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8305d992-3c46-4906-931f-7e8875ab724b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:57:54.544853 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:57:54.578811 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4487/8980] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:57:54 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:57:54.597317 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100c59b-e318-4fc5-b2a3-ce1ac4dbc2c4 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:54.600877 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d100c59b-e318-4fc5-b2a3-ce1ac4dbc2c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:57:54.682755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100c59b-e318-4fc5-b2a3-ce1ac4dbc2c4 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:54.688279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e146a4-125f-4dde-af96-b44e2d1e58f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:54.688896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e146a4-125f-4dde-af96-b44e2d1e58f1 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:54.689180 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e146a4-125f-4dde-af96-b44e2d1e58f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:54.689478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e146a4-125f-4dde-af96-b44e2d1e58f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:54.715346 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:57:54.750690 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e146a4-125f-4dde-af96-b44e2d1e58f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:54.752346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e146a4-125f-4dde-af96-b44e2d1e58f1 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:54.763031 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4494/8981] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:57:54 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:57:54.839058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98637844-695a-4476-9004-ea71fe2976d4 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:54.839346 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98637844-695a-4476-9004-ea71fe2976d4 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:54.839618 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98637844-695a-4476-9004-ea71fe2976d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:54.859423 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-98637844-695a-4476-9004-ea71fe2976d4 None None] MFA Rules not processed for user `2438e353a5c14eeb96cb5750b7cef1be`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:57:54.860678 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-98637844-695a-4476-9004-ea71fe2976d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:57:54.868012 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4488/8982] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:57:54 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:57:55.145494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e146a4-125f-4dde-af96-b44e2d1e58f1 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:55.146874 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-05e146a4-125f-4dde-af96-b44e2d1e58f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:57:55.212198 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e146a4-125f-4dde-af96-b44e2d1e58f1 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:55.216142 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7316f-09d3-4169-83c3-6cdbf4e094e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:55.216696 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7316f-09d3-4169-83c3-6cdbf4e094e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:55.216971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7316f-09d3-4169-83c3-6cdbf4e094e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:55.217238 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7316f-09d3-4169-83c3-6cdbf4e094e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:55.218998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-cbb7316f-09d3-4169-83c3-6cdbf4e094e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:57:55.235087 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7316f-09d3-4169-83c3-6cdbf4e094e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:55.236779 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7316f-09d3-4169-83c3-6cdbf4e094e2 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:55.260391 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4495/8983] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:57:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:57:57.641536 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98637844-695a-4476-9004-ea71fe2976d4 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:57:57.654960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98637844-695a-4476-9004-ea71fe2976d4 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:57:57.659417 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d50cdc-a56a-4059-8c20-64f73696f583 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:57:57.660151 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d50cdc-a56a-4059-8c20-64f73696f583 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:57:57.661045 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d50cdc-a56a-4059-8c20-64f73696f583 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:57:57.661321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d50cdc-a56a-4059-8c20-64f73696f583 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:57:57.663330 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-42d50cdc-a56a-4059-8c20-64f73696f583 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:57:57.677845 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d50cdc-a56a-4059-8c20-64f73696f583 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:57:57.679417 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d50cdc-a56a-4059-8c20-64f73696f583 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:57:57.692137 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4489/8984] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:57:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:58:01.438076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb8c57-b539-4f48-8d1b-1b5a7a3c21be None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:58:01.438609 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb8c57-b539-4f48-8d1b-1b5a7a3c21be None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:58:01.438841 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb8c57-b539-4f48-8d1b-1b5a7a3c21be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:58:01.481856 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d2fb8c57-b539-4f48-8d1b-1b5a7a3c21be None None] MFA Rules not processed for user `13f0f341bf2c475d82b4e7b34d503dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:58:01.483096 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d2fb8c57-b539-4f48-8d1b-1b5a7a3c21be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:58:01.493134 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4496/8985] 10.222.0.30 () {58 vars in 1059 bytes} [Sun Sep 4 01:58:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:58:02.676180 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5daf51-06ba-4c80-a521-a0cd7a4f8c81 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:58:02.676689 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5daf51-06ba-4c80-a521-a0cd7a4f8c81 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:58:02.676783 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5daf51-06ba-4c80-a521-a0cd7a4f8c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:58:02.696196 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-8b5daf51-06ba-4c80-a521-a0cd7a4f8c81 None None] MFA Rules not processed for user `13f0f341bf2c475d82b4e7b34d503dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:58:02.697371 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-8b5daf51-06ba-4c80-a521-a0cd7a4f8c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:58:02.706467 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4490/8986] 10.222.0.30 () {58 vars in 1059 bytes} [Sun Sep 4 01:58:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:58:03.881167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe0ab1-d11d-4128-83e4-a0c4442ba9f5 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:58:03.881736 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe0ab1-d11d-4128-83e4-a0c4442ba9f5 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:58:03.881736 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe0ab1-d11d-4128-83e4-a0c4442ba9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:58:03.901914 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-61fe0ab1-d11d-4128-83e4-a0c4442ba9f5 None None] MFA Rules not processed for user `13f0f341bf2c475d82b4e7b34d503dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:58:03.903049 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-61fe0ab1-d11d-4128-83e4-a0c4442ba9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:58:03.912570 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4497/8987] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:58:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:58:03.923286 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5daf51-06ba-4c80-a521-a0cd7a4f8c81 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:58:03.933099 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5daf51-06ba-4c80-a521-a0cd7a4f8c81 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:58:03.936710 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fec432-f825-4e3b-8bd9-cedb8581b9e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:58:03.937307 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fec432-f825-4e3b-8bd9-cedb8581b9e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:58:03.937629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fec432-f825-4e3b-8bd9-cedb8581b9e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:58:03.937904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fec432-f825-4e3b-8bd9-cedb8581b9e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:58:03.947749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fec432-f825-4e3b-8bd9-cedb8581b9e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:58:03.949170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fec432-f825-4e3b-8bd9-cedb8581b9e5 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:58:03.961637 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4491/8988] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:58:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 01:58:05.133615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80586086-58e7-4d41-bded-441e3f98adf3 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:58:05.134122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80586086-58e7-4d41-bded-441e3f98adf3 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:58:05.134237 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80586086-58e7-4d41-bded-441e3f98adf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:58:05.153623 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-80586086-58e7-4d41-bded-441e3f98adf3 None None] MFA Rules not processed for user `13f0f341bf2c475d82b4e7b34d503dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:58:05.154795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-80586086-58e7-4d41-bded-441e3f98adf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:58:05.164505 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4498/8989] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:58:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:58:05.175218 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fec432-f825-4e3b-8bd9-cedb8581b9e5 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:58:05.183961 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fec432-f825-4e3b-8bd9-cedb8581b9e5 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:58:05.188491 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300644f-2a3a-44fe-8b76-d3190e2ac895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:58:05.189135 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300644f-2a3a-44fe-8b76-d3190e2ac895 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:58:05.189383 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300644f-2a3a-44fe-8b76-d3190e2ac895 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:58:05.189690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300644f-2a3a-44fe-8b76-d3190e2ac895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:58:05.199935 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300644f-2a3a-44fe-8b76-d3190e2ac895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:58:05.201680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300644f-2a3a-44fe-8b76-d3190e2ac895 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:58:05.212878 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4492/8990] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:58:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:58:05.353564 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80586086-58e7-4d41-bded-441e3f98adf3 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:58:05.364979 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80586086-58e7-4d41-bded-441e3f98adf3 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:58:05.370555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7fa453-a57d-428a-98ce-775966539b25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:58:05.371169 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fa453-a57d-428a-98ce-775966539b25 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:58:05.371449 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fa453-a57d-428a-98ce-775966539b25 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:58:05.371724 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fa453-a57d-428a-98ce-775966539b25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:58:05.373466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9f7fa453-a57d-428a-98ce-775966539b25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:58:05.389067 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7fa453-a57d-428a-98ce-775966539b25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:58:05.390792 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7fa453-a57d-428a-98ce-775966539b25 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:58:05.404818 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4499/8991] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:58:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:58:07.863821 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300644f-2a3a-44fe-8b76-d3190e2ac895 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:58:07.865205 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a300644f-2a3a-44fe-8b76-d3190e2ac895 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:58:07.922120 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300644f-2a3a-44fe-8b76-d3190e2ac895 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:58:07.926219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e84ca-2501-4ace-93be-b26a55664b87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9108334da66445c2a0ba438c19850357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:58:07.926818 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e84ca-2501-4ace-93be-b26a55664b87 service cinder] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:58:07.927103 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e84ca-2501-4ace-93be-b26a55664b87 service cinder] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:58:07.927373 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e84ca-2501-4ace-93be-b26a55664b87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:58:07.935969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e84ca-2501-4ace-93be-b26a55664b87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:58:07.937386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e84ca-2501-4ace-93be-b26a55664b87 service cinder] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:58:07.947104 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4493/8992] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:58:07 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:58:15.397622 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=63 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:58:17.942997 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=62 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:58:31.734953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdd02a-ed08-4062-85cf-23f902ab53f5 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:58:31.735869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdd02a-ed08-4062-85cf-23f902ab53f5 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:58:31.736147 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdd02a-ed08-4062-85cf-23f902ab53f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:58:31.770672 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-53cdd02a-ed08-4062-85cf-23f902ab53f5 None None] MFA Rules not processed for user `13f0f341bf2c475d82b4e7b34d503dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:58:31.772092 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-53cdd02a-ed08-4062-85cf-23f902ab53f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:58:31.817118 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4500/8993] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Sep 4 01:58:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:58:31.833718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e84ca-2501-4ace-93be-b26a55664b87 service cinder] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:58:31.886228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e84ca-2501-4ace-93be-b26a55664b87 service cinder] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:58:31.892922 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a5cfe-062e-4745-bdaa-ccb40fb66a8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:58:31.894171 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a5cfe-062e-4745-bdaa-ccb40fb66a8b service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:58:31.897664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a5cfe-062e-4745-bdaa-ccb40fb66a8b service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:58:31.897977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a5cfe-062e-4745-bdaa-ccb40fb66a8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:58:31.907926 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a5cfe-062e-4745-bdaa-ccb40fb66a8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:58:31.910123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a5cfe-062e-4745-bdaa-ccb40fb66a8b service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:58:31.923846 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4494/8994] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:58:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:58:33.141011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b410f0-0263-4101-8d93-19825c273b09 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:58:33.141544 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b410f0-0263-4101-8d93-19825c273b09 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:58:33.141662 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b410f0-0263-4101-8d93-19825c273b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:58:33.160334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-68b410f0-0263-4101-8d93-19825c273b09 None None] MFA Rules not processed for user `2438e353a5c14eeb96cb5750b7cef1be`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:58:33.162046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-68b410f0-0263-4101-8d93-19825c273b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:58:33.168814 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4501/8995] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:58:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:58:35.447155 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c662c3-f325-4a28-b4a1-81530f86a30f None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:58:35.447670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c662c3-f325-4a28-b4a1-81530f86a30f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:58:35.447797 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c662c3-f325-4a28-b4a1-81530f86a30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:58:35.468174 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a1c662c3-f325-4a28-b4a1-81530f86a30f None None] MFA Rules not processed for user `2cdde7a212954a01a2591ad5ac30d049`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:58:35.469398 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a1c662c3-f325-4a28-b4a1-81530f86a30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:58:35.476552 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4495/8996] 10.222.0.49 () {58 vars in 1015 bytes} [Sun Sep 4 01:58:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:58:35.488805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b410f0-0263-4101-8d93-19825c273b09 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:58:35.500025 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b410f0-0263-4101-8d93-19825c273b09 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:58:35.503629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8ad9d-40bd-4d31-b4dd-2e6bb35e0402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:58:35.504239 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8ad9d-40bd-4d31-b4dd-2e6bb35e0402 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:58:35.504515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8ad9d-40bd-4d31-b4dd-2e6bb35e0402 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:58:35.504785 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8ad9d-40bd-4d31-b4dd-2e6bb35e0402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:58:35.512973 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba8ad9d-40bd-4d31-b4dd-2e6bb35e0402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:58:35.514516 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba8ad9d-40bd-4d31-b4dd-2e6bb35e0402 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:58:35.522972 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4502/8997] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:58:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:58:43.545676 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e977aa0-5627-4da6-bb33-5318b63dd662 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:58:43.546190 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e977aa0-5627-4da6-bb33-5318b63dd662 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:58:43.546292 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e977aa0-5627-4da6-bb33-5318b63dd662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:58:43.567893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-5e977aa0-5627-4da6-bb33-5318b63dd662 None None] MFA Rules not processed for user `13f0f341bf2c475d82b4e7b34d503dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:58:43.569105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5e977aa0-5627-4da6-bb33-5318b63dd662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:58:43.579107 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4496/8998] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Sep 4 01:58:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:58:43.593298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8ad9d-40bd-4d31-b4dd-2e6bb35e0402 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:58:43.606653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8ad9d-40bd-4d31-b4dd-2e6bb35e0402 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:58:43.612722 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f051a-8e42-4b17-a73e-d66f34daace8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:58:43.613323 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f051a-8e42-4b17-a73e-d66f34daace8 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:58:43.613652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f051a-8e42-4b17-a73e-d66f34daace8 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:58:43.613924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f051a-8e42-4b17-a73e-d66f34daace8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:58:43.625002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f051a-8e42-4b17-a73e-d66f34daace8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:58:43.626622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f051a-8e42-4b17-a73e-d66f34daace8 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:58:43.637908 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4503/8999] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:58:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:58:53.562701 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=23 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:58:53.633061 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=33 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:59:10.866527 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7de683-43ee-4111-ba8a-8812e3a75e17 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:59:10.867047 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7de683-43ee-4111-ba8a-8812e3a75e17 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:59:10.867443 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7de683-43ee-4111-ba8a-8812e3a75e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:59:10.887184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ca7de683-43ee-4111-ba8a-8812e3a75e17 None None] MFA Rules not processed for user `2438e353a5c14eeb96cb5750b7cef1be`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:59:10.888552 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ca7de683-43ee-4111-ba8a-8812e3a75e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:59:10.895912 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4497/9000] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:59:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:59:11.149833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be5ac7-b680-40fb-b086-9db282062f94 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:59:11.150346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be5ac7-b680-40fb-b086-9db282062f94 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:59:11.150443 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be5ac7-b680-40fb-b086-9db282062f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:59:11.170213 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-f3be5ac7-b680-40fb-b086-9db282062f94 None None] MFA Rules not processed for user `2cdde7a212954a01a2591ad5ac30d049`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:59:11.171408 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f3be5ac7-b680-40fb-b086-9db282062f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:59:11.194040 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4504/9001] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 01:59:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:59:11.205525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7de683-43ee-4111-ba8a-8812e3a75e17 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:59:11.215724 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7de683-43ee-4111-ba8a-8812e3a75e17 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:59:11.219363 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606d654-1698-449e-8b33-ffb61c337d8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:59:11.219960 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606d654-1698-449e-8b33-ffb61c337d8b service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:59:11.220294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606d654-1698-449e-8b33-ffb61c337d8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:59:11.220574 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606d654-1698-449e-8b33-ffb61c337d8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:59:11.227554 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606d654-1698-449e-8b33-ffb61c337d8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:59:11.228977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606d654-1698-449e-8b33-ffb61c337d8b service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:59:11.236668 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4498/9002] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:59:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:59:13.676699 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde3cb4-f164-4a25-bf97-bfea24e2d5fa None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:59:13.677210 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde3cb4-f164-4a25-bf97-bfea24e2d5fa None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:59:13.677302 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde3cb4-f164-4a25-bf97-bfea24e2d5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:59:13.703667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-8fde3cb4-f164-4a25-bf97-bfea24e2d5fa None None] MFA Rules not processed for user `2cdde7a212954a01a2591ad5ac30d049`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:59:13.704919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-8fde3cb4-f164-4a25-bf97-bfea24e2d5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:59:13.711809 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4505/9003] 10.222.0.39 () {58 vars in 1015 bytes} [Sun Sep 4 01:59:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 01:59:13.724173 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606d654-1698-449e-8b33-ffb61c337d8b service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:59:13.733027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606d654-1698-449e-8b33-ffb61c337d8b service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:59:13.737784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb430d-4214-4c7c-b4b7-00201f9e815b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:59:13.738425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb430d-4214-4c7c-b4b7-00201f9e815b service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:59:13.739452 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb430d-4214-4c7c-b4b7-00201f9e815b service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:59:13.739877 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb430d-4214-4c7c-b4b7-00201f9e815b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:59:13.748792 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb430d-4214-4c7c-b4b7-00201f9e815b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:59:13.750369 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb430d-4214-4c7c-b4b7-00201f9e815b service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:59:13.760601 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4499/9004] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:59:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:59:23.698300 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=13 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:59:23.755492 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=15 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:59:51.313521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde3cb4-f164-4a25-bf97-bfea24e2d5fa None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:59:51.398452 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde3cb4-f164-4a25-bf97-bfea24e2d5fa None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:59:51.404470 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ddeb7-57fb-4ec1-b74c-e48e73313191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:59:51.405104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ddeb7-57fb-4ec1-b74c-e48e73313191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:59:51.405380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ddeb7-57fb-4ec1-b74c-e48e73313191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:59:51.405750 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ddeb7-57fb-4ec1-b74c-e48e73313191 admin admin] PATH_INFO: `/v3/users/2438e353a5c14eeb96cb5750b7cef1be` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:59:51.407008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ddeb7-57fb-4ec1-b74c-e48e73313191 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2438e353a5c14eeb96cb5750b7cef1be)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:59:51.408940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ddeb7-57fb-4ec1-b74c-e48e73313191 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:59:51.457457 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-799ddeb7-57fb-4ec1-b74c-e48e73313191 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2438e353a5c14eeb96cb5750b7cef1be'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:59:51.460114 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-799ddeb7-57fb-4ec1-b74c-e48e73313191 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2438e353a5c14eeb96cb5750b7cef1be'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:59:51.467154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-799ddeb7-57fb-4ec1-b74c-e48e73313191 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2438e353a5c14eeb96cb5750b7cef1be'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:59:51.474086 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-799ddeb7-57fb-4ec1-b74c-e48e73313191 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2438e353a5c14eeb96cb5750b7cef1be'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:59:51.474713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-799ddeb7-57fb-4ec1-b74c-e48e73313191 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2438e353a5c14eeb96cb5750b7cef1be'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:59:51.492165 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4506/9005] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:59:51 2022] DELETE /identity/v3/users/2438e353a5c14eeb96cb5750b7cef1be => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:59:51.658905 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb430d-4214-4c7c-b4b7-00201f9e815b service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:59:51.678900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb430d-4214-4c7c-b4b7-00201f9e815b service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:59:51.755355 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d4f07-6bb7-4d92-a1fe-cd331196fab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:59:51.755909 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d4f07-6bb7-4d92-a1fe-cd331196fab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:59:51.756193 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d4f07-6bb7-4d92-a1fe-cd331196fab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:59:51.756472 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d4f07-6bb7-4d92-a1fe-cd331196fab5 admin admin] PATH_INFO: `/v3/projects/0d325fd0cca5433bb7c81ed850678fc6` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:59:51.757726 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d4f07-6bb7-4d92-a1fe-cd331196fab5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d325fd0cca5433bb7c81ed850678fc6)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:59:51.759906 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d4f07-6bb7-4d92-a1fe-cd331196fab5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:59:51.805736 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-af5d4f07-6bb7-4d92-a1fe-cd331196fab5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d325fd0cca5433bb7c81ed850678fc6', 'request_id': 'req-af5d4f07-6bb7-4d92-a1fe-cd331196fab5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:59:51.812600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-af5d4f07-6bb7-4d92-a1fe-cd331196fab5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d325fd0cca5433bb7c81ed850678fc6', 'request_id': 'req-af5d4f07-6bb7-4d92-a1fe-cd331196fab5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:59:51.818188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-af5d4f07-6bb7-4d92-a1fe-cd331196fab5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d325fd0cca5433bb7c81ed850678fc6', 'request_id': 'req-af5d4f07-6bb7-4d92-a1fe-cd331196fab5'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:59:51.828896 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-af5d4f07-6bb7-4d92-a1fe-cd331196fab5 admin admin] The token cache is being invalidate because project 0d325fd0cca5433bb7c81ed850678fc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:59:51.829177 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-af5d4f07-6bb7-4d92-a1fe-cd331196fab5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:59:51.829928 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-af5d4f07-6bb7-4d92-a1fe-cd331196fab5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:59:51.831412 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4500/9006] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:59:51 2022] DELETE /identity/v3/projects/0d325fd0cca5433bb7c81ed850678fc6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:59:51.835418 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ddeb7-57fb-4ec1-b74c-e48e73313191 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:59:51.836833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-799ddeb7-57fb-4ec1-b74c-e48e73313191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:59:51.850296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ddeb7-57fb-4ec1-b74c-e48e73313191 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:59:51.905303 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d04e4-7793-4851-a646-9d857e9cd9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:59:51.905959 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d04e4-7793-4851-a646-9d857e9cd9c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:59:51.906240 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d04e4-7793-4851-a646-9d857e9cd9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:59:51.906511 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d04e4-7793-4851-a646-9d857e9cd9c8 admin admin] PATH_INFO: `/v3/users/da5814932cfc424d81f76245aeafb5cb` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:59:51.907811 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d04e4-7793-4851-a646-9d857e9cd9c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da5814932cfc424d81f76245aeafb5cb)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:59:51.910279 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d04e4-7793-4851-a646-9d857e9cd9c8 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:59:51.932869 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:59:51.958737 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-784d04e4-7793-4851-a646-9d857e9cd9c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da5814932cfc424d81f76245aeafb5cb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:59:51.959381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-784d04e4-7793-4851-a646-9d857e9cd9c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da5814932cfc424d81f76245aeafb5cb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:59:51.966145 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-784d04e4-7793-4851-a646-9d857e9cd9c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da5814932cfc424d81f76245aeafb5cb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:59:51.973729 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-784d04e4-7793-4851-a646-9d857e9cd9c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da5814932cfc424d81f76245aeafb5cb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:59:51.974338 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-784d04e4-7793-4851-a646-9d857e9cd9c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da5814932cfc424d81f76245aeafb5cb'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:59:51.991731 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4507/9007] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 01:59:51 2022] DELETE /identity/v3/users/da5814932cfc424d81f76245aeafb5cb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:59:52.166374 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d4f07-6bb7-4d92-a1fe-cd331196fab5 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:59:52.167818 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-af5d4f07-6bb7-4d92-a1fe-cd331196fab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:59:52.181152 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d4f07-6bb7-4d92-a1fe-cd331196fab5 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:59:52.238743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397aef2-2d38-4b96-ba12-16386d235ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:59:52.239374 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397aef2-2d38-4b96-ba12-16386d235ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:59:52.239663 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397aef2-2d38-4b96-ba12-16386d235ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:59:52.239943 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397aef2-2d38-4b96-ba12-16386d235ed0 admin admin] PATH_INFO: `/v3/projects/cc8a24ab36de4b43828e1d2f46dca433` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:59:52.241062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3397aef2-2d38-4b96-ba12-16386d235ed0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc8a24ab36de4b43828e1d2f46dca433)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:59:52.243049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3397aef2-2d38-4b96-ba12-16386d235ed0 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:59:52.276924 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:59:52.291947 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3397aef2-2d38-4b96-ba12-16386d235ed0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc8a24ab36de4b43828e1d2f46dca433', 'request_id': 'req-3397aef2-2d38-4b96-ba12-16386d235ed0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:59:52.298706 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3397aef2-2d38-4b96-ba12-16386d235ed0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc8a24ab36de4b43828e1d2f46dca433', 'request_id': 'req-3397aef2-2d38-4b96-ba12-16386d235ed0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:59:52.304841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3397aef2-2d38-4b96-ba12-16386d235ed0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc8a24ab36de4b43828e1d2f46dca433', 'request_id': 'req-3397aef2-2d38-4b96-ba12-16386d235ed0'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:59:52.315730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3397aef2-2d38-4b96-ba12-16386d235ed0 admin admin] The token cache is being invalidate because project cc8a24ab36de4b43828e1d2f46dca433 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 01:59:52.316019 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3397aef2-2d38-4b96-ba12-16386d235ed0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:59:52.316653 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-3397aef2-2d38-4b96-ba12-16386d235ed0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 01:59:52.318219 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4501/9008] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 01:59:52 2022] DELETE /identity/v3/projects/cc8a24ab36de4b43828e1d2f46dca433 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:59:52.323148 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa0d50-f172-415c-93af-1fbd1693ffe2 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:59:52.323629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa0d50-f172-415c-93af-1fbd1693ffe2 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:59:52.323733 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa0d50-f172-415c-93af-1fbd1693ffe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:59:52.353818 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-bbaa0d50-f172-415c-93af-1fbd1693ffe2 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:59:52.354998 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bbaa0d50-f172-415c-93af-1fbd1693ffe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:59:52.413100 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4508/9009] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:59:52.421798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bc2f4-9c05-43af-9696-637a8c59ccf3 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:59:52.422086 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bc2f4-9c05-43af-9696-637a8c59ccf3 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:59:52.422363 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bc2f4-9c05-43af-9696-637a8c59ccf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:59:52.443526 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-fb0bc2f4-9c05-43af-9696-637a8c59ccf3 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:59:52.444739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-fb0bc2f4-9c05-43af-9696-637a8c59ccf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:59:52.452783 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4502/9010] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:59:52.457066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa0d50-f172-415c-93af-1fbd1693ffe2 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:59:52.467546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa0d50-f172-415c-93af-1fbd1693ffe2 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:59:52.472030 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30d7c1-74e8-4bbb-a7e0-ac1c09b0d594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:59:52.472649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30d7c1-74e8-4bbb-a7e0-ac1c09b0d594 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:59:52.472925 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30d7c1-74e8-4bbb-a7e0-ac1c09b0d594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:59:52.473192 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30d7c1-74e8-4bbb-a7e0-ac1c09b0d594 admin admin] PATH_INFO: `/v3/domains` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:59:52.473865 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30d7c1-74e8-4bbb-a7e0-ac1c09b0d594 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 01:59:52.474166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30d7c1-74e8-4bbb-a7e0-ac1c09b0d594 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:59:52.475752 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30d7c1-74e8-4bbb-a7e0-ac1c09b0d594 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:59:52.487094 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4509/9011] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 01:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 01:59:52.491237 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0bc2f4-9c05-43af-9696-637a8c59ccf3 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:59:52.500356 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0bc2f4-9c05-43af-9696-637a8c59ccf3 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:59:52.505604 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52718b-062d-429a-a493-94e0fc4a59c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:59:52.506186 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52718b-062d-429a-a493-94e0fc4a59c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:59:52.506463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52718b-062d-429a-a493-94e0fc4a59c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:59:52.506733 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52718b-062d-429a-a493-94e0fc4a59c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:59:52.507350 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc52718b-062d-429a-a493-94e0fc4a59c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:59:52.509577 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc52718b-062d-429a-a493-94e0fc4a59c5 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:59:52.536646 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4503/9012] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:59:52 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:59:52.540671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30d7c1-74e8-4bbb-a7e0-ac1c09b0d594 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:59:52.550400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30d7c1-74e8-4bbb-a7e0-ac1c09b0d594 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:59:52.607176 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b3da6-dfd0-4dd8-bb34-88bd818e30ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:59:52.607775 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b3da6-dfd0-4dd8-bb34-88bd818e30ff admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:59:52.608056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b3da6-dfd0-4dd8-bb34-88bd818e30ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:59:52.608361 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b3da6-dfd0-4dd8-bb34-88bd818e30ff admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:59:52.608982 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b3da6-dfd0-4dd8-bb34-88bd818e30ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:59:52.610926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b3da6-dfd0-4dd8-bb34-88bd818e30ff admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:59:52.631873 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4510/9013] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:59:52 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 01:59:52.636262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52718b-062d-429a-a493-94e0fc4a59c5 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:59:52.646975 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52718b-062d-429a-a493-94e0fc4a59c5 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:59:52.651621 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd46014-6d84-49ae-9af5-18b8da74fcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:59:52.652241 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd46014-6d84-49ae-9af5-18b8da74fcce admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:59:52.652523 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd46014-6d84-49ae-9af5-18b8da74fcce admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:59:52.652798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd46014-6d84-49ae-9af5-18b8da74fcce admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:59:52.653455 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd46014-6d84-49ae-9af5-18b8da74fcce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:59:52.655049 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd46014-6d84-49ae-9af5-18b8da74fcce admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:59:52.664695 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4504/9014] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:59:52.668637 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b3da6-dfd0-4dd8-bb34-88bd818e30ff admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:59:52.678381 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b3da6-dfd0-4dd8-bb34-88bd818e30ff admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:59:52.683030 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b09a6-1935-4dfd-b194-1addd0844e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:59:52.683617 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b09a6-1935-4dfd-b194-1addd0844e6c admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:59:52.683895 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b09a6-1935-4dfd-b194-1addd0844e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:59:52.684164 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b09a6-1935-4dfd-b194-1addd0844e6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:59:52.684791 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b09a6-1935-4dfd-b194-1addd0844e6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:59:52.686390 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b09a6-1935-4dfd-b194-1addd0844e6c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:59:52.687597 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:59:52.699699 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4511/9015] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:59:52.703875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd46014-6d84-49ae-9af5-18b8da74fcce admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:59:52.714417 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd46014-6d84-49ae-9af5-18b8da74fcce admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:59:52.719014 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f562b1-9608-4a90-8e89-a2111930fd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:59:52.719658 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f562b1-9608-4a90-8e89-a2111930fd3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:59:52.719939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f562b1-9608-4a90-8e89-a2111930fd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:59:52.720209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f562b1-9608-4a90-8e89-a2111930fd3c admin admin] PATH_INFO: `/v3/projects/2509f82fd5744911bdea0b7e8cf4c0ba/users/a8618ff1f93340debc7b7e7bc22dcdc1/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:59:52.734509 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f562b1-9608-4a90-8e89-a2111930fd3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2509f82fd5744911bdea0b7e8cf4c0ba, user_id=a8618ff1f93340debc7b7e7bc22dcdc1, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:59:52.737154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f562b1-9608-4a90-8e89-a2111930fd3c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:59:52.750422 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4505/9016] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:59:52 2022] PUT /identity/v3/projects/2509f82fd5744911bdea0b7e8cf4c0ba/users/a8618ff1f93340debc7b7e7bc22dcdc1/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:59:52.756108 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bff8ad-268f-47eb-979e-632d4b206ff0 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:59:52.756391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bff8ad-268f-47eb-979e-632d4b206ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:59:52.756685 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bff8ad-268f-47eb-979e-632d4b206ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:59:52.775856 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-49bff8ad-268f-47eb-979e-632d4b206ff0 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:59:52.777039 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-49bff8ad-268f-47eb-979e-632d4b206ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:59:52.836662 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4512/9017] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:59:52.846255 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f562b1-9608-4a90-8e89-a2111930fd3c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:59:52.847948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-11f562b1-9608-4a90-8e89-a2111930fd3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:59:52.903965 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f562b1-9608-4a90-8e89-a2111930fd3c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:59:52.907666 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29101f-736a-413e-8e25-58eea4f61450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:59:52.908272 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29101f-736a-413e-8e25-58eea4f61450 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:59:52.908554 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29101f-736a-413e-8e25-58eea4f61450 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:59:52.908830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29101f-736a-413e-8e25-58eea4f61450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:59:52.917842 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29101f-736a-413e-8e25-58eea4f61450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:59:52.919267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29101f-736a-413e-8e25-58eea4f61450 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:59:52.928886 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4506/9018] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 01:59:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 01:59:57.281586 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e25883-1b9b-40f8-8a03-4ce4c3635dc0 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:59:57.281586 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e25883-1b9b-40f8-8a03-4ce4c3635dc0 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:59:57.282128 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e25883-1b9b-40f8-8a03-4ce4c3635dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:59:57.319537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e7e25883-1b9b-40f8-8a03-4ce4c3635dc0 None None] MFA Rules not processed for user `a8618ff1f93340debc7b7e7bc22dcdc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 01:59:57.320928 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e7e25883-1b9b-40f8-8a03-4ce4c3635dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 01:59:57.397645 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4513/9019] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 01:59:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 01:59:57.402290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29101f-736a-413e-8e25-58eea4f61450 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:59:57.412675 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29101f-736a-413e-8e25-58eea4f61450 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:59:57.418447 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7db3e-35d0-4250-9aaf-0eb0d5a45f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:59:57.419213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7db3e-35d0-4250-9aaf-0eb0d5a45f0c admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:59:57.419562 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7db3e-35d0-4250-9aaf-0eb0d5a45f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:59:57.419944 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7db3e-35d0-4250-9aaf-0eb0d5a45f0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:59:57.420837 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7db3e-35d0-4250-9aaf-0eb0d5a45f0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:59:57.422970 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7db3e-35d0-4250-9aaf-0eb0d5a45f0c admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:59:57.461037 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4507/9020] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 01:59:57 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:59:57.464872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e25883-1b9b-40f8-8a03-4ce4c3635dc0 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:59:57.476721 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e25883-1b9b-40f8-8a03-4ce4c3635dc0 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:59:57.544461 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fcb96c-9f4e-4565-bdea-487b733db71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:59:57.545208 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcb96c-9f4e-4565-bdea-487b733db71c admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:59:57.545606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcb96c-9f4e-4565-bdea-487b733db71c admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:59:57.545885 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcb96c-9f4e-4565-bdea-487b733db71c admin admin] PATH_INFO: `/v3/users` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:59:57.546568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fcb96c-9f4e-4565-bdea-487b733db71c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:59:57.548506 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fcb96c-9f4e-4565-bdea-487b733db71c admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:59:57.576525 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4514/9021] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 01:59:57 2022] POST /identity/v3/users => generated 299 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 01:59:57.580498 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7db3e-35d0-4250-9aaf-0eb0d5a45f0c admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:59:57.594575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7db3e-35d0-4250-9aaf-0eb0d5a45f0c admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:59:57.600017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ae7d0-9b74-417a-a936-2ffa7ba3e771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:59:57.600809 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ae7d0-9b74-417a-a936-2ffa7ba3e771 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:59:57.601102 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ae7d0-9b74-417a-a936-2ffa7ba3e771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:59:57.601562 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ae7d0-9b74-417a-a936-2ffa7ba3e771 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:59:57.602464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ae7d0-9b74-417a-a936-2ffa7ba3e771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:59:57.604147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ae7d0-9b74-417a-a936-2ffa7ba3e771 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:59:57.619314 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4508/9022] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:59:57.620702 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fcb96c-9f4e-4565-bdea-487b733db71c admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:59:57.633856 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fcb96c-9f4e-4565-bdea-487b733db71c admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:59:57.638645 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12736415-06c5-4eea-9a0d-584a768d4e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:59:57.639377 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12736415-06c5-4eea-9a0d-584a768d4e6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:59:57.639741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12736415-06c5-4eea-9a0d-584a768d4e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:59:57.640080 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12736415-06c5-4eea-9a0d-584a768d4e6a admin admin] PATH_INFO: `/v3/projects/0bcd73e6fe654a7ea0fbe85de84b0afa/users/027384d151af497b98e3fafb6bf52cc6/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:59:57.653676 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:59:57.661234 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12736415-06c5-4eea-9a0d-584a768d4e6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bcd73e6fe654a7ea0fbe85de84b0afa, user_id=027384d151af497b98e3fafb6bf52cc6, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:59:57.664193 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12736415-06c5-4eea-9a0d-584a768d4e6a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:59:57.685116 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4515/9023] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:59:57 2022] PUT /identity/v3/projects/0bcd73e6fe654a7ea0fbe85de84b0afa/users/027384d151af497b98e3fafb6bf52cc6/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 01:59:57.688698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ae7d0-9b74-417a-a936-2ffa7ba3e771 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:59:57.703599 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ae7d0-9b74-417a-a936-2ffa7ba3e771 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:59:57.731018 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:59:57.768334 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2e5da-45fd-48b8-ac3d-eeb7cdb646a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:59:57.769231 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2e5da-45fd-48b8-ac3d-eeb7cdb646a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:59:57.769568 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2e5da-45fd-48b8-ac3d-eeb7cdb646a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:59:57.769916 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2e5da-45fd-48b8-ac3d-eeb7cdb646a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:59:57.770631 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc2e5da-45fd-48b8-ac3d-eeb7cdb646a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:59:57.772246 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc2e5da-45fd-48b8-ac3d-eeb7cdb646a2 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:59:57.782638 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4509/9024] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 01:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 01:59:57.787283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12736415-06c5-4eea-9a0d-584a768d4e6a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 01:59:57.797667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12736415-06c5-4eea-9a0d-584a768d4e6a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 01:59:57.802946 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f431e62-25ca-4b03-ad32-d64f199d7705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 01:59:57.803606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f431e62-25ca-4b03-ad32-d64f199d7705 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 01:59:57.803889 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f431e62-25ca-4b03-ad32-d64f199d7705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 01:59:57.804167 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f431e62-25ca-4b03-ad32-d64f199d7705 admin admin] PATH_INFO: `/v3/projects/0bcd73e6fe654a7ea0fbe85de84b0afa/users/027384d151af497b98e3fafb6bf52cc6/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 01:59:57.806136 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f431e62-25ca-4b03-ad32-d64f199d7705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bcd73e6fe654a7ea0fbe85de84b0afa, user_id=027384d151af497b98e3fafb6bf52cc6, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 01:59:57.808776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f431e62-25ca-4b03-ad32-d64f199d7705 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 01:59:57.819293 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4516/9025] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 01:59:57 2022] PUT /identity/v3/projects/0bcd73e6fe654a7ea0fbe85de84b0afa/users/027384d151af497b98e3fafb6bf52cc6/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 02:00:02.216608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e3c04-2b2e-47cc-869c-10084e873db4 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:00:02.217165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e3c04-2b2e-47cc-869c-10084e873db4 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:00:02.217165 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e3c04-2b2e-47cc-869c-10084e873db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:00:02.247483 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-258e3c04-2b2e-47cc-869c-10084e873db4 None None] MFA Rules not processed for user `027384d151af497b98e3fafb6bf52cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:00:02.248632 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-258e3c04-2b2e-47cc-869c-10084e873db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:00:02.339605 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4510/9026] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 02:00:02 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:00:02.364196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82acd2e-c2ed-4e38-ba45-2901f74f2764 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:00:02.364768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82acd2e-c2ed-4e38-ba45-2901f74f2764 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:00:02.364955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82acd2e-c2ed-4e38-ba45-2901f74f2764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:00:02.441748 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e82acd2e-c2ed-4e38-ba45-2901f74f2764 None None] MFA Rules not processed for user `efcee9b21ea94b1b8e5c9c5acb35839f`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:00:02.441748 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e82acd2e-c2ed-4e38-ba45-2901f74f2764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:00:02.521074 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4517/9027] 10.222.0.30 () {58 vars in 1058 bytes} [Sun Sep 4 02:00:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 02:00:02.527361 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e3c04-2b2e-47cc-869c-10084e873db4 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:00:02.538184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e3c04-2b2e-47cc-869c-10084e873db4 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:00:02.541982 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ba0ba-fa4a-466d-be61-b8ac85a5b069 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efcee9b21ea94b1b8e5c9c5acb35839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:00:02.542603 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ba0ba-fa4a-466d-be61-b8ac85a5b069 service glance] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:00:02.542884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ba0ba-fa4a-466d-be61-b8ac85a5b069 service glance] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:00:02.543161 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ba0ba-fa4a-466d-be61-b8ac85a5b069 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:00:02.609603 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ba0ba-fa4a-466d-be61-b8ac85a5b069 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:00:02.611188 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ba0ba-fa4a-466d-be61-b8ac85a5b069 service glance] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:00:02.621172 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4511/9028] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:00:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:00:02.797833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b53a3-19c0-4302-8566-6382e24765d6 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:00:02.798122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b53a3-19c0-4302-8566-6382e24765d6 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:00:02.798796 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b53a3-19c0-4302-8566-6382e24765d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:00:02.858299 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-bb1b53a3-19c0-4302-8566-6382e24765d6 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:00:02.859435 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bb1b53a3-19c0-4302-8566-6382e24765d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:00:02.932763 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4518/9029] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 02:00:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:00:02.988092 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e42e1-3206-42b4-8f7d-5d400f1783a4 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:00:02.988384 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e42e1-3206-42b4-8f7d-5d400f1783a4 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:00:02.988664 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e42e1-3206-42b4-8f7d-5d400f1783a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:00:03.047096 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ae0e42e1-3206-42b4-8f7d-5d400f1783a4 None None] MFA Rules not processed for user `9bcc7a857fad4310896da5a87e71baed`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:00:03.048327 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ae0e42e1-3206-42b4-8f7d-5d400f1783a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:00:03.066867 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=100 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:00:03.127346 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4512/9030] 10.222.0.30 () {58 vars in 1040 bytes} [Sun Sep 4 02:00:02 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:00:03.134504 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b53a3-19c0-4302-8566-6382e24765d6 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:00:03.147679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b53a3-19c0-4302-8566-6382e24765d6 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:00:03.156781 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d01489-b377-4207-8436-9a185054c2fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:00:03.157413 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d01489-b377-4207-8436-9a185054c2fc service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:00:03.157716 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d01489-b377-4207-8436-9a185054c2fc service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:00:03.158031 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d01489-b377-4207-8436-9a185054c2fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:00:03.174832 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d01489-b377-4207-8436-9a185054c2fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:00:03.176467 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d01489-b377-4207-8436-9a185054c2fc service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:00:03.187318 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4519/9031] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 02:00:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 02:00:12.133071 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0741c2b-4670-44d3-974c-f955f6ebc724 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:00:12.133947 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0741c2b-4670-44d3-974c-f955f6ebc724 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:00:12.133947 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0741c2b-4670-44d3-974c-f955f6ebc724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:00:12.154716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-b0741c2b-4670-44d3-974c-f955f6ebc724 None None] MFA Rules not processed for user `a8618ff1f93340debc7b7e7bc22dcdc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:00:12.155906 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b0741c2b-4670-44d3-974c-f955f6ebc724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:00:12.163214 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4513/9032] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 02:00:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:00:12.421416 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371880f3-ce3f-4247-baa1-8c868a40e65f None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:00:12.421940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371880f3-ce3f-4247-baa1-8c868a40e65f None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:00:12.422056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371880f3-ce3f-4247-baa1-8c868a40e65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:00:12.429745 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:00:12.471423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-371880f3-ce3f-4247-baa1-8c868a40e65f None None] MFA Rules not processed for user `2cdde7a212954a01a2591ad5ac30d049`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:00:12.473278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-371880f3-ce3f-4247-baa1-8c868a40e65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:00:12.522946 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4520/9033] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 02:00:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:00:12.535533 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0741c2b-4670-44d3-974c-f955f6ebc724 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:00:12.544976 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0741c2b-4670-44d3-974c-f955f6ebc724 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:00:12.548501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315cd61-26b6-4ffc-a819-b9d01ac2d7e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:00:12.549097 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315cd61-26b6-4ffc-a819-b9d01ac2d7e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:00:12.549373 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315cd61-26b6-4ffc-a819-b9d01ac2d7e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:00:12.549674 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315cd61-26b6-4ffc-a819-b9d01ac2d7e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:00:12.556532 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b315cd61-26b6-4ffc-a819-b9d01ac2d7e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:00:12.558001 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b315cd61-26b6-4ffc-a819-b9d01ac2d7e3 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:00:12.566040 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4514/9034] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:00:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:00:14.182968 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c20b6-7dab-43aa-858c-cf93a7eb849e None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:00:14.183447 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c20b6-7dab-43aa-858c-cf93a7eb849e None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:00:14.183549 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c20b6-7dab-43aa-858c-cf93a7eb849e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:00:14.203644 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-013c20b6-7dab-43aa-858c-cf93a7eb849e None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:00:14.204783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-013c20b6-7dab-43aa-858c-cf93a7eb849e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:00:14.212699 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4521/9035] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 02:00:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:00:14.224655 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315cd61-26b6-4ffc-a819-b9d01ac2d7e3 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:00:14.236716 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315cd61-26b6-4ffc-a819-b9d01ac2d7e3 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:00:14.241752 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c5139-f037-473a-82fc-50b9ed71b862 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:00:14.242351 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c5139-f037-473a-82fc-50b9ed71b862 service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:00:14.242629 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c5139-f037-473a-82fc-50b9ed71b862 service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:00:14.242903 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c5139-f037-473a-82fc-50b9ed71b862 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:00:14.251289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c5139-f037-473a-82fc-50b9ed71b862 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:00:14.253832 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c5139-f037-473a-82fc-50b9ed71b862 service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:00:14.262177 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4515/9036] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 02:00:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 02:00:24.198480 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=35 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:00:24.258554 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=38 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:00:49.663494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c20b6-7dab-43aa-858c-cf93a7eb849e None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:00:49.672991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c20b6-7dab-43aa-858c-cf93a7eb849e None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:00:49.676606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606fe01f-403b-477a-b9a6-56e8141d2bff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:00:49.677207 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fe01f-403b-477a-b9a6-56e8141d2bff service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:00:49.677592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fe01f-403b-477a-b9a6-56e8141d2bff service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:00:49.677872 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fe01f-403b-477a-b9a6-56e8141d2bff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:00:49.686955 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606fe01f-403b-477a-b9a6-56e8141d2bff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:00:49.688394 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606fe01f-403b-477a-b9a6-56e8141d2bff service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:00:49.699061 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4522/9037] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:00:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:00:51.272209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424df620-ee50-4c18-941a-4b97b5781186 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:00:51.272209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424df620-ee50-4c18-941a-4b97b5781186 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:00:51.272209 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424df620-ee50-4c18-941a-4b97b5781186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:00:51.294003 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-424df620-ee50-4c18-941a-4b97b5781186 None None] MFA Rules not processed for user `13f0f341bf2c475d82b4e7b34d503dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:00:51.295642 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-424df620-ee50-4c18-941a-4b97b5781186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:00:51.375609 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4516/9038] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Sep 4 02:00:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:00:51.393321 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606fe01f-403b-477a-b9a6-56e8141d2bff service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:00:51.394827 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-606fe01f-403b-477a-b9a6-56e8141d2bff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:00:51.416651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606fe01f-403b-477a-b9a6-56e8141d2bff service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:00:51.422555 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d4ca9-c788-4095-9d9c-e3ca60803fb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:00:51.423383 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d4ca9-c788-4095-9d9c-e3ca60803fb2 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:00:51.424349 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d4ca9-c788-4095-9d9c-e3ca60803fb2 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:00:51.424780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d4ca9-c788-4095-9d9c-e3ca60803fb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:00:51.455589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d4ca9-c788-4095-9d9c-e3ca60803fb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:00:51.457218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d4ca9-c788-4095-9d9c-e3ca60803fb2 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:00:51.470163 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4523/9039] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:00:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:00:59.568537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaa22d-77b4-45cf-a986-63022a555815 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:00:59.569017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaa22d-77b4-45cf-a986-63022a555815 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:00:59.569123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaa22d-77b4-45cf-a986-63022a555815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:00:59.621638 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-b1aaa22d-77b4-45cf-a986-63022a555815 None None] MFA Rules not processed for user `f908fda75ef8440cb6a0ef9440127d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:00:59.622850 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b1aaa22d-77b4-45cf-a986-63022a555815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:00:59.687375 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4517/9040] 10.222.0.30 () {58 vars in 1058 bytes} [Sun Sep 4 02:00:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:00:59.693785 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d4ca9-c788-4095-9d9c-e3ca60803fb2 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:00:59.705183 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d4ca9-c788-4095-9d9c-e3ca60803fb2 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:00:59.710700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d91364-15b1-4270-a965-e49115228dd4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:00:59.711299 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d91364-15b1-4270-a965-e49115228dd4 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:00:59.711576 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d91364-15b1-4270-a965-e49115228dd4 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:00:59.711846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d91364-15b1-4270-a965-e49115228dd4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:00:59.713585 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d1d91364-15b1-4270-a965-e49115228dd4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:00:59.725831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d91364-15b1-4270-a965-e49115228dd4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:00:59.727622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d91364-15b1-4270-a965-e49115228dd4 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:00:59.738466 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4524/9041] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:00:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:01:09.678486 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=71 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:01:09.733345 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=18 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:01:57.204399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aaa22d-77b4-45cf-a986-63022a555815 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:01:57.214367 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aaa22d-77b4-45cf-a986-63022a555815 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:01:57.219329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23db49-70f0-4cf2-9e11-2e73c0dcddc5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:01:57.219924 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23db49-70f0-4cf2-9e11-2e73c0dcddc5 service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:01:57.220211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23db49-70f0-4cf2-9e11-2e73c0dcddc5 service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:01:57.220487 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23db49-70f0-4cf2-9e11-2e73c0dcddc5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:01:57.222204 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6f23db49-70f0-4cf2-9e11-2e73c0dcddc5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:01:57.233760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23db49-70f0-4cf2-9e11-2e73c0dcddc5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:01:57.235368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23db49-70f0-4cf2-9e11-2e73c0dcddc5 service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:01:57.245578 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4518/9042] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:01:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:02:07.241609 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=6 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:03:05.567123 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d91364-15b1-4270-a965-e49115228dd4 service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:03:05.577554 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d91364-15b1-4270-a965-e49115228dd4 service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:03:05.581235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07b98a-2a60-4250-939e-f13b78757061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:03:05.581888 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07b98a-2a60-4250-939e-f13b78757061 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:03:05.582173 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07b98a-2a60-4250-939e-f13b78757061 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:03:05.582448 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07b98a-2a60-4250-939e-f13b78757061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:03:05.584177 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3c07b98a-2a60-4250-939e-f13b78757061 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:03:05.620451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c07b98a-2a60-4250-939e-f13b78757061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:03:05.621931 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c07b98a-2a60-4250-939e-f13b78757061 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:03:05.633261 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4525/9043] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:03:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:03:06.832865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23db49-70f0-4cf2-9e11-2e73c0dcddc5 service placement] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:03:06.834267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6f23db49-70f0-4cf2-9e11-2e73c0dcddc5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:03:06.845811 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23db49-70f0-4cf2-9e11-2e73c0dcddc5 service placement] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:03:06.849315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57689f-b9fe-4940-bc31-a2123ca1595d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:03:06.849935 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57689f-b9fe-4940-bc31-a2123ca1595d service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:03:06.850210 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57689f-b9fe-4940-bc31-a2123ca1595d service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:03:06.850477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57689f-b9fe-4940-bc31-a2123ca1595d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:03:06.852105 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-dd57689f-b9fe-4940-bc31-a2123ca1595d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:03:06.869085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57689f-b9fe-4940-bc31-a2123ca1595d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:03:06.871766 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57689f-b9fe-4940-bc31-a2123ca1595d service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:03:06.884591 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4519/9044] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:03:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:03:15.627991 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=14 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:03:16.878107 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=6 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:04:02.600847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07b98a-2a60-4250-939e-f13b78757061 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:04:02.610347 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07b98a-2a60-4250-939e-f13b78757061 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:04:02.614068 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d40b9-e6d7-42af-a99c-a80b6c1900ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:04:02.614679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d40b9-e6d7-42af-a99c-a80b6c1900ba service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:04:02.614961 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d40b9-e6d7-42af-a99c-a80b6c1900ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:04:02.615233 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d40b9-e6d7-42af-a99c-a80b6c1900ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:04:02.617010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-110d40b9-e6d7-42af-a99c-a80b6c1900ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:04:02.627805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110d40b9-e6d7-42af-a99c-a80b6c1900ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:04:02.629240 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110d40b9-e6d7-42af-a99c-a80b6c1900ba service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:04:02.638522 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4526/9045] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:04:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:04:12.633776 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:05:02.742917 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57689f-b9fe-4940-bc31-a2123ca1595d service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:05:02.754665 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57689f-b9fe-4940-bc31-a2123ca1595d service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:05:02.760140 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb83eb-4241-46aa-a1a9-7e2720018c27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:05:02.760764 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb83eb-4241-46aa-a1a9-7e2720018c27 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:05:02.761294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb83eb-4241-46aa-a1a9-7e2720018c27 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:05:02.761605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb83eb-4241-46aa-a1a9-7e2720018c27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:05:02.769609 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb83eb-4241-46aa-a1a9-7e2720018c27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:05:02.771183 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb83eb-4241-46aa-a1a9-7e2720018c27 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:05:02.779696 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4520/9046] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:05:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:05:03.918878 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d40b9-e6d7-42af-a99c-a80b6c1900ba service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:05:03.920568 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-110d40b9-e6d7-42af-a99c-a80b6c1900ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:05:03.937278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d40b9-e6d7-42af-a99c-a80b6c1900ba service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:05:03.943328 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd8420-b121-47cf-ba61-a7a0ff5d3353 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:05:03.943941 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd8420-b121-47cf-ba61-a7a0ff5d3353 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:05:03.944257 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd8420-b121-47cf-ba61-a7a0ff5d3353 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:05:03.945029 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd8420-b121-47cf-ba61-a7a0ff5d3353 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:05:03.946768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d8fd8420-b121-47cf-ba61-a7a0ff5d3353 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:05:03.961518 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd8420-b121-47cf-ba61-a7a0ff5d3353 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:05:03.963214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd8420-b121-47cf-ba61-a7a0ff5d3353 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:05:03.976514 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4527/9047] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:05:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:05:05.159565 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411e63e-39ee-468c-aa8b-a5b58415b3e6 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:05:05.160027 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411e63e-39ee-468c-aa8b-a5b58415b3e6 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:05:05.160134 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411e63e-39ee-468c-aa8b-a5b58415b3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:05:05.180050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-1411e63e-39ee-468c-aa8b-a5b58415b3e6 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:05:05.181234 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1411e63e-39ee-468c-aa8b-a5b58415b3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:05:05.188408 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4521/9048] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 02:05:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:05:05.228356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd8420-b121-47cf-ba61-a7a0ff5d3353 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:05:05.239484 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd8420-b121-47cf-ba61-a7a0ff5d3353 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:05:05.245216 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e13c4ef-f2c5-4a01-a9f8-b6fee5201087 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:05:05.246252 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13c4ef-f2c5-4a01-a9f8-b6fee5201087 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:05:05.246739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13c4ef-f2c5-4a01-a9f8-b6fee5201087 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:05:05.247243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13c4ef-f2c5-4a01-a9f8-b6fee5201087 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:05:05.256649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e13c4ef-f2c5-4a01-a9f8-b6fee5201087 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:05:05.258741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e13c4ef-f2c5-4a01-a9f8-b6fee5201087 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:05:05.266963 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4528/9049] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 02:05:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 02:05:05.737017 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88744957-8d3e-407f-9769-e8d49a6ddd76 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:05:05.737300 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88744957-8d3e-407f-9769-e8d49a6ddd76 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:05:05.737620 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88744957-8d3e-407f-9769-e8d49a6ddd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:05:05.757514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-88744957-8d3e-407f-9769-e8d49a6ddd76 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:05:05.758790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-88744957-8d3e-407f-9769-e8d49a6ddd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:05:05.766191 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4522/9050] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 02:05:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:05:05.778030 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e13c4ef-f2c5-4a01-a9f8-b6fee5201087 service swift] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:05:05.788886 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e13c4ef-f2c5-4a01-a9f8-b6fee5201087 service swift] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:05:05.793876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a27a4-0b97-41c4-a426-706cef1f28f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:05:05.794474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a27a4-0b97-41c4-a426-706cef1f28f6 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:05:05.794756 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a27a4-0b97-41c4-a426-706cef1f28f6 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:05:05.795063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a27a4-0b97-41c4-a426-706cef1f28f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:05:05.803064 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a27a4-0b97-41c4-a426-706cef1f28f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:05:05.805250 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a27a4-0b97-41c4-a426-706cef1f28f6 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:05:05.813770 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4529/9051] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 02:05:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 02:05:14.214776 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef9db5-781c-4698-873b-9df6c3e4f03b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:05:14.215259 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef9db5-781c-4698-873b-9df6c3e4f03b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:05:14.215356 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef9db5-781c-4698-873b-9df6c3e4f03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:05:14.234013 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-5aef9db5-781c-4698-873b-9df6c3e4f03b None None] MFA Rules not processed for user `a8618ff1f93340debc7b7e7bc22dcdc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:05:14.235204 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5aef9db5-781c-4698-873b-9df6c3e4f03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:05:14.241944 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4523/9052] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 02:05:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:05:14.501263 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a27a4-0b97-41c4-a426-706cef1f28f6 service swift] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:05:14.520408 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a27a4-0b97-41c4-a426-706cef1f28f6 service swift] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:05:14.524529 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9686c-22cd-4d37-95fb-751e83e40e33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:05:14.525178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9686c-22cd-4d37-95fb-751e83e40e33 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:05:14.525410 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9686c-22cd-4d37-95fb-751e83e40e33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:05:14.525719 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9686c-22cd-4d37-95fb-751e83e40e33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:05:14.527418 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-53a9686c-22cd-4d37-95fb-751e83e40e33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:05:14.536624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a9686c-22cd-4d37-95fb-751e83e40e33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:05:14.538654 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a9686c-22cd-4d37-95fb-751e83e40e33 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:05:14.546291 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4530/9053] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:05:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:05:14.861866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd1bfb-9edf-4068-8061-b3bac2e39e1a None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:05:14.862307 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd1bfb-9edf-4068-8061-b3bac2e39e1a None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:05:14.862598 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd1bfb-9edf-4068-8061-b3bac2e39e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:05:14.883346 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-03cd1bfb-9edf-4068-8061-b3bac2e39e1a None None] MFA Rules not processed for user `f908fda75ef8440cb6a0ef9440127d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:05:14.884694 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-03cd1bfb-9edf-4068-8061-b3bac2e39e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:05:14.907990 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4524/9054] 10.222.0.30 () {58 vars in 1058 bytes} [Sun Sep 4 02:05:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:05:14.914608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9686c-22cd-4d37-95fb-751e83e40e33 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:05:14.926867 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9686c-22cd-4d37-95fb-751e83e40e33 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:05:14.931810 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d06573-6cb8-4bd2-bf3d-3a60db572439 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:05:14.932393 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d06573-6cb8-4bd2-bf3d-3a60db572439 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:05:14.932671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d06573-6cb8-4bd2-bf3d-3a60db572439 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:05:14.932938 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d06573-6cb8-4bd2-bf3d-3a60db572439 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:05:14.934728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e5d06573-6cb8-4bd2-bf3d-3a60db572439 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:05:14.946649 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d06573-6cb8-4bd2-bf3d-3a60db572439 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:05:14.948306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d06573-6cb8-4bd2-bf3d-3a60db572439 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:05:14.960671 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4531/9055] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:05:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:05:16.255393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbf505-4f99-46f2-a77e-8448b126f7ae None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:05:16.255856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbf505-4f99-46f2-a77e-8448b126f7ae None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:05:16.256023 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbf505-4f99-46f2-a77e-8448b126f7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:05:16.278625 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-2bdbf505-4f99-46f2-a77e-8448b126f7ae None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:05:16.279840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2bdbf505-4f99-46f2-a77e-8448b126f7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:05:16.287282 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4525/9056] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 02:05:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:05:16.298911 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d06573-6cb8-4bd2-bf3d-3a60db572439 service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:05:16.310707 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d06573-6cb8-4bd2-bf3d-3a60db572439 service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:05:16.315777 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446a1b2-9e64-4956-9281-aa292dc93533 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:05:16.316396 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446a1b2-9e64-4956-9281-aa292dc93533 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:05:16.316659 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446a1b2-9e64-4956-9281-aa292dc93533 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:05:16.316930 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446a1b2-9e64-4956-9281-aa292dc93533 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:05:16.325639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446a1b2-9e64-4956-9281-aa292dc93533 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:05:16.327214 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446a1b2-9e64-4956-9281-aa292dc93533 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:05:16.336043 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4532/9057] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 02:05:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 02:05:24.333249 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbf505-4f99-46f2-a77e-8448b126f7ae None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:05:24.343362 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbf505-4f99-46f2-a77e-8448b126f7ae None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:05:24.347418 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72699c-a6a5-4ca4-b709-a40238326b6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:05:24.348322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72699c-a6a5-4ca4-b709-a40238326b6f service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:05:24.348606 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72699c-a6a5-4ca4-b709-a40238326b6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:05:24.348876 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72699c-a6a5-4ca4-b709-a40238326b6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:05:24.350740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ef72699c-a6a5-4ca4-b709-a40238326b6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:05:24.360555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef72699c-a6a5-4ca4-b709-a40238326b6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:05:24.362044 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef72699c-a6a5-4ca4-b709-a40238326b6f service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:05:24.370541 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4526/9058] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:05:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:05:26.332056 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=40 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:05:31.609822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446a1b2-9e64-4956-9281-aa292dc93533 service swift] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:05:31.624050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446a1b2-9e64-4956-9281-aa292dc93533 service swift] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:05:31.629498 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ddd2a-ffb1-4cfb-861b-fa994f355b5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:05:31.630104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ddd2a-ffb1-4cfb-861b-fa994f355b5f service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:05:31.630385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ddd2a-ffb1-4cfb-861b-fa994f355b5f service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:05:31.630658 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ddd2a-ffb1-4cfb-861b-fa994f355b5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:05:31.632386 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0a2ddd2a-ffb1-4cfb-861b-fa994f355b5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:05:31.645229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ddd2a-ffb1-4cfb-861b-fa994f355b5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:05:31.646856 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ddd2a-ffb1-4cfb-861b-fa994f355b5f service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:05:31.657901 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4533/9059] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:05:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:05:34.366612 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=31 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:05:41.653657 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:06:04.579857 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72699c-a6a5-4ca4-b709-a40238326b6f service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:06:04.592784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72699c-a6a5-4ca4-b709-a40238326b6f service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:06:04.597706 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b254b-2b05-422d-b092-752858ad774c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:06:04.598302 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b254b-2b05-422d-b092-752858ad774c service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:06:04.598580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b254b-2b05-422d-b092-752858ad774c service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:06:04.598848 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b254b-2b05-422d-b092-752858ad774c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:06:04.607620 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b254b-2b05-422d-b092-752858ad774c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:06:04.609185 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b254b-2b05-422d-b092-752858ad774c service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:06:04.618959 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4527/9060] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:06:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:06:14.614839 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=6 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:06:50.481542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ddd2a-ffb1-4cfb-861b-fa994f355b5f service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:06:50.504456 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ddd2a-ffb1-4cfb-861b-fa994f355b5f service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:06:50.511011 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e725d6-79f4-4a6a-88df-6ff802e59d54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:06:50.512146 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e725d6-79f4-4a6a-88df-6ff802e59d54 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:06:50.512432 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e725d6-79f4-4a6a-88df-6ff802e59d54 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:06:50.512761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e725d6-79f4-4a6a-88df-6ff802e59d54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:06:50.522901 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e725d6-79f4-4a6a-88df-6ff802e59d54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:06:50.524651 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e725d6-79f4-4a6a-88df-6ff802e59d54 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:06:50.537607 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4534/9061] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:06:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:07:00.532977 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=10 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:07:04.199315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b254b-2b05-422d-b092-752858ad774c service placement] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:07:04.211004 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b254b-2b05-422d-b092-752858ad774c service placement] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:07:04.216364 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32fee3-2ca7-44e1-a2b0-19007bd7d1b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:07:04.216978 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32fee3-2ca7-44e1-a2b0-19007bd7d1b3 service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:07:04.217301 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32fee3-2ca7-44e1-a2b0-19007bd7d1b3 service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:07:04.217603 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32fee3-2ca7-44e1-a2b0-19007bd7d1b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:07:04.227494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d32fee3-2ca7-44e1-a2b0-19007bd7d1b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:07:04.228982 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d32fee3-2ca7-44e1-a2b0-19007bd7d1b3 service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:07:04.232202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728e3c6-dd06-41af-ab5e-133cb1960ad1 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:07:04.232693 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728e3c6-dd06-41af-ab5e-133cb1960ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:07:04.232789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728e3c6-dd06-41af-ab5e-133cb1960ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:07:04.239833 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4528/9062] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:07:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:07:04.254689 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e728e3c6-dd06-41af-ab5e-133cb1960ad1 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:07:04.255761 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e728e3c6-dd06-41af-ab5e-133cb1960ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:07:04.263504 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4535/9063] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 02:07:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 02:07:04.305794 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32fee3-2ca7-44e1-a2b0-19007bd7d1b3 service placement] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:07:04.316939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32fee3-2ca7-44e1-a2b0-19007bd7d1b3 service placement] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:07:04.321984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb53b16-2a7d-47b5-91fe-339ec2a18512 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:07:04.322579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb53b16-2a7d-47b5-91fe-339ec2a18512 service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:07:04.322921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb53b16-2a7d-47b5-91fe-339ec2a18512 service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:07:04.323286 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb53b16-2a7d-47b5-91fe-339ec2a18512 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:07:04.332087 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb53b16-2a7d-47b5-91fe-339ec2a18512 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:07:04.333875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb53b16-2a7d-47b5-91fe-339ec2a18512 service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:07:04.342792 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4529/9064] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 02:07:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 02:07:04.693971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728e3c6-dd06-41af-ab5e-133cb1960ad1 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:07:04.703584 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728e3c6-dd06-41af-ab5e-133cb1960ad1 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:07:04.707315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f4383-6f88-4d40-8251-0b1e2b09af3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:07:04.707984 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f4383-6f88-4d40-8251-0b1e2b09af3c service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:07:04.708261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f4383-6f88-4d40-8251-0b1e2b09af3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:07:04.708528 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f4383-6f88-4d40-8251-0b1e2b09af3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:07:04.777860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f4383-6f88-4d40-8251-0b1e2b09af3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:07:04.779281 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f4383-6f88-4d40-8251-0b1e2b09af3c service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:07:04.798578 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4536/9065] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:07:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:07:07.907054 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da948737-bc1e-4100-bab0-f1eb10437894 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:07:07.907594 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da948737-bc1e-4100-bab0-f1eb10437894 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:07:07.907717 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da948737-bc1e-4100-bab0-f1eb10437894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:07:07.929846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-da948737-bc1e-4100-bab0-f1eb10437894 None None] MFA Rules not processed for user `f908fda75ef8440cb6a0ef9440127d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:07:07.931050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-da948737-bc1e-4100-bab0-f1eb10437894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:07:07.939684 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4530/9066] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Sep 4 02:07:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:07:07.951772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f4383-6f88-4d40-8251-0b1e2b09af3c service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:07:07.963120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f4383-6f88-4d40-8251-0b1e2b09af3c service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:07:07.969401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01446f-0eb8-4692-a7c7-bc1f17bed35a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:07:07.970106 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01446f-0eb8-4692-a7c7-bc1f17bed35a service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:07:07.970386 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01446f-0eb8-4692-a7c7-bc1f17bed35a service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:07:07.970858 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01446f-0eb8-4692-a7c7-bc1f17bed35a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:07:07.980534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01446f-0eb8-4692-a7c7-bc1f17bed35a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:07:07.982155 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01446f-0eb8-4692-a7c7-bc1f17bed35a service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:07:07.994897 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4537/9067] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:07:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:07:10.907658 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac629ed9-80f5-4c96-b421-0eb6f9ed79cf None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:07:10.908222 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac629ed9-80f5-4c96-b421-0eb6f9ed79cf None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:07:10.908305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac629ed9-80f5-4c96-b421-0eb6f9ed79cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:07:10.933914 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ac629ed9-80f5-4c96-b421-0eb6f9ed79cf None None] MFA Rules not processed for user `f908fda75ef8440cb6a0ef9440127d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:07:10.935656 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ac629ed9-80f5-4c96-b421-0eb6f9ed79cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:07:10.949641 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4531/9068] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Sep 4 02:07:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:07:10.969293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01446f-0eb8-4692-a7c7-bc1f17bed35a service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:07:10.980976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01446f-0eb8-4692-a7c7-bc1f17bed35a service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:07:10.987218 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb55d0-1ef8-4d93-b202-c1fc5562ceb7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:07:10.988033 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb55d0-1ef8-4d93-b202-c1fc5562ceb7 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:07:10.988413 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb55d0-1ef8-4d93-b202-c1fc5562ceb7 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:07:10.988918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb55d0-1ef8-4d93-b202-c1fc5562ceb7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:07:10.998875 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb55d0-1ef8-4d93-b202-c1fc5562ceb7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:07:11.001842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb55d0-1ef8-4d93-b202-c1fc5562ceb7 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:07:11.004203 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac629ed9-80f5-4c96-b421-0eb6f9ed79cf None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:07:11.013115 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4538/9069] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:07:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:07:11.020295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac629ed9-80f5-4c96-b421-0eb6f9ed79cf None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:07:11.026526 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c039611-f87f-455a-9ba3-03324351c035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:07:11.027195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c039611-f87f-455a-9ba3-03324351c035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:07:11.027869 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c039611-f87f-455a-9ba3-03324351c035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:07:11.028154 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c039611-f87f-455a-9ba3-03324351c035 admin admin] PATH_INFO: `/v3/users/a8618ff1f93340debc7b7e7bc22dcdc1` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:07:11.029368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c039611-f87f-455a-9ba3-03324351c035 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8618ff1f93340debc7b7e7bc22dcdc1)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:07:11.031354 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c039611-f87f-455a-9ba3-03324351c035 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:07:11.078555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5c039611-f87f-455a-9ba3-03324351c035 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8618ff1f93340debc7b7e7bc22dcdc1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:07:11.079226 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5c039611-f87f-455a-9ba3-03324351c035 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8618ff1f93340debc7b7e7bc22dcdc1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:07:11.086658 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5c039611-f87f-455a-9ba3-03324351c035 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8618ff1f93340debc7b7e7bc22dcdc1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:07:11.094572 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5c039611-f87f-455a-9ba3-03324351c035 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8618ff1f93340debc7b7e7bc22dcdc1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:07:11.095255 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-5c039611-f87f-455a-9ba3-03324351c035 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8618ff1f93340debc7b7e7bc22dcdc1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:07:11.117189 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4532/9070] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 02:07:11 2022] DELETE /identity/v3/users/a8618ff1f93340debc7b7e7bc22dcdc1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 02:07:11.297904 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb55d0-1ef8-4d93-b202-c1fc5562ceb7 service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:07:11.309206 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb55d0-1ef8-4d93-b202-c1fc5562ceb7 service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:07:11.368261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd616432-40ed-4cb9-8bcb-bd45472c53aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:07:11.368924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd616432-40ed-4cb9-8bcb-bd45472c53aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:07:11.369201 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd616432-40ed-4cb9-8bcb-bd45472c53aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:07:11.369501 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd616432-40ed-4cb9-8bcb-bd45472c53aa admin admin] PATH_INFO: `/v3/projects/2509f82fd5744911bdea0b7e8cf4c0ba` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:07:11.370609 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd616432-40ed-4cb9-8bcb-bd45472c53aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=2509f82fd5744911bdea0b7e8cf4c0ba)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:07:11.372520 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd616432-40ed-4cb9-8bcb-bd45472c53aa admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:07:11.415689 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:07:11.419754 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dd616432-40ed-4cb9-8bcb-bd45472c53aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2509f82fd5744911bdea0b7e8cf4c0ba', 'request_id': 'req-dd616432-40ed-4cb9-8bcb-bd45472c53aa'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:07:11.429752 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dd616432-40ed-4cb9-8bcb-bd45472c53aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2509f82fd5744911bdea0b7e8cf4c0ba', 'request_id': 'req-dd616432-40ed-4cb9-8bcb-bd45472c53aa'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:07:11.435426 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dd616432-40ed-4cb9-8bcb-bd45472c53aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2509f82fd5744911bdea0b7e8cf4c0ba', 'request_id': 'req-dd616432-40ed-4cb9-8bcb-bd45472c53aa'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:07:11.466308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dd616432-40ed-4cb9-8bcb-bd45472c53aa admin admin] The token cache is being invalidate because project 2509f82fd5744911bdea0b7e8cf4c0ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 02:07:11.466600 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dd616432-40ed-4cb9-8bcb-bd45472c53aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:07:11.467237 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-dd616432-40ed-4cb9-8bcb-bd45472c53aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:07:11.468743 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4539/9071] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 02:07:11 2022] DELETE /identity/v3/projects/2509f82fd5744911bdea0b7e8cf4c0ba => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 02:07:11.472790 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c039611-f87f-455a-9ba3-03324351c035 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:07:11.474261 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5c039611-f87f-455a-9ba3-03324351c035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:07:11.487759 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c039611-f87f-455a-9ba3-03324351c035 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:07:11.548796 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e83a46-2d89-4d95-85b9-e1aeabe23058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:07:11.549583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e83a46-2d89-4d95-85b9-e1aeabe23058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:07:11.549936 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e83a46-2d89-4d95-85b9-e1aeabe23058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:07:11.550285 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e83a46-2d89-4d95-85b9-e1aeabe23058 admin admin] PATH_INFO: `/v3/users/027384d151af497b98e3fafb6bf52cc6` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:07:11.551457 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e83a46-2d89-4d95-85b9-e1aeabe23058 admin admin] RBAC: Authorizing `identity:delete_user(user_id=027384d151af497b98e3fafb6bf52cc6)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:07:11.553401 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e83a46-2d89-4d95-85b9-e1aeabe23058 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:07:11.590893 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:07:11.601840 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-05e83a46-2d89-4d95-85b9-e1aeabe23058 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '027384d151af497b98e3fafb6bf52cc6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:07:11.602619 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-05e83a46-2d89-4d95-85b9-e1aeabe23058 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '027384d151af497b98e3fafb6bf52cc6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:07:11.609622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-05e83a46-2d89-4d95-85b9-e1aeabe23058 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '027384d151af497b98e3fafb6bf52cc6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:07:11.617103 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-05e83a46-2d89-4d95-85b9-e1aeabe23058 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '027384d151af497b98e3fafb6bf52cc6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:07:11.617762 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-05e83a46-2d89-4d95-85b9-e1aeabe23058 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '027384d151af497b98e3fafb6bf52cc6'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:07:11.635504 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4533/9072] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 02:07:11 2022] DELETE /identity/v3/users/027384d151af497b98e3fafb6bf52cc6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 02:07:11.809269 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd616432-40ed-4cb9-8bcb-bd45472c53aa admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:07:11.810916 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-dd616432-40ed-4cb9-8bcb-bd45472c53aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:07:11.824520 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd616432-40ed-4cb9-8bcb-bd45472c53aa admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:07:11.882842 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d8b72-a9e5-4dc3-bc22-f086d99c80a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:07:11.883487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d8b72-a9e5-4dc3-bc22-f086d99c80a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:07:11.883768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d8b72-a9e5-4dc3-bc22-f086d99c80a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:07:11.884107 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d8b72-a9e5-4dc3-bc22-f086d99c80a4 admin admin] PATH_INFO: `/v3/projects/0bcd73e6fe654a7ea0fbe85de84b0afa` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:07:11.885262 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d8b72-a9e5-4dc3-bc22-f086d99c80a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bcd73e6fe654a7ea0fbe85de84b0afa)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:07:11.887583 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d8b72-a9e5-4dc3-bc22-f086d99c80a4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:07:11.933369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-db9d8b72-a9e5-4dc3-bc22-f086d99c80a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bcd73e6fe654a7ea0fbe85de84b0afa', 'request_id': 'req-db9d8b72-a9e5-4dc3-bc22-f086d99c80a4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:07:11.940500 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-db9d8b72-a9e5-4dc3-bc22-f086d99c80a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bcd73e6fe654a7ea0fbe85de84b0afa', 'request_id': 'req-db9d8b72-a9e5-4dc3-bc22-f086d99c80a4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:07:11.946567 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-db9d8b72-a9e5-4dc3-bc22-f086d99c80a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bcd73e6fe654a7ea0fbe85de84b0afa', 'request_id': 'req-db9d8b72-a9e5-4dc3-bc22-f086d99c80a4'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:07:11.957543 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-db9d8b72-a9e5-4dc3-bc22-f086d99c80a4 admin admin] The token cache is being invalidate because project 0bcd73e6fe654a7ea0fbe85de84b0afa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 02:07:11.957833 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-db9d8b72-a9e5-4dc3-bc22-f086d99c80a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:07:11.958831 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-db9d8b72-a9e5-4dc3-bc22-f086d99c80a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:07:11.960938 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4540/9073] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 02:07:11 2022] DELETE /identity/v3/projects/0bcd73e6fe654a7ea0fbe85de84b0afa => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 02:07:11.966100 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae058c1-8cb9-424a-9a9c-8c4c4c441c43 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:07:11.966586 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae058c1-8cb9-424a-9a9c-8c4c4c441c43 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:07:11.966685 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae058c1-8cb9-424a-9a9c-8c4c4c441c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:07:12.019046 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-5ae058c1-8cb9-424a-9a9c-8c4c4c441c43 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:07:12.020282 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5ae058c1-8cb9-424a-9a9c-8c4c4c441c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:07:12.078450 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4534/9074] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 02:07:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:07:12.087082 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75554ca-e2ac-40b8-b1f3-dbb7af0bfb42 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:07:12.087599 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75554ca-e2ac-40b8-b1f3-dbb7af0bfb42 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:07:12.087735 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75554ca-e2ac-40b8-b1f3-dbb7af0bfb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:07:12.107154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-f75554ca-e2ac-40b8-b1f3-dbb7af0bfb42 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:07:12.108346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f75554ca-e2ac-40b8-b1f3-dbb7af0bfb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:07:12.117396 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4541/9075] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 02:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:07:12.121608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae058c1-8cb9-424a-9a9c-8c4c4c441c43 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:07:12.131138 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae058c1-8cb9-424a-9a9c-8c4c4c441c43 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:07:12.136331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203776a6-f2d6-4a2c-89b1-cdac786f621d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:07:12.137200 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203776a6-f2d6-4a2c-89b1-cdac786f621d admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:07:12.137517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203776a6-f2d6-4a2c-89b1-cdac786f621d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:07:12.137874 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203776a6-f2d6-4a2c-89b1-cdac786f621d admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:07:12.138452 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203776a6-f2d6-4a2c-89b1-cdac786f621d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 02:07:12.138757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203776a6-f2d6-4a2c-89b1-cdac786f621d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:07:12.140353 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203776a6-f2d6-4a2c-89b1-cdac786f621d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:07:12.152061 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4535/9076] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 02:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 04 02:07:12.156388 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75554ca-e2ac-40b8-b1f3-dbb7af0bfb42 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:07:12.165697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75554ca-e2ac-40b8-b1f3-dbb7af0bfb42 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:07:12.170342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c416acc-2d7e-452a-9bea-e3ea7006c1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:07:12.170936 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c416acc-2d7e-452a-9bea-e3ea7006c1a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:07:12.171216 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c416acc-2d7e-452a-9bea-e3ea7006c1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:07:12.171487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c416acc-2d7e-452a-9bea-e3ea7006c1a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:07:12.172113 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c416acc-2d7e-452a-9bea-e3ea7006c1a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:07:12.174088 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c416acc-2d7e-452a-9bea-e3ea7006c1a1 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:07:12.210804 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4542/9077] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 02:07:12 2022] POST /identity/v3/projects => generated 393 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 02:07:12.215129 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203776a6-f2d6-4a2c-89b1-cdac786f621d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:07:12.225053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203776a6-f2d6-4a2c-89b1-cdac786f621d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:07:12.283577 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ddf6d9-7604-447c-b38b-140568715920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:07:12.284182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddf6d9-7604-447c-b38b-140568715920 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:07:12.284458 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddf6d9-7604-447c-b38b-140568715920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:07:12.284727 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddf6d9-7604-447c-b38b-140568715920 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:07:12.285363 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ddf6d9-7604-447c-b38b-140568715920 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:07:12.287319 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ddf6d9-7604-447c-b38b-140568715920 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:07:12.310264 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4536/9078] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 02:07:12 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 02:07:12.314531 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c416acc-2d7e-452a-9bea-e3ea7006c1a1 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:07:12.325427 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c416acc-2d7e-452a-9bea-e3ea7006c1a1 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:07:12.330154 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7a3c3-fc55-496c-8416-1ec82d3be4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:07:12.330759 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7a3c3-fc55-496c-8416-1ec82d3be4e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:07:12.331039 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7a3c3-fc55-496c-8416-1ec82d3be4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:07:12.331311 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7a3c3-fc55-496c-8416-1ec82d3be4e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:07:12.331948 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7a3c3-fc55-496c-8416-1ec82d3be4e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:07:12.333576 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7a3c3-fc55-496c-8416-1ec82d3be4e3 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:07:12.343563 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4543/9079] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 02:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 04 02:07:12.347951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ddf6d9-7604-447c-b38b-140568715920 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:07:12.359011 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ddf6d9-7604-447c-b38b-140568715920 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:07:12.363652 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f2e8c-3fb1-4518-be07-76f2a39e2e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:07:12.364256 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f2e8c-3fb1-4518-be07-76f2a39e2e10 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:07:12.364541 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f2e8c-3fb1-4518-be07-76f2a39e2e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:07:12.364818 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f2e8c-3fb1-4518-be07-76f2a39e2e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:07:12.365490 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f2e8c-3fb1-4518-be07-76f2a39e2e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:07:12.367746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f2e8c-3fb1-4518-be07-76f2a39e2e10 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:07:12.368998 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:07:12.385936 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4537/9080] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 02:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 02:07:12.387419 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7a3c3-fc55-496c-8416-1ec82d3be4e3 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:07:12.393830 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:07:12.397679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7a3c3-fc55-496c-8416-1ec82d3be4e3 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:07:12.403866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb263558-ced7-41d1-a5d1-585c104e811d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:07:12.404527 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb263558-ced7-41d1-a5d1-585c104e811d admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:07:12.404978 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb263558-ced7-41d1-a5d1-585c104e811d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:07:12.405391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb263558-ced7-41d1-a5d1-585c104e811d admin admin] PATH_INFO: `/v3/projects/43abbac4c8964413ac462eeb9ca00a27/users/8b0dd7a3450d4c65930854f7d2810e74/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:07:12.420960 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb263558-ced7-41d1-a5d1-585c104e811d admin admin] RBAC: Authorizing `identity:create_grant(project_id=43abbac4c8964413ac462eeb9ca00a27, user_id=8b0dd7a3450d4c65930854f7d2810e74, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:07:12.423650 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb263558-ced7-41d1-a5d1-585c104e811d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:07:12.436384 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4544/9081] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 02:07:12 2022] PUT /identity/v3/projects/43abbac4c8964413ac462eeb9ca00a27/users/8b0dd7a3450d4c65930854f7d2810e74/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 02:07:12.446368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ddd4f-1b4b-48ef-9a2c-b9edd1775060 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:07:12.446654 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ddd4f-1b4b-48ef-9a2c-b9edd1775060 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:07:12.446930 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ddd4f-1b4b-48ef-9a2c-b9edd1775060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:07:12.474227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-7e1ddd4f-1b4b-48ef-9a2c-b9edd1775060 None None] MFA Rules not processed for user `8b0dd7a3450d4c65930854f7d2810e74`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:07:12.475933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7e1ddd4f-1b4b-48ef-9a2c-b9edd1775060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:07:12.539018 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4538/9082] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 02:07:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:07:12.543552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb263558-ced7-41d1-a5d1-585c104e811d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:07:12.604896 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb263558-ced7-41d1-a5d1-585c104e811d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:07:12.609592 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da70c43-27ce-44fd-bb48-9e61e46af73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:07:12.610196 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da70c43-27ce-44fd-bb48-9e61e46af73d admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:07:12.610473 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da70c43-27ce-44fd-bb48-9e61e46af73d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:07:12.610746 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da70c43-27ce-44fd-bb48-9e61e46af73d admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:07:12.611379 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da70c43-27ce-44fd-bb48-9e61e46af73d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:07:12.613295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da70c43-27ce-44fd-bb48-9e61e46af73d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:07:12.639803 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4545/9083] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 02:07:12 2022] POST /identity/v3/projects => generated 391 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 02:07:12.644058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ddd4f-1b4b-48ef-9a2c-b9edd1775060 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:07:12.654410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ddd4f-1b4b-48ef-9a2c-b9edd1775060 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:07:12.710321 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32a749-6dde-4f86-b27a-18f3d4bc797e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:07:12.710912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32a749-6dde-4f86-b27a-18f3d4bc797e admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:07:12.711189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32a749-6dde-4f86-b27a-18f3d4bc797e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:07:12.711462 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32a749-6dde-4f86-b27a-18f3d4bc797e admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:07:12.712077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32a749-6dde-4f86-b27a-18f3d4bc797e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:07:12.714006 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32a749-6dde-4f86-b27a-18f3d4bc797e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:07:12.737458 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4539/9084] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 02:07:12 2022] POST /identity/v3/users => generated 302 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 02:07:12.738740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da70c43-27ce-44fd-bb48-9e61e46af73d admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:07:12.749307 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da70c43-27ce-44fd-bb48-9e61e46af73d admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:07:12.754002 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba20665-8bf4-4039-9f61-c128d79b7436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:07:12.754589 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba20665-8bf4-4039-9f61-c128d79b7436 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:07:12.754866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba20665-8bf4-4039-9f61-c128d79b7436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:07:12.755136 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba20665-8bf4-4039-9f61-c128d79b7436 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:07:12.755764 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba20665-8bf4-4039-9f61-c128d79b7436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:07:12.758033 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba20665-8bf4-4039-9f61-c128d79b7436 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:07:12.768559 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4546/9085] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 02:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 02:07:12.772591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32a749-6dde-4f86-b27a-18f3d4bc797e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:07:12.782278 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32a749-6dde-4f86-b27a-18f3d4bc797e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:07:12.786829 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f7e09-2683-4625-9a21-c0b0b4e9436d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:07:12.787494 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f7e09-2683-4625-9a21-c0b0b4e9436d admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:07:12.787772 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f7e09-2683-4625-9a21-c0b0b4e9436d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:07:12.788041 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f7e09-2683-4625-9a21-c0b0b4e9436d admin admin] PATH_INFO: `/v3/projects/8c7d6f6c71524f7f837d85fc373ed771/users/302acfd64c3447d6a86ec1d53914603b/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:07:12.803983 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f7e09-2683-4625-9a21-c0b0b4e9436d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c7d6f6c71524f7f837d85fc373ed771, user_id=302acfd64c3447d6a86ec1d53914603b, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:07:12.806828 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f7e09-2683-4625-9a21-c0b0b4e9436d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:07:12.819954 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4540/9086] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 02:07:12 2022] PUT /identity/v3/projects/8c7d6f6c71524f7f837d85fc373ed771/users/302acfd64c3447d6a86ec1d53914603b/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 02:07:12.823862 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba20665-8bf4-4039-9f61-c128d79b7436 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:07:12.833714 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba20665-8bf4-4039-9f61-c128d79b7436 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:07:12.889522 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd461035-9a32-4d10-b03b-134b37c29f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:07:12.890122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd461035-9a32-4d10-b03b-134b37c29f14 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:07:12.890403 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd461035-9a32-4d10-b03b-134b37c29f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:07:12.890679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd461035-9a32-4d10-b03b-134b37c29f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:07:12.891309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd461035-9a32-4d10-b03b-134b37c29f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:07:12.892893 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd461035-9a32-4d10-b03b-134b37c29f14 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:07:12.902554 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4547/9087] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 02:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 02:07:12.906524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f7e09-2683-4625-9a21-c0b0b4e9436d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:07:12.916714 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f7e09-2683-4625-9a21-c0b0b4e9436d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:07:12.921304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb6dbf-5b07-4806-b14e-80297059cb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:07:12.921979 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb6dbf-5b07-4806-b14e-80297059cb00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:07:12.922262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb6dbf-5b07-4806-b14e-80297059cb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:07:12.922537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb6dbf-5b07-4806-b14e-80297059cb00 admin admin] PATH_INFO: `/v3/projects/8c7d6f6c71524f7f837d85fc373ed771/users/302acfd64c3447d6a86ec1d53914603b/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:07:12.924451 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb6dbf-5b07-4806-b14e-80297059cb00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c7d6f6c71524f7f837d85fc373ed771, user_id=302acfd64c3447d6a86ec1d53914603b, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:07:12.927123 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb6dbf-5b07-4806-b14e-80297059cb00 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:07:12.937680 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4541/9088] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 02:07:12 2022] PUT /identity/v3/projects/8c7d6f6c71524f7f837d85fc373ed771/users/302acfd64c3447d6a86ec1d53914603b/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 02:07:12.947860 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa61aef-7a63-47d1-8e69-c0d0bbf12512 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:07:12.948150 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa61aef-7a63-47d1-8e69-c0d0bbf12512 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:07:12.948427 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa61aef-7a63-47d1-8e69-c0d0bbf12512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:07:12.975289 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-daa61aef-7a63-47d1-8e69-c0d0bbf12512 None None] MFA Rules not processed for user `302acfd64c3447d6a86ec1d53914603b`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:07:12.976489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-daa61aef-7a63-47d1-8e69-c0d0bbf12512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:07:13.017237 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:07:13.046353 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4548/9089] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 02:07:12 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:07:13.060408 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb6dbf-5b07-4806-b14e-80297059cb00 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:07:13.062118 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d8cb6dbf-5b07-4806-b14e-80297059cb00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:07:13.105106 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:07:13.137761 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb6dbf-5b07-4806-b14e-80297059cb00 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:07:13.143341 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b301b2-db53-47b1-a393-a317004fdbf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:07:13.143949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b301b2-db53-47b1-a393-a317004fdbf7 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:07:13.144239 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b301b2-db53-47b1-a393-a317004fdbf7 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:07:13.144517 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b301b2-db53-47b1-a393-a317004fdbf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:07:13.199433 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b301b2-db53-47b1-a393-a317004fdbf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:07:13.200985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b301b2-db53-47b1-a393-a317004fdbf7 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:07:13.210409 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4542/9090] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:07:13 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:07:16.217451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa61aef-7a63-47d1-8e69-c0d0bbf12512 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:07:16.218915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-daa61aef-7a63-47d1-8e69-c0d0bbf12512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:07:16.277156 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa61aef-7a63-47d1-8e69-c0d0bbf12512 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:07:16.280767 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301882ea-337b-4afc-9cf2-3df31227c179 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:07:16.281379 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301882ea-337b-4afc-9cf2-3df31227c179 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:07:16.281722 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301882ea-337b-4afc-9cf2-3df31227c179 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:07:16.281996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301882ea-337b-4afc-9cf2-3df31227c179 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:07:16.291610 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301882ea-337b-4afc-9cf2-3df31227c179 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:07:16.293054 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301882ea-337b-4afc-9cf2-3df31227c179 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:07:16.302884 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4549/9091] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:07:16 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:07:19.038854 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8078c19-b21d-43a7-9722-0b27824d098b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:07:19.039380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8078c19-b21d-43a7-9722-0b27824d098b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:07:19.039380 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8078c19-b21d-43a7-9722-0b27824d098b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:07:19.061195 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-d8078c19-b21d-43a7-9722-0b27824d098b None None] MFA Rules not processed for user `8b0dd7a3450d4c65930854f7d2810e74`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:07:19.062445 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d8078c19-b21d-43a7-9722-0b27824d098b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:07:19.070478 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4543/9092] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 02:07:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:07:19.857202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301882ea-337b-4afc-9cf2-3df31227c179 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:07:19.863681 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-301882ea-337b-4afc-9cf2-3df31227c179 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:07:20.005287 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301882ea-337b-4afc-9cf2-3df31227c179 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:07:20.012728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e76a9-86a2-40a3-bbc9-bafc6428ae58 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:07:20.013537 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e76a9-86a2-40a3-bbc9-bafc6428ae58 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:07:20.013922 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e76a9-86a2-40a3-bbc9-bafc6428ae58 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:07:20.014462 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e76a9-86a2-40a3-bbc9-bafc6428ae58 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:07:20.017074 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-175e76a9-86a2-40a3-bbc9-bafc6428ae58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:07:20.042515 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e76a9-86a2-40a3-bbc9-bafc6428ae58 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:07:20.044169 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e76a9-86a2-40a3-bbc9-bafc6428ae58 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:07:20.057098 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4550/9093] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:07:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:07:29.054612 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=42 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:07:30.050967 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=69 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:08:39.447313 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8078c19-b21d-43a7-9722-0b27824d098b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:08:39.448957 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d8078c19-b21d-43a7-9722-0b27824d098b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:08:39.473308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8078c19-b21d-43a7-9722-0b27824d098b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:08:39.477499 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161256b-0cf3-415f-8708-b039f5af130d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:08:39.478106 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161256b-0cf3-415f-8708-b039f5af130d service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:08:39.478390 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161256b-0cf3-415f-8708-b039f5af130d service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:08:39.478662 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161256b-0cf3-415f-8708-b039f5af130d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:08:39.480359 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-4161256b-0cf3-415f-8708-b039f5af130d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:08:39.519795 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161256b-0cf3-415f-8708-b039f5af130d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:08:39.521254 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161256b-0cf3-415f-8708-b039f5af130d service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:08:39.531881 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4544/9094] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:08:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:08:40.721461 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e76a9-86a2-40a3-bbc9-bafc6428ae58 service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:08:40.733616 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e76a9-86a2-40a3-bbc9-bafc6428ae58 service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:08:40.737227 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01213ceb-480d-4a7f-9f5d-627fd322f576 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:08:40.737850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01213ceb-480d-4a7f-9f5d-627fd322f576 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:08:40.738137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01213ceb-480d-4a7f-9f5d-627fd322f576 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:08:40.738406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01213ceb-480d-4a7f-9f5d-627fd322f576 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:08:40.740629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-01213ceb-480d-4a7f-9f5d-627fd322f576 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:08:40.753479 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01213ceb-480d-4a7f-9f5d-627fd322f576 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:08:40.754898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01213ceb-480d-4a7f-9f5d-627fd322f576 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:08:40.766466 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4551/9095] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:08:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:08:49.527306 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=21 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:08:50.761703 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=8 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:08:57.230875 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24e0b8-6469-4cf3-910f-c4af60710d60 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:08:57.231385 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24e0b8-6469-4cf3-910f-c4af60710d60 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:08:57.231501 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24e0b8-6469-4cf3-910f-c4af60710d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:08:57.256373 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-9f24e0b8-6469-4cf3-910f-c4af60710d60 None None] MFA Rules not processed for user `8b0dd7a3450d4c65930854f7d2810e74`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:08:57.258480 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9f24e0b8-6469-4cf3-910f-c4af60710d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:08:57.266574 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4545/9096] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 02:08:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:08:57.628339 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01213ceb-480d-4a7f-9f5d-627fd322f576 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:08:57.636950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01213ceb-480d-4a7f-9f5d-627fd322f576 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:08:57.641549 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3bb48-c1b5-4180-81c5-55d4c5d5db82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:08:57.642301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3bb48-c1b5-4180-81c5-55d4c5d5db82 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:08:57.642586 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3bb48-c1b5-4180-81c5-55d4c5d5db82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:08:57.643000 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3bb48-c1b5-4180-81c5-55d4c5d5db82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:08:57.644740 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2fe3bb48-c1b5-4180-81c5-55d4c5d5db82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:08:57.655356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3bb48-c1b5-4180-81c5-55d4c5d5db82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:08:57.656783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3bb48-c1b5-4180-81c5-55d4c5d5db82 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:08:57.665242 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4552/9097] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:08:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:09:03.020267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24e0b8-6469-4cf3-910f-c4af60710d60 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:09:03.030534 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24e0b8-6469-4cf3-910f-c4af60710d60 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:09:03.034091 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163bdfb-3d4e-43b3-913f-2c8eae1473f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:09:03.034688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163bdfb-3d4e-43b3-913f-2c8eae1473f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:09:03.034969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163bdfb-3d4e-43b3-913f-2c8eae1473f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:09:03.035243 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163bdfb-3d4e-43b3-913f-2c8eae1473f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:09:03.036985 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d163bdfb-3d4e-43b3-913f-2c8eae1473f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:09:03.046032 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163bdfb-3d4e-43b3-913f-2c8eae1473f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:09:03.047448 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163bdfb-3d4e-43b3-913f-2c8eae1473f1 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:09:03.057001 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4546/9098] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:09:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:09:07.661168 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:09:13.052398 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=9 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:11:10.642693 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3bb48-c1b5-4180-81c5-55d4c5d5db82 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:11:10.644125 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2fe3bb48-c1b5-4180-81c5-55d4c5d5db82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:11:10.698513 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3bb48-c1b5-4180-81c5-55d4c5d5db82 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:11:10.704032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08a940-5dbb-446f-bd5b-b6e144ab2414 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:11:10.704675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08a940-5dbb-446f-bd5b-b6e144ab2414 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:11:10.705027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08a940-5dbb-446f-bd5b-b6e144ab2414 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:11:10.705378 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08a940-5dbb-446f-bd5b-b6e144ab2414 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:11:10.707355 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-4d08a940-5dbb-446f-bd5b-b6e144ab2414 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:11:10.720124 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08a940-5dbb-446f-bd5b-b6e144ab2414 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:11:10.721855 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08a940-5dbb-446f-bd5b-b6e144ab2414 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:11:10.732600 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4553/9099] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:11:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:11:16.985893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163bdfb-3d4e-43b3-913f-2c8eae1473f1 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:11:16.988977 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d163bdfb-3d4e-43b3-913f-2c8eae1473f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:11:17.022016 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163bdfb-3d4e-43b3-913f-2c8eae1473f1 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:11:17.027608 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8a9f4-7c16-487a-b4a4-d2c5763dcebf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:11:17.028213 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8a9f4-7c16-487a-b4a4-d2c5763dcebf service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:11:17.028544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8a9f4-7c16-487a-b4a4-d2c5763dcebf service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:11:17.028822 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8a9f4-7c16-487a-b4a4-d2c5763dcebf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:11:17.030589 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a6f8a9f4-7c16-487a-b4a4-d2c5763dcebf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:11:17.043163 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8a9f4-7c16-487a-b4a4-d2c5763dcebf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:11:17.044738 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8a9f4-7c16-487a-b4a4-d2c5763dcebf service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:11:17.055082 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4547/9100] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:11:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:11:20.728281 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=18 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:11:27.051010 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=13 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:11:28.513850 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff9caa-a661-428b-965d-078bda4de847 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:11:28.514306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff9caa-a661-428b-965d-078bda4de847 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:11:28.514554 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff9caa-a661-428b-965d-078bda4de847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:11:28.533958 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-e7ff9caa-a661-428b-965d-078bda4de847 None None] MFA Rules not processed for user `8b0dd7a3450d4c65930854f7d2810e74`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:11:28.535284 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-e7ff9caa-a661-428b-965d-078bda4de847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:11:28.542898 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4554/9101] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 02:11:28 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:11:31.265427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8a9f4-7c16-487a-b4a4-d2c5763dcebf service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:11:31.277106 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8a9f4-7c16-487a-b4a4-d2c5763dcebf service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:11:31.281345 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da985c68-4976-4c7a-98d3-f637ff065c5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:11:31.282189 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da985c68-4976-4c7a-98d3-f637ff065c5a service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:11:31.282483 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da985c68-4976-4c7a-98d3-f637ff065c5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:11:31.282811 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da985c68-4976-4c7a-98d3-f637ff065c5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:11:31.284655 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-da985c68-4976-4c7a-98d3-f637ff065c5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:11:31.310690 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da985c68-4976-4c7a-98d3-f637ff065c5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:11:31.312160 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da985c68-4976-4c7a-98d3-f637ff065c5a service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:11:31.322201 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4548/9102] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:11:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:11:37.454929 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff9caa-a661-428b-965d-078bda4de847 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:11:37.469709 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff9caa-a661-428b-965d-078bda4de847 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:11:37.476724 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91b57c-458a-4dca-af1f-26e61e8990b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:11:37.477679 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91b57c-458a-4dca-af1f-26e61e8990b2 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:11:37.478143 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91b57c-458a-4dca-af1f-26e61e8990b2 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:11:37.478738 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91b57c-458a-4dca-af1f-26e61e8990b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:11:37.480866 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6b91b57c-458a-4dca-af1f-26e61e8990b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:11:37.494414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91b57c-458a-4dca-af1f-26e61e8990b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:11:37.495988 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91b57c-458a-4dca-af1f-26e61e8990b2 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:11:37.513314 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4555/9103] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:11:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:11:41.318801 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=11 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:11:47.501947 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=9 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:12:10.872722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da985c68-4976-4c7a-98d3-f637ff065c5a service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:12:10.884595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da985c68-4976-4c7a-98d3-f637ff065c5a service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:12:10.889956 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be3f5d-2520-46e2-b4a9-afebfc4fd10d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:12:10.890975 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be3f5d-2520-46e2-b4a9-afebfc4fd10d service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:12:10.891314 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be3f5d-2520-46e2-b4a9-afebfc4fd10d service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:12:10.891651 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be3f5d-2520-46e2-b4a9-afebfc4fd10d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:12:10.893567 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-46be3f5d-2520-46e2-b4a9-afebfc4fd10d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:12:10.905860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be3f5d-2520-46e2-b4a9-afebfc4fd10d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:12:10.908115 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be3f5d-2520-46e2-b4a9-afebfc4fd10d service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:12:10.917631 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4549/9104] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:12:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:12:11.052692 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f558d8f-3758-403e-b406-e4fba8f93385 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:12:11.053281 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f558d8f-3758-403e-b406-e4fba8f93385 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:12:11.053281 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f558d8f-3758-403e-b406-e4fba8f93385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:12:11.122643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-9f558d8f-3758-403e-b406-e4fba8f93385 None None] MFA Rules not processed for user `2cdde7a212954a01a2591ad5ac30d049`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:12:11.123913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9f558d8f-3758-403e-b406-e4fba8f93385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:12:11.130972 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4556/9105] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Sep 4 02:12:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:12:11.143042 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be3f5d-2520-46e2-b4a9-afebfc4fd10d service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:12:11.152068 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be3f5d-2520-46e2-b4a9-afebfc4fd10d service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:12:11.155705 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44141fc6-1034-4b24-9f42-499bd66ea5d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:12:11.156308 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44141fc6-1034-4b24-9f42-499bd66ea5d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:12:11.156587 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44141fc6-1034-4b24-9f42-499bd66ea5d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:12:11.156865 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44141fc6-1034-4b24-9f42-499bd66ea5d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:12:11.164826 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44141fc6-1034-4b24-9f42-499bd66ea5d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:12:11.166378 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44141fc6-1034-4b24-9f42-499bd66ea5d5 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:12:11.174282 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4550/9106] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:12:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:12:11.218598 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f558d8f-3758-403e-b406-e4fba8f93385 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:12:11.230763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f558d8f-3758-403e-b406-e4fba8f93385 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:12:11.235806 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ee94a-f38e-4b55-aa63-9b5288cfee3b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:12:11.236419 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ee94a-f38e-4b55-aa63-9b5288cfee3b service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:12:11.236698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ee94a-f38e-4b55-aa63-9b5288cfee3b service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:12:11.236971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ee94a-f38e-4b55-aa63-9b5288cfee3b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:12:11.238890 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d61ee94a-f38e-4b55-aa63-9b5288cfee3b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:12:11.256400 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ee94a-f38e-4b55-aa63-9b5288cfee3b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:12:11.258480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ee94a-f38e-4b55-aa63-9b5288cfee3b service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:12:11.262315 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c210a02-dcda-44d8-8d3f-f60e35b490a6 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:12:11.262680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c210a02-dcda-44d8-8d3f-f60e35b490a6 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:12:11.263333 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c210a02-dcda-44d8-8d3f-f60e35b490a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:12:11.270451 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4557/9107] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:12:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:12:11.305348 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-6c210a02-dcda-44d8-8d3f-f60e35b490a6 None None] MFA Rules not processed for user `f908fda75ef8440cb6a0ef9440127d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:12:11.306611 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-6c210a02-dcda-44d8-8d3f-f60e35b490a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:12:11.315643 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4551/9108] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Sep 4 02:12:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:12:11.329134 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ee94a-f38e-4b55-aa63-9b5288cfee3b service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:12:11.340789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ee94a-f38e-4b55-aa63-9b5288cfee3b service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:12:11.345934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84a4dd-e410-4f84-978f-bee846da5b4a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:12:11.346543 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84a4dd-e410-4f84-978f-bee846da5b4a service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:12:11.346825 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84a4dd-e410-4f84-978f-bee846da5b4a service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:12:11.347098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84a4dd-e410-4f84-978f-bee846da5b4a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:12:11.356226 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84a4dd-e410-4f84-978f-bee846da5b4a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:12:11.357847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84a4dd-e410-4f84-978f-bee846da5b4a service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:12:11.368241 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4558/9109] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:12:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 02:12:11.536227 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dedabe-110d-4ef6-a3ab-b03fa6611e8c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:12:11.536511 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dedabe-110d-4ef6-a3ab-b03fa6611e8c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:12:11.536811 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dedabe-110d-4ef6-a3ab-b03fa6611e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:12:11.574923 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-45dedabe-110d-4ef6-a3ab-b03fa6611e8c None None] MFA Rules not processed for user `13f0f341bf2c475d82b4e7b34d503dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:12:11.576130 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-45dedabe-110d-4ef6-a3ab-b03fa6611e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:12:11.588133 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4552/9110] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Sep 4 02:12:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:12:11.599296 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84a4dd-e410-4f84-978f-bee846da5b4a service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:12:11.609705 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84a4dd-e410-4f84-978f-bee846da5b4a service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:12:11.613626 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba2a07-a1df-48f5-a648-39ed123b3e30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:12:11.614221 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba2a07-a1df-48f5-a648-39ed123b3e30 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:12:11.614497 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba2a07-a1df-48f5-a648-39ed123b3e30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:12:11.614765 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba2a07-a1df-48f5-a648-39ed123b3e30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:12:11.626573 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba2a07-a1df-48f5-a648-39ed123b3e30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:12:11.628065 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba2a07-a1df-48f5-a648-39ed123b3e30 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:12:11.639950 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4559/9111] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:12:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:12:11.704201 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dedabe-110d-4ef6-a3ab-b03fa6611e8c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:12:11.715566 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dedabe-110d-4ef6-a3ab-b03fa6611e8c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:12:11.720890 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabab0a5-98da-40dc-9c23-d64e01c5f40b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:12:11.721528 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabab0a5-98da-40dc-9c23-d64e01c5f40b service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:12:11.721808 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabab0a5-98da-40dc-9c23-d64e01c5f40b service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:12:11.722077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabab0a5-98da-40dc-9c23-d64e01c5f40b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:12:11.723766 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-dabab0a5-98da-40dc-9c23-d64e01c5f40b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:12:11.735399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabab0a5-98da-40dc-9c23-d64e01c5f40b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:12:11.736984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabab0a5-98da-40dc-9c23-d64e01c5f40b service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:12:11.747525 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4553/9112] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:12:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:12:12.221606 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba2a07-a1df-48f5-a648-39ed123b3e30 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:12:12.233228 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba2a07-a1df-48f5-a648-39ed123b3e30 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:12:12.239122 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0724d87-7061-4950-bd42-b18fe926fc0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:12:12.239772 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0724d87-7061-4950-bd42-b18fe926fc0d service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:12:12.240051 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0724d87-7061-4950-bd42-b18fe926fc0d service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:12:12.240322 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0724d87-7061-4950-bd42-b18fe926fc0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:12:12.248032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0724d87-7061-4950-bd42-b18fe926fc0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:12:12.249637 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0724d87-7061-4950-bd42-b18fe926fc0d service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:12:12.260091 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4560/9113] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:12:12 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:12:21.743378 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=36 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:12:22.255658 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=41 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:13:21.744914 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabab0a5-98da-40dc-9c23-d64e01c5f40b service placement] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:13:21.764591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabab0a5-98da-40dc-9c23-d64e01c5f40b service placement] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:13:21.771981 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90de9e-472e-402a-8de8-4095894d7da1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:13:21.772591 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90de9e-472e-402a-8de8-4095894d7da1 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:13:21.772871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90de9e-472e-402a-8de8-4095894d7da1 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:13:21.773144 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90de9e-472e-402a-8de8-4095894d7da1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:13:21.774894 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ff90de9e-472e-402a-8de8-4095894d7da1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:13:21.799992 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90de9e-472e-402a-8de8-4095894d7da1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:13:21.801524 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90de9e-472e-402a-8de8-4095894d7da1 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:13:21.812484 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4554/9114] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:13:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:13:25.242038 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0724d87-7061-4950-bd42-b18fe926fc0d service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:13:25.253324 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0724d87-7061-4950-bd42-b18fe926fc0d service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:13:25.258391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8bf1c-8289-4a3a-aea5-82738e54c414 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:13:25.258996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8bf1c-8289-4a3a-aea5-82738e54c414 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:13:25.259474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8bf1c-8289-4a3a-aea5-82738e54c414 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:13:25.259751 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8bf1c-8289-4a3a-aea5-82738e54c414 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:13:25.261549 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3fe8bf1c-8289-4a3a-aea5-82738e54c414 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:13:25.278517 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe8bf1c-8289-4a3a-aea5-82738e54c414 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:13:25.280117 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe8bf1c-8289-4a3a-aea5-82738e54c414 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:13:25.292039 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4561/9115] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:13:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:13:28.166805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90de9e-472e-402a-8de8-4095894d7da1 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:13:28.176529 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90de9e-472e-402a-8de8-4095894d7da1 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:13:28.180053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42773df5-20ca-4cf1-a2c9-d93d03d5ff9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:13:28.180657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42773df5-20ca-4cf1-a2c9-d93d03d5ff9c service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:13:28.180939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42773df5-20ca-4cf1-a2c9-d93d03d5ff9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:13:28.181214 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42773df5-20ca-4cf1-a2c9-d93d03d5ff9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:13:28.190423 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42773df5-20ca-4cf1-a2c9-d93d03d5ff9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:13:28.192498 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42773df5-20ca-4cf1-a2c9-d93d03d5ff9c service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:13:28.202449 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4555/9116] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:13:28 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:13:31.146493 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb4fed-54e1-43eb-9ac8-595cd8c3e18a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:13:31.146990 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb4fed-54e1-43eb-9ac8-595cd8c3e18a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:13:31.147159 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb4fed-54e1-43eb-9ac8-595cd8c3e18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:13:31.174370 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-f1eb4fed-54e1-43eb-9ac8-595cd8c3e18a None None] MFA Rules not processed for user `8b0dd7a3450d4c65930854f7d2810e74`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:13:31.175913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f1eb4fed-54e1-43eb-9ac8-595cd8c3e18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:13:31.183743 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4562/9117] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 02:13:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:13:32.191951 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42773df5-20ca-4cf1-a2c9-d93d03d5ff9c service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:13:32.203949 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42773df5-20ca-4cf1-a2c9-d93d03d5ff9c service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:13:32.210367 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e0f9d-6ade-48f0-b298-c7992660263c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:13:32.210993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e0f9d-6ade-48f0-b298-c7992660263c service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:13:32.211465 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e0f9d-6ade-48f0-b298-c7992660263c service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:13:32.211750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e0f9d-6ade-48f0-b298-c7992660263c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:13:32.221630 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e0f9d-6ade-48f0-b298-c7992660263c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:13:32.223260 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e0f9d-6ade-48f0-b298-c7992660263c service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:13:32.235064 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4556/9118] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:13:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 02:13:40.374271 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb4fed-54e1-43eb-9ac8-595cd8c3e18a None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:13:40.384393 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb4fed-54e1-43eb-9ac8-595cd8c3e18a None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:13:40.387929 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519733fe-a569-4090-9d00-2bb5e5638f1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:13:40.388773 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519733fe-a569-4090-9d00-2bb5e5638f1b service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:13:40.389079 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519733fe-a569-4090-9d00-2bb5e5638f1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:13:40.389346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519733fe-a569-4090-9d00-2bb5e5638f1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:13:40.400023 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519733fe-a569-4090-9d00-2bb5e5638f1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:13:40.401369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519733fe-a569-4090-9d00-2bb5e5638f1b service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:13:40.412223 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4563/9119] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:13:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:13:41.604974 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e0f9d-6ade-48f0-b298-c7992660263c service placement] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:13:41.614192 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e0f9d-6ade-48f0-b298-c7992660263c service placement] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:13:41.617795 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfc5c4-0e8e-4615-a8c3-d71222cd2b78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:13:41.618393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfc5c4-0e8e-4615-a8c3-d71222cd2b78 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:13:41.618676 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfc5c4-0e8e-4615-a8c3-d71222cd2b78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:13:41.618954 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfc5c4-0e8e-4615-a8c3-d71222cd2b78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:13:41.629969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfc5c4-0e8e-4615-a8c3-d71222cd2b78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:13:41.631417 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfc5c4-0e8e-4615-a8c3-d71222cd2b78 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:13:41.642443 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4557/9120] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:13:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:13:50.407596 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=15 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:13:51.637475 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=32 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:14:14.905768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519733fe-a569-4090-9d00-2bb5e5638f1b service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:14:14.914763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519733fe-a569-4090-9d00-2bb5e5638f1b service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:14:14.918330 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd38a3b-6ccb-488d-a8f8-ca266ea39fb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:14:14.918926 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd38a3b-6ccb-488d-a8f8-ca266ea39fb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:14:14.919199 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd38a3b-6ccb-488d-a8f8-ca266ea39fb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:14:14.919468 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd38a3b-6ccb-488d-a8f8-ca266ea39fb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:14:14.927008 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd38a3b-6ccb-488d-a8f8-ca266ea39fb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:14:14.928415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd38a3b-6ccb-488d-a8f8-ca266ea39fb0 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:14:14.936056 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4564/9121] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:14:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:14:24.932679 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:16:03.546262 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfc5c4-0e8e-4615-a8c3-d71222cd2b78 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:16:03.570672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfc5c4-0e8e-4615-a8c3-d71222cd2b78 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:16:03.576031 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cc608-2bfa-4b50-9144-ced1161fed75 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:16:03.576654 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cc608-2bfa-4b50-9144-ced1161fed75 service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:16:03.576933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cc608-2bfa-4b50-9144-ced1161fed75 service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:16:03.577206 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cc608-2bfa-4b50-9144-ced1161fed75 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:16:03.579279 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a90cc608-2bfa-4b50-9144-ced1161fed75 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:16:03.595138 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90cc608-2bfa-4b50-9144-ced1161fed75 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:16:03.597060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90cc608-2bfa-4b50-9144-ced1161fed75 service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:16:03.617125 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4558/9122] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:16:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:16:10.245350 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ec614-20e6-48b7-b28b-a51705ae45a2 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:16:10.245903 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ec614-20e6-48b7-b28b-a51705ae45a2 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:16:10.246119 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ec614-20e6-48b7-b28b-a51705ae45a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:16:10.271771 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-d76ec614-20e6-48b7-b28b-a51705ae45a2 None None] MFA Rules not processed for user `8b0dd7a3450d4c65930854f7d2810e74`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:16:10.279687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d76ec614-20e6-48b7-b28b-a51705ae45a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:16:10.287552 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4565/9123] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 02:16:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:16:13.603805 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=10 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:16:16.575570 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cc608-2bfa-4b50-9144-ced1161fed75 service placement] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:16:16.585847 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cc608-2bfa-4b50-9144-ced1161fed75 service placement] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:16:16.590855 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4cb5fc-df5c-48ce-b527-b320a29cb800 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:16:16.591445 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cb5fc-df5c-48ce-b527-b320a29cb800 service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:16:16.591724 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cb5fc-df5c-48ce-b527-b320a29cb800 service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:16:16.591995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cb5fc-df5c-48ce-b527-b320a29cb800 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:16:16.600058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4cb5fc-df5c-48ce-b527-b320a29cb800 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:16:16.601665 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4cb5fc-df5c-48ce-b527-b320a29cb800 service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:16:16.611090 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4559/9124] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:16:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:16:20.262504 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:16:26.517137 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ec614-20e6-48b7-b28b-a51705ae45a2 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:16:26.533342 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ec614-20e6-48b7-b28b-a51705ae45a2 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:16:26.539615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39951d2a-4141-41f7-bfc1-0e04e868bcca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:16:26.540261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39951d2a-4141-41f7-bfc1-0e04e868bcca service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:16:26.540540 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39951d2a-4141-41f7-bfc1-0e04e868bcca service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:16:26.540813 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39951d2a-4141-41f7-bfc1-0e04e868bcca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:16:26.551097 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39951d2a-4141-41f7-bfc1-0e04e868bcca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:16:26.552677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39951d2a-4141-41f7-bfc1-0e04e868bcca service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:16:26.564493 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4566/9125] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:16:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:16:26.607068 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=6 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:16:36.559716 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:17:19.222229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4cb5fc-df5c-48ce-b527-b320a29cb800 service placement] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:17:19.232615 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4cb5fc-df5c-48ce-b527-b320a29cb800 service placement] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:17:19.237677 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f65f9-3129-4386-841f-039ccb54bae7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:17:19.238271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f65f9-3129-4386-841f-039ccb54bae7 service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:17:19.238552 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f65f9-3129-4386-841f-039ccb54bae7 service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:17:19.238835 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f65f9-3129-4386-841f-039ccb54bae7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:17:19.247056 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f65f9-3129-4386-841f-039ccb54bae7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:17:19.248636 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f65f9-3129-4386-841f-039ccb54bae7 service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:17:19.258729 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4560/9126] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:17:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:17:28.465919 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39951d2a-4141-41f7-bfc1-0e04e868bcca service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:17:28.467760 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-39951d2a-4141-41f7-bfc1-0e04e868bcca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:17:28.547464 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39951d2a-4141-41f7-bfc1-0e04e868bcca service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:17:28.552897 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126ed41-e2f5-4062-b01c-2df1cacf5e53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:17:28.553614 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126ed41-e2f5-4062-b01c-2df1cacf5e53 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:17:28.553900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126ed41-e2f5-4062-b01c-2df1cacf5e53 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:17:28.554170 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126ed41-e2f5-4062-b01c-2df1cacf5e53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:17:28.555939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f126ed41-e2f5-4062-b01c-2df1cacf5e53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:17:28.638929 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126ed41-e2f5-4062-b01c-2df1cacf5e53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:17:28.640770 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126ed41-e2f5-4062-b01c-2df1cacf5e53 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:17:28.661029 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4567/9127] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:17:28 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:17:29.254250 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=6 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:17:38.658858 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=73 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:17:43.169590 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f65f9-3129-4386-841f-039ccb54bae7 service placement] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:17:43.171408 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9c2f65f9-3129-4386-841f-039ccb54bae7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:17:43.271109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f65f9-3129-4386-841f-039ccb54bae7 service placement] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:17:43.276537 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28176e38-513c-4a00-ad32-ee36bbefef70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:17:43.277060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28176e38-513c-4a00-ad32-ee36bbefef70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:17:43.277340 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28176e38-513c-4a00-ad32-ee36bbefef70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:17:43.277670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28176e38-513c-4a00-ad32-ee36bbefef70 admin admin] PATH_INFO: `/v3/users/8b0dd7a3450d4c65930854f7d2810e74` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:17:43.279176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28176e38-513c-4a00-ad32-ee36bbefef70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b0dd7a3450d4c65930854f7d2810e74)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:17:43.281143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28176e38-513c-4a00-ad32-ee36bbefef70 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:17:43.331799 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-28176e38-513c-4a00-ad32-ee36bbefef70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b0dd7a3450d4c65930854f7d2810e74'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:17:43.332739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-28176e38-513c-4a00-ad32-ee36bbefef70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b0dd7a3450d4c65930854f7d2810e74'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:17:43.342720 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-28176e38-513c-4a00-ad32-ee36bbefef70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b0dd7a3450d4c65930854f7d2810e74'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:17:43.352238 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-28176e38-513c-4a00-ad32-ee36bbefef70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b0dd7a3450d4c65930854f7d2810e74'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:17:43.352852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-28176e38-513c-4a00-ad32-ee36bbefef70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b0dd7a3450d4c65930854f7d2810e74'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:17:43.371352 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4561/9128] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 02:17:43 2022] DELETE /identity/v3/users/8b0dd7a3450d4c65930854f7d2810e74 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 02:17:43.376157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0a1a6-d43e-48c8-b1ec-032eb5107882 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:17:43.376660 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0a1a6-d43e-48c8-b1ec-032eb5107882 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:17:43.376782 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0a1a6-d43e-48c8-b1ec-032eb5107882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:17:43.404524 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-92a0a1a6-d43e-48c8-b1ec-032eb5107882 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:17:43.405794 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-92a0a1a6-d43e-48c8-b1ec-032eb5107882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:17:43.463681 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4568/9129] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 02:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:17:43.473415 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28176e38-513c-4a00-ad32-ee36bbefef70 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:17:43.474824 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-28176e38-513c-4a00-ad32-ee36bbefef70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:17:43.532679 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:17:43.542411 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28176e38-513c-4a00-ad32-ee36bbefef70 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:17:43.546579 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2fdfb-0af0-4206-bd46-32c7ca7f9758 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:17:43.547296 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2fdfb-0af0-4206-bd46-32c7ca7f9758 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:17:43.547578 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2fdfb-0af0-4206-bd46-32c7ca7f9758 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:17:43.547852 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2fdfb-0af0-4206-bd46-32c7ca7f9758 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:17:43.557166 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd2fdfb-0af0-4206-bd46-32c7ca7f9758 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:17:43.558667 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd2fdfb-0af0-4206-bd46-32c7ca7f9758 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:17:43.567908 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4562/9130] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:17:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:17:43.738608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0a1a6-d43e-48c8-b1ec-032eb5107882 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:17:43.740046 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-92a0a1a6-d43e-48c8-b1ec-032eb5107882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:17:43.753545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0a1a6-d43e-48c8-b1ec-032eb5107882 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:17:43.759032 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb370b7-6459-49fb-aa3b-cb1f1a9b421b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:17:43.759675 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb370b7-6459-49fb-aa3b-cb1f1a9b421b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:17:43.759985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb370b7-6459-49fb-aa3b-cb1f1a9b421b admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:17:43.760291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb370b7-6459-49fb-aa3b-cb1f1a9b421b admin admin] PATH_INFO: `/v3/projects/43abbac4c8964413ac462eeb9ca00a27` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:17:43.761548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb370b7-6459-49fb-aa3b-cb1f1a9b421b admin admin] RBAC: Authorizing `identity:delete_project(project_id=43abbac4c8964413ac462eeb9ca00a27)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:17:43.763728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb370b7-6459-49fb-aa3b-cb1f1a9b421b admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:17:43.811272 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2bb370b7-6459-49fb-aa3b-cb1f1a9b421b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43abbac4c8964413ac462eeb9ca00a27', 'request_id': 'req-2bb370b7-6459-49fb-aa3b-cb1f1a9b421b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:17:43.819202 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2bb370b7-6459-49fb-aa3b-cb1f1a9b421b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43abbac4c8964413ac462eeb9ca00a27', 'request_id': 'req-2bb370b7-6459-49fb-aa3b-cb1f1a9b421b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:17:43.825678 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2bb370b7-6459-49fb-aa3b-cb1f1a9b421b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43abbac4c8964413ac462eeb9ca00a27', 'request_id': 'req-2bb370b7-6459-49fb-aa3b-cb1f1a9b421b'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:17:43.837597 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2bb370b7-6459-49fb-aa3b-cb1f1a9b421b admin admin] The token cache is being invalidate because project 43abbac4c8964413ac462eeb9ca00a27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 02:17:43.837891 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2bb370b7-6459-49fb-aa3b-cb1f1a9b421b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:17:43.838573 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2bb370b7-6459-49fb-aa3b-cb1f1a9b421b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:17:43.843319 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4569/9131] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 02:17:43 2022] DELETE /identity/v3/projects/43abbac4c8964413ac462eeb9ca00a27 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 04 02:17:43.844531 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2fdfb-0af0-4206-bd46-32c7ca7f9758 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:17:43.855130 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2fdfb-0af0-4206-bd46-32c7ca7f9758 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:17:43.913691 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba9182-36a6-4c10-bd51-6c3d4f8cb0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:17:43.914327 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba9182-36a6-4c10-bd51-6c3d4f8cb0cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:17:43.914610 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba9182-36a6-4c10-bd51-6c3d4f8cb0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:17:43.914884 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba9182-36a6-4c10-bd51-6c3d4f8cb0cf admin admin] PATH_INFO: `/v3/users/302acfd64c3447d6a86ec1d53914603b` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:17:43.929496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba9182-36a6-4c10-bd51-6c3d4f8cb0cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=302acfd64c3447d6a86ec1d53914603b)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:17:43.931449 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba9182-36a6-4c10-bd51-6c3d4f8cb0cf admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:17:43.976258 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-45ba9182-36a6-4c10-bd51-6c3d4f8cb0cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '302acfd64c3447d6a86ec1d53914603b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:17:43.976836 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-45ba9182-36a6-4c10-bd51-6c3d4f8cb0cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '302acfd64c3447d6a86ec1d53914603b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:17:43.983667 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-45ba9182-36a6-4c10-bd51-6c3d4f8cb0cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '302acfd64c3447d6a86ec1d53914603b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:17:43.991299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-45ba9182-36a6-4c10-bd51-6c3d4f8cb0cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '302acfd64c3447d6a86ec1d53914603b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:17:43.991893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-45ba9182-36a6-4c10-bd51-6c3d4f8cb0cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '302acfd64c3447d6a86ec1d53914603b'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:17:44.008626 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4563/9132] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 02:17:43 2022] DELETE /identity/v3/users/302acfd64c3447d6a86ec1d53914603b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 02:17:44.285952 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb370b7-6459-49fb-aa3b-cb1f1a9b421b admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:17:44.287391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2bb370b7-6459-49fb-aa3b-cb1f1a9b421b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:17:44.301700 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb370b7-6459-49fb-aa3b-cb1f1a9b421b admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:17:44.357240 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2649d7-f807-4457-aea8-a68b782c6f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:17:44.357819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2649d7-f807-4457-aea8-a68b782c6f6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:17:44.358103 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2649d7-f807-4457-aea8-a68b782c6f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:17:44.358374 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2649d7-f807-4457-aea8-a68b782c6f6e admin admin] PATH_INFO: `/v3/projects/8c7d6f6c71524f7f837d85fc373ed771` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:17:44.368812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2649d7-f807-4457-aea8-a68b782c6f6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c7d6f6c71524f7f837d85fc373ed771)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:17:44.370747 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2649d7-f807-4457-aea8-a68b782c6f6e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:17:44.381202 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:17:44.421502 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5e2649d7-f807-4457-aea8-a68b782c6f6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c7d6f6c71524f7f837d85fc373ed771', 'request_id': 'req-5e2649d7-f807-4457-aea8-a68b782c6f6e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:17:44.429326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5e2649d7-f807-4457-aea8-a68b782c6f6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c7d6f6c71524f7f837d85fc373ed771', 'request_id': 'req-5e2649d7-f807-4457-aea8-a68b782c6f6e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:17:44.436399 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5e2649d7-f807-4457-aea8-a68b782c6f6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c7d6f6c71524f7f837d85fc373ed771', 'request_id': 'req-5e2649d7-f807-4457-aea8-a68b782c6f6e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:17:44.452301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5e2649d7-f807-4457-aea8-a68b782c6f6e admin admin] The token cache is being invalidate because project 8c7d6f6c71524f7f837d85fc373ed771 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 02:17:44.452591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5e2649d7-f807-4457-aea8-a68b782c6f6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:17:44.453748 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-5e2649d7-f807-4457-aea8-a68b782c6f6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:17:44.454765 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4570/9133] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 02:17:44 2022] DELETE /identity/v3/projects/8c7d6f6c71524f7f837d85fc373ed771 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 02:17:44.460518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af9964-0da0-4b76-a35f-bde712ff6f5b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:17:44.460945 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af9964-0da0-4b76-a35f-bde712ff6f5b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:17:44.461052 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af9964-0da0-4b76-a35f-bde712ff6f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:17:44.499305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-00af9964-0da0-4b76-a35f-bde712ff6f5b None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:17:44.500504 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-00af9964-0da0-4b76-a35f-bde712ff6f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:17:44.533305 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:17:44.560891 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4564/9134] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 02:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:17:44.569915 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cee768-bbdb-4fc8-83d6-4e6781105426 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:17:44.570229 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cee768-bbdb-4fc8-83d6-4e6781105426 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:17:44.570506 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cee768-bbdb-4fc8-83d6-4e6781105426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:17:44.590494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-f4cee768-bbdb-4fc8-83d6-4e6781105426 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:17:44.591687 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-f4cee768-bbdb-4fc8-83d6-4e6781105426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:17:44.599498 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4571/9135] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 02:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:17:44.603660 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af9964-0da0-4b76-a35f-bde712ff6f5b None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:17:44.613191 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af9964-0da0-4b76-a35f-bde712ff6f5b None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:17:44.617763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec47422-1880-46eb-8df0-eb8d420821de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:17:44.618358 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec47422-1880-46eb-8df0-eb8d420821de admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:17:44.618637 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec47422-1880-46eb-8df0-eb8d420821de admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:17:44.618912 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec47422-1880-46eb-8df0-eb8d420821de admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:17:44.619551 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec47422-1880-46eb-8df0-eb8d420821de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 02:17:44.619856 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec47422-1880-46eb-8df0-eb8d420821de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:17:44.621488 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec47422-1880-46eb-8df0-eb8d420821de admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:17:44.633271 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4565/9136] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 02:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 02:17:44.637422 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cee768-bbdb-4fc8-83d6-4e6781105426 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:17:44.646848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cee768-bbdb-4fc8-83d6-4e6781105426 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:17:44.653766 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179dbbf-323e-4813-b06a-ae94c8942bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:17:44.654366 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179dbbf-323e-4813-b06a-ae94c8942bd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:17:44.654648 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179dbbf-323e-4813-b06a-ae94c8942bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:17:44.654920 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179dbbf-323e-4813-b06a-ae94c8942bd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:17:44.655557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8179dbbf-323e-4813-b06a-ae94c8942bd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:17:44.657474 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8179dbbf-323e-4813-b06a-ae94c8942bd7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:17:44.700635 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4572/9137] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 02:17:44 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 02:17:44.701904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec47422-1880-46eb-8df0-eb8d420821de admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:17:44.713143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec47422-1880-46eb-8df0-eb8d420821de admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:17:44.772450 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a656d2-ab64-4ab3-923f-50ca0cd40e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:17:44.773391 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a656d2-ab64-4ab3-923f-50ca0cd40e2e admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:17:44.773893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a656d2-ab64-4ab3-923f-50ca0cd40e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:17:44.774355 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a656d2-ab64-4ab3-923f-50ca0cd40e2e admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:17:44.775218 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a656d2-ab64-4ab3-923f-50ca0cd40e2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:17:44.777549 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a656d2-ab64-4ab3-923f-50ca0cd40e2e admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:17:44.801607 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4566/9138] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 02:17:44 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 02:17:44.805834 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179dbbf-323e-4813-b06a-ae94c8942bd7 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:17:44.816581 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179dbbf-323e-4813-b06a-ae94c8942bd7 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:17:44.821838 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb49a52-9617-4faf-b6fb-caaf2b35b000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:17:44.822446 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb49a52-9617-4faf-b6fb-caaf2b35b000 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:17:44.822730 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb49a52-9617-4faf-b6fb-caaf2b35b000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:17:44.823000 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb49a52-9617-4faf-b6fb-caaf2b35b000 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:17:44.823643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb49a52-9617-4faf-b6fb-caaf2b35b000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:17:44.825410 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb49a52-9617-4faf-b6fb-caaf2b35b000 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:17:44.836807 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4573/9139] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 02:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 02:17:44.841024 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a656d2-ab64-4ab3-923f-50ca0cd40e2e admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:17:44.851589 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a656d2-ab64-4ab3-923f-50ca0cd40e2e admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:17:44.856615 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b85a38-f84f-45ae-b37e-4139531cf1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:17:44.857289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b85a38-f84f-45ae-b37e-4139531cf1ae admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:17:44.857672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b85a38-f84f-45ae-b37e-4139531cf1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:17:44.858041 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b85a38-f84f-45ae-b37e-4139531cf1ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:17:44.858750 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b85a38-f84f-45ae-b37e-4139531cf1ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:17:44.860451 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b85a38-f84f-45ae-b37e-4139531cf1ae admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:17:44.873537 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4567/9140] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 02:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 02:17:44.876491 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb49a52-9617-4faf-b6fb-caaf2b35b000 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:17:44.887621 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb49a52-9617-4faf-b6fb-caaf2b35b000 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:17:44.892639 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3863a4-79d2-42cb-be98-e2c3df480046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:17:44.893298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3863a4-79d2-42cb-be98-e2c3df480046 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:17:44.893619 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3863a4-79d2-42cb-be98-e2c3df480046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:17:44.894157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3863a4-79d2-42cb-be98-e2c3df480046 admin admin] PATH_INFO: `/v3/projects/af8e868e7aea4b3e94d15ca49fa7fdf2/users/14c4b5dff8ce43139a4054ffca98774e/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:17:44.908918 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3863a4-79d2-42cb-be98-e2c3df480046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af8e868e7aea4b3e94d15ca49fa7fdf2, user_id=14c4b5dff8ce43139a4054ffca98774e, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:17:44.911643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3863a4-79d2-42cb-be98-e2c3df480046 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:17:44.926920 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4574/9141] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 02:17:44 2022] PUT /identity/v3/projects/af8e868e7aea4b3e94d15ca49fa7fdf2/users/14c4b5dff8ce43139a4054ffca98774e/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 02:17:44.932620 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a6d5d-d42e-4776-b970-b94c60045300 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:17:44.932908 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a6d5d-d42e-4776-b970-b94c60045300 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:17:44.933230 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a6d5d-d42e-4776-b970-b94c60045300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:17:44.955098 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-9b5a6d5d-d42e-4776-b970-b94c60045300 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:17:44.956299 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9b5a6d5d-d42e-4776-b970-b94c60045300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:17:45.015061 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4568/9142] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 02:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:17:45.025138 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3863a4-79d2-42cb-be98-e2c3df480046 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:17:45.026924 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-0c3863a4-79d2-42cb-be98-e2c3df480046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:17:45.088859 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3863a4-79d2-42cb-be98-e2c3df480046 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:17:45.092931 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382f019-16bd-4ed3-80a3-980c7dc367ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:17:45.093579 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382f019-16bd-4ed3-80a3-980c7dc367ad service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:17:45.093864 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382f019-16bd-4ed3-80a3-980c7dc367ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:17:45.094139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382f019-16bd-4ed3-80a3-980c7dc367ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:17:45.103917 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382f019-16bd-4ed3-80a3-980c7dc367ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:17:45.105554 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382f019-16bd-4ed3-80a3-980c7dc367ad service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:17:45.116247 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4575/9143] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:17:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:17:49.197468 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4df54-3603-451c-80e8-500578b2b707 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:17:49.198021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4df54-3603-451c-80e8-500578b2b707 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:17:49.198021 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4df54-3603-451c-80e8-500578b2b707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:17:49.230128 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-96a4df54-3603-451c-80e8-500578b2b707 None None] MFA Rules not processed for user `14c4b5dff8ce43139a4054ffca98774e`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:17:49.231480 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-96a4df54-3603-451c-80e8-500578b2b707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:17:49.273048 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:17:49.307190 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4569/9144] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 02:17:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:17:49.311682 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382f019-16bd-4ed3-80a3-980c7dc367ad service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:17:49.322396 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382f019-16bd-4ed3-80a3-980c7dc367ad service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:17:49.327997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb62fcc-e0b7-4811-9d9b-653d6759dbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:17:49.328622 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb62fcc-e0b7-4811-9d9b-653d6759dbf7 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:17:49.328996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb62fcc-e0b7-4811-9d9b-653d6759dbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:17:49.329275 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb62fcc-e0b7-4811-9d9b-653d6759dbf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:17:49.329962 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb62fcc-e0b7-4811-9d9b-653d6759dbf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:17:49.331876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb62fcc-e0b7-4811-9d9b-653d6759dbf7 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:17:49.361113 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4576/9145] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 02:17:49 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 02:17:49.366803 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4df54-3603-451c-80e8-500578b2b707 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:17:49.378050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4df54-3603-451c-80e8-500578b2b707 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:17:49.433621 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1b10c-2c6a-420d-84cf-03b9bfcd3947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:17:49.434151 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1b10c-2c6a-420d-84cf-03b9bfcd3947 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:17:49.434434 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1b10c-2c6a-420d-84cf-03b9bfcd3947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:17:49.434708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1b10c-2c6a-420d-84cf-03b9bfcd3947 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:17:49.435337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c1b10c-2c6a-420d-84cf-03b9bfcd3947 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:17:49.437260 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c1b10c-2c6a-420d-84cf-03b9bfcd3947 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:17:49.459889 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4570/9146] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 02:17:49 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 04 02:17:49.463939 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb62fcc-e0b7-4811-9d9b-653d6759dbf7 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:17:49.474334 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb62fcc-e0b7-4811-9d9b-653d6759dbf7 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:17:49.478882 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c41c9e-028a-444a-839c-e62ac1bd3598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:17:49.479480 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c41c9e-028a-444a-839c-e62ac1bd3598 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:17:49.479758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c41c9e-028a-444a-839c-e62ac1bd3598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:17:49.480041 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c41c9e-028a-444a-839c-e62ac1bd3598 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:17:49.480657 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c41c9e-028a-444a-839c-e62ac1bd3598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:17:49.482309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c41c9e-028a-444a-839c-e62ac1bd3598 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:17:49.483534 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:17:49.497398 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4577/9147] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 02:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 02:17:49.498571 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1b10c-2c6a-420d-84cf-03b9bfcd3947 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:17:49.509094 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1b10c-2c6a-420d-84cf-03b9bfcd3947 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:17:49.514780 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753439b1-e4c4-4776-821d-ad0db2162268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:17:49.515443 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753439b1-e4c4-4776-821d-ad0db2162268 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:17:49.515721 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753439b1-e4c4-4776-821d-ad0db2162268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:17:49.515995 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753439b1-e4c4-4776-821d-ad0db2162268 admin admin] PATH_INFO: `/v3/projects/ab1d016ad5884611b549f1c4bab4fc9c/users/07f9c9c06c534b7cab9fb13d51e43fb1/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:17:49.532538 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753439b1-e4c4-4776-821d-ad0db2162268 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab1d016ad5884611b549f1c4bab4fc9c, user_id=07f9c9c06c534b7cab9fb13d51e43fb1, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:17:49.535355 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753439b1-e4c4-4776-821d-ad0db2162268 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:17:49.549420 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4571/9148] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 02:17:49 2022] PUT /identity/v3/projects/ab1d016ad5884611b549f1c4bab4fc9c/users/07f9c9c06c534b7cab9fb13d51e43fb1/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 02:17:49.553557 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c41c9e-028a-444a-839c-e62ac1bd3598 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:17:49.563711 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c41c9e-028a-444a-839c-e62ac1bd3598 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:17:49.619856 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee59693-152f-4e74-b547-f9c656d7a0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:17:49.620461 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee59693-152f-4e74-b547-f9c656d7a0a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:17:49.620741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee59693-152f-4e74-b547-f9c656d7a0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:17:49.621014 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee59693-152f-4e74-b547-f9c656d7a0a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:17:49.621685 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee59693-152f-4e74-b547-f9c656d7a0a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:17:49.623275 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee59693-152f-4e74-b547-f9c656d7a0a4 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:17:49.632849 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4578/9149] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 02:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 02:17:49.637062 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753439b1-e4c4-4776-821d-ad0db2162268 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:17:49.648170 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753439b1-e4c4-4776-821d-ad0db2162268 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:17:49.653475 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034e2bb-084b-413d-b6da-257afc51c3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:17:49.654121 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034e2bb-084b-413d-b6da-257afc51c3f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:17:49.654514 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034e2bb-084b-413d-b6da-257afc51c3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:17:49.654798 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034e2bb-084b-413d-b6da-257afc51c3f3 admin admin] PATH_INFO: `/v3/projects/ab1d016ad5884611b549f1c4bab4fc9c/users/07f9c9c06c534b7cab9fb13d51e43fb1/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:17:49.656711 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0034e2bb-084b-413d-b6da-257afc51c3f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab1d016ad5884611b549f1c4bab4fc9c, user_id=07f9c9c06c534b7cab9fb13d51e43fb1, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:17:49.659379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0034e2bb-084b-413d-b6da-257afc51c3f3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:17:49.670317 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4572/9150] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 02:17:49 2022] PUT /identity/v3/projects/ab1d016ad5884611b549f1c4bab4fc9c/users/07f9c9c06c534b7cab9fb13d51e43fb1/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 02:17:54.318039 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d2b75-f5ea-49e0-927a-371f052c257a None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:17:54.319120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d2b75-f5ea-49e0-927a-371f052c257a None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:17:54.319120 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d2b75-f5ea-49e0-927a-371f052c257a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:17:54.492237 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-879d2b75-f5ea-49e0-927a-371f052c257a None None] MFA Rules not processed for user `07f9c9c06c534b7cab9fb13d51e43fb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:17:54.493470 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-879d2b75-f5ea-49e0-927a-371f052c257a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:17:54.563492 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4579/9151] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 02:17:54 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:17:54.579700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034e2bb-084b-413d-b6da-257afc51c3f3 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:17:54.581658 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0034e2bb-084b-413d-b6da-257afc51c3f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:17:54.658787 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034e2bb-084b-413d-b6da-257afc51c3f3 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:17:54.664646 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad900105-e1f9-47a1-bcb3-e567787796f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:17:54.665302 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad900105-e1f9-47a1-bcb3-e567787796f8 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:17:54.665688 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad900105-e1f9-47a1-bcb3-e567787796f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:17:54.665969 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad900105-e1f9-47a1-bcb3-e567787796f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:17:54.687320 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:17:54.726496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad900105-e1f9-47a1-bcb3-e567787796f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:17:54.728109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad900105-e1f9-47a1-bcb3-e567787796f8 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:17:54.737074 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4573/9152] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:17:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:17:55.737000 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f13158-8c22-4099-9fc8-dffb32d45521 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:17:55.737566 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f13158-8c22-4099-9fc8-dffb32d45521 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:17:55.737669 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f13158-8c22-4099-9fc8-dffb32d45521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:17:55.757107 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-46f13158-8c22-4099-9fc8-dffb32d45521 None None] MFA Rules not processed for user `14c4b5dff8ce43139a4054ffca98774e`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:17:55.758580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-46f13158-8c22-4099-9fc8-dffb32d45521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:17:55.766065 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4580/9153] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 02:17:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:17:56.113887 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad900105-e1f9-47a1-bcb3-e567787796f8 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:17:56.171763 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad900105-e1f9-47a1-bcb3-e567787796f8 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:17:56.175441 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e933c-fcd2-4970-abac-4540201374f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:17:56.176052 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e933c-fcd2-4970-abac-4540201374f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:17:56.176329 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e933c-fcd2-4970-abac-4540201374f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:17:56.176600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e933c-fcd2-4970-abac-4540201374f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:17:56.178872 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-987e933c-fcd2-4970-abac-4540201374f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:17:56.188657 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e933c-fcd2-4970-abac-4540201374f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:17:56.190131 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e933c-fcd2-4970-abac-4540201374f8 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:17:56.198753 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4574/9154] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:17:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:18:05.751377 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=68 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:18:06.195152 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=43 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:18:06.700407 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f13158-8c22-4099-9fc8-dffb32d45521 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:18:06.713752 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f13158-8c22-4099-9fc8-dffb32d45521 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:18:06.719048 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b73bb4-de82-45ee-9457-b7a7226f0e90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:18:06.719650 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b73bb4-de82-45ee-9457-b7a7226f0e90 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:18:06.719935 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b73bb4-de82-45ee-9457-b7a7226f0e90 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:18:06.720206 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b73bb4-de82-45ee-9457-b7a7226f0e90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:18:06.721929 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d0b73bb4-de82-45ee-9457-b7a7226f0e90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:18:06.733805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b73bb4-de82-45ee-9457-b7a7226f0e90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:18:06.735385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b73bb4-de82-45ee-9457-b7a7226f0e90 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:18:06.746969 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4581/9155] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:18:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:18:09.678746 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e933c-fcd2-4970-abac-4540201374f8 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:18:09.687283 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e933c-fcd2-4970-abac-4540201374f8 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:18:09.691295 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8048a2-fd5c-431b-9303-8029bd812379 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:18:09.691896 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8048a2-fd5c-431b-9303-8029bd812379 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:18:09.692203 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8048a2-fd5c-431b-9303-8029bd812379 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:18:09.692473 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8048a2-fd5c-431b-9303-8029bd812379 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:18:09.702618 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8048a2-fd5c-431b-9303-8029bd812379 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:18:09.704054 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8048a2-fd5c-431b-9303-8029bd812379 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:18:09.714829 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4575/9156] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:18:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:18:16.742922 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:18:19.710293 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=6 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:19:18.897797 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b73bb4-de82-45ee-9457-b7a7226f0e90 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:19:18.910015 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b73bb4-de82-45ee-9457-b7a7226f0e90 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:19:18.913594 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11f2a6-cf10-4f6e-bf39-70a41a8295f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:19:18.914189 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11f2a6-cf10-4f6e-bf39-70a41a8295f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:19:18.914466 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11f2a6-cf10-4f6e-bf39-70a41a8295f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:19:18.914741 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11f2a6-cf10-4f6e-bf39-70a41a8295f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:19:18.916411 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-fb11f2a6-cf10-4f6e-bf39-70a41a8295f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:19:18.935809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11f2a6-cf10-4f6e-bf39-70a41a8295f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:19:18.937216 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11f2a6-cf10-4f6e-bf39-70a41a8295f2 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:19:18.945632 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4582/9157] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:19:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:19:28.941590 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=12 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:20:37.975849 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8048a2-fd5c-431b-9303-8029bd812379 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:20:37.977250 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-2a8048a2-fd5c-431b-9303-8029bd812379 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:20:38.057156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8048a2-fd5c-431b-9303-8029bd812379 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:20:38.060709 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea591d0-cdcb-4613-883f-71aeb5adc1f5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efcee9b21ea94b1b8e5c9c5acb35839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:20:38.061305 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea591d0-cdcb-4613-883f-71aeb5adc1f5 service glance] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:20:38.061683 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea591d0-cdcb-4613-883f-71aeb5adc1f5 service glance] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:20:38.061953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea591d0-cdcb-4613-883f-71aeb5adc1f5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:20:38.063641 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-7ea591d0-cdcb-4613-883f-71aeb5adc1f5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:20:38.095738 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea591d0-cdcb-4613-883f-71aeb5adc1f5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:20:38.097221 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea591d0-cdcb-4613-883f-71aeb5adc1f5 service glance] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:20:38.108190 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4576/9158] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:20:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:20:38.291380 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11f2a6-cf10-4f6e-bf39-70a41a8295f2 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:20:38.300406 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11f2a6-cf10-4f6e-bf39-70a41a8295f2 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:20:38.304763 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3058f-ee6b-4fda-8716-42153fd43daf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:20:38.305393 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3058f-ee6b-4fda-8716-42153fd43daf service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:20:38.305702 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3058f-ee6b-4fda-8716-42153fd43daf service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:20:38.305972 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3058f-ee6b-4fda-8716-42153fd43daf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:20:38.307680 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d4b3058f-ee6b-4fda-8716-42153fd43daf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:20:38.324665 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3058f-ee6b-4fda-8716-42153fd43daf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:20:38.326099 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3058f-ee6b-4fda-8716-42153fd43daf service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:20:38.336709 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4583/9159] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:20:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:20:48.103489 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=46 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:20:48.331879 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:20:54.456849 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7950c6-710c-4974-9269-fb00274597cf None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:20:54.457289 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7950c6-710c-4974-9269-fb00274597cf None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:20:54.457412 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7950c6-710c-4974-9269-fb00274597cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:20:54.512068 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-ba7950c6-710c-4974-9269-fb00274597cf None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:20:54.513267 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-ba7950c6-710c-4974-9269-fb00274597cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:20:54.576515 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4577/9160] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 02:20:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:20:54.622313 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3058f-ee6b-4fda-8716-42153fd43daf service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:20:54.623739 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d4b3058f-ee6b-4fda-8716-42153fd43daf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:20:54.711869 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3058f-ee6b-4fda-8716-42153fd43daf service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:20:54.716714 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fd11e-66cd-4d29-bb73-c4422ee2523a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:20:54.717308 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fd11e-66cd-4d29-bb73-c4422ee2523a service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:20:54.717615 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fd11e-66cd-4d29-bb73-c4422ee2523a service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:20:54.717880 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fd11e-66cd-4d29-bb73-c4422ee2523a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:20:54.725664 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75fd11e-66cd-4d29-bb73-c4422ee2523a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:20:54.727213 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75fd11e-66cd-4d29-bb73-c4422ee2523a service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:20:54.735039 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4584/9161] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 02:20:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 02:21:04.573697 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=40 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:21:04.732003 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=41 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:21:07.359703 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe4e77-eeb8-4d83-874b-e9e9edac17b3 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:21:07.360219 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe4e77-eeb8-4d83-874b-e9e9edac17b3 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:21:07.360340 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe4e77-eeb8-4d83-874b-e9e9edac17b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:21:07.381324 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-dbbe4e77-eeb8-4d83-874b-e9e9edac17b3 None None] MFA Rules not processed for user `13f0f341bf2c475d82b4e7b34d503dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:21:07.382640 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-dbbe4e77-eeb8-4d83-874b-e9e9edac17b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:21:07.392500 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4578/9162] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Sep 4 02:21:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:21:07.404367 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fd11e-66cd-4d29-bb73-c4422ee2523a service swift] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:21:07.413540 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fd11e-66cd-4d29-bb73-c4422ee2523a service swift] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:21:07.417106 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49441e1f-7736-49e2-bf54-cee9e454b331 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efcee9b21ea94b1b8e5c9c5acb35839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:21:07.417745 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49441e1f-7736-49e2-bf54-cee9e454b331 service glance] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:21:07.418024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49441e1f-7736-49e2-bf54-cee9e454b331 service glance] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:21:07.418293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49441e1f-7736-49e2-bf54-cee9e454b331 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:21:07.428705 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49441e1f-7736-49e2-bf54-cee9e454b331 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:21:07.430152 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49441e1f-7736-49e2-bf54-cee9e454b331 service glance] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:21:07.442151 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4585/9163] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:21:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:21:07.510374 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe4e77-eeb8-4d83-874b-e9e9edac17b3 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:21:07.511788 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-dbbe4e77-eeb8-4d83-874b-e9e9edac17b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:21:07.524222 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe4e77-eeb8-4d83-874b-e9e9edac17b3 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:21:07.527784 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623cb2ec-2f71-46c8-9a7c-58f0c011766e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:21:07.528376 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cb2ec-2f71-46c8-9a7c-58f0c011766e service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:21:07.528659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cb2ec-2f71-46c8-9a7c-58f0c011766e service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:21:07.528928 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cb2ec-2f71-46c8-9a7c-58f0c011766e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:21:07.530601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-623cb2ec-2f71-46c8-9a7c-58f0c011766e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:21:07.539589 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623cb2ec-2f71-46c8-9a7c-58f0c011766e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:21:07.541000 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623cb2ec-2f71-46c8-9a7c-58f0c011766e service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:21:07.548561 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4579/9164] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:21:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:21:08.633758 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49441e1f-7736-49e2-bf54-cee9e454b331 service glance] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:21:08.643116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49441e1f-7736-49e2-bf54-cee9e454b331 service glance] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:21:08.647222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbceca8c-431f-43a0-abd7-9a41eff27d9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:21:08.647818 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbceca8c-431f-43a0-abd7-9a41eff27d9a service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:21:08.648100 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbceca8c-431f-43a0-abd7-9a41eff27d9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:21:08.648367 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbceca8c-431f-43a0-abd7-9a41eff27d9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:21:08.650299 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-bbceca8c-431f-43a0-abd7-9a41eff27d9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:21:08.670546 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbceca8c-431f-43a0-abd7-9a41eff27d9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:21:08.672023 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbceca8c-431f-43a0-abd7-9a41eff27d9a service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:21:08.683646 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4586/9165] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:21:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:21:08.743914 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623cb2ec-2f71-46c8-9a7c-58f0c011766e service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:21:08.745393 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-623cb2ec-2f71-46c8-9a7c-58f0c011766e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:21:08.814322 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623cb2ec-2f71-46c8-9a7c-58f0c011766e service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:21:08.819826 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408edc9e-f539-4ce4-adf3-1def0bf64d16 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:21:08.820438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408edc9e-f539-4ce4-adf3-1def0bf64d16 service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:21:08.820718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408edc9e-f539-4ce4-adf3-1def0bf64d16 service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:21:08.820990 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408edc9e-f539-4ce4-adf3-1def0bf64d16 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:21:08.822701 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-408edc9e-f539-4ce4-adf3-1def0bf64d16 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:21:08.834354 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408edc9e-f539-4ce4-adf3-1def0bf64d16 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:21:08.835939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408edc9e-f539-4ce4-adf3-1def0bf64d16 service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:21:08.845485 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4580/9166] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:21:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 02:21:12.729201 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbceca8c-431f-43a0-abd7-9a41eff27d9a service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:21:12.737815 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbceca8c-431f-43a0-abd7-9a41eff27d9a service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:21:12.742076 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246bddb-53a3-4440-8800-bacac3a9401f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:21:12.742696 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246bddb-53a3-4440-8800-bacac3a9401f service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:21:12.742972 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246bddb-53a3-4440-8800-bacac3a9401f service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:21:12.743242 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246bddb-53a3-4440-8800-bacac3a9401f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:21:12.744937 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-6246bddb-53a3-4440-8800-bacac3a9401f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:21:12.754409 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246bddb-53a3-4440-8800-bacac3a9401f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:21:12.755812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246bddb-53a3-4440-8800-bacac3a9401f service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:21:12.763521 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4587/9167] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:21:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:21:14.219566 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ab7de-5b85-4a9b-a12d-dfb401474614 None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:21:14.220068 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ab7de-5b85-4a9b-a12d-dfb401474614 None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:21:14.220168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ab7de-5b85-4a9b-a12d-dfb401474614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:21:14.240069 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-a48ab7de-5b85-4a9b-a12d-dfb401474614 None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:21:14.241281 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-a48ab7de-5b85-4a9b-a12d-dfb401474614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:21:14.248483 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4581/9168] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 02:21:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:21:14.261007 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246bddb-53a3-4440-8800-bacac3a9401f service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:21:14.273711 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246bddb-53a3-4440-8800-bacac3a9401f service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:21:14.278694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e1fac-847a-4cc4-ac89-6fd4600aaa39 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:21:14.279295 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e1fac-847a-4cc4-ac89-6fd4600aaa39 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:21:14.279575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e1fac-847a-4cc4-ac89-6fd4600aaa39 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:21:14.279848 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e1fac-847a-4cc4-ac89-6fd4600aaa39 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:21:14.289940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e1fac-847a-4cc4-ac89-6fd4600aaa39 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:21:14.291652 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e1fac-847a-4cc4-ac89-6fd4600aaa39 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:21:14.302294 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4588/9169] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 02:21:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 02:21:22.437883 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ab7de-5b85-4a9b-a12d-dfb401474614 None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:21:22.459915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ab7de-5b85-4a9b-a12d-dfb401474614 None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:21:22.465692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0353276-82ae-4921-97af-26e0b4230561 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:21:22.466372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0353276-82ae-4921-97af-26e0b4230561 service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:21:22.466662 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0353276-82ae-4921-97af-26e0b4230561 service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:21:22.466944 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0353276-82ae-4921-97af-26e0b4230561 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:21:22.468921 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b0353276-82ae-4921-97af-26e0b4230561 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:21:22.503060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0353276-82ae-4921-97af-26e0b4230561 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:21:22.505202 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0353276-82ae-4921-97af-26e0b4230561 service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:21:22.515166 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4582/9170] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:21:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:21:24.299223 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=24 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:21:27.673138 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89678e24-eda7-4099-8d8d-e730338d68ae None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:21:27.673795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89678e24-eda7-4099-8d8d-e730338d68ae None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:21:27.673795 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89678e24-eda7-4099-8d8d-e730338d68ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:21:27.693305 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-89678e24-eda7-4099-8d8d-e730338d68ae None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:21:27.694556 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-89678e24-eda7-4099-8d8d-e730338d68ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:21:27.701861 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4589/9171] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 02:21:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:21:27.714087 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0353276-82ae-4921-97af-26e0b4230561 service placement] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:21:27.725670 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0353276-82ae-4921-97af-26e0b4230561 service placement] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:21:27.730694 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b81812-27af-4454-9e4e-912ce25854f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:21:27.731290 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b81812-27af-4454-9e4e-912ce25854f4 service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:21:27.731567 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b81812-27af-4454-9e4e-912ce25854f4 service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:21:27.731839 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b81812-27af-4454-9e4e-912ce25854f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:21:27.741060 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b81812-27af-4454-9e4e-912ce25854f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:21:27.742722 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b81812-27af-4454-9e4e-912ce25854f4 service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:21:27.751134 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4583/9172] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 02:21:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 02:21:37.688299 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:21:37.747820 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=68 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:22:23.198345 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89678e24-eda7-4099-8d8d-e730338d68ae None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:22:23.199780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-89678e24-eda7-4099-8d8d-e730338d68ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:22:23.214178 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89678e24-eda7-4099-8d8d-e730338d68ae None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:22:23.219155 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6352a13-6d0a-45ba-9595-4830aac22bcd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:22:23.219753 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6352a13-6d0a-45ba-9595-4830aac22bcd service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:22:23.220058 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6352a13-6d0a-45ba-9595-4830aac22bcd service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:22:23.220440 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6352a13-6d0a-45ba-9595-4830aac22bcd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:22:23.222116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d6352a13-6d0a-45ba-9595-4830aac22bcd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:22:23.233913 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6352a13-6d0a-45ba-9595-4830aac22bcd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:22:23.235504 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6352a13-6d0a-45ba-9595-4830aac22bcd service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:22:23.246052 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4590/9173] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:22:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:22:33.241999 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:22:38.729242 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b81812-27af-4454-9e4e-912ce25854f4 service swift] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:22:38.733126 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-30b81812-27af-4454-9e4e-912ce25854f4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:22:38.748901 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b81812-27af-4454-9e4e-912ce25854f4 service swift] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:22:38.754386 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759e56f-5e9b-4f42-922e-ecedecf7ca08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:22:38.756216 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759e56f-5e9b-4f42-922e-ecedecf7ca08 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:22:38.756500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759e56f-5e9b-4f42-922e-ecedecf7ca08 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:22:38.756777 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759e56f-5e9b-4f42-922e-ecedecf7ca08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:22:38.758548 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-f759e56f-5e9b-4f42-922e-ecedecf7ca08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:22:38.772979 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759e56f-5e9b-4f42-922e-ecedecf7ca08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:22:38.774659 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759e56f-5e9b-4f42-922e-ecedecf7ca08 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:22:38.786523 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4584/9174] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:22:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:22:43.630541 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c157d0c-db35-4fbd-b159-6deae57dcb3b None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:22:43.631038 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c157d0c-db35-4fbd-b159-6deae57dcb3b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:22:43.631165 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c157d0c-db35-4fbd-b159-6deae57dcb3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:22:43.650623 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-9c157d0c-db35-4fbd-b159-6deae57dcb3b None None] MFA Rules not processed for user `14c4b5dff8ce43139a4054ffca98774e`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:22:43.651812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-9c157d0c-db35-4fbd-b159-6deae57dcb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:22:43.658619 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4591/9175] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 02:22:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:22:48.781360 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=6 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:22:53.645831 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=3 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:22:54.518964 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759e56f-5e9b-4f42-922e-ecedecf7ca08 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:22:54.528890 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759e56f-5e9b-4f42-922e-ecedecf7ca08 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:22:54.532477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311ebc0-eee5-4911-a4bb-a3791fb06da1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efcee9b21ea94b1b8e5c9c5acb35839f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:22:54.533071 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311ebc0-eee5-4911-a4bb-a3791fb06da1 service glance] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:22:54.533347 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311ebc0-eee5-4911-a4bb-a3791fb06da1 service glance] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:22:54.533650 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311ebc0-eee5-4911-a4bb-a3791fb06da1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:22:54.541692 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311ebc0-eee5-4911-a4bb-a3791fb06da1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:22:54.543107 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311ebc0-eee5-4911-a4bb-a3791fb06da1 service glance] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:22:54.551681 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4585/9176] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:22:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:22:59.209185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c157d0c-db35-4fbd-b159-6deae57dcb3b None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:22:59.218847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c157d0c-db35-4fbd-b159-6deae57dcb3b None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:22:59.222412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89d23b-1f11-43f7-9850-bdde46a25ea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:22:59.223518 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89d23b-1f11-43f7-9850-bdde46a25ea2 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:22:59.223784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89d23b-1f11-43f7-9850-bdde46a25ea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:22:59.224055 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89d23b-1f11-43f7-9850-bdde46a25ea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:22:59.225776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-3b89d23b-1f11-43f7-9850-bdde46a25ea2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:22:59.248109 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b89d23b-1f11-43f7-9850-bdde46a25ea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:22:59.249545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b89d23b-1f11-43f7-9850-bdde46a25ea2 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:22:59.257231 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4592/9177] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:22:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:23:00.713113 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311ebc0-eee5-4911-a4bb-a3791fb06da1 service glance] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:23:00.724998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311ebc0-eee5-4911-a4bb-a3791fb06da1 service glance] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:23:00.729988 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251fd9a7-72aa-4eb1-a515-61e24d20965c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:23:00.730588 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fd9a7-72aa-4eb1-a515-61e24d20965c service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:23:00.730871 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fd9a7-72aa-4eb1-a515-61e24d20965c service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:23:00.731147 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fd9a7-72aa-4eb1-a515-61e24d20965c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:23:00.732867 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-251fd9a7-72aa-4eb1-a515-61e24d20965c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:23:00.744757 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251fd9a7-72aa-4eb1-a515-61e24d20965c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:23:00.746391 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251fd9a7-72aa-4eb1-a515-61e24d20965c service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:23:00.756014 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4586/9178] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:23:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:23:09.253835 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=11 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:23:10.752100 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=12 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:23:21.914744 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89d23b-1f11-43f7-9850-bdde46a25ea2 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:23:21.937366 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89d23b-1f11-43f7-9850-bdde46a25ea2 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:23:21.942846 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435a3d1-a88a-4a3f-a562-fca9ac43508c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:23:21.943451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435a3d1-a88a-4a3f-a562-fca9ac43508c service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:23:21.943731 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435a3d1-a88a-4a3f-a562-fca9ac43508c service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:23:21.944565 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435a3d1-a88a-4a3f-a562-fca9ac43508c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:23:21.952880 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435a3d1-a88a-4a3f-a562-fca9ac43508c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:23:21.954471 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435a3d1-a88a-4a3f-a562-fca9ac43508c service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:23:21.966204 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4593/9179] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:23:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:23:24.269605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251fd9a7-72aa-4eb1-a515-61e24d20965c service placement] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:23:24.279366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251fd9a7-72aa-4eb1-a515-61e24d20965c service placement] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:23:24.282898 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05ed4b-7ca7-40ce-8507-472c1d0ca2bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:23:24.283496 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05ed4b-7ca7-40ce-8507-472c1d0ca2bf service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:23:24.283773 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05ed4b-7ca7-40ce-8507-472c1d0ca2bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:23:24.284050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05ed4b-7ca7-40ce-8507-472c1d0ca2bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:23:24.293520 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c05ed4b-7ca7-40ce-8507-472c1d0ca2bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:23:24.294946 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c05ed4b-7ca7-40ce-8507-472c1d0ca2bf service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:23:24.304208 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4587/9180] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:23:24 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:23:31.961607 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=9 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:23:34.300205 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=6 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:24:21.895309 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435a3d1-a88a-4a3f-a562-fca9ac43508c service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:24:21.904683 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435a3d1-a88a-4a3f-a562-fca9ac43508c service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:24:21.908244 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e0977-f5c7-4ae7-a3ec-f229043748fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:24:21.908840 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e0977-f5c7-4ae7-a3ec-f229043748fe service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:24:21.909118 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e0977-f5c7-4ae7-a3ec-f229043748fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:24:21.909389 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e0977-f5c7-4ae7-a3ec-f229043748fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:24:21.916328 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e0977-f5c7-4ae7-a3ec-f229043748fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:24:21.917789 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e0977-f5c7-4ae7-a3ec-f229043748fe service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:24:21.925489 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4594/9181] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:24:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:24:31.922149 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:25:38.557972 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05ed4b-7ca7-40ce-8507-472c1d0ca2bf service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:25:38.571492 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05ed4b-7ca7-40ce-8507-472c1d0ca2bf service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:25:38.575506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5c57e-766b-4b9b-a1d3-6f36746f8187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:25:38.576442 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5c57e-766b-4b9b-a1d3-6f36746f8187 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:25:38.576993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5c57e-766b-4b9b-a1d3-6f36746f8187 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:25:38.577491 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5c57e-766b-4b9b-a1d3-6f36746f8187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:25:38.590686 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5c57e-766b-4b9b-a1d3-6f36746f8187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:25:38.592381 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5c57e-766b-4b9b-a1d3-6f36746f8187 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:25:38.604114 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4588/9182] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:25:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:25:39.790876 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e0977-f5c7-4ae7-a3ec-f229043748fe service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:25:39.799453 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e0977-f5c7-4ae7-a3ec-f229043748fe service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:25:39.803402 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7704d5-df36-4a9c-8659-29afa311b034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:25:39.804696 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7704d5-df36-4a9c-8659-29afa311b034 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:25:39.805035 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7704d5-df36-4a9c-8659-29afa311b034 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:25:39.805426 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7704d5-df36-4a9c-8659-29afa311b034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:25:39.815805 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7704d5-df36-4a9c-8659-29afa311b034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:25:39.817298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7704d5-df36-4a9c-8659-29afa311b034 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:25:39.827954 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4595/9183] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:25:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:25:48.599466 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=6 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:25:49.823279 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=6 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:26:26.545600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5c57e-766b-4b9b-a1d3-6f36746f8187 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:26:26.567989 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5c57e-766b-4b9b-a1d3-6f36746f8187 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:26:26.573286 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a0438-cc40-409b-b2b8-f06cbcf19c4a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:26:26.574001 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a0438-cc40-409b-b2b8-f06cbcf19c4a service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:26:26.574293 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a0438-cc40-409b-b2b8-f06cbcf19c4a service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:26:26.574575 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a0438-cc40-409b-b2b8-f06cbcf19c4a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:26:26.583271 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a0438-cc40-409b-b2b8-f06cbcf19c4a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:26:26.584935 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a0438-cc40-409b-b2b8-f06cbcf19c4a service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:26:26.595539 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4589/9184] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:26:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:26:36.591363 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=10 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:27:18.991467 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7704d5-df36-4a9c-8659-29afa311b034 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:27:19.000287 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7704d5-df36-4a9c-8659-29afa311b034 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:27:19.003934 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bd412-c419-4a65-bdcd-8b73dc71006e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:27:19.004520 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bd412-c419-4a65-bdcd-8b73dc71006e service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:27:19.004801 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bd412-c419-4a65-bdcd-8b73dc71006e service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:27:19.005072 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bd412-c419-4a65-bdcd-8b73dc71006e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:27:19.067768 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913bd412-c419-4a65-bdcd-8b73dc71006e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:27:19.069293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913bd412-c419-4a65-bdcd-8b73dc71006e service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:27:19.078851 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4596/9185] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:27:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:27:22.288051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a0438-cc40-409b-b2b8-f06cbcf19c4a service placement] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:27:22.305077 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a0438-cc40-409b-b2b8-f06cbcf19c4a service placement] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:27:22.318506 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ac995-955d-4173-89ba-16d6a58a0c96 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:27:22.319366 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ac995-955d-4173-89ba-16d6a58a0c96 service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:27:22.319984 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ac995-955d-4173-89ba-16d6a58a0c96 service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:27:22.322303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ac995-955d-4173-89ba-16d6a58a0c96 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:27:22.326749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d26ac995-955d-4173-89ba-16d6a58a0c96 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:27:22.349008 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ac995-955d-4173-89ba-16d6a58a0c96 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:27:22.352229 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ac995-955d-4173-89ba-16d6a58a0c96 service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:27:22.361743 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4590/9186] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:27:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:27:25.226391 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bd412-c419-4a65-bdcd-8b73dc71006e service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:27:25.238643 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bd412-c419-4a65-bdcd-8b73dc71006e service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:27:25.244017 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a9f4a-1d7a-4878-bc73-19593e1d5465 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:27:25.244705 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a9f4a-1d7a-4878-bc73-19593e1d5465 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:27:25.245581 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a9f4a-1d7a-4878-bc73-19593e1d5465 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:27:25.245863 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a9f4a-1d7a-4878-bc73-19593e1d5465 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:27:25.247677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-548a9f4a-1d7a-4878-bc73-19593e1d5465 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:27:25.260357 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548a9f4a-1d7a-4878-bc73-19593e1d5465 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:27:25.262991 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548a9f4a-1d7a-4878-bc73-19593e1d5465 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:27:25.275754 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4597/9187] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:27:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:27:25.296580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ac995-955d-4173-89ba-16d6a58a0c96 service placement] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:27:25.308346 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ac995-955d-4173-89ba-16d6a58a0c96 service placement] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:27:25.313539 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b012c-b4d7-446f-b000-a8e15191124b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:27:25.314176 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b012c-b4d7-446f-b000-a8e15191124b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:27:25.314464 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b012c-b4d7-446f-b000-a8e15191124b admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:27:25.314749 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b012c-b4d7-446f-b000-a8e15191124b admin admin] PATH_INFO: `/v3/users/14c4b5dff8ce43139a4054ffca98774e` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:27:25.315939 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553b012c-b4d7-446f-b000-a8e15191124b admin admin] RBAC: Authorizing `identity:delete_user(user_id=14c4b5dff8ce43139a4054ffca98774e)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:27:25.317926 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553b012c-b4d7-446f-b000-a8e15191124b admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:27:25.382846 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-553b012c-b4d7-446f-b000-a8e15191124b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14c4b5dff8ce43139a4054ffca98774e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:27:25.383507 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-553b012c-b4d7-446f-b000-a8e15191124b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14c4b5dff8ce43139a4054ffca98774e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:27:25.390626 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-553b012c-b4d7-446f-b000-a8e15191124b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14c4b5dff8ce43139a4054ffca98774e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:27:25.398427 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-553b012c-b4d7-446f-b000-a8e15191124b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14c4b5dff8ce43139a4054ffca98774e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:27:25.399225 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-553b012c-b4d7-446f-b000-a8e15191124b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14c4b5dff8ce43139a4054ffca98774e'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:27:25.416305 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4591/9188] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 02:27:25 2022] DELETE /identity/v3/users/14c4b5dff8ce43139a4054ffca98774e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 02:27:25.592097 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a9f4a-1d7a-4878-bc73-19593e1d5465 service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:27:25.602632 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a9f4a-1d7a-4878-bc73-19593e1d5465 service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:27:25.664402 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdba29b-aaeb-4ce6-afe6-7fecc13e90ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:27:25.665027 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdba29b-aaeb-4ce6-afe6-7fecc13e90ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:27:25.665306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdba29b-aaeb-4ce6-afe6-7fecc13e90ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:27:25.665629 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdba29b-aaeb-4ce6-afe6-7fecc13e90ac admin admin] PATH_INFO: `/v3/projects/af8e868e7aea4b3e94d15ca49fa7fdf2` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:27:25.666726 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdba29b-aaeb-4ce6-afe6-7fecc13e90ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=af8e868e7aea4b3e94d15ca49fa7fdf2)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:27:25.669112 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdba29b-aaeb-4ce6-afe6-7fecc13e90ac admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:27:25.716276 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-acdba29b-aaeb-4ce6-afe6-7fecc13e90ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af8e868e7aea4b3e94d15ca49fa7fdf2', 'request_id': 'req-acdba29b-aaeb-4ce6-afe6-7fecc13e90ac'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:27:25.723051 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-acdba29b-aaeb-4ce6-afe6-7fecc13e90ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af8e868e7aea4b3e94d15ca49fa7fdf2', 'request_id': 'req-acdba29b-aaeb-4ce6-afe6-7fecc13e90ac'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:27:25.728653 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-acdba29b-aaeb-4ce6-afe6-7fecc13e90ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af8e868e7aea4b3e94d15ca49fa7fdf2', 'request_id': 'req-acdba29b-aaeb-4ce6-afe6-7fecc13e90ac'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:27:25.740243 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-acdba29b-aaeb-4ce6-afe6-7fecc13e90ac admin admin] The token cache is being invalidate because project af8e868e7aea4b3e94d15ca49fa7fdf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 02:27:25.740528 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-acdba29b-aaeb-4ce6-afe6-7fecc13e90ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:27:25.741186 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-acdba29b-aaeb-4ce6-afe6-7fecc13e90ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:27:25.742681 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4598/9189] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 02:27:25 2022] DELETE /identity/v3/projects/af8e868e7aea4b3e94d15ca49fa7fdf2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 02:27:25.746653 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b012c-b4d7-446f-b000-a8e15191124b admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:27:25.748083 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-553b012c-b4d7-446f-b000-a8e15191124b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:27:25.760830 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b012c-b4d7-446f-b000-a8e15191124b admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:27:25.817698 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ceea6-de7c-42de-8ddb-22513f4a3d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:27:25.818328 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ceea6-de7c-42de-8ddb-22513f4a3d6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:27:25.818607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ceea6-de7c-42de-8ddb-22513f4a3d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:27:25.818882 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ceea6-de7c-42de-8ddb-22513f4a3d6a admin admin] PATH_INFO: `/v3/users/07f9c9c06c534b7cab9fb13d51e43fb1` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:27:25.820015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ceea6-de7c-42de-8ddb-22513f4a3d6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=07f9c9c06c534b7cab9fb13d51e43fb1)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:27:25.821993 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ceea6-de7c-42de-8ddb-22513f4a3d6a admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:27:25.868399 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c55ceea6-de7c-42de-8ddb-22513f4a3d6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07f9c9c06c534b7cab9fb13d51e43fb1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:27:25.869055 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c55ceea6-de7c-42de-8ddb-22513f4a3d6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07f9c9c06c534b7cab9fb13d51e43fb1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:27:25.876367 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c55ceea6-de7c-42de-8ddb-22513f4a3d6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07f9c9c06c534b7cab9fb13d51e43fb1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:27:25.880219 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:27:25.884303 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c55ceea6-de7c-42de-8ddb-22513f4a3d6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07f9c9c06c534b7cab9fb13d51e43fb1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:27:25.885379 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-c55ceea6-de7c-42de-8ddb-22513f4a3d6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07f9c9c06c534b7cab9fb13d51e43fb1'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:27:25.904208 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4592/9190] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 02:27:25 2022] DELETE /identity/v3/users/07f9c9c06c534b7cab9fb13d51e43fb1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 02:27:26.077236 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdba29b-aaeb-4ce6-afe6-7fecc13e90ac admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:27:26.078868 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-acdba29b-aaeb-4ce6-afe6-7fecc13e90ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:27:26.092050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdba29b-aaeb-4ce6-afe6-7fecc13e90ac admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:27:26.100850 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:27:26.156408 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acaadb7-6030-4663-be40-e4d0fecacc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:27:26.157498 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acaadb7-6030-4663-be40-e4d0fecacc1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:27:26.158965 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acaadb7-6030-4663-be40-e4d0fecacc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:27:26.159804 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acaadb7-6030-4663-be40-e4d0fecacc1e admin admin] PATH_INFO: `/v3/projects/ab1d016ad5884611b549f1c4bab4fc9c` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:27:26.161953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acaadb7-6030-4663-be40-e4d0fecacc1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab1d016ad5884611b549f1c4bab4fc9c)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:27:26.164223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acaadb7-6030-4663-be40-e4d0fecacc1e admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:27:26.183803 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ceea6-de7c-42de-8ddb-22513f4a3d6a admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:27:26.185273 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c55ceea6-de7c-42de-8ddb-22513f4a3d6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:27:26.220450 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6acaadb7-6030-4663-be40-e4d0fecacc1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab1d016ad5884611b549f1c4bab4fc9c', 'request_id': 'req-6acaadb7-6030-4663-be40-e4d0fecacc1e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:27:26.229887 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6acaadb7-6030-4663-be40-e4d0fecacc1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab1d016ad5884611b549f1c4bab4fc9c', 'request_id': 'req-6acaadb7-6030-4663-be40-e4d0fecacc1e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:27:26.239429 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6acaadb7-6030-4663-be40-e4d0fecacc1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab1d016ad5884611b549f1c4bab4fc9c', 'request_id': 'req-6acaadb7-6030-4663-be40-e4d0fecacc1e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:27:26.252793 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6acaadb7-6030-4663-be40-e4d0fecacc1e admin admin] The token cache is being invalidate because project ab1d016ad5884611b549f1c4bab4fc9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 02:27:26.253010 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6acaadb7-6030-4663-be40-e4d0fecacc1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:27:26.253892 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-6acaadb7-6030-4663-be40-e4d0fecacc1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:27:26.255393 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4599/9191] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 02:27:26 2022] DELETE /identity/v3/projects/ab1d016ad5884611b549f1c4bab4fc9c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 02:27:26.260169 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f46cb-750f-47c1-bc66-11a3734cbb02 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:27:26.260445 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f46cb-750f-47c1-bc66-11a3734cbb02 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:27:26.261237 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f46cb-750f-47c1-bc66-11a3734cbb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:27:26.271092 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ceea6-de7c-42de-8ddb-22513f4a3d6a admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:27:26.291677 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-222f46cb-750f-47c1-bc66-11a3734cbb02 None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:27:26.293163 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-222f46cb-750f-47c1-bc66-11a3734cbb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:27:26.332680 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e17828-fc6b-4ba3-9243-97dea3b2b80e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:27:26.333301 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e17828-fc6b-4ba3-9243-97dea3b2b80e service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:27:26.333613 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e17828-fc6b-4ba3-9243-97dea3b2b80e service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:27:26.333889 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e17828-fc6b-4ba3-9243-97dea3b2b80e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:27:26.335730 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-72e17828-fc6b-4ba3-9243-97dea3b2b80e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:27:26.347076 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e17828-fc6b-4ba3-9243-97dea3b2b80e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:27:26.348739 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e17828-fc6b-4ba3-9243-97dea3b2b80e service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:27:26.349894 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4600/9192] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 02:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 02:27:26.358262 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a4b89-15ad-4f61-9045-8238e30654cc None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:27:26.358547 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a4b89-15ad-4f61-9045-8238e30654cc None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:27:26.358819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a4b89-15ad-4f61-9045-8238e30654cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:27:26.359444 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4593/9193] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:27:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 02:27:26.378819 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-390a4b89-15ad-4f61-9045-8238e30654cc None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:27:26.380066 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-390a4b89-15ad-4f61-9045-8238e30654cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:27:26.387932 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4601/9194] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 02:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 04 02:27:26.392110 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e17828-fc6b-4ba3-9243-97dea3b2b80e service placement] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:27:26.402882 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e17828-fc6b-4ba3-9243-97dea3b2b80e service placement] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:27:26.407823 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacf302-7a66-4819-bd71-a98e815e6778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:27:26.408440 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacf302-7a66-4819-bd71-a98e815e6778 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:27:26.408719 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacf302-7a66-4819-bd71-a98e815e6778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:27:26.409015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacf302-7a66-4819-bd71-a98e815e6778 admin admin] PATH_INFO: `/v3/domains` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:27:26.409748 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bacf302-7a66-4819-bd71-a98e815e6778 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81824) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 04 02:27:26.410043 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bacf302-7a66-4819-bd71-a98e815e6778 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:27:26.411758 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bacf302-7a66-4819-bd71-a98e815e6778 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:27:26.425254 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4594/9195] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Sep 4 02:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 04 02:27:26.429871 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a4b89-15ad-4f61-9045-8238e30654cc None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:27:26.440170 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a4b89-15ad-4f61-9045-8238e30654cc None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:27:26.445575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec26a68-cb61-4080-a97d-279c905232d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:27:26.446191 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec26a68-cb61-4080-a97d-279c905232d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:27:26.446469 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec26a68-cb61-4080-a97d-279c905232d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:27:26.446738 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec26a68-cb61-4080-a97d-279c905232d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:27:26.447529 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec26a68-cb61-4080-a97d-279c905232d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:27:26.449478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec26a68-cb61-4080-a97d-279c905232d9 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:27:26.477340 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4602/9196] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 02:27:26 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 02:27:26.482319 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacf302-7a66-4819-bd71-a98e815e6778 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:27:26.492410 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacf302-7a66-4819-bd71-a98e815e6778 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:27:26.544492 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:27:26.551194 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d2a5a-38c0-418f-91ee-991a96f78489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:27:26.552015 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d2a5a-38c0-418f-91ee-991a96f78489 admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:27:26.552307 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d2a5a-38c0-418f-91ee-991a96f78489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:27:26.552738 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d2a5a-38c0-418f-91ee-991a96f78489 admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:27:26.553564 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d2a5a-38c0-418f-91ee-991a96f78489 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:27:26.555518 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d2a5a-38c0-418f-91ee-991a96f78489 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:27:26.575589 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4595/9197] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 02:27:26 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 02:27:26.580028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec26a68-cb61-4080-a97d-279c905232d9 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:27:26.586695 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:27:26.591068 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec26a68-cb61-4080-a97d-279c905232d9 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:27:26.597158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b6656-b845-47cb-9dd4-46545f88157a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:27:26.598024 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b6656-b845-47cb-9dd4-46545f88157a admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:27:26.598487 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b6656-b845-47cb-9dd4-46545f88157a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:27:26.598917 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b6656-b845-47cb-9dd4-46545f88157a admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:27:26.599591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b6656-b845-47cb-9dd4-46545f88157a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:27:26.601206 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b6656-b845-47cb-9dd4-46545f88157a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:27:26.611825 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4603/9198] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 02:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 02:27:26.615816 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d2a5a-38c0-418f-91ee-991a96f78489 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:27:26.625948 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d2a5a-38c0-418f-91ee-991a96f78489 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:27:26.630618 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933c68c-a822-48e2-8053-17f4a7861fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:27:26.631244 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933c68c-a822-48e2-8053-17f4a7861fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:27:26.631527 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933c68c-a822-48e2-8053-17f4a7861fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:27:26.631803 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933c68c-a822-48e2-8053-17f4a7861fa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:27:26.632454 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933c68c-a822-48e2-8053-17f4a7861fa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:27:26.634087 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933c68c-a822-48e2-8053-17f4a7861fa3 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:27:26.649943 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4596/9199] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 02:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 02:27:26.654534 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b6656-b845-47cb-9dd4-46545f88157a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:27:26.664575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b6656-b845-47cb-9dd4-46545f88157a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:27:26.669971 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb82e87-8aeb-48ec-80f3-a95416047930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:27:26.670618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb82e87-8aeb-48ec-80f3-a95416047930 admin admin] REQUEST_METHOD: `PUT` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:27:26.670900 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb82e87-8aeb-48ec-80f3-a95416047930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:27:26.671174 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb82e87-8aeb-48ec-80f3-a95416047930 admin admin] PATH_INFO: `/v3/projects/a972c0c8084d4e148fb8642fea036312/users/8bfdd2c363f64f008a4509927d8bfa1e/roles/7c1abe5c3a82479484ec5a104ec31f8f` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:27:26.685611 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb82e87-8aeb-48ec-80f3-a95416047930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a972c0c8084d4e148fb8642fea036312, user_id=8bfdd2c363f64f008a4509927d8bfa1e, role_id=7c1abe5c3a82479484ec5a104ec31f8f)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:27:26.688247 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb82e87-8aeb-48ec-80f3-a95416047930 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:27:26.701080 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4604/9200] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 02:27:26 2022] PUT /identity/v3/projects/a972c0c8084d4e148fb8642fea036312/users/8bfdd2c363f64f008a4509927d8bfa1e/roles/7c1abe5c3a82479484ec5a104ec31f8f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 02:27:26.706311 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a7c56-9255-42f4-aa02-d40d6de9486f None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:27:26.706605 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a7c56-9255-42f4-aa02-d40d6de9486f None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:27:26.706882 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a7c56-9255-42f4-aa02-d40d6de9486f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:27:26.726053 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-396a7c56-9255-42f4-aa02-d40d6de9486f None None] MFA Rules not processed for user `b3da54db0785474cb38733cf09ad01a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:27:26.727252 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-396a7c56-9255-42f4-aa02-d40d6de9486f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:27:26.785780 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4597/9201] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 02:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:27:26.796451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb82e87-8aeb-48ec-80f3-a95416047930 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:27:26.798139 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-aeb82e87-8aeb-48ec-80f3-a95416047930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:27:26.853575 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb82e87-8aeb-48ec-80f3-a95416047930 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:27:26.857159 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5e817-0a2c-4506-a279-2a1fb71feac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:27:26.857784 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5e817-0a2c-4506-a279-2a1fb71feac4 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:27:26.858060 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5e817-0a2c-4506-a279-2a1fb71feac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:27:26.858330 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5e817-0a2c-4506-a279-2a1fb71feac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:27:26.867147 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5e817-0a2c-4506-a279-2a1fb71feac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:27:26.868553 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5e817-0a2c-4506-a279-2a1fb71feac4 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:27:26.878945 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4605/9202] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:27:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:27:31.406228 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a521776-d497-4127-8461-2e2fb123c80c None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:27:31.406760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a521776-d497-4127-8461-2e2fb123c80c None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:27:31.406760 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a521776-d497-4127-8461-2e2fb123c80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:27:31.434900 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-3a521776-d497-4127-8461-2e2fb123c80c None None] MFA Rules not processed for user `8bfdd2c363f64f008a4509927d8bfa1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:27:31.436264 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3a521776-d497-4127-8461-2e2fb123c80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:27:31.516634 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4598/9203] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 02:27:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:27:31.522287 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5e817-0a2c-4506-a279-2a1fb71feac4 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:27:31.532851 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5e817-0a2c-4506-a279-2a1fb71feac4 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:27:31.537822 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f9e9a-8ab2-4d3b-9a1c-9495dddf1070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:27:31.538545 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f9e9a-8ab2-4d3b-9a1c-9495dddf1070 admin admin] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:27:31.538856 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f9e9a-8ab2-4d3b-9a1c-9495dddf1070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:27:31.539132 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f9e9a-8ab2-4d3b-9a1c-9495dddf1070 admin admin] PATH_INFO: `/v3/projects` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:27:31.539778 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f9e9a-8ab2-4d3b-9a1c-9495dddf1070 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:27:31.541790 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f9e9a-8ab2-4d3b-9a1c-9495dddf1070 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:27:31.568512 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4606/9204] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Sep 4 02:27:31 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 02:27:31.572503 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a521776-d497-4127-8461-2e2fb123c80c None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:27:31.583765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a521776-d497-4127-8461-2e2fb123c80c None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:27:31.640124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a8c4e-d939-4bc0-86ef-4371097bd9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:27:31.640737 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a8c4e-d939-4bc0-86ef-4371097bd9bb admin admin] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:27:31.641023 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a8c4e-d939-4bc0-86ef-4371097bd9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:27:31.641301 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a8c4e-d939-4bc0-86ef-4371097bd9bb admin admin] PATH_INFO: `/v3/users` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:27:31.641989 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a8c4e-d939-4bc0-86ef-4371097bd9bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:27:31.643953 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a8c4e-d939-4bc0-86ef-4371097bd9bb admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:27:31.655948 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:27:31.666789 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4599/9205] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Sep 4 02:27:31 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 04 02:27:31.670776 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f9e9a-8ab2-4d3b-9a1c-9495dddf1070 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:27:31.681003 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f9e9a-8ab2-4d3b-9a1c-9495dddf1070 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:27:31.686098 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d413f-b502-4c23-8f67-60609c5b2cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:27:31.686697 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d413f-b502-4c23-8f67-60609c5b2cdc admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:27:31.686976 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d413f-b502-4c23-8f67-60609c5b2cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:27:31.687301 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d413f-b502-4c23-8f67-60609c5b2cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:27:31.687953 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d413f-b502-4c23-8f67-60609c5b2cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:27:31.689605 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d413f-b502-4c23-8f67-60609c5b2cdc admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:27:31.700854 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4607/9206] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 02:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 02:27:31.705109 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a8c4e-d939-4bc0-86ef-4371097bd9bb admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:27:31.715477 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a8c4e-d939-4bc0-86ef-4371097bd9bb admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:27:31.720294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343593c-7d00-4a4d-8d84-00b2c2b13489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:27:31.720955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343593c-7d00-4a4d-8d84-00b2c2b13489 admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:27:31.721235 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343593c-7d00-4a4d-8d84-00b2c2b13489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:27:31.721547 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343593c-7d00-4a4d-8d84-00b2c2b13489 admin admin] PATH_INFO: `/v3/projects/112f884850c34ddd875e893a52e896ad/users/41c1584c77f940ebb92bdfa5504338ab/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:27:31.736683 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343593c-7d00-4a4d-8d84-00b2c2b13489 admin admin] RBAC: Authorizing `identity:create_grant(project_id=112f884850c34ddd875e893a52e896ad, user_id=41c1584c77f940ebb92bdfa5504338ab, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:27:31.739373 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343593c-7d00-4a4d-8d84-00b2c2b13489 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:27:31.752698 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4600/9207] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 02:27:31 2022] PUT /identity/v3/projects/112f884850c34ddd875e893a52e896ad/users/41c1584c77f940ebb92bdfa5504338ab/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 02:27:31.756694 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d413f-b502-4c23-8f67-60609c5b2cdc admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:27:31.767415 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d413f-b502-4c23-8f67-60609c5b2cdc admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:27:31.822478 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db0cbb-9002-4440-a3f4-c9fffbdb282d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:27:31.823588 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db0cbb-9002-4440-a3f4-c9fffbdb282d admin admin] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:27:31.823870 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db0cbb-9002-4440-a3f4-c9fffbdb282d admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:27:31.824179 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db0cbb-9002-4440-a3f4-c9fffbdb282d admin admin] PATH_INFO: `/v3/roles` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:27:31.824817 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db0cbb-9002-4440-a3f4-c9fffbdb282d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:27:31.826439 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db0cbb-9002-4440-a3f4-c9fffbdb282d admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:27:31.836255 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4608/9208] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Sep 4 02:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 04 02:27:31.842555 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343593c-7d00-4a4d-8d84-00b2c2b13489 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:27:31.853853 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343593c-7d00-4a4d-8d84-00b2c2b13489 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:27:31.858699 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892ad64-b8f3-4bac-98d7-334ee52dd95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:27:31.859341 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892ad64-b8f3-4bac-98d7-334ee52dd95d admin admin] REQUEST_METHOD: `PUT` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:27:31.859622 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892ad64-b8f3-4bac-98d7-334ee52dd95d admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:27:31.859893 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892ad64-b8f3-4bac-98d7-334ee52dd95d admin admin] PATH_INFO: `/v3/projects/112f884850c34ddd875e893a52e896ad/users/41c1584c77f940ebb92bdfa5504338ab/roles/d255b03c37d64371a148ec4e11be01d9` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:27:31.861838 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892ad64-b8f3-4bac-98d7-334ee52dd95d admin admin] RBAC: Authorizing `identity:create_grant(project_id=112f884850c34ddd875e893a52e896ad, user_id=41c1584c77f940ebb92bdfa5504338ab, role_id=d255b03c37d64371a148ec4e11be01d9)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:27:31.864461 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892ad64-b8f3-4bac-98d7-334ee52dd95d admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:27:31.875311 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4601/9209] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Sep 4 02:27:31 2022] PUT /identity/v3/projects/112f884850c34ddd875e893a52e896ad/users/41c1584c77f940ebb92bdfa5504338ab/roles/d255b03c37d64371a148ec4e11be01d9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 02:27:36.446693 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704300c-ab1a-4f81-98c6-68f55460b55b None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:27:36.447511 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704300c-ab1a-4f81-98c6-68f55460b55b None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:27:36.448360 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704300c-ab1a-4f81-98c6-68f55460b55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:27:36.490028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-1704300c-ab1a-4f81-98c6-68f55460b55b None None] MFA Rules not processed for user `41c1584c77f940ebb92bdfa5504338ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:27:36.491556 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-1704300c-ab1a-4f81-98c6-68f55460b55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:27:36.520913 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:27:36.576664 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4609/9210] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 02:27:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:27:36.591260 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892ad64-b8f3-4bac-98d7-334ee52dd95d admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:27:36.592560 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3892ad64-b8f3-4bac-98d7-334ee52dd95d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:27:36.702443 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892ad64-b8f3-4bac-98d7-334ee52dd95d admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:27:36.708396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e170db-408f-46c5-a762-9275ba2eeca4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:27:36.709372 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e170db-408f-46c5-a762-9275ba2eeca4 service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:27:36.709851 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e170db-408f-46c5-a762-9275ba2eeca4 service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:27:36.710294 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e170db-408f-46c5-a762-9275ba2eeca4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:27:36.776156 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e170db-408f-46c5-a762-9275ba2eeca4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:27:36.778164 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e170db-408f-46c5-a762-9275ba2eeca4 service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:27:36.787947 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4602/9211] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:27:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:27:37.778663 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577995ee-f29f-43f2-9409-34e90eb09890 None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:27:37.779181 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577995ee-f29f-43f2-9409-34e90eb09890 None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:27:37.779277 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577995ee-f29f-43f2-9409-34e90eb09890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:27:37.797973 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-577995ee-f29f-43f2-9409-34e90eb09890 None None] MFA Rules not processed for user `8bfdd2c363f64f008a4509927d8bfa1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:27:37.799166 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-577995ee-f29f-43f2-9409-34e90eb09890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:27:37.806026 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4610/9212] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 02:27:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:27:41.116580 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e170db-408f-46c5-a762-9275ba2eeca4 service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:27:41.118179 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-d3e170db-408f-46c5-a762-9275ba2eeca4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:27:41.143172 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e170db-408f-46c5-a762-9275ba2eeca4 service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:27:41.149904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacca26-c136-4ff3-8f7d-ea42989d7f3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:27:41.151432 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacca26-c136-4ff3-8f7d-ea42989d7f3d service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:27:41.151904 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacca26-c136-4ff3-8f7d-ea42989d7f3d service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:27:41.152374 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacca26-c136-4ff3-8f7d-ea42989d7f3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:27:41.157117 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-5bacca26-c136-4ff3-8f7d-ea42989d7f3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:27:41.172211 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bacca26-c136-4ff3-8f7d-ea42989d7f3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:27:41.173895 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bacca26-c136-4ff3-8f7d-ea42989d7f3d service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:27:41.188296 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4603/9213] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:27:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 02:27:47.793118 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=21 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:27:49.389702 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577995ee-f29f-43f2-9409-34e90eb09890 None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:27:49.458979 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577995ee-f29f-43f2-9409-34e90eb09890 None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:27:49.462667 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a38a7-ea62-4ea0-af96-dff98eb39bec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:27:49.463940 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a38a7-ea62-4ea0-af96-dff98eb39bec service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:27:49.464222 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a38a7-ea62-4ea0-af96-dff98eb39bec service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:27:49.464490 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a38a7-ea62-4ea0-af96-dff98eb39bec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:27:49.473560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a38a7-ea62-4ea0-af96-dff98eb39bec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:27:49.475022 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a38a7-ea62-4ea0-af96-dff98eb39bec service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:27:49.484573 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4611/9214] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:27:49 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:27:51.180210 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=88,keystone:INSERT=2 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:27:59.480404 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=30 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:29:26.894426 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacca26-c136-4ff3-8f7d-ea42989d7f3d service nova] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:29:26.904620 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacca26-c136-4ff3-8f7d-ea42989d7f3d service nova] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:29:26.908257 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f756d1-9825-4fd9-90c0-70b4a3fc61af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:29:26.908860 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f756d1-9825-4fd9-90c0-70b4a3fc61af service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:29:26.909141 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f756d1-9825-4fd9-90c0-70b4a3fc61af service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:29:26.909416 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f756d1-9825-4fd9-90c0-70b4a3fc61af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:29:26.911182 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-77f756d1-9825-4fd9-90c0-70b4a3fc61af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:29:26.932004 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f756d1-9825-4fd9-90c0-70b4a3fc61af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:29:26.933502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f756d1-9825-4fd9-90c0-70b4a3fc61af service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:29:26.941216 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4604/9215] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:29:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:29:36.937802 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=10 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:30:23.950412 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a38a7-ea62-4ea0-af96-dff98eb39bec service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:30:23.963315 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a38a7-ea62-4ea0-af96-dff98eb39bec service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:30:23.968809 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a892ddb-d4f5-44fb-bf1c-91748abbcd17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:30:23.969414 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a892ddb-d4f5-44fb-bf1c-91748abbcd17 service nova] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:30:23.969751 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a892ddb-d4f5-44fb-bf1c-91748abbcd17 service nova] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:30:23.970022 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a892ddb-d4f5-44fb-bf1c-91748abbcd17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:30:23.971777 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7a892ddb-d4f5-44fb-bf1c-91748abbcd17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:30:23.984497 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a892ddb-d4f5-44fb-bf1c-91748abbcd17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:30:23.986104 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a892ddb-d4f5-44fb-bf1c-91748abbcd17 service nova] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:30:23.997200 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4612/9216] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:30:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 04 02:30:26.545544 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16674d-979f-40f2-a4d0-099f5ddfe3ed None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:30:26.546020 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16674d-979f-40f2-a4d0-099f5ddfe3ed None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:30:26.546124 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16674d-979f-40f2-a4d0-099f5ddfe3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:30:26.578926 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-9c16674d-979f-40f2-a4d0-099f5ddfe3ed None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:30:26.580119 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9c16674d-979f-40f2-a4d0-099f5ddfe3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:30:26.635891 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4605/9217] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 02:30:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:30:26.688177 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a892ddb-d4f5-44fb-bf1c-91748abbcd17 service nova] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:30:26.689596 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7a892ddb-d4f5-44fb-bf1c-91748abbcd17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:30:26.757951 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a892ddb-d4f5-44fb-bf1c-91748abbcd17 service nova] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:30:26.763384 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5d726-f84e-47c9-a820-0840fe85baa1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:30:26.763983 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5d726-f84e-47c9-a820-0840fe85baa1 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:30:26.764261 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5d726-f84e-47c9-a820-0840fe85baa1 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:30:26.764530 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5d726-f84e-47c9-a820-0840fe85baa1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:30:26.772698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e5d726-f84e-47c9-a820-0840fe85baa1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:30:26.774293 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e5d726-f84e-47c9-a820-0840fe85baa1 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:30:26.782903 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4613/9218] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 02:30:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 02:30:35.801037 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c050d12-4e64-4f08-b4b5-97a3e247dcab None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:30:35.801595 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c050d12-4e64-4f08-b4b5-97a3e247dcab None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:30:35.801708 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c050d12-4e64-4f08-b4b5-97a3e247dcab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:30:35.821066 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-3c050d12-4e64-4f08-b4b5-97a3e247dcab None None] MFA Rules not processed for user `8bfdd2c363f64f008a4509927d8bfa1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:30:35.822327 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3c050d12-4e64-4f08-b4b5-97a3e247dcab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:30:35.829138 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4606/9219] 10.222.0.30 () {58 vars in 958 bytes} [Sun Sep 4 02:30:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:30:36.160126 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5d726-f84e-47c9-a820-0840fe85baa1 service swift] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:30:36.169856 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5d726-f84e-47c9-a820-0840fe85baa1 service swift] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:30:36.173375 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec0679-2988-49be-ba19-d5f28ba01df3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:30:36.173994 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec0679-2988-49be-ba19-d5f28ba01df3 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:30:36.174271 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec0679-2988-49be-ba19-d5f28ba01df3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:30:36.174540 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec0679-2988-49be-ba19-d5f28ba01df3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:30:36.176369 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-ffec0679-2988-49be-ba19-d5f28ba01df3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:30:36.186113 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec0679-2988-49be-ba19-d5f28ba01df3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:30:36.187593 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec0679-2988-49be-ba19-d5f28ba01df3 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:30:36.195608 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4614/9220] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:30:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:30:36.537732 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c050d12-4e64-4f08-b4b5-97a3e247dcab None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:30:36.539185 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3c050d12-4e64-4f08-b4b5-97a3e247dcab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:30:36.612735 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c050d12-4e64-4f08-b4b5-97a3e247dcab None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:30:36.618061 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f584ca3-830c-499c-b5b1-5748bb3aae68 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:30:36.618678 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f584ca3-830c-499c-b5b1-5748bb3aae68 service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:30:36.618955 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f584ca3-830c-499c-b5b1-5748bb3aae68 service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:30:36.619862 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f584ca3-830c-499c-b5b1-5748bb3aae68 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:30:36.621633 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-1f584ca3-830c-499c-b5b1-5748bb3aae68 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:30:36.632740 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f584ca3-830c-499c-b5b1-5748bb3aae68 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:30:36.634345 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f584ca3-830c-499c-b5b1-5748bb3aae68 service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:30:36.643982 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4607/9221] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:30:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:30:38.011608 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4dbe6-3b2a-407f-83e3-bd53452c0afd None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:30:38.012580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4dbe6-3b2a-407f-83e3-bd53452c0afd None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:30:38.012867 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4dbe6-3b2a-407f-83e3-bd53452c0afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:30:38.034550 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-7ea4dbe6-3b2a-407f-83e3-bd53452c0afd None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:30:38.035786 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7ea4dbe6-3b2a-407f-83e3-bd53452c0afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:30:38.044091 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4615/9222] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 02:30:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:30:38.057251 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f584ca3-830c-499c-b5b1-5748bb3aae68 service placement] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:30:38.077247 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f584ca3-830c-499c-b5b1-5748bb3aae68 service placement] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:30:38.098432 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34712653-bc88-4470-a968-a46672a89c7f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:30:38.099050 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34712653-bc88-4470-a968-a46672a89c7f service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:30:38.099332 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34712653-bc88-4470-a968-a46672a89c7f service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:30:38.099607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34712653-bc88-4470-a968-a46672a89c7f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:30:38.109700 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34712653-bc88-4470-a968-a46672a89c7f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:30:38.111396 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34712653-bc88-4470-a968-a46672a89c7f service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:30:38.120503 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4608/9223] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 02:30:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 02:30:38.816552 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea4dbe6-3b2a-407f-83e3-bd53452c0afd None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:30:38.818075 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-7ea4dbe6-3b2a-407f-83e3-bd53452c0afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:30:38.833288 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea4dbe6-3b2a-407f-83e3-bd53452c0afd None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:30:38.837020 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a95ea-bce6-4759-a1ae-126c5e8465e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:30:38.837663 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a95ea-bce6-4759-a1ae-126c5e8465e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:30:38.838535 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a95ea-bce6-4759-a1ae-126c5e8465e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:30:38.838808 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a95ea-bce6-4759-a1ae-126c5e8465e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:30:38.840548 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-d84a95ea-bce6-4759-a1ae-126c5e8465e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:30:38.869131 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a95ea-bce6-4759-a1ae-126c5e8465e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:30:38.870889 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a95ea-bce6-4759-a1ae-126c5e8465e6 service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:30:38.896232 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4616/9224] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:30:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:30:41.277463 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34712653-bc88-4470-a968-a46672a89c7f service swift] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:30:41.287552 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34712653-bc88-4470-a968-a46672a89c7f service swift] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:30:41.291394 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968f60f-86aa-400a-95b2-167985029853 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:30:41.292010 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968f60f-86aa-400a-95b2-167985029853 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:30:41.292288 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968f60f-86aa-400a-95b2-167985029853 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:30:41.292600 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968f60f-86aa-400a-95b2-167985029853 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:30:41.294718 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-c968f60f-86aa-400a-95b2-167985029853 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:30:41.309265 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968f60f-86aa-400a-95b2-167985029853 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:30:41.310745 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968f60f-86aa-400a-95b2-167985029853 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:30:41.322700 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4609/9225] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:30:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:30:46.156278 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a95ea-bce6-4759-a1ae-126c5e8465e6 service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:30:46.166812 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a95ea-bce6-4759-a1ae-126c5e8465e6 service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:30:46.170813 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbeb17-18d3-4ce3-a303-32020356e1cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:30:46.171439 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbeb17-18d3-4ce3-a303-32020356e1cb service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:30:46.171743 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbeb17-18d3-4ce3-a303-32020356e1cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:30:46.172028 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbeb17-18d3-4ce3-a303-32020356e1cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:30:46.173898 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-69cbeb17-18d3-4ce3-a303-32020356e1cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:30:46.184361 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbeb17-18d3-4ce3-a303-32020356e1cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:30:46.185814 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbeb17-18d3-4ce3-a303-32020356e1cb service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:30:46.194206 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4617/9226] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:30:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:30:51.317003 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=81 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:30:55.083987 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968f60f-86aa-400a-95b2-167985029853 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:30:55.096149 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968f60f-86aa-400a-95b2-167985029853 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:30:55.102766 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1e6e1-489b-42df-bfa9-adefc51b127d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f0f341bf2c475d82b4e7b34d503dd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:30:55.103946 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1e6e1-489b-42df-bfa9-adefc51b127d service nova] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:30:55.104237 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1e6e1-489b-42df-bfa9-adefc51b127d service nova] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:30:55.104503 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1e6e1-489b-42df-bfa9-adefc51b127d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:30:55.106233 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-b2d1e6e1-489b-42df-bfa9-adefc51b127d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:30:55.118500 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1e6e1-489b-42df-bfa9-adefc51b127d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:30:55.120074 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1e6e1-489b-42df-bfa9-adefc51b127d service nova] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:30:55.130284 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4610/9227] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:30:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:30:56.190440 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=67 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:31:05.126070 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=6 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:31:33.588042 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbeb17-18d3-4ce3-a303-32020356e1cb service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:31:33.589494 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-69cbeb17-18d3-4ce3-a303-32020356e1cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:31:33.632283 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbeb17-18d3-4ce3-a303-32020356e1cb service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:31:33.637423 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e867da9-8637-439d-9f44-fd783e934512 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:31:33.638050 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e867da9-8637-439d-9f44-fd783e934512 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:31:33.638328 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e867da9-8637-439d-9f44-fd783e934512 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:31:33.638599 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e867da9-8637-439d-9f44-fd783e934512 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:31:33.640282 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-5e867da9-8637-439d-9f44-fd783e934512 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:31:33.651385 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e867da9-8637-439d-9f44-fd783e934512 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:31:33.652943 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e867da9-8637-439d-9f44-fd783e934512 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:31:33.662401 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4618/9228] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:31:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:31:43.658432 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=18 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:32:18.958866 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5c670-17bf-43b0-ab04-b62f50efff3b None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:32:18.959425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5c670-17bf-43b0-ab04-b62f50efff3b None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:32:18.959425 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5c670-17bf-43b0-ab04-b62f50efff3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:32:19.012184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-00a5c670-17bf-43b0-ab04-b62f50efff3b None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:32:19.013414 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-00a5c670-17bf-43b0-ab04-b62f50efff3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:32:19.030739 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4611/9229] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Sep 4 02:32:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:32:19.072521 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e867da9-8637-439d-9f44-fd783e934512 service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:32:19.092728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e867da9-8637-439d-9f44-fd783e934512 service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:32:19.097698 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ff10c-edb4-4ac3-86a1-08ea228d3ad1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:32:19.098291 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ff10c-edb4-4ac3-86a1-08ea228d3ad1 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:32:19.098570 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ff10c-edb4-4ac3-86a1-08ea228d3ad1 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:32:19.098839 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ff10c-edb4-4ac3-86a1-08ea228d3ad1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:32:19.107204 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ff10c-edb4-4ac3-86a1-08ea228d3ad1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:32:19.108755 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ff10c-edb4-4ac3-86a1-08ea228d3ad1 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:32:19.116593 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4619/9230] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 02:32:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 02:32:28.334368 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724915d-54b2-4bd1-812d-94a23ccbd5ac None None] REQUEST_METHOD: `POST` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:32:28.334888 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724915d-54b2-4bd1-812d-94a23ccbd5ac None None] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:32:28.334998 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724915d-54b2-4bd1-812d-94a23ccbd5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:32:28.354645 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.auth.core [None req-9724915d-54b2-4bd1-812d-94a23ccbd5ac None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81824) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:32:28.355841 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9724915d-54b2-4bd1-812d-94a23ccbd5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:32:28.362939 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4612/9231] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 02:32:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:32:28.374911 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ff10c-edb4-4ac3-86a1-08ea228d3ad1 service swift] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:32:28.385185 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ff10c-edb4-4ac3-86a1-08ea228d3ad1 service swift] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:32:28.390326 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034b54b-b57d-4267-8ba8-17cec2379375 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:32:28.390925 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034b54b-b57d-4267-8ba8-17cec2379375 service swift] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:32:28.391205 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034b54b-b57d-4267-8ba8-17cec2379375 service swift] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:32:28.391506 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034b54b-b57d-4267-8ba8-17cec2379375 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:32:28.399870 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5034b54b-b57d-4267-8ba8-17cec2379375 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:32:28.401963 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5034b54b-b57d-4267-8ba8-17cec2379375 service swift] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:32:28.410155 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4620/9232] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 02:32:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 02:32:31.177868 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724915d-54b2-4bd1-812d-94a23ccbd5ac None None] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:32:31.190287 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724915d-54b2-4bd1-812d-94a23ccbd5ac None None] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:32:31.195175 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18e3d1-4d97-42a5-8022-de95bf7c87b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:32:31.195805 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18e3d1-4d97-42a5-8022-de95bf7c87b9 service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:32:31.196085 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18e3d1-4d97-42a5-8022-de95bf7c87b9 service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:32:31.196357 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18e3d1-4d97-42a5-8022-de95bf7c87b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:32:31.205495 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad18e3d1-4d97-42a5-8022-de95bf7c87b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:32:31.207168 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad18e3d1-4d97-42a5-8022-de95bf7c87b9 service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:32:31.217559 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4613/9233] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:32:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:32:33.233745 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d95ab-c7b1-4aa1-831a-349c2c3b5afd None None] REQUEST_METHOD: `POST` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:32:33.234209 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d95ab-c7b1-4aa1-831a-349c2c3b5afd None None] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:32:33.234306 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d95ab-c7b1-4aa1-831a-349c2c3b5afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:32:33.253852 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.auth.core [None req-b71d95ab-c7b1-4aa1-831a-349c2c3b5afd None None] MFA Rules not processed for user `00543899e82647e8ba187b8d0b60d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 04 02:32:33.255056 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-b71d95ab-c7b1-4aa1-831a-349c2c3b5afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:32:33.262218 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4621/9234] 10.222.0.30 () {58 vars in 967 bytes} [Sun Sep 4 02:32:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 04 02:32:33.274223 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18e3d1-4d97-42a5-8022-de95bf7c87b9 service placement] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:32:33.285184 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18e3d1-4d97-42a5-8022-de95bf7c87b9 service placement] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:32:33.290387 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628bc3a7-127b-4422-8b91-06418a182c94 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bcc7a857fad4310896da5a87e71baed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:32:33.291502 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628bc3a7-127b-4422-8b91-06418a182c94 service swift] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:32:33.291781 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628bc3a7-127b-4422-8b91-06418a182c94 service swift] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:32:33.292051 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628bc3a7-127b-4422-8b91-06418a182c94 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:32:33.300167 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628bc3a7-127b-4422-8b91-06418a182c94 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:32:33.301779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628bc3a7-127b-4422-8b91-06418a182c94 service swift] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:32:33.310356 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4614/9235] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Sep 4 02:32:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 04 02:32:36.969560 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d95ab-c7b1-4aa1-831a-349c2c3b5afd None None] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:32:36.979017 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d95ab-c7b1-4aa1-831a-349c2c3b5afd None None] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:32:36.982605 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f33bf9-dbff-48b0-807e-86d2cfc004aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:32:36.983234 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f33bf9-dbff-48b0-807e-86d2cfc004aa service neutron] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:32:36.983512 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f33bf9-dbff-48b0-807e-86d2cfc004aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:32:36.983783 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f33bf9-dbff-48b0-807e-86d2cfc004aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:32:36.991927 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f33bf9-dbff-48b0-807e-86d2cfc004aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:32:36.993346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f33bf9-dbff-48b0-807e-86d2cfc004aa service neutron] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:32:37.002436 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4622/9236] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:32:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:32:38.752073 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628bc3a7-127b-4422-8b91-06418a182c94 service swift] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:32:38.761309 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628bc3a7-127b-4422-8b91-06418a182c94 service swift] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:32:38.764765 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24103f-a203-49b7-b858-0ce00edbe4e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdde7a212954a01a2591ad5ac30d049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:32:38.765352 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24103f-a203-49b7-b858-0ce00edbe4e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:32:38.765672 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24103f-a203-49b7-b858-0ce00edbe4e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:32:38.765940 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24103f-a203-49b7-b858-0ce00edbe4e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:32:38.841466 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe24103f-a203-49b7-b858-0ce00edbe4e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:32:38.842933 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe24103f-a203-49b7-b858-0ce00edbe4e5 service neutron] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:32:38.866274 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4615/9237] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:32:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:32:41.763191 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f33bf9-dbff-48b0-807e-86d2cfc004aa service neutron] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:32:41.775356 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f33bf9-dbff-48b0-807e-86d2cfc004aa service neutron] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:32:41.780827 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd229b-fe86-4511-b947-982a13bc013c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:32:41.781372 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd229b-fe86-4511-b947-982a13bc013c service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:32:41.781713 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd229b-fe86-4511-b947-982a13bc013c service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:32:41.781985 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd229b-fe86-4511-b947-982a13bc013c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:32:41.783728 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-53cd229b-fe86-4511-b947-982a13bc013c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:32:41.795348 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd229b-fe86-4511-b947-982a13bc013c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:32:41.796909 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd229b-fe86-4511-b947-982a13bc013c service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:32:41.807559 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4623/9238] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:32:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:32:44.958782 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24103f-a203-49b7-b858-0ce00edbe4e5 service neutron] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:32:44.972365 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24103f-a203-49b7-b858-0ce00edbe4e5 service neutron] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:32:44.977779 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76294a-f6fa-4d46-84ca-8100bd6b0a1b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:32:44.978525 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76294a-f6fa-4d46-84ca-8100bd6b0a1b service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:32:44.978903 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76294a-f6fa-4d46-84ca-8100bd6b0a1b service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:32:44.979273 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76294a-f6fa-4d46-84ca-8100bd6b0a1b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:32:44.981593 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-dc76294a-f6fa-4d46-84ca-8100bd6b0a1b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:32:44.995438 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76294a-f6fa-4d46-84ca-8100bd6b0a1b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:32:44.997220 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76294a-f6fa-4d46-84ca-8100bd6b0a1b service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:32:45.010851 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4616/9239] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:32:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:32:45.038591 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd229b-fe86-4511-b947-982a13bc013c service placement] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:32:45.044900 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=32 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:32:45.051888 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd229b-fe86-4511-b947-982a13bc013c service placement] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:32:45.060997 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cea5ae-fc2b-495c-85a7-a9a8d77b4359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:32:45.061671 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cea5ae-fc2b-495c-85a7-a9a8d77b4359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:32:45.061950 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cea5ae-fc2b-495c-85a7-a9a8d77b4359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:32:45.062298 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cea5ae-fc2b-495c-85a7-a9a8d77b4359 admin admin] PATH_INFO: `/v3/users/8bfdd2c363f64f008a4509927d8bfa1e` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:32:45.063584 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cea5ae-fc2b-495c-85a7-a9a8d77b4359 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bfdd2c363f64f008a4509927d8bfa1e)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:32:45.065624 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cea5ae-fc2b-495c-85a7-a9a8d77b4359 admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:32:45.119580 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-20cea5ae-fc2b-495c-85a7-a9a8d77b4359 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bfdd2c363f64f008a4509927d8bfa1e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:32:45.120235 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-20cea5ae-fc2b-495c-85a7-a9a8d77b4359 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bfdd2c363f64f008a4509927d8bfa1e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:32:45.127157 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-20cea5ae-fc2b-495c-85a7-a9a8d77b4359 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bfdd2c363f64f008a4509927d8bfa1e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:32:45.152151 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-20cea5ae-fc2b-495c-85a7-a9a8d77b4359 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bfdd2c363f64f008a4509927d8bfa1e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:32:45.152839 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-20cea5ae-fc2b-495c-85a7-a9a8d77b4359 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bfdd2c363f64f008a4509927d8bfa1e'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:32:45.176291 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4624/9240] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 02:32:45 2022] DELETE /identity/v3/users/8bfdd2c363f64f008a4509927d8bfa1e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 02:32:45.350583 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76294a-f6fa-4d46-84ca-8100bd6b0a1b service placement] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:32:45.356311 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=78 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:32:45.367617 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76294a-f6fa-4d46-84ca-8100bd6b0a1b service placement] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:32:45.424926 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bc752-2f5c-4427-a9fb-d64c320ac001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:32:45.425585 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bc752-2f5c-4427-a9fb-d64c320ac001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:32:45.425868 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bc752-2f5c-4427-a9fb-d64c320ac001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:32:45.426143 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bc752-2f5c-4427-a9fb-d64c320ac001 admin admin] PATH_INFO: `/v3/projects/a972c0c8084d4e148fb8642fea036312` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:32:45.427245 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4bc752-2f5c-4427-a9fb-d64c320ac001 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a972c0c8084d4e148fb8642fea036312)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:32:45.429136 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4bc752-2f5c-4427-a9fb-d64c320ac001 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:32:45.474837 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0f4bc752-2f5c-4427-a9fb-d64c320ac001 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a972c0c8084d4e148fb8642fea036312', 'request_id': 'req-0f4bc752-2f5c-4427-a9fb-d64c320ac001'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:32:45.483304 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0f4bc752-2f5c-4427-a9fb-d64c320ac001 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a972c0c8084d4e148fb8642fea036312', 'request_id': 'req-0f4bc752-2f5c-4427-a9fb-d64c320ac001'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:32:45.489103 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0f4bc752-2f5c-4427-a9fb-d64c320ac001 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a972c0c8084d4e148fb8642fea036312', 'request_id': 'req-0f4bc752-2f5c-4427-a9fb-d64c320ac001'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:32:45.511549 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0f4bc752-2f5c-4427-a9fb-d64c320ac001 admin admin] The token cache is being invalidate because project a972c0c8084d4e148fb8642fea036312 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 02:32:45.511838 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0f4bc752-2f5c-4427-a9fb-d64c320ac001 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:32:45.512470 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-0f4bc752-2f5c-4427-a9fb-d64c320ac001 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:32:45.514000 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4617/9241] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 02:32:45 2022] DELETE /identity/v3/projects/a972c0c8084d4e148fb8642fea036312 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 02:32:45.518065 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cea5ae-fc2b-495c-85a7-a9a8d77b4359 admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:32:45.519451 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-20cea5ae-fc2b-495c-85a7-a9a8d77b4359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:32:45.533158 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cea5ae-fc2b-495c-85a7-a9a8d77b4359 admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:32:45.588619 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f6004-9350-490f-9ddc-eb7ddd11379a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:32:45.589250 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f6004-9350-490f-9ddc-eb7ddd11379a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:32:45.589571 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f6004-9350-490f-9ddc-eb7ddd11379a admin admin] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:32:45.589847 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f6004-9350-490f-9ddc-eb7ddd11379a admin admin] PATH_INFO: `/v3/users/41c1584c77f940ebb92bdfa5504338ab` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:32:45.590982 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f6004-9350-490f-9ddc-eb7ddd11379a admin admin] RBAC: Authorizing `identity:delete_user(user_id=41c1584c77f940ebb92bdfa5504338ab)` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:32:45.592916 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f6004-9350-490f-9ddc-eb7ddd11379a admin admin] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:32:45.636489 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2c1f6004-9350-490f-9ddc-eb7ddd11379a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41c1584c77f940ebb92bdfa5504338ab'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:32:45.637144 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2c1f6004-9350-490f-9ddc-eb7ddd11379a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41c1584c77f940ebb92bdfa5504338ab'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:32:45.644200 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2c1f6004-9350-490f-9ddc-eb7ddd11379a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41c1584c77f940ebb92bdfa5504338ab'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:32:45.652401 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2c1f6004-9350-490f-9ddc-eb7ddd11379a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41c1584c77f940ebb92bdfa5504338ab'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:32:45.653116 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.notifications [None req-2c1f6004-9350-490f-9ddc-eb7ddd11379a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41c1584c77f940ebb92bdfa5504338ab'} {{(pid=81825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:32:45.663163 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:32:45.672522 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4625/9242] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Sep 4 02:32:45 2022] DELETE /identity/v3/users/41c1584c77f940ebb92bdfa5504338ab => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 02:32:45.843940 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bc752-2f5c-4427-a9fb-d64c320ac001 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:32:45.845392 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-0f4bc752-2f5c-4427-a9fb-d64c320ac001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:32:45.863734 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bc752-2f5c-4427-a9fb-d64c320ac001 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:32:45.924458 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6118cc-1582-4e32-ad0b-cd21922810e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3da54db0785474cb38733cf09ad01a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6638e0942c764685b0292b0ca0b1b3e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:32:45.925084 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6118cc-1582-4e32-ad0b-cd21922810e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:32:45.925364 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6118cc-1582-4e32-ad0b-cd21922810e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:32:45.925667 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6118cc-1582-4e32-ad0b-cd21922810e9 admin admin] PATH_INFO: `/v3/projects/112f884850c34ddd875e893a52e896ad` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:32:45.926766 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6118cc-1582-4e32-ad0b-cd21922810e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=112f884850c34ddd875e893a52e896ad)` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:32:45.928671 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6118cc-1582-4e32-ad0b-cd21922810e9 admin admin] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:32:45.953398 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:32:45.977317 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9f6118cc-1582-4e32-ad0b-cd21922810e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '112f884850c34ddd875e893a52e896ad', 'request_id': 'req-9f6118cc-1582-4e32-ad0b-cd21922810e9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:32:45.984482 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9f6118cc-1582-4e32-ad0b-cd21922810e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '112f884850c34ddd875e893a52e896ad', 'request_id': 'req-9f6118cc-1582-4e32-ad0b-cd21922810e9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:32:45.990099 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9f6118cc-1582-4e32-ad0b-cd21922810e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '112f884850c34ddd875e893a52e896ad', 'request_id': 'req-9f6118cc-1582-4e32-ad0b-cd21922810e9'} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:32:46.000823 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9f6118cc-1582-4e32-ad0b-cd21922810e9 admin admin] The token cache is being invalidate because project 112f884850c34ddd875e893a52e896ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81824) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 04 02:32:46.001106 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9f6118cc-1582-4e32-ad0b-cd21922810e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:32:46.001743 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.notifications [None req-9f6118cc-1582-4e32-ad0b-cd21922810e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81824) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 04 02:32:46.003239 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4618/9243] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Sep 4 02:32:45 2022] DELETE /identity/v3/projects/112f884850c34ddd875e893a52e896ad => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 04 02:32:55.673655 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:DELETE=1,keystone:SELECT=2 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:32:55.997880 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=15,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:36:37.540542 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f6004-9350-490f-9ddc-eb7ddd11379a admin admin] Authenticating user token {{(pid=81825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:36:37.541996 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-2c1f6004-9350-490f-9ddc-eb7ddd11379a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:36:37.619904 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f6004-9350-490f-9ddc-eb7ddd11379a admin admin] Validating token access rules against request {{(pid=81825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:36:37.677508 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a607a-2856-4467-8ec6-ec1e434a4f91 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:36:37.678063 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a607a-2856-4467-8ec6-ec1e434a4f91 service placement] REQUEST_METHOD: `GET` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:36:37.678344 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a607a-2856-4467-8ec6-ec1e434a4f91 service placement] SCRIPT_NAME: `/identity` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:36:37.678618 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a607a-2856-4467-8ec6-ec1e434a4f91 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:36:37.680346 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.fernet_utils [None req-096a607a-2856-4467-8ec6-ec1e434a4f91 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:36:37.691223 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a607a-2856-4467-8ec6-ec1e434a4f91 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:36:37.692780 n-d-master-1 devstack@keystone.service[81825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a607a-2856-4467-8ec6-ec1e434a4f91 service placement] RBAC: Authorization granted {{(pid=81825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:36:37.702402 n-d-master-1 devstack@keystone.service[81825]: [pid: 81825|app: 0|req: 4626/9244] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:36:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:36:47.698461 n-d-master-1 devstack@keystone.service[81825]: DEBUG dbcounter [-] [81825] Writing DB stats keystone:SELECT=62 {{(pid=81825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 02:37:34.187559 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6118cc-1582-4e32-ad0b-cd21922810e9 admin admin] Authenticating user token {{(pid=81824) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 04 02:37:34.189601 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-9f6118cc-1582-4e32-ad0b-cd21922810e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:37:34.206208 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6118cc-1582-4e32-ad0b-cd21922810e9 admin admin] Validating token access rules against request {{(pid=81824) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 04 02:37:34.211453 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f9e27-562e-4072-a322-a05227ceb247 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f908fda75ef8440cb6a0ef9440127d6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40b24e92f8594ee08bd2a55f79e3b299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81824) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 04 02:37:34.212058 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f9e27-562e-4072-a322-a05227ceb247 service placement] REQUEST_METHOD: `GET` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 04 02:37:34.212337 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f9e27-562e-4072-a322-a05227ceb247 service placement] SCRIPT_NAME: `/identity` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 04 02:37:34.212607 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f9e27-562e-4072-a322-a05227ceb247 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81824) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 04 02:37:34.214331 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.fernet_utils [None req-3a3f9e27-562e-4072-a322-a05227ceb247 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81824) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 04 02:37:34.225915 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3f9e27-562e-4072-a322-a05227ceb247 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 04 02:37:34.227505 n-d-master-1 devstack@keystone.service[81824]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3f9e27-562e-4072-a322-a05227ceb247 service placement] RBAC: Authorization granted {{(pid=81824) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 04 02:37:34.238066 n-d-master-1 devstack@keystone.service[81824]: [pid: 81824|app: 0|req: 4619/9245] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Sep 4 02:37:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 04 02:37:44.233396 n-d-master-1 devstack@keystone.service[81824]: DEBUG dbcounter [-] [81824] Writing DB stats keystone:SELECT=6 {{(pid=81824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}